-- Logs begin at Wed 2022-10-05 16:45:09 UTC, end at Wed 2022-10-05 19:18:32 UTC. -- Oct 05 17:20:37.073203 n-d-835595-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 05 17:20:37.085780 n-d-835595-3 devstack@n-api.service[106322]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 5 17:20:37 2022] *** Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: nodename: n-d-835595-3 Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: machine: x86_64 Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: clock source: unix Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: pcre jit disabled Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: detected number of CPU cores: 4 Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: current working directory: / Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: detected binary path: /usr/bin/uwsgi-core Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: your processes number limit is 47680 Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: your memory page size is 4096 bytes Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: detected max file descriptor number: 2048 Oct 05 17:20:37.087787 n-d-835595-3 devstack@n-api.service[106322]: lock engine: pthread robust mutexes Oct 05 17:20:37.088756 n-d-835595-3 devstack@n-api.service[106322]: thunder lock: enabled Oct 05 17:20:37.088756 n-d-835595-3 devstack@n-api.service[106322]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 05 17:20:37.088756 n-d-835595-3 devstack@n-api.service[106322]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 05 17:20:37.126849 n-d-835595-3 devstack@n-api.service[106322]: Python main interpreter initialized at 0x563711fe59c0 Oct 05 17:20:37.126849 n-d-835595-3 devstack@n-api.service[106322]: python threads support enabled Oct 05 17:20:37.126849 n-d-835595-3 devstack@n-api.service[106322]: your server socket listen backlog is limited to 100 connections Oct 05 17:20:37.126849 n-d-835595-3 devstack@n-api.service[106322]: your mercy for graceful operations on workers is 90 seconds Oct 05 17:20:37.127219 n-d-835595-3 devstack@n-api.service[106322]: mapped 403077 bytes (393 KB) for 2 cores Oct 05 17:20:37.127219 n-d-835595-3 devstack@n-api.service[106322]: *** Operational MODE: preforking *** Oct 05 17:20:37.127515 n-d-835595-3 devstack@n-api.service[106322]: *** uWSGI is running in multiple interpreter mode *** Oct 05 17:20:37.127515 n-d-835595-3 devstack@n-api.service[106322]: spawned uWSGI master process (pid: 106322) Oct 05 17:20:37.127732 n-d-835595-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 05 17:20:37.128438 n-d-835595-3 devstack@n-api.service[106322]: spawned uWSGI worker 1 (pid: 106334, cores: 1) Oct 05 17:20:37.128636 n-d-835595-3 devstack@n-api.service[106322]: spawned uWSGI worker 2 (pid: 106335, cores: 1) Oct 05 17:20:37.128734 n-d-835595-3 devstack@n-api.service[106322]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 05 17:20:37.786082 n-d-835595-3 devstack@n-api.service[106335]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 17:20:37.786787 n-d-835595-3 devstack@n-api.service[106334]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 17:20:38.872689 n-d-835595-3 devstack@n-api.service[106335]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 17:20:38.872689 n-d-835595-3 devstack@n-api.service[106335]: from cryptography.utils import int_from_bytes Oct 05 17:20:38.873357 n-d-835595-3 devstack@n-api.service[106335]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 17:20:38.873357 n-d-835595-3 devstack@n-api.service[106335]: from cryptography.utils import int_from_bytes Oct 05 17:20:38.885680 n-d-835595-3 devstack@n-api.service[106334]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 17:20:38.885680 n-d-835595-3 devstack@n-api.service[106334]: from cryptography.utils import int_from_bytes Oct 05 17:20:38.886153 n-d-835595-3 devstack@n-api.service[106334]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 17:20:38.886153 n-d-835595-3 devstack@n-api.service[106334]: from cryptography.utils import int_from_bytes Oct 05 17:20:41.321321 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 17:20:41.321915 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 17:20:41.322070 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 17:20:41.322482 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 17:20:41.322738 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 17:20:41.323131 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.323457 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.323783 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.324100 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.324431 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.324753 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.324979 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 17:20:41.325378 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.325470 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 17:20:41.325557 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.325676 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.325767 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 17:20:41.325943 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.326114 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 17:20:41.326264 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.326519 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 17:20:41.326616 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-835595-3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.326911 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.327007 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.327219 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.327316 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.327532 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.327648 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.327842 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.327939 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.328163 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.328254 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.328474 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.328569 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.328782 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.328887 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.329108 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.329277 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.330543 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.330543 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.330787 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.330911 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.331042 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.331184 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-835595-3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.331315 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.331444 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.331580 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.331704 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.331836 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.331973 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.332103 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.332238 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.332367 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.332489 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.332615 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.332750 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.332879 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.333021 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.333149 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.333149 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-835595-3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.333460 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.333689 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.333813 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.333940 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.334072 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.334193 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.334343 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.334343 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.334584 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.334711 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.334831 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.334961 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.335099 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.335226 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.335427 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.335553 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.335685 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.335822 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.335955 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.336091 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.336215 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.336412 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.336552 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-835595-3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.336732 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.336868 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.337029 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.337168 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.337342 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.337476 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.337655 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.337784 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.337995 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.338147 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.338311 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.338438 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.338591 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.338731 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.338899 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.339031 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.339162 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.339295 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.339428 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.339599 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.339742 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.339922 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.340053 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.340241 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.340377 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.340571 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.340707 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.340838 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.340962 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.341161 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.341292 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.341457 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.341586 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.341783 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.341918 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.342054 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.342187 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.342398 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.342542 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.342672 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.342803 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.342925 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.343067 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.343254 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.343392 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.343581 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.343724 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.343882 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.344024 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.344155 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.344288 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.344411 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.344540 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.344668 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.344799 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.344996 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.345127 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.345304 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.345448 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.345656 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.345784 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.345916 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.346039 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.346202 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.346383 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.346522 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.346653 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.346837 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.346967 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.347150 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.347288 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.347431 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.347566 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.347760 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.347897 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.348102 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.348248 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.348374 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.348496 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.349002 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.349132 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.349350 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.349490 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.349743 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.349870 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.350005 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.350135 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.350257 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.350412 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.350602 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.350729 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.350911 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.351052 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.351231 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.351369 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.351542 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.351672 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.351849 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.351991 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.352123 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.352254 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.352446 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.352575 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.352752 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.352884 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.353051 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.353179 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.353363 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.353495 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.353680 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.353821 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.353968 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.354105 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.354234 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.354372 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.354514 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.354641 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.354853 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.354976 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.355162 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.355300 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.355473 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.355627 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.355831 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.355971 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.356095 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.356215 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.356335 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.356465 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.356656 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.356786 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.356953 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.357083 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.357271 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.357398 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.357581 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.357709 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.357890 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.358026 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.358163 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.358477 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.358477 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.358724 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.358848 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.358969 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.359090 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.359220 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.359404 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.359534 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.359712 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.359853 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.360008 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.360153 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.360313 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.360441 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.360628 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.360764 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.360935 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.361079 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.361240 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.361375 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.361557 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.361685 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.361863 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.362000 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.362161 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.362309 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.362500 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.362627 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.362810 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.362952 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.363107 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.363235 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.363419 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.363547 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.363720 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.363856 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.364030 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.364160 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.364335 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.364469 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.364696 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.364828 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.365014 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.365144 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.365319 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.365621 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.365769 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.365980 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.366107 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.366231 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.366533 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.366661 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.366851 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.366988 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.367142 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.367278 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.367456 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.367593 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.367746 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.367875 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.368080 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.368209 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.368440 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.368584 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.368698 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.368827 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.369007 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.369145 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.369323 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.369462 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.369634 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:20:41.369774 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.369972 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.370101 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.370321 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.370466 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.370672 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.370801 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.370993 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.371129 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.371318 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.371457 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.371650 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.371777 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.371968 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.372103 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.372288 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.372417 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.372601 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.372766 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.372900 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.373029 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.373225 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.373356 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.373535 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.373664 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.373851 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.373987 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.374169 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.374327 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.374516 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.374658 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.374852 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.374982 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.375173 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.375320 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.375496 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.375634 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.375812 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.375963 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.376162 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.376288 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.376411 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.376549 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.376726 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.376874 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.377065 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.377193 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.377379 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.377509 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.377692 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.377835 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.378018 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.378148 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.378334 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.378487 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.378673 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.378803 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.378979 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.379120 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.379299 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.379533 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.379658 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.379789 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.379913 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.380036 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.380244 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.380373 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.380575 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.380705 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.380885 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.381016 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.381207 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.381336 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.381523 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.381652 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.381836 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.381966 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.382151 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.382302 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.382480 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.382616 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.382803 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.382931 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.383116 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.383245 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.383430 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.383561 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.383739 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.383876 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.384052 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.384183 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.384370 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.384513 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.384667 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.384796 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.384987 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.385126 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.385309 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.385452 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.385607 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.385735 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.385928 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.386531 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.386685 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.386811 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.386934 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.387056 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.387179 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.387312 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.387436 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.387558 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.387687 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.387811 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.387939 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.388076 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.388212 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.388336 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.388336 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.388571 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.388719 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.388926 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.389054 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.389185 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.389323 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.389459 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.389592 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.389716 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.389901 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.390032 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.390216 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.390378 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.390547 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.390679 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.390871 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.391010 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.391183 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.391311 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.391497 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.391627 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.391801 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.391922 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.392119 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.392256 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.392435 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.392575 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.392729 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.392857 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.393048 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.393186 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.393360 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.393492 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.393679 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.393821 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.394002 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.394135 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.394355 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.394485 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.394652 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.394831 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.394961 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.395129 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.395260 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.396158 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.396306 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.396443 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.396593 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.396812 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.396946 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.397069 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.397191 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.397312 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.397450 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.397583 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.397708 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.397837 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.397960 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.398082 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.398212 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.398354 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.398479 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.398602 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.398739 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.398863 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.399088 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.399224 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.399364 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.399489 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.399619 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.399752 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.399877 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.399999 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.400122 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.400244 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.400408 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.400549 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.400676 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.400800 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.400923 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.401046 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.401176 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.401367 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.401526 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.401679 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.401810 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.402005 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.402144 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.402329 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.402493 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.402634 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.402759 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.402952 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.403092 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.403253 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.403390 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.403580 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.403746 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.403872 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.404005 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.404188 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.404326 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.404516 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.404650 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.404830 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.404966 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.405153 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.405278 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.405465 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.405598 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.405775 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.405916 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.406083 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.406208 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.406415 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.406558 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.406739 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.406945 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.407073 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.407205 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.407362 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.407490 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.407674 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.407802 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.407986 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.408111 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.408302 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.408427 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.408615 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.408749 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.408919 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.409059 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.409245 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.409371 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.409574 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.409709 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.409832 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.409954 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.410129 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.410258 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.410476 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.410611 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.410789 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.410924 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.411114 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.411250 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.411443 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.411579 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.411761 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.411888 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.412064 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.412203 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.412383 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.412508 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.412704 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.412831 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.413019 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.413155 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.413338 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.413478 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.413651 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.413776 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.413977 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.414124 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.414301 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.414430 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.414623 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.414749 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.414926 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.415052 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.415231 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.415356 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.415540 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.415674 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.415855 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.415982 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.416173 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.416300 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.416484 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.416610 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.416792 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.416933 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.417122 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.417249 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.417405 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.417531 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.417716 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.417843 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.418020 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.418153 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.418349 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.418493 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.418662 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.418801 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.418980 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.419108 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.419300 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.419441 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.419596 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.419723 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.419902 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.420036 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.420214 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.420350 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.420520 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.420646 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.420825 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.420950 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.421132 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.421272 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.421438 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.421571 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.421747 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.421875 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.422054 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.422201 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.422397 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.422546 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.422728 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.422856 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.423032 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.423159 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.423335 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.423466 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.423662 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.423796 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.423971 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.424096 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.424277 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.424403 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.424585 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.424711 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.424893 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.425022 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.425212 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.425344 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.425530 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.425663 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.425834 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.425960 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.426154 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.426297 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.426497 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.426641 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.426808 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.426933 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.427183 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.427319 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.427500 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.427637 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.427811 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.427946 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.428126 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.428261 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.428438 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.428572 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.428743 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.428877 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.429054 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.429187 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.429442 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.429588 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.429712 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.429946 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.430073 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.430306 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.430442 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.430615 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.430742 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.430929 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.431056 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.431241 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.431382 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.431547 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.431690 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.431858 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.431985 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.432208 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.432340 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.432524 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.432774 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.432903 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.433110 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.433237 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.433425 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.433561 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.433733 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.433860 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.434049 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.434177 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.434389 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.434598 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.434747 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.434882 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.435006 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.435128 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.435300 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.435436 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.435609 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.435738 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.435920 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.436048 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.436229 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.436364 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.436534 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.436662 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.436847 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.436984 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.437154 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.437379 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.437510 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.437631 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.437754 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.437885 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.438051 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.438189 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.438378 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.438507 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.438687 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.438824 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.438993 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.439128 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.439297 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.439431 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.439630 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.439755 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.439906 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.440046 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.440219 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.440345 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.440525 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.440654 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.440851 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.440980 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.441161 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.441287 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.441466 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.441595 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.441770 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.441900 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.442077 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.442204 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.442414 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.442541 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.442742 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.442876 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.443061 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.443197 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.443373 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.443527 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.443681 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.443813 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.443994 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.444121 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.444317 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.444453 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.444631 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.444766 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.444943 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.445070 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.445246 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.445383 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.445550 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.445676 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.445853 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.445986 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.446159 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.446313 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.446490 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.446617 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.446794 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.446920 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.447099 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.447226 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.447431 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.447562 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.447723 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.447850 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.448030 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.448157 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.448339 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.448473 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.448644 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.448770 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.448960 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.449088 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.449264 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.449393 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.449566 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.449764 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.449906 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.450029 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.450152 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.450322 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.450466 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.450598 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.450777 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.450903 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.451089 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.451224 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.451393 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.451528 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.451694 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.451819 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.452002 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.452128 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.452310 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.452447 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.452613 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.452739 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.452918 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.453045 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.453225 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.453360 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.453536 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.453662 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.453850 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.453976 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.454157 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.454304 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.454526 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.454644 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.454851 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.454997 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.455164 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.455292 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.455469 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.455596 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.455781 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.455914 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.456076 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.456202 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.456383 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.456511 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.456701 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.456836 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.456995 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.457121 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.457299 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.457425 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.457623 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.457758 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.457883 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.458005 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.458185 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.458481 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.458626 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.458759 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.458883 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.459013 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.459171 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.459297 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.459478 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.459623 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.459827 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.459967 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.460100 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.460224 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.460399 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.460535 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.460712 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.460847 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.461020 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.461147 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.461328 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.461463 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.461633 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.461760 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.461941 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.462067 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.462350 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.462493 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.462618 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.462760 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.462884 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.463007 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.463179 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.463307 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.463486 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.463613 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.463808 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.463935 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.464124 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.464252 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.464441 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.464569 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.464747 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.464873 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.465068 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.465196 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.465383 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.465509 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.465692 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.465828 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.466001 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.466127 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.466328 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.466458 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.466645 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.466782 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.466957 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.467083 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.467267 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.467392 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.467581 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.467801 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.467937 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.468063 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.468185 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.468307 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.468497 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.468637 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.468811 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.468937 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.469120 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.469246 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.469430 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.469556 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.469741 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.469889 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.470085 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.470219 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.470382 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.470507 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.470696 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.470823 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.471010 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.471136 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.471324 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.471459 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.471631 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.471758 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.471939 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.472071 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.472244 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.472377 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.472557 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.472691 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.472867 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.473003 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.473197 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.473324 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.473518 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.473994 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.474188 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.474348 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.474528 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.474655 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.474841 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.474975 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.475159 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.475296 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.475469 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.475595 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.475908 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.476034 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.476223 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.476358 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.476539 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.476677 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.476845 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.476970 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.477152 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.477278 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.477461 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.477588 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.477843 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.477979 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.478111 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.478234 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.478413 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.478537 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.478720 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.478846 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.479031 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.479159 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.479357 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.479485 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.479670 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.479797 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.479996 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.480205 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.480402 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.480529 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.480650 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.480781 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.480904 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.481025 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.481204 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.481421 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.481549 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.481738 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.481872 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.482052 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.482177 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.482403 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.482542 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.482731 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.482852 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.483059 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.483192 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.483373 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.483529 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.483674 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.483798 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.483986 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.484153 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.484324 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.484458 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.484654 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.484788 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.484969 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.485098 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.485292 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.485427 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.485604 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.485742 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.485934 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.486062 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.486261 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.486423 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.486601 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.486738 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.486925 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.487060 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.487249 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.487375 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.487562 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.487698 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.487955 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.488091 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.488214 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.488337 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.488510 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.488647 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.488836 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.488963 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.489154 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.489282 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.489478 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.489627 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.489841 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.489969 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.490154 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.490442 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.490588 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.490714 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.490836 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.490958 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.491112 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.491240 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.491430 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.491557 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.491748 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.491884 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.492066 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.492193 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.492378 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.492506 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.492694 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.492822 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.493003 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.493142 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.493325 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.493450 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.493645 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.493781 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.493959 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.494092 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.494274 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.494419 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.494609 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.494736 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.494920 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.495065 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.495237 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.495364 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.495544 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.495670 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.495858 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.495997 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.496173 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.496300 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.496498 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.496623 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.496815 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.496950 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.497120 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.497252 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.497447 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.497574 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.497761 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.497882 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.498084 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.498219 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.498397 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.498526 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.498707 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.498838 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.499055 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.499184 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.499366 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.499495 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.499687 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.499813 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.500017 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.500148 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.500337 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.500538 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.500666 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.500790 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.500935 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.501061 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.501243 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.501380 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.501552 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.501691 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.501859 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.501986 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.502176 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.502376 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.502514 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.502638 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.502817 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.502944 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.503126 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.503262 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.503448 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.503567 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.503760 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.503890 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.504058 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.504184 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.504365 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.504491 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.504674 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.504801 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.504979 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.505106 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.505337 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.505465 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.505649 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.505778 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.505975 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.506103 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.506326 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.506459 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.506631 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.506759 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.506943 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.507070 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.507251 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.507378 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.507561 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.507698 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.507868 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.507996 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.508201 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.508347 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.508499 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.508635 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.508816 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.508952 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.509127 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.509253 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.509437 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.509642 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.509769 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.509893 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.510058 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.510190 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.510395 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.510550 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.510738 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.510909 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.511038 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.511241 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.511386 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.511559 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.511695 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.511875 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.512011 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.512216 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.512359 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.512531 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.512657 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.512844 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.512977 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.513158 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.513364 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.513492 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.513696 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.513831 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.514016 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.514157 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.514357 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.514487 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.514676 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.514803 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.514995 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.515133 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.515310 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.515438 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.515629 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.515756 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.515943 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.516080 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.516257 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.516385 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.516570 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.516697 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.516895 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.517020 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.517209 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.517347 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.517518 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.517643 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.517841 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.517977 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.518158 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.518509 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.518644 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.518768 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.518906 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.519031 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.519155 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.519281 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.519415 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.519548 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.519706 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.519834 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.520024 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.520151 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.520340 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.520477 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.520656 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.520917 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.521093 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.521220 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.521358 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.521619 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.521745 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.521937 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.522252 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.522447 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.522600 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.522731 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.522916 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.523055 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.523238 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.523365 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.523555 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.523691 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.523884 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.524199 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.524326 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.524524 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.524652 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.524837 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.524964 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.525153 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.525288 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.525473 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.525602 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.525805 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.525995 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.526129 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.526331 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.526475 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.526668 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.526805 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.526995 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.527122 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.527322 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.527458 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.527643 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.527771 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.527967 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.528102 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.528289 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.528424 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.528630 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.528776 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.528901 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.529024 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.529195 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.529324 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.529507 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.529632 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.529812 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.530039 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.530175 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.530418 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.530564 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.530740 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.530883 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.531070 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.531205 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.531355 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.531482 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.531691 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.531884 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.532022 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.532236 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.532362 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.532554 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.532690 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.532882 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.533023 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.533211 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.533345 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.533526 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.533658 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.533831 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.533958 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.534144 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.534300 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.534476 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.534607 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.534783 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.534920 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.535090 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.535216 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.535400 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.535525 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.535704 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.535831 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.536008 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.536143 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.536321 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.536492 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.536696 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.536824 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.537006 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.537136 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.537319 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.537447 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.537624 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.537752 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.537953 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.538089 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.538262 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.538419 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.538594 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.538796 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.538923 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.539048 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.539202 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.539343 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.539510 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.539637 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.539816 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.539943 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.540123 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.540259 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.540430 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.540555 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.540742 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.540868 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.541120 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.541270 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.541397 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.541520 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.541644 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.541775 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.541949 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.542086 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.542272 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.542435 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.542613 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.542741 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.542916 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.543043 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.543244 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.543373 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.543551 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.543679 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.543856 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.543985 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.544173 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.544301 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.544486 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.544733 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.544869 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.545074 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.545210 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.545403 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.545538 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.545741 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.545880 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.546057 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.546182 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.546399 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.546617 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.546829 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.546956 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.547079 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.547266 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.547402 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.547602 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.547741 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.547927 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.548054 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.548234 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.548359 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.548541 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.548684 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.548889 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.549023 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.549146 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.549268 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.549455 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.549584 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.549769 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.549895 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.550083 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.550216 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.550415 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.550543 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.550730 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.550858 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.551042 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.551184 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.551379 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.551507 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.551652 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.551780 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.551960 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.552158 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.552315 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.552442 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.552627 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.552754 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.552939 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.553074 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.553257 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.553384 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.553570 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.553704 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.553882 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.554018 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.554204 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.554378 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.554545 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.554673 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.554862 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.555003 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.555187 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.555346 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.555493 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.555621 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.555807 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.555935 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.556113 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.556239 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.556421 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.556733 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.556867 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.557050 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.557178 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.557380 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.557515 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.557699 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.557839 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.558009 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.558137 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.558370 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.558701 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.558839 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.559044 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.559192 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.559324 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.559453 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.559643 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.559777 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.559956 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.560082 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.560285 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.560418 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.560611 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.560747 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.560928 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.561055 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.561238 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.561378 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.561573 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.561702 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.561833 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.561965 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.562148 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.562308 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.562499 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.562629 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.562818 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.562947 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.563129 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.563256 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.563437 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.563569 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.563745 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.563968 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.564097 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.564229 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.564353 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.564476 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.564646 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.564781 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.564958 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.565094 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.565265 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.565398 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.565569 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.565701 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.565875 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.566014 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.566180 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.566326 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.566513 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.566641 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.566819 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.566957 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.567114 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.567238 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.567429 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.567565 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.567834 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.567964 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.568152 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.568422 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.568557 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.568761 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.568901 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.569069 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.569273 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.569400 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.569523 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.569728 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.569866 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.570048 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.570175 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.570399 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.570541 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.570718 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.570860 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.571032 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.571158 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.571392 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.571527 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.571739 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.571876 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.572001 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.572124 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.572285 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.572420 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.572603 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.572732 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.572927 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.573052 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.573246 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.573372 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.573563 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.573691 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.573882 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.574009 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.574204 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.574350 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.574547 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.574670 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.574862 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.574996 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.575192 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.575327 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.575508 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.575641 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.575818 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.575958 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.576135 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.576338 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.576474 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.576606 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.576755 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.576883 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.577070 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.577206 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.577385 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.577512 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.577717 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.577853 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.578029 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.578158 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.578363 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.578491 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.578681 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.578808 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.578999 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.579129 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.579335 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.579469 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.579628 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.579762 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.579940 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.580070 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.580254 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.580389 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.580568 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.580703 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.580885 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.581012 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.581202 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.581389 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.581517 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.581651 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.581851 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.581984 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.582108 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.582232 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.582487 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.582632 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.582838 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.582997 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.583157 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.583318 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.583512 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.583641 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.583843 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.583970 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.584161 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.584289 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.584488 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.584748 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.584875 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.584999 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.585120 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 17:20:41.585243 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.585449 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.585796 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.586126 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.586474 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.586794 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.587104 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:20:41.587348 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 17:20:41.739069 n-d-835595-3 devstack@n-api.service[106335]: INFO dbcounter [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Registered counter for database nova_api Oct 05 17:20:41.741281 n-d-835595-3 devstack@n-api.service[106334]: INFO dbcounter [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Registered counter for database nova_api Oct 05 17:20:41.761327 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_db.sqlalchemy.engines [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:20:41.763186 n-d-835595-3 devstack@n-api.service[106334]: DEBUG oslo_db.sqlalchemy.engines [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:20:41.768032 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writer thread running {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:20:41.769769 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writer thread running {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:20:41.826120 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.context [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) {{(pid=106335) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 17:20:41.826338 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.context [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) {{(pid=106334) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 17:20:41.829990 n-d-835595-3 devstack@n-api.service[106334]: DEBUG oslo_concurrency.lockutils [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:20:41.830160 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:20:41.830490 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:20:41.830623 n-d-835595-3 devstack@n-api.service[106334]: DEBUG oslo_concurrency.lockutils [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:20:41.832103 n-d-835595-3 devstack@n-api.service[106334]: DEBUG oslo_concurrency.lockutils [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:20:41.832246 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:20:41.832831 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:20:41.832965 n-d-835595-3 devstack@n-api.service[106334]: DEBUG oslo_concurrency.lockutils [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:20:41.833311 n-d-835595-3 devstack@n-api.service[106334]: DEBUG oslo_concurrency.lockutils [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:20:41.833450 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:20:41.835377 n-d-835595-3 devstack@n-api.service[106334]: DEBUG oslo_concurrency.lockutils [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106334) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:20:41.835541 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:20:41.837403 n-d-835595-3 devstack@n-api.service[106334]: INFO dbcounter [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Registered counter for database nova_cell0 Oct 05 17:20:41.837545 n-d-835595-3 devstack@n-api.service[106335]: INFO dbcounter [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Registered counter for database nova_cell0 Oct 05 17:20:41.841531 n-d-835595-3 devstack@n-api.service[106334]: INFO dbcounter [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Registered counter for database nova_cell1 Oct 05 17:20:41.841813 n-d-835595-3 devstack@n-api.service[106335]: INFO dbcounter [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Registered counter for database nova_cell1 Oct 05 17:20:41.850188 n-d-835595-3 devstack@n-api.service[106334]: DEBUG oslo_db.sqlalchemy.engines [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:20:41.852395 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_db.sqlalchemy.engines [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:20:41.853483 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_db.sqlalchemy.engines [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:20:41.855084 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writer thread running {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:20:41.855730 n-d-835595-3 devstack@n-api.service[106334]: DEBUG oslo_db.sqlalchemy.engines [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:20:41.861442 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writer thread running {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:20:41.861810 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writer thread running {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:20:41.995706 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writer thread running {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:20:42.004617 n-d-835595-3 devstack@n-api.service[106334]: INFO dbcounter [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Registered counter for database nova_cell0 Oct 05 17:20:42.006556 n-d-835595-3 devstack@n-api.service[106335]: INFO dbcounter [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Registered counter for database nova_cell0 Oct 05 17:20:42.015611 n-d-835595-3 devstack@n-api.service[106334]: DEBUG oslo_db.sqlalchemy.engines [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:20:42.019273 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_db.sqlalchemy.engines [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:20:42.020715 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writer thread running {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:20:42.025061 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writer thread running {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:20:42.359474 n-d-835595-3 devstack@n-api.service[106334]: WARNING keystonemiddleware.auth_token [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 17:20:42.360460 n-d-835595-3 devstack@n-api.service[106335]: WARNING keystonemiddleware.auth_token [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 17:20:42.367008 n-d-835595-3 devstack@n-api.service[106334]: WARNING keystonemiddleware.auth_token [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 17:20:42.367932 n-d-835595-3 devstack@n-api.service[106335]: WARNING keystonemiddleware.auth_token [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 17:20:42.717307 n-d-835595-3 devstack@n-api.service[106334]: WARNING keystonemiddleware.auth_token [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 17:20:42.720589 n-d-835595-3 devstack@n-api.service[106335]: WARNING keystonemiddleware.auth_token [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 17:20:42.723335 n-d-835595-3 devstack@n-api.service[106334]: WARNING keystonemiddleware.auth_token [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 17:20:42.727557 n-d-835595-3 devstack@n-api.service[106335]: WARNING keystonemiddleware.auth_token [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 17:20:42.729492 n-d-835595-3 devstack@n-api.service[106334]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563711fe59c0 pid: 106334 (default app) Oct 05 17:20:42.731645 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:20:42.732819 n-d-835595-3 devstack@n-api.service[106335]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563711fe59c0 pid: 106335 (default app) Oct 05 17:20:42.732976 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-84a4ba5c-9c36-4c7c-98c8-6e64d0c6f74a None None] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001789 Oct 05 17:20:42.733207 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 788 bytes} [Wed Oct 5 17:20:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:05.461144 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:05.462898 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002712 Oct 05 17:22:05.463429 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:05.475546 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writing DB stats nova_api:SELECT=3 {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:22:05.476821 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writing DB stats nova_cell1:SELECT=3 {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:22:05.478978 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writing DB stats nova_cell0:SELECT=3 {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:22:05.479801 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:22:06.344117 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-0612c230-3456-46b8-b0a5-8b85d52a4607 admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:06.377500 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-0612c230-3456-46b8-b0a5-8b85d52a4607 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.907636 Oct 05 17:22:06.383709 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 2/3] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Oct 5 17:22:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:22:08.977796 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:08.978889 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-22f32cea-e8c9-47be-ba8f-d48d95b34f87 None None] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Oct 05 17:22:08.979291 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 2/4] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:09.454951 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-938d6d57-0d79-4082-8006-fc84267c07c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:09.503437 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-938d6d57-0d79-4082-8006-fc84267c07c3 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.517823 Oct 05 17:22:09.504011 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 3/5] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Oct 5 17:22:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:22:09.517956 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writing DB stats nova_api:SELECT=3 {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:22:09.518802 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writing DB stats nova_cell1:SELECT=3 {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:22:09.520802 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writing DB stats nova_cell0:SELECT=3 {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:22:09.521542 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:22:09.723560 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-7c2e79fc-798b-4395-bed9-fc8c7ca64afa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:09.797499 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-7c2e79fc-798b-4395-bed9-fc8c7ca64afa admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284754 Oct 05 17:22:09.798101 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 3/6] 10.222.0.70 () {64 vars in 1336 bytes} [Wed Oct 5 17:22:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:22:12.433687 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-938d6d57-0d79-4082-8006-fc84267c07c3 admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:12.435267 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-938d6d57-0d79-4082-8006-fc84267c07c3 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Oct 05 17:22:12.435826 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 4/7] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:13.231718 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-2a45da8e-ba31-4de0-b7a8-a6a0a6d27acd admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 512, "id": "d1", "os-flavor-access:is_public": true}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:13.290647 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-2a45da8e-ba31-4de0-b7a8-a6a0a6d27acd admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.847580 Oct 05 17:22:13.294926 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 4/8] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Oct 5 17:22:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:22:13.308225 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-9c85387d-eaad-4a25-ad99-f9060e1da40d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:13.360320 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-9c85387d-eaad-4a25-ad99-f9060e1da40d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056768 Oct 05 17:22:13.361727 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 5/9] 10.222.0.70 () {64 vars in 1336 bytes} [Wed Oct 5 17:22:13 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:22:16.122072 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-2a45da8e-ba31-4de0-b7a8-a6a0a6d27acd admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:16.124177 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-2a45da8e-ba31-4de0-b7a8-a6a0a6d27acd admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002565 Oct 05 17:22:16.125090 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:16.658209 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-8c084b1c-3e5f-4823-a9e1-2621be1fd2ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G"}} {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:16.705161 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-8c084b1c-3e5f-4823-a9e1-2621be1fd2ca admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.573528 Oct 05 17:22:16.710107 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 6/11] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Oct 5 17:22:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:22:16.722199 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-0d932eed-9d0e-4c7c-a04f-e195e94965ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:16.751950 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-0d932eed-9d0e-4c7c-a04f-e195e94965ba admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033368 Oct 05 17:22:16.758925 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 6/12] 10.222.0.70 () {64 vars in 1336 bytes} [Wed Oct 5 17:22:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:22:19.389770 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-8c084b1c-3e5f-4823-a9e1-2621be1fd2ca admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:19.390919 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-8c084b1c-3e5f-4823-a9e1-2621be1fd2ca admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001708 Oct 05 17:22:19.391316 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 7/13] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:19.919669 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-7792439c-3f70-45b2-9fa2-6126c5cd9909 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:19.951432 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-7792439c-3f70-45b2-9fa2-6126c5cd9909 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.553195 Oct 05 17:22:19.952531 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 7/14] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Oct 5 17:22:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:22:19.965627 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-116ab6da-d6e0-41bc-99cd-c1b6dca92cd5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:20.013327 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-116ab6da-d6e0-41bc-99cd-c1b6dca92cd5 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052346 Oct 05 17:22:20.014697 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 8/15] 10.222.0.70 () {64 vars in 1336 bytes} [Wed Oct 5 17:22:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:22:22.715618 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-7792439c-3f70-45b2-9fa2-6126c5cd9909 admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:22.717299 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-7792439c-3f70-45b2-9fa2-6126c5cd9909 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Oct 05 17:22:22.717845 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 8/16] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:23.241058 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-696f5ca1-ea56-4217-b571-426aabb52cee admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:23.265161 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-696f5ca1-ea56-4217-b571-426aabb52cee admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.540783 Oct 05 17:22:23.266336 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 9/17] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Oct 5 17:22:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:22:23.279362 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-0a10ab6f-1117-43da-a0f6-66e40132aeb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:23.308064 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-0a10ab6f-1117-43da-a0f6-66e40132aeb8 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033454 Oct 05 17:22:23.319101 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 9/18] 10.222.0.70 () {64 vars in 1336 bytes} [Wed Oct 5 17:22:23 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:22:25.968766 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-696f5ca1-ea56-4217-b571-426aabb52cee admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:25.969822 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-696f5ca1-ea56-4217-b571-426aabb52cee admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Oct 05 17:22:25.970803 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 10/19] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:26.406803 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-7aa4370b-f0e4-4d81-9e8b-6a7ba8b354f6 admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:26.431685 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-7aa4370b-f0e4-4d81-9e8b-6a7ba8b354f6 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.454739 Oct 05 17:22:26.432341 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 10/20] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Oct 5 17:22:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:22:29.217505 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-696f5ca1-ea56-4217-b571-426aabb52cee admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:29.218587 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-696f5ca1-ea56-4217-b571-426aabb52cee admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Oct 05 17:22:29.219004 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 11/21] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:29.671368 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-45129f7d-8f59-42e7-9cd2-f59cf338731a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "swap": 0, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:29.694817 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-45129f7d-8f59-42e7-9cd2-f59cf338731a admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.469007 Oct 05 17:22:29.695399 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 11/22] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Oct 5 17:22:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:22:29.707859 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-2a564ca7-befc-493d-bc3d-427f3939d613 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:29.735562 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-2a564ca7-befc-493d-bc3d-427f3939d613 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031447 Oct 05 17:22:29.736159 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 12/23] 10.222.0.70 () {64 vars in 1333 bytes} [Wed Oct 5 17:22:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:22:32.365394 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-45129f7d-8f59-42e7-9cd2-f59cf338731a admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:32.366447 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-45129f7d-8f59-42e7-9cd2-f59cf338731a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 05 17:22:32.366849 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 12/24] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:32.772433 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-6695366c-1dd6-48c8-8647-ebfd31be5a9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:32.793487 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-6695366c-1dd6-48c8-8647-ebfd31be5a9d admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.420325 Oct 05 17:22:32.794385 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 13/25] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Oct 5 17:22:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:22:32.806542 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-5a80b096-162b-41ac-8335-2dc54f46381b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:32.832977 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-5a80b096-162b-41ac-8335-2dc54f46381b admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030208 Oct 05 17:22:32.833576 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 13/26] 10.222.0.70 () {64 vars in 1333 bytes} [Wed Oct 5 17:22:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:22:35.406096 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-6695366c-1dd6-48c8-8647-ebfd31be5a9d admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:35.407788 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-6695366c-1dd6-48c8-8647-ebfd31be5a9d admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002182 Oct 05 17:22:35.408192 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 14/27] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:35.824978 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-7a163834-c4b4-4c13-8cf9-b720508752a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 40, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:35.845423 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-7a163834-c4b4-4c13-8cf9-b720508752a3 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.430788 Oct 05 17:22:35.846296 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 14/28] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Oct 5 17:22:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:22:35.859246 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-9763941b-c592-44ae-8781-d1a635acbfe3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:35.864267 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:22:35.890733 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-9763941b-c592-44ae-8781-d1a635acbfe3 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035140 Oct 05 17:22:35.891348 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 15/29] 10.222.0.70 () {64 vars in 1333 bytes} [Wed Oct 5 17:22:35 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:22:38.527158 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-7a163834-c4b4-4c13-8cf9-b720508752a3 admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:38.528775 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-7a163834-c4b4-4c13-8cf9-b720508752a3 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002133 Oct 05 17:22:38.529592 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 15/30] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:38.982602 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-a557b4a9-6ee7-4d48-b69b-314a4c1bc6ab admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "disk": 80, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "swap": 0, "id": "4"}} {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:39.009425 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-a557b4a9-6ee7-4d48-b69b-314a4c1bc6ab admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473682 Oct 05 17:22:39.010339 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 16/31] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Oct 5 17:22:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:22:39.022360 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-7c0e0c05-80d3-4e6b-99a9-fa8c1bdff3f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:39.049184 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-7c0e0c05-80d3-4e6b-99a9-fa8c1bdff3f4 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030515 Oct 05 17:22:39.050918 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 16/32] 10.222.0.70 () {64 vars in 1333 bytes} [Wed Oct 5 17:22:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:22:41.795654 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-a557b4a9-6ee7-4d48-b69b-314a4c1bc6ab admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:22:41.796597 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-a557b4a9-6ee7-4d48-b69b-314a4c1bc6ab admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Oct 05 17:22:41.797129 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 17/33] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:22:42.260466 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-c40193d5-32a8-4713-80ce-07fbd935ab1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:42.267366 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:22:42.286020 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-c40193d5-32a8-4713-80ce-07fbd935ab1c admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.482273 Oct 05 17:22:42.294031 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 17/34] 10.222.0.70 () {64 vars in 1283 bytes} [Wed Oct 5 17:22:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:22:42.299015 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-1d25f82a-39ae-4cfb-9cba-dc554099b084 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:22:42.326540 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-1d25f82a-39ae-4cfb-9cba-dc554099b084 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031190 Oct 05 17:22:42.327320 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 18/35] 10.222.0.70 () {64 vars in 1333 bytes} [Wed Oct 5 17:22:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:23:03.746664 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-c40193d5-32a8-4713-80ce-07fbd935ab1c admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:03.747690 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-c40193d5-32a8-4713-80ce-07fbd935ab1c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Oct 05 17:23:03.748090 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 18/36] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:23:03.761979 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:23:04.180373 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-165b5682-e953-47bc-bfd4-fdb903797393 admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:04.198758 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-165b5682-e953-47bc-bfd4-fdb903797393 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.444046 Oct 05 17:23:04.199301 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 19/37] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Oct 5 17:23:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:23:05.545276 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-c40193d5-32a8-4713-80ce-07fbd935ab1c admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:05.546314 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-c40193d5-32a8-4713-80ce-07fbd935ab1c admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 05 17:23:05.546724 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 19/38] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Oct 5 17:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:23:06.142190 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-2a254ba5-55d0-46bf-a314-e6094cc59ee6 admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:06.147750 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.wsgi [None req-2a254ba5-55d0-46bf-a314-e6094cc59ee6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-2a254ba5-55d0-46bf-a314-e6094cc59ee6 admin admin] Request method failure captured: Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: Accept: application/json Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: Accept-Encoding: gzip, deflate Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: Connection: keep-alive Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: Content-Length: 0 Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: Host: 10.222.0.70 Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: Openstack-Api-Version: compute 2.92 Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: Openstack-System-Scope: None Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: User-Agent: python-novaclient Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Auth-Token: gAAAAABjPb15vHI63n-hfzXPwkzV2UJRTScUwKuNc-TljSHY-b2ly7df5CohrIz-YtnWh8wvC06Yg_JRFp3Mq-g_Wwb0L9F8jLI3rcaBfCIh04Z25K0tNnbNBc1oc--4k3Ps_7j9Fm9Ep5rTXZNXsl_bjlepGnC0-YWewF55NWNt_L7p4svG15k Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Domain-Id: None Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Domain-Name: None Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Identity-Status: Confirmed Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Is-Admin-Project: True Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Domain-Id: default Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Domain-Name: Default Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Name: admin Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Role: reader,admin,member Oct 05 17:23:06.151259 n-d-835595-3 devstack@n-api.service[106334]: X-Roles: reader,admin,member Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_34bec5f6ea85472a87becfda8503e895", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}] Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: X-Tenant: admin Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: X-Tenant-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: X-Tenant-Name: admin Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: X-User: admin Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: X-User-Domain-Id: default Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: X-User-Domain-Name: Default Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: X-User-Id: fa6b7c2170d54e5eb06a893cef39959a Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: X-User-Name: admin Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: method: > Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: exception: Flavor 42 could not be found. Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: action_args: {'id': '42'} Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:23:06.153031 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:06.154181 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:06.155751 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-2a254ba5-55d0-46bf-a314-e6094cc59ee6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:23:06.157204 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-2a254ba5-55d0-46bf-a314-e6094cc59ee6 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.438401 Oct 05 17:23:06.157204 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 20/39] 10.222.0.70 () {60 vars in 1190 bytes} [Wed Oct 5 17:23:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 440 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:23:06.162704 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-62bcc667-9364-4372-b9ce-0ada9120ae86 admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:06.186562 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-62bcc667-9364-4372-b9ce-0ada9120ae86 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027402 Oct 05 17:23:06.187109 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 20/40] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Oct 5 17:23:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:23:06.201900 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-5a4ef5ef-f70a-4ae6-995e-837fd623b290 admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:06.224505 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-5a4ef5ef-f70a-4ae6-995e-837fd623b290 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027901 Oct 05 17:23:06.225052 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 21/41] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Oct 5 17:23:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:23:06.237634 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-850b89ef-0077-4dd1-871f-109a4831dd6f admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:06.245539 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.wsgi [None req-850b89ef-0077-4dd1-871f-109a4831dd6f admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-850b89ef-0077-4dd1-871f-109a4831dd6f admin admin] Request method failure captured: Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: Accept: application/json Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: Accept-Encoding: gzip, deflate Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: Connection: keep-alive Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: Content-Length: 0 Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: Host: 10.222.0.70 Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: Openstack-Api-Version: compute 2.92 Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: Openstack-System-Scope: None Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: User-Agent: python-novaclient Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Auth-Token: gAAAAABjPb15vHI63n-hfzXPwkzV2UJRTScUwKuNc-TljSHY-b2ly7df5CohrIz-YtnWh8wvC06Yg_JRFp3Mq-g_Wwb0L9F8jLI3rcaBfCIh04Z25K0tNnbNBc1oc--4k3Ps_7j9Fm9Ep5rTXZNXsl_bjlepGnC0-YWewF55NWNt_L7p4svG15k Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Domain-Id: None Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Domain-Name: None Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Identity-Status: Confirmed Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Is-Admin-Project: True Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Domain-Id: default Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Domain-Name: Default Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Name: admin Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Role: reader,admin,member Oct 05 17:23:06.250637 n-d-835595-3 devstack@n-api.service[106335]: X-Roles: reader,admin,member Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_34bec5f6ea85472a87becfda8503e895", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}] Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: X-Tenant: admin Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: X-Tenant-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: X-Tenant-Name: admin Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: X-User: admin Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: X-User-Domain-Id: default Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: X-User-Domain-Name: Default Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: X-User-Id: fa6b7c2170d54e5eb06a893cef39959a Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: X-User-Name: admin Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: method: > Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: exception: Flavor 42 could not be found. Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: action_args: {'id': '42'} Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:23:06.252142 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:06.253074 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:06.254166 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-850b89ef-0077-4dd1-871f-109a4831dd6f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:23:06.255908 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-850b89ef-0077-4dd1-871f-109a4831dd6f admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.020194 Oct 05 17:23:06.255908 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 21/42] 10.222.0.70 () {60 vars in 1190 bytes} [Wed Oct 5 17:23:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:23:07.535753 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-5a4ef5ef-f70a-4ae6-995e-837fd623b290 admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:07.536772 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-5a4ef5ef-f70a-4ae6-995e-837fd623b290 admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 05 17:23:07.537182 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 22/43] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Oct 5 17:23:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:23:08.110877 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-cf7c1ada-e4f2-41f0-a270-69e1930828d5 admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:08.116221 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.wsgi [None req-cf7c1ada-e4f2-41f0-a270-69e1930828d5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-cf7c1ada-e4f2-41f0-a270-69e1930828d5 admin admin] Request method failure captured: Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: Accept: application/json Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: Accept-Encoding: gzip, deflate Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: Connection: keep-alive Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: Content-Length: 0 Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: Host: 10.222.0.70 Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: Openstack-Api-Version: compute 2.92 Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: Openstack-System-Scope: None Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: User-Agent: python-novaclient Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Auth-Token: gAAAAABjPb17L9gmy-ApvjeMBN69VUY54hFPPn0lBWL5Q0wPby9hWYgNan3jCMBtaQ-UkuZTwcFAnu9uggvYpsEz_Jhpx01hhGa8zLVelZ_ZsWv80WUh8SobTwFmbf9RliKCL_A28EZ14Z5G0CGlzsbJ-ugsvSkF_-f5YxyqaL3ZhJ4w3wUe_bA Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Domain-Id: None Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Domain-Name: None Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Identity-Status: Confirmed Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Is-Admin-Project: True Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Domain-Id: default Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Domain-Name: Default Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Name: admin Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Role: reader,admin,member Oct 05 17:23:08.117734 n-d-835595-3 devstack@n-api.service[106335]: X-Roles: reader,admin,member Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_34bec5f6ea85472a87becfda8503e895", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}] Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: X-Tenant: admin Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: X-Tenant-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: X-Tenant-Name: admin Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: X-User: admin Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: X-User-Domain-Id: default Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: X-User-Domain-Name: Default Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: X-User-Id: fa6b7c2170d54e5eb06a893cef39959a Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: X-User-Name: admin Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: method: > Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: exception: Flavor 84 could not be found. Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: action_args: {'id': '84'} Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:23:08.119349 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:08.120540 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:08.122053 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-cf7c1ada-e4f2-41f0-a270-69e1930828d5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:23:08.123368 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-cf7c1ada-e4f2-41f0-a270-69e1930828d5 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.444718 Oct 05 17:23:08.123368 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 22/44] 10.222.0.70 () {60 vars in 1190 bytes} [Wed Oct 5 17:23:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:23:08.129321 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-bfba4d46-9b0e-4b6d-b1a6-6e7f0fbdfaa7 admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:08.144827 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-bfba4d46-9b0e-4b6d-b1a6-6e7f0fbdfaa7 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019073 Oct 05 17:23:08.145292 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 23/45] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Oct 5 17:23:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:23:08.155241 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-fb7ae930-a3a1-4930-a416-fd868a4e377a admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:08.171112 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-fb7ae930-a3a1-4930-a416-fd868a4e377a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019674 Oct 05 17:23:08.171648 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Oct 5 17:23:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:23:08.181190 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-72af4130-9ca1-44e5-849e-15e834e843ff admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:08.187874 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.wsgi [None req-72af4130-9ca1-44e5-849e-15e834e843ff admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-72af4130-9ca1-44e5-849e-15e834e843ff admin admin] Request method failure captured: Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: Accept: application/json Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: Accept-Encoding: gzip, deflate Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: Connection: keep-alive Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: Content-Length: 0 Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: Host: 10.222.0.70 Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: Openstack-Api-Version: compute 2.92 Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: Openstack-System-Scope: None Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: User-Agent: python-novaclient Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Auth-Token: gAAAAABjPb17L9gmy-ApvjeMBN69VUY54hFPPn0lBWL5Q0wPby9hWYgNan3jCMBtaQ-UkuZTwcFAnu9uggvYpsEz_Jhpx01hhGa8zLVelZ_ZsWv80WUh8SobTwFmbf9RliKCL_A28EZ14Z5G0CGlzsbJ-ugsvSkF_-f5YxyqaL3ZhJ4w3wUe_bA Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Domain-Id: None Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Domain-Name: None Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Identity-Status: Confirmed Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Is-Admin-Project: True Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Domain-Id: default Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Domain-Name: Default Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Name: admin Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Role: reader,admin,member Oct 05 17:23:08.190356 n-d-835595-3 devstack@n-api.service[106334]: X-Roles: reader,admin,member Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_34bec5f6ea85472a87becfda8503e895", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}] Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: X-Tenant: admin Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: X-Tenant-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: X-Tenant-Name: admin Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: X-User: admin Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: X-User-Domain-Id: default Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: X-User-Domain-Name: Default Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: X-User-Id: fa6b7c2170d54e5eb06a893cef39959a Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: X-User-Name: admin Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: method: > Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: exception: Flavor 84 could not be found. Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: action_args: {'id': '84'} Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:23:08.192630 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:08.194342 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:08.196404 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-72af4130-9ca1-44e5-849e-15e834e843ff admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:23:08.198299 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-72af4130-9ca1-44e5-849e-15e834e843ff admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.014639 Oct 05 17:23:08.198299 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 24/47] 10.222.0.70 () {60 vars in 1190 bytes} [Wed Oct 5 17:23:08 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:23:09.439608 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-fb7ae930-a3a1-4930-a416-fd868a4e377a admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:09.440732 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-fb7ae930-a3a1-4930-a416-fd868a4e377a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Oct 05 17:23:09.441148 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 24/48] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Oct 5 17:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:23:10.001628 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-7ea3a1b2-5856-42f7-98c8-63d2820a4afc admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:10.007634 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.wsgi [None req-7ea3a1b2-5856-42f7-98c8-63d2820a4afc admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-7ea3a1b2-5856-42f7-98c8-63d2820a4afc admin admin] Request method failure captured: Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: Accept: application/json Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: Accept-Encoding: gzip, deflate Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: Connection: keep-alive Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: Content-Length: 0 Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: Host: 10.222.0.70 Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: Openstack-Api-Version: compute 2.92 Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: Openstack-System-Scope: None Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: User-Agent: python-novaclient Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Auth-Token: gAAAAABjPb19nf2IsWLuBhUpuHWz7lX2ZodVu6NUJOFyiWZuVEjVS_yHY4XliyT-HnqaQ2NbVdhYkh3Wy0fjlDs8NORjWcL1HOXGoGb4G2FvZlji20dL6eSby32Wgllcfw-v1b1vNMzPanJ_X7hZfzFuBD_VbN4vNWfUjBE_vwGAr-HO92TnbXY Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Domain-Id: None Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Domain-Name: None Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Identity-Status: Confirmed Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Is-Admin-Project: True Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Domain-Id: default Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Domain-Name: Default Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Project-Name: admin Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Role: reader,admin,member Oct 05 17:23:10.009137 n-d-835595-3 devstack@n-api.service[106334]: X-Roles: reader,admin,member Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_34bec5f6ea85472a87becfda8503e895", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}] Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: X-Tenant: admin Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: X-Tenant-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: X-Tenant-Name: admin Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: X-User: admin Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: X-User-Domain-Id: default Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: X-User-Domain-Name: Default Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: X-User-Id: fa6b7c2170d54e5eb06a893cef39959a Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: X-User-Name: admin Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: method: > Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: exception: Flavor 451 could not be found. Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: action_args: {'id': '451'} Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:23:10.010777 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:10.014766 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: ERROR nova.api.openstack.wsgi Oct 05 17:23:10.015976 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-7ea3a1b2-5856-42f7-98c8-63d2820a4afc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:23:10.017160 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-7ea3a1b2-5856-42f7-98c8-63d2820a4afc admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.433637 Oct 05 17:23:10.017160 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 25/49] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Oct 5 17:23:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 435 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:23:10.022628 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-b9fecf5b-0e79-4c1d-b534-940ee9f4d518 admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:10.044039 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-b9fecf5b-0e79-4c1d-b534-940ee9f4d518 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026813 Oct 05 17:23:10.044578 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 25/50] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Oct 5 17:23:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:23:10.060009 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:10.079694 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] 10.222.0.70 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025694 Oct 05 17:23:10.080215 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 26/51] 10.222.0.70 () {60 vars in 1210 bytes} [Wed Oct 5 17:23:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:23:10.089666 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-acad1e71-83ce-4cf2-91c2-6b8e2e6fe327 admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:10.094948 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.wsgi [None req-acad1e71-83ce-4cf2-91c2-6b8e2e6fe327 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-acad1e71-83ce-4cf2-91c2-6b8e2e6fe327 admin admin] Request method failure captured: Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: Accept: application/json Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: Accept-Encoding: gzip, deflate Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: Connection: keep-alive Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: Content-Length: 0 Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: Host: 10.222.0.70 Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: Openstack-Api-Version: compute 2.92 Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: Openstack-System-Scope: None Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: User-Agent: python-novaclient Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Auth-Token: gAAAAABjPb19nf2IsWLuBhUpuHWz7lX2ZodVu6NUJOFyiWZuVEjVS_yHY4XliyT-HnqaQ2NbVdhYkh3Wy0fjlDs8NORjWcL1HOXGoGb4G2FvZlji20dL6eSby32Wgllcfw-v1b1vNMzPanJ_X7hZfzFuBD_VbN4vNWfUjBE_vwGAr-HO92TnbXY Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Domain-Id: None Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Domain-Name: None Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Identity-Status: Confirmed Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Is-Admin-Project: True Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Openstack-Nova-Api-Version: 2.92 Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Domain-Id: default Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Domain-Name: Default Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Project-Name: admin Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Role: reader,admin,member Oct 05 17:23:10.096426 n-d-835595-3 devstack@n-api.service[106335]: X-Roles: reader,admin,member Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_34bec5f6ea85472a87becfda8503e895", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/34bec5f6ea85472a87becfda8503e895"}]}] Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: X-Tenant: admin Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: X-Tenant-Id: 34bec5f6ea85472a87becfda8503e895 Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: X-Tenant-Name: admin Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: X-User: admin Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: X-User-Domain-Id: default Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: X-User-Domain-Name: Default Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: X-User-Id: fa6b7c2170d54e5eb06a893cef39959a Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: X-User-Name: admin Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: method: > Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: exception: Flavor 451 could not be found. Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: action_args: {'id': '451'} Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:23:10.097956 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:10.098849 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: ERROR nova.api.openstack.wsgi Oct 05 17:23:10.099999 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-acad1e71-83ce-4cf2-91c2-6b8e2e6fe327 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106335) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:23:10.101033 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-acad1e71-83ce-4cf2-91c2-6b8e2e6fe327 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011780 Oct 05 17:23:10.101033 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 26/52] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Oct 5 17:23:10 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 05 17:23:11.331118 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:11.332119 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 05 17:23:11.332547 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 27/53] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Oct 5 17:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:23:11.930536 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-962877fb-7e4e-4b0f-a1cc-0ee901be2969 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:23:11.951588 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-962877fb-7e4e-4b0f-a1cc-0ee901be2969 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.467741 Oct 05 17:23:11.952121 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 27/54] 10.222.0.70 () {64 vars in 1235 bytes} [Wed Oct 5 17:23:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:23:13.195724 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:13.197094 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002016 Oct 05 17:23:13.197635 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 28/55] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Oct 5 17:23:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:23:13.751763 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-44f85a64-0b8d-469e-ac57-89b29909542f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:23:13.772718 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-44f85a64-0b8d-469e-ac57-89b29909542f admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.438482 Oct 05 17:23:13.773247 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 28/56] 10.222.0.70 () {64 vars in 1235 bytes} [Wed Oct 5 17:23:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:23:15.036296 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:15.037310 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Oct 05 17:23:15.037710 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 29/57] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Oct 5 17:23:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:23:15.603528 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-2b342f66-8d8d-470b-b028-0672cfac5fe1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:23:15.628054 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-2b342f66-8d8d-470b-b028-0672cfac5fe1 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.453650 Oct 05 17:23:15.628609 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 29/58] 10.222.0.70 () {64 vars in 1235 bytes} [Wed Oct 5 17:23:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:23:16.907871 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:16.908938 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Oct 05 17:23:16.909320 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 30/59] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Oct 5 17:23:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:23:17.475653 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-7e1fb467-6f69-4d75-924f-0396eb526952 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:23:17.498011 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-7e1fb467-6f69-4d75-924f-0396eb526952 admin admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.452441 Oct 05 17:23:17.498618 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 30/60] 10.222.0.70 () {64 vars in 1235 bytes} [Wed Oct 5 17:23:17 2022] POST /compute/v2.1/flavors => generated 409 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:23:18.759216 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:18.760319 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Oct 05 17:23:18.760813 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 31/61] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Oct 5 17:23:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:23:19.314371 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-d53af698-4dba-4fe8-949d-638ec796f57f admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:23:19.336361 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-d53af698-4dba-4fe8-949d-638ec796f57f admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.438646 Oct 05 17:23:19.336905 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 31/62] 10.222.0.70 () {60 vars in 1202 bytes} [Wed Oct 5 17:23:18 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:24:16.905253 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:24:16.906306 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-902569fc-c96f-4fb6-82a2-189c844cd06a admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 05 17:24:16.906746 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 32/63] 10.222.0.70 () {54 vars in 931 bytes} [Wed Oct 5 17:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:24:16.920919 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:24:17.360395 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-43e2f256-913a-4b52-8b30-7e35c7c3338c admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:24:17.386598 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-43e2f256-913a-4b52-8b30-7e35c7c3338c admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.472600 Oct 05 17:24:17.387570 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 32/64] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Oct 5 17:24:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:24:17.413851 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writing DB stats nova_api:SELECT=14 {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:24:17.417957 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-e83b4268-c3f0-4b78-a1a3-9baf7f703866 admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:24:17.425633 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-e83b4268-c3f0-4b78-a1a3-9baf7f703866 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013875 Oct 05 17:24:17.426200 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 33/65] 10.222.0.70 () {60 vars in 1283 bytes} [Wed Oct 5 17:24:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:24:17.438412 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-820b5e29-810f-4181-8479-5a0040bdf634 admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:24:17.445957 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-820b5e29-810f-4181-8479-5a0040bdf634 admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011271 Oct 05 17:24:17.446550 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 33/66] 10.222.0.70 () {60 vars in 1286 bytes} [Wed Oct 5 17:24:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:24:17.460500 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-2aa1cf3c-e4d7-4a80-b3cb-dd926fd0b11b admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:24:17.476169 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-2aa1cf3c-e4d7-4a80-b3cb-dd926fd0b11b admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020993 Oct 05 17:24:17.476977 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 34/67] 10.222.0.70 () {60 vars in 1286 bytes} [Wed Oct 5 17:24:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:24:17.489391 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-e7499613-ae29-4edb-98cc-647db002d76d admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:24:17.496821 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-e7499613-ae29-4edb-98cc-647db002d76d admin admin] 10.222.0.70 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011092 Oct 05 17:24:17.497355 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 34/68] 10.222.0.70 () {60 vars in 1283 bytes} [Wed Oct 5 17:24:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:30:05.686629 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-2aa1cf3c-e4d7-4a80-b3cb-dd926fd0b11b admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:30:05.687652 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-2aa1cf3c-e4d7-4a80-b3cb-dd926fd0b11b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Oct 05 17:30:05.688070 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 35/69] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Oct 5 17:30:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:30:05.831165 n-d-835595-3 devstack@n-api.service[106335]: DEBUG dbcounter [-] [106335] Writing DB stats nova_api:SELECT=6 {{(pid=106335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:30:05.984059 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-0ec96f49-1c76-4064-b08c-333871576620 admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:30:05.989030 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-0ec96f49-1c76-4064-b08c-333871576620 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:30:05.989505 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-0ec96f49-1c76-4064-b08c-333871576620 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:30:05.989944 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-0ec96f49-1c76-4064-b08c-333871576620 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:30:05.990686 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-0ec96f49-1c76-4064-b08c-333871576620 admin admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:30:05.991136 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-0ec96f49-1c76-4064-b08c-333871576620 admin admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:30:05.991552 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-0ec96f49-1c76-4064-b08c-333871576620 admin admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:30:06.033451 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-0ec96f49-1c76-4064-b08c-333871576620 admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.203433 Oct 05 17:30:06.034064 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 35/70] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Oct 5 17:30:05 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:30:07.124319 n-d-835595-3 devstack@n-api.service[106334]: DEBUG nova.api.openstack.wsgi [None req-2aa1cf3c-e4d7-4a80-b3cb-dd926fd0b11b admin admin] Calling method '>' {{(pid=106334) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:30:07.125336 n-d-835595-3 devstack@n-api.service[106334]: INFO nova.api.openstack.requestlog [None req-2aa1cf3c-e4d7-4a80-b3cb-dd926fd0b11b admin admin] 10.222.0.70 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 05 17:30:07.125739 n-d-835595-3 devstack@n-api.service[106334]: [pid: 106334|app: 0|req: 36/71] 10.222.0.70 () {56 vars in 1074 bytes} [Wed Oct 5 17:30:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:30:07.319858 n-d-835595-3 devstack@n-api.service[106335]: DEBUG nova.api.openstack.wsgi [None req-36d426c9-96f7-40e7-8e6a-494169517d1c admin admin] Calling method '>' {{(pid=106335) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:30:07.323500 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-36d426c9-96f7-40e7-8e6a-494169517d1c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:30:07.323906 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-36d426c9-96f7-40e7-8e6a-494169517d1c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:30:07.324323 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-36d426c9-96f7-40e7-8e6a-494169517d1c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:30:07.325025 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-36d426c9-96f7-40e7-8e6a-494169517d1c admin admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:30:07.325460 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-36d426c9-96f7-40e7-8e6a-494169517d1c admin admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:30:07.325870 n-d-835595-3 devstack@n-api.service[106335]: DEBUG oslo_concurrency.lockutils [None req-36d426c9-96f7-40e7-8e6a-494169517d1c admin admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106335) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:30:07.348769 n-d-835595-3 devstack@n-api.service[106335]: INFO nova.api.openstack.requestlog [None req-36d426c9-96f7-40e7-8e6a-494169517d1c admin admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.087669 Oct 05 17:30:07.349331 n-d-835595-3 devstack@n-api.service[106335]: [pid: 106335|app: 0|req: 36/72] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Oct 5 17:30:07 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:30:51.954515 n-d-835595-3 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 05 17:30:51.955102 n-d-835595-3 devstack@n-api.service[106322]: Wed Oct 5 17:30:51 2022 - graceful shutdown triggered... Oct 05 17:30:51.955544 n-d-835595-3 devstack@n-api.service[106335]: Gracefully killing worker 2 (pid: 106335)... Oct 05 17:30:51.956293 n-d-835595-3 devstack@n-api.service[106334]: Gracefully killing worker 1 (pid: 106334)... Oct 05 17:30:52.084881 n-d-835595-3 devstack@n-api.service[106334]: DEBUG dbcounter [-] [106334] Writing DB stats nova_api:SELECT=4 {{(pid=106334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:30:52.955429 n-d-835595-3 devstack@n-api.service[106322]: worker 1 buried after 1 seconds Oct 05 17:30:52.955429 n-d-835595-3 devstack@n-api.service[106322]: worker 2 buried after 1 seconds Oct 05 17:30:52.955429 n-d-835595-3 devstack@n-api.service[106322]: goodbye to uWSGI. Oct 05 17:30:52.957191 n-d-835595-3 systemd[1]: devstack@n-api.service: Succeeded. Oct 05 17:30:52.957794 n-d-835595-3 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 05 17:30:52.960548 n-d-835595-3 systemd[1]: Starting Devstack devstack@n-api.service... Oct 05 17:30:52.979054 n-d-835595-3 devstack@n-api.service[128831]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 5 17:30:52 2022] *** Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: nodename: n-d-835595-3 Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: machine: x86_64 Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: clock source: unix Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: pcre jit disabled Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: detected number of CPU cores: 4 Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: current working directory: / Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: detected binary path: /usr/bin/uwsgi-core Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: your processes number limit is 47680 Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: your memory page size is 4096 bytes Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: detected max file descriptor number: 2048 Oct 05 17:30:52.998180 n-d-835595-3 devstack@n-api.service[128831]: lock engine: pthread robust mutexes Oct 05 17:30:52.999361 n-d-835595-3 devstack@n-api.service[128831]: thunder lock: enabled Oct 05 17:30:52.999361 n-d-835595-3 devstack@n-api.service[128831]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 05 17:30:52.999361 n-d-835595-3 devstack@n-api.service[128831]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 05 17:30:53.045703 n-d-835595-3 devstack@n-api.service[128831]: Python main interpreter initialized at 0x5583502a79c0 Oct 05 17:30:53.045703 n-d-835595-3 devstack@n-api.service[128831]: python threads support enabled Oct 05 17:30:53.045703 n-d-835595-3 devstack@n-api.service[128831]: your server socket listen backlog is limited to 100 connections Oct 05 17:30:53.045703 n-d-835595-3 devstack@n-api.service[128831]: your mercy for graceful operations on workers is 90 seconds Oct 05 17:30:53.046146 n-d-835595-3 devstack@n-api.service[128831]: mapped 403077 bytes (393 KB) for 2 cores Oct 05 17:30:53.046146 n-d-835595-3 devstack@n-api.service[128831]: *** Operational MODE: preforking *** Oct 05 17:30:53.046425 n-d-835595-3 devstack@n-api.service[128831]: *** uWSGI is running in multiple interpreter mode *** Oct 05 17:30:53.046425 n-d-835595-3 devstack@n-api.service[128831]: spawned uWSGI master process (pid: 128831) Oct 05 17:30:53.046605 n-d-835595-3 systemd[1]: Started Devstack devstack@n-api.service. Oct 05 17:30:53.064746 n-d-835595-3 devstack@n-api.service[128831]: spawned uWSGI worker 1 (pid: 128843, cores: 1) Oct 05 17:30:53.064746 n-d-835595-3 devstack@n-api.service[128831]: spawned uWSGI worker 2 (pid: 128844, cores: 1) Oct 05 17:30:53.064746 n-d-835595-3 devstack@n-api.service[128831]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 05 17:30:53.697773 n-d-835595-3 devstack@n-api.service[128843]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 17:30:53.698440 n-d-835595-3 devstack@n-api.service[128844]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 05 17:30:54.857289 n-d-835595-3 devstack@n-api.service[128844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 17:30:54.857289 n-d-835595-3 devstack@n-api.service[128844]: from cryptography.utils import int_from_bytes Oct 05 17:30:54.858084 n-d-835595-3 devstack@n-api.service[128844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 17:30:54.858084 n-d-835595-3 devstack@n-api.service[128844]: from cryptography.utils import int_from_bytes Oct 05 17:30:54.858222 n-d-835595-3 devstack@n-api.service[128843]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 17:30:54.858222 n-d-835595-3 devstack@n-api.service[128843]: from cryptography.utils import int_from_bytes Oct 05 17:30:54.858222 n-d-835595-3 devstack@n-api.service[128843]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 05 17:30:54.858222 n-d-835595-3 devstack@n-api.service[128843]: from cryptography.utils import int_from_bytes Oct 05 17:30:57.276738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 17:30:57.277485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 17:30:57.277485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 17:30:57.277863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 17:30:57.278081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 17:30:57.278531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.278844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.279160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.279475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.279798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.280099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.280243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 05 17:30:57.280625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.280717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 05 17:30:57.280814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.280947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 05 17:30:57.281063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.281253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.281468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 05 17:30:57.281576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.281670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 05 17:30:57.281955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.282093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-835595-3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.282317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.282470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.282572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.282659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.282914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.283063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.283207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.283350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.283555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.283800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.283932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.284111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.284218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.284440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.284550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.284802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.285127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.285363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.285588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-835595-3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.286033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.286353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.286675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.286801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.287019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.287146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.287319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.287534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.287676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.287887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.288005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.288215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.288328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.288534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.288633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.288840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.288943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.289240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-835595-3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.289394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.289539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.289728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.289831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.290032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.290163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.290381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.290571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.290725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.290881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.291048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.291187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.291366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.291521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.291697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.291822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.292008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.292132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.292340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.292463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.292655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.292756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.293022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.293114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-835595-3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.293341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.293442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.293638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.293834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.293962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.294164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.294365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.294580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.294780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.294884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.295100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.295201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.295374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.295465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.295677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.295785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.295997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.296131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.296313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.296455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.296634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.296789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.296912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.297109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.297200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.297427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.297547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.297739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.297834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.298042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.298142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.298365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.298480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.298672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.298774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.298974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.299068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.299275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.299382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.299575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.299676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.299823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.299914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.300162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.300259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.300487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.300587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.300797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.300888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.301114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.301206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.301362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.301590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.301690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.301908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.302013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.302225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.302344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.302561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.302663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.302864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.302958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.303178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.303283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.303485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.303584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.303792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.303903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.304094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.304209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.304411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.304513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.304711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.304812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.305013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.305114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.305316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.305418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.305629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.305729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.305957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.306050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.306258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.306475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.306573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.306735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.70 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.306840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.306990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.70 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.307111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.307298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.307411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.307689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.307819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.307990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.308107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.308293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.308396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.308588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.308688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.308888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.308989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.309189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.309289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.309489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.309580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.309790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.309895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.310091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.310190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.310417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.310537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.310720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.310823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.310985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.311077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.311306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.311405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.311604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.311707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.311918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.312007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.312222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.312326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.312525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.312625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.312824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.312919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.313123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.313223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.313423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.313525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.313738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.313854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.314043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.314153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.314366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.314484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.314685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.314800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.314984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.315076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.315286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.315377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.315598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.315700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.315950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.316057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.316252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.316352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.316570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.316677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.316865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.316957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.317166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.317266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.317476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.317603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.317779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.317879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.318079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.318173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.318397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.318491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.318699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.318802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.318998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.319098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.319298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.319390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.319594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.319696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.319893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.319985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.320186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.320294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.320503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.320647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.320821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.320930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.321126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.321240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.321426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.321535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.321724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.321827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.322036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.322127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.322369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.322488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.322676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.322768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.322979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.323091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.323282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.323383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.323587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.323681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.323893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.323995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.324195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.324288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.324499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.324603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.324818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.324912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.325136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.325238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.325440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.325533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.325748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.325852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.326053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.326153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.326398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.326567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.326711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.326868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 05 17:30:57.327023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.327171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.327319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.327466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.327626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.327788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.327932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.328079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.328225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.328371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.328526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.328666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.328824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.328978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.329127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.329273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.329424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.329572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.329752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.329901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.330098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.330254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.330466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.330629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.330777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.330912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.331086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.331230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.331431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.331663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.331807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.331954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.332102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.332250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.332398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.332564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.332701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.332842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.332989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.333129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.333277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.333452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.333592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.333730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.333916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.334065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.334242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.334444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.334543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.334866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.335166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.335315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.335469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.335617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.335774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.335913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.336059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.336214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.336362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.336509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.336677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.336826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.336987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.337134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.337307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.337451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.337592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.337742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.337881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.338025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.338186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.338364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.338515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.338667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.338826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.338979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.339123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.339264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.339412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.339552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.339702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.339854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.340000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.340139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.340286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.340432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.340571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.340720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.340893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.341049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.341196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.341367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.341507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.341693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.341816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.342011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.342123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.342346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.342462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.342670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.342763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.342986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.343079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.343298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.343399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.343611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.343703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.343918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.344060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.344217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.344318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.344521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.344620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.344829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.344950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.345134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.345291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.345443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.345536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.345751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.345852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.346071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.346240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.346430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.346570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.346758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.346903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.347106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.347415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.347510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.347731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.347879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.348030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.348176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.348343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.348478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.348655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.348801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.348950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.349106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.349256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.349400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.349573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.349719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.349883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.350035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.350176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.350346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.350483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.350623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.350772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.350918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.351075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.351208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.351379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.351485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.351687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.351783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.351987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.352089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.352288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.352386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.352587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.352702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.352887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.352988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.353184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.353295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.353503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.353597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.353806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.353907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.354113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.354229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.354436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.354580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.354735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.354830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.355080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.355226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.355382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.355492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.355713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.355814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.356019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.356136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.356326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.356437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.356633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.356735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.357303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.357403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.357614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.357870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.357965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.358183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.358347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.358530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.358627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.358816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.358917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.359121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.359229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.359431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.359526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.359740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.359839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.360045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.360146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.360349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.360445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.360654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.360755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.361060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.361165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.361265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.361353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.361568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.361663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.361902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.361996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.362229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.362366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.362569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.362685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.362933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.363026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.363250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.363349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.363564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.363656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.363869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.363970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.364179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.364344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.364494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.364663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.364806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.364949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.365097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.365339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.365485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.365587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.365683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.365768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.365966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.366068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.366320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.366432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.366621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.366722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.366938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.367035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.367241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.367369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.367550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.367654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.367874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.368205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.368511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.368818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.369138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.369446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.369751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.370062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.370387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.370563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.370710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.370854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.370995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.371179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.371349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.371514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.371659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.371853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.371995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.372148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.372302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.372442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.372583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.372732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.372878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.373019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.373175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.373336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.373486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.373626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.373768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.373923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.374070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.374212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.374485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.374662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.374810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.374967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.375133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.375271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.375366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.375536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.375687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.375838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.375984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.376124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.376274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.376415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.376585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.376740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.376907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.377000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.377207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.377379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.377526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.377683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.377826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.377988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.378144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.378392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.378597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.378755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.378918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.379065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.379234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.379370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.379555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.379692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.379859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.380002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.380179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.380323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.380483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.380652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.380797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.380937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.381076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.381230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.381422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.381514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.381663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.381765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.381971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.382073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.382317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.382411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.382620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.382711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.382928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.383031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.383239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.383352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.383536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.383644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.383843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.383945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.384158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.384265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.384528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.384751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.384912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.385087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.385228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.385399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.385565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.385696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.385839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.386038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.386187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.386382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.386530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.386710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.386841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.387034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.387162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.387342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.387490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.387643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.387807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.387949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.388158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.388293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.388506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.388612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.388784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.388879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.389111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.389211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.389415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.389531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.389714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.389809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.390019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.390125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.390340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.390449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.390647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.390747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.390951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.391074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.391247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.391367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.391556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.391653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.391856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.391949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.392160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.392253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.392461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.392564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.392863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.392962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.393187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.393301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.393551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.393768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.393873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.394190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.394316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.394572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.394822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.395061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.395221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.395394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.395559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.395713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.395890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.395991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.396080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.396286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.396380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.396480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.396569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.396708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.396825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.397009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.397144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.397311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.397449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.397611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.397755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.397918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.398068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.398223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.398397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.398557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.398705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.398864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.399002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.399169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.399315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.399476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.399626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.399783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.399931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.400082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.400236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.400388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.400542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.400692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.400863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.401024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.401171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.401298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.401483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.401622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.401791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.401884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.402115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.402208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.402456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.402653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.402782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.402903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.403061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.403163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.403368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.403470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.403760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.403871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.403967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.404055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.404264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.404366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.404563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.404656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.404867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.404984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.405180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.405294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.405478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.405574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.405796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.405890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.406104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.406199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.406432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.406527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.406733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.406829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.407038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.407141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.407336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.407437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.407635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.407746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.407938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.408031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.408264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.408366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.408615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.408748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.408927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.409065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.409233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.409338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.409562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.409673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.409872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.409967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.410190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.410324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.410530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.410646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.410839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.410933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.411138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.411234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.411438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.411584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.411741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.411909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.412059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.412208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.412365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.412505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.412652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.412800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.412940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.413080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.413235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.413375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.413528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.413668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.413827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.413985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.414143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.414300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.414437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.414588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.414729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.414885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.415033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.415172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.415320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.415485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.415724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.415967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.416107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.416245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.416386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.416558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.416705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.416855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.416996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.417135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.417277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.417425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.417579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.417729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.417878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.418018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.418167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.418338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.418493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.418641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.418810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.418955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.419123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.419263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.419419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.419569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.419717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.419862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.420002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.420149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.420298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.420439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.420578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.420726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.420874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.421022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.421206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.421354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.421513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.421651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.421790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.421935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.422073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.422213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.422371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.422509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.422648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.422799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.422947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.423094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.423252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.423391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.423532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.423689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.423835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.423974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.424119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.424217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.424364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.424468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.424688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.424783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.424997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.425134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.425353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.425458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.425661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.425819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.425964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.426101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.426290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.426387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.426599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.426702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.426902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.427030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.427208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.427392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.427662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.427754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.427968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.428154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.428337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.428496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.428646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.428805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.428953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.429104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.429278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.429459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.429631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.429796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.429965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.430144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.430362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.430571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.430715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.430830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.430940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.431138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.431253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.431406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.431531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.431643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.431754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.431876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.431988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.432110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.432230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.432342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.432526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.432655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.432825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.432946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.433288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.433603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.433915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.434187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.434361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.434481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.434594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.434769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.434881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.435207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.435342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.435474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.435622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.435788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.435924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.436093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.436228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.436530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.436629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.436845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.436947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.437160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.437262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.437470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.437562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.437784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.437878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.438087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.438188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.438425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.438521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.438736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.438831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.439044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.439135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.439366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.439458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.439777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.439869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.440092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.440237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.440405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.440550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.440705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.440866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.441030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.441171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.441323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.441478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.441632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.441779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.441939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.442124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.442299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.442475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.442627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.442788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.442930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.443112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.443249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.443440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.443593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.443742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.443885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.444044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.444186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.444425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.444574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.444716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.444856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.445007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.445154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.445295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.445452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.445600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.445776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.445934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.446099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.446194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.446427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.446534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.446728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.446831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.447029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.447130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.447341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.447432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.447638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.447731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.447957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.448049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.448265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.448357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.448581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.448681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.448889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.448990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.449188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.449287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.449506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.449609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.449815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.449967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.450124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.450253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.450423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.450584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.450774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.450927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.451069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.451216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.451375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.451550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.451696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.451866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.452038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.452174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.452369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.452489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.452678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.452807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.453027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.453233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.453364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.453487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.453658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.453779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.453966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.454088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.454410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.454674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.454807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.454930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.455053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.455167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.455285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.455399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.484551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.484551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.485004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.485247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.485379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.485379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.485628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.485802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.486015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.486239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.486533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.486746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.486951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.487188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.487383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.487609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.487609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.488038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.488240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.488240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.488240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.488740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.488866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.488968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.489061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.489160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.489327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.489442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.489565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.489686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.489787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.489896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.490009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.490112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.490240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.490378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.490501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.490691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.490920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.491220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.491220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.491220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.491220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.491220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.492259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.492479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.492479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.492884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.493147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.493391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.493616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.493833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.494044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.494259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.494533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.494745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.494982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.495552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.495687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.495808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.495973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.496941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.497946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.498014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.498089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.498149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.498206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.498206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.498425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.498573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.498907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.499054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.499197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.499306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.499400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.499513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.499646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.499763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.499889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.499990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.500116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.500233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.500373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.500592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.500701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.500821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.500948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.501058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.501058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.501240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.501340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.501454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.501587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.501703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.501810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.501931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.502008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.502130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.502266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.502384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.502477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.502620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.502724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.502820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.502925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.503972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.504970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.505132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.505266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.505342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.505401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.505524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.505653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.505749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.505850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.505930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.506948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.507995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.508728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.509937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.510985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.511901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.512971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.513953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.514946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.515985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.516974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.517972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.518984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.519990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.520073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.520245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.520345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.520503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.520631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.520808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.520894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.521111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.521206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.521421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.521502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.521737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.521818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.522046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.522137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.522371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.522457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.522674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.522755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.522989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.523072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.523292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.523372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.523594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.523675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.523896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.523977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.524196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.524277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.524501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.524582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.524800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.524882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.525100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.525181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.525399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.525486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.525699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.525778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.526001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.526151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.526326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.526503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.526633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.526796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.526922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.527047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.527173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.527307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.527472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.527600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.527770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.527897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.528068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.528204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.528394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.528518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.528724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.528850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.529035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.529218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.529358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.529556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.529667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.529855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.529985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.530180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.530369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.530519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.530616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.530846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.530945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.531169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.531249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.531482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.531561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.531807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.531887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.532119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.532198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.532434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.532512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.532744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.532825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.533051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.533130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.533356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.533435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.533663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.533745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.533987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.534066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.534308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.534390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.534650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.534733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.534974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.535053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.535289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.535377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.535604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.535684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.535905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.535982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.536211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.536297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.536516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.536593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.536823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.536902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.537126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.537212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.537428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.537505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.537730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.537808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.538031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.538109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.538359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.538454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.538664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.538742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.538967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.539046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.539272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.539350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.539579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.539679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.539890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.540013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.540195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.540304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.540501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.540596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.540803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.540954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.541107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.541188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.541408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.541495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.541740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.541819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.542075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.542154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.542413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.542508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.542724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.542802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.543035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.543115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.543336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.543423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.543574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 17:30:57.543654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.543954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.544277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.544590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.544898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.545236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.545551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.545863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.546178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.546517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.546828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.547137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.547467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.547794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.548101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.548426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.548746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.549065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.549388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.549702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.550082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.550421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.550761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.551073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.551408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.551723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.552041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.552352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.552664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.552982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.553298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.553624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.553948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.554260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.554608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.554937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.555284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.555598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.555941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.556269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.556585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.556895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.557202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 05 17:30:57.557446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 05 17:30:57.605233 n-d-835595-3 devstack@n-api.service[128843]: INFO dbcounter [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Registered counter for database nova_api Oct 05 17:30:57.621845 n-d-835595-3 devstack@n-api.service[128844]: INFO dbcounter [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Registered counter for database nova_api Oct 05 17:30:57.626622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_db.sqlalchemy.engines [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:30:57.633723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writer thread running {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:30:57.642581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_db.sqlalchemy.engines [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:30:57.649723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writer thread running {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:30:57.690263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.context [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) {{(pid=128843) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 17:30:57.694567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:30:57.695045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:30:57.696628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:30:57.697345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:30:57.697785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:30:57.699822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:30:57.701885 n-d-835595-3 devstack@n-api.service[128843]: INFO dbcounter [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Registered counter for database nova_cell0 Oct 05 17:30:57.706127 n-d-835595-3 devstack@n-api.service[128843]: INFO dbcounter [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Registered counter for database nova_cell1 Oct 05 17:30:57.710010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.context [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) {{(pid=128844) load_cells /opt/stack/nova/nova/context.py:464}} Oct 05 17:30:57.713872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_db.sqlalchemy.engines [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:30:57.714319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:30:57.714828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:30:57.718932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writer thread running {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:30:57.719570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_db.sqlalchemy.engines [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:30:57.720042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:30:57.720970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:30:57.721591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:30:57.723891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:30:57.726210 n-d-835595-3 devstack@n-api.service[128844]: INFO dbcounter [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Registered counter for database nova_cell0 Oct 05 17:30:57.730429 n-d-835595-3 devstack@n-api.service[128844]: INFO dbcounter [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Registered counter for database nova_cell1 Oct 05 17:30:57.738551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_db.sqlalchemy.engines [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:30:57.741221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_db.sqlalchemy.engines [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:30:57.749449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writer thread running {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:30:57.749787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writer thread running {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:30:57.863725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writer thread running {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:30:57.872734 n-d-835595-3 devstack@n-api.service[128843]: INFO dbcounter [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Registered counter for database nova_cell0 Oct 05 17:30:57.880453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_db.sqlalchemy.engines [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:30:57.885414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writer thread running {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:30:57.899859 n-d-835595-3 devstack@n-api.service[128844]: INFO dbcounter [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Registered counter for database nova_cell0 Oct 05 17:30:57.910140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_db.sqlalchemy.engines [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 05 17:30:57.916598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writer thread running {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 05 17:30:58.206234 n-d-835595-3 devstack@n-api.service[128843]: WARNING keystonemiddleware.auth_token [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 17:30:58.213799 n-d-835595-3 devstack@n-api.service[128843]: WARNING keystonemiddleware.auth_token [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 17:30:58.244619 n-d-835595-3 devstack@n-api.service[128844]: WARNING keystonemiddleware.auth_token [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 17:30:58.252230 n-d-835595-3 devstack@n-api.service[128844]: WARNING keystonemiddleware.auth_token [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 17:30:58.559690 n-d-835595-3 devstack@n-api.service[128843]: WARNING keystonemiddleware.auth_token [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 17:30:58.565919 n-d-835595-3 devstack@n-api.service[128843]: WARNING keystonemiddleware.auth_token [None req-1fd10a97-b7fc-4149-bc8e-cd19c8e23c8e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 17:30:58.571189 n-d-835595-3 devstack@n-api.service[128843]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5583502a79c0 pid: 128843 (default app) Oct 05 17:30:58.600056 n-d-835595-3 devstack@n-api.service[128844]: WARNING keystonemiddleware.auth_token [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 05 17:30:58.606259 n-d-835595-3 devstack@n-api.service[128844]: WARNING keystonemiddleware.auth_token [None req-8ebd877b-2b7c-4edb-8597-f45fe1d2d749 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 05 17:30:58.612073 n-d-835595-3 devstack@n-api.service[128844]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5583502a79c0 pid: 128844 (default app) Oct 05 17:31:38.453076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:38.454096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:38.455280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:38.456151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:38.482941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:38.483933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:38.485286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:38.486711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:39.581551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1181886055", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:31:39.597614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Calling method '.version_select at 0x7f7776d304c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:39.605025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) {{(pid=128844) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 05 17:31:39.605756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:39.606234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:39.606717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:39.635170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:39.636131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:39.636572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:39.650884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:39.651369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:39.651806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:39.657936 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0d887f41-69cd-483e-b8a8-1314ce4126d1 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 1.181854 Oct 05 17:31:39.658711 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1/1] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:31:38 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:39.884500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '.version_select at 0x7f7776d44670>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:39.886402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:39.886936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:39.887439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:39.902574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:39.903057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:39.903488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:39.914188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:39.914692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:39.915112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:39.920948 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.261086 Oct 05 17:31:39.921519 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2/2] 10.222.0.70 () {58 vars in 1167 bytes} [Wed Oct 5 17:31:39 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:39.922540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:39.923580 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2a07ab1-9dce-4111-88c1-eb1b64afea74 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001224 Oct 05 17:31:39.923819 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3/3] 10.222.0.70 () {56 vars in 886 bytes} [Wed Oct 5 17:31:39 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 05 17:31:40.005349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:31:40.027577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-178d24f3-80c1-422a-8854-77fa9a09536f tempest-AZAdminNegativeTestJSON-1473671016 tempest-AZAdminNegativeTestJSON-1473671016-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:40.029073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-178d24f3-80c1-422a-8854-77fa9a09536f tempest-AZAdminNegativeTestJSON-1473671016 tempest-AZAdminNegativeTestJSON-1473671016-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'e4a834500bdb4200ad3fc7c7081b40b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6031ef1903144b184f3e21e4a6827a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-178d24f3-80c1-422a-8854-77fa9a09536f tempest-AZAdminNegativeTestJSON-1473671016 tempest-AZAdminNegativeTestJSON-1473671016-project] Request method failure captured: Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb95lf_4Gui-jiVc6oNhU4gks6dMKplGc6a7Qf-1QreLlwJ4zJhRa3ixew8arXtWBZXcZ8COAqOC2FpkzTzI6r1qgh5s6L048ywAwcksX9kbBHy0AHGQaAWGBOFMDfFV87AF_jy2WIUrXJFWG8TrhA3u1xJhhvlyXrjh-_IULemrriA Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: a6031ef1903144b184f3e21e4a6827a8 Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1473671016 Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:31:40.033769 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a6031ef1903144b184f3e21e4a6827a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a6031ef1903144b184f3e21e4a6827a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a6031ef1903144b184f3e21e4a6827a8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a6031ef1903144b184f3e21e4a6827a8"}]}] Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AZAdminNegativeTestJSON-1473671016 Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: a6031ef1903144b184f3e21e4a6827a8 Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1473671016 Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AZAdminNegativeTestJSON-1473671016-project Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: e4a834500bdb4200ad3fc7c7081b40b6 Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AZAdminNegativeTestJSON-1473671016-project Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 05 17:31:40.035267 n-d-835595-3 devstack@n-api.service[128844]: action_args: {} Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:31:40.036020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:31:40.037075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-178d24f3-80c1-422a-8854-77fa9a09536f tempest-AZAdminNegativeTestJSON-1473671016 tempest-AZAdminNegativeTestJSON-1473671016-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:31:40.037997 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-178d24f3-80c1-422a-8854-77fa9a09536f tempest-AZAdminNegativeTestJSON-1473671016 tempest-AZAdminNegativeTestJSON-1473671016-project] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.110470 Oct 05 17:31:40.040138 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4/4] 10.222.0.70 () {58 vars in 1185 bytes} [Wed Oct 5 17:31:39 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 115 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:31:40.044956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Calling method '.version_select at 0x7f7776bb54c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:40.046708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.047188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.047737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.070105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.070635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.071064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.121274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.121830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.122593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.132299 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e94d192e-2cfa-47fe-a962-8163b50e4398 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h2-835595-3/servers" status: 200 len: 104 microversion: 2.1 time: 0.090752 Oct 05 17:31:40.133325 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 5/5] 10.222.0.70 () {58 vars in 1212 bytes} [Wed Oct 5 17:31:40 2022] GET /compute/v2.1/os-hypervisors/n-h2-835595-3/servers => generated 104 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:40.426568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:31:40.426983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:31:40.427457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:31:40.428096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:31:40.428599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:31:40.444113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c15860d1-3ead-4fda-aeb3-2d7eb8b6f8c0 tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:40.445768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c15860d1-3ead-4fda-aeb3-2d7eb8b6f8c0 tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.446588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c15860d1-3ead-4fda-aeb3-2d7eb8b6f8c0 tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.447188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c15860d1-3ead-4fda-aeb3-2d7eb8b6f8c0 tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.447920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c15860d1-3ead-4fda-aeb3-2d7eb8b6f8c0 tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.448374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c15860d1-3ead-4fda-aeb3-2d7eb8b6f8c0 tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.448940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c15860d1-3ead-4fda-aeb3-2d7eb8b6f8c0 tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.458790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.461555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.462077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.464521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.464986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.465407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.490915 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c15860d1-3ead-4fda-aeb3-2d7eb8b6f8c0 tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.356055 Oct 05 17:31:40.491811 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 6/6] 10.222.0.70 () {58 vars in 1164 bytes} [Wed Oct 5 17:31:40 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:31:40.512274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Getting quotas for project 8cbe7c9e993940f7a9ee263e9fce0745. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:31:40.518360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Getting quotas for user cebd216a206f494197bf0b71d294cb01 and project 8cbe7c9e993940f7a9ee263e9fce0745. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:31:40.531008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:31:40.534119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:31:40.611920 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b6c78ded-28e3-41c0-bd40-6907c6af69d5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.168324 Oct 05 17:31:40.613532 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1/7] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:31:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:31:40.633775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8108a8d7-8887-4869-b1a2-f8f461eb4f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:40.639266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8108a8d7-8887-4869-b1a2-f8f461eb4f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.639901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8108a8d7-8887-4869-b1a2-f8f461eb4f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.640196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8108a8d7-8887-4869-b1a2-f8f461eb4f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.640926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8108a8d7-8887-4869-b1a2-f8f461eb4f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.641446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8108a8d7-8887-4869-b1a2-f8f461eb4f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.642074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8108a8d7-8887-4869-b1a2-f8f461eb4f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.666583 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8108a8d7-8887-4869-b1a2-f8f461eb4f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.173502 Oct 05 17:31:40.667192 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 7/8] 10.222.0.70 () {58 vars in 1176 bytes} [Wed Oct 5 17:31:40 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:40.681819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b98c39c-0db3-48c7-b24a-0df7227847a4 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-69234323", "name": "tempest-test_aggregate-1705109267"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:31:40.727902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-6b98c39c-0db3-48c7-b24a-0df7227847a4 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Generated uuid 362ec323-7ea1-4fe2-ab1d-61ea3adb9f8c for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:31:40.823945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Calling method '.version_select at 0x7f7776324f70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:40.835708 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b98c39c-0db3-48c7-b24a-0df7227847a4 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.167190 Oct 05 17:31:40.845119 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 8/9] 10.222.0.70 () {60 vars in 1165 bytes} [Wed Oct 5 17:31:40 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:40.849551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) {{(pid=128843) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 05 17:31:40.850621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Calling method '.version_select at 0x7f7776b34dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:40.851193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.853444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.853561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.854046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.855237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.866188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.872951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.873469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.873897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.888573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.889121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.889613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.898710 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d91969e-8564-4fb5-80e9-a256c5f2d355 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052252 Oct 05 17:31:40.899391 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 9/10] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:31:40 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:40.912124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a70db84-fe97-4932-9a0e-4b02ae2dd2ab tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:40.914003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a70db84-fe97-4932-9a0e-4b02ae2dd2ab tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.914563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a70db84-fe97-4932-9a0e-4b02ae2dd2ab tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.915001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a70db84-fe97-4932-9a0e-4b02ae2dd2ab tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.915769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a70db84-fe97-4932-9a0e-4b02ae2dd2ab tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.916351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a70db84-fe97-4932-9a0e-4b02ae2dd2ab tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.916772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a70db84-fe97-4932-9a0e-4b02ae2dd2ab tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.949308 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a70db84-fe97-4932-9a0e-4b02ae2dd2ab tempest-AZAdminV2TestJSON-926884519 tempest-AZAdminV2TestJSON-926884519-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.048712 Oct 05 17:31:40.949525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.949807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.950252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:40.959881 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 10/11] 10.222.0.70 () {58 vars in 1185 bytes} [Wed Oct 5 17:31:40 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:40.965850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30b3293d-ec0e-403a-b65b-d4352eba1f93 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:40.966948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-30b3293d-ec0e-403a-b65b-d4352eba1f93 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:40.981983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:40.985198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:40.988060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:41.015248 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4027671a-a7c7-4c9c-a120-b365784bf944 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.396000 Oct 05 17:31:41.022517 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2/12] 10.222.0.70 () {60 vars in 1208 bytes} [Wed Oct 5 17:31:40 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:31:41.026687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ae559a7-4647-4801-ada2-92ae7ee88448 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:41.058797 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2ae559a7-4647-4801-ada2-92ae7ee88448 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 299 microversion: 2.1 time: 0.038257 Oct 05 17:31:41.059383 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3/13] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:31:41 2022] GET /compute/v2.1/os-aggregates => generated 299 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:41.064948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-799bbeb8-8cf9-421e-8855-ed77b2684ee6 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Calling method '.version_select at 0x7f77762ea670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:41.068315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-799bbeb8-8cf9-421e-8855-ed77b2684ee6 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:41.069007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-799bbeb8-8cf9-421e-8855-ed77b2684ee6 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:41.069448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-799bbeb8-8cf9-421e-8855-ed77b2684ee6 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:41.088520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-799bbeb8-8cf9-421e-8855-ed77b2684ee6 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:41.089005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-799bbeb8-8cf9-421e-8855-ed77b2684ee6 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:41.089628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-799bbeb8-8cf9-421e-8855-ed77b2684ee6 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:41.096952 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-799bbeb8-8cf9-421e-8855-ed77b2684ee6 tempest-HypervisorAdminUnderV252Test-341815599 tempest-HypervisorAdminUnderV252Test-341815599-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h2-835595-3/search" status: 200 len: 104 microversion: 2.1 time: 0.036380 Oct 05 17:31:41.098307 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 4/14] 10.222.0.70 () {58 vars in 1209 bytes} [Wed Oct 5 17:31:41 2022] GET /compute/v2.1/os-hypervisors/n-h2-835595-3/search => generated 104 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:41.103681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6bf36e2f-244d-4491-8a01-fef5b251fa4a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-835595-3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:31:41.141879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf36e2f-244d-4491-8a01-fef5b251fa4a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:41.142428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf36e2f-244d-4491-8a01-fef5b251fa4a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:41.142868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf36e2f-244d-4491-8a01-fef5b251fa4a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:42.319903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-30b3293d-ec0e-403a-b65b-d4352eba1f93 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:42.336625 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-30b3293d-ec0e-403a-b65b-d4352eba1f93 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1220 microversion: 2.1 time: 1.375297 Oct 05 17:31:42.337864 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 11/15] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:40 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1220 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:42.460013 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6bf36e2f-244d-4491-8a01-fef5b251fa4a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 311 microversion: 2.1 time: 1.359815 Oct 05 17:31:42.465517 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 5/16] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:31:41 2022] POST /compute/v2.1/os-aggregates/1/action => generated 311 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:43.074442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-549778075", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "availability_zone": "tempest-test_az-69234323"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:31:43.106114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:43.106625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:43.107226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:43.108396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:43.108845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:43.109258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:43.201453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:31:43.363950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-09f8d6e7-9b16-49b7-be9b-4ac67fbc3af0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:43.365186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-09f8d6e7-9b16-49b7-be9b-4ac67fbc3af0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:43.403677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09f8d6e7-9b16-49b7-be9b-4ac67fbc3af0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:43.404238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09f8d6e7-9b16-49b7-be9b-4ac67fbc3af0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:43.404875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09f8d6e7-9b16-49b7-be9b-4ac67fbc3af0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:43.405650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09f8d6e7-9b16-49b7-be9b-4ac67fbc3af0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:43.406147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09f8d6e7-9b16-49b7-be9b-4ac67fbc3af0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:43.415981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09f8d6e7-9b16-49b7-be9b-4ac67fbc3af0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:43.631993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09f8d6e7-9b16-49b7-be9b-4ac67fbc3af0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:43.639550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:31:43.640040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:31:43.640441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:31:43.641130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:31:43.641250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:31:43.652988 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-09f8d6e7-9b16-49b7-be9b-4ac67fbc3af0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1278 microversion: 2.1 time: 0.296459 Oct 05 17:31:43.662310 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 6/17] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:43 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1278 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:31:43.681269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:43.682160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:43.682947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:43.684020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:43.685328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:43.686447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:43.732895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Getting quotas for project a103a4e230044899bb4f3e07d7d406b7. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:31:43.743998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Getting quotas for user e06a2990dd7b4defb1a1a7345e5511a9 and project a103a4e230044899bb4f3e07d7d406b7. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:31:43.763940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:31:43.769258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:31:43.879550 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc8178ed-fcbe-4faa-8024-d486310efa01 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.161008 Oct 05 17:31:43.881620 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 12/18] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:31:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:31:43.896241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c7f9d6f1-13f8-4bcb-a116-0375f579aad2 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:43.897949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c7f9d6f1-13f8-4bcb-a116-0375f579aad2 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:44.031562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7f9d6f1-13f8-4bcb-a116-0375f579aad2 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:44.052868 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c7f9d6f1-13f8-4bcb-a116-0375f579aad2 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1240 microversion: 2.1 time: 0.163704 Oct 05 17:31:44.053478 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 7/19] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:43 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1240 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:31:44.680877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1fbb9083-8471-470d-96c9-5226a00aa4fb tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:44.682673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1fbb9083-8471-470d-96c9-5226a00aa4fb tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:44.691901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbb9083-8471-470d-96c9-5226a00aa4fb tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:44.692638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbb9083-8471-470d-96c9-5226a00aa4fb tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:44.693263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbb9083-8471-470d-96c9-5226a00aa4fb tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:44.694253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbb9083-8471-470d-96c9-5226a00aa4fb tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:44.695136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbb9083-8471-470d-96c9-5226a00aa4fb tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:44.695765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbb9083-8471-470d-96c9-5226a00aa4fb tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:45.076956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ba2b0b05-aa77-4adc-a16c-61b02a7eefc4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:45.077584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ba2b0b05-aa77-4adc-a16c-61b02a7eefc4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:45.095372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b05-aa77-4adc-a16c-61b02a7eefc4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:45.097433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b05-aa77-4adc-a16c-61b02a7eefc4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:45.100168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b05-aa77-4adc-a16c-61b02a7eefc4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:45.101163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1fbb9083-8471-470d-96c9-5226a00aa4fb tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:45.104214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b05-aa77-4adc-a16c-61b02a7eefc4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:45.105019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b05-aa77-4adc-a16c-61b02a7eefc4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:45.106491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba2b0b05-aa77-4adc-a16c-61b02a7eefc4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:45.158265 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1fbb9083-8471-470d-96c9-5226a00aa4fb tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.480911 Oct 05 17:31:45.170883 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 13/20] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:44 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:31:45.282478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ba2b0b05-aa77-4adc-a16c-61b02a7eefc4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:45.303530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ba2b0b05-aa77-4adc-a16c-61b02a7eefc4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1240 microversion: 2.1 time: 0.225417 Oct 05 17:31:45.304799 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 8/21] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:45 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1240 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:46.188764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7d767288-4b32-4522-b077-9906c4ee3d39 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:46.189566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7d767288-4b32-4522-b077-9906c4ee3d39 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:46.199012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d767288-4b32-4522-b077-9906c4ee3d39 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:46.202331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d767288-4b32-4522-b077-9906c4ee3d39 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:46.203423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d767288-4b32-4522-b077-9906c4ee3d39 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:46.205456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d767288-4b32-4522-b077-9906c4ee3d39 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:46.206800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d767288-4b32-4522-b077-9906c4ee3d39 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:46.207729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d767288-4b32-4522-b077-9906c4ee3d39 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:46.329043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-170d3db4-99a0-4d74-9d52-4d427f1f577b tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:46.329806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-170d3db4-99a0-4d74-9d52-4d427f1f577b tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:46.351815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-170d3db4-99a0-4d74-9d52-4d427f1f577b tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:46.352593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-170d3db4-99a0-4d74-9d52-4d427f1f577b tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:46.353195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-170d3db4-99a0-4d74-9d52-4d427f1f577b tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:46.354088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-170d3db4-99a0-4d74-9d52-4d427f1f577b tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:46.354752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-170d3db4-99a0-4d74-9d52-4d427f1f577b tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:46.355324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-170d3db4-99a0-4d74-9d52-4d427f1f577b tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:46.473338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-170d3db4-99a0-4d74-9d52-4d427f1f577b tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:46.488054 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-170d3db4-99a0-4d74-9d52-4d427f1f577b tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1294 microversion: 2.1 time: 0.161496 Oct 05 17:31:46.489541 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 9/22] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:46 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1294 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:31:46.824814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7d767288-4b32-4522-b077-9906c4ee3d39 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:46.843574 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7d767288-4b32-4522-b077-9906c4ee3d39 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.660036 Oct 05 17:31:46.845444 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 14/23] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:46 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:47.514268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-09a14bb7-df39-4f06-a824-4a173c2f67a1 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:47.516096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-09a14bb7-df39-4f06-a824-4a173c2f67a1 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:47.535133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09a14bb7-df39-4f06-a824-4a173c2f67a1 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:47.538346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09a14bb7-df39-4f06-a824-4a173c2f67a1 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:47.543790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09a14bb7-df39-4f06-a824-4a173c2f67a1 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:47.545110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09a14bb7-df39-4f06-a824-4a173c2f67a1 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:47.548371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09a14bb7-df39-4f06-a824-4a173c2f67a1 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:47.548779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09a14bb7-df39-4f06-a824-4a173c2f67a1 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:47.730668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09a14bb7-df39-4f06-a824-4a173c2f67a1 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:47.749681 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-09a14bb7-df39-4f06-a824-4a173c2f67a1 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1294 microversion: 2.1 time: 0.240122 Oct 05 17:31:47.751270 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 10/24] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:47 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1294 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:47.871131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-592facf2-2dd0-47cb-88f0-a3e949299ee3 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:47.871938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-592facf2-2dd0-47cb-88f0-a3e949299ee3 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:47.890465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-592facf2-2dd0-47cb-88f0-a3e949299ee3 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:47.897979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-592facf2-2dd0-47cb-88f0-a3e949299ee3 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:47.901001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-592facf2-2dd0-47cb-88f0-a3e949299ee3 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:47.902631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-592facf2-2dd0-47cb-88f0-a3e949299ee3 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:47.911633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-592facf2-2dd0-47cb-88f0-a3e949299ee3 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:47.917516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-592facf2-2dd0-47cb-88f0-a3e949299ee3 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:48.385292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-96392b33-7658-48a8-bc8d-6193b8f4f190 tempest-FlavorsV261TestJSON-589950338 tempest-FlavorsV261TestJSON-589950338-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1898911069", "id": 1521423355, "os-flavor-access:is_public": "True"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:31:48.469991 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-96392b33-7658-48a8-bc8d-6193b8f4f190 tempest-FlavorsV261TestJSON-589950338 tempest-FlavorsV261TestJSON-589950338-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.844728 Oct 05 17:31:48.483638 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 15/25] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:31:47 2022] POST /compute/v2.1/flavors => generated 468 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:31:48.601134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Calling method '.version_select at 0x7f777611fdc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:48.604439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:48.605541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:48.607694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:48.644840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:48.647954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:48.649414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:48.685557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:48.686320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:48.686999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:48.703029 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d67cd6d-8bbd-4fb7-81c9-335c10373046 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.226620 Oct 05 17:31:48.705798 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 16/26] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:31:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:48.864370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-592facf2-2dd0-47cb-88f0-a3e949299ee3 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:48.881468 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-592facf2-2dd0-47cb-88f0-a3e949299ee3 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 1.015321 Oct 05 17:31:48.884423 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 11/27] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:47 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:48.897140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Calling method '.version_select at 0x7f777618c160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:48.903334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:48.904408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:48.905298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:48.985622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:48.985622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:48.985622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:49.002710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:49.003508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:49.004194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:49.020437 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3083ec4e-ea4e-43d0-b495-4c32c16667fd tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.134063 Oct 05 17:31:49.038072 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 12/28] 10.222.0.70 () {58 vars in 1167 bytes} [Wed Oct 5 17:31:48 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:49.044923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00b2e586-5c56-48ec-8e00-6c1949876d95 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:49.045784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00b2e586-5c56-48ec-8e00-6c1949876d95 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:49.054784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b2e586-5c56-48ec-8e00-6c1949876d95 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:49.055672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b2e586-5c56-48ec-8e00-6c1949876d95 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:49.056378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b2e586-5c56-48ec-8e00-6c1949876d95 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:49.057728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b2e586-5c56-48ec-8e00-6c1949876d95 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:49.058666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b2e586-5c56-48ec-8e00-6c1949876d95 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:49.059303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b2e586-5c56-48ec-8e00-6c1949876d95 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:49.458956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2879a8c-3359-4a05-a5db-489f9d2819d4 tempest-FlavorsV261TestJSON-1657017975 tempest-FlavorsV261TestJSON-1657017975-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:49.492114 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2879a8c-3359-4a05-a5db-489f9d2819d4 tempest-FlavorsV261TestJSON-1657017975 tempest-FlavorsV261TestJSON-1657017975-project] 10.222.0.70 "GET /compute/v2.1/flavors/1521423355" status: 200 len: 468 microversion: 2.61 time: 0.781186 Oct 05 17:31:49.492877 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 17/29] 10.222.0.70 () {60 vars in 1199 bytes} [Wed Oct 5 17:31:48 2022] GET /compute/v2.1/flavors/1521423355 => generated 468 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:31:49.499979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Calling method '.version_select at 0x7f7776169dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:49.501971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:49.507235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:49.508031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:49.541587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:49.543535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:49.545793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:49.584396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:49.585145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:49.585771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:49.602491 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0e4398e7-2cdd-4d97-8370-091a252d975f tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.108141 Oct 05 17:31:49.603445 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 18/30] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:31:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:49.615416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79d18fc3-ba2b-43d3-af15-bc0fdea9464b tempest-FlavorsV261TestJSON-589950338 tempest-FlavorsV261TestJSON-589950338-project-admin] Action: 'update', calling method: .version_select at 0x7f77770eab80>, body: {"flavor": {"description": "new"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:31:49.757462 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79d18fc3-ba2b-43d3-af15-bc0fdea9464b tempest-FlavorsV261TestJSON-589950338 tempest-FlavorsV261TestJSON-589950338-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1521423355" status: 200 len: 469 microversion: 2.61 time: 0.148659 Oct 05 17:31:49.765276 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 19/31] 10.222.0.70 () {62 vars in 1219 bytes} [Wed Oct 5 17:31:49 2022] PUT /compute/v2.1/flavors/1521423355 => generated 469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:31:49.784752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1d621ff-4b72-466d-8076-de441a40b075 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Calling method '.version_select at 0x7f777613fa60>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:49.789459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d621ff-4b72-466d-8076-de441a40b075 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:49.790853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d621ff-4b72-466d-8076-de441a40b075 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:49.793803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d621ff-4b72-466d-8076-de441a40b075 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:49.833969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d621ff-4b72-466d-8076-de441a40b075 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:49.834879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d621ff-4b72-466d-8076-de441a40b075 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:49.835623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d621ff-4b72-466d-8076-de441a40b075 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:49.846573 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f1d621ff-4b72-466d-8076-de441a40b075 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.079941 Oct 05 17:31:49.853754 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 20/32] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:31:49 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:50.140845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Calling method '.version_select at 0x7f777613f550>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:50.144130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.146252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.146872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.185699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-00b2e586-5c56-48ec-8e00-6c1949876d95 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:50.194813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.194813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.194813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.224125 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00b2e586-5c56-48ec-8e00-6c1949876d95 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 1.181878 Oct 05 17:31:50.226478 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 13/33] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:49 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:50.233258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9a0e4316-a51b-4350-84d1-44c2cf63cfb5 tempest-FlavorsV261TestJSON-1657017975 tempest-FlavorsV261TestJSON-1657017975-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:50.248769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.249530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.250159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.283439 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-351b1247-c012-4d4d-8153-367fc1667624 tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.426095 Oct 05 17:31:50.290875 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 21/34] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:31:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:31:50.305139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b1922d5-770e-4767-b2cf-3662accef84a tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Calling method '.version_select at 0x7f777613ff70>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:50.313555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b1922d5-770e-4767-b2cf-3662accef84a tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.314937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b1922d5-770e-4767-b2cf-3662accef84a tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.317759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b1922d5-770e-4767-b2cf-3662accef84a tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.354731 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9a0e4316-a51b-4350-84d1-44c2cf63cfb5 tempest-FlavorsV261TestJSON-1657017975 tempest-FlavorsV261TestJSON-1657017975-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.126783 Oct 05 17:31:50.365887 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 14/35] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:31:50 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:31:50.385628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a22c6394-65ac-4735-a900-8976773d835e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:50.387515 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b1922d5-770e-4767-b2cf-3662accef84a tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.094765 Oct 05 17:31:50.392299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a22c6394-65ac-4735-a900-8976773d835e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:50.397483 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 22/36] 10.222.0.70 () {58 vars in 1179 bytes} [Wed Oct 5 17:31:50 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:50.407533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9057f4f9-5daa-4b3b-a985-4774926f3e8d tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Calling method '.version_select at 0x7f777613fc10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:50.411173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9057f4f9-5daa-4b3b-a985-4774926f3e8d tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.411979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9057f4f9-5daa-4b3b-a985-4774926f3e8d tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.412676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9057f4f9-5daa-4b3b-a985-4774926f3e8d tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.414378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a22c6394-65ac-4735-a900-8976773d835e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.414887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a22c6394-65ac-4735-a900-8976773d835e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.415371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a22c6394-65ac-4735-a900-8976773d835e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.417286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a22c6394-65ac-4735-a900-8976773d835e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.417755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a22c6394-65ac-4735-a900-8976773d835e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.418181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a22c6394-65ac-4735-a900-8976773d835e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.445683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9057f4f9-5daa-4b3b-a985-4774926f3e8d tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.447360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9057f4f9-5daa-4b3b-a985-4774926f3e8d tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.451073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9057f4f9-5daa-4b3b-a985-4774926f3e8d tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.469835 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9057f4f9-5daa-4b3b-a985-4774926f3e8d tempest-HypervisorAdminV228Test-639979834 tempest-HypervisorAdminV228Test-639979834-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.069417 Oct 05 17:31:50.479199 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 23/37] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Oct 5 17:31:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:31:50.485134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-867f3f48-f9e4-4b40-87fe-cea46d972e9f tempest-FlavorsV261TestJSON-1657017975 tempest-FlavorsV261TestJSON-1657017975-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:50.514543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:50.573309 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-867f3f48-f9e4-4b40-87fe-cea46d972e9f tempest-FlavorsV261TestJSON-1657017975 tempest-FlavorsV261TestJSON-1657017975-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.091360 Oct 05 17:31:50.589756 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 24/38] 10.222.0.70 () {60 vars in 1166 bytes} [Wed Oct 5 17:31:50 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:31:50.606448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Calling method '.version_select at 0x7f7776068d30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:50.608629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.609548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.610193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.654176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.655184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.655783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.678833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:50.688993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.694762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.699563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.716834 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-20a3736b-c309-4966-9454-36842c5a69d5 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.127997 Oct 05 17:31:50.724683 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 25/39] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:31:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:50.730069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8460f967-8869-4c00-a786-80db94ba48b8 tempest-FlavorsV261TestJSON-589950338 tempest-FlavorsV261TestJSON-589950338-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:50.796743 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8460f967-8869-4c00-a786-80db94ba48b8 tempest-FlavorsV261TestJSON-589950338 tempest-FlavorsV261TestJSON-589950338-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1521423355" status: 202 len: 0 microversion: 2.61 time: 0.070654 Oct 05 17:31:50.800568 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 26/40] 10.222.0.70 () {60 vars in 1202 bytes} [Wed Oct 5 17:31:50 2022] DELETE /compute/v2.1/flavors/1521423355 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:31:50.805528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2320b2c7-951d-4e88-b721-1f237af8f26c tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Calling method '.version_select at 0x7f777611fdc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:50.809256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2320b2c7-951d-4e88-b721-1f237af8f26c tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.812173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2320b2c7-951d-4e88-b721-1f237af8f26c tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.812799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2320b2c7-951d-4e88-b721-1f237af8f26c tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.847955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2320b2c7-951d-4e88-b721-1f237af8f26c tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:50.848746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2320b2c7-951d-4e88-b721-1f237af8f26c tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:50.849365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2320b2c7-951d-4e88-b721-1f237af8f26c tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:50.865424 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2320b2c7-951d-4e88-b721-1f237af8f26c tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.061779 Oct 05 17:31:50.871529 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 27/41] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:31:50 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:50.876282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-533d8731-efef-48bc-ae71-e0c282d82edc tempest-FlavorsV261TestJSON-589950338 tempest-FlavorsV261TestJSON-589950338-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:50.962758 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-533d8731-efef-48bc-ae71-e0c282d82edc tempest-FlavorsV261TestJSON-589950338 tempest-FlavorsV261TestJSON-589950338-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.084317 Oct 05 17:31:50.968821 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 28/42] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:31:50 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:31:51.102039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a22c6394-65ac-4735-a900-8976773d835e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:51.117737 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a22c6394-65ac-4735-a900-8976773d835e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.747066 Oct 05 17:31:51.118727 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 15/43] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:50 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:51.123512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5492dbc1-dd65-4114-8a43-0ca211b0b03b tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Calling method '.version_select at 0x7f77761c1a60>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:51.136611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5492dbc1-dd65-4114-8a43-0ca211b0b03b tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.137469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5492dbc1-dd65-4114-8a43-0ca211b0b03b tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.138147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5492dbc1-dd65-4114-8a43-0ca211b0b03b tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.173781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5492dbc1-dd65-4114-8a43-0ca211b0b03b tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.174834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5492dbc1-dd65-4114-8a43-0ca211b0b03b tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.175597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5492dbc1-dd65-4114-8a43-0ca211b0b03b tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.202958 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5492dbc1-dd65-4114-8a43-0ca211b0b03b tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.074731 Oct 05 17:31:51.208179 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 16/44] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:31:51 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:51.237857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Calling method '.version_select at 0x7f777627fee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:51.240487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.241149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.241776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.259141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.259984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.260935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.290587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.292103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.292859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.300586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquiring lock "compute-rpcapi-router" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:31:51.301338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6580ce2a-00db-4431-8969-393e67054df1 tempest-HypervisorAdminTestJSON-1032669345 tempest-HypervisorAdminTestJSON-1032669345-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:31:51.303007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daf7ff03-36d6-43db-aa44-2f5800e6a6d5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.303823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daf7ff03-36d6-43db-aa44-2f5800e6a6d5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.304519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daf7ff03-36d6-43db-aa44-2f5800e6a6d5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.305755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daf7ff03-36d6-43db-aa44-2f5800e6a6d5 None None] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.306677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daf7ff03-36d6-43db-aa44-2f5800e6a6d5 None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.307612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daf7ff03-36d6-43db-aa44-2f5800e6a6d5 None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.321444 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.compute.rpcapi [None req-daf7ff03-36d6-43db-aa44-2f5800e6a6d5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 05 17:31:51.322993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daf7ff03-36d6-43db-aa44-2f5800e6a6d5 None None] Releasing lock "compute-rpcapi-router" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:31:51.449572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-16060b9d-e332-4429-8a49-f3f081df47f1 req-3fc09779-ef4c-4fbc-b580-1243aebbfa57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74cc75f1-6210-49f8-bc81-cba60f855ea8", "tag": "568c3446-5b6b-40e0-bad9-f9888300fca6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:31:51.482300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-16060b9d-e332-4429-8a49-f3f081df47f1 req-3fc09779-ef4c-4fbc-b580-1243aebbfa57 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.483336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-16060b9d-e332-4429-8a49-f3f081df47f1 req-3fc09779-ef4c-4fbc-b580-1243aebbfa57 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.483543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-16060b9d-e332-4429-8a49-f3f081df47f1 req-3fc09779-ef4c-4fbc-b580-1243aebbfa57 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.489982 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-daf7ff03-36d6-43db-aa44-2f5800e6a6d5 None None] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.269080 Oct 05 17:31:51.498224 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 17/45] 10.222.0.70 () {58 vars in 1173 bytes} [Wed Oct 5 17:31:51 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:31:51.506526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-075b9deb-5416-4361-b2b7-b7785cf28686 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:51.507944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-075b9deb-5416-4361-b2b7-b7785cf28686 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:51.523549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-075b9deb-5416-4361-b2b7-b7785cf28686 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.524599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-075b9deb-5416-4361-b2b7-b7785cf28686 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.525472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-075b9deb-5416-4361-b2b7-b7785cf28686 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.530704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-075b9deb-5416-4361-b2b7-b7785cf28686 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.532272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-075b9deb-5416-4361-b2b7-b7785cf28686 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.533013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-075b9deb-5416-4361-b2b7-b7785cf28686 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.564857 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-16060b9d-e332-4429-8a49-f3f081df47f1 req-3fc09779-ef4c-4fbc-b580-1243aebbfa57 service nova] Creating event network-changed:568c3446-5b6b-40e0-bad9-f9888300fca6 for instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 on n-h2-835595-3 Oct 05 17:31:51.565513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-16060b9d-e332-4429-8a49-f3f081df47f1 req-3fc09779-ef4c-4fbc-b580-1243aebbfa57 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:31:51.568616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-16060b9d-e332-4429-8a49-f3f081df47f1 req-3fc09779-ef4c-4fbc-b580-1243aebbfa57 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:31:51.570498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb2a6d7f-5e77-41d7-a5dd-daa86bbd03ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.571769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb2a6d7f-5e77-41d7-a5dd-daa86bbd03ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.572229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb2a6d7f-5e77-41d7-a5dd-daa86bbd03ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.573004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb2a6d7f-5e77-41d7-a5dd-daa86bbd03ed None None] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:51.573454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb2a6d7f-5e77-41d7-a5dd-daa86bbd03ed None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:51.573872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb2a6d7f-5e77-41d7-a5dd-daa86bbd03ed None None] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:51.608322 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.rpcapi [None req-eb2a6d7f-5e77-41d7-a5dd-daa86bbd03ed None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 05 17:31:51.615828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb2a6d7f-5e77-41d7-a5dd-daa86bbd03ed None None] Releasing lock "compute-rpcapi-router" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:31:51.671952 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb2a6d7f-5e77-41d7-a5dd-daa86bbd03ed None None] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.686248 Oct 05 17:31:51.679636 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 29/46] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:52.145525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5d50ca0-424e-4230-bb32-4b4d2a36b41d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:52.146619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5d50ca0-424e-4230-bb32-4b4d2a36b41d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:52.162571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d50ca0-424e-4230-bb32-4b4d2a36b41d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:52.163302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d50ca0-424e-4230-bb32-4b4d2a36b41d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:52.163889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d50ca0-424e-4230-bb32-4b4d2a36b41d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:52.164794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d50ca0-424e-4230-bb32-4b4d2a36b41d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:52.165381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d50ca0-424e-4230-bb32-4b4d2a36b41d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:52.165939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d50ca0-424e-4230-bb32-4b4d2a36b41d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:52.401954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-075b9deb-5416-4361-b2b7-b7785cf28686 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:52.411172 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-075b9deb-5416-4361-b2b7-b7785cf28686 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.911103 Oct 05 17:31:52.418861 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 18/47] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:51 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:52.715306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5d50ca0-424e-4230-bb32-4b4d2a36b41d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:52.738406 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5d50ca0-424e-4230-bb32-4b4d2a36b41d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.594340 Oct 05 17:31:52.742400 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 30/48] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:52 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:31:53.196240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-00f71d01-82a7-4a00-b2f7-364f2274acc6 req-f9841f33-b177-4f42-812e-13de28553a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0bdcb64-ff16-45b4-aa53-bf5e5963957b", "tag": "f7299bac-8095-4a7c-8b6b-f90db404747c"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:31:53.225752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-00f71d01-82a7-4a00-b2f7-364f2274acc6 req-f9841f33-b177-4f42-812e-13de28553a93 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:53.226244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-00f71d01-82a7-4a00-b2f7-364f2274acc6 req-f9841f33-b177-4f42-812e-13de28553a93 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:53.226712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-00f71d01-82a7-4a00-b2f7-364f2274acc6 req-f9841f33-b177-4f42-812e-13de28553a93 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:53.264986 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-00f71d01-82a7-4a00-b2f7-364f2274acc6 req-f9841f33-b177-4f42-812e-13de28553a93 service nova] Creating event network-changed:f7299bac-8095-4a7c-8b6b-f90db404747c for instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b on n-h1-835595-3 Oct 05 17:31:53.271129 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-00f71d01-82a7-4a00-b2f7-364f2274acc6 req-f9841f33-b177-4f42-812e-13de28553a93 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193388 Oct 05 17:31:53.272339 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 19/49] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:31:53.454863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63413a4f-8b7b-4aec-9a04-99e9968be416 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:53.456107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63413a4f-8b7b-4aec-9a04-99e9968be416 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:53.473613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63413a4f-8b7b-4aec-9a04-99e9968be416 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:53.475236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63413a4f-8b7b-4aec-9a04-99e9968be416 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:53.476028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63413a4f-8b7b-4aec-9a04-99e9968be416 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:53.476973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63413a4f-8b7b-4aec-9a04-99e9968be416 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:53.477734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63413a4f-8b7b-4aec-9a04-99e9968be416 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:53.478644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63413a4f-8b7b-4aec-9a04-99e9968be416 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:53.727657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63413a4f-8b7b-4aec-9a04-99e9968be416 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:53.745190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:53.755215 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63413a4f-8b7b-4aec-9a04-99e9968be416 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.306691 Oct 05 17:31:53.756397 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 31/50] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:53 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:31:53.780341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d43ad375-f70e-48f9-9edf-a8362834bbb0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:53.781153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d43ad375-f70e-48f9-9edf-a8362834bbb0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:53.788291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d43ad375-f70e-48f9-9edf-a8362834bbb0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:53.789129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d43ad375-f70e-48f9-9edf-a8362834bbb0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:53.789715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d43ad375-f70e-48f9-9edf-a8362834bbb0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:53.790590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d43ad375-f70e-48f9-9edf-a8362834bbb0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:53.798105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d43ad375-f70e-48f9-9edf-a8362834bbb0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:53.798823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d43ad375-f70e-48f9-9edf-a8362834bbb0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:54.053779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:54.720254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d43ad375-f70e-48f9-9edf-a8362834bbb0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:54.729530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d43ad375-f70e-48f9-9edf-a8362834bbb0 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.958834 Oct 05 17:31:54.732711 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 20/51] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:53 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:54.781733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-44993a29-af8e-4f05-9ed8-d17cab624c7e tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:54.782437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-44993a29-af8e-4f05-9ed8-d17cab624c7e tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:54.784649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:54.791650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44993a29-af8e-4f05-9ed8-d17cab624c7e tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:54.792500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44993a29-af8e-4f05-9ed8-d17cab624c7e tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:54.793176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44993a29-af8e-4f05-9ed8-d17cab624c7e tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:54.794225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44993a29-af8e-4f05-9ed8-d17cab624c7e tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:54.794854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44993a29-af8e-4f05-9ed8-d17cab624c7e tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:54.795474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44993a29-af8e-4f05-9ed8-d17cab624c7e tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:55.311186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-44993a29-af8e-4f05-9ed8-d17cab624c7e tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:55.325078 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-44993a29-af8e-4f05-9ed8-d17cab624c7e tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.547213 Oct 05 17:31:55.327396 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 32/52] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:54 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:55.760543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47910eb3-3f79-4ae6-aca6-c64298839b66 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:55.761676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47910eb3-3f79-4ae6-aca6-c64298839b66 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:55.774086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47910eb3-3f79-4ae6-aca6-c64298839b66 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:55.791533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47910eb3-3f79-4ae6-aca6-c64298839b66 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:55.793975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47910eb3-3f79-4ae6-aca6-c64298839b66 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:55.795127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47910eb3-3f79-4ae6-aca6-c64298839b66 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:55.798727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47910eb3-3f79-4ae6-aca6-c64298839b66 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:55.799960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47910eb3-3f79-4ae6-aca6-c64298839b66 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:56.267528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-47910eb3-3f79-4ae6-aca6-c64298839b66 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:56.276557 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47910eb3-3f79-4ae6-aca6-c64298839b66 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.520823 Oct 05 17:31:56.280094 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 21/53] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:55 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:56.348180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a0d7f26b-d22f-49a7-b0f2-43ec7a571cc9 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:56.349476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a0d7f26b-d22f-49a7-b0f2-43ec7a571cc9 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:56.360513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d7f26b-d22f-49a7-b0f2-43ec7a571cc9 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:56.362983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d7f26b-d22f-49a7-b0f2-43ec7a571cc9 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:56.363649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d7f26b-d22f-49a7-b0f2-43ec7a571cc9 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:56.370029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d7f26b-d22f-49a7-b0f2-43ec7a571cc9 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:56.370979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d7f26b-d22f-49a7-b0f2-43ec7a571cc9 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:56.371631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d7f26b-d22f-49a7-b0f2-43ec7a571cc9 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:56.685774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a0d7f26b-d22f-49a7-b0f2-43ec7a571cc9 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:56.697277 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a0d7f26b-d22f-49a7-b0f2-43ec7a571cc9 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.353453 Oct 05 17:31:56.700517 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 33/54] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:56 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:57.307557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ba8b7ddc-c418-4264-9819-f0aee2ac0536 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:57.309196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ba8b7ddc-c418-4264-9819-f0aee2ac0536 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:57.323860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba8b7ddc-c418-4264-9819-f0aee2ac0536 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:57.324567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba8b7ddc-c418-4264-9819-f0aee2ac0536 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:57.326677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba8b7ddc-c418-4264-9819-f0aee2ac0536 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:57.327868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba8b7ddc-c418-4264-9819-f0aee2ac0536 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:57.331418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba8b7ddc-c418-4264-9819-f0aee2ac0536 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:57.332042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba8b7ddc-c418-4264-9819-f0aee2ac0536 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:57.389552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:31:57.723282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3554d7a9-699f-45ea-bb76-7e89bc9f4ba3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:57.724159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3554d7a9-699f-45ea-bb76-7e89bc9f4ba3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:57.749573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3554d7a9-699f-45ea-bb76-7e89bc9f4ba3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:57.753296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3554d7a9-699f-45ea-bb76-7e89bc9f4ba3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:57.753296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3554d7a9-699f-45ea-bb76-7e89bc9f4ba3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:57.754511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3554d7a9-699f-45ea-bb76-7e89bc9f4ba3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:57.755981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3554d7a9-699f-45ea-bb76-7e89bc9f4ba3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:57.757624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3554d7a9-699f-45ea-bb76-7e89bc9f4ba3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:57.893861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ba8b7ddc-c418-4264-9819-f0aee2ac0536 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:57.910971 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ba8b7ddc-c418-4264-9819-f0aee2ac0536 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.607898 Oct 05 17:31:57.912816 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 22/55] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:57 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:58.103834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3554d7a9-699f-45ea-bb76-7e89bc9f4ba3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:58.113728 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3554d7a9-699f-45ea-bb76-7e89bc9f4ba3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.395320 Oct 05 17:31:58.125308 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 34/56] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:57 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:58.938388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-af386a76-a789-4b32-9eea-892b5c14bcb4 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:58.939168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-af386a76-a789-4b32-9eea-892b5c14bcb4 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:58.958656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af386a76-a789-4b32-9eea-892b5c14bcb4 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:58.959328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af386a76-a789-4b32-9eea-892b5c14bcb4 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:58.959771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af386a76-a789-4b32-9eea-892b5c14bcb4 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:58.960507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af386a76-a789-4b32-9eea-892b5c14bcb4 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:58.960966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af386a76-a789-4b32-9eea-892b5c14bcb4 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:58.966781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af386a76-a789-4b32-9eea-892b5c14bcb4 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:59.141435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81871129-b0c3-4202-aa47-276c94ec7dcf tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:31:59.142741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-81871129-b0c3-4202-aa47-276c94ec7dcf tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:31:59.158565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81871129-b0c3-4202-aa47-276c94ec7dcf tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:59.159370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81871129-b0c3-4202-aa47-276c94ec7dcf tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:59.159955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81871129-b0c3-4202-aa47-276c94ec7dcf tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:59.161768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81871129-b0c3-4202-aa47-276c94ec7dcf tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:31:59.162410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81871129-b0c3-4202-aa47-276c94ec7dcf tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:31:59.163001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81871129-b0c3-4202-aa47-276c94ec7dcf tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:31:59.702762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81871129-b0c3-4202-aa47-276c94ec7dcf tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:59.726410 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81871129-b0c3-4202-aa47-276c94ec7dcf tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.588543 Oct 05 17:31:59.738371 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 35/57] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:59 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:31:59.813318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-af386a76-a789-4b32-9eea-892b5c14bcb4 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:31:59.837018 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-af386a76-a789-4b32-9eea-892b5c14bcb4 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.894000 Oct 05 17:31:59.842405 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 23/58] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:31:58 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:00.773013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4ba31b1a-85ea-4d09-aa30-7384855255ab tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:00.775708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4ba31b1a-85ea-4d09-aa30-7384855255ab tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:00.807181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ba31b1a-85ea-4d09-aa30-7384855255ab tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:00.808674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ba31b1a-85ea-4d09-aa30-7384855255ab tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:00.810897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ba31b1a-85ea-4d09-aa30-7384855255ab tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:00.815396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ba31b1a-85ea-4d09-aa30-7384855255ab tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:00.817760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ba31b1a-85ea-4d09-aa30-7384855255ab tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:00.820674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ba31b1a-85ea-4d09-aa30-7384855255ab tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:00.870129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab3c1bb3-c4f6-4af2-8b50-961157510d09 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:00.873752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ab3c1bb3-c4f6-4af2-8b50-961157510d09 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:00.918976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab3c1bb3-c4f6-4af2-8b50-961157510d09 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:00.920157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab3c1bb3-c4f6-4af2-8b50-961157510d09 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:00.922397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab3c1bb3-c4f6-4af2-8b50-961157510d09 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:00.924577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab3c1bb3-c4f6-4af2-8b50-961157510d09 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:00.928842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab3c1bb3-c4f6-4af2-8b50-961157510d09 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:00.931266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab3c1bb3-c4f6-4af2-8b50-961157510d09 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:01.320050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:01.406410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ab3c1bb3-c4f6-4af2-8b50-961157510d09 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:01.418246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ab3c1bb3-c4f6-4af2-8b50-961157510d09 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.556440 Oct 05 17:32:01.428440 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 24/59] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:00 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:01.505812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4ba31b1a-85ea-4d09-aa30-7384855255ab tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:01.516536 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4ba31b1a-85ea-4d09-aa30-7384855255ab tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.752622 Oct 05 17:32:01.517442 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 36/60] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:00 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:01.601196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=12 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:01.906603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Calling method '.version_select at 0x7f77760780d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:01.915841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:01.916347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:01.919463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:01.968532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Calling method '.version_select at 0x7f77760523a0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:01.970648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:01.971148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:01.971749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:01.978423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:01.978931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:01.979373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.009748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.013301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.013816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.043560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.046581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.048553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.064059 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1cdf6b26-15d9-4a77-ad72-55123d34a4ac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.545510 Oct 05 17:32:02.064673 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 37/61] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:01 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:02.076097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.076597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.077036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.096674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.097248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.098217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.124533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.125035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.125479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.134205 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c08a46a-3acc-492f-a9bf-6e6787982106 tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.704334 Oct 05 17:32:02.147499 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 25/62] 10.222.0.70 () {60 vars in 1243 bytes} [Wed Oct 5 17:32:01 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:02.156417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Calling method '.version_select at 0x7f77760fb1f0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.162719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.163223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.163826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.180036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.180548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.181098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.205353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.205852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.206426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.218980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.219676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.220369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.244196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.244749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.245958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.254483 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6ee592ab-8e2b-4045-ab8d-16043ad597cc tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.104039 Oct 05 17:32:02.255076 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 26/63] 10.222.0.70 () {60 vars in 1222 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:02.314073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-82d075b0-27fe-4a13-b49a-8a4acf7c8016 tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306 tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.317628 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-82d075b0-27fe-4a13-b49a-8a4acf7c8016 tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306 tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 05 17:32:02.318442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8612c40b-6b33-4f55-8207-41fd99220d2c tempest-HypervisorAdminNegativeUnderV252Test-1582831113 tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project] Calling method '.version_select at 0x7f7776052a60>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.320884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8612c40b-6b33-4f55-8207-41fd99220d2c tempest-HypervisorAdminNegativeUnderV252Test-1582831113 tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'cb08c5ad3c96449ba1143aa7c9c24f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37234b6489343fda60c13c3a79b050c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-82d075b0-27fe-4a13-b49a-8a4acf7c8016 tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306 tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306-project-admin] Request method failure captured: Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-SA5i8ToOZopQyZSSR-oDehW2nqDMT4cGkA7jdMOq6Ov3E5b7y1t8lSNSVxY0HwvOr6sshd86cAit-ukTjvtXzedBgR47y9hp6cECa4P3KL1eAr1ZdYJACdcuL_EHh07OYmvET2QGhEMb2IJMtnPSrbIlV-OIkhRkp9a7a34J6H4o Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 2363d8dc046b496a8aa5422763bbb2b5 Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306 Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:02.323955 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2363d8dc046b496a8aa5422763bbb2b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2363d8dc046b496a8aa5422763bbb2b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2363d8dc046b496a8aa5422763bbb2b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2363d8dc046b496a8aa5422763bbb2b5"}]}] Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306 Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 2363d8dc046b496a8aa5422763bbb2b5 Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306 Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306-project-admin Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: c6e2773366fa431aaf8ddccf8e13fa8d Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306-project-admin Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:02.325097 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid timestamp for date invalid_time Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'invalid_time'} Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:02.325711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 05 17:32:02.326783 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8612c40b-6b33-4f55-8207-41fd99220d2c tempest-HypervisorAdminNegativeUnderV252Test-1582831113 tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project] Request method failure captured: Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hypervisors/n-h2-835595-3/search HTTP/1.1 Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-OWopiOHMVK-pXO165i6bxgmB35TBBxIkFyd_noxGaCNXFvLcKMV0NoEC4Xrf6YUgnaE0IOETUGKSpBoUOPiNGfQAiHDVMVXdMiDtcclyBX-feIN4w0G69glzx6pb_f914cFvNOXtxIH8Mhf3vRWkk9gMJJYLS4XoXXBzbflf9TjA Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: b37234b6489343fda60c13c3a79b050c Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1582831113 Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:02.327482 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b37234b6489343fda60c13c3a79b050c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b37234b6489343fda60c13c3a79b050c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b37234b6489343fda60c13c3a79b050c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b37234b6489343fda60c13c3a79b050c"}]}] Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1582831113 Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: b37234b6489343fda60c13c3a79b050c Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1582831113 Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: cb08c5ad3c96449ba1143aa7c9c24f1e Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 05 17:32:02.328530 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'n-h2-835595-3'} Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:02.329882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 05 17:32:02.332139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.333733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8612c40b-6b33-4f55-8207-41fd99220d2c tempest-HypervisorAdminNegativeUnderV252Test-1582831113 tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:02.333733 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8612c40b-6b33-4f55-8207-41fd99220d2c tempest-HypervisorAdminNegativeUnderV252Test-1582831113 tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/n-h2-835595-3/search" status: 403 len: 117 microversion: 2.1 time: 0.252267 Oct 05 17:32:02.334938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-82d075b0-27fe-4a13-b49a-8a4acf7c8016 tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306 tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:02.335962 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-82d075b0-27fe-4a13-b49a-8a4acf7c8016 tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306 tempest-InstanceUsageAuditLogNegativeTestJSON-1851439306-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.079629 Oct 05 17:32:02.336466 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 38/64] 10.222.0.70 () {58 vars in 1209 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/os-hypervisors/n-h2-835595-3/search => generated 117 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:02.337153 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 27/65] 10.222.0.70 () {58 vars in 1224 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:32:02.344321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1aa34528-4896-4247-b25f-a9adcf3370ef tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Calling method '.version_select at 0x7f77760a91f0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.344730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-de2c9ea6-dd68-473c-8e35-81037691f16f tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Calling method '.version_select at 0x7f77760680d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.346095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1aa34528-4896-4247-b25f-a9adcf3370ef tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.346648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1aa34528-4896-4247-b25f-a9adcf3370ef tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.347141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1aa34528-4896-4247-b25f-a9adcf3370ef tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.349098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de2c9ea6-dd68-473c-8e35-81037691f16f tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.349840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de2c9ea6-dd68-473c-8e35-81037691f16f tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.350390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de2c9ea6-dd68-473c-8e35-81037691f16f tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.354256 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-1aa34528-4896-4247-b25f-a9adcf3370ef tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1aa34528-4896-4247-b25f-a9adcf3370ef tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Request method failure captured: Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-Q74ENy1ZrrqwmETFmY3f32srcQOXzXZVM7u5hgZOSUtEgnOn19zykkSb6wG4AeOqqrA-nan1qUv63uq62E1LKUhvLLZg44RibNgOonUn8-3CypJXO8zQh2LXkw0uRFKB3q73BL6dY4ex9Hs67zzZIAKUnJv7PXv6cYP6r-hVXiP8 Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 24296ce873d34e16a541a0bbf17d4058 Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-526613936 Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:02.356421 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24296ce873d34e16a541a0bbf17d4058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24296ce873d34e16a541a0bbf17d4058"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24296ce873d34e16a541a0bbf17d4058", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24296ce873d34e16a541a0bbf17d4058"}]}] Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-526613936 Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 24296ce873d34e16a541a0bbf17d4058 Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-526613936 Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cef96cf6df5342159d1951453ad99ee0 Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 05 17:32:02.358132 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.359055 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.360677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.360677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:02.360677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:02.360677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 05 17:32:02.360677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.361842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1aa34528-4896-4247-b25f-a9adcf3370ef tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:02.362902 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1aa34528-4896-4247-b25f-a9adcf3370ef tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.024525 Oct 05 17:32:02.363925 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 28/66] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:02.376358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de2c9ea6-dd68-473c-8e35-81037691f16f tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.376934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de2c9ea6-dd68-473c-8e35-81037691f16f tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.377450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de2c9ea6-dd68-473c-8e35-81037691f16f tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.385233 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-de2c9ea6-dd68-473c-8e35-81037691f16f tempest-HypervisorAdminV253TestBase-1574777855 tempest-HypervisorAdminV253TestBase-1574777855-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/d8000268-e766-41a8-bf22-5e2b4366689b" status: 200 len: 792 microversion: 2.53 time: 0.047210 Oct 05 17:32:02.385863 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 39/67] 10.222.0.70 () {60 vars in 1298 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/os-hypervisors/d8000268-e766-41a8-bf22-5e2b4366689b => generated 792 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:02.390969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Calling method '.version_select at 0x7f7776bdb550>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.392814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.393500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.394244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.417202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.418085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.418922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.433298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.434127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.434761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.442987 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b348d81-eb5a-440e-a05f-935ebc147eac tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.055365 Oct 05 17:32:02.450485 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 40/68] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:02.458021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5c96324-6c6e-426c-90b3-1e2f9717d4d7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.458885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5c96324-6c6e-426c-90b3-1e2f9717d4d7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:02.466562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c96324-6c6e-426c-90b3-1e2f9717d4d7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.467290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c96324-6c6e-426c-90b3-1e2f9717d4d7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.467883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c96324-6c6e-426c-90b3-1e2f9717d4d7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.468759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c96324-6c6e-426c-90b3-1e2f9717d4d7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.469362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c96324-6c6e-426c-90b3-1e2f9717d4d7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.469930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c96324-6c6e-426c-90b3-1e2f9717d4d7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.542121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69531d60-f35f-44ff-a095-63ec9fe2731d tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.544877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-69531d60-f35f-44ff-a095-63ec9fe2731d tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'ef365d701d464a578ba07c5ea8f09032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38fb2c8e104447b402590bdd1d8f72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69531d60-f35f-44ff-a095-63ec9fe2731d tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project] Request method failure captured: Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-QGdpUIg54WdrUm3TS9ZxWQxiTZs3acjFKIpPzRds5oCjfps5bN4I4AZr1cgGPu_ui_sBJLUK9qs4bcnOqMEjhwXHgjNM6V7CdR7KAhbnvtB9niFt1Q_2HKw5MGa54fhZPntfKiMHiOBMY2QGfO9-5E0usy7Jzl-KGEyh-9vfoTf0 Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 0f38fb2c8e104447b402590bdd1d8f72 Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:02.546834 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:02.547959 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0f38fb2c8e104447b402590bdd1d8f72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0f38fb2c8e104447b402590bdd1d8f72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0f38fb2c8e104447b402590bdd1d8f72", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0f38fb2c8e104447b402590bdd1d8f72"}]}] Oct 05 17:32:02.547959 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 Oct 05 17:32:02.547959 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 0f38fb2c8e104447b402590bdd1d8f72 Oct 05 17:32:02.547959 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 Oct 05 17:32:02.547959 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project Oct 05 17:32:02.547959 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:02.547959 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:02.547959 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: ef365d701d464a578ba07c5ea8f09032 Oct 05 17:32:02.547959 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project Oct 05 17:32:02.547959 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: action_args: {} Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:02.548510 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 05 17:32:02.549603 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.551312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69531d60-f35f-44ff-a095-63ec9fe2731d tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:02.551312 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69531d60-f35f-44ff-a095-63ec9fe2731d tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.183243 Oct 05 17:32:02.551312 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 29/69] 10.222.0.70 () {58 vars in 1185 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 185 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:02.554225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ce32064-3b19-42a4-bd76-d9ff322f5d17 tempest-HypervisorAdminNegativeUnderV252Test-1582831113 tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project] Calling method '.version_select at 0x7f77761cfb80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.557604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6ce32064-3b19-42a4-bd76-d9ff322f5d17 tempest-HypervisorAdminNegativeUnderV252Test-1582831113 tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'cb08c5ad3c96449ba1143aa7c9c24f1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b37234b6489343fda60c13c3a79b050c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ce32064-3b19-42a4-bd76-d9ff322f5d17 tempest-HypervisorAdminNegativeUnderV252Test-1582831113 tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project] Request method failure captured: Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-OWopiOHMVK-pXO165i6bxgmB35TBBxIkFyd_noxGaCNXFvLcKMV0NoEC4Xrf6YUgnaE0IOETUGKSpBoUOPiNGfQAiHDVMVXdMiDtcclyBX-feIN4w0G69glzx6pb_f914cFvNOXtxIH8Mhf3vRWkk9gMJJYLS4XoXXBzbflf9TjA Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: b37234b6489343fda60c13c3a79b050c Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1582831113 Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:02.559260 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b37234b6489343fda60c13c3a79b050c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b37234b6489343fda60c13c3a79b050c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b37234b6489343fda60c13c3a79b050c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b37234b6489343fda60c13c3a79b050c"}]}] Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1582831113 Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: b37234b6489343fda60c13c3a79b050c Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1582831113 Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cb08c5ad3c96449ba1143aa7c9c24f1e Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 05 17:32:02.560660 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '1'} Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:02.561359 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 05 17:32:02.563496 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.564668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ce32064-3b19-42a4-bd76-d9ff322f5d17 tempest-HypervisorAdminNegativeUnderV252Test-1582831113 tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:02.564668 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6ce32064-3b19-42a4-bd76-d9ff322f5d17 tempest-HypervisorAdminNegativeUnderV252Test-1582831113 tempest-HypervisorAdminNegativeUnderV252Test-1582831113-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.010270 Oct 05 17:32:02.564668 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 30/70] 10.222.0.70 () {58 vars in 1176 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:02.567476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea55c740-ca4f-44e7-ad3a-78bbe2218b74 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.568151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ea55c740-ca4f-44e7-ad3a-78bbe2218b74 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:02.576243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea55c740-ca4f-44e7-ad3a-78bbe2218b74 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.576968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea55c740-ca4f-44e7-ad3a-78bbe2218b74 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.577554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea55c740-ca4f-44e7-ad3a-78bbe2218b74 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.578774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea55c740-ca4f-44e7-ad3a-78bbe2218b74 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.579376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea55c740-ca4f-44e7-ad3a-78bbe2218b74 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.579983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea55c740-ca4f-44e7-ad3a-78bbe2218b74 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.752302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f5c96324-6c6e-426c-90b3-1e2f9717d4d7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:02.762616 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5c96324-6c6e-426c-90b3-1e2f9717d4d7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.310460 Oct 05 17:32:02.763716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ea55c740-ca4f-44e7-ad3a-78bbe2218b74 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:02.763839 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 41/71] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:02.769389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6507ffc0-a743-4575-8df3-32d3a229be93 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.771397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6507ffc0-a743-4575-8df3-32d3a229be93 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'ef365d701d464a578ba07c5ea8f09032', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f38fb2c8e104447b402590bdd1d8f72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:02.772004 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ea55c740-ca4f-44e7-ad3a-78bbe2218b74 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.209353 Oct 05 17:32:02.772595 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 31/72] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6507ffc0-a743-4575-8df3-32d3a229be93 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project] Request method failure captured: Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-05%2017:32:02 HTTP/1.1 Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-QGdpUIg54WdrUm3TS9ZxWQxiTZs3acjFKIpPzRds5oCjfps5bN4I4AZr1cgGPu_ui_sBJLUK9qs4bcnOqMEjhwXHgjNM6V7CdR7KAhbnvtB9niFt1Q_2HKw5MGa54fhZPntfKiMHiOBMY2QGfO9-5E0usy7Jzl-KGEyh-9vfoTf0 Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 0f38fb2c8e104447b402590bdd1d8f72 Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:02.773868 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:02.775062 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0f38fb2c8e104447b402590bdd1d8f72"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0f38fb2c8e104447b402590bdd1d8f72"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0f38fb2c8e104447b402590bdd1d8f72", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0f38fb2c8e104447b402590bdd1d8f72"}]}] Oct 05 17:32:02.775062 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 Oct 05 17:32:02.775062 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 0f38fb2c8e104447b402590bdd1d8f72 Oct 05 17:32:02.775062 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 Oct 05 17:32:02.775062 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project Oct 05 17:32:02.775062 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:02.775062 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:02.775062 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: ef365d701d464a578ba07c5ea8f09032 Oct 05 17:32:02.775062 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project Oct 05 17:32:02.775062 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '2022-10-05 17:32:02'} Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:02.775579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 05 17:32:02.776965 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.777814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6507ffc0-a743-4575-8df3-32d3a229be93 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:02.777814 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6507ffc0-a743-4575-8df3-32d3a229be93 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994 tempest-InstanceUsageAuditLogNegativeTestJSON-1687217994-project] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-05 17:32:02" status: 403 len: 128 microversion: 2.1 time: 0.010816 Oct 05 17:32:02.779970 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 42/73] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-05%2017%3A32%3A02 => generated 128 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:02.791450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5ba1ce0c-a6e2-4e83-8bf9-ee3b4f9c8d3f tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Calling method '.version_select at 0x7f77760633a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:02.793570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ba1ce0c-a6e2-4e83-8bf9-ee3b4f9c8d3f tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:02.794460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ba1ce0c-a6e2-4e83-8bf9-ee3b4f9c8d3f tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:02.795052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ba1ce0c-a6e2-4e83-8bf9-ee3b4f9c8d3f tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:02.801991 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-5ba1ce0c-a6e2-4e83-8bf9-ee3b4f9c8d3f tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] HTTP exception thrown: No hypervisor matching 'f4797b6e-3989-4c5d-b8b2-437291be3441' could be found. Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5ba1ce0c-a6e2-4e83-8bf9-ee3b4f9c8d3f tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Request method failure captured: Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-hypervisors/f4797b6e-3989-4c5d-b8b2-437291be3441/servers HTTP/1.1 Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-Q74ENy1ZrrqwmETFmY3f32srcQOXzXZVM7u5hgZOSUtEgnOn19zykkSb6wG4AeOqqrA-nan1qUv63uq62E1LKUhvLLZg44RibNgOonUn8-3CypJXO8zQh2LXkw0uRFKB3q73BL6dY4ex9Hs67zzZIAKUnJv7PXv6cYP6r-hVXiP8 Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 24296ce873d34e16a541a0bbf17d4058 Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-526613936 Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:02.803847 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24296ce873d34e16a541a0bbf17d4058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24296ce873d34e16a541a0bbf17d4058"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24296ce873d34e16a541a0bbf17d4058", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24296ce873d34e16a541a0bbf17d4058"}]}] Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-526613936 Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 24296ce873d34e16a541a0bbf17d4058 Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-526613936 Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cef96cf6df5342159d1951453ad99ee0 Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: exception: No hypervisor matching 'f4797b6e-3989-4c5d-b8b2-437291be3441' could be found. Oct 05 17:32:02.804966 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'f4797b6e-3989-4c5d-b8b2-437291be3441'} Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'f4797b6e-3989-4c5d-b8b2-437291be3441' could be found. Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.805811 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:02.806781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:02.806781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:02.806781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:02.806781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:02.806781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'f4797b6e-3989-4c5d-b8b2-437291be3441' could be found. Oct 05 17:32:02.806781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:02.806781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5ba1ce0c-a6e2-4e83-8bf9-ee3b4f9c8d3f tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] Returning 404 to user: No hypervisor matching 'f4797b6e-3989-4c5d-b8b2-437291be3441' could be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:02.806781 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5ba1ce0c-a6e2-4e83-8bf9-ee3b4f9c8d3f tempest-HypervisorAdminNegativeUnderV252Test-526613936 tempest-HypervisorAdminNegativeUnderV252Test-526613936-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/f4797b6e-3989-4c5d-b8b2-437291be3441/servers" status: 404 len: 123 microversion: 2.1 time: 0.031733 Oct 05 17:32:02.806781 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 32/74] 10.222.0.70 () {58 vars in 1281 bytes} [Wed Oct 5 17:32:02 2022] GET /compute/v2.1/os-hypervisors/f4797b6e-3989-4c5d-b8b2-437291be3441/servers => generated 123 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:03.813855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d6f25509-e41a-48e8-a9d1-cd53e44e7506 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:03.818210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d6f25509-e41a-48e8-a9d1-cd53e44e7506 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:03.819017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-26a35375-3748-4253-b264-9af52789df9c tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:03.824088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-26a35375-3748-4253-b264-9af52789df9c tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:03.861915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6f25509-e41a-48e8-a9d1-cd53e44e7506 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:03.865046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6f25509-e41a-48e8-a9d1-cd53e44e7506 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:03.865382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:03.867110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26a35375-3748-4253-b264-9af52789df9c tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:03.867701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6f25509-e41a-48e8-a9d1-cd53e44e7506 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:03.869514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6f25509-e41a-48e8-a9d1-cd53e44e7506 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:03.872579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26a35375-3748-4253-b264-9af52789df9c tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:03.872939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6f25509-e41a-48e8-a9d1-cd53e44e7506 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:03.873479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6f25509-e41a-48e8-a9d1-cd53e44e7506 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:03.878351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26a35375-3748-4253-b264-9af52789df9c tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:03.880815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26a35375-3748-4253-b264-9af52789df9c tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:03.885147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26a35375-3748-4253-b264-9af52789df9c tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:03.885834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26a35375-3748-4253-b264-9af52789df9c tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:04.257296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-26a35375-3748-4253-b264-9af52789df9c tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:04.269874 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-26a35375-3748-4253-b264-9af52789df9c tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.477113 Oct 05 17:32:04.274256 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 33/75] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:03 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:04.282270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d6f25509-e41a-48e8-a9d1-cd53e44e7506 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:04.299754 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d6f25509-e41a-48e8-a9d1-cd53e44e7506 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.513555 Oct 05 17:32:04.318713 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 43/76] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:03 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:05.299402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8646447a-45ef-47ef-a894-9b67b610e2a4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:05.302683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8646447a-45ef-47ef-a894-9b67b610e2a4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:05.339867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b95fa859-67d9-4148-a93a-a0f09f038049 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:05.344353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b95fa859-67d9-4148-a93a-a0f09f038049 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:05.356151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8646447a-45ef-47ef-a894-9b67b610e2a4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:05.364072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8646447a-45ef-47ef-a894-9b67b610e2a4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:05.366589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8646447a-45ef-47ef-a894-9b67b610e2a4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:05.376521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8646447a-45ef-47ef-a894-9b67b610e2a4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:05.381307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8646447a-45ef-47ef-a894-9b67b610e2a4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:05.381869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8646447a-45ef-47ef-a894-9b67b610e2a4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:05.387174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b95fa859-67d9-4148-a93a-a0f09f038049 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:05.387999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b95fa859-67d9-4148-a93a-a0f09f038049 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:05.391416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b95fa859-67d9-4148-a93a-a0f09f038049 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:05.394747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b95fa859-67d9-4148-a93a-a0f09f038049 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:05.395977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b95fa859-67d9-4148-a93a-a0f09f038049 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:05.399549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b95fa859-67d9-4148-a93a-a0f09f038049 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:05.769372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b95fa859-67d9-4148-a93a-a0f09f038049 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:05.780665 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b95fa859-67d9-4148-a93a-a0f09f038049 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.450983 Oct 05 17:32:05.782699 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 44/77] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:05 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:05.783537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8646447a-45ef-47ef-a894-9b67b610e2a4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:05.801780 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8646447a-45ef-47ef-a894-9b67b610e2a4 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.508372 Oct 05 17:32:05.814527 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 34/78] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:05 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:06.815054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69058bf0-62e1-4d3b-9953-ac70dcda8133 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:06.816761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-69058bf0-62e1-4d3b-9953-ac70dcda8133 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:06.840357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69058bf0-62e1-4d3b-9953-ac70dcda8133 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:06.841180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69058bf0-62e1-4d3b-9953-ac70dcda8133 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:06.841742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69058bf0-62e1-4d3b-9953-ac70dcda8133 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:06.842925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69058bf0-62e1-4d3b-9953-ac70dcda8133 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:06.843522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69058bf0-62e1-4d3b-9953-ac70dcda8133 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:06.844267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69058bf0-62e1-4d3b-9953-ac70dcda8133 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:07.008310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ee47e538-4b32-42b6-8081-648e7e026b89 req-f8121024-1be8-4fa3-9325-fc5070a0024a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cc75f1-6210-49f8-bc81-cba60f855ea8", "name": "network-vif-plugged", "status": "completed", "tag": "568c3446-5b6b-40e0-bad9-f9888300fca6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:07.022454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ee47e538-4b32-42b6-8081-648e7e026b89 req-f8121024-1be8-4fa3-9325-fc5070a0024a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:07.023153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ee47e538-4b32-42b6-8081-648e7e026b89 req-f8121024-1be8-4fa3-9325-fc5070a0024a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:07.023745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ee47e538-4b32-42b6-8081-648e7e026b89 req-f8121024-1be8-4fa3-9325-fc5070a0024a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:07.055226 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ee47e538-4b32-42b6-8081-648e7e026b89 req-f8121024-1be8-4fa3-9325-fc5070a0024a service nova] Creating event network-vif-plugged:568c3446-5b6b-40e0-bad9-f9888300fca6 for instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 on n-h2-835595-3 Oct 05 17:32:07.064120 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ee47e538-4b32-42b6-8081-648e7e026b89 req-f8121024-1be8-4fa3-9325-fc5070a0024a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.571235 Oct 05 17:32:07.065256 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 45/79] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:07.072032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1c29eb00-bbdb-4e18-9df8-5a45cbba0afd tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:07.073032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1c29eb00-bbdb-4e18-9df8-5a45cbba0afd tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:07.115839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c29eb00-bbdb-4e18-9df8-5a45cbba0afd tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:07.118963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c29eb00-bbdb-4e18-9df8-5a45cbba0afd tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:07.123900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c29eb00-bbdb-4e18-9df8-5a45cbba0afd tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:07.127377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c29eb00-bbdb-4e18-9df8-5a45cbba0afd tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:07.128185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c29eb00-bbdb-4e18-9df8-5a45cbba0afd tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:07.129069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c29eb00-bbdb-4e18-9df8-5a45cbba0afd tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:07.290176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-69058bf0-62e1-4d3b-9953-ac70dcda8133 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:07.302476 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69058bf0-62e1-4d3b-9953-ac70dcda8133 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.491144 Oct 05 17:32:07.318076 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 35/80] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:06 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:07.615266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1c29eb00-bbdb-4e18-9df8-5a45cbba0afd tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:07.627937 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1c29eb00-bbdb-4e18-9df8-5a45cbba0afd tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.560756 Oct 05 17:32:07.649205 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 46/81] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:07 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:08.329545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed75aa50-c889-4961-b5f1-aaacf787540d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:08.330163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed75aa50-c889-4961-b5f1-aaacf787540d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:08.354824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed75aa50-c889-4961-b5f1-aaacf787540d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:08.364668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed75aa50-c889-4961-b5f1-aaacf787540d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:08.364668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed75aa50-c889-4961-b5f1-aaacf787540d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:08.369222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed75aa50-c889-4961-b5f1-aaacf787540d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:08.371512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed75aa50-c889-4961-b5f1-aaacf787540d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:08.372078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed75aa50-c889-4961-b5f1-aaacf787540d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:08.995775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ed75aa50-c889-4961-b5f1-aaacf787540d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:09.007168 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed75aa50-c889-4961-b5f1-aaacf787540d tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.681663 Oct 05 17:32:09.009031 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 36/82] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:08 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:09.018220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23f19393-de11-4d6b-a8ab-547013bd4a89 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:09.019146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23f19393-de11-4d6b-a8ab-547013bd4a89 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:09.029522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f19393-de11-4d6b-a8ab-547013bd4a89 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:09.030675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f19393-de11-4d6b-a8ab-547013bd4a89 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:09.030919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f19393-de11-4d6b-a8ab-547013bd4a89 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:09.031953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f19393-de11-4d6b-a8ab-547013bd4a89 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:09.032553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f19393-de11-4d6b-a8ab-547013bd4a89 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:09.033108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f19393-de11-4d6b-a8ab-547013bd4a89 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:09.179102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6dc45770-8a13-4afc-80ab-346c1cd4fbc6 tempest-InstanceUsageAuditLogTestJSON-1039938492 tempest-InstanceUsageAuditLogTestJSON-1039938492-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:09.221421 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6dc45770-8a13-4afc-80ab-346c1cd4fbc6 tempest-InstanceUsageAuditLogTestJSON-1039938492 tempest-InstanceUsageAuditLogTestJSON-1039938492-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-05 17:32:08" status: 200 len: 318 microversion: 2.1 time: 0.602139 Oct 05 17:32:09.227121 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 47/83] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:32:08 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-05%2017%3A32%3A08 => generated 318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:09.240554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12e14aed-fb50-4d4a-aa36-43beed4a9306 tempest-InstanceUsageAuditLogTestJSON-1039938492 tempest-InstanceUsageAuditLogTestJSON-1039938492-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:09.280370 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12e14aed-fb50-4d4a-aa36-43beed4a9306 tempest-InstanceUsageAuditLogTestJSON-1039938492 tempest-InstanceUsageAuditLogTestJSON-1039938492-project-admin] 10.222.0.70 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.044352 Oct 05 17:32:09.301412 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 48/84] 10.222.0.70 () {58 vars in 1185 bytes} [Wed Oct 5 17:32:09 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:09.456114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23f19393-de11-4d6b-a8ab-547013bd4a89 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:09.470030 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23f19393-de11-4d6b-a8ab-547013bd4a89 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1336 microversion: 2.1 time: 0.459677 Oct 05 17:32:09.487936 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 37/85] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:09 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1336 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:09.999280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4070cad8-fb02-4bdf-8d87-d7894eafdc79 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Action: 'create', calling method: .version_select at 0x7f7775ffda60>, body: {"keypair": {"name": "tempest-keypair-698262958", "type": "ssh", "user_id": "6107a570a2ee4480a5f8260d48af8341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQkPDh7X/Rk2RpzF9E5OrVv9RnTbmaImauMXqrPQzd/pn3beGr+o1Mhyy72n+7OcAtKNO2DNmeAqEKdgNp/zTrNhPxId1UFJdXD0BkUjZ1JMrqDmB0qcwolUDK+CY5j4w=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:10.054585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4c0e6180-37d8-4a97-a17c-6be5c8038923 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Calling method '.version_select at 0x7f7775ff9ca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:10.059966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-4070cad8-fb02-4bdf-8d87-d7894eafdc79 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Getting quotas for project 18a144bfd99d46439095d6fc00577251. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:10.064669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-4070cad8-fb02-4bdf-8d87-d7894eafdc79 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Getting quotas for user 8ce3563d8d624671accf6e2a8c5b21eb and project 18a144bfd99d46439095d6fc00577251. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:10.109637 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4070cad8-fb02-4bdf-8d87-d7894eafdc79 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.318836 Oct 05 17:32:10.122567 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 38/86] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Oct 5 17:32:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 332 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 05 17:32:10.134984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a818ee9-19c0-46ff-b253-0a49cb59a154 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:10.139883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a818ee9-19c0-46ff-b253-0a49cb59a154 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:10.155580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a818ee9-19c0-46ff-b253-0a49cb59a154 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:10.156074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a818ee9-19c0-46ff-b253-0a49cb59a154 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:10.156513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a818ee9-19c0-46ff-b253-0a49cb59a154 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:10.161464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a818ee9-19c0-46ff-b253-0a49cb59a154 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:10.161975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a818ee9-19c0-46ff-b253-0a49cb59a154 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:10.162449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a818ee9-19c0-46ff-b253-0a49cb59a154 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:10.188954 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4c0e6180-37d8-4a97-a17c-6be5c8038923 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/7e02864147c14011a2cec75b3dc0cb8b" status: 200 len: 371 microversion: 2.1 time: 0.845279 Oct 05 17:32:10.192613 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 49/87] 10.222.0.70 () {58 vars in 1242 bytes} [Wed Oct 5 17:32:09 2022] GET /compute/v2.1/os-quota-sets/7e02864147c14011a2cec75b3dc0cb8b => generated 371 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:10.203212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e516d3d-b42e-4e01-a65a-a54b2ebebc54 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Action: 'create', calling method: .version_select at 0x7f7776052430>, body: {"keypair": {"name": "tempest-keypair-71746057", "type": "ssh", "user_id": "6107a570a2ee4480a5f8260d48af8341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM08D6n+cZmLtOaBRAPOqX8swvLB/ANNP4ypUq1qoD3C0kTLMlxqVieag40ZH7R22LADQFGn84o2+zq2kBeilugz09Om/PEGuLf0fM9VtoG/K13uK7tmKor6D6F6ARkDw=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:10.250665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-7e516d3d-b42e-4e01-a65a-a54b2ebebc54 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Getting quotas for project 18a144bfd99d46439095d6fc00577251. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:10.263199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-7e516d3d-b42e-4e01-a65a-a54b2ebebc54 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Getting quotas for user 8ce3563d8d624671accf6e2a8c5b21eb and project 18a144bfd99d46439095d6fc00577251. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:10.307259 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7e516d3d-b42e-4e01-a65a-a54b2ebebc54 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.10 time: 0.112986 Oct 05 17:32:10.308414 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 50/88] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Oct 5 17:32:10 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 17:32:10.314539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-217398a3-0db4-440d-b5ab-0f84c09c8165 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Action: 'update', calling method: .version_select at 0x7f77760528b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:10.426036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-217398a3-0db4-440d-b5ab-0f84c09c8165 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:10.428494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-217398a3-0db4-440d-b5ab-0f84c09c8165 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:10.431439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-217398a3-0db4-440d-b5ab-0f84c09c8165 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:10.433489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-217398a3-0db4-440d-b5ab-0f84c09c8165 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:10.436027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-217398a3-0db4-440d-b5ab-0f84c09c8165 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:10.436734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-217398a3-0db4-440d-b5ab-0f84c09c8165 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:10.496903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6a818ee9-19c0-46ff-b253-0a49cb59a154 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:10.505395 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a818ee9-19c0-46ff-b253-0a49cb59a154 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.380822 Oct 05 17:32:10.513824 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 39/89] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:10 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:10.519150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b72084c-c252-4da4-bbe3-df0c5034cae9 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Calling method '.version_select at 0x7f7776063a60>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:10.538802 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b72084c-c252-4da4-bbe3-df0c5034cae9 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-698262958?user_id=6107a570a2ee4480a5f8260d48af8341" status: 200 len: 511 microversion: 2.10 time: 0.023324 Oct 05 17:32:10.541525 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-217398a3-0db4-440d-b5ab-0f84c09c8165 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/7e02864147c14011a2cec75b3dc0cb8b" status: 200 len: 328 microversion: 2.1 time: 0.231505 Oct 05 17:32:10.542711 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 40/91] 10.222.0.70 () {60 vars in 1337 bytes} [Wed Oct 5 17:32:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-698262958?user_id=6107a570a2ee4480a5f8260d48af8341 => generated 511 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:10.543620 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 51/91] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:32:10 2022] PUT /compute/v2.1/os-quota-sets/7e02864147c14011a2cec75b3dc0cb8b => generated 328 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:10.550015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da72395e-d382-4678-94a2-fcfbc7328042 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:10.554238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da72395e-d382-4678-94a2-fcfbc7328042 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:10.559811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b23102ee-30d2-4f5a-978c-5b280d20eecc tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:10.576324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da72395e-d382-4678-94a2-fcfbc7328042 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:10.576834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da72395e-d382-4678-94a2-fcfbc7328042 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:10.577280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da72395e-d382-4678-94a2-fcfbc7328042 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:10.577999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da72395e-d382-4678-94a2-fcfbc7328042 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:10.578484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da72395e-d382-4678-94a2-fcfbc7328042 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:10.578904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da72395e-d382-4678-94a2-fcfbc7328042 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:10.604738 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b23102ee-30d2-4f5a-978c-5b280d20eecc tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-quota-sets/7e02864147c14011a2cec75b3dc0cb8b" status: 202 len: 0 microversion: 2.1 time: 0.054833 Oct 05 17:32:10.605948 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 52/92] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:32:10 2022] DELETE /compute/v2.1/os-quota-sets/7e02864147c14011a2cec75b3dc0cb8b => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:10.614440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63e0412b-e64f-41ef-beb1-5b61c2eb7949 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Action: 'create', calling method: .version_select at 0x7f7775fde3a0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1453621300", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOSIxmyQYXw+QIEEM5yY4087qkUOajwrFaJ83wkDXyvXugZcrRhqMRWjKyByuM4zlvcmsqH27MvXAyeyN+iQH95lOAEfktW7eL2oDIEhTHAatLW3cT3SRLnN9Rc4oy8pg=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:10.652063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-63e0412b-e64f-41ef-beb1-5b61c2eb7949 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Getting quotas for project 18a144bfd99d46439095d6fc00577251. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:10.658210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-63e0412b-e64f-41ef-beb1-5b61c2eb7949 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Getting quotas for user 8ce3563d8d624671accf6e2a8c5b21eb and project 18a144bfd99d46439095d6fc00577251. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:10.690607 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63e0412b-e64f-41ef-beb1-5b61c2eb7949 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.082341 Oct 05 17:32:10.694326 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 53/93] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Oct 5 17:32:10 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 17:32:10.697356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6e6af0c6-107e-4520-beae-418743a2492c tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Calling method '.version_select at 0x7f7775f64790>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:10.795280 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6e6af0c6-107e-4520-beae-418743a2492c tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/7e02864147c14011a2cec75b3dc0cb8b" status: 200 len: 371 microversion: 2.1 time: 0.102277 Oct 05 17:32:10.807322 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 54/94] 10.222.0.70 () {58 vars in 1242 bytes} [Wed Oct 5 17:32:10 2022] GET /compute/v2.1/os-quota-sets/7e02864147c14011a2cec75b3dc0cb8b => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:10.828448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3dd3c67b-e7ab-4ffc-9f5f-5536631239eb tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Calling method '.version_select at 0x7f7775f653a0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:10.833659 n-d-835595-3 devstack@n-api.service[128844]: WARNING oslo_db.sqlalchemy.utils [None req-3dd3c67b-e7ab-4ffc-9f5f-5536631239eb tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 17:32:10.843476 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3dd3c67b-e7ab-4ffc-9f5f-5536631239eb tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] 10.222.0.70 "GET /compute/v2.1/os-keypairs?user_id=6107a570a2ee4480a5f8260d48af8341" status: 200 len: 723 microversion: 2.10 time: 0.027861 Oct 05 17:32:10.855797 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 55/95] 10.222.0.70 () {60 vars in 1259 bytes} [Wed Oct 5 17:32:10 2022] GET /compute/v2.1/os-keypairs?user_id=6107a570a2ee4480a5f8260d48af8341 => generated 723 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:10.873494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-60569876-8627-49d1-ae37-db0898024b4a tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Calling method '.version_select at 0x7f7775f6f3a0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:10.906862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=5,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:10.933261 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-60569876-8627-49d1-ae37-db0898024b4a tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1453621300" status: 204 len: 0 microversion: 2.10 time: 0.072895 Oct 05 17:32:10.939123 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 56/96] 10.222.0.70 () {60 vars in 1325 bytes} [Wed Oct 5 17:32:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1453621300 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:32:10.951440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a9d9931c-d1d9-4295-86ce-0c0605b6ce19 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Calling method '.version_select at 0x7f7775f6f9d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:10.951873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-da72395e-d382-4678-94a2-fcfbc7328042 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:10.962960 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da72395e-d382-4678-94a2-fcfbc7328042 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1485 microversion: 2.1 time: 0.418172 Oct 05 17:32:10.963571 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 41/97] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:10 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1485 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:10.990006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c9d31a4-8c7a-463f-a94f-f79bd53f4d1c tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:10.990980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7c9d31a4-8c7a-463f-a94f-f79bd53f4d1c tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:10.999696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c9d31a4-8c7a-463f-a94f-f79bd53f4d1c tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:11.000063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c9d31a4-8c7a-463f-a94f-f79bd53f4d1c tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:11.004759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c9d31a4-8c7a-463f-a94f-f79bd53f4d1c tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:11.005580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c9d31a4-8c7a-463f-a94f-f79bd53f4d1c tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:11.006039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c9d31a4-8c7a-463f-a94f-f79bd53f4d1c tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:11.010862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c9d31a4-8c7a-463f-a94f-f79bd53f4d1c tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:11.031956 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a9d9931c-d1d9-4295-86ce-0c0605b6ce19 tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-71746057?user_id=6107a570a2ee4480a5f8260d48af8341" status: 204 len: 0 microversion: 2.10 time: 0.090042 Oct 05 17:32:11.036533 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 57/98] 10.222.0.70 () {60 vars in 1337 bytes} [Wed Oct 5 17:32:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-71746057?user_id=6107a570a2ee4480a5f8260d48af8341 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:32:11.045888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e820e2aa-b53d-4caa-a293-19382eef422c tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] Calling method '.version_select at 0x7f7775f64280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:11.099569 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e820e2aa-b53d-4caa-a293-19382eef422c tempest-KeyPairsV210TestJSON-1236008617 tempest-KeyPairsV210TestJSON-1236008617-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-698262958?user_id=6107a570a2ee4480a5f8260d48af8341" status: 204 len: 0 microversion: 2.10 time: 0.061492 Oct 05 17:32:11.100460 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 58/99] 10.222.0.70 () {60 vars in 1340 bytes} [Wed Oct 5 17:32:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-698262958?user_id=6107a570a2ee4480a5f8260d48af8341 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:32:11.135031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a6d26ec9-6d56-41fd-a19f-3e92141bfeed tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Calling method '.version_select at 0x7f7775f7cb80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:11.880423 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a6d26ec9-6d56-41fd-a19f-3e92141bfeed tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/6963712f8bd5429bbc29f28b0a840729/defaults" status: 200 len: 371 microversion: 2.1 time: 0.750136 Oct 05 17:32:11.882759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 59/100] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:32:11 2022] GET /compute/v2.1/os-quota-sets/6963712f8bd5429bbc29f28b0a840729/defaults => generated 371 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:11.897255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-2ee138a7-6904-4145-83b1-330217ff6270 req-16536cad-665a-480b-8776-453a656098bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0bdcb64-ff16-45b4-aa53-bf5e5963957b", "name": "network-vif-plugged", "status": "completed", "tag": "f7299bac-8095-4a7c-8b6b-f90db404747c"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:11.931739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2ee138a7-6904-4145-83b1-330217ff6270 req-16536cad-665a-480b-8776-453a656098bc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:11.932256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2ee138a7-6904-4145-83b1-330217ff6270 req-16536cad-665a-480b-8776-453a656098bc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:11.932687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2ee138a7-6904-4145-83b1-330217ff6270 req-16536cad-665a-480b-8776-453a656098bc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:11.952861 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-2ee138a7-6904-4145-83b1-330217ff6270 req-16536cad-665a-480b-8776-453a656098bc service nova] Creating event network-vif-plugged:f7299bac-8095-4a7c-8b6b-f90db404747c for instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b on n-h1-835595-3 Oct 05 17:32:11.960400 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-2ee138a7-6904-4145-83b1-330217ff6270 req-16536cad-665a-480b-8776-453a656098bc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075817 Oct 05 17:32:11.961614 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 60/101] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:11.971983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d85a0dda-14d1-48a3-85d5-d0e9b53f6735 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:11.974692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d85a0dda-14d1-48a3-85d5-d0e9b53f6735 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:11.986067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d85a0dda-14d1-48a3-85d5-d0e9b53f6735 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:11.987479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d85a0dda-14d1-48a3-85d5-d0e9b53f6735 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:11.988111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d85a0dda-14d1-48a3-85d5-d0e9b53f6735 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:11.997619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d85a0dda-14d1-48a3-85d5-d0e9b53f6735 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:12.000000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d85a0dda-14d1-48a3-85d5-d0e9b53f6735 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:12.002598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d85a0dda-14d1-48a3-85d5-d0e9b53f6735 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:12.216533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:12.222948 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7c9d31a4-8c7a-463f-a94f-f79bd53f4d1c tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1636 microversion: 2.1 time: 1.237147 Oct 05 17:32:12.227242 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 42/102] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:10 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1636 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:12.248635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e3de8225-fab8-4edb-973b-5ac02b7a6c13 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:12.249144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e3de8225-fab8-4edb-973b-5ac02b7a6c13 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:12.261371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3de8225-fab8-4edb-973b-5ac02b7a6c13 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:12.261872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3de8225-fab8-4edb-973b-5ac02b7a6c13 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:12.264353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3de8225-fab8-4edb-973b-5ac02b7a6c13 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:12.265315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3de8225-fab8-4edb-973b-5ac02b7a6c13 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:12.266795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3de8225-fab8-4edb-973b-5ac02b7a6c13 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:12.267440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3de8225-fab8-4edb-973b-5ac02b7a6c13 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:12.297764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e3de8225-fab8-4edb-973b-5ac02b7a6c13 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:32:12.447830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d85a0dda-14d1-48a3-85d5-d0e9b53f6735 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:12.456371 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d85a0dda-14d1-48a3-85d5-d0e9b53f6735 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.493043 Oct 05 17:32:12.462632 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 61/103] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:11 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:12.467390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0899c93b-8e1c-4652-89ae-c1378fef73f6 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Action: 'update', calling method: .version_select at 0x7f7775f64430>, body: {"quota_set": {"ram": "5120"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:12.572911 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e3de8225-fab8-4edb-973b-5ac02b7a6c13 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 204 len: 0 microversion: 2.1 time: 0.328043 Oct 05 17:32:12.573666 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 43/104] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:32:12 2022] DELETE /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:32:12.584084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8aefba8d-73df-4be7-b425-0270e86da4d3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:12.587822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8aefba8d-73df-4be7-b425-0270e86da4d3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:12.849249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aefba8d-73df-4be7-b425-0270e86da4d3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:12.849931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aefba8d-73df-4be7-b425-0270e86da4d3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:12.850527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aefba8d-73df-4be7-b425-0270e86da4d3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:12.853927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aefba8d-73df-4be7-b425-0270e86da4d3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:12.855031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aefba8d-73df-4be7-b425-0270e86da4d3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:12.855789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aefba8d-73df-4be7-b425-0270e86da4d3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:12.873116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0899c93b-8e1c-4652-89ae-c1378fef73f6 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:12.873600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0899c93b-8e1c-4652-89ae-c1378fef73f6 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:12.878086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0899c93b-8e1c-4652-89ae-c1378fef73f6 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:12.880050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0899c93b-8e1c-4652-89ae-c1378fef73f6 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:12.884246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0899c93b-8e1c-4652-89ae-c1378fef73f6 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:12.885344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0899c93b-8e1c-4652-89ae-c1378fef73f6 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:13.001668 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0899c93b-8e1c-4652-89ae-c1378fef73f6 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0adf41d869d64e2cb80f02d8743cbe12" status: 200 len: 328 microversion: 2.1 time: 0.537836 Oct 05 17:32:13.003694 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 62/105] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:32:12 2022] PUT /compute/v2.1/os-quota-sets/0adf41d869d64e2cb80f02d8743cbe12 => generated 328 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:13.024204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f06d34be-7848-4b68-a06a-8427781059fd tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Calling method '.version_select at 0x7f7775f7c820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:13.089589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8aefba8d-73df-4be7-b425-0270e86da4d3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:13.099266 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8aefba8d-73df-4be7-b425-0270e86da4d3 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1491 microversion: 2.1 time: 0.520578 Oct 05 17:32:13.099860 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 44/106] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:12 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1491 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:13.359104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-306fd44b-1325-4b3d-90b2-7b6b6eee3591 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:13.377707 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-306fd44b-1325-4b3d-90b2-7b6b6eee3591 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.257189 Oct 05 17:32:13.378342 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 45/107] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:32:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:13.591302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06d34be-7848-4b68-a06a-8427781059fd tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:13.591788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06d34be-7848-4b68-a06a-8427781059fd tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:13.592677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06d34be-7848-4b68-a06a-8427781059fd tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:13.593416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06d34be-7848-4b68-a06a-8427781059fd tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:13.593876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06d34be-7848-4b68-a06a-8427781059fd tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:13.594404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06d34be-7848-4b68-a06a-8427781059fd tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:13.653186 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f06d34be-7848-4b68-a06a-8427781059fd tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/0adf41d869d64e2cb80f02d8743cbe12/detail" status: 200 len: 916 microversion: 2.1 time: 0.638261 Oct 05 17:32:13.653912 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 63/108] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:32:13 2022] GET /compute/v2.1/os-quota-sets/0adf41d869d64e2cb80f02d8743cbe12/detail => generated 916 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:13.660019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b9df0db-0c00-46fe-a912-7ec6269e3204 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:13.660736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5b9df0db-0c00-46fe-a912-7ec6269e3204 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:13.683984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b9df0db-0c00-46fe-a912-7ec6269e3204 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:13.684714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b9df0db-0c00-46fe-a912-7ec6269e3204 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:13.685226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b9df0db-0c00-46fe-a912-7ec6269e3204 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:13.686815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b9df0db-0c00-46fe-a912-7ec6269e3204 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:13.687537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b9df0db-0c00-46fe-a912-7ec6269e3204 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:13.688203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b9df0db-0c00-46fe-a912-7ec6269e3204 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:13.888992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b5691658-e1c8-475c-8d6b-b448b00cd507 tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-449578878", "id": 1553919301, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:13.898430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5b9df0db-0c00-46fe-a912-7ec6269e3204 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:13.910148 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b9df0db-0c00-46fe-a912-7ec6269e3204 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1320 microversion: 2.1 time: 0.254651 Oct 05 17:32:13.910941 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 64/109] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:13 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1320 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:13.957826 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b5691658-e1c8-475c-8d6b-b448b00cd507 tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.570562 Oct 05 17:32:13.962902 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 46/110] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:13 2022] POST /compute/v2.1/flavors => generated 424 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:13.976991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e78607fe-55f4-45b4-938d-f9bee67e4595 tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:13.985858 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e78607fe-55f4-45b4-938d-f9bee67e4595 tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013016 Oct 05 17:32:13.987343 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 65/111] 10.222.0.70 () {58 vars in 1182 bytes} [Wed Oct 5 17:32:13 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:13.997287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-04dc5637-d77a-4e5f-8bcf-51d062195a08 tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-855192714", "id": 1284091807, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:14.027476 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-04dc5637-d77a-4e5f-8bcf-51d062195a08 tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 424 microversion: 2.1 time: 0.034381 Oct 05 17:32:14.028676 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 47/112] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:13 2022] POST /compute/v2.1/flavors => generated 424 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:14.042918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e53d8145-a00e-4ad0-a467-8f36f201f00e tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:14.059838 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e53d8145-a00e-4ad0-a467-8f36f201f00e tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019639 Oct 05 17:32:14.069134 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 66/113] 10.222.0.70 () {58 vars in 1182 bytes} [Wed Oct 5 17:32:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:14.075435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2008a477-327f-4dc6-ab32-e4f34eaa272f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Action: 'create', calling method: .version_select at 0x7f7775fad280>, body: {"keypair": {"name": "tempest-keypair-2119713767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELZc//SeEtvLmfqlOrHYsnhzAvhOE349D/6RXddC3+intTsOceYOkB2zcRqsasGv+6IZgyhgLQS8H8POxRUQuFOFNJXuKvg5i3jwfvLhWQZ5SJTygO2fY2PkbJOpHslZA=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:14.095322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2008a477-327f-4dc6-ab32-e4f34eaa272f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Getting quotas for project adbb4e67ac704e69842024b3ae1a023d. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:14.100571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2008a477-327f-4dc6-ab32-e4f34eaa272f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Getting quotas for user 0a3a1e26a77e4895a996fc9375e26550 and project adbb4e67ac704e69842024b3ae1a023d. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:14.125770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c150bdd-18ee-4253-9ab7-dd3882b095d5 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:14.126401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c150bdd-18ee-4253-9ab7-dd3882b095d5 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:14.136497 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2008a477-327f-4dc6-ab32-e4f34eaa272f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065013 Oct 05 17:32:14.137076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c150bdd-18ee-4253-9ab7-dd3882b095d5 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:14.137996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c150bdd-18ee-4253-9ab7-dd3882b095d5 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:14.138768 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 48/114] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:32:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:14.139054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c150bdd-18ee-4253-9ab7-dd3882b095d5 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:14.140061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c150bdd-18ee-4253-9ab7-dd3882b095d5 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:14.140669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c150bdd-18ee-4253-9ab7-dd3882b095d5 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:14.141092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c150bdd-18ee-4253-9ab7-dd3882b095d5 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:14.380268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Action: 'update', calling method: .version_select at 0x7f77760fb4c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:14.420311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0c150bdd-18ee-4253-9ab7-dd3882b095d5 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:14.432673 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0c150bdd-18ee-4253-9ab7-dd3882b095d5 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1491 microversion: 2.1 time: 0.310917 Oct 05 17:32:14.438736 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 67/115] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:14 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1491 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:14.746467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:14.748143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:14.749420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:14.752962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:14.753502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:14.754260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:14.863806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:14.867663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:14.871340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:14.872226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:14.872705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:14.874614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:14.936295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f49522d6-e5ce-4a89-a69e-da1f9493cf32 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:14.936919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f49522d6-e5ce-4a89-a69e-da1f9493cf32 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:14.945751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49522d6-e5ce-4a89-a69e-da1f9493cf32 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:14.946253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49522d6-e5ce-4a89-a69e-da1f9493cf32 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:14.946719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49522d6-e5ce-4a89-a69e-da1f9493cf32 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:14.947557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49522d6-e5ce-4a89-a69e-da1f9493cf32 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:14.948865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49522d6-e5ce-4a89-a69e-da1f9493cf32 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:14.949481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49522d6-e5ce-4a89-a69e-da1f9493cf32 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:14.962142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:15.136755 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e8313e9b-1444-4f54-81f6-3c8124486201 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/0adf41d869d64e2cb80f02d8743cbe12?user_id=f4ef59de42ff43aea124b8274b0b5c2e" status: 200 len: 328 microversion: 2.1 time: 0.761234 Oct 05 17:32:15.141984 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 49/116] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 17:32:14 2022] PUT /compute/v2.1/os-quota-sets/0adf41d869d64e2cb80f02d8743cbe12?user_id=f4ef59de42ff43aea124b8274b0b5c2e => generated 328 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:15.161185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-da2be6f7-2c94-4b2f-b244-a307dbf466b1 req-679cc1ff-ced9-4754-a782-1bea06f46143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74cc75f1-6210-49f8-bc81-cba60f855ea8", "name": "network-vif-deleted", "tag": "568c3446-5b6b-40e0-bad9-f9888300fca6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:15.201335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-da2be6f7-2c94-4b2f-b244-a307dbf466b1 req-679cc1ff-ced9-4754-a782-1bea06f46143 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:15.202986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-da2be6f7-2c94-4b2f-b244-a307dbf466b1 req-679cc1ff-ced9-4754-a782-1bea06f46143 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:15.205189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-da2be6f7-2c94-4b2f-b244-a307dbf466b1 req-679cc1ff-ced9-4754-a782-1bea06f46143 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:15.234755 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-da2be6f7-2c94-4b2f-b244-a307dbf466b1 req-679cc1ff-ced9-4754-a782-1bea06f46143 service nova] Creating event network-vif-deleted:568c3446-5b6b-40e0-bad9-f9888300fca6 for instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 on n-h2-835595-3 Oct 05 17:32:15.237503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f49522d6-e5ce-4a89-a69e-da1f9493cf32 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:15.250722 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f49522d6-e5ce-4a89-a69e-da1f9493cf32 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1470 microversion: 2.1 time: 0.318068 Oct 05 17:32:15.251457 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 68/117] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:14 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1470 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:15.257631 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-da2be6f7-2c94-4b2f-b244-a307dbf466b1 req-679cc1ff-ced9-4754-a782-1bea06f46143 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108539 Oct 05 17:32:15.271162 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 50/118] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:15.285275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e8e05e9c-b6b5-4cad-a8c9-8b4615b742ea tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Calling method '.version_select at 0x7f7775f64d30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:15.737163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-70585a48-0921-4663-9b6d-fc782f0dc66f tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:15.738521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-70585a48-0921-4663-9b6d-fc782f0dc66f tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:15.749793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70585a48-0921-4663-9b6d-fc782f0dc66f tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:15.751592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70585a48-0921-4663-9b6d-fc782f0dc66f tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:15.753237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70585a48-0921-4663-9b6d-fc782f0dc66f tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:15.754922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70585a48-0921-4663-9b6d-fc782f0dc66f tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:15.758646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70585a48-0921-4663-9b6d-fc782f0dc66f tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:15.759848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70585a48-0921-4663-9b6d-fc782f0dc66f tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:15.786643 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e8e05e9c-b6b5-4cad-a8c9-8b4615b742ea tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/0adf41d869d64e2cb80f02d8743cbe12?user_id=f4ef59de42ff43aea124b8274b0b5c2e" status: 200 len: 370 microversion: 2.1 time: 0.528055 Oct 05 17:32:15.787629 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 69/119] 10.222.0.70 () {58 vars in 1323 bytes} [Wed Oct 5 17:32:15 2022] GET /compute/v2.1/os-quota-sets/0adf41d869d64e2cb80f02d8743cbe12?user_id=f4ef59de42ff43aea124b8274b0b5c2e => generated 370 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:15.798344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:15.798948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:15.811166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:15.812003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:15.812618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:15.813459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:15.814049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:15.818898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:15.821976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-70585a48-0921-4663-9b6d-fc782f0dc66f tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:32:15.898728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:15.899693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:15.900334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:15.900966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lazy-loading 'fault' on Instance uuid 74cc75f1-6210-49f8-bc81-cba60f855ea8 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:32:16.036474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e06a2990dd7b4defb1a1a7345e5511a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a103a4e230044899bb4f3e07d7d406b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:16.049373 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-051ae728-b1c7-454c-9044-5de614808a7a tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 200 len: 1326 microversion: 2.1 time: 0.260615 Oct 05 17:32:16.068585 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 70/120] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:15 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 1326 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:16.174169 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-70585a48-0921-4663-9b6d-fc782f0dc66f tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 204 len: 0 microversion: 2.1 time: 0.899993 Oct 05 17:32:16.175499 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 51/121] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:32:15 2022] DELETE /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 0 bytes in 904 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:32:16.187078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3f7cc5c9-615b-4847-8a7e-54a74348f76e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:16.187078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3f7cc5c9-615b-4847-8a7e-54a74348f76e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:16.193332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7cc5c9-615b-4847-8a7e-54a74348f76e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:16.194078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7cc5c9-615b-4847-8a7e-54a74348f76e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:16.194715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7cc5c9-615b-4847-8a7e-54a74348f76e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:16.196174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7cc5c9-615b-4847-8a7e-54a74348f76e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:16.196685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7cc5c9-615b-4847-8a7e-54a74348f76e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:16.197523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7cc5c9-615b-4847-8a7e-54a74348f76e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:16.504847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-152c1536-6188-49c2-8685-ce92e8ec09d1 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Calling method '.version_select at 0x7f7775f67310>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:16.704110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3f7cc5c9-615b-4847-8a7e-54a74348f76e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:16.712505 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3f7cc5c9-615b-4847-8a7e-54a74348f76e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 200 len: 1476 microversion: 2.1 time: 0.532387 Oct 05 17:32:16.726883 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 71/122] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:16 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 1476 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:17.002581 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-152c1536-6188-49c2-8685-ce92e8ec09d1 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/6963712f8bd5429bbc29f28b0a840729/defaults" status: 200 len: 371 microversion: 2.1 time: 0.503175 Oct 05 17:32:17.011050 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 52/123] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:32:16 2022] GET /compute/v2.1/os-quota-sets/6963712f8bd5429bbc29f28b0a840729/defaults => generated 371 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:17.021353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd0fca61-ced1-4335-a86f-8f7d8858fa79 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Action: 'update', calling method: .version_select at 0x7f7775fc6670>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:17.080131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1976492754", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:17.173188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:32:17.236646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd0fca61-ced1-4335-a86f-8f7d8858fa79 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:17.237534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd0fca61-ced1-4335-a86f-8f7d8858fa79 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:17.238472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd0fca61-ced1-4335-a86f-8f7d8858fa79 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:17.239798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd0fca61-ced1-4335-a86f-8f7d8858fa79 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:17.241014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd0fca61-ced1-4335-a86f-8f7d8858fa79 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:17.241822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd0fca61-ced1-4335-a86f-8f7d8858fa79 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:17.285693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:17.472847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:32:17.473277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:32:17.473744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:32:17.474455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:32:17.475110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:32:17.484520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:17.484992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:17.485801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:17.486791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:17.487270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:17.487722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:17.505994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for project afc6422679664e47892eef7185291846. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:17.510058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for user 15a6bfffd8fb473b83de94858676f8ed and project afc6422679664e47892eef7185291846. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:17.523088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:32:17.525454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:32:17.586226 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c22c323c-e721-44d1-8b96-a069ba2942a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806686 Oct 05 17:32:17.590635 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 72/124] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 17:32:17.602713 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bd0fca61-ced1-4335-a86f-8f7d8858fa79 tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/6963712f8bd5429bbc29f28b0a840729" status: 200 len: 329 microversion: 2.1 time: 0.589145 Oct 05 17:32:17.604161 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 53/125] 10.222.0.70 () {60 vars in 1263 bytes} [Wed Oct 5 17:32:17 2022] PUT /compute/v2.1/os-quota-sets/6963712f8bd5429bbc29f28b0a840729 => generated 329 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:17.610251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1243057149", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "1284091807", "adminPass": "***", "networks": [{"uuid": "22b7db7a-1fab-4bbf-84a9-79fa232ccfc0"}], "security_groups": [{"name": "tempest-securitygroup--940985860"}], "key_name": "tempest-keypair-2119713767", "user_data": "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:17.624064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:17.625538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:17.646311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:17.647597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:17.648190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:17.649047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:17.649671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:17.650240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:17.669271 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] HTTP exception thrown: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Request method failure captured: Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 HTTP/1.1 Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb94L5ZMAMC4oWUocyeXoG6qrTB6cjSnw-lrJjkdnw2tzUtVtzw-pMUZZGoxttJar_BYgJVB5M87lpXH-GTBYVZypxLs8hYypKPdN1TXddPYE_84mNw_QSHPUKeUdg91IapxsXhbgUbcKy5wpUimkbiXhvn6WUnkUXMrh6c-Eak0e-0 Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: a103a4e230044899bb4f3e07d7d406b7 Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminTestJSON-1349942713 Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:17.683623 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a103a4e230044899bb4f3e07d7d406b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a103a4e230044899bb4f3e07d7d406b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a103a4e230044899bb4f3e07d7d406b7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a103a4e230044899bb4f3e07d7d406b7"}]}] Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminTestJSON-1349942713 Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: a103a4e230044899bb4f3e07d7d406b7 Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1349942713 Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminTestJSON-1349942713-project Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: e06a2990dd7b4defb1a1a7345e5511a9 Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminTestJSON-1349942713-project Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:17.685198 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '74cc75f1-6210-49f8-bc81-cba60f855ea8'} Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:17.686076 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:17.687199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:17.688304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Returning 404 to user: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:17.688304 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-23e2b6c5-9c83-459c-a00d-4cde1ef4171d tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 404 len: 111 microversion: 2.1 time: 0.087439 Oct 05 17:32:17.688304 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 73/126] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:17 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:17.695887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-600c149c-3adc-4aa7-9ec9-5c7c2b009e4e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:17.696625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-600c149c-3adc-4aa7-9ec9-5c7c2b009e4e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:17.766875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-600c149c-3adc-4aa7-9ec9-5c7c2b009e4e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:17.776374 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-600c149c-3adc-4aa7-9ec9-5c7c2b009e4e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1213 microversion: 2.1 time: 0.088854 Oct 05 17:32:17.777049 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 74/127] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:17 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:17.782228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf4d1ad7-95ee-4648-8849-76f30c1f738a tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Action: 'update', calling method: .version_select at 0x7f7775e86c10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:17.868178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] validate_networks() for [('22b7db7a-1fab-4bbf-84a9-79fa232ccfc0', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:32:18.008054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf4d1ad7-95ee-4648-8849-76f30c1f738a tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:18.008887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf4d1ad7-95ee-4648-8849-76f30c1f738a tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:18.009318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf4d1ad7-95ee-4648-8849-76f30c1f738a tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:18.010226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf4d1ad7-95ee-4648-8849-76f30c1f738a tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:18.010936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf4d1ad7-95ee-4648-8849-76f30c1f738a tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:18.011366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf4d1ad7-95ee-4648-8849-76f30c1f738a tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:18.097474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=3,nova_api:INSERT=7,nova_api:UPDATE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:18.427872 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf4d1ad7-95ee-4648-8849-76f30c1f738a tempest-QuotasAdminTestJSON-733630244 tempest-QuotasAdminTestJSON-733630244-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/6963712f8bd5429bbc29f28b0a840729" status: 200 len: 329 microversion: 2.1 time: 0.649279 Oct 05 17:32:18.428581 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 75/128] 10.222.0.70 () {60 vars in 1263 bytes} [Wed Oct 5 17:32:17 2022] PUT /compute/v2.1/os-quota-sets/6963712f8bd5429bbc29f28b0a840729 => generated 329 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:18.433853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-04e6e246-f9b9-44d7-9649-f7c833da5d6a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:18.447896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04e6e246-f9b9-44d7-9649-f7c833da5d6a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:18.448507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04e6e246-f9b9-44d7-9649-f7c833da5d6a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:18.448942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04e6e246-f9b9-44d7-9649-f7c833da5d6a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:19.013249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:32:19.014506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:32:19.015146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:32:19.015696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:32:19.016282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:32:19.035418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:19.035920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:19.036382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:19.037101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:19.037545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:19.037956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:19.059246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Getting quotas for project adbb4e67ac704e69842024b3ae1a023d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:19.063266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Getting quotas for user 0a3a1e26a77e4895a996fc9375e26550 and project adbb4e67ac704e69842024b3ae1a023d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:19.090857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:32:19.097934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:32:19.181817 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-641b6c15-705c-423b-b66b-6b2145611919 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.576839 Oct 05 17:32:19.183107 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 54/129] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:32:19.189343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:19.190456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:19.199059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:19.199790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:19.200593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:19.202401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:19.203065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:19.203687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:19.226240 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] HTTP exception thrown: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Request method failure captured: Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b HTTP/1.1 Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb93Nd2MkBq9lJnM1aRBTut-TWZiu31gtQgdqI1IAJa8ozhro1YodTyc5cKXDvXePXTKVBbarr5ENVnMgzVCdR2JukMKr0OZOLmTKsyVfvl3lp1vDItZuVrVxhN_607CHcSjhQu9DrNoqbT32Q-BLz77rF5FTMnU4-A4PkJIy9iUIo4 Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:19.234081 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8cbe7c9e993940f7a9ee263e9fce0745", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}] Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cebd216a206f494197bf0b71d294cb01 Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:19.235826 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'c0bdcb64-ff16-45b4-aa53-bf5e5963957b'} Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:19.236613 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:19.237935 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:19.240399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Returning 404 to user: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:19.242469 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-343d458c-89f1-4ce1-9c74-09a4659ccf1e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 404 len: 111 microversion: 2.1 time: 0.057984 Oct 05 17:32:19.267882 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 55/130] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:19 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:19.280167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e31f3d8a-fd2c-4f4d-91de-bd7acbe63ed7 req-20dfbd19-b02e-4836-9813-b64da7db15a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0bdcb64-ff16-45b4-aa53-bf5e5963957b", "name": "network-vif-deleted", "tag": "f7299bac-8095-4a7c-8b6b-f90db404747c"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:19.293913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e31f3d8a-fd2c-4f4d-91de-bd7acbe63ed7 req-20dfbd19-b02e-4836-9813-b64da7db15a1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:19.294422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e31f3d8a-fd2c-4f4d-91de-bd7acbe63ed7 req-20dfbd19-b02e-4836-9813-b64da7db15a1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:19.294852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e31f3d8a-fd2c-4f4d-91de-bd7acbe63ed7 req-20dfbd19-b02e-4836-9813-b64da7db15a1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:19.310325 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e31f3d8a-fd2c-4f4d-91de-bd7acbe63ed7 req-20dfbd19-b02e-4836-9813-b64da7db15a1 service nova] Creating event network-vif-deleted:f7299bac-8095-4a7c-8b6b-f90db404747c for instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b on n-h1-835595-3 Oct 05 17:32:19.318634 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e31f3d8a-fd2c-4f4d-91de-bd7acbe63ed7 req-20dfbd19-b02e-4836-9813-b64da7db15a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049108 Oct 05 17:32:19.326711 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 56/131] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:19.333425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e492f21f-15db-4b67-a9a0-839ecbb16a3b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:19.334180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e492f21f-15db-4b67-a9a0-839ecbb16a3b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:19.342067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e492f21f-15db-4b67-a9a0-839ecbb16a3b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:19.342748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e492f21f-15db-4b67-a9a0-839ecbb16a3b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:19.343667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e492f21f-15db-4b67-a9a0-839ecbb16a3b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:19.344504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e492f21f-15db-4b67-a9a0-839ecbb16a3b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:19.345289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e492f21f-15db-4b67-a9a0-839ecbb16a3b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:19.345915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e492f21f-15db-4b67-a9a0-839ecbb16a3b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:19.404603 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-04e6e246-f9b9-44d7-9649-f7c833da5d6a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 296 microversion: 2.1 time: 0.974792 Oct 05 17:32:19.413196 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 76/132] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:32:18 2022] POST /compute/v2.1/os-aggregates/1/action => generated 296 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:19.466592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e492f21f-15db-4b67-a9a0-839ecbb16a3b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:19.479288 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e492f21f-15db-4b67-a9a0-839ecbb16a3b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1291 microversion: 2.1 time: 0.150961 Oct 05 17:32:19.482324 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 57/133] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:19 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1291 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:19.489398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2bbb59c3-1973-45e9-bdce-46f0ff5d7038 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:19.490331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2bbb59c3-1973-45e9-bdce-46f0ff5d7038 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:19.552432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2bbb59c3-1973-45e9-bdce-46f0ff5d7038 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:19.563246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2bbb59c3-1973-45e9-bdce-46f0ff5d7038 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1265 microversion: 2.1 time: 0.078829 Oct 05 17:32:19.564392 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 58/134] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:19 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:19.569130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-decb5cb2-db7d-4e8b-867d-9437d8d7295f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:19.608213 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-decb5cb2-db7d-4e8b-867d-9437d8d7295f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.041712 Oct 05 17:32:19.621466 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 59/135] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:19 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:19.621466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-779509823", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:19.687568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6ac8fc3-8e7d-48fe-9521-11215b176386 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Action: 'update', calling method: .version_select at 0x7f7775f73820>, body: {"quota_set": {"ram": "5120"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:19.688997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:32:19.763121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6ac8fc3-8e7d-48fe-9521-11215b176386 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:19.763672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6ac8fc3-8e7d-48fe-9521-11215b176386 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:19.764207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6ac8fc3-8e7d-48fe-9521-11215b176386 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:19.764937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6ac8fc3-8e7d-48fe-9521-11215b176386 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:19.766010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6ac8fc3-8e7d-48fe-9521-11215b176386 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:19.766511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6ac8fc3-8e7d-48fe-9521-11215b176386 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:19.846003 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c6ac8fc3-8e7d-48fe-9521-11215b176386 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/480984ff95a648419c6092bfd099953c" status: 200 len: 148 microversion: 2.57 time: 0.428169 Oct 05 17:32:19.849566 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 77/136] 10.222.0.70 () {62 vars in 1303 bytes} [Wed Oct 5 17:32:19 2022] PUT /compute/v2.1/os-quota-sets/480984ff95a648419c6092bfd099953c => generated 148 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:19.862118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ff13ab05-5686-435f-b26c-0d0375d3fefc tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1324236909"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:19.865597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-ff13ab05-5686-435f-b26c-0d0375d3fefc tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Generated uuid 5cc0a75b-b403-462b-a2ef-189b8b73419d for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:19.922654 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ff13ab05-5686-435f-b26c-0d0375d3fefc tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.070852 Oct 05 17:32:19.930574 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 78/137] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:19.935769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e506849-6f89-4909-931d-45aa8498213b tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Calling method '.version_select at 0x7f7775f73550>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:20.028056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e506849-6f89-4909-931d-45aa8498213b tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:20.031828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e506849-6f89-4909-931d-45aa8498213b tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:20.032678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e506849-6f89-4909-931d-45aa8498213b tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:20.035387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e506849-6f89-4909-931d-45aa8498213b tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:20.035869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e506849-6f89-4909-931d-45aa8498213b tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:20.037322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e506849-6f89-4909-931d-45aa8498213b tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:20.051849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:32:20.052823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:32:20.053509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:32:20.054080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:32:20.054671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:32:20.073010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:20.073960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:20.075394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:20.076413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:20.078006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:20.078124 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e506849-6f89-4909-931d-45aa8498213b tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/480984ff95a648419c6092bfd099953c/detail" status: 200 len: 463 microversion: 2.57 time: 0.146322 Oct 05 17:32:20.078756 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 79/138] 10.222.0.70 () {60 vars in 1304 bytes} [Wed Oct 5 17:32:19 2022] GET /compute/v2.1/os-quota-sets/480984ff95a648419c6092bfd099953c/detail => generated 463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:20.079441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:20.100404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Getting quotas for project 8cbe7c9e993940f7a9ee263e9fce0745. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:20.105560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Getting quotas for user cebd216a206f494197bf0b71d294cb01 and project 8cbe7c9e993940f7a9ee263e9fce0745. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:20.111872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-38f4086d-1e85-49d9-bc1b-705a1f4a5210 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:20.125880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-38f4086d-1e85-49d9-bc1b-705a1f4a5210 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:20.126541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-38f4086d-1e85-49d9-bc1b-705a1f4a5210 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:20.127180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-38f4086d-1e85-49d9-bc1b-705a1f4a5210 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:20.135641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:32:20.138868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:32:20.250498 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ec132f00-2640-47ef-982c-e0c55c18d964 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634611 Oct 05 17:32:20.257417 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 60/139] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:32:20.272073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97455d5c-699f-4ab6-ac14-57cd44d0ed5c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:20.277029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-97455d5c-699f-4ab6-ac14-57cd44d0ed5c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:20.294829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-38f4086d-1e85-49d9-bc1b-705a1f4a5210 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.214817 Oct 05 17:32:20.295738 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 80/140] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:32:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:20.307653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb4456dd-cf38-49f2-938d-0531c8fc7ce5 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:20.335500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-97455d5c-699f-4ab6-ac14-57cd44d0ed5c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:20.341351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4456dd-cf38-49f2-938d-0531c8fc7ce5 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:20.344178 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-97455d5c-699f-4ab6-ac14-57cd44d0ed5c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1219 microversion: 2.1 time: 0.077813 Oct 05 17:32:20.345593 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 61/141] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:20 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:20.347042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4456dd-cf38-49f2-938d-0531c8fc7ce5 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:20.347596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4456dd-cf38-49f2-938d-0531c8fc7ce5 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:20.405439 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-fb4456dd-cf38-49f2-938d-0531c8fc7ce5 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] HTTP exception thrown: Aggregate 2 already has host n-h2-835595-3. Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb4456dd-cf38-49f2-938d-0531c8fc7ce5 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Request method failure captured: Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 39 Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb97uZAFgFPaRd4LcRiRrinGIZcMYpFf4lVwzgwx_SPkY8MEjwB4m4P7Q_2Et-vrtOiBeX7qsojRalP9RlI_PPX78a7K8oaa-ShEwmHExiHRJl3s5HjDqcDkh0T6RI-6DmJ8glxsMPL7Cguyi1xqt0Sj3leGEC7RmeiqEs32N_H0qjU Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:20.447568 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cce77f155c4108a9f351f060605470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cce77f155c4108a9f351f060605470", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}] Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: ad3f5bee3f474f61bec3cef068443bf7 Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: {"add_host": {"host": "n-h2-835595-3"}} Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:20.448773 n-d-835595-3 devstack@n-api.service[128844]: exception: Aggregate 2 already has host n-h2-835595-3. Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h2-835595-3'}}} Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result.read() Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 17:32:20.449483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-835595-3-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi session.flush() Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 17:32:20.450629 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 17:32:20.451688 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 17:32:20.452846 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result.read() Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-835595-3-2' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 5, 17, 32, 20, 386875), 'updated_at': None, 'host': 'n-h2-835595-3', 'aggregate_id': 2}] Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:20.453825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 2 already has host n-h2-835595-3. Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:20.461159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 2 already has host n-h2-835595-3. Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:20.464630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:20.467536 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 2 already has host n-h2-835595-3. Oct 05 17:32:20.467536 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:20.467536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb4456dd-cf38-49f2-938d-0531c8fc7ce5 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Returning 409 to user: Aggregate 2 already has host n-h2-835595-3. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:20.467536 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb4456dd-cf38-49f2-938d-0531c8fc7ce5 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/2/action" status: 409 len: 95 microversion: 2.1 time: 0.149278 Oct 05 17:32:20.467536 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 81/142] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:32:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 95 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 05 17:32:20.468915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ae07fd95-af06-40d4-b768-2a8ce1c264a1 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-835595-3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:20.492951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae07fd95-af06-40d4-b768-2a8ce1c264a1 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:20.493456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae07fd95-af06-40d4-b768-2a8ce1c264a1 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:20.493902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae07fd95-af06-40d4-b768-2a8ce1c264a1 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:20.511768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30a7b0ad-27b5-41cd-ad74-77364256bc4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:20.512514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-30a7b0ad-27b5-41cd-ad74-77364256bc4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:20.524236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30a7b0ad-27b5-41cd-ad74-77364256bc4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:20.526889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30a7b0ad-27b5-41cd-ad74-77364256bc4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:20.530586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30a7b0ad-27b5-41cd-ad74-77364256bc4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:20.548805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30a7b0ad-27b5-41cd-ad74-77364256bc4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:20.549849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30a7b0ad-27b5-41cd-ad74-77364256bc4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:20.551871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30a7b0ad-27b5-41cd-ad74-77364256bc4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:20.625259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:UPDATE=12,nova_api:SELECT=72,nova_api:INSERT=15,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:20.745207 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ae07fd95-af06-40d4-b768-2a8ce1c264a1 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 227 microversion: 2.1 time: 0.282643 Oct 05 17:32:20.746227 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 62/143] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:32:20 2022] POST /compute/v2.1/os-aggregates/2/action => generated 227 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:20.753302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Action: 'update', calling method: .version_select at 0x7f777613b1f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:21.022918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-30a7b0ad-27b5-41cd-ad74-77364256bc4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:21.032769 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-30a7b0ad-27b5-41cd-ad74-77364256bc4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1313 microversion: 2.1 time: 0.525260 Oct 05 17:32:21.036816 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 82/144] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:20 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:21.047488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a8d1306e-db7e-41e2-8ccb-fe68e6535ee2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:21.048440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a8d1306e-db7e-41e2-8ccb-fe68e6535ee2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:21.063355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d1306e-db7e-41e2-8ccb-fe68e6535ee2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.064145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d1306e-db7e-41e2-8ccb-fe68e6535ee2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.064677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d1306e-db7e-41e2-8ccb-fe68e6535ee2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.066036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d1306e-db7e-41e2-8ccb-fe68e6535ee2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.067671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d1306e-db7e-41e2-8ccb-fe68e6535ee2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.068801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d1306e-db7e-41e2-8ccb-fe68e6535ee2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.145781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.146335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.146732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.147658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.148117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.148527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.171145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=20,nova_api:DELETE=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:21.204401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.205268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.206633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.207556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.208169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.208668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.249829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8d1306e-db7e-41e2-8ccb-fe68e6535ee2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:21.262864 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a8d1306e-db7e-41e2-8ccb-fe68e6535ee2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1325 microversion: 2.1 time: 0.223708 Oct 05 17:32:21.263872 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 83/145] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:21 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1325 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:21.270557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9025de12-c038-4e40-bc67-c7ed37f7614f tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:21.297108 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4d480101-217e-4db7-b89b-d07e0ca7e5e4 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/480984ff95a648419c6092bfd099953c?user_id=4997cc39b4454f2ea9177e56ef59c7cf" status: 200 len: 148 microversion: 2.57 time: 0.548839 Oct 05 17:32:21.303654 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 63/146] 10.222.0.70 () {62 vars in 1384 bytes} [Wed Oct 5 17:32:20 2022] PUT /compute/v2.1/os-quota-sets/480984ff95a648419c6092bfd099953c?user_id=4997cc39b4454f2ea9177e56ef59c7cf => generated 148 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:21.309188 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9025de12-c038-4e40-bc67-c7ed37f7614f tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.043433 Oct 05 17:32:21.310324 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 84/147] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:21 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:21.315031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cf11938b-1ad8-4923-837f-118ffe3a3745 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] Calling method '.version_select at 0x7f77760a9940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:21.320683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a163c000-84e9-42a8-bf3f-77b52de115fa tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-970079708"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:21.328809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-a163c000-84e9-42a8-bf3f-77b52de115fa tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Generated uuid 1bbc6bfe-7c3d-4af5-bf58-c09171b7d4f2 for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:21.361529 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a163c000-84e9-42a8-bf3f-77b52de115fa tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.044601 Oct 05 17:32:21.363217 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 85/148] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:21 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:21.368347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-252f3719-9002-42f5-9bc6-6f40e5c7d2ea tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:21.370051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-252f3719-9002-42f5-9bc6-6f40e5c7d2ea tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:21.382035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-252f3719-9002-42f5-9bc6-6f40e5c7d2ea tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.382561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-252f3719-9002-42f5-9bc6-6f40e5c7d2ea tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.382995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-252f3719-9002-42f5-9bc6-6f40e5c7d2ea tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.383728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-252f3719-9002-42f5-9bc6-6f40e5c7d2ea tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.384174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-252f3719-9002-42f5-9bc6-6f40e5c7d2ea tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.384586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-252f3719-9002-42f5-9bc6-6f40e5c7d2ea tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.425758 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cf11938b-1ad8-4923-837f-118ffe3a3745 tempest-QuotasAdminTestV257-2122753193 tempest-QuotasAdminTestV257-2122753193-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/480984ff95a648419c6092bfd099953c?user_id=4997cc39b4454f2ea9177e56ef59c7cf" status: 200 len: 190 microversion: 2.57 time: 0.120571 Oct 05 17:32:21.427014 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 64/149] 10.222.0.70 () {60 vars in 1364 bytes} [Wed Oct 5 17:32:21 2022] GET /compute/v2.1/os-quota-sets/480984ff95a648419c6092bfd099953c?user_id=4997cc39b4454f2ea9177e56ef59c7cf => generated 190 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:21.512120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-252f3719-9002-42f5-9bc6-6f40e5c7d2ea tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:21.523361 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-252f3719-9002-42f5-9bc6-6f40e5c7d2ea tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1215 microversion: 2.1 time: 0.157985 Oct 05 17:32:21.527617 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 86/150] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:21 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:21.538080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e32be5e-ada5-4eef-a696-772069af47f7 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1784354963"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:21.544273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-4e32be5e-ada5-4eef-a696-772069af47f7 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Generated uuid 4ef63c24-cca0-407d-8dfe-de0ef87caa9e for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:21.620806 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e32be5e-ada5-4eef-a696-772069af47f7 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.091825 Oct 05 17:32:21.621939 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 87/151] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:21 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:21.642809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fe6cf32f-002b-4031-802a-04b6a509e65d tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:21.668100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80cbfdbb-f175-4822-9abf-ae94be5701dc tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-835595-3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:21.671709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-80cbfdbb-f175-4822-9abf-ae94be5701dc tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '445e740a11db467989c79dbdd626a1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab78d9b4e5f4d128ad2984eb693eeaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80cbfdbb-f175-4822-9abf-ae94be5701dc tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Request method failure captured: Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-aggregates/3/action HTTP/1.1 Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 39 Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb95X0XbxPEgSgiOvPrTgTiYE_Z76gUJ6o9FniYH28hY3uzbXE3XZWFGkjxsiLN6uFN-EXFvVdYUGVeGQkCQ7t9Rjy2fe0Sy2Nqb3ECCYpMTK36fqt76yDrWX2WDHbBm_IYxr_zWxm6TDYkAK3q3yeWqClkH4EECWPqjMC0uGXCJlkc Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:21.677767 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aab78d9b4e5f4d128ad2984eb693eeaa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}] Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 445e740a11db467989c79dbdd626a1ac Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: {"add_host": {"host": "n-h2-835595-3"}} Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:21.679232 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '3', 'body': {'add_host': {'host': 'n-h2-835595-3'}}} Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:21.680040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 05 17:32:21.681046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.682306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80cbfdbb-f175-4822-9abf-ae94be5701dc tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:21.684576 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-80cbfdbb-f175-4822-9abf-ae94be5701dc tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates/3/action" status: 403 len: 118 microversion: 2.1 time: 0.253360 Oct 05 17:32:21.685254 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 65/152] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:32:21 2022] POST /compute/v2.1/os-aggregates/3/action => generated 118 bytes in 258 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:21.695588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe6cf32f-002b-4031-802a-04b6a509e65d tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.696092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe6cf32f-002b-4031-802a-04b6a509e65d tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.696522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe6cf32f-002b-4031-802a-04b6a509e65d tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.702833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d78d2a44-ed92-4c48-afc6-337856dc9d2d tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:21.745819 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d78d2a44-ed92-4c48-afc6-337856dc9d2d tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.046976 Oct 05 17:32:21.748475 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 66/153] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:21 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:21.763903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cbdd7a1f-0573-4a9d-8242-f0aab4b2e709 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-364823129"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:21.775885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.aggregate [None req-cbdd7a1f-0573-4a9d-8242-f0aab4b2e709 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Generated uuid 58d993f2-5fa1-41f8-b133-3a29f375558a for aggregate {{(pid=128843) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:21.845528 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cbdd7a1f-0573-4a9d-8242-f0aab4b2e709 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.091848 Oct 05 17:32:21.846936 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 67/154] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:21 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:21.864725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1327793592"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:21.896899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.898859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.900931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.919109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:21.922885 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fe6cf32f-002b-4031-802a-04b6a509e65d tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.292820 Oct 05 17:32:21.923773 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 88/155] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:32:21 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:21.924640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:21.925124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:21.942119 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1327793592 could not be found. Oct 05 17:32:21.950853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c81d2e29-6ae6-45ee-88fa-a528cf00b96a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Request method failure captured: Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-aggregates/5/action HTTP/1.1 Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 58 Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb97uZAFgFPaRd4LcRiRrinGIZcMYpFf4lVwzgwx_SPkY8MEjwB4m4P7Q_2Et-vrtOiBeX7qsojRalP9RlI_PPX78a7K8oaa-ShEwmHExiHRJl3s5HjDqcDkh0T6RI-6DmJ8glxsMPL7Cguyi1xqt0Sj3leGEC7RmeiqEs32N_H0qjU Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:21.956127 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cce77f155c4108a9f351f060605470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cce77f155c4108a9f351f060605470", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}] Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: ad3f5bee3f474f61bec3cef068443bf7 Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: {"add_host": {"host": "tempest-nonexist_host-1327793592"}} Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:21.957570 n-d-835595-3 devstack@n-api.service[128843]: exception: Compute host tempest-nonexist_host-1327793592 could not be found. Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '5', 'body': {'add_host': {'host': 'tempest-nonexist_host-1327793592'}}} Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1327793592' is not mapped to any cell Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:21.958463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 05 17:32:21.959808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1327793592 could not be found. Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1327793592 could not be found. Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:21.961111 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.962632 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:21.962632 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:21.962632 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:21.962632 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:21.962632 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:21.962632 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1327793592 could not be found. Oct 05 17:32:21.962632 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:21.962632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1327793592 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:21.962632 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-274b0b2d-5a1c-4caa-94fb-83c54dad7a80 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/5/action" status: 404 len: 111 microversion: 2.1 time: 0.108089 Oct 05 17:32:21.963396 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 68/156] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:32:21 2022] POST /compute/v2.1/os-aggregates/5/action => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:21.973546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64c8d992-1681-4fae-bde7-0d3e7ec5d0f5 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:22.025680 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-64c8d992-1681-4fae-bde7-0d3e7ec5d0f5 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.058201 Oct 05 17:32:22.028465 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 69/157] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:21 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:22.044462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4c098d58-369e-4dbc-bcd4-2649c625a3d8 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4c098d58-369e-4dbc-bcd4-2649c625a3d8 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Request method failure captured: Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 283 Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb97uZAFgFPaRd4LcRiRrinGIZcMYpFf4lVwzgwx_SPkY8MEjwB4m4P7Q_2Et-vrtOiBeX7qsojRalP9RlI_PPX78a7K8oaa-ShEwmHExiHRJl3s5HjDqcDkh0T6RI-6DmJ8glxsMPL7Cguyi1xqt0Sj3leGEC7RmeiqEs32N_H0qjU Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:22.070627 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:22.071899 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cce77f155c4108a9f351f060605470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cce77f155c4108a9f351f060605470", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}] Oct 05 17:32:22.071899 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:22.071899 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:22.071899 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:22.071899 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:22.071899 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:22.071899 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:22.071899 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: ad3f5bee3f474f61bec3cef068443bf7 Oct 05 17:32:22.071899 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:22.071899 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:32:22.072439 n-d-835595-3 devstack@n-api.service[128843]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 05 17:32:22.072439 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:22.072439 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 17:32:22.072439 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 05 17:32:22.072439 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:22.072439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:22.072439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:32:22.072439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:32:22.072439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:32:22.072439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:22.073115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:22.074587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:22.075369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:32:22.075369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:32:22.075369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 17:32:22.075369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.075369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4c098d58-369e-4dbc-bcd4-2649c625a3d8 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:22.075675 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4c098d58-369e-4dbc-bcd4-2649c625a3d8 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.040118 Oct 05 17:32:22.075675 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 70/158] 10.222.0.70 () {60 vars in 1165 bytes} [Wed Oct 5 17:32:22 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:32:22.084884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd53ed9c-a999-4eeb-be08-43ece01630cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:22.085535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bd53ed9c-a999-4eeb-be08-43ece01630cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:22.099394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd53ed9c-a999-4eeb-be08-43ece01630cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:22.101099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd53ed9c-a999-4eeb-be08-43ece01630cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:22.102677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd53ed9c-a999-4eeb-be08-43ece01630cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:22.104966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd53ed9c-a999-4eeb-be08-43ece01630cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:22.106764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd53ed9c-a999-4eeb-be08-43ece01630cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:22.107370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd53ed9c-a999-4eeb-be08-43ece01630cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:22.346507 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c81d2e29-6ae6-45ee-88fa-a528cf00b96a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/4" status: 200 len: 242 microversion: 2.1 time: 0.410169 Oct 05 17:32:22.354399 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 89/159] 10.222.0.70 () {58 vars in 1149 bytes} [Wed Oct 5 17:32:21 2022] GET /compute/v2.1/os-aggregates/4 => generated 242 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:22.361358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-669cc7d7-bbb4-4ed9-90c8-bd2b8ed1a8dd tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-669cc7d7-bbb4-4ed9-90c8-bd2b8ed1a8dd tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Request method failure captured: Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 27 Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb97uZAFgFPaRd4LcRiRrinGIZcMYpFf4lVwzgwx_SPkY8MEjwB4m4P7Q_2Et-vrtOiBeX7qsojRalP9RlI_PPX78a7K8oaa-ShEwmHExiHRJl3s5HjDqcDkh0T6RI-6DmJ8glxsMPL7Cguyi1xqt0Sj3leGEC7RmeiqEs32N_H0qjU Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:22.367766 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cce77f155c4108a9f351f060605470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cce77f155c4108a9f351f060605470", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}] Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: ad3f5bee3f474f61bec3cef068443bf7 Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: {"aggregate": {"name": ""}} Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:22.369163 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi '' Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:22.370089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 05 17:32:22.371741 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.373778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-669cc7d7-bbb4-4ed9-90c8-bd2b8ed1a8dd tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:22.375364 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-669cc7d7-bbb4-4ed9-90c8-bd2b8ed1a8dd tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019627 Oct 05 17:32:22.376111 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 90/160] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:22 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:32:22.380998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3502ceb8-52ed-4609-8e80-2a5dc668c84e req-05b580d2-2142-4dcd-9ea1-02f86154129a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d6f375-344a-4460-a8bd-dc5e9c7af8e6", "tag": "16de15df-aa59-4811-a979-bf656b358834"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:22.393667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3502ceb8-52ed-4609-8e80-2a5dc668c84e req-05b580d2-2142-4dcd-9ea1-02f86154129a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:22.395537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3502ceb8-52ed-4609-8e80-2a5dc668c84e req-05b580d2-2142-4dcd-9ea1-02f86154129a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:22.396466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3502ceb8-52ed-4609-8e80-2a5dc668c84e req-05b580d2-2142-4dcd-9ea1-02f86154129a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:22.410029 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3502ceb8-52ed-4609-8e80-2a5dc668c84e req-05b580d2-2142-4dcd-9ea1-02f86154129a service nova] Creating event network-changed:16de15df-aa59-4811-a979-bf656b358834 for instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 on n-h2-835595-3 Oct 05 17:32:22.417412 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3502ceb8-52ed-4609-8e80-2a5dc668c84e req-05b580d2-2142-4dcd-9ea1-02f86154129a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039802 Oct 05 17:32:22.418270 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 91/161] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:22.425932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-401b3584-34a5-4a9f-839d-c57626e723b9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:22.427286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-401b3584-34a5-4a9f-839d-c57626e723b9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:22.439974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-401b3584-34a5-4a9f-839d-c57626e723b9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:22.441901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-401b3584-34a5-4a9f-839d-c57626e723b9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:22.443386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-401b3584-34a5-4a9f-839d-c57626e723b9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:22.444611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-401b3584-34a5-4a9f-839d-c57626e723b9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:22.447617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-401b3584-34a5-4a9f-839d-c57626e723b9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:22.448423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-401b3584-34a5-4a9f-839d-c57626e723b9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:22.594691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-401b3584-34a5-4a9f-839d-c57626e723b9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:22.607502 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-401b3584-34a5-4a9f-839d-c57626e723b9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1323 microversion: 2.1 time: 0.184639 Oct 05 17:32:22.608488 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 92/162] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:22 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1323 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:22.621540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ab53b92-2c45-436a-8f35-e60c26137614 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:22.650706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ab53b92-2c45-436a-8f35-e60c26137614 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:22.651385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ab53b92-2c45-436a-8f35-e60c26137614 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:22.651968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ab53b92-2c45-436a-8f35-e60c26137614 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:22.689003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bd53ed9c-a999-4eeb-be08-43ece01630cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:22.717098 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bd53ed9c-a999-4eeb-be08-43ece01630cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1313 microversion: 2.1 time: 0.642121 Oct 05 17:32:22.717895 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 71/163] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:22 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1313 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:22.723736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a80d4ffe-719c-470c-ad08-dfc03b0f21f9 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1857662518"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:22.734724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a80d4ffe-719c-470c-ad08-dfc03b0f21f9 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '445e740a11db467989c79dbdd626a1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab78d9b4e5f4d128ad2984eb693eeaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a80d4ffe-719c-470c-ad08-dfc03b0f21f9 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Request method failure captured: Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 60 Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb95X0XbxPEgSgiOvPrTgTiYE_Z76gUJ6o9FniYH28hY3uzbXE3XZWFGkjxsiLN6uFN-EXFvVdYUGVeGQkCQ7t9Rjy2fe0Sy2Nqb3ECCYpMTK36fqt76yDrWX2WDHbBm_IYxr_zWxm6TDYkAK3q3yeWqClkH4EECWPqjMC0uGXCJlkc Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:22.736754 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aab78d9b4e5f4d128ad2984eb693eeaa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}] Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 445e740a11db467989c79dbdd626a1ac Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: {"aggregate": {"name": "tempest-test_aggregate-1857662518"}} Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:22.738221 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1857662518'}}} Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:22.739204 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:22.740256 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 05 17:32:22.741528 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:22.741528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a80d4ffe-719c-470c-ad08-dfc03b0f21f9 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:22.741528 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a80d4ffe-719c-470c-ad08-dfc03b0f21f9 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.018813 Oct 05 17:32:22.742018 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 72/164] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:22 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:22.757841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-15357212-48f0-4d4e-8c90-75a4eb249fcd tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:22.759400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-15357212-48f0-4d4e-8c90-75a4eb249fcd tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:22.777248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15357212-48f0-4d4e-8c90-75a4eb249fcd tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:22.778008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15357212-48f0-4d4e-8c90-75a4eb249fcd tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:22.779111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15357212-48f0-4d4e-8c90-75a4eb249fcd tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:22.780247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15357212-48f0-4d4e-8c90-75a4eb249fcd tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:22.780902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15357212-48f0-4d4e-8c90-75a4eb249fcd tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:22.781521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15357212-48f0-4d4e-8c90-75a4eb249fcd tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:22.918774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-15357212-48f0-4d4e-8c90-75a4eb249fcd tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:22.930526 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ab53b92-2c45-436a-8f35-e60c26137614 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.320174 Oct 05 17:32:22.932921 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-15357212-48f0-4d4e-8c90-75a4eb249fcd tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1277 microversion: 2.1 time: 0.189583 Oct 05 17:32:22.933630 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 93/165] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:32:22 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:22.935936 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 73/166] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:22 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:22.945306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cccbccc0-869a-4094-a43c-c62b8f5400ed tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:22.952010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-735fff34-4862-4535-8534-385ca9199b41 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-48422511"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:22.971735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-735fff34-4862-4535-8534-385ca9199b41 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Generated uuid 57b17316-ea80-44ab-845d-786cdf4d76e1 for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:23.021474 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cccbccc0-869a-4094-a43c-c62b8f5400ed tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.077656 Oct 05 17:32:23.022876 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 74/167] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:22 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:23.042410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5dffc1af-237c-4fb1-aaa4-c505b40c4aef tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1878559175"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:23.053171 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-735fff34-4862-4535-8534-385ca9199b41 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.116101 Oct 05 17:32:23.056087 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 94/168] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:22 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:23.062892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.aggregate [None req-5dffc1af-237c-4fb1-aaa4-c505b40c4aef tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Generated uuid fa021a01-3721-4299-b06b-11214d7f80b0 for aggregate {{(pid=128843) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:23.075269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1bb843f8-db81-48cd-8637-8466db232a9c tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-48422511"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:23.085172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-1bb843f8-db81-48cd-8637-8466db232a9c tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Generated uuid 3c4a315a-1c75-4a5f-9cda-11321dc7b958 for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:23.103355 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-1bb843f8-db81-48cd-8637-8466db232a9c tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-48422511 already exists. Oct 05 17:32:23.111822 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5dffc1af-237c-4fb1-aaa4-c505b40c4aef tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.080600 Oct 05 17:32:23.113180 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 75/169] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:23 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1bb843f8-db81-48cd-8637-8466db232a9c tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Request method failure captured: Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 58 Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb97uZAFgFPaRd4LcRiRrinGIZcMYpFf4lVwzgwx_SPkY8MEjwB4m4P7Q_2Et-vrtOiBeX7qsojRalP9RlI_PPX78a7K8oaa-ShEwmHExiHRJl3s5HjDqcDkh0T6RI-6DmJ8glxsMPL7Cguyi1xqt0Sj3leGEC7RmeiqEs32N_H0qjU Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:23.114055 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cce77f155c4108a9f351f060605470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cce77f155c4108a9f351f060605470", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}] Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: ad3f5bee3f474f61bec3cef068443bf7 Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: {"aggregate": {"name": "tempest-test_aggregate-48422511"}} Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:23.115386 n-d-835595-3 devstack@n-api.service[128844]: exception: Aggregate tempest-test_aggregate-48422511 already exists. Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-48422511'}}} Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 05 17:32:23.116210 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-48422511 already exists. Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:23.117601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-48422511 already exists. Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-48422511 already exists. Oct 05 17:32:23.119597 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.121661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1bb843f8-db81-48cd-8637-8466db232a9c tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-48422511 already exists. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:23.122731 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1bb843f8-db81-48cd-8637-8466db232a9c tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 409 len: 109 microversion: 2.1 time: 0.057698 Oct 05 17:32:23.123493 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 95/170] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:23 2022] POST /compute/v2.1/os-aggregates => generated 109 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:23.132066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d590437d-7387-4cc3-8f17-b2151a221812 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.133013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de5545d6-b1a6-4e00-9b1e-b00cf1c0e2c2 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-835595-3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:23.158055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de5545d6-b1a6-4e00-9b1e-b00cf1c0e2c2 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:23.158727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de5545d6-b1a6-4e00-9b1e-b00cf1c0e2c2 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:23.159273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de5545d6-b1a6-4e00-9b1e-b00cf1c0e2c2 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:23.170260 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d590437d-7387-4cc3-8f17-b2151a221812 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.041944 Oct 05 17:32:23.171245 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 96/171] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:23 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:23.181167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a6557996-20a3-4629-9107-80120c1f82f4 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-319807696"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:23.185011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-a6557996-20a3-4629-9107-80120c1f82f4 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Generated uuid 65f75c54-1471-4f6d-bca6-d853371dee9c for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:23.243234 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a6557996-20a3-4629-9107-80120c1f82f4 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.066468 Oct 05 17:32:23.252107 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 97/172] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:23 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:23.266763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0dad0631-b200-4372-875c-f984949a2782 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.271415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0dad0631-b200-4372-875c-f984949a2782 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '445e740a11db467989c79dbdd626a1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab78d9b4e5f4d128ad2984eb693eeaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0dad0631-b200-4372-875c-f984949a2782 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Request method failure captured: Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb95X0XbxPEgSgiOvPrTgTiYE_Z76gUJ6o9FniYH28hY3uzbXE3XZWFGkjxsiLN6uFN-EXFvVdYUGVeGQkCQ7t9Rjy2fe0Sy2Nqb3ECCYpMTK36fqt76yDrWX2WDHbBm_IYxr_zWxm6TDYkAK3q3yeWqClkH4EECWPqjMC0uGXCJlkc Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:23.276797 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aab78d9b4e5f4d128ad2984eb693eeaa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}] Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 445e740a11db467989c79dbdd626a1ac Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 05 17:32:23.278302 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '8'} Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:23.279120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 05 17:32:23.280681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.281992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0dad0631-b200-4372-875c-f984949a2782 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:23.283734 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0dad0631-b200-4372-875c-f984949a2782 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/8" status: 403 len: 116 microversion: 2.1 time: 0.027248 Oct 05 17:32:23.284398 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 98/173] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:23 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 116 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:23.296125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c3c9b29-73a9-4adc-a6e7-a12b08035b68 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.340792 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c3c9b29-73a9-4adc-a6e7-a12b08035b68 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.050083 Oct 05 17:32:23.341784 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 99/174] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:23 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:23.360093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-41fe57a7-1cf7-4bfe-b6e9-44994bbb3f1d tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.377879 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-41fe57a7-1cf7-4bfe-b6e9-44994bbb3f1d tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-41fe57a7-1cf7-4bfe-b6e9-44994bbb3f1d tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Request method failure captured: Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb97uZAFgFPaRd4LcRiRrinGIZcMYpFf4lVwzgwx_SPkY8MEjwB4m4P7Q_2Et-vrtOiBeX7qsojRalP9RlI_PPX78a7K8oaa-ShEwmHExiHRJl3s5HjDqcDkh0T6RI-6DmJ8glxsMPL7Cguyi1xqt0Sj3leGEC7RmeiqEs32N_H0qjU Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:23.380450 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cce77f155c4108a9f351f060605470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cce77f155c4108a9f351f060605470", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}] Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: ad3f5bee3f474f61bec3cef068443bf7 Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: exception: Aggregate -1 could not be found. Oct 05 17:32:23.381615 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '-1'} Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 17:32:23.382342 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.384182 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.385312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.385312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.385312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:23.385312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:23.385312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 05 17:32:23.385312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.385312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-41fe57a7-1cf7-4bfe-b6e9-44994bbb3f1d tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:23.385312 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-41fe57a7-1cf7-4bfe-b6e9-44994bbb3f1d tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.035040 Oct 05 17:32:23.385312 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 100/175] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:23 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:23.396593 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de5545d6-b1a6-4e00-9b1e-b00cf1c0e2c2 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 242 microversion: 2.1 time: 0.275712 Oct 05 17:32:23.397265 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 76/176] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:32:23 2022] POST /compute/v2.1/os-aggregates/7/action => generated 242 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:23.403997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ce3140f-b3af-4684-a150-c243590f042f tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-26070176"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:23.409411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d31a0b8d-277b-4d39-8955-1c68621d2947 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.422891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-3ce3140f-b3af-4684-a150-c243590f042f tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Generated uuid d6ea6ba5-b041-4637-9c47-0c0042ede58d for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:23.431764 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d31a0b8d-277b-4d39-8955-1c68621d2947 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.025737 Oct 05 17:32:23.440048 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 77/177] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:32:23 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:23.450914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa3d8d03-28f7-441b-b944-b1ef03e8413e tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-835595-3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:23.456156 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ce3140f-b3af-4684-a150-c243590f042f tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.067270 Oct 05 17:32:23.456942 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 101/178] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:23 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:23.470075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d057b733-539c-464d-ad4a-50f93dc3b741 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.471729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d057b733-539c-464d-ad4a-50f93dc3b741 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '445e740a11db467989c79dbdd626a1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab78d9b4e5f4d128ad2984eb693eeaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d057b733-539c-464d-ad4a-50f93dc3b741 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Request method failure captured: Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-aggregates/9 HTTP/1.1 Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb95X0XbxPEgSgiOvPrTgTiYE_Z76gUJ6o9FniYH28hY3uzbXE3XZWFGkjxsiLN6uFN-EXFvVdYUGVeGQkCQ7t9Rjy2fe0Sy2Nqb3ECCYpMTK36fqt76yDrWX2WDHbBm_IYxr_zWxm6TDYkAK3q3yeWqClkH4EECWPqjMC0uGXCJlkc Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:23.478060 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aab78d9b4e5f4d128ad2984eb693eeaa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}] Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 445e740a11db467989c79dbdd626a1ac Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 05 17:32:23.479342 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '9'} Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:23.479991 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 05 17:32:23.480995 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.481884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa3d8d03-28f7-441b-b944-b1ef03e8413e tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:23.481961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d057b733-539c-464d-ad4a-50f93dc3b741 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:23.482031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa3d8d03-28f7-441b-b944-b1ef03e8413e tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:23.482031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa3d8d03-28f7-441b-b944-b1ef03e8413e tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:23.482185 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d057b733-539c-464d-ad4a-50f93dc3b741 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] 10.222.0.70 "GET /compute/v2.1/os-aggregates/9" status: 403 len: 114 microversion: 2.1 time: 0.015354 Oct 05 17:32:23.482185 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 102/179] 10.222.0.70 () {58 vars in 1149 bytes} [Wed Oct 5 17:32:23 2022] GET /compute/v2.1/os-aggregates/9 => generated 114 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:32:23.489304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e502e38-662a-4a44-8f36-d768092bd303 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.518633 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e502e38-662a-4a44-8f36-d768092bd303 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.033506 Oct 05 17:32:23.521263 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 103/180] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:23 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:23.529870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb17104c-ec1c-4754-ab6d-9698a7161556 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.566799 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-eb17104c-ec1c-4754-ab6d-9698a7161556 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb17104c-ec1c-4754-ab6d-9698a7161556 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Request method failure captured: Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb97uZAFgFPaRd4LcRiRrinGIZcMYpFf4lVwzgwx_SPkY8MEjwB4m4P7Q_2Et-vrtOiBeX7qsojRalP9RlI_PPX78a7K8oaa-ShEwmHExiHRJl3s5HjDqcDkh0T6RI-6DmJ8glxsMPL7Cguyi1xqt0Sj3leGEC7RmeiqEs32N_H0qjU Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:23.568792 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cce77f155c4108a9f351f060605470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cce77f155c4108a9f351f060605470", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}] Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: ad3f5bee3f474f61bec3cef068443bf7 Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: exception: Aggregate -1 could not be found. Oct 05 17:32:23.570273 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '-1'} Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.571084 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 05 17:32:23.572178 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.575918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb17104c-ec1c-4754-ab6d-9698a7161556 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:23.575918 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb17104c-ec1c-4754-ab6d-9698a7161556 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.046481 Oct 05 17:32:23.575918 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 104/181] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:23 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:23.596041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd02ad93-ea56-4181-a985-71920643850f tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.599602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd02ad93-ea56-4181-a985-71920643850f tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '445e740a11db467989c79dbdd626a1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab78d9b4e5f4d128ad2984eb693eeaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd02ad93-ea56-4181-a985-71920643850f tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Request method failure captured: Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb95X0XbxPEgSgiOvPrTgTiYE_Z76gUJ6o9FniYH28hY3uzbXE3XZWFGkjxsiLN6uFN-EXFvVdYUGVeGQkCQ7t9Rjy2fe0Sy2Nqb3ECCYpMTK36fqt76yDrWX2WDHbBm_IYxr_zWxm6TDYkAK3q3yeWqClkH4EECWPqjMC0uGXCJlkc Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:23.604558 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aab78d9b4e5f4d128ad2984eb693eeaa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}] Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 445e740a11db467989c79dbdd626a1ac Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 05 17:32:23.605899 n-d-835595-3 devstack@n-api.service[128844]: action_args: {} Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:23.606702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:23.608149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd02ad93-ea56-4181-a985-71920643850f tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:23.611964 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd02ad93-ea56-4181-a985-71920643850f tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.029302 Oct 05 17:32:23.613772 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 105/182] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:32:23 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:23.639602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-465d0016-478a-446d-a792-065ecc7cd972 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.640232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-465d0016-478a-446d-a792-065ecc7cd972 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:23.653126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-465d0016-478a-446d-a792-065ecc7cd972 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:23.654563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-465d0016-478a-446d-a792-065ecc7cd972 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:23.655191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-465d0016-478a-446d-a792-065ecc7cd972 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:23.656896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-465d0016-478a-446d-a792-065ecc7cd972 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:23.657548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-465d0016-478a-446d-a792-065ecc7cd972 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:23.658244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-465d0016-478a-446d-a792-065ecc7cd972 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:23.739419 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa3d8d03-28f7-441b-b944-b1ef03e8413e tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/7/action" status: 200 len: 227 microversion: 2.1 time: 0.296715 Oct 05 17:32:23.746941 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 78/183] 10.222.0.70 () {60 vars in 1191 bytes} [Wed Oct 5 17:32:23 2022] POST /compute/v2.1/os-aggregates/7/action => generated 227 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:23.751766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a327bf9-103c-46a5-852e-7ba0b5bc5cc1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.752871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7a327bf9-103c-46a5-852e-7ba0b5bc5cc1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:23.762098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a327bf9-103c-46a5-852e-7ba0b5bc5cc1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:23.762690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a327bf9-103c-46a5-852e-7ba0b5bc5cc1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:23.780836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a327bf9-103c-46a5-852e-7ba0b5bc5cc1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:23.781631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a327bf9-103c-46a5-852e-7ba0b5bc5cc1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:23.782114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a327bf9-103c-46a5-852e-7ba0b5bc5cc1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:23.784906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a327bf9-103c-46a5-852e-7ba0b5bc5cc1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:23.899490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-465d0016-478a-446d-a792-065ecc7cd972 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:23.918250 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-465d0016-478a-446d-a792-065ecc7cd972 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1390 microversion: 2.1 time: 0.287378 Oct 05 17:32:23.919184 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 106/184] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:23 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1390 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:23.926630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c660d079-b403-4882-b6d9-ada3698d9c94 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.965093 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c660d079-b403-4882-b6d9-ada3698d9c94 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.044311 Oct 05 17:32:23.971401 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 107/185] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:23 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:23.975290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b1c96236-54a3-466a-a07a-c559b0261b9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:23.976009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b1c96236-54a3-466a-a07a-c559b0261b9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:23.985732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c96236-54a3-466a-a07a-c559b0261b9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:23.986270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c96236-54a3-466a-a07a-c559b0261b9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:23.986757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c96236-54a3-466a-a07a-c559b0261b9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:23.987518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c96236-54a3-466a-a07a-c559b0261b9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:23.987977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c96236-54a3-466a-a07a-c559b0261b9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:23.988465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c96236-54a3-466a-a07a-c559b0261b9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:24.059812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b1c96236-54a3-466a-a07a-c559b0261b9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:24.067917 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b1c96236-54a3-466a-a07a-c559b0261b9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1277 microversion: 2.1 time: 0.100523 Oct 05 17:32:24.078297 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 108/186] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:23 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:24.078297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d4ecfe4-d338-4f6c-9b15-292a0d5664e1 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-482070174"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:24.078297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-9d4ecfe4-d338-4f6c-9b15-292a0d5664e1 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Generated uuid 59c15df0-a5f3-4a65-93c0-0e0591195d60 for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:24.104279 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9d4ecfe4-d338-4f6c-9b15-292a0d5664e1 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.034069 Oct 05 17:32:24.105231 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 109/187] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:24.118211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5436bb1-3cfb-4b70-b927-3d6f44f2356f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:24.130645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5436bb1-3cfb-4b70-b927-3d6f44f2356f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:24.131309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5436bb1-3cfb-4b70-b927-3d6f44f2356f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:24.131842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5436bb1-3cfb-4b70-b927-3d6f44f2356f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:24.224094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7a327bf9-103c-46a5-852e-7ba0b5bc5cc1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:24.251490 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a327bf9-103c-46a5-852e-7ba0b5bc5cc1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1313 microversion: 2.1 time: 0.509249 Oct 05 17:32:24.252096 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 79/188] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:23 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:24.402531 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b5436bb1-3cfb-4b70-b927-3d6f44f2356f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 242 microversion: 2.1 time: 0.289172 Oct 05 17:32:24.403982 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 110/189] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:32:24 2022] POST /compute/v2.1/os-aggregates/10/action => generated 242 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:24.418249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f266a268-9fbf-4190-90cb-e8c7d9bb7a3f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-835595-3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:24.433049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f266a268-9fbf-4190-90cb-e8c7d9bb7a3f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:24.433546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f266a268-9fbf-4190-90cb-e8c7d9bb7a3f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:24.433973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f266a268-9fbf-4190-90cb-e8c7d9bb7a3f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:24.437794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:24.604860 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f266a268-9fbf-4190-90cb-e8c7d9bb7a3f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.192368 Oct 05 17:32:24.608160 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 80/190] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:32:24 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:24.619526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-69afd31b-b1cb-4f88-a8cf-150a3479ad38 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:24.641203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=11,nova_api:INSERT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:24.660362 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-69afd31b-b1cb-4f88-a8cf-150a3479ad38 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.044478 Oct 05 17:32:24.660949 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 111/191] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:24 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:24.671095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1e42ecac-0bae-425c-b3aa-525665e22892 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-120329324"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:24.680202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.aggregate [None req-1e42ecac-0bae-425c-b3aa-525665e22892 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Generated uuid f6d257ba-d07f-497f-8bad-365be5d14725 for aggregate {{(pid=128843) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:24.681609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a46f683d-70f3-424d-83f0-a2c41b7c3f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-987054785"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:24.685635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-a46f683d-70f3-424d-83f0-a2c41b7c3f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Generated uuid f839b90b-c208-4b43-8c83-924169e3382c for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:24.738332 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1e42ecac-0bae-425c-b3aa-525665e22892 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.071591 Oct 05 17:32:24.743994 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 81/192] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:24.758047 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a46f683d-70f3-424d-83f0-a2c41b7c3f79 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.083336 Oct 05 17:32:24.763176 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 112/193] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:24 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:24.764039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9021b505-4b68-49af-9eff-a5555932182b tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:24.776770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e2519b4-5d56-4cd3-bdd3-3f2a0fc9414a tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:24.812025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e2519b4-5d56-4cd3-bdd3-3f2a0fc9414a tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:24.813314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e2519b4-5d56-4cd3-bdd3-3f2a0fc9414a tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:24.814074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e2519b4-5d56-4cd3-bdd3-3f2a0fc9414a tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:24.826672 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9021b505-4b68-49af-9eff-a5555932182b tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.077649 Oct 05 17:32:24.827749 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 82/194] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:24 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:24.846565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53fa6c30-7237-4637-92f7-9634eae5dee3 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:24.866135 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-53fa6c30-7237-4637-92f7-9634eae5dee3 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53fa6c30-7237-4637-92f7-9634eae5dee3 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Request method failure captured: Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb970-xulHP5gDCuHPz1kMK31A8OIXhij8FW4lMH5cOCcqpiMsZZbAhrA2LZNnSORw5tV4H6JZbUHCOdALwaBmzxrXb5oBZlrhBBsGHA_Mn6n8Uw5_yXUFpNbo7josbj1mohnskXmQsYOT__LUaug_FrFMUeVrkqPIoToG4UK85JdRs Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: edeac9c5e6b744ffab7020bd5143e11e Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:24.874727 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/edeac9c5e6b744ffab7020bd5143e11e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/edeac9c5e6b744ffab7020bd5143e11e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_edeac9c5e6b744ffab7020bd5143e11e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/edeac9c5e6b744ffab7020bd5143e11e"}]}] Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: edeac9c5e6b744ffab7020bd5143e11e Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AggregatesAdminTestJSON-970960795-project-admin Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 8a68e19049b945c9bf0611bfa5c4e78e Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AggregatesAdminTestJSON-970960795-project-admin Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: exception: Aggregate 11 could not be found. Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '11'} Oct 05 17:32:24.876246 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:24.877125 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 05 17:32:24.878773 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:24.883810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53fa6c30-7237-4637-92f7-9634eae5dee3 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:24.887087 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53fa6c30-7237-4637-92f7-9634eae5dee3 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.052894 Oct 05 17:32:24.891500 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 83/195] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:24 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:24.898582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e6ac9440-2589-4615-b3c3-cb24726417fb tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:24.940446 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e6ac9440-2589-4615-b3c3-cb24726417fb tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e6ac9440-2589-4615-b3c3-cb24726417fb tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Request method failure captured: Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb970-xulHP5gDCuHPz1kMK31A8OIXhij8FW4lMH5cOCcqpiMsZZbAhrA2LZNnSORw5tV4H6JZbUHCOdALwaBmzxrXb5oBZlrhBBsGHA_Mn6n8Uw5_yXUFpNbo7josbj1mohnskXmQsYOT__LUaug_FrFMUeVrkqPIoToG4UK85JdRs Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: edeac9c5e6b744ffab7020bd5143e11e Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:24.942426 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/edeac9c5e6b744ffab7020bd5143e11e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/edeac9c5e6b744ffab7020bd5143e11e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_edeac9c5e6b744ffab7020bd5143e11e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/edeac9c5e6b744ffab7020bd5143e11e"}]}] Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: edeac9c5e6b744ffab7020bd5143e11e Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AggregatesAdminTestJSON-970960795-project-admin Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 8a68e19049b945c9bf0611bfa5c4e78e Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AggregatesAdminTestJSON-970960795-project-admin Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: exception: Aggregate 11 could not be found. Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '11'} Oct 05 17:32:24.944031 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:24.944922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:24.946214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:24.948590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:24.948590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:24.948590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:24.948590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 05 17:32:24.948590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:24.952122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e6ac9440-2589-4615-b3c3-cb24726417fb tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:24.953181 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e6ac9440-2589-4615-b3c3-cb24726417fb tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.059931 Oct 05 17:32:24.953904 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 84/196] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:24 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:24.965464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f751d1d-8536-469e-b9e2-bb1e04232151 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:24.966479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3f751d1d-8536-469e-b9e2-bb1e04232151 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:24.968976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:DELETE=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:24.977074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f751d1d-8536-469e-b9e2-bb1e04232151 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:24.978168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f751d1d-8536-469e-b9e2-bb1e04232151 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:24.978669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f751d1d-8536-469e-b9e2-bb1e04232151 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:24.979587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f751d1d-8536-469e-b9e2-bb1e04232151 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:24.981066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f751d1d-8536-469e-b9e2-bb1e04232151 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:24.981751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f751d1d-8536-469e-b9e2-bb1e04232151 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:25.114257 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e2519b4-5d56-4cd3-bdd3-3f2a0fc9414a tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 242 microversion: 2.1 time: 0.344865 Oct 05 17:32:25.115318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 113/197] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:32:24 2022] POST /compute/v2.1/os-aggregates/12/action => generated 242 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:25.122207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6aa5e7f1-463e-40fe-acf6-8201f252bd6a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1814516856", "name": "tempest-test_aggregate-838193475"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:25.126047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-6aa5e7f1-463e-40fe-acf6-8201f252bd6a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Generated uuid 659d55de-70da-41e6-8de8-1b835a3788ad for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:25.165540 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6aa5e7f1-463e-40fe-acf6-8201f252bd6a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.042449 Oct 05 17:32:25.165540 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 114/198] 10.222.0.70 () {60 vars in 1165 bytes} [Wed Oct 5 17:32:25 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:25.165540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-19e0aca1-efc1-4d0b-a55c-442e157099e7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:25.165540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-19e0aca1-efc1-4d0b-a55c-442e157099e7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:25.172720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19e0aca1-efc1-4d0b-a55c-442e157099e7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:25.173209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19e0aca1-efc1-4d0b-a55c-442e157099e7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:25.173737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19e0aca1-efc1-4d0b-a55c-442e157099e7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:25.174474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19e0aca1-efc1-4d0b-a55c-442e157099e7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:25.175087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19e0aca1-efc1-4d0b-a55c-442e157099e7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:25.175607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19e0aca1-efc1-4d0b-a55c-442e157099e7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:25.458845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-19e0aca1-efc1-4d0b-a55c-442e157099e7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:25.467829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-19e0aca1-efc1-4d0b-a55c-442e157099e7 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1319 microversion: 2.1 time: 0.306496 Oct 05 17:32:25.469094 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 115/199] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:25 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:25.473818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-506389b4-46ce-4661-a67e-12387e9e84a3 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:25.477519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-506389b4-46ce-4661-a67e-12387e9e84a3 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '445e740a11db467989c79dbdd626a1ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aab78d9b4e5f4d128ad2984eb693eeaa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-506389b4-46ce-4661-a67e-12387e9e84a3 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Request method failure captured: Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 42 Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb95X0XbxPEgSgiOvPrTgTiYE_Z76gUJ6o9FniYH28hY3uzbXE3XZWFGkjxsiLN6uFN-EXFvVdYUGVeGQkCQ7t9Rjy2fe0Sy2Nqb3ECCYpMTK36fqt76yDrWX2WDHbBm_IYxr_zWxm6TDYkAK3q3yeWqClkH4EECWPqjMC0uGXCJlkc Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:25.479329 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_aab78d9b4e5f4d128ad2984eb693eeaa", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/aab78d9b4e5f4d128ad2984eb693eeaa"}]}] Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: aab78d9b4e5f4d128ad2984eb693eeaa Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-287804791 Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 445e740a11db467989c79dbdd626a1ac Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-287804791-project Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: {"remove_host": {"host": "n-h2-835595-3"}} Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:25.480800 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h2-835595-3'}}} Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:25.481719 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 05 17:32:25.483378 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.486119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-506389b4-46ce-4661-a67e-12387e9e84a3 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:25.486119 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-506389b4-46ce-4661-a67e-12387e9e84a3 tempest-AggregatesAdminNegativeTestJSON-287804791 tempest-AggregatesAdminNegativeTestJSON-287804791-project] 10.222.0.70 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.014355 Oct 05 17:32:25.486119 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 116/200] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:32:25 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:25.490010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1f404f3f-c3ce-4103-93ec-0f41c7b166fe tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:25.514167 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1f404f3f-c3ce-4103-93ec-0f41c7b166fe tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.027764 Oct 05 17:32:25.515412 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 117/201] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:25 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:25.520283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ba9beac3-3c7f-4ced-8f98-f9f48f2281ab tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:25.520973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ba9beac3-3c7f-4ced-8f98-f9f48f2281ab tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:25.527470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba9beac3-3c7f-4ced-8f98-f9f48f2281ab tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:25.528194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba9beac3-3c7f-4ced-8f98-f9f48f2281ab tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:25.528820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba9beac3-3c7f-4ced-8f98-f9f48f2281ab tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:25.529555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba9beac3-3c7f-4ced-8f98-f9f48f2281ab tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:25.530106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba9beac3-3c7f-4ced-8f98-f9f48f2281ab tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:25.538330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba9beac3-3c7f-4ced-8f98-f9f48f2281ab tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:25.544349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:25.688969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3f751d1d-8536-469e-b9e2-bb1e04232151 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:25.699001 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3f751d1d-8536-469e-b9e2-bb1e04232151 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1390 microversion: 2.1 time: 0.739393 Oct 05 17:32:25.699621 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 85/202] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:24 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1390 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:25.719623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-07f29ef2-e8a6-4e35-b275-9e1fa137f909 req-d243e834-7a96-456e-997a-85f4526293ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50deba5b-8150-4d35-9fea-79d5acdbf33e", "tag": "359f2c58-5ec7-4319-85c5-b3d744235dab"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:25.731009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-07f29ef2-e8a6-4e35-b275-9e1fa137f909 req-d243e834-7a96-456e-997a-85f4526293ba service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:25.731649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-07f29ef2-e8a6-4e35-b275-9e1fa137f909 req-d243e834-7a96-456e-997a-85f4526293ba service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:25.732228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-07f29ef2-e8a6-4e35-b275-9e1fa137f909 req-d243e834-7a96-456e-997a-85f4526293ba service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:25.746973 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-07f29ef2-e8a6-4e35-b275-9e1fa137f909 req-d243e834-7a96-456e-997a-85f4526293ba service nova] Creating event network-changed:359f2c58-5ec7-4319-85c5-b3d744235dab for instance 50deba5b-8150-4d35-9fea-79d5acdbf33e on n-h1-835595-3 Oct 05 17:32:25.753731 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-07f29ef2-e8a6-4e35-b275-9e1fa137f909 req-d243e834-7a96-456e-997a-85f4526293ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037826 Oct 05 17:32:25.754517 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 86/203] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:25.760461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-36a7343c-991d-4838-bcd8-a64d0b1bcb08 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-835595-3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:25.770573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba9beac3-3c7f-4ced-8f98-f9f48f2281ab tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:25.773953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36a7343c-991d-4838-bcd8-a64d0b1bcb08 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:25.775024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36a7343c-991d-4838-bcd8-a64d0b1bcb08 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:25.775673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36a7343c-991d-4838-bcd8-a64d0b1bcb08 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:25.779554 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ba9beac3-3c7f-4ced-8f98-f9f48f2281ab tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1313 microversion: 2.1 time: 0.263554 Oct 05 17:32:25.780150 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 118/204] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:25 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:25.785471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d21cdfe-4d08-4327-872f-50d6fccd1e48 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:25.802560 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-9d21cdfe-4d08-4327-872f-50d6fccd1e48 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d21cdfe-4d08-4327-872f-50d6fccd1e48 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Request method failure captured: Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb970-xulHP5gDCuHPz1kMK31A8OIXhij8FW4lMH5cOCcqpiMsZZbAhrA2LZNnSORw5tV4H6JZbUHCOdALwaBmzxrXb5oBZlrhBBsGHA_Mn6n8Uw5_yXUFpNbo7josbj1mohnskXmQsYOT__LUaug_FrFMUeVrkqPIoToG4UK85JdRs Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: edeac9c5e6b744ffab7020bd5143e11e Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:25.809271 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/edeac9c5e6b744ffab7020bd5143e11e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/edeac9c5e6b744ffab7020bd5143e11e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_edeac9c5e6b744ffab7020bd5143e11e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/edeac9c5e6b744ffab7020bd5143e11e"}]}] Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: edeac9c5e6b744ffab7020bd5143e11e Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminTestJSON-970960795-project-admin Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a68e19049b945c9bf0611bfa5c4e78e Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminTestJSON-970960795-project-admin Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: exception: Aggregate 13 could not be found. Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '13'} Oct 05 17:32:25.810703 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:25.811460 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 05 17:32:25.812524 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.816074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d21cdfe-4d08-4327-872f-50d6fccd1e48 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:25.816074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9d21cdfe-4d08-4327-872f-50d6fccd1e48 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.029704 Oct 05 17:32:25.816074 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 119/205] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:25 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:25.848794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d4e9f3b-5fd6-445b-9815-d980e1b42ba3 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:25.880601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-2d4e9f3b-5fd6-445b-9815-d980e1b42ba3 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d4e9f3b-5fd6-445b-9815-d980e1b42ba3 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Request method failure captured: Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb970-xulHP5gDCuHPz1kMK31A8OIXhij8FW4lMH5cOCcqpiMsZZbAhrA2LZNnSORw5tV4H6JZbUHCOdALwaBmzxrXb5oBZlrhBBsGHA_Mn6n8Uw5_yXUFpNbo7josbj1mohnskXmQsYOT__LUaug_FrFMUeVrkqPIoToG4UK85JdRs Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: edeac9c5e6b744ffab7020bd5143e11e Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:25.883970 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/edeac9c5e6b744ffab7020bd5143e11e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/edeac9c5e6b744ffab7020bd5143e11e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_edeac9c5e6b744ffab7020bd5143e11e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/edeac9c5e6b744ffab7020bd5143e11e"}]}] Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: edeac9c5e6b744ffab7020bd5143e11e Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-970960795 Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminTestJSON-970960795-project-admin Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a68e19049b945c9bf0611bfa5c4e78e Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminTestJSON-970960795-project-admin Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: exception: Aggregate 13 could not be found. Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '13'} Oct 05 17:32:25.885156 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:25.886039 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:25.887168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:25.888407 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:25.888407 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:25.888407 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:25.888407 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 05 17:32:25.888407 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:25.888407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d4e9f3b-5fd6-445b-9815-d980e1b42ba3 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:25.888407 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2d4e9f3b-5fd6-445b-9815-d980e1b42ba3 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.052510 Oct 05 17:32:25.888407 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 120/206] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:25 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:25.897563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7f22559c-b28b-4f05-bce7-3c9e14143455 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-664379188"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:25.901064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-7f22559c-b28b-4f05-bce7-3c9e14143455 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Generated uuid 82dcd630-f92c-45d8-8dec-1351d6853ca9 for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:25.944520 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7f22559c-b28b-4f05-bce7-3c9e14143455 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.051068 Oct 05 17:32:25.953190 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 121/207] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:25 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:25.958210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e99da91-00f6-4513-8f7d-46193994671d tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:25.985670 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7e99da91-00f6-4513-8f7d-46193994671d tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.031054 Oct 05 17:32:25.986992 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-36a7343c-991d-4838-bcd8-a64d0b1bcb08 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.228927 Oct 05 17:32:25.988328 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 87/208] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:32:25 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:25.988781 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 122/209] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:25 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:26.004476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b11e42aa-c243-4c00-b857-341f47cdfba1 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:26.010629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c1aeb16b-70c7-48cc-b41e-5916222b2fee tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:26.041462 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b11e42aa-c243-4c00-b857-341f47cdfba1 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.041758 Oct 05 17:32:26.043050 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 88/210] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:25 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:26.054469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-68566bd7-959c-4168-8b93-edc9c8af60dc tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-40889586"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:26.062027 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c1aeb16b-70c7-48cc-b41e-5916222b2fee tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.059768 Oct 05 17:32:26.062913 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 123/211] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:32:25 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:26.069507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.aggregate [None req-68566bd7-959c-4168-8b93-edc9c8af60dc tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Generated uuid a83fc08a-0516-46f7-92d7-75061f1e2c34 for aggregate {{(pid=128843) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:26.074915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-03209b18-8504-4a15-a75c-0aced4cea3ec tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:26.084671 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-03209b18-8504-4a15-a75c-0aced4cea3ec tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.013487 Oct 05 17:32:26.085596 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 124/212] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:32:26 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:26.098192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f4e4df99-e7af-4a60-a6b7-e0e807b1286a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:26.116824 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-68566bd7-959c-4168-8b93-edc9c8af60dc tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.066398 Oct 05 17:32:26.118092 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 89/213] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:26 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:26.126106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da66a131-473b-4467-a24e-be5544ca1791 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-775239064"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:26.133553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.aggregate [None req-da66a131-473b-4467-a24e-be5544ca1791 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Generated uuid 830b3ebd-b814-490d-8e9a-13db0a69f72f for aggregate {{(pid=128843) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:26.137120 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f4e4df99-e7af-4a60-a6b7-e0e807b1286a tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.043346 Oct 05 17:32:26.137711 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 125/214] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:26 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:26.143342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:26.158077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:26.159106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:26.159708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:26.167988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:26.168738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:26.169481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:26.172166 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da66a131-473b-4467-a24e-be5544ca1791 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.051884 Oct 05 17:32:26.174992 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 90/215] 10.222.0.70 () {62 vars in 1205 bytes} [Wed Oct 5 17:32:26 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:26.181983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b5858a5e-ae41-42e1-8970-ac8c6767cd8f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-789068956", "availability_zone": "tempest-test_az-1305026023"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:26.186234 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.compute.aggregates [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 05 17:32:26.187064 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Request method failure captured: Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-aggregates/15/action HTTP/1.1 Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 42 Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb97uZAFgFPaRd4LcRiRrinGIZcMYpFf4lVwzgwx_SPkY8MEjwB4m4P7Q_2Et-vrtOiBeX7qsojRalP9RlI_PPX78a7K8oaa-ShEwmHExiHRJl3s5HjDqcDkh0T6RI-6DmJ8glxsMPL7Cguyi1xqt0Sj3leGEC7RmeiqEs32N_H0qjU Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:26.190602 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/85cce77f155c4108a9f351f060605470"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_85cce77f155c4108a9f351f060605470", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/85cce77f155c4108a9f351f060605470"}]}] Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 85cce77f155c4108a9f351f060605470 Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-548888860 Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: ad3f5bee3f474f61bec3cef068443bf7 Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: {"remove_host": {"host": "nonexist_host"}} Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:26.192140 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot remove host nonexist_host in aggregate 15 Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '15', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 05 17:32:26.193033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 05 17:32:26.194402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 15 Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:26.195780 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:26.197135 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:26.197135 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:26.197135 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:26.197135 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:26.197135 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 15 Oct 05 17:32:26.197135 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:26.198437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:26.199800 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-791b3506-0388-43e6-a7f7-f061806a8cad tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.060772 Oct 05 17:32:26.200526 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 126/216] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:32:26 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:26.206526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-407c5551-fef9-4034-9763-1a7ab70af01d tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1703118243"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:26.238182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.aggregate [None req-b5858a5e-ae41-42e1-8970-ac8c6767cd8f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Generated uuid 7392e4a0-c118-4866-a713-ee7f0c77a745 for aggregate {{(pid=128843) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:26.314997 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b5858a5e-ae41-42e1-8970-ac8c6767cd8f tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.137500 Oct 05 17:32:26.316357 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 91/217] 10.222.0.70 () {60 vars in 1165 bytes} [Wed Oct 5 17:32:26 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:26.321167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a05798e-0737-498c-983f-bf04218c46e1 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:26.342131 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-407c5551-fef9-4034-9763-1a7ab70af01d tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 300 microversion: 2.41 time: 0.140230 Oct 05 17:32:26.343803 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 127/218] 10.222.0.70 () {62 vars in 1213 bytes} [Wed Oct 5 17:32:26 2022] PUT /compute/v2.1/os-aggregates/16 => generated 300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:26.350550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dfb12eaa-4833-494b-b827-db4204177da7 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-789068956_new", "availability_zone": "tempest-test_az-1305026023_new"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:26.371610 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a05798e-0737-498c-983f-bf04218c46e1 tempest-AggregatesAdminNegativeTestJSON-548888860 tempest-AggregatesAdminNegativeTestJSON-548888860-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.054041 Oct 05 17:32:26.376927 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 92/219] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:26 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:26.391757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b46b0fca-8f79-4a55-8151-5fb8e04f88b1 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:26.401279 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b46b0fca-8f79-4a55-8151-5fb8e04f88b1 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 300 microversion: 2.41 time: 0.022760 Oct 05 17:32:26.402649 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 93/220] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Oct 5 17:32:26 2022] GET /compute/v2.1/os-aggregates/16 => generated 300 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:26.407616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfb12eaa-4833-494b-b827-db4204177da7 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:26.408103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfb12eaa-4833-494b-b827-db4204177da7 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:26.408532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfb12eaa-4833-494b-b827-db4204177da7 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:26.418609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-145d2876-1959-471b-81d2-9b629b66a5f6 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-835595-3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:26.447552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-145d2876-1959-471b-81d2-9b629b66a5f6 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:26.448436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-145d2876-1959-471b-81d2-9b629b66a5f6 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:26.449123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-145d2876-1959-471b-81d2-9b629b66a5f6 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:26.495272 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dfb12eaa-4833-494b-b827-db4204177da7 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.149492 Oct 05 17:32:26.498697 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 128/221] 10.222.0.70 () {60 vars in 1173 bytes} [Wed Oct 5 17:32:26 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:26.512550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-65539bb0-c357-4dbd-ac1d-c9d1151aebe6 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:26.513177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-65539bb0-c357-4dbd-ac1d-c9d1151aebe6 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:26.530292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65539bb0-c357-4dbd-ac1d-c9d1151aebe6 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:26.533750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65539bb0-c357-4dbd-ac1d-c9d1151aebe6 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:26.534368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65539bb0-c357-4dbd-ac1d-c9d1151aebe6 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:26.535264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65539bb0-c357-4dbd-ac1d-c9d1151aebe6 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:26.536198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65539bb0-c357-4dbd-ac1d-c9d1151aebe6 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:26.537219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65539bb0-c357-4dbd-ac1d-c9d1151aebe6 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:26.734687 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-145d2876-1959-471b-81d2-9b629b66a5f6 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 315 microversion: 2.41 time: 0.324476 Oct 05 17:32:26.735789 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 94/222] 10.222.0.70 () {62 vars in 1235 bytes} [Wed Oct 5 17:32:26 2022] POST /compute/v2.1/os-aggregates/16/action => generated 315 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:26.747201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bfddba89-b7a6-48ad-9abc-f0a0b0f2c0bb tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:26.758314 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bfddba89-b7a6-48ad-9abc-f0a0b0f2c0bb tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 593 microversion: 2.1 time: 0.021181 Oct 05 17:32:26.758918 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 95/223] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:32:26 2022] GET /compute/v2.1/os-aggregates => generated 593 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:26.776291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ef9f97d6-70c6-4a50-bd82-7e1888beb8db tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:26.777070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ef9f97d6-70c6-4a50-bd82-7e1888beb8db tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:26.782511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65539bb0-c357-4dbd-ac1d-c9d1151aebe6 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:26.802133 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-65539bb0-c357-4dbd-ac1d-c9d1151aebe6 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1319 microversion: 2.1 time: 0.286290 Oct 05 17:32:26.803678 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 129/224] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:26 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:26.809555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef9f97d6-70c6-4a50-bd82-7e1888beb8db tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:26.810683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef9f97d6-70c6-4a50-bd82-7e1888beb8db tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:26.812222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef9f97d6-70c6-4a50-bd82-7e1888beb8db tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:26.813427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef9f97d6-70c6-4a50-bd82-7e1888beb8db tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:26.814223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef9f97d6-70c6-4a50-bd82-7e1888beb8db tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:26.819286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e03301e5-9df3-41e5-97ad-c845ae7d014c tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:26.822135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef9f97d6-70c6-4a50-bd82-7e1888beb8db tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:26.846062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e03301e5-9df3-41e5-97ad-c845ae7d014c tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:26.849776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e03301e5-9df3-41e5-97ad-c845ae7d014c tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:26.852718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e03301e5-9df3-41e5-97ad-c845ae7d014c tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:27.076902 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e03301e5-9df3-41e5-97ad-c845ae7d014c tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 300 microversion: 2.41 time: 0.271977 Oct 05 17:32:27.078090 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 130/225] 10.222.0.70 () {62 vars in 1235 bytes} [Wed Oct 5 17:32:26 2022] POST /compute/v2.1/os-aggregates/16/action => generated 300 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:27.082819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e09bc981-3d9d-4d8f-bda6-f28ab430f094 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:27.136979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ef9f97d6-70c6-4a50-bd82-7e1888beb8db tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:27.141730 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e09bc981-3d9d-4d8f-bda6-f28ab430f094 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.062372 Oct 05 17:32:27.146183 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 131/226] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:27 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:27.163832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0bf24d06-db97-4a47-b63e-33f0882cfc9c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:27.167570 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ef9f97d6-70c6-4a50-bd82-7e1888beb8db tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1390 microversion: 2.1 time: 0.403139 Oct 05 17:32:27.168152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0bf24d06-db97-4a47-b63e-33f0882cfc9c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:27.171666 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 96/227] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:26 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1390 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:27.190069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-303fd400-53a7-420d-83d6-7d54e2187145 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:27.193114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf24d06-db97-4a47-b63e-33f0882cfc9c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:27.193616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf24d06-db97-4a47-b63e-33f0882cfc9c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:27.194053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf24d06-db97-4a47-b63e-33f0882cfc9c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:27.194797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf24d06-db97-4a47-b63e-33f0882cfc9c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:27.196954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf24d06-db97-4a47-b63e-33f0882cfc9c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:27.200622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf24d06-db97-4a47-b63e-33f0882cfc9c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:27.243880 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-303fd400-53a7-420d-83d6-7d54e2187145 tempest-AggregatesAdminTestV241-1141615889 tempest-AggregatesAdminTestV241-1141615889-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.41 time: 0.070895 Oct 05 17:32:27.245259 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 97/228] 10.222.0.70 () {60 vars in 1196 bytes} [Wed Oct 5 17:32:27 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:27.252034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97aaaeb5-a9e3-4ffa-bafa-9c029956e09b tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1404497886"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:27.262833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.aggregate [None req-97aaaeb5-a9e3-4ffa-bafa-9c029956e09b tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Generated uuid 56205e43-ee73-4fb6-a500-4e32796ccf90 for aggregate {{(pid=128843) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:32:27.342797 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-97aaaeb5-a9e3-4ffa-bafa-9c029956e09b tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.088145 Oct 05 17:32:27.343514 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 98/229] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:32:27 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:27.366899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b89bd568-4d1b-440e-aef4-2ef50c6b9861 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:27.382489 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b89bd568-4d1b-440e-aef4-2ef50c6b9861 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.030096 Oct 05 17:32:27.391208 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 99/230] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:32:27 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:27.397851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-98dae2db-12de-4cd7-8ca7-2d2e1e8651a6 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:27.435439 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-98dae2db-12de-4cd7-8ca7-2d2e1e8651a6 tempest-AggregatesAdminTestJSON-970960795 tempest-AggregatesAdminTestJSON-970960795-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.042561 Oct 05 17:32:27.438941 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 100/231] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:27 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:27.447741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:27.448527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:27.459691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:27.459852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:27.460366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:27.461238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:27.461781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:27.462318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:27.481079 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] HTTP exception thrown: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Request method failure captured: Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 HTTP/1.1 Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb94L5ZMAMC4oWUocyeXoG6qrTB6cjSnw-lrJjkdnw2tzUtVtzw-pMUZZGoxttJar_BYgJVB5M87lpXH-GTBYVZypxLs8hYypKPdN1TXddPYE_84mNw_QSHPUKeUdg91IapxsXhbgUbcKy5wpUimkbiXhvn6WUnkUXMrh6c-Eak0e-0 Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: a103a4e230044899bb4f3e07d7d406b7 Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AggregatesAdminTestJSON-1349942713 Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:27.483359 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a103a4e230044899bb4f3e07d7d406b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a103a4e230044899bb4f3e07d7d406b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a103a4e230044899bb4f3e07d7d406b7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a103a4e230044899bb4f3e07d7d406b7"}]}] Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AggregatesAdminTestJSON-1349942713 Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: a103a4e230044899bb4f3e07d7d406b7 Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1349942713 Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AggregatesAdminTestJSON-1349942713-project Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: e06a2990dd7b4defb1a1a7345e5511a9 Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AggregatesAdminTestJSON-1349942713-project Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:27.484931 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '74cc75f1-6210-49f8-bc81-cba60f855ea8'} Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:27.485769 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:27.487329 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:27.489032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Returning 404 to user: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:27.489896 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1ed00280-b56e-4053-b585-0232dca35785 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 404 len: 111 microversion: 2.1 time: 0.046049 Oct 05 17:32:27.494647 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 101/232] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:32:27 2022] DELETE /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:27.499957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:27.500731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] [instance: 74cc75f1-6210-49f8-bc81-cba60f855ea8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:27.507972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:27.508561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:27.509167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:27.509931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:27.510488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:27.511106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:27.544828 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] HTTP exception thrown: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Request method failure captured: Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 HTTP/1.1 Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb94L5ZMAMC4oWUocyeXoG6qrTB6cjSnw-lrJjkdnw2tzUtVtzw-pMUZZGoxttJar_BYgJVB5M87lpXH-GTBYVZypxLs8hYypKPdN1TXddPYE_84mNw_QSHPUKeUdg91IapxsXhbgUbcKy5wpUimkbiXhvn6WUnkUXMrh6c-Eak0e-0 Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: a103a4e230044899bb4f3e07d7d406b7 Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AggregatesAdminTestJSON-1349942713 Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:27.546444 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a103a4e230044899bb4f3e07d7d406b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a103a4e230044899bb4f3e07d7d406b7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a103a4e230044899bb4f3e07d7d406b7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a103a4e230044899bb4f3e07d7d406b7"}]}] Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AggregatesAdminTestJSON-1349942713 Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: a103a4e230044899bb4f3e07d7d406b7 Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1349942713 Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AggregatesAdminTestJSON-1349942713-project Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: e06a2990dd7b4defb1a1a7345e5511a9 Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AggregatesAdminTestJSON-1349942713-project Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:27.549057 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '74cc75f1-6210-49f8-bc81-cba60f855ea8'} Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:27.550230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. Oct 05 17:32:27.551590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:27.552708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] Returning 404 to user: Instance 74cc75f1-6210-49f8-bc81-cba60f855ea8 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:27.552708 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7c8940df-a8a1-43ea-8d38-03e5247e57d8 tempest-AggregatesAdminTestJSON-1349942713 tempest-AggregatesAdminTestJSON-1349942713-project] 10.222.0.70 "GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8" status: 404 len: 111 microversion: 2.1 time: 0.053733 Oct 05 17:32:27.552708 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 102/233] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:27 2022] GET /compute/v2.1/servers/74cc75f1-6210-49f8-bc81-cba60f855ea8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:27.592507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0bf24d06-db97-4a47-b63e-33f0882cfc9c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:27.603017 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0bf24d06-db97-4a47-b63e-33f0882cfc9c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1313 microversion: 2.1 time: 0.455597 Oct 05 17:32:27.608508 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 132/234] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:27 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1313 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:27.829270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9484458f-fb7f-4681-a592-9688ddafff3e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:27.830561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9484458f-fb7f-4681-a592-9688ddafff3e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:27.838002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9484458f-fb7f-4681-a592-9688ddafff3e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:27.838717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9484458f-fb7f-4681-a592-9688ddafff3e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:27.839291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9484458f-fb7f-4681-a592-9688ddafff3e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:27.840336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9484458f-fb7f-4681-a592-9688ddafff3e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:27.840925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9484458f-fb7f-4681-a592-9688ddafff3e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:27.841481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9484458f-fb7f-4681-a592-9688ddafff3e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:27.859945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-2256b5b5-813b-46d5-aa49-e9c93540802b req-1a70e2d2-487d-4f66-a7b2-0131fc952272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdbcaff8-caf7-4c1b-bca7-74a96aa993b6", "tag": "3b9334d9-1dd8-4ec9-a566-eb97e6aae2a9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:27.878042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2256b5b5-813b-46d5-aa49-e9c93540802b req-1a70e2d2-487d-4f66-a7b2-0131fc952272 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:27.880840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2256b5b5-813b-46d5-aa49-e9c93540802b req-1a70e2d2-487d-4f66-a7b2-0131fc952272 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:27.882835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2256b5b5-813b-46d5-aa49-e9c93540802b req-1a70e2d2-487d-4f66-a7b2-0131fc952272 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:27.926046 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-2256b5b5-813b-46d5-aa49-e9c93540802b req-1a70e2d2-487d-4f66-a7b2-0131fc952272 service nova] Creating event network-changed:3b9334d9-1dd8-4ec9-a566-eb97e6aae2a9 for instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 on n-h1-835595-3 Oct 05 17:32:27.937245 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-2256b5b5-813b-46d5-aa49-e9c93540802b req-1a70e2d2-487d-4f66-a7b2-0131fc952272 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079264 Oct 05 17:32:27.937879 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 133/235] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:28.199549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-046792c3-5375-411e-97dd-1c5d6ca221b6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:28.200254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-046792c3-5375-411e-97dd-1c5d6ca221b6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:28.218070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-046792c3-5375-411e-97dd-1c5d6ca221b6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:28.218610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-046792c3-5375-411e-97dd-1c5d6ca221b6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:28.219026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-046792c3-5375-411e-97dd-1c5d6ca221b6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:28.219817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-046792c3-5375-411e-97dd-1c5d6ca221b6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:28.220311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-046792c3-5375-411e-97dd-1c5d6ca221b6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:28.220726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-046792c3-5375-411e-97dd-1c5d6ca221b6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:28.295010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9484458f-fb7f-4681-a592-9688ddafff3e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:28.303668 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9484458f-fb7f-4681-a592-9688ddafff3e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1319 microversion: 2.1 time: 0.478227 Oct 05 17:32:28.306883 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 103/236] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:27 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1319 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:28.544244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-046792c3-5375-411e-97dd-1c5d6ca221b6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:28.559236 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-046792c3-5375-411e-97dd-1c5d6ca221b6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1390 microversion: 2.1 time: 0.365218 Oct 05 17:32:28.560006 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 134/237] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:28 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1390 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:28.627984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9b600982-4094-4722-91da-1697bcda5801 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:28.628708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9b600982-4094-4722-91da-1697bcda5801 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:28.641138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b600982-4094-4722-91da-1697bcda5801 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:28.641799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b600982-4094-4722-91da-1697bcda5801 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:28.642403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b600982-4094-4722-91da-1697bcda5801 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:28.643608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b600982-4094-4722-91da-1697bcda5801 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:28.644600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b600982-4094-4722-91da-1697bcda5801 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:28.645401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b600982-4094-4722-91da-1697bcda5801 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:28.893015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9b600982-4094-4722-91da-1697bcda5801 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:28.901322 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9b600982-4094-4722-91da-1697bcda5801 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1313 microversion: 2.1 time: 0.277303 Oct 05 17:32:28.901978 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 104/238] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:28 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:29.198685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c7d51e8-4b28-4434-9704-641c2ddedfd4 tempest-SecurityGroupsTestAdminJSON-568066269 tempest-SecurityGroupsTestAdminJSON-568066269-project] Action: 'create', calling method: .version_select at 0x7f7775e269d0>, body: {"security_group": {"name": "tempest-securitygroup-1079553933", "description": "tempest-description-520673552"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:29.246735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-8cddbf10-e620-4462-bacc-4bcf0984aa0e req-ebb524f2-40e1-4665-ab7d-dc4842b01e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d6f375-344a-4460-a8bd-dc5e9c7af8e6", "name": "network-vif-plugged", "status": "completed", "tag": "16de15df-aa59-4811-a979-bf656b358834"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:29.268322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8cddbf10-e620-4462-bacc-4bcf0984aa0e req-ebb524f2-40e1-4665-ab7d-dc4842b01e7c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:29.270110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8cddbf10-e620-4462-bacc-4bcf0984aa0e req-ebb524f2-40e1-4665-ab7d-dc4842b01e7c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:29.271649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8cddbf10-e620-4462-bacc-4bcf0984aa0e req-ebb524f2-40e1-4665-ab7d-dc4842b01e7c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:29.304048 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-8cddbf10-e620-4462-bacc-4bcf0984aa0e req-ebb524f2-40e1-4665-ab7d-dc4842b01e7c service nova] Creating event network-vif-plugged:16de15df-aa59-4811-a979-bf656b358834 for instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 on n-h2-835595-3 Oct 05 17:32:29.321245 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-8cddbf10-e620-4462-bacc-4bcf0984aa0e req-ebb524f2-40e1-4665-ab7d-dc4842b01e7c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076465 Oct 05 17:32:29.321245 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 105/239] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:29.337364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea838acc-8ff9-485e-bb6d-93bccd418d8b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:29.340641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ea838acc-8ff9-485e-bb6d-93bccd418d8b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:29.360079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea838acc-8ff9-485e-bb6d-93bccd418d8b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:29.360589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea838acc-8ff9-485e-bb6d-93bccd418d8b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:29.363477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea838acc-8ff9-485e-bb6d-93bccd418d8b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:29.364788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea838acc-8ff9-485e-bb6d-93bccd418d8b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:29.368680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea838acc-8ff9-485e-bb6d-93bccd418d8b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:29.370231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea838acc-8ff9-485e-bb6d-93bccd418d8b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:29.700176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ea838acc-8ff9-485e-bb6d-93bccd418d8b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:29.715171 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ea838acc-8ff9-485e-bb6d-93bccd418d8b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1319 microversion: 2.1 time: 0.387869 Oct 05 17:32:29.715880 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 106/240] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:29 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1319 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:29.723471 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c7d51e8-4b28-4434-9704-641c2ddedfd4 tempest-SecurityGroupsTestAdminJSON-568066269 tempest-SecurityGroupsTestAdminJSON-568066269-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.003968 Oct 05 17:32:29.724072 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 135/241] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:32:28 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:29.727411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d10a2b5-655b-4b8b-869b-6bfca83cb12e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:29.730630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4d10a2b5-655b-4b8b-869b-6bfca83cb12e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:29.747883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-517b6743-5ae5-4262-9468-19bc4ebd1b5b tempest-SecurityGroupsTestAdminJSON-568066269 tempest-SecurityGroupsTestAdminJSON-568066269-project] Action: 'create', calling method: .version_select at 0x7f7775f7c3a0>, body: {"security_group": {"name": "tempest-securitygroup-1865235075", "description": "tempest-description-1945987876"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:29.754396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d10a2b5-655b-4b8b-869b-6bfca83cb12e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:29.754899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d10a2b5-655b-4b8b-869b-6bfca83cb12e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:29.755336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d10a2b5-655b-4b8b-869b-6bfca83cb12e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:29.761711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d10a2b5-655b-4b8b-869b-6bfca83cb12e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:29.767478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d10a2b5-655b-4b8b-869b-6bfca83cb12e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:29.768148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d10a2b5-655b-4b8b-869b-6bfca83cb12e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:30.008294 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-517b6743-5ae5-4262-9468-19bc4ebd1b5b tempest-SecurityGroupsTestAdminJSON-568066269 tempest-SecurityGroupsTestAdminJSON-568066269-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.266992 Oct 05 17:32:30.009937 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 136/242] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:32:29 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:30.016692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e737c5f5-6bdc-4ae5-9f02-543c47919e88 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:30.018809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e737c5f5-6bdc-4ae5-9f02-543c47919e88 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:30.025970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=94 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:30.037484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e737c5f5-6bdc-4ae5-9f02-543c47919e88 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:30.037995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e737c5f5-6bdc-4ae5-9f02-543c47919e88 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:30.038463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e737c5f5-6bdc-4ae5-9f02-543c47919e88 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:30.039185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e737c5f5-6bdc-4ae5-9f02-543c47919e88 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:30.045928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e737c5f5-6bdc-4ae5-9f02-543c47919e88 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:30.046601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e737c5f5-6bdc-4ae5-9f02-543c47919e88 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:30.116627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:DELETE=9,nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:30.370455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e737c5f5-6bdc-4ae5-9f02-543c47919e88 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:30.380113 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e737c5f5-6bdc-4ae5-9f02-543c47919e88 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1313 microversion: 2.1 time: 0.367671 Oct 05 17:32:30.384146 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 137/243] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:30 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:30.576390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4d10a2b5-655b-4b8b-869b-6bfca83cb12e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:30.589900 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4d10a2b5-655b-4b8b-869b-6bfca83cb12e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1390 microversion: 2.1 time: 0.870779 Oct 05 17:32:30.595128 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 107/244] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:29 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1390 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:30.739214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8d872b0-c419-4778-b92c-c3a6ea5b472f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:30.739864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8d872b0-c419-4778-b92c-c3a6ea5b472f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:30.769910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8d872b0-c419-4778-b92c-c3a6ea5b472f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:30.771431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8d872b0-c419-4778-b92c-c3a6ea5b472f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:30.772255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8d872b0-c419-4778-b92c-c3a6ea5b472f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:30.774043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8d872b0-c419-4778-b92c-c3a6ea5b472f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:30.776265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8d872b0-c419-4778-b92c-c3a6ea5b472f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:30.776929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8d872b0-c419-4778-b92c-c3a6ea5b472f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:30.987243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ec00b35-56be-4d88-b96a-1beb0bfd6518 tempest-SecurityGroupsTestAdminJSON-1909952123 tempest-SecurityGroupsTestAdminJSON-1909952123-project-admin] Action: 'create', calling method: .version_select at 0x7f77771e3ca0>, body: {"security_group": {"name": "tempest-securitygroup-1169276541", "description": "tempest-description-1263508136"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:31.258603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b8d872b0-c419-4778-b92c-c3a6ea5b472f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:31.269339 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8d872b0-c419-4778-b92c-c3a6ea5b472f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1319 microversion: 2.1 time: 0.535288 Oct 05 17:32:31.270693 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 108/245] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:30 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:31.384700 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ec00b35-56be-4d88-b96a-1beb0bfd6518 tempest-SecurityGroupsTestAdminJSON-1909952123 tempest-SecurityGroupsTestAdminJSON-1909952123-project-admin] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.995628 Oct 05 17:32:31.385323 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 138/246] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:32:30 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:31.398744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb38aff3-3084-47c7-91c9-d1d7842d3baf tempest-SecurityGroupsTestAdminJSON-1909952123 tempest-SecurityGroupsTestAdminJSON-1909952123-project-admin] Action: 'create', calling method: .version_select at 0x7f7775cc6430>, body: {"security_group": {"name": "tempest-securitygroup-1620485297", "description": "tempest-description-321752674"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:31.406085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a8448e8-27fd-4a7d-8e81-392c1f17b077 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:31.407602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4a8448e8-27fd-4a7d-8e81-392c1f17b077 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:31.419781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a8448e8-27fd-4a7d-8e81-392c1f17b077 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:31.420801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=86 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:31.422026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a8448e8-27fd-4a7d-8e81-392c1f17b077 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:31.422660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a8448e8-27fd-4a7d-8e81-392c1f17b077 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:31.423837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a8448e8-27fd-4a7d-8e81-392c1f17b077 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:31.425072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a8448e8-27fd-4a7d-8e81-392c1f17b077 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:31.426780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a8448e8-27fd-4a7d-8e81-392c1f17b077 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:31.600633 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb38aff3-3084-47c7-91c9-d1d7842d3baf tempest-SecurityGroupsTestAdminJSON-1909952123 tempest-SecurityGroupsTestAdminJSON-1909952123-project-admin] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.206449 Oct 05 17:32:31.601246 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 109/247] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:32:31 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:31.614379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-824c18e2-b51d-45da-918b-85c5addaa874 tempest-SecurityGroupsTestAdminJSON-1909952123 tempest-SecurityGroupsTestAdminJSON-1909952123-project-admin] Calling method '.version_select at 0x7f7775c34ca0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:31.677331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4a8448e8-27fd-4a7d-8e81-392c1f17b077 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:31.691774 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4a8448e8-27fd-4a7d-8e81-392c1f17b077 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1462 microversion: 2.1 time: 0.287520 Oct 05 17:32:31.694592 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 139/248] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:31 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1462 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:31.707373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d8dba1e8-3794-4da8-b9ae-4984b499bf18 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:31.708209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d8dba1e8-3794-4da8-b9ae-4984b499bf18 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:31.730072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8dba1e8-3794-4da8-b9ae-4984b499bf18 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:31.730844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8dba1e8-3794-4da8-b9ae-4984b499bf18 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:31.734144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8dba1e8-3794-4da8-b9ae-4984b499bf18 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:31.736318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8dba1e8-3794-4da8-b9ae-4984b499bf18 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:31.738816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8dba1e8-3794-4da8-b9ae-4984b499bf18 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:31.740379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8dba1e8-3794-4da8-b9ae-4984b499bf18 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:31.916588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=18 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:32.041782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d8dba1e8-3794-4da8-b9ae-4984b499bf18 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:32.050508 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d8dba1e8-3794-4da8-b9ae-4984b499bf18 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1390 microversion: 2.1 time: 0.354551 Oct 05 17:32:32.054989 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 140/249] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:31 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1390 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:32.558337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64e09805-e097-483a-a070-ab18339dba6a tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:32.558955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-64e09805-e097-483a-a070-ab18339dba6a tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:32.568326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64e09805-e097-483a-a070-ab18339dba6a tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:32.568823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64e09805-e097-483a-a070-ab18339dba6a tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:32.569259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64e09805-e097-483a-a070-ab18339dba6a tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:32.569964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64e09805-e097-483a-a070-ab18339dba6a tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:32.572201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64e09805-e097-483a-a070-ab18339dba6a tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:32.572664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64e09805-e097-483a-a070-ab18339dba6a tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:33.058484 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-824c18e2-b51d-45da-918b-85c5addaa874 tempest-SecurityGroupsTestAdminJSON-1909952123 tempest-SecurityGroupsTestAdminJSON-1909952123-project-admin] 10.222.0.70 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 7625 microversion: 2.1 time: 1.447683 Oct 05 17:32:33.071298 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 110/250] 10.222.0.70 () {58 vars in 1191 bytes} [Wed Oct 5 17:32:31 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 7625 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:33.079519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d5d38703-9379-4b8b-b089-9182f1b8b3af tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:33.080205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d5d38703-9379-4b8b-b089-9182f1b8b3af tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:33.087591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5d38703-9379-4b8b-b089-9182f1b8b3af tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:33.088567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5d38703-9379-4b8b-b089-9182f1b8b3af tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:33.089200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5d38703-9379-4b8b-b089-9182f1b8b3af tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:33.092032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5d38703-9379-4b8b-b089-9182f1b8b3af tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:33.092639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5d38703-9379-4b8b-b089-9182f1b8b3af tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:33.093267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5d38703-9379-4b8b-b089-9182f1b8b3af tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:33.105001 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-64e09805-e097-483a-a070-ab18339dba6a tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1613 microversion: 2.1 time: 1.048718 Oct 05 17:32:33.109124 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 141/251] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:32 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1613 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:33.114915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-14abc5c6-6690-43e1-93fc-de3f75141c39 req-e25207dd-282f-49f4-8c81-902c287cc2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50deba5b-8150-4d35-9fea-79d5acdbf33e", "name": "network-vif-plugged", "status": "completed", "tag": "359f2c58-5ec7-4319-85c5-b3d744235dab"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:33.125084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-14abc5c6-6690-43e1-93fc-de3f75141c39 req-e25207dd-282f-49f4-8c81-902c287cc2e8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:33.125772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-14abc5c6-6690-43e1-93fc-de3f75141c39 req-e25207dd-282f-49f4-8c81-902c287cc2e8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:33.126415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-14abc5c6-6690-43e1-93fc-de3f75141c39 req-e25207dd-282f-49f4-8c81-902c287cc2e8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:33.162226 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-14abc5c6-6690-43e1-93fc-de3f75141c39 req-e25207dd-282f-49f4-8c81-902c287cc2e8 service nova] Creating event network-vif-plugged:359f2c58-5ec7-4319-85c5-b3d744235dab for instance 50deba5b-8150-4d35-9fea-79d5acdbf33e on n-h1-835595-3 Oct 05 17:32:33.167980 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-14abc5c6-6690-43e1-93fc-de3f75141c39 req-e25207dd-282f-49f4-8c81-902c287cc2e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057452 Oct 05 17:32:33.173443 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 142/252] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:33.362534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d5d38703-9379-4b8b-b089-9182f1b8b3af tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:33.371724 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d5d38703-9379-4b8b-b089-9182f1b8b3af tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1319 microversion: 2.1 time: 0.299227 Oct 05 17:32:33.372626 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 111/253] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:33 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:33.378267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e3432819-080f-40ed-a614-b90a1b6d6703 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:33.379384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e3432819-080f-40ed-a614-b90a1b6d6703 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:33.395935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3432819-080f-40ed-a614-b90a1b6d6703 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:33.396796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3432819-080f-40ed-a614-b90a1b6d6703 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:33.397438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3432819-080f-40ed-a614-b90a1b6d6703 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:33.398469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3432819-080f-40ed-a614-b90a1b6d6703 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:33.399172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3432819-080f-40ed-a614-b90a1b6d6703 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:33.400023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3432819-080f-40ed-a614-b90a1b6d6703 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:33.423609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1896116825", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": "none"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:33.492651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:32:33.493081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:32:33.493553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:32:33.494093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:32:33.494703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:32:33.505890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:33.506619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:33.507212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:33.508134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:33.508752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:33.509593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:33.519488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=17 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:33.530653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Getting quotas for project 26131a1b2f444be09171129cf0a8ead0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:33.536044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Getting quotas for user 0980740c97e44a6ca30d5ee4b6fb9b8c and project 26131a1b2f444be09171129cf0a8ead0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:33.552997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:32:33.556512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:32:33.567158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e3432819-080f-40ed-a614-b90a1b6d6703 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:33.577827 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e3432819-080f-40ed-a614-b90a1b6d6703 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1390 microversion: 2.1 time: 0.203527 Oct 05 17:32:33.591759 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 112/254] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:33 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1390 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:33.607458 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e170ee6b-b54f-44ff-98a7-43128bb67104 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.432374 Oct 05 17:32:33.612034 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 143/255] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:32:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:32:33.618127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-877f44be-f556-4bfd-ab70-81483e4aa110 tempest-SecurityGroupsTestAdminJSON-568066269 tempest-SecurityGroupsTestAdminJSON-568066269-project] Calling method '.version_select at 0x7f777613b820>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:33.626509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:33.627248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:33.636402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:33.637351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:33.637692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:33.638679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:33.639456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:33.643204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:33.925550 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-877f44be-f556-4bfd-ab70-81483e4aa110 tempest-SecurityGroupsTestAdminJSON-568066269 tempest-SecurityGroupsTestAdminJSON-568066269-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.330508 Oct 05 17:32:33.937003 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 113/256] 10.222.0.70 () {58 vars in 1191 bytes} [Wed Oct 5 17:32:33 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:33.943888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ea3c7ca-378b-47f8-baaa-fe2b6197befb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:33.947174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ea3c7ca-378b-47f8-baaa-fe2b6197befb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:34.051961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3ea3c7ca-378b-47f8-baaa-fe2b6197befb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:34.061407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3ea3c7ca-378b-47f8-baaa-fe2b6197befb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:34.070848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3ea3c7ca-378b-47f8-baaa-fe2b6197befb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:34.081871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:34.086399 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ea3c7ca-378b-47f8-baaa-fe2b6197befb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "PUT /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1359 microversion: 2.75 time: 0.148017 Oct 05 17:32:34.100605 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 114/257] 10.222.0.70 () {62 vars in 1297 bytes} [Wed Oct 5 17:32:33 2022] PUT /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:34.113476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4fcb2bf5-ba84-43cf-86be-19bd2216ac2e tempest-SecurityGroupsTestAdminJSON-1909952123 tempest-SecurityGroupsTestAdminJSON-1909952123-project-admin] Calling method '.version_select at 0x7f7775cc64c0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:34.259209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '80d5eab89e6240caaa54a381b4d2af4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6f93d534014f37a2527e4d0a6953e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:34.260125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] flavor_id is None. Assuming migration. {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 05 17:32:34.260881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 17:32:34.397169 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4fcb2bf5-ba84-43cf-86be-19bd2216ac2e tempest-SecurityGroupsTestAdminJSON-1909952123 tempest-SecurityGroupsTestAdminJSON-1909952123-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/14f3bbf9-81ff-48f4-9a90-f507b5acca37" status: 202 len: 0 microversion: 2.1 time: 0.293634 Oct 05 17:32:34.398045 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 115/258] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:32:34 2022] DELETE /compute/v2.1/os-security-groups/14f3bbf9-81ff-48f4-9a90-f507b5acca37 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:34.406851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48e2b319-fb36-41c1-89c7-d027cfb466c9 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:34.407649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48e2b319-fb36-41c1-89c7-d027cfb466c9 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:34.561964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48e2b319-fb36-41c1-89c7-d027cfb466c9 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:34.572900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48e2b319-fb36-41c1-89c7-d027cfb466c9 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:34.574368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48e2b319-fb36-41c1-89c7-d027cfb466c9 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:34.579859 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48e2b319-fb36-41c1-89c7-d027cfb466c9 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1359 microversion: 2.75 time: 0.176874 Oct 05 17:32:34.580437 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 116/259] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:34 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:34.585935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0bb45a2d-b885-435e-83c7-ccb3e2c1966b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:34.586705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0bb45a2d-b885-435e-83c7-ccb3e2c1966b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:34.593271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bb45a2d-b885-435e-83c7-ccb3e2c1966b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:34.594636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bb45a2d-b885-435e-83c7-ccb3e2c1966b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:34.595406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bb45a2d-b885-435e-83c7-ccb3e2c1966b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:34.596814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bb45a2d-b885-435e-83c7-ccb3e2c1966b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:34.597433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bb45a2d-b885-435e-83c7-ccb3e2c1966b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:34.598040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bb45a2d-b885-435e-83c7-ccb3e2c1966b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:34.691691 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cae9568e-3ddf-45a4-a795-aaae61168014 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6/action" status: 202 len: 0 microversion: 2.1 time: 1.077392 Oct 05 17:32:34.692327 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 144/260] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:32:33 2022] POST /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6/action => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:34.707848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5678da5-aeaf-4f9a-91c6-0ee6343ce041 tempest-SecurityGroupsTestAdminJSON-1909952123 tempest-SecurityGroupsTestAdminJSON-1909952123-project-admin] Calling method '.version_select at 0x7f7775e4aca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:34.858862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0bb45a2d-b885-435e-83c7-ccb3e2c1966b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:34.870178 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0bb45a2d-b885-435e-83c7-ccb3e2c1966b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1319 microversion: 2.1 time: 0.287658 Oct 05 17:32:34.871201 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 117/261] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:34 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:34.876758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85d9dfda-8c58-4cff-bbab-9060416bd9eb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:34.877659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-85d9dfda-8c58-4cff-bbab-9060416bd9eb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:34.885960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85d9dfda-8c58-4cff-bbab-9060416bd9eb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:34.887234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85d9dfda-8c58-4cff-bbab-9060416bd9eb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:34.887736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85d9dfda-8c58-4cff-bbab-9060416bd9eb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:34.888464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85d9dfda-8c58-4cff-bbab-9060416bd9eb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:34.888963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85d9dfda-8c58-4cff-bbab-9060416bd9eb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:34.890460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85d9dfda-8c58-4cff-bbab-9060416bd9eb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:34.993607 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5678da5-aeaf-4f9a-91c6-0ee6343ce041 tempest-SecurityGroupsTestAdminJSON-1909952123 tempest-SecurityGroupsTestAdminJSON-1909952123-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/ce29a785-4cc9-4f71-ad61-7f93bb251040" status: 202 len: 0 microversion: 2.1 time: 0.295750 Oct 05 17:32:34.994612 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 145/262] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:32:34 2022] DELETE /compute/v2.1/os-security-groups/ce29a785-4cc9-4f71-ad61-7f93bb251040 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:35.006863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0366a9a5-0278-491b-857d-34d124876c02 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:35.008161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0366a9a5-0278-491b-857d-34d124876c02 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:35.020005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0366a9a5-0278-491b-857d-34d124876c02 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:35.021208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0366a9a5-0278-491b-857d-34d124876c02 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:35.021719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0366a9a5-0278-491b-857d-34d124876c02 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:35.023216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0366a9a5-0278-491b-857d-34d124876c02 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:35.023757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0366a9a5-0278-491b-857d-34d124876c02 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:35.024429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0366a9a5-0278-491b-857d-34d124876c02 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:35.071997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85d9dfda-8c58-4cff-bbab-9060416bd9eb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:35.082200 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85d9dfda-8c58-4cff-bbab-9060416bd9eb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1589 microversion: 2.1 time: 0.209742 Oct 05 17:32:35.083161 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 118/263] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:34 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1589 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:35.088042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2eb5f9ff-9fde-4858-bf09-853eab25aabe tempest-SecurityGroupsTestAdminJSON-568066269 tempest-SecurityGroupsTestAdminJSON-568066269-project] Calling method '.version_select at 0x7f77760fb9d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:35.229513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0366a9a5-0278-491b-857d-34d124876c02 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:35.239235 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0366a9a5-0278-491b-857d-34d124876c02 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1471 microversion: 2.1 time: 0.243206 Oct 05 17:32:35.240365 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 146/264] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:34 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1471 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:35.369319 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2eb5f9ff-9fde-4858-bf09-853eab25aabe tempest-SecurityGroupsTestAdminJSON-568066269 tempest-SecurityGroupsTestAdminJSON-568066269-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/0804b76c-11ba-4714-a707-fa47a254453a" status: 202 len: 0 microversion: 2.1 time: 0.284661 Oct 05 17:32:35.369923 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 119/265] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:32:35 2022] DELETE /compute/v2.1/os-security-groups/0804b76c-11ba-4714-a707-fa47a254453a => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:35.380070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2bd0b94e-925d-4cd9-b6dc-a0c27b842e6e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:35.380568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2bd0b94e-925d-4cd9-b6dc-a0c27b842e6e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:35.398875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bd0b94e-925d-4cd9-b6dc-a0c27b842e6e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:35.399088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bd0b94e-925d-4cd9-b6dc-a0c27b842e6e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:35.399493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bd0b94e-925d-4cd9-b6dc-a0c27b842e6e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:35.400192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bd0b94e-925d-4cd9-b6dc-a0c27b842e6e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:35.400645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bd0b94e-925d-4cd9-b6dc-a0c27b842e6e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:35.401268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bd0b94e-925d-4cd9-b6dc-a0c27b842e6e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:35.513995 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2bd0b94e-925d-4cd9-b6dc-a0c27b842e6e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139409 Oct 05 17:32:35.515155 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 120/266] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:32:35 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:35.520993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-36f4a290-8f2f-4de2-a1e4-f3795ed2d238 req-b1af971b-92bf-4cdb-9188-8928f9a69f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcaff8-caf7-4c1b-bca7-74a96aa993b6", "name": "network-vif-plugged", "status": "completed", "tag": "3b9334d9-1dd8-4ec9-a566-eb97e6aae2a9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:35.532013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-36f4a290-8f2f-4de2-a1e4-f3795ed2d238 req-b1af971b-92bf-4cdb-9188-8928f9a69f05 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:35.533356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-36f4a290-8f2f-4de2-a1e4-f3795ed2d238 req-b1af971b-92bf-4cdb-9188-8928f9a69f05 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:35.533830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-36f4a290-8f2f-4de2-a1e4-f3795ed2d238 req-b1af971b-92bf-4cdb-9188-8928f9a69f05 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:35.547506 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-36f4a290-8f2f-4de2-a1e4-f3795ed2d238 req-b1af971b-92bf-4cdb-9188-8928f9a69f05 service nova] Creating event network-vif-plugged:3b9334d9-1dd8-4ec9-a566-eb97e6aae2a9 for instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 on n-h1-835595-3 Oct 05 17:32:35.553219 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-36f4a290-8f2f-4de2-a1e4-f3795ed2d238 req-b1af971b-92bf-4cdb-9188-8928f9a69f05 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036664 Oct 05 17:32:35.554496 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 121/267] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:35.627741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2282360b-b46c-4597-96a1-4a3d45bda0ef tempest-FlavorMetadataValidation-1334831220 tempest-FlavorMetadataValidation-1334831220-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1144544936", "id": 1849226819, "os-flavor-access:is_public": "True"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:35.688749 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2282360b-b46c-4597-96a1-4a3d45bda0ef tempest-FlavorMetadataValidation-1334831220 tempest-FlavorMetadataValidation-1334831220-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.446947 Oct 05 17:32:35.693837 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 147/268] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:32:35 2022] POST /compute/v2.1/flavors => generated 471 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:35.703846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a9fde8a-9cce-4771-94a6-710df7c5ee84 tempest-SecurityGroupsTestAdminJSON-568066269 tempest-SecurityGroupsTestAdminJSON-568066269-project] Calling method '.version_select at 0x7f7775b204c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:35.803395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa7fd815-9758-433a-9462-082671c3c012 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1432218617", "id": 588846072, "os-flavor-access:is_public": "True"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:35.850622 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa7fd815-9758-433a-9462-082671c3c012 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.294520 Oct 05 17:32:35.851965 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 122/269] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:35 2022] POST /compute/v2.1/flavors => generated 427 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:35.859717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:35.861579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:35.872873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:35.873555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:35.874133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:35.875048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:35.876324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:35.877939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:35.953684 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4a9fde8a-9cce-4771-94a6-710df7c5ee84 tempest-SecurityGroupsTestAdminJSON-568066269 tempest-SecurityGroupsTestAdminJSON-568066269-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/4b00e94c-c028-429f-94ec-2a90e2cef954" status: 202 len: 0 microversion: 2.1 time: 0.258694 Oct 05 17:32:35.954340 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 148/270] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:32:35 2022] DELETE /compute/v2.1/os-security-groups/4b00e94c-c028-429f-94ec-2a90e2cef954 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:35.958978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac282859-df6e-413d-a7e8-d9cff805d2fd tempest-FlavorMetadataValidation-1334831220 tempest-FlavorMetadataValidation-1334831220-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:36.069519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:36.078718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:36.081326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:36.087091 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9289c2d0-eafd-47d3-bb6b-85816d70b7ee tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1417 microversion: 2.75 time: 0.233331 Oct 05 17:32:36.103457 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 123/271] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:35 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1417 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:36.115264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-18118e09-e3f4-4ce6-83b3-a39b28ed07a7 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:36.161452 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-18118e09-e3f4-4ce6-83b3-a39b28ed07a7 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/588846072" status: 202 len: 0 microversion: 2.1 time: 0.056303 Oct 05 17:32:36.162032 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 124/272] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:32:36 2022] DELETE /compute/v2.1/flavors/588846072 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:36.173008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1d2e0eae-4d73-4447-adb4-78110989ceb9 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:36.173631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1d2e0eae-4d73-4447-adb4-78110989ceb9 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:36.189553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d2e0eae-4d73-4447-adb4-78110989ceb9 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:36.190420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d2e0eae-4d73-4447-adb4-78110989ceb9 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:36.190929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d2e0eae-4d73-4447-adb4-78110989ceb9 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:36.191577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d2e0eae-4d73-4447-adb4-78110989ceb9 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:36.192035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d2e0eae-4d73-4447-adb4-78110989ceb9 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:36.192455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d2e0eae-4d73-4447-adb4-78110989ceb9 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:36.233157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:36.313196 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac282859-df6e-413d-a7e8-d9cff805d2fd tempest-FlavorMetadataValidation-1334831220 tempest-FlavorMetadataValidation-1334831220-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1849226819/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.357059 Oct 05 17:32:36.314707 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 149/273] 10.222.0.70 () {62 vars in 1265 bytes} [Wed Oct 5 17:32:35 2022] POST /compute/v2.1/flavors/1849226819/os-extra_specs => generated 62 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:36.323089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a3c9a364-0761-465a-8d8c-3c183a2fb109 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:36.369326 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a3c9a364-0761-465a-8d8c-3c183a2fb109 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6241 microversion: 2.1 time: 0.052354 Oct 05 17:32:36.383550 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 150/274] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:36 2022] GET /compute/v2.1/flavors/detail => generated 6241 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:36.383550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-575b35db-6fe4-4932-add0-44b70c05d246 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:36.383550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-575b35db-6fe4-4932-add0-44b70c05d246 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:36.385951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575b35db-6fe4-4932-add0-44b70c05d246 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:36.386665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575b35db-6fe4-4932-add0-44b70c05d246 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:36.387245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575b35db-6fe4-4932-add0-44b70c05d246 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:36.393869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575b35db-6fe4-4932-add0-44b70c05d246 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:36.394652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575b35db-6fe4-4932-add0-44b70c05d246 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:36.395194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575b35db-6fe4-4932-add0-44b70c05d246 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:36.635377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-575b35db-6fe4-4932-add0-44b70c05d246 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:36.647233 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-575b35db-6fe4-4932-add0-44b70c05d246 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1471 microversion: 2.1 time: 0.273397 Oct 05 17:32:36.647814 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 151/275] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:36 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:36.672166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ddeb8ab-ee66-4a25-832c-ee14ddf08b35 tempest-FlavorMetadataValidation-1334831220 tempest-FlavorMetadataValidation-1334831220-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:36.696881 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ddeb8ab-ee66-4a25-832c-ee14ddf08b35 tempest-FlavorMetadataValidation-1334831220 tempest-FlavorMetadataValidation-1334831220-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1849226819" status: 202 len: 0 microversion: 2.86 time: 0.029454 Oct 05 17:32:36.701024 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 152/276] 10.222.0.70 () {60 vars in 1202 bytes} [Wed Oct 5 17:32:36 2022] DELETE /compute/v2.1/flavors/1849226819 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:32:36.705494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2746e56b-2831-4831-b300-7035d6af0fff tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-24639580", "id": 575896273, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:36.749448 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2746e56b-2831-4831-b300-7035d6af0fff tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.050147 Oct 05 17:32:36.750717 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 153/277] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:36 2022] POST /compute/v2.1/flavors => generated 412 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:36.764051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ffe2fe7-2740-403c-9fbb-b1f60d4a4c1a tempest-FlavorMetadataValidation-1334831220 tempest-FlavorMetadataValidation-1334831220-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:36.800302 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7ffe2fe7-2740-403c-9fbb-b1f60d4a4c1a tempest-FlavorMetadataValidation-1334831220 tempest-FlavorMetadataValidation-1334831220-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 7125 microversion: 2.86 time: 0.047766 Oct 05 17:32:36.800965 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 154/278] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:32:36 2022] GET /compute/v2.1/flavors/detail => generated 7125 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:36.815294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-159f10af-e9ae-4ab8-8edf-e5c72163b30a tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:36.896896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1d2e0eae-4d73-4447-adb4-78110989ceb9 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:36.906397 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1d2e0eae-4d73-4447-adb4-78110989ceb9 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1319 microversion: 2.1 time: 0.739847 Oct 05 17:32:36.912449 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 125/279] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:36 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1319 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:36.916410 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-159f10af-e9ae-4ab8-8edf-e5c72163b30a tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.1 time: 0.111122 Oct 05 17:32:36.923401 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 155/280] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:36 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:36.959596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4884a54f-9b3d-4649-bef9-2d7f88d0df83 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:36.999645 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4884a54f-9b3d-4649-bef9-2d7f88d0df83 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/575896273" status: 202 len: 0 microversion: 2.1 time: 0.046304 Oct 05 17:32:37.007289 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 126/281] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:32:36 2022] DELETE /compute/v2.1/flavors/575896273 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:37.009821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e88a6f4-1595-484f-bef6-a40c90134cb9 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:37.057157 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e88a6f4-1595-484f-bef6-a40c90134cb9 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.051302 Oct 05 17:32:37.060018 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 156/282] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:37 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:37.079282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f7d966a5-77a6-48b2-9494-ef044c9f51ea tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2143099593", "id": 730425148, "os-flavor-access:is_public": "True"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:37.110777 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f7d966a5-77a6-48b2-9494-ef044c9f51ea tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.035531 Oct 05 17:32:37.115145 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 127/283] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:37 2022] POST /compute/v2.1/flavors => generated 426 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:37.120525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:37.121332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:37.131602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-462ee828-8c08-49be-9a7a-a0e34543c17c tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:37.135828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:37.136883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:37.138648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:37.139533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:37.141454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:37.142817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:37.166497 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-462ee828-8c08-49be-9a7a-a0e34543c17c tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/730425148" status: 202 len: 0 microversion: 2.1 time: 0.043114 Oct 05 17:32:37.167659 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 128/284] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:32:37 2022] DELETE /compute/v2.1/flavors/730425148 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:37.178102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5434aa31-1693-4fa2-9b4f-d7798bdb1d96 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:37.259117 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5434aa31-1693-4fa2-9b4f-d7798bdb1d96 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.086354 Oct 05 17:32:37.268278 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 129/285] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:37 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:37.292133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f55ec5e7-c61b-4263-871e-625ae9a5ebe7 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-688457155", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:37.319075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:37.338448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:37.341197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:37.353452 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f55ec5e7-c61b-4263-871e-625ae9a5ebe7 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.064949 Oct 05 17:32:37.353824 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49949f28-7bd9-44d8-95a1-36550141e559 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1417 microversion: 2.75 time: 0.237184 Oct 05 17:32:37.355523 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 130/287] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:37 2022] POST /compute/v2.1/flavors => generated 506 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:37.365692 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 157/287] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:37 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1417 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:37.394100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c351ff5-fabc-475e-a09e-a0772af9c138 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:37.442593 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c351ff5-fabc-475e-a09e-a0772af9c138 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/228a1035-346e-459f-a5b3-69a79ec34f3c" status: 202 len: 0 microversion: 2.1 time: 0.077718 Oct 05 17:32:37.443839 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 131/288] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:32:37 2022] DELETE /compute/v2.1/flavors/228a1035-346e-459f-a5b3-69a79ec34f3c => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:37.454659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d0d8107-aeea-429e-9d02-99cce9abecc6 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:37.494086 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d0d8107-aeea-429e-9d02-99cce9abecc6 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.045297 Oct 05 17:32:37.494714 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 158/289] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:37 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:37.515666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a92a19e5-92c9-488e-b807-a9f50e40ff43 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-464976479", "id": "da6a39ba-b437-431c-b328-a9351260bf76", "os-flavor-access:is_public": "True"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:37.556919 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a92a19e5-92c9-488e-b807-a9f50e40ff43 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.044495 Oct 05 17:32:37.558839 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 132/290] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:37 2022] POST /compute/v2.1/flavors => generated 506 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:37.570917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d6e326be-8e87-4a33-94b2-68da550d5b10 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:37.596988 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d6e326be-8e87-4a33-94b2-68da550d5b10 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/da6a39ba-b437-431c-b328-a9351260bf76" status: 202 len: 0 microversion: 2.1 time: 0.030074 Oct 05 17:32:37.598936 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 159/291] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:32:37 2022] DELETE /compute/v2.1/flavors/da6a39ba-b437-431c-b328-a9351260bf76 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:37.611068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-573d00b5-5aa3-4a61-bb78-9f5ad346b894 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:37.647619 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-573d00b5-5aa3-4a61-bb78-9f5ad346b894 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.043394 Oct 05 17:32:37.648645 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 133/292] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:37 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:37.684754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1fc5ebd5-7e1e-4921-b5c5-3b71deb1168e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:37.685284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1fc5ebd5-7e1e-4921-b5c5-3b71deb1168e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:37.686047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e1d7d08b-c75c-4bd0-a7ef-15ce10e1cbe4 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1561508485", "id": 490319749, "os-flavor-access:is_public": "True"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:37.703997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fc5ebd5-7e1e-4921-b5c5-3b71deb1168e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:37.705474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fc5ebd5-7e1e-4921-b5c5-3b71deb1168e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:37.706186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fc5ebd5-7e1e-4921-b5c5-3b71deb1168e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:37.707127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fc5ebd5-7e1e-4921-b5c5-3b71deb1168e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:37.708249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fc5ebd5-7e1e-4921-b5c5-3b71deb1168e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:37.708850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fc5ebd5-7e1e-4921-b5c5-3b71deb1168e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:37.719067 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e1d7d08b-c75c-4bd0-a7ef-15ce10e1cbe4 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.053994 Oct 05 17:32:37.729350 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 160/293] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:37 2022] POST /compute/v2.1/flavors => generated 411 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:37.735839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86f2ba2d-1034-4f5f-92ac-42eda1ffe9d6 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:37.748893 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-86f2ba2d-1034-4f5f-92ac-42eda1ffe9d6 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/490319749" status: 200 len: 411 microversion: 2.1 time: 0.015974 Oct 05 17:32:37.750845 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 161/294] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:37 2022] GET /compute/v2.1/flavors/490319749 => generated 411 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:37.993395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1fc5ebd5-7e1e-4921-b5c5-3b71deb1168e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:38.002056 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1fc5ebd5-7e1e-4921-b5c5-3b71deb1168e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1471 microversion: 2.1 time: 0.321930 Oct 05 17:32:38.002953 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 134/295] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:37 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1471 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:38.011451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-38021e36-6065-439b-a72b-f34d1cb5c71b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:38.012139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-38021e36-6065-439b-a72b-f34d1cb5c71b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:38.019617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38021e36-6065-439b-a72b-f34d1cb5c71b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:38.020410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38021e36-6065-439b-a72b-f34d1cb5c71b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:38.021044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38021e36-6065-439b-a72b-f34d1cb5c71b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:38.022001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38021e36-6065-439b-a72b-f34d1cb5c71b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:38.022758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38021e36-6065-439b-a72b-f34d1cb5c71b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:38.023381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38021e36-6065-439b-a72b-f34d1cb5c71b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:38.286210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-38021e36-6065-439b-a72b-f34d1cb5c71b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:38.298060 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-38021e36-6065-439b-a72b-f34d1cb5c71b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1469 microversion: 2.1 time: 0.293869 Oct 05 17:32:38.310318 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 135/296] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:38 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1469 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:38.310318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc12278a-7144-407c-8120-4fec09681423 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:38.311668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fc12278a-7144-407c-8120-4fec09681423 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:38.333006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc12278a-7144-407c-8120-4fec09681423 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:38.333963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc12278a-7144-407c-8120-4fec09681423 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:38.336394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc12278a-7144-407c-8120-4fec09681423 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:38.341337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc12278a-7144-407c-8120-4fec09681423 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:38.342061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc12278a-7144-407c-8120-4fec09681423 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:38.343992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc12278a-7144-407c-8120-4fec09681423 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:38.381946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a3dc3049-7444-4529-821a-95f2ab75cd55 tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:38.431895 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a3dc3049-7444-4529-821a-95f2ab75cd55 tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.669664 Oct 05 17:32:38.433490 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 162/297] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:37 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:38.440864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-49a248db-68ae-4cd1-b837-59e5e1199213 req-d65a1c26-2371-4138-a264-a5bfc40c9b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50deba5b-8150-4d35-9fea-79d5acdbf33e", "tag": "359f2c58-5ec7-4319-85c5-b3d744235dab"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:38.470062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-49a248db-68ae-4cd1-b837-59e5e1199213 req-d65a1c26-2371-4138-a264-a5bfc40c9b04 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:38.472469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-49a248db-68ae-4cd1-b837-59e5e1199213 req-d65a1c26-2371-4138-a264-a5bfc40c9b04 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:38.473166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-49a248db-68ae-4cd1-b837-59e5e1199213 req-d65a1c26-2371-4138-a264-a5bfc40c9b04 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:38.503760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-49a248db-68ae-4cd1-b837-59e5e1199213 req-d65a1c26-2371-4138-a264-a5bfc40c9b04 service nova] Creating event network-changed:359f2c58-5ec7-4319-85c5-b3d744235dab for instance 50deba5b-8150-4d35-9fea-79d5acdbf33e on n-h1-835595-3 Oct 05 17:32:38.509325 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-49a248db-68ae-4cd1-b837-59e5e1199213 req-d65a1c26-2371-4138-a264-a5bfc40c9b04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074289 Oct 05 17:32:38.511311 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 163/298] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:38.742009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fc12278a-7144-407c-8120-4fec09681423 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:38.754962 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fc12278a-7144-407c-8120-4fec09681423 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 200 len: 1589 microversion: 2.1 time: 0.451960 Oct 05 17:32:38.766750 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 136/299] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:38 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 1589 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:38.781177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-544f187f-d389-447d-8e50-7b2f36d77131 tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:38.790018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-544f187f-d389-447d-8e50-7b2f36d77131 tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:38.804380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-544f187f-d389-447d-8e50-7b2f36d77131 tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:38.805271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-544f187f-d389-447d-8e50-7b2f36d77131 tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:38.806192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-544f187f-d389-447d-8e50-7b2f36d77131 tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:38.807108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-544f187f-d389-447d-8e50-7b2f36d77131 tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:38.808557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-544f187f-d389-447d-8e50-7b2f36d77131 tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:38.809287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-544f187f-d389-447d-8e50-7b2f36d77131 tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:38.966685 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-544f187f-d389-447d-8e50-7b2f36d77131 tempest-DeleteServersAdminTestJSON-1744474253 tempest-DeleteServersAdminTestJSON-1744474253-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6/action" status: 202 len: 0 microversion: 2.1 time: 0.196244 Oct 05 17:32:38.967733 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 137/300] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:32:38 2022] POST /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:38.973669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:38.974334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:38.981895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:38.982421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:38.983954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:38.985068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:38.985975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:38.987069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:39.083334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:39.095764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:39.099160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:39.114570 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0282fbd2-051d-4562-8471-26a559b7dcaf tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1438 microversion: 2.75 time: 0.142933 Oct 05 17:32:39.115687 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 138/301] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:38 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1438 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:39.137226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-171b5053-3a2b-4e44-b316-6af148025955 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:39.148624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce20dfe7-9e73-445c-aa93-3915c61d15b5 tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-721815991", "id": 357072309, "os-flavor-access:is_public": "False"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:39.161578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:39.163059 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-171b5053-3a2b-4e44-b316-6af148025955 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/490319749" status: 202 len: 0 microversion: 2.1 time: 0.046248 Oct 05 17:32:39.163704 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 139/302] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:32:39 2022] DELETE /compute/v2.1/flavors/490319749 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:39.173076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:39.173678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:39.180120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:39.180965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:39.181604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:39.182585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:39.183276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:39.183898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:39.195393 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ce20dfe7-9e73-445c-aa93-3915c61d15b5 tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.682598 Oct 05 17:32:39.199559 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 164/303] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:38 2022] POST /compute/v2.1/flavors => generated 427 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:39.216550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56f36596-ebdc-42d8-8c8e-9b5e16edce0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:39.226770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56f36596-ebdc-42d8-8c8e-9b5e16edce0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:39.252985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:39.255700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56f36596-ebdc-42d8-8c8e-9b5e16edce0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:39.256320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56f36596-ebdc-42d8-8c8e-9b5e16edce0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:39.256857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56f36596-ebdc-42d8-8c8e-9b5e16edce0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:39.259429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56f36596-ebdc-42d8-8c8e-9b5e16edce0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:39.260070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56f36596-ebdc-42d8-8c8e-9b5e16edce0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:39.261222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56f36596-ebdc-42d8-8c8e-9b5e16edce0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:39.261453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:39.262059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:39.263954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lazy-loading 'fault' on Instance uuid fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:32:39.325150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:39.560994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:39.573392 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-035f639a-008c-466e-8a3b-e0b0d06a9392 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1452 microversion: 2.1 time: 0.404024 Oct 05 17:32:39.575491 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 140/304] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:39 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1452 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:39.587510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:39.591884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:39.604592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:39.605102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:39.605536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:39.606246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:39.606740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:39.607201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:39.747428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:32:39.748215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:32:39.749138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:32:39.749921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:32:39.750935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:32:39.759447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-56f36596-ebdc-42d8-8c8e-9b5e16edce0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:39.784229 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56f36596-ebdc-42d8-8c8e-9b5e16edce0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1471 microversion: 2.1 time: 0.581210 Oct 05 17:32:39.784833 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 165/305] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:39 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1471 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:39.810313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eec9e7a8-8df6-4e28-a8f4-7572b48c7ccd tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:39.835695 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eec9e7a8-8df6-4e28-a8f4-7572b48c7ccd tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.029075 Oct 05 17:32:39.836864 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 166/306] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:39 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:39.855869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e192129-5316-48ff-a6ea-4f7ff77217e9 tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "c0713814d16643338dc22a07823ba379"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:39.866182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:39.875650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:39.876374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:39.877205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:39.878433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:39.879145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:39.879893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:39.965716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:39.985831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:39.991739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:40.003045 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4bc19607-df74-4eeb-8e42-fbd5ec7c0577 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "POST /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6/action" status: 202 len: 1495 microversion: 2.75 time: 0.420899 Oct 05 17:32:40.007033 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 141/307] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:32:39 2022] POST /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6/action => generated 1495 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 05 17:32:40.019940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7e526c4d-77ce-41c6-8856-c348eecfb071 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:40.020637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7e526c4d-77ce-41c6-8856-c348eecfb071 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:40.024443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:DELETE=15 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:40.035727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e526c4d-77ce-41c6-8856-c348eecfb071 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:40.036470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e526c4d-77ce-41c6-8856-c348eecfb071 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:40.037142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e526c4d-77ce-41c6-8856-c348eecfb071 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:40.038100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e526c4d-77ce-41c6-8856-c348eecfb071 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:40.038715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e526c4d-77ce-41c6-8856-c348eecfb071 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:40.039536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e526c4d-77ce-41c6-8856-c348eecfb071 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:40.073014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7e526c4d-77ce-41c6-8856-c348eecfb071 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:32:40.183363 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7e526c4d-77ce-41c6-8856-c348eecfb071 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 204 len: 0 microversion: 2.1 time: 0.174861 Oct 05 17:32:40.188292 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 142/308] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:32:40 2022] DELETE /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:32:40.194480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9868ec0-3302-4622-8805-4263d9988111 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-806508682", "id": 2066688343, "os-flavor-access:is_public": "False"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:40.222585 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f9868ec0-3302-4622-8805-4263d9988111 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.032870 Oct 05 17:32:40.223415 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 143/309] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:40 2022] POST /compute/v2.1/flavors => generated 429 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:40.231097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:40.231097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:40.235692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:40.236209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:40.236683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:40.238555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:40.239099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:40.239712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:40.326515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:40.342193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:40.343992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:40.349401 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b18f8993-fd2f-477e-9e0f-d321cc5de498 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.124959 Oct 05 17:32:40.358507 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 144/310] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:40 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:40.358507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:40.358507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:40.365096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:40.365880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:40.366576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:40.367610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:40.368265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:40.369053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:40.377866 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e192129-5316-48ff-a6ea-4f7ff77217e9 tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/357072309/action" status: 200 len: 96 microversion: 2.1 time: 0.535244 Oct 05 17:32:40.378566 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 167/311] 10.222.0.70 () {60 vars in 1197 bytes} [Wed Oct 5 17:32:39 2022] POST /compute/v2.1/flavors/357072309/action => generated 96 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:40.387789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-03620f54-3e33-470f-b4f7-dd28b80887f9 tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "2066688343"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:40.401746 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-03620f54-3e33-470f-b4f7-dd28b80887f9 tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] HTTP exception thrown: Flavor 2066688343 could not be found. Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-03620f54-3e33-470f-b4f7-dd28b80887f9 tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] Request method failure captured: Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 107 Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-xvAEyxqcieixNf-uFliSOS3-K_nKQNjoF7MNQCuaS9nIZA1t3DJ2O_yg-m8pvHOzpdfILjBpqpfdfbqqyaBr8lcqMa3q5Bo3TujoZZlnVS7b29LA2wlElWtgIaRece5DN9gY-KTVhbVbU2vG5ZDVbD_VWwmPjm2lwIsK01R5Zrgs Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: ab9fb1523a0c4822bb34b177d6b9df84 Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FlavorsAdminTestJSON-1513073549 Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:40.406177 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ab9fb1523a0c4822bb34b177d6b9df84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ab9fb1523a0c4822bb34b177d6b9df84"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ab9fb1523a0c4822bb34b177d6b9df84", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ab9fb1523a0c4822bb34b177d6b9df84"}]}] Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FlavorsAdminTestJSON-1513073549 Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: ab9fb1523a0c4822bb34b177d6b9df84 Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1513073549 Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FlavorsAdminTestJSON-1513073549-project Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: bd55d24bba7641de867efc58eec9cb2d Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FlavorsAdminTestJSON-1513073549-project Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "test", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "2066688343"}} Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:40.407719 n-d-835595-3 devstack@n-api.service[128844]: exception: Flavor 2066688343 could not be found. Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '2066688343'}}} Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2066688343 could not be found. Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:40.408651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2066688343 could not be found. Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:40.410238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:40.411677 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:40.411677 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:40.411677 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:40.411677 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2066688343 could not be found. Oct 05 17:32:40.411677 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:40.411677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-03620f54-3e33-470f-b4f7-dd28b80887f9 tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] Returning 400 to user: Flavor 2066688343 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:40.411677 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-03620f54-3e33-470f-b4f7-dd28b80887f9 tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.028281 Oct 05 17:32:40.418160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:40.419061 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 168/312] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:40 2022] POST /compute/v2.1/servers => generated 81 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:32:40.419275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:40.419839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:40.420532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lazy-loading 'fault' on Instance uuid fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:32:40.556328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:40.566206 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3e4f179b-0d33-4836-a5d1-9e811e89933b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1458 microversion: 2.1 time: 0.215146 Oct 05 17:32:40.578380 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 145/313] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:40 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1458 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:40.578380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-090ec4a3-3ed5-4d1d-af37-bd666c282a9a tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:40.602619 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-090ec4a3-3ed5-4d1d-af37-bd666c282a9a tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/2066688343" status: 202 len: 0 microversion: 2.1 time: 0.034111 Oct 05 17:32:40.604680 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 146/314] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:32:40 2022] DELETE /compute/v2.1/flavors/2066688343 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:40.614733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c845fcf9-26d3-4718-a9c3-7cc6c6654b16 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:40.644297 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c845fcf9-26d3-4718-a9c3-7cc6c6654b16 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.033885 Oct 05 17:32:40.644959 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 147/315] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:40 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:40.666557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f4908fa4-22b5-40bb-8704-107446511016 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1564243888", "id": 1454214356, "os-flavor-access:is_public": "False"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:40.687180 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f4908fa4-22b5-40bb-8704-107446511016 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.024847 Oct 05 17:32:40.694577 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 148/316] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:40 2022] POST /compute/v2.1/flavors => generated 415 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:40.703890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-17056196-72a3-4c86-826e-0754496812be tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1182716365", "id": 1226218109, "os-flavor-access:is_public": "True"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:40.731912 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-17056196-72a3-4c86-826e-0754496812be tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.034080 Oct 05 17:32:40.732781 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 149/317] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:40 2022] POST /compute/v2.1/flavors => generated 414 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:40.751011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e969cc77-6b64-44a6-963f-3ebc5c3c503a tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:40.764977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-df502e36-120f-4ab8-b8dd-e19cdfb0a590 tempest-FlavorsAccessTestJSON-1722231264 tempest-FlavorsAccessTestJSON-1722231264-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:40.772864 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e969cc77-6b64-44a6-963f-3ebc5c3c503a tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 835 microversion: 2.1 time: 0.030496 Oct 05 17:32:40.776508 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 150/318] 10.222.0.70 () {58 vars in 1169 bytes} [Wed Oct 5 17:32:40 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 835 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:40.788334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3185eff5-15b5-4eb6-8724-7e05af9b31d9 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:40.800530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3185eff5-15b5-4eb6-8724-7e05af9b31d9 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 835 microversion: 2.1 time: 0.016078 Oct 05 17:32:40.801602 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 151/319] 10.222.0.70 () {58 vars in 1177 bytes} [Wed Oct 5 17:32:40 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 835 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:40.814211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-abf2e6cc-6b3a-40ff-9ded-08784b305eae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:40.815526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-abf2e6cc-6b3a-40ff-9ded-08784b305eae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:40.817556 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-df502e36-120f-4ab8-b8dd-e19cdfb0a590 tempest-FlavorsAccessTestJSON-1722231264 tempest-FlavorsAccessTestJSON-1722231264-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6640 microversion: 2.1 time: 0.386755 Oct 05 17:32:40.818465 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 169/320] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:40 2022] GET /compute/v2.1/flavors/detail => generated 6640 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:40.828151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e0fef70-4b1c-4694-aa64-0a09159ef006 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:40.836194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf2e6cc-6b3a-40ff-9ded-08784b305eae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:40.840796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf2e6cc-6b3a-40ff-9ded-08784b305eae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:40.841295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf2e6cc-6b3a-40ff-9ded-08784b305eae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:40.842229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf2e6cc-6b3a-40ff-9ded-08784b305eae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:40.842746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf2e6cc-6b3a-40ff-9ded-08784b305eae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:40.843157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf2e6cc-6b3a-40ff-9ded-08784b305eae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:40.856635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:40.872884 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0e0fef70-4b1c-4694-aa64-0a09159ef006 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 835 microversion: 2.1 time: 0.051702 Oct 05 17:32:40.873784 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 170/321] 10.222.0.70 () {58 vars in 1171 bytes} [Wed Oct 5 17:32:40 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 835 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:40.888978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd5a7ef8-71e2-42be-ae35-d8074264b36b tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c0713814d16643338dc22a07823ba379"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:41.016903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-abf2e6cc-6b3a-40ff-9ded-08784b305eae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:41.031730 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-abf2e6cc-6b3a-40ff-9ded-08784b305eae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.222300 Oct 05 17:32:41.047937 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 152/322] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:40 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:41.052684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7168a8d4-d1d3-42f7-9e1f-d7e62d2bbbc0 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.063092 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7168a8d4-d1d3-42f7-9e1f-d7e62d2bbbc0 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 835 microversion: 2.1 time: 0.013918 Oct 05 17:32:41.072097 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 153/323] 10.222.0.70 () {58 vars in 1169 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 835 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:41.078580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c0ff6b5-16ca-4150-9d94-ffecd4d8389a tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.106824 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c0ff6b5-16ca-4150-9d94-ffecd4d8389a tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6223 microversion: 2.1 time: 0.032308 Oct 05 17:32:41.118139 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 154/324] 10.222.0.70 () {58 vars in 1169 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6223 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.127552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-36921376-0cf7-4552-9c7a-f9d11171e233 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.162507 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-36921376-0cf7-4552-9c7a-f9d11171e233 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6223 microversion: 2.1 time: 0.039140 Oct 05 17:32:41.179776 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 155/325] 10.222.0.70 () {58 vars in 1175 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6223 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.185088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c75e9878-3fbf-4496-b4cb-696f9cd89509 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.187314 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd5a7ef8-71e2-42be-ae35-d8074264b36b tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/357072309/action" status: 200 len: 21 microversion: 2.1 time: 0.300531 Oct 05 17:32:41.188058 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 171/326] 10.222.0.70 () {60 vars in 1197 bytes} [Wed Oct 5 17:32:40 2022] POST /compute/v2.1/flavors/357072309/action => generated 21 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:41.199611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-139e37e6-1d43-480f-b00e-cfbf852d7752 tempest-FlavorsAccessTestJSON-1722231264 tempest-FlavorsAccessTestJSON-1722231264-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.214869 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c75e9878-3fbf-4496-b4cb-696f9cd89509 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6223 microversion: 2.1 time: 0.033450 Oct 05 17:32:41.215465 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 156/327] 10.222.0.70 () {58 vars in 1173 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6223 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.228146 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-139e37e6-1d43-480f-b00e-cfbf852d7752 tempest-FlavorsAccessTestJSON-1722231264 tempest-FlavorsAccessTestJSON-1722231264-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.033988 Oct 05 17:32:41.230002 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 172/328] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:41.239016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-858a10cd-efb4-42ab-80ce-cfb3b8ab889e tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.253156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-447c925e-a026-4097-87ad-80722a5d4f11 tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.275942 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-447c925e-a026-4097-87ad-80722a5d4f11 tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/357072309" status: 202 len: 0 microversion: 2.1 time: 0.026377 Oct 05 17:32:41.276749 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 173/329] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:32:41 2022] DELETE /compute/v2.1/flavors/357072309 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:41.285165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b79374e-74b6-478c-83f7-cf1207054897 tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.289649 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-858a10cd-efb4-42ab-80ce-cfb3b8ab889e tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6223 microversion: 2.1 time: 0.059125 Oct 05 17:32:41.294407 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 157/330] 10.222.0.70 () {58 vars in 1169 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6223 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.318190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6183ab69-a4bd-43fe-a9ab-226e9c095211 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.326168 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b79374e-74b6-478c-83f7-cf1207054897 tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.044481 Oct 05 17:32:41.327022 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 174/331] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.350252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1da9684c-d8c1-4b98-8a21-8da151ddcd4e tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-819988159", "id": 1826903297, "os-flavor-access:is_public": "False"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:41.375168 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1da9684c-d8c1-4b98-8a21-8da151ddcd4e tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.029162 Oct 05 17:32:41.378020 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6183ab69-a4bd-43fe-a9ab-226e9c095211 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1226218109" status: 202 len: 0 microversion: 2.1 time: 0.067518 Oct 05 17:32:41.379381 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 158/333] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:32:41 2022] DELETE /compute/v2.1/flavors/1226218109 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:41.379552 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 175/333] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:41 2022] POST /compute/v2.1/flavors => generated 430 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:41.387265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.387863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:41.392338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-57a3ce5d-1a4c-4f92-9489-77f16952a2d3 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.399257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:41.400103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:41.400676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:41.401533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:41.402088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:41.402665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:41.440508 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-57a3ce5d-1a4c-4f92-9489-77f16952a2d3 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.052914 Oct 05 17:32:41.441116 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 176/334] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.451330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-32ce720e-11c9-4381-8673-16729a83145d tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.471771 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-32ce720e-11c9-4381-8673-16729a83145d tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1826903297/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.024211 Oct 05 17:32:41.479937 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 177/335] 10.222.0.70 () {58 vars in 1209 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/1826903297/os-flavor-access => generated 21 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:41.487948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8bea78b8-4a71-4c97-89d1-bcecaebfb5e2 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.508657 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8bea78b8-4a71-4c97-89d1-bcecaebfb5e2 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1454214356" status: 202 len: 0 microversion: 2.1 time: 0.027210 Oct 05 17:32:41.509541 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 178/336] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:32:41 2022] DELETE /compute/v2.1/flavors/1454214356 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:41.514893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-be73eb93-679d-4e7f-b66d-303bcd24584e tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.535692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:41.536919 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-be73eb93-679d-4e7f-b66d-303bcd24584e tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1826903297" status: 202 len: 0 microversion: 2.1 time: 0.026106 Oct 05 17:32:41.537702 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 179/337] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:32:41 2022] DELETE /compute/v2.1/flavors/1826903297 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:41.542731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a3633d9-76ce-4fc5-9185-07c0ef3b5d92 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.549812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:41.551766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:41.558806 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e32a8149-9b3a-4f3d-87ac-4b2372dd9342 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.178354 Oct 05 17:32:41.559964 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 159/338] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:41.568948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bbee8569-3c9f-448d-b45d-0431617d430d tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.589259 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a3633d9-76ce-4fc5-9185-07c0ef3b5d92 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.050119 Oct 05 17:32:41.598378 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 180/339] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.598378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.598378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:41.609951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:41.610481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:41.612197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:41.612917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:41.613379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:41.613805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:41.618058 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bbee8569-3c9f-448d-b45d-0431617d430d tempest-FlavorsAccessTestJSON-126684175 tempest-FlavorsAccessTestJSON-126684175-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.056751 Oct 05 17:32:41.630300 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 160/340] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.630300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-691ea998-5f81-450a-9577-6088469c726d tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2044874213", "id": 1540683565, "os-flavor-access:is_public": "False"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:41.668933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:41.669485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:41.670025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:41.670379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lazy-loading 'fault' on Instance uuid fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:32:41.671508 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-691ea998-5f81-450a-9577-6088469c726d tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.051120 Oct 05 17:32:41.672320 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 161/341] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:41 2022] POST /compute/v2.1/flavors => generated 415 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:41.685328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9570f37a-ef39-437c-a696-1ac383ae8c66 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.707395 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9570f37a-ef39-437c-a696-1ac383ae8c66 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.026006 Oct 05 17:32:41.708348 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 162/342] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.727849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9a5fed4-c930-4190-a60b-d304e963b62a tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.753549 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c9a5fed4-c930-4190-a60b-d304e963b62a tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.029335 Oct 05 17:32:41.754787 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 163/343] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.773687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8473a79c-6658-4f39-8acd-0ad9a7e7591e tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.812285 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8473a79c-6658-4f39-8acd-0ad9a7e7591e tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1540683565" status: 202 len: 0 microversion: 2.1 time: 0.042201 Oct 05 17:32:41.812937 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 164/344] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:32:41 2022] DELETE /compute/v2.1/flavors/1540683565 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:41.824794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c016794-927e-485a-97b4-c82b7a07d319 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.866425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:41.870397 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c016794-927e-485a-97b4-c82b7a07d319 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.052110 Oct 05 17:32:41.886048 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 165/345] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:41.887709 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a005b0dd-b017-4bef-9221-e998029e72df tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1458 microversion: 2.1 time: 0.290127 Oct 05 17:32:41.887709 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 181/346] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1458 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:41.898953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85c881b3-038a-49b7-96cc-92ba734165a1 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-144027452", "id": 829060626, "os-flavor-access:is_public": "True"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:41.936102 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85c881b3-038a-49b7-96cc-92ba734165a1 tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.046916 Oct 05 17:32:41.937079 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 166/347] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:41 2022] POST /compute/v2.1/flavors => generated 410 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:41.952309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-03f15ea0-ebdb-490a-98ef-3509b2e9db95 tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:41.980824 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-03f15ea0-ebdb-490a-98ef-3509b2e9db95 tempest-FlavorsAdminTestJSON-1513073549 tempest-FlavorsAdminTestJSON-1513073549-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6219 microversion: 2.1 time: 0.034049 Oct 05 17:32:41.982127 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 167/348] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:41 2022] GET /compute/v2.1/flavors/detail => generated 6219 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:42.004140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-824e9a30-8ab0-406e-9eda-42ff8afca2eb tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:42.032809 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-824e9a30-8ab0-406e-9eda-42ff8afca2eb tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/829060626" status: 202 len: 0 microversion: 2.1 time: 0.033489 Oct 05 17:32:42.034123 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 168/349] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:32:41 2022] DELETE /compute/v2.1/flavors/829060626 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:42.043477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-972396ef-9a0d-4385-83d4-8803114f7d1a tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:42.070421 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-972396ef-9a0d-4385-83d4-8803114f7d1a tempest-FlavorsAdminTestJSON-1823815112 tempest-FlavorsAdminTestJSON-1823815112-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.030922 Oct 05 17:32:42.074369 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 169/350] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:42 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:42.106768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29d2e29c-75bf-4436-9a84-6c3393e94741 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:42.107431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29d2e29c-75bf-4436-9a84-6c3393e94741 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:42.114453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d2e29c-75bf-4436-9a84-6c3393e94741 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:42.114453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d2e29c-75bf-4436-9a84-6c3393e94741 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:42.115655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d2e29c-75bf-4436-9a84-6c3393e94741 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:42.116382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d2e29c-75bf-4436-9a84-6c3393e94741 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:42.116851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d2e29c-75bf-4436-9a84-6c3393e94741 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:42.117642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d2e29c-75bf-4436-9a84-6c3393e94741 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:42.311886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb357265-81a3-4160-9a66-891962f6bd56 tempest-FlavorsV255TestJSON-1059167831 tempest-FlavorsV255TestJSON-1059167831-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-756768926", "id": 1433413482, "os-flavor-access:is_public": "True"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:42.339042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb357265-81a3-4160-9a66-891962f6bd56 tempest-FlavorsV255TestJSON-1059167831 tempest-FlavorsV255TestJSON-1059167831-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.403009 Oct 05 17:32:42.352352 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 182/351] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:32:41 2022] POST /compute/v2.1/flavors => generated 448 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:32:42.414593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29d2e29c-75bf-4436-9a84-6c3393e94741 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:42.434065 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29d2e29c-75bf-4436-9a84-6c3393e94741 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.361353 Oct 05 17:32:42.434873 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 170/352] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:42 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:42.594525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:42.595140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:42.598244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=12 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:42.618874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:42.624535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:42.625205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:42.626062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:42.627118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:42.628772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:42.735385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cb2a2422-7714-471e-8941-902650e33e4d tempest-FlavorsV255TestJSON-844821306 tempest-FlavorsV255TestJSON-844821306-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:42.747285 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cb2a2422-7714-471e-8941-902650e33e4d tempest-FlavorsV255TestJSON-844821306 tempest-FlavorsV255TestJSON-844821306-project] 10.222.0.70 "GET /compute/v2.1/flavors/1433413482" status: 200 len: 448 microversion: 2.55 time: 0.393539 Oct 05 17:32:42.750573 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 183/353] 10.222.0.70 () {60 vars in 1199 bytes} [Wed Oct 5 17:32:42 2022] GET /compute/v2.1/flavors/1433413482 => generated 448 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:42.765091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ad50345-0d19-4641-9cb5-ab17643b335c tempest-FlavorsV255TestJSON-1059167831 tempest-FlavorsV255TestJSON-1059167831-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:42.811562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:42.826484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:42.828338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:42.843119 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e4d5df3b-462d-4d2d-a478-dc09df47f93d tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.253240 Oct 05 17:32:42.854830 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ad50345-0d19-4641-9cb5-ab17643b335c tempest-FlavorsV255TestJSON-1059167831 tempest-FlavorsV255TestJSON-1059167831-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1433413482" status: 200 len: 449 microversion: 2.55 time: 0.094335 Oct 05 17:32:42.855053 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 171/354] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:42 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:42.857358 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 184/355] 10.222.0.70 () {62 vars in 1219 bytes} [Wed Oct 5 17:32:42 2022] PUT /compute/v2.1/flavors/1433413482 => generated 449 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:42.875353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d62dee1-5241-4d8b-9ea0-0ea91b644866 tempest-FlavorsV255TestJSON-844821306 tempest-FlavorsV255TestJSON-844821306-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:42.904720 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6d62dee1-5241-4d8b-9ea0-0ea91b644866 tempest-FlavorsV255TestJSON-844821306 tempest-FlavorsV255TestJSON-844821306-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6594 microversion: 2.55 time: 0.036613 Oct 05 17:32:42.905916 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 172/356] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:32:42 2022] GET /compute/v2.1/flavors/detail => generated 6594 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:42.915419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:42.916767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:42.933894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-89aae492-f311-4c6e-b467-9b177722044d tempest-FlavorsV255TestJSON-844821306 tempest-FlavorsV255TestJSON-844821306-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:42.935092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:42.935881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:42.936605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:42.937691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:42.939546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:42.940639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:42.961455 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-89aae492-f311-4c6e-b467-9b177722044d tempest-FlavorsV255TestJSON-844821306 tempest-FlavorsV255TestJSON-844821306-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 3684 microversion: 2.55 time: 0.036632 Oct 05 17:32:42.962817 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 173/357] 10.222.0.70 () {60 vars in 1166 bytes} [Wed Oct 5 17:32:42 2022] GET /compute/v2.1/flavors => generated 3684 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:32:42.980785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:42.981690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:42.982216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:42.982770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lazy-loading 'fault' on Instance uuid fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:32:42.984958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-99113f04-9afe-41bf-a596-367ac8716161 tempest-FlavorsV255TestJSON-1059167831 tempest-FlavorsV255TestJSON-1059167831-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:43.011952 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-99113f04-9afe-41bf-a596-367ac8716161 tempest-FlavorsV255TestJSON-1059167831 tempest-FlavorsV255TestJSON-1059167831-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1433413482" status: 202 len: 0 microversion: 2.55 time: 0.034549 Oct 05 17:32:43.012667 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 174/358] 10.222.0.70 () {60 vars in 1202 bytes} [Wed Oct 5 17:32:42 2022] DELETE /compute/v2.1/flavors/1433413482 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:32:43.043000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53e97e12-1101-466d-8aa1-2d229cb56e60 tempest-FlavorsV255TestJSON-1059167831 tempest-FlavorsV255TestJSON-1059167831-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:43.102071 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53e97e12-1101-466d-8aa1-2d229cb56e60 tempest-FlavorsV255TestJSON-1059167831 tempest-FlavorsV255TestJSON-1059167831-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 6155 microversion: 2.55 time: 0.082665 Oct 05 17:32:43.120133 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 175/359] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:32:43 2022] GET /compute/v2.1/flavors/detail => generated 6155 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:43.263564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:43.272960 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63f1cb09-fc8a-4831-91b4-4cf7d2eb9c9a tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1458 microversion: 2.1 time: 0.371934 Oct 05 17:32:43.279210 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 185/360] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:42 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1458 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:43.463033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-daa35b3d-0551-4ffa-8656-0138f8f48799 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:43.463905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-daa35b3d-0551-4ffa-8656-0138f8f48799 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:43.476227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daa35b3d-0551-4ffa-8656-0138f8f48799 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:43.477056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daa35b3d-0551-4ffa-8656-0138f8f48799 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:43.477712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daa35b3d-0551-4ffa-8656-0138f8f48799 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:43.487232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daa35b3d-0551-4ffa-8656-0138f8f48799 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:43.488684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daa35b3d-0551-4ffa-8656-0138f8f48799 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:43.489329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daa35b3d-0551-4ffa-8656-0138f8f48799 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:43.587602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-340d6eb9-2f38-4b74-a6be-1686667d59ea req-a8393c2f-52cc-4961-9fea-861f1f2a4fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdbcaff8-caf7-4c1b-bca7-74a96aa993b6", "name": "network-vif-deleted", "tag": "3b9334d9-1dd8-4ec9-a566-eb97e6aae2a9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:43.592832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:43.595306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:43.612157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-340d6eb9-2f38-4b74-a6be-1686667d59ea req-a8393c2f-52cc-4961-9fea-861f1f2a4fde service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:43.613159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-340d6eb9-2f38-4b74-a6be-1686667d59ea req-a8393c2f-52cc-4961-9fea-861f1f2a4fde service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:43.613611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-340d6eb9-2f38-4b74-a6be-1686667d59ea req-a8393c2f-52cc-4961-9fea-861f1f2a4fde service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:43.651808 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-340d6eb9-2f38-4b74-a6be-1686667d59ea req-a8393c2f-52cc-4961-9fea-861f1f2a4fde service nova] Creating event network-vif-deleted:3b9334d9-1dd8-4ec9-a566-eb97e6aae2a9 for instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 on n-h1-835595-3 Oct 05 17:32:43.671133 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-340d6eb9-2f38-4b74-a6be-1686667d59ea req-a8393c2f-52cc-4961-9fea-861f1f2a4fde service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083848 Oct 05 17:32:43.672328 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 186/361] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:43.858956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-daa35b3d-0551-4ffa-8656-0138f8f48799 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:43.882620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:43.883225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:43.907891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:43.908610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:43.909039 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-daa35b3d-0551-4ffa-8656-0138f8f48799 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.448395 Oct 05 17:32:43.909176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:43.910918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:43.911377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:43.911568 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 176/362] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:43 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:43.912155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:44.289663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:44.301285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:44.303054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:44.307351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:44.309568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:44.317693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:44.318204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:44.319105 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92c22aca-064e-4b17-a9d4-f4b426e98bae tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.443335 Oct 05 17:32:44.334318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 187/363] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:43 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:32:44.334553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:44.334553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:44.334553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:44.334553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:44.412127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:44.412640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:44.413062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:44.415405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lazy-loading 'fault' on Instance uuid fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:32:44.469717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cebd216a206f494197bf0b71d294cb01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8cbe7c9e993940f7a9ee263e9fce0745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:44.485256 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29a1ae1b-4a90-414b-9648-fa3522fca1b5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 200 len: 1309 microversion: 2.1 time: 0.189563 Oct 05 17:32:44.501109 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 177/364] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:44 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 1309 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:44.933268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ba23674-7025-4332-92f0-177639dc0d03 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:44.934037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8ba23674-7025-4332-92f0-177639dc0d03 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:44.950799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ba23674-7025-4332-92f0-177639dc0d03 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:44.951391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ba23674-7025-4332-92f0-177639dc0d03 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:44.954181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ba23674-7025-4332-92f0-177639dc0d03 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:44.956650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ba23674-7025-4332-92f0-177639dc0d03 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:44.958834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ba23674-7025-4332-92f0-177639dc0d03 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:44.959343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ba23674-7025-4332-92f0-177639dc0d03 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.348158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:45.349088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:45.352612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:45.369962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.370689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.371855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.372943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.375573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.376356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.452676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8ba23674-7025-4332-92f0-177639dc0d03 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:45.472434 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8ba23674-7025-4332-92f0-177639dc0d03 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.543126 Oct 05 17:32:45.492045 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 188/365] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:44 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:45.497942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:45.512819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:45.514001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:45.517275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:45.518260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:45.532326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.533260 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2b8cfb80-e1df-4241-8f54-b7332c4a2de4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.189907 Oct 05 17:32:45.547690 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 178/366] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:45 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:32:45.548948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.549648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.556002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.556507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.562995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.607660 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] HTTP exception thrown: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Request method failure captured: Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 HTTP/1.1 Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb93Nd2MkBq9lJnM1aRBTut-TWZiu31gtQgdqI1IAJa8ozhro1YodTyc5cKXDvXePXTKVBbarr5ENVnMgzVCdR2JukMKr0OZOLmTKsyVfvl3lp1vDItZuVrVxhN_607CHcSjhQu9DrNoqbT32Q-BLz77rF5FTMnU4-A4PkJIy9iUIo4 Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:45.612987 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8cbe7c9e993940f7a9ee263e9fce0745", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}] Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: cebd216a206f494197bf0b71d294cb01 Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.615642 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'fdbcaff8-caf7-4c1b-bca7-74a96aa993b6'} Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:45.616594 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.617874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.620144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Returning 404 to user: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:45.621196 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5dbd776a-4dab-43fa-aa21-c4686c35196b tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 404 len: 111 microversion: 2.1 time: 0.116108 Oct 05 17:32:45.631177 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 189/367] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:45 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:45.644718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:45.646222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:45.657472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.662873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.665683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.667813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.668858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.672239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.697936 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] HTTP exception thrown: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Request method failure captured: Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 HTTP/1.1 Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb93Nd2MkBq9lJnM1aRBTut-TWZiu31gtQgdqI1IAJa8ozhro1YodTyc5cKXDvXePXTKVBbarr5ENVnMgzVCdR2JukMKr0OZOLmTKsyVfvl3lp1vDItZuVrVxhN_607CHcSjhQu9DrNoqbT32Q-BLz77rF5FTMnU4-A4PkJIy9iUIo4 Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:45.701744 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8cbe7c9e993940f7a9ee263e9fce0745", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}] Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cebd216a206f494197bf0b71d294cb01 Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.703680 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'fdbcaff8-caf7-4c1b-bca7-74a96aa993b6'} Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:45.704400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.705564 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.709326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Returning 404 to user: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:45.714952 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-41a4f76d-f330-43bc-ba65-85aefa76586f tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 404 len: 111 microversion: 2.1 time: 0.079973 Oct 05 17:32:45.717342 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 179/368] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:32:45 2022] DELETE /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:45.725947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:45.726606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: fdbcaff8-caf7-4c1b-bca7-74a96aa993b6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:45.735313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.735797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.736233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.737021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.737482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.738316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.755363 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] HTTP exception thrown: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Request method failure captured: Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 HTTP/1.1 Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb93Nd2MkBq9lJnM1aRBTut-TWZiu31gtQgdqI1IAJa8ozhro1YodTyc5cKXDvXePXTKVBbarr5ENVnMgzVCdR2JukMKr0OZOLmTKsyVfvl3lp1vDItZuVrVxhN_607CHcSjhQu9DrNoqbT32Q-BLz77rF5FTMnU4-A4PkJIy9iUIo4 Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:45.756919 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8cbe7c9e993940f7a9ee263e9fce0745", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}] Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: cebd216a206f494197bf0b71d294cb01 Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.758495 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'fdbcaff8-caf7-4c1b-bca7-74a96aa993b6'} Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:45.759358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. Oct 05 17:32:45.760609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.765178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Returning 404 to user: Instance fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:45.767318 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-098706c9-e8c7-4b77-ab6e-6a9f64e7e36c tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6" status: 404 len: 111 microversion: 2.1 time: 0.044539 Oct 05 17:32:45.777393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:45.778088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:45.787999 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 190/369] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:45 2022] GET /compute/v2.1/servers/fdbcaff8-caf7-4c1b-bca7-74a96aa993b6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:45.793786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.795453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.798109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.800936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.805778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.806596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.852166 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] HTTP exception thrown: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Request method failure captured: Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b HTTP/1.1 Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb93Nd2MkBq9lJnM1aRBTut-TWZiu31gtQgdqI1IAJa8ozhro1YodTyc5cKXDvXePXTKVBbarr5ENVnMgzVCdR2JukMKr0OZOLmTKsyVfvl3lp1vDItZuVrVxhN_607CHcSjhQu9DrNoqbT32Q-BLz77rF5FTMnU4-A4PkJIy9iUIo4 Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:45.856967 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8cbe7c9e993940f7a9ee263e9fce0745", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}] Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cebd216a206f494197bf0b71d294cb01 Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:45.858965 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'c0bdcb64-ff16-45b4-aa53-bf5e5963957b'} Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:45.863369 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:45.864790 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.866106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Returning 404 to user: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:45.866106 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85285d99-1d83-45f3-8919-5018f89bd47e tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 404 len: 111 microversion: 2.1 time: 0.085928 Oct 05 17:32:45.866106 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 180/370] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:32:45 2022] DELETE /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:45.871702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:45.872683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] [instance: c0bdcb64-ff16-45b4-aa53-bf5e5963957b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:45.887961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.890092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.890710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.893520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:45.897728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:45.899291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:45.942225 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] HTTP exception thrown: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Request method failure captured: Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b HTTP/1.1 Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb93Nd2MkBq9lJnM1aRBTut-TWZiu31gtQgdqI1IAJa8ozhro1YodTyc5cKXDvXePXTKVBbarr5ENVnMgzVCdR2JukMKr0OZOLmTKsyVfvl3lp1vDItZuVrVxhN_607CHcSjhQu9DrNoqbT32Q-BLz77rF5FTMnU4-A4PkJIy9iUIo4 Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:45.963096 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8cbe7c9e993940f7a9ee263e9fce0745", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8cbe7c9e993940f7a9ee263e9fce0745"}]}] Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 8cbe7c9e993940f7a9ee263e9fce0745 Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1502732277 Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: cebd216a206f494197bf0b71d294cb01 Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersAdminTestJSON-1502732277-project Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:45.964688 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'c0bdcb64-ff16-45b4-aa53-bf5e5963957b'} Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:45.965773 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. Oct 05 17:32:45.966975 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:45.970318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] Returning 404 to user: Instance c0bdcb64-ff16-45b4-aa53-bf5e5963957b could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:45.971534 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5a9cff40-a519-44b0-b019-5f665016fee5 tempest-DeleteServersAdminTestJSON-1502732277 tempest-DeleteServersAdminTestJSON-1502732277-project] 10.222.0.70 "GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b" status: 404 len: 111 microversion: 2.1 time: 0.103671 Oct 05 17:32:45.976885 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 191/371] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:45 2022] GET /compute/v2.1/servers/c0bdcb64-ff16-45b4-aa53-bf5e5963957b => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:46.501902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9cdc0b7f-62b7-4580-b8ac-dfec35518193 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:46.503686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9cdc0b7f-62b7-4580-b8ac-dfec35518193 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:46.522761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc0b7f-62b7-4580-b8ac-dfec35518193 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:46.523657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc0b7f-62b7-4580-b8ac-dfec35518193 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:46.524243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc0b7f-62b7-4580-b8ac-dfec35518193 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:46.525941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc0b7f-62b7-4580-b8ac-dfec35518193 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:46.526609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc0b7f-62b7-4580-b8ac-dfec35518193 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:46.527202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc0b7f-62b7-4580-b8ac-dfec35518193 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:46.565753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:46.566792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:46.575012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:46.579002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:46.582120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:46.583106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:46.583844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:46.584429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:46.790347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9cdc0b7f-62b7-4580-b8ac-dfec35518193 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:46.798908 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9cdc0b7f-62b7-4580-b8ac-dfec35518193 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.303111 Oct 05 17:32:46.811364 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 181/372] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:46 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:46.856960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:46.868439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:46.872931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:46.887336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=85,nova_api:DELETE=10,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:46.890367 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b7d2078c-f07d-464d-9a2c-1bf1a9a4ed9b tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.328945 Oct 05 17:32:46.890970 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 192/373] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:46 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:47.823754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9333d81e-35cc-424b-b768-b004a0d9426e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:47.825344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9333d81e-35cc-424b-b768-b004a0d9426e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:47.833165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9333d81e-35cc-424b-b768-b004a0d9426e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:47.834107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9333d81e-35cc-424b-b768-b004a0d9426e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:47.835144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9333d81e-35cc-424b-b768-b004a0d9426e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:47.835950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9333d81e-35cc-424b-b768-b004a0d9426e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:47.836722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9333d81e-35cc-424b-b768-b004a0d9426e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:47.837350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9333d81e-35cc-424b-b768-b004a0d9426e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:47.928739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:47.930134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:47.941384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:47.941875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:47.942322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:47.943022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:47.943877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:47.943877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:48.031493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9333d81e-35cc-424b-b768-b004a0d9426e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:48.042450 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9333d81e-35cc-424b-b768-b004a0d9426e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.222667 Oct 05 17:32:48.057794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:48.068861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:48.069081 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 182/374] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:47 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:48.071417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:48.080229 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-40012a17-4996-4b4c-9d94-8c13a24757fb tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.157224 Oct 05 17:32:48.092603 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 193/375] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:47 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:48.445975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-56ee5b56-e20e-45d3-9607-b2d05d03a313 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: .version_select at 0x7f7775b51310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-692727329", "description": "tempest-description-557426457"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:48.616987 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-56ee5b56-e20e-45d3-9607-b2d05d03a313 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.514850 Oct 05 17:32:48.626017 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 183/376] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:32:48 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:48.632013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-033f268c-e6d8-4a23-9ead-bf6a7bebbc57 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: .version_select at 0x7f777596d160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1873487331", "description": "tempest-description-1131719773"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:48.840903 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-033f268c-e6d8-4a23-9ead-bf6a7bebbc57 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.213721 Oct 05 17:32:48.841682 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 194/377] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:32:48 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:49.084450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b60c4933-e7c7-4fd9-ac76-09f4a700cce5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:49.085236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b60c4933-e7c7-4fd9-ac76-09f4a700cce5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:49.094690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b60c4933-e7c7-4fd9-ac76-09f4a700cce5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:49.096151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b60c4933-e7c7-4fd9-ac76-09f4a700cce5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:49.096604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b60c4933-e7c7-4fd9-ac76-09f4a700cce5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:49.097362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b60c4933-e7c7-4fd9-ac76-09f4a700cce5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:49.097820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b60c4933-e7c7-4fd9-ac76-09f4a700cce5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:49.098268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b60c4933-e7c7-4fd9-ac76-09f4a700cce5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:49.111776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:49.114384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:49.121119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:49.121980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:49.122754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:49.124095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:49.124720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:49.125154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:49.216798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:49.226534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:49.228277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:49.237281 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88c5887a-0154-4112-91f1-b377e4603c88 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.131607 Oct 05 17:32:49.237868 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 195/378] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:49 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:32:49.243239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-417867050", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "46cd59dc-0f3c-4b1d-9c41-793bec981fb3"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:49.324640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] validate_networks() for [('46cd59dc-0f3c-4b1d-9c41-793bec981fb3', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:32:49.357233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b60c4933-e7c7-4fd9-ac76-09f4a700cce5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:49.367047 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b60c4933-e7c7-4fd9-ac76-09f4a700cce5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.301351 Oct 05 17:32:49.367578 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 184/379] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:49 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:49.785101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dd9ddeca-2040-47d3-98b7-6069922ffd3e tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-119305667", "ram": 512, "vcpus": 1, "disk": 10, "id": 1033980280, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:49.820119 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dd9ddeca-2040-47d3-98b7-6069922ffd3e tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.434347 Oct 05 17:32:49.824369 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 185/380] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:49 2022] POST /compute/v2.1/flavors => generated 415 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:49.943426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:32:49.943842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:32:49.944476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:32:49.945078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:32:49.945500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:32:49.955233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:49.955233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:49.955661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:49.956553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:49.957011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:49.957656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:49.979512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Getting quotas for project 9bdb0c8c021f481882fc6eda0ae41eb4. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:49.984949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Getting quotas for user f53bebb71deb4cd0a33f962302456404 and project 9bdb0c8c021f481882fc6eda0ae41eb4. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:49.999867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:32:50.004636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:32:50.063773 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-10244895-0e40-4a05-b2e0-09abfec4d59e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.823971 Oct 05 17:32:50.064422 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 196/381] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:32:50.077249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0a0221d1-5361-43df-8791-48787eaba0f5 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:50.121782 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0a0221d1-5361-43df-8791-48787eaba0f5 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1033980280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.055308 Oct 05 17:32:50.122948 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 197/382] 10.222.0.70 () {60 vars in 1224 bytes} [Wed Oct 5 17:32:50 2022] POST /compute/v2.1/flavors/1033980280/os-extra_specs => generated 66 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:50.133933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35a0645c-474f-4a42-912d-71e7ed6c3dcc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:50.137069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-35a0645c-474f-4a42-912d-71e7ed6c3dcc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:50.201128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-840431205", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": "none"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:50.279275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-35a0645c-474f-4a42-912d-71e7ed6c3dcc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:50.293300 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35a0645c-474f-4a42-912d-71e7ed6c3dcc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1215 microversion: 2.1 time: 0.168827 Oct 05 17:32:50.294523 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 198/383] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:50 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1215 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:50.332902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:32:50.333525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:32:50.334197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:32:50.335175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:32:50.336216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:32:50.347186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:50.347928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:50.348548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:50.349282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:50.349749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:50.350175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:50.395222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Getting quotas for project 9a375e05788045cf81f99be3b4c17ed7. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:50.408920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Getting quotas for user 570fc4032e2e4607ab3017364f22e8fe and project 9a375e05788045cf81f99be3b4c17ed7. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:50.440710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:32:50.444045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:32:50.567210 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-109afc58-ad62-4720-beb3-2fdbb0c8130e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.741243 Oct 05 17:32:50.580436 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 186/384] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:32:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:32:50.604069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:50.606091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:50.623765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:50.624081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:50.624515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:50.629305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:50.629807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:50.630252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:50.766994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:50.788572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:50.792861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:50.797290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-095d1c37-2e85-4880-af02-b422b5b40a3e tempest-FlavorsExtraSpecsTestJSON-513692623 tempest-FlavorsExtraSpecsTestJSON-513692623-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:50.801277 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-154519ef-c156-442d-92e7-92471b1538a4 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.219468 Oct 05 17:32:50.812458 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 187/385] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:50 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:50.814862 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-095d1c37-2e85-4880-af02-b422b5b40a3e tempest-FlavorsExtraSpecsTestJSON-513692623 tempest-FlavorsExtraSpecsTestJSON-513692623-project] 10.222.0.70 "GET /compute/v2.1/flavors/1033980280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.518652 Oct 05 17:32:50.822441 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 199/386] 10.222.0.70 () {58 vars in 1203 bytes} [Wed Oct 5 17:32:50 2022] GET /compute/v2.1/flavors/1033980280/os-extra_specs => generated 66 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:50.828353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0ae50e0-44c8-45e7-9fa4-c30347b354ce tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:50.837195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e0ae50e0-44c8-45e7-9fa4-c30347b354ce tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:50.847291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ae50e0-44c8-45e7-9fa4-c30347b354ce tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:50.847780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ae50e0-44c8-45e7-9fa4-c30347b354ce tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:50.848219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ae50e0-44c8-45e7-9fa4-c30347b354ce tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:50.848932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ae50e0-44c8-45e7-9fa4-c30347b354ce tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:50.849378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ae50e0-44c8-45e7-9fa4-c30347b354ce tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:50.850294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ae50e0-44c8-45e7-9fa4-c30347b354ce tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:51.000995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c37f8bad-74b3-4f3d-b1bf-eac1b4c17bf2 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Calling method '.version_select at 0x7f7775927160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.005139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37f8bad-74b3-4f3d-b1bf-eac1b4c17bf2 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:51.020228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37f8bad-74b3-4f3d-b1bf-eac1b4c17bf2 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:51.021013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37f8bad-74b3-4f3d-b1bf-eac1b4c17bf2 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:51.023501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37f8bad-74b3-4f3d-b1bf-eac1b4c17bf2 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:51.026152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37f8bad-74b3-4f3d-b1bf-eac1b4c17bf2 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:51.027408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37f8bad-74b3-4f3d-b1bf-eac1b4c17bf2 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:51.122642 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c37f8bad-74b3-4f3d-b1bf-eac1b4c17bf2 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.298956 Oct 05 17:32:51.125593 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 200/387] 10.222.0.70 () {58 vars in 1128 bytes} [Wed Oct 5 17:32:50 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:51.131864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce4f9eac-9d3c-41df-b23a-484eafaf374d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.137891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ce4f9eac-9d3c-41df-b23a-484eafaf374d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:51.146264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e0ae50e0-44c8-45e7-9fa4-c30347b354ce tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:51.156097 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e0ae50e0-44c8-45e7-9fa4-c30347b354ce tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.342229 Oct 05 17:32:51.170933 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 188/388] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:50 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:51.178273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f91c0279-4b36-45cc-aa98-01813cd9d521 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:51.276033 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f91c0279-4b36-45cc-aa98-01813cd9d521 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1033980280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.098176 Oct 05 17:32:51.286116 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 189/389] 10.222.0.70 () {60 vars in 1224 bytes} [Wed Oct 5 17:32:51 2022] POST /compute/v2.1/flavors/1033980280/os-extra_specs => generated 66 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:51.308808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ce4f9eac-9d3c-41df-b23a-484eafaf374d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:51.318096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ce4f9eac-9d3c-41df-b23a-484eafaf374d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:51.323153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ce4f9eac-9d3c-41df-b23a-484eafaf374d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:51.340054 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ce4f9eac-9d3c-41df-b23a-484eafaf374d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1452 microversion: 2.91 time: 0.209444 Oct 05 17:32:51.341670 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 201/390] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:51 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1452 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:51.364608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7becaae8-a5c4-4ee0-89ea-528dcb260dad tempest-FlavorsExtraSpecsTestJSON-513692623 tempest-FlavorsExtraSpecsTestJSON-513692623-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.389640 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7becaae8-a5c4-4ee0-89ea-528dcb260dad tempest-FlavorsExtraSpecsTestJSON-513692623 tempest-FlavorsExtraSpecsTestJSON-513692623-project] 10.222.0.70 "GET /compute/v2.1/flavors/1033980280/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.041091 Oct 05 17:32:51.390331 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 202/391] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:32:51 2022] GET /compute/v2.1/flavors/1033980280/os-extra_specs/hw:numa_nodes => generated 22 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:51.401472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12b5d17f-66fe-46ee-bc41-c3b4abc33199 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.404920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12b5d17f-66fe-46ee-bc41-c3b4abc33199 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:51.431195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12b5d17f-66fe-46ee-bc41-c3b4abc33199 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:51.432763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12b5d17f-66fe-46ee-bc41-c3b4abc33199 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:51.432763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12b5d17f-66fe-46ee-bc41-c3b4abc33199 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:51.432939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12b5d17f-66fe-46ee-bc41-c3b4abc33199 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:51.433411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12b5d17f-66fe-46ee-bc41-c3b4abc33199 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:51.433838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12b5d17f-66fe-46ee-bc41-c3b4abc33199 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:51.567289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-12b5d17f-66fe-46ee-bc41-c3b4abc33199 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:51.578919 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12b5d17f-66fe-46ee-bc41-c3b4abc33199 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1267 microversion: 2.1 time: 0.180125 Oct 05 17:32:51.578919 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 203/392] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:51 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:51.585728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7db09250-d1a4-4005-ad80-cbfdee545a3e tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:51.615658 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7db09250-d1a4-4005-ad80-cbfdee545a3e tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1033980280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035137 Oct 05 17:32:51.620333 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 204/393] 10.222.0.70 () {60 vars in 1224 bytes} [Wed Oct 5 17:32:51 2022] POST /compute/v2.1/flavors/1033980280/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:51.626913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b67537b-3887-47ff-8ab6-908672204df6 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.637707 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b67537b-3887-47ff-8ab6-908672204df6 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1033980280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015067 Oct 05 17:32:51.642493 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 205/394] 10.222.0.70 () {58 vars in 1203 bytes} [Wed Oct 5 17:32:51 2022] GET /compute/v2.1/flavors/1033980280/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:51.656356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a89d5bd0-21d2-4de3-9b54-428163ca22b7 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:51.701035 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a89d5bd0-21d2-4de3-9b54-428163ca22b7 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/1033980280/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.043544 Oct 05 17:32:51.701740 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 206/395] 10.222.0.70 () {60 vars in 1265 bytes} [Wed Oct 5 17:32:51 2022] PUT /compute/v2.1/flavors/1033980280/os-extra_specs/hw:numa_nodes => generated 22 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:51.712091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9d386a2-42c7-45a4-8d8e-3a43463c56b7 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.721232 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9d386a2-42c7-45a4-8d8e-3a43463c56b7 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1033980280/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.013310 Oct 05 17:32:51.722410 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 207/396] 10.222.0.70 () {58 vars in 1203 bytes} [Wed Oct 5 17:32:51 2022] GET /compute/v2.1/flavors/1033980280/os-extra_specs => generated 66 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:51.732343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f8eb2436-bebc-474a-95e6-18f996e5e546 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.809785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2add415a-927a-4a93-ba4c-32f3c82036cd tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Calling method '.version_select at 0x7f7775b96940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.817788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2add415a-927a-4a93-ba4c-32f3c82036cd tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '70ec838bba3b4a32b1a515828b96a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f651be2be68848088a446a37b11a929e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2add415a-927a-4a93-ba4c-32f3c82036cd tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Request method failure captured: Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_AWGlDY8hbVCgp6emWdmanr1HMYXgd2mKxSxoepC6EEixYRlkm9OcU24-aK_U_oAW0rykhTn27BGtNS9tFpVPftwqso4aY-kliINKOGcRDuVV19fpO1NLqjLG0JqpjV-JvyqxInWzlaPFlSlNcR3Z4TuRXlpUcWk6ybewbiycyMFU Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:51.827288 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f651be2be68848088a446a37b11a929e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f651be2be68848088a446a37b11a929e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}] Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 70ec838bba3b4a32b1a515828b96a0ef Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: action_args: {} Oct 05 17:32:51.828573 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:51.829331 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 05 17:32:51.831907 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:51.833468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2add415a-927a-4a93-ba4c-32f3c82036cd tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:51.833553 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f8eb2436-bebc-474a-95e6-18f996e5e546 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1033980280/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.100046 Oct 05 17:32:51.833644 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2add415a-927a-4a93-ba4c-32f3c82036cd tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.541107 Oct 05 17:32:51.833727 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 208/397] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:32:51 2022] DELETE /compute/v2.1/flavors/1033980280/os-extra_specs/hw:numa_nodes => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:51.842846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.843473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:51.845229 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 190/398] 10.222.0.70 () {58 vars in 1128 bytes} [Wed Oct 5 17:32:51 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 558 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:51.855224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:51.855720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:51.856042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a6a775f5-1675-4e75-b860-55673403d89e tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.856183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:51.856848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:51.858557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:51.859057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:51.914036 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a6a775f5-1675-4e75-b860-55673403d89e tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1033980280/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.067472 Oct 05 17:32:51.914923 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 191/399] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:32:51 2022] DELETE /compute/v2.1/flavors/1033980280/os-extra_specs/hw:cpu_policy => generated 0 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:32:51.927053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc9a61f0-03db-46c7-9898-e0f716cfdc29 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Calling method '.version_select at 0x7f7775bb84c0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.931522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fc9a61f0-03db-46c7-9898-e0f716cfdc29 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '70ec838bba3b4a32b1a515828b96a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f651be2be68848088a446a37b11a929e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc9a61f0-03db-46c7-9898-e0f716cfdc29 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Request method failure captured: Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-hosts/n-d-835595-3/reboot HTTP/1.1 Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_AWGlDY8hbVCgp6emWdmanr1HMYXgd2mKxSxoepC6EEixYRlkm9OcU24-aK_U_oAW0rykhTn27BGtNS9tFpVPftwqso4aY-kliINKOGcRDuVV19fpO1NLqjLG0JqpjV-JvyqxInWzlaPFlSlNcR3Z4TuRXlpUcWk6ybewbiycyMFU Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:51.933392 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f651be2be68848088a446a37b11a929e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f651be2be68848088a446a37b11a929e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}] Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 70ec838bba3b4a32b1a515828b96a0ef Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'n-d-835595-3'} Oct 05 17:32:51.934652 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:51.935370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 05 17:32:51.936840 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:51.937753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc9a61f0-03db-46c7-9898-e0f716cfdc29 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:51.937753 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fc9a61f0-03db-46c7-9898-e0f716cfdc29 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-835595-3/reboot" status: 403 len: 111 microversion: 2.1 time: 0.018864 Oct 05 17:32:51.937753 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 192/400] 10.222.0.70 () {58 vars in 1188 bytes} [Wed Oct 5 17:32:51 2022] GET /compute/v2.1/os-hosts/n-d-835595-3/reboot => generated 111 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:51.957596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1e2a8f9-cfba-4542-a3cf-adc1498f34e3 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:51.965282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:51.976979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:51.978928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:51.979773 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c1e2a8f9-cfba-4542-a3cf-adc1498f34e3 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1033980280/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.042398 Oct 05 17:32:51.980350 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 193/401] 10.222.0.70 () {58 vars in 1203 bytes} [Wed Oct 5 17:32:51 2022] GET /compute/v2.1/flavors/1033980280/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:52.001432 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8cc7b747-3f7e-40ee-972c-cdab4c3cd7e6 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.170273 Oct 05 17:32:52.002038 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 209/402] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:51 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:52.007513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79712aba-04cf-4be2-a740-1a88fb718acf tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Calling method '.version_select at 0x7f7775927280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.016570 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-79712aba-04cf-4be2-a740-1a88fb718acf tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79712aba-04cf-4be2-a740-1a88fb718acf tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Request method failure captured: Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_C9y96I9lC3lQqHiPp6bui6EpfkyiGXNRu1-0uuDVeghP547Ca3BNEq2IVpiT7GAi75wIkekPlSh0Wqalbf1d5MaKkXQzTQhxCooMDeuuRlRXBSfa4Go-vNRo2xO-3B0GOd6ZBcfK9c9fplRAQNwAvmLFYgm2vyQTkyoCm_WsCj8c Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:52.019252 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe46efa4020649e0b50947f475af9e1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}] Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9e76577acb0342b89244a58cde6c9ffe Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'nonexistent_hostname'} Oct 05 17:32:52.020590 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:52.021382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 05 17:32:52.022473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.023505 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.025115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79712aba-04cf-4be2-a740-1a88fb718acf tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:52.026322 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79712aba-04cf-4be2-a740-1a88fb718acf tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.022731 Oct 05 17:32:52.028661 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 210/403] 10.222.0.70 () {58 vars in 1212 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:52.034049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc83c9ac-e122-4e6e-a6a8-8ffe05fb95c5 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.047217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=5,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:52.065571 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc83c9ac-e122-4e6e-a6a8-8ffe05fb95c5 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1033980280" status: 202 len: 0 microversion: 2.1 time: 0.035424 Oct 05 17:32:52.066399 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 211/404] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:32:52 2022] DELETE /compute/v2.1/flavors/1033980280 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:52.073530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac54e237-601d-4498-9f8a-8f0b9c584b65 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Calling method '.version_select at 0x7f7775978d30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.080854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ac54e237-601d-4498-9f8a-8f0b9c584b65 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '70ec838bba3b4a32b1a515828b96a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f651be2be68848088a446a37b11a929e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac54e237-601d-4498-9f8a-8f0b9c584b65 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Request method failure captured: Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hosts/n-d-835595-3 HTTP/1.1 Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_AWGlDY8hbVCgp6emWdmanr1HMYXgd2mKxSxoepC6EEixYRlkm9OcU24-aK_U_oAW0rykhTn27BGtNS9tFpVPftwqso4aY-kliINKOGcRDuVV19fpO1NLqjLG0JqpjV-JvyqxInWzlaPFlSlNcR3Z4TuRXlpUcWk6ybewbiycyMFU Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:52.082991 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f651be2be68848088a446a37b11a929e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f651be2be68848088a446a37b11a929e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}] Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 70ec838bba3b4a32b1a515828b96a0ef Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'n-d-835595-3'} Oct 05 17:32:52.084330 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:52.085217 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 05 17:32:52.086521 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.088981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac54e237-601d-4498-9f8a-8f0b9c584b65 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:52.090072 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac54e237-601d-4498-9f8a-8f0b9c584b65 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-835595-3" status: 403 len: 109 microversion: 2.1 time: 0.022274 Oct 05 17:32:52.091514 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 212/405] 10.222.0.70 () {58 vars in 1167 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts/n-d-835595-3 => generated 109 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:52.096585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bbc45cd7-5944-4692-b33b-782a89dbba04 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.123869 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bbc45cd7-5944-4692-b33b-782a89dbba04 tempest-FlavorsExtraSpecsTestJSON-242817620 tempest-FlavorsExtraSpecsTestJSON-242817620-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.030763 Oct 05 17:32:52.138828 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 213/406] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:52.160800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a36fbce6-4848-4a32-9a97-317e78f94d07 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Calling method '.version_select at 0x7f7775ba3820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.193326 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-a36fbce6-4848-4a32-9a97-317e78f94d07 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a36fbce6-4848-4a32-9a97-317e78f94d07 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Request method failure captured: Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_C9y96I9lC3lQqHiPp6bui6EpfkyiGXNRu1-0uuDVeghP547Ca3BNEq2IVpiT7GAi75wIkekPlSh0Wqalbf1d5MaKkXQzTQhxCooMDeuuRlRXBSfa4Go-vNRo2xO-3B0GOd6ZBcfK9c9fplRAQNwAvmLFYgm2vyQTkyoCm_WsCj8c Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:52.200197 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe46efa4020649e0b50947f475af9e1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}] Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9e76577acb0342b89244a58cde6c9ffe Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'nonexistent_hostname'} Oct 05 17:32:52.201481 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.202214 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.203264 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.204305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a36fbce6-4848-4a32-9a97-317e78f94d07 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:52.206735 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a36fbce6-4848-4a32-9a97-317e78f94d07 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.066112 Oct 05 17:32:52.212196 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 214/407] 10.222.0.70 () {58 vars in 1191 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:52.224264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7c005e76-fccc-4ff4-8e20-e84afc2e0536 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.225038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7c005e76-fccc-4ff4-8e20-e84afc2e0536 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:52.247328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c005e76-fccc-4ff4-8e20-e84afc2e0536 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.247839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c005e76-fccc-4ff4-8e20-e84afc2e0536 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.248277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c005e76-fccc-4ff4-8e20-e84afc2e0536 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.249003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c005e76-fccc-4ff4-8e20-e84afc2e0536 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.249466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c005e76-fccc-4ff4-8e20-e84afc2e0536 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.249914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c005e76-fccc-4ff4-8e20-e84afc2e0536 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.297429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd472bc5-81ce-4940-9f7e-4c8f4f55f6d5 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Calling method '.version_select at 0x7f7775b96b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.300407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd472bc5-81ce-4940-9f7e-4c8f4f55f6d5 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.301271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd472bc5-81ce-4940-9f7e-4c8f4f55f6d5 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.307180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd472bc5-81ce-4940-9f7e-4c8f4f55f6d5 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.308216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd472bc5-81ce-4940-9f7e-4c8f4f55f6d5 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.309018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd472bc5-81ce-4940-9f7e-4c8f4f55f6d5 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.309637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd472bc5-81ce-4940-9f7e-4c8f4f55f6d5 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.361127 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bd472bc5-81ce-4940-9f7e-4c8f4f55f6d5 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.379708 Oct 05 17:32:52.362484 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 194/408] 10.222.0.70 () {58 vars in 1128 bytes} [Wed Oct 5 17:32:51 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:52.367901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53fc7538-2672-476d-8826-2e47c74b8df0 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Calling method '.version_select at 0x7f7775af1790>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.370422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-53fc7538-2672-476d-8826-2e47c74b8df0 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '70ec838bba3b4a32b1a515828b96a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f651be2be68848088a446a37b11a929e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53fc7538-2672-476d-8826-2e47c74b8df0 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Request method failure captured: Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-hosts/n-d-835595-3/shutdown HTTP/1.1 Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_AWGlDY8hbVCgp6emWdmanr1HMYXgd2mKxSxoepC6EEixYRlkm9OcU24-aK_U_oAW0rykhTn27BGtNS9tFpVPftwqso4aY-kliINKOGcRDuVV19fpO1NLqjLG0JqpjV-JvyqxInWzlaPFlSlNcR3Z4TuRXlpUcWk6ybewbiycyMFU Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:52.372715 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f651be2be68848088a446a37b11a929e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f651be2be68848088a446a37b11a929e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}] Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 70ec838bba3b4a32b1a515828b96a0ef Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'n-d-835595-3'} Oct 05 17:32:52.373937 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:52.374690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 05 17:32:52.375720 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.378179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53fc7538-2672-476d-8826-2e47c74b8df0 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:52.379452 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53fc7538-2672-476d-8826-2e47c74b8df0 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-835595-3/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.015742 Oct 05 17:32:52.380533 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 195/409] 10.222.0.70 () {58 vars in 1194 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts/n-d-835595-3/shutdown => generated 113 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:52.389061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.389944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:52.397387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.398272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.398982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.399887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.400597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.401210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.488861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:52.504548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:52.506122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:52.520028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e9989ca9-75b5-4d24-9027-2e56c79eb57b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1504 microversion: 2.91 time: 0.137784 Oct 05 17:32:52.521643 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 196/410] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1504 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:52.532472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7c005e76-fccc-4ff4-8e20-e84afc2e0536 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:52.554597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b92d5d1-dfee-4563-ac18-069f6f1c26f3 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Calling method '.version_select at 0x7f7775af1940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.558941 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7c005e76-fccc-4ff4-8e20-e84afc2e0536 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.344616 Oct 05 17:32:52.559707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b92d5d1-dfee-4563-ac18-069f6f1c26f3 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.560452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b92d5d1-dfee-4563-ac18-069f6f1c26f3 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.561077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b92d5d1-dfee-4563-ac18-069f6f1c26f3 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.562371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b92d5d1-dfee-4563-ac18-069f6f1c26f3 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.563522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b92d5d1-dfee-4563-ac18-069f6f1c26f3 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.564293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b92d5d1-dfee-4563-ac18-069f6f1c26f3 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.565555 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 215/411] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:52.597677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce270b55-021c-4379-a0b5-3f8f4e91aaad tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Calling method '.version_select at 0x7f7775ba3820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.603451 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0b92d5d1-dfee-4563-ac18-069f6f1c26f3 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.063895 Oct 05 17:32:52.604477 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 197/412] 10.222.0.70 () {58 vars in 1139 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:52.611034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ccde6980-91ae-4329-ae6a-93ddfcc6d002 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.612176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ccde6980-91ae-4329-ae6a-93ddfcc6d002 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:52.624103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccde6980-91ae-4329-ae6a-93ddfcc6d002 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.625426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccde6980-91ae-4329-ae6a-93ddfcc6d002 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.626255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccde6980-91ae-4329-ae6a-93ddfcc6d002 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.627705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccde6980-91ae-4329-ae6a-93ddfcc6d002 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.628533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccde6980-91ae-4329-ae6a-93ddfcc6d002 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.629368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccde6980-91ae-4329-ae6a-93ddfcc6d002 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.645246 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ce270b55-021c-4379-a0b5-3f8f4e91aaad tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce270b55-021c-4379-a0b5-3f8f4e91aaad tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Request method failure captured: Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_C9y96I9lC3lQqHiPp6bui6EpfkyiGXNRu1-0uuDVeghP547Ca3BNEq2IVpiT7GAi75wIkekPlSh0Wqalbf1d5MaKkXQzTQhxCooMDeuuRlRXBSfa4Go-vNRo2xO-3B0GOd6ZBcfK9c9fplRAQNwAvmLFYgm2vyQTkyoCm_WsCj8c Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:52.653381 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe46efa4020649e0b50947f475af9e1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}] Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9e76577acb0342b89244a58cde6c9ffe Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'nonexistent_hostname'} Oct 05 17:32:52.654715 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:52.655463 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 05 17:32:52.656546 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.657624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.660008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce270b55-021c-4379-a0b5-3f8f4e91aaad tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:52.665972 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ce270b55-021c-4379-a0b5-3f8f4e91aaad tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.079808 Oct 05 17:32:52.667148 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 216/413] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:52.682366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f42b4039-e501-4267-878a-abcc46fabf6f tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Calling method '.version_select at 0x7f77759270d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.693867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f42b4039-e501-4267-878a-abcc46fabf6f tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.695881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f42b4039-e501-4267-878a-abcc46fabf6f tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.696678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f42b4039-e501-4267-878a-abcc46fabf6f tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.699402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f42b4039-e501-4267-878a-abcc46fabf6f tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.700127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f42b4039-e501-4267-878a-abcc46fabf6f tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.702247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f42b4039-e501-4267-878a-abcc46fabf6f tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.760924 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f42b4039-e501-4267-878a-abcc46fabf6f tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.092408 Oct 05 17:32:52.773344 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 217/414] 10.222.0.70 () {58 vars in 1145 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:52.778399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3418287d-a9cd-4d26-b2a1-eb740e0d6cc4 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Calling method '.version_select at 0x7f7775b204c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.780690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3418287d-a9cd-4d26-b2a1-eb740e0d6cc4 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '70ec838bba3b4a32b1a515828b96a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f651be2be68848088a446a37b11a929e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3418287d-a9cd-4d26-b2a1-eb740e0d6cc4 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Request method failure captured: Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hosts/n-d-835595-3/startup HTTP/1.1 Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_AWGlDY8hbVCgp6emWdmanr1HMYXgd2mKxSxoepC6EEixYRlkm9OcU24-aK_U_oAW0rykhTn27BGtNS9tFpVPftwqso4aY-kliINKOGcRDuVV19fpO1NLqjLG0JqpjV-JvyqxInWzlaPFlSlNcR3Z4TuRXlpUcWk6ybewbiycyMFU Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:52.783263 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f651be2be68848088a446a37b11a929e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f651be2be68848088a446a37b11a929e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}] Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 70ec838bba3b4a32b1a515828b96a0ef Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'n-d-835595-3'} Oct 05 17:32:52.784844 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:52.785729 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 05 17:32:52.787492 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.788609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3418287d-a9cd-4d26-b2a1-eb740e0d6cc4 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:52.788609 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3418287d-a9cd-4d26-b2a1-eb740e0d6cc4 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-d-835595-3/startup" status: 403 len: 110 microversion: 2.1 time: 0.010405 Oct 05 17:32:52.789984 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 218/415] 10.222.0.70 () {58 vars in 1191 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts/n-d-835595-3/startup => generated 110 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:52.795835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76679482-4a24-4b74-a1bc-68e845eaab05 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Calling method '.version_select at 0x7f7775927ca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.799836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76679482-4a24-4b74-a1bc-68e845eaab05 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.800877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76679482-4a24-4b74-a1bc-68e845eaab05 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.801345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76679482-4a24-4b74-a1bc-68e845eaab05 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.802463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76679482-4a24-4b74-a1bc-68e845eaab05 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.802940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76679482-4a24-4b74-a1bc-68e845eaab05 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.803366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76679482-4a24-4b74-a1bc-68e845eaab05 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.838760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ccde6980-91ae-4329-ae6a-93ddfcc6d002 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:52.842406 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76679482-4a24-4b74-a1bc-68e845eaab05 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.051216 Oct 05 17:32:52.847855 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ccde6980-91ae-4329-ae6a-93ddfcc6d002 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1273 microversion: 2.1 time: 0.241615 Oct 05 17:32:52.848527 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 198/416] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1273 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:52.850127 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 219/417] 10.222.0.70 () {58 vars in 1128 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:52.855830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c67ce6f5-b491-4f1a-b012-aaa83721e73a tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Calling method '.version_select at 0x7f7775a26af0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.861881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c67ce6f5-b491-4f1a-b012-aaa83721e73a tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.862490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c67ce6f5-b491-4f1a-b012-aaa83721e73a tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.863118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c67ce6f5-b491-4f1a-b012-aaa83721e73a tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.864027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c67ce6f5-b491-4f1a-b012-aaa83721e73a tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.865037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c67ce6f5-b491-4f1a-b012-aaa83721e73a tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.865492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c67ce6f5-b491-4f1a-b012-aaa83721e73a tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.879304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b90bd0a-9421-4b00-bc46-1e9d17490810 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Calling method '.version_select at 0x7f7775b96940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.897684 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-7b90bd0a-9421-4b00-bc46-1e9d17490810 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b90bd0a-9421-4b00-bc46-1e9d17490810 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Request method failure captured: Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_C9y96I9lC3lQqHiPp6bui6EpfkyiGXNRu1-0uuDVeghP547Ca3BNEq2IVpiT7GAi75wIkekPlSh0Wqalbf1d5MaKkXQzTQhxCooMDeuuRlRXBSfa4Go-vNRo2xO-3B0GOd6ZBcfK9c9fplRAQNwAvmLFYgm2vyQTkyoCm_WsCj8c Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:52.902716 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe46efa4020649e0b50947f475af9e1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}] Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9e76577acb0342b89244a58cde6c9ffe Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'nonexistent_hostname'} Oct 05 17:32:52.904069 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:52.904763 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 05 17:32:52.905786 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.908112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b90bd0a-9421-4b00-bc46-1e9d17490810 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:52.909637 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7b90bd0a-9421-4b00-bc46-1e9d17490810 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.041181 Oct 05 17:32:52.909637 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 199/418] 10.222.0.70 () {58 vars in 1215 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:52.914258 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c67ce6f5-b491-4f1a-b012-aaa83721e73a tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.062935 Oct 05 17:32:52.915401 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 220/419] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:52.921057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55e06631-4f6f-47af-8392-94042de8afdf tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Action: 'update', calling method: .version_select at 0x7f7775aa71f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55e06631-4f6f-47af-8392-94042de8afdf tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Request method failure captured: Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: request: PUT /compute/v2.1/os-hosts/n-d-835595-3 HTTP/1.1 Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 51 Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_C9y96I9lC3lQqHiPp6bui6EpfkyiGXNRu1-0uuDVeghP547Ca3BNEq2IVpiT7GAi75wIkekPlSh0Wqalbf1d5MaKkXQzTQhxCooMDeuuRlRXBSfa4Go-vNRo2xO-3B0GOd6ZBcfK9c9fplRAQNwAvmLFYgm2vyQTkyoCm_WsCj8c Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:52.925305 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe46efa4020649e0b50947f475af9e1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}] Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9e76577acb0342b89244a58cde6c9ffe Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: {"status": "enable", "maintenance_mode": "invalid"} Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:52.926638 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'n-d-835595-3', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'disable', Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'Enable', Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'Disable', Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance: Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'invalid' Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.927416 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.928836 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.929887 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.929887 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:32:52.929887 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:32:52.929887 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 17:32:52.929887 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.929887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55e06631-4f6f-47af-8392-94042de8afdf tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:52.929887 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-55e06631-4f6f-47af-8392-94042de8afdf tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-835595-3" status: 400 len: 199 microversion: 2.1 time: 0.011427 Oct 05 17:32:52.933734 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 200/420] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:32:52 2022] PUT /compute/v2.1/os-hosts/n-d-835595-3 => generated 199 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:32:52.938804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dea74a65-e593-431f-90dc-65821c842c36 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Calling method '.version_select at 0x7f7777221040>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:52.942918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dea74a65-e593-431f-90dc-65821c842c36 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.943675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dea74a65-e593-431f-90dc-65821c842c36 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.944445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dea74a65-e593-431f-90dc-65821c842c36 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.945834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dea74a65-e593-431f-90dc-65821c842c36 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:52.946677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dea74a65-e593-431f-90dc-65821c842c36 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:52.947400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dea74a65-e593-431f-90dc-65821c842c36 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:52.955261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76eaee93-16d2-44fb-8990-83b867e0fd85 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Action: 'update', calling method: .version_select at 0x7f7775e871f0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76eaee93-16d2-44fb-8990-83b867e0fd85 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Request method failure captured: Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: request: PUT /compute/v2.1/os-hosts/n-d-835595-3 HTTP/1.1 Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 51 Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_C9y96I9lC3lQqHiPp6bui6EpfkyiGXNRu1-0uuDVeghP547Ca3BNEq2IVpiT7GAi75wIkekPlSh0Wqalbf1d5MaKkXQzTQhxCooMDeuuRlRXBSfa4Go-vNRo2xO-3B0GOd6ZBcfK9c9fplRAQNwAvmLFYgm2vyQTkyoCm_WsCj8c Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:52.962063 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe46efa4020649e0b50947f475af9e1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}] Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9e76577acb0342b89244a58cde6c9ffe Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: {"status": "invalid", "maintenance_mode": "enable"} Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:52.963470 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'n-d-835595-3', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'disable', Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'Enable', Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'Disable', Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance: Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'invalid' Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.964186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.965599 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.966708 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.966708 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:32:52.966708 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:32:52.966708 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 05 17:32:52.966708 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.966708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76eaee93-16d2-44fb-8990-83b867e0fd85 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:52.966708 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76eaee93-16d2-44fb-8990-83b867e0fd85 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-835595-3" status: 400 len: 189 microversion: 2.1 time: 0.017055 Oct 05 17:32:52.969789 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 201/421] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:32:52 2022] PUT /compute/v2.1/os-hosts/n-d-835595-3 => generated 189 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:32:52.976767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d6ed483-a898-4232-b5e5-2cd935ced744 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Action: 'update', calling method: .version_select at 0x7f7775aa7b80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:52.979997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d6ed483-a898-4232-b5e5-2cd935ced744 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '70ec838bba3b4a32b1a515828b96a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f651be2be68848088a446a37b11a929e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d6ed483-a898-4232-b5e5-2cd935ced744 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Request method failure captured: Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: request: PUT /compute/v2.1/os-hosts/n-d-835595-3 HTTP/1.1 Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 50 Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_AWGlDY8hbVCgp6emWdmanr1HMYXgd2mKxSxoepC6EEixYRlkm9OcU24-aK_U_oAW0rykhTn27BGtNS9tFpVPftwqso4aY-kliINKOGcRDuVV19fpO1NLqjLG0JqpjV-JvyqxInWzlaPFlSlNcR3Z4TuRXlpUcWk6ybewbiycyMFU Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:52.981587 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f651be2be68848088a446a37b11a929e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f651be2be68848088a446a37b11a929e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f651be2be68848088a446a37b11a929e"}]}] Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f651be2be68848088a446a37b11a929e Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-2033642092 Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 70ec838bba3b4a32b1a515828b96a0ef Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HostsAdminNegativeTestJSON-2033642092-project Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: {"status": "enable", "maintenance_mode": "enable"} Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 05 17:32:52.982806 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'n-d-835595-3', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:52.983901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 05 17:32:52.985367 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:52.987565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d6ed483-a898-4232-b5e5-2cd935ced744 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:52.989649 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6d6ed483-a898-4232-b5e5-2cd935ced744 tempest-HostsAdminNegativeTestJSON-2033642092 tempest-HostsAdminNegativeTestJSON-2033642092-project] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-835595-3" status: 403 len: 111 microversion: 2.1 time: 0.018706 Oct 05 17:32:52.991272 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 202/422] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:32:52 2022] PUT /compute/v2.1/os-hosts/n-d-835595-3 => generated 111 bytes in 20 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:53.000206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dea74a65-e593-431f-90dc-65821c842c36 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.076331 Oct 05 17:32:53.001375 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 221/423] 10.222.0.70 () {58 vars in 1128 bytes} [Wed Oct 5 17:32:52 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:53.003872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6f0a8294-9321-4a62-9786-74af8f362194 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Action: 'update', calling method: .version_select at 0x7f7775b70550>, body: {"status": null, "maintenance_mode": null} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:53.012647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-895b839a-3f8d-4f87-92af-f4135148a0e8 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Calling method '.version_select at 0x7f777596d040>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6f0a8294-9321-4a62-9786-74af8f362194 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Request method failure captured: Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: request: PUT /compute/v2.1/os-hosts/n-d-835595-3 HTTP/1.1 Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 42 Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_C9y96I9lC3lQqHiPp6bui6EpfkyiGXNRu1-0uuDVeghP547Ca3BNEq2IVpiT7GAi75wIkekPlSh0Wqalbf1d5MaKkXQzTQhxCooMDeuuRlRXBSfa4Go-vNRo2xO-3B0GOd6ZBcfK9c9fplRAQNwAvmLFYgm2vyQTkyoCm_WsCj8c Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:53.016513 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe46efa4020649e0b50947f475af9e1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}] Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9e76577acb0342b89244a58cde6c9ffe Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: {"status": null, "maintenance_mode": null} Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 05 17:32:53.017980 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'n-d-835595-3', 'body': {'status': None, 'maintenance_mode': None}} Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'disable', Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'Enable', Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'Disable', Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance: Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi None Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:53.018782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:53.020170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:53.022754 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:32:53.022754 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:32:53.022754 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 05 17:32:53.022754 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.022754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6f0a8294-9321-4a62-9786-74af8f362194 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:53.022754 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6f0a8294-9321-4a62-9786-74af8f362194 tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/n-d-835595-3" status: 400 len: 127 microversion: 2.1 time: 0.026192 Oct 05 17:32:53.023715 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 203/424] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:32:52 2022] PUT /compute/v2.1/os-hosts/n-d-835595-3 => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:32:53.031913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:53.032516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:53.033702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895b839a-3f8d-4f87-92af-f4135148a0e8 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.034208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895b839a-3f8d-4f87-92af-f4135148a0e8 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.034662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895b839a-3f8d-4f87-92af-f4135148a0e8 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.044528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.045013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.045439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.046139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.056052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.056541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.065233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895b839a-3f8d-4f87-92af-f4135148a0e8 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.065734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895b839a-3f8d-4f87-92af-f4135148a0e8 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.066189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895b839a-3f8d-4f87-92af-f4135148a0e8 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.110358 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-895b839a-3f8d-4f87-92af-f4135148a0e8 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-h2-835595-3" status: 200 len: 598 microversion: 2.1 time: 0.102501 Oct 05 17:32:53.114253 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 222/425] 10.222.0.70 () {58 vars in 1170 bytes} [Wed Oct 5 17:32:53 2022] GET /compute/v2.1/os-hosts/n-h2-835595-3 => generated 598 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:53.118788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bba060f7-9f2d-42dc-9f36-4a63e96ba10c tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Action: 'update', calling method: .version_select at 0x7f7775a26310>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:53.131001 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.hosts [None req-bba060f7-9f2d-42dc-9f36-4a63e96ba10c tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Enabling host nonexistent_hostname. Oct 05 17:32:53.156568 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-bba060f7-9f2d-42dc-9f36-4a63e96ba10c tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bba060f7-9f2d-42dc-9f36-4a63e96ba10c tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Request method failure captured: Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 50 Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_C9y96I9lC3lQqHiPp6bui6EpfkyiGXNRu1-0uuDVeghP547Ca3BNEq2IVpiT7GAi75wIkekPlSh0Wqalbf1d5MaKkXQzTQhxCooMDeuuRlRXBSfa4Go-vNRo2xO-3B0GOd6ZBcfK9c9fplRAQNwAvmLFYgm2vyQTkyoCm_WsCj8c Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:53.158639 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe46efa4020649e0b50947f475af9e1a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe46efa4020649e0b50947f475af9e1a"}]}] Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fe46efa4020649e0b50947f475af9e1a Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-571709125 Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9e76577acb0342b89244a58cde6c9ffe Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HostsAdminNegativeTestJSON-571709125-project-admin Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: {"status": "enable", "maintenance_mode": "enable"} Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:53.159811 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 05 17:32:53.160617 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:53.161589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:53.162753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bba060f7-9f2d-42dc-9f36-4a63e96ba10c tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:53.163574 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bba060f7-9f2d-42dc-9f36-4a63e96ba10c tempest-HostsAdminNegativeTestJSON-571709125 tempest-HostsAdminNegativeTestJSON-571709125-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.044963 Oct 05 17:32:53.163574 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 223/426] 10.222.0.70 () {60 vars in 1211 bytes} [Wed Oct 5 17:32:53 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:32:53.167018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c91f699e-97f7-4e6e-99cf-f007fe5806d1 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Calling method '.version_select at 0x7f7775978e50>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:53.185361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c91f699e-97f7-4e6e-99cf-f007fe5806d1 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.186045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c91f699e-97f7-4e6e-99cf-f007fe5806d1 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.186511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c91f699e-97f7-4e6e-99cf-f007fe5806d1 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.201180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:53.211367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:53.213830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c91f699e-97f7-4e6e-99cf-f007fe5806d1 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.214386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c91f699e-97f7-4e6e-99cf-f007fe5806d1 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.214820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c91f699e-97f7-4e6e-99cf-f007fe5806d1 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.216220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:53.231297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:53.245334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=4,nova_api:INSERT=4,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:53.249828 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c1e4f134-43df-4127-873e-b97c13c4f1e8 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.221654 Oct 05 17:32:53.266178 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 204/427] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:53 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:53.278013 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c91f699e-97f7-4e6e-99cf-f007fe5806d1 tempest-HostsAdminTestJSON-1099083732 tempest-HostsAdminTestJSON-1099083732-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hosts/n-h1-835595-3" status: 200 len: 729 microversion: 2.1 time: 0.111455 Oct 05 17:32:53.278913 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 224/428] 10.222.0.70 () {58 vars in 1170 bytes} [Wed Oct 5 17:32:53 2022] GET /compute/v2.1/os-hosts/n-h1-835595-3 => generated 729 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:53.556017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:53.556635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:53.574892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.575480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.576760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.579691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.581657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.582314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.614986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-371235ab-e774-4d4f-bc08-77d8416dc1ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:53.618184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-371235ab-e774-4d4f-bc08-77d8416dc1ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:53.629272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371235ab-e774-4d4f-bc08-77d8416dc1ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.629782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371235ab-e774-4d4f-bc08-77d8416dc1ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.630212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371235ab-e774-4d4f-bc08-77d8416dc1ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.630953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371235ab-e774-4d4f-bc08-77d8416dc1ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.631453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371235ab-e774-4d4f-bc08-77d8416dc1ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.631873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371235ab-e774-4d4f-bc08-77d8416dc1ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.655533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:32:53.751304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:53.763374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:53.765191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:53.771257 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48f97a0a-03f7-4dbf-b1d2-c9f999d71167 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1510 microversion: 2.91 time: 0.219093 Oct 05 17:32:53.772440 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 205/429] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:53 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1510 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:53.874828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7354aa50-0e83-4a71-8998-7640f75c4ddc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:53.876038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7354aa50-0e83-4a71-8998-7640f75c4ddc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:53.882653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7354aa50-0e83-4a71-8998-7640f75c4ddc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.883193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7354aa50-0e83-4a71-8998-7640f75c4ddc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.883955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7354aa50-0e83-4a71-8998-7640f75c4ddc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.884820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7354aa50-0e83-4a71-8998-7640f75c4ddc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:53.885546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7354aa50-0e83-4a71-8998-7640f75c4ddc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:53.886119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7354aa50-0e83-4a71-8998-7640f75c4ddc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:53.934971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-371235ab-e774-4d4f-bc08-77d8416dc1ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:53.944776 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-371235ab-e774-4d4f-bc08-77d8416dc1ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.343203 Oct 05 17:32:53.945565 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 225/430] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:53 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:54.250862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7354aa50-0e83-4a71-8998-7640f75c4ddc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:54.260001 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7354aa50-0e83-4a71-8998-7640f75c4ddc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1315 microversion: 2.1 time: 0.389444 Oct 05 17:32:54.260606 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 206/431] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:53 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:54.279113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:54.279784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:54.287513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:54.288264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:54.288927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:54.290030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:54.290749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:54.291370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:54.390315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:54.399930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:54.401606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:54.407306 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a43eacbf-9b66-416f-afe8-52a1cd895328 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.132404 Oct 05 17:32:54.408475 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 226/432] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:54 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:54.802461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:54.803105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:54.811228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:54.811879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:54.812562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:54.813668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:54.814414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:54.815259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:54.923266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:54.938383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:54.946407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:54.956674 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c9593410-b0a3-48a3-90f7-b7a0b405c5e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1510 microversion: 2.91 time: 0.158821 Oct 05 17:32:54.957702 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 207/433] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:54 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:54.972853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d5e2800-5d7b-4f41-a015-b7176b680a45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:54.973582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9d5e2800-5d7b-4f41-a015-b7176b680a45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:54.983902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5e2800-5d7b-4f41-a015-b7176b680a45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:54.984544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5e2800-5d7b-4f41-a015-b7176b680a45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:54.984847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5e2800-5d7b-4f41-a015-b7176b680a45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:54.985584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5e2800-5d7b-4f41-a015-b7176b680a45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:54.986041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5e2800-5d7b-4f41-a015-b7176b680a45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:54.991477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5e2800-5d7b-4f41-a015-b7176b680a45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:55.262625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9d5e2800-5d7b-4f41-a015-b7176b680a45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:55.274547 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9d5e2800-5d7b-4f41-a015-b7176b680a45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.306497 Oct 05 17:32:55.286005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9ca24eed-8c1d-4706-92fd-3a66a9897b2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:55.286954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9ca24eed-8c1d-4706-92fd-3a66a9897b2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:55.296877 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 227/434] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:54 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:55.298180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca24eed-8c1d-4706-92fd-3a66a9897b2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:55.300005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca24eed-8c1d-4706-92fd-3a66a9897b2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:55.300781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca24eed-8c1d-4706-92fd-3a66a9897b2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:55.302886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca24eed-8c1d-4706-92fd-3a66a9897b2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:55.303364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca24eed-8c1d-4706-92fd-3a66a9897b2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:55.306955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca24eed-8c1d-4706-92fd-3a66a9897b2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:55.451869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:55.455969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:55.468583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:55.471517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:55.472184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:55.472975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:55.473542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:55.474425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:55.578479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:55.604359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:55.607875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9ca24eed-8c1d-4706-92fd-3a66a9897b2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:55.609219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:55.619680 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9ca24eed-8c1d-4706-92fd-3a66a9897b2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1315 microversion: 2.1 time: 0.338379 Oct 05 17:32:55.620262 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 208/435] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:55 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:55.626657 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-23b73ce7-f4e2-4b11-89bf-36e8e2f4d582 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.192451 Oct 05 17:32:55.630336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-380b9cdb-5720-4b76-8ccb-941268e13628 req-e043e21f-65ed-49cb-a683-59a9f80cf614 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2326b784-d0b7-455c-8a14-0d28dc57d0bd", "tag": "32488405-5d93-4136-b35d-8aeeae91d166"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:55.640971 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 228/436] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:55 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:55.663465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-380b9cdb-5720-4b76-8ccb-941268e13628 req-e043e21f-65ed-49cb-a683-59a9f80cf614 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:55.664417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-380b9cdb-5720-4b76-8ccb-941268e13628 req-e043e21f-65ed-49cb-a683-59a9f80cf614 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:55.665035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-380b9cdb-5720-4b76-8ccb-941268e13628 req-e043e21f-65ed-49cb-a683-59a9f80cf614 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:55.682151 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-380b9cdb-5720-4b76-8ccb-941268e13628 req-e043e21f-65ed-49cb-a683-59a9f80cf614 service nova] Creating event network-changed:32488405-5d93-4136-b35d-8aeeae91d166 for instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd on n-h1-835595-3 Oct 05 17:32:55.689321 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-380b9cdb-5720-4b76-8ccb-941268e13628 req-e043e21f-65ed-49cb-a683-59a9f80cf614 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067911 Oct 05 17:32:55.691718 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 209/437] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:32:55.994186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:55.995105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:56.008839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.010754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.011978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.019883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.021094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.021958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.130349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:56.139751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:56.141192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:56.146721 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-36d5ff8d-f5f8-4aa9-b508-8cc4c3699ef5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1531 microversion: 2.91 time: 0.163406 Oct 05 17:32:56.147711 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 229/438] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:55 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1531 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:56.303936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9b85a54d-f9a9-46b6-af3d-36b6b0d76b3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:56.304541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9b85a54d-f9a9-46b6-af3d-36b6b0d76b3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:56.311445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b85a54d-f9a9-46b6-af3d-36b6b0d76b3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.312171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b85a54d-f9a9-46b6-af3d-36b6b0d76b3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.312670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b85a54d-f9a9-46b6-af3d-36b6b0d76b3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.313383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b85a54d-f9a9-46b6-af3d-36b6b0d76b3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.313922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b85a54d-f9a9-46b6-af3d-36b6b0d76b3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.314383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b85a54d-f9a9-46b6-af3d-36b6b0d76b3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.467153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9b85a54d-f9a9-46b6-af3d-36b6b0d76b3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:56.475574 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9b85a54d-f9a9-46b6-af3d-36b6b0d76b3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.175556 Oct 05 17:32:56.488957 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 230/439] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:56 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:56.569317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-49d2fb16-c27b-4c92-8cc2-599d9f8430e6 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:56.570154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-49d2fb16-c27b-4c92-8cc2-599d9f8430e6 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:56.576451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d2fb16-c27b-4c92-8cc2-599d9f8430e6 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.577109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d2fb16-c27b-4c92-8cc2-599d9f8430e6 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.577700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d2fb16-c27b-4c92-8cc2-599d9f8430e6 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.578414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d2fb16-c27b-4c92-8cc2-599d9f8430e6 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.578864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d2fb16-c27b-4c92-8cc2-599d9f8430e6 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.579278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d2fb16-c27b-4c92-8cc2-599d9f8430e6 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.645468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9faf786b-9919-4360-96de-bdb14517d4ec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:56.646345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9faf786b-9919-4360-96de-bdb14517d4ec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:56.656753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9faf786b-9919-4360-96de-bdb14517d4ec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.657462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9faf786b-9919-4360-96de-bdb14517d4ec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.658076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9faf786b-9919-4360-96de-bdb14517d4ec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.659198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9faf786b-9919-4360-96de-bdb14517d4ec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.659804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9faf786b-9919-4360-96de-bdb14517d4ec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.660377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9faf786b-9919-4360-96de-bdb14517d4ec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.705967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-49d2fb16-c27b-4c92-8cc2-599d9f8430e6 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lazy-loading 'services' on Instance uuid bd2347ec-34bb-4815-8968-2c92099344c1 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:32:56.768254 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-49d2fb16-c27b-4c92-8cc2-599d9f8430e6 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1936 microversion: 2.91 time: 0.591118 Oct 05 17:32:56.769507 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 210/440] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:56 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1936 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:56.774661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:56.776090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:56.782310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.782874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.783303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.784019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.784632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.785053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.836234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9faf786b-9919-4360-96de-bdb14517d4ec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:56.859837 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9faf786b-9919-4360-96de-bdb14517d4ec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1315 microversion: 2.1 time: 0.218334 Oct 05 17:32:56.881245 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 231/441] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:56 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:56.886394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bfc3b404-2974-47da-966d-08011f093c8f tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:56.887201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bfc3b404-2974-47da-966d-08011f093c8f tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:56.893755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfc3b404-2974-47da-966d-08011f093c8f tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.894562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfc3b404-2974-47da-966d-08011f093c8f tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.895342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfc3b404-2974-47da-966d-08011f093c8f tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.897163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfc3b404-2974-47da-966d-08011f093c8f tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:56.897859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfc3b404-2974-47da-966d-08011f093c8f tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:56.898635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfc3b404-2974-47da-966d-08011f093c8f tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:56.912518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:56.921526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:56.929955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:56.935941 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ae819d9d-202b-4b4e-979e-c7414396668c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.165281 Oct 05 17:32:56.936928 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 211/442] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:56 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:57.037403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-bfc3b404-2974-47da-966d-08011f093c8f tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lazy-loading 'services' on Instance uuid bd2347ec-34bb-4815-8968-2c92099344c1 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:32:57.101382 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bfc3b404-2974-47da-966d-08011f093c8f tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1936 microversion: 2.91 time: 0.218847 Oct 05 17:32:57.102010 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 232/443] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:56 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1936 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:57.130740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1a240ed-ada0-4043-bc4c-619fb432c608 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:57.134600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1a240ed-ada0-4043-bc4c-619fb432c608 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:57.135117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1a240ed-ada0-4043-bc4c-619fb432c608 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:57.135576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1a240ed-ada0-4043-bc4c-619fb432c608 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:57.136302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1a240ed-ada0-4043-bc4c-619fb432c608 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:57.136748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1a240ed-ada0-4043-bc4c-619fb432c608 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:57.137162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1a240ed-ada0-4043-bc4c-619fb432c608 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:57.167532 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c1a240ed-ada0-4043-bc4c-619fb432c608 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.040821 Oct 05 17:32:57.168443 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 212/444] 10.222.0.70 () {60 vars in 1217 bytes} [Wed Oct 5 17:32:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:32:57.181745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-566c957a-8e09-461a-9b9a-7c04f41eb8a8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:57.182338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-566c957a-8e09-461a-9b9a-7c04f41eb8a8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:57.189096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-566c957a-8e09-461a-9b9a-7c04f41eb8a8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:57.189581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-566c957a-8e09-461a-9b9a-7c04f41eb8a8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:57.190324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-566c957a-8e09-461a-9b9a-7c04f41eb8a8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:57.191182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-566c957a-8e09-461a-9b9a-7c04f41eb8a8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:57.191827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-566c957a-8e09-461a-9b9a-7c04f41eb8a8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:57.192436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-566c957a-8e09-461a-9b9a-7c04f41eb8a8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:57.265760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-566c957a-8e09-461a-9b9a-7c04f41eb8a8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lazy-loading 'flavor' on Instance uuid bd2347ec-34bb-4815-8968-2c92099344c1 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:32:57.567687 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-566c957a-8e09-461a-9b9a-7c04f41eb8a8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "POST /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1/action" status: 202 len: 0 microversion: 2.91 time: 0.389787 Oct 05 17:32:57.569533 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 233/445] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:32:57 2022] POST /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:32:57.580427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eae8926e-aaad-4dfe-a88d-a180f7b19054 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:57.581293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eae8926e-aaad-4dfe-a88d-a180f7b19054 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:57.588923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eae8926e-aaad-4dfe-a88d-a180f7b19054 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:57.589622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eae8926e-aaad-4dfe-a88d-a180f7b19054 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:57.590325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eae8926e-aaad-4dfe-a88d-a180f7b19054 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:57.591274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eae8926e-aaad-4dfe-a88d-a180f7b19054 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:57.592175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eae8926e-aaad-4dfe-a88d-a180f7b19054 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:57.592744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eae8926e-aaad-4dfe-a88d-a180f7b19054 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:57.603644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ce9319aa-10ab-46f3-b2ca-809d96b3e34f tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-882987734", "ram": 512, "vcpus": 1, "disk": 10, "id": 833874829, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:57.644405 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ce9319aa-10ab-46f3-b2ca-809d96b3e34f tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.313211 Oct 05 17:32:57.647757 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 213/446] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:57 2022] POST /compute/v2.1/flavors => generated 412 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:32:57.661647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:57.662518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:57.675577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:57.678626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:57.679304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:57.690791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:57.694066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:57.694066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:57.793520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eae8926e-aaad-4dfe-a88d-a180f7b19054 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:57.803115 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eae8926e-aaad-4dfe-a88d-a180f7b19054 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.227366 Oct 05 17:32:57.804240 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 234/447] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:57 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:57.804914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:57.819763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:57.821164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:57.830776 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f858de40-d88d-4210-9a97-80b89535cd77 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.179780 Oct 05 17:32:57.831716 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 214/448] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:57 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:57.888414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ae60620-7673-47bd-ae9e-2a2542cd6902 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:57.889027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7ae60620-7673-47bd-ae9e-2a2542cd6902 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:57.896095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ae60620-7673-47bd-ae9e-2a2542cd6902 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:57.896609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ae60620-7673-47bd-ae9e-2a2542cd6902 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:57.897204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ae60620-7673-47bd-ae9e-2a2542cd6902 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:57.898668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ae60620-7673-47bd-ae9e-2a2542cd6902 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:57.899279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ae60620-7673-47bd-ae9e-2a2542cd6902 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:57.899855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ae60620-7673-47bd-ae9e-2a2542cd6902 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:58.005038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-904612b5-a381-4a0d-9b5d-3785c04d398f tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:58.015265 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-904612b5-a381-4a0d-9b5d-3785c04d398f tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] HTTP exception thrown: Flavor 833874829 has no extra specs with key hw:cpu_thread_policy. Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-904612b5-a381-4a0d-9b5d-3785c04d398f tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Request method failure captured: Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/flavors/833874829/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_IuhpJvTK8CN-4pYa72epePvp2vBvdIjoL4NFSA6JKRGLLN9recYa7xLYyICl9hqfz9gp4XaO0cKmA3x4u3U6X8ucHrTa2Cl24qvwEJ5-UGlssOERaApahltKdAaVWO_wS7d4yXyx5OTT1A7zQR1BgnauMgh229qm9n_4HEDS-NAI Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9d50653f38a6468fa9e98edafa1dd45d Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:58.016981 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d50653f38a6468fa9e98edafa1dd45d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d50653f38a6468fa9e98edafa1dd45d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d50653f38a6468fa9e98edafa1dd45d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d50653f38a6468fa9e98edafa1dd45d"}]}] Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9d50653f38a6468fa9e98edafa1dd45d Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6ad9fe7d09b842fe8a70b732e0acb7d9 Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:58.018341 n-d-835595-3 devstack@n-api.service[128844]: exception: Flavor 833874829 has no extra specs with key hw:cpu_thread_policy. Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'flavor_id': '833874829', 'id': 'hw:cpu_thread_policy'} Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 833874829 has no extra specs with key hw:cpu_thread_policy. Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:58.019052 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.020328 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.020328 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.020328 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.020328 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:58.020328 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:58.020328 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 833874829 has no extra specs with key hw:cpu_thread_policy. Oct 05 17:32:58.020328 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.020328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-904612b5-a381-4a0d-9b5d-3785c04d398f tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Returning 404 to user: Flavor 833874829 has no extra specs with key hw:cpu_thread_policy. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:58.020328 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-904612b5-a381-4a0d-9b5d-3785c04d398f tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] 10.222.0.70 "GET /compute/v2.1/flavors/833874829/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.212724 Oct 05 17:32:58.020328 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 235/449] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:32:57 2022] GET /compute/v2.1/flavors/833874829/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 214 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:58.026157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:58.026843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:58.037262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:58.037773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:58.038189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:58.038957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:58.039637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:58.040058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:58.085902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7ae60620-7673-47bd-ae9e-2a2542cd6902 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:58.098007 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ae60620-7673-47bd-ae9e-2a2542cd6902 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1315 microversion: 2.1 time: 0.213500 Oct 05 17:32:58.109126 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 215/450] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:57 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:58.115689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:58.121011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aba6ed6c-0686-476a-aee2-005a95bef5d2 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:58.125635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aba6ed6c-0686-476a-aee2-005a95bef5d2 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '6ad9fe7d09b842fe8a70b732e0acb7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d50653f38a6468fa9e98edafa1dd45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:58.125800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:58.127708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aba6ed6c-0686-476a-aee2-005a95bef5d2 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Request method failure captured: Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/flavors/833874829/os-extra_specs HTTP/1.1 Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 66 Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_IuhpJvTK8CN-4pYa72epePvp2vBvdIjoL4NFSA6JKRGLLN9recYa7xLYyICl9hqfz9gp4XaO0cKmA3x4u3U6X8ucHrTa2Cl24qvwEJ5-UGlssOERaApahltKdAaVWO_wS7d4yXyx5OTT1A7zQR1BgnauMgh229qm9n_4HEDS-NAI Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 9d50653f38a6468fa9e98edafa1dd45d Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:32:58.128365 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d50653f38a6468fa9e98edafa1dd45d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d50653f38a6468fa9e98edafa1dd45d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d50653f38a6468fa9e98edafa1dd45d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d50653f38a6468fa9e98edafa1dd45d"}]}] Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 9d50653f38a6468fa9e98edafa1dd45d Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6ad9fe7d09b842fe8a70b732e0acb7d9 Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 05 17:32:58.129730 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'flavor_id': '833874829', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:58.130465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 05 17:32:58.131837 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.132908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aba6ed6c-0686-476a-aee2-005a95bef5d2 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:58.132908 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aba6ed6c-0686-476a-aee2-005a95bef5d2 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] 10.222.0.70 "POST /compute/v2.1/flavors/833874829/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.019665 Oct 05 17:32:58.132908 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 216/451] 10.222.0.70 () {60 vars in 1221 bytes} [Wed Oct 5 17:32:58 2022] POST /compute/v2.1/flavors/833874829/os-extra_specs => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:58.136384 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a286e669-3632-4864-9427-55206ae09181 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.115807 Oct 05 17:32:58.137271 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 236/452] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:58 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:58.140752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a2f76688-9f3a-4120-a9e3-6a07e57787e3 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:58.175767 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a2f76688-9f3a-4120-a9e3-6a07e57787e3 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/833874829/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039466 Oct 05 17:32:58.176915 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 217/453] 10.222.0.70 () {60 vars in 1221 bytes} [Wed Oct 5 17:32:58 2022] POST /compute/v2.1/flavors/833874829/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:58.186668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-298bcbdd-e028-44b0-9460-3df99d600b01 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:58.188486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-298bcbdd-e028-44b0-9460-3df99d600b01 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '6ad9fe7d09b842fe8a70b732e0acb7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d50653f38a6468fa9e98edafa1dd45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-298bcbdd-e028-44b0-9460-3df99d600b01 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Request method failure captured: Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_IuhpJvTK8CN-4pYa72epePvp2vBvdIjoL4NFSA6JKRGLLN9recYa7xLYyICl9hqfz9gp4XaO0cKmA3x4u3U6X8ucHrTa2Cl24qvwEJ5-UGlssOERaApahltKdAaVWO_wS7d4yXyx5OTT1A7zQR1BgnauMgh229qm9n_4HEDS-NAI Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9d50653f38a6468fa9e98edafa1dd45d Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:58.190365 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d50653f38a6468fa9e98edafa1dd45d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d50653f38a6468fa9e98edafa1dd45d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d50653f38a6468fa9e98edafa1dd45d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d50653f38a6468fa9e98edafa1dd45d"}]}] Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9d50653f38a6468fa9e98edafa1dd45d Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6ad9fe7d09b842fe8a70b732e0acb7d9 Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:58.191739 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'flavor_id': '833874829', 'id': 'hw:numa_nodes'} Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:58.192373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 05 17:32:58.193456 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.195824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-298bcbdd-e028-44b0-9460-3df99d600b01 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:58.196858 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-298bcbdd-e028-44b0-9460-3df99d600b01 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] 10.222.0.70 "DELETE /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.014361 Oct 05 17:32:58.203720 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 237/454] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:32:58 2022] DELETE /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes => generated 124 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:58.209523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-650c8336-e8fc-4fd0-98de-75c6ffe4b8a0 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:58.237310 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-650c8336-e8fc-4fd0-98de-75c6ffe4b8a0 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/833874829/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031302 Oct 05 17:32:58.237963 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 218/455] 10.222.0.70 () {60 vars in 1221 bytes} [Wed Oct 5 17:32:58 2022] POST /compute/v2.1/flavors/833874829/os-extra_specs => generated 66 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:32:58.249152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ee35ab0-2051-472d-83c2-0550712cc9bb tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:58.253634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5ee35ab0-2051-472d-83c2-0550712cc9bb tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '6ad9fe7d09b842fe8a70b732e0acb7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d50653f38a6468fa9e98edafa1dd45d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ee35ab0-2051-472d-83c2-0550712cc9bb tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Request method failure captured: Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 22 Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_IuhpJvTK8CN-4pYa72epePvp2vBvdIjoL4NFSA6JKRGLLN9recYa7xLYyICl9hqfz9gp4XaO0cKmA3x4u3U6X8ucHrTa2Cl24qvwEJ5-UGlssOERaApahltKdAaVWO_wS7d4yXyx5OTT1A7zQR1BgnauMgh229qm9n_4HEDS-NAI Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9d50653f38a6468fa9e98edafa1dd45d Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:32:58.255767 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9d50653f38a6468fa9e98edafa1dd45d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d50653f38a6468fa9e98edafa1dd45d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9d50653f38a6468fa9e98edafa1dd45d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9d50653f38a6468fa9e98edafa1dd45d"}]}] Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9d50653f38a6468fa9e98edafa1dd45d Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6ad9fe7d09b842fe8a70b732e0acb7d9 Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: {"hw:numa_nodes": "1"} Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:58.257023 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'flavor_id': '833874829', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:32:58.258618 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 05 17:32:58.259678 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.263408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ee35ab0-2051-472d-83c2-0550712cc9bb tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:58.264550 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ee35ab0-2051-472d-83c2-0550712cc9bb tempest-FlavorsExtraSpecsNegativeTestJSON-433179954 tempest-FlavorsExtraSpecsNegativeTestJSON-433179954-project] 10.222.0.70 "PUT /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020370 Oct 05 17:32:58.270694 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 238/456] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:32:58 2022] PUT /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes => generated 124 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:32:58.280205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c2abd21-d481-41e6-ad59-d10998b0a966 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:58.288669 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-3c2abd21-d481-41e6-ad59-d10998b0a966 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] HTTP exception thrown: Flavor 833874829 has no extra specs with key hw:cpu_thread_policy. Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c2abd21-d481-41e6-ad59-d10998b0a966 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Request method failure captured: Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/flavors/833874829/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_JfLWjmnSXV2s6zPmIWd_KVGeILydru9KGZciA3vQ0ysSmquID1nH1u76s-cY5K2-2sOD_AeS8w7TexrNJ8py9kIIjWnA41l9Dedcaipb9-ok03Ptn0Wd9MqllpWk39wos24NcnJl4Sf2NKKsHb1lo7N7rSOnu8NHB0CXqQaYhxIA Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 923c65fa892a436ca70703a86e27c4b5 Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:58.290190 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/923c65fa892a436ca70703a86e27c4b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/923c65fa892a436ca70703a86e27c4b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_923c65fa892a436ca70703a86e27c4b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/923c65fa892a436ca70703a86e27c4b5"}]}] Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 923c65fa892a436ca70703a86e27c4b5 Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 657fe28a84e348b1b72870bff4433467 Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:58.291485 n-d-835595-3 devstack@n-api.service[128843]: exception: Flavor 833874829 has no extra specs with key hw:cpu_thread_policy. Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'flavor_id': '833874829', 'id': 'hw:cpu_thread_policy'} Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 833874829 has no extra specs with key hw:cpu_thread_policy. Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:58.292136 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.293390 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.293390 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.293390 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.293390 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:58.293390 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:58.293390 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 833874829 has no extra specs with key hw:cpu_thread_policy. Oct 05 17:32:58.293390 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.293390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c2abd21-d481-41e6-ad59-d10998b0a966 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Returning 404 to user: Flavor 833874829 has no extra specs with key hw:cpu_thread_policy. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:58.293390 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c2abd21-d481-41e6-ad59-d10998b0a966 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/833874829/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.019797 Oct 05 17:32:58.297221 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 219/457] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:32:58 2022] DELETE /compute/v2.1/flavors/833874829/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:32:58.304702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec290f18-7186-42ad-8712-a3311151fa55 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:58.309138 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ec290f18-7186-42ad-8712-a3311151fa55 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec290f18-7186-42ad-8712-a3311151fa55 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Request method failure captured: Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 27 Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_JfLWjmnSXV2s6zPmIWd_KVGeILydru9KGZciA3vQ0ysSmquID1nH1u76s-cY5K2-2sOD_AeS8w7TexrNJ8py9kIIjWnA41l9Dedcaipb9-ok03Ptn0Wd9MqllpWk39wos24NcnJl4Sf2NKKsHb1lo7N7rSOnu8NHB0CXqQaYhxIA Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 923c65fa892a436ca70703a86e27c4b5 Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:32:58.310946 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/923c65fa892a436ca70703a86e27c4b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/923c65fa892a436ca70703a86e27c4b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_923c65fa892a436ca70703a86e27c4b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/923c65fa892a436ca70703a86e27c4b5"}]}] Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 923c65fa892a436ca70703a86e27c4b5 Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 657fe28a84e348b1b72870bff4433467 Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: {"hw:cpu_policy": "shared"} Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:32:58.312296 n-d-835595-3 devstack@n-api.service[128844]: exception: Request body and URI mismatch Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'flavor_id': '833874829', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.313020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.314116 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:32:58.314116 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:32:58.314116 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 05 17:32:58.314116 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.315605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec290f18-7186-42ad-8712-a3311151fa55 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:58.322571 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ec290f18-7186-42ad-8712-a3311151fa55 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.020924 Oct 05 17:32:58.322571 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 239/458] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:32:58 2022] PUT /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes => generated 73 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:32:58.330089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6128f07-f88f-4aea-a96b-320450400aee tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6128f07-f88f-4aea-a96b-320450400aee tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Request method failure captured: Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: request: PUT /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 49 Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_JfLWjmnSXV2s6zPmIWd_KVGeILydru9KGZciA3vQ0ysSmquID1nH1u76s-cY5K2-2sOD_AeS8w7TexrNJ8py9kIIjWnA41l9Dedcaipb9-ok03Ptn0Wd9MqllpWk39wos24NcnJl4Sf2NKKsHb1lo7N7rSOnu8NHB0CXqQaYhxIA Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 923c65fa892a436ca70703a86e27c4b5 Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:32:58.335274 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/923c65fa892a436ca70703a86e27c4b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/923c65fa892a436ca70703a86e27c4b5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_923c65fa892a436ca70703a86e27c4b5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/923c65fa892a436ca70703a86e27c4b5"}]}] Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 923c65fa892a436ca70703a86e27c4b5 Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 657fe28a84e348b1b72870bff4433467 Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 05 17:32:58.336918 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'flavor_id': '833874829', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance: Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 05 17:32:58.337782 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.339397 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:32:58.340744 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:32:58.340744 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:32:58.340744 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:32:58.340744 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:32:58.340744 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 05 17:32:58.340744 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:32:58.340744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6128f07-f88f-4aea-a96b-320450400aee tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:32:58.340744 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c6128f07-f88f-4aea-a96b-320450400aee tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] 10.222.0.70 "PUT /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.011862 Oct 05 17:32:58.341633 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 220/459] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:32:58 2022] PUT /compute/v2.1/flavors/833874829/os-extra_specs/hw:numa_nodes => generated 117 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:32:58.348279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c67179ba-4a40-45f1-a2cb-64ed7d1dbc3b tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:58.368656 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c67179ba-4a40-45f1-a2cb-64ed7d1dbc3b tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/833874829" status: 202 len: 0 microversion: 2.1 time: 0.024811 Oct 05 17:32:58.370339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 240/460] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:32:58 2022] DELETE /compute/v2.1/flavors/833874829 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:32:58.377882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-430eecec-daf7-4df6-a9ad-82110e28d5d7 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:58.400750 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-430eecec-daf7-4df6-a9ad-82110e28d5d7 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186 tempest-FlavorsExtraSpecsNegativeTestJSON-624311186-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5819 microversion: 2.1 time: 0.026915 Oct 05 17:32:58.401319 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 221/461] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:32:58 2022] GET /compute/v2.1/flavors/detail => generated 5819 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:32:58.829830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a4119e1f-d43e-4059-8442-46e5e01f5e8d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:58.830486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a4119e1f-d43e-4059-8442-46e5e01f5e8d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:58.840107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4119e1f-d43e-4059-8442-46e5e01f5e8d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:58.840599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4119e1f-d43e-4059-8442-46e5e01f5e8d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:58.841029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4119e1f-d43e-4059-8442-46e5e01f5e8d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:58.847450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4119e1f-d43e-4059-8442-46e5e01f5e8d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:58.848826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4119e1f-d43e-4059-8442-46e5e01f5e8d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:58.849631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4119e1f-d43e-4059-8442-46e5e01f5e8d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:58.987683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2050643590", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:32:59.002734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a4119e1f-d43e-4059-8442-46e5e01f5e8d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:59.014706 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a4119e1f-d43e-4059-8442-46e5e01f5e8d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.190080 Oct 05 17:32:59.015724 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 222/462] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:58 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:59.024570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:59.025409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:59.045660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:59.047998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:59.048658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:59.049717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:59.050932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:59.054099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:59.054230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:32:59.128788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:59.137750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:59.139482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:59.144682 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f050219f-7755-4bcf-b837-34b6a82499a0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.126517 Oct 05 17:32:59.145638 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 223/463] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:59 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:59.150421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-197c9e44-c98f-4930-8986-bc85baaa8981 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:59.151272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-197c9e44-c98f-4930-8986-bc85baaa8981 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:59.170785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197c9e44-c98f-4930-8986-bc85baaa8981 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:59.171672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197c9e44-c98f-4930-8986-bc85baaa8981 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:59.172782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197c9e44-c98f-4930-8986-bc85baaa8981 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:59.173739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197c9e44-c98f-4930-8986-bc85baaa8981 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:59.174347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197c9e44-c98f-4930-8986-bc85baaa8981 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:59.174937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197c9e44-c98f-4930-8986-bc85baaa8981 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:59.325369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-197c9e44-c98f-4930-8986-bc85baaa8981 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:59.335212 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-197c9e44-c98f-4930-8986-bc85baaa8981 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1315 microversion: 2.1 time: 0.188241 Oct 05 17:32:59.335801 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 224/464] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:59 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:32:59.348393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:59.348393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:59.348393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:59.348393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:59.348808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:59.349736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:59.350406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:59.351014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:59.432499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:59.441767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:59.443240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:59.449381 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-584ec0bb-aba7-451e-8528-8496124a104c tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.112529 Oct 05 17:32:59.450306 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 225/465] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:32:59 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:32:59.629855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:32:59.630824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:32:59.631543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:32:59.632475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:32:59.633082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:32:59.649827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:59.650526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:59.651118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:59.651842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:32:59.652289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:32:59.652707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:32:59.674612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Getting quotas for project 411f6ccee8514f6a8f54cd913f958cee. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:32:59.679549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Getting quotas for user 6a0d71e683ff47aa968e4334e5999077 and project 411f6ccee8514f6a8f54cd913f958cee. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:32:59.693084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:32:59.697137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:32:59.816992 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f84e237e-088f-4dbf-bf5f-4e1dbbf59235 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.180926 Oct 05 17:32:59.834926 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 241/466] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:32:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:32:59.835154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d64a03e-829c-4500-b88e-a9abf9027df9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:32:59.835768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4d64a03e-829c-4500-b88e-a9abf9027df9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:32:59.919494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4d64a03e-829c-4500-b88e-a9abf9027df9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:32:59.932263 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4d64a03e-829c-4500-b88e-a9abf9027df9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1222 microversion: 2.1 time: 0.106734 Oct 05 17:32:59.938505 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 226/467] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:32:59 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1222 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:00.040347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c929335b-8e6b-4f18-aeda-96b96b3f1878 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:00.041713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c929335b-8e6b-4f18-aeda-96b96b3f1878 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:00.050464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c929335b-8e6b-4f18-aeda-96b96b3f1878 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:00.050961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c929335b-8e6b-4f18-aeda-96b96b3f1878 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:00.051395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c929335b-8e6b-4f18-aeda-96b96b3f1878 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:00.052100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c929335b-8e6b-4f18-aeda-96b96b3f1878 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:00.059819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c929335b-8e6b-4f18-aeda-96b96b3f1878 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:00.060437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c929335b-8e6b-4f18-aeda-96b96b3f1878 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:00.178644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:00.179689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:00.186772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:00.188311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:00.189015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:00.190256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:00.191103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:00.191728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:00.284261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:00.327596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:00.329482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:00.337462 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-050bb74f-0cbd-4002-b7c8-c570d89041f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.164770 Oct 05 17:33:00.338929 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 227/468] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:00 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:00.365841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a7489b47-4ed9-4a22-a292-85d08602bf95 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:00.366728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a7489b47-4ed9-4a22-a292-85d08602bf95 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:00.381034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7489b47-4ed9-4a22-a292-85d08602bf95 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:00.382158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7489b47-4ed9-4a22-a292-85d08602bf95 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:00.383666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7489b47-4ed9-4a22-a292-85d08602bf95 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:00.384942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7489b47-4ed9-4a22-a292-85d08602bf95 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:00.385639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7489b47-4ed9-4a22-a292-85d08602bf95 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:00.386356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7489b47-4ed9-4a22-a292-85d08602bf95 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:00.411209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c929335b-8e6b-4f18-aeda-96b96b3f1878 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:00.422177 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c929335b-8e6b-4f18-aeda-96b96b3f1878 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.385608 Oct 05 17:33:00.440989 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 242/469] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:00 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:00.478474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:00.479301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:00.489616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:00.493240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:00.496380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:00.497397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:00.500185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:00.500722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:00.501165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:00.684321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:00.693783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:00.696162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:00.706369 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1cf4bfb7-05d2-4290-b2be-aa472f524d16 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.233007 Oct 05 17:33:00.710219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a7489b47-4ed9-4a22-a292-85d08602bf95 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:00.725684 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 243/470] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:00 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:00.733732 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a7489b47-4ed9-4a22-a292-85d08602bf95 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1315 microversion: 2.1 time: 0.373910 Oct 05 17:33:00.734413 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 228/471] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:00 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1315 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:00.960647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f91a4f1b-d18c-4e47-8b48-cac5af486897 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:00.961941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f91a4f1b-d18c-4e47-8b48-cac5af486897 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:00.973906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a4f1b-d18c-4e47-8b48-cac5af486897 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:00.976104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a4f1b-d18c-4e47-8b48-cac5af486897 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:00.978005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a4f1b-d18c-4e47-8b48-cac5af486897 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:00.980043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a4f1b-d18c-4e47-8b48-cac5af486897 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:00.983406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a4f1b-d18c-4e47-8b48-cac5af486897 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:00.985326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a4f1b-d18c-4e47-8b48-cac5af486897 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:01.091327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f91a4f1b-d18c-4e47-8b48-cac5af486897 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:01.111574 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f91a4f1b-d18c-4e47-8b48-cac5af486897 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1226 microversion: 2.1 time: 0.155912 Oct 05 17:33:01.113308 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 244/472] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:00 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1226 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:01.373614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:01.374236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:01.381055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:01.381905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:01.382693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:01.383595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:01.386322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:01.387600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:01.447641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1f230cb1-878b-4665-9077-99ee6c7eb8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:01.449410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1f230cb1-878b-4665-9077-99ee6c7eb8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:01.457961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f230cb1-878b-4665-9077-99ee6c7eb8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:01.465528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f230cb1-878b-4665-9077-99ee6c7eb8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:01.466461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f230cb1-878b-4665-9077-99ee6c7eb8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:01.467554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f230cb1-878b-4665-9077-99ee6c7eb8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:01.468215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f230cb1-878b-4665-9077-99ee6c7eb8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:01.468965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f230cb1-878b-4665-9077-99ee6c7eb8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:01.480850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:01.493145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:01.512975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:01.515459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:01.531074 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2993e7ea-1bfc-4a4d-9f1c-a3d84e23865e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.161814 Oct 05 17:33:01.534790 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 229/473] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:01 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:01.696395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1f230cb1-878b-4665-9077-99ee6c7eb8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:01.705636 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1f230cb1-878b-4665-9077-99ee6c7eb8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1476 microversion: 2.1 time: 0.261761 Oct 05 17:33:01.706827 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 245/474] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:01 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:01.742661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:01.743754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:01.762726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e49afe30-d88e-4084-85d0-518c080eb2e6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:01.763675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e49afe30-d88e-4084-85d0-518c080eb2e6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:01.764242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:01.764765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:01.765265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:01.767012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:01.768128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:01.768554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:01.773405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e49afe30-d88e-4084-85d0-518c080eb2e6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:01.774388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e49afe30-d88e-4084-85d0-518c080eb2e6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:01.779642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e49afe30-d88e-4084-85d0-518c080eb2e6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:01.780728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e49afe30-d88e-4084-85d0-518c080eb2e6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:01.782164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e49afe30-d88e-4084-85d0-518c080eb2e6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:01.783091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e49afe30-d88e-4084-85d0-518c080eb2e6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:01.802092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:01.869441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:01.888741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:01.892182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:01.914153 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8d36e473-71ed-4778-8399-7f04dd90bd31 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.175104 Oct 05 17:33:01.924547 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 230/475] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:01 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:02.032423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e49afe30-d88e-4084-85d0-518c080eb2e6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:02.042266 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e49afe30-d88e-4084-85d0-518c080eb2e6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1315 microversion: 2.1 time: 0.288210 Oct 05 17:33:02.058845 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 246/476] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:01 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:02.138383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c97483f4-3cf8-4736-9070-d21c2b58fae8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:02.139399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c97483f4-3cf8-4736-9070-d21c2b58fae8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:02.151438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c97483f4-3cf8-4736-9070-d21c2b58fae8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:02.153336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c97483f4-3cf8-4736-9070-d21c2b58fae8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:02.154616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c97483f4-3cf8-4736-9070-d21c2b58fae8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:02.157104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c97483f4-3cf8-4736-9070-d21c2b58fae8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:02.158989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c97483f4-3cf8-4736-9070-d21c2b58fae8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:02.160907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c97483f4-3cf8-4736-9070-d21c2b58fae8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:02.267274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4e2a0799-498b-4627-86f2-fb8d9c70aa17 req-59e2598f-6269-4d68-8158-d51fe76af1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2326b784-d0b7-455c-8a14-0d28dc57d0bd", "name": "network-vif-plugged", "status": "completed", "tag": "32488405-5d93-4136-b35d-8aeeae91d166"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:02.290535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4e2a0799-498b-4627-86f2-fb8d9c70aa17 req-59e2598f-6269-4d68-8158-d51fe76af1fd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:02.291044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4e2a0799-498b-4627-86f2-fb8d9c70aa17 req-59e2598f-6269-4d68-8158-d51fe76af1fd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:02.291668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4e2a0799-498b-4627-86f2-fb8d9c70aa17 req-59e2598f-6269-4d68-8158-d51fe76af1fd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:02.311181 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4e2a0799-498b-4627-86f2-fb8d9c70aa17 req-59e2598f-6269-4d68-8158-d51fe76af1fd service nova] Creating event network-vif-plugged:32488405-5d93-4136-b35d-8aeeae91d166 for instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd on n-h1-835595-3 Oct 05 17:33:02.320895 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4e2a0799-498b-4627-86f2-fb8d9c70aa17 req-59e2598f-6269-4d68-8158-d51fe76af1fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061011 Oct 05 17:33:02.325574 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 247/477] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:02.343514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c97483f4-3cf8-4736-9070-d21c2b58fae8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:02.355199 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c97483f4-3cf8-4736-9070-d21c2b58fae8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1274 microversion: 2.1 time: 0.223544 Oct 05 17:33:02.362470 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 231/478] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:02 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1274 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:02.567218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:02.568528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:02.578655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:02.579470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:02.580387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:02.581501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:02.582370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:02.583165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:02.683088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:02.701485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:02.703994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:02.717858 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-68efe59e-9d0b-453b-9a08-0f951bd7f569 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.158489 Oct 05 17:33:02.718672 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 248/479] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:02 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:02.729329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dbedcbbf-555b-44dc-b743-d1284fe7a1e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:02.729797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dbedcbbf-555b-44dc-b743-d1284fe7a1e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:02.736911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbedcbbf-555b-44dc-b743-d1284fe7a1e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:02.737610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbedcbbf-555b-44dc-b743-d1284fe7a1e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:02.738195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbedcbbf-555b-44dc-b743-d1284fe7a1e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:02.739082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbedcbbf-555b-44dc-b743-d1284fe7a1e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:02.739694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbedcbbf-555b-44dc-b743-d1284fe7a1e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:02.740482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbedcbbf-555b-44dc-b743-d1284fe7a1e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:02.952142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:02.952748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:02.960214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:02.960712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:02.961154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:02.961855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:02.962321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:02.962747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:03.159168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:03.182346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:03.184266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:03.202395 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2550a731-c8e2-4734-8473-35eeab8ae264 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.253964 Oct 05 17:33:03.203684 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 249/480] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:02 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:03.208655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c593fa5-c7f3-41a3-908d-d0e779374004 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:03.211343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5c593fa5-c7f3-41a3-908d-d0e779374004 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:03.224660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c593fa5-c7f3-41a3-908d-d0e779374004 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:03.225988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c593fa5-c7f3-41a3-908d-d0e779374004 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:03.226643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c593fa5-c7f3-41a3-908d-d0e779374004 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:03.227581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c593fa5-c7f3-41a3-908d-d0e779374004 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:03.228052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c593fa5-c7f3-41a3-908d-d0e779374004 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:03.228481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c593fa5-c7f3-41a3-908d-d0e779374004 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:03.433301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dbedcbbf-555b-44dc-b743-d1284fe7a1e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:03.445376 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dbedcbbf-555b-44dc-b743-d1284fe7a1e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1475 microversion: 2.1 time: 0.719169 Oct 05 17:33:03.449191 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 232/481] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:02 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1475 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:03.463359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5c593fa5-c7f3-41a3-908d-d0e779374004 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:03.480981 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c593fa5-c7f3-41a3-908d-d0e779374004 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1315 microversion: 2.1 time: 0.275481 Oct 05 17:33:03.481589 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 250/482] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:03 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:03.494784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5473b59-1ee6-4f73-bc73-0cc6e638b559 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:03.494784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5473b59-1ee6-4f73-bc73-0cc6e638b559 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:03.502957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5473b59-1ee6-4f73-bc73-0cc6e638b559 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:03.503638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5473b59-1ee6-4f73-bc73-0cc6e638b559 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:03.505498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5473b59-1ee6-4f73-bc73-0cc6e638b559 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:03.508192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5473b59-1ee6-4f73-bc73-0cc6e638b559 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:03.508708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5473b59-1ee6-4f73-bc73-0cc6e638b559 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:03.509140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5473b59-1ee6-4f73-bc73-0cc6e638b559 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:03.678618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5473b59-1ee6-4f73-bc73-0cc6e638b559 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:03.680249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1686914558", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:03.690492 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5473b59-1ee6-4f73-bc73-0cc6e638b559 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1280 microversion: 2.1 time: 0.207601 Oct 05 17:33:03.691087 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 251/483] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:03 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1280 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:03.749372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:03.749995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:03.761753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:03.762089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:03.765397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:03.766267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:03.768182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:03.769359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:03.821671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:33:03.890918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:03.903052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:03.904745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:03.916458 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9edec72e-717a-438b-86c6-9d77bbec3c35 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.172484 Oct 05 17:33:03.923525 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 252/484] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:03 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:03.956738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5ab76fa3-5d33-47ea-8f4a-ab60b12a2cf4 req-b1f3a981-cb8a-4d41-8c18-89000219559d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d6f375-344a-4460-a8bd-dc5e9c7af8e6", "name": "network-vif-unplugged", "status": "completed", "tag": "16de15df-aa59-4811-a979-bf656b358834"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:03.975864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ab76fa3-5d33-47ea-8f4a-ab60b12a2cf4 req-b1f3a981-cb8a-4d41-8c18-89000219559d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:03.976693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ab76fa3-5d33-47ea-8f4a-ab60b12a2cf4 req-b1f3a981-cb8a-4d41-8c18-89000219559d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:03.977288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ab76fa3-5d33-47ea-8f4a-ab60b12a2cf4 req-b1f3a981-cb8a-4d41-8c18-89000219559d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:03.996079 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5ab76fa3-5d33-47ea-8f4a-ab60b12a2cf4 req-b1f3a981-cb8a-4d41-8c18-89000219559d service nova] Creating event network-vif-unplugged:16de15df-aa59-4811-a979-bf656b358834 for instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 on n-h1-835595-3 Oct 05 17:33:04.033755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-5ab76fa3-5d33-47ea-8f4a-ab60b12a2cf4 req-b1f3a981-cb8a-4d41-8c18-89000219559d service nova] Instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:33:04.070227 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5ab76fa3-5d33-47ea-8f4a-ab60b12a2cf4 req-b1f3a981-cb8a-4d41-8c18-89000219559d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144386 Oct 05 17:33:04.071276 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 253/485] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:04.235144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:04.235948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:04.248741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:04.252089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:04.252677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:04.260852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:04.261669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:04.262261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:04.383342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:33:04.383903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:33:04.384387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:33:04.384799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:33:04.386365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:33:04.399389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:04.408690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:04.409734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:04.413745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:04.418851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:04.419740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:04.423050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:04.423378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:04.427518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:04.428997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:04.443582 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ccf95ebf-147e-4c9c-8544-b1d918c149a1 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.217469 Oct 05 17:33:04.448363 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 254/486] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:04 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:04.462399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Getting quotas for project 78997afe35c142c486d6079e462c5ddf. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:33:04.468129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Getting quotas for user b2af401d63f24d9a9cb58c54602768f7 and project 78997afe35c142c486d6079e462c5ddf. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:33:04.478242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f801cab-05ef-4236-ac1b-10f8ef432d65 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:04.478885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6f801cab-05ef-4236-ac1b-10f8ef432d65 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:04.489957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f801cab-05ef-4236-ac1b-10f8ef432d65 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:04.490792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f801cab-05ef-4236-ac1b-10f8ef432d65 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:04.492149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f801cab-05ef-4236-ac1b-10f8ef432d65 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:04.495714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f801cab-05ef-4236-ac1b-10f8ef432d65 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:04.496937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f801cab-05ef-4236-ac1b-10f8ef432d65 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:04.497752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f801cab-05ef-4236-ac1b-10f8ef432d65 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:04.506849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:33:04.513450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:33:04.614131 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8fa704f9-9b9c-4809-aec8-22633d41c358 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.159969 Oct 05 17:33:04.615085 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 233/487] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:33:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:33:04.629239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d3acfa4d-bae1-426d-b86c-43c77d546747 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:04.630034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d3acfa4d-bae1-426d-b86c-43c77d546747 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:04.644407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3acfa4d-bae1-426d-b86c-43c77d546747 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:04.645265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3acfa4d-bae1-426d-b86c-43c77d546747 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:04.645856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3acfa4d-bae1-426d-b86c-43c77d546747 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:04.647182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3acfa4d-bae1-426d-b86c-43c77d546747 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:04.647801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3acfa4d-bae1-426d-b86c-43c77d546747 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:04.648593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3acfa4d-bae1-426d-b86c-43c77d546747 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:04.893192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6f801cab-05ef-4236-ac1b-10f8ef432d65 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:04.904468 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6f801cab-05ef-4236-ac1b-10f8ef432d65 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1475 microversion: 2.1 time: 0.430059 Oct 05 17:33:04.907020 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 255/488] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:04 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1475 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:04.912677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e1dd0257-6b9c-45ca-b36f-4ce569cd66d7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:04.913853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e1dd0257-6b9c-45ca-b36f-4ce569cd66d7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:04.984738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e1dd0257-6b9c-45ca-b36f-4ce569cd66d7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:04.994448 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e1dd0257-6b9c-45ca-b36f-4ce569cd66d7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1219 microversion: 2.1 time: 0.085982 Oct 05 17:33:04.996376 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 256/489] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:04 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:05.001766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-80d066dd-3b3b-4ef0-b89b-cc20fbca785b tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:05.004596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-80d066dd-3b3b-4ef0-b89b-cc20fbca785b tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:05.011497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80d066dd-3b3b-4ef0-b89b-cc20fbca785b tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:05.012230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80d066dd-3b3b-4ef0-b89b-cc20fbca785b tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:05.012977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80d066dd-3b3b-4ef0-b89b-cc20fbca785b tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:05.013764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80d066dd-3b3b-4ef0-b89b-cc20fbca785b tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:05.014327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80d066dd-3b3b-4ef0-b89b-cc20fbca785b tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:05.014733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80d066dd-3b3b-4ef0-b89b-cc20fbca785b tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:05.101466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d3acfa4d-bae1-426d-b86c-43c77d546747 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:05.122887 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d3acfa4d-bae1-426d-b86c-43c77d546747 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1503 microversion: 2.1 time: 0.498846 Oct 05 17:33:05.124310 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 234/490] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:04 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1503 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:05.139459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:05.141057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:05.153262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:05.154472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:05.156597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:05.157779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:05.159816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:05.162371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:05.243704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-80d066dd-3b3b-4ef0-b89b-cc20fbca785b tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:05.255205 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-80d066dd-3b3b-4ef0-b89b-cc20fbca785b tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1322 microversion: 2.1 time: 0.257377 Oct 05 17:33:05.257410 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 257/491] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:04 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:05.267992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-861e4dce-03af-4a0e-9b4c-789609f4aeec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-692727329"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:05.275129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-861e4dce-03af-4a0e-9b4c-789609f4aeec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:05.282074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861e4dce-03af-4a0e-9b4c-789609f4aeec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:05.285349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861e4dce-03af-4a0e-9b4c-789609f4aeec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:05.286878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861e4dce-03af-4a0e-9b4c-789609f4aeec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:05.289514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861e4dce-03af-4a0e-9b4c-789609f4aeec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:05.291527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861e4dce-03af-4a0e-9b4c-789609f4aeec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:05.292112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861e4dce-03af-4a0e-9b4c-789609f4aeec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:05.456841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:05.491683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:05.495845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:05.506641 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d9fa5f48-7f01-4c50-8310-e22529c34e05 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.379574 Oct 05 17:33:05.511181 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 235/492] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:05 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:05.522868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:05.523994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:05.535023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:05.542014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:05.542577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:05.543342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:05.545880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:05.546408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:05.676115 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.network.security_group_api [None req-861e4dce-03af-4a0e-9b4c-789609f4aeec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Adding security group 97cb6d8b-e6b1-4ab9-8655-4d49400c5c5c to port 32488405-5d93-4136-b35d-8aeeae91d166 Oct 05 17:33:05.741812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:05.756516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:05.762336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:05.777264 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b76093e3-3e12-4b96-9cab-ef5438f07109 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.264417 Oct 05 17:33:05.779353 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 236/493] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:05 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:05.927844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c3fd0df6-04f6-479d-b067-9674483e73a4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:05.931398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3fd0df6-04f6-479d-b067-9674483e73a4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:05.941743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3fd0df6-04f6-479d-b067-9674483e73a4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:05.948870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3fd0df6-04f6-479d-b067-9674483e73a4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:05.949694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3fd0df6-04f6-479d-b067-9674483e73a4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:05.950937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3fd0df6-04f6-479d-b067-9674483e73a4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:05.951790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3fd0df6-04f6-479d-b067-9674483e73a4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:05.952321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3fd0df6-04f6-479d-b067-9674483e73a4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:06.221362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c3fd0df6-04f6-479d-b067-9674483e73a4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:06.232558 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c3fd0df6-04f6-479d-b067-9674483e73a4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1475 microversion: 2.1 time: 0.308800 Oct 05 17:33:06.233459 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 237/494] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:05 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1475 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:06.248509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-0f0f6a1f-004e-4494-acfd-eb33f6d51cc6 req-afd72666-58bc-49b4-90bd-5cac884ed3bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07ea7e2-f9cd-493e-82f9-15deae371911", "tag": "285f5185-4e97-4744-b230-1804227341e6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:06.269100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0f0f6a1f-004e-4494-acfd-eb33f6d51cc6 req-afd72666-58bc-49b4-90bd-5cac884ed3bc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:06.273652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0f0f6a1f-004e-4494-acfd-eb33f6d51cc6 req-afd72666-58bc-49b4-90bd-5cac884ed3bc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:06.276075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0f0f6a1f-004e-4494-acfd-eb33f6d51cc6 req-afd72666-58bc-49b4-90bd-5cac884ed3bc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:06.300438 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-0f0f6a1f-004e-4494-acfd-eb33f6d51cc6 req-afd72666-58bc-49b4-90bd-5cac884ed3bc service nova] Creating event network-changed:285f5185-4e97-4744-b230-1804227341e6 for instance d07ea7e2-f9cd-493e-82f9-15deae371911 on n-h2-835595-3 Oct 05 17:33:06.310763 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-0f0f6a1f-004e-4494-acfd-eb33f6d51cc6 req-afd72666-58bc-49b4-90bd-5cac884ed3bc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074073 Oct 05 17:33:06.312449 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 238/495] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:06.314016 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-861e4dce-03af-4a0e-9b4c-789609f4aeec tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd/action" status: 202 len: 0 microversion: 2.1 time: 1.055495 Oct 05 17:33:06.317848 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 258/496] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:05 2022] POST /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd/action => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:33:06.320767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8266994d-a1c9-4a9d-bd35-10c15a860fe5 req-2b725f44-f2e0-4639-81a6-310e64dd591c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d6f375-344a-4460-a8bd-dc5e9c7af8e6", "tag": "16de15df-aa59-4811-a979-bf656b358834"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:06.329034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ffe9158f-896c-40c6-863f-9161b91d3778 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:06.331502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ffe9158f-896c-40c6-863f-9161b91d3778 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:06.340855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8266994d-a1c9-4a9d-bd35-10c15a860fe5 req-2b725f44-f2e0-4639-81a6-310e64dd591c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:06.341316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8266994d-a1c9-4a9d-bd35-10c15a860fe5 req-2b725f44-f2e0-4639-81a6-310e64dd591c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:06.344270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe9158f-896c-40c6-863f-9161b91d3778 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:06.344934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe9158f-896c-40c6-863f-9161b91d3778 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:06.345544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe9158f-896c-40c6-863f-9161b91d3778 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:06.346500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe9158f-896c-40c6-863f-9161b91d3778 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:06.346619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8266994d-a1c9-4a9d-bd35-10c15a860fe5 req-2b725f44-f2e0-4639-81a6-310e64dd591c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:06.347204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe9158f-896c-40c6-863f-9161b91d3778 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:06.347796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe9158f-896c-40c6-863f-9161b91d3778 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:06.385251 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8266994d-a1c9-4a9d-bd35-10c15a860fe5 req-2b725f44-f2e0-4639-81a6-310e64dd591c service nova] Creating event network-changed:16de15df-aa59-4811-a979-bf656b358834 for instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 on n-h1-835595-3 Oct 05 17:33:06.392480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-8266994d-a1c9-4a9d-bd35-10c15a860fe5 req-2b725f44-f2e0-4639-81a6-310e64dd591c service nova] Instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:33:06.405353 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8266994d-a1c9-4a9d-bd35-10c15a860fe5 req-2b725f44-f2e0-4639-81a6-310e64dd591c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088863 Oct 05 17:33:06.406848 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 259/497] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:06.425996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c95c261-ce01-4485-95f3-5fb3fade449f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:06.427683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6c95c261-ce01-4485-95f3-5fb3fade449f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:06.437407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c95c261-ce01-4485-95f3-5fb3fade449f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:06.438473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c95c261-ce01-4485-95f3-5fb3fade449f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:06.439240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c95c261-ce01-4485-95f3-5fb3fade449f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:06.440673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c95c261-ce01-4485-95f3-5fb3fade449f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:06.441284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c95c261-ce01-4485-95f3-5fb3fade449f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:06.441909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c95c261-ce01-4485-95f3-5fb3fade449f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:06.812502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6c95c261-ce01-4485-95f3-5fb3fade449f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:06.831720 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6c95c261-ce01-4485-95f3-5fb3fade449f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1322 microversion: 2.1 time: 0.421277 Oct 05 17:33:06.833534 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 260/498] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:06 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1322 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:06.849443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3a90010-cbbd-4660-b265-81b998afc5c2 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1873487331"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:06.850273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c3a90010-cbbd-4660-b265-81b998afc5c2 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:06.862788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a90010-cbbd-4660-b265-81b998afc5c2 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:06.863382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a90010-cbbd-4660-b265-81b998afc5c2 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:06.863831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a90010-cbbd-4660-b265-81b998afc5c2 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:06.864577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a90010-cbbd-4660-b265-81b998afc5c2 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:06.874157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a90010-cbbd-4660-b265-81b998afc5c2 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:06.874730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a90010-cbbd-4660-b265-81b998afc5c2 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:07.071028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ffe9158f-896c-40c6-863f-9161b91d3778 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:07.083807 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ffe9158f-896c-40c6-863f-9161b91d3778 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1279 microversion: 2.1 time: 0.770021 Oct 05 17:33:07.085793 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 239/499] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:06 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1279 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:07.096311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:07.099313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:07.115585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:07.116351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:07.119030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:07.119990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:07.120621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:07.122746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:07.166329 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.network.security_group_api [None req-c3a90010-cbbd-4660-b265-81b998afc5c2 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Adding security group 5b5b8fed-89e6-44bf-80f8-be918b8de6ac to port 32488405-5d93-4136-b35d-8aeeae91d166 Oct 05 17:33:07.227327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:07.238765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:07.240220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:07.245929 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d6daee81-7b27-4599-9bd5-a68bad26df7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.158624 Oct 05 17:33:07.246539 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 240/500] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:07 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:07.272877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:07.273699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:07.283040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:07.284036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:07.284807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:07.285649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:07.286204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:07.286802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:07.365003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:07.374480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:07.376033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:07.381711 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23f1a058-0344-4ebf-be95-e5ba6bfdfd11 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1447 microversion: 2.75 time: 0.121832 Oct 05 17:33:07.382589 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 241/501] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:07 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1447 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:07.398736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-765922ec-47c9-4dcc-afbb-0f34a0d9e0a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:07.399603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-765922ec-47c9-4dcc-afbb-0f34a0d9e0a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:07.407342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765922ec-47c9-4dcc-afbb-0f34a0d9e0a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:07.408397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765922ec-47c9-4dcc-afbb-0f34a0d9e0a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:07.409027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765922ec-47c9-4dcc-afbb-0f34a0d9e0a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:07.410565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765922ec-47c9-4dcc-afbb-0f34a0d9e0a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:07.411472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765922ec-47c9-4dcc-afbb-0f34a0d9e0a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:07.412237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765922ec-47c9-4dcc-afbb-0f34a0d9e0a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:07.559490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-765922ec-47c9-4dcc-afbb-0f34a0d9e0a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:07.569415 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-765922ec-47c9-4dcc-afbb-0f34a0d9e0a6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1473 microversion: 2.1 time: 0.176734 Oct 05 17:33:07.570257 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 242/502] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:07 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1473 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:07.859875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65c08438-3909-4b5d-b3f8-ed78a6e33eaa tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:07.860712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-65c08438-3909-4b5d-b3f8-ed78a6e33eaa tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:07.869668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65c08438-3909-4b5d-b3f8-ed78a6e33eaa tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:07.870438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65c08438-3909-4b5d-b3f8-ed78a6e33eaa tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:07.870970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65c08438-3909-4b5d-b3f8-ed78a6e33eaa tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:07.872352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65c08438-3909-4b5d-b3f8-ed78a6e33eaa tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:07.872925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65c08438-3909-4b5d-b3f8-ed78a6e33eaa tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:07.874073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65c08438-3909-4b5d-b3f8-ed78a6e33eaa tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.094635 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3a90010-cbbd-4660-b265-81b998afc5c2 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd/action" status: 202 len: 0 microversion: 2.1 time: 1.259018 Oct 05 17:33:08.096187 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 261/503] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:06 2022] POST /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd/action => generated 0 bytes in 1261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:33:08.104512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c538fdd-d580-478e-a989-7ca4da7d7f85 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:08.105230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5c538fdd-d580-478e-a989-7ca4da7d7f85 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:08.126237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c538fdd-d580-478e-a989-7ca4da7d7f85 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.127031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c538fdd-d580-478e-a989-7ca4da7d7f85 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.127638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c538fdd-d580-478e-a989-7ca4da7d7f85 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.128508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c538fdd-d580-478e-a989-7ca4da7d7f85 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.129133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c538fdd-d580-478e-a989-7ca4da7d7f85 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.129708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c538fdd-d580-478e-a989-7ca4da7d7f85 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.258307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65c08438-3909-4b5d-b3f8-ed78a6e33eaa tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:08.280207 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-65c08438-3909-4b5d-b3f8-ed78a6e33eaa tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1322 microversion: 2.1 time: 0.425850 Oct 05 17:33:08.284698 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 243/504] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:07 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:08.294824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-666161b9-3f84-461d-9475-88af0ec31de0 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:08.295779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-666161b9-3f84-461d-9475-88af0ec31de0 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:08.324318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-666161b9-3f84-461d-9475-88af0ec31de0 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.325184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-666161b9-3f84-461d-9475-88af0ec31de0 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.325947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-666161b9-3f84-461d-9475-88af0ec31de0 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.326047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-666161b9-3f84-461d-9475-88af0ec31de0 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.326599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-666161b9-3f84-461d-9475-88af0ec31de0 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.327250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-666161b9-3f84-461d-9475-88af0ec31de0 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.505416 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c538fdd-d580-478e-a989-7ca4da7d7f85 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.404439 Oct 05 17:33:08.507280 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 262/505] 10.222.0.70 () {58 vars in 1293 bytes} [Wed Oct 5 17:33:08 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd/os-security-groups => generated 1157 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:08.513765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:08.514745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:08.524059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.524985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.527094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.530311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.543027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.545258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.674377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:08.687033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:08.688716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:08.698571 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c03dedf1-24db-4257-9790-798c6454bccd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.189811 Oct 05 17:33:08.711455 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 263/506] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:08 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:08.722720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c45715d3-71dd-491f-befd-224cb9796c71 req-f1200801-1f21-410e-ba97-19468e9abb6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2326b784-d0b7-455c-8a14-0d28dc57d0bd", "tag": "32488405-5d93-4136-b35d-8aeeae91d166"}, {"name": "network-changed", "server_uuid": "2326b784-d0b7-455c-8a14-0d28dc57d0bd", "tag": "32488405-5d93-4136-b35d-8aeeae91d166"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:08.744346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c45715d3-71dd-491f-befd-224cb9796c71 req-f1200801-1f21-410e-ba97-19468e9abb6a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.745168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c45715d3-71dd-491f-befd-224cb9796c71 req-f1200801-1f21-410e-ba97-19468e9abb6a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.746057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c45715d3-71dd-491f-befd-224cb9796c71 req-f1200801-1f21-410e-ba97-19468e9abb6a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.764175 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c45715d3-71dd-491f-befd-224cb9796c71 req-f1200801-1f21-410e-ba97-19468e9abb6a service nova] Creating event network-changed:32488405-5d93-4136-b35d-8aeeae91d166 for instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd on n-h1-835595-3 Oct 05 17:33:08.764852 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c45715d3-71dd-491f-befd-224cb9796c71 req-f1200801-1f21-410e-ba97-19468e9abb6a service nova] Creating event network-changed:32488405-5d93-4136-b35d-8aeeae91d166 for instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd on n-h1-835595-3 Oct 05 17:33:08.774096 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c45715d3-71dd-491f-befd-224cb9796c71 req-f1200801-1f21-410e-ba97-19468e9abb6a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061961 Oct 05 17:33:08.776728 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 264/507] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:08.779895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-666161b9-3f84-461d-9475-88af0ec31de0 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:08.788687 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-666161b9-3f84-461d-9475-88af0ec31de0 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1277 microversion: 2.1 time: 0.501936 Oct 05 17:33:08.801225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:08.802818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:08.803074 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 244/508] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:08 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1277 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:08.807927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-203f8aa6-774d-473a-b76e-3416e549dc06 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: .version_select at 0x7f77759a6160>, body: {"security_group": {"name": " tempest-securitygroup -60413702 ", "description": "tempest-description-764208289"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:08.814376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.816292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.816887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.818900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.820070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.820708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.958798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:08.962900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:08.968325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:08.970021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:08.976851 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a7b4fb0e-f71c-4dfd-806b-72c4e3481247 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1453 microversion: 2.75 time: 0.196997 Oct 05 17:33:08.977908 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 265/509] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:08 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1453 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:08.984624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bb5336c7-864c-4985-a360-40f8d9088b0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:08.985534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bb5336c7-864c-4985-a360-40f8d9088b0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:08.992535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb5336c7-864c-4985-a360-40f8d9088b0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.993342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb5336c7-864c-4985-a360-40f8d9088b0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.994307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb5336c7-864c-4985-a360-40f8d9088b0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:08.995220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb5336c7-864c-4985-a360-40f8d9088b0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:08.995920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb5336c7-864c-4985-a360-40f8d9088b0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:08.996704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb5336c7-864c-4985-a360-40f8d9088b0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:09.373530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bb5336c7-864c-4985-a360-40f8d9088b0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:09.385322 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bb5336c7-864c-4985-a360-40f8d9088b0c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1470 microversion: 2.1 time: 0.405031 Oct 05 17:33:09.399112 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 266/510] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:08 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1470 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:09.413497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e4f33a6-54e4-4ead-8ac7-570b0c8c5fe4 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:09.414120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7e4f33a6-54e4-4ead-8ac7-570b0c8c5fe4 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:09.423542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e4f33a6-54e4-4ead-8ac7-570b0c8c5fe4 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:09.424114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e4f33a6-54e4-4ead-8ac7-570b0c8c5fe4 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:09.424554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e4f33a6-54e4-4ead-8ac7-570b0c8c5fe4 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:09.425264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e4f33a6-54e4-4ead-8ac7-570b0c8c5fe4 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:09.425720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e4f33a6-54e4-4ead-8ac7-570b0c8c5fe4 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:09.426142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e4f33a6-54e4-4ead-8ac7-570b0c8c5fe4 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:09.662771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=14 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:09.724518 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-203f8aa6-774d-473a-b76e-3416e549dc06 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.919680 Oct 05 17:33:09.733934 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 245/511] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:33:08 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:09.734970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7e4f33a6-54e4-4ead-8ac7-570b0c8c5fe4 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:09.747000 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7e4f33a6-54e4-4ead-8ac7-570b0c8c5fe4 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1322 microversion: 2.1 time: 0.348211 Oct 05 17:33:09.747365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b614fbf2-4d47-47ef-92f7-473f5197ebbc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:09.747922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b614fbf2-4d47-47ef-92f7-473f5197ebbc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:09.750987 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 267/512] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:09 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:09.760945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:09.764883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:09.776623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b614fbf2-4d47-47ef-92f7-473f5197ebbc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:09.777945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:09.778474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b614fbf2-4d47-47ef-92f7-473f5197ebbc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:09.779395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b614fbf2-4d47-47ef-92f7-473f5197ebbc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:09.779784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:09.780264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b614fbf2-4d47-47ef-92f7-473f5197ebbc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:09.780492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:09.780803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b614fbf2-4d47-47ef-92f7-473f5197ebbc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:09.781228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b614fbf2-4d47-47ef-92f7-473f5197ebbc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:09.784545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:09.785133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:09.785637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:09.940469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:09.963822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:09.965574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:09.974117 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e48b09ec-aff3-4237-b461-dc35fbe0081e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.220474 Oct 05 17:33:09.975218 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 268/513] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:09 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:09.976260 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b614fbf2-4d47-47ef-92f7-473f5197ebbc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6/action" status: 204 len: 0 microversion: 2.1 time: 0.237978 Oct 05 17:33:09.980843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a5cd3f8-d34b-4bce-b527-5e8e0bbb4ac6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f77757969d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:09.981163 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 246/514] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:09 2022] POST /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6/action => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:33:09.990770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a5d43554-757c-47b4-bb8e-ef9973da14e5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:09.992055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a5d43554-757c-47b4-bb8e-ef9973da14e5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:10.001153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5d43554-757c-47b4-bb8e-ef9973da14e5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:10.001653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5d43554-757c-47b4-bb8e-ef9973da14e5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:10.002649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5d43554-757c-47b4-bb8e-ef9973da14e5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:10.004273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5d43554-757c-47b4-bb8e-ef9973da14e5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:10.005362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5d43554-757c-47b4-bb8e-ef9973da14e5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:10.006265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5d43554-757c-47b4-bb8e-ef9973da14e5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:10.438740 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a5cd3f8-d34b-4bce-b527-5e8e0bbb4ac6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/dd1e11bc-70b1-455b-8588-a5c9a0868644" status: 200 len: 221 microversion: 2.1 time: 0.462358 Oct 05 17:33:10.448706 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 269/515] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:33:09 2022] GET /compute/v2.1/os-security-groups/dd1e11bc-70b1-455b-8588-a5c9a0868644 => generated 221 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:10.456297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cd6bcd1f-d304-4080-88bc-9d6eca4974f1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:10.457212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cd6bcd1f-d304-4080-88bc-9d6eca4974f1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:10.466350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd6bcd1f-d304-4080-88bc-9d6eca4974f1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:10.467895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd6bcd1f-d304-4080-88bc-9d6eca4974f1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:10.468562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd6bcd1f-d304-4080-88bc-9d6eca4974f1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:10.469532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd6bcd1f-d304-4080-88bc-9d6eca4974f1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:10.470156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd6bcd1f-d304-4080-88bc-9d6eca4974f1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:10.470801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd6bcd1f-d304-4080-88bc-9d6eca4974f1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:10.530593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a5d43554-757c-47b4-bb8e-ef9973da14e5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:10.546964 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a5d43554-757c-47b4-bb8e-ef9973da14e5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1319 microversion: 2.1 time: 0.562220 Oct 05 17:33:10.548140 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 247/516] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:09 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1319 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:10.554588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:10.555412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:10.565491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:10.573411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:10.573871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:10.575444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:10.576234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:10.577564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:10.583853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:10.886118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:10.898343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:10.905344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:10.918963 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-01d266f6-abd2-4919-ba58-bd040d36527e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1453 microversion: 2.75 time: 0.369603 Oct 05 17:33:10.920170 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 248/517] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:10 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1453 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:10.925296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b898040-ad4f-4dd1-8cf8-22604096c8fa tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f77759658b0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:11.337328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cd6bcd1f-d304-4080-88bc-9d6eca4974f1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:11.347917 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cd6bcd1f-d304-4080-88bc-9d6eca4974f1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1470 microversion: 2.1 time: 0.897433 Oct 05 17:33:11.371089 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 270/518] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:10 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1470 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:11.381887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81170010-91a3-44aa-a1d8-ffe8f9898ec0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:11.383571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-81170010-91a3-44aa-a1d8-ffe8f9898ec0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:11.391248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81170010-91a3-44aa-a1d8-ffe8f9898ec0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:11.392026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81170010-91a3-44aa-a1d8-ffe8f9898ec0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:11.393112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81170010-91a3-44aa-a1d8-ffe8f9898ec0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:11.396193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81170010-91a3-44aa-a1d8-ffe8f9898ec0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:11.397566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81170010-91a3-44aa-a1d8-ffe8f9898ec0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:11.398215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81170010-91a3-44aa-a1d8-ffe8f9898ec0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:11.718165 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0b898040-ad4f-4dd1-8cf8-22604096c8fa tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/dd1e11bc-70b1-455b-8588-a5c9a0868644" status: 202 len: 0 microversion: 2.1 time: 0.796526 Oct 05 17:33:11.718834 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 249/519] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:33:10 2022] DELETE /compute/v2.1/os-security-groups/dd1e11bc-70b1-455b-8588-a5c9a0868644 => generated 0 bytes in 798 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:33:11.736842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:11.737837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:11.746811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:11.749950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:11.750683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:11.751668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:11.752372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:11.753118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:11.884541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:11.900954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:11.906015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:11.916530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5fdf24ca-6472-48b6-a6a2-8b612f5c78d5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.196411 Oct 05 17:33:11.919027 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 250/520] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:11 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:11.935965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-88cb1da2-a38b-4c13-aeba-8c85e0df8d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:11.936823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-88cb1da2-a38b-4c13-aeba-8c85e0df8d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:11.948262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cb1da2-a38b-4c13-aeba-8c85e0df8d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:11.956118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cb1da2-a38b-4c13-aeba-8c85e0df8d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:11.957031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cb1da2-a38b-4c13-aeba-8c85e0df8d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:11.957954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cb1da2-a38b-4c13-aeba-8c85e0df8d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:11.961095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cb1da2-a38b-4c13-aeba-8c85e0df8d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:11.964047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cb1da2-a38b-4c13-aeba-8c85e0df8d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:12.111035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81170010-91a3-44aa-a1d8-ffe8f9898ec0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:12.120536 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81170010-91a3-44aa-a1d8-ffe8f9898ec0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1322 microversion: 2.1 time: 0.751751 Oct 05 17:33:12.140374 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 271/521] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:11 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1322 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:12.146520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70322eb8-74f5-4b21-9a50-504869097398 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775796430>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:12.234173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG neutronclient.v2_0.client [None req-70322eb8-74f5-4b21-9a50-504869097398 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist", "detail": ""}} {{(pid=128844) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:33:12.235109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.security_group_api [None req-70322eb8-74f5-4b21-9a50-504869097398 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Neutron security group dd1e11bc-70b1-455b-8588-a5c9a0868644 not found {{(pid=128844) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:33:12.235821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-70322eb8-74f5-4b21-9a50-504869097398 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:33:12.235821 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-c310a5be-6228-485a-84b7-0ce92030b376'] Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70322eb8-74f5-4b21-9a50-504869097398 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-security-groups/dd1e11bc-70b1-455b-8588-a5c9a0868644 HTTP/1.1 Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:33:12.250403 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: exception: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-c310a5be-6228-485a-84b7-0ce92030b376'] Oct 05 17:33:12.252243 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'dd1e11bc-70b1-455b-8588-a5c9a0868644'} Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:12.253174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c310a5be-6228-485a-84b7-0ce92030b376'] Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:33:12.255777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c310a5be-6228-485a-84b7-0ce92030b376'] Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c310a5be-6228-485a-84b7-0ce92030b376'] Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:12.256977 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:12.258393 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:12.258393 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:12.258393 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:12.258393 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:12.258393 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:33:12.258393 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c310a5be-6228-485a-84b7-0ce92030b376'] Oct 05 17:33:12.258393 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:12.258393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70322eb8-74f5-4b21-9a50-504869097398 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:33:12.258393 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-c310a5be-6228-485a-84b7-0ce92030b376'] {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:12.260458 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-70322eb8-74f5-4b21-9a50-504869097398 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/dd1e11bc-70b1-455b-8588-a5c9a0868644" status: 404 len: 194 microversion: 2.1 time: 0.118873 Oct 05 17:33:12.261283 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 272/522] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:33:12 2022] GET /compute/v2.1/os-security-groups/dd1e11bc-70b1-455b-8588-a5c9a0868644 => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:33:12.271366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:12.272519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:12.280879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:12.281381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:12.281991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:12.283291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:12.283904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:12.284875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:12.454534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:12.469027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:12.470882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:12.483458 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fef6e9b2-bcdf-4d94-b253-b14e7b4f0aa3 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1438 microversion: 2.75 time: 0.215780 Oct 05 17:33:12.491166 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 273/523] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:12 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1438 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:12.506682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1d4299da-6145-4874-9dd5-d33628492f1c tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: .version_select at 0x7f7775796790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-559499948", "description": "tempest-description-67577709"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:12.725362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-88cb1da2-a38b-4c13-aeba-8c85e0df8d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:12.736365 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-88cb1da2-a38b-4c13-aeba-8c85e0df8d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1319 microversion: 2.1 time: 0.815583 Oct 05 17:33:12.738117 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 251/524] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:11 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1319 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:12.744173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a0e928bb-324d-4f12-9fe6-70d1dee57480 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:12.745530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a0e928bb-324d-4f12-9fe6-70d1dee57480 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:12.755628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e928bb-324d-4f12-9fe6-70d1dee57480 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:12.756754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e928bb-324d-4f12-9fe6-70d1dee57480 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:12.757530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e928bb-324d-4f12-9fe6-70d1dee57480 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:12.758368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e928bb-324d-4f12-9fe6-70d1dee57480 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:12.759196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e928bb-324d-4f12-9fe6-70d1dee57480 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:12.759891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e928bb-324d-4f12-9fe6-70d1dee57480 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:12.992925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0e928bb-324d-4f12-9fe6-70d1dee57480 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:13.001594 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a0e928bb-324d-4f12-9fe6-70d1dee57480 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1470 microversion: 2.1 time: 0.261858 Oct 05 17:33:13.002618 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 252/525] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:12 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1470 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:13.282843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:13.287734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:13.298013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:13.299003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:13.300207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:13.302240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:13.303581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:13.305241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:13.309847 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1d4299da-6145-4874-9dd5-d33628492f1c tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.817112 Oct 05 17:33:13.311743 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 274/526] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:33:12 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:13.318081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e0b7d371-412f-4c9b-9cd8-faab559c6259 req-0b2a96b7-d50b-4668-a9c8-e0de7f3e4412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d6f375-344a-4460-a8bd-dc5e9c7af8e6", "name": "network-vif-plugged", "status": "completed", "tag": "16de15df-aa59-4811-a979-bf656b358834"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:13.350657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e0b7d371-412f-4c9b-9cd8-faab559c6259 req-0b2a96b7-d50b-4668-a9c8-e0de7f3e4412 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:13.351135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e0b7d371-412f-4c9b-9cd8-faab559c6259 req-0b2a96b7-d50b-4668-a9c8-e0de7f3e4412 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:13.351569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e0b7d371-412f-4c9b-9cd8-faab559c6259 req-0b2a96b7-d50b-4668-a9c8-e0de7f3e4412 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:13.375444 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e0b7d371-412f-4c9b-9cd8-faab559c6259 req-0b2a96b7-d50b-4668-a9c8-e0de7f3e4412 service nova] Creating event network-vif-plugged:16de15df-aa59-4811-a979-bf656b358834 for instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 on n-h1-835595-3 Oct 05 17:33:13.386734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-e0b7d371-412f-4c9b-9cd8-faab559c6259 req-0b2a96b7-d50b-4668-a9c8-e0de7f3e4412 service nova] Instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:33:13.404384 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e0b7d371-412f-4c9b-9cd8-faab559c6259 req-0b2a96b7-d50b-4668-a9c8-e0de7f3e4412 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090231 Oct 05 17:33:13.405930 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 275/527] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:13.417916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:13.420289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:13.443462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:13.445585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:13.448187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:13.449619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:13.453209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:13.453674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:13.457365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:33:13.463934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:33:13.465320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:33:13.465834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:33:13.468854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:33:13.633507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:13.654943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:13.655642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:13.656403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:13.661809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:13.662555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:13.663206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:13.737763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:13.755253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:13.757433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:13.763388 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9dfca280-1c8b-4dff-822f-44ced6c60dfd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.355669 Oct 05 17:33:13.778973 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 276/528] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:13 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:13.792712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-118a76af-1dbc-4d6b-8f03-da9639c8ac84 req-d9636cfd-e1e0-44a1-ad2f-307937cd8cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71c9e52-3103-4955-9c3e-071006ce5757", "tag": "4151ae59-7916-4ccb-8a3c-ef4306940d47"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:13.811838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:13.819883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-118a76af-1dbc-4d6b-8f03-da9639c8ac84 req-d9636cfd-e1e0-44a1-ad2f-307937cd8cd9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:13.820477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-118a76af-1dbc-4d6b-8f03-da9639c8ac84 req-d9636cfd-e1e0-44a1-ad2f-307937cd8cd9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:13.821620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-118a76af-1dbc-4d6b-8f03-da9639c8ac84 req-d9636cfd-e1e0-44a1-ad2f-307937cd8cd9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:13.837861 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-118a76af-1dbc-4d6b-8f03-da9639c8ac84 req-d9636cfd-e1e0-44a1-ad2f-307937cd8cd9 service nova] Creating event network-changed:4151ae59-7916-4ccb-8a3c-ef4306940d47 for instance c71c9e52-3103-4955-9c3e-071006ce5757 on n-h2-835595-3 Oct 05 17:33:13.844823 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-118a76af-1dbc-4d6b-8f03-da9639c8ac84 req-d9636cfd-e1e0-44a1-ad2f-307937cd8cd9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063890 Oct 05 17:33:13.845097 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8e827b3a-09be-4bdb-a62b-6263f9c3aad3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6/action" status: 202 len: 1942 microversion: 2.75 time: 0.839673 Oct 05 17:33:13.846064 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 253/529] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:33:13 2022] POST /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6/action => generated 1942 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 05 17:33:13.850681 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 277/530] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:13.858869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72486ea2-1e97-430d-9e7f-dafe0e054c78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:13.859431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3617a159-263a-4402-b973-6c1acb5004dc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: .version_select at 0x7f7775796940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-758371836", "description": "tempest-description-1993211968"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:13.861054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-72486ea2-1e97-430d-9e7f-dafe0e054c78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:13.875510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72486ea2-1e97-430d-9e7f-dafe0e054c78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:13.876010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72486ea2-1e97-430d-9e7f-dafe0e054c78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:13.876540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72486ea2-1e97-430d-9e7f-dafe0e054c78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:13.877473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72486ea2-1e97-430d-9e7f-dafe0e054c78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:13.878892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72486ea2-1e97-430d-9e7f-dafe0e054c78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:13.879440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72486ea2-1e97-430d-9e7f-dafe0e054c78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:14.056832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-72486ea2-1e97-430d-9e7f-dafe0e054c78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:14.065057 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-72486ea2-1e97-430d-9e7f-dafe0e054c78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1322 microversion: 2.1 time: 0.215765 Oct 05 17:33:14.065632 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 254/531] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:13 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:14.072621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a30ec65f-0b8f-4903-80c2-ac5dcc1425d1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:14.073879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a30ec65f-0b8f-4903-80c2-ac5dcc1425d1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:14.083251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a30ec65f-0b8f-4903-80c2-ac5dcc1425d1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:14.083739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a30ec65f-0b8f-4903-80c2-ac5dcc1425d1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:14.084475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a30ec65f-0b8f-4903-80c2-ac5dcc1425d1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:14.085213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a30ec65f-0b8f-4903-80c2-ac5dcc1425d1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:14.085667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a30ec65f-0b8f-4903-80c2-ac5dcc1425d1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:14.086266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a30ec65f-0b8f-4903-80c2-ac5dcc1425d1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:14.218503 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3617a159-263a-4402-b973-6c1acb5004dc tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.365453 Oct 05 17:33:14.219942 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 278/532] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:33:13 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:14.234640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-551daacc-c60c-4ea4-9ec1-9550964a2d35 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:14.235739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a30ec65f-0b8f-4903-80c2-ac5dcc1425d1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:14.236162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-551daacc-c60c-4ea4-9ec1-9550964a2d35 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:14.253621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-551daacc-c60c-4ea4-9ec1-9550964a2d35 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:14.254113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-551daacc-c60c-4ea4-9ec1-9550964a2d35 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:14.254580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-551daacc-c60c-4ea4-9ec1-9550964a2d35 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:14.255287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-551daacc-c60c-4ea4-9ec1-9550964a2d35 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:14.255744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-551daacc-c60c-4ea4-9ec1-9550964a2d35 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:14.256161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-551daacc-c60c-4ea4-9ec1-9550964a2d35 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:14.258745 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a30ec65f-0b8f-4903-80c2-ac5dcc1425d1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1319 microversion: 2.1 time: 0.180999 Oct 05 17:33:14.259604 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 255/533] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:14 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:14.270729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e97d69d1-4af3-4653-b10a-4c01d7e203e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:14.271643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e97d69d1-4af3-4653-b10a-4c01d7e203e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:14.280200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e97d69d1-4af3-4653-b10a-4c01d7e203e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:14.291422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e97d69d1-4af3-4653-b10a-4c01d7e203e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:14.291937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e97d69d1-4af3-4653-b10a-4c01d7e203e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:14.292685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e97d69d1-4af3-4653-b10a-4c01d7e203e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:14.293166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e97d69d1-4af3-4653-b10a-4c01d7e203e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:14.293579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e97d69d1-4af3-4653-b10a-4c01d7e203e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:14.405888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-551daacc-c60c-4ea4-9ec1-9550964a2d35 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:14.429266 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-551daacc-c60c-4ea4-9ec1-9550964a2d35 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.207750 Oct 05 17:33:14.430106 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 279/534] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:14 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:14.435143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bdf911c3-af38-404f-a01e-d635ff7eb853 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: .version_select at 0x7f7775698af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-918697560", "description": "tempest-description-1381226506"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:14.451467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:14.458469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e97d69d1-4af3-4653-b10a-4c01d7e203e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:14.467138 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e97d69d1-4af3-4653-b10a-4c01d7e203e0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1470 microversion: 2.1 time: 0.206297 Oct 05 17:33:14.467975 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 256/535] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:14 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:14.754979 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bdf911c3-af38-404f-a01e-d635ff7eb853 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.323564 Oct 05 17:33:14.755752 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 280/536] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:33:14 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:14.769944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dab2e591-fb7d-4f9d-94d3-df28e2b349f9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775ab7160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:14.790697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=14 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:14.797639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:14.799287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:14.806698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:14.807694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:14.808509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:14.810495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:14.811121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:14.811827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:14.963185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:14.981698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:14.991935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:14.999806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=18 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:15.016315 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9221d64-6c10-4992-bdf3-744bef3a7bfa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.222553 Oct 05 17:33:15.044977 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 281/537] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:14 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:15.092619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f61ad199-6d59-4546-b646-ec5a272ee442 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:15.093533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f61ad199-6d59-4546-b646-ec5a272ee442 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:15.107193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f61ad199-6d59-4546-b646-ec5a272ee442 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.107709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f61ad199-6d59-4546-b646-ec5a272ee442 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.108450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f61ad199-6d59-4546-b646-ec5a272ee442 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.110411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f61ad199-6d59-4546-b646-ec5a272ee442 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.111806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f61ad199-6d59-4546-b646-ec5a272ee442 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.112804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f61ad199-6d59-4546-b646-ec5a272ee442 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.189494 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dab2e591-fb7d-4f9d-94d3-df28e2b349f9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 0.424561 Oct 05 17:33:15.191484 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 257/538] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:33:14 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:15.205493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f165ded6-13e1-41e8-8aa8-cd6b263fb0f6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f777598b0d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:15.385056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f61ad199-6d59-4546-b646-ec5a272ee442 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:15.394816 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f61ad199-6d59-4546-b646-ec5a272ee442 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1322 microversion: 2.1 time: 0.308779 Oct 05 17:33:15.395405 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 282/539] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:15 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:15.403005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-083c3eed-98d7-4e52-b0db-b24781d6ee1c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:15.409138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-083c3eed-98d7-4e52-b0db-b24781d6ee1c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:15.420545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-083c3eed-98d7-4e52-b0db-b24781d6ee1c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.422525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-083c3eed-98d7-4e52-b0db-b24781d6ee1c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.423202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-083c3eed-98d7-4e52-b0db-b24781d6ee1c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.424136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-083c3eed-98d7-4e52-b0db-b24781d6ee1c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.424742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-083c3eed-98d7-4e52-b0db-b24781d6ee1c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.425314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-083c3eed-98d7-4e52-b0db-b24781d6ee1c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.627868 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f165ded6-13e1-41e8-8aa8-cd6b263fb0f6 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/8e85be18-07a3-41de-9c8d-9e60b1e762e5" status: 202 len: 0 microversion: 2.1 time: 0.426225 Oct 05 17:33:15.632129 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 258/540] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:33:15 2022] DELETE /compute/v2.1/os-security-groups/8e85be18-07a3-41de-9c8d-9e60b1e762e5 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:33:15.637398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-30c64959-5c83-46b0-956c-0f5d2f4c6232 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:15.638012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30c64959-5c83-46b0-956c-0f5d2f4c6232 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:15.652662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c64959-5c83-46b0-956c-0f5d2f4c6232 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.653462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c64959-5c83-46b0-956c-0f5d2f4c6232 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.654892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c64959-5c83-46b0-956c-0f5d2f4c6232 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.656080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c64959-5c83-46b0-956c-0f5d2f4c6232 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.656812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c64959-5c83-46b0-956c-0f5d2f4c6232 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.657483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c64959-5c83-46b0-956c-0f5d2f4c6232 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.716316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-083c3eed-98d7-4e52-b0db-b24781d6ee1c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:15.725241 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-083c3eed-98d7-4e52-b0db-b24781d6ee1c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1319 microversion: 2.1 time: 0.325807 Oct 05 17:33:15.726992 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 283/541] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:15 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1319 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:15.750921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-61fe364c-f351-41b8-aad5-04b803e3f290 req-01378169-8483-4295-931e-58496b525524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07ea7e2-f9cd-493e-82f9-15deae371911", "name": "network-vif-plugged", "status": "completed", "tag": "285f5185-4e97-4744-b230-1804227341e6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:15.761742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-61fe364c-f351-41b8-aad5-04b803e3f290 req-01378169-8483-4295-931e-58496b525524 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.762219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-61fe364c-f351-41b8-aad5-04b803e3f290 req-01378169-8483-4295-931e-58496b525524 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.762667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-61fe364c-f351-41b8-aad5-04b803e3f290 req-01378169-8483-4295-931e-58496b525524 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.774064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-30c64959-5c83-46b0-956c-0f5d2f4c6232 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:15.786004 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-61fe364c-f351-41b8-aad5-04b803e3f290 req-01378169-8483-4295-931e-58496b525524 service nova] Creating event network-vif-plugged:285f5185-4e97-4744-b230-1804227341e6 for instance d07ea7e2-f9cd-493e-82f9-15deae371911 on n-h2-835595-3 Oct 05 17:33:15.794533 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-61fe364c-f351-41b8-aad5-04b803e3f290 req-01378169-8483-4295-931e-58496b525524 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050117 Oct 05 17:33:15.795627 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 284/542] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:15.824940 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-30c64959-5c83-46b0-956c-0f5d2f4c6232 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.191601 Oct 05 17:33:15.848540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cd29cf43-931d-43b6-90dc-ac65b05065f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:15.850087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cd29cf43-931d-43b6-90dc-ac65b05065f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:15.855055 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 259/543] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:15 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:15.857931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:15.860136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd29cf43-931d-43b6-90dc-ac65b05065f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.860811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd29cf43-931d-43b6-90dc-ac65b05065f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.861461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd29cf43-931d-43b6-90dc-ac65b05065f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.862217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9e3d2c68-faf4-4fc2-889a-f0b8e64ad8e9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:15.863008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9e3d2c68-faf4-4fc2-889a-f0b8e64ad8e9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:15.863142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd29cf43-931d-43b6-90dc-ac65b05065f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.863851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd29cf43-931d-43b6-90dc-ac65b05065f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.864290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd29cf43-931d-43b6-90dc-ac65b05065f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.870384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3d2c68-faf4-4fc2-889a-f0b8e64ad8e9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.871191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3d2c68-faf4-4fc2-889a-f0b8e64ad8e9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.871722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3d2c68-faf4-4fc2-889a-f0b8e64ad8e9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.872533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3d2c68-faf4-4fc2-889a-f0b8e64ad8e9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:15.873086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3d2c68-faf4-4fc2-889a-f0b8e64ad8e9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:15.873607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3d2c68-faf4-4fc2-889a-f0b8e64ad8e9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:15.904003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9e3d2c68-faf4-4fc2-889a-f0b8e64ad8e9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:33:16.031748 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9e3d2c68-faf4-4fc2-889a-f0b8e64ad8e9 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "DELETE /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 204 len: 0 microversion: 2.1 time: 0.174943 Oct 05 17:33:16.032267 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 260/544] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:33:15 2022] DELETE /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:33:16.047656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00a815cf-9767-4e4c-9c0e-c57e6d51ca9f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f77759e8040>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:16.084518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-00a815cf-9767-4e4c-9c0e-c57e6d51ca9f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:33:16.085435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.security_group_api [None req-00a815cf-9767-4e4c-9c0e-c57e6d51ca9f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Neutron security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 not found {{(pid=128843) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:33:16.085653 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-00a815cf-9767-4e4c-9c0e-c57e6d51ca9f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:33:16.085653 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-fdb8c4d4-f87a-4138-bde6-817a2bdbde60'] Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00a815cf-9767-4e4c-9c0e-c57e6d51ca9f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-security-groups/8e85be18-07a3-41de-9c8d-9e60b1e762e5 HTTP/1.1 Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:33:16.090574 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: exception: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-fdb8c4d4-f87a-4138-bde6-817a2bdbde60'] Oct 05 17:33:16.092134 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '8e85be18-07a3-41de-9c8d-9e60b1e762e5'} Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:16.093050 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdb8c4d4-f87a-4138-bde6-817a2bdbde60'] Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:33:16.094435 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdb8c4d4-f87a-4138-bde6-817a2bdbde60'] Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdb8c4d4-f87a-4138-bde6-817a2bdbde60'] Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.095728 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:16.097186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:16.097186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:16.097186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:16.097186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:16.097186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:33:16.097186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdb8c4d4-f87a-4138-bde6-817a2bdbde60'] Oct 05 17:33:16.097186 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.097186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00a815cf-9767-4e4c-9c0e-c57e6d51ca9f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:33:16.097186 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-fdb8c4d4-f87a-4138-bde6-817a2bdbde60'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:16.097186 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00a815cf-9767-4e4c-9c0e-c57e6d51ca9f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/8e85be18-07a3-41de-9c8d-9e60b1e762e5" status: 404 len: 194 microversion: 2.1 time: 0.052931 Oct 05 17:33:16.098255 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 261/545] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:33:16 2022] GET /compute/v2.1/os-security-groups/8e85be18-07a3-41de-9c8d-9e60b1e762e5 => generated 194 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:33:16.102914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:16.103654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:16.113570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:16.114061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:16.114551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:16.115257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:16.115874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:16.116777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:16.210261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:16.219197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:16.221064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:16.227096 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2b538ea0-619d-4533-a8cb-1a8ae6accbc2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.127804 Oct 05 17:33:16.227881 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 262/546] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:16 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:16.232547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f5340b91-1696-4667-aab2-2c068c3113f8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775b96310>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:16.278315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cd29cf43-931d-43b6-90dc-ac65b05065f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:16.288476 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cd29cf43-931d-43b6-90dc-ac65b05065f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1462 microversion: 2.1 time: 0.491383 Oct 05 17:33:16.304426 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 285/547] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:15 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1462 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:16.313786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-539833825", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "1553919301", "adminPass": "***", "networks": [{"uuid": "22b7db7a-1fab-4bbf-84a9-79fa232ccfc0"}], "security_groups": [{"name": "tempest-securitygroup--940985860"}], "key_name": "tempest-keypair-2119713767", "user_data": "}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:16.446749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] validate_networks() for [('22b7db7a-1fab-4bbf-84a9-79fa232ccfc0', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:33:16.474651 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f5340b91-1696-4667-aab2-2c068c3113f8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/9b95a091-7731-42f7-973f-a68eced15e7d" status: 202 len: 0 microversion: 2.1 time: 0.245165 Oct 05 17:33:16.474926 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 263/548] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:33:16 2022] DELETE /compute/v2.1/os-security-groups/9b95a091-7731-42f7-973f-a68eced15e7d => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:33:16.480076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6349bd62-c16d-44a1-ba84-87d559d4be9f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:16.481212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6349bd62-c16d-44a1-ba84-87d559d4be9f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:16.492320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6349bd62-c16d-44a1-ba84-87d559d4be9f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:16.492794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6349bd62-c16d-44a1-ba84-87d559d4be9f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:16.493299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6349bd62-c16d-44a1-ba84-87d559d4be9f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:16.493980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6349bd62-c16d-44a1-ba84-87d559d4be9f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:16.494806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6349bd62-c16d-44a1-ba84-87d559d4be9f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:16.495383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6349bd62-c16d-44a1-ba84-87d559d4be9f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:16.673510 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6349bd62-c16d-44a1-ba84-87d559d4be9f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1613 microversion: 2.1 time: 0.197226 Oct 05 17:33:16.674135 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 264/549] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:16 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1613 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:16.678941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-08d7fef1-02d4-4cb0-8773-8309e00b8949 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:16.679746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-08d7fef1-02d4-4cb0-8773-8309e00b8949 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:16.689021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d7fef1-02d4-4cb0-8773-8309e00b8949 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:16.689915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d7fef1-02d4-4cb0-8773-8309e00b8949 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:16.690889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d7fef1-02d4-4cb0-8773-8309e00b8949 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:16.691821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d7fef1-02d4-4cb0-8773-8309e00b8949 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:16.692348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d7fef1-02d4-4cb0-8773-8309e00b8949 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:16.692961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d7fef1-02d4-4cb0-8773-8309e00b8949 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:16.698987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:16.826384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08d7fef1-02d4-4cb0-8773-8309e00b8949 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:16.834584 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-08d7fef1-02d4-4cb0-8773-8309e00b8949 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1322 microversion: 2.1 time: 0.159163 Oct 05 17:33:16.835143 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 265/550] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:16 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:16.839927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e444e6e9-1766-4321-8a91-eaf11d06c02d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f77758cbc10>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:16.864352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-e444e6e9-1766-4321-8a91-eaf11d06c02d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:33:16.864942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.security_group_api [None req-e444e6e9-1766-4321-8a91-eaf11d06c02d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Neutron security group 9b95a091-7731-42f7-973f-a68eced15e7d not found {{(pid=128843) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:33:16.865504 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e444e6e9-1766-4321-8a91-eaf11d06c02d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:33:16.865504 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-8ca1e0d5-44a4-46aa-af7c-c7c03b598fb6'] Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e444e6e9-1766-4321-8a91-eaf11d06c02d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-security-groups/9b95a091-7731-42f7-973f-a68eced15e7d HTTP/1.1 Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:33:16.867399 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: exception: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-8ca1e0d5-44a4-46aa-af7c-c7c03b598fb6'] Oct 05 17:33:16.869160 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '9b95a091-7731-42f7-973f-a68eced15e7d'} Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:16.870024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ca1e0d5-44a4-46aa-af7c-c7c03b598fb6'] Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:33:16.871258 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ca1e0d5-44a4-46aa-af7c-c7c03b598fb6'] Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ca1e0d5-44a4-46aa-af7c-c7c03b598fb6'] Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.872585 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8ca1e0d5-44a4-46aa-af7c-c7c03b598fb6'] Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e444e6e9-1766-4321-8a91-eaf11d06c02d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-8ca1e0d5-44a4-46aa-af7c-c7c03b598fb6'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e444e6e9-1766-4321-8a91-eaf11d06c02d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/9b95a091-7731-42f7-973f-a68eced15e7d" status: 404 len: 194 microversion: 2.1 time: 0.035928 Oct 05 17:33:16.874914 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 266/551] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:33:16 2022] GET /compute/v2.1/os-security-groups/9b95a091-7731-42f7-973f-a68eced15e7d => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:33:16.904314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:33:16.904737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:33:16.905211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:33:16.905638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:33:16.906062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:33:16.916050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:16.916541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:16.916972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:16.917695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:16.918154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:16.918602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:16.934155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-276203735", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "71625936-48e5-43f1-8d04-88ba77014c3c"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:16.936801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Getting quotas for project adbb4e67ac704e69842024b3ae1a023d. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:33:16.940980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Getting quotas for user 0a3a1e26a77e4895a996fc9375e26550 and project adbb4e67ac704e69842024b3ae1a023d. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:33:16.952811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:33:16.955918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:33:16.989857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] validate_networks() for [('71625936-48e5-43f1-8d04-88ba77014c3c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:33:17.006768 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7809214f-2f86-4746-85dc-43d94d66b41e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.700963 Oct 05 17:33:17.007419 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 286/552] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:33:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:33:17.011940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b6667c77-8d09-4a9e-9446-f74a085b412f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '.version_select at 0x7f7775698ca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:17.015528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6667c77-8d09-4a9e-9446-f74a085b412f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:17.016022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6667c77-8d09-4a9e-9446-f74a085b412f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:17.016459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6667c77-8d09-4a9e-9446-f74a085b412f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:17.027293 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b6667c77-8d09-4a9e-9446-f74a085b412f tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.018827 Oct 05 17:33:17.038306 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 287/553] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:33:17 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:17.052676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-73c4a200-94be-4eca-ae40-0603587ff067 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:17.053644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-73c4a200-94be-4eca-ae40-0603587ff067 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:17.062667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73c4a200-94be-4eca-ae40-0603587ff067 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:17.063162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73c4a200-94be-4eca-ae40-0603587ff067 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:17.063648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73c4a200-94be-4eca-ae40-0603587ff067 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:17.065058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73c4a200-94be-4eca-ae40-0603587ff067 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:17.065530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73c4a200-94be-4eca-ae40-0603587ff067 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:17.066137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73c4a200-94be-4eca-ae40-0603587ff067 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:17.270409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-73c4a200-94be-4eca-ae40-0603587ff067 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:17.279479 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-73c4a200-94be-4eca-ae40-0603587ff067 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1319 microversion: 2.1 time: 0.250075 Oct 05 17:33:17.280377 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 288/554] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:17 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:17.286009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8b3491c8-a1fc-4d9e-a2e3-1d30c012e0fa tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:17.287801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8b3491c8-a1fc-4d9e-a2e3-1d30c012e0fa tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:17.308307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b3491c8-a1fc-4d9e-a2e3-1d30c012e0fa tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:17.308870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b3491c8-a1fc-4d9e-a2e3-1d30c012e0fa tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:17.309448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b3491c8-a1fc-4d9e-a2e3-1d30c012e0fa tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:17.310307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b3491c8-a1fc-4d9e-a2e3-1d30c012e0fa tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:17.311788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b3491c8-a1fc-4d9e-a2e3-1d30c012e0fa tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:17.312301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b3491c8-a1fc-4d9e-a2e3-1d30c012e0fa tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:17.407584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-8b3491c8-a1fc-4d9e-a2e3-1d30c012e0fa tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:17.411009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:17.437612 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8b3491c8-a1fc-4d9e-a2e3-1d30c012e0fa tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.155251 Oct 05 17:33:17.439053 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 289/555] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:17 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:17.443719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-907ec76c-ac95-4bd7-a364-b1f6fe20749a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775796160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:17.667928 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-907ec76c-ac95-4bd7-a364-b1f6fe20749a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c75eb4c7-40da-47dc-8faa-d4215f438b9a" status: 202 len: 0 microversion: 2.1 time: 0.227154 Oct 05 17:33:17.670649 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 290/556] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:33:17 2022] DELETE /compute/v2.1/os-security-groups/c75eb4c7-40da-47dc-8faa-d4215f438b9a => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:33:17.682653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ca177db1-215f-4c87-811b-c7891f3ec2fb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:17.683740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ca177db1-215f-4c87-811b-c7891f3ec2fb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:17.762199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ca177db1-215f-4c87-811b-c7891f3ec2fb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:17.774770 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ca177db1-215f-4c87-811b-c7891f3ec2fb tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1264 microversion: 2.1 time: 0.101780 Oct 05 17:33:17.776225 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 291/557] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:17 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1264 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:17.782777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1646712211", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:17.789345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:33:17.789900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:33:17.790221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:33:17.791524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:33:17.791934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:33:17.803948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:17.804662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:17.805647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:17.808118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:17.808118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:17.808118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:17.834346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Getting quotas for project 51a14f79344f4986a6c54001c3d7590c. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:33:17.839066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:17.841131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Getting quotas for user 205777d0702b45d1b400045c3a2fd47b and project 51a14f79344f4986a6c54001c3d7590c. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:33:17.862164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:33:17.862569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:33:17.865073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:33:17.973343 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1cf4ddec-e102-441e-b155-f683e3ebfed4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.098628 Oct 05 17:33:17.983546 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 267/558] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:33:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:33:17.995020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:17.995708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:18.004334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:18.004488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:18.005149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:18.008028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:18.008695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:18.009673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:18.137351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:18.151245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:18.152741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:18.168046 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-99d5d662-73e9-4408-b13b-e58ce950759e tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.183270 Oct 05 17:33:18.174529 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 268/559] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:17 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:18.179747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-96bfe48f-a2a6-4439-af26-1319a7730aeb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f777586bca0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:18.188792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:33:18.189215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:33:18.189764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:33:18.196302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:33:18.197203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:33:18.208003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:18.208566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:18.209098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:18.210115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:18.210798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:18.211316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:18.232197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for project afc6422679664e47892eef7185291846. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:33:18.236962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for user 15a6bfffd8fb473b83de94858676f8ed and project afc6422679664e47892eef7185291846. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:33:18.250843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:33:18.254034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:33:18.254184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-96bfe48f-a2a6-4439-af26-1319a7730aeb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:33:18.254780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.security_group_api [None req-96bfe48f-a2a6-4439-af26-1319a7730aeb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Neutron security group c75eb4c7-40da-47dc-8faa-d4215f438b9a not found {{(pid=128843) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:33:18.255304 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-96bfe48f-a2a6-4439-af26-1319a7730aeb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:33:18.255304 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-0b84051a-5915-4d5d-b175-9077f2e80971'] Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-96bfe48f-a2a6-4439-af26-1319a7730aeb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-security-groups/c75eb4c7-40da-47dc-8faa-d4215f438b9a HTTP/1.1 Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:33:18.257117 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: exception: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-0b84051a-5915-4d5d-b175-9077f2e80971'] Oct 05 17:33:18.258619 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'c75eb4c7-40da-47dc-8faa-d4215f438b9a'} Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:18.259895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b84051a-5915-4d5d-b175-9077f2e80971'] Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:33:18.261217 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b84051a-5915-4d5d-b175-9077f2e80971'] Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b84051a-5915-4d5d-b175-9077f2e80971'] Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:18.262455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:18.263909 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:18.263909 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:18.263909 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:18.263909 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:18.263909 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:33:18.263909 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b84051a-5915-4d5d-b175-9077f2e80971'] Oct 05 17:33:18.263909 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:18.268393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-96bfe48f-a2a6-4439-af26-1319a7730aeb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:33:18.268393 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-0b84051a-5915-4d5d-b175-9077f2e80971'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:18.268393 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-96bfe48f-a2a6-4439-af26-1319a7730aeb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/c75eb4c7-40da-47dc-8faa-d4215f438b9a" status: 404 len: 194 microversion: 2.1 time: 0.090693 Oct 05 17:33:18.268393 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 269/560] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:33:18 2022] GET /compute/v2.1/os-security-groups/c75eb4c7-40da-47dc-8faa-d4215f438b9a => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:33:18.272071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7270f666-8616-4929-990d-7577277674c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:18.276856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7270f666-8616-4929-990d-7577277674c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:18.297676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7270f666-8616-4929-990d-7577277674c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:18.298916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7270f666-8616-4929-990d-7577277674c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:18.299656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7270f666-8616-4929-990d-7577277674c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:18.300537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7270f666-8616-4929-990d-7577277674c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:18.301811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7270f666-8616-4929-990d-7577277674c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:18.302318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7270f666-8616-4929-990d-7577277674c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:18.322095 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-640bf156-b79e-48df-8bd9-4009626344fb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543715 Oct 05 17:33:18.323338 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 292/561] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:33:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:33:18.339795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aa2205eb-75f8-4ee0-a96c-61e4e4b7d8e4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:18.342317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aa2205eb-75f8-4ee0-a96c-61e4e4b7d8e4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:18.430568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aa2205eb-75f8-4ee0-a96c-61e4e4b7d8e4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:18.440931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aa2205eb-75f8-4ee0-a96c-61e4e4b7d8e4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:18.442435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aa2205eb-75f8-4ee0-a96c-61e4e4b7d8e4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:18.443683 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aa2205eb-75f8-4ee0-a96c-61e4e4b7d8e4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1261 microversion: 2.25 time: 0.119010 Oct 05 17:33:18.456608 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 293/562] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:18 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1261 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:18.469813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7d927204-35bc-4772-8b46-a15cc66a7381 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775698dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:18.534474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7270f666-8616-4929-990d-7577277674c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:18.555591 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7270f666-8616-4929-990d-7577277674c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1471 microversion: 2.1 time: 0.287650 Oct 05 17:33:18.558541 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 270/563] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:18 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:18.569435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-392f626f-1bdc-4df6-a680-0438149506a1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:18.572089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-392f626f-1bdc-4df6-a680-0438149506a1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:18.588051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-392f626f-1bdc-4df6-a680-0438149506a1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:18.588452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-392f626f-1bdc-4df6-a680-0438149506a1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:18.588935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-392f626f-1bdc-4df6-a680-0438149506a1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:18.589656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-392f626f-1bdc-4df6-a680-0438149506a1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:18.590124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-392f626f-1bdc-4df6-a680-0438149506a1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:18.592821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-392f626f-1bdc-4df6-a680-0438149506a1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:18.843565 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7d927204-35bc-4772-8b46-a15cc66a7381 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.384208 Oct 05 17:33:18.855268 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 294/564] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:33:18 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:18.864946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2e97eca6-e092-4dd6-8353-9fd61d7bdaea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:18.865990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2e97eca6-e092-4dd6-8353-9fd61d7bdaea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:18.983694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2e97eca6-e092-4dd6-8353-9fd61d7bdaea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:19.011698 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2e97eca6-e092-4dd6-8353-9fd61d7bdaea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1213 microversion: 2.1 time: 0.155749 Oct 05 17:33:19.015918 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 295/565] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:18 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:19.030476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7916386b-ab9d-4efa-a6d7-0c99b11d8cec tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:19.031491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7916386b-ab9d-4efa-a6d7-0c99b11d8cec tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:19.060135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7916386b-ab9d-4efa-a6d7-0c99b11d8cec tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:19.060664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7916386b-ab9d-4efa-a6d7-0c99b11d8cec tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:19.064360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7916386b-ab9d-4efa-a6d7-0c99b11d8cec tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:19.067410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7916386b-ab9d-4efa-a6d7-0c99b11d8cec tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:19.071868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7916386b-ab9d-4efa-a6d7-0c99b11d8cec tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:19.072365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7916386b-ab9d-4efa-a6d7-0c99b11d8cec tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:19.236615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-7916386b-ab9d-4efa-a6d7-0c99b11d8cec tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:19.266498 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7916386b-ab9d-4efa-a6d7-0c99b11d8cec tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.248350 Oct 05 17:33:19.269333 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 296/566] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:19 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:19.496335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f321d3c2-6923-4f78-8153-c0913005fdf2 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:19.497050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f321d3c2-6923-4f78-8153-c0913005fdf2 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] [instance: e5a7220b-2112-4ea6-aab1-62a353b5a905] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:19.503559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-f321d3c2-6923-4f78-8153-c0913005fdf2 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] HTTP exception thrown: Instance e5a7220b-2112-4ea6-aab1-62a353b5a905 could not be found. Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f321d3c2-6923-4f78-8153-c0913005fdf2 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Request method failure captured: Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/e5a7220b-2112-4ea6-aab1-62a353b5a905/action HTTP/1.1 Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 15 Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_KeVqfMZvTUhpx_-Dbgm7ohdOJgse5-QdXDattqcXDBH65Q0ApbvYTz6LE3ROP8R_jvbQ69ebC1tR0SA8oza2D01pYmVyfnsZomP9chzOcVunodTpk81a-YbTjwAHZlVsB8mgJTTsDb-XGc6T7zjgFvBc2siBAy6fIhgzmEZxg5Y4 Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f727c86299b545c39393131ddd5017f6 Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:33:19.511453 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f727c86299b545c39393131ddd5017f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f727c86299b545c39393131ddd5017f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f727c86299b545c39393131ddd5017f6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f727c86299b545c39393131ddd5017f6"}]}] Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f727c86299b545c39393131ddd5017f6 Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersAdminNegativeTestJSON-1593672326-project-admin Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 25fe6ef7486549e6b3d9080ac13362be Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1593672326-project-admin Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: {"migrate": {}} Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:33:19.513101 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e5a7220b-2112-4ea6-aab1-62a353b5a905 could not be found. Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e5a7220b-2112-4ea6-aab1-62a353b5a905', 'body': {'migrate': {}}} Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5a7220b-2112-4ea6-aab1-62a353b5a905 could not be found. Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:19.514170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5a7220b-2112-4ea6-aab1-62a353b5a905 could not be found. Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5a7220b-2112-4ea6-aab1-62a353b5a905 could not be found. Oct 05 17:33:19.515996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:19.519605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f321d3c2-6923-4f78-8153-c0913005fdf2 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Returning 404 to user: Instance e5a7220b-2112-4ea6-aab1-62a353b5a905 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:19.521506 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f321d3c2-6923-4f78-8153-c0913005fdf2 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/e5a7220b-2112-4ea6-aab1-62a353b5a905/action" status: 404 len: 111 microversion: 2.1 time: 0.249883 Oct 05 17:33:19.522682 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 297/567] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:19 2022] POST /compute/v2.1/servers/e5a7220b-2112-4ea6-aab1-62a353b5a905/action => generated 111 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:33:19.530510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f9f3c76c-cbaf-49b4-8ed2-e05dac0ffcae tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:19.531940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f9f3c76c-cbaf-49b4-8ed2-e05dac0ffcae tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:19.558973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9f3c76c-cbaf-49b4-8ed2-e05dac0ffcae tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:19.560912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9f3c76c-cbaf-49b4-8ed2-e05dac0ffcae tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:19.561369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9f3c76c-cbaf-49b4-8ed2-e05dac0ffcae tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:19.563329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9f3c76c-cbaf-49b4-8ed2-e05dac0ffcae tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:19.563965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9f3c76c-cbaf-49b4-8ed2-e05dac0ffcae tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:19.566224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9f3c76c-cbaf-49b4-8ed2-e05dac0ffcae tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:19.662464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-392f626f-1bdc-4df6-a680-0438149506a1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:19.674737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f9f3c76c-cbaf-49b4-8ed2-e05dac0ffcae tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:19.677665 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-392f626f-1bdc-4df6-a680-0438149506a1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1319 microversion: 2.1 time: 1.113978 Oct 05 17:33:19.686300 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f9f3c76c-cbaf-49b4-8ed2-e05dac0ffcae tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1322 microversion: 2.1 time: 0.160310 Oct 05 17:33:19.701549 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 298/568] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:19 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:19.701777 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 271/569] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:18 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1319 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:19.701885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d9fc4e2-9238-48b5-baad-a304a3a4b4a3 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: .version_select at 0x7f7775927550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1905454302", "description": "tempest-description-594691465"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:19.707782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:19.709706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:19.723712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:19.725130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:19.726430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:19.727260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:19.728579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:19.730138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:19.888881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:19.899279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:19.902381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:19.909589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cfdaf8ec-40db-4e77-bca5-34b9986f9db0 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.212128 Oct 05 17:33:19.929407 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 272/570] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:19 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:19.939334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:19.940199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:19.948291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:19.949477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:19.950154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:19.951438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:19.952225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:19.953134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:19.987671 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d9fc4e2-9238-48b5-baad-a304a3a4b4a3 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.298506 Oct 05 17:33:19.988701 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 299/571] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:33:19 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:20.006199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-979410147", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:20.135177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:33:20.337929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:20.354704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:20.359446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:20.361565 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-693b3329-9146-4d3b-8f0f-263a1c2c3b25 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1313 microversion: 2.25 time: 0.430637 Oct 05 17:33:20.362758 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 273/572] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:19 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1313 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:20.368196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-000ffd9d-c0f0-4eac-a6b1-22615a17781a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: .version_select at 0x7f77758cba60>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1026086702", "description": "tempest-description-896843775"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:20.675764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:33:20.676323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:33:20.676962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:33:20.677618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:33:20.678209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:33:20.692945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:20.693750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:20.694523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:20.696194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:20.697591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:20.698396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:20.726057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Getting quotas for project 411f6ccee8514f6a8f54cd913f958cee. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:33:20.730887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Getting quotas for user 6a0d71e683ff47aa968e4334e5999077 and project 411f6ccee8514f6a8f54cd913f958cee. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:33:20.764124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:33:20.769484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:33:20.848829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-19ff3995-8c72-45de-ae70-64199a9dbcc0 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.858173 Oct 05 17:33:20.850084 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 300/573] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:33:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:33:20.856847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8fd40b19-6519-4bf9-a4d8-b562716e08da tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:20.857930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8fd40b19-6519-4bf9-a4d8-b562716e08da tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:20.880733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fd40b19-6519-4bf9-a4d8-b562716e08da tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:20.882527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fd40b19-6519-4bf9-a4d8-b562716e08da tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:20.883041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fd40b19-6519-4bf9-a4d8-b562716e08da tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:20.884838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fd40b19-6519-4bf9-a4d8-b562716e08da tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:20.885373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fd40b19-6519-4bf9-a4d8-b562716e08da tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:20.886634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fd40b19-6519-4bf9-a4d8-b562716e08da tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:21.149320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8fd40b19-6519-4bf9-a4d8-b562716e08da tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:21.187429 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8fd40b19-6519-4bf9-a4d8-b562716e08da tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1273 microversion: 2.1 time: 0.330374 Oct 05 17:33:21.189214 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 301/574] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:20 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1273 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:21.207176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-68a0fa6e-1a01-40a5-8a98-daad808f282b tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:21.209548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-68a0fa6e-1a01-40a5-8a98-daad808f282b tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:21.247831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a0fa6e-1a01-40a5-8a98-daad808f282b tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:21.248564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a0fa6e-1a01-40a5-8a98-daad808f282b tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:21.249177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a0fa6e-1a01-40a5-8a98-daad808f282b tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:21.251739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a0fa6e-1a01-40a5-8a98-daad808f282b tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:21.252434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a0fa6e-1a01-40a5-8a98-daad808f282b tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:21.254125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a0fa6e-1a01-40a5-8a98-daad808f282b tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:21.560055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-68a0fa6e-1a01-40a5-8a98-daad808f282b tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:21.647997 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-68a0fa6e-1a01-40a5-8a98-daad808f282b tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.455778 Oct 05 17:33:21.657162 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 302/575] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:21 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:21.663433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7dff4349-e66f-4a7b-9dee-b1626fbf109c req-8db7c458-6efe-4e6b-b69d-f5c9726df038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50deba5b-8150-4d35-9fea-79d5acdbf33e", "name": "network-vif-deleted", "tag": "359f2c58-5ec7-4319-85c5-b3d744235dab"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:21.685401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7dff4349-e66f-4a7b-9dee-b1626fbf109c req-8db7c458-6efe-4e6b-b69d-f5c9726df038 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:21.688094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7dff4349-e66f-4a7b-9dee-b1626fbf109c req-8db7c458-6efe-4e6b-b69d-f5c9726df038 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:21.688750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7dff4349-e66f-4a7b-9dee-b1626fbf109c req-8db7c458-6efe-4e6b-b69d-f5c9726df038 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:21.716376 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7dff4349-e66f-4a7b-9dee-b1626fbf109c req-8db7c458-6efe-4e6b-b69d-f5c9726df038 service nova] Creating event network-vif-deleted:359f2c58-5ec7-4319-85c5-b3d744235dab for instance 50deba5b-8150-4d35-9fea-79d5acdbf33e on n-h1-835595-3 Oct 05 17:33:21.730128 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-000ffd9d-c0f0-4eac-a6b1-22615a17781a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.365773 Oct 05 17:33:21.741546 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 274/576] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:33:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:21.741546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cf264720-1d40-4327-9935-4e405428f5dc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:21.741546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cf264720-1d40-4327-9935-4e405428f5dc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:21.748038 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7dff4349-e66f-4a7b-9dee-b1626fbf109c req-8db7c458-6efe-4e6b-b69d-f5c9726df038 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089061 Oct 05 17:33:21.759562 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 303/577] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:21.775951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf264720-1d40-4327-9935-4e405428f5dc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:21.776470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf264720-1d40-4327-9935-4e405428f5dc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:21.780517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf264720-1d40-4327-9935-4e405428f5dc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:21.781996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf264720-1d40-4327-9935-4e405428f5dc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:21.787410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf264720-1d40-4327-9935-4e405428f5dc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:21.789269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf264720-1d40-4327-9935-4e405428f5dc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:21.791831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a96d43ec-17cd-4143-afbc-8ea3d58a635f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:21.796310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a96d43ec-17cd-4143-afbc-8ea3d58a635f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:21.823336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a96d43ec-17cd-4143-afbc-8ea3d58a635f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:21.826888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a96d43ec-17cd-4143-afbc-8ea3d58a635f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:21.827402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a96d43ec-17cd-4143-afbc-8ea3d58a635f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:21.833661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a96d43ec-17cd-4143-afbc-8ea3d58a635f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:21.834587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a96d43ec-17cd-4143-afbc-8ea3d58a635f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:21.855278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a96d43ec-17cd-4143-afbc-8ea3d58a635f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:22.049415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a96d43ec-17cd-4143-afbc-8ea3d58a635f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:22.063341 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a96d43ec-17cd-4143-afbc-8ea3d58a635f tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1322 microversion: 2.1 time: 0.299450 Oct 05 17:33:22.064359 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 304/578] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:21 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:22.068976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-83a696ae-cc52-4797-be3e-0fd8dfbbb0a8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:22.080704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-83a696ae-cc52-4797-be3e-0fd8dfbbb0a8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:22.099577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83a696ae-cc52-4797-be3e-0fd8dfbbb0a8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:22.100189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83a696ae-cc52-4797-be3e-0fd8dfbbb0a8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:22.112457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83a696ae-cc52-4797-be3e-0fd8dfbbb0a8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:22.113659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83a696ae-cc52-4797-be3e-0fd8dfbbb0a8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:22.115456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83a696ae-cc52-4797-be3e-0fd8dfbbb0a8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:22.118063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83a696ae-cc52-4797-be3e-0fd8dfbbb0a8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:22.541655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cf264720-1d40-4327-9935-4e405428f5dc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:22.557511 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cf264720-1d40-4327-9935-4e405428f5dc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1319 microversion: 2.1 time: 0.824732 Oct 05 17:33:22.560009 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 275/579] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:21 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1319 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:22.607988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:22.615295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:22.624342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:22.633618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:22.634261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:22.637768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:22.638508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:22.652713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:22.652916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-83a696ae-cc52-4797-be3e-0fd8dfbbb0a8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:22.665365 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-83a696ae-cc52-4797-be3e-0fd8dfbbb0a8 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1225 microversion: 2.1 time: 0.600005 Oct 05 17:33:22.683144 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 305/580] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:22 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1225 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:22.703288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:22.704325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:22.720197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:22.721106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:22.723761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:22.725847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:22.731504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:22.734150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:22.918017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:22.931873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:22.933810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:22.935733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:22.941856 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9f833385-8a80-49b4-92b5-f33f9b984f72 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.359251 Oct 05 17:33:22.960236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:22.960236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:22.960236 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-438fc7f2-db8b-458b-84e9-c57720962aa3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1319 microversion: 2.25 time: 0.270924 Oct 05 17:33:22.971810 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 306/581] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:22 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:22.984514 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 276/582] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:22 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:22.993743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1932660953", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "46cd59dc-0f3c-4b1d-9c41-793bec981fb3"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:22.994265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b99163f-d994-4597-8765-1c65bb0d4d32 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:22.999943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b99163f-d994-4597-8765-1c65bb0d4d32 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:23.011323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b99163f-d994-4597-8765-1c65bb0d4d32 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:23.012070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b99163f-d994-4597-8765-1c65bb0d4d32 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:23.012742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b99163f-d994-4597-8765-1c65bb0d4d32 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:23.013678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b99163f-d994-4597-8765-1c65bb0d4d32 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:23.014340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b99163f-d994-4597-8765-1c65bb0d4d32 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:23.014958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b99163f-d994-4597-8765-1c65bb0d4d32 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:23.087315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] validate_networks() for [('46cd59dc-0f3c-4b1d-9c41-793bec981fb3', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:33:23.740827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8b99163f-d994-4597-8765-1c65bb0d4d32 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:23.750588 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b99163f-d994-4597-8765-1c65bb0d4d32 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1313 microversion: 2.1 time: 0.764306 Oct 05 17:33:23.752102 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 277/583] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:22 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1313 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:23.775538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d0cd6124-8129-498e-a79e-885a748288e9 req-407bd570-0717-45ac-b5b7-4040453ce914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71c9e52-3103-4955-9c3e-071006ce5757", "name": "network-vif-plugged", "status": "completed", "tag": "4151ae59-7916-4ccb-8a3c-ef4306940d47"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:23.803353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d0cd6124-8129-498e-a79e-885a748288e9 req-407bd570-0717-45ac-b5b7-4040453ce914 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:23.804292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d0cd6124-8129-498e-a79e-885a748288e9 req-407bd570-0717-45ac-b5b7-4040453ce914 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:23.804958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d0cd6124-8129-498e-a79e-885a748288e9 req-407bd570-0717-45ac-b5b7-4040453ce914 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:23.844082 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d0cd6124-8129-498e-a79e-885a748288e9 req-407bd570-0717-45ac-b5b7-4040453ce914 service nova] Creating event network-vif-plugged:4151ae59-7916-4ccb-8a3c-ef4306940d47 for instance c71c9e52-3103-4955-9c3e-071006ce5757 on n-h2-835595-3 Oct 05 17:33:23.853771 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d0cd6124-8129-498e-a79e-885a748288e9 req-407bd570-0717-45ac-b5b7-4040453ce914 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099517 Oct 05 17:33:23.855289 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 278/584] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:23.865891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-214787a8-b8a3-478e-b9c9-d4e014f0eea7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:23.866924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-214787a8-b8a3-478e-b9c9-d4e014f0eea7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:23.877972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-214787a8-b8a3-478e-b9c9-d4e014f0eea7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:23.880085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-214787a8-b8a3-478e-b9c9-d4e014f0eea7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:23.880708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-214787a8-b8a3-478e-b9c9-d4e014f0eea7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:23.881874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-214787a8-b8a3-478e-b9c9-d4e014f0eea7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:23.882697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-214787a8-b8a3-478e-b9c9-d4e014f0eea7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:23.883430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-214787a8-b8a3-478e-b9c9-d4e014f0eea7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.121283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-214787a8-b8a3-478e-b9c9-d4e014f0eea7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:24.139649 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-214787a8-b8a3-478e-b9c9-d4e014f0eea7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.282787 Oct 05 17:33:24.154323 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 279/585] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:23 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:24.166369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7f85a23b-11f6-4c93-a6e5-f914d83d1986 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:24.166369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7f85a23b-11f6-4c93-a6e5-f914d83d1986 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:24.173507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f85a23b-11f6-4c93-a6e5-f914d83d1986 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.174631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f85a23b-11f6-4c93-a6e5-f914d83d1986 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.175331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f85a23b-11f6-4c93-a6e5-f914d83d1986 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.176208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f85a23b-11f6-4c93-a6e5-f914d83d1986 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.176914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f85a23b-11f6-4c93-a6e5-f914d83d1986 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.178492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f85a23b-11f6-4c93-a6e5-f914d83d1986 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.299095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:33:24.300834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:33:24.301386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:33:24.302045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:33:24.302682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:33:24.312161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.313000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.313674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.314862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.315579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.316078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.337957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Getting quotas for project 9bdb0c8c021f481882fc6eda0ae41eb4. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:33:24.342374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Getting quotas for user f53bebb71deb4cd0a33f962302456404 and project 9bdb0c8c021f481882fc6eda0ae41eb4. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:33:24.345086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:24.359275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:33:24.362233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:33:24.413962 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c0c6a744-d6b2-48a7-b99d-741ec62f8a09 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440921 Oct 05 17:33:24.414962 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 307/586] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:33:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1443 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:33:24.425599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9be8d61-7072-48ed-b7b3-2743763e23e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:24.426200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9be8d61-7072-48ed-b7b3-2743763e23e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:24.444532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9be8d61-7072-48ed-b7b3-2743763e23e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.445168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9be8d61-7072-48ed-b7b3-2743763e23e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.445738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9be8d61-7072-48ed-b7b3-2743763e23e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.446493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9be8d61-7072-48ed-b7b3-2743763e23e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.446955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9be8d61-7072-48ed-b7b3-2743763e23e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.447385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9be8d61-7072-48ed-b7b3-2743763e23e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.652374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9be8d61-7072-48ed-b7b3-2743763e23e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:24.660790 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9be8d61-7072-48ed-b7b3-2743763e23e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1319 microversion: 2.1 time: 0.244581 Oct 05 17:33:24.662068 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 308/587] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:24 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:24.666989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-504b17fc-34bc-4849-8b75-5ddb76cef795 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:24.667870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-504b17fc-34bc-4849-8b75-5ddb76cef795 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:24.674309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-504b17fc-34bc-4849-8b75-5ddb76cef795 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.675140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-504b17fc-34bc-4849-8b75-5ddb76cef795 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.675809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-504b17fc-34bc-4849-8b75-5ddb76cef795 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.676850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-504b17fc-34bc-4849-8b75-5ddb76cef795 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.677528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-504b17fc-34bc-4849-8b75-5ddb76cef795 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.678157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-504b17fc-34bc-4849-8b75-5ddb76cef795 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.692662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7f85a23b-11f6-4c93-a6e5-f914d83d1986 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:24.701211 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7f85a23b-11f6-4c93-a6e5-f914d83d1986 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.559140 Oct 05 17:33:24.701855 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 280/588] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:24 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:24.719310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:24.719953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:24.738169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.738958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.739398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.740298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.740832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.741408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.787656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-504b17fc-34bc-4849-8b75-5ddb76cef795 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:24.797415 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-504b17fc-34bc-4849-8b75-5ddb76cef795 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1279 microversion: 2.1 time: 0.133791 Oct 05 17:33:24.798425 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 309/589] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:24 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1279 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:24.803054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:24.803851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:24.811404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.812431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.813433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.814644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:24.815528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:24.816356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:24.979380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:24.990850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:24.992307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:24.993437 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4f463083-979a-47e3-a34b-2ec424421807 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1361 microversion: 2.25 time: 0.194005 Oct 05 17:33:24.994038 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 310/590] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:24 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:24.999351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-95bcd521-70c2-466e-8d74-745b51b078d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:25.000288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-95bcd521-70c2-466e-8d74-745b51b078d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:25.007874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95bcd521-70c2-466e-8d74-745b51b078d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.008738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95bcd521-70c2-466e-8d74-745b51b078d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.009425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95bcd521-70c2-466e-8d74-745b51b078d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.010375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95bcd521-70c2-466e-8d74-745b51b078d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.011092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95bcd521-70c2-466e-8d74-745b51b078d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.011788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95bcd521-70c2-466e-8d74-745b51b078d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.096346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-95bcd521-70c2-466e-8d74-745b51b078d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:25.106359 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-95bcd521-70c2-466e-8d74-745b51b078d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1220 microversion: 2.1 time: 0.110755 Oct 05 17:33:25.107698 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 311/591] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:24 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:25.116312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-bac0dfcb-8c5d-4dd8-a773-926d9ab90d54 req-e78ac21f-2730-4df4-888b-7a512c469d2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6f8884c-4ca4-429c-aa7b-df2fc97a928c", "tag": "a18e8b53-aade-42fb-9dfa-55dfdd67d235"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:25.130365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bac0dfcb-8c5d-4dd8-a773-926d9ab90d54 req-e78ac21f-2730-4df4-888b-7a512c469d2d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.131985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bac0dfcb-8c5d-4dd8-a773-926d9ab90d54 req-e78ac21f-2730-4df4-888b-7a512c469d2d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.133594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bac0dfcb-8c5d-4dd8-a773-926d9ab90d54 req-e78ac21f-2730-4df4-888b-7a512c469d2d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.142043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:25.153863 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-bac0dfcb-8c5d-4dd8-a773-926d9ab90d54 req-e78ac21f-2730-4df4-888b-7a512c469d2d service nova] Creating event network-changed:a18e8b53-aade-42fb-9dfa-55dfdd67d235 for instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c on n-h2-835595-3 Oct 05 17:33:25.155215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:25.159969 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-bac0dfcb-8c5d-4dd8-a773-926d9ab90d54 req-e78ac21f-2730-4df4-888b-7a512c469d2d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049949 Oct 05 17:33:25.160638 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 312/592] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:25.161646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:25.168907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f51c98b-157b-4f58-ae31-772d96b5707f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:25.169605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6f51c98b-157b-4f58-ae31-772d96b5707f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:25.175793 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b85ba63e-341f-42d3-b8d3-5c8592cbb3f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.460247 Oct 05 17:33:25.176734 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 281/593] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:24 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:25.187307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-78f29f0c-d05b-4b2d-8942-bab7b003983a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:25.191597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f51c98b-157b-4f58-ae31-772d96b5707f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.192101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f51c98b-157b-4f58-ae31-772d96b5707f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.192762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-78f29f0c-d05b-4b2d-8942-bab7b003983a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:25.193773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f51c98b-157b-4f58-ae31-772d96b5707f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.195067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f51c98b-157b-4f58-ae31-772d96b5707f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.195843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f51c98b-157b-4f58-ae31-772d96b5707f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.196291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f51c98b-157b-4f58-ae31-772d96b5707f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.207515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f29f0c-d05b-4b2d-8942-bab7b003983a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.208385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f29f0c-d05b-4b2d-8942-bab7b003983a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.209055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f29f0c-d05b-4b2d-8942-bab7b003983a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.214827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f29f0c-d05b-4b2d-8942-bab7b003983a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.215573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f29f0c-d05b-4b2d-8942-bab7b003983a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.216606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f29f0c-d05b-4b2d-8942-bab7b003983a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.340302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-78f29f0c-d05b-4b2d-8942-bab7b003983a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:25.387661 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-78f29f0c-d05b-4b2d-8942-bab7b003983a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.208368 Oct 05 17:33:25.388665 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 282/594] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:25 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:25.442847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6f51c98b-157b-4f58-ae31-772d96b5707f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:25.470914 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6f51c98b-157b-4f58-ae31-772d96b5707f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1313 microversion: 2.1 time: 0.307126 Oct 05 17:33:25.472224 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 313/595] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:25 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1313 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:25.689943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea084d26-a068-4dc9-8415-d525a613bc9e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:25.690650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ea084d26-a068-4dc9-8415-d525a613bc9e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:25.697726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea084d26-a068-4dc9-8415-d525a613bc9e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.698423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea084d26-a068-4dc9-8415-d525a613bc9e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.698853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea084d26-a068-4dc9-8415-d525a613bc9e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.699827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea084d26-a068-4dc9-8415-d525a613bc9e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.700342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea084d26-a068-4dc9-8415-d525a613bc9e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.700760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea084d26-a068-4dc9-8415-d525a613bc9e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.728001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a7af783-304d-4be2-9681-1c07c80513c8 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:25.729719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9a7af783-304d-4be2-9681-1c07c80513c8 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:25.736533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a7af783-304d-4be2-9681-1c07c80513c8 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.737326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a7af783-304d-4be2-9681-1c07c80513c8 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.737856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a7af783-304d-4be2-9681-1c07c80513c8 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.738756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a7af783-304d-4be2-9681-1c07c80513c8 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:25.739432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a7af783-304d-4be2-9681-1c07c80513c8 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:25.739857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a7af783-304d-4be2-9681-1c07c80513c8 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:25.955860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9a7af783-304d-4be2-9681-1c07c80513c8 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:25.978127 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a7af783-304d-4be2-9681-1c07c80513c8 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.254044 Oct 05 17:33:25.983566 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 314/596] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:25 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:25.992653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0fadb37f-8b9e-4fd7-8b4f-4ba8b29f1e78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:25.993486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0fadb37f-8b9e-4fd7-8b4f-4ba8b29f1e78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:26.002015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fadb37f-8b9e-4fd7-8b4f-4ba8b29f1e78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.002634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fadb37f-8b9e-4fd7-8b4f-4ba8b29f1e78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.004211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fadb37f-8b9e-4fd7-8b4f-4ba8b29f1e78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.004211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fadb37f-8b9e-4fd7-8b4f-4ba8b29f1e78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.004440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fadb37f-8b9e-4fd7-8b4f-4ba8b29f1e78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.004923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fadb37f-8b9e-4fd7-8b4f-4ba8b29f1e78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.050359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ea084d26-a068-4dc9-8415-d525a613bc9e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:26.060631 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ea084d26-a068-4dc9-8415-d525a613bc9e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1469 microversion: 2.1 time: 0.376094 Oct 05 17:33:26.066833 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 283/597] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:25 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1469 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:26.090677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:26.091561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:26.099461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.100252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.100900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.101648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.102273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.103026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.336941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0fadb37f-8b9e-4fd7-8b4f-4ba8b29f1e78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:26.352415 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0fadb37f-8b9e-4fd7-8b4f-4ba8b29f1e78 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.365772 Oct 05 17:33:26.353930 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 315/598] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:25 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:26.498851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2075226160", "block_migration": true, "disk_over_commit": false}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:26.501763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:26.510039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.510921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.511920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.512809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.513426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.514481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.534980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:26.546794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:26.549169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:26.550645 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c1b38c3b-12ef-4ce7-b800-e1f1b23b7110 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1361 microversion: 2.25 time: 0.467031 Oct 05 17:33:26.578327 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 284/599] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:26 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1361 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:26.595429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e9c6663e-0003-4281-826c-9fdfc28b15d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:26.597342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e9c6663e-0003-4281-826c-9fdfc28b15d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:26.605685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9c6663e-0003-4281-826c-9fdfc28b15d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.607428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9c6663e-0003-4281-826c-9fdfc28b15d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.608590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9c6663e-0003-4281-826c-9fdfc28b15d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.610203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9c6663e-0003-4281-826c-9fdfc28b15d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.610920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9c6663e-0003-4281-826c-9fdfc28b15d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.611046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:26.611752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9c6663e-0003-4281-826c-9fdfc28b15d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.629972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lazy-loading 'flavor' on Instance uuid c71c9e52-3103-4955-9c3e-071006ce5757 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:26.640843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:26.691651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Going to try to live migrate instance to tempest-host-2075226160 {{(pid=128844) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 17:33:26.700230 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] HTTP exception thrown: Compute host tempest-host-2075226160 could not be found. Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Request method failure captured: Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757/action HTTP/1.1 Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 107 Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_OkU5wPDET2pdddxf8EOBpmWpg9teabIfXOf8dWi4EewTK_N59PyM0mmcFYYUIkycDCWgmnj3ygjDg8TH38vR2nRI1i7hEPpeqZ9lNUMvVLDFjuVaydzj62fMohK-NbIjd6LQU68kwJIQ_K0gHnpT_0AzZHiXz1U-C8QYSJWDcOUc Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cfc4f62977324815b29ad0082ef414e6 Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-LiveMigrationNegativeTest-726872911 Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:33:26.705110 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfc4f62977324815b29ad0082ef414e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfc4f62977324815b29ad0082ef414e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfc4f62977324815b29ad0082ef414e6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfc4f62977324815b29ad0082ef414e6"}]}] Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-LiveMigrationNegativeTest-726872911 Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cfc4f62977324815b29ad0082ef414e6 Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-726872911 Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-LiveMigrationNegativeTest-726872911-project-admin Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6dda89d3ed5a45edb7eab53969b959bb Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-LiveMigrationNegativeTest-726872911-project-admin Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: {"os-migrateLive": {"host": "tempest-host-2075226160", "block_migration": true, "disk_over_commit": false}} Oct 05 17:33:26.706893 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: exception: Compute host tempest-host-2075226160 could not be found. Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'c71c9e52-3103-4955-9c3e-071006ce5757', 'body': {'os-migrateLive': {'host': 'tempest-host-2075226160', 'block_migration': True, 'disk_over_commit': False}}} Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 17:33:26.707862 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-2075226160 could not be found. Oct 05 17:33:26.709184 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-2075226160 could not be found. Oct 05 17:33:26.710461 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:26.711830 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:26.711830 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:26.711830 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:26.711830 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:26.711830 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:26.711830 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:26.711830 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:26.711830 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-2075226160 could not be found. Oct 05 17:33:26.711830 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:26.713712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Returning 400 to user: Compute host tempest-host-2075226160 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:26.714774 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cf572322-464e-4fea-95e3-f17ca31428aa tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757/action" status: 400 len: 100 microversion: 2.1 time: 0.359519 Oct 05 17:33:26.715523 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 316/600] 10.222.0.70 () {60 vars in 1279 bytes} [Wed Oct 5 17:33:26 2022] POST /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757/action => generated 100 bytes in 361 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:33:26.721204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:26.722638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:26.729445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.730170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.730674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.731418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.731875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.732477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.749824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e9c6663e-0003-4281-826c-9fdfc28b15d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:26.764954 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e9c6663e-0003-4281-826c-9fdfc28b15d9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1274 microversion: 2.1 time: 0.183374 Oct 05 17:33:26.765704 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 285/601] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:26 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:26.771768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0e75350-9926-454a-ab04-5e27167427c4 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:26.772568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e0e75350-9926-454a-ab04-5e27167427c4 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:26.780893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0e75350-9926-454a-ab04-5e27167427c4 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.781683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0e75350-9926-454a-ab04-5e27167427c4 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.782016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0e75350-9926-454a-ab04-5e27167427c4 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.782796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0e75350-9926-454a-ab04-5e27167427c4 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.783349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0e75350-9926-454a-ab04-5e27167427c4 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.783774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0e75350-9926-454a-ab04-5e27167427c4 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.841939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:26.851797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:26.853689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:26.859423 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-94dc5dac-c040-406b-ab40-8d343ab4791f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.142608 Oct 05 17:33:26.859921 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 317/602] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:26 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:26.877977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-0d880d39-6f89-4a9b-a408-695d5ebc0e3d req-64a77a84-a495-40ea-adf7-e19be79d61b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d655671e-b4fa-4bf6-85b2-5a2d556124a2", "tag": "d566d38c-8389-4104-8984-f5d607c56fe6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:26.892008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0d880d39-6f89-4a9b-a408-695d5ebc0e3d req-64a77a84-a495-40ea-adf7-e19be79d61b7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.892834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0d880d39-6f89-4a9b-a408-695d5ebc0e3d req-64a77a84-a495-40ea-adf7-e19be79d61b7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.893444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0d880d39-6f89-4a9b-a408-695d5ebc0e3d req-64a77a84-a495-40ea-adf7-e19be79d61b7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.896368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-e0e75350-9926-454a-ab04-5e27167427c4 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:26.910011 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-0d880d39-6f89-4a9b-a408-695d5ebc0e3d req-64a77a84-a495-40ea-adf7-e19be79d61b7 service nova] Creating event network-changed:d566d38c-8389-4104-8984-f5d607c56fe6 for instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 on n-h2-835595-3 Oct 05 17:33:26.916693 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-0d880d39-6f89-4a9b-a408-695d5ebc0e3d req-64a77a84-a495-40ea-adf7-e19be79d61b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054738 Oct 05 17:33:26.918307 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 318/603] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:26.919453 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e0e75350-9926-454a-ab04-5e27167427c4 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.151783 Oct 05 17:33:26.920469 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 286/604] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:26 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:26.925005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1311c832-f538-476b-986c-f6896f4ca510 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:26.925861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1311c832-f538-476b-986c-f6896f4ca510 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:26.926335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f47b141-d02c-40bf-b430-b49560496d4f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:26.927153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f47b141-d02c-40bf-b430-b49560496d4f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:26.943143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1311c832-f538-476b-986c-f6896f4ca510 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.943636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1311c832-f538-476b-986c-f6896f4ca510 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.944964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1311c832-f538-476b-986c-f6896f4ca510 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.945698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1311c832-f538-476b-986c-f6896f4ca510 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.946040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f47b141-d02c-40bf-b430-b49560496d4f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.946150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1311c832-f538-476b-986c-f6896f4ca510 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.946602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1311c832-f538-476b-986c-f6896f4ca510 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.946938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f47b141-d02c-40bf-b430-b49560496d4f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.947678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f47b141-d02c-40bf-b430-b49560496d4f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:26.948385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f47b141-d02c-40bf-b430-b49560496d4f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:26.948993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f47b141-d02c-40bf-b430-b49560496d4f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:26.949424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f47b141-d02c-40bf-b430-b49560496d4f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:27.311673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1311c832-f538-476b-986c-f6896f4ca510 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:27.323987 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1311c832-f538-476b-986c-f6896f4ca510 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1313 microversion: 2.1 time: 0.400116 Oct 05 17:33:27.338455 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 319/605] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:26 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:27.353716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f2a040b-9686-44eb-8d5b-b2f31bf92e65 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:27.355190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8f2a040b-9686-44eb-8d5b-b2f31bf92e65 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:27.362976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f2a040b-9686-44eb-8d5b-b2f31bf92e65 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:27.363846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f2a040b-9686-44eb-8d5b-b2f31bf92e65 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:27.364559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f2a040b-9686-44eb-8d5b-b2f31bf92e65 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:27.365444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f2a040b-9686-44eb-8d5b-b2f31bf92e65 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:27.366052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f2a040b-9686-44eb-8d5b-b2f31bf92e65 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:27.366625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f2a040b-9686-44eb-8d5b-b2f31bf92e65 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:27.382583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4f47b141-d02c-40bf-b430-b49560496d4f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:27.395540 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f47b141-d02c-40bf-b430-b49560496d4f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1469 microversion: 2.1 time: 0.473167 Oct 05 17:33:27.396386 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 287/606] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:26 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1469 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:27.431591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76e7779f-1c97-42aa-92fe-211d2835abfb tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:27.431591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-76e7779f-1c97-42aa-92fe-211d2835abfb tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:27.437735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76e7779f-1c97-42aa-92fe-211d2835abfb tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:27.438228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76e7779f-1c97-42aa-92fe-211d2835abfb tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:27.439119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76e7779f-1c97-42aa-92fe-211d2835abfb tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:27.440297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76e7779f-1c97-42aa-92fe-211d2835abfb tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:27.440888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76e7779f-1c97-42aa-92fe-211d2835abfb tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:27.441467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76e7779f-1c97-42aa-92fe-211d2835abfb tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:27.750890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8f2a040b-9686-44eb-8d5b-b2f31bf92e65 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:27.762460 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f2a040b-9686-44eb-8d5b-b2f31bf92e65 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.421093 Oct 05 17:33:27.763070 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 320/607] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:27 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:27.769476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-911158613", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:27.813950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:27.838549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:33:27.840061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-76e7779f-1c97-42aa-92fe-211d2835abfb tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:27.851282 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76e7779f-1c97-42aa-92fe-211d2835abfb tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.439740 Oct 05 17:33:27.852254 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 288/608] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:27 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:27.866666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:27.867712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:27.869899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:27.876425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:27.877590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:27.878126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:27.878945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:27.879595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:27.880745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.111956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:28.121441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:28.123098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:28.124506 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-16152f55-2e05-455f-8b51-e24249995d03 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1361 microversion: 2.25 time: 0.264601 Oct 05 17:33:28.125119 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 289/609] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:27 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:28.130472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9fce59d-21d0-4fd4-ab52-c3cc2503b739 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:28.131283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f9fce59d-21d0-4fd4-ab52-c3cc2503b739 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:28.137519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9fce59d-21d0-4fd4-ab52-c3cc2503b739 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.138236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9fce59d-21d0-4fd4-ab52-c3cc2503b739 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.138831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9fce59d-21d0-4fd4-ab52-c3cc2503b739 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.139668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9fce59d-21d0-4fd4-ab52-c3cc2503b739 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.140266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9fce59d-21d0-4fd4-ab52-c3cc2503b739 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.140832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9fce59d-21d0-4fd4-ab52-c3cc2503b739 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.416519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:33:28.416964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:33:28.417442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:33:28.417879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:33:28.418300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:33:28.428612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.429106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.429542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.430266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.430783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.431218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.451656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Getting quotas for project 78997afe35c142c486d6079e462c5ddf. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:33:28.456731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Getting quotas for user b2af401d63f24d9a9cb58c54602768f7 and project 78997afe35c142c486d6079e462c5ddf. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:33:28.469357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:33:28.471836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:33:28.523759 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab0ba728-f35c-4788-814b-d689b9c2a425 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759324 Oct 05 17:33:28.530547 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 321/610] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:33:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:33:28.530547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:28.530547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:28.537364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.537727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.538167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.538902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.539539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.540151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.580043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f9fce59d-21d0-4fd4-ab52-c3cc2503b739 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:28.589908 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f9fce59d-21d0-4fd4-ab52-c3cc2503b739 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1316 microversion: 2.1 time: 0.463163 Oct 05 17:33:28.590590 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 290/611] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:28 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1316 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:28.595324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-40553f19-c73c-44da-b49c-e56defe38fdb tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:28.596203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-40553f19-c73c-44da-b49c-e56defe38fdb tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:28.605115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40553f19-c73c-44da-b49c-e56defe38fdb tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.605911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40553f19-c73c-44da-b49c-e56defe38fdb tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.606581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40553f19-c73c-44da-b49c-e56defe38fdb tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.607429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40553f19-c73c-44da-b49c-e56defe38fdb tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.608028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40553f19-c73c-44da-b49c-e56defe38fdb tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.608915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40553f19-c73c-44da-b49c-e56defe38fdb tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.647215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:28.660242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:28.661931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:28.667448 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d7c2288-6e7c-4982-9444-b1f70b556108 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.141349 Oct 05 17:33:28.668196 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 322/612] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:28 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:28.674008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9dff5c5a-6605-4d3d-9a35-a079a8a07959 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:28.674850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9dff5c5a-6605-4d3d-9a35-a079a8a07959 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:28.697302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-40553f19-c73c-44da-b49c-e56defe38fdb tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:28.699535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dff5c5a-6605-4d3d-9a35-a079a8a07959 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.701572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dff5c5a-6605-4d3d-9a35-a079a8a07959 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.707107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dff5c5a-6605-4d3d-9a35-a079a8a07959 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.708007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dff5c5a-6605-4d3d-9a35-a079a8a07959 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.708623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dff5c5a-6605-4d3d-9a35-a079a8a07959 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.709149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dff5c5a-6605-4d3d-9a35-a079a8a07959 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.725087 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-40553f19-c73c-44da-b49c-e56defe38fdb tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.133306 Oct 05 17:33:28.726675 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 291/613] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:28 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:28.732241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-928ee508-605f-4fec-927b-d70fbcb25577 req-5e88f953-d7f6-4e1e-84a7-a480138d7b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9991e62c-dc92-416f-a357-785ac57919cd", "tag": "4406b87b-0391-45db-9f46-d867ac4e374e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:28.742787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-928ee508-605f-4fec-927b-d70fbcb25577 req-5e88f953-d7f6-4e1e-84a7-a480138d7b18 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.743396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-928ee508-605f-4fec-927b-d70fbcb25577 req-5e88f953-d7f6-4e1e-84a7-a480138d7b18 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.743919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-928ee508-605f-4fec-927b-d70fbcb25577 req-5e88f953-d7f6-4e1e-84a7-a480138d7b18 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.763041 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-928ee508-605f-4fec-927b-d70fbcb25577 req-5e88f953-d7f6-4e1e-84a7-a480138d7b18 service nova] Creating event network-changed:4406b87b-0391-45db-9f46-d867ac4e374e for instance 9991e62c-dc92-416f-a357-785ac57919cd on n-h1-835595-3 Oct 05 17:33:28.768447 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-928ee508-605f-4fec-927b-d70fbcb25577 req-5e88f953-d7f6-4e1e-84a7-a480138d7b18 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040512 Oct 05 17:33:28.769890 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 292/614] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:28.775639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7dc8c4b1-0600-4ab1-ba7c-00a3e26d79cc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:28.776332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7dc8c4b1-0600-4ab1-ba7c-00a3e26d79cc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:28.897363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7dc8c4b1-0600-4ab1-ba7c-00a3e26d79cc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:28.910014 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7dc8c4b1-0600-4ab1-ba7c-00a3e26d79cc tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1218 microversion: 2.1 time: 0.136195 Oct 05 17:33:28.911191 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 293/615] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:28 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:28.917031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-31a72548-ce1b-4ced-aa2a-26915d1265d2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:28.917835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-31a72548-ce1b-4ced-aa2a-26915d1265d2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:28.934771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31a72548-ce1b-4ced-aa2a-26915d1265d2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.935472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31a72548-ce1b-4ced-aa2a-26915d1265d2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.936185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31a72548-ce1b-4ced-aa2a-26915d1265d2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:28.936919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31a72548-ce1b-4ced-aa2a-26915d1265d2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:28.937825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31a72548-ce1b-4ced-aa2a-26915d1265d2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:28.938834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31a72548-ce1b-4ced-aa2a-26915d1265d2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.147205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-31a72548-ce1b-4ced-aa2a-26915d1265d2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:29.156505 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-31a72548-ce1b-4ced-aa2a-26915d1265d2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.244031 Oct 05 17:33:29.157103 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 294/616] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:28 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:29.161593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3d2b7082-b3ad-46aa-9a28-58a67bf5989c tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:29.162195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3d2b7082-b3ad-46aa-9a28-58a67bf5989c tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:29.168699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d2b7082-b3ad-46aa-9a28-58a67bf5989c tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.169109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d2b7082-b3ad-46aa-9a28-58a67bf5989c tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.169750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d2b7082-b3ad-46aa-9a28-58a67bf5989c tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.170500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d2b7082-b3ad-46aa-9a28-58a67bf5989c tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.171125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d2b7082-b3ad-46aa-9a28-58a67bf5989c tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.171747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d2b7082-b3ad-46aa-9a28-58a67bf5989c tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.173231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9dff5c5a-6605-4d3d-9a35-a079a8a07959 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:29.181070 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9dff5c5a-6605-4d3d-9a35-a079a8a07959 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1313 microversion: 2.1 time: 0.511220 Oct 05 17:33:29.181859 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 323/617] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:28 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1313 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:29.186027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-46db8285-19d2-475b-97d4-9ae94cd8fd20 req-86b82daf-5b7b-44de-b007-7222de6445d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac05337-a984-4965-8063-1ab27852ea1f", "tag": "1861731d-3108-4910-9e4d-39792f5b782d"}, {"name": "network-changed", "server_uuid": "be31de3d-24a3-4ab8-9ade-0025b4e7e27f", "tag": "330929f2-a2ab-4071-8916-ad38327eb67e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:29.196733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-46db8285-19d2-475b-97d4-9ae94cd8fd20 req-86b82daf-5b7b-44de-b007-7222de6445d5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.197214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-46db8285-19d2-475b-97d4-9ae94cd8fd20 req-86b82daf-5b7b-44de-b007-7222de6445d5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.197643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-46db8285-19d2-475b-97d4-9ae94cd8fd20 req-86b82daf-5b7b-44de-b007-7222de6445d5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.211054 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-46db8285-19d2-475b-97d4-9ae94cd8fd20 req-86b82daf-5b7b-44de-b007-7222de6445d5 service nova] Creating event network-changed:1861731d-3108-4910-9e4d-39792f5b782d for instance bac05337-a984-4965-8063-1ab27852ea1f on n-h1-835595-3 Oct 05 17:33:29.211556 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-46db8285-19d2-475b-97d4-9ae94cd8fd20 req-86b82daf-5b7b-44de-b007-7222de6445d5 service nova] Creating event network-changed:330929f2-a2ab-4071-8916-ad38327eb67e for instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f on n-h1-835595-3 Oct 05 17:33:29.218349 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-46db8285-19d2-475b-97d4-9ae94cd8fd20 req-86b82daf-5b7b-44de-b007-7222de6445d5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035511 Oct 05 17:33:29.219218 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 324/618] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:29.224403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:29.225109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:29.232279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.232823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.234363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.234363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.236396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.236396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.328546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3d2b7082-b3ad-46aa-9a28-58a67bf5989c tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:29.337052 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3d2b7082-b3ad-46aa-9a28-58a67bf5989c tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.178938 Oct 05 17:33:29.337883 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 295/619] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:29 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:29.533237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:29.554042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:29.555816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:29.557335 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1dc2dd35-9629-4fdf-94c8-c63380b398fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1361 microversion: 2.25 time: 0.337238 Oct 05 17:33:29.558091 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 325/620] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:29 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1361 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:29.616386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55a88b01-8b65-4d87-998e-2a03126688e0 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:29.617305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-55a88b01-8b65-4d87-998e-2a03126688e0 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:29.629499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55a88b01-8b65-4d87-998e-2a03126688e0 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.631283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55a88b01-8b65-4d87-998e-2a03126688e0 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.632863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55a88b01-8b65-4d87-998e-2a03126688e0 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.634901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55a88b01-8b65-4d87-998e-2a03126688e0 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.635964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55a88b01-8b65-4d87-998e-2a03126688e0 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.637730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55a88b01-8b65-4d87-998e-2a03126688e0 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.700004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:29.702470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:29.711802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.712720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.713541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.714427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.714924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.715320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.832945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:29.874074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:29.880278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:29.896189 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-569c40bb-4777-44e8-a8fc-96f0c19e3ab1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.199293 Oct 05 17:33:29.938402 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 326/621] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:29 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:29.943696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9dc268c1-4a8a-4a76-89aa-fed8c5d64c8a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:29.944532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9dc268c1-4a8a-4a76-89aa-fed8c5d64c8a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:29.953506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dc268c1-4a8a-4a76-89aa-fed8c5d64c8a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.954256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dc268c1-4a8a-4a76-89aa-fed8c5d64c8a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.955029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dc268c1-4a8a-4a76-89aa-fed8c5d64c8a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:29.955907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dc268c1-4a8a-4a76-89aa-fed8c5d64c8a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:29.956518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dc268c1-4a8a-4a76-89aa-fed8c5d64c8a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:29.957098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dc268c1-4a8a-4a76-89aa-fed8c5d64c8a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.122924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-9dc268c1-4a8a-4a76-89aa-fed8c5d64c8a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:30.145244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-55a88b01-8b65-4d87-998e-2a03126688e0 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:30.153831 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-55a88b01-8b65-4d87-998e-2a03126688e0 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1316 microversion: 2.1 time: 0.541684 Oct 05 17:33:30.154847 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 296/622] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:29 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:30.159060 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9dc268c1-4a8a-4a76-89aa-fed8c5d64c8a tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.219098 Oct 05 17:33:30.170546 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 327/623] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:29 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:30.170762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b2a7a8fd-abaf-4d30-b145-33fdd3966d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:30.170762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b2a7a8fd-abaf-4d30-b145-33fdd3966d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:30.180499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a38fb995-9eda-4676-9092-739ec5cb1e86 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:30.181187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a38fb995-9eda-4676-9092-739ec5cb1e86 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:30.190012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a7a8fd-abaf-4d30-b145-33fdd3966d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.190686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a7a8fd-abaf-4d30-b145-33fdd3966d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.191213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a7a8fd-abaf-4d30-b145-33fdd3966d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.192010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a7a8fd-abaf-4d30-b145-33fdd3966d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.192684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a7a8fd-abaf-4d30-b145-33fdd3966d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.193296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a7a8fd-abaf-4d30-b145-33fdd3966d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.203434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a38fb995-9eda-4676-9092-739ec5cb1e86 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.203434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a38fb995-9eda-4676-9092-739ec5cb1e86 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.203434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a38fb995-9eda-4676-9092-739ec5cb1e86 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.204149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a38fb995-9eda-4676-9092-739ec5cb1e86 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.204610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a38fb995-9eda-4676-9092-739ec5cb1e86 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.205096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a38fb995-9eda-4676-9092-739ec5cb1e86 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.278831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2a7a8fd-abaf-4d30-b145-33fdd3966d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:30.292703 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b2a7a8fd-abaf-4d30-b145-33fdd3966d05 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1270 microversion: 2.1 time: 0.135751 Oct 05 17:33:30.294041 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 297/624] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:30 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1270 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:30.301445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-363d3417-61d8-4c2a-9037-3207d471c3d7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:30.302131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-363d3417-61d8-4c2a-9037-3207d471c3d7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:30.309404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363d3417-61d8-4c2a-9037-3207d471c3d7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.309973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363d3417-61d8-4c2a-9037-3207d471c3d7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.310500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363d3417-61d8-4c2a-9037-3207d471c3d7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.311283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363d3417-61d8-4c2a-9037-3207d471c3d7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.311792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363d3417-61d8-4c2a-9037-3207d471c3d7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.312286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363d3417-61d8-4c2a-9037-3207d471c3d7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.461320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-363d3417-61d8-4c2a-9037-3207d471c3d7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:30.471004 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-363d3417-61d8-4c2a-9037-3207d471c3d7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1313 microversion: 2.1 time: 0.175667 Oct 05 17:33:30.472525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a38fb995-9eda-4676-9092-739ec5cb1e86 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:30.475930 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 298/625] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:30 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:30.493636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-913e0c9d-c7e4-439d-862a-8a945bd20fa7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:30.496126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-913e0c9d-c7e4-439d-862a-8a945bd20fa7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:30.504492 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a38fb995-9eda-4676-9092-739ec5cb1e86 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.327735 Oct 05 17:33:30.505700 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 328/626] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:30 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:30.525409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-913e0c9d-c7e4-439d-862a-8a945bd20fa7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.526004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-913e0c9d-c7e4-439d-862a-8a945bd20fa7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.526578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-913e0c9d-c7e4-439d-862a-8a945bd20fa7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.527489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-913e0c9d-c7e4-439d-862a-8a945bd20fa7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.528073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-913e0c9d-c7e4-439d-862a-8a945bd20fa7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.528591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-913e0c9d-c7e4-439d-862a-8a945bd20fa7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.585510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:30.587259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:30.596820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.597721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.598128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.599049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.599896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.600330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.826893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-913e0c9d-c7e4-439d-862a-8a945bd20fa7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:30.836158 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-913e0c9d-c7e4-439d-862a-8a945bd20fa7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.356619 Oct 05 17:33:30.836863 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 299/627] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:30 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:30.920060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:30.932688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:30.933152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:30.933791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:30.934477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:30.935796 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf8d3a32-4aa3-4ca1-a4d5-71a0738a9761 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1361 microversion: 2.25 time: 0.356241 Oct 05 17:33:30.936499 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 329/628] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:30 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1361 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:30.941086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.941598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.942029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:30.942801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:30.943270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:30.943684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.012290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:31.021845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:31.023476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:31.030036 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6da81406-2805-4d1b-a6e1-0a1d762608f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1558 microversion: 2.91 time: 0.101031 Oct 05 17:33:31.030660 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 300/629] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:30 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1558 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:31.177808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f3d441ad-5f7a-4ff8-9909-2c7d86e3aeb9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:31.178452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f3d441ad-5f7a-4ff8-9909-2c7d86e3aeb9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:31.185608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3d441ad-5f7a-4ff8-9909-2c7d86e3aeb9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.186208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3d441ad-5f7a-4ff8-9909-2c7d86e3aeb9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.186680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3d441ad-5f7a-4ff8-9909-2c7d86e3aeb9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.187513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3d441ad-5f7a-4ff8-9909-2c7d86e3aeb9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.188049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3d441ad-5f7a-4ff8-9909-2c7d86e3aeb9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.188568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3d441ad-5f7a-4ff8-9909-2c7d86e3aeb9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.189387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-738a7c06-e174-421b-bfd7-4aed6264972f tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:31.190355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-738a7c06-e174-421b-bfd7-4aed6264972f tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:31.196970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-738a7c06-e174-421b-bfd7-4aed6264972f tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.197526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-738a7c06-e174-421b-bfd7-4aed6264972f tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.198023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-738a7c06-e174-421b-bfd7-4aed6264972f tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.198802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-738a7c06-e174-421b-bfd7-4aed6264972f tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.199332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-738a7c06-e174-421b-bfd7-4aed6264972f tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.199848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-738a7c06-e174-421b-bfd7-4aed6264972f tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.273119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-738a7c06-e174-421b-bfd7-4aed6264972f tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:31.291056 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-738a7c06-e174-421b-bfd7-4aed6264972f tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.105795 Oct 05 17:33:31.291839 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 301/630] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:31 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:31.317254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2923c88f-110b-40b9-88ed-5ef97b2bc447 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:31.317860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2923c88f-110b-40b9-88ed-5ef97b2bc447 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:31.327078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2923c88f-110b-40b9-88ed-5ef97b2bc447 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.327570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2923c88f-110b-40b9-88ed-5ef97b2bc447 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.327933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f3d441ad-5f7a-4ff8-9909-2c7d86e3aeb9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:31.328059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2923c88f-110b-40b9-88ed-5ef97b2bc447 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.328868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2923c88f-110b-40b9-88ed-5ef97b2bc447 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.329139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2923c88f-110b-40b9-88ed-5ef97b2bc447 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.329558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2923c88f-110b-40b9-88ed-5ef97b2bc447 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.337420 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f3d441ad-5f7a-4ff8-9909-2c7d86e3aeb9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1316 microversion: 2.1 time: 0.163620 Oct 05 17:33:31.338190 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 330/631] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:31 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:31.399407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2923c88f-110b-40b9-88ed-5ef97b2bc447 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:31.405546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:31.411658 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2923c88f-110b-40b9-88ed-5ef97b2bc447 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1276 microversion: 2.1 time: 0.098325 Oct 05 17:33:31.427314 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 302/632] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:31 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:31.499652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e69340f-91e0-4cfb-b806-2f2cfba591a0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:31.500492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7e69340f-91e0-4cfb-b806-2f2cfba591a0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:31.506856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e69340f-91e0-4cfb-b806-2f2cfba591a0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.507339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e69340f-91e0-4cfb-b806-2f2cfba591a0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.507782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e69340f-91e0-4cfb-b806-2f2cfba591a0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.508883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e69340f-91e0-4cfb-b806-2f2cfba591a0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.509042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e69340f-91e0-4cfb-b806-2f2cfba591a0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.509439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e69340f-91e0-4cfb-b806-2f2cfba591a0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.527936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9af5b35-d436-43a1-8669-cd158bc4c318 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:31.528551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f9af5b35-d436-43a1-8669-cd158bc4c318 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:31.534723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9af5b35-d436-43a1-8669-cd158bc4c318 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.535461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9af5b35-d436-43a1-8669-cd158bc4c318 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.535895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9af5b35-d436-43a1-8669-cd158bc4c318 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.536595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9af5b35-d436-43a1-8669-cd158bc4c318 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.537045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9af5b35-d436-43a1-8669-cd158bc4c318 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.537466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9af5b35-d436-43a1-8669-cd158bc4c318 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.728920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7e69340f-91e0-4cfb-b806-2f2cfba591a0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:31.731486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f9af5b35-d436-43a1-8669-cd158bc4c318 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:31.738107 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7e69340f-91e0-4cfb-b806-2f2cfba591a0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1313 microversion: 2.1 time: 0.242477 Oct 05 17:33:31.740732 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f9af5b35-d436-43a1-8669-cd158bc4c318 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.216901 Oct 05 17:33:31.746403 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 303/633] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:31 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:31.746550 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 331/634] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:31 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:31.854016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f27b251b-6dc7-4b50-b46a-167e546ea8e0 req-35f4f69f-f055-46d1-bebc-55404aae67ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f8884c-4ca4-429c-aa7b-df2fc97a928c", "name": "network-vif-plugged", "status": "completed", "tag": "a18e8b53-aade-42fb-9dfa-55dfdd67d235"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:31.860308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-254e144b-0e93-4948-98ce-0238b01311ac tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:31.860983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-254e144b-0e93-4948-98ce-0238b01311ac tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:31.863758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:31.865557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f27b251b-6dc7-4b50-b46a-167e546ea8e0 req-35f4f69f-f055-46d1-bebc-55404aae67ae service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.865993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f27b251b-6dc7-4b50-b46a-167e546ea8e0 req-35f4f69f-f055-46d1-bebc-55404aae67ae service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.866457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f27b251b-6dc7-4b50-b46a-167e546ea8e0 req-35f4f69f-f055-46d1-bebc-55404aae67ae service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.868735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-254e144b-0e93-4948-98ce-0238b01311ac tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.869318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-254e144b-0e93-4948-98ce-0238b01311ac tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.869807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-254e144b-0e93-4948-98ce-0238b01311ac tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.870774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-254e144b-0e93-4948-98ce-0238b01311ac tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.871519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-254e144b-0e93-4948-98ce-0238b01311ac tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.871924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-254e144b-0e93-4948-98ce-0238b01311ac tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.881850 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f27b251b-6dc7-4b50-b46a-167e546ea8e0 req-35f4f69f-f055-46d1-bebc-55404aae67ae service nova] Creating event network-vif-plugged:a18e8b53-aade-42fb-9dfa-55dfdd67d235 for instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c on n-h2-835595-3 Oct 05 17:33:31.887640 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f27b251b-6dc7-4b50-b46a-167e546ea8e0 req-35f4f69f-f055-46d1-bebc-55404aae67ae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037679 Oct 05 17:33:31.888791 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 304/635] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:31.962179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:31.963213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:31.970267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.971534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.972184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:31.973571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:31.974487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:31.975093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.025763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-254e144b-0e93-4948-98ce-0238b01311ac tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:32.033885 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-254e144b-0e93-4948-98ce-0238b01311ac tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.178285 Oct 05 17:33:32.034721 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 332/636] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:31 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:32.058370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:32.058961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:32.065361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.066009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.066301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.067042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.067502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.067934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.117349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:32.126455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:32.127954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:32.129090 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b46c35df-41a1-4bca-854c-95cf85639cb0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1361 microversion: 2.25 time: 0.171590 Oct 05 17:33:32.129848 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 305/637] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:31 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:32.140463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:32.151928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:32.153438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:32.159207 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87bb81e1-3605-4831-860d-fa55a5cee77c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1558 microversion: 2.91 time: 0.104956 Oct 05 17:33:32.160101 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 333/638] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:32 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1558 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:32.329679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-74d7866d-67ef-47f7-b996-e6a5e9fcafb9 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:32.330531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-74d7866d-67ef-47f7-b996-e6a5e9fcafb9 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:32.339406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74d7866d-67ef-47f7-b996-e6a5e9fcafb9 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.340167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74d7866d-67ef-47f7-b996-e6a5e9fcafb9 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.340875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74d7866d-67ef-47f7-b996-e6a5e9fcafb9 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.341990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74d7866d-67ef-47f7-b996-e6a5e9fcafb9 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.342795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74d7866d-67ef-47f7-b996-e6a5e9fcafb9 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.343504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74d7866d-67ef-47f7-b996-e6a5e9fcafb9 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.360156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-164352cc-5d2c-4349-986c-ff8518c70334 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:32.360872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-164352cc-5d2c-4349-986c-ff8518c70334 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:32.367957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-164352cc-5d2c-4349-986c-ff8518c70334 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.368689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-164352cc-5d2c-4349-986c-ff8518c70334 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.369332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-164352cc-5d2c-4349-986c-ff8518c70334 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.370027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-164352cc-5d2c-4349-986c-ff8518c70334 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.370559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-164352cc-5d2c-4349-986c-ff8518c70334 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.371002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-164352cc-5d2c-4349-986c-ff8518c70334 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.375461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:32.435883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-74d7866d-67ef-47f7-b996-e6a5e9fcafb9 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:32.455217 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-74d7866d-67ef-47f7-b996-e6a5e9fcafb9 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.129988 Oct 05 17:33:32.456606 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 306/639] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:32 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:32.461948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6999bafd-7342-483c-8043-138f5143d8bb tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:32.463060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6999bafd-7342-483c-8043-138f5143d8bb tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:32.484029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6999bafd-7342-483c-8043-138f5143d8bb tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.484541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6999bafd-7342-483c-8043-138f5143d8bb tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.484988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6999bafd-7342-483c-8043-138f5143d8bb tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.485710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6999bafd-7342-483c-8043-138f5143d8bb tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.486363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6999bafd-7342-483c-8043-138f5143d8bb tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.486715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6999bafd-7342-483c-8043-138f5143d8bb tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.556294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6999bafd-7342-483c-8043-138f5143d8bb tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:32.564695 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6999bafd-7342-483c-8043-138f5143d8bb tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1276 microversion: 2.1 time: 0.106576 Oct 05 17:33:32.565200 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 307/640] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:32 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:32.757095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-164352cc-5d2c-4349-986c-ff8518c70334 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:32.762643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa838cc3-23e7-439e-9848-af1479a3231e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:32.763868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fa838cc3-23e7-439e-9848-af1479a3231e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:32.771858 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-164352cc-5d2c-4349-986c-ff8518c70334 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1316 microversion: 2.1 time: 0.415951 Oct 05 17:33:32.787705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa838cc3-23e7-439e-9848-af1479a3231e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.787705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa838cc3-23e7-439e-9848-af1479a3231e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.787705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa838cc3-23e7-439e-9848-af1479a3231e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.787705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa838cc3-23e7-439e-9848-af1479a3231e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.788036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa838cc3-23e7-439e-9848-af1479a3231e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.788036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa838cc3-23e7-439e-9848-af1479a3231e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.790819 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 334/641] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:32 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1316 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:32.802767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-50dacb69-df18-4412-84e3-8c6767ba6e5a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:32.803977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-50dacb69-df18-4412-84e3-8c6767ba6e5a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:32.813974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50dacb69-df18-4412-84e3-8c6767ba6e5a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.815011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50dacb69-df18-4412-84e3-8c6767ba6e5a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.816183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50dacb69-df18-4412-84e3-8c6767ba6e5a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.817516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50dacb69-df18-4412-84e3-8c6767ba6e5a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:32.818855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50dacb69-df18-4412-84e3-8c6767ba6e5a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:32.819591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50dacb69-df18-4412-84e3-8c6767ba6e5a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:32.995520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa838cc3-23e7-439e-9848-af1479a3231e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.004902 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa838cc3-23e7-439e-9848-af1479a3231e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1313 microversion: 2.1 time: 0.247550 Oct 05 17:33:33.006090 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 308/642] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:32 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:33.057372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3dc6c3cd-6326-4bfb-a71d-f5b7c06e35ce tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:33.058085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3dc6c3cd-6326-4bfb-a71d-f5b7c06e35ce tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:33.064364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc6c3cd-6326-4bfb-a71d-f5b7c06e35ce tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.064875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc6c3cd-6326-4bfb-a71d-f5b7c06e35ce tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.065365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc6c3cd-6326-4bfb-a71d-f5b7c06e35ce tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.066006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc6c3cd-6326-4bfb-a71d-f5b7c06e35ce tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.066492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc6c3cd-6326-4bfb-a71d-f5b7c06e35ce tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.066913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc6c3cd-6326-4bfb-a71d-f5b7c06e35ce tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.072207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-50dacb69-df18-4412-84e3-8c6767ba6e5a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.080513 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-50dacb69-df18-4412-84e3-8c6767ba6e5a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.287580 Oct 05 17:33:33.081490 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 335/643] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:32 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:33.154727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:33.155487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:33.163450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.163955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.164408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.165152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.165609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.166030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.200779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3dc6c3cd-6326-4bfb-a71d-f5b7c06e35ce tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.209518 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3dc6c3cd-6326-4bfb-a71d-f5b7c06e35ce tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.156250 Oct 05 17:33:33.210239 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 309/644] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:33 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:33.215430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:33.216091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:33.224572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.224572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.224572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.224572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.225065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.225065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.291659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.300035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.301492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.306423 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0d720f8c-5357-4fd9-a96d-290118cb3f52 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1558 microversion: 2.91 time: 0.095031 Oct 05 17:33:33.306976 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 310/645] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:33 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1558 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:33.341046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.350100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.351595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.352762 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9d606e27-abfe-404b-b158-b96f6ecd88da tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1361 microversion: 2.25 time: 0.202030 Oct 05 17:33:33.365933 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 336/646] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:33 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:33.488901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b38e3452-6368-425c-8f5e-0c7b770971b6 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:33.490220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b38e3452-6368-425c-8f5e-0c7b770971b6 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:33.498576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b38e3452-6368-425c-8f5e-0c7b770971b6 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.501220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b38e3452-6368-425c-8f5e-0c7b770971b6 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.502312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b38e3452-6368-425c-8f5e-0c7b770971b6 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.503731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b38e3452-6368-425c-8f5e-0c7b770971b6 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.504748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b38e3452-6368-425c-8f5e-0c7b770971b6 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.505520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b38e3452-6368-425c-8f5e-0c7b770971b6 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.587609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-156ca1bc-1637-4ec5-bfd1-2740c447d4b4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:33.588169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-156ca1bc-1637-4ec5-bfd1-2740c447d4b4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:33.594409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-156ca1bc-1637-4ec5-bfd1-2740c447d4b4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.594901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-156ca1bc-1637-4ec5-bfd1-2740c447d4b4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.596079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-156ca1bc-1637-4ec5-bfd1-2740c447d4b4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.596079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-156ca1bc-1637-4ec5-bfd1-2740c447d4b4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.596515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-156ca1bc-1637-4ec5-bfd1-2740c447d4b4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.596939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-156ca1bc-1637-4ec5-bfd1-2740c447d4b4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.602820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-b38e3452-6368-425c-8f5e-0c7b770971b6 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:33.622628 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b38e3452-6368-425c-8f5e-0c7b770971b6 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.140745 Oct 05 17:33:33.633066 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 311/647] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:33 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:33.733795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-156ca1bc-1637-4ec5-bfd1-2740c447d4b4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.741896 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-156ca1bc-1637-4ec5-bfd1-2740c447d4b4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.158358 Oct 05 17:33:33.742485 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 337/648] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:33 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:33.801411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1a1c56dd-3e0f-42ca-a106-ca58e3ed7417 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:33.802012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1a1c56dd-3e0f-42ca-a106-ca58e3ed7417 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:33.808506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a1c56dd-3e0f-42ca-a106-ca58e3ed7417 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.808982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a1c56dd-3e0f-42ca-a106-ca58e3ed7417 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.809464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a1c56dd-3e0f-42ca-a106-ca58e3ed7417 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.810090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a1c56dd-3e0f-42ca-a106-ca58e3ed7417 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.810602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a1c56dd-3e0f-42ca-a106-ca58e3ed7417 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.811011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a1c56dd-3e0f-42ca-a106-ca58e3ed7417 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.904534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c5806de7-3b60-4cca-80de-23b646042595 req-f7f676c1-b80c-4a77-b8a8-0f779e8fff8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d655671e-b4fa-4bf6-85b2-5a2d556124a2", "name": "network-vif-plugged", "status": "completed", "tag": "d566d38c-8389-4104-8984-f5d607c56fe6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:33.914772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c5806de7-3b60-4cca-80de-23b646042595 req-f7f676c1-b80c-4a77-b8a8-0f779e8fff8d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:33.915339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c5806de7-3b60-4cca-80de-23b646042595 req-f7f676c1-b80c-4a77-b8a8-0f779e8fff8d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:33.915905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c5806de7-3b60-4cca-80de-23b646042595 req-f7f676c1-b80c-4a77-b8a8-0f779e8fff8d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:33.927774 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c5806de7-3b60-4cca-80de-23b646042595 req-f7f676c1-b80c-4a77-b8a8-0f779e8fff8d service nova] Creating event network-vif-plugged:d566d38c-8389-4104-8984-f5d607c56fe6 for instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 on n-h2-835595-3 Oct 05 17:33:33.934562 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c5806de7-3b60-4cca-80de-23b646042595 req-f7f676c1-b80c-4a77-b8a8-0f779e8fff8d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033290 Oct 05 17:33:33.935904 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 338/649] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:33.951596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1a1c56dd-3e0f-42ca-a106-ca58e3ed7417 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:33.959777 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1a1c56dd-3e0f-42ca-a106-ca58e3ed7417 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1316 microversion: 2.1 time: 0.162505 Oct 05 17:33:33.960351 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 312/650] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:33 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:34.029706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb4dc8c0-0afa-424c-ad38-341d60a0ae3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:34.031264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb4dc8c0-0afa-424c-ad38-341d60a0ae3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:34.038079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4dc8c0-0afa-424c-ad38-341d60a0ae3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.038621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4dc8c0-0afa-424c-ad38-341d60a0ae3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.039057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4dc8c0-0afa-424c-ad38-341d60a0ae3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.039762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4dc8c0-0afa-424c-ad38-341d60a0ae3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.040210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4dc8c0-0afa-424c-ad38-341d60a0ae3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.040775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4dc8c0-0afa-424c-ad38-341d60a0ae3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.104188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-261a8f3e-94cf-4db8-8571-b0878780e7af tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:34.105425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-261a8f3e-94cf-4db8-8571-b0878780e7af tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:34.117013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-261a8f3e-94cf-4db8-8571-b0878780e7af tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.118518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-261a8f3e-94cf-4db8-8571-b0878780e7af tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.118518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-261a8f3e-94cf-4db8-8571-b0878780e7af tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.120853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-261a8f3e-94cf-4db8-8571-b0878780e7af tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.121476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-261a8f3e-94cf-4db8-8571-b0878780e7af tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.122148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-261a8f3e-94cf-4db8-8571-b0878780e7af tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.354954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fb4dc8c0-0afa-424c-ad38-341d60a0ae3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:34.364366 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb4dc8c0-0afa-424c-ad38-341d60a0ae3c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1462 microversion: 2.1 time: 0.339761 Oct 05 17:33:34.381899 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 339/651] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:34 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1462 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:34.395200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9fd0d4e0-495d-4fae-85cf-06de06a6f421 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:34.396514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9fd0d4e0-495d-4fae-85cf-06de06a6f421 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:34.404190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fd0d4e0-495d-4fae-85cf-06de06a6f421 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.405187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fd0d4e0-495d-4fae-85cf-06de06a6f421 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.405848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fd0d4e0-495d-4fae-85cf-06de06a6f421 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.407864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fd0d4e0-495d-4fae-85cf-06de06a6f421 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.408722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fd0d4e0-495d-4fae-85cf-06de06a6f421 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.414208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-261a8f3e-94cf-4db8-8571-b0878780e7af tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:34.422159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fd0d4e0-495d-4fae-85cf-06de06a6f421 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.430059 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-261a8f3e-94cf-4db8-8571-b0878780e7af tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.328427 Oct 05 17:33:34.430985 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 313/652] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:34 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:34.446550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:34.448516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:34.469493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.470690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.471505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.472794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.473410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.474015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.663764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:34.676691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:34.678716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:34.685179 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9740a85-f486-4db5-a70a-75f4ce1fcece tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.251282 Oct 05 17:33:34.686078 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 314/653] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:34 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:34.691259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:34.691948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:34.698048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.698793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.699391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.700444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.701048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.701629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.851101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9fd0d4e0-495d-4fae-85cf-06de06a6f421 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:34.859748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:34.864417 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9fd0d4e0-495d-4fae-85cf-06de06a6f421 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.478880 Oct 05 17:33:34.864986 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 340/654] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:34 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:34.869819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:34.885037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:34.887826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:34.891185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.891701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.892085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:34.892380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.892902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.893354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.893770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.893906 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-40595f3c-1f02-49d4-a108-103e1183ef8d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1361 microversion: 2.25 time: 0.206642 Oct 05 17:33:34.902636 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 315/655] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:34 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:34.908495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-45e0e30c-5819-4805-9cfa-a8bf0423aaf3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:34.912602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-45e0e30c-5819-4805-9cfa-a8bf0423aaf3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:34.932870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45e0e30c-5819-4805-9cfa-a8bf0423aaf3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.940195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45e0e30c-5819-4805-9cfa-a8bf0423aaf3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.941247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45e0e30c-5819-4805-9cfa-a8bf0423aaf3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:34.945862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45e0e30c-5819-4805-9cfa-a8bf0423aaf3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:34.946677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45e0e30c-5819-4805-9cfa-a8bf0423aaf3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:34.947187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45e0e30c-5819-4805-9cfa-a8bf0423aaf3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:35.035383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:35.047452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 17:33:35.068554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:35.072084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-45e0e30c-5819-4805-9cfa-a8bf0423aaf3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:35.076798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:33:35.077537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:33:35.079544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:33:35.080617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:33:35.081077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:33:35.103424 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-45e0e30c-5819-4805-9cfa-a8bf0423aaf3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.198740 Oct 05 17:33:35.104547 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 316/656] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:34 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:35.110661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-abf21e13-4495-4543-9e92-cbff1a9b9e83 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:35.112167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-abf21e13-4495-4543-9e92-cbff1a9b9e83 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:35.119236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf21e13-4495-4543-9e92-cbff1a9b9e83 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:35.120397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf21e13-4495-4543-9e92-cbff1a9b9e83 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:35.120397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf21e13-4495-4543-9e92-cbff1a9b9e83 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:35.132351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf21e13-4495-4543-9e92-cbff1a9b9e83 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:35.133003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf21e13-4495-4543-9e92-cbff1a9b9e83 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:35.133457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abf21e13-4495-4543-9e92-cbff1a9b9e83 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:35.247045 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c4246143-c3c7-4e26-8a17-2c5a2fbcfa07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c/action" status: 202 len: 0 microversion: 2.1 time: 0.380790 Oct 05 17:33:35.248689 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 341/657] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:34 2022] POST /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c/action => generated 0 bytes in 383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:33:35.254043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79a84a10-6844-4d6a-a32e-d0aeb63d3b26 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:35.254903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-79a84a10-6844-4d6a-a32e-d0aeb63d3b26 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:35.262875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79a84a10-6844-4d6a-a32e-d0aeb63d3b26 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:35.263700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79a84a10-6844-4d6a-a32e-d0aeb63d3b26 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:35.264286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79a84a10-6844-4d6a-a32e-d0aeb63d3b26 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:35.265485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79a84a10-6844-4d6a-a32e-d0aeb63d3b26 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:35.266116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79a84a10-6844-4d6a-a32e-d0aeb63d3b26 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:35.266921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79a84a10-6844-4d6a-a32e-d0aeb63d3b26 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:35.395817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-abf21e13-4495-4543-9e92-cbff1a9b9e83 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:35.408817 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-abf21e13-4495-4543-9e92-cbff1a9b9e83 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.303073 Oct 05 17:33:35.410417 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 317/658] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:35 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:35.416429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65d15ad1-7f18-4bf3-a8c5-30e85f3ce12d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:35.417286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-65d15ad1-7f18-4bf3-a8c5-30e85f3ce12d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:35.424841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65d15ad1-7f18-4bf3-a8c5-30e85f3ce12d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:35.425566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65d15ad1-7f18-4bf3-a8c5-30e85f3ce12d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:35.426363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65d15ad1-7f18-4bf3-a8c5-30e85f3ce12d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:35.427325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65d15ad1-7f18-4bf3-a8c5-30e85f3ce12d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:35.427951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65d15ad1-7f18-4bf3-a8c5-30e85f3ce12d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:35.428539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65d15ad1-7f18-4bf3-a8c5-30e85f3ce12d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:35.662755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65d15ad1-7f18-4bf3-a8c5-30e85f3ce12d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:35.688958 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-65d15ad1-7f18-4bf3-a8c5-30e85f3ce12d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1471 microversion: 2.1 time: 0.277312 Oct 05 17:33:35.692077 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 318/659] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:35 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1471 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:35.705380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b00f4a8e-292a-4be2-a8c9-4498a86692f2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:35.706381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b00f4a8e-292a-4be2-a8c9-4498a86692f2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:35.723390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00f4a8e-292a-4be2-a8c9-4498a86692f2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:35.726129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00f4a8e-292a-4be2-a8c9-4498a86692f2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:35.726851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00f4a8e-292a-4be2-a8c9-4498a86692f2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:35.728370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00f4a8e-292a-4be2-a8c9-4498a86692f2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:35.729211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00f4a8e-292a-4be2-a8c9-4498a86692f2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:35.729906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00f4a8e-292a-4be2-a8c9-4498a86692f2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:35.740002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:35.884495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79a84a10-6844-4d6a-a32e-d0aeb63d3b26 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:35.897074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79a84a10-6844-4d6a-a32e-d0aeb63d3b26 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1316 microversion: 2.1 time: 0.644321 Oct 05 17:33:35.897714 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 342/660] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:35 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1316 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:35.916516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:35.918211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:35.934977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:35.935715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:35.936325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:35.937231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:35.937845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:35.938467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.054167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b00f4a8e-292a-4be2-a8c9-4498a86692f2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:36.064868 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b00f4a8e-292a-4be2-a8c9-4498a86692f2 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.371271 Oct 05 17:33:36.067557 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 319/661] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:35 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:36.081055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f69de098-d632-445d-b1c8-58dd1db0dbe3 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:36.082876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f69de098-d632-445d-b1c8-58dd1db0dbe3 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:36.102446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f69de098-d632-445d-b1c8-58dd1db0dbe3 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.102959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f69de098-d632-445d-b1c8-58dd1db0dbe3 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.104633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f69de098-d632-445d-b1c8-58dd1db0dbe3 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.105365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f69de098-d632-445d-b1c8-58dd1db0dbe3 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.105829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f69de098-d632-445d-b1c8-58dd1db0dbe3 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.106258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f69de098-d632-445d-b1c8-58dd1db0dbe3 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.142840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:36.161383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:36.164229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:36.185891 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cf2d5f1d-73d5-4fba-b863-419676ef1eaf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.286351 Oct 05 17:33:36.193920 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 343/662] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:35 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:36.200648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:36.201507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:36.215547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.217583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.218333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.219243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.223061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.223523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.489249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f69de098-d632-445d-b1c8-58dd1db0dbe3 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:36.498623 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f69de098-d632-445d-b1c8-58dd1db0dbe3 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.429868 Oct 05 17:33:36.499903 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 320/663] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:36 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:36.509102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-de79d130-6318-42c3-82be-5d85a9f659c3 req-33dc7da5-8025-482d-8223-cc88cf6d77e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac05337-a984-4965-8063-1ab27852ea1f", "name": "network-vif-plugged", "status": "completed", "tag": "1861731d-3108-4910-9e4d-39792f5b782d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:36.539146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-de79d130-6318-42c3-82be-5d85a9f659c3 req-33dc7da5-8025-482d-8223-cc88cf6d77e1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.539686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-de79d130-6318-42c3-82be-5d85a9f659c3 req-33dc7da5-8025-482d-8223-cc88cf6d77e1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.540125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-de79d130-6318-42c3-82be-5d85a9f659c3 req-33dc7da5-8025-482d-8223-cc88cf6d77e1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.571877 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-de79d130-6318-42c3-82be-5d85a9f659c3 req-33dc7da5-8025-482d-8223-cc88cf6d77e1 service nova] Creating event network-vif-plugged:1861731d-3108-4910-9e4d-39792f5b782d for instance bac05337-a984-4965-8063-1ab27852ea1f on n-h1-835595-3 Oct 05 17:33:36.588392 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-de79d130-6318-42c3-82be-5d85a9f659c3 req-33dc7da5-8025-482d-8223-cc88cf6d77e1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087236 Oct 05 17:33:36.589912 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 321/664] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:36.593167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:36.603702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e345d91-a717-420d-b021-f9f68e1dfd86 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:36.604604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e345d91-a717-420d-b021-f9f68e1dfd86 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:36.613482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:36.613829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e345d91-a717-420d-b021-f9f68e1dfd86 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.614537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e345d91-a717-420d-b021-f9f68e1dfd86 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.615286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e345d91-a717-420d-b021-f9f68e1dfd86 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.616209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e345d91-a717-420d-b021-f9f68e1dfd86 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.618452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e345d91-a717-420d-b021-f9f68e1dfd86 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.619280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e345d91-a717-420d-b021-f9f68e1dfd86 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.620735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:36.664741 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3f21f2e-271a-4526-b308-8656e0aefe00 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1556 microversion: 2.25 time: 0.453285 Oct 05 17:33:36.679182 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 344/665] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:36 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1556 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:36.696984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-101089b1-edc8-4a76-b3ab-da581a73c7e9 req-dd12ee15-4d45-4b30-8e6a-b3a9882fdaea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c980c65d-9eb1-40b0-857f-ffb08dbbc3ba", "tag": "4ec3b379-8a74-4c12-97da-5c39576a258e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:36.735809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-101089b1-edc8-4a76-b3ab-da581a73c7e9 req-dd12ee15-4d45-4b30-8e6a-b3a9882fdaea service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.736383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-101089b1-edc8-4a76-b3ab-da581a73c7e9 req-dd12ee15-4d45-4b30-8e6a-b3a9882fdaea service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.736820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-101089b1-edc8-4a76-b3ab-da581a73c7e9 req-dd12ee15-4d45-4b30-8e6a-b3a9882fdaea service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.763740 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-101089b1-edc8-4a76-b3ab-da581a73c7e9 req-dd12ee15-4d45-4b30-8e6a-b3a9882fdaea service nova] Creating event network-changed:4ec3b379-8a74-4c12-97da-5c39576a258e for instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba on n-h1-835595-3 Oct 05 17:33:36.785291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-8e345d91-a717-420d-b021-f9f68e1dfd86 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:36.787170 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-101089b1-edc8-4a76-b3ab-da581a73c7e9 req-dd12ee15-4d45-4b30-8e6a-b3a9882fdaea service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105331 Oct 05 17:33:36.791321 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 345/666] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:36.797785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-344cd9d9-a172-417d-bb77-3361b63809ce tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:36.798580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-344cd9d9-a172-417d-bb77-3361b63809ce tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:36.824570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-344cd9d9-a172-417d-bb77-3361b63809ce tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.826961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-344cd9d9-a172-417d-bb77-3361b63809ce tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.829929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-344cd9d9-a172-417d-bb77-3361b63809ce tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.832309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-344cd9d9-a172-417d-bb77-3361b63809ce tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.832801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-344cd9d9-a172-417d-bb77-3361b63809ce tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.839456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-344cd9d9-a172-417d-bb77-3361b63809ce tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.844205 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8e345d91-a717-420d-b021-f9f68e1dfd86 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.251378 Oct 05 17:33:36.845458 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 322/667] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:36 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:36.987452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ad130098-3958-4399-a08d-3ac69a08046a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:36.988310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ad130098-3958-4399-a08d-3ac69a08046a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:36.997690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad130098-3958-4399-a08d-3ac69a08046a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:36.998463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad130098-3958-4399-a08d-3ac69a08046a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:36.999071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad130098-3958-4399-a08d-3ac69a08046a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:36.999962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad130098-3958-4399-a08d-3ac69a08046a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.000727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad130098-3958-4399-a08d-3ac69a08046a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.001296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad130098-3958-4399-a08d-3ac69a08046a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.149893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-344cd9d9-a172-417d-bb77-3361b63809ce tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:37.178246 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-344cd9d9-a172-417d-bb77-3361b63809ce tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.378962 Oct 05 17:33:37.179008 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 346/668] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:36 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:37.196825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b3ee4c4-bc5b-4895-919c-2e6ac5113cc7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:37.199798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6b3ee4c4-bc5b-4895-919c-2e6ac5113cc7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:37.212583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b3ee4c4-bc5b-4895-919c-2e6ac5113cc7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.213434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b3ee4c4-bc5b-4895-919c-2e6ac5113cc7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.214115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b3ee4c4-bc5b-4895-919c-2e6ac5113cc7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.215211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b3ee4c4-bc5b-4895-919c-2e6ac5113cc7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.216053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b3ee4c4-bc5b-4895-919c-2e6ac5113cc7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.216688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b3ee4c4-bc5b-4895-919c-2e6ac5113cc7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.219840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-ad130098-3958-4399-a08d-3ac69a08046a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid d655671e-b4fa-4bf6-85b2-5a2d556124a2 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:37.245389 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ad130098-3958-4399-a08d-3ac69a08046a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 2048 microversion: 2.25 time: 0.398821 Oct 05 17:33:37.245969 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 323/669] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:36 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 2048 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:37.253409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-56c4d1f4-1c37-4716-9f51-a54d8c8d2dfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:37.254022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-56c4d1f4-1c37-4716-9f51-a54d8c8d2dfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:37.268332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56c4d1f4-1c37-4716-9f51-a54d8c8d2dfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.268849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56c4d1f4-1c37-4716-9f51-a54d8c8d2dfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.269476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56c4d1f4-1c37-4716-9f51-a54d8c8d2dfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.270168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56c4d1f4-1c37-4716-9f51-a54d8c8d2dfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.270648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56c4d1f4-1c37-4716-9f51-a54d8c8d2dfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.272027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56c4d1f4-1c37-4716-9f51-a54d8c8d2dfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.454467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6b3ee4c4-bc5b-4895-919c-2e6ac5113cc7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:37.472734 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b3ee4c4-bc5b-4895-919c-2e6ac5113cc7 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1471 microversion: 2.1 time: 0.288993 Oct 05 17:33:37.476032 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 347/670] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:37 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1471 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:37.484392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0cc412df-b7ef-4ee8-b33f-4c981a304660 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:37.491429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0cc412df-b7ef-4ee8-b33f-4c981a304660 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:37.508954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc412df-b7ef-4ee8-b33f-4c981a304660 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.509844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc412df-b7ef-4ee8-b33f-4c981a304660 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.510910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc412df-b7ef-4ee8-b33f-4c981a304660 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.512303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc412df-b7ef-4ee8-b33f-4c981a304660 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.512422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-56c4d1f4-1c37-4716-9f51-a54d8c8d2dfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:37.513136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc412df-b7ef-4ee8-b33f-4c981a304660 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.513775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc412df-b7ef-4ee8-b33f-4c981a304660 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.522571 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-56c4d1f4-1c37-4716-9f51-a54d8c8d2dfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1316 microversion: 2.1 time: 0.274839 Oct 05 17:33:37.523823 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 324/671] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:37 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1316 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:37.528703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:37.529322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:37.535553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.536041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.536476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.537177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.537628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.538049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.643711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:37.657704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:37.659233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:37.666686 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-09d5dd21-35fb-483a-a6c3-0792b4b2e0bd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.141829 Oct 05 17:33:37.667731 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 325/672] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:37 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:37.673171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c81d6b54-c202-4402-8b68-b8246289070b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:37.674050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c81d6b54-c202-4402-8b68-b8246289070b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:37.680894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c81d6b54-c202-4402-8b68-b8246289070b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.681744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c81d6b54-c202-4402-8b68-b8246289070b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.682536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c81d6b54-c202-4402-8b68-b8246289070b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.683434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c81d6b54-c202-4402-8b68-b8246289070b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.684032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c81d6b54-c202-4402-8b68-b8246289070b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.684587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c81d6b54-c202-4402-8b68-b8246289070b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.764315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0cc412df-b7ef-4ee8-b33f-4c981a304660 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:37.773589 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0cc412df-b7ef-4ee8-b33f-4c981a304660 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.295575 Oct 05 17:33:37.774559 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 348/673] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:37 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:37.779338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ae71c5a-ca23-4112-8743-da6142b0d253 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:37.780202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ae71c5a-ca23-4112-8743-da6142b0d253 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:37.787114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae71c5a-ca23-4112-8743-da6142b0d253 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.787875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae71c5a-ca23-4112-8743-da6142b0d253 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.788566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae71c5a-ca23-4112-8743-da6142b0d253 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.789483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae71c5a-ca23-4112-8743-da6142b0d253 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.799915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae71c5a-ca23-4112-8743-da6142b0d253 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.800934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae71c5a-ca23-4112-8743-da6142b0d253 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.869050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-c81d6b54-c202-4402-8b68-b8246289070b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid d655671e-b4fa-4bf6-85b2-5a2d556124a2 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:37.888607 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c81d6b54-c202-4402-8b68-b8246289070b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 2048 microversion: 2.25 time: 0.219588 Oct 05 17:33:37.889199 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 326/674] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:37 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 2048 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:37.894674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7cbae441-efce-4f79-8424-1bbc1c91c353 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:37.895627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7cbae441-efce-4f79-8424-1bbc1c91c353 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:37.902505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cbae441-efce-4f79-8424-1bbc1c91c353 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.903212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cbae441-efce-4f79-8424-1bbc1c91c353 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.903908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cbae441-efce-4f79-8424-1bbc1c91c353 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:37.904744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cbae441-efce-4f79-8424-1bbc1c91c353 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:37.905347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cbae441-efce-4f79-8424-1bbc1c91c353 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:37.906031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cbae441-efce-4f79-8424-1bbc1c91c353 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.038361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-7cbae441-efce-4f79-8424-1bbc1c91c353 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:38.058216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9ae71c5a-ca23-4112-8743-da6142b0d253 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:38.060903 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7cbae441-efce-4f79-8424-1bbc1c91c353 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.170441 Oct 05 17:33:38.061849 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 327/675] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:37 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:38.067784 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ae71c5a-ca23-4112-8743-da6142b0d253 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.291884 Oct 05 17:33:38.068951 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 349/676] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:37 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:38.076492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9fcf978-3d8c-44a8-9839-e109686854e2 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:38.080751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9fcf978-3d8c-44a8-9839-e109686854e2 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:38.081510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9fcf978-3d8c-44a8-9839-e109686854e2 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:38.082171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9fcf978-3d8c-44a8-9839-e109686854e2 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.087936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9fcf978-3d8c-44a8-9839-e109686854e2 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:38.088779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9fcf978-3d8c-44a8-9839-e109686854e2 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:38.089461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9fcf978-3d8c-44a8-9839-e109686854e2 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.119967 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c9fcf978-3d8c-44a8-9839-e109686854e2 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.053061 Oct 05 17:33:38.120704 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 328/677] 10.222.0.70 () {60 vars in 1217 bytes} [Wed Oct 5 17:33:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:33:38.133467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-835595-3", "block_migration": "auto"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:38.136586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:38.143387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:38.144115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:38.144782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.145590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:38.146346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:38.147054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.176198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'flavor' on Instance uuid d655671e-b4fa-4bf6-85b2-5a2d556124a2 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:38.180053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:38.192370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Going to try to live migrate instance to n-h1-835595-3 {{(pid=128844) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 17:33:38.201095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-af042fd7-5c40-41f7-b71c-21a55654644e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:38.201700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-af042fd7-5c40-41f7-b71c-21a55654644e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:38.208360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af042fd7-5c40-41f7-b71c-21a55654644e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:38.208828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af042fd7-5c40-41f7-b71c-21a55654644e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:38.209262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af042fd7-5c40-41f7-b71c-21a55654644e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.209942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af042fd7-5c40-41f7-b71c-21a55654644e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:38.210413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af042fd7-5c40-41f7-b71c-21a55654644e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:38.210828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af042fd7-5c40-41f7-b71c-21a55654644e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.432739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-af042fd7-5c40-41f7-b71c-21a55654644e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:38.440350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=10 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:38.445034 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-af042fd7-5c40-41f7-b71c-21a55654644e tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.247564 Oct 05 17:33:38.446502 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 329/678] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:38 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:38.464567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=36 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:38.500154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a6428334-c64c-4295-bb53-2feb45bc416d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:38.500882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a6428334-c64c-4295-bb53-2feb45bc416d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:38.508679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6428334-c64c-4295-bb53-2feb45bc416d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:38.509071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6428334-c64c-4295-bb53-2feb45bc416d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:38.509505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6428334-c64c-4295-bb53-2feb45bc416d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.510218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6428334-c64c-4295-bb53-2feb45bc416d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:38.510763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6428334-c64c-4295-bb53-2feb45bc416d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:38.512131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6428334-c64c-4295-bb53-2feb45bc416d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.784159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a6428334-c64c-4295-bb53-2feb45bc416d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:38.797840 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a6428334-c64c-4295-bb53-2feb45bc416d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1471 microversion: 2.1 time: 0.301290 Oct 05 17:33:38.801360 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 330/679] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:38 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1471 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:38.807550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7bfdf87f-0bcb-422d-ae25-6fecb272382e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:38.808080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7bfdf87f-0bcb-422d-ae25-6fecb272382e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:38.820019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bfdf87f-0bcb-422d-ae25-6fecb272382e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:38.820510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bfdf87f-0bcb-422d-ae25-6fecb272382e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:38.821173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bfdf87f-0bcb-422d-ae25-6fecb272382e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.822035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bfdf87f-0bcb-422d-ae25-6fecb272382e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:38.822519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bfdf87f-0bcb-422d-ae25-6fecb272382e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:38.822943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bfdf87f-0bcb-422d-ae25-6fecb272382e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:38.908819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:39.008609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7bfdf87f-0bcb-422d-ae25-6fecb272382e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:39.021478 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7bfdf87f-0bcb-422d-ae25-6fecb272382e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1316 microversion: 2.1 time: 0.218684 Oct 05 17:33:39.022714 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 331/680] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:38 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:39.027833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-222aca09-0e6d-40e4-8849-dc6cd4d31fe3 req-2f687f80-9a8c-4449-8ab8-a325b690dbfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be31de3d-24a3-4ab8-9ade-0025b4e7e27f", "name": "network-vif-plugged", "status": "completed", "tag": "330929f2-a2ab-4071-8916-ad38327eb67e"}, {"server_uuid": "9991e62c-dc92-416f-a357-785ac57919cd", "name": "network-vif-plugged", "status": "completed", "tag": "4406b87b-0391-45db-9f46-d867ac4e374e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:39.039695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-222aca09-0e6d-40e4-8849-dc6cd4d31fe3 req-2f687f80-9a8c-4449-8ab8-a325b690dbfb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.040178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-222aca09-0e6d-40e4-8849-dc6cd4d31fe3 req-2f687f80-9a8c-4449-8ab8-a325b690dbfb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.040610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-222aca09-0e6d-40e4-8849-dc6cd4d31fe3 req-2f687f80-9a8c-4449-8ab8-a325b690dbfb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.056252 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-222aca09-0e6d-40e4-8849-dc6cd4d31fe3 req-2f687f80-9a8c-4449-8ab8-a325b690dbfb service nova] Creating event network-vif-plugged:330929f2-a2ab-4071-8916-ad38327eb67e for instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f on n-h1-835595-3 Oct 05 17:33:39.056754 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-222aca09-0e6d-40e4-8849-dc6cd4d31fe3 req-2f687f80-9a8c-4449-8ab8-a325b690dbfb service nova] Creating event network-vif-plugged:4406b87b-0391-45db-9f46-d867ac4e374e for instance 9991e62c-dc92-416f-a357-785ac57919cd on n-h1-835595-3 Oct 05 17:33:39.063408 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-222aca09-0e6d-40e4-8849-dc6cd4d31fe3 req-2f687f80-9a8c-4449-8ab8-a325b690dbfb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039096 Oct 05 17:33:39.068805 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 332/681] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:39.075132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:39.076211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:39.083088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.084198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.085164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.087092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.087587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.088000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.170130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:39.181571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:39.183504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:39.189563 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-df3de148-13fd-4bab-a695-27a4a79b7063 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.119302 Oct 05 17:33:39.194649 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 333/682] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:39 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:39.200221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47e1e53d-13fb-4b45-9d41-62d61e8b9f3e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:39.201183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47e1e53d-13fb-4b45-9d41-62d61e8b9f3e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:39.208065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47e1e53d-13fb-4b45-9d41-62d61e8b9f3e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.208758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47e1e53d-13fb-4b45-9d41-62d61e8b9f3e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.209410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47e1e53d-13fb-4b45-9d41-62d61e8b9f3e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.210116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47e1e53d-13fb-4b45-9d41-62d61e8b9f3e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.210693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47e1e53d-13fb-4b45-9d41-62d61e8b9f3e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.211117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47e1e53d-13fb-4b45-9d41-62d61e8b9f3e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.364991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-47e1e53d-13fb-4b45-9d41-62d61e8b9f3e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:39.377998 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47e1e53d-13fb-4b45-9d41-62d61e8b9f3e tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1389 microversion: 2.1 time: 0.182038 Oct 05 17:33:39.379170 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 334/683] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:39 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1389 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:39.383816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cca51a68-54e4-4d9d-961c-60736b99ad63 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:39.384546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cca51a68-54e4-4d9d-961c-60736b99ad63 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:39.392203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cca51a68-54e4-4d9d-961c-60736b99ad63 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.392820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cca51a68-54e4-4d9d-961c-60736b99ad63 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.394110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cca51a68-54e4-4d9d-961c-60736b99ad63 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.394940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cca51a68-54e4-4d9d-961c-60736b99ad63 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.395510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cca51a68-54e4-4d9d-961c-60736b99ad63 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.396027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cca51a68-54e4-4d9d-961c-60736b99ad63 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.551994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cca51a68-54e4-4d9d-961c-60736b99ad63 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:39.564470 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cca51a68-54e4-4d9d-961c-60736b99ad63 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.180636 Oct 05 17:33:39.574442 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 335/684] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:39 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:39.590516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-49bdb75c-a6e8-4ee8-b3a7-86582aafc187 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:39.591132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-49bdb75c-a6e8-4ee8-b3a7-86582aafc187 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:39.606437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49bdb75c-a6e8-4ee8-b3a7-86582aafc187 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.606978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49bdb75c-a6e8-4ee8-b3a7-86582aafc187 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.607511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49bdb75c-a6e8-4ee8-b3a7-86582aafc187 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.608264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49bdb75c-a6e8-4ee8-b3a7-86582aafc187 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.609140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49bdb75c-a6e8-4ee8-b3a7-86582aafc187 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.609718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49bdb75c-a6e8-4ee8-b3a7-86582aafc187 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.634773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:39.723445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-49bdb75c-a6e8-4ee8-b3a7-86582aafc187 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:39.741616 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-49bdb75c-a6e8-4ee8-b3a7-86582aafc187 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.168979 Oct 05 17:33:39.742764 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 336/685] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:39 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:39.747360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-37a3ac42-7234-4827-a2cf-42ef2681d626 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:39.748156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-37a3ac42-7234-4827-a2cf-42ef2681d626 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:39.754689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37a3ac42-7234-4827-a2cf-42ef2681d626 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.755376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37a3ac42-7234-4827-a2cf-42ef2681d626 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.755977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37a3ac42-7234-4827-a2cf-42ef2681d626 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.756824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37a3ac42-7234-4827-a2cf-42ef2681d626 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.757425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37a3ac42-7234-4827-a2cf-42ef2681d626 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.757981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37a3ac42-7234-4827-a2cf-42ef2681d626 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.934063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-37a3ac42-7234-4827-a2cf-42ef2681d626 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:39.943984 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-37a3ac42-7234-4827-a2cf-42ef2681d626 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.199991 Oct 05 17:33:39.946737 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 337/686] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:39 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:39.954492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4048e229-ce98-4cbb-895f-c6139f5f9499 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:39.955474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4048e229-ce98-4cbb-895f-c6139f5f9499 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:39.963096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4048e229-ce98-4cbb-895f-c6139f5f9499 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.963620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4048e229-ce98-4cbb-895f-c6139f5f9499 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.964054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4048e229-ce98-4cbb-895f-c6139f5f9499 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:39.964864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4048e229-ce98-4cbb-895f-c6139f5f9499 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:39.965321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4048e229-ce98-4cbb-895f-c6139f5f9499 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:39.965752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4048e229-ce98-4cbb-895f-c6139f5f9499 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:40.216097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4048e229-ce98-4cbb-895f-c6139f5f9499 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:40.224431 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4048e229-ce98-4cbb-895f-c6139f5f9499 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.275974 Oct 05 17:33:40.226053 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 338/687] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:39 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:40.231310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7dfd32a3-4ebf-4166-8631-94ac33e093e1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:40.232129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7dfd32a3-4ebf-4166-8631-94ac33e093e1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:40.241295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dfd32a3-4ebf-4166-8631-94ac33e093e1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:40.242611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dfd32a3-4ebf-4166-8631-94ac33e093e1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:40.243112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dfd32a3-4ebf-4166-8631-94ac33e093e1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:40.243837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dfd32a3-4ebf-4166-8631-94ac33e093e1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:40.244302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dfd32a3-4ebf-4166-8631-94ac33e093e1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:40.244726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dfd32a3-4ebf-4166-8631-94ac33e093e1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:40.404337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7dfd32a3-4ebf-4166-8631-94ac33e093e1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:40.412393 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7dfd32a3-4ebf-4166-8631-94ac33e093e1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1316 microversion: 2.1 time: 0.184717 Oct 05 17:33:40.426703 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 339/688] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:40 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:40.432786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:40.433397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:40.440029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:40.440525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:40.441029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:40.441746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:40.442200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:40.442647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:40.520242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:40.530299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:40.531748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:40.537560 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8babe387-13d1-4baa-929e-b545d0bcf2c9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.109703 Oct 05 17:33:40.538345 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 340/689] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:40 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:40.542861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ce16fb3d-c4c2-46bc-9f3a-e4ea497ec618 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:40.543536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ce16fb3d-c4c2-46bc-9f3a-e4ea497ec618 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:40.552322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce16fb3d-c4c2-46bc-9f3a-e4ea497ec618 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:40.552817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce16fb3d-c4c2-46bc-9f3a-e4ea497ec618 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:40.553319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce16fb3d-c4c2-46bc-9f3a-e4ea497ec618 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:40.554032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce16fb3d-c4c2-46bc-9f3a-e4ea497ec618 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:40.554550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce16fb3d-c4c2-46bc-9f3a-e4ea497ec618 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:40.554978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce16fb3d-c4c2-46bc-9f3a-e4ea497ec618 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:40.700964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ce16fb3d-c4c2-46bc-9f3a-e4ea497ec618 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:40.712571 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ce16fb3d-c4c2-46bc-9f3a-e4ea497ec618 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1589 microversion: 2.1 time: 0.173341 Oct 05 17:33:40.714551 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 341/690] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:40 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1589 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:40.742293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bb86dda9-017f-4a63-80e0-43308437166a tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:40.743775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bb86dda9-017f-4a63-80e0-43308437166a tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:40.747953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:40.753442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb86dda9-017f-4a63-80e0-43308437166a tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:40.756835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb86dda9-017f-4a63-80e0-43308437166a tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:40.756835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb86dda9-017f-4a63-80e0-43308437166a tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:40.756835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb86dda9-017f-4a63-80e0-43308437166a tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:40.756835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb86dda9-017f-4a63-80e0-43308437166a tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:40.757467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb86dda9-017f-4a63-80e0-43308437166a tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:40.899639 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5f6e8831-86b9-4797-b045-2d7b9627389e tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2/action" status: 202 len: 0 microversion: 2.25 time: 2.770080 Oct 05 17:33:40.900271 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 350/691] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:33:38 2022] POST /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2/action => generated 0 bytes in 2771 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:33:40.908976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4b2b446e-9853-4bd1-b34f-6f32814394e4 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:40.909969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4b2b446e-9853-4bd1-b34f-6f32814394e4 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:40.931896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b2b446e-9853-4bd1-b34f-6f32814394e4 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:40.935142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b2b446e-9853-4bd1-b34f-6f32814394e4 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:40.936464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b2b446e-9853-4bd1-b34f-6f32814394e4 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:40.938906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b2b446e-9853-4bd1-b34f-6f32814394e4 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:40.940630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b2b446e-9853-4bd1-b34f-6f32814394e4 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:40.942000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b2b446e-9853-4bd1-b34f-6f32814394e4 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:41.082077 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4b2b446e-9853-4bd1-b34f-6f32814394e4 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.177064 Oct 05 17:33:41.082710 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 351/692] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:33:40 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f/os-interface => generated 285 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:41.087083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbc09f73-4d61-446e-9062-5608539a0a09 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:41.087692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dbc09f73-4d61-446e-9062-5608539a0a09 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:41.094339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc09f73-4d61-446e-9062-5608539a0a09 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:41.095579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc09f73-4d61-446e-9062-5608539a0a09 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:41.096461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc09f73-4d61-446e-9062-5608539a0a09 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:41.097388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc09f73-4d61-446e-9062-5608539a0a09 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:41.098023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc09f73-4d61-446e-9062-5608539a0a09 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:41.098626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc09f73-4d61-446e-9062-5608539a0a09 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:41.312680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bb86dda9-017f-4a63-80e0-43308437166a tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:41.321158 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bb86dda9-017f-4a63-80e0-43308437166a tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1321 microversion: 2.1 time: 0.605569 Oct 05 17:33:41.322056 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 342/693] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:40 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1321 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:41.341938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:41.342868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:41.349629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:41.350469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:41.351142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:41.352059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:41.352750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:41.353393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:41.379821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-dbc09f73-4d61-446e-9062-5608539a0a09 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:41.406775 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dbc09f73-4d61-446e-9062-5608539a0a09 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.322898 Oct 05 17:33:41.412007 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 352/694] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:41 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:41.418789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40d601d6-4790-4f56-8157-3a4717c17278 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:41.419405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-40d601d6-4790-4f56-8157-3a4717c17278 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:41.438314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d601d6-4790-4f56-8157-3a4717c17278 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:41.438813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d601d6-4790-4f56-8157-3a4717c17278 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:41.439322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d601d6-4790-4f56-8157-3a4717c17278 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:41.440052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d601d6-4790-4f56-8157-3a4717c17278 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:41.440515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d601d6-4790-4f56-8157-3a4717c17278 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:41.440942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d601d6-4790-4f56-8157-3a4717c17278 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:41.524422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:41.535597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:41.537426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:41.538764 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-58cfe807-e4e2-403b-8e94-c95de421073e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.200732 Oct 05 17:33:41.561058 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 343/695] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:41 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:41.566763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a12b329c-7287-41d0-b056-52e3369ad7d1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:41.567390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a12b329c-7287-41d0-b056-52e3369ad7d1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:41.573814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12b329c-7287-41d0-b056-52e3369ad7d1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:41.574326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12b329c-7287-41d0-b056-52e3369ad7d1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:41.574767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12b329c-7287-41d0-b056-52e3369ad7d1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:41.575464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12b329c-7287-41d0-b056-52e3369ad7d1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:41.575923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12b329c-7287-41d0-b056-52e3369ad7d1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:41.576408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12b329c-7287-41d0-b056-52e3369ad7d1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:41.812858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a12b329c-7287-41d0-b056-52e3369ad7d1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:41.822805 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a12b329c-7287-41d0-b056-52e3369ad7d1 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.260523 Oct 05 17:33:41.852815 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 344/696] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:41 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:41.865362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b05b0f49-1f83-4774-a9cd-c6a77f993250 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:41.865977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b05b0f49-1f83-4774-a9cd-c6a77f993250 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:41.892724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05b0f49-1f83-4774-a9cd-c6a77f993250 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:41.893222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05b0f49-1f83-4774-a9cd-c6a77f993250 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:41.895292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05b0f49-1f83-4774-a9cd-c6a77f993250 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:41.898640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05b0f49-1f83-4774-a9cd-c6a77f993250 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:41.902196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05b0f49-1f83-4774-a9cd-c6a77f993250 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:41.902759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05b0f49-1f83-4774-a9cd-c6a77f993250 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.104519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b05b0f49-1f83-4774-a9cd-c6a77f993250 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:42.113887 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b05b0f49-1f83-4774-a9cd-c6a77f993250 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1316 microversion: 2.1 time: 0.259863 Oct 05 17:33:42.114515 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 345/697] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:41 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:42.135331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:42.136007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:42.142270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.142792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.143227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.144139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.144388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.144793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.212736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:42.221751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:42.223029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40d601d6-4790-4f56-8157-3a4717c17278 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:42.223466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:42.234823 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-546492e8-2133-4e4a-83aa-36d008e5fcf1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.103467 Oct 05 17:33:42.235837 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-40d601d6-4790-4f56-8157-3a4717c17278 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.822278 Oct 05 17:33:42.236497 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 353/698] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:41 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:42.250771 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 346/699] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:42 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:42.344782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99f3170c-1c67-4f22-8737-0fbe7868ad71 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:42.345756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99f3170c-1c67-4f22-8737-0fbe7868ad71 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:42.355994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99f3170c-1c67-4f22-8737-0fbe7868ad71 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.359417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99f3170c-1c67-4f22-8737-0fbe7868ad71 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.360053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99f3170c-1c67-4f22-8737-0fbe7868ad71 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.360974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99f3170c-1c67-4f22-8737-0fbe7868ad71 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.362320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99f3170c-1c67-4f22-8737-0fbe7868ad71 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.363692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99f3170c-1c67-4f22-8737-0fbe7868ad71 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.439453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b5c5729-d40c-4867-9c76-ec679b761b41 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:42.440070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b5c5729-d40c-4867-9c76-ec679b761b41 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:42.446343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5c5729-d40c-4867-9c76-ec679b761b41 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.446932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5c5729-d40c-4867-9c76-ec679b761b41 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.447375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5c5729-d40c-4867-9c76-ec679b761b41 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.448074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5c5729-d40c-4867-9c76-ec679b761b41 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.448533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5c5729-d40c-4867-9c76-ec679b761b41 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.448973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5c5729-d40c-4867-9c76-ec679b761b41 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.533763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-6b5c5729-d40c-4867-9c76-ec679b761b41 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:42.565548 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b5c5729-d40c-4867-9c76-ec679b761b41 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.130056 Oct 05 17:33:42.566093 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 347/700] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:42 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:42.583345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:42.584114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:42.591085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.591603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.592032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.592729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.593178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.593597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.757853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:42.775389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99f3170c-1c67-4f22-8737-0fbe7868ad71 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:42.777684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:42.779922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:42.781177 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b09fb256-dd7f-4158-8bd6-5e497685c8a9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.214066 Oct 05 17:33:42.782262 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 348/701] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:42 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:42.797187 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99f3170c-1c67-4f22-8737-0fbe7868ad71 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1470 microversion: 2.1 time: 0.456550 Oct 05 17:33:42.799360 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 354/702] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:42 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1470 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:42.823610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a4aab5f-c40c-4b52-b137-28e600d52309 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:42.824161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7a4aab5f-c40c-4b52-b137-28e600d52309 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:42.831482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4aab5f-c40c-4b52-b137-28e600d52309 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.831982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4aab5f-c40c-4b52-b137-28e600d52309 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.836391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4aab5f-c40c-4b52-b137-28e600d52309 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.837216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4aab5f-c40c-4b52-b137-28e600d52309 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.837671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4aab5f-c40c-4b52-b137-28e600d52309 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.839581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4aab5f-c40c-4b52-b137-28e600d52309 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.850607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-16b1ac90-3343-4e78-80f5-07ec6721817c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:42.851529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-16b1ac90-3343-4e78-80f5-07ec6721817c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:42.858220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16b1ac90-3343-4e78-80f5-07ec6721817c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.862554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16b1ac90-3343-4e78-80f5-07ec6721817c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.863659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16b1ac90-3343-4e78-80f5-07ec6721817c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.864627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16b1ac90-3343-4e78-80f5-07ec6721817c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:42.865269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16b1ac90-3343-4e78-80f5-07ec6721817c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:42.866213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16b1ac90-3343-4e78-80f5-07ec6721817c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:42.872684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-7a4aab5f-c40c-4b52-b137-28e600d52309 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lazy-loading 'flavor' on Instance uuid be31de3d-24a3-4ab8-9ade-0025b4e7e27f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:42.998125 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a4aab5f-c40c-4b52-b137-28e600d52309 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f/action" status: 202 len: 0 microversion: 2.1 time: 0.178154 Oct 05 17:33:42.998858 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 349/703] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:42 2022] POST /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:33:43.009258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b6bee26-e086-42dd-b410-ad0b0be79b4b tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:43.010113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b6bee26-e086-42dd-b410-ad0b0be79b4b tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:43.017947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6bee26-e086-42dd-b410-ad0b0be79b4b tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.018665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6bee26-e086-42dd-b410-ad0b0be79b4b tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.019824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6bee26-e086-42dd-b410-ad0b0be79b4b tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.020700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6bee26-e086-42dd-b410-ad0b0be79b4b tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.021829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6bee26-e086-42dd-b410-ad0b0be79b4b tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.022531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6bee26-e086-42dd-b410-ad0b0be79b4b tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.250774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-16b1ac90-3343-4e78-80f5-07ec6721817c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:43.264730 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-16b1ac90-3343-4e78-80f5-07ec6721817c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.417685 Oct 05 17:33:43.265914 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 355/704] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:42 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:43.284386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9cabc1ca-2345-4f9f-89a7-af9989ab992b tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:43.289441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9cabc1ca-2345-4f9f-89a7-af9989ab992b tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:43.298302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cabc1ca-2345-4f9f-89a7-af9989ab992b tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.299741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cabc1ca-2345-4f9f-89a7-af9989ab992b tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.300684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cabc1ca-2345-4f9f-89a7-af9989ab992b tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.301631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cabc1ca-2345-4f9f-89a7-af9989ab992b tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.302611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cabc1ca-2345-4f9f-89a7-af9989ab992b tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.303578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cabc1ca-2345-4f9f-89a7-af9989ab992b tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.311150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:43.319563 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b6bee26-e086-42dd-b410-ad0b0be79b4b tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1629 microversion: 2.1 time: 0.314244 Oct 05 17:33:43.330533 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 350/705] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:43 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1629 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:43.330533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-45140b8b-160b-4747-ac77-4febbcadf00b tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:43.330533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-45140b8b-160b-4747-ac77-4febbcadf00b tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:43.339736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45140b8b-160b-4747-ac77-4febbcadf00b tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.339736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45140b8b-160b-4747-ac77-4febbcadf00b tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.339736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45140b8b-160b-4747-ac77-4febbcadf00b tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.339736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45140b8b-160b-4747-ac77-4febbcadf00b tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.350795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45140b8b-160b-4747-ac77-4febbcadf00b tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.351463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45140b8b-160b-4747-ac77-4febbcadf00b tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.530116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-45140b8b-160b-4747-ac77-4febbcadf00b tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:43.540641 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-45140b8b-160b-4747-ac77-4febbcadf00b tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.217212 Oct 05 17:33:43.542361 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 351/706] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:43 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:43.548752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:43.550900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:43.558542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.559350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.560185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.561133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.562606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.563389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.646105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:43.660026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9cabc1ca-2345-4f9f-89a7-af9989ab992b tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:43.670729 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9cabc1ca-2345-4f9f-89a7-af9989ab992b tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1505 microversion: 2.1 time: 0.403183 Oct 05 17:33:43.671553 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 356/707] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:43 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:43.676148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b6d62230-5eba-4e53-841d-381923748358 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:43.684112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:43.685111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b6d62230-5eba-4e53-841d-381923748358 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:43.685948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:43.696355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6d62230-5eba-4e53-841d-381923748358 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.697566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6d62230-5eba-4e53-841d-381923748358 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.698622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6d62230-5eba-4e53-841d-381923748358 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.699631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6d62230-5eba-4e53-841d-381923748358 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.700332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6d62230-5eba-4e53-841d-381923748358 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.701001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6d62230-5eba-4e53-841d-381923748358 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.703430 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8098fa07-5f4d-44db-b1b1-a0566853fc56 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.159119 Oct 05 17:33:43.714662 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 352/708] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:43 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:43.720517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e297c68e-ab46-43ad-ac19-9fc124b19b41 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1905454302"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:43.720517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e297c68e-ab46-43ad-ac19-9fc124b19b41 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:43.736022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e297c68e-ab46-43ad-ac19-9fc124b19b41 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.736513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e297c68e-ab46-43ad-ac19-9fc124b19b41 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.736943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e297c68e-ab46-43ad-ac19-9fc124b19b41 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.737641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e297c68e-ab46-43ad-ac19-9fc124b19b41 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:43.738093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e297c68e-ab46-43ad-ac19-9fc124b19b41 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:43.738531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e297c68e-ab46-43ad-ac19-9fc124b19b41 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:43.960884 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.network.security_group_api [None req-e297c68e-ab46-43ad-ac19-9fc124b19b41 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Adding security group 8b532bf8-3500-47c8-b7f7-782ad031769e to port 4406b87b-0391-45db-9f46-d867ac4e374e Oct 05 17:33:44.017822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-b6d62230-5eba-4e53-841d-381923748358 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:44.055039 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b6d62230-5eba-4e53-841d-381923748358 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.382164 Oct 05 17:33:44.070680 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 357/709] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:43 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:44.081886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:44.082845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:44.089777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:44.090262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:44.090893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:44.091756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:44.092367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:44.093050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:44.439988 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e297c68e-ab46-43ad-ac19-9fc124b19b41 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd/action" status: 202 len: 0 microversion: 2.1 time: 0.724120 Oct 05 17:33:44.458360 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 353/710] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:43 2022] POST /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd/action => generated 0 bytes in 743 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:33:44.468605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2edc59e1-3949-4fcb-b8be-0f61d5e5f543 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:44.481447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2edc59e1-3949-4fcb-b8be-0f61d5e5f543 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:44.494423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:44.510469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2edc59e1-3949-4fcb-b8be-0f61d5e5f543 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:44.520209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2edc59e1-3949-4fcb-b8be-0f61d5e5f543 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:44.521241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:44.523343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:44.525591 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2489456a-1c78-4891-88c4-945f698a356d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.453306 Oct 05 17:33:44.525982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2edc59e1-3949-4fcb-b8be-0f61d5e5f543 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:44.534324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2edc59e1-3949-4fcb-b8be-0f61d5e5f543 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:44.534324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2edc59e1-3949-4fcb-b8be-0f61d5e5f543 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:44.534324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2edc59e1-3949-4fcb-b8be-0f61d5e5f543 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:44.537750 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 358/711] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:44 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:44.548816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a3509886-7c8b-4cef-94ff-db59200c2638 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:44.549634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a3509886-7c8b-4cef-94ff-db59200c2638 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:44.582754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3509886-7c8b-4cef-94ff-db59200c2638 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:44.584872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3509886-7c8b-4cef-94ff-db59200c2638 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:44.585427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3509886-7c8b-4cef-94ff-db59200c2638 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:44.587167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3509886-7c8b-4cef-94ff-db59200c2638 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:44.589205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3509886-7c8b-4cef-94ff-db59200c2638 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:44.590857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3509886-7c8b-4cef-94ff-db59200c2638 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:44.883768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2edc59e1-3949-4fcb-b8be-0f61d5e5f543 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:44.892314 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2edc59e1-3949-4fcb-b8be-0f61d5e5f543 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.431653 Oct 05 17:33:44.895011 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 354/712] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:44 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:44.905555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b0288f86-6eed-4135-899a-be1fe09f47a8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f777584bb80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:45.138873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-b0288f86-6eed-4135-899a-be1fe09f47a8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 8b532bf8-3500-47c8-b7f7-782ad031769e in use.", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:33:45.139792 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-b0288f86-6eed-4135-899a-be1fe09f47a8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security Group 8b532bf8-3500-47c8-b7f7-782ad031769e in use. Oct 05 17:33:45.139792 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-632cf8f2-a4bb-4ed0-8077-9e48da72de63'] Oct 05 17:33:45.141108 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a3509886-7c8b-4cef-94ff-db59200c2638 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1612 microversion: 2.1 time: 0.601776 Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b0288f86-6eed-4135-899a-be1fe09f47a8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-security-groups/8b532bf8-3500-47c8-b7f7-782ad031769e HTTP/1.1 Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:33:45.142663 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: exception: Security Group 8b532bf8-3500-47c8-b7f7-782ad031769e in use. Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-632cf8f2-a4bb-4ed0-8077-9e48da72de63'] Oct 05 17:33:45.144162 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '8b532bf8-3500-47c8-b7f7-782ad031769e'} Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:45.145102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 8b532bf8-3500-47c8-b7f7-782ad031769e in use. Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-632cf8f2-a4bb-4ed0-8077-9e48da72de63'] Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 8b532bf8-3500-47c8-b7f7-782ad031769e in use. Oct 05 17:33:45.146423 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-632cf8f2-a4bb-4ed0-8077-9e48da72de63'] Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 8b532bf8-3500-47c8-b7f7-782ad031769e in use. Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-632cf8f2-a4bb-4ed0-8077-9e48da72de63'] Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:45.147791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:45.149280 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:45.149280 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:45.149280 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:45.149280 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 8b532bf8-3500-47c8-b7f7-782ad031769e in use. Oct 05 17:33:45.149280 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-632cf8f2-a4bb-4ed0-8077-9e48da72de63'] Oct 05 17:33:45.149280 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:45.149770 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 359/713] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:44 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1612 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:45.151926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b0288f86-6eed-4135-899a-be1fe09f47a8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 400 to user: Security Group 8b532bf8-3500-47c8-b7f7-782ad031769e in use. Oct 05 17:33:45.151926 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-632cf8f2-a4bb-4ed0-8077-9e48da72de63'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:45.153028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b0288f86-6eed-4135-899a-be1fe09f47a8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/8b532bf8-3500-47c8-b7f7-782ad031769e" status: 400 len: 185 microversion: 2.1 time: 0.256010 Oct 05 17:33:45.153738 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 355/714] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:33:44 2022] DELETE /compute/v2.1/os-security-groups/8b532bf8-3500-47c8-b7f7-782ad031769e => generated 185 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:33:45.161542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3cc4d992-379c-49af-acb9-4b72ea3f9e30 req-d8e2424c-4d50-4b82-b2d1-0f7d1b43cb7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9991e62c-dc92-416f-a357-785ac57919cd", "tag": "4406b87b-0391-45db-9f46-d867ac4e374e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:45.162289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48444b68-d0a1-4049-a2ed-26891592c748 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:45.162917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-48444b68-d0a1-4049-a2ed-26891592c748 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:45.171777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48444b68-d0a1-4049-a2ed-26891592c748 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.172435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48444b68-d0a1-4049-a2ed-26891592c748 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.172870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48444b68-d0a1-4049-a2ed-26891592c748 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.173614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48444b68-d0a1-4049-a2ed-26891592c748 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.174070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48444b68-d0a1-4049-a2ed-26891592c748 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.174516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48444b68-d0a1-4049-a2ed-26891592c748 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.197039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3cc4d992-379c-49af-acb9-4b72ea3f9e30 req-d8e2424c-4d50-4b82-b2d1-0f7d1b43cb7c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.197540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3cc4d992-379c-49af-acb9-4b72ea3f9e30 req-d8e2424c-4d50-4b82-b2d1-0f7d1b43cb7c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.197969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3cc4d992-379c-49af-acb9-4b72ea3f9e30 req-d8e2424c-4d50-4b82-b2d1-0f7d1b43cb7c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.218942 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3cc4d992-379c-49af-acb9-4b72ea3f9e30 req-d8e2424c-4d50-4b82-b2d1-0f7d1b43cb7c service nova] Creating event network-changed:4406b87b-0391-45db-9f46-d867ac4e374e for instance 9991e62c-dc92-416f-a357-785ac57919cd on n-h1-835595-3 Oct 05 17:33:45.231156 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3cc4d992-379c-49af-acb9-4b72ea3f9e30 req-d8e2424c-4d50-4b82-b2d1-0f7d1b43cb7c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075992 Oct 05 17:33:45.234950 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 356/715] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:45.257136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2a91b672-0a2c-4be2-abef-575ee10c2d21 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:45.258378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2a91b672-0a2c-4be2-abef-575ee10c2d21 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:45.267248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a91b672-0a2c-4be2-abef-575ee10c2d21 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.267742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a91b672-0a2c-4be2-abef-575ee10c2d21 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.268175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a91b672-0a2c-4be2-abef-575ee10c2d21 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.269138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a91b672-0a2c-4be2-abef-575ee10c2d21 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.269590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a91b672-0a2c-4be2-abef-575ee10c2d21 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.270005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a91b672-0a2c-4be2-abef-575ee10c2d21 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.539230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2a91b672-0a2c-4be2-abef-575ee10c2d21 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:45.560687 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2a91b672-0a2c-4be2-abef-575ee10c2d21 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1589 microversion: 2.1 time: 0.313979 Oct 05 17:33:45.582885 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 357/716] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:45 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1589 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:45.589789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:45.590739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:45.602815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.602815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.609345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.610187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.610697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.611190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.724305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-48444b68-d0a1-4049-a2ed-26891592c748 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:45.737295 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48444b68-d0a1-4049-a2ed-26891592c748 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.590808 Oct 05 17:33:45.739664 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 360/717] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:45 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:45.756498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:45.760847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5f9401da-e784-4280-8229-e78f39da965f req-81131bd6-2d23-4f05-a3d8-ad7dff76dceb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bac05337-a984-4965-8063-1ab27852ea1f", "tag": "1861731d-3108-4910-9e4d-39792f5b782d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:45.766335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:45.772646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:45.784813 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fc4806b9-8e5f-4987-9ea2-66848159512f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.200724 Oct 05 17:33:45.787217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5f9401da-e784-4280-8229-e78f39da965f req-81131bd6-2d23-4f05-a3d8-ad7dff76dceb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.788529 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 358/718] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:45 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:45.790593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5f9401da-e784-4280-8229-e78f39da965f req-81131bd6-2d23-4f05-a3d8-ad7dff76dceb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.792374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5f9401da-e784-4280-8229-e78f39da965f req-81131bd6-2d23-4f05-a3d8-ad7dff76dceb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.798023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c6df9cc-44a6-4e45-a075-4047652826e7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:45.798931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7c6df9cc-44a6-4e45-a075-4047652826e7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:45.805136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c6df9cc-44a6-4e45-a075-4047652826e7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.805836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c6df9cc-44a6-4e45-a075-4047652826e7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.808316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c6df9cc-44a6-4e45-a075-4047652826e7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.815427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c6df9cc-44a6-4e45-a075-4047652826e7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.817563 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5f9401da-e784-4280-8229-e78f39da965f req-81131bd6-2d23-4f05-a3d8-ad7dff76dceb service nova] Creating event network-changed:1861731d-3108-4910-9e4d-39792f5b782d for instance bac05337-a984-4965-8063-1ab27852ea1f on n-h1-835595-3 Oct 05 17:33:45.818397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c6df9cc-44a6-4e45-a075-4047652826e7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.818994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c6df9cc-44a6-4e45-a075-4047652826e7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.833713 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5f9401da-e784-4280-8229-e78f39da965f req-81131bd6-2d23-4f05-a3d8-ad7dff76dceb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092536 Oct 05 17:33:45.839721 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 361/719] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:45.845461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ba3d1484-282c-4d9c-9454-19bbe651953a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:45.848294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ba3d1484-282c-4d9c-9454-19bbe651953a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:45.867572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3d1484-282c-4d9c-9454-19bbe651953a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.868058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3d1484-282c-4d9c-9454-19bbe651953a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.873866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3d1484-282c-4d9c-9454-19bbe651953a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:45.880436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3d1484-282c-4d9c-9454-19bbe651953a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:45.881156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3d1484-282c-4d9c-9454-19bbe651953a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:45.881752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3d1484-282c-4d9c-9454-19bbe651953a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.021465 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ba3d1484-282c-4d9c-9454-19bbe651953a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd/action" status: 202 len: 0 microversion: 2.1 time: 0.180207 Oct 05 17:33:46.022928 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 362/720] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:45 2022] POST /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:33:46.029031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:46.029271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-7c6df9cc-44a6-4e45-a075-4047652826e7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:46.030602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:46.038856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.040305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.041087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.042559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.043329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.044214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.081342 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7c6df9cc-44a6-4e45-a075-4047652826e7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1929 microversion: 2.75 time: 0.291502 Oct 05 17:33:46.082979 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 359/721] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:45 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1929 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:46.085578 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] HTTP exception thrown: Cannot 'migrate' instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f while it is in vm_state suspended Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Request method failure captured: Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f/action HTTP/1.1 Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 15 Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_KeVqfMZvTUhpx_-Dbgm7ohdOJgse5-QdXDattqcXDBH65Q0ApbvYTz6LE3ROP8R_jvbQ69ebC1tR0SA8oza2D01pYmVyfnsZomP9chzOcVunodTpk81a-YbTjwAHZlVsB8mgJTTsDb-XGc6T7zjgFvBc2siBAy6fIhgzmEZxg5Y4 Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f727c86299b545c39393131ddd5017f6 Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:33:46.089496 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f727c86299b545c39393131ddd5017f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f727c86299b545c39393131ddd5017f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f727c86299b545c39393131ddd5017f6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f727c86299b545c39393131ddd5017f6"}]}] Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f727c86299b545c39393131ddd5017f6 Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersAdminNegativeTestJSON-1593672326-project-admin Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 25fe6ef7486549e6b3d9080ac13362be Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1593672326-project-admin Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: {"migrate": {}} Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:33:46.091562 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot 'migrate' instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f while it is in vm_state suspended Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'be31de3d-24a3-4ab8-9ade-0025b4e7e27f', 'body': {'migrate': {}}} Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f in vm_state suspended. Cannot resize while the instance is in this state. Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.092566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f while it is in vm_state suspended Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:46.094093 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:46.095675 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:46.095675 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:46.095675 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f while it is in vm_state suspended Oct 05 17:33:46.095675 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.095977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5b5ed000-87e4-4583-8193-ffd13c468d8f req-03236fb8-e9a5-4aa7-b1e0-b786d142a54c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c980c65d-9eb1-40b0-857f-ffb08dbbc3ba", "name": "network-vif-plugged", "status": "completed", "tag": "4ec3b379-8a74-4c12-97da-5c39576a258e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:46.109658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Returning 409 to user: Cannot 'migrate' instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f while it is in vm_state suspended {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:46.110985 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c513db37-3571-44ba-a9d3-75d9df8f7c62 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f/action" status: 409 len: 148 microversion: 2.1 time: 0.086652 Oct 05 17:33:46.114953 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 363/722] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:46 2022] POST /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f/action => generated 148 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:33:46.125964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5b5ed000-87e4-4583-8193-ffd13c468d8f req-03236fb8-e9a5-4aa7-b1e0-b786d142a54c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.126521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5b5ed000-87e4-4583-8193-ffd13c468d8f req-03236fb8-e9a5-4aa7-b1e0-b786d142a54c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.126966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5b5ed000-87e4-4583-8193-ffd13c468d8f req-03236fb8-e9a5-4aa7-b1e0-b786d142a54c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.127420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:46.128032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:46.136383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.138060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.138841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.139794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.140420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.141076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.158765 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5b5ed000-87e4-4583-8193-ffd13c468d8f req-03236fb8-e9a5-4aa7-b1e0-b786d142a54c service nova] Creating event network-vif-plugged:4ec3b379-8a74-4c12-97da-5c39576a258e for instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba on n-h1-835595-3 Oct 05 17:33:46.171159 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5b5ed000-87e4-4583-8193-ffd13c468d8f req-03236fb8-e9a5-4aa7-b1e0-b786d142a54c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086385 Oct 05 17:33:46.178007 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 360/723] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:46.185817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7541b420-1b47-4718-9b1f-a8d9a3fe4e0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:46.188129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7541b420-1b47-4718-9b1f-a8d9a3fe4e0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:46.215791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7541b420-1b47-4718-9b1f-a8d9a3fe4e0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.216539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7541b420-1b47-4718-9b1f-a8d9a3fe4e0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.217123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7541b420-1b47-4718-9b1f-a8d9a3fe4e0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.218012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7541b420-1b47-4718-9b1f-a8d9a3fe4e0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.219901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7541b420-1b47-4718-9b1f-a8d9a3fe4e0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.220614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7541b420-1b47-4718-9b1f-a8d9a3fe4e0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.465588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:46.480106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:46.481780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:46.483964 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2009fc21-1672-41a5-8aa4-8a23fd98328c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.360455 Oct 05 17:33:46.504285 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 364/724] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:46 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:46.514463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-33bf15b0-4c20-42c2-8b2f-0e76eb207370 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:46.524015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-33bf15b0-4c20-42c2-8b2f-0e76eb207370 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:46.531278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33bf15b0-4c20-42c2-8b2f-0e76eb207370 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.533341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33bf15b0-4c20-42c2-8b2f-0e76eb207370 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.533948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33bf15b0-4c20-42c2-8b2f-0e76eb207370 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.536142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33bf15b0-4c20-42c2-8b2f-0e76eb207370 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.536785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33bf15b0-4c20-42c2-8b2f-0e76eb207370 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.540061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33bf15b0-4c20-42c2-8b2f-0e76eb207370 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.552774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:46.600653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7541b420-1b47-4718-9b1f-a8d9a3fe4e0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:46.613011 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7541b420-1b47-4718-9b1f-a8d9a3fe4e0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.433319 Oct 05 17:33:46.614000 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 361/725] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:46 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:46.634728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-400eaf49-0199-4a3b-a383-de507b22bef3 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-400eaf49-0199-4a3b-a383-de507b22bef3 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Request method failure captured: Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911/action HTTP/1.1 Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 39 Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_KeVqfMZvTUhpx_-Dbgm7ohdOJgse5-QdXDattqcXDBH65Q0ApbvYTz6LE3ROP8R_jvbQ69ebC1tR0SA8oza2D01pYmVyfnsZomP9chzOcVunodTpk81a-YbTjwAHZlVsB8mgJTTsDb-XGc6T7zjgFvBc2siBAy6fIhgzmEZxg5Y4 Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f727c86299b545c39393131ddd5017f6 Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:33:46.639667 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f727c86299b545c39393131ddd5017f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f727c86299b545c39393131ddd5017f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f727c86299b545c39393131ddd5017f6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f727c86299b545c39393131ddd5017f6"}]}] Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f727c86299b545c39393131ddd5017f6 Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersAdminNegativeTestJSON-1593672326-project-admin Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 25fe6ef7486549e6b3d9080ac13362be Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1593672326-project-admin Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: {"os-resetState": {"state": "invalid"}} Oct 05 17:33:46.641201 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'd07ea7e2-f9cd-493e-82f9-15deae371911', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'invalid' Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:46.642170 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:33:46.644214 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 05 17:33:46.645593 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.645593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-400eaf49-0199-4a3b-a383-de507b22bef3 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:46.646385 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-400eaf49-0199-4a3b-a383-de507b22bef3 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911/action" status: 400 len: 144 microversion: 2.1 time: 0.016182 Oct 05 17:33:46.654857 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 362/726] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:46 2022] POST /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911/action => generated 144 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:33:46.663975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-16269d16-45ab-47fa-b677-60f5293eb501 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-16269d16-45ab-47fa-b677-60f5293eb501 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Request method failure captured: Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911/action HTTP/1.1 Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 31 Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_KeVqfMZvTUhpx_-Dbgm7ohdOJgse5-QdXDattqcXDBH65Q0ApbvYTz6LE3ROP8R_jvbQ69ebC1tR0SA8oza2D01pYmVyfnsZomP9chzOcVunodTpk81a-YbTjwAHZlVsB8mgJTTsDb-XGc6T7zjgFvBc2siBAy6fIhgzmEZxg5Y4 Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f727c86299b545c39393131ddd5017f6 Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:33:46.673001 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f727c86299b545c39393131ddd5017f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f727c86299b545c39393131ddd5017f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f727c86299b545c39393131ddd5017f6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f727c86299b545c39393131ddd5017f6"}]}] Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f727c86299b545c39393131ddd5017f6 Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersAdminNegativeTestJSON-1593672326-project-admin Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 25fe6ef7486549e6b3d9080ac13362be Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1593672326-project-admin Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: {"os-resetState": {"state": 1}} Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:33:46.674451 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'd07ea7e2-f9cd-493e-82f9-15deae371911', 'body': {'os-resetState': {'state': 1}}} Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 1 Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:46.675235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 05 17:33:46.676530 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.681872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-16269d16-45ab-47fa-b677-60f5293eb501 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:46.683260 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-16269d16-45ab-47fa-b677-60f5293eb501 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911/action" status: 400 len: 120 microversion: 2.1 time: 0.027384 Oct 05 17:33:46.684066 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 363/727] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:46 2022] POST /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911/action => generated 120 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:33:46.694687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-279e2c8f-9193-4035-a6b3-1b4ddd8d43d4 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:46.697795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-279e2c8f-9193-4035-a6b3-1b4ddd8d43d4 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Failed to fetch instance by id 999 {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 17:33:46.698586 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-279e2c8f-9193-4035-a6b3-1b4ddd8d43d4 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-279e2c8f-9193-4035-a6b3-1b4ddd8d43d4 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Request method failure captured: Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 37 Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_KeVqfMZvTUhpx_-Dbgm7ohdOJgse5-QdXDattqcXDBH65Q0ApbvYTz6LE3ROP8R_jvbQ69ebC1tR0SA8oza2D01pYmVyfnsZomP9chzOcVunodTpk81a-YbTjwAHZlVsB8mgJTTsDb-XGc6T7zjgFvBc2siBAy6fIhgzmEZxg5Y4 Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f727c86299b545c39393131ddd5017f6 Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:33:46.706900 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f727c86299b545c39393131ddd5017f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f727c86299b545c39393131ddd5017f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f727c86299b545c39393131ddd5017f6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f727c86299b545c39393131ddd5017f6"}]}] Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f727c86299b545c39393131ddd5017f6 Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1593672326 Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersAdminNegativeTestJSON-1593672326-project-admin Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 25fe6ef7486549e6b3d9080ac13362be Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1593672326-project-admin Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: {"os-resetState": {"state": "error"}} Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:33:46.708220 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 999 could not be found. Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:33:46.708975 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 05 17:33:46.710196 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:46.713866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-279e2c8f-9193-4035-a6b3-1b4ddd8d43d4 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:46.714921 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-279e2c8f-9193-4035-a6b3-1b4ddd8d43d4 tempest-ServersAdminNegativeTestJSON-1593672326 tempest-ServersAdminNegativeTestJSON-1593672326-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.025281 Oct 05 17:33:46.719602 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 364/728] 10.222.0.70 () {60 vars in 1179 bytes} [Wed Oct 5 17:33:46 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:33:46.724791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-75eb7f6c-ba60-4c54-99c6-08a079746ec9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:46.725521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-75eb7f6c-ba60-4c54-99c6-08a079746ec9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:46.731907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75eb7f6c-ba60-4c54-99c6-08a079746ec9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.732704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75eb7f6c-ba60-4c54-99c6-08a079746ec9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.733970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75eb7f6c-ba60-4c54-99c6-08a079746ec9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.734969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75eb7f6c-ba60-4c54-99c6-08a079746ec9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.735575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75eb7f6c-ba60-4c54-99c6-08a079746ec9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.736195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75eb7f6c-ba60-4c54-99c6-08a079746ec9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.777521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-33bf15b0-4c20-42c2-8b2f-0e76eb207370 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:46.787668 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-33bf15b0-4c20-42c2-8b2f-0e76eb207370 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1576 microversion: 2.1 time: 0.279549 Oct 05 17:33:46.788392 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 365/729] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:46 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1576 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:46.790176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-75eb7f6c-ba60-4c54-99c6-08a079746ec9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:33:46.795289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-140eb73d-f582-4ca9-a66d-f5ef4e874689 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:46.796275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-140eb73d-f582-4ca9-a66d-f5ef4e874689 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:46.803639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-140eb73d-f582-4ca9-a66d-f5ef4e874689 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.804738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-140eb73d-f582-4ca9-a66d-f5ef4e874689 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.818918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-140eb73d-f582-4ca9-a66d-f5ef4e874689 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.820093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-140eb73d-f582-4ca9-a66d-f5ef4e874689 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:46.821921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-140eb73d-f582-4ca9-a66d-f5ef4e874689 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:46.822822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-140eb73d-f582-4ca9-a66d-f5ef4e874689 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:46.989029 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-75eb7f6c-ba60-4c54-99c6-08a079746ec9 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "DELETE /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 204 len: 0 microversion: 2.1 time: 0.267772 Oct 05 17:33:46.989612 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 365/730] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:33:46 2022] DELETE /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:33:46.998442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:46.999136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:47.019772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.020565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.021154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.022021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.022648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.023215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.138020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-140eb73d-f582-4ca9-a66d-f5ef4e874689 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:47.151094 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-140eb73d-f582-4ca9-a66d-f5ef4e874689 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.358592 Oct 05 17:33:47.155453 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 366/731] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:46 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:47.165404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7f08777b-49dd-4203-901f-92635ba7c633 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:47.168616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7f08777b-49dd-4203-901f-92635ba7c633 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:47.193746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f08777b-49dd-4203-901f-92635ba7c633 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.194687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f08777b-49dd-4203-901f-92635ba7c633 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.195314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f08777b-49dd-4203-901f-92635ba7c633 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.196227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f08777b-49dd-4203-901f-92635ba7c633 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.196858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f08777b-49dd-4203-901f-92635ba7c633 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.197499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f08777b-49dd-4203-901f-92635ba7c633 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.311705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:47.322930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:47.324398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:47.330098 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fe2aba01-b4bd-44ea-b055-7421696e78a4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.335711 Oct 05 17:33:47.331026 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 366/732] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:46 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:47.335804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d045cfb-1810-4860-8cf1-784464f0fcb7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:47.336410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0d045cfb-1810-4860-8cf1-784464f0fcb7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:47.343146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d045cfb-1810-4860-8cf1-784464f0fcb7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.343638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d045cfb-1810-4860-8cf1-784464f0fcb7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.344074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d045cfb-1810-4860-8cf1-784464f0fcb7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.344774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d045cfb-1810-4860-8cf1-784464f0fcb7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.345308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d045cfb-1810-4860-8cf1-784464f0fcb7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.345735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d045cfb-1810-4860-8cf1-784464f0fcb7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.381541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7f08777b-49dd-4203-901f-92635ba7c633 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:47.391479 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7f08777b-49dd-4203-901f-92635ba7c633 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1467 microversion: 2.1 time: 0.234565 Oct 05 17:33:47.392394 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 367/733] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:47 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1467 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:47.454685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-0d045cfb-1810-4860-8cf1-784464f0fcb7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:47.484358 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0d045cfb-1810-4860-8cf1-784464f0fcb7 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1947 microversion: 2.75 time: 0.152038 Oct 05 17:33:47.484948 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 367/734] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:47 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1947 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:47.517818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:47.518731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:47.525214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.525843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.526553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.527475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.528118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.529506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.637359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4bfc5df6-f8cd-4ef6-abb4-145215715b13 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:47.640435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4bfc5df6-f8cd-4ef6-abb4-145215715b13 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:47.650618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bfc5df6-f8cd-4ef6-abb4-145215715b13 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.651295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bfc5df6-f8cd-4ef6-abb4-145215715b13 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.651920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bfc5df6-f8cd-4ef6-abb4-145215715b13 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.652744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bfc5df6-f8cd-4ef6-abb4-145215715b13 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.653308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bfc5df6-f8cd-4ef6-abb4-145215715b13 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.653863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bfc5df6-f8cd-4ef6-abb4-145215715b13 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.694267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:47.704059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:47.706372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:47.707760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-15ff270c-e7b9-4013-b475-b62c1fafdbc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.195580 Oct 05 17:33:47.708339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 368/735] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:47 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:47.803342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4bfc5df6-f8cd-4ef6-abb4-145215715b13 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:47.815202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a50b9a48-a4c8-4f99-9d4d-33f2cedd8e52 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:47.815824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a50b9a48-a4c8-4f99-9d4d-33f2cedd8e52 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:47.817892 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4bfc5df6-f8cd-4ef6-abb4-145215715b13 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.185191 Oct 05 17:33:47.822543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a50b9a48-a4c8-4f99-9d4d-33f2cedd8e52 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.823231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a50b9a48-a4c8-4f99-9d4d-33f2cedd8e52 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.823840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a50b9a48-a4c8-4f99-9d4d-33f2cedd8e52 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.824722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a50b9a48-a4c8-4f99-9d4d-33f2cedd8e52 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.825329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a50b9a48-a4c8-4f99-9d4d-33f2cedd8e52 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.825905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a50b9a48-a4c8-4f99-9d4d-33f2cedd8e52 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.838123 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 368/736] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:47 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:47.909411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3b2b4d4b-53f7-45a3-9263-c20aad14a688 req-1320e6de-719f-4bf8-bf78-6245aa75a62a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d655671e-b4fa-4bf6-85b2-5a2d556124a2", "name": "network-vif-unplugged", "status": "completed", "tag": "d566d38c-8389-4104-8984-f5d607c56fe6"}, {"name": "network-changed", "server_uuid": "d655671e-b4fa-4bf6-85b2-5a2d556124a2", "tag": "d566d38c-8389-4104-8984-f5d607c56fe6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:47.931951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3b2b4d4b-53f7-45a3-9263-c20aad14a688 req-1320e6de-719f-4bf8-bf78-6245aa75a62a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:47.932679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3b2b4d4b-53f7-45a3-9263-c20aad14a688 req-1320e6de-719f-4bf8-bf78-6245aa75a62a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:47.933202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3b2b4d4b-53f7-45a3-9263-c20aad14a688 req-1320e6de-719f-4bf8-bf78-6245aa75a62a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:47.951669 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3b2b4d4b-53f7-45a3-9263-c20aad14a688 req-1320e6de-719f-4bf8-bf78-6245aa75a62a service nova] Creating event network-vif-unplugged:d566d38c-8389-4104-8984-f5d607c56fe6 for instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 on n-h2-835595-3 Oct 05 17:33:47.955852 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3b2b4d4b-53f7-45a3-9263-c20aad14a688 req-1320e6de-719f-4bf8-bf78-6245aa75a62a service nova] Creating event network-changed:d566d38c-8389-4104-8984-f5d607c56fe6 for instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 on n-h2-835595-3 Oct 05 17:33:47.963089 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3b2b4d4b-53f7-45a3-9263-c20aad14a688 req-1320e6de-719f-4bf8-bf78-6245aa75a62a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.063684 Oct 05 17:33:47.964212 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 369/737] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:33:48.002140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a50b9a48-a4c8-4f99-9d4d-33f2cedd8e52 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:48.011895 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a50b9a48-a4c8-4f99-9d4d-33f2cedd8e52 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1576 microversion: 2.1 time: 0.201034 Oct 05 17:33:48.013065 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 369/738] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:47 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:48.177107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:48.181776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c259ff9-2bef-420e-91ca-2b7c6569f0c6 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:48.182391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3c259ff9-2bef-420e-91ca-2b7c6569f0c6 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:48.189920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c259ff9-2bef-420e-91ca-2b7c6569f0c6 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.190689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c259ff9-2bef-420e-91ca-2b7c6569f0c6 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.191271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c259ff9-2bef-420e-91ca-2b7c6569f0c6 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.192131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c259ff9-2bef-420e-91ca-2b7c6569f0c6 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.192737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c259ff9-2bef-420e-91ca-2b7c6569f0c6 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.193308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c259ff9-2bef-420e-91ca-2b7c6569f0c6 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.347574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3c259ff9-2bef-420e-91ca-2b7c6569f0c6 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:48.356291 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c259ff9-2bef-420e-91ca-2b7c6569f0c6 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.180184 Oct 05 17:33:48.357060 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 370/739] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:48 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:48.376302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:48.377278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:48.384471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.387227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.387742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.388526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.389010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.389438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.415979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4e10f195-4ff3-4dc5-ba8b-d8c9cc9426b7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:48.416597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4e10f195-4ff3-4dc5-ba8b-d8c9cc9426b7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:48.432897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e10f195-4ff3-4dc5-ba8b-d8c9cc9426b7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.433309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e10f195-4ff3-4dc5-ba8b-d8c9cc9426b7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.433754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e10f195-4ff3-4dc5-ba8b-d8c9cc9426b7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.434542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e10f195-4ff3-4dc5-ba8b-d8c9cc9426b7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.434970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e10f195-4ff3-4dc5-ba8b-d8c9cc9426b7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.435402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e10f195-4ff3-4dc5-ba8b-d8c9cc9426b7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.463814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:48.474766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:48.474999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:48.476675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:48.482458 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c138c578-2448-48df-85a4-ae5a76dcbeb2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.110472 Oct 05 17:33:48.483341 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 370/740] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:48 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:48.512375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8532f1bd-a897-4bae-aa8c-e1d5b19b0530 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:48.513508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8532f1bd-a897-4bae-aa8c-e1d5b19b0530 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:48.522879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8532f1bd-a897-4bae-aa8c-e1d5b19b0530 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.525118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8532f1bd-a897-4bae-aa8c-e1d5b19b0530 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.525118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8532f1bd-a897-4bae-aa8c-e1d5b19b0530 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.525118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8532f1bd-a897-4bae-aa8c-e1d5b19b0530 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.525803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8532f1bd-a897-4bae-aa8c-e1d5b19b0530 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.526933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8532f1bd-a897-4bae-aa8c-e1d5b19b0530 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.611424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-8532f1bd-a897-4bae-aa8c-e1d5b19b0530 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:48.631697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4e10f195-4ff3-4dc5-ba8b-d8c9cc9426b7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:48.632903 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8532f1bd-a897-4bae-aa8c-e1d5b19b0530 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1935 microversion: 2.75 time: 0.124365 Oct 05 17:33:48.633957 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 371/741] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:48 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1935 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:48.669239 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4e10f195-4ff3-4dc5-ba8b-d8c9cc9426b7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1467 microversion: 2.1 time: 0.257134 Oct 05 17:33:48.682715 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 371/742] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:48 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1467 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:48.735869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:48.737081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:48.755576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.756446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.757110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.758363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.759003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.759611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.850268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c03bbc36-1f24-43fd-b2bf-6bb7648b4bb3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:48.851880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c03bbc36-1f24-43fd-b2bf-6bb7648b4bb3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:48.868870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c03bbc36-1f24-43fd-b2bf-6bb7648b4bb3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.870005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c03bbc36-1f24-43fd-b2bf-6bb7648b4bb3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.870963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c03bbc36-1f24-43fd-b2bf-6bb7648b4bb3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:48.871992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c03bbc36-1f24-43fd-b2bf-6bb7648b4bb3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:48.873300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c03bbc36-1f24-43fd-b2bf-6bb7648b4bb3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:48.873750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c03bbc36-1f24-43fd-b2bf-6bb7648b4bb3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.115067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c03bbc36-1f24-43fd-b2bf-6bb7648b4bb3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:49.125135 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c03bbc36-1f24-43fd-b2bf-6bb7648b4bb3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.283503 Oct 05 17:33:49.126025 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 372/743] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:48 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:49.131720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c63c4e6d-6be4-4971-ae99-b5c834c82e21 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:49.132327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c63c4e6d-6be4-4971-ae99-b5c834c82e21 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:49.138757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c63c4e6d-6be4-4971-ae99-b5c834c82e21 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:49.139244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c63c4e6d-6be4-4971-ae99-b5c834c82e21 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:49.139675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c63c4e6d-6be4-4971-ae99-b5c834c82e21 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.140530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c63c4e6d-6be4-4971-ae99-b5c834c82e21 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:49.140992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c63c4e6d-6be4-4971-ae99-b5c834c82e21 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:49.141419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c63c4e6d-6be4-4971-ae99-b5c834c82e21 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.168389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:49.179697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:49.181174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:49.182411 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a70136a4-3009-4c68-ab84-178886ff542b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.451407 Oct 05 17:33:49.183621 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 372/744] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:48 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:49.371782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c63c4e6d-6be4-4971-ae99-b5c834c82e21 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:49.380529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fde18933-567d-4803-9055-9304a4a07821 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:49.381328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fde18933-567d-4803-9055-9304a4a07821 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:49.393173 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c63c4e6d-6be4-4971-ae99-b5c834c82e21 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1576 microversion: 2.1 time: 0.265661 Oct 05 17:33:49.395607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fde18933-567d-4803-9055-9304a4a07821 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:49.411590 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 373/745] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:49 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1576 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:49.411840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fde18933-567d-4803-9055-9304a4a07821 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:49.411840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fde18933-567d-4803-9055-9304a4a07821 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.411840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fde18933-567d-4803-9055-9304a4a07821 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:49.411840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fde18933-567d-4803-9055-9304a4a07821 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:49.412201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fde18933-567d-4803-9055-9304a4a07821 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.513867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:49.515160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:49.525762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:49.526752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:49.527411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.528171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:49.528637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:49.529055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.661203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:49.663718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fde18933-567d-4803-9055-9304a4a07821 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:49.672256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:49.673839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:49.676651 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fde18933-567d-4803-9055-9304a4a07821 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1318 microversion: 2.1 time: 0.298106 Oct 05 17:33:49.677918 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 373/746] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:49 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:49.679765 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3d0a3eea-451a-4417-ba58-2b713d4a045f tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.170808 Oct 05 17:33:49.688972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-19df7dd7-65a6-4285-8981-1bf878a4d9e3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:49.690023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-19df7dd7-65a6-4285-8981-1bf878a4d9e3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:49.692073 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 374/747] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:49 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:33:49.704857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19df7dd7-65a6-4285-8981-1bf878a4d9e3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:49.705405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19df7dd7-65a6-4285-8981-1bf878a4d9e3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:49.705945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19df7dd7-65a6-4285-8981-1bf878a4d9e3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.706238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a948836-f0ba-4fec-b98b-bf3c61bb7d07 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:49.706950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7a948836-f0ba-4fec-b98b-bf3c61bb7d07 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:49.707532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19df7dd7-65a6-4285-8981-1bf878a4d9e3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:49.708011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19df7dd7-65a6-4285-8981-1bf878a4d9e3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:49.708465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19df7dd7-65a6-4285-8981-1bf878a4d9e3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.713580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a948836-f0ba-4fec-b98b-bf3c61bb7d07 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:49.714107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a948836-f0ba-4fec-b98b-bf3c61bb7d07 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:49.714592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a948836-f0ba-4fec-b98b-bf3c61bb7d07 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.715350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a948836-f0ba-4fec-b98b-bf3c61bb7d07 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:49.715801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a948836-f0ba-4fec-b98b-bf3c61bb7d07 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:49.716223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a948836-f0ba-4fec-b98b-bf3c61bb7d07 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:49.800012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-19df7dd7-65a6-4285-8981-1bf878a4d9e3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:49.818660 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-19df7dd7-65a6-4285-8981-1bf878a4d9e3 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1935 microversion: 2.75 time: 0.139349 Oct 05 17:33:49.819243 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 374/748] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:49 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1935 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:49.965306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7a948836-f0ba-4fec-b98b-bf3c61bb7d07 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:49.976105 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a948836-f0ba-4fec-b98b-bf3c61bb7d07 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1467 microversion: 2.1 time: 0.282857 Oct 05 17:33:49.977304 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 375/749] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:49 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1467 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:50.156546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9b613db1-604c-4056-ba66-2e36dd7705b2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:50.157178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9b613db1-604c-4056-ba66-2e36dd7705b2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:50.165265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b613db1-604c-4056-ba66-2e36dd7705b2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.165782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b613db1-604c-4056-ba66-2e36dd7705b2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.166226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b613db1-604c-4056-ba66-2e36dd7705b2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.166971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b613db1-604c-4056-ba66-2e36dd7705b2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.167437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b613db1-604c-4056-ba66-2e36dd7705b2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.167870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b613db1-604c-4056-ba66-2e36dd7705b2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.181593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-36f160d0-a61d-4810-b564-086d7773f413 req-9db94925-a112-4c89-a472-5bdf28279ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be31de3d-24a3-4ab8-9ade-0025b4e7e27f", "name": "network-vif-deleted", "tag": "330929f2-a2ab-4071-8916-ad38327eb67e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:50.209492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-36f160d0-a61d-4810-b564-086d7773f413 req-9db94925-a112-4c89-a472-5bdf28279ce6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.210303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-36f160d0-a61d-4810-b564-086d7773f413 req-9db94925-a112-4c89-a472-5bdf28279ce6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.210896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-36f160d0-a61d-4810-b564-086d7773f413 req-9db94925-a112-4c89-a472-5bdf28279ce6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.223041 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-36f160d0-a61d-4810-b564-086d7773f413 req-9db94925-a112-4c89-a472-5bdf28279ce6 service nova] Creating event network-vif-deleted:330929f2-a2ab-4071-8916-ad38327eb67e for instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f on n-h1-835595-3 Oct 05 17:33:50.228589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-36f160d0-a61d-4810-b564-086d7773f413 req-9db94925-a112-4c89-a472-5bdf28279ce6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050778 Oct 05 17:33:50.229736 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 376/750] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:33:50.238715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:50.240400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:50.248459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.249268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.249954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.250897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.251612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.252277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.445058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:50.459461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:50.462090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:50.463743 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b74904d1-8610-4e93-856b-b7c6d7339910 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.232621 Oct 05 17:33:50.481472 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 377/751] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:50 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:50.482898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85df0081-033d-4ea1-8309-a3a865d2692d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:50.484050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-85df0081-033d-4ea1-8309-a3a865d2692d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:50.491193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85df0081-033d-4ea1-8309-a3a865d2692d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.491688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85df0081-033d-4ea1-8309-a3a865d2692d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.492455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85df0081-033d-4ea1-8309-a3a865d2692d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.493206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85df0081-033d-4ea1-8309-a3a865d2692d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.493661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85df0081-033d-4ea1-8309-a3a865d2692d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.494092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85df0081-033d-4ea1-8309-a3a865d2692d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.707739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85df0081-033d-4ea1-8309-a3a865d2692d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:50.708947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9b613db1-604c-4056-ba66-2e36dd7705b2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:50.717065 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9b613db1-604c-4056-ba66-2e36dd7705b2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.566042 Oct 05 17:33:50.717410 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85df0081-033d-4ea1-8309-a3a865d2692d tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1576 microversion: 2.1 time: 0.242757 Oct 05 17:33:50.736329 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 378/752] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:50 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:50.739170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ffd6ab60-8675-48ca-939c-09fa47c7cd9f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:50.739813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ffd6ab60-8675-48ca-939c-09fa47c7cd9f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:50.745869 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 375/753] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:50 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:50.746428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd6ab60-8675-48ca-939c-09fa47c7cd9f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.746940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd6ab60-8675-48ca-939c-09fa47c7cd9f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.747375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd6ab60-8675-48ca-939c-09fa47c7cd9f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.748098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd6ab60-8675-48ca-939c-09fa47c7cd9f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.749573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd6ab60-8675-48ca-939c-09fa47c7cd9f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.749573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd6ab60-8675-48ca-939c-09fa47c7cd9f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.755179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:50.755782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:50.774924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.775561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.778355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.779304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.779873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.781120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.922805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:50.937468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:50.939310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:50.945279 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e8617589-8e9d-428d-be43-2043faa891f1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1535 microversion: 2.91 time: 0.197611 Oct 05 17:33:50.946730 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 376/754] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:50 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1535 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:50.951647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84d8834c-3ede-47c2-ade4-ad8c2bdbf0d0 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:50.952510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-84d8834c-3ede-47c2-ade4-ad8c2bdbf0d0 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:50.959222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d8834c-3ede-47c2-ade4-ad8c2bdbf0d0 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.959876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d8834c-3ede-47c2-ade4-ad8c2bdbf0d0 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.960474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d8834c-3ede-47c2-ade4-ad8c2bdbf0d0 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:50.961341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d8834c-3ede-47c2-ade4-ad8c2bdbf0d0 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:50.961949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d8834c-3ede-47c2-ade4-ad8c2bdbf0d0 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:50.962714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d8834c-3ede-47c2-ade4-ad8c2bdbf0d0 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.055582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-84d8834c-3ede-47c2-ade4-ad8c2bdbf0d0 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] Lazy-loading 'services' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:51.067399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ffd6ab60-8675-48ca-939c-09fa47c7cd9f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.075449 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ffd6ab60-8675-48ca-939c-09fa47c7cd9f tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1468 microversion: 2.1 time: 0.340847 Oct 05 17:33:51.086511 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 379/755] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:50 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1468 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:51.086511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:51.086511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:51.086832 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84d8834c-3ede-47c2-ade4-ad8c2bdbf0d0 tempest-ServersAdmin275Test-1241344283 tempest-ServersAdmin275Test-1241344283-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1920 microversion: 2.75 time: 0.134585 Oct 05 17:33:51.086832 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 377/756] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:50 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1920 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:51.098743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b2876e8-1d65-474e-9f1d-bf81899c2c50 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:51.099282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6b2876e8-1d65-474e-9f1d-bf81899c2c50 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:51.105374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b2876e8-1d65-474e-9f1d-bf81899c2c50 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.106765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b2876e8-1d65-474e-9f1d-bf81899c2c50 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.107294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b2876e8-1d65-474e-9f1d-bf81899c2c50 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.108017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b2876e8-1d65-474e-9f1d-bf81899c2c50 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.108788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b2876e8-1d65-474e-9f1d-bf81899c2c50 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.109372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b2876e8-1d65-474e-9f1d-bf81899c2c50 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.112251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.112747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.113342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.114873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.115474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.116037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.133089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-6b2876e8-1d65-474e-9f1d-bf81899c2c50 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lazy-loading 'flavor' on Instance uuid c980c65d-9eb1-40b0-857f-ffb08dbbc3ba {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:51.150746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.151227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.151658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.152099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lazy-loading 'fault' on Instance uuid be31de3d-24a3-4ab8-9ade-0025b4e7e27f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:51.193003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.201002 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b2876e8-1d65-474e-9f1d-bf81899c2c50 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba/action" status: 202 len: 0 microversion: 2.1 time: 0.106146 Oct 05 17:33:51.201208 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-54b59370-4b9e-416c-a298-a6685d140056 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1311 microversion: 2.1 time: 0.123746 Oct 05 17:33:51.204722 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 380/758] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:51 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:51.204881 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 378/758] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:51 2022] POST /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:33:51.206839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8af18b4b-e9dc-4a70-8d0a-990d9afa8d2a tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:51.207391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8af18b4b-e9dc-4a70-8d0a-990d9afa8d2a tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:51.212193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ba2c833-eb31-40cc-a070-af669b7d2de5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:51.212896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7ba2c833-eb31-40cc-a070-af669b7d2de5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:51.213330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8af18b4b-e9dc-4a70-8d0a-990d9afa8d2a tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.213822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8af18b4b-e9dc-4a70-8d0a-990d9afa8d2a tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.214251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8af18b4b-e9dc-4a70-8d0a-990d9afa8d2a tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.214963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8af18b4b-e9dc-4a70-8d0a-990d9afa8d2a tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.215412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8af18b4b-e9dc-4a70-8d0a-990d9afa8d2a tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.216065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8af18b4b-e9dc-4a70-8d0a-990d9afa8d2a tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.219286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ba2c833-eb31-40cc-a070-af669b7d2de5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.219777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ba2c833-eb31-40cc-a070-af669b7d2de5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.220274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ba2c833-eb31-40cc-a070-af669b7d2de5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.220978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ba2c833-eb31-40cc-a070-af669b7d2de5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.221438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ba2c833-eb31-40cc-a070-af669b7d2de5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.221862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ba2c833-eb31-40cc-a070-af669b7d2de5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.226103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:51.241295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8af18b4b-e9dc-4a70-8d0a-990d9afa8d2a tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:33:51.315159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:51.322932 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8af18b4b-e9dc-4a70-8d0a-990d9afa8d2a tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "DELETE /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 204 len: 0 microversion: 2.75 time: 0.119920 Oct 05 17:33:51.323514 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 381/759] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:33:51 2022] DELETE /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:33:51.332827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:51.333536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:51.339738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.340134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.340561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.341522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.341739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.342106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.359194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7ba2c833-eb31-40cc-a070-af669b7d2de5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.368377 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7ba2c833-eb31-40cc-a070-af669b7d2de5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1476 microversion: 2.1 time: 0.160655 Oct 05 17:33:51.376628 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 379/760] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:51 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1476 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:51.409422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.418370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.419884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.425376 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8f572a35-299b-416d-bca5-e37c502b7cb7 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1444 microversion: 2.75 time: 0.097452 Oct 05 17:33:51.425937 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 382/761] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:51 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:51.492529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:51.493181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:51.501220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.501775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.502292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.503126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.503634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.504119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.681699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.690042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.691554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.692732 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99106155-5f99-4fe1-998a-b07bb09a2a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.204313 Oct 05 17:33:51.693333 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 380/762] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:51 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:51.741507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f4832af2-9b8e-419b-ae44-931ee83228be tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:51.742087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f4832af2-9b8e-419b-ae44-931ee83228be tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:51.743662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-69c2e302-0ef2-4cb5-82fd-f4f627c9f790 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:51.744279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-69c2e302-0ef2-4cb5-82fd-f4f627c9f790 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:51.747185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:51.749003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4832af2-9b8e-419b-ae44-931ee83228be tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.749501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4832af2-9b8e-419b-ae44-931ee83228be tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.749957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4832af2-9b8e-419b-ae44-931ee83228be tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.750713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4832af2-9b8e-419b-ae44-931ee83228be tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.751172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4832af2-9b8e-419b-ae44-931ee83228be tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.751556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c2e302-0ef2-4cb5-82fd-f4f627c9f790 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.752035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c2e302-0ef2-4cb5-82fd-f4f627c9f790 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.752483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c2e302-0ef2-4cb5-82fd-f4f627c9f790 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.752786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4832af2-9b8e-419b-ae44-931ee83228be tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.753164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c2e302-0ef2-4cb5-82fd-f4f627c9f790 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.753619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c2e302-0ef2-4cb5-82fd-f4f627c9f790 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.754044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c2e302-0ef2-4cb5-82fd-f4f627c9f790 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.891458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-69c2e302-0ef2-4cb5-82fd-f4f627c9f790 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.899821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-69c2e302-0ef2-4cb5-82fd-f4f627c9f790 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.159773 Oct 05 17:33:51.900413 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 381/763] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:51 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:51.904187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f4832af2-9b8e-419b-ae44-931ee83228be tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:51.913070 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f4832af2-9b8e-419b-ae44-931ee83228be tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1576 microversion: 2.1 time: 0.176425 Oct 05 17:33:51.913647 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 383/764] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:51 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:51.975810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:51.976411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:51.982946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.983731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.984224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:51.984917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:51.985373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:51.985806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.054641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.064037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.065575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.071082 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1bb866ed-7c57-489b-94ac-ee986f0f54ec tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1535 microversion: 2.91 time: 0.099654 Oct 05 17:33:52.071653 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 382/765] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:51 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1535 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:52.226371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:52.226994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:52.236516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.237038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.237464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.238154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.238975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.239419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.273064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.273537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.274017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.274522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lazy-loading 'fault' on Instance uuid be31de3d-24a3-4ab8-9ade-0025b4e7e27f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:52.322261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.330539 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-24025b9c-8eb8-4e2d-bb64-684aba763a67 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1311 microversion: 2.1 time: 0.109780 Oct 05 17:33:52.331129 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 384/766] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:52 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:52.392287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9384cf9-cbc2-4ee3-a779-e8a155ba4a16 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:52.392964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b9384cf9-cbc2-4ee3-a779-e8a155ba4a16 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:52.399871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9384cf9-cbc2-4ee3-a779-e8a155ba4a16 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.400359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9384cf9-cbc2-4ee3-a779-e8a155ba4a16 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.400796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9384cf9-cbc2-4ee3-a779-e8a155ba4a16 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.401501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9384cf9-cbc2-4ee3-a779-e8a155ba4a16 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.401964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9384cf9-cbc2-4ee3-a779-e8a155ba4a16 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.402422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9384cf9-cbc2-4ee3-a779-e8a155ba4a16 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.453216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:52.453834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:52.460544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.461031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.461519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.462163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.462657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.463089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.533345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.541621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.543107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.548648 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-509603b9-e103-467f-86ef-ffd2e90da74e tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1444 microversion: 2.75 time: 0.099323 Oct 05 17:33:52.549220 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 385/767] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:52 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:52.558534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b9384cf9-cbc2-4ee3-a779-e8a155ba4a16 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.566722 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b9384cf9-cbc2-4ee3-a779-e8a155ba4a16 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1476 microversion: 2.1 time: 0.178956 Oct 05 17:33:52.567344 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 383/768] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:52 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:52.718440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:52.719039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:52.725350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.725840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.726301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.727024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.727478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.727903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.747574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:52.870329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.882836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.885297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:52.886614 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-759cb8a7-db21-47c9-9470-54db6ff8550d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.172840 Oct 05 17:33:52.887267 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 386/769] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:52 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:52.925839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c4b3f1e3-20e1-4198-9ad5-d35f19215fe4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:52.926625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c4b3f1e3-20e1-4198-9ad5-d35f19215fe4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:52.935787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4b3f1e3-20e1-4198-9ad5-d35f19215fe4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.936001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-349f1a7d-a08e-4f7c-b001-9f32a01bb73e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:52.936430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-349f1a7d-a08e-4f7c-b001-9f32a01bb73e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:52.936539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4b3f1e3-20e1-4198-9ad5-d35f19215fe4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.937109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4b3f1e3-20e1-4198-9ad5-d35f19215fe4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.937835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4b3f1e3-20e1-4198-9ad5-d35f19215fe4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.938466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4b3f1e3-20e1-4198-9ad5-d35f19215fe4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.938891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4b3f1e3-20e1-4198-9ad5-d35f19215fe4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.946478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-349f1a7d-a08e-4f7c-b001-9f32a01bb73e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.947067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-349f1a7d-a08e-4f7c-b001-9f32a01bb73e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.947627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-349f1a7d-a08e-4f7c-b001-9f32a01bb73e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:52.948405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-349f1a7d-a08e-4f7c-b001-9f32a01bb73e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:52.948961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-349f1a7d-a08e-4f7c-b001-9f32a01bb73e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:52.949462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-349f1a7d-a08e-4f7c-b001-9f32a01bb73e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.095556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-349f1a7d-a08e-4f7c-b001-9f32a01bb73e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:53.102310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c4b3f1e3-20e1-4198-9ad5-d35f19215fe4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:53.104468 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-349f1a7d-a08e-4f7c-b001-9f32a01bb73e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1581 microversion: 2.1 time: 0.172362 Oct 05 17:33:53.105315 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 387/770] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:52 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1581 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:53.110164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:53.111113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:53.117083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.117558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.117976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.118716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.119215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.119572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.121927 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c4b3f1e3-20e1-4198-9ad5-d35f19215fe4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.201904 Oct 05 17:33:53.122911 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 384/771] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:52 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:53.184927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:53.193308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:53.194768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:53.199695 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ba32b423-8c6a-4e46-8232-ae602aae11ee tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1535 microversion: 2.91 time: 0.093522 Oct 05 17:33:53.200230 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 388/772] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:53 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1535 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:53.355061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:53.355780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:53.362539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.363151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.363741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.364610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.365317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.366018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.398752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.399230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.399659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.400101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lazy-loading 'fault' on Instance uuid be31de3d-24a3-4ab8-9ade-0025b4e7e27f {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:53.460762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:53.469447 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-11e7c8c0-082f-4ec4-9415-1080686d4c73 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 200 len: 1311 microversion: 2.1 time: 0.118791 Oct 05 17:33:53.470361 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 385/773] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:53 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 1311 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:53.577304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:53.577954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:53.592801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-886b928f-820a-4cb4-86de-2587fd8f6ec5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:53.593411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-886b928f-820a-4cb4-86de-2587fd8f6ec5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:53.598547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.599519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.600374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.600906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-886b928f-820a-4cb4-86de-2587fd8f6ec5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.601598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-886b928f-820a-4cb4-86de-2587fd8f6ec5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.602041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-886b928f-820a-4cb4-86de-2587fd8f6ec5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.602576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.603199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.603775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.605407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-886b928f-820a-4cb4-86de-2587fd8f6ec5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.606049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-886b928f-820a-4cb4-86de-2587fd8f6ec5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.607449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-886b928f-820a-4cb4-86de-2587fd8f6ec5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.651268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.651801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.652412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.652932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lazy-loading 'fault' on Instance uuid 80d67bc2-1121-445f-9c38-6dc3f7019dd6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:53.711648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:53.721786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:53.723326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0980740c97e44a6ca30d5ee4b6fb9b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26131a1b2f444be09171129cf0a8ead0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:53.729104 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2ab2be19-d4dc-4ca2-a67b-cd7318a13a35 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 200 len: 1449 microversion: 2.75 time: 0.155730 Oct 05 17:33:53.729706 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 389/774] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:53 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:53.770262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-886b928f-820a-4cb4-86de-2587fd8f6ec5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:53.778206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-886b928f-820a-4cb4-86de-2587fd8f6ec5 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1459 microversion: 2.1 time: 0.189205 Oct 05 17:33:53.778812 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 386/775] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:53 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1459 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:53.800015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9b8c570c-5053-43f9-a74f-ff3788405ac7 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:53.800633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9b8c570c-5053-43f9-a74f-ff3788405ac7 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:53.806724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b8c570c-5053-43f9-a74f-ff3788405ac7 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.807241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b8c570c-5053-43f9-a74f-ff3788405ac7 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.807678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b8c570c-5053-43f9-a74f-ff3788405ac7 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.808366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b8c570c-5053-43f9-a74f-ff3788405ac7 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.808821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b8c570c-5053-43f9-a74f-ff3788405ac7 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.809251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b8c570c-5053-43f9-a74f-ff3788405ac7 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.914132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:53.914950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:53.935936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.939292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.940013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:53.941198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:53.941846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:53.942295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.090732 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9b8c570c-5053-43f9-a74f-ff3788405ac7 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1610 microversion: 2.1 time: 0.294385 Oct 05 17:33:54.091450 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 390/776] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:53 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1610 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:54.113755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4ba16b37-6d5b-4ee8-9d7c-55b1ad2febe9 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:54.118216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ba16b37-6d5b-4ee8-9d7c-55b1ad2febe9 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.118801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ba16b37-6d5b-4ee8-9d7c-55b1ad2febe9 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.119337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ba16b37-6d5b-4ee8-9d7c-55b1ad2febe9 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.120155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ba16b37-6d5b-4ee8-9d7c-55b1ad2febe9 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.120769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ba16b37-6d5b-4ee8-9d7c-55b1ad2febe9 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.121294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ba16b37-6d5b-4ee8-9d7c-55b1ad2febe9 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.148936 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4ba16b37-6d5b-4ee8-9d7c-55b1ad2febe9 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039155 Oct 05 17:33:54.149595 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 391/777] 10.222.0.70 () {58 vars in 1176 bytes} [Wed Oct 5 17:33:54 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:33:54.155013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b0cd33fd-42cc-4247-b9fd-3e598c0ff407 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:54.155644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b0cd33fd-42cc-4247-b9fd-3e598c0ff407 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:54.161787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0cd33fd-42cc-4247-b9fd-3e598c0ff407 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.162265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0cd33fd-42cc-4247-b9fd-3e598c0ff407 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.162728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0cd33fd-42cc-4247-b9fd-3e598c0ff407 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.163637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0cd33fd-42cc-4247-b9fd-3e598c0ff407 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.163863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0cd33fd-42cc-4247-b9fd-3e598c0ff407 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.164397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0cd33fd-42cc-4247-b9fd-3e598c0ff407 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.194855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:54.203410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:54.204931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:54.206107 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6117b2da-71b4-42ef-90ee-f3b70e6a05ab tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.297550 Oct 05 17:33:54.206701 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 387/778] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:53 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:54.211412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5427e5e-898e-4f92-a808-3eb042598940 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:54.212027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5427e5e-898e-4f92-a808-3eb042598940 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:54.218099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5427e5e-898e-4f92-a808-3eb042598940 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.218617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5427e5e-898e-4f92-a808-3eb042598940 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.219250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5427e5e-898e-4f92-a808-3eb042598940 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.220172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5427e5e-898e-4f92-a808-3eb042598940 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.220638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5427e5e-898e-4f92-a808-3eb042598940 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.221063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5427e5e-898e-4f92-a808-3eb042598940 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.313448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b0cd33fd-42cc-4247-b9fd-3e598c0ff407 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:54.324911 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b0cd33fd-42cc-4247-b9fd-3e598c0ff407 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1574 microversion: 2.1 time: 0.174198 Oct 05 17:33:54.325495 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 392/779] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:54 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:54.330325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-835595-3", "block_migration": true, "disk_over_commit": false}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:54.332771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:54.338799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.339471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.339904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.340598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.341048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.341463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.358790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f5427e5e-898e-4f92-a808-3eb042598940 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:54.366716 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5427e5e-898e-4f92-a808-3eb042598940 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.158835 Oct 05 17:33:54.367296 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 388/780] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:54 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:54.371887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:54.372463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:54.378203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.378725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.379184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.379876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.380333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.380756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.420543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Lazy-loading 'flavor' on Instance uuid c980c65d-9eb1-40b0-857f-ffb08dbbc3ba {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:54.436513 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba while it is in vm_state suspended Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Request method failure captured: Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba/action HTTP/1.1 Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 97 Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_OkU5wPDET2pdddxf8EOBpmWpg9teabIfXOf8dWi4EewTK_N59PyM0mmcFYYUIkycDCWgmnj3ygjDg8TH38vR2nRI1i7hEPpeqZ9lNUMvVLDFjuVaydzj62fMohK-NbIjd6LQU68kwJIQ_K0gHnpT_0AzZHiXz1U-C8QYSJWDcOUc Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: cfc4f62977324815b29ad0082ef414e6 Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-LiveMigrationNegativeTest-726872911 Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:33:54.439420 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cfc4f62977324815b29ad0082ef414e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfc4f62977324815b29ad0082ef414e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cfc4f62977324815b29ad0082ef414e6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cfc4f62977324815b29ad0082ef414e6"}]}] Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-LiveMigrationNegativeTest-726872911 Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: cfc4f62977324815b29ad0082ef414e6 Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-726872911 Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-LiveMigrationNegativeTest-726872911-project-admin Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6dda89d3ed5a45edb7eab53969b959bb Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-LiveMigrationNegativeTest-726872911-project-admin Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: {"os-migrateLive": {"host": "n-h2-835595-3", "block_migration": true, "disk_over_commit": false}} Oct 05 17:33:54.441007 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: exception: Cannot 'os-migrateLive' instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba while it is in vm_state suspended Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'c980c65d-9eb1-40b0-857f-ffb08dbbc3ba', 'body': {'os-migrateLive': {'host': 'n-h2-835595-3', 'block_migration': True, 'disk_over_commit': False}}} Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 05 17:33:54.441942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:33:54.443400 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba while it is in vm_state suspended Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba while it is in vm_state suspended Oct 05 17:33:54.444867 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:54.445940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba while it is in vm_state suspended {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:54.445940 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a7c9b64-923a-4030-9b9f-f5a60bdd71f5 tempest-LiveMigrationNegativeTest-726872911 tempest-LiveMigrationNegativeTest-726872911-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba/action" status: 409 len: 155 microversion: 2.1 time: 0.114348 Oct 05 17:33:54.445940 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 393/781] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:54 2022] POST /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba/action => generated 155 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:33:54.449177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-81dcc22e-b6de-4dcd-8ae5-699c49a88fe8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1026086702"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:54.449397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-81dcc22e-b6de-4dcd-8ae5-699c49a88fe8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:54.456835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81dcc22e-b6de-4dcd-8ae5-699c49a88fe8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.457327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81dcc22e-b6de-4dcd-8ae5-699c49a88fe8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.457747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81dcc22e-b6de-4dcd-8ae5-699c49a88fe8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.458478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81dcc22e-b6de-4dcd-8ae5-699c49a88fe8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.458933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81dcc22e-b6de-4dcd-8ae5-699c49a88fe8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.459357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81dcc22e-b6de-4dcd-8ae5-699c49a88fe8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.464744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:54.477725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:54.479636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:54.485517 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c29badb6-1a93-4d3d-b07a-5c461eba404b tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1538 microversion: 2.91 time: 0.117214 Oct 05 17:33:54.486163 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 389/782] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:54 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1538 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:54.495706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9f14164-26b5-420d-8fb9-b8a58bbc8c12 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:54.496612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b9f14164-26b5-420d-8fb9-b8a58bbc8c12 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:54.504056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9f14164-26b5-420d-8fb9-b8a58bbc8c12 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.504919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9f14164-26b5-420d-8fb9-b8a58bbc8c12 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.505580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9f14164-26b5-420d-8fb9-b8a58bbc8c12 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.506516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9f14164-26b5-420d-8fb9-b8a58bbc8c12 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.507167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9f14164-26b5-420d-8fb9-b8a58bbc8c12 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.507783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9f14164-26b5-420d-8fb9-b8a58bbc8c12 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.537523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b9f14164-26b5-420d-8fb9-b8a58bbc8c12 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:33:54.613499 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.network.security_group_api [None req-81dcc22e-b6de-4dcd-8ae5-699c49a88fe8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Adding security group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b to port 4406b87b-0391-45db-9f46-d867ac4e374e Oct 05 17:33:54.638330 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b9f14164-26b5-420d-8fb9-b8a58bbc8c12 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 204 len: 0 microversion: 2.1 time: 0.146310 Oct 05 17:33:54.639189 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 390/783] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:33:54 2022] DELETE /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:33:54.645320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:54.646201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: be31de3d-24a3-4ab8-9ade-0025b4e7e27f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:54.652881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.653377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.654410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.655291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.655821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.656251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.670915 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] HTTP exception thrown: Instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f could not be found. Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Request method failure captured: Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f HTTP/1.1 Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_JNYqz3iJg8iGTrYNFsbv2r-wT1RfwB4kY_SPCcav7dFSXLFV0I-kVkWAnpgdstj4k4vfSyQioXfPaRm5mfPQVaNKyIcbO1LCU24h0UDJ_Xl81Kf4IjwK7WRBaUiMLAtnbt1l8gaSgj3Uu_tw5rF-upZqb747-2nNM7KnRF3kha20 Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 411f6ccee8514f6a8f54cd913f958cee Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1685298558 Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:33:54.672591 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/411f6ccee8514f6a8f54cd913f958cee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/411f6ccee8514f6a8f54cd913f958cee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_411f6ccee8514f6a8f54cd913f958cee", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/411f6ccee8514f6a8f54cd913f958cee"}]}] Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1685298558 Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 411f6ccee8514f6a8f54cd913f958cee Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1685298558 Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersAdminNegativeTestJSON-1685298558-project Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6a0d71e683ff47aa968e4334e5999077 Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1685298558-project Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f could not be found. Oct 05 17:33:54.674232 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'be31de3d-24a3-4ab8-9ade-0025b4e7e27f'} Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f could not be found. Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:54.675125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f could not be found. Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f could not be found. Oct 05 17:33:54.676503 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:54.677839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Returning 404 to user: Instance be31de3d-24a3-4ab8-9ade-0025b4e7e27f could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:54.677839 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-da844ba5-1835-4a9e-b8fe-d7af3b21833f tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f" status: 404 len: 111 microversion: 2.1 time: 0.033816 Oct 05 17:33:54.677839 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 391/784] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:54 2022] GET /compute/v2.1/servers/be31de3d-24a3-4ab8-9ade-0025b4e7e27f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:33:54.682649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-91cec5ad-88e3-4ecb-8f36-edf4b11889af tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:54.685106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-91cec5ad-88e3-4ecb-8f36-edf4b11889af tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:54.691181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91cec5ad-88e3-4ecb-8f36-edf4b11889af tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.691665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91cec5ad-88e3-4ecb-8f36-edf4b11889af tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.692098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91cec5ad-88e3-4ecb-8f36-edf4b11889af tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.692795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91cec5ad-88e3-4ecb-8f36-edf4b11889af tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.693250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91cec5ad-88e3-4ecb-8f36-edf4b11889af tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.693672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91cec5ad-88e3-4ecb-8f36-edf4b11889af tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.745326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-91cec5ad-88e3-4ecb-8f36-edf4b11889af tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-835595-3". {{(pid=128844) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 17:33:54.814592 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-91cec5ad-88e3-4ecb-8f36-edf4b11889af tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1/action" status: 202 len: 0 microversion: 2.91 time: 0.135059 Oct 05 17:33:54.815635 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 392/785] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:33:54 2022] POST /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:33:54.820568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4ca07445-bae8-46ec-ab25-54de9be8c5ec tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:54.821392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4ca07445-bae8-46ec-ab25-54de9be8c5ec tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:54.827698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ca07445-bae8-46ec-ab25-54de9be8c5ec tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.828230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ca07445-bae8-46ec-ab25-54de9be8c5ec tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.828625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ca07445-bae8-46ec-ab25-54de9be8c5ec tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.829330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ca07445-bae8-46ec-ab25-54de9be8c5ec tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:54.830504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ca07445-bae8-46ec-ab25-54de9be8c5ec tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:54.830925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ca07445-bae8-46ec-ab25-54de9be8c5ec tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:54.837264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:54.990774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4ca07445-bae8-46ec-ab25-54de9be8c5ec tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:54.998643 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4ca07445-bae8-46ec-ab25-54de9be8c5ec tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1465 microversion: 2.1 time: 0.181696 Oct 05 17:33:54.999274 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 393/786] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:54 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1465 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:55.016298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ae994a5-dbb0-4ecb-9713-9486f1927b57 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:55.017094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ae994a5-dbb0-4ecb-9713-9486f1927b57 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:55.026575 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-81dcc22e-b6de-4dcd-8ae5-699c49a88fe8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd/action" status: 202 len: 0 microversion: 2.1 time: 0.583615 Oct 05 17:33:55.027272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae994a5-dbb0-4ecb-9713-9486f1927b57 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.027272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae994a5-dbb0-4ecb-9713-9486f1927b57 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.027715 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 394/787] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:33:54 2022] POST /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:33:55.027873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae994a5-dbb0-4ecb-9713-9486f1927b57 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.028815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae994a5-dbb0-4ecb-9713-9486f1927b57 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.029504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae994a5-dbb0-4ecb-9713-9486f1927b57 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.029990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ae994a5-dbb0-4ecb-9713-9486f1927b57 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.048595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:55.049957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] [instance: 80d67bc2-1121-445f-9c38-6dc3f7019dd6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:55.072198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.073281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.073996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.075162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.075897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.076788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.081587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ae994a5-dbb0-4ecb-9713-9486f1927b57 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:33:55.105118 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] HTTP exception thrown: Instance 80d67bc2-1121-445f-9c38-6dc3f7019dd6 could not be found. Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Request method failure captured: Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 HTTP/1.1 Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-tDmzZAYu1VLccMxn5T1cyYtTVGt8x4ejpqzv1MhuN_fopyYUefWhlehusLjxBzjOzQ7Ky3BpDgobJ6otEzKszjoieyKiR8sfr9DrJbfQLGJ9MSaeQhmbrEEtO9g8vnbmEXJaMCR7jy3Ksf80R9OmaIPV63HZyVAEd1MaosWXtEXA Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.75 Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 26131a1b2f444be09171129cf0a8ead0 Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersAdmin275Test-842618651 Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:33:55.106943 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/26131a1b2f444be09171129cf0a8ead0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26131a1b2f444be09171129cf0a8ead0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_26131a1b2f444be09171129cf0a8ead0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/26131a1b2f444be09171129cf0a8ead0"}]}] Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersAdmin275Test-842618651 Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 26131a1b2f444be09171129cf0a8ead0 Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersAdmin275Test-842618651 Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersAdmin275Test-842618651-project Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0980740c97e44a6ca30d5ee4b6fb9b8c Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersAdmin275Test-842618651-project Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 80d67bc2-1121-445f-9c38-6dc3f7019dd6 could not be found. Oct 05 17:33:55.108904 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '80d67bc2-1121-445f-9c38-6dc3f7019dd6'} Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80d67bc2-1121-445f-9c38-6dc3f7019dd6 could not be found. Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:55.109847 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80d67bc2-1121-445f-9c38-6dc3f7019dd6 could not be found. Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80d67bc2-1121-445f-9c38-6dc3f7019dd6 could not be found. Oct 05 17:33:55.111316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.112459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] Returning 404 to user: Instance 80d67bc2-1121-445f-9c38-6dc3f7019dd6 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:55.112459 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0e1c1f79-98ea-4676-aa56-427e90cf8f48 tempest-ServersAdmin275Test-842618651 tempest-ServersAdmin275Test-842618651-project] 10.222.0.70 "GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6" status: 404 len: 111 microversion: 2.75 time: 0.074766 Oct 05 17:33:55.113012 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 395/788] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:55 2022] GET /compute/v2.1/servers/80d67bc2-1121-445f-9c38-6dc3f7019dd6 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:33:55.118376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:55.118984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:55.126069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.126664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.127120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.127844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.128377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.128802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.210061 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ae994a5-dbb0-4ecb-9713-9486f1927b57 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 204 len: 0 microversion: 2.1 time: 0.197785 Oct 05 17:33:55.211440 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 394/789] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:33:54 2022] DELETE /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:33:55.220242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26cdf26c-46c0-45e8-8b05-ca3419ce0fe1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775360280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:55.220609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:55.236586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:55.238774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:55.251394 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ddec8ce8-9d7b-49b4-bca0-a1040241049d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1486 microversion: 2.91 time: 0.137197 Oct 05 17:33:55.258152 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 396/790] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:55 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1486 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:55.267512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-82339f1f-620b-4cc4-90be-9b140c2cf0f6 req-09176e02-014b-4ac9-9456-afe95bb61c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9991e62c-dc92-416f-a357-785ac57919cd", "tag": "4406b87b-0391-45db-9f46-d867ac4e374e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:55.278034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-82339f1f-620b-4cc4-90be-9b140c2cf0f6 req-09176e02-014b-4ac9-9456-afe95bb61c4e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.278854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-82339f1f-620b-4cc4-90be-9b140c2cf0f6 req-09176e02-014b-4ac9-9456-afe95bb61c4e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.279480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-82339f1f-620b-4cc4-90be-9b140c2cf0f6 req-09176e02-014b-4ac9-9456-afe95bb61c4e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.298690 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-82339f1f-620b-4cc4-90be-9b140c2cf0f6 req-09176e02-014b-4ac9-9456-afe95bb61c4e service nova] Creating event network-changed:4406b87b-0391-45db-9f46-d867ac4e374e for instance 9991e62c-dc92-416f-a357-785ac57919cd on n-h1-835595-3 Oct 05 17:33:55.304424 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-82339f1f-620b-4cc4-90be-9b140c2cf0f6 req-09176e02-014b-4ac9-9456-afe95bb61c4e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044851 Oct 05 17:33:55.305153 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 397/791] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:55.314815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f6c6d78b-fdd8-46b1-bbc9-359052eec5c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:55.315690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f6c6d78b-fdd8-46b1-bbc9-359052eec5c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:55.324006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c6d78b-fdd8-46b1-bbc9-359052eec5c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.324915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c6d78b-fdd8-46b1-bbc9-359052eec5c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.325583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c6d78b-fdd8-46b1-bbc9-359052eec5c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.327254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c6d78b-fdd8-46b1-bbc9-359052eec5c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.327979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c6d78b-fdd8-46b1-bbc9-359052eec5c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.328633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c6d78b-fdd8-46b1-bbc9-359052eec5c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.354109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG neutronclient.v2_0.client [None req-26cdf26c-46c0-45e8-8b05-ca3419ce0fe1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b in use.", "detail": ""}} {{(pid=128844) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:33:55.356775 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-26cdf26c-46c0-45e8-8b05-ca3419ce0fe1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security Group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b in use. Oct 05 17:33:55.356775 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-7026629a-2ab9-4dce-9aed-6b3739893cc5'] Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26cdf26c-46c0-45e8-8b05-ca3419ce0fe1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-security-groups/4051ab2c-b1eb-4161-8d7c-a9316e22f33b HTTP/1.1 Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:33:55.361591 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: exception: Security Group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b in use. Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-7026629a-2ab9-4dce-9aed-6b3739893cc5'] Oct 05 17:33:55.363970 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4051ab2c-b1eb-4161-8d7c-a9316e22f33b'} Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:55.364867 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b in use. Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7026629a-2ab9-4dce-9aed-6b3739893cc5'] Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b in use. Oct 05 17:33:55.366227 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7026629a-2ab9-4dce-9aed-6b3739893cc5'] Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b in use. Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7026629a-2ab9-4dce-9aed-6b3739893cc5'] Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:55.367616 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:55.368945 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:55.368945 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:55.368945 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:55.368945 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b in use. Oct 05 17:33:55.368945 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7026629a-2ab9-4dce-9aed-6b3739893cc5'] Oct 05 17:33:55.368945 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:55.371723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26cdf26c-46c0-45e8-8b05-ca3419ce0fe1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 400 to user: Security Group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b in use. Oct 05 17:33:55.371723 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-7026629a-2ab9-4dce-9aed-6b3739893cc5'] {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:55.373005 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-26cdf26c-46c0-45e8-8b05-ca3419ce0fe1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/4051ab2c-b1eb-4161-8d7c-a9316e22f33b" status: 400 len: 185 microversion: 2.1 time: 0.160121 Oct 05 17:33:55.374208 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 395/792] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:33:55 2022] DELETE /compute/v2.1/os-security-groups/4051ab2c-b1eb-4161-8d7c-a9316e22f33b => generated 185 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:33:55.383407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:55.384427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:55.394368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.395177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.395799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.396705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.397442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.398031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.565862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f6c6d78b-fdd8-46b1-bbc9-359052eec5c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:55.575977 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f6c6d78b-fdd8-46b1-bbc9-359052eec5c6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1477 microversion: 2.1 time: 0.265843 Oct 05 17:33:55.590539 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 398/793] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:55 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1477 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:55.590539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f231c6c-ca66-48dd-b56a-7bfdba81b177 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:55.590539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f231c6c-ca66-48dd-b56a-7bfdba81b177 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:55.590539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f231c6c-ca66-48dd-b56a-7bfdba81b177 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.590944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f231c6c-ca66-48dd-b56a-7bfdba81b177 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.590944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f231c6c-ca66-48dd-b56a-7bfdba81b177 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.591528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f231c6c-ca66-48dd-b56a-7bfdba81b177 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.592617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f231c6c-ca66-48dd-b56a-7bfdba81b177 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.593485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f231c6c-ca66-48dd-b56a-7bfdba81b177 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.631105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f231c6c-ca66-48dd-b56a-7bfdba81b177 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:33:55.639774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:55.651301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:55.653209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:55.655605 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-46799086-b0be-43b7-a0da-afc1547cf280 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.280044 Oct 05 17:33:55.656185 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 396/794] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:55 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:55.670104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f84c63b6-1acb-49e0-98b9-0e2ae60690ae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:55.670765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f84c63b6-1acb-49e0-98b9-0e2ae60690ae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:55.687163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84c63b6-1acb-49e0-98b9-0e2ae60690ae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.687764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84c63b6-1acb-49e0-98b9-0e2ae60690ae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.688203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84c63b6-1acb-49e0-98b9-0e2ae60690ae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.688977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84c63b6-1acb-49e0-98b9-0e2ae60690ae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.689449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84c63b6-1acb-49e0-98b9-0e2ae60690ae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.689846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f84c63b6-1acb-49e0-98b9-0e2ae60690ae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.768387 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f231c6c-ca66-48dd-b56a-7bfdba81b177 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 204 len: 0 microversion: 2.1 time: 0.189611 Oct 05 17:33:55.772188 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 399/795] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:33:55 2022] DELETE /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:33:55.780739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-345a8e6a-7702-4cc8-b9cf-acc510248c2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:55.782426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-345a8e6a-7702-4cc8-b9cf-acc510248c2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:55.790321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-345a8e6a-7702-4cc8-b9cf-acc510248c2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.791803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-345a8e6a-7702-4cc8-b9cf-acc510248c2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.792509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-345a8e6a-7702-4cc8-b9cf-acc510248c2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.793672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-345a8e6a-7702-4cc8-b9cf-acc510248c2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:55.794893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-345a8e6a-7702-4cc8-b9cf-acc510248c2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:55.795648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-345a8e6a-7702-4cc8-b9cf-acc510248c2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:55.939453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f84c63b6-1acb-49e0-98b9-0e2ae60690ae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:55.948662 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f84c63b6-1acb-49e0-98b9-0e2ae60690ae tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.291441 Oct 05 17:33:55.962302 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 397/796] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:55 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:56.021410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26a673c6-2509-4713-bbeb-f28df54fdcb1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:56.022132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-26a673c6-2509-4713-bbeb-f28df54fdcb1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:56.028736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26a673c6-2509-4713-bbeb-f28df54fdcb1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:56.029229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26a673c6-2509-4713-bbeb-f28df54fdcb1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:56.029664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26a673c6-2509-4713-bbeb-f28df54fdcb1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:56.030392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26a673c6-2509-4713-bbeb-f28df54fdcb1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:56.030852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26a673c6-2509-4713-bbeb-f28df54fdcb1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:56.031271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26a673c6-2509-4713-bbeb-f28df54fdcb1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:56.168067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-26a673c6-2509-4713-bbeb-f28df54fdcb1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:56.176435 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-26a673c6-2509-4713-bbeb-f28df54fdcb1 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1465 microversion: 2.1 time: 0.159085 Oct 05 17:33:56.177010 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 398/797] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:56 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1465 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:56.280735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:56.281397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:56.288852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:56.290821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:56.291785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:56.292703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:56.293431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:56.294208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:56.337852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-345a8e6a-7702-4cc8-b9cf-acc510248c2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:56.347530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-345a8e6a-7702-4cc8-b9cf-acc510248c2f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1649 microversion: 2.1 time: 0.571049 Oct 05 17:33:56.348388 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 400/798] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:55 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1649 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:56.380126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:56.388442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:56.389891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:56.394975 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9963a1a1-85b5-43e8-893c-b26339daefae tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1486 microversion: 2.91 time: 0.119338 Oct 05 17:33:56.395579 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 399/799] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:56 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1486 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:56.604815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dbe3d945-8a1e-4e0a-9a59-c44561579470 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:56.605542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dbe3d945-8a1e-4e0a-9a59-c44561579470 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:56.613521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbe3d945-8a1e-4e0a-9a59-c44561579470 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:56.614047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbe3d945-8a1e-4e0a-9a59-c44561579470 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:56.614536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbe3d945-8a1e-4e0a-9a59-c44561579470 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:56.615224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbe3d945-8a1e-4e0a-9a59-c44561579470 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:56.615649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbe3d945-8a1e-4e0a-9a59-c44561579470 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:56.616296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbe3d945-8a1e-4e0a-9a59-c44561579470 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:56.681744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:56.682491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:56.689786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:56.690386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:56.690886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:56.691706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:56.692246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:56.692704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:56.759550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dbe3d945-8a1e-4e0a-9a59-c44561579470 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:56.767816 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dbe3d945-8a1e-4e0a-9a59-c44561579470 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1477 microversion: 2.1 time: 0.167806 Oct 05 17:33:56.768848 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 401/800] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:56 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:56.922728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:56.935120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:56.936914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:56.940648 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81629af2-5922-4cb1-97df-dfa382f035c5 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.262379 Oct 05 17:33:56.954313 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 400/801] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:56 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:56.974494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-61aa6553-1ca8-47ed-8e73-462dc9138273 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:56.975430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-61aa6553-1ca8-47ed-8e73-462dc9138273 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:56.983022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61aa6553-1ca8-47ed-8e73-462dc9138273 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:56.984358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61aa6553-1ca8-47ed-8e73-462dc9138273 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:56.984858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61aa6553-1ca8-47ed-8e73-462dc9138273 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:56.987276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61aa6553-1ca8-47ed-8e73-462dc9138273 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:56.987909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61aa6553-1ca8-47ed-8e73-462dc9138273 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:56.988620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61aa6553-1ca8-47ed-8e73-462dc9138273 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.160997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-61aa6553-1ca8-47ed-8e73-462dc9138273 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:57.170205 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-61aa6553-1ca8-47ed-8e73-462dc9138273 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.201171 Oct 05 17:33:57.171039 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 402/802] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:56 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:57.199249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d8ec65b1-650c-448d-a2cd-4b0f775dd9aa tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:57.199867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d8ec65b1-650c-448d-a2cd-4b0f775dd9aa tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:57.205955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8ec65b1-650c-448d-a2cd-4b0f775dd9aa tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.206683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8ec65b1-650c-448d-a2cd-4b0f775dd9aa tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.207130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8ec65b1-650c-448d-a2cd-4b0f775dd9aa tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.207818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8ec65b1-650c-448d-a2cd-4b0f775dd9aa tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.208274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8ec65b1-650c-448d-a2cd-4b0f775dd9aa tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.208701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8ec65b1-650c-448d-a2cd-4b0f775dd9aa tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.373214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ada75fad-31e0-4a9f-983e-a8535d358e63 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:57.375103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ada75fad-31e0-4a9f-983e-a8535d358e63 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:57.382376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ada75fad-31e0-4a9f-983e-a8535d358e63 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.382909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ada75fad-31e0-4a9f-983e-a8535d358e63 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.383311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ada75fad-31e0-4a9f-983e-a8535d358e63 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.385169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ada75fad-31e0-4a9f-983e-a8535d358e63 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.385867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ada75fad-31e0-4a9f-983e-a8535d358e63 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.386681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ada75fad-31e0-4a9f-983e-a8535d358e63 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.408849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:33:57.425931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d8ec65b1-650c-448d-a2cd-4b0f775dd9aa tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:57.436179 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d8ec65b1-650c-448d-a2cd-4b0f775dd9aa tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1465 microversion: 2.1 time: 0.240761 Oct 05 17:33:57.437638 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 401/803] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:57 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1465 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:57.448581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-75a68bfd-b053-4236-ae19-abfff2f9555b req-ac3dfed4-62d4-49cf-94cd-de1da3327d86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07ea7e2-f9cd-493e-82f9-15deae371911", "name": "network-vif-deleted", "tag": "285f5185-4e97-4744-b230-1804227341e6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:57.481563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-75a68bfd-b053-4236-ae19-abfff2f9555b req-ac3dfed4-62d4-49cf-94cd-de1da3327d86 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.482229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-75a68bfd-b053-4236-ae19-abfff2f9555b req-ac3dfed4-62d4-49cf-94cd-de1da3327d86 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.482838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-75a68bfd-b053-4236-ae19-abfff2f9555b req-ac3dfed4-62d4-49cf-94cd-de1da3327d86 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.504593 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-75a68bfd-b053-4236-ae19-abfff2f9555b req-ac3dfed4-62d4-49cf-94cd-de1da3327d86 service nova] Creating event network-vif-deleted:285f5185-4e97-4744-b230-1804227341e6 for instance d07ea7e2-f9cd-493e-82f9-15deae371911 on n-h2-835595-3 Oct 05 17:33:57.519349 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-75a68bfd-b053-4236-ae19-abfff2f9555b req-ac3dfed4-62d4-49cf-94cd-de1da3327d86 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080177 Oct 05 17:33:57.519980 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 402/804] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:57.531882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:57.532636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:57.539508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.540009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.540450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.541169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.541633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.542260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.616309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ada75fad-31e0-4a9f-983e-a8535d358e63 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:57.624171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:57.625826 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ada75fad-31e0-4a9f-983e-a8535d358e63 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1649 microversion: 2.1 time: 0.258386 Oct 05 17:33:57.626471 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 403/805] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:57 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1649 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:57.633947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:57.635426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:57.641570 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b58b46cf-a834-405f-87a5-527fab1ec6a3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1486 microversion: 2.91 time: 0.115881 Oct 05 17:33:57.642083 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 403/806] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:57 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1486 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:57.791102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:57.791854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:57.799385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.799945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.800448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.801229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.801678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.802126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.855959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.856487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.856896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.857723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lazy-loading 'fault' on Instance uuid d07ea7e2-f9cd-493e-82f9-15deae371911 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:33:57.914008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a0d71e683ff47aa968e4334e5999077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411f6ccee8514f6a8f54cd913f958cee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:57.925558 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bf6b9bdf-4c79-4219-bc1e-9f2698e801b6 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 200 len: 1312 microversion: 2.1 time: 0.138366 Oct 05 17:33:57.926077 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 404/807] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:57 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 1312 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:57.968788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:57.969412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:57.977583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.978074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.978552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:57.979290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:57.979754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:57.980941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.196444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f45a6986-4d21-4c18-ae8f-cf69ee56455d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:58.197270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f45a6986-4d21-4c18-ae8f-cf69ee56455d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:58.213289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f45a6986-4d21-4c18-ae8f-cf69ee56455d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:58.215832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f45a6986-4d21-4c18-ae8f-cf69ee56455d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:58.217568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f45a6986-4d21-4c18-ae8f-cf69ee56455d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.220632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f45a6986-4d21-4c18-ae8f-cf69ee56455d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:58.221154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f45a6986-4d21-4c18-ae8f-cf69ee56455d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:58.221832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f45a6986-4d21-4c18-ae8f-cf69ee56455d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.394871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:58.407434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:58.409236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:58.410908 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-65212d42-47c5-4bed-80fd-37ec76f23ad3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1566 microversion: 2.25 time: 0.446319 Oct 05 17:33:58.413204 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 404/808] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:57 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1566 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:58.462336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c1c826d5-dd4c-43ca-bc08-86533f679ee7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:58.463136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c1c826d5-dd4c-43ca-bc08-86533f679ee7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:58.471861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1c826d5-dd4c-43ca-bc08-86533f679ee7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:58.474325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1c826d5-dd4c-43ca-bc08-86533f679ee7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:58.475075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1c826d5-dd4c-43ca-bc08-86533f679ee7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.476973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1c826d5-dd4c-43ca-bc08-86533f679ee7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:58.478315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1c826d5-dd4c-43ca-bc08-86533f679ee7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:58.481070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1c826d5-dd4c-43ca-bc08-86533f679ee7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.704865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f45a6986-4d21-4c18-ae8f-cf69ee56455d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:58.714652 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f45a6986-4d21-4c18-ae8f-cf69ee56455d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.524869 Oct 05 17:33:58.715761 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 405/809] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:58 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:58.721820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a81156a3-d464-4207-88b6-84400a1bcdfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:58.722996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a81156a3-d464-4207-88b6-84400a1bcdfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:58.729723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81156a3-d464-4207-88b6-84400a1bcdfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:58.733992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c1c826d5-dd4c-43ca-bc08-86533f679ee7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:58.734605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81156a3-d464-4207-88b6-84400a1bcdfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:58.735144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81156a3-d464-4207-88b6-84400a1bcdfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.735956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81156a3-d464-4207-88b6-84400a1bcdfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:58.736438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81156a3-d464-4207-88b6-84400a1bcdfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:58.736862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81156a3-d464-4207-88b6-84400a1bcdfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.745591 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c1c826d5-dd4c-43ca-bc08-86533f679ee7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1465 microversion: 2.1 time: 0.288764 Oct 05 17:33:58.747347 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 405/810] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:58 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1465 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:33:58.753460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:58.754473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:58.762227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:58.763182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:58.763960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.764925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:58.765757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:58.766505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.864993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:58.873926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:58.875582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:58.881604 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4cf9a496-78a7-4539-8f22-bfb9ce297bbb tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.132487 Oct 05 17:33:58.882594 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 406/811] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:58 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:58.949925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:58.950721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] [instance: d07ea7e2-f9cd-493e-82f9-15deae371911] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:58.957448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:58.958159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:58.958715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.959569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:58.960368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:58.960904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:58.982371 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] HTTP exception thrown: Instance d07ea7e2-f9cd-493e-82f9-15deae371911 could not be found. Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Request method failure captured: Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 HTTP/1.1 Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_JNYqz3iJg8iGTrYNFsbv2r-wT1RfwB4kY_SPCcav7dFSXLFV0I-kVkWAnpgdstj4k4vfSyQioXfPaRm5mfPQVaNKyIcbO1LCU24h0UDJ_Xl81Kf4IjwK7WRBaUiMLAtnbt1l8gaSgj3Uu_tw5rF-upZqb747-2nNM7KnRF3kha20 Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 411f6ccee8514f6a8f54cd913f958cee Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1685298558 Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:33:58.985564 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/411f6ccee8514f6a8f54cd913f958cee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/411f6ccee8514f6a8f54cd913f958cee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_411f6ccee8514f6a8f54cd913f958cee", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/411f6ccee8514f6a8f54cd913f958cee"}]}] Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1685298558 Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 411f6ccee8514f6a8f54cd913f958cee Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1685298558 Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersAdminNegativeTestJSON-1685298558-project Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6a0d71e683ff47aa968e4334e5999077 Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1685298558-project Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance d07ea7e2-f9cd-493e-82f9-15deae371911 could not be found. Oct 05 17:33:58.987591 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'd07ea7e2-f9cd-493e-82f9-15deae371911'} Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d07ea7e2-f9cd-493e-82f9-15deae371911 could not be found. Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:33:58.988474 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d07ea7e2-f9cd-493e-82f9-15deae371911 could not be found. Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d07ea7e2-f9cd-493e-82f9-15deae371911 could not be found. Oct 05 17:33:58.989712 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:33:58.993010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] Returning 404 to user: Instance d07ea7e2-f9cd-493e-82f9-15deae371911 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:33:58.994902 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78e4bb3c-8851-4866-89a3-3c1e495de1f7 tempest-ServersAdminNegativeTestJSON-1685298558 tempest-ServersAdminNegativeTestJSON-1685298558-project] 10.222.0.70 "GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911" status: 404 len: 111 microversion: 2.1 time: 0.049487 Oct 05 17:33:58.995755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 407/812] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:58 2022] GET /compute/v2.1/servers/d07ea7e2-f9cd-493e-82f9-15deae371911 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:33:59.440846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:59.441863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:59.454519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:59.455948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:59.456934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:59.458956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:59.459427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:59.461937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:59.515065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a81156a3-d464-4207-88b6-84400a1bcdfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:59.529368 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a81156a3-d464-4207-88b6-84400a1bcdfb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1649 microversion: 2.1 time: 0.811363 Oct 05 17:33:59.544389 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 406/813] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:58 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1649 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:33:59.552770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-71904e93-8faf-4826-96da-0090be8d99ef req-a061b18e-cf61-44bd-b218-cbb33d887613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9991e62c-dc92-416f-a357-785ac57919cd", "name": "network-vif-deleted", "tag": "4406b87b-0391-45db-9f46-d867ac4e374e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:33:59.566863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-71904e93-8faf-4826-96da-0090be8d99ef req-a061b18e-cf61-44bd-b218-cbb33d887613 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:59.567745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-71904e93-8faf-4826-96da-0090be8d99ef req-a061b18e-cf61-44bd-b218-cbb33d887613 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:59.568371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-71904e93-8faf-4826-96da-0090be8d99ef req-a061b18e-cf61-44bd-b218-cbb33d887613 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:59.598866 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-71904e93-8faf-4826-96da-0090be8d99ef req-a061b18e-cf61-44bd-b218-cbb33d887613 service nova] Creating event network-vif-deleted:4406b87b-0391-45db-9f46-d867ac4e374e for instance 9991e62c-dc92-416f-a357-785ac57919cd on n-h1-835595-3 Oct 05 17:33:59.620994 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-71904e93-8faf-4826-96da-0090be8d99ef req-a061b18e-cf61-44bd-b218-cbb33d887613 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074749 Oct 05 17:33:59.626428 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 407/814] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:33:59.741835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca7f2aa2-cc64-48b5-b7e5-77b4f488a63b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:59.742555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ca7f2aa2-cc64-48b5-b7e5-77b4f488a63b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:59.754850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca7f2aa2-cc64-48b5-b7e5-77b4f488a63b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:59.755362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca7f2aa2-cc64-48b5-b7e5-77b4f488a63b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:59.755804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca7f2aa2-cc64-48b5-b7e5-77b4f488a63b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:59.756542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca7f2aa2-cc64-48b5-b7e5-77b4f488a63b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:59.757002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca7f2aa2-cc64-48b5-b7e5-77b4f488a63b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:59.757443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca7f2aa2-cc64-48b5-b7e5-77b4f488a63b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:59.931268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:59.945817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:59.947709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:33:59.949638 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5fb05595-8b8d-4d3b-bc22-03d1638bb12d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1556 microversion: 2.25 time: 0.516059 Oct 05 17:33:59.950777 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 408/815] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:33:59 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1556 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:33:59.957622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d497050-83a2-4acd-a7d0-b143f8b5f866 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:33:59.959164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2d497050-83a2-4acd-a7d0-b143f8b5f866 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:33:59.975119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d497050-83a2-4acd-a7d0-b143f8b5f866 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:59.975616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d497050-83a2-4acd-a7d0-b143f8b5f866 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:59.976099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d497050-83a2-4acd-a7d0-b143f8b5f866 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:33:59.976830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d497050-83a2-4acd-a7d0-b143f8b5f866 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:33:59.977288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d497050-83a2-4acd-a7d0-b143f8b5f866 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:33:59.977708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d497050-83a2-4acd-a7d0-b143f8b5f866 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:00.198266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ca7f2aa2-cc64-48b5-b7e5-77b4f488a63b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:00.209956 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ca7f2aa2-cc64-48b5-b7e5-77b4f488a63b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.473759 Oct 05 17:34:00.210920 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 408/816] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:59 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:34:00.218066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:00.219194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:00.250265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:00.251471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:00.255807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:00.258416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:00.260609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:00.261560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:00.430840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:00.431157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2d497050-83a2-4acd-a7d0-b143f8b5f866 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:00.458120 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2d497050-83a2-4acd-a7d0-b143f8b5f866 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1423 microversion: 2.1 time: 0.505824 Oct 05 17:34:00.459638 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 409/817] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:33:59 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1423 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:00.465739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ea8b38b4-90a4-4699-b239-71fd88622694 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '.version_select at 0x7f7775429d30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:00.470560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea8b38b4-90a4-4699-b239-71fd88622694 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:00.471269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea8b38b4-90a4-4699-b239-71fd88622694 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:00.471414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:00.472367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea8b38b4-90a4-4699-b239-71fd88622694 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:00.477326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:00.484514 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ea8b38b4-90a4-4699-b239-71fd88622694 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1525 microversion: 2.25 time: 0.023003 Oct 05 17:34:00.485828 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 410/818] 10.222.0.70 () {60 vars in 1184 bytes} [Wed Oct 5 17:34:00 2022] GET /compute/v2.1/os-migrations => generated 1525 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:00.491079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-0f9a929c-1e2e-4ac3-9558-ff8e481b323f req-4b7f5399-cb5e-4f9e-8fff-d87ca5bc8f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c980c65d-9eb1-40b0-857f-ffb08dbbc3ba", "name": "network-vif-deleted", "tag": "4ec3b379-8a74-4c12-97da-5c39576a258e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:00.504269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0f9a929c-1e2e-4ac3-9558-ff8e481b323f req-4b7f5399-cb5e-4f9e-8fff-d87ca5bc8f2b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:00.506454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0f9a929c-1e2e-4ac3-9558-ff8e481b323f req-4b7f5399-cb5e-4f9e-8fff-d87ca5bc8f2b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:00.507627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0f9a929c-1e2e-4ac3-9558-ff8e481b323f req-4b7f5399-cb5e-4f9e-8fff-d87ca5bc8f2b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:00.509881 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-66a23e6e-9f8a-4dbb-b798-1477c6706db6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.294734 Oct 05 17:34:00.512219 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 409/819] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:00 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:00.528343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51bd40c9-6019-4158-835e-171f94d4abeb tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:00.539732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51bd40c9-6019-4158-835e-171f94d4abeb tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:00.553210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51bd40c9-6019-4158-835e-171f94d4abeb tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:00.556272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51bd40c9-6019-4158-835e-171f94d4abeb tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:00.557945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51bd40c9-6019-4158-835e-171f94d4abeb tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:00.567229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51bd40c9-6019-4158-835e-171f94d4abeb tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:00.572371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:00.575594 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-0f9a929c-1e2e-4ac3-9558-ff8e481b323f req-4b7f5399-cb5e-4f9e-8fff-d87ca5bc8f2b service nova] Creating event network-vif-deleted:4ec3b379-8a74-4c12-97da-5c39576a258e for instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba on n-h1-835595-3 Oct 05 17:34:00.584827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51bd40c9-6019-4158-835e-171f94d4abeb tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:00.589016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51bd40c9-6019-4158-835e-171f94d4abeb tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:00.593199 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-0f9a929c-1e2e-4ac3-9558-ff8e481b323f req-4b7f5399-cb5e-4f9e-8fff-d87ca5bc8f2b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105700 Oct 05 17:34:00.593925 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 411/820] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:00.611689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:00.614919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:00.643724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:00.647358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:00.648190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:00.651427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:00.655645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:00.659682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:00.789925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:00.791113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:00.793314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:00.794999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lazy-loading 'fault' on Instance uuid 9991e62c-dc92-416f-a357-785ac57919cd {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:00.930910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:00.974704 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8c83ff0a-f96a-4186-b544-daf5e3583976 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 200 len: 1306 microversion: 2.1 time: 0.377700 Oct 05 17:34:00.988330 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 412/821] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:00 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 1306 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:01.181002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-51bd40c9-6019-4158-835e-171f94d4abeb tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid d655671e-b4fa-4bf6-85b2-5a2d556124a2 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:01.211906 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51bd40c9-6019-4158-835e-171f94d4abeb tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 2048 microversion: 2.25 time: 0.697860 Oct 05 17:34:01.217606 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 410/822] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:00 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 2048 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:01.240024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e34c3fc3-0810-486f-b908-afd4158c8269 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:01.240815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e34c3fc3-0810-486f-b908-afd4158c8269 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:01.256419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e34c3fc3-0810-486f-b908-afd4158c8269 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:01.256916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e34c3fc3-0810-486f-b908-afd4158c8269 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:01.257436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e34c3fc3-0810-486f-b908-afd4158c8269 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:01.258054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e34c3fc3-0810-486f-b908-afd4158c8269 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:01.276200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e34c3fc3-0810-486f-b908-afd4158c8269 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:01.276881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e34c3fc3-0810-486f-b908-afd4158c8269 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:01.483325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:01.484698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:01.502141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:01.502920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:01.504002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:01.504929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:01.506182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:01.506840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:01.580781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:01.581771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:01.582564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:01.583795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lazy-loading 'fault' on Instance uuid c980c65d-9eb1-40b0-857f-ffb08dbbc3ba {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:01.661449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:01.676884 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d5f2e16a-2a26-4572-a5cf-43e59f6a0a74 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1308 microversion: 2.1 time: 0.197918 Oct 05 17:34:01.679356 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 411/823] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:01 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:01.687898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1586201948", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "71625936-48e5-43f1-8d04-88ba77014c3c"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:01.807123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] validate_networks() for [('71625936-48e5-43f1-8d04-88ba77014c3c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:34:01.974211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e34c3fc3-0810-486f-b908-afd4158c8269 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:01.988916 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e34c3fc3-0810-486f-b908-afd4158c8269 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.753265 Oct 05 17:34:01.992113 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 413/824] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:01 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:34:02.019447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:02.020152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:02.038125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:02.039666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:02.041887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:02.043365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:02.043880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:02.044326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:02.264592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:02.279862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:02.286589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:02.299283 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e995b2d-28db-444d-9b36-7267b1b29a51 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.302450 Oct 05 17:34:02.300359 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 414/825] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:01 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:02.309764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:02.311241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:02.328269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:02.329309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:02.330079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:02.331766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:02.332679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:02.334518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:02.399982 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd HTTP/1.1 Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:02.402149 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:02.403600 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '9991e62c-dc92-416f-a357-785ac57919cd'} Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:02.404345 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:02.405525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:02.411585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:02.416455 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e860db79-6642-4754-87c5-dc4f909efae1 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 404 len: 111 microversion: 2.1 time: 0.114799 Oct 05 17:34:02.420859 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 415/826] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:02 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:02.433636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-faeb1d2f-9ec6-4b1d-82b3-071e1c1a6265 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775360ca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:02.868419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:34:02.869047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:34:02.869317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:34:02.869768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:34:02.870134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:34:02.883767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:02.884581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:02.885305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:02.886918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:02.887687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:02.890189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:02.918149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Getting quotas for project 51a14f79344f4986a6c54001c3d7590c. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:02.924391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Getting quotas for user 205777d0702b45d1b400045c3a2fd47b and project 51a14f79344f4986a6c54001c3d7590c. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:02.945141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:02.947232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:34:02.951502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:34:03.074657 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-363f4751-4210-416f-935f-5da4a30f03b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.391611 Oct 05 17:34:03.097283 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 412/827] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:34:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:34:03.115861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:03.123639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:03.148400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:03.148879 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-faeb1d2f-9ec6-4b1d-82b3-071e1c1a6265 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/8b532bf8-3500-47c8-b7f7-782ad031769e" status: 202 len: 0 microversion: 2.1 time: 0.724171 Oct 05 17:34:03.160477 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 416/828] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:02 2022] DELETE /compute/v2.1/os-security-groups/8b532bf8-3500-47c8-b7f7-782ad031769e => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:34:03.161118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:03.161118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:03.161118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:03.161118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:03.161414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:03.161497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63de528f-f9ed-43a9-a57c-05841a21b8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:03.161497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63de528f-f9ed-43a9-a57c-05841a21b8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:03.197744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63de528f-f9ed-43a9-a57c-05841a21b8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:03.198274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63de528f-f9ed-43a9-a57c-05841a21b8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:03.198745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63de528f-f9ed-43a9-a57c-05841a21b8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:03.199902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63de528f-f9ed-43a9-a57c-05841a21b8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:03.200019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63de528f-f9ed-43a9-a57c-05841a21b8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:03.200365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63de528f-f9ed-43a9-a57c-05841a21b8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:03.274436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:03.285378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:03.286962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:03.289033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lazy-loading 'fault' on Instance uuid c980c65d-9eb1-40b0-857f-ffb08dbbc3ba {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:03.442996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:03.462136 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2a638155-a2f4-4d5a-81c7-a6ed2fe2a302 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 200 len: 1308 microversion: 2.1 time: 0.361043 Oct 05 17:34:03.467647 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 413/829] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:03 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:03.484672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c756453f-46bb-4ff6-9202-db1144259998 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:03.485711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c756453f-46bb-4ff6-9202-db1144259998 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:03.593943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c756453f-46bb-4ff6-9202-db1144259998 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:03.606209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c756453f-46bb-4ff6-9202-db1144259998 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:03.611816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c756453f-46bb-4ff6-9202-db1144259998 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:03.612985 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c756453f-46bb-4ff6-9202-db1144259998 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1262 microversion: 2.25 time: 0.144055 Oct 05 17:34:03.613744 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 414/830] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:03 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1262 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:03.624670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0478eac7-c40e-4885-a1aa-08838b77cafb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f777584bca0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:03.785534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63de528f-f9ed-43a9-a57c-05841a21b8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:03.796553 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63de528f-f9ed-43a9-a57c-05841a21b8f2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.644272 Oct 05 17:34:03.803501 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 417/831] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:03 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:03.819210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:03.820892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:03.841129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:03.848193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:03.848754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:03.849203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:03.855098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:03.862666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:03.863126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:04.120454 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0478eac7-c40e-4885-a1aa-08838b77cafb tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/4051ab2c-b1eb-4161-8d7c-a9316e22f33b" status: 202 len: 0 microversion: 2.1 time: 0.505729 Oct 05 17:34:04.121254 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 415/832] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:03 2022] DELETE /compute/v2.1/os-security-groups/4051ab2c-b1eb-4161-8d7c-a9316e22f33b => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:34:04.134327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-71da1336-50ad-4471-8f1f-b374cbfe140c tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'create', calling method: .version_select at 0x7f7775b964c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1321598034", "description": "tempest-description-975753801"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:04.237939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:04.256077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:04.257608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:04.301864 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e3624a3-9cb5-43b8-929e-3f9cc30512aa tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.496119 Oct 05 17:34:04.304212 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 418/833] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:03 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:04.482351 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-71da1336-50ad-4471-8f1f-b374cbfe140c tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.352446 Oct 05 17:34:04.482951 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 416/834] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:34:04 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:04.499633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c21ccf97-b038-4d7e-b00b-c58436c58b84 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Action: 'update', calling method: .version_select at 0x7f7775af10d0>, body: {"security_group": {"name": "tempest-sg-hth-171903147", "description": "tempest-description-hth-1905761926"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:04.503788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:04.504810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c980c65d-9eb1-40b0-857f-ffb08dbbc3ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:04.543484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:04.547479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:04.549455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:04.552083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:04.553456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:04.555437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:04.639191 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] HTTP exception thrown: Instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba could not be found. Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Request method failure captured: Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba HTTP/1.1 Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_NbUn04VZlTkelCCWetN8HPefMgPl-RkpfdiEp__KaBfg2YwHZcQN7GGdkp__Tc1hhiTaDMSe-JiZTNftddSdauAVh26123wz6T8ATjYMpqoQmqQ85xBax5yeb_nZswd7zTtGdSeZXlRWnC5f1Br9TBDmNX0E_NLzXIU1-npyqpL8 Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 78997afe35c142c486d6079e462c5ddf Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-LiveMigrationNegativeTest-1828845879 Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:04.643190 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/78997afe35c142c486d6079e462c5ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/78997afe35c142c486d6079e462c5ddf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_78997afe35c142c486d6079e462c5ddf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/78997afe35c142c486d6079e462c5ddf"}]}] Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-LiveMigrationNegativeTest-1828845879 Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 78997afe35c142c486d6079e462c5ddf Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1828845879 Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-LiveMigrationNegativeTest-1828845879-project Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: b2af401d63f24d9a9cb58c54602768f7 Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-LiveMigrationNegativeTest-1828845879-project Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba could not be found. Oct 05 17:34:04.644874 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'c980c65d-9eb1-40b0-857f-ffb08dbbc3ba'} Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba could not be found. Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:04.645752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba could not be found. Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba could not be found. Oct 05 17:34:04.647984 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:04.652198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Returning 404 to user: Instance c980c65d-9eb1-40b0-857f-ffb08dbbc3ba could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:04.653646 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ff6e9357-5f14-4447-821b-657567a1267c tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba" status: 404 len: 111 microversion: 2.1 time: 0.163807 Oct 05 17:34:04.658343 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 419/835] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:04 2022] GET /compute/v2.1/servers/c980c65d-9eb1-40b0-857f-ffb08dbbc3ba => generated 111 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:04.666176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:04.668395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:04.676216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:04.676966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:04.677625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:04.678668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:04.679280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:04.679848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:04.943768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:04.989059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:05.000360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:05.004628 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f7853e97-fb69-4501-933f-08a27d051f94 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1258 microversion: 2.25 time: 0.343456 Oct 05 17:34:05.010179 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 420/836] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:04 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1258 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:05.013814 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c21ccf97-b038-4d7e-b00b-c58436c58b84 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "PUT /compute/v2.1/os-security-groups/285b4452-2f10-4023-9393-ec1e5e2518a6" status: 200 len: 217 microversion: 2.1 time: 0.518091 Oct 05 17:34:05.015039 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 417/837] 10.222.0.70 () {60 vars in 1290 bytes} [Wed Oct 5 17:34:04 2022] PUT /compute/v2.1/os-security-groups/285b4452-2f10-4023-9393-ec1e5e2518a6 => generated 217 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:05.027562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80a47c11-f42e-4461-81fd-c8441d8fbbfd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:05.028545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-80a47c11-f42e-4461-81fd-c8441d8fbbfd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:05.043931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b0f2aa09-3600-454d-bea2-461c143fbff8 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:05.046639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b0f2aa09-3600-454d-bea2-461c143fbff8 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:05.050307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80a47c11-f42e-4461-81fd-c8441d8fbbfd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:05.051061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80a47c11-f42e-4461-81fd-c8441d8fbbfd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:05.051657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80a47c11-f42e-4461-81fd-c8441d8fbbfd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:05.055247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80a47c11-f42e-4461-81fd-c8441d8fbbfd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:05.055917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80a47c11-f42e-4461-81fd-c8441d8fbbfd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:05.056508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80a47c11-f42e-4461-81fd-c8441d8fbbfd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:05.071666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f2aa09-3600-454d-bea2-461c143fbff8 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:05.080172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f2aa09-3600-454d-bea2-461c143fbff8 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:05.081258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f2aa09-3600-454d-bea2-461c143fbff8 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:05.087612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f2aa09-3600-454d-bea2-461c143fbff8 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:05.088728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f2aa09-3600-454d-bea2-461c143fbff8 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:05.092910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f2aa09-3600-454d-bea2-461c143fbff8 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:05.221539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b0f2aa09-3600-454d-bea2-461c143fbff8 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:34:05.611006 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b0f2aa09-3600-454d-bea2-461c143fbff8 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 204 len: 0 microversion: 2.1 time: 0.598395 Oct 05 17:34:05.613354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-80a47c11-f42e-4461-81fd-c8441d8fbbfd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:05.617172 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 421/838] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:34:05 2022] DELETE /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:34:05.628735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f1ea5d7-0b13-4b9d-8e2d-33c128e3b8d8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775394790>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:05.631325 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-80a47c11-f42e-4461-81fd-c8441d8fbbfd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.611088 Oct 05 17:34:05.633195 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 418/839] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:05 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:05.662979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:05.663787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:05.684575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:05.695149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:05.696022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:05.702491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:05.703258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:05.703699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:05.901615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:05.915684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:05.917109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:05.930064 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ef2389a1-af12-4221-a360-cda5eea55292 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.282854 Oct 05 17:34:05.931394 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 419/840] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:05 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:05.950446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8cc03894-662d-40a6-91ee-21d8c22f79e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:05.951448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8cc03894-662d-40a6-91ee-21d8c22f79e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:05.959309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cc03894-662d-40a6-91ee-21d8c22f79e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:05.962233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cc03894-662d-40a6-91ee-21d8c22f79e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:05.963014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cc03894-662d-40a6-91ee-21d8c22f79e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:05.963966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cc03894-662d-40a6-91ee-21d8c22f79e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:05.964632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cc03894-662d-40a6-91ee-21d8c22f79e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:05.967133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cc03894-662d-40a6-91ee-21d8c22f79e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.078173 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f1ea5d7-0b13-4b9d-8e2d-33c128e3b8d8 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/285b4452-2f10-4023-9393-ec1e5e2518a6" status: 200 len: 217 microversion: 2.1 time: 0.460313 Oct 05 17:34:06.078822 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 422/841] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:34:05 2022] GET /compute/v2.1/os-security-groups/285b4452-2f10-4023-9393-ec1e5e2518a6 => generated 217 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:06.182954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8cc03894-662d-40a6-91ee-21d8c22f79e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:06.198294 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8cc03894-662d-40a6-91ee-21d8c22f79e7 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1475 microversion: 2.1 time: 0.262218 Oct 05 17:34:06.202236 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 420/842] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:05 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1475 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:06.207469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:06.210255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:06.221967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.222931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.223646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.225478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.226339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.227082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.275527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Action: 'update', calling method: .version_select at 0x7f7775394e50>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:06.281302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.282548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.284021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.299816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.306536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.307242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.324593 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] HTTP exception thrown: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.334550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Request method failure captured: Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/os-services/c21ef909-21c9-4467-b707-960753fc165a HTTP/1.1 Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 56 Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcANW6beS83afEI8uk12eOzSvQC5vXjGa5tg7yUEGs0tw0tAbB_nrE_Qu2H_8NKTQkoIkkPPUCruWZt7ZJ143AVY8jvaAG2IEcPZxiyWiBAiYYRPUwZ0bO0e7eAyrvtnVekc051lA8QfALyvE3MttVcyRWDBNb9qV74VTncT0GmdM6g Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.53 Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: b8af593147a549b0857f21292d087e77 Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1386041032 Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:34:06.335841 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8af593147a549b0857f21292d087e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8af593147a549b0857f21292d087e77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8af593147a549b0857f21292d087e77", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8af593147a549b0857f21292d087e77"}]}] Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1386041032 Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: b8af593147a549b0857f21292d087e77 Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1386041032 Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 905defa20a01410ba26df4e9a6888a7e Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:34:06.337320 n-d-835595-3 devstack@n-api.service[128844]: exception: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'c21ef909-21c9-4467-b707-960753fc165a', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.338172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:06.339516 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:06.342055 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:06.342055 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.342055 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.343674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Returning 404 to user: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:06.344803 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2df9b6d7-713c-4746-9702-875e98b1c99a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/c21ef909-21c9-4467-b707-960753fc165a" status: 404 len: 110 microversion: 2.53 time: 0.265000 Oct 05 17:34:06.346123 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 423/843] 10.222.0.70 () {62 vars in 1309 bytes} [Wed Oct 5 17:34:06 2022] PUT /compute/v2.1/os-services/c21ef909-21c9-4467-b707-960753fc165a => generated 110 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:34:06.351298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:06.352870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:06.354037 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29cb42d5-258d-478e-9b41-fa23609b058a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1322 microversion: 2.25 time: 0.150532 Oct 05 17:34:06.355035 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 421/844] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:06 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:06.355881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-abe683bb-a1ee-4e61-b5ce-522b2bda3d20 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775394af0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:06.370512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Action: 'update', calling method: .version_select at 0x7f7775af1550>, body: {"status": "disabled"} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:06.374698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.375264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.375747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.384008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.384776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.394308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.414753 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] HTTP exception thrown: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Request method failure captured: Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: request: PUT /compute/v2.1/os-services/c21ef909-21c9-4467-b707-960753fc165a HTTP/1.1 Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 22 Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcANW6beS83afEI8uk12eOzSvQC5vXjGa5tg7yUEGs0tw0tAbB_nrE_Qu2H_8NKTQkoIkkPPUCruWZt7ZJ143AVY8jvaAG2IEcPZxiyWiBAiYYRPUwZ0bO0e7eAyrvtnVekc051lA8QfALyvE3MttVcyRWDBNb9qV74VTncT0GmdM6g Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.53 Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: b8af593147a549b0857f21292d087e77 Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1386041032 Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:34:06.425661 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8af593147a549b0857f21292d087e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8af593147a549b0857f21292d087e77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8af593147a549b0857f21292d087e77", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8af593147a549b0857f21292d087e77"}]}] Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1386041032 Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: b8af593147a549b0857f21292d087e77 Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1386041032 Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 905defa20a01410ba26df4e9a6888a7e Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: {"status": "disabled"} Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: exception: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.427509 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'c21ef909-21c9-4467-b707-960753fc165a', 'body': {'status': 'disabled'}} Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.428614 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:06.431057 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:06.433069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.433069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.434654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Returning 404 to user: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:06.435822 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-565bc3d4-c821-47fa-9d51-afb78582b1fa tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/c21ef909-21c9-4467-b707-960753fc165a" status: 404 len: 110 microversion: 2.53 time: 0.079738 Oct 05 17:34:06.438913 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 422/845] 10.222.0.70 () {62 vars in 1309 bytes} [Wed Oct 5 17:34:06 2022] PUT /compute/v2.1/os-services/c21ef909-21c9-4467-b707-960753fc165a => generated 110 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:34:06.453231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Action: 'update', calling method: .version_select at 0x7f77759a6160>, body: {"status": "enabled"} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:06.468016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.468534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.469025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.482588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.483123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.483904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.496887 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] HTTP exception thrown: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Request method failure captured: Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: request: PUT /compute/v2.1/os-services/c21ef909-21c9-4467-b707-960753fc165a HTTP/1.1 Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 21 Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcANW6beS83afEI8uk12eOzSvQC5vXjGa5tg7yUEGs0tw0tAbB_nrE_Qu2H_8NKTQkoIkkPPUCruWZt7ZJ143AVY8jvaAG2IEcPZxiyWiBAiYYRPUwZ0bO0e7eAyrvtnVekc051lA8QfALyvE3MttVcyRWDBNb9qV74VTncT0GmdM6g Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.53 Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: b8af593147a549b0857f21292d087e77 Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1386041032 Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:34:06.500775 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8af593147a549b0857f21292d087e77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8af593147a549b0857f21292d087e77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8af593147a549b0857f21292d087e77", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8af593147a549b0857f21292d087e77"}]}] Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1386041032 Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: b8af593147a549b0857f21292d087e77 Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1386041032 Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 905defa20a01410ba26df4e9a6888a7e Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: {"status": "enabled"} Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: exception: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.502397 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'c21ef909-21c9-4467-b707-960753fc165a', 'body': {'status': 'enabled'}} Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.503326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:06.504820 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:06.506194 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. Oct 05 17:34:06.506194 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:06.506194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Returning 404 to user: Service c21ef909-21c9-4467-b707-960753fc165a could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:06.507058 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e833ad85-fdbd-4b31-9a26-e48f01908734 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-services/c21ef909-21c9-4467-b707-960753fc165a" status: 404 len: 110 microversion: 2.53 time: 0.061740 Oct 05 17:34:06.507831 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 423/846] 10.222.0.70 () {62 vars in 1309 bytes} [Wed Oct 5 17:34:06 2022] PUT /compute/v2.1/os-services/c21ef909-21c9-4467-b707-960753fc165a => generated 110 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:34:06.518999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-330d5c99-7444-4847-8522-4741aab980b4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:06.523055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330d5c99-7444-4847-8522-4741aab980b4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.523910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330d5c99-7444-4847-8522-4741aab980b4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.524529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330d5c99-7444-4847-8522-4741aab980b4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.525685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330d5c99-7444-4847-8522-4741aab980b4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.526446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330d5c99-7444-4847-8522-4741aab980b4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.527073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330d5c99-7444-4847-8522-4741aab980b4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.557180 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-330d5c99-7444-4847-8522-4741aab980b4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043822 Oct 05 17:34:06.567076 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 424/847] 10.222.0.70 () {60 vars in 1178 bytes} [Wed Oct 5 17:34:06 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:06.574116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-acbe5742-a71c-40e9-99b9-166c6546bb0a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:06.583114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbe5742-a71c-40e9-99b9-166c6546bb0a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.593264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbe5742-a71c-40e9-99b9-166c6546bb0a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.594270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbe5742-a71c-40e9-99b9-166c6546bb0a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.595482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbe5742-a71c-40e9-99b9-166c6546bb0a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.596183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbe5742-a71c-40e9-99b9-166c6546bb0a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.596833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbe5742-a71c-40e9-99b9-166c6546bb0a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.640217 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-acbe5742-a71c-40e9-99b9-166c6546bb0a tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.071328 Oct 05 17:34:06.640970 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 425/848] 10.222.0.70 () {60 vars in 1211 bytes} [Wed Oct 5 17:34:06 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:06.656085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4ff674da-1277-4c71-a0ca-b464ff8a87c3 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:06.662005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ff674da-1277-4c71-a0ca-b464ff8a87c3 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.663702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ff674da-1277-4c71-a0ca-b464ff8a87c3 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.664376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ff674da-1277-4c71-a0ca-b464ff8a87c3 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.665946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ff674da-1277-4c71-a0ca-b464ff8a87c3 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.667284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ff674da-1277-4c71-a0ca-b464ff8a87c3 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.667968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ff674da-1277-4c71-a0ca-b464ff8a87c3 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.699043 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4ff674da-1277-4c71-a0ca-b464ff8a87c3 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.047524 Oct 05 17:34:06.700279 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 426/849] 10.222.0.70 () {60 vars in 1178 bytes} [Wed Oct 5 17:34:06 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:06.705347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-edd4dd3b-b4ad-4ed4-a505-d4e7affcc03b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:06.707476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-edd4dd3b-b4ad-4ed4-a505-d4e7affcc03b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:06.714449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edd4dd3b-b4ad-4ed4-a505-d4e7affcc03b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.715242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edd4dd3b-b4ad-4ed4-a505-d4e7affcc03b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.716612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edd4dd3b-b4ad-4ed4-a505-d4e7affcc03b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.717565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edd4dd3b-b4ad-4ed4-a505-d4e7affcc03b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:06.718183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edd4dd3b-b4ad-4ed4-a505-d4e7affcc03b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:06.718786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edd4dd3b-b4ad-4ed4-a505-d4e7affcc03b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:06.763119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:07.094071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-edd4dd3b-b4ad-4ed4-a505-d4e7affcc03b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:07.104979 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-edd4dd3b-b4ad-4ed4-a505-d4e7affcc03b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.403398 Oct 05 17:34:07.107209 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 427/850] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:06 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:07.115122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6dc25980-0a9b-4b23-a114-16af126f215f tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:07.124136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc25980-0a9b-4b23-a114-16af126f215f tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.133958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc25980-0a9b-4b23-a114-16af126f215f tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.134741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc25980-0a9b-4b23-a114-16af126f215f tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.135732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc25980-0a9b-4b23-a114-16af126f215f tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.136376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc25980-0a9b-4b23-a114-16af126f215f tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.137625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc25980-0a9b-4b23-a114-16af126f215f tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.198514 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6dc25980-0a9b-4b23-a114-16af126f215f tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-835595-3&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.089688 Oct 05 17:34:07.199722 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 428/851] 10.222.0.70 () {60 vars in 1235 bytes} [Wed Oct 5 17:34:07 2022] GET /compute/v2.1/os-services?host=n-d-835595-3&binary=xxx => generated 16 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:07.204899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:07.207428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:07.214710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.215450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.216092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.216956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.217595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.218180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.337511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:07.351512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:07.352993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:07.369731 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e47ec136-36b0-4476-a4a8-304a78b364e2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.168728 Oct 05 17:34:07.371346 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 429/852] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:07 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:07.382393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-702132a7-8355-456c-b21e-56fc1cfebde4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:07.390483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702132a7-8355-456c-b21e-56fc1cfebde4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.391845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702132a7-8355-456c-b21e-56fc1cfebde4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.392490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702132a7-8355-456c-b21e-56fc1cfebde4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.393484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702132a7-8355-456c-b21e-56fc1cfebde4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.394130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702132a7-8355-456c-b21e-56fc1cfebde4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.398452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702132a7-8355-456c-b21e-56fc1cfebde4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.455493 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-702132a7-8355-456c-b21e-56fc1cfebde4 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.082809 Oct 05 17:34:07.456645 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 430/853] 10.222.0.70 () {60 vars in 1178 bytes} [Wed Oct 5 17:34:07 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:07.461453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1f01090f-24f4-448c-88a8-17d44d58e8df tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:07.462477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1f01090f-24f4-448c-88a8-17d44d58e8df tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:07.469675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f01090f-24f4-448c-88a8-17d44d58e8df tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.470704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f01090f-24f4-448c-88a8-17d44d58e8df tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.471323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f01090f-24f4-448c-88a8-17d44d58e8df tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.472516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f01090f-24f4-448c-88a8-17d44d58e8df tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.473751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f01090f-24f4-448c-88a8-17d44d58e8df tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.474419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f01090f-24f4-448c-88a8-17d44d58e8df tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.732066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1f01090f-24f4-448c-88a8-17d44d58e8df tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:07.748361 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1f01090f-24f4-448c-88a8-17d44d58e8df tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1475 microversion: 2.1 time: 0.290226 Oct 05 17:34:07.749536 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 431/854] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:07 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1475 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:07.766882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:07.767889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:07.778490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.780093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.781377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.783872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.785544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.786396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.951997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:07.974258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:07.976642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:07.980322 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5216ad53-2c78-4691-924c-0d1ae4e8e425 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1320 microversion: 2.25 time: 0.226874 Oct 05 17:34:07.980322 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 432/855] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:07 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:07.986098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-315b5dad-61dc-4439-84b7-1095f832fb11 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:07.990462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-315b5dad-61dc-4439-84b7-1095f832fb11 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.991056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-315b5dad-61dc-4439-84b7-1095f832fb11 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.991931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-315b5dad-61dc-4439-84b7-1095f832fb11 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:07.992748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-315b5dad-61dc-4439-84b7-1095f832fb11 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:07.993654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-315b5dad-61dc-4439-84b7-1095f832fb11 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:07.994204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-315b5dad-61dc-4439-84b7-1095f832fb11 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:08.031792 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-315b5dad-61dc-4439-84b7-1095f832fb11 tempest-ServicesAdminNegativeV253TestJSON-1386041032 tempest-ServicesAdminNegativeV253TestJSON-1386041032-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.049511 Oct 05 17:34:08.034076 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 433/856] 10.222.0.70 () {60 vars in 1239 bytes} [Wed Oct 5 17:34:07 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:08.122078 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-abe683bb-a1ee-4e61-b5ce-522b2bda3d20 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/285b4452-2f10-4023-9393-ec1e5e2518a6" status: 202 len: 0 microversion: 2.1 time: 1.774442 Oct 05 17:34:08.126904 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 424/857] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:06 2022] DELETE /compute/v2.1/os-security-groups/285b4452-2f10-4023-9393-ec1e5e2518a6 => generated 0 bytes in 1780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:34:08.133007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:08.133981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:08.153979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:08.155841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:08.157496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:08.159400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:08.160208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:08.162214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:08.210500 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd HTTP/1.1 Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:08.213081 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:08.214746 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '9991e62c-dc92-416f-a357-785ac57919cd'} Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:08.215832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:08.217231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.220902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:08.221782 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bdd54f6a-243a-4466-9d08-7b5d4dc6d967 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 404 len: 111 microversion: 2.1 time: 0.093381 Oct 05 17:34:08.226115 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 425/858] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:34:08 2022] DELETE /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:08.241533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc2204e3-49b4-4fca-97e6-0a9588a8086a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:08.244158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc2204e3-49b4-4fca-97e6-0a9588a8086a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:08.256477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc2204e3-49b4-4fca-97e6-0a9588a8086a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:08.260495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc2204e3-49b4-4fca-97e6-0a9588a8086a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:08.261140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc2204e3-49b4-4fca-97e6-0a9588a8086a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:08.262032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc2204e3-49b4-4fca-97e6-0a9588a8086a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:08.264473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc2204e3-49b4-4fca-97e6-0a9588a8086a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:08.265163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc2204e3-49b4-4fca-97e6-0a9588a8086a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:08.362110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e05b9371-dc47-4ab5-817f-96eaa5d49406 tempest-ServicesAdminNegativeV253TestJSON-1206976694 tempest-ServicesAdminNegativeV253TestJSON-1206976694-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:08.367046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e05b9371-dc47-4ab5-817f-96eaa5d49406 tempest-ServicesAdminNegativeV253TestJSON-1206976694 tempest-ServicesAdminNegativeV253TestJSON-1206976694-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '713feae550f6427296c300c75565ca26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4c2731c99143daaaade2bab7742991', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e05b9371-dc47-4ab5-817f-96eaa5d49406 tempest-ServicesAdminNegativeV253TestJSON-1206976694 tempest-ServicesAdminNegativeV253TestJSON-1206976694-project] Request method failure captured: Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcALR3bAeWDMBS8MtHbAUqV29k6jQNDpYtNarivXR-sHhgN8SZZMWLVlTINvqMoDp_12_yhJkd0aRohaqxCk3Uoj6SNfi-4AL1UPD5QPNNXwClzHR_h0Uv5dH4S8912U4pcjM2NHaAaKz0YdkfPQmOgAq4dBv666-Ro2iTVzP6KZQPo Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.53 Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7f4c2731c99143daaaade2bab7742991 Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1206976694 Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:08.369077 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7f4c2731c99143daaaade2bab7742991"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7f4c2731c99143daaaade2bab7742991"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7f4c2731c99143daaaade2bab7742991", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7f4c2731c99143daaaade2bab7742991"}]}] Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1206976694 Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7f4c2731c99143daaaade2bab7742991 Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1206976694 Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1206976694-project Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 713feae550f6427296c300c75565ca26 Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1206976694-project Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 17:34:08.371344 n-d-835595-3 devstack@n-api.service[128843]: action_args: {} Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:34:08.372112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 17:34:08.373241 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.376542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e05b9371-dc47-4ab5-817f-96eaa5d49406 tempest-ServicesAdminNegativeV253TestJSON-1206976694 tempest-ServicesAdminNegativeV253TestJSON-1206976694-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:08.377868 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e05b9371-dc47-4ab5-817f-96eaa5d49406 tempest-ServicesAdminNegativeV253TestJSON-1206976694 tempest-ServicesAdminNegativeV253TestJSON-1206976694-project] 10.222.0.70 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.334722 Oct 05 17:34:08.385096 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 434/859] 10.222.0.70 () {60 vars in 1178 bytes} [Wed Oct 5 17:34:08 2022] GET /compute/v2.1/os-services => generated 112 bytes in 339 msecs (HTTP/1.1 403) 9 headers in 381 bytes (2 switches on core 0) Oct 05 17:34:08.387822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:08.388921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 9991e62c-dc92-416f-a357-785ac57919cd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:08.397416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:08.398300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:08.399029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:08.400181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:08.400950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:08.401611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:08.466220 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd HTTP/1.1 Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:08.472429 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:08.474077 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '9991e62c-dc92-416f-a357-785ac57919cd'} Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:08.475066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. Oct 05 17:34:08.476574 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.477911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Instance 9991e62c-dc92-416f-a357-785ac57919cd could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:08.478763 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e457824d-e67d-4a38-bbeb-f5f56dfd7f30 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd" status: 404 len: 111 microversion: 2.1 time: 0.095719 Oct 05 17:34:08.482499 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 435/860] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:08 2022] GET /compute/v2.1/servers/9991e62c-dc92-416f-a357-785ac57919cd => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:08.487565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:08.488330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:08.509216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:08.510156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:08.511477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:08.512569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:08.520174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:08.521262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:08.657814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:08.705347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:08.709499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:08.724122 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-65adbff1-eb66-481f-b60b-8aae9786aad4 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.242859 Oct 05 17:34:08.738745 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 436/861] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:08 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:08.749833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64271e79-aa0a-45c8-883d-4f258a8d4b10 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f777584b9d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:08.774176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-64271e79-aa0a-45c8-883d-4f258a8d4b10 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b does not exist", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:34:08.774569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.security_group_api [None req-64271e79-aa0a-45c8-883d-4f258a8d4b10 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Neutron security group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b not found {{(pid=128843) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:34:08.775097 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-64271e79-aa0a-45c8-883d-4f258a8d4b10 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b does not exist Oct 05 17:34:08.775097 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-edbe8980-67f6-4096-a2af-80205bbe2f39'] Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64271e79-aa0a-45c8-883d-4f258a8d4b10 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-security-groups/4051ab2c-b1eb-4161-8d7c-a9316e22f33b HTTP/1.1 Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:08.777019 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: exception: Security group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b does not exist Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-edbe8980-67f6-4096-a2af-80205bbe2f39'] Oct 05 17:34:08.778412 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4051ab2c-b1eb-4161-8d7c-a9316e22f33b'} Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:08.779273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b does not exist Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-edbe8980-67f6-4096-a2af-80205bbe2f39'] Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:34:08.780785 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b does not exist Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-edbe8980-67f6-4096-a2af-80205bbe2f39'] Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b does not exist Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-edbe8980-67f6-4096-a2af-80205bbe2f39'] Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.781972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b does not exist Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-edbe8980-67f6-4096-a2af-80205bbe2f39'] Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64271e79-aa0a-45c8-883d-4f258a8d4b10 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Security group 4051ab2c-b1eb-4161-8d7c-a9316e22f33b does not exist Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-edbe8980-67f6-4096-a2af-80205bbe2f39'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-64271e79-aa0a-45c8-883d-4f258a8d4b10 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/4051ab2c-b1eb-4161-8d7c-a9316e22f33b" status: 404 len: 194 microversion: 2.1 time: 0.038499 Oct 05 17:34:08.783581 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 437/862] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:08 2022] DELETE /compute/v2.1/os-security-groups/4051ab2c-b1eb-4161-8d7c-a9316e22f33b => generated 194 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:08.784387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b995904f-5832-4845-9260-dc614ad1243a tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:08.785265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b995904f-5832-4845-9260-dc614ad1243a tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:08.792893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b995904f-5832-4845-9260-dc614ad1243a tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:08.793435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b995904f-5832-4845-9260-dc614ad1243a tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:08.793908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b995904f-5832-4845-9260-dc614ad1243a tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:08.794641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b995904f-5832-4845-9260-dc614ad1243a tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:08.795096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b995904f-5832-4845-9260-dc614ad1243a tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:08.795519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b995904f-5832-4845-9260-dc614ad1243a tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:09.203897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b995904f-5832-4845-9260-dc614ad1243a tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:09.214558 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b995904f-5832-4845-9260-dc614ad1243a tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1475 microversion: 2.1 time: 0.433639 Oct 05 17:34:09.221884 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 438/863] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:08 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1475 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:09.244775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9dbd3fe7-d7b8-44be-955c-ab610e14265a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f777584b670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:09.288907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-9dbd3fe7-d7b8-44be-955c-ab610e14265a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8b532bf8-3500-47c8-b7f7-782ad031769e does not exist", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:34:09.289768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.security_group_api [None req-9dbd3fe7-d7b8-44be-955c-ab610e14265a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Neutron security group 8b532bf8-3500-47c8-b7f7-782ad031769e not found {{(pid=128843) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:34:09.290446 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9dbd3fe7-d7b8-44be-955c-ab610e14265a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security group 8b532bf8-3500-47c8-b7f7-782ad031769e does not exist Oct 05 17:34:09.290446 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-6245b419-76d0-4a68-8eb1-b22ede0a67d4'] Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9dbd3fe7-d7b8-44be-955c-ab610e14265a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-security-groups/8b532bf8-3500-47c8-b7f7-782ad031769e HTTP/1.1 Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:09.292566 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: exception: Security group 8b532bf8-3500-47c8-b7f7-782ad031769e does not exist Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-6245b419-76d0-4a68-8eb1-b22ede0a67d4'] Oct 05 17:34:09.294607 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '8b532bf8-3500-47c8-b7f7-782ad031769e'} Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.295723 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8b532bf8-3500-47c8-b7f7-782ad031769e does not exist Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6245b419-76d0-4a68-8eb1-b22ede0a67d4'] Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:34:09.297098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8b532bf8-3500-47c8-b7f7-782ad031769e does not exist Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6245b419-76d0-4a68-8eb1-b22ede0a67d4'] Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8b532bf8-3500-47c8-b7f7-782ad031769e does not exist Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6245b419-76d0-4a68-8eb1-b22ede0a67d4'] Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.298505 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.300106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:09.300106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:09.300106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:09.300106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:09.300106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8b532bf8-3500-47c8-b7f7-782ad031769e does not exist Oct 05 17:34:09.300106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6245b419-76d0-4a68-8eb1-b22ede0a67d4'] Oct 05 17:34:09.300106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.300106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9dbd3fe7-d7b8-44be-955c-ab610e14265a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Security group 8b532bf8-3500-47c8-b7f7-782ad031769e does not exist Oct 05 17:34:09.300106 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-6245b419-76d0-4a68-8eb1-b22ede0a67d4'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:09.305273 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9dbd3fe7-d7b8-44be-955c-ab610e14265a tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/8b532bf8-3500-47c8-b7f7-782ad031769e" status: 404 len: 194 microversion: 2.1 time: 0.074400 Oct 05 17:34:09.305273 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 439/864] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:09 2022] DELETE /compute/v2.1/os-security-groups/8b532bf8-3500-47c8-b7f7-782ad031769e => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:09.319614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:09.322604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:09.335680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:09.336689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:09.339661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:09.344946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:09.345719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:09.346441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:09.347872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc2204e3-49b4-4fca-97e6-0a9588a8086a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:09.363971 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc2204e3-49b4-4fca-97e6-0a9588a8086a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 1.130657 Oct 05 17:34:09.366562 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 426/865] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:08 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:09.381400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7168c75e-1ca1-49c9-880e-7574b0fe66ee tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775360b80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:09.518386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:09.531718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:09.533859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:09.537648 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a5e55baa-889b-4cc3-9cfa-c0a52f6d5ff9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1320 microversion: 2.25 time: 0.234759 Oct 05 17:34:09.555062 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 440/866] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:09 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:09.754831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:09.755509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:09.764353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:09.765121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:09.765770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:09.766914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:09.767534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:09.768113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:09.818183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG neutronclient.v2_0.client [None req-7168c75e-1ca1-49c9-880e-7574b0fe66ee tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist", "detail": ""}} {{(pid=128844) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:34:09.819064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.security_group_api [None req-7168c75e-1ca1-49c9-880e-7574b0fe66ee tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Neutron security group c75eb4c7-40da-47dc-8faa-d4215f438b9a not found {{(pid=128844) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:34:09.819787 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-7168c75e-1ca1-49c9-880e-7574b0fe66ee tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:34:09.819787 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-cf6fdd70-8cc4-49c8-9f92-5e7f2cf79635'] Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7168c75e-1ca1-49c9-880e-7574b0fe66ee tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-security-groups/c75eb4c7-40da-47dc-8faa-d4215f438b9a HTTP/1.1 Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:09.822067 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: exception: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-cf6fdd70-8cc4-49c8-9f92-5e7f2cf79635'] Oct 05 17:34:09.823627 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'c75eb4c7-40da-47dc-8faa-d4215f438b9a'} Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.824559 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf6fdd70-8cc4-49c8-9f92-5e7f2cf79635'] Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:34:09.825766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf6fdd70-8cc4-49c8-9f92-5e7f2cf79635'] Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf6fdd70-8cc4-49c8-9f92-5e7f2cf79635'] Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.827061 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.828487 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:09.828487 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:09.828487 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:09.828487 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:09.828487 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:34:09.828487 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cf6fdd70-8cc4-49c8-9f92-5e7f2cf79635'] Oct 05 17:34:09.828487 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.829813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7168c75e-1ca1-49c9-880e-7574b0fe66ee tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Security group c75eb4c7-40da-47dc-8faa-d4215f438b9a does not exist Oct 05 17:34:09.829813 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-cf6fdd70-8cc4-49c8-9f92-5e7f2cf79635'] {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:09.830699 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7168c75e-1ca1-49c9-880e-7574b0fe66ee tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c75eb4c7-40da-47dc-8faa-d4215f438b9a" status: 404 len: 194 microversion: 2.1 time: 0.462901 Oct 05 17:34:09.831471 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 427/867] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:09 2022] DELETE /compute/v2.1/os-security-groups/c75eb4c7-40da-47dc-8faa-d4215f438b9a => generated 194 bytes in 464 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:09.840428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2703b655-fc54-4118-a21a-d3a4c4f06400 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f77753ae040>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:09.904119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG neutronclient.v2_0.client [None req-2703b655-fc54-4118-a21a-d3a4c4f06400 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist", "detail": ""}} {{(pid=128844) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:34:09.904960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.security_group_api [None req-2703b655-fc54-4118-a21a-d3a4c4f06400 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Neutron security group 9b95a091-7731-42f7-973f-a68eced15e7d not found {{(pid=128844) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:34:09.905665 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-2703b655-fc54-4118-a21a-d3a4c4f06400 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:34:09.905665 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-dd458eaa-7046-4c99-a603-c7b2f0b96618'] Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2703b655-fc54-4118-a21a-d3a4c4f06400 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-security-groups/9b95a091-7731-42f7-973f-a68eced15e7d HTTP/1.1 Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:09.908146 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: exception: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-dd458eaa-7046-4c99-a603-c7b2f0b96618'] Oct 05 17:34:09.909630 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '9b95a091-7731-42f7-973f-a68eced15e7d'} Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.910539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd458eaa-7046-4c99-a603-c7b2f0b96618'] Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:34:09.911768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd458eaa-7046-4c99-a603-c7b2f0b96618'] Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd458eaa-7046-4c99-a603-c7b2f0b96618'] Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.913544 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:09.914964 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:09.914964 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:09.914964 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:09.914964 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:09.914964 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:34:09.914964 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dd458eaa-7046-4c99-a603-c7b2f0b96618'] Oct 05 17:34:09.914964 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:09.916368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2703b655-fc54-4118-a21a-d3a4c4f06400 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Security group 9b95a091-7731-42f7-973f-a68eced15e7d does not exist Oct 05 17:34:09.916368 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-dd458eaa-7046-4c99-a603-c7b2f0b96618'] {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:09.917503 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2703b655-fc54-4118-a21a-d3a4c4f06400 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/9b95a091-7731-42f7-973f-a68eced15e7d" status: 404 len: 194 microversion: 2.1 time: 0.081969 Oct 05 17:34:09.918584 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 428/868] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:09 2022] DELETE /compute/v2.1/os-security-groups/9b95a091-7731-42f7-973f-a68eced15e7d => generated 194 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:34:09.926898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d987a8d7-d8a2-4b90-85d2-19247e66ed8e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f777533bc10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:10.217319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG neutronclient.v2_0.client [None req-d987a8d7-d8a2-4b90-85d2-19247e66ed8e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist", "detail": ""}} {{(pid=128844) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:34:10.219560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.security_group_api [None req-d987a8d7-d8a2-4b90-85d2-19247e66ed8e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Neutron security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 not found {{(pid=128844) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:34:10.221074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d987a8d7-d8a2-4b90-85d2-19247e66ed8e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:34:10.221074 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-e6225692-2251-4660-9a86-380e2e0ee21b'] Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d987a8d7-d8a2-4b90-85d2-19247e66ed8e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-security-groups/8e85be18-07a3-41de-9c8d-9e60b1e762e5 HTTP/1.1 Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:10.225339 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: exception: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-e6225692-2251-4660-9a86-380e2e0ee21b'] Oct 05 17:34:10.226962 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '8e85be18-07a3-41de-9c8d-9e60b1e762e5'} Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:10.227949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6225692-2251-4660-9a86-380e2e0ee21b'] Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:34:10.230204 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6225692-2251-4660-9a86-380e2e0ee21b'] Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6225692-2251-4660-9a86-380e2e0ee21b'] Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.231605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:10.233133 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:10.233133 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:10.233133 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:10.233133 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:10.233133 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:34:10.233133 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e6225692-2251-4660-9a86-380e2e0ee21b'] Oct 05 17:34:10.233133 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.235879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d987a8d7-d8a2-4b90-85d2-19247e66ed8e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Security group 8e85be18-07a3-41de-9c8d-9e60b1e762e5 does not exist Oct 05 17:34:10.235879 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-e6225692-2251-4660-9a86-380e2e0ee21b'] {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:10.237978 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d987a8d7-d8a2-4b90-85d2-19247e66ed8e tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/8e85be18-07a3-41de-9c8d-9e60b1e762e5" status: 404 len: 194 microversion: 2.1 time: 0.315616 Oct 05 17:34:10.246213 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 429/869] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:09 2022] DELETE /compute/v2.1/os-security-groups/8e85be18-07a3-41de-9c8d-9e60b1e762e5 => generated 194 bytes in 324 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:10.269707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-088ab00d-2e87-4d6c-b082-31823b8187e4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:10.272597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-088ab00d-2e87-4d6c-b082-31823b8187e4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:10.286144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:10.296629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088ab00d-2e87-4d6c-b082-31823b8187e4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:10.297358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:10.298682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088ab00d-2e87-4d6c-b082-31823b8187e4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:10.299652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088ab00d-2e87-4d6c-b082-31823b8187e4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:10.300006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:10.300943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088ab00d-2e87-4d6c-b082-31823b8187e4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:10.302328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088ab00d-2e87-4d6c-b082-31823b8187e4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:10.303159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088ab00d-2e87-4d6c-b082-31823b8187e4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:10.322170 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7fcc72e7-2a25-42fa-9190-ff29f1eb8e20 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.571406 Oct 05 17:34:10.330462 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 441/870] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:09 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:10.339849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c6ab80b-04b5-4edf-bcf7-87218e1f34c3 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775ae8af0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:10.420477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-6c6ab80b-04b5-4edf-bcf7-87218e1f34c3 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:34:10.421405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.security_group_api [None req-6c6ab80b-04b5-4edf-bcf7-87218e1f34c3 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Neutron security group dd1e11bc-70b1-455b-8588-a5c9a0868644 not found {{(pid=128843) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:34:10.422195 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-6c6ab80b-04b5-4edf-bcf7-87218e1f34c3 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:34:10.422195 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-60296295-cd64-4409-b839-a37fe96500b6'] Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c6ab80b-04b5-4edf-bcf7-87218e1f34c3 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-security-groups/dd1e11bc-70b1-455b-8588-a5c9a0868644 HTTP/1.1 Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:10.425216 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: exception: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-60296295-cd64-4409-b839-a37fe96500b6'] Oct 05 17:34:10.426579 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'dd1e11bc-70b1-455b-8588-a5c9a0868644'} Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:10.427349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60296295-cd64-4409-b839-a37fe96500b6'] Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:34:10.428452 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60296295-cd64-4409-b839-a37fe96500b6'] Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60296295-cd64-4409-b839-a37fe96500b6'] Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.429518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-60296295-cd64-4409-b839-a37fe96500b6'] Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c6ab80b-04b5-4edf-bcf7-87218e1f34c3 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Security group dd1e11bc-70b1-455b-8588-a5c9a0868644 does not exist Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-60296295-cd64-4409-b839-a37fe96500b6'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c6ab80b-04b5-4edf-bcf7-87218e1f34c3 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/dd1e11bc-70b1-455b-8588-a5c9a0868644" status: 404 len: 194 microversion: 2.1 time: 0.094675 Oct 05 17:34:10.432296 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 442/871] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:10 2022] DELETE /compute/v2.1/os-security-groups/dd1e11bc-70b1-455b-8588-a5c9a0868644 => generated 194 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:10.438609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b3d563c-6388-4271-a8b1-7c9a6de2c3ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:10.439321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b3d563c-6388-4271-a8b1-7c9a6de2c3ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:10.456036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3d563c-6388-4271-a8b1-7c9a6de2c3ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:10.457612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3d563c-6388-4271-a8b1-7c9a6de2c3ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:10.458617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3d563c-6388-4271-a8b1-7c9a6de2c3ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:10.460183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3d563c-6388-4271-a8b1-7c9a6de2c3ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:10.464148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3d563c-6388-4271-a8b1-7c9a6de2c3ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:10.465296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3d563c-6388-4271-a8b1-7c9a6de2c3ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:10.508188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-088ab00d-2e87-4d6c-b082-31823b8187e4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:10.522198 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-088ab00d-2e87-4d6c-b082-31823b8187e4 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1433 microversion: 2.1 time: 0.270805 Oct 05 17:34:10.523238 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 430/872] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:10 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1433 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:10.538149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6a2e6d50-3f5b-4b93-ad97-987abb1b9f11 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:10.538702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6a2e6d50-3f5b-4b93-ad97-987abb1b9f11 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:10.560717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a2e6d50-3f5b-4b93-ad97-987abb1b9f11 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:10.561221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a2e6d50-3f5b-4b93-ad97-987abb1b9f11 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:10.561656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a2e6d50-3f5b-4b93-ad97-987abb1b9f11 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:10.562884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a2e6d50-3f5b-4b93-ad97-987abb1b9f11 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:10.563705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a2e6d50-3f5b-4b93-ad97-987abb1b9f11 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:10.568529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a2e6d50-3f5b-4b93-ad97-987abb1b9f11 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:10.645886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6a2e6d50-3f5b-4b93-ad97-987abb1b9f11 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:34:10.834116 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6a2e6d50-3f5b-4b93-ad97-987abb1b9f11 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 204 len: 0 microversion: 2.1 time: 0.307814 Oct 05 17:34:10.841228 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 431/873] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:34:10 2022] DELETE /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:34:10.853523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:10.857091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:10.916094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:10.916903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:10.917931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:10.920752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:10.921852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:10.930743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:11.008257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b3d563c-6388-4271-a8b1-7c9a6de2c3ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:11.025151 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b3d563c-6388-4271-a8b1-7c9a6de2c3ec tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1476 microversion: 2.1 time: 0.595846 Oct 05 17:34:11.027375 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 443/874] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:10 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1476 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:11.047430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c431861-6f0c-4cd5-b24f-47c70d2232f7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:11.050627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3c431861-6f0c-4cd5-b24f-47c70d2232f7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:11.071529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c431861-6f0c-4cd5-b24f-47c70d2232f7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:11.074295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c431861-6f0c-4cd5-b24f-47c70d2232f7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:11.074941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c431861-6f0c-4cd5-b24f-47c70d2232f7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:11.077151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c431861-6f0c-4cd5-b24f-47c70d2232f7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:11.078343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c431861-6f0c-4cd5-b24f-47c70d2232f7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:11.080026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c431861-6f0c-4cd5-b24f-47c70d2232f7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:11.475208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:11.495953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:11.498202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:11.499597 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4f8a6e82-3643-422e-96cc-45ff2d52dedc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1362 microversion: 2.25 time: 0.656648 Oct 05 17:34:11.500224 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 432/875] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:10 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1362 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:11.511177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3c431861-6f0c-4cd5-b24f-47c70d2232f7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:11.513660 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c431861-6f0c-4cd5-b24f-47c70d2232f7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1646 microversion: 2.1 time: 0.484952 Oct 05 17:34:11.515414 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 444/876] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:11 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1646 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:11.523453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b3666d15-4150-49e9-b360-8bef1efdb999 req-ff5f2383-7025-4733-9adf-bfe30836f8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71c9e52-3103-4955-9c3e-071006ce5757", "name": "network-vif-deleted", "tag": "4151ae59-7916-4ccb-8a3c-ef4306940d47"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:11.529950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:11.532786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:11.543142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b3666d15-4150-49e9-b360-8bef1efdb999 req-ff5f2383-7025-4733-9adf-bfe30836f8b1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:11.543628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b3666d15-4150-49e9-b360-8bef1efdb999 req-ff5f2383-7025-4733-9adf-bfe30836f8b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:11.544063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b3666d15-4150-49e9-b360-8bef1efdb999 req-ff5f2383-7025-4733-9adf-bfe30836f8b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:11.563934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:11.564425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:11.564938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:11.565683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:11.566225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:11.566677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:11.577164 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b3666d15-4150-49e9-b360-8bef1efdb999 req-ff5f2383-7025-4733-9adf-bfe30836f8b1 service nova] Creating event network-vif-deleted:4151ae59-7916-4ccb-8a3c-ef4306940d47 for instance c71c9e52-3103-4955-9c3e-071006ce5757 on n-h2-835595-3 Oct 05 17:34:11.598482 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b3666d15-4150-49e9-b360-8bef1efdb999 req-ff5f2383-7025-4733-9adf-bfe30836f8b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081603 Oct 05 17:34:11.599990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:11.602000 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 445/877] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:11.614830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:11.615573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:11.631432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:11.633317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:11.633986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:11.635537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:11.636013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:11.636487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:11.700271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:11.700776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:11.702023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:11.702657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lazy-loading 'fault' on Instance uuid c71c9e52-3103-4955-9c3e-071006ce5757 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:11.755572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:11.768330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:11.771547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:11.778721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2af401d63f24d9a9cb58c54602768f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78997afe35c142c486d6079e462c5ddf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:11.780579 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c7505e2-88dd-4c6c-8867-eb2d436c1335 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.258972 Oct 05 17:34:11.781659 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 433/878] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:11 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:11.802821 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-091251cb-01e7-4388-89f9-4d5b0ebde275 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 200 len: 1309 microversion: 2.1 time: 0.199073 Oct 05 17:34:11.804478 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 446/879] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:11 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:12.052512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-390993e6-146b-4181-a7e7-3450a20c4b15 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:12.054020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-390993e6-146b-4181-a7e7-3450a20c4b15 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:12.064586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390993e6-146b-4181-a7e7-3450a20c4b15 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:12.065316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390993e6-146b-4181-a7e7-3450a20c4b15 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:12.067273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390993e6-146b-4181-a7e7-3450a20c4b15 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:12.068485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390993e6-146b-4181-a7e7-3450a20c4b15 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:12.070433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390993e6-146b-4181-a7e7-3450a20c4b15 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:12.071067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390993e6-146b-4181-a7e7-3450a20c4b15 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:12.530523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:12.533666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:12.542575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:12.543471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:12.544187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:12.545499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:12.547544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:12.548102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:12.742812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:12.748609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-390993e6-146b-4181-a7e7-3450a20c4b15 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:12.753179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:12.755650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:12.757031 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d483192c-4873-452c-bc22-e13e1fbc5d9b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1362 microversion: 2.25 time: 0.233007 Oct 05 17:34:12.758099 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 447/880] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:12 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:12.764369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6588dfca-aa95-49d3-9a25-73ec85f6930f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:12.765328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6588dfca-aa95-49d3-9a25-73ec85f6930f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:12.771926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6588dfca-aa95-49d3-9a25-73ec85f6930f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:12.772719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6588dfca-aa95-49d3-9a25-73ec85f6930f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:12.773398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6588dfca-aa95-49d3-9a25-73ec85f6930f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:12.774231 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-390993e6-146b-4181-a7e7-3450a20c4b15 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1475 microversion: 2.1 time: 0.728806 Oct 05 17:34:12.775168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6588dfca-aa95-49d3-9a25-73ec85f6930f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:12.776013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6588dfca-aa95-49d3-9a25-73ec85f6930f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:12.776660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6588dfca-aa95-49d3-9a25-73ec85f6930f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:12.782520 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 434/881] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:12 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1475 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:12.809959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:12.810695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:12.821761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:12.827027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:12.827844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:12.828929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:12.830945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:12.831650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:13.015304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:13.026787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:13.028525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:13.034260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6588dfca-aa95-49d3-9a25-73ec85f6930f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:13.036055 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90225ecc-ddaa-4f6c-b530-f50208c1ba7d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.230829 Oct 05 17:34:13.044901 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6588dfca-aa95-49d3-9a25-73ec85f6930f tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1646 microversion: 2.1 time: 0.284031 Oct 05 17:34:13.045713 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 448/882] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:12 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1646 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:13.050909 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 435/883] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:12 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:34:13.051627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:13.052382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] [instance: c71c9e52-3103-4955-9c3e-071006ce5757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:13.059387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:13.060246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:13.060884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:13.061794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:13.062507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:13.063309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:13.086340 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] HTTP exception thrown: Instance c71c9e52-3103-4955-9c3e-071006ce5757 could not be found. Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Request method failure captured: Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 HTTP/1.1 Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_NbUn04VZlTkelCCWetN8HPefMgPl-RkpfdiEp__KaBfg2YwHZcQN7GGdkp__Tc1hhiTaDMSe-JiZTNftddSdauAVh26123wz6T8ATjYMpqoQmqQ85xBax5yeb_nZswd7zTtGdSeZXlRWnC5f1Br9TBDmNX0E_NLzXIU1-npyqpL8 Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 78997afe35c142c486d6079e462c5ddf Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-LiveMigrationNegativeTest-1828845879 Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:13.089021 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/78997afe35c142c486d6079e462c5ddf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/78997afe35c142c486d6079e462c5ddf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_78997afe35c142c486d6079e462c5ddf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/78997afe35c142c486d6079e462c5ddf"}]}] Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-LiveMigrationNegativeTest-1828845879 Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 78997afe35c142c486d6079e462c5ddf Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1828845879 Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-LiveMigrationNegativeTest-1828845879-project Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: b2af401d63f24d9a9cb58c54602768f7 Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-LiveMigrationNegativeTest-1828845879-project Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance c71c9e52-3103-4955-9c3e-071006ce5757 could not be found. Oct 05 17:34:13.090651 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'c71c9e52-3103-4955-9c3e-071006ce5757'} Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71c9e52-3103-4955-9c3e-071006ce5757 could not be found. Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:13.092364 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71c9e52-3103-4955-9c3e-071006ce5757 could not be found. Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71c9e52-3103-4955-9c3e-071006ce5757 could not be found. Oct 05 17:34:13.093861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:13.097837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] Returning 404 to user: Instance c71c9e52-3103-4955-9c3e-071006ce5757 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:13.099134 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0b941e6d-3635-4a5b-903d-12c7cc630a02 tempest-LiveMigrationNegativeTest-1828845879 tempest-LiveMigrationNegativeTest-1828845879-project] 10.222.0.70 "GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757" status: 404 len: 111 microversion: 2.1 time: 0.051998 Oct 05 17:34:13.100426 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 449/884] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:13 2022] GET /compute/v2.1/servers/c71c9e52-3103-4955-9c3e-071006ce5757 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:13.660089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-aed7cf89-7ea7-40ba-b3e6-e6dbebf2699a req-dc389cfe-db03-454a-a9c8-08b1aae698b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc39da4-3415-41c0-9552-de49d599f894", "tag": "4c8c6427-bd57-44ed-aa04-e2b51f49ce09"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:13.683224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aed7cf89-7ea7-40ba-b3e6-e6dbebf2699a req-dc389cfe-db03-454a-a9c8-08b1aae698b5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:13.684147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aed7cf89-7ea7-40ba-b3e6-e6dbebf2699a req-dc389cfe-db03-454a-a9c8-08b1aae698b5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:13.686164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aed7cf89-7ea7-40ba-b3e6-e6dbebf2699a req-dc389cfe-db03-454a-a9c8-08b1aae698b5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:13.715164 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-aed7cf89-7ea7-40ba-b3e6-e6dbebf2699a req-dc389cfe-db03-454a-a9c8-08b1aae698b5 service nova] Creating event network-changed:4c8c6427-bd57-44ed-aa04-e2b51f49ce09 for instance ebc39da4-3415-41c0-9552-de49d599f894 on n-h2-835595-3 Oct 05 17:34:13.728408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:13.730806 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-aed7cf89-7ea7-40ba-b3e6-e6dbebf2699a req-dc389cfe-db03-454a-a9c8-08b1aae698b5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074411 Oct 05 17:34:13.734884 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 436/885] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:13.786635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:13.788184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:13.798863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:13.802990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:13.803529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:13.804367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:13.810441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:13.811346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:14.260819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5c90509c-4b41-41d8-b363-a095033e7544 tempest-FlavorsV2NegativeTest-1155000337 tempest-FlavorsV2NegativeTest-1155000337-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:14.275725 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5c90509c-4b41-41d8-b363-a095033e7544 tempest-FlavorsV2NegativeTest-1155000337 tempest-FlavorsV2NegativeTest-1155000337-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.552488 Oct 05 17:34:14.278641 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 450/886] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:34:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:34:14.295261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f85398e2-4df5-4c4e-88c7-a7d45b9b61cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:14.296139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f85398e2-4df5-4c4e-88c7-a7d45b9b61cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:14.300486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:14.311411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f85398e2-4df5-4c4e-88c7-a7d45b9b61cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:14.311958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f85398e2-4df5-4c4e-88c7-a7d45b9b61cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:14.312519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f85398e2-4df5-4c4e-88c7-a7d45b9b61cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:14.313105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f85398e2-4df5-4c4e-88c7-a7d45b9b61cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:14.313612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f85398e2-4df5-4c4e-88c7-a7d45b9b61cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:14.314043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f85398e2-4df5-4c4e-88c7-a7d45b9b61cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:14.321546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:14.327629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:14.332527 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-09f09fcf-99ad-4c84-bf2b-b1942d1fd75a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1362 microversion: 2.25 time: 0.547081 Oct 05 17:34:14.335946 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 437/887] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:13 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1362 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:14.365949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9fc53fe2-67c1-4d64-85f3-8cd4232088e9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:14.369492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9fc53fe2-67c1-4d64-85f3-8cd4232088e9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:14.386731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc53fe2-67c1-4d64-85f3-8cd4232088e9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:14.389140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc53fe2-67c1-4d64-85f3-8cd4232088e9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:14.389801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc53fe2-67c1-4d64-85f3-8cd4232088e9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:14.395690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc53fe2-67c1-4d64-85f3-8cd4232088e9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:14.398426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc53fe2-67c1-4d64-85f3-8cd4232088e9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:14.403748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc53fe2-67c1-4d64-85f3-8cd4232088e9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:14.582667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9fc53fe2-67c1-4d64-85f3-8cd4232088e9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:14.597556 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9fc53fe2-67c1-4d64-85f3-8cd4232088e9 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1467 microversion: 2.1 time: 0.259417 Oct 05 17:34:14.599614 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 438/888] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:14 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1467 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:14.615272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:14.616310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:14.633758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:14.635430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:14.638182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:14.639285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:14.642812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:14.643278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:14.778446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:14.800610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:14.810452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:14.826378 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e129a3fb-a05c-4a46-abaa-fd3b0a0216ba tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.223609 Oct 05 17:34:14.826531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f85398e2-4df5-4c4e-88c7-a7d45b9b61cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:14.829735 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 439/889] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:14 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:14.843595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7e4a3392-b9db-4b63-9a41-690ef6a43312 req-d2817021-b6ef-46da-afa9-5b235025cb74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2326b784-d0b7-455c-8a14-0d28dc57d0bd", "name": "network-vif-deleted", "tag": "32488405-5d93-4136-b35d-8aeeae91d166"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:14.855793 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f85398e2-4df5-4c4e-88c7-a7d45b9b61cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1470 microversion: 2.1 time: 0.575821 Oct 05 17:34:14.877000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7e4a3392-b9db-4b63-9a41-690ef6a43312 req-d2817021-b6ef-46da-afa9-5b235025cb74 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:14.877897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7e4a3392-b9db-4b63-9a41-690ef6a43312 req-d2817021-b6ef-46da-afa9-5b235025cb74 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:14.878507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7e4a3392-b9db-4b63-9a41-690ef6a43312 req-d2817021-b6ef-46da-afa9-5b235025cb74 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:14.886464 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 451/890] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:14 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1470 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:14.902515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c753f350-2a80-4f4f-93f1-69424ba3ef95 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:14.910985 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7e4a3392-b9db-4b63-9a41-690ef6a43312 req-d2817021-b6ef-46da-afa9-5b235025cb74 service nova] Creating event network-vif-deleted:32488405-5d93-4136-b35d-8aeeae91d166 for instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd on n-h1-835595-3 Oct 05 17:34:14.912064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c753f350-2a80-4f4f-93f1-69424ba3ef95 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:14.938215 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7e4a3392-b9db-4b63-9a41-690ef6a43312 req-d2817021-b6ef-46da-afa9-5b235025cb74 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105940 Oct 05 17:34:14.940808 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 440/891] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:14.975944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c753f350-2a80-4f4f-93f1-69424ba3ef95 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:14.976365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c753f350-2a80-4f4f-93f1-69424ba3ef95 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:14.976804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c753f350-2a80-4f4f-93f1-69424ba3ef95 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:14.977592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c753f350-2a80-4f4f-93f1-69424ba3ef95 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:14.978056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c753f350-2a80-4f4f-93f1-69424ba3ef95 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:14.978564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c753f350-2a80-4f4f-93f1-69424ba3ef95 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:15.124425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:15.198584 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c753f350-2a80-4f4f-93f1-69424ba3ef95 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c/action" status: 204 len: 0 microversion: 2.1 time: 0.309895 Oct 05 17:34:15.200503 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 452/892] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:34:14 2022] POST /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c/action => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:34:15.209285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b86b7a9d-0229-46f2-9a97-9769270e442f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:15.210753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b86b7a9d-0229-46f2-9a97-9769270e442f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:15.218560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86b7a9d-0229-46f2-9a97-9769270e442f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:15.219350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86b7a9d-0229-46f2-9a97-9769270e442f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:15.220267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86b7a9d-0229-46f2-9a97-9769270e442f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:15.221471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86b7a9d-0229-46f2-9a97-9769270e442f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:15.223531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86b7a9d-0229-46f2-9a97-9769270e442f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:15.224621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86b7a9d-0229-46f2-9a97-9769270e442f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:15.366234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:15.366966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:15.378640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:15.379130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:15.379562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:15.380266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:15.384207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:15.384640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:15.513163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b86b7a9d-0229-46f2-9a97-9769270e442f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:15.531768 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b86b7a9d-0229-46f2-9a97-9769270e442f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1470 microversion: 2.1 time: 0.325442 Oct 05 17:34:15.533362 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 441/893] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:15 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1470 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:15.612029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:15.623558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:15.624702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:15.625206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:15.625493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:15.626396 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-765221b9-659e-4b2b-857c-d8ed2290624d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1362 microversion: 2.25 time: 0.266156 Oct 05 17:34:15.638943 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 453/894] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:15 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:15.647725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:15.648233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:15.648671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:15.649385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:15.649910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:15.650655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:15.719355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1519b047-c4b1-4383-b4ed-3e0e575a0b4b tempest-FlavorsV2NegativeTest-1155000337 tempest-FlavorsV2NegativeTest-1155000337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-953735808", "imageRef": "1ced4d65-9709-4ea4-b22d-fe06b1e72448", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:15.737429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:15.738308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:15.739825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:15.740388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lazy-loading 'fault' on Instance uuid 2326b784-d0b7-455c-8a14-0d28dc57d0bd {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:15.835898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-1519b047-c4b1-4383-b4ed-3e0e575a0b4b tempest-FlavorsV2NegativeTest-1155000337 tempest-FlavorsV2NegativeTest-1155000337-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:34:16.023251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f53bebb71deb4cd0a33f962302456404', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bdb0c8c021f481882fc6eda0ae41eb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:16.033273 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-01cdca98-0ba4-45bd-99a2-e373d09aa9e5 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 200 len: 1305 microversion: 2.1 time: 0.412806 Oct 05 17:34:16.034182 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 442/895] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:15 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 1305 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:34:16.044991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:16.051004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:16.067230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:16.071166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:16.072236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:16.073353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:16.073970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:16.079558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:16.250455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:16.266564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:16.271986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:16.285920 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ff4a0526-b065-4007-8710-422ee871d814 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.248649 Oct 05 17:34:16.289674 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 443/896] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:16 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:16.434369 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-1519b047-c4b1-4383-b4ed-3e0e575a0b4b tempest-FlavorsV2NegativeTest-1155000337 tempest-FlavorsV2NegativeTest-1155000337-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1519b047-c4b1-4383-b4ed-3e0e575a0b4b tempest-FlavorsV2NegativeTest-1155000337 tempest-FlavorsV2NegativeTest-1155000337-project] Request method failure captured: Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 142 Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcAV7Tff79Q-5frkbd07LCM4pFyHOma04uX4B3UWQXNkLlZD6GmOPTXmCZq0eNQL5DCLp8-HC1Sl2F6WwpK4R7yO52cD0wk65K4TIzfzstnMDx4M4fNtF5RXhj3iRC4f1BxV3jsMcGfZ3uxMjrT6SXqA4rY5NagITU30b1QCi-cEOQU Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 0a44cc69442e43209fd038e2d5f655e1 Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FlavorsV2NegativeTest-1155000337 Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:16.436331 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0a44cc69442e43209fd038e2d5f655e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a44cc69442e43209fd038e2d5f655e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0a44cc69442e43209fd038e2d5f655e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0a44cc69442e43209fd038e2d5f655e1"}]}] Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FlavorsV2NegativeTest-1155000337 Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 0a44cc69442e43209fd038e2d5f655e1 Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1155000337 Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FlavorsV2NegativeTest-1155000337-project Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 3650ba1f18af472bb9cfdd455c3fa9da Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FlavorsV2NegativeTest-1155000337-project Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-953735808", "imageRef": "1ced4d65-9709-4ea4-b22d-fe06b1e72448", "flavorRef": "452"}} Oct 05 17:34:16.437753 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: exception: Flavor's memory is too small for requested image. Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-953735808', 'imageRef': '1ced4d65-9709-4ea4-b22d-fe06b1e72448', 'flavorRef': '452'}}} Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:16.438705 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:16.440019 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:16.441361 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:16.441361 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:16.441361 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:16.441361 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:16.441361 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 05 17:34:16.441361 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:16.445414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1519b047-c4b1-4383-b4ed-3e0e575a0b4b tempest-FlavorsV2NegativeTest-1155000337 tempest-FlavorsV2NegativeTest-1155000337-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:16.446441 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1519b047-c4b1-4383-b4ed-3e0e575a0b4b tempest-FlavorsV2NegativeTest-1155000337 tempest-FlavorsV2NegativeTest-1155000337-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.731507 Oct 05 17:34:16.451259 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 454/897] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:34:15 2022] POST /compute/v2.1/servers => generated 93 bytes in 733 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:34:16.480237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b329fe33-2e8c-40a8-afb5-3c946eda2cb0 req-60443b75-9484-4094-a1e5-cb7d23f84f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f8884c-4ca4-429c-aa7b-df2fc97a928c", "name": "network-vif-unplugged", "status": "completed", "tag": "a18e8b53-aade-42fb-9dfa-55dfdd67d235"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:16.488761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:16.515165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b329fe33-2e8c-40a8-afb5-3c946eda2cb0 req-60443b75-9484-4094-a1e5-cb7d23f84f18 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:16.517481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b329fe33-2e8c-40a8-afb5-3c946eda2cb0 req-60443b75-9484-4094-a1e5-cb7d23f84f18 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:16.519601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b329fe33-2e8c-40a8-afb5-3c946eda2cb0 req-60443b75-9484-4094-a1e5-cb7d23f84f18 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:16.560713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c009e0ab-d242-4580-bd7a-284a2140eff9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:16.560713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c009e0ab-d242-4580-bd7a-284a2140eff9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:16.575819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009e0ab-d242-4580-bd7a-284a2140eff9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:16.576403 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b329fe33-2e8c-40a8-afb5-3c946eda2cb0 req-60443b75-9484-4094-a1e5-cb7d23f84f18 service nova] Creating event network-vif-unplugged:a18e8b53-aade-42fb-9dfa-55dfdd67d235 for instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c on n-h2-835595-3 Oct 05 17:34:16.578015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009e0ab-d242-4580-bd7a-284a2140eff9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:16.583063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009e0ab-d242-4580-bd7a-284a2140eff9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:16.584062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009e0ab-d242-4580-bd7a-284a2140eff9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:16.591170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009e0ab-d242-4580-bd7a-284a2140eff9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:16.593548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009e0ab-d242-4580-bd7a-284a2140eff9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:16.610750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-b329fe33-2e8c-40a8-afb5-3c946eda2cb0 req-60443b75-9484-4094-a1e5-cb7d23f84f18 service nova] Instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c is migrating within the same cell, copying events to all relevant hosts: {'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:34:16.646439 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b329fe33-2e8c-40a8-afb5-3c946eda2cb0 req-60443b75-9484-4094-a1e5-cb7d23f84f18 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.169677 Oct 05 17:34:16.647954 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 444/898] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:16.662858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:16.663646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:16.692965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:16.693464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:16.693903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:16.704157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:16.704684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:16.705135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:17.098447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:17.108373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:17.114406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:17.132985 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-563e66af-ec53-490b-850c-45601be21e67 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1362 microversion: 2.25 time: 0.483539 Oct 05 17:34:17.136177 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 445/899] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:16 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1362 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:17.165401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:17.166436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] [instance: 2326b784-d0b7-455c-8a14-0d28dc57d0bd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:17.184708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:17.185788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:17.188441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:17.191336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:17.192322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:17.195889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:17.212272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c009e0ab-d242-4580-bd7a-284a2140eff9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:17.227057 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c009e0ab-d242-4580-bd7a-284a2140eff9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1470 microversion: 2.1 time: 0.673626 Oct 05 17:34:17.246588 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 455/900] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:16 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1470 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:17.257723 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] HTTP exception thrown: Instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd could not be found. Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Request method failure captured: Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd HTTP/1.1 Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-_nX-roTQhVw6T551-rxlVGyJpgWf07MCF9z_K0qW-E7gF2SK1jh0Cufv9m-yp-_eC7A78uCtKkkBdcaEtbyc27by8M4ihNCryR8PqDs3Zy15R5XWiSfhrl64sCVYcuPw9C4gaswJMbn23h3sKblEb8TZkDadJi4w0WgBdG8nJuxI Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:17.259440 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9bdb0c8c021f481882fc6eda0ae41eb4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9bdb0c8c021f481882fc6eda0ae41eb4"}]}] Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9bdb0c8c021f481882fc6eda0ae41eb4 Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-667983909 Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f53bebb71deb4cd0a33f962302456404 Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsTestJSON-667983909-project Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd could not be found. Oct 05 17:34:17.260772 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '2326b784-d0b7-455c-8a14-0d28dc57d0bd'} Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd could not be found. Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:17.261491 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd could not be found. Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd could not be found. Oct 05 17:34:17.263158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:17.264646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Returning 404 to user: Instance 2326b784-d0b7-455c-8a14-0d28dc57d0bd could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:17.264646 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c38def72-4c7d-4c42-b39f-8d73158ed344 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd" status: 404 len: 111 microversion: 2.1 time: 0.123535 Oct 05 17:34:17.264646 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 446/901] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:17 2022] GET /compute/v2.1/servers/2326b784-d0b7-455c-8a14-0d28dc57d0bd => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:17.269535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d7c7bad2-47c6-4f5f-a3ef-6d4165c0cea7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f7775b19f70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:17.319634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:17.320045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:17.330139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:17.330676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:17.331117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:17.331832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:17.332289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:17.332711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:17.493206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:17.509189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:17.511487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:17.525179 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5d5dda5-0340-45bf-8e97-369f90d7f6fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1531 microversion: 2.91 time: 0.209576 Oct 05 17:34:17.525993 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 447/902] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:17 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1531 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:34:17.553084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5cb9544e-746c-4be7-8f07-82c1652c2299 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:17.554053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5cb9544e-746c-4be7-8f07-82c1652c2299 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:17.560647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb9544e-746c-4be7-8f07-82c1652c2299 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:17.561362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb9544e-746c-4be7-8f07-82c1652c2299 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:17.562193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb9544e-746c-4be7-8f07-82c1652c2299 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:17.563082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb9544e-746c-4be7-8f07-82c1652c2299 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:17.564367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb9544e-746c-4be7-8f07-82c1652c2299 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:17.565202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb9544e-746c-4be7-8f07-82c1652c2299 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:17.702606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-5cb9544e-746c-4be7-8f07-82c1652c2299 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lazy-loading 'services' on Instance uuid bd2347ec-34bb-4815-8968-2c92099344c1 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:17.728183 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5cb9544e-746c-4be7-8f07-82c1652c2299 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1936 microversion: 2.91 time: 0.178761 Oct 05 17:34:17.743485 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 448/903] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:17 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1936 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:34:17.765402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-29e6bb83-073e-49de-84e8-fe51fc004c8c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:17.766294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-29e6bb83-073e-49de-84e8-fe51fc004c8c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:17.784235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e6bb83-073e-49de-84e8-fe51fc004c8c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:17.784629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e6bb83-073e-49de-84e8-fe51fc004c8c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:17.787270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e6bb83-073e-49de-84e8-fe51fc004c8c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:17.788026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e6bb83-073e-49de-84e8-fe51fc004c8c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:17.788505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e6bb83-073e-49de-84e8-fe51fc004c8c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:17.788937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e6bb83-073e-49de-84e8-fe51fc004c8c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:17.839329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-29e6bb83-073e-49de-84e8-fe51fc004c8c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lazy-loading 'flavor' on Instance uuid bd2347ec-34bb-4815-8968-2c92099344c1 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:17.963743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:18.001947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=20 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:18.161729 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d7c7bad2-47c6-4f5f-a3ef-6d4165c0cea7 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/5b5b8fed-89e6-44bf-80f8-be918b8de6ac" status: 202 len: 0 microversion: 2.1 time: 0.896026 Oct 05 17:34:18.165701 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 456/904] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:17 2022] DELETE /compute/v2.1/os-security-groups/5b5b8fed-89e6-44bf-80f8-be918b8de6ac => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:34:18.169377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:18.170008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:18.183151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:18.198003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:18.198544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:18.198987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:18.206665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:18.207998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:18.208467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:18.232015 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-29e6bb83-073e-49de-84e8-fe51fc004c8c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "POST /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1/action" status: 202 len: 0 microversion: 2.91 time: 0.477551 Oct 05 17:34:18.248430 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 449/905] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:34:17 2022] POST /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:34:18.267883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90d21236-21f3-4c8a-b4ca-36e2b6977709 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] Calling method '.version_select at 0x7f77752f8700>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:18.682210 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90d21236-21f3-4c8a-b4ca-36e2b6977709 tempest-SecurityGroupsTestJSON-667983909 tempest-SecurityGroupsTestJSON-667983909-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/97cb6d8b-e6b1-4ab9-8655-4d49400c5c5c" status: 202 len: 0 microversion: 2.1 time: 0.426595 Oct 05 17:34:18.683501 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 450/906] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:18 2022] DELETE /compute/v2.1/os-security-groups/97cb6d8b-e6b1-4ab9-8655-4d49400c5c5c => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:34:18.936197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:18.957520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:18.961380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:18.962823 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8419ee10-ad2f-4d4d-8a26-471ad1e8ed95 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1362 microversion: 2.25 time: 0.798877 Oct 05 17:34:18.979035 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 457/907] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:18 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1362 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:18.992837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a4b5e09-defe-48ff-bff8-8ea90c4c564e tempest-NetworksTest-450708744 tempest-NetworksTest-450708744-project-admin] Calling method '.version_select at 0x7f77752e2790>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:18.994153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:18.994844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:19.006781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:19.007263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:19.012656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:19.013406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:19.015510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:19.016101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:19.171092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:19.189133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:19.195188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:19.211385 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0283fc3f-b060-4a80-a94c-335d9409d70a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.228194 Oct 05 17:34:19.238750 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 458/908] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:18 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:19.244034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-543eebc0-e6db-468c-9534-02658e52e173 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:19.255303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-543eebc0-e6db-468c-9534-02658e52e173 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:19.262208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-543eebc0-e6db-468c-9534-02658e52e173 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:19.267222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-543eebc0-e6db-468c-9534-02658e52e173 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:19.267881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-543eebc0-e6db-468c-9534-02658e52e173 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:19.275405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-543eebc0-e6db-468c-9534-02658e52e173 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:19.276110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-543eebc0-e6db-468c-9534-02658e52e173 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:19.276719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-543eebc0-e6db-468c-9534-02658e52e173 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:19.347424 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a4b5e09-defe-48ff-bff8-8ea90c4c564e tempest-NetworksTest-450708744 tempest-NetworksTest-450708744-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks" status: 200 len: 6767 microversion: 2.1 time: 0.661854 Oct 05 17:34:19.348133 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 451/909] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:34:18 2022] GET /compute/v2.1/os-networks => generated 6767 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:19.358118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64233f73-b40e-44a1-a63a-deaac1c221d1 tempest-NetworksTest-450708744 tempest-NetworksTest-450708744-project-admin] Calling method '.version_select at 0x7f777530d820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:19.609680 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-64233f73-b40e-44a1-a63a-deaac1c221d1 tempest-NetworksTest-450708744 tempest-NetworksTest-450708744-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks/de643343-c49d-40ba-bdff-e7e84d69a963" status: 200 len: 652 microversion: 2.1 time: 0.257067 Oct 05 17:34:19.622799 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 452/910] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:34:19 2022] GET /compute/v2.1/os-networks/de643343-c49d-40ba-bdff-e7e84d69a963 => generated 652 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:19.630166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e4240ce-0312-4971-a965-1bf5da1eb5b4 tempest-NetworksTest-450708744 tempest-NetworksTest-450708744-project-admin] Calling method '.version_select at 0x7f77752e2af0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:19.805195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-543eebc0-e6db-468c-9534-02658e52e173 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:19.816120 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-543eebc0-e6db-468c-9534-02658e52e173 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1470 microversion: 2.1 time: 0.575897 Oct 05 17:34:19.818052 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 459/911] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:19 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1470 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:19.874191 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0e4240ce-0312-4971-a965-1bf5da1eb5b4 tempest-NetworksTest-450708744 tempest-NetworksTest-450708744-project-admin] 10.222.0.70 "GET /compute/v2.1/os-networks" status: 200 len: 6767 microversion: 2.1 time: 0.249328 Oct 05 17:34:19.875266 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 453/912] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:34:19 2022] GET /compute/v2.1/os-networks => generated 6767 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:19.980622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-efa94cc7-7b61-4898-bc18-b76f935f1ab2 req-d2cf24ea-34ab-4cca-99ce-3ff07d798225 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f8884c-4ca4-429c-aa7b-df2fc97a928c", "name": "network-vif-plugged", "status": "completed", "tag": "a18e8b53-aade-42fb-9dfa-55dfdd67d235"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:19.992127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:19.992858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:20.010063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:20.015118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:20.018035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-efa94cc7-7b61-4898-bc18-b76f935f1ab2 req-d2cf24ea-34ab-4cca-99ce-3ff07d798225 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:20.018979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:20.022411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:20.023482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:20.024112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:20.024917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-efa94cc7-7b61-4898-bc18-b76f935f1ab2 req-d2cf24ea-34ab-4cca-99ce-3ff07d798225 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:20.028487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-efa94cc7-7b61-4898-bc18-b76f935f1ab2 req-d2cf24ea-34ab-4cca-99ce-3ff07d798225 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:20.054316 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-efa94cc7-7b61-4898-bc18-b76f935f1ab2 req-d2cf24ea-34ab-4cca-99ce-3ff07d798225 service nova] Creating event network-vif-plugged:a18e8b53-aade-42fb-9dfa-55dfdd67d235 for instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c on n-h2-835595-3 Oct 05 17:34:20.077124 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-efa94cc7-7b61-4898-bc18-b76f935f1ab2 req-d2cf24ea-34ab-4cca-99ce-3ff07d798225 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100444 Oct 05 17:34:20.078392 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 460/913] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:34:20.245341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:20.253194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:20.257313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:20.264405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:20.264405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:20.266083 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2735d63-7c25-488b-a233-32e0e88bb9c2 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1362 microversion: 2.25 time: 0.277076 Oct 05 17:34:20.266999 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 454/914] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:19 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:34:20.273474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:20.274210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:20.274857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:20.275901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:20.276536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:20.277281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:20.440941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:20.458989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:20.460704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:20.468611 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8d525469-cd6f-42da-b10f-a46cb4bb95e7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.227697 Oct 05 17:34:20.469210 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 461/915] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:20 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:20.838652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fc626b44-9dd8-44e3-b9c3-be0c0b77b0e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:20.839278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fc626b44-9dd8-44e3-b9c3-be0c0b77b0e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:20.851944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc626b44-9dd8-44e3-b9c3-be0c0b77b0e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:20.852445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc626b44-9dd8-44e3-b9c3-be0c0b77b0e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:20.852889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc626b44-9dd8-44e3-b9c3-be0c0b77b0e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:20.853603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc626b44-9dd8-44e3-b9c3-be0c0b77b0e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:20.854060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc626b44-9dd8-44e3-b9c3-be0c0b77b0e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:20.854528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc626b44-9dd8-44e3-b9c3-be0c0b77b0e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:21.300782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fc626b44-9dd8-44e3-b9c3-be0c0b77b0e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:21.309279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:21.310977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:21.319672 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fc626b44-9dd8-44e3-b9c3-be0c0b77b0e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1462 microversion: 2.1 time: 0.484931 Oct 05 17:34:21.322548 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 455/916] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:20 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1462 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:34:21.336085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:21.342814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:21.344043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:21.345025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:21.345884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:21.346589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:21.349503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9f2e8425-dc13-4da0-85a4-8a93510c728d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:21.350484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9f2e8425-dc13-4da0-85a4-8a93510c728d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:21.364170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f2e8425-dc13-4da0-85a4-8a93510c728d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:21.368668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f2e8425-dc13-4da0-85a4-8a93510c728d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:21.371126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f2e8425-dc13-4da0-85a4-8a93510c728d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:21.374023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f2e8425-dc13-4da0-85a4-8a93510c728d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:21.374782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f2e8425-dc13-4da0-85a4-8a93510c728d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:21.377105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f2e8425-dc13-4da0-85a4-8a93510c728d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:21.544813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9f2e8425-dc13-4da0-85a4-8a93510c728d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:21.554124 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9f2e8425-dc13-4da0-85a4-8a93510c728d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1462 microversion: 2.1 time: 0.210728 Oct 05 17:34:21.554809 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 456/917] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:21 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1462 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:34:21.563903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:21.564801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:21.572136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:21.572931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:21.573615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:21.574571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:21.575243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:21.575945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:21.659073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:21.669344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:21.671136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:21.677214 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6cbaf055-b31a-41d2-bd0f-bc1836497e7a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.121216 Oct 05 17:34:21.678051 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 457/918] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:21 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:21.702040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5a1a9006-ce49-4148-ac6d-74c459a657cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'create', calling method: .version_select at 0x7f77752e2ee0>, body: {"keypair": {"name": "tempest-keypair-1426769608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDlvAAn8sfC2xgnT7EpC8zE+LcgKqtBdvEz7jse/Zuyl3+H91a/o1DZaeoM0kdkqeMQKWB6sUlS+2SkAiScUaFBoHeW14DBLd07jD+0rWb7Kwi+wDSQ/AhR1ysZJ+EbE8A=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:21.725463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-5a1a9006-ce49-4148-ac6d-74c459a657cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for project afc6422679664e47892eef7185291846. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:21.730145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-5a1a9006-ce49-4148-ac6d-74c459a657cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for user 15a6bfffd8fb473b83de94858676f8ed and project afc6422679664e47892eef7185291846. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:21.747851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:21.761019 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5a1a9006-ce49-4148-ac6d-74c459a657cc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.070994 Oct 05 17:34:21.766757 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 458/919] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:34:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:21.785303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:21.810889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:21.831213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:21.832909 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b33421dd-2b63-44a4-835d-af5ee9051fc9 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1362 microversion: 2.25 time: 0.541983 Oct 05 17:34:21.836961 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 462/920] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:21 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1362 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:22.129046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e17675ad-3cfe-4fbb-b345-d7ae66b6305d req-b09fb674-cd6c-4c96-af5d-3b8cabd80cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc39da4-3415-41c0-9552-de49d599f894", "name": "network-vif-plugged", "status": "completed", "tag": "4c8c6427-bd57-44ed-aa04-e2b51f49ce09"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:22.143918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e17675ad-3cfe-4fbb-b345-d7ae66b6305d req-b09fb674-cd6c-4c96-af5d-3b8cabd80cca service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:22.144541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e17675ad-3cfe-4fbb-b345-d7ae66b6305d req-b09fb674-cd6c-4c96-af5d-3b8cabd80cca service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:22.144984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e17675ad-3cfe-4fbb-b345-d7ae66b6305d req-b09fb674-cd6c-4c96-af5d-3b8cabd80cca service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:22.159184 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e17675ad-3cfe-4fbb-b345-d7ae66b6305d req-b09fb674-cd6c-4c96-af5d-3b8cabd80cca service nova] Creating event network-vif-plugged:4c8c6427-bd57-44ed-aa04-e2b51f49ce09 for instance ebc39da4-3415-41c0-9552-de49d599f894 on n-h2-835595-3 Oct 05 17:34:22.164591 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e17675ad-3cfe-4fbb-b345-d7ae66b6305d req-b09fb674-cd6c-4c96-af5d-3b8cabd80cca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043167 Oct 05 17:34:22.168677 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 459/921] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:22.708374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:22.708993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:22.716894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:22.717391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:22.717823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:22.718556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:22.719015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:22.719442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:22.864358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:22.866262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:22.879708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:22.880511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:22.881615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:22.882580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:22.888312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:22.896398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:22.900087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:22.902246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:22.904614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:22.912292 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a17f3862-fcfb-43d0-9af2-92f31cde1a27 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.207810 Oct 05 17:34:22.928245 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 463/922] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:22 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:23.232007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:23.259622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:23.261441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:23.274625 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-07761f3e-b59f-4f4e-9b35-6878694403ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1362 microversion: 2.25 time: 0.417540 Oct 05 17:34:23.278517 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 460/923] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:22 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:34:23.542128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a8312ae-3691-4910-945e-4f0a1771b8dd tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '.version_select at 0x7f7775bc5670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:23.546479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a8312ae-3691-4910-945e-4f0a1771b8dd tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:23.547354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a8312ae-3691-4910-945e-4f0a1771b8dd tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:23.548065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a8312ae-3691-4910-945e-4f0a1771b8dd tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:23.572509 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a8312ae-3691-4910-945e-4f0a1771b8dd tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1186 microversion: 2.1 time: 0.029318 Oct 05 17:34:23.583901 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 464/924] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:34:23 2022] GET /compute/v2.1/os-migrations => generated 1186 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:23.596170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6d892f1d-11db-4189-881d-32fe65c1eff0 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:23.620593 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6d892f1d-11db-4189-881d-32fe65c1eff0 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029723 Oct 05 17:34:23.622684 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 461/925] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:34:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:34:23.643352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bbb9bcb5-4161-4db4-9eac-a8344d473d69 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-221548510", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:23.674715 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bbb9bcb5-4161-4db4-9eac-a8344d473d69 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.041429 Oct 05 17:34:23.676031 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 465/926] 10.222.0.70 () {60 vars in 1146 bytes} [Wed Oct 5 17:34:23 2022] POST /compute/v2.1/flavors => generated 498 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:34:23.715908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b18e5d30-a8b5-495f-aaad-40898d7d1393 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:23.741079 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b18e5d30-a8b5-495f-aaad-40898d7d1393 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.055256 Oct 05 17:34:23.741609 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 462/927] 10.222.0.70 () {58 vars in 1182 bytes} [Wed Oct 5 17:34:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:34:23.953772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:23.954536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:23.974057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:23.975603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:23.976861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:23.977765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:23.978413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:23.978995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:24.062578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-772397772", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "6403527e-38a9-40d5-82c1-5ca19de08c4b"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:24.164423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:34:24.206517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:24.243118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:24.244776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:24.254976 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-098d2334-808d-4d89-95a5-9603a9e2cf9a tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.307959 Oct 05 17:34:24.266970 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 466/928] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:23 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:24.309810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:24.311370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:24.342259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:24.344382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:24.347185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:24.351661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:24.354739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:24.357239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:24.559733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:34:24.560272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:34:24.560604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:34:24.561009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:34:24.561412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:34:24.578434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:24.578934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:24.579462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:24.582951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:24.585057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:24.585525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:24.619811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for project afc6422679664e47892eef7185291846. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:24.630036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for user 15a6bfffd8fb473b83de94858676f8ed and project afc6422679664e47892eef7185291846. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:24.649451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:34:24.652480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:34:24.782954 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f554b3b4-2a49-47a2-a1bc-868c4e20e250 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724008 Oct 05 17:34:24.792783 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 463/929] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:34:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 17:34:24.798366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26e19a67-236c-4d57-947b-80b5b2bb9857 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:24.803265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-26e19a67-236c-4d57-947b-80b5b2bb9857 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:24.883423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-26e19a67-236c-4d57-947b-80b5b2bb9857 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:24.893608 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-26e19a67-236c-4d57-947b-80b5b2bb9857 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1278 microversion: 2.1 time: 0.099472 Oct 05 17:34:24.907083 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 464/930] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:24 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1278 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:25.285563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:25.286541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:25.308353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:25.311474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:25.312083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:25.313673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:25.315468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:25.317642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:25.373441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:25.387574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:25.398876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:25.400168 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-252c1373-6e4e-4970-84b4-3b8c221acf64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1557 microversion: 2.25 time: 1.096495 Oct 05 17:34:25.429313 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 467/931] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:24 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1557 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:25.434193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-77f58d03-cfd8-42a9-8388-33f12dacaf5b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:25.445863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-77f58d03-cfd8-42a9-8388-33f12dacaf5b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:25.468330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f58d03-cfd8-42a9-8388-33f12dacaf5b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:25.468330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f58d03-cfd8-42a9-8388-33f12dacaf5b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:25.469113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f58d03-cfd8-42a9-8388-33f12dacaf5b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:25.476388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f58d03-cfd8-42a9-8388-33f12dacaf5b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:25.476958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f58d03-cfd8-42a9-8388-33f12dacaf5b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:25.477402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f58d03-cfd8-42a9-8388-33f12dacaf5b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:25.486250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:25.503236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:25.512322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:25.531999 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dab8bc8e-c1eb-4534-8b67-478888364874 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.250884 Oct 05 17:34:25.534589 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 465/932] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:25 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:34:25.917383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ad7876f2-0f19-4edd-ab9d-0c8964d92e50 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:25.918845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ad7876f2-0f19-4edd-ab9d-0c8964d92e50 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:25.932515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad7876f2-0f19-4edd-ab9d-0c8964d92e50 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:25.933507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad7876f2-0f19-4edd-ab9d-0c8964d92e50 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:25.934339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad7876f2-0f19-4edd-ab9d-0c8964d92e50 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:25.937622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad7876f2-0f19-4edd-ab9d-0c8964d92e50 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:25.939890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad7876f2-0f19-4edd-ab9d-0c8964d92e50 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:25.947373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad7876f2-0f19-4edd-ab9d-0c8964d92e50 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:26.097114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ad7876f2-0f19-4edd-ab9d-0c8964d92e50 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:26.109392 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ad7876f2-0f19-4edd-ab9d-0c8964d92e50 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1330 microversion: 2.1 time: 0.195766 Oct 05 17:34:26.109996 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 466/933] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:25 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1330 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:34:26.289154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-77f58d03-cfd8-42a9-8388-33f12dacaf5b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid ebc39da4-3415-41c0-9552-de49d599f894 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:26.316576 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-77f58d03-cfd8-42a9-8388-33f12dacaf5b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 2050 microversion: 2.25 time: 0.885983 Oct 05 17:34:26.317789 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 468/934] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:25 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 2050 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:26.341503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dcc5f788-8005-4e21-9c3a-bce353b637d3 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:26.342445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dcc5f788-8005-4e21-9c3a-bce353b637d3 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:26.351260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcc5f788-8005-4e21-9c3a-bce353b637d3 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:26.356619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcc5f788-8005-4e21-9c3a-bce353b637d3 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:26.357387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcc5f788-8005-4e21-9c3a-bce353b637d3 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:26.358627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcc5f788-8005-4e21-9c3a-bce353b637d3 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:26.359845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcc5f788-8005-4e21-9c3a-bce353b637d3 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:26.360517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcc5f788-8005-4e21-9c3a-bce353b637d3 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:26.573462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-dcc5f788-8005-4e21-9c3a-bce353b637d3 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid ebc39da4-3415-41c0-9552-de49d599f894 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:26.579639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:26.587122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:26.605281 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dcc5f788-8005-4e21-9c3a-bce353b637d3 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 2050 microversion: 2.25 time: 0.267554 Oct 05 17:34:26.609694 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 467/935] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:26 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 2050 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:26.637568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:26.638067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:26.641836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2043bacd-f613-4314-a94c-27c948063669 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:26.646495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2043bacd-f613-4314-a94c-27c948063669 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:26.650672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2043bacd-f613-4314-a94c-27c948063669 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:26.652174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2043bacd-f613-4314-a94c-27c948063669 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:26.658418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2043bacd-f613-4314-a94c-27c948063669 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:26.659433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2043bacd-f613-4314-a94c-27c948063669 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:26.660215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2043bacd-f613-4314-a94c-27c948063669 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:26.674935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:26.675797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:26.676282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:26.676712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:26.747342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2043bacd-f613-4314-a94c-27c948063669 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.108972 Oct 05 17:34:26.754490 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 468/936] 10.222.0.70 () {60 vars in 1217 bytes} [Wed Oct 5 17:34:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:34:26.765238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a366c39b-153b-415d-a0fc-e1858c4308d1 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:26.766160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a366c39b-153b-415d-a0fc-e1858c4308d1 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:26.773598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a366c39b-153b-415d-a0fc-e1858c4308d1 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:26.774353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a366c39b-153b-415d-a0fc-e1858c4308d1 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:26.775008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a366c39b-153b-415d-a0fc-e1858c4308d1 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:26.779326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a366c39b-153b-415d-a0fc-e1858c4308d1 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:26.779326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a366c39b-153b-415d-a0fc-e1858c4308d1 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:26.783655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a366c39b-153b-415d-a0fc-e1858c4308d1 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:26.987695 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a366c39b-153b-415d-a0fc-e1858c4308d1 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894/action" status: 202 len: 0 microversion: 2.25 time: 0.229226 Oct 05 17:34:26.993182 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 469/937] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:34:26 2022] POST /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:34:27.153324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:27.162799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:27.164338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:27.176341 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a503d8e9-598b-489d-af30-922bee4cc6e9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.608876 Oct 05 17:34:27.176930 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 469/938] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:26 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:27.192705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a351327-b533-4279-82e4-6502e379893b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:27.193628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0a351327-b533-4279-82e4-6502e379893b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:27.205458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a351327-b533-4279-82e4-6502e379893b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:27.206321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a351327-b533-4279-82e4-6502e379893b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:27.209234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a351327-b533-4279-82e4-6502e379893b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:27.210180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a351327-b533-4279-82e4-6502e379893b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:27.210890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a351327-b533-4279-82e4-6502e379893b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:27.212559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a351327-b533-4279-82e4-6502e379893b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:27.246101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b96920d7-46cb-4b75-9e9a-77505bec3e56 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Calling method '.version_select at 0x7f7775770430>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:27.349840 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b96920d7-46cb-4b75-9e9a-77505bec3e56 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942" status: 200 len: 371 microversion: 2.1 time: 0.354963 Oct 05 17:34:27.351148 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 470/939] 10.222.0.70 () {58 vars in 1242 bytes} [Wed Oct 5 17:34:26 2022] GET /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 => generated 371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:27.381652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7bea7a3e-fdcc-46ea-841f-142a9eb50b45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:27.382443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7bea7a3e-fdcc-46ea-841f-142a9eb50b45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:27.401490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bea7a3e-fdcc-46ea-841f-142a9eb50b45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:27.402012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bea7a3e-fdcc-46ea-841f-142a9eb50b45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:27.402465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bea7a3e-fdcc-46ea-841f-142a9eb50b45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:27.405018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bea7a3e-fdcc-46ea-841f-142a9eb50b45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:27.407044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bea7a3e-fdcc-46ea-841f-142a9eb50b45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:27.408221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bea7a3e-fdcc-46ea-841f-142a9eb50b45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:27.517362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7bea7a3e-fdcc-46ea-841f-142a9eb50b45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:27.526426 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7bea7a3e-fdcc-46ea-841f-142a9eb50b45 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1336 microversion: 2.1 time: 0.173823 Oct 05 17:34:27.527607 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 471/940] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:27 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1336 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:27.533342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fe017f2f-71eb-4d93-8572-4fb453042fb5 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Action: 'update', calling method: .version_select at 0x7f7775360b80>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:27.615059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe017f2f-71eb-4d93-8572-4fb453042fb5 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:27.623572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe017f2f-71eb-4d93-8572-4fb453042fb5 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:27.624532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe017f2f-71eb-4d93-8572-4fb453042fb5 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:27.625697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe017f2f-71eb-4d93-8572-4fb453042fb5 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:27.626432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe017f2f-71eb-4d93-8572-4fb453042fb5 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:27.627046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe017f2f-71eb-4d93-8572-4fb453042fb5 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:27.688925 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fe017f2f-71eb-4d93-8572-4fb453042fb5 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942" status: 200 len: 328 microversion: 2.1 time: 0.159834 Oct 05 17:34:27.689591 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 472/941] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:34:27 2022] PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 => generated 328 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:27.868853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-959759249", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:27.929587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:34:28.132746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:34:28.133365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:34:28.133772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:34:28.134266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:34:28.134777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:34:28.144317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:28.144885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:28.145451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:28.146344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:28.147278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:28.147783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:28.168290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Getting quotas for project 727752ba808041b1adbdd9c084f03942. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:28.176161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Getting quotas for user b77eb07fdbad43aaa5335e4900a3e895 and project 727752ba808041b1adbdd9c084f03942. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:28.191506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.utils [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] cores quota exceeded for 727752ba808041b1adbdd9c084f03942, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128844) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 05 17:34:28.192346 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Request method failure captured: Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 144 Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcAhn8NRnJ8VMeGiUqaTSAdYYOufujPjmf_5AnM_t_HOSVb7ybBl9dK5u_EfXvIfQc1YH8ZkFNeADlPJ4CxonIDMS0tcxzu4oEnUI2pbZ2q3hJRjNNau7oGwFeecFKZi7hD-nm62h4ILEnDVpDybVoZ-Miuxq8vgL34iuGaDeTPR1Zg Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 727752ba808041b1adbdd9c084f03942 Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:28.196584 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/727752ba808041b1adbdd9c084f03942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/727752ba808041b1adbdd9c084f03942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_727752ba808041b1adbdd9c084f03942", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/727752ba808041b1adbdd9c084f03942"}]}] Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 727752ba808041b1adbdd9c084f03942 Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-QuotasAdminNegativeTest-1634390414-project Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: b77eb07fdbad43aaa5335e4900a3e895 Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-QuotasAdminNegativeTest-1634390414-project Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-959759249", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} Oct 05 17:34:28.198220 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-959759249', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452'}}} Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 05 17:34:28.199149 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:28.200299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:28.203673 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:28.205736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:28.205736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:28.205736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:28.205736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:28.205736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 05 17:34:28.205736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:28.205736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:28.205736 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b07b8787-f163-4c41-aca5-5db21c403bf7 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.396991 Oct 05 17:34:28.205736 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 473/942] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:34:27 2022] POST /compute/v2.1/servers => generated 111 bytes in 399 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:34:28.221717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:28.222582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:28.232827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:28.235552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:28.236212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:28.237092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:28.237652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:28.238173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:28.338911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:28.363147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:28.365284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:28.373645 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-653cbb0a-ebb8-44d4-bc08-f2d8a79598fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.158139 Oct 05 17:34:28.374908 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 474/943] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:28 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:34:28.385834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-0a351327-b533-4279-82e4-6502e379893b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid ebc39da4-3415-41c0-9552-de49d599f894 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:28.390984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7a844e9b-5baa-439e-9f64-e01b16504fdb tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Action: 'update', calling method: .version_select at 0x7f77752a1040>, body: {"quota_set": {"cores": 20}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:28.412471 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0a351327-b533-4279-82e4-6502e379893b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 2055 microversion: 2.25 time: 1.227597 Oct 05 17:34:28.413079 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 470/944] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:27 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 2055 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:28.494903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a844e9b-5baa-439e-9f64-e01b16504fdb tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:28.496153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a844e9b-5baa-439e-9f64-e01b16504fdb tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:28.496709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a844e9b-5baa-439e-9f64-e01b16504fdb tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:28.497538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a844e9b-5baa-439e-9f64-e01b16504fdb tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:28.498088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a844e9b-5baa-439e-9f64-e01b16504fdb tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:28.498636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a844e9b-5baa-439e-9f64-e01b16504fdb tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:28.550858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6381d929-20d2-44e8-b128-2ecfd8ce8c1a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:28.551477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6381d929-20d2-44e8-b128-2ecfd8ce8c1a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:28.559436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6381d929-20d2-44e8-b128-2ecfd8ce8c1a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:28.559931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6381d929-20d2-44e8-b128-2ecfd8ce8c1a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:28.560364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6381d929-20d2-44e8-b128-2ecfd8ce8c1a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:28.561076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6381d929-20d2-44e8-b128-2ecfd8ce8c1a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:28.561531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6381d929-20d2-44e8-b128-2ecfd8ce8c1a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:28.561952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6381d929-20d2-44e8-b128-2ecfd8ce8c1a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:28.574227 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7a844e9b-5baa-439e-9f64-e01b16504fdb tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942" status: 200 len: 329 microversion: 2.1 time: 0.197893 Oct 05 17:34:28.575587 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 475/945] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:34:28 2022] PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 => generated 329 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:28.594942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5f0a09f-f958-4e7d-a711-740caba466a6 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Calling method '.version_select at 0x7f77752a1d30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:28.731537 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b5f0a09f-f958-4e7d-a711-740caba466a6 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942" status: 200 len: 371 microversion: 2.1 time: 0.143674 Oct 05 17:34:28.733438 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 476/946] 10.222.0.70 () {58 vars in 1242 bytes} [Wed Oct 5 17:34:28 2022] GET /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 => generated 371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:28.745695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d892fd62-b9cb-4756-9186-6f1f9658c5b4 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Action: 'update', calling method: .version_select at 0x7f7775360c10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:28.840403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6381d929-20d2-44e8-b128-2ecfd8ce8c1a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:28.842338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:28.870874 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6381d929-20d2-44e8-b128-2ecfd8ce8c1a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1336 microversion: 2.1 time: 0.323829 Oct 05 17:34:28.872055 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 471/947] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:28 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1336 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:34:28.881870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d892fd62-b9cb-4756-9186-6f1f9658c5b4 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:28.882715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d892fd62-b9cb-4756-9186-6f1f9658c5b4 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:28.883158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d892fd62-b9cb-4756-9186-6f1f9658c5b4 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:28.887540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d892fd62-b9cb-4756-9186-6f1f9658c5b4 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:28.888071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d892fd62-b9cb-4756-9186-6f1f9658c5b4 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:28.888772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d892fd62-b9cb-4756-9186-6f1f9658c5b4 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:28.969459 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d892fd62-b9cb-4756-9186-6f1f9658c5b4 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942" status: 200 len: 328 microversion: 2.1 time: 0.227653 Oct 05 17:34:28.993283 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 477/948] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:34:28 2022] PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 => generated 328 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:34:29.064005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-722283165", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:29.211866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:34:29.527628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c06ede5-506c-40cb-b6c4-449eeaf5a2cd tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Action: 'create', calling method: .version_select at 0x7f77752a10d0>, body: {"keypair": {"name": "tempest-keypair-1031472713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDG0ybFXy1B9Ijcbgt/PlfWBEVhHa8xCj5zAtkwEP2o91rwhJaOAqUizq5F6PzfT1cktHhPhAZowG0TgGlN7usOHGDEMMmsIbPmFLzXMYBs8fXpFphm/cw8WvSLZmKWZtQ=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:29.545448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9c06ede5-506c-40cb-b6c4-449eeaf5a2cd tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Getting quotas for project 1164570e81d8431f882d07b9fa9e8056. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:29.549623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9c06ede5-506c-40cb-b6c4-449eeaf5a2cd tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Getting quotas for user e97eb363a60947e9b2d2d12494714aae and project 1164570e81d8431f882d07b9fa9e8056. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:29.597411 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c06ede5-506c-40cb-b6c4-449eeaf5a2cd tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.251089 Oct 05 17:34:29.601011 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 478/949] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:34:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:29.612630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:29.616948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:29.636129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:29.636860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:29.638354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:29.642469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:29.643219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:29.644039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:29.722560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:34:29.723483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:34:29.724036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:34:29.724451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:34:29.724864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:34:29.744151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:29.744916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:29.745510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:29.746458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:29.747057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:29.748163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:29.756879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:29.779968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Getting quotas for project 727752ba808041b1adbdd9c084f03942. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:29.784917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Getting quotas for user b77eb07fdbad43aaa5335e4900a3e895 and project 727752ba808041b1adbdd9c084f03942. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:29.799659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.utils [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] instances quota exceeded for 727752ba808041b1adbdd9c084f03942, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128843) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 05 17:34:29.800745 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Request method failure captured: Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 144 Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcAhn8NRnJ8VMeGiUqaTSAdYYOufujPjmf_5AnM_t_HOSVb7ybBl9dK5u_EfXvIfQc1YH8ZkFNeADlPJ4CxonIDMS0tcxzu4oEnUI2pbZ2q3hJRjNNau7oGwFeecFKZi7hD-nm62h4ILEnDVpDybVoZ-Miuxq8vgL34iuGaDeTPR1Zg Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 727752ba808041b1adbdd9c084f03942 Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:29.805560 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/727752ba808041b1adbdd9c084f03942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/727752ba808041b1adbdd9c084f03942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_727752ba808041b1adbdd9c084f03942", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/727752ba808041b1adbdd9c084f03942"}]}] Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 727752ba808041b1adbdd9c084f03942 Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-QuotasAdminNegativeTest-1634390414-project Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: b77eb07fdbad43aaa5335e4900a3e895 Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-QuotasAdminNegativeTest-1634390414-project Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-722283165", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} Oct 05 17:34:29.807783 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-722283165', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452'}}} Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 05 17:34:29.808979 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:29.810382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:29.811969 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:29.813578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:29.813578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:29.813578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:29.813578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:29.813578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 05 17:34:29.813578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:29.815618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:29.816660 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-41e7d4bc-9a61-4829-8ccb-9cdecec5f1d6 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.758753 Oct 05 17:34:29.817735 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 472/950] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:34:29 2022] POST /compute/v2.1/servers => generated 119 bytes in 760 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:29.826260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a47c1e54-03a5-434a-849c-bce6523cdebc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:29.827225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a47c1e54-03a5-434a-849c-bce6523cdebc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:29.836121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a47c1e54-03a5-434a-849c-bce6523cdebc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:29.837039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a47c1e54-03a5-434a-849c-bce6523cdebc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:29.837717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a47c1e54-03a5-434a-849c-bce6523cdebc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:29.838716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a47c1e54-03a5-434a-849c-bce6523cdebc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:29.839787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a47c1e54-03a5-434a-849c-bce6523cdebc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:29.841088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a47c1e54-03a5-434a-849c-bce6523cdebc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:29.860101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:29.881288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:29.884155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:29.916144 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90f5f040-0079-4d56-86f2-61a641dbb61d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.313720 Oct 05 17:34:29.921762 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 479/951] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:29 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:29.943061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a0ac904e-e88b-47e8-9a75-1b5e2b8c65f5 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:29.945063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a0ac904e-e88b-47e8-9a75-1b5e2b8c65f5 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:29.968811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ac904e-e88b-47e8-9a75-1b5e2b8c65f5 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:29.976335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ac904e-e88b-47e8-9a75-1b5e2b8c65f5 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:29.976977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ac904e-e88b-47e8-9a75-1b5e2b8c65f5 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:29.982076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ac904e-e88b-47e8-9a75-1b5e2b8c65f5 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:29.987707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ac904e-e88b-47e8-9a75-1b5e2b8c65f5 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:29.989933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ac904e-e88b-47e8-9a75-1b5e2b8c65f5 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:30.091161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a0ac904e-e88b-47e8-9a75-1b5e2b8c65f5 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:34:30.108537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:30.298702 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a0ac904e-e88b-47e8-9a75-1b5e2b8c65f5 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 204 len: 0 microversion: 2.1 time: 0.368570 Oct 05 17:34:30.305404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 480/952] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:34:29 2022] DELETE /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:34:30.318940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e663c39e-8792-4424-8261-2ac3b1abc055 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Action: 'update', calling method: .version_select at 0x7f7775429ee0>, body: {"quota_set": {"instances": 10}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:30.473251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e663c39e-8792-4424-8261-2ac3b1abc055 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:30.473829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e663c39e-8792-4424-8261-2ac3b1abc055 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:30.474554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e663c39e-8792-4424-8261-2ac3b1abc055 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:30.475452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e663c39e-8792-4424-8261-2ac3b1abc055 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:30.475903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e663c39e-8792-4424-8261-2ac3b1abc055 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:30.476321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e663c39e-8792-4424-8261-2ac3b1abc055 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:30.584164 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e663c39e-8792-4424-8261-2ac3b1abc055 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942" status: 200 len: 329 microversion: 2.1 time: 0.277166 Oct 05 17:34:30.593517 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 481/953] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:34:30 2022] PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 => generated 329 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:30.609374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-209c8f9d-392e-487e-84f5-e42216aeab0f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:30.610366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-209c8f9d-392e-487e-84f5-e42216aeab0f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:30.630974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209c8f9d-392e-487e-84f5-e42216aeab0f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:30.631794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209c8f9d-392e-487e-84f5-e42216aeab0f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:30.632385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209c8f9d-392e-487e-84f5-e42216aeab0f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:30.633490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209c8f9d-392e-487e-84f5-e42216aeab0f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:30.634092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209c8f9d-392e-487e-84f5-e42216aeab0f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:30.634701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209c8f9d-392e-487e-84f5-e42216aeab0f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:30.865988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-209c8f9d-392e-487e-84f5-e42216aeab0f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:30.875555 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-209c8f9d-392e-487e-84f5-e42216aeab0f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1378 microversion: 2.1 time: 0.280588 Oct 05 17:34:30.896478 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 482/954] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:30 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1378 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:30.901684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f49ad9c2-1bcd-4f28-97c8-37c7d54c6169 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:30.903193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f49ad9c2-1bcd-4f28-97c8-37c7d54c6169 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:30.910090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49ad9c2-1bcd-4f28-97c8-37c7d54c6169 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:30.910603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49ad9c2-1bcd-4f28-97c8-37c7d54c6169 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:30.911471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49ad9c2-1bcd-4f28-97c8-37c7d54c6169 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:30.912560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49ad9c2-1bcd-4f28-97c8-37c7d54c6169 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:30.913185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49ad9c2-1bcd-4f28-97c8-37c7d54c6169 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:30.915638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f49ad9c2-1bcd-4f28-97c8-37c7d54c6169 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:31.139662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f49ad9c2-1bcd-4f28-97c8-37c7d54c6169 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:31.153945 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f49ad9c2-1bcd-4f28-97c8-37c7d54c6169 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1714 microversion: 2.1 time: 0.255807 Oct 05 17:34:31.155293 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 483/955] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:30 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1714 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:31.160677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b490cd1-73be-4852-a5ad-142809db6284 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Calling method '.version_select at 0x7f777533b280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:31.737336 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b490cd1-73be-4852-a5ad-142809db6284 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942" status: 200 len: 371 microversion: 2.1 time: 0.580364 Oct 05 17:34:31.748220 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 484/956] 10.222.0.70 () {58 vars in 1242 bytes} [Wed Oct 5 17:34:31 2022] GET /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 => generated 371 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:31.769711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:31.770368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:31.804501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:31.809274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:31.810647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:31.811870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:31.817121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:31.819644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:31.976470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:31.989192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:31.990689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:31.996611 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a6e157b5-83bc-48cc-864a-a2a00abc13ed tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.246852 Oct 05 17:34:31.998056 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 485/957] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:31 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:32.003128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c471006e-0755-44b2-a138-2323fb0a1c17 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Action: 'update', calling method: .version_select at 0x7f77753414c0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:32.403300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c471006e-0755-44b2-a138-2323fb0a1c17 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:32.403806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c471006e-0755-44b2-a138-2323fb0a1c17 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:32.404255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c471006e-0755-44b2-a138-2323fb0a1c17 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:32.407206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c471006e-0755-44b2-a138-2323fb0a1c17 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:32.407680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c471006e-0755-44b2-a138-2323fb0a1c17 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:32.408109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c471006e-0755-44b2-a138-2323fb0a1c17 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:32.499872 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c471006e-0755-44b2-a138-2323fb0a1c17 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942" status: 200 len: 325 microversion: 2.1 time: 0.499279 Oct 05 17:34:32.501453 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 486/958] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:34:31 2022] PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 => generated 325 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:32.523527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a7a7ef4-dd8f-46e3-b9dd-07f16dfdccf9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:32.524489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1a7a7ef4-dd8f-46e3-b9dd-07f16dfdccf9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:32.539027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7a7ef4-dd8f-46e3-b9dd-07f16dfdccf9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:32.539748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7a7ef4-dd8f-46e3-b9dd-07f16dfdccf9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:32.540792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7a7ef4-dd8f-46e3-b9dd-07f16dfdccf9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:32.543208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7a7ef4-dd8f-46e3-b9dd-07f16dfdccf9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:32.543859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7a7ef4-dd8f-46e3-b9dd-07f16dfdccf9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:32.544942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7a7ef4-dd8f-46e3-b9dd-07f16dfdccf9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:32.546036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-a47c1e54-03a5-434a-849c-bce6523cdebc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid ebc39da4-3415-41c0-9552-de49d599f894 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:32.613218 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a47c1e54-03a5-434a-849c-bce6523cdebc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 2035 microversion: 2.25 time: 2.789908 Oct 05 17:34:32.616150 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 473/959] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:29 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 2035 bytes in 2798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:32.634918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-89cb23e1-b747-466c-bc12-b13c8f30dd74 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:32.635845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-89cb23e1-b747-466c-bc12-b13c8f30dd74 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:32.671506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89cb23e1-b747-466c-bc12-b13c8f30dd74 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:32.675289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89cb23e1-b747-466c-bc12-b13c8f30dd74 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:32.677837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89cb23e1-b747-466c-bc12-b13c8f30dd74 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:32.685090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89cb23e1-b747-466c-bc12-b13c8f30dd74 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:32.691477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89cb23e1-b747-466c-bc12-b13c8f30dd74 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:32.692324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89cb23e1-b747-466c-bc12-b13c8f30dd74 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:33.034857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1a7a7ef4-dd8f-46e3-b9dd-07f16dfdccf9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:33.049506 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1a7a7ef4-dd8f-46e3-b9dd-07f16dfdccf9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1378 microversion: 2.1 time: 0.543405 Oct 05 17:34:33.050337 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 487/960] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:32 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1378 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:33.065222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-835595-3", "block_migration": "auto"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:33.071115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:33.097329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:33.098626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:33.100243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:33.104584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:33.105177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:33.105682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:33.193893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'flavor' on Instance uuid ebc39da4-3415-41c0-9552-de49d599f894 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:33.217450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Going to try to live migrate instance to n-h1-835595-3 {{(pid=128844) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 17:34:33.285154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-89cb23e1-b747-466c-bc12-b13c8f30dd74 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:33.293736 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-89cb23e1-b747-466c-bc12-b13c8f30dd74 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1714 microversion: 2.1 time: 0.676040 Oct 05 17:34:33.322023 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 474/961] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:32 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1714 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:33.332726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-732482678", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:33.439162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:34:34.579840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:34:34.580598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:34:34.581311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:34:34.581819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:34:34.582456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:34:34.596827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:34.602383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:34.603612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:34.604100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:34.604796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:34.605308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:34.625431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Getting quotas for project 727752ba808041b1adbdd9c084f03942. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:34.631016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Getting quotas for user b77eb07fdbad43aaa5335e4900a3e895 and project 727752ba808041b1adbdd9c084f03942. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:34.646120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.utils [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] ram quota exceeded for 727752ba808041b1adbdd9c084f03942, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128843) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 05 17:34:34.647239 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Request method failure captured: Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 144 Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcAhn8NRnJ8VMeGiUqaTSAdYYOufujPjmf_5AnM_t_HOSVb7ybBl9dK5u_EfXvIfQc1YH8ZkFNeADlPJ4CxonIDMS0tcxzu4oEnUI2pbZ2q3hJRjNNau7oGwFeecFKZi7hD-nm62h4ILEnDVpDybVoZ-Miuxq8vgL34iuGaDeTPR1Zg Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 727752ba808041b1adbdd9c084f03942 Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:34.649695 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/727752ba808041b1adbdd9c084f03942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/727752ba808041b1adbdd9c084f03942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_727752ba808041b1adbdd9c084f03942", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/727752ba808041b1adbdd9c084f03942"}]}] Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 727752ba808041b1adbdd9c084f03942 Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-QuotasAdminNegativeTest-1634390414-project Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: b77eb07fdbad43aaa5335e4900a3e895 Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-QuotasAdminNegativeTest-1634390414-project Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-732482678", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} Oct 05 17:34:34.651050 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-732482678', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452'}}} Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 05 17:34:34.651791 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:34.652889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:34.655640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:34.659373 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:34.659373 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:34.659373 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:34.659373 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:34.659373 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 05 17:34:34.659373 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:34.661550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:34.662828 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0a113700-c3ce-4c84-b62f-c848d9158936 tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.339601 Oct 05 17:34:34.667589 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 475/962] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:34:33 2022] POST /compute/v2.1/servers => generated 110 bytes in 1345 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:34.674802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:34.675791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:34.682599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:34.683476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:34.684167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:34.685091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:34.685789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:34.686513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:34.900662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:34.920245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:34.922732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:34.930533 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0392eef4-2ebf-412c-a531-54e2dfff5c13 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.261333 Oct 05 17:34:34.959072 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 476/963] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:34 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:34.974192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-869883f7-9b6f-4fcc-a1b6-9d313ad2e671 req-d5e26104-379a-48c9-ad8b-fca7e06fddcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3793214f-3607-4041-8f62-fd2b36f1b171", "tag": "8fd18242-e1fd-42af-9db6-62c95ec947e4"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:35.001151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-869883f7-9b6f-4fcc-a1b6-9d313ad2e671 req-d5e26104-379a-48c9-ad8b-fca7e06fddcf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:35.003895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-869883f7-9b6f-4fcc-a1b6-9d313ad2e671 req-d5e26104-379a-48c9-ad8b-fca7e06fddcf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:35.004467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-869883f7-9b6f-4fcc-a1b6-9d313ad2e671 req-d5e26104-379a-48c9-ad8b-fca7e06fddcf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:35.029305 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-869883f7-9b6f-4fcc-a1b6-9d313ad2e671 req-d5e26104-379a-48c9-ad8b-fca7e06fddcf service nova] Creating event network-changed:8fd18242-e1fd-42af-9db6-62c95ec947e4 for instance 3793214f-3607-4041-8f62-fd2b36f1b171 on n-h1-835595-3 Oct 05 17:34:35.040763 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-869883f7-9b6f-4fcc-a1b6-9d313ad2e671 req-d5e26104-379a-48c9-ad8b-fca7e06fddcf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080106 Oct 05 17:34:35.046649 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 477/964] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:35.052489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d9a9ed4d-47fd-467e-9e5d-83b8d8abbf1b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:35.055340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d9a9ed4d-47fd-467e-9e5d-83b8d8abbf1b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:35.075176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a9ed4d-47fd-467e-9e5d-83b8d8abbf1b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:35.076075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a9ed4d-47fd-467e-9e5d-83b8d8abbf1b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:35.077456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a9ed4d-47fd-467e-9e5d-83b8d8abbf1b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:35.079895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a9ed4d-47fd-467e-9e5d-83b8d8abbf1b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:35.080634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a9ed4d-47fd-467e-9e5d-83b8d8abbf1b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:35.085565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a9ed4d-47fd-467e-9e5d-83b8d8abbf1b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:35.978178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9a9ed4d-47fd-467e-9e5d-83b8d8abbf1b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:35.992202 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d9a9ed4d-47fd-467e-9e5d-83b8d8abbf1b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1378 microversion: 2.1 time: 0.942958 Oct 05 17:34:35.993952 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 478/965] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:35 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1378 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:36.006011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-81ff1659-9dd2-4891-92ae-cb01ff25d613 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:36.006011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-81ff1659-9dd2-4891-92ae-cb01ff25d613 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:36.018971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ff1659-9dd2-4891-92ae-cb01ff25d613 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:36.022160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ff1659-9dd2-4891-92ae-cb01ff25d613 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:36.022876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ff1659-9dd2-4891-92ae-cb01ff25d613 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:36.025967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ff1659-9dd2-4891-92ae-cb01ff25d613 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:36.026795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ff1659-9dd2-4891-92ae-cb01ff25d613 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:36.027393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ff1659-9dd2-4891-92ae-cb01ff25d613 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:36.161251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-81ff1659-9dd2-4891-92ae-cb01ff25d613 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:36.172319 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-81ff1659-9dd2-4891-92ae-cb01ff25d613 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1647 microversion: 2.1 time: 0.176652 Oct 05 17:34:36.176829 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 479/966] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:35 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1647 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:36.191099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0953cae0-f375-4520-b3a5-400fd5cbb7a3 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Action: 'update', calling method: .version_select at 0x7f7775b96a60>, body: {"quota_set": {"ram": 51200}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:36.487900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0953cae0-f375-4520-b3a5-400fd5cbb7a3 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:36.491530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0953cae0-f375-4520-b3a5-400fd5cbb7a3 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:36.492228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0953cae0-f375-4520-b3a5-400fd5cbb7a3 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:36.493274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0953cae0-f375-4520-b3a5-400fd5cbb7a3 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:36.499459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0953cae0-f375-4520-b3a5-400fd5cbb7a3 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:36.501540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0953cae0-f375-4520-b3a5-400fd5cbb7a3 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:36.671443 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0953cae0-f375-4520-b3a5-400fd5cbb7a3 tempest-QuotasAdminNegativeTest-1546104195 tempest-QuotasAdminNegativeTest-1546104195-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942" status: 200 len: 329 microversion: 2.1 time: 0.488965 Oct 05 17:34:36.672826 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 480/967] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:34:36 2022] PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 => generated 329 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:36.684647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:36.688095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:36.705668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:36.706169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:36.708772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:36.709563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:36.710063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:36.712633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:36.872372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:36.901157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:36.907139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:36.925578 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29deb92e-c739-47a2-b739-ee53324fa22d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.250157 Oct 05 17:34:36.927239 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 481/968] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:36 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:36.942249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-536d1325-75a7-4968-8136-a2540e0ca1fe tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Action: 'update', calling method: .version_select at 0x7f7775aa7700>, body: {"quota_set": {"ram": 0}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:36.961877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-536d1325-75a7-4968-8136-a2540e0ca1fe tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b77eb07fdbad43aaa5335e4900a3e895', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '727752ba808041b1adbdd9c084f03942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-536d1325-75a7-4968-8136-a2540e0ca1fe tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Request method failure captured: Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: request: PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 HTTP/1.1 Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 25 Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcAhn8NRnJ8VMeGiUqaTSAdYYOufujPjmf_5AnM_t_HOSVb7ybBl9dK5u_EfXvIfQc1YH8ZkFNeADlPJ4CxonIDMS0tcxzu4oEnUI2pbZ2q3hJRjNNau7oGwFeecFKZi7hD-nm62h4ILEnDVpDybVoZ-Miuxq8vgL34iuGaDeTPR1Zg Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 727752ba808041b1adbdd9c084f03942 Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:36.968060 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/727752ba808041b1adbdd9c084f03942"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/727752ba808041b1adbdd9c084f03942"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_727752ba808041b1adbdd9c084f03942", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/727752ba808041b1adbdd9c084f03942"}]}] Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 727752ba808041b1adbdd9c084f03942 Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1634390414 Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-QuotasAdminNegativeTest-1634390414-project Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: b77eb07fdbad43aaa5335e4900a3e895 Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-QuotasAdminNegativeTest-1634390414-project Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: {"quota_set": {"ram": 0}} Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 05 17:34:36.969844 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '727752ba808041b1adbdd9c084f03942', 'body': {'quota_set': {'ram': 0}}} Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:34:36.970905 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:36.972347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:36.973762 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:36.973762 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:36.973762 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:34:36.973762 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:34:36.973762 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 05 17:34:36.973762 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:36.975226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-536d1325-75a7-4968-8136-a2540e0ca1fe tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:36.979334 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-536d1325-75a7-4968-8136-a2540e0ca1fe tempest-QuotasAdminNegativeTest-1634390414 tempest-QuotasAdminNegativeTest-1634390414-project] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942" status: 403 len: 116 microversion: 2.1 time: 0.050437 Oct 05 17:34:36.979945 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 482/969] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 17:34:36 2022] PUT /compute/v2.1/os-quota-sets/727752ba808041b1adbdd9c084f03942 => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:37.021997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e87e1ff3-3e4e-4418-8764-66d42678a8fc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:37.023190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e87e1ff3-3e4e-4418-8764-66d42678a8fc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:37.031853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e87e1ff3-3e4e-4418-8764-66d42678a8fc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:37.032651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e87e1ff3-3e4e-4418-8764-66d42678a8fc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:37.033252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e87e1ff3-3e4e-4418-8764-66d42678a8fc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:37.034142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e87e1ff3-3e4e-4418-8764-66d42678a8fc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:37.034800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e87e1ff3-3e4e-4418-8764-66d42678a8fc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:37.035370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e87e1ff3-3e4e-4418-8764-66d42678a8fc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:37.139088 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a778b88d-8c80-4a19-aaff-7c2a8c673cd0 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894/action" status: 202 len: 0 microversion: 2.25 time: 4.084002 Oct 05 17:34:37.151445 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 488/970] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:34:33 2022] POST /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894/action => generated 0 bytes in 4100 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:34:37.184418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f2d5d461-7724-4a73-b11c-fcacc8503c60 req-398a03da-029d-4108-bbe0-4523f2ccc5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bac05337-a984-4965-8063-1ab27852ea1f", "name": "network-vif-deleted", "tag": "1861731d-3108-4910-9e4d-39792f5b782d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:37.216218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f2d5d461-7724-4a73-b11c-fcacc8503c60 req-398a03da-029d-4108-bbe0-4523f2ccc5ff service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:37.221256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f2d5d461-7724-4a73-b11c-fcacc8503c60 req-398a03da-029d-4108-bbe0-4523f2ccc5ff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:37.224119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f2d5d461-7724-4a73-b11c-fcacc8503c60 req-398a03da-029d-4108-bbe0-4523f2ccc5ff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:37.250973 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f2d5d461-7724-4a73-b11c-fcacc8503c60 req-398a03da-029d-4108-bbe0-4523f2ccc5ff service nova] Creating event network-vif-deleted:1861731d-3108-4910-9e4d-39792f5b782d for instance bac05337-a984-4965-8063-1ab27852ea1f on n-h1-835595-3 Oct 05 17:34:37.265028 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f2d5d461-7724-4a73-b11c-fcacc8503c60 req-398a03da-029d-4108-bbe0-4523f2ccc5ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109463 Oct 05 17:34:37.268114 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 489/971] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:37.291829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:37.294714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:37.312979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:37.314928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:37.316744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:37.318502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:37.320275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:37.323125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:37.843745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:37.861743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:37.863486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:37.864993 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8b8b19fc-affc-428d-982c-a1809d5bbdb3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1567 microversion: 2.25 time: 0.594967 Oct 05 17:34:37.879414 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 490/972] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:37 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1567 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:37.889526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:37.891041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:37.897641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:37.898407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:37.899304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:37.900177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:37.902609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:37.903203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:37.967866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e87e1ff3-3e4e-4418-8764-66d42678a8fc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:37.997083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:37.997572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:37.998007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:37.998491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lazy-loading 'fault' on Instance uuid bac05337-a984-4965-8063-1ab27852ea1f {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:38.006796 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e87e1ff3-3e4e-4418-8764-66d42678a8fc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1378 microversion: 2.1 time: 0.989761 Oct 05 17:34:38.007341 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 483/973] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:37 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1378 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:38.017428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-179251180", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "9681e21a-0d48-466d-973b-d73679e29ebc"}], "security_groups": [{"name": "tempest-securitygroup--1282811996"}], "key_name": "tempest-keypair-1031472713", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:38.064205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:38.167340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3a1e26a77e4895a996fc9375e26550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adbb4e67ac704e69842024b3ae1a023d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:38.181718 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0e7f62eb-6060-463f-a682-456212163e0a tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 200 len: 1354 microversion: 2.1 time: 0.301066 Oct 05 17:34:38.182651 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 491/974] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:37 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 1354 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:38.193422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:38.195548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:38.211204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:38.212152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:38.214065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:38.214839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:38.215917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:38.218470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:38.363991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:38.380574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:38.382123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:38.393138 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-062c6f39-6787-455e-9fa3-19811f0923b1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.208734 Oct 05 17:34:38.394464 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 492/975] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:38 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:38.489066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] validate_networks() for [('9681e21a-0d48-466d-973b-d73679e29ebc', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:34:38.902585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:38.903216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:38.929948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:38.932095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:38.934236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:38.936125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:38.938498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:38.939347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:39.432072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:39.453320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:39.455098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:39.478697 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1d84bd9e-1e66-43ac-b094-b9637b395e27 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1567 microversion: 2.25 time: 0.587578 Oct 05 17:34:39.479329 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 493/976] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:38 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1567 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:39.511897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fbb76271-0cee-4fe8-a6ce-c4b04f9b65c4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:39.512598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fbb76271-0cee-4fe8-a6ce-c4b04f9b65c4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:39.525279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:39.527209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb76271-0cee-4fe8-a6ce-c4b04f9b65c4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:39.527888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb76271-0cee-4fe8-a6ce-c4b04f9b65c4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:39.528540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb76271-0cee-4fe8-a6ce-c4b04f9b65c4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:39.529432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb76271-0cee-4fe8-a6ce-c4b04f9b65c4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:39.530058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb76271-0cee-4fe8-a6ce-c4b04f9b65c4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:39.532017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb76271-0cee-4fe8-a6ce-c4b04f9b65c4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:40.118838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:34:40.119441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:34:40.119740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:34:40.120155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:34:40.120564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:34:40.137925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:40.138481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:40.138937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:40.139702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:40.140164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:40.140594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:40.186003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fbb76271-0cee-4fe8-a6ce-c4b04f9b65c4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:40.195631 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fbb76271-0cee-4fe8-a6ce-c4b04f9b65c4 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1378 microversion: 2.1 time: 0.709743 Oct 05 17:34:40.196241 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 494/977] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:39 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1378 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:40.211733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Getting quotas for project 1164570e81d8431f882d07b9fa9e8056. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:40.216954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Getting quotas for user e97eb363a60947e9b2d2d12494714aae and project 1164570e81d8431f882d07b9fa9e8056. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:40.226787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:40.227557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:40.244670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:40.245192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:40.245634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:40.246394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:40.246858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:40.247294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:40.257598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:34:40.260312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:34:40.276042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] HTTP exception thrown: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Request method failure captured: Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f HTTP/1.1 Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-SeLVGBz6zXD957_OLRTL55BVXnUZD6yfQQN7l6f27AY9NLzi5HAvpsOmCqSlASgvAcgnU3z2rHnJQ4SoKf8_SjRr2VYT-LJQtitivjTwpdfi1I7RGT92mEwXTBP8BM41LSGSqToZSjtsl_12HtxungiJhtCmfVYV2Mha-pzkge7k Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:40.277846 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_adbb4e67ac704e69842024b3ae1a023d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}] Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0a3a1e26a77e4895a996fc9375e26550 Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:40.279217 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'bac05337-a984-4965-8063-1ab27852ea1f'} Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:40.279986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:40.281383 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:40.282977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Returning 404 to user: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:40.291543 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b7c4d2de-bb07-4e27-ae1b-3791c8a5f6c6 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 404 len: 111 microversion: 2.1 time: 0.094138 Oct 05 17:34:40.292200 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 495/978] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:40 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:40.300826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:40.301449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:40.322063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:40.322591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:40.323232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:40.324147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:40.324794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:40.325518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:40.365964 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aad6c45b-6e46-44f9-a62f-d4f3a2aee222 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.357393 Oct 05 17:34:40.368107 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 484/979] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:34:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:34:40.650233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:40.680529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:40.701005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:40.716796 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02ad7c99-9ace-4f30-947f-9d96bf6fc2d9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.420022 Oct 05 17:34:40.717430 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 496/980] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:40 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:40.733325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:40.733834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:40.754558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:40.755465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:40.756240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:40.757219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:40.758244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:40.759263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:40.769359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:40.799799 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] HTTP exception thrown: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Request method failure captured: Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e HTTP/1.1 Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-SeLVGBz6zXD957_OLRTL55BVXnUZD6yfQQN7l6f27AY9NLzi5HAvpsOmCqSlASgvAcgnU3z2rHnJQ4SoKf8_SjRr2VYT-LJQtitivjTwpdfi1I7RGT92mEwXTBP8BM41LSGSqToZSjtsl_12HtxungiJhtCmfVYV2Mha-pzkge7k Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:40.808612 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_adbb4e67ac704e69842024b3ae1a023d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}] Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0a3a1e26a77e4895a996fc9375e26550 Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:40.810524 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '50deba5b-8150-4d35-9fea-79d5acdbf33e'} Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:40.811476 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:40.814126 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:40.817866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Returning 404 to user: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:40.826455 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ea02d7d7-1ce3-4a11-8a4e-75772b373d46 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "DELETE /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 404 len: 111 microversion: 2.1 time: 0.102976 Oct 05 17:34:40.829426 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 497/981] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:34:40 2022] DELETE /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:40.842726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eab914cc-6ff8-4d21-b493-abe7f33daac0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:40.846481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eab914cc-6ff8-4d21-b493-abe7f33daac0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:40.891891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1516210364", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "ea241c31-49cc-49d5-85d6-e6b48dbd2dff"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:41.013512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] validate_networks() for [('ea241c31-49cc-49d5-85d6-e6b48dbd2dff', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:34:41.040250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eab914cc-6ff8-4d21-b493-abe7f33daac0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:41.061833 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eab914cc-6ff8-4d21-b493-abe7f33daac0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1241 microversion: 2.1 time: 0.231116 Oct 05 17:34:41.062787 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 498/982] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:40 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1241 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:41.081895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:41.082607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:41.091696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:41.092215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:41.092717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:41.093444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:41.093900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:41.101599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:41.526669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:41.537250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:41.542615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:41.544088 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c330a2cf-26a0-4263-9648-dadecf9c971d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1567 microversion: 2.25 time: 0.479726 Oct 05 17:34:41.547563 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 499/983] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:41 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1567 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:41.554780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:41.557362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:41.573805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:41.574613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:41.582400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:41.583436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:41.584159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:41.584798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:41.614708 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] HTTP exception thrown: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Request method failure captured: Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e HTTP/1.1 Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-SeLVGBz6zXD957_OLRTL55BVXnUZD6yfQQN7l6f27AY9NLzi5HAvpsOmCqSlASgvAcgnU3z2rHnJQ4SoKf8_SjRr2VYT-LJQtitivjTwpdfi1I7RGT92mEwXTBP8BM41LSGSqToZSjtsl_12HtxungiJhtCmfVYV2Mha-pzkge7k Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:41.616680 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_adbb4e67ac704e69842024b3ae1a023d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}] Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0a3a1e26a77e4895a996fc9375e26550 Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:41.617977 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '50deba5b-8150-4d35-9fea-79d5acdbf33e'} Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:41.618725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:41.619900 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:41.624188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Returning 404 to user: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:41.633100 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d83488fa-1064-4222-b3ae-ee15c4bbc8cc tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 404 len: 111 microversion: 2.1 time: 0.084062 Oct 05 17:34:41.633697 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 500/984] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:41 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:41.642311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b97c3d11-03db-4cec-9ca2-9d0d31eb2958 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:41.642945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b97c3d11-03db-4cec-9ca2-9d0d31eb2958 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:41.649566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b97c3d11-03db-4cec-9ca2-9d0d31eb2958 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:41.650066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b97c3d11-03db-4cec-9ca2-9d0d31eb2958 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:41.650531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b97c3d11-03db-4cec-9ca2-9d0d31eb2958 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:41.651332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b97c3d11-03db-4cec-9ca2-9d0d31eb2958 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:41.652400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b97c3d11-03db-4cec-9ca2-9d0d31eb2958 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:41.653039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b97c3d11-03db-4cec-9ca2-9d0d31eb2958 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:42.243843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b97c3d11-03db-4cec-9ca2-9d0d31eb2958 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:42.263093 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b97c3d11-03db-4cec-9ca2-9d0d31eb2958 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1378 microversion: 2.1 time: 0.623096 Oct 05 17:34:42.266404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 501/985] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:41 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1378 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:42.279613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f0acdd31-9e93-463e-a3cc-975358f56547 req-8e7cc6d2-8c1c-4ca4-9c75-ec62bcb008f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc39da4-3415-41c0-9552-de49d599f894", "name": "network-vif-unplugged", "status": "completed", "tag": "4c8c6427-bd57-44ed-aa04-e2b51f49ce09"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:42.329050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f0acdd31-9e93-463e-a3cc-975358f56547 req-8e7cc6d2-8c1c-4ca4-9c75-ec62bcb008f9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:42.332245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f0acdd31-9e93-463e-a3cc-975358f56547 req-8e7cc6d2-8c1c-4ca4-9c75-ec62bcb008f9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:42.332988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f0acdd31-9e93-463e-a3cc-975358f56547 req-8e7cc6d2-8c1c-4ca4-9c75-ec62bcb008f9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:42.380757 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f0acdd31-9e93-463e-a3cc-975358f56547 req-8e7cc6d2-8c1c-4ca4-9c75-ec62bcb008f9 service nova] Creating event network-vif-unplugged:4c8c6427-bd57-44ed-aa04-e2b51f49ce09 for instance ebc39da4-3415-41c0-9552-de49d599f894 on n-h2-835595-3 Oct 05 17:34:42.392549 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f0acdd31-9e93-463e-a3cc-975358f56547 req-8e7cc6d2-8c1c-4ca4-9c75-ec62bcb008f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124321 Oct 05 17:34:42.394707 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 502/986] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:42.408723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1f8d2e91-658e-441b-a197-ddc4fdc94c6b tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '.version_select at 0x7f77753174c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:42.423566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=16 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:42.451805 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1f8d2e91-658e-441b-a197-ddc4fdc94c6b tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119713767" status: 202 len: 0 microversion: 2.1 time: 0.053900 Oct 05 17:34:42.452463 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 503/987] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 17:34:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119713767 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:34:42.463616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:42.464837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:42.481660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:42.482407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:42.484818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:42.486987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:42.489411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:42.490061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:42.671860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:42.687464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:42.689015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:42.720766 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d324db6a-1ddd-48f4-b354-48a357721c2d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.266935 Oct 05 17:34:42.721469 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 504/988] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:42 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:42.727098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-1b252e33-f9c6-4a11-ae5a-f50b0d037b6f req-c6ae5e20-5af3-4f88-9619-6d27f0d5da2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3793214f-3607-4041-8f62-fd2b36f1b171", "name": "network-vif-plugged", "status": "completed", "tag": "8fd18242-e1fd-42af-9db6-62c95ec947e4"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:42.762561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1b252e33-f9c6-4a11-ae5a-f50b0d037b6f req-c6ae5e20-5af3-4f88-9619-6d27f0d5da2a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:42.763238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1b252e33-f9c6-4a11-ae5a-f50b0d037b6f req-c6ae5e20-5af3-4f88-9619-6d27f0d5da2a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:42.764132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1b252e33-f9c6-4a11-ae5a-f50b0d037b6f req-c6ae5e20-5af3-4f88-9619-6d27f0d5da2a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:42.789008 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-1b252e33-f9c6-4a11-ae5a-f50b0d037b6f req-c6ae5e20-5af3-4f88-9619-6d27f0d5da2a service nova] Creating event network-vif-plugged:8fd18242-e1fd-42af-9db6-62c95ec947e4 for instance 3793214f-3607-4041-8f62-fd2b36f1b171 on n-h1-835595-3 Oct 05 17:34:42.807192 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-1b252e33-f9c6-4a11-ae5a-f50b0d037b6f req-c6ae5e20-5af3-4f88-9619-6d27f0d5da2a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080628 Oct 05 17:34:42.808260 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 505/989] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:42.824491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d37e243e-83ee-4f41-bf14-4ac6e3448334 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:42.825230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d37e243e-83ee-4f41-bf14-4ac6e3448334 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:42.838543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d37e243e-83ee-4f41-bf14-4ac6e3448334 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:42.841349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d37e243e-83ee-4f41-bf14-4ac6e3448334 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:42.841819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d37e243e-83ee-4f41-bf14-4ac6e3448334 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:42.862912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d37e243e-83ee-4f41-bf14-4ac6e3448334 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:42.863502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d37e243e-83ee-4f41-bf14-4ac6e3448334 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:42.863960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d37e243e-83ee-4f41-bf14-4ac6e3448334 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:42.990706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:34:42.991212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:34:42.991620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:34:42.992085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:34:42.992534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:34:43.011156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:43.011676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:43.014992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:43.016069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:43.016683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:43.017113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:43.069122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d37e243e-83ee-4f41-bf14-4ac6e3448334 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:43.078500 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d37e243e-83ee-4f41-bf14-4ac6e3448334 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1299 microversion: 2.1 time: 0.268717 Oct 05 17:34:43.090717 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 506/990] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:42 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:43.096135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:43.096743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:43.097266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Getting quotas for project 065544965253483e8e506c98a39646ce. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:43.106267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Getting quotas for user 37ac9633604b4bea8e346140bd7915ca and project 065544965253483e8e506c98a39646ce. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:43.118953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:43.124865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:43.125373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:43.126349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:43.127987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:43.128666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:43.191000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:34:43.199826 n-d-835595-3 devstack@n-api.service[128843]: WARNING nova.utils [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1516210364 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-151621036 Oct 05 17:34:43.205456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:34:43.317345 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a299fe4-dfd9-4e89-8c9b-aab396835981 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.946883 Oct 05 17:34:43.319235 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 485/991] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:34:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:34:43.330224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2b97ea8b-f45c-4752-b110-de8b5394e722 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:43.331046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2b97ea8b-f45c-4752-b110-de8b5394e722 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:43.339054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b97ea8b-f45c-4752-b110-de8b5394e722 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:43.339734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b97ea8b-f45c-4752-b110-de8b5394e722 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:43.340351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b97ea8b-f45c-4752-b110-de8b5394e722 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:43.341231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b97ea8b-f45c-4752-b110-de8b5394e722 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:43.342617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b97ea8b-f45c-4752-b110-de8b5394e722 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:43.343207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b97ea8b-f45c-4752-b110-de8b5394e722 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:43.810329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:43.822136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:43.824366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:43.825655 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ba62739a-bca9-4220-a252-7a0a64fd1e5c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1567 microversion: 2.25 time: 0.733817 Oct 05 17:34:43.827156 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 507/992] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:43 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1567 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:43.834225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3471d3e7-9c6f-4bc6-9aae-a2e24a1d3bbf tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:43.835075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3471d3e7-9c6f-4bc6-9aae-a2e24a1d3bbf tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:43.976412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3471d3e7-9c6f-4bc6-9aae-a2e24a1d3bbf tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:43.984405 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3471d3e7-9c6f-4bc6-9aae-a2e24a1d3bbf tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1232 microversion: 2.1 time: 0.155430 Oct 05 17:34:43.988315 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 508/993] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:43 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1232 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:43.993523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:44.020426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:44.030983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:44.031728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:44.032717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:44.033626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:44.034374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:44.035213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:44.178189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:44.193010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:44.197549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:44.204284 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6cea7881-04fa-405d-8c87-653b6d51e6e1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1558 microversion: 2.91 time: 0.214299 Oct 05 17:34:44.204879 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 509/994] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:43 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:44.210384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-93a20189-52ba-4649-9691-afe604a319e0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:44.210999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-93a20189-52ba-4649-9691-afe604a319e0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:44.218187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a20189-52ba-4649-9691-afe604a319e0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:44.218712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a20189-52ba-4649-9691-afe604a319e0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:44.219365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a20189-52ba-4649-9691-afe604a319e0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:44.220026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a20189-52ba-4649-9691-afe604a319e0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:44.220484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a20189-52ba-4649-9691-afe604a319e0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:44.220912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a20189-52ba-4649-9691-afe604a319e0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:44.249326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b97ea8b-f45c-4752-b110-de8b5394e722 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:44.275377 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2b97ea8b-f45c-4752-b110-de8b5394e722 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1378 microversion: 2.1 time: 0.952175 Oct 05 17:34:44.289418 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 486/995] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:43 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1378 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:44.334954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-93a20189-52ba-4649-9691-afe604a319e0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:44.348438 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-93a20189-52ba-4649-9691-afe604a319e0 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1299 microversion: 2.1 time: 0.142337 Oct 05 17:34:44.351697 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 510/996] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:44 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:44.486074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f8dbda1b-f741-4ab7-8b81-cdd093cf96ef req-6558603e-c24e-43e4-a258-2a3b032b9478 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebc39da4-3415-41c0-9552-de49d599f894", "tag": "4c8c6427-bd57-44ed-aa04-e2b51f49ce09"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:44.513639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f8dbda1b-f741-4ab7-8b81-cdd093cf96ef req-6558603e-c24e-43e4-a258-2a3b032b9478 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:44.516626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f8dbda1b-f741-4ab7-8b81-cdd093cf96ef req-6558603e-c24e-43e4-a258-2a3b032b9478 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:44.519498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f8dbda1b-f741-4ab7-8b81-cdd093cf96ef req-6558603e-c24e-43e4-a258-2a3b032b9478 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:44.561196 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f8dbda1b-f741-4ab7-8b81-cdd093cf96ef req-6558603e-c24e-43e4-a258-2a3b032b9478 service nova] Creating event network-changed:4c8c6427-bd57-44ed-aa04-e2b51f49ce09 for instance ebc39da4-3415-41c0-9552-de49d599f894 on n-h2-835595-3 Oct 05 17:34:44.585557 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f8dbda1b-f741-4ab7-8b81-cdd093cf96ef req-6558603e-c24e-43e4-a258-2a3b032b9478 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112682 Oct 05 17:34:44.591685 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 511/997] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:44.622390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2134172572", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:44.659400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9d02504-a1ad-435f-b94e-b0269204a21f tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:44.684079 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b9d02504-a1ad-435f-b94e-b0269204a21f tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1284091807" status: 202 len: 0 microversion: 2.1 time: 0.035408 Oct 05 17:34:44.687021 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 512/998] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:34:44 2022] DELETE /compute/v2.1/flavors/1284091807 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:34:44.697417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e2c88e26-f666-4209-8d67-4bc085ead10b tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:44.723223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:34:44.737087 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e2c88e26-f666-4209-8d67-4bc085ead10b tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5893 microversion: 2.1 time: 0.045130 Oct 05 17:34:44.738423 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 513/999] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:34:44 2022] GET /compute/v2.1/flavors/detail => generated 5893 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:44.758651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0fabf759-cff8-4fe2-81b7-78421db6a28b tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:44.779601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0fabf759-cff8-4fe2-81b7-78421db6a28b tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1553919301" status: 202 len: 0 microversion: 2.1 time: 0.024856 Oct 05 17:34:44.783972 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 514/1000] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:34:44 2022] DELETE /compute/v2.1/flavors/1553919301 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:34:44.789189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab67fab0-26b9-49b6-a7fc-5f85ef3a3602 tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:44.810866 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab67fab0-26b9-49b6-a7fc-5f85ef3a3602 tempest-ServersWithSpecificFlavorTestJSON-1824968379 tempest-ServersWithSpecificFlavorTestJSON-1824968379-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 5479 microversion: 2.1 time: 0.025351 Oct 05 17:34:44.825735 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 515/1001] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:34:44 2022] GET /compute/v2.1/flavors/detail => generated 5479 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:44.849229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:44.850758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:44.865051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:44.866750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:44.870733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:44.874591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:44.879204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:44.879905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:44.902825 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] HTTP exception thrown: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Request method failure captured: Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f HTTP/1.1 Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-SeLVGBz6zXD957_OLRTL55BVXnUZD6yfQQN7l6f27AY9NLzi5HAvpsOmCqSlASgvAcgnU3z2rHnJQ4SoKf8_SjRr2VYT-LJQtitivjTwpdfi1I7RGT92mEwXTBP8BM41LSGSqToZSjtsl_12HtxungiJhtCmfVYV2Mha-pzkge7k Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:44.915017 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_adbb4e67ac704e69842024b3ae1a023d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}] Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0a3a1e26a77e4895a996fc9375e26550 Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:44.916608 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'bac05337-a984-4965-8063-1ab27852ea1f'} Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:44.917478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:44.918968 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:44.920388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Returning 404 to user: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:44.920678 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-405fe467-4cd6-4b72-848f-56990562f0df tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 404 len: 111 microversion: 2.1 time: 0.083401 Oct 05 17:34:44.926059 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 516/1002] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:34:44 2022] DELETE /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:44.933931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:44.937818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:44.952844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:44.953353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:44.953846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:44.954607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:44.955065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:44.955487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.170069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:45.186914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:45.188505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:45.189763 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-69148b0d-4689-4c09-993f-ca336d248c48 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1567 microversion: 2.25 time: 0.265620 Oct 05 17:34:45.202846 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 517/1003] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:44 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:45.213567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:45.214304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: bac05337-a984-4965-8063-1ab27852ea1f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:45.220815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.221494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.221987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.222771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.223452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.224053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.246740 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] HTTP exception thrown: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:45.248863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:34:45.249465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Request method failure captured: Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f HTTP/1.1 Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-SeLVGBz6zXD957_OLRTL55BVXnUZD6yfQQN7l6f27AY9NLzi5HAvpsOmCqSlASgvAcgnU3z2rHnJQ4SoKf8_SjRr2VYT-LJQtitivjTwpdfi1I7RGT92mEwXTBP8BM41LSGSqToZSjtsl_12HtxungiJhtCmfVYV2Mha-pzkge7k Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:45.250038 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_adbb4e67ac704e69842024b3ae1a023d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}] Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0a3a1e26a77e4895a996fc9375e26550 Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:45.251659 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'bac05337-a984-4965-8063-1ab27852ea1f'} Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:45.252518 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. Oct 05 17:34:45.253834 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.255243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Returning 404 to user: Instance bac05337-a984-4965-8063-1ab27852ea1f could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:45.255920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:34:45.256479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:34:45.256985 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-639b2972-b691-4900-b77f-e0ae1ec2cdce tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f" status: 404 len: 111 microversion: 2.1 time: 0.052932 Oct 05 17:34:45.257216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:34:45.257764 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 518/1004] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:45 2022] GET /compute/v2.1/servers/bac05337-a984-4965-8063-1ab27852ea1f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:45.263938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7160affe-fd26-4750-bb2a-6095de7f65c3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:45.264775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7160affe-fd26-4750-bb2a-6095de7f65c3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:45.267293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.267965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.268571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.269468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.269922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.270593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.274380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7160affe-fd26-4750-bb2a-6095de7f65c3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.275179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7160affe-fd26-4750-bb2a-6095de7f65c3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.276640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7160affe-fd26-4750-bb2a-6095de7f65c3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.277842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7160affe-fd26-4750-bb2a-6095de7f65c3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.278441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7160affe-fd26-4750-bb2a-6095de7f65c3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.279015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7160affe-fd26-4750-bb2a-6095de7f65c3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.291972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Getting quotas for project 1c79b829a6194b7fbfe07a1c77cd2464. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:45.296094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Getting quotas for user 0683f65832f146b0bb85a984370186be and project 1c79b829a6194b7fbfe07a1c77cd2464. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:45.308558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:34:45.311421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:34:45.363066 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f2d23fb-185f-4997-8a07-0f76ec9543f7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008848 Oct 05 17:34:45.364399 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 487/1005] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:34:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:34:45.369813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:45.370664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:45.395277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.395846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.396410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.397119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.397568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.397982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.580429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7160affe-fd26-4750-bb2a-6095de7f65c3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:45.592479 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7160affe-fd26-4750-bb2a-6095de7f65c3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1284 microversion: 2.1 time: 0.333514 Oct 05 17:34:45.611760 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 519/1006] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:45 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1284 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:45.651356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:45.671396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:45.673073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:45.710067 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6d2c7edd-7ebe-46d4-9f93-0c630bc3da43 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1558 microversion: 2.91 time: 0.344132 Oct 05 17:34:45.710682 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 488/1007] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:45 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1558 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:45.740309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:45.740841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:45.766683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.768335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.768787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.771022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.771494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.771927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.791793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-01b87b62-37d4-4673-a38c-ded75e66163f tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Calling method '.version_select at 0x7f777533b0d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:45.812942 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] HTTP exception thrown: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Request method failure captured: Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e HTTP/1.1 Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-SeLVGBz6zXD957_OLRTL55BVXnUZD6yfQQN7l6f27AY9NLzi5HAvpsOmCqSlASgvAcgnU3z2rHnJQ4SoKf8_SjRr2VYT-LJQtitivjTwpdfi1I7RGT92mEwXTBP8BM41LSGSqToZSjtsl_12HtxungiJhtCmfVYV2Mha-pzkge7k Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:45.814810 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_adbb4e67ac704e69842024b3ae1a023d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}] Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0a3a1e26a77e4895a996fc9375e26550 Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:45.816204 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '50deba5b-8150-4d35-9fea-79d5acdbf33e'} Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:45.816988 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:45.818183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.822238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Returning 404 to user: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:45.822238 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5c3b59d1-e9e8-4fc1-8e15-f071abf0a825 tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "DELETE /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 404 len: 111 microversion: 2.1 time: 0.093645 Oct 05 17:34:45.822238 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 489/1008] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:34:45 2022] DELETE /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:45.846364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-18076279-cb6f-4061-859b-46071c1ca75b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:45.849567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-18076279-cb6f-4061-859b-46071c1ca75b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:45.869791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18076279-cb6f-4061-859b-46071c1ca75b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.870718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18076279-cb6f-4061-859b-46071c1ca75b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.871376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18076279-cb6f-4061-859b-46071c1ca75b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.872742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18076279-cb6f-4061-859b-46071c1ca75b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:45.872742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18076279-cb6f-4061-859b-46071c1ca75b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:45.873134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18076279-cb6f-4061-859b-46071c1ca75b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:45.946038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG neutronclient.v2_0.client [None req-01b87b62-37d4-4673-a38c-ded75e66163f tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group edb923a3-120d-42a8-8a0e-cf47f5ed8217 does not exist", "detail": ""}} {{(pid=128844) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:34:45.947278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.security_group_api [None req-01b87b62-37d4-4673-a38c-ded75e66163f tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Neutron security group edb923a3-120d-42a8-8a0e-cf47f5ed8217 not found {{(pid=128844) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:34:45.947968 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-01b87b62-37d4-4673-a38c-ded75e66163f tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] HTTP exception thrown: Security group edb923a3-120d-42a8-8a0e-cf47f5ed8217 does not exist Oct 05 17:34:45.947968 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-fe7b3bcc-ed7a-4142-9982-ecf07d169455'] Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-01b87b62-37d4-4673-a38c-ded75e66163f tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Request method failure captured: Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-security-groups/edb923a3-120d-42a8-8a0e-cf47f5ed8217 HTTP/1.1 Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcA1EEsjdNVIgXwvx8WVjdeiX2enCw722sPxUz-Isv2if-I_xxzhiAeC6fpDevRlPgJbobFnEXWAR87hirqfc8OLpP1DkvT0u5AmUiv0jFTsqjNSWlLTmIQ-PtVFmP_hjAvG21uHEAh-4WejUa830kzCIgUWk9JFSdogPC_Eop7ICec Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7fdbaa37b99f4a97989a28c2881dbfe1 Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:45.950077 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7fdbaa37b99f4a97989a28c2881dbfe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7fdbaa37b99f4a97989a28c2881dbfe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7fdbaa37b99f4a97989a28c2881dbfe1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7fdbaa37b99f4a97989a28c2881dbfe1"}]}] Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7fdbaa37b99f4a97989a28c2881dbfe1 Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsNegativeTestJSON-325320926-project Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: a37cc450edfc4e89ab8c8bed810516cf Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-325320926-project Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: exception: Security group edb923a3-120d-42a8-8a0e-cf47f5ed8217 does not exist Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-fe7b3bcc-ed7a-4142-9982-ecf07d169455'] Oct 05 17:34:45.951659 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'edb923a3-120d-42a8-8a0e-cf47f5ed8217'} Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:45.952614 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group edb923a3-120d-42a8-8a0e-cf47f5ed8217 does not exist Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe7b3bcc-ed7a-4142-9982-ecf07d169455'] Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:34:45.954014 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group edb923a3-120d-42a8-8a0e-cf47f5ed8217 does not exist Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe7b3bcc-ed7a-4142-9982-ecf07d169455'] Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group edb923a3-120d-42a8-8a0e-cf47f5ed8217 does not exist Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe7b3bcc-ed7a-4142-9982-ecf07d169455'] Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.955209 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:45.956479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:45.956479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:45.956479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:45.956479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:45.956479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group edb923a3-120d-42a8-8a0e-cf47f5ed8217 does not exist Oct 05 17:34:45.956479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe7b3bcc-ed7a-4142-9982-ecf07d169455'] Oct 05 17:34:45.956479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:45.958602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-01b87b62-37d4-4673-a38c-ded75e66163f tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Returning 404 to user: Security group edb923a3-120d-42a8-8a0e-cf47f5ed8217 does not exist Oct 05 17:34:45.958602 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-fe7b3bcc-ed7a-4142-9982-ecf07d169455'] {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:45.959635 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-01b87b62-37d4-4673-a38c-ded75e66163f tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/edb923a3-120d-42a8-8a0e-cf47f5ed8217" status: 404 len: 194 microversion: 2.1 time: 0.346543 Oct 05 17:34:45.960262 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 520/1009] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:45 2022] DELETE /compute/v2.1/os-security-groups/edb923a3-120d-42a8-8a0e-cf47f5ed8217 => generated 194 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:45.970835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c7aa1a13-3057-4d38-85a4-f4edda6ddf51 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:45.971492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c7aa1a13-3057-4d38-85a4-f4edda6ddf51 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:46.004370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7aa1a13-3057-4d38-85a4-f4edda6ddf51 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:46.005025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7aa1a13-3057-4d38-85a4-f4edda6ddf51 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:46.005577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7aa1a13-3057-4d38-85a4-f4edda6ddf51 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:46.006533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7aa1a13-3057-4d38-85a4-f4edda6ddf51 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:46.009908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7aa1a13-3057-4d38-85a4-f4edda6ddf51 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:46.010384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7aa1a13-3057-4d38-85a4-f4edda6ddf51 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:46.294937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-18076279-cb6f-4061-859b-46071c1ca75b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:46.305045 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-18076279-cb6f-4061-859b-46071c1ca75b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1527 microversion: 2.1 time: 0.487237 Oct 05 17:34:46.308174 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 490/1010] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:45 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1527 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:46.315523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1080618335", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:46.432579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:34:46.875228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:34:46.875980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:34:46.876319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:34:46.876721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:34:46.877310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:34:46.897659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:46.900763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:46.901400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:46.902346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:46.905305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:46.906070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:46.930880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c7aa1a13-3057-4d38-85a4-f4edda6ddf51 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:46.944082 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c7aa1a13-3057-4d38-85a4-f4edda6ddf51 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1367 microversion: 2.1 time: 0.982709 Oct 05 17:34:46.946081 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 521/1011] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:45 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1367 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:46.953637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Getting quotas for project 1c79b829a6194b7fbfe07a1c77cd2464. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:46.960085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:46.960925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] [instance: 50deba5b-8150-4d35-9fea-79d5acdbf33e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:46.967281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Getting quotas for user 0683f65832f146b0bb85a984370186be and project 1c79b829a6194b7fbfe07a1c77cd2464. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:46.974664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:46.977295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:46.978057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:46.979779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:46.980426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:46.983067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:46.984871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:34:46.987925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:34:47.029266 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] HTTP exception thrown: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Request method failure captured: Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e HTTP/1.1 Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-SeLVGBz6zXD957_OLRTL55BVXnUZD6yfQQN7l6f27AY9NLzi5HAvpsOmCqSlASgvAcgnU3z2rHnJQ4SoKf8_SjRr2VYT-LJQtitivjTwpdfi1I7RGT92mEwXTBP8BM41LSGSqToZSjtsl_12HtxungiJhtCmfVYV2Mha-pzkge7k Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:47.033077 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_adbb4e67ac704e69842024b3ae1a023d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/adbb4e67ac704e69842024b3ae1a023d"}]}] Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: adbb4e67ac704e69842024b3ae1a023d Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107 Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0a3a1e26a77e4895a996fc9375e26550 Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-901130107-project Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:47.034835 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '50deba5b-8150-4d35-9fea-79d5acdbf33e'} Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:47.036070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. Oct 05 17:34:47.037716 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:47.042442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] Returning 404 to user: Instance 50deba5b-8150-4d35-9fea-79d5acdbf33e could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:47.043500 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d3ad254-1254-42fa-b22b-0a14bb1e868c tempest-ServersWithSpecificFlavorTestJSON-901130107 tempest-ServersWithSpecificFlavorTestJSON-901130107-project] 10.222.0.70 "GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e" status: 404 len: 111 microversion: 2.1 time: 0.093404 Oct 05 17:34:47.048102 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 522/1012] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:46 2022] GET /compute/v2.1/servers/50deba5b-8150-4d35-9fea-79d5acdbf33e => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:47.064921 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-761e1682-adce-4318-addc-73a86e8542b7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751745 Oct 05 17:34:47.073303 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 491/1013] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:34:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:34:47.074595 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-abc0c4e4-4631-4672-8383-ae84ee134555 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.025121 Oct 05 17:34:47.076941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:47.078741 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 523/1014] 10.222.0.70 () {58 vars in 1164 bytes} [Wed Oct 5 17:34:47 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 17:34:47.083079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:47.088859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dfe5456b-ed8f-4aca-abc0-60c9ccce5f1f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:47.102117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dfe5456b-ed8f-4aca-abc0-60c9ccce5f1f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:47.113519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:47.114818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:47.115263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:47.116013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:47.116466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:47.116913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:47.129465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe5456b-ed8f-4aca-abc0-60c9ccce5f1f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:47.130311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe5456b-ed8f-4aca-abc0-60c9ccce5f1f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:47.131039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe5456b-ed8f-4aca-abc0-60c9ccce5f1f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:47.136957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe5456b-ed8f-4aca-abc0-60c9ccce5f1f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:47.137500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe5456b-ed8f-4aca-abc0-60c9ccce5f1f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:47.137938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe5456b-ed8f-4aca-abc0-60c9ccce5f1f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:47.644417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:47.667625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:47.673372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:47.687867 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fd182fb8-5618-4079-bb6c-e7e505fb0fdd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1567 microversion: 2.25 time: 0.611349 Oct 05 17:34:47.692253 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 492/1015] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:47 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1567 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:47.702126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a950e2f-e1b8-4e68-8167-c23dfda2aca9 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:47.704230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a950e2f-e1b8-4e68-8167-c23dfda2aca9 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:47.719506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a950e2f-e1b8-4e68-8167-c23dfda2aca9 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:47.721780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a950e2f-e1b8-4e68-8167-c23dfda2aca9 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:47.722697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a950e2f-e1b8-4e68-8167-c23dfda2aca9 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:47.725082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a950e2f-e1b8-4e68-8167-c23dfda2aca9 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:47.726269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a950e2f-e1b8-4e68-8167-c23dfda2aca9 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:47.727608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a950e2f-e1b8-4e68-8167-c23dfda2aca9 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:48.541091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a950e2f-e1b8-4e68-8167-c23dfda2aca9 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:48.549746 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a950e2f-e1b8-4e68-8167-c23dfda2aca9 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1290 microversion: 2.1 time: 0.856050 Oct 05 17:34:48.557490 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 493/1016] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:47 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1290 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:48.574662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:48.575580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:48.595699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:48.596507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:48.597129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:48.599001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:48.601143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:48.601783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:48.723779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dfe5456b-ed8f-4aca-abc0-60c9ccce5f1f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:48.734482 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dfe5456b-ed8f-4aca-abc0-60c9ccce5f1f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1527 microversion: 2.1 time: 1.654088 Oct 05 17:34:48.747082 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 524/1017] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:47 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1527 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:48.752579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3191f4d-b65b-474f-92e0-936456e8b18f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:48.753381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c3191f4d-b65b-474f-92e0-936456e8b18f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:48.766963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3191f4d-b65b-474f-92e0-936456e8b18f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:48.767476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3191f4d-b65b-474f-92e0-936456e8b18f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:48.767912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3191f4d-b65b-474f-92e0-936456e8b18f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:48.768761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3191f4d-b65b-474f-92e0-936456e8b18f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:48.769220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3191f4d-b65b-474f-92e0-936456e8b18f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:48.769713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3191f4d-b65b-474f-92e0-936456e8b18f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:48.957655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:48.972188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:48.978443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:48.991576 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-65de23e3-b92c-4d94-8989-8d762c97a9ce tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.432707 Oct 05 17:34:48.992444 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 494/1018] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:48 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:49.007252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8bb25586-70ee-427f-9518-5f31604b4293 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Calling method '.version_select at 0x7f7775fc6430>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:49.103911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c3191f4d-b65b-474f-92e0-936456e8b18f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:49.119652 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3191f4d-b65b-474f-92e0-936456e8b18f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1266 microversion: 2.1 time: 0.370902 Oct 05 17:34:49.125946 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 525/1019] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:48 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1266 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:49.151815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1772617f-f009-4bc8-81fb-e8fb89031a27 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:49.156322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1772617f-f009-4bc8-81fb-e8fb89031a27 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:49.171147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1772617f-f009-4bc8-81fb-e8fb89031a27 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:49.172004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1772617f-f009-4bc8-81fb-e8fb89031a27 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:49.172733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1772617f-f009-4bc8-81fb-e8fb89031a27 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:49.173698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1772617f-f009-4bc8-81fb-e8fb89031a27 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:49.174447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1772617f-f009-4bc8-81fb-e8fb89031a27 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:49.175073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1772617f-f009-4bc8-81fb-e8fb89031a27 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:50.198562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1772617f-f009-4bc8-81fb-e8fb89031a27 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:50.219597 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1772617f-f009-4bc8-81fb-e8fb89031a27 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1367 microversion: 2.1 time: 1.078496 Oct 05 17:34:50.220568 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 526/1020] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:49 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1367 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:50.242248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-edafc7b2-b1fd-4bbc-82fb-3521ad62f26c req-907894e6-b105-4e4f-8de6-2301646ba98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df1c2e18-968f-4926-a47b-8e73ea54b4fa", "tag": "d8268a63-1db3-4a60-8640-16a2a12e466b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:50.255503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-edafc7b2-b1fd-4bbc-82fb-3521ad62f26c req-907894e6-b105-4e4f-8de6-2301646ba98d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:50.256269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-edafc7b2-b1fd-4bbc-82fb-3521ad62f26c req-907894e6-b105-4e4f-8de6-2301646ba98d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:50.256857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-edafc7b2-b1fd-4bbc-82fb-3521ad62f26c req-907894e6-b105-4e4f-8de6-2301646ba98d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:50.280867 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-edafc7b2-b1fd-4bbc-82fb-3521ad62f26c req-907894e6-b105-4e4f-8de6-2301646ba98d service nova] Creating event network-changed:d8268a63-1db3-4a60-8640-16a2a12e466b for instance df1c2e18-968f-4926-a47b-8e73ea54b4fa on n-h2-835595-3 Oct 05 17:34:50.287095 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-edafc7b2-b1fd-4bbc-82fb-3521ad62f26c req-907894e6-b105-4e4f-8de6-2301646ba98d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054636 Oct 05 17:34:50.288299 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 527/1021] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:50.295618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:50.296597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:50.319842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:50.320596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:50.321221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:50.322092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:50.322804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:50.323391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:51.025301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:51.029616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:51.039411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:51.040863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:51.041859 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8bb25586-70ee-427f-9518-5f31604b4293 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.048127 Oct 05 17:34:51.051561 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 495/1022] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:34:48 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:51.056586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-39a50ee0-343a-4137-a810-db9ee54968a5 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:51.057340 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d53eba4-7bd8-477d-9128-2204cb17932c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1567 microversion: 2.25 time: 0.767637 Oct 05 17:34:51.058940 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 528/1023] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:50 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1567 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:51.064988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6c6c144-bbd9-4538-8bd7-7f0c984e96ff tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:51.085684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c6c6c144-bbd9-4538-8bd7-7f0c984e96ff tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:51.095729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c6c144-bbd9-4538-8bd7-7f0c984e96ff tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:51.103846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c6c144-bbd9-4538-8bd7-7f0c984e96ff tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:51.104565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c6c144-bbd9-4538-8bd7-7f0c984e96ff tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:51.105524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c6c144-bbd9-4538-8bd7-7f0c984e96ff tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:51.106766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c6c144-bbd9-4538-8bd7-7f0c984e96ff tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:51.109330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c6c144-bbd9-4538-8bd7-7f0c984e96ff tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:51.115389 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-39a50ee0-343a-4137-a810-db9ee54968a5 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/6403527e-38a9-40d5-82c1-5ca19de08c4b" status: 202 len: 0 microversion: 2.1 time: 0.061727 Oct 05 17:34:51.116768 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 496/1024] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:34:51 2022] DELETE /compute/v2.1/flavors/6403527e-38a9-40d5-82c1-5ca19de08c4b => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:34:51.123327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:51.124278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:51.136748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:51.138029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:51.140109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:51.142545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:51.144352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:51.145940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:51.187690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:51.327085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:51.337054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:51.338565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:51.375451 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1aa90706-b572-4639-8ea2-5b88b6c3d018 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.257322 Oct 05 17:34:51.400327 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 497/1025] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:51 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:51.406362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5590d18f-95b4-4e6a-8e0d-6bdfa323a28c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:51.407431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5590d18f-95b4-4e6a-8e0d-6bdfa323a28c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:51.415915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5590d18f-95b4-4e6a-8e0d-6bdfa323a28c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:51.416667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5590d18f-95b4-4e6a-8e0d-6bdfa323a28c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:51.417288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5590d18f-95b4-4e6a-8e0d-6bdfa323a28c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:51.418170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5590d18f-95b4-4e6a-8e0d-6bdfa323a28c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:51.418824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5590d18f-95b4-4e6a-8e0d-6bdfa323a28c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:51.419407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5590d18f-95b4-4e6a-8e0d-6bdfa323a28c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:51.670352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5590d18f-95b4-4e6a-8e0d-6bdfa323a28c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:51.681507 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5590d18f-95b4-4e6a-8e0d-6bdfa323a28c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1272 microversion: 2.1 time: 0.279634 Oct 05 17:34:51.682409 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 498/1026] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:51 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1272 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:51.708318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23bba188-9267-4563-b47a-9e1cb6c96215 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Calling method '.version_select at 0x7f7775cb6b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:51.745525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c6c6c144-bbd9-4538-8bd7-7f0c984e96ff tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:51.759138 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c6c6c144-bbd9-4538-8bd7-7f0c984e96ff tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1332 microversion: 2.1 time: 0.696928 Oct 05 17:34:51.760025 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 529/1027] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:51 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1332 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:51.775525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac1908a5-3774-4b69-abc0-fc1b94aa3694 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:51.828260 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac1908a5-3774-4b69-abc0-fc1b94aa3694 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062969 Oct 05 17:34:51.829528 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 530/1028] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:34:51 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:51.845679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-67b4d926-1cbd-47d7-9ff6-4bb79651f68d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:51.846805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-67b4d926-1cbd-47d7-9ff6-4bb79651f68d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:51.866062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67b4d926-1cbd-47d7-9ff6-4bb79651f68d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:51.873003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67b4d926-1cbd-47d7-9ff6-4bb79651f68d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:51.878510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67b4d926-1cbd-47d7-9ff6-4bb79651f68d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:51.879909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67b4d926-1cbd-47d7-9ff6-4bb79651f68d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:51.880934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67b4d926-1cbd-47d7-9ff6-4bb79651f68d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:51.881613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67b4d926-1cbd-47d7-9ff6-4bb79651f68d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:52.208973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-67b4d926-1cbd-47d7-9ff6-4bb79651f68d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:52.223427 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-67b4d926-1cbd-47d7-9ff6-4bb79651f68d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1367 microversion: 2.1 time: 0.389865 Oct 05 17:34:52.224043 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 531/1029] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:51 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:52.229528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:52.241915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:52.256558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:52.259596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:52.261194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:52.265383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:52.266233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:52.266980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:52.334409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:52.341673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Old instance type tempest-test_resize_flavor_-221548510, new instance type m1.heat {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 17:34:52.360236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:34:52.361047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:34:52.361745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:34:52.362405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:34:52.363058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:34:52.419737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-23bba188-9267-4563-b47a-9e1cb6c96215 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:34:52.420610 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-23bba188-9267-4563-b47a-9e1cb6c96215 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 05 17:34:52.420610 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-d4ef6e06-b124-4575-b050-9047563ee301'] Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23bba188-9267-4563-b47a-9e1cb6c96215 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Request method failure captured: Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-security-groups/180053d5-abf6-4303-8229-436c7ed56566 HTTP/1.1 Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcA1EEsjdNVIgXwvx8WVjdeiX2enCw722sPxUz-Isv2if-I_xxzhiAeC6fpDevRlPgJbobFnEXWAR87hirqfc8OLpP1DkvT0u5AmUiv0jFTsqjNSWlLTmIQ-PtVFmP_hjAvG21uHEAh-4WejUa830kzCIgUWk9JFSdogPC_Eop7ICec Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7fdbaa37b99f4a97989a28c2881dbfe1 Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:34:52.423674 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7fdbaa37b99f4a97989a28c2881dbfe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7fdbaa37b99f4a97989a28c2881dbfe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7fdbaa37b99f4a97989a28c2881dbfe1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7fdbaa37b99f4a97989a28c2881dbfe1"}]}] Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7fdbaa37b99f4a97989a28c2881dbfe1 Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupsNegativeTestJSON-325320926-project Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: a37cc450edfc4e89ab8c8bed810516cf Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-325320926-project Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: exception: Insufficient rights for removing default security group. Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-d4ef6e06-b124-4575-b050-9047563ee301'] Oct 05 17:34:52.425383 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '180053d5-abf6-4303-8229-436c7ed56566'} Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:52.426433 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4ef6e06-b124-4575-b050-9047563ee301'] Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 05 17:34:52.427833 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4ef6e06-b124-4575-b050-9047563ee301'] Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4ef6e06-b124-4575-b050-9047563ee301'] Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:52.429439 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:52.432073 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:52.432073 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:52.432073 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:52.432073 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 05 17:34:52.432073 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4ef6e06-b124-4575-b050-9047563ee301'] Oct 05 17:34:52.432073 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.432073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23bba188-9267-4563-b47a-9e1cb6c96215 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 05 17:34:52.432073 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-d4ef6e06-b124-4575-b050-9047563ee301'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:52.433102 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23bba188-9267-4563-b47a-9e1cb6c96215 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/180053d5-abf6-4303-8229-436c7ed56566" status: 400 len: 182 microversion: 2.1 time: 0.728440 Oct 05 17:34:52.444213 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 499/1030] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:34:51 2022] DELETE /compute/v2.1/os-security-groups/180053d5-abf6-4303-8229-436c7ed56566 => generated 182 bytes in 741 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:34:52.457225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:52.462117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:52.483128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:52.486437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:52.486950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:52.487695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:52.488217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:52.488643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:52.530248 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-66da6a33-0af9-4fca-99b6-9991f4762b4d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171/action" status: 202 len: 0 microversion: 2.1 time: 0.299862 Oct 05 17:34:52.535240 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 532/1031] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:34:52 2022] POST /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:34:52.540290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:52.540906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:52.590892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=7 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:52.596738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:52.597605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:52.611069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:52.612265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:52.612977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:52.613654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:52.763454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:52.779794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:52.785665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:52.797392 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-59c08b12-117d-47fd-a99a-652bea836962 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.260899 Oct 05 17:34:52.798379 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 533/1032] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:52 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:52.806192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b78e02ff-bc13-4b07-a6cb-9827068acbf5 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Calling method '.version_select at 0x7f777522edc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:52.952443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG neutronclient.v2_0.client [None req-b78e02ff-bc13-4b07-a6cb-9827068acbf5 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 does not exist", "detail": ""}} {{(pid=128844) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:34:52.953045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.security_group_api [None req-b78e02ff-bc13-4b07-a6cb-9827068acbf5 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Neutron security group d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 not found {{(pid=128844) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:34:52.953847 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b78e02ff-bc13-4b07-a6cb-9827068acbf5 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] HTTP exception thrown: Security group d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 does not exist Oct 05 17:34:52.953847 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-b80e867f-d6e8-4ce4-9cc3-36e0ab360ced'] Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b78e02ff-bc13-4b07-a6cb-9827068acbf5 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Request method failure captured: Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-security-groups/d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 HTTP/1.1 Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcA1EEsjdNVIgXwvx8WVjdeiX2enCw722sPxUz-Isv2if-I_xxzhiAeC6fpDevRlPgJbobFnEXWAR87hirqfc8OLpP1DkvT0u5AmUiv0jFTsqjNSWlLTmIQ-PtVFmP_hjAvG21uHEAh-4WejUa830kzCIgUWk9JFSdogPC_Eop7ICec Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7fdbaa37b99f4a97989a28c2881dbfe1 Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:52.955842 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7fdbaa37b99f4a97989a28c2881dbfe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7fdbaa37b99f4a97989a28c2881dbfe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7fdbaa37b99f4a97989a28c2881dbfe1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7fdbaa37b99f4a97989a28c2881dbfe1"}]}] Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7fdbaa37b99f4a97989a28c2881dbfe1 Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsNegativeTestJSON-325320926-project Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: a37cc450edfc4e89ab8c8bed810516cf Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-325320926-project Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: exception: Security group d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 does not exist Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-b80e867f-d6e8-4ce4-9cc3-36e0ab360ced'] Oct 05 17:34:52.958569 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'd6b0c625-8fc2-41ed-b52b-0e0c8a1aae83'} Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:52.959424 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 does not exist Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80e867f-d6e8-4ce4-9cc3-36e0ab360ced'] Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:34:52.962755 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 does not exist Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80e867f-d6e8-4ce4-9cc3-36e0ab360ced'] Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 does not exist Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80e867f-d6e8-4ce4-9cc3-36e0ab360ced'] Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.966102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 does not exist Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b80e867f-d6e8-4ce4-9cc3-36e0ab360ced'] Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b78e02ff-bc13-4b07-a6cb-9827068acbf5 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Returning 404 to user: Security group d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 does not exist Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-b80e867f-d6e8-4ce4-9cc3-36e0ab360ced'] {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b78e02ff-bc13-4b07-a6cb-9827068acbf5 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83" status: 404 len: 194 microversion: 2.1 time: 0.158703 Oct 05 17:34:52.968935 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 534/1033] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:34:52 2022] GET /compute/v2.1/os-security-groups/d6b0c625-8fc2-41ed-b52b-0e0c8a1aae83 => generated 194 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:52.974859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-22ee71d0-2232-4c97-8495-81cbc4f9fc6c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:52.976190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-22ee71d0-2232-4c97-8495-81cbc4f9fc6c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:53.003838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22ee71d0-2232-4c97-8495-81cbc4f9fc6c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:53.004604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22ee71d0-2232-4c97-8495-81cbc4f9fc6c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:53.005948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22ee71d0-2232-4c97-8495-81cbc4f9fc6c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:53.006873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22ee71d0-2232-4c97-8495-81cbc4f9fc6c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:53.007489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22ee71d0-2232-4c97-8495-81cbc4f9fc6c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:53.008067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22ee71d0-2232-4c97-8495-81cbc4f9fc6c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:53.161438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:53.181295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:53.188941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:53.191228 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fed41ddb-6497-4bd7-b9c2-63eac220c6d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1567 microversion: 2.25 time: 0.745836 Oct 05 17:34:53.192199 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 500/1034] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:52 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1567 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:53.222099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-87d5d588-6a86-4607-bfc9-183582e5e1e5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:53.224486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-87d5d588-6a86-4607-bfc9-183582e5e1e5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:53.245335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87d5d588-6a86-4607-bfc9-183582e5e1e5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:53.247884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87d5d588-6a86-4607-bfc9-183582e5e1e5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:53.250672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87d5d588-6a86-4607-bfc9-183582e5e1e5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:53.251634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87d5d588-6a86-4607-bfc9-183582e5e1e5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:53.255306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87d5d588-6a86-4607-bfc9-183582e5e1e5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:53.256666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87d5d588-6a86-4607-bfc9-183582e5e1e5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:53.478148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-87d5d588-6a86-4607-bfc9-183582e5e1e5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:53.488376 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-87d5d588-6a86-4607-bfc9-183582e5e1e5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1272 microversion: 2.1 time: 0.293317 Oct 05 17:34:53.495407 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 501/1035] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:53 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1272 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:53.506209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-03c0ac74-2a48-4b69-9dcc-45eaab0a31a7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:53.507158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-03c0ac74-2a48-4b69-9dcc-45eaab0a31a7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:53.514460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=12,nova_api:DELETE=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:53.519312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03c0ac74-2a48-4b69-9dcc-45eaab0a31a7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:53.531077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03c0ac74-2a48-4b69-9dcc-45eaab0a31a7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:53.531883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03c0ac74-2a48-4b69-9dcc-45eaab0a31a7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:53.532947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03c0ac74-2a48-4b69-9dcc-45eaab0a31a7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:53.534193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03c0ac74-2a48-4b69-9dcc-45eaab0a31a7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:53.534845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03c0ac74-2a48-4b69-9dcc-45eaab0a31a7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:53.550686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-22ee71d0-2232-4c97-8495-81cbc4f9fc6c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:53.562318 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-22ee71d0-2232-4c97-8495-81cbc4f9fc6c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1536 microversion: 2.1 time: 0.596983 Oct 05 17:34:53.563172 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 535/1036] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:52 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1536 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:53.578594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ef8a7b64-9fe2-4deb-bf28-e68f151b4434 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Action: 'update', calling method: .version_select at 0x7f777522e700>, body: {"security_group": {"name": "tempest-sg-615755227", "description": "tempest-description-2030574210"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:53.795530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG neutronclient.v2_0.client [None req-ef8a7b64-9fe2-4deb-bf28-e68f151b4434 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fc86159a-8d51-4b50-ad8f-bdbc92f391a6 does not exist", "detail": ""}} {{(pid=128844) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:34:53.796978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.security_group_api [None req-ef8a7b64-9fe2-4deb-bf28-e68f151b4434 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Neutron security group fc86159a-8d51-4b50-ad8f-bdbc92f391a6 not found {{(pid=128844) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:34:53.797851 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ef8a7b64-9fe2-4deb-bf28-e68f151b4434 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] HTTP exception thrown: Security group fc86159a-8d51-4b50-ad8f-bdbc92f391a6 does not exist Oct 05 17:34:53.797851 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-e5a49e5b-77ca-4bd6-9238-798bb29c19ae'] Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ef8a7b64-9fe2-4deb-bf28-e68f151b4434 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Request method failure captured: Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/os-security-groups/fc86159a-8d51-4b50-ad8f-bdbc92f391a6 HTTP/1.1 Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 101 Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcA1EEsjdNVIgXwvx8WVjdeiX2enCw722sPxUz-Isv2if-I_xxzhiAeC6fpDevRlPgJbobFnEXWAR87hirqfc8OLpP1DkvT0u5AmUiv0jFTsqjNSWlLTmIQ-PtVFmP_hjAvG21uHEAh-4WejUa830kzCIgUWk9JFSdogPC_Eop7ICec Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7fdbaa37b99f4a97989a28c2881dbfe1 Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:34:53.800229 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7fdbaa37b99f4a97989a28c2881dbfe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7fdbaa37b99f4a97989a28c2881dbfe1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7fdbaa37b99f4a97989a28c2881dbfe1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7fdbaa37b99f4a97989a28c2881dbfe1"}]}] Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7fdbaa37b99f4a97989a28c2881dbfe1 Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-325320926 Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupsNegativeTestJSON-325320926-project Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: a37cc450edfc4e89ab8c8bed810516cf Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-325320926-project Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: {"security_group": {"name": "tempest-sg-615755227", "description": "tempest-description-2030574210"}} Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:34:53.802106 n-d-835595-3 devstack@n-api.service[128844]: exception: Security group fc86159a-8d51-4b50-ad8f-bdbc92f391a6 does not exist Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-e5a49e5b-77ca-4bd6-9238-798bb29c19ae'] Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'fc86159a-8d51-4b50-ad8f-bdbc92f391a6', 'body': {'security_group': {'name': 'tempest-sg-615755227', 'description': 'tempest-description-2030574210'}}} Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:34:53.803223 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fc86159a-8d51-4b50-ad8f-bdbc92f391a6 does not exist Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5a49e5b-77ca-4bd6-9238-798bb29c19ae'] Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:34:53.804530 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fc86159a-8d51-4b50-ad8f-bdbc92f391a6 does not exist Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5a49e5b-77ca-4bd6-9238-798bb29c19ae'] Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fc86159a-8d51-4b50-ad8f-bdbc92f391a6 does not exist Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5a49e5b-77ca-4bd6-9238-798bb29c19ae'] Oct 05 17:34:53.805920 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:53.807392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:34:53.807392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:53.807392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:34:53.807392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:34:53.807392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:34:53.807392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:34:53.807392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:34:53.807392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fc86159a-8d51-4b50-ad8f-bdbc92f391a6 does not exist Oct 05 17:34:53.807392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e5a49e5b-77ca-4bd6-9238-798bb29c19ae'] Oct 05 17:34:53.807392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:34:53.810433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ef8a7b64-9fe2-4deb-bf28-e68f151b4434 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] Returning 404 to user: Security group fc86159a-8d51-4b50-ad8f-bdbc92f391a6 does not exist Oct 05 17:34:53.810433 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-e5a49e5b-77ca-4bd6-9238-798bb29c19ae'] {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:34:53.811641 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ef8a7b64-9fe2-4deb-bf28-e68f151b4434 tempest-SecurityGroupsNegativeTestJSON-325320926 tempest-SecurityGroupsNegativeTestJSON-325320926-project] 10.222.0.70 "PUT /compute/v2.1/os-security-groups/fc86159a-8d51-4b50-ad8f-bdbc92f391a6" status: 404 len: 194 microversion: 2.1 time: 0.247352 Oct 05 17:34:53.818855 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 536/1037] 10.222.0.70 () {60 vars in 1290 bytes} [Wed Oct 5 17:34:53 2022] PUT /compute/v2.1/os-security-groups/fc86159a-8d51-4b50-ad8f-bdbc92f391a6 => generated 194 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:34:53.828319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-cae87f3a-9bcf-465c-908f-49badfe09bde req-5b1f0dd1-9516-409e-9535-f6204eea9199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0b701-73ce-4633-be8b-d2a78230b701", "tag": "26a9ba3f-e269-4580-b31d-95b12b0c1e21"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:53.856696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cae87f3a-9bcf-465c-908f-49badfe09bde req-5b1f0dd1-9516-409e-9535-f6204eea9199 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:53.857539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cae87f3a-9bcf-465c-908f-49badfe09bde req-5b1f0dd1-9516-409e-9535-f6204eea9199 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:53.858811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cae87f3a-9bcf-465c-908f-49badfe09bde req-5b1f0dd1-9516-409e-9535-f6204eea9199 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:53.876726 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-cae87f3a-9bcf-465c-908f-49badfe09bde req-5b1f0dd1-9516-409e-9535-f6204eea9199 service nova] Creating event network-changed:26a9ba3f-e269-4580-b31d-95b12b0c1e21 for instance 51c0b701-73ce-4633-be8b-d2a78230b701 on n-h2-835595-3 Oct 05 17:34:53.881828 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-cae87f3a-9bcf-465c-908f-49badfe09bde req-5b1f0dd1-9516-409e-9535-f6204eea9199 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061604 Oct 05 17:34:53.882983 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 537/1038] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:53.888599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6924e343-197d-4f02-b2d0-5ce849ba1889 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:53.890153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6924e343-197d-4f02-b2d0-5ce849ba1889 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:53.898146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6924e343-197d-4f02-b2d0-5ce849ba1889 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:53.898971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6924e343-197d-4f02-b2d0-5ce849ba1889 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:53.899569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6924e343-197d-4f02-b2d0-5ce849ba1889 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:53.900473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6924e343-197d-4f02-b2d0-5ce849ba1889 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:53.901095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6924e343-197d-4f02-b2d0-5ce849ba1889 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:53.901840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6924e343-197d-4f02-b2d0-5ce849ba1889 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:53.987043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=72 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:54.548035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-03c0ac74-2a48-4b69-9dcc-45eaab0a31a7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:54.559962 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-03c0ac74-2a48-4b69-9dcc-45eaab0a31a7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1332 microversion: 2.1 time: 1.063161 Oct 05 17:34:54.562492 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 502/1039] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:53 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1332 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:54.571289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:54.572178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:54.591851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:54.593649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:54.596258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:54.599089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:54.601173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:54.602662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:54.881488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:54.901150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:54.907376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:54.924515 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5707711c-7125-4b50-ba57-3a14f3c008ef tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.356726 Oct 05 17:34:54.948907 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 503/1040] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:54 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:54.963679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:54.964814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:54.979584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:54.981702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:54.982369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:54.986847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:54.987766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:54.988379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:55.220904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:55.230511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:55.231476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:55.232671 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-66293068-8339-4c8f-9432-7c9207c722cd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1542 microversion: 2.25 time: 0.288451 Oct 05 17:34:55.233601 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 504/1041] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:54 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1542 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:55.239054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-549e744a-18a6-4961-99fc-70a80f7797a9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:55.239925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-549e744a-18a6-4961-99fc-70a80f7797a9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:55.246308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549e744a-18a6-4961-99fc-70a80f7797a9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:55.247126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549e744a-18a6-4961-99fc-70a80f7797a9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:55.247721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549e744a-18a6-4961-99fc-70a80f7797a9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:55.248585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549e744a-18a6-4961-99fc-70a80f7797a9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:55.249297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549e744a-18a6-4961-99fc-70a80f7797a9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:55.249875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549e744a-18a6-4961-99fc-70a80f7797a9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:55.530769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6924e343-197d-4f02-b2d0-5ce849ba1889 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:55.547692 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6924e343-197d-4f02-b2d0-5ce849ba1889 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1367 microversion: 2.1 time: 1.663241 Oct 05 17:34:55.550433 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 538/1042] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:53 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1367 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:55.574049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-53e0a17d-3793-4989-9488-7fe33c9566cb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:55.574949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-53e0a17d-3793-4989-9488-7fe33c9566cb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:55.584453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53e0a17d-3793-4989-9488-7fe33c9566cb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:55.585250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53e0a17d-3793-4989-9488-7fe33c9566cb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:55.587014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53e0a17d-3793-4989-9488-7fe33c9566cb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:55.594572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53e0a17d-3793-4989-9488-7fe33c9566cb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:55.595440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53e0a17d-3793-4989-9488-7fe33c9566cb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:55.596056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53e0a17d-3793-4989-9488-7fe33c9566cb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:55.692096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-549e744a-18a6-4961-99fc-70a80f7797a9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:55.701487 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-549e744a-18a6-4961-99fc-70a80f7797a9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1314 microversion: 2.1 time: 0.466283 Oct 05 17:34:55.715447 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 505/1043] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:55 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:55.720780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7c436ece-0f26-40b3-bffc-7ae7dbd325e6 req-2f68b1a3-aeee-4ed6-82cb-dc61cd2bc4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6321627d-1957-42b5-a223-da558b58bbdf", "tag": "9752d52f-5ec4-412b-ae98-2e0cd46d439f"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:55.743776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7c436ece-0f26-40b3-bffc-7ae7dbd325e6 req-2f68b1a3-aeee-4ed6-82cb-dc61cd2bc4c3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:55.744510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7c436ece-0f26-40b3-bffc-7ae7dbd325e6 req-2f68b1a3-aeee-4ed6-82cb-dc61cd2bc4c3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:55.745121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7c436ece-0f26-40b3-bffc-7ae7dbd325e6 req-2f68b1a3-aeee-4ed6-82cb-dc61cd2bc4c3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:55.766331 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7c436ece-0f26-40b3-bffc-7ae7dbd325e6 req-2f68b1a3-aeee-4ed6-82cb-dc61cd2bc4c3 service nova] Creating event network-changed:9752d52f-5ec4-412b-ae98-2e0cd46d439f for instance 6321627d-1957-42b5-a223-da558b58bbdf on n-h1-835595-3 Oct 05 17:34:55.773676 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7c436ece-0f26-40b3-bffc-7ae7dbd325e6 req-2f68b1a3-aeee-4ed6-82cb-dc61cd2bc4c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056650 Oct 05 17:34:55.785265 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 506/1044] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:55.795348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a68b6b7-29da-4d73-b70a-c8e160827ab5 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '.version_select at 0x7f7775bc5ee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:55.809233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a68b6b7-29da-4d73-b70a-c8e160827ab5 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:55.810046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a68b6b7-29da-4d73-b70a-c8e160827ab5 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:55.810743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a68b6b7-29da-4d73-b70a-c8e160827ab5 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:55.835729 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0a68b6b7-29da-4d73-b70a-c8e160827ab5 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 2370 microversion: 2.25 time: 0.048608 Oct 05 17:34:55.836923 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 507/1045] 10.222.0.70 () {60 vars in 1184 bytes} [Wed Oct 5 17:34:55 2022] GET /compute/v2.1/os-migrations => generated 2370 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:55.844012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-68a333d7-71ec-46d0-9ea6-332f771d44d3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:55.853581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-68a333d7-71ec-46d0-9ea6-332f771d44d3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:55.870610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a333d7-71ec-46d0-9ea6-332f771d44d3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:55.871590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a333d7-71ec-46d0-9ea6-332f771d44d3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:55.872232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a333d7-71ec-46d0-9ea6-332f771d44d3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:55.873164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a333d7-71ec-46d0-9ea6-332f771d44d3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:55.873797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a333d7-71ec-46d0-9ea6-332f771d44d3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:55.874504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a333d7-71ec-46d0-9ea6-332f771d44d3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:55.946656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-53e0a17d-3793-4989-9488-7fe33c9566cb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:55.965655 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-53e0a17d-3793-4989-9488-7fe33c9566cb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1536 microversion: 2.1 time: 0.408375 Oct 05 17:34:55.967182 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 539/1046] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:55 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1536 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:55.973264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dcd1e888-8b18-4226-8300-fcffc7dfb548 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:55.974031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dcd1e888-8b18-4226-8300-fcffc7dfb548 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:55.981803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcd1e888-8b18-4226-8300-fcffc7dfb548 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:55.982454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcd1e888-8b18-4226-8300-fcffc7dfb548 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:55.983218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcd1e888-8b18-4226-8300-fcffc7dfb548 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:55.984363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcd1e888-8b18-4226-8300-fcffc7dfb548 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:55.985581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcd1e888-8b18-4226-8300-fcffc7dfb548 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:55.986393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcd1e888-8b18-4226-8300-fcffc7dfb548 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:56.284712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-68a333d7-71ec-46d0-9ea6-332f771d44d3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:56.307828 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-68a333d7-71ec-46d0-9ea6-332f771d44d3 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1332 microversion: 2.1 time: 0.469191 Oct 05 17:34:56.311763 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 508/1047] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:55 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1332 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:56.317973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:56.326984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:56.339992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:56.342371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:56.342951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:56.343797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:56.355013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:56.355634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:56.540913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:56.549326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:56.550790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:56.569408 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dd8ac858-aeac-48da-b04b-3ba6ef1818a5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.255332 Oct 05 17:34:56.582813 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 509/1048] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:56 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:56.596548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d1a5623c-d0b9-4fdc-8b89-83ee6c1041eb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:56.597232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d1a5623c-d0b9-4fdc-8b89-83ee6c1041eb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:56.603219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1a5623c-d0b9-4fdc-8b89-83ee6c1041eb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:56.603708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1a5623c-d0b9-4fdc-8b89-83ee6c1041eb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:56.604138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1a5623c-d0b9-4fdc-8b89-83ee6c1041eb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:56.604836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1a5623c-d0b9-4fdc-8b89-83ee6c1041eb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:56.605283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1a5623c-d0b9-4fdc-8b89-83ee6c1041eb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:56.605700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1a5623c-d0b9-4fdc-8b89-83ee6c1041eb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:56.745452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-dcd1e888-8b18-4226-8300-fcffc7dfb548 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid ebc39da4-3415-41c0-9552-de49d599f894 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:34:56.787248 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dcd1e888-8b18-4226-8300-fcffc7dfb548 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 2035 microversion: 2.25 time: 0.816222 Oct 05 17:34:56.788075 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 540/1049] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:55 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 2035 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:56.822534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5b534707-f8c4-4e8c-a858-02c9603bebab req-86ada574-547d-435a-ae17-051f70cbc8ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df1c2e18-968f-4926-a47b-8e73ea54b4fa", "name": "network-vif-plugged", "status": "completed", "tag": "d8268a63-1db3-4a60-8640-16a2a12e466b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:56.835205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5b534707-f8c4-4e8c-a858-02c9603bebab req-86ada574-547d-435a-ae17-051f70cbc8ec service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:56.836854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5b534707-f8c4-4e8c-a858-02c9603bebab req-86ada574-547d-435a-ae17-051f70cbc8ec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:56.837794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5b534707-f8c4-4e8c-a858-02c9603bebab req-86ada574-547d-435a-ae17-051f70cbc8ec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:56.852639 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5b534707-f8c4-4e8c-a858-02c9603bebab req-86ada574-547d-435a-ae17-051f70cbc8ec service nova] Creating event network-vif-plugged:d8268a63-1db3-4a60-8640-16a2a12e466b for instance df1c2e18-968f-4926-a47b-8e73ea54b4fa on n-h2-835595-3 Oct 05 17:34:56.858473 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5b534707-f8c4-4e8c-a858-02c9603bebab req-86ada574-547d-435a-ae17-051f70cbc8ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054167 Oct 05 17:34:56.860604 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 541/1050] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:34:56.867006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc05e851-aa30-40f1-894b-6cc70f28019f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:56.868079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc05e851-aa30-40f1-894b-6cc70f28019f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:56.878123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc05e851-aa30-40f1-894b-6cc70f28019f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:56.879021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc05e851-aa30-40f1-894b-6cc70f28019f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:56.880015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc05e851-aa30-40f1-894b-6cc70f28019f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:56.881187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc05e851-aa30-40f1-894b-6cc70f28019f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:56.881891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc05e851-aa30-40f1-894b-6cc70f28019f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:56.882601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc05e851-aa30-40f1-894b-6cc70f28019f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:56.930600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=14 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:56.980765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=44 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:34:57.130223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d1a5623c-d0b9-4fdc-8b89-83ee6c1041eb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:57.139359 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d1a5623c-d0b9-4fdc-8b89-83ee6c1041eb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1367 microversion: 2.1 time: 0.555358 Oct 05 17:34:57.142166 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 510/1051] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:56 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1367 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:57.158731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-119d8749-ccc0-4a18-8fe9-96a27a960113 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Action: 'create', calling method: .version_select at 0x7f7775c5d160>, body: {"keypair": {"name": "tempest-keypair-591109418", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhbcjtIsn9iAYo6zwbBMQR2DMLVd8PUkspbQTy9J17J4QoWjVerK6Y+i3VQsRC7Z66ZrPiFqELqeRpzoVRPTW4n0fjj+/atTU/n3frgxvko8+2x38cWkbvJMpKFbKJA5g=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:34:57.195097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-119d8749-ccc0-4a18-8fe9-96a27a960113 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Getting quotas for project 51a14f79344f4986a6c54001c3d7590c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:34:57.209778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-119d8749-ccc0-4a18-8fe9-96a27a960113 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Getting quotas for user 205777d0702b45d1b400045c3a2fd47b and project 51a14f79344f4986a6c54001c3d7590c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:34:57.247151 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-119d8749-ccc0-4a18-8fe9-96a27a960113 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.103032 Oct 05 17:34:57.255928 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 511/1052] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Oct 5 17:34:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 113 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 17:34:57.277163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-33f185f4-1d3c-48b5-acd2-369c7259a9af tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:57.278866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-33f185f4-1d3c-48b5-acd2-369c7259a9af tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:57.287639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33f185f4-1d3c-48b5-acd2-369c7259a9af tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:57.288845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33f185f4-1d3c-48b5-acd2-369c7259a9af tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:57.289564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33f185f4-1d3c-48b5-acd2-369c7259a9af tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:57.290702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33f185f4-1d3c-48b5-acd2-369c7259a9af tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:57.291584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33f185f4-1d3c-48b5-acd2-369c7259a9af tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:57.292242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33f185f4-1d3c-48b5-acd2-369c7259a9af tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:57.509329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc05e851-aa30-40f1-894b-6cc70f28019f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:57.523116 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc05e851-aa30-40f1-894b-6cc70f28019f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1314 microversion: 2.1 time: 0.660968 Oct 05 17:34:57.523951 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 542/1053] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:56 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:57.529110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-622f9206-ccb1-4c4e-a805-ba8beef60ee2 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:57.532547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-622f9206-ccb1-4c4e-a805-ba8beef60ee2 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:57.546029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f9206-ccb1-4c4e-a805-ba8beef60ee2 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:57.551084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f9206-ccb1-4c4e-a805-ba8beef60ee2 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:57.551838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f9206-ccb1-4c4e-a805-ba8beef60ee2 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:57.552753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f9206-ccb1-4c4e-a805-ba8beef60ee2 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:57.553613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f9206-ccb1-4c4e-a805-ba8beef60ee2 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:57.554194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f9206-ccb1-4c4e-a805-ba8beef60ee2 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:57.751553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-33f185f4-1d3c-48b5-acd2-369c7259a9af tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:57.763028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-33f185f4-1d3c-48b5-acd2-369c7259a9af tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1536 microversion: 2.1 time: 0.505247 Oct 05 17:34:57.778809 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 512/1054] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:57 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1536 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:57.785168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:57.786045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:57.792700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:57.793466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:57.794065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:57.795006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:57.795619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:57.796202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:57.958915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:57.973849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:57.975719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:57.983038 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9f7b0f31-3598-46a6-b16d-4e881b02fc85 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.202698 Oct 05 17:34:58.001089 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 513/1055] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:57 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:58.172974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ed6efca-5e49-48e6-b535-b76ef4f57d25 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:58.174005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7ed6efca-5e49-48e6-b535-b76ef4f57d25 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:58.184412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ed6efca-5e49-48e6-b535-b76ef4f57d25 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:58.185246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ed6efca-5e49-48e6-b535-b76ef4f57d25 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:58.185940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ed6efca-5e49-48e6-b535-b76ef4f57d25 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:58.187027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ed6efca-5e49-48e6-b535-b76ef4f57d25 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:58.187803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ed6efca-5e49-48e6-b535-b76ef4f57d25 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:58.188526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ed6efca-5e49-48e6-b535-b76ef4f57d25 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:58.330462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-622f9206-ccb1-4c4e-a805-ba8beef60ee2 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:58.344511 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-622f9206-ccb1-4c4e-a805-ba8beef60ee2 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1332 microversion: 2.1 time: 0.819390 Oct 05 17:34:58.371787 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 543/1056] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:57 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1332 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:58.547781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a4b7a069-545d-4ca3-9918-b1be7cb77696 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:58.548548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a4b7a069-545d-4ca3-9918-b1be7cb77696 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:58.583222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4b7a069-545d-4ca3-9918-b1be7cb77696 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:58.584063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4b7a069-545d-4ca3-9918-b1be7cb77696 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:58.586661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4b7a069-545d-4ca3-9918-b1be7cb77696 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:58.587868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4b7a069-545d-4ca3-9918-b1be7cb77696 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:58.589143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4b7a069-545d-4ca3-9918-b1be7cb77696 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:58.590874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4b7a069-545d-4ca3-9918-b1be7cb77696 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:59.318849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7ed6efca-5e49-48e6-b535-b76ef4f57d25 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:59.333400 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ed6efca-5e49-48e6-b535-b76ef4f57d25 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1367 microversion: 2.1 time: 1.158959 Oct 05 17:34:59.334708 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 514/1057] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:58 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1367 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:34:59.341692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-830a2599-14af-42ea-94e3-9e0e2a09dace tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:59.350964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-830a2599-14af-42ea-94e3-9e0e2a09dace tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:59.360570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830a2599-14af-42ea-94e3-9e0e2a09dace tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:59.361187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830a2599-14af-42ea-94e3-9e0e2a09dace tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:59.372388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830a2599-14af-42ea-94e3-9e0e2a09dace tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:59.373615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830a2599-14af-42ea-94e3-9e0e2a09dace tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:59.374195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830a2599-14af-42ea-94e3-9e0e2a09dace tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:59.374975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830a2599-14af-42ea-94e3-9e0e2a09dace tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:59.499789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a4b7a069-545d-4ca3-9918-b1be7cb77696 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:59.512305 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a4b7a069-545d-4ca3-9918-b1be7cb77696 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1314 microversion: 2.1 time: 0.968099 Oct 05 17:34:59.515050 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 544/1058] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:58 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:34:59.532679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:59.536882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:59.558980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:59.560688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:59.563704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:59.564644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:59.565269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:59.566887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:59.747062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:59.760683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:59.767128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:34:59.777256 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b90a1bfd-2c95-435b-95c7-3007868a4cb5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.260848 Oct 05 17:34:59.778760 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 545/1059] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:34:59 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:34:59.784087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13a1458d-f6df-4339-b058-be6b823e3635 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:34:59.785100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13a1458d-f6df-4339-b058-be6b823e3635 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:34:59.800612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a1458d-f6df-4339-b058-be6b823e3635 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:59.803976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a1458d-f6df-4339-b058-be6b823e3635 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:59.805366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a1458d-f6df-4339-b058-be6b823e3635 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:59.806395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a1458d-f6df-4339-b058-be6b823e3635 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:34:59.809592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a1458d-f6df-4339-b058-be6b823e3635 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:34:59.810415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a1458d-f6df-4339-b058-be6b823e3635 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:34:59.983491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-830a2599-14af-42ea-94e3-9e0e2a09dace tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:00.002404 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-830a2599-14af-42ea-94e3-9e0e2a09dace tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1536 microversion: 2.1 time: 0.657879 Oct 05 17:35:00.006336 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 515/1060] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:59 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1536 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:00.202270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5ec0b506-8121-4be4-831e-900c95463997 req-139c0214-60df-452f-b6e2-b577798392d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0b701-73ce-4633-be8b-d2a78230b701", "name": "network-vif-plugged", "status": "completed", "tag": "26a9ba3f-e269-4580-b31d-95b12b0c1e21"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:00.219561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5ec0b506-8121-4be4-831e-900c95463997 req-139c0214-60df-452f-b6e2-b577798392d0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:00.223059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5ec0b506-8121-4be4-831e-900c95463997 req-139c0214-60df-452f-b6e2-b577798392d0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:00.223744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5ec0b506-8121-4be4-831e-900c95463997 req-139c0214-60df-452f-b6e2-b577798392d0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:00.252991 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5ec0b506-8121-4be4-831e-900c95463997 req-139c0214-60df-452f-b6e2-b577798392d0 service nova] Creating event network-vif-plugged:26a9ba3f-e269-4580-b31d-95b12b0c1e21 for instance 51c0b701-73ce-4633-be8b-d2a78230b701 on n-h2-835595-3 Oct 05 17:35:00.265757 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5ec0b506-8121-4be4-831e-900c95463997 req-139c0214-60df-452f-b6e2-b577798392d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067545 Oct 05 17:35:00.270688 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 516/1061] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:00.366167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e33fe49-4d29-450e-b484-2d8503a8eca4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:00.368170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6e33fe49-4d29-450e-b484-2d8503a8eca4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:00.380133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e33fe49-4d29-450e-b484-2d8503a8eca4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:00.386814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e33fe49-4d29-450e-b484-2d8503a8eca4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:00.388275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e33fe49-4d29-450e-b484-2d8503a8eca4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:00.389228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e33fe49-4d29-450e-b484-2d8503a8eca4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:00.390467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e33fe49-4d29-450e-b484-2d8503a8eca4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:00.391122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e33fe49-4d29-450e-b484-2d8503a8eca4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:00.521047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-13a1458d-f6df-4339-b058-be6b823e3635 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:00.530073 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13a1458d-f6df-4339-b058-be6b823e3635 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1332 microversion: 2.1 time: 0.750008 Oct 05 17:35:00.533083 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 546/1062] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:34:59 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1332 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:00.543081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c50bd60a-2665-48fa-ae04-c1a1d8414db7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:00.545534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c50bd60a-2665-48fa-ae04-c1a1d8414db7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:00.564646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c50bd60a-2665-48fa-ae04-c1a1d8414db7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:00.567077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c50bd60a-2665-48fa-ae04-c1a1d8414db7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:00.568833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c50bd60a-2665-48fa-ae04-c1a1d8414db7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:00.569807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c50bd60a-2665-48fa-ae04-c1a1d8414db7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:00.572113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c50bd60a-2665-48fa-ae04-c1a1d8414db7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:00.575124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c50bd60a-2665-48fa-ae04-c1a1d8414db7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:00.766806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6e33fe49-4d29-450e-b484-2d8503a8eca4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:00.775848 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6e33fe49-4d29-450e-b484-2d8503a8eca4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1558 microversion: 2.1 time: 0.417747 Oct 05 17:35:00.792406 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 517/1063] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:00 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1558 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:00.802171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-2e38a075-cc2a-4fc9-a134-f1e84b19d04b req-f910838a-e13b-4738-8fc2-52093a5cd154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3dfaed00-73fb-45f1-8690-fd6cd745ec22", "tag": "9cabd191-2500-4d11-a1fb-9ebe696a3704"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:00.812996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2e38a075-cc2a-4fc9-a134-f1e84b19d04b req-f910838a-e13b-4738-8fc2-52093a5cd154 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:00.813765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2e38a075-cc2a-4fc9-a134-f1e84b19d04b req-f910838a-e13b-4738-8fc2-52093a5cd154 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:00.814531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2e38a075-cc2a-4fc9-a134-f1e84b19d04b req-f910838a-e13b-4738-8fc2-52093a5cd154 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:00.827428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:00.830082 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-2e38a075-cc2a-4fc9-a134-f1e84b19d04b req-f910838a-e13b-4738-8fc2-52093a5cd154 service nova] Creating event network-changed:9cabd191-2500-4d11-a1fb-9ebe696a3704 for instance 3dfaed00-73fb-45f1-8690-fd6cd745ec22 on n-h2-835595-3 Oct 05 17:35:00.836539 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-2e38a075-cc2a-4fc9-a134-f1e84b19d04b req-f910838a-e13b-4738-8fc2-52093a5cd154 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042283 Oct 05 17:35:00.837660 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 518/1064] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:00.844301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-24f8fe70-7eb1-4768-926a-d9db17a991da tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:00.845127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-24f8fe70-7eb1-4768-926a-d9db17a991da tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:00.853337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24f8fe70-7eb1-4768-926a-d9db17a991da tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:00.854351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24f8fe70-7eb1-4768-926a-d9db17a991da tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:00.855964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24f8fe70-7eb1-4768-926a-d9db17a991da tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:00.856961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24f8fe70-7eb1-4768-926a-d9db17a991da tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:00.857611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24f8fe70-7eb1-4768-926a-d9db17a991da tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:00.858221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24f8fe70-7eb1-4768-926a-d9db17a991da tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:01.002941 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-24f8fe70-7eb1-4768-926a-d9db17a991da tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.163506 Oct 05 17:35:01.021181 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 519/1065] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:35:00 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:01.033271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:01.035213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:01.049222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:01.050465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:01.051162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:01.052104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:01.053170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:01.053833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:01.222426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c50bd60a-2665-48fa-ae04-c1a1d8414db7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:01.231316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:01.231565 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c50bd60a-2665-48fa-ae04-c1a1d8414db7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1314 microversion: 2.1 time: 0.692313 Oct 05 17:35:01.246944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:01.247396 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 547/1066] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:00 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1314 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:01.248382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:01.262237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6197582b-2f7c-46db-bca6-dc9dd81ab747 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:01.263202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6197582b-2f7c-46db-bca6-dc9dd81ab747 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:01.263402 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1dc523ce-aecc-4d78-9c46-89608adae656 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.240743 Oct 05 17:35:01.278924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6197582b-2f7c-46db-bca6-dc9dd81ab747 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:01.280153 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 520/1067] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:01 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:01.280830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6197582b-2f7c-46db-bca6-dc9dd81ab747 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:01.284075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6197582b-2f7c-46db-bca6-dc9dd81ab747 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:01.291976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6197582b-2f7c-46db-bca6-dc9dd81ab747 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:01.296969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6197582b-2f7c-46db-bca6-dc9dd81ab747 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:01.300276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6197582b-2f7c-46db-bca6-dc9dd81ab747 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:01.346570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:01.555200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b37c6d90-a551-4288-b112-a75e3b4536c1 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:01.555798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b37c6d90-a551-4288-b112-a75e3b4536c1 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:01.571109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b37c6d90-a551-4288-b112-a75e3b4536c1 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:01.571604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b37c6d90-a551-4288-b112-a75e3b4536c1 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:01.572039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b37c6d90-a551-4288-b112-a75e3b4536c1 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:01.572742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b37c6d90-a551-4288-b112-a75e3b4536c1 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:01.573194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b37c6d90-a551-4288-b112-a75e3b4536c1 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:01.573615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b37c6d90-a551-4288-b112-a75e3b4536c1 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:02.082356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6197582b-2f7c-46db-bca6-dc9dd81ab747 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:02.099843 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6197582b-2f7c-46db-bca6-dc9dd81ab747 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1541 microversion: 2.1 time: 0.842607 Oct 05 17:35:02.101815 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 548/1068] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:01 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1541 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:02.230533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b37c6d90-a551-4288-b112-a75e3b4536c1 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:02.239962 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b37c6d90-a551-4288-b112-a75e3b4536c1 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1332 microversion: 2.1 time: 0.688658 Oct 05 17:35:02.254606 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 521/1069] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:01 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1332 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:02.257905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d16a8a9b-df2a-48a3-997c-51e0c4484881 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:02.258897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d16a8a9b-df2a-48a3-997c-51e0c4484881 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:02.269817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d16a8a9b-df2a-48a3-997c-51e0c4484881 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:02.270576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d16a8a9b-df2a-48a3-997c-51e0c4484881 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:02.272156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d16a8a9b-df2a-48a3-997c-51e0c4484881 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:02.273102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d16a8a9b-df2a-48a3-997c-51e0c4484881 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:02.276185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d16a8a9b-df2a-48a3-997c-51e0c4484881 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:02.278764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d16a8a9b-df2a-48a3-997c-51e0c4484881 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:02.295152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:02.295775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:02.306906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:02.307483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:02.307918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:02.308628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:02.309090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:02.309512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:02.420292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:02.439439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:02.440085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:02.453403 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d9694548-2489-4515-99d4-f6df6ce2e568 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.161384 Oct 05 17:35:02.456774 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 522/1070] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:02 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:35:03.131491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fabf54a0-ed7f-4977-bde8-e5905f894539 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:03.132237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fabf54a0-ed7f-4977-bde8-e5905f894539 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:03.144890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fabf54a0-ed7f-4977-bde8-e5905f894539 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:03.145407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fabf54a0-ed7f-4977-bde8-e5905f894539 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:03.145933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fabf54a0-ed7f-4977-bde8-e5905f894539 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:03.146692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fabf54a0-ed7f-4977-bde8-e5905f894539 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:03.147156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fabf54a0-ed7f-4977-bde8-e5905f894539 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:03.147582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fabf54a0-ed7f-4977-bde8-e5905f894539 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:03.190375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d16a8a9b-df2a-48a3-997c-51e0c4484881 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:03.201795 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d16a8a9b-df2a-48a3-997c-51e0c4484881 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1314 microversion: 2.1 time: 0.948247 Oct 05 17:35:03.206318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 549/1071] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:02 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1314 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:03.215225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7fc0075d-c1b1-4b85-aaba-565468abe9c1 req-58cb6c92-45af-412e-8cc2-040ab26e596b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6321627d-1957-42b5-a223-da558b58bbdf", "name": "network-vif-plugged", "status": "completed", "tag": "9752d52f-5ec4-412b-ae98-2e0cd46d439f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:03.252401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7fc0075d-c1b1-4b85-aaba-565468abe9c1 req-58cb6c92-45af-412e-8cc2-040ab26e596b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:03.253133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7fc0075d-c1b1-4b85-aaba-565468abe9c1 req-58cb6c92-45af-412e-8cc2-040ab26e596b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:03.253736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7fc0075d-c1b1-4b85-aaba-565468abe9c1 req-58cb6c92-45af-412e-8cc2-040ab26e596b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:03.284516 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7fc0075d-c1b1-4b85-aaba-565468abe9c1 req-58cb6c92-45af-412e-8cc2-040ab26e596b service nova] Creating event network-vif-plugged:9752d52f-5ec4-412b-ae98-2e0cd46d439f for instance 6321627d-1957-42b5-a223-da558b58bbdf on n-h1-835595-3 Oct 05 17:35:03.317123 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7fc0075d-c1b1-4b85-aaba-565468abe9c1 req-58cb6c92-45af-412e-8cc2-040ab26e596b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084150 Oct 05 17:35:03.335326 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 550/1072] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:03.395160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ebbcdc3e-5ea8-42b1-ada1-39e33f8b213f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:03.401297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ebbcdc3e-5ea8-42b1-ada1-39e33f8b213f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:03.428224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebbcdc3e-5ea8-42b1-ada1-39e33f8b213f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:03.430080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebbcdc3e-5ea8-42b1-ada1-39e33f8b213f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:03.431603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebbcdc3e-5ea8-42b1-ada1-39e33f8b213f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:03.432592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebbcdc3e-5ea8-42b1-ada1-39e33f8b213f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:03.433493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebbcdc3e-5ea8-42b1-ada1-39e33f8b213f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:03.441199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebbcdc3e-5ea8-42b1-ada1-39e33f8b213f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:03.601950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fabf54a0-ed7f-4977-bde8-e5905f894539 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:03.617177 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fabf54a0-ed7f-4977-bde8-e5905f894539 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1541 microversion: 2.1 time: 0.487411 Oct 05 17:35:03.617798 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 523/1073] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:03 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1541 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:03.637168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:03.638105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:03.660248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:03.664919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:03.666668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:03.669476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:03.671336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:03.673118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:03.826032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ebbcdc3e-5ea8-42b1-ada1-39e33f8b213f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:03.864583 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ebbcdc3e-5ea8-42b1-ada1-39e33f8b213f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1537 microversion: 2.1 time: 0.523180 Oct 05 17:35:03.881918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:03.890623 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 551/1074] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:03 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1537 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:03.895689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:03.897181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:03.906701 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b7db4e3-6e00-44b3-b9e5-0b816f5231bc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.286600 Oct 05 17:35:03.908126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d76caa79-95e9-49a9-ac45-120e7738362b tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Action: 'create', calling method: .version_select at 0x7f7775360b80>, body: {"pool": "de643343-c49d-40ba-bdff-e7e84d69a963"} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:03.910970 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 524/1075] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:03 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:04.008130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-943702642", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "71625936-48e5-43f1-8d04-88ba77014c3c"}], "security_groups": [{"name": "tempest-securitygroup--1656197716"}], "key_name": "tempest-keypair-591109418", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:04.255302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] validate_networks() for [('71625936-48e5-43f1-8d04-88ba77014c3c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:35:05.042143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:35:05.042713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:35:05.043199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:35:05.043790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:35:05.045247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:35:05.078259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:05.080086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:05.083416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:05.084504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:05.089933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:05.091051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:05.124405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Getting quotas for project 51a14f79344f4986a6c54001c3d7590c. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:35:05.131253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Getting quotas for user 205777d0702b45d1b400045c3a2fd47b and project 51a14f79344f4986a6c54001c3d7590c. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:35:05.148147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:35:05.150945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:35:05.236430 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47b2f2b5-25ce-4ee4-9409-5ab85f374181 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.231443 Oct 05 17:35:05.244304 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 525/1076] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:35:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 05 17:35:05.250149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ea34d694-a2f1-46cb-9e71-2f8b706c969f req-f050b3c0-3cea-4939-9448-f18188c919e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df1c2e18-968f-4926-a47b-8e73ea54b4fa", "tag": "d8268a63-1db3-4a60-8640-16a2a12e466b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:05.262414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ea34d694-a2f1-46cb-9e71-2f8b706c969f req-f050b3c0-3cea-4939-9448-f18188c919e3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:05.263848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ea34d694-a2f1-46cb-9e71-2f8b706c969f req-f050b3c0-3cea-4939-9448-f18188c919e3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:05.264874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ea34d694-a2f1-46cb-9e71-2f8b706c969f req-f050b3c0-3cea-4939-9448-f18188c919e3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:05.297550 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ea34d694-a2f1-46cb-9e71-2f8b706c969f req-f050b3c0-3cea-4939-9448-f18188c919e3 service nova] Creating event network-changed:d8268a63-1db3-4a60-8640-16a2a12e466b for instance df1c2e18-968f-4926-a47b-8e73ea54b4fa on n-h2-835595-3 Oct 05 17:35:05.302739 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ea34d694-a2f1-46cb-9e71-2f8b706c969f req-f050b3c0-3cea-4939-9448-f18188c919e3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056473 Oct 05 17:35:05.303355 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 526/1077] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:05.318353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dec7c088-cbf1-42cc-8137-fd3723f05f15 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:05.321435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dec7c088-cbf1-42cc-8137-fd3723f05f15 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:05.337723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dec7c088-cbf1-42cc-8137-fd3723f05f15 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:05.339830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dec7c088-cbf1-42cc-8137-fd3723f05f15 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:05.340423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dec7c088-cbf1-42cc-8137-fd3723f05f15 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:05.341318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dec7c088-cbf1-42cc-8137-fd3723f05f15 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:05.341976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dec7c088-cbf1-42cc-8137-fd3723f05f15 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:05.342595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dec7c088-cbf1-42cc-8137-fd3723f05f15 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:05.760520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dec7c088-cbf1-42cc-8137-fd3723f05f15 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:05.777987 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dec7c088-cbf1-42cc-8137-fd3723f05f15 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1314 microversion: 2.1 time: 0.465630 Oct 05 17:35:05.792645 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 527/1078] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:05 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:05.806548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-96781fe2-84fe-49dd-b4a4-ef1e4aa2ce91 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:05.810653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-96781fe2-84fe-49dd-b4a4-ef1e4aa2ce91 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:05.826603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96781fe2-84fe-49dd-b4a4-ef1e4aa2ce91 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:05.827005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96781fe2-84fe-49dd-b4a4-ef1e4aa2ce91 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:05.830494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96781fe2-84fe-49dd-b4a4-ef1e4aa2ce91 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:05.833600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96781fe2-84fe-49dd-b4a4-ef1e4aa2ce91 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:05.834316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96781fe2-84fe-49dd-b4a4-ef1e4aa2ce91 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:05.836390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96781fe2-84fe-49dd-b4a4-ef1e4aa2ce91 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:06.274664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-96781fe2-84fe-49dd-b4a4-ef1e4aa2ce91 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:06.290038 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-96781fe2-84fe-49dd-b4a4-ef1e4aa2ce91 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1541 microversion: 2.1 time: 0.496157 Oct 05 17:35:06.295474 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 528/1079] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:05 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1541 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:06.309418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:06.315117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:06.333147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:06.340978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:06.343546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:06.347207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:06.351249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:06.351757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:06.584820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:06.600556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:06.604644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:06.626892 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-05b79613-ab3c-4c56-8a44-0ff0e0b094b3 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.325563 Oct 05 17:35:06.628255 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 529/1080] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:06 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:06.639982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:06.640625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:06.660220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:06.661802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:06.662296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:06.663032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:06.663481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:06.663914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:06.820291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:06.854475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:06.858700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:06.864751 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a5eb96c-1b89-49ff-a050-b0b43e8cf821 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1280 microversion: 2.25 time: 0.232285 Oct 05 17:35:06.872722 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 530/1081] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:06 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:06.882196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-89534c40-a7b2-483e-879c-79598e2287a7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:06.886433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-89534c40-a7b2-483e-879c-79598e2287a7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:06.909680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89534c40-a7b2-483e-879c-79598e2287a7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:06.911418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89534c40-a7b2-483e-879c-79598e2287a7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:06.917505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89534c40-a7b2-483e-879c-79598e2287a7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:06.918712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89534c40-a7b2-483e-879c-79598e2287a7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:06.919659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89534c40-a7b2-483e-879c-79598e2287a7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:06.920275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89534c40-a7b2-483e-879c-79598e2287a7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:07.507439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-89534c40-a7b2-483e-879c-79598e2287a7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:07.524582 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-89534c40-a7b2-483e-879c-79598e2287a7 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1314 microversion: 2.1 time: 0.650478 Oct 05 17:35:07.529338 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 531/1082] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:06 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:07.536958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ea19fdc-e521-4c63-b1a2-bf073e1052cf tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:07.544345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6ea19fdc-e521-4c63-b1a2-bf073e1052cf tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:07.559137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ea19fdc-e521-4c63-b1a2-bf073e1052cf tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:07.563020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ea19fdc-e521-4c63-b1a2-bf073e1052cf tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:07.563601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ea19fdc-e521-4c63-b1a2-bf073e1052cf tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:07.567724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ea19fdc-e521-4c63-b1a2-bf073e1052cf tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:07.568442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ea19fdc-e521-4c63-b1a2-bf073e1052cf tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:07.568948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ea19fdc-e521-4c63-b1a2-bf073e1052cf tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:08.245067 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d76caa79-95e9-49a9-ac45-120e7738362b tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.350271 Oct 05 17:35:08.246307 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 552/1083] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:35:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:08.251648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:08.252565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:08.270962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:08.271774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:08.272383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:08.273299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:08.273931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:08.274564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:08.354778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6ea19fdc-e521-4c63-b1a2-bf073e1052cf tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:08.395502 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6ea19fdc-e521-4c63-b1a2-bf073e1052cf tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1541 microversion: 2.1 time: 0.863680 Oct 05 17:35:08.412303 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 532/1084] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:07 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1541 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:08.447029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:08.448257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:08.456707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:08.459795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:08.459955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:08.460425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:08.460919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:08.461914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:08.462706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:08.463310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:08.474211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:08.476074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:08.482488 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7cde5f34-37b5-4a3a-b714-70b0a7f34d73 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.234900 Oct 05 17:35:08.484710 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 553/1085] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:08 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:08.491331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Action: 'action', calling method: .version_select at 0x7f77779658b0>, body: {"addFloatingIp": {"address": "172.25.5.145"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:08.495322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:08.513206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:08.517470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:08.518144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:08.519085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:08.519717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:08.521040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:08.593863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:08.608394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:08.614886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:08.617675 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b3f36740-e880-46f5-ada9-3cdb4f7c5268 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1342 microversion: 2.25 time: 0.202667 Oct 05 17:35:08.619675 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 533/1086] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:08 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1342 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:08.625477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:35:08.626253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquired lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:35:08.631766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b7ca2cce-457f-401c-8090-222801d76006 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:08.632415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b7ca2cce-457f-401c-8090-222801d76006 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:08.678426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7ca2cce-457f-401c-8090-222801d76006 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:08.680000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7ca2cce-457f-401c-8090-222801d76006 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:08.680918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7ca2cce-457f-401c-8090-222801d76006 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:08.697053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7ca2cce-457f-401c-8090-222801d76006 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:08.697579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7ca2cce-457f-401c-8090-222801d76006 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:08.699339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7ca2cce-457f-401c-8090-222801d76006 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:09.672427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7ca2cce-457f-401c-8090-222801d76006 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:09.759762 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b7ca2cce-457f-401c-8090-222801d76006 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1314 microversion: 2.1 time: 1.060510 Oct 05 17:35:09.759762 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 534/1087] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:08 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1314 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:09.759762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4da10d5b-45de-477d-b784-a21572fc2733 req-8849205c-4ca2-4da8-980b-46618ce66e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfaed00-73fb-45f1-8690-fd6cd745ec22", "name": "network-vif-plugged", "status": "completed", "tag": "9cabd191-2500-4d11-a1fb-9ebe696a3704"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:09.759762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4da10d5b-45de-477d-b784-a21572fc2733 req-8849205c-4ca2-4da8-980b-46618ce66e04 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:09.761028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4da10d5b-45de-477d-b784-a21572fc2733 req-8849205c-4ca2-4da8-980b-46618ce66e04 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:09.761028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4da10d5b-45de-477d-b784-a21572fc2733 req-8849205c-4ca2-4da8-980b-46618ce66e04 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:09.761028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4da10d5b-45de-477d-b784-a21572fc2733 req-8849205c-4ca2-4da8-980b-46618ce66e04 service nova] Creating event network-vif-plugged:9cabd191-2500-4d11-a1fb-9ebe696a3704 for instance 3dfaed00-73fb-45f1-8690-fd6cd745ec22 on n-h2-835595-3 Oct 05 17:35:09.761028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4da10d5b-45de-477d-b784-a21572fc2733 req-8849205c-4ca2-4da8-980b-46618ce66e04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033528 Oct 05 17:35:09.761028 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 535/1088] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:09.761421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c8ceeb0-c053-4eda-beb6-58c262521dba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:09.761421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0c8ceeb0-c053-4eda-beb6-58c262521dba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:09.761421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c8ceeb0-c053-4eda-beb6-58c262521dba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:09.761421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c8ceeb0-c053-4eda-beb6-58c262521dba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:09.761714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c8ceeb0-c053-4eda-beb6-58c262521dba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:09.761714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c8ceeb0-c053-4eda-beb6-58c262521dba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:09.761714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c8ceeb0-c053-4eda-beb6-58c262521dba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:09.761714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c8ceeb0-c053-4eda-beb6-58c262521dba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:10.173942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0c8ceeb0-c053-4eda-beb6-58c262521dba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:10.186058 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c8ceeb0-c053-4eda-beb6-58c262521dba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1541 microversion: 2.1 time: 0.467108 Oct 05 17:35:10.202370 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 536/1089] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:09 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1541 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:10.202370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:10.202370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:10.202370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:10.202886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:10.202886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:10.202886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:10.203340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:10.203754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:10.370820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:10.382860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Building network info cache for instance {{(pid=128844) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 17:35:10.393287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:10.401425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:10.419894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:10.439597 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-092c823e-f0df-4c81-9144-527c81384bcd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1553 microversion: 2.91 time: 0.246643 Oct 05 17:35:10.440410 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 537/1090] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:10 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1553 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:10.450550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:10.455381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:10.470067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:10.471586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:10.473360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:10.476828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:10.478128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:10.478831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:10.976667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:10.990008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:10.991823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:11.006725 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eeac8d5c-2557-4f72-8430-b5db5efdc472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1410 microversion: 2.25 time: 0.553921 Oct 05 17:35:11.008035 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 538/1091] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:10 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1410 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:11.013010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b3bbef40-69d0-4bb8-b4cf-8a9b16fbfab7 req-5ab05b0d-1f9c-4da2-a552-82f72e2c6374 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0b701-73ce-4633-be8b-d2a78230b701", "tag": "26a9ba3f-e269-4580-b31d-95b12b0c1e21"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:11.030984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b3bbef40-69d0-4bb8-b4cf-8a9b16fbfab7 req-5ab05b0d-1f9c-4da2-a552-82f72e2c6374 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:11.031515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b3bbef40-69d0-4bb8-b4cf-8a9b16fbfab7 req-5ab05b0d-1f9c-4da2-a552-82f72e2c6374 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:11.031953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b3bbef40-69d0-4bb8-b4cf-8a9b16fbfab7 req-5ab05b0d-1f9c-4da2-a552-82f72e2c6374 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:11.061567 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b3bbef40-69d0-4bb8-b4cf-8a9b16fbfab7 req-5ab05b0d-1f9c-4da2-a552-82f72e2c6374 service nova] Creating event network-changed:26a9ba3f-e269-4580-b31d-95b12b0c1e21 for instance 51c0b701-73ce-4633-be8b-d2a78230b701 on n-h2-835595-3 Oct 05 17:35:11.070316 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b3bbef40-69d0-4bb8-b4cf-8a9b16fbfab7 req-5ab05b0d-1f9c-4da2-a552-82f72e2c6374 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060660 Oct 05 17:35:11.074175 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 539/1092] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:11.087174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b23cbe41-46bd-4ef9-bd7a-88295666d6e6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:11.087899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b23cbe41-46bd-4ef9-bd7a-88295666d6e6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:11.103468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b23cbe41-46bd-4ef9-bd7a-88295666d6e6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:11.103989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b23cbe41-46bd-4ef9-bd7a-88295666d6e6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:11.104424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b23cbe41-46bd-4ef9-bd7a-88295666d6e6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:11.105161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b23cbe41-46bd-4ef9-bd7a-88295666d6e6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:11.105618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b23cbe41-46bd-4ef9-bd7a-88295666d6e6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:11.109818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b23cbe41-46bd-4ef9-bd7a-88295666d6e6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:11.418393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b23cbe41-46bd-4ef9-bd7a-88295666d6e6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:11.435668 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b23cbe41-46bd-4ef9-bd7a-88295666d6e6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1314 microversion: 2.1 time: 0.359840 Oct 05 17:35:11.446316 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 540/1093] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:11 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:11.446316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d9467a76-3ccc-4814-833e-20911d79335f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:11.446879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d9467a76-3ccc-4814-833e-20911d79335f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:11.480771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9467a76-3ccc-4814-833e-20911d79335f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:11.485117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9467a76-3ccc-4814-833e-20911d79335f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:11.486970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9467a76-3ccc-4814-833e-20911d79335f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:11.488671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9467a76-3ccc-4814-833e-20911d79335f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:11.490839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9467a76-3ccc-4814-833e-20911d79335f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:11.491690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9467a76-3ccc-4814-833e-20911d79335f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:11.783687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9467a76-3ccc-4814-833e-20911d79335f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:11.806784 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d9467a76-3ccc-4814-833e-20911d79335f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1541 microversion: 2.1 time: 0.368135 Oct 05 17:35:11.809233 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 541/1094] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:11 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1541 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:11.815394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:11.816551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:11.829049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:11.830058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:11.831274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:11.832251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:11.833382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:11.834032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:12.113198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Updating instance_info_cache with network_info: [{"id": "26a9ba3f-e269-4580-b31d-95b12b0c1e21", "address": "fa:16:3e:83:77:0c", "network": {"id": "ea241c31-49cc-49d5-85d6-e6b48dbd2dff", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1559608266-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "065544965253483e8e506c98a39646ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap26a9ba3f-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128844) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:35:12.141297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Releasing lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:35:12.142693 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bdb0c926-1b05-47f7-8b0d-b39329db9b4a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action" status: 202 len: 0 microversion: 2.1 time: 3.656665 Oct 05 17:35:12.144171 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 554/1095] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:08 2022] POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action => generated 0 bytes in 3659 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 17:35:12.157748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:12.159807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:12.174240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:12.175872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:12.177169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:12.179147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:12.181269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:12.182226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:12.265224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:12.275999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:12.278507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:12.298221 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d30fd9a9-e9eb-4b87-8606-17690d0b1b7c tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1535 microversion: 2.91 time: 0.486202 Oct 05 17:35:12.299210 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 542/1096] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:11 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1535 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:12.305087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-98c89159-60f2-40cb-8161-c76539327231 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Action: 'create', calling method: .version_select at 0x7f77756da280>, body: {"pool": "de643343-c49d-40ba-bdff-e7e84d69a963"} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:12.616426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:12.632400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:12.634709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:12.636158 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ba0c5824-4700-406f-a599-174c62552530 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1410 microversion: 2.25 time: 0.488838 Oct 05 17:35:12.655634 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 555/1097] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:12 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1410 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:12.667082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-224d0fb7-f5de-4304-b090-ad9c306ba81a tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:12.669362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-224d0fb7-f5de-4304-b090-ad9c306ba81a tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:12.680520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224d0fb7-f5de-4304-b090-ad9c306ba81a tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:12.681358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224d0fb7-f5de-4304-b090-ad9c306ba81a tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:12.682725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224d0fb7-f5de-4304-b090-ad9c306ba81a tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:12.683873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224d0fb7-f5de-4304-b090-ad9c306ba81a tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:12.684657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224d0fb7-f5de-4304-b090-ad9c306ba81a tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:12.685238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224d0fb7-f5de-4304-b090-ad9c306ba81a tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:13.095977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-224d0fb7-f5de-4304-b090-ad9c306ba81a tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:13.109989 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-224d0fb7-f5de-4304-b090-ad9c306ba81a tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1463 microversion: 2.1 time: 0.452397 Oct 05 17:35:13.110619 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 556/1098] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:12 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1463 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:13.135034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-bca4ef42-8393-4240-bcb8-3dbeb93ac843 req-94e8cf51-5332-422a-9982-6e9544a8dd75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63958af-abf6-42db-be31-d666ae842191", "tag": "341a9f89-e472-44f2-8da1-34fc17c91f7b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:13.147047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bca4ef42-8393-4240-bcb8-3dbeb93ac843 req-94e8cf51-5332-422a-9982-6e9544a8dd75 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:13.148038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bca4ef42-8393-4240-bcb8-3dbeb93ac843 req-94e8cf51-5332-422a-9982-6e9544a8dd75 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:13.148616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bca4ef42-8393-4240-bcb8-3dbeb93ac843 req-94e8cf51-5332-422a-9982-6e9544a8dd75 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:13.163691 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-bca4ef42-8393-4240-bcb8-3dbeb93ac843 req-94e8cf51-5332-422a-9982-6e9544a8dd75 service nova] Creating event network-changed:341a9f89-e472-44f2-8da1-34fc17c91f7b for instance a63958af-abf6-42db-be31-d666ae842191 on n-h1-835595-3 Oct 05 17:35:13.188396 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-bca4ef42-8393-4240-bcb8-3dbeb93ac843 req-94e8cf51-5332-422a-9982-6e9544a8dd75 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063456 Oct 05 17:35:13.189358 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 557/1099] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:13.197269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-019b61c6-ffcf-41e4-ad29-1828f1e3baea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:13.198833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-019b61c6-ffcf-41e4-ad29-1828f1e3baea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:13.207410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019b61c6-ffcf-41e4-ad29-1828f1e3baea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:13.207916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019b61c6-ffcf-41e4-ad29-1828f1e3baea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:13.208401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019b61c6-ffcf-41e4-ad29-1828f1e3baea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:13.209393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019b61c6-ffcf-41e4-ad29-1828f1e3baea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:13.209859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019b61c6-ffcf-41e4-ad29-1828f1e3baea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:13.210360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019b61c6-ffcf-41e4-ad29-1828f1e3baea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:13.439276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-019b61c6-ffcf-41e4-ad29-1828f1e3baea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:13.448970 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-019b61c6-ffcf-41e4-ad29-1828f1e3baea tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1541 microversion: 2.1 time: 0.257187 Oct 05 17:35:13.450170 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 558/1100] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:13 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1541 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:13.455214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8be82f8f-85f5-4c17-acbf-830a8a487db3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:13.456281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8be82f8f-85f5-4c17-acbf-830a8a487db3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:13.462520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be82f8f-85f5-4c17-acbf-830a8a487db3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:13.463157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be82f8f-85f5-4c17-acbf-830a8a487db3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:13.463717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be82f8f-85f5-4c17-acbf-830a8a487db3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:13.464535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be82f8f-85f5-4c17-acbf-830a8a487db3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:13.465086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be82f8f-85f5-4c17-acbf-830a8a487db3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:13.465632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be82f8f-85f5-4c17-acbf-830a8a487db3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:13.618985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8be82f8f-85f5-4c17-acbf-830a8a487db3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:13.627084 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8be82f8f-85f5-4c17-acbf-830a8a487db3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1463 microversion: 2.1 time: 0.175505 Oct 05 17:35:13.628035 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 559/1101] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:13 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1463 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:13.635507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:13.636291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:13.644729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:13.645477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:13.646630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:13.647740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:13.648352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:13.648955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:13.753145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:13.760678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:13.762310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:13.768281 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-644728da-666c-453e-8307-477a6e96e492 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1478 microversion: 2.91 time: 0.139070 Oct 05 17:35:13.769332 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 560/1102] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:13 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1478 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:13.774312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:13.774926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:13.781152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:13.781819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:13.782505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:13.783398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:13.784024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:13.784607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:13.963921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:13.974577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:13.976316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:13.978239 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e37d4869-a257-47cf-957c-be4fef27b0c1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1410 microversion: 2.25 time: 0.207723 Oct 05 17:35:13.978861 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 561/1103] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:13 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1410 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:13.985217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1268035888", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "6321627d-1957-42b5-a223-da558b58bbdf"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:14.055730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:35:14.337063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:35:14.337697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:35:14.337948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:35:14.338384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:35:14.338795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:35:14.350314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:14.351091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:14.351524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:14.352416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:14.353090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:14.353733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:14.374173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Getting quotas for project 1c79b829a6194b7fbfe07a1c77cd2464. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:35:14.378455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Getting quotas for user 0683f65832f146b0bb85a984370186be and project 1c79b829a6194b7fbfe07a1c77cd2464. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:35:14.390401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:35:14.392727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:35:14.473979 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0c47297d-852e-4ceb-86f9-4e420f27ea5e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.493859 Oct 05 17:35:14.476036 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 562/1104] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:35:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:35:14.481845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-31f8419c-5dce-4b0a-b603-3c2dfbc6cbc8 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-835595-3"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:14.485321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-31f8419c-5dce-4b0a-b603-3c2dfbc6cbc8 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:14.494602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31f8419c-5dce-4b0a-b603-3c2dfbc6cbc8 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:14.495552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31f8419c-5dce-4b0a-b603-3c2dfbc6cbc8 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:14.496710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31f8419c-5dce-4b0a-b603-3c2dfbc6cbc8 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:14.497683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31f8419c-5dce-4b0a-b603-3c2dfbc6cbc8 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:14.498484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31f8419c-5dce-4b0a-b603-3c2dfbc6cbc8 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:14.499176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31f8419c-5dce-4b0a-b603-3c2dfbc6cbc8 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:14.575032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-31f8419c-5dce-4b0a-b603-3c2dfbc6cbc8 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-835595-3". {{(pid=128844) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 17:35:14.696045 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-31f8419c-5dce-4b0a-b603-3c2dfbc6cbc8 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1/action" status: 202 len: 0 microversion: 2.91 time: 0.216401 Oct 05 17:35:14.704144 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 563/1105] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:35:14 2022] POST /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:35:14.718649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bba89420-52cc-424f-b7c8-1d06860a83c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:14.721037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bba89420-52cc-424f-b7c8-1d06860a83c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:14.741193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bba89420-52cc-424f-b7c8-1d06860a83c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:14.741940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bba89420-52cc-424f-b7c8-1d06860a83c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:14.743315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bba89420-52cc-424f-b7c8-1d06860a83c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:14.747313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bba89420-52cc-424f-b7c8-1d06860a83c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:14.748707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bba89420-52cc-424f-b7c8-1d06860a83c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:14.750114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bba89420-52cc-424f-b7c8-1d06860a83c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:14.976104 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-98c89159-60f2-40cb-8161-c76539327231 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.675293 Oct 05 17:35:14.979731 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 543/1106] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:35:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:14.988720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d223ad8c-4e18-4fab-bf26-7f6d20048623 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:14.989929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d223ad8c-4e18-4fab-bf26-7f6d20048623 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:15.091577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bba89420-52cc-424f-b7c8-1d06860a83c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:15.108678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d223ad8c-4e18-4fab-bf26-7f6d20048623 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:15.109619 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bba89420-52cc-424f-b7c8-1d06860a83c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1541 microversion: 2.1 time: 0.397606 Oct 05 17:35:15.110765 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 564/1107] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:14 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1541 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:15.122060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:15.122060 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d223ad8c-4e18-4fab-bf26-7f6d20048623 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1214 microversion: 2.1 time: 0.139415 Oct 05 17:35:15.122060 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 544/1108] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:14 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1214 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:15.127159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:15.128952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:15.135237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.173"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:15.137053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:15.138154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:15.138440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:15.138746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:15.140497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:15.141461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:15.141969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:15.146251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:15.146859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:15.147378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:15.148329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:15.148844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:15.149327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:15.208204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:35:15.210809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquired lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:35:15.302232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:15.317290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:15.320484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:15.333331 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa56e695-5217-4559-962a-0bf3b02c99fc tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1486 microversion: 2.91 time: 0.210615 Oct 05 17:35:15.334353 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 545/1109] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:15 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1486 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:15.373812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:15.374474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:15.383676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:15.384324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:15.385267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:15.386118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:15.387296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:15.388252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:15.869302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:15.880588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:15.882006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:15.883160 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8772fb29-1ed4-44af-80e3-4cce96a16826 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1410 microversion: 2.25 time: 0.542755 Oct 05 17:35:15.883723 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 546/1110] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:15 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1410 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:16.023193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG neutronclient.v2_0.client [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.173 (6c8e8f08-4ede-448f-b38f-6366d88fc76c) with port 26a9ba3f-e269-4580-b31d-95b12b0c1e21 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network de643343-c49d-40ba-bdff-e7e84d69a963.", "detail": ""}} {{(pid=128844) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:35:16.023937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Releasing lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:35:16.024693 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.173 (6c8e8f08-4ede-448f-b38f-6366d88fc76c) with port 26a9ba3f-e269-4580-b31d-95b12b0c1e21 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network de643343-c49d-40ba-bdff-e7e84d69a963. Oct 05 17:35:16.024693 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-ad616334-2280-4a84-a9e9-1ce70fc49bb0'] Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Request method failure captured: Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action HTTP/1.1 Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 46 Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcAvW-3zHy31Zk49RJWapq7bc9AS9flZE-SRw7Jnbl8lfCjqFj5rg72ltRf6OpQ_t95Tax_6ss9x5u4M-TqlwGSZp4dd-oTNZPlvsPHOp5lD604r54IKmxAXnmvS6nvRMzH99-WTKdOLHJ6k94ZEh9YgK659ULXUyT1TDxXnHetKoVE Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 065544965253483e8e506c98a39646ce Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:16.027878 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/065544965253483e8e506c98a39646ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/065544965253483e8e506c98a39646ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_065544965253483e8e506c98a39646ce", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/065544965253483e8e506c98a39646ce"}]}] Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 065544965253483e8e506c98a39646ce Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 37ac9633604b4bea8e346140bd7915ca Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: {"addFloatingIp": {"address": "172.25.5.173"}} Oct 05 17:35:16.029468 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot associate floating IP 172.25.5.173 (6c8e8f08-4ede-448f-b38f-6366d88fc76c) with port 26a9ba3f-e269-4580-b31d-95b12b0c1e21 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network de643343-c49d-40ba-bdff-e7e84d69a963. Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-ad616334-2280-4a84-a9e9-1ce70fc49bb0'] Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '51c0b701-73ce-4633-be8b-d2a78230b701', 'body': {'addFloatingIp': {'address': '172.25.5.173'}}} Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:35:16.030404 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:35:16.031699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.173 (6c8e8f08-4ede-448f-b38f-6366d88fc76c) with port 26a9ba3f-e269-4580-b31d-95b12b0c1e21 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network de643343-c49d-40ba-bdff-e7e84d69a963. Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad616334-2280-4a84-a9e9-1ce70fc49bb0'] Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.173 (6c8e8f08-4ede-448f-b38f-6366d88fc76c) with port 26a9ba3f-e269-4580-b31d-95b12b0c1e21 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network de643343-c49d-40ba-bdff-e7e84d69a963. Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad616334-2280-4a84-a9e9-1ce70fc49bb0'] Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:16.032973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.173 (6c8e8f08-4ede-448f-b38f-6366d88fc76c) with port 26a9ba3f-e269-4580-b31d-95b12b0c1e21 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network de643343-c49d-40ba-bdff-e7e84d69a963. Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad616334-2280-4a84-a9e9-1ce70fc49bb0'] Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:16.034160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.173 (6c8e8f08-4ede-448f-b38f-6366d88fc76c) with port 26a9ba3f-e269-4580-b31d-95b12b0c1e21 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network de643343-c49d-40ba-bdff-e7e84d69a963. Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ad616334-2280-4a84-a9e9-1ce70fc49bb0'] Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Returning 400 to user: Cannot associate floating IP 172.25.5.173 (6c8e8f08-4ede-448f-b38f-6366d88fc76c) with port 26a9ba3f-e269-4580-b31d-95b12b0c1e21 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network de643343-c49d-40ba-bdff-e7e84d69a963. Oct 05 17:35:16.035562 n-d-835595-3 devstack@n-api.service[128844]: Neutron server returns request_ids: ['req-ad616334-2280-4a84-a9e9-1ce70fc49bb0'] {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:16.036441 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ffee8722-50d5-4546-9444-74667a10d717 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action" status: 400 len: 382 microversion: 2.1 time: 0.906373 Oct 05 17:35:16.036441 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 565/1111] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:15 2022] POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action => generated 382 bytes in 909 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:35:16.041167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-717abb8d-2c1d-4a93-a3f2-ede4469c78e8 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '.version_select at 0x7f7775896d30>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:16.137323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-46565757-60b1-4896-9a09-2adf4457a08c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:16.138016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-46565757-60b1-4896-9a09-2adf4457a08c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:16.147865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46565757-60b1-4896-9a09-2adf4457a08c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:16.149595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46565757-60b1-4896-9a09-2adf4457a08c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:16.150109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46565757-60b1-4896-9a09-2adf4457a08c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:16.151159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46565757-60b1-4896-9a09-2adf4457a08c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:16.152732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46565757-60b1-4896-9a09-2adf4457a08c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:16.154754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46565757-60b1-4896-9a09-2adf4457a08c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:16.167598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:16.386562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46565757-60b1-4896-9a09-2adf4457a08c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:16.395118 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-46565757-60b1-4896-9a09-2adf4457a08c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1541 microversion: 2.1 time: 0.262457 Oct 05 17:35:16.396817 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 566/1112] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:16 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1541 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:16.402172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a44b2252-6821-475d-ade1-1ff9674724b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:16.403064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a44b2252-6821-475d-ade1-1ff9674724b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:16.409906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a44b2252-6821-475d-ade1-1ff9674724b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:16.410659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a44b2252-6821-475d-ade1-1ff9674724b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:16.411286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a44b2252-6821-475d-ade1-1ff9674724b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:16.412147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a44b2252-6821-475d-ade1-1ff9674724b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:16.412757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a44b2252-6821-475d-ade1-1ff9674724b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:16.413391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a44b2252-6821-475d-ade1-1ff9674724b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:16.520192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a44b2252-6821-475d-ade1-1ff9674724b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:16.542050 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a44b2252-6821-475d-ade1-1ff9674724b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1210 microversion: 2.1 time: 0.143472 Oct 05 17:35:16.543753 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 567/1113] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:16 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1210 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:16.551664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:16.555229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:16.563552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:16.564047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:16.564479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:16.565511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:16.565969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:16.566421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:16.702997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:16.716029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:16.717695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:16.740977 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a8a6de5b-b43b-48e6-9162-b55e81a5b372 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.194851 Oct 05 17:35:16.751414 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 568/1114] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:16 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:16.914146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:16.914950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:16.924336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:16.928855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:16.929623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:16.930619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:16.931265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:16.933315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:17.283095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:17.305016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:17.309611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:17.311610 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4f01809e-ee25-445d-b0f5-5ed01c6e88d0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1410 microversion: 2.25 time: 0.405476 Oct 05 17:35:17.323060 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 569/1115] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:16 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1410 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:35:17.421117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7304a005-3b14-48a8-80f3-957ef4a03a73 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:17.422032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7304a005-3b14-48a8-80f3-957ef4a03a73 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:17.430070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7304a005-3b14-48a8-80f3-957ef4a03a73 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:17.430836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7304a005-3b14-48a8-80f3-957ef4a03a73 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:17.432851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7304a005-3b14-48a8-80f3-957ef4a03a73 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:17.434887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7304a005-3b14-48a8-80f3-957ef4a03a73 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:17.435570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7304a005-3b14-48a8-80f3-957ef4a03a73 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:17.436323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7304a005-3b14-48a8-80f3-957ef4a03a73 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:17.774728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7304a005-3b14-48a8-80f3-957ef4a03a73 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:17.790897 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7304a005-3b14-48a8-80f3-957ef4a03a73 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1540 microversion: 2.1 time: 0.368979 Oct 05 17:35:17.791685 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 570/1116] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:17 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1540 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:17.820684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13de4ca2-83ed-4b1f-85a3-b1ecc84116d1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:17.821614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13de4ca2-83ed-4b1f-85a3-b1ecc84116d1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:17.835479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de4ca2-83ed-4b1f-85a3-b1ecc84116d1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:17.838736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de4ca2-83ed-4b1f-85a3-b1ecc84116d1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:17.839258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de4ca2-83ed-4b1f-85a3-b1ecc84116d1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:17.841574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de4ca2-83ed-4b1f-85a3-b1ecc84116d1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:17.842147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de4ca2-83ed-4b1f-85a3-b1ecc84116d1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:17.842691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de4ca2-83ed-4b1f-85a3-b1ecc84116d1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:17.982144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-13de4ca2-83ed-4b1f-85a3-b1ecc84116d1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:17.992483 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13de4ca2-83ed-4b1f-85a3-b1ecc84116d1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1284 microversion: 2.1 time: 0.187925 Oct 05 17:35:17.998419 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 571/1117] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:17 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:18.026836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:18.029489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:18.045733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:18.048809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:18.049575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:18.050206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:18.052481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:18.056025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:18.056840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:18.211825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:18.228082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:18.230919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:18.250692 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2201193-ff27-4b0c-ac12-e41fc11449f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.232767 Oct 05 17:35:18.252982 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 572/1118] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:18 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:18.343788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:18.345846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:18.353584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:18.354430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:18.354977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:18.356065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:18.356835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:18.357358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:18.538197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:18.551538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:18.554862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:18.556429 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-218d5217-df96-4423-b9fb-b39bb419bfcf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1410 microversion: 2.25 time: 0.222601 Oct 05 17:35:18.571957 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 573/1119] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:18 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1410 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:19.099352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-da60c6b2-4b16-4bcb-afeb-b0e2b9539dcd tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-189035308", "id": 752452435, "os-flavor-access:is_public": "False"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:19.133450 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-da60c6b2-4b16-4bcb-afeb-b0e2b9539dcd tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.553782 Oct 05 17:35:19.137672 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 574/1120] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:35:18 2022] POST /compute/v2.1/flavors => generated 435 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:19.161767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c6005b1-8dd7-4a60-9bf1-5d9e0f6588eb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:19.162716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c6005b1-8dd7-4a60-9bf1-5d9e0f6588eb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:19.178447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c6005b1-8dd7-4a60-9bf1-5d9e0f6588eb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:19.180239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c6005b1-8dd7-4a60-9bf1-5d9e0f6588eb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:19.181329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c6005b1-8dd7-4a60-9bf1-5d9e0f6588eb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:19.183331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c6005b1-8dd7-4a60-9bf1-5d9e0f6588eb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:19.185119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c6005b1-8dd7-4a60-9bf1-5d9e0f6588eb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:19.185714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c6005b1-8dd7-4a60-9bf1-5d9e0f6588eb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:19.485774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0c6005b1-8dd7-4a60-9bf1-5d9e0f6588eb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:19.494067 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0c6005b1-8dd7-4a60-9bf1-5d9e0f6588eb tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1540 microversion: 2.1 time: 0.346851 Oct 05 17:35:19.519519 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 575/1121] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:19 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1540 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:19.527130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cba86231-3d6c-4c13-8e8f-481f1326fc48 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:19.533215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cba86231-3d6c-4c13-8e8f-481f1326fc48 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:19.548437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cba86231-3d6c-4c13-8e8f-481f1326fc48 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:19.549282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cba86231-3d6c-4c13-8e8f-481f1326fc48 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:19.549964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cba86231-3d6c-4c13-8e8f-481f1326fc48 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:19.551123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cba86231-3d6c-4c13-8e8f-481f1326fc48 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:19.551826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cba86231-3d6c-4c13-8e8f-481f1326fc48 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:19.552499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cba86231-3d6c-4c13-8e8f-481f1326fc48 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:19.656121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cba86231-3d6c-4c13-8e8f-481f1326fc48 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:19.667504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cba86231-3d6c-4c13-8e8f-481f1326fc48 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1272 microversion: 2.1 time: 0.146209 Oct 05 17:35:19.686818 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 576/1122] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:19 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:19.694651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3f025e22-9ae0-4a51-9841-dbb6cde5072c req-47a5805c-9efe-4b21-b884-f40258489a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63958af-abf6-42db-be31-d666ae842191", "name": "network-vif-plugged", "status": "completed", "tag": "341a9f89-e472-44f2-8da1-34fc17c91f7b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:19.706233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3f025e22-9ae0-4a51-9841-dbb6cde5072c req-47a5805c-9efe-4b21-b884-f40258489a59 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:19.707219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3f025e22-9ae0-4a51-9841-dbb6cde5072c req-47a5805c-9efe-4b21-b884-f40258489a59 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:19.707879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3f025e22-9ae0-4a51-9841-dbb6cde5072c req-47a5805c-9efe-4b21-b884-f40258489a59 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:19.723674 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3f025e22-9ae0-4a51-9841-dbb6cde5072c req-47a5805c-9efe-4b21-b884-f40258489a59 service nova] Creating event network-vif-plugged:341a9f89-e472-44f2-8da1-34fc17c91f7b for instance a63958af-abf6-42db-be31-d666ae842191 on n-h1-835595-3 Oct 05 17:35:19.730975 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3f025e22-9ae0-4a51-9841-dbb6cde5072c req-47a5805c-9efe-4b21-b884-f40258489a59 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040291 Oct 05 17:35:19.732553 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 577/1123] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:19.739987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f6e3aec9-40c2-46c9-8223-2185ced4ca88 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "01cf740288ee4c198c9560c01c91ec8b"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:19.850221 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f6e3aec9-40c2-46c9-8223-2185ced4ca88 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/752452435/action" status: 200 len: 96 microversion: 2.1 time: 0.116105 Oct 05 17:35:19.860946 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 578/1124] 10.222.0.70 () {60 vars in 1197 bytes} [Wed Oct 5 17:35:19 2022] POST /compute/v2.1/flavors/752452435/action => generated 96 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:19.872369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:19.877936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:19.918480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:19.919234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:19.922313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:19.923282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:19.923909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:19.928632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:20.056717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:20.069409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:20.071047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:20.080926 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-31e547c8-41f6-408a-851e-24118e6695fd tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.217158 Oct 05 17:35:20.082125 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 579/1125] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:19 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:20.087686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:20.089098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:20.096202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:20.098071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:20.099269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:20.100308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:20.101283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:20.102064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:20.622431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:20.631022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:20.637494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:20.648633 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3725bc8e-c7f2-46c5-9306-13f18aa77c0e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1410 microversion: 2.25 time: 0.565052 Oct 05 17:35:20.649519 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 580/1126] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:20 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1410 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:20.654114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d46b7e99-4ae2-46b7-b7ed-c16e0feef117 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "01cf740288ee4c198c9560c01c91ec8b"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:20.729693 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d46b7e99-4ae2-46b7-b7ed-c16e0feef117 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] HTTP exception thrown: Flavor access already exists for flavor 36 and project 01cf740288ee4c198c9560c01c91ec8b combination. Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d46b7e99-4ae2-46b7-b7ed-c16e0feef117 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Request method failure captured: Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/flavors/752452435/action HTTP/1.1 Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 67 Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBVzf94fSxe5_fFYdbbeQOJ9uAh6wvo95KcJGMQQkKyLm5rqP5-H2Wpw6zyLZdlqKzmfvCP99TGxgvFjdw9Ciu3Y3DVKJoN2fhAHWEMyYbt4aFieFyEvNYna2QBaK-UFrfL71RN0vrn7Q2hc-2_mIt9qAxg2Hmdz_5POmS9ar9-4TU Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 72f7b2a33acb4a9fbfa41f57d92a2d8d Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-884418649 Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:35:20.739697 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72f7b2a33acb4a9fbfa41f57d92a2d8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72f7b2a33acb4a9fbfa41f57d92a2d8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72f7b2a33acb4a9fbfa41f57d92a2d8d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72f7b2a33acb4a9fbfa41f57d92a2d8d"}]}] Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-884418649 Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 72f7b2a33acb4a9fbfa41f57d92a2d8d Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-884418649 Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 701cf2911aae4dc0b169633fa85004de Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: {"addTenantAccess": {"tenant": "01cf740288ee4c198c9560c01c91ec8b"}} Oct 05 17:35:20.741481 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: exception: Flavor access already exists for flavor 36 and project 01cf740288ee4c198c9560c01c91ec8b combination. Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '752452435', 'body': {'addTenantAccess': {'tenant': '01cf740288ee4c198c9560c01c91ec8b'}}} Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result.read() Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 17:35:20.742436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '36-01cf740288ee4c198c9560c01c91ec8b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi session.flush() Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 17:35:20.743823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 17:35:20.745255 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 17:35:20.746562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result.read() Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '36-01cf740288ee4c198c9560c01c91ec8b' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 5, 17, 35, 20, 723936), 'updated_at': None, 'flavor_id': 36, 'project_id': '01cf740288ee4c198c9560c01c91ec8b'}] Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:20.747967 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 36 and project 01cf740288ee4c198c9560c01c91ec8b combination. Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:20.749002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 36 and project 01cf740288ee4c198c9560c01c91ec8b combination. Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:20.751768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:20.753996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 36 and project 01cf740288ee4c198c9560c01c91ec8b combination. Oct 05 17:35:20.753996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:20.753996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d46b7e99-4ae2-46b7-b7ed-c16e0feef117 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Returning 409 to user: Flavor access already exists for flavor 36 and project 01cf740288ee4c198c9560c01c91ec8b combination. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:20.753996 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d46b7e99-4ae2-46b7-b7ed-c16e0feef117 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/752452435/action" status: 409 len: 152 microversion: 2.1 time: 0.092297 Oct 05 17:35:20.753996 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 581/1127] 10.222.0.70 () {60 vars in 1197 bytes} [Wed Oct 5 17:35:20 2022] POST /compute/v2.1/flavors/752452435/action => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:35:20.764036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f31e8f6f-edf8-4a01-b8c5-d8a8c7542ef2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:20.764709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f31e8f6f-edf8-4a01-b8c5-d8a8c7542ef2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:20.771510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f31e8f6f-edf8-4a01-b8c5-d8a8c7542ef2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:20.772010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f31e8f6f-edf8-4a01-b8c5-d8a8c7542ef2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:20.772445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f31e8f6f-edf8-4a01-b8c5-d8a8c7542ef2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:20.773161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f31e8f6f-edf8-4a01-b8c5-d8a8c7542ef2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:20.773621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f31e8f6f-edf8-4a01-b8c5-d8a8c7542ef2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:20.774068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f31e8f6f-edf8-4a01-b8c5-d8a8c7542ef2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:20.927936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f31e8f6f-edf8-4a01-b8c5-d8a8c7542ef2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:20.936789 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f31e8f6f-edf8-4a01-b8c5-d8a8c7542ef2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1540 microversion: 2.1 time: 0.189284 Oct 05 17:35:20.952844 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 582/1128] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:20 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1540 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:20.952844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23cb242e-803f-456b-a088-603cea30c258 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:20.952844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-23cb242e-803f-456b-a088-603cea30c258 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:20.956732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cb242e-803f-456b-a088-603cea30c258 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:20.957702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cb242e-803f-456b-a088-603cea30c258 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:20.958242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cb242e-803f-456b-a088-603cea30c258 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:20.959297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cb242e-803f-456b-a088-603cea30c258 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:20.959878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cb242e-803f-456b-a088-603cea30c258 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:20.960412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cb242e-803f-456b-a088-603cea30c258 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:21.045678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23cb242e-803f-456b-a088-603cea30c258 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:21.056919 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-23cb242e-803f-456b-a088-603cea30c258 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1272 microversion: 2.1 time: 0.111256 Oct 05 17:35:21.069865 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 583/1129] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:20 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:21.080913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27407125-e2e5-41f2-b5c9-c13141e3d35a tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "01cf740288ee4c198c9560c01c91ec8b"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:21.146548 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-717abb8d-2c1d-4a93-a3f2-ede4469c78e8 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/6c8e8f08-4ede-448f-b38f-6366d88fc76c" status: 202 len: 0 microversion: 2.1 time: 5.107889 Oct 05 17:35:21.147726 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 547/1130] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:35:16 2022] DELETE /compute/v2.1/os-floating-ips/6c8e8f08-4ede-448f-b38f-6366d88fc76c => generated 0 bytes in 5112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:21.153663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:21.154494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:21.168533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:21.169128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:21.169685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:21.170817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:21.171378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:21.172079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:21.209165 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27407125-e2e5-41f2-b5c9-c13141e3d35a tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/752452435/action" status: 200 len: 21 microversion: 2.1 time: 0.137669 Oct 05 17:35:21.209767 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 584/1131] 10.222.0.70 () {60 vars in 1197 bytes} [Wed Oct 5 17:35:21 2022] POST /compute/v2.1/flavors/752452435/action => generated 21 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:21.220229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Action: 'action', calling method: .version_select at 0x7f77779659d0>, body: {"removeFloatingIp": {"address": "172.25.5.145"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:21.321207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:21.331094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:21.332539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:21.349863 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4c17cf79-5cee-4a0c-bf86-75c7f40373c1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.200705 Oct 05 17:35:21.350689 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 548/1132] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:21 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:21.356704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a8d71b73-a1f3-41db-aad0-496de3b6cdcd tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:21.377729 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a8d71b73-a1f3-41db-aad0-496de3b6cdcd tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/752452435" status: 202 len: 0 microversion: 2.1 time: 0.025613 Oct 05 17:35:21.385109 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 549/1133] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:35:21 2022] DELETE /compute/v2.1/flavors/752452435 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:21.399482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-111e51f8-b24f-4756-be9b-5be43d0d619e tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:21.459727 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-111e51f8-b24f-4756-be9b-5be43d0d619e tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072605 Oct 05 17:35:21.462059 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 550/1134] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:35:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:21.488046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ef640549-b1c6-4dd4-942b-fb595e52a89f tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1182379733", "id": 1898560339, "os-flavor-access:is_public": "True"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:21.517540 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ef640549-b1c6-4dd4-942b-fb595e52a89f tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.033787 Oct 05 17:35:21.528992 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 551/1135] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:35:21 2022] POST /compute/v2.1/flavors => generated 438 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:21.535440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a5d99952-bbc7-46fc-86d2-334f95d6c23e tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:21.553334 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-a5d99952-bbc7-46fc-86d2-334f95d6c23e tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a5d99952-bbc7-46fc-86d2-334f95d6c23e tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Request method failure captured: Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/flavors/1898560339/os-flavor-access HTTP/1.1 Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcBVzf94fSxe5_fFYdbbeQOJ9uAh6wvo95KcJGMQQkKyLm5rqP5-H2Wpw6zyLZdlqKzmfvCP99TGxgvFjdw9Ciu3Y3DVKJoN2fhAHWEMyYbt4aFieFyEvNYna2QBaK-UFrfL71RN0vrn7Q2hc-2_mIt9qAxg2Hmdz_5POmS9ar9-4TU Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 72f7b2a33acb4a9fbfa41f57d92a2d8d Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-884418649 Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:35:21.555391 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72f7b2a33acb4a9fbfa41f57d92a2d8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72f7b2a33acb4a9fbfa41f57d92a2d8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72f7b2a33acb4a9fbfa41f57d92a2d8d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72f7b2a33acb4a9fbfa41f57d92a2d8d"}]}] Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-884418649 Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 72f7b2a33acb4a9fbfa41f57d92a2d8d Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-884418649 Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 701cf2911aae4dc0b169633fa85004de Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: exception: Access list not available for public flavors. Oct 05 17:35:21.556711 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'flavor_id': '1898560339'} Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 05 17:35:21.557507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:21.558989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a5d99952-bbc7-46fc-86d2-334f95d6c23e tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:21.559116 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a5d99952-bbc7-46fc-86d2-334f95d6c23e tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/1898560339/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.027402 Oct 05 17:35:21.559937 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 552/1136] 10.222.0.70 () {58 vars in 1209 bytes} [Wed Oct 5 17:35:21 2022] GET /compute/v2.1/flavors/1898560339/os-flavor-access => generated 91 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 17:35:21.565527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:21.580469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:21.580966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:21.582625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:21.584803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:21.585636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:21.587042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:21.587576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a9ced17-ceb2-4154-923b-c14575e5456c tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:21.615246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a9ced17-ceb2-4154-923b-c14575e5456c tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1898560339" status: 202 len: 0 microversion: 2.1 time: 0.032278 Oct 05 17:35:21.620176 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 553/1137] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:35:21 2022] DELETE /compute/v2.1/flavors/1898560339 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:21.630156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ef11fb9a-bb9d-46c4-a08e-6de99c02e1dd tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:21.677720 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ef11fb9a-bb9d-46c4-a08e-6de99c02e1dd tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056277 Oct 05 17:35:21.688963 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 554/1138] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:35:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:21.694171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:21.694807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:21.706085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:21.706637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:21.708267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:21.708267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:21.708267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:21.708634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:22.173628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:35:22.175746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquired lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:35:22.297849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:22.312366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:22.319622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:22.321360 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b3c0512a-33f1-4c38-841c-214b8346fe30 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1606 microversion: 2.25 time: 0.631286 Oct 05 17:35:22.323214 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 555/1139] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:21 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1606 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:22.335763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8eb9562f-064a-427a-ba24-2aa732176d57 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1591363281", "id": 891025123, "os-flavor-access:is_public": "False"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:22.378312 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8eb9562f-064a-427a-ba24-2aa732176d57 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.053803 Oct 05 17:35:22.379209 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 556/1140] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:35:22 2022] POST /compute/v2.1/flavors => generated 436 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:22.398001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-69eaa173-fea4-400f-95d7-f7b92038ab79 req-a4dac2a5-f184-44c5-801c-1a1983f5faa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3793214f-3607-4041-8f62-fd2b36f1b171", "name": "network-vif-unplugged", "status": "completed", "tag": "8fd18242-e1fd-42af-9db6-62c95ec947e4"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:22.413411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-69eaa173-fea4-400f-95d7-f7b92038ab79 req-a4dac2a5-f184-44c5-801c-1a1983f5faa0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:22.414105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-69eaa173-fea4-400f-95d7-f7b92038ab79 req-a4dac2a5-f184-44c5-801c-1a1983f5faa0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:22.414820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-69eaa173-fea4-400f-95d7-f7b92038ab79 req-a4dac2a5-f184-44c5-801c-1a1983f5faa0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:22.437361 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-69eaa173-fea4-400f-95d7-f7b92038ab79 req-a4dac2a5-f184-44c5-801c-1a1983f5faa0 service nova] Creating event network-vif-unplugged:8fd18242-e1fd-42af-9db6-62c95ec947e4 for instance 3793214f-3607-4041-8f62-fd2b36f1b171 on n-h1-835595-3 Oct 05 17:35:22.450665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-69eaa173-fea4-400f-95d7-f7b92038ab79 req-a4dac2a5-f184-44c5-801c-1a1983f5faa0 service nova] Instance 3793214f-3607-4041-8f62-fd2b36f1b171 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:35:22.469877 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-69eaa173-fea4-400f-95d7-f7b92038ab79 req-a4dac2a5-f184-44c5-801c-1a1983f5faa0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078219 Oct 05 17:35:22.471252 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 557/1141] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:22.482140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-093ea3f3-1c91-4f29-b2e0-dfa35018adba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:22.484872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-093ea3f3-1c91-4f29-b2e0-dfa35018adba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:22.499539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-093ea3f3-1c91-4f29-b2e0-dfa35018adba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:22.499794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-093ea3f3-1c91-4f29-b2e0-dfa35018adba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:22.500269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-093ea3f3-1c91-4f29-b2e0-dfa35018adba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:22.501576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-093ea3f3-1c91-4f29-b2e0-dfa35018adba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:22.502045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-093ea3f3-1c91-4f29-b2e0-dfa35018adba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:22.502507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-093ea3f3-1c91-4f29-b2e0-dfa35018adba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:23.035008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-093ea3f3-1c91-4f29-b2e0-dfa35018adba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:23.046341 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-093ea3f3-1c91-4f29-b2e0-dfa35018adba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1472 microversion: 2.1 time: 0.573907 Oct 05 17:35:23.047220 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 558/1142] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:22 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1472 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:23.051526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f5e451b-c244-4bb3-ae77-d193f4ada31c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:23.052129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0f5e451b-c244-4bb3-ae77-d193f4ada31c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:23.075067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f5e451b-c244-4bb3-ae77-d193f4ada31c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:23.075561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f5e451b-c244-4bb3-ae77-d193f4ada31c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:23.080388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f5e451b-c244-4bb3-ae77-d193f4ada31c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:23.082057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f5e451b-c244-4bb3-ae77-d193f4ada31c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:23.082582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f5e451b-c244-4bb3-ae77-d193f4ada31c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:23.083024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f5e451b-c244-4bb3-ae77-d193f4ada31c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:23.309146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Building network info cache for instance {{(pid=128844) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 17:35:23.696885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0f5e451b-c244-4bb3-ae77-d193f4ada31c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:23.705580 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f5e451b-c244-4bb3-ae77-d193f4ada31c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.657539 Oct 05 17:35:23.718899 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 559/1143] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:23 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:23.728029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d33967e-c7cc-4d2d-9974-4cede483768d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:23.739255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9d33967e-c7cc-4d2d-9974-4cede483768d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:23.747399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d33967e-c7cc-4d2d-9974-4cede483768d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:23.748197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d33967e-c7cc-4d2d-9974-4cede483768d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:23.748640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d33967e-c7cc-4d2d-9974-4cede483768d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:23.759337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d33967e-c7cc-4d2d-9974-4cede483768d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:23.759878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d33967e-c7cc-4d2d-9974-4cede483768d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:23.760280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d33967e-c7cc-4d2d-9974-4cede483768d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:24.241814 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d33967e-c7cc-4d2d-9974-4cede483768d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.521519 Oct 05 17:35:24.254765 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 560/1144] 10.222.0.70 () {60 vars in 1316 bytes} [Wed Oct 5 17:35:23 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-interface => generated 285 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:35:24.261878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:24.262524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:24.292021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:24.303348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:24.304147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:24.323577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:24.327013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:24.335620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:24.367557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:24.385899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:24.919918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:24.949244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:24.954501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:24.972001 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d69ca30e-c2c4-4595-93d7-9a460926a0d6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.714602 Oct 05 17:35:24.998649 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 561/1145] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:24 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:25.117532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=12 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:25.350672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0e0dd058-37c3-4362-9912-35a381570bb6 tempest-FlavorsAccessNegativeTestJSON-1586351389 tempest-FlavorsAccessNegativeTestJSON-1586351389-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "01cf740288ee4c198c9560c01c91ec8b"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:25.355244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0e0dd058-37c3-4362-9912-35a381570bb6 tempest-FlavorsAccessNegativeTestJSON-1586351389 tempest-FlavorsAccessNegativeTestJSON-1586351389-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '10c1bb3224284303aae1a5b20d9d9aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cf740288ee4c198c9560c01c91ec8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0e0dd058-37c3-4362-9912-35a381570bb6 tempest-FlavorsAccessNegativeTestJSON-1586351389 tempest-FlavorsAccessNegativeTestJSON-1586351389-project] Request method failure captured: Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/flavors/891025123/action HTTP/1.1 Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 67 Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcBUyQMswLoqSO3wO4vla7xLHemAV4McbvnY3HKY2Zk9mWWaFkHREjpRB8MvrdHMsjQ0P-wYnbsA7HHAwUwx1IBu4KLZ3dFiWcmwv8_XJmwfSCVJp5-rNe49Tgxq90s-BFvbOa6DkUQ9WSMeXyAJKiS74lmnJ8sqF34ke6wfTvVZ_ZM Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 01cf740288ee4c198c9560c01c91ec8b Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1586351389 Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:35:25.357026 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/01cf740288ee4c198c9560c01c91ec8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/01cf740288ee4c198c9560c01c91ec8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_01cf740288ee4c198c9560c01c91ec8b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/01cf740288ee4c198c9560c01c91ec8b"}]}] Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1586351389 Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 01cf740288ee4c198c9560c01c91ec8b Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1586351389 Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FlavorsAccessNegativeTestJSON-1586351389-project Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 10c1bb3224284303aae1a5b20d9d9aa2 Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1586351389-project Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: {"addTenantAccess": {"tenant": "01cf740288ee4c198c9560c01c91ec8b"}} Oct 05 17:35:25.358770 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '891025123', 'body': {'addTenantAccess': {'tenant': '01cf740288ee4c198c9560c01c91ec8b'}}} Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:35:25.360141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 05 17:35:25.361709 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:25.363807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0e0dd058-37c3-4362-9912-35a381570bb6 tempest-FlavorsAccessNegativeTestJSON-1586351389 tempest-FlavorsAccessNegativeTestJSON-1586351389-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:25.371984 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0e0dd058-37c3-4362-9912-35a381570bb6 tempest-FlavorsAccessNegativeTestJSON-1586351389 tempest-FlavorsAccessNegativeTestJSON-1586351389-project] 10.222.0.70 "POST /compute/v2.1/flavors/891025123/action" status: 403 len: 130 microversion: 2.1 time: 0.357869 Oct 05 17:35:25.379617 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 562/1146] 10.222.0.70 () {60 vars in 1197 bytes} [Wed Oct 5 17:35:24 2022] POST /compute/v2.1/flavors/891025123/action => generated 130 bytes in 382 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:35:25.392514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-38f11bb4-2bd1-481d-aa85-43116787130e req-71bf6d5a-4c91-40c8-a4d8-18977a921cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0b701-73ce-4633-be8b-d2a78230b701", "tag": "26a9ba3f-e269-4580-b31d-95b12b0c1e21"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:25.453699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-38f11bb4-2bd1-481d-aa85-43116787130e req-71bf6d5a-4c91-40c8-a4d8-18977a921cc2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:25.455134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-38f11bb4-2bd1-481d-aa85-43116787130e req-71bf6d5a-4c91-40c8-a4d8-18977a921cc2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:25.457821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-38f11bb4-2bd1-481d-aa85-43116787130e req-71bf6d5a-4c91-40c8-a4d8-18977a921cc2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:25.545237 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-38f11bb4-2bd1-481d-aa85-43116787130e req-71bf6d5a-4c91-40c8-a4d8-18977a921cc2 service nova] Creating event network-changed:26a9ba3f-e269-4580-b31d-95b12b0c1e21 for instance 51c0b701-73ce-4633-be8b-d2a78230b701 on n-h2-835595-3 Oct 05 17:35:25.554218 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-38f11bb4-2bd1-481d-aa85-43116787130e req-71bf6d5a-4c91-40c8-a4d8-18977a921cc2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172937 Oct 05 17:35:25.556787 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 563/1147] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:25.571280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dc8d32e8-4510-4660-8654-847fbeb10bc0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:25.571849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dc8d32e8-4510-4660-8654-847fbeb10bc0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:25.591935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc8d32e8-4510-4660-8654-847fbeb10bc0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:25.593246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc8d32e8-4510-4660-8654-847fbeb10bc0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:25.596500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc8d32e8-4510-4660-8654-847fbeb10bc0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:25.597762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc8d32e8-4510-4660-8654-847fbeb10bc0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:25.600514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc8d32e8-4510-4660-8654-847fbeb10bc0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:25.601549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc8d32e8-4510-4660-8654-847fbeb10bc0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:26.035687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Updating instance_info_cache with network_info: [{"id": "26a9ba3f-e269-4580-b31d-95b12b0c1e21", "address": "fa:16:3e:83:77:0c", "network": {"id": "ea241c31-49cc-49d5-85d6-e6b48dbd2dff", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1559608266-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "065544965253483e8e506c98a39646ce", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap26a9ba3f-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128844) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:35:26.051965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Releasing lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:35:26.054681 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13de8c88-b2b5-49c6-8668-40382f22cc82 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action" status: 202 len: 0 microversion: 2.1 time: 4.841002 Oct 05 17:35:26.063334 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 585/1148] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:21 2022] POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action => generated 0 bytes in 4850 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 17:35:26.089327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fcb66d24-4c86-4e2f-af2e-09dbc47be7b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:26.090102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fcb66d24-4c86-4e2f-af2e-09dbc47be7b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:26.118252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcb66d24-4c86-4e2f-af2e-09dbc47be7b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:26.118784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcb66d24-4c86-4e2f-af2e-09dbc47be7b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:26.119219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcb66d24-4c86-4e2f-af2e-09dbc47be7b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:26.119928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcb66d24-4c86-4e2f-af2e-09dbc47be7b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:26.120382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcb66d24-4c86-4e2f-af2e-09dbc47be7b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:26.120802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcb66d24-4c86-4e2f-af2e-09dbc47be7b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:26.213536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:26.663995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fcb66d24-4c86-4e2f-af2e-09dbc47be7b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:26.679865 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fcb66d24-4c86-4e2f-af2e-09dbc47be7b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.615103 Oct 05 17:35:26.682802 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 586/1149] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:26 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:26.698669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43e112a6-f9a2-43a7-a0a1-6377def0832f tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:26.757828 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-43e112a6-f9a2-43a7-a0a1-6377def0832f tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/891025123" status: 202 len: 0 microversion: 2.1 time: 0.071829 Oct 05 17:35:26.761793 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 587/1150] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:35:26 2022] DELETE /compute/v2.1/flavors/891025123 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:26.766849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-1430346d-7ecd-40e1-93d5-16c56b8253ba req-bedf3e13-55de-44cd-b75e-47e93aaf8e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ed8f88-a944-458d-8c5a-5264bce6dad6", "tag": "b64c94bd-1f5c-4c74-b4ca-f8d4b3407486"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:26.792690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1430346d-7ecd-40e1-93d5-16c56b8253ba req-bedf3e13-55de-44cd-b75e-47e93aaf8e0d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:26.793178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1430346d-7ecd-40e1-93d5-16c56b8253ba req-bedf3e13-55de-44cd-b75e-47e93aaf8e0d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:26.793842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1430346d-7ecd-40e1-93d5-16c56b8253ba req-bedf3e13-55de-44cd-b75e-47e93aaf8e0d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:26.842362 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-1430346d-7ecd-40e1-93d5-16c56b8253ba req-bedf3e13-55de-44cd-b75e-47e93aaf8e0d service nova] Creating event network-changed:b64c94bd-1f5c-4c74-b4ca-f8d4b3407486 for instance 09ed8f88-a944-458d-8c5a-5264bce6dad6 on n-h1-835595-3 Oct 05 17:35:26.849004 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-1430346d-7ecd-40e1-93d5-16c56b8253ba req-bedf3e13-55de-44cd-b75e-47e93aaf8e0d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088626 Oct 05 17:35:26.853083 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 588/1151] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:26.871384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:26.879109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:26.887362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:26.893352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:26.894081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:26.897387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:26.898840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:26.900501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:27.071155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dc8d32e8-4510-4660-8654-847fbeb10bc0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:27.080735 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dc8d32e8-4510-4660-8654-847fbeb10bc0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1469 microversion: 2.1 time: 1.522429 Oct 05 17:35:27.088465 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 564/1152] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:25 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1469 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:27.097835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f746a7e9-85da-4249-afca-8aaefa26240a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '.version_select at 0x7f7775fc6280>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:27.155196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:27.172724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:27.174037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:27.181603 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9592e9df-6ff6-4d85-8af1-2de6570670f2 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.326957 Oct 05 17:35:27.182858 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 589/1153] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:26 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:27.193817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ae086cb-2ad8-4cab-bea5-4b99f5313282 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:27.250583 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1ae086cb-2ad8-4cab-bea5-4b99f5313282 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.066183 Oct 05 17:35:27.251211 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 590/1154] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:35:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:27.263975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:27.263975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:27.284358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:27.284861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:27.287503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:27.289440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:27.291553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:27.293855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:27.365723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:27.366481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:27.367100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:27.368025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:27.368698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:27.369217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:27.403646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for project afc6422679664e47892eef7185291846. Resources: {'cores', 'ram'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:35:27.410142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for user 15a6bfffd8fb473b83de94858676f8ed and project afc6422679664e47892eef7185291846. Resources: {'cores', 'ram'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:35:27.819923 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-021ccb4e-b9a6-41eb-927a-4aec5dd37c49 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171/action" status: 202 len: 0 microversion: 2.1 time: 0.567399 Oct 05 17:35:27.826382 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 591/1155] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:27 2022] POST /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:27.834701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-690a1d7f-b614-4f81-95c4-6b684adc8d6a tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-576182556", "id": 1012314596, "os-flavor-access:is_public": "False"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:27.885568 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-690a1d7f-b614-4f81-95c4-6b684adc8d6a tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.057623 Oct 05 17:35:27.890497 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 592/1156] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:35:27 2022] POST /compute/v2.1/flavors => generated 438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:27.902060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d7f7c0df-2a1f-48c2-b48e-32736ee4b144 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:27.902999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d7f7c0df-2a1f-48c2-b48e-32736ee4b144 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:27.920108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7f7c0df-2a1f-48c2-b48e-32736ee4b144 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:27.922408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7f7c0df-2a1f-48c2-b48e-32736ee4b144 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:27.922968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7f7c0df-2a1f-48c2-b48e-32736ee4b144 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:27.926888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7f7c0df-2a1f-48c2-b48e-32736ee4b144 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:27.927545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7f7c0df-2a1f-48c2-b48e-32736ee4b144 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:27.928460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7f7c0df-2a1f-48c2-b48e-32736ee4b144 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:28.744166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d7f7c0df-2a1f-48c2-b48e-32736ee4b144 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:28.752090 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d7f7c0df-2a1f-48c2-b48e-32736ee4b144 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.860114 Oct 05 17:35:28.767959 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 593/1157] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:27 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:28.772916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d7e04677-619c-41f8-8a1c-cfb27d887d40 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:28.773547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d7e04677-619c-41f8-8a1c-cfb27d887d40 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:28.779660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7e04677-619c-41f8-8a1c-cfb27d887d40 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:28.780131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7e04677-619c-41f8-8a1c-cfb27d887d40 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:28.780568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7e04677-619c-41f8-8a1c-cfb27d887d40 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:28.781357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7e04677-619c-41f8-8a1c-cfb27d887d40 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:28.781813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7e04677-619c-41f8-8a1c-cfb27d887d40 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:28.782234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7e04677-619c-41f8-8a1c-cfb27d887d40 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:28.964948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d7e04677-619c-41f8-8a1c-cfb27d887d40 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:28.973787 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d7e04677-619c-41f8-8a1c-cfb27d887d40 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1468 microversion: 2.1 time: 0.204628 Oct 05 17:35:28.975598 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 594/1158] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:28 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1468 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:28.980099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c73578e-13c1-4b3d-be88-68f46f079309 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "01cf740288ee4c198c9560c01c91ec8b"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:29.061504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c73578e-13c1-4b3d-be88-68f46f079309 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1012314596/action" status: 200 len: 97 microversion: 2.1 time: 0.084901 Oct 05 17:35:29.062313 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 595/1159] 10.222.0.70 () {60 vars in 1200 bytes} [Wed Oct 5 17:35:28 2022] POST /compute/v2.1/flavors/1012314596/action => generated 97 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:29.066947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4dfa04ff-cd15-45d0-87cc-74a238edadac req-f9b1f139-237d-4740-8553-6bff12772196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3793214f-3607-4041-8f62-fd2b36f1b171", "name": "network-vif-plugged", "status": "completed", "tag": "8fd18242-e1fd-42af-9db6-62c95ec947e4"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:29.079391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4dfa04ff-cd15-45d0-87cc-74a238edadac req-f9b1f139-237d-4740-8553-6bff12772196 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:29.080806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4dfa04ff-cd15-45d0-87cc-74a238edadac req-f9b1f139-237d-4740-8553-6bff12772196 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:29.081447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4dfa04ff-cd15-45d0-87cc-74a238edadac req-f9b1f139-237d-4740-8553-6bff12772196 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:29.095479 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4dfa04ff-cd15-45d0-87cc-74a238edadac req-f9b1f139-237d-4740-8553-6bff12772196 service nova] Creating event network-vif-plugged:8fd18242-e1fd-42af-9db6-62c95ec947e4 for instance 3793214f-3607-4041-8f62-fd2b36f1b171 on n-h1-835595-3 Oct 05 17:35:29.101537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-4dfa04ff-cd15-45d0-87cc-74a238edadac req-f9b1f139-237d-4740-8553-6bff12772196 service nova] Instance 3793214f-3607-4041-8f62-fd2b36f1b171 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:35:29.108114 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4dfa04ff-cd15-45d0-87cc-74a238edadac req-f9b1f139-237d-4740-8553-6bff12772196 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044813 Oct 05 17:35:29.108938 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 596/1160] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:29.114108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-79a7e9e6-3054-4a49-acba-40b8d52a825a req-85f509ec-758b-47ba-8e1a-afbbcd44953d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63958af-abf6-42db-be31-d666ae842191", "tag": "341a9f89-e472-44f2-8da1-34fc17c91f7b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:29.124569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-79a7e9e6-3054-4a49-acba-40b8d52a825a req-85f509ec-758b-47ba-8e1a-afbbcd44953d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:29.125094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-79a7e9e6-3054-4a49-acba-40b8d52a825a req-85f509ec-758b-47ba-8e1a-afbbcd44953d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:29.125521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-79a7e9e6-3054-4a49-acba-40b8d52a825a req-85f509ec-758b-47ba-8e1a-afbbcd44953d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:29.136840 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-79a7e9e6-3054-4a49-acba-40b8d52a825a req-85f509ec-758b-47ba-8e1a-afbbcd44953d service nova] Creating event network-changed:341a9f89-e472-44f2-8da1-34fc17c91f7b for instance a63958af-abf6-42db-be31-d666ae842191 on n-h1-835595-3 Oct 05 17:35:29.141782 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-79a7e9e6-3054-4a49-acba-40b8d52a825a req-85f509ec-758b-47ba-8e1a-afbbcd44953d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031343 Oct 05 17:35:29.142744 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 597/1161] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:29.147932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:29.148622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:29.154910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:29.155447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:29.155903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:29.156925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:29.157603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:29.158318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:29.238697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:29.249866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:29.251453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:29.258268 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2b960b0c-9da1-43f5-b5d0-06b69421e5f8 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.113964 Oct 05 17:35:29.258820 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 598/1162] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:29 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:29.263987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6ca83d32-7b7c-4b72-af76-d0a0acc269ba tempest-FlavorsAccessNegativeTestJSON-1586351389 tempest-FlavorsAccessNegativeTestJSON-1586351389-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "01cf740288ee4c198c9560c01c91ec8b"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:29.267660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6ca83d32-7b7c-4b72-af76-d0a0acc269ba tempest-FlavorsAccessNegativeTestJSON-1586351389 tempest-FlavorsAccessNegativeTestJSON-1586351389-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '10c1bb3224284303aae1a5b20d9d9aa2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cf740288ee4c198c9560c01c91ec8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6ca83d32-7b7c-4b72-af76-d0a0acc269ba tempest-FlavorsAccessNegativeTestJSON-1586351389 tempest-FlavorsAccessNegativeTestJSON-1586351389-project] Request method failure captured: Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/flavors/1012314596/action HTTP/1.1 Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 70 Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBUyQMswLoqSO3wO4vla7xLHemAV4McbvnY3HKY2Zk9mWWaFkHREjpRB8MvrdHMsjQ0P-wYnbsA7HHAwUwx1IBu4KLZ3dFiWcmwv8_XJmwfSCVJp5-rNe49Tgxq90s-BFvbOa6DkUQ9WSMeXyAJKiS74lmnJ8sqF34ke6wfTvVZ_ZM Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 01cf740288ee4c198c9560c01c91ec8b Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1586351389 Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:29.269968 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/01cf740288ee4c198c9560c01c91ec8b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/01cf740288ee4c198c9560c01c91ec8b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_01cf740288ee4c198c9560c01c91ec8b", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/01cf740288ee4c198c9560c01c91ec8b"}]}] Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1586351389 Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 01cf740288ee4c198c9560c01c91ec8b Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1586351389 Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FlavorsAccessNegativeTestJSON-1586351389-project Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 10c1bb3224284303aae1a5b20d9d9aa2 Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1586351389-project Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: {"removeTenantAccess": {"tenant": "01cf740288ee4c198c9560c01c91ec8b"}} Oct 05 17:35:29.271440 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '1012314596', 'body': {'removeTenantAccess': {'tenant': '01cf740288ee4c198c9560c01c91ec8b'}}} Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can( Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:35:29.272231 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 05 17:35:29.273775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.276092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6ca83d32-7b7c-4b72-af76-d0a0acc269ba tempest-FlavorsAccessNegativeTestJSON-1586351389 tempest-FlavorsAccessNegativeTestJSON-1586351389-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:29.276092 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6ca83d32-7b7c-4b72-af76-d0a0acc269ba tempest-FlavorsAccessNegativeTestJSON-1586351389 tempest-FlavorsAccessNegativeTestJSON-1586351389-project] 10.222.0.70 "POST /compute/v2.1/flavors/1012314596/action" status: 403 len: 133 microversion: 2.1 time: 0.012113 Oct 05 17:35:29.276092 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 599/1163] 10.222.0.70 () {60 vars in 1200 bytes} [Wed Oct 5 17:35:29 2022] POST /compute/v2.1/flavors/1012314596/action => generated 133 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:35:29.289973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-761b23c1-2eba-4763-8f6f-9118b17cc5c3 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "01cf740288ee4c198c9560c01c91ec8b"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:29.369041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:29.408521 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-761b23c1-2eba-4763-8f6f-9118b17cc5c3 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1012314596/action" status: 200 len: 21 microversion: 2.1 time: 0.122291 Oct 05 17:35:29.409333 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 600/1164] 10.222.0.70 () {60 vars in 1200 bytes} [Wed Oct 5 17:35:29 2022] POST /compute/v2.1/flavors/1012314596/action => generated 21 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:29.424577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5de8e64c-7c21-47d4-b0e0-d42284501800 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:29.448276 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f746a7e9-85da-4249-afca-8aaefa26240a tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/1f5c1261-9af6-4f28-a775-a5506381df2f" status: 202 len: 0 microversion: 2.1 time: 2.358537 Oct 05 17:35:29.449270 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 565/1165] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:35:27 2022] DELETE /compute/v2.1/os-floating-ips/1f5c1261-9af6-4f28-a775-a5506381df2f => generated 0 bytes in 2360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:29.454329 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5de8e64c-7c21-47d4-b0e0-d42284501800 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1012314596" status: 202 len: 0 microversion: 2.1 time: 0.033257 Oct 05 17:35:29.458079 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 601/1166] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:35:29 2022] DELETE /compute/v2.1/flavors/1012314596 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:29.460051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea4a7fca-ab4f-48d5-aa0d-9ba5028b501f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Action: 'action', calling method: .version_select at 0x7f77779658b0>, body: {"addFloatingIp": {"address": ""}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:29.463530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8afcd50a-32f5-4906-bf52-0bd1b6bc35c5 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea4a7fca-ab4f-48d5-aa0d-9ba5028b501f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Request method failure captured: Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action HTTP/1.1 Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 34 Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcAvW-3zHy31Zk49RJWapq7bc9AS9flZE-SRw7Jnbl8lfCjqFj5rg72ltRf6OpQ_t95Tax_6ss9x5u4M-TqlwGSZp4dd-oTNZPlvsPHOp5lD604r54IKmxAXnmvS6nvRMzH99-WTKdOLHJ6k94ZEh9YgK659ULXUyT1TDxXnHetKoVE Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 065544965253483e8e506c98a39646ce Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:35:29.465704 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/065544965253483e8e506c98a39646ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/065544965253483e8e506c98a39646ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_065544965253483e8e506c98a39646ce", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/065544965253483e8e506c98a39646ce"}]}] Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 065544965253483e8e506c98a39646ce Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 37ac9633604b4bea8e346140bd7915ca Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: {"addFloatingIp": {"address": ""}} Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:35:29.467302 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '51c0b701-73ce-4633-be8b-d2a78230b701', 'body': {'addFloatingIp': {'address': ''}}} Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi '' Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:29.468292 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:35:29.469774 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:35:29.471909 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 05 17:35:29.471909 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.471909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea4a7fca-ab4f-48d5-aa0d-9ba5028b501f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:29.471909 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ea4a7fca-ab4f-48d5-aa0d-9ba5028b501f tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action" status: 400 len: 142 microversion: 2.1 time: 0.014305 Oct 05 17:35:29.475418 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 566/1167] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:29 2022] POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action => generated 142 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 17:35:29.481222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:29.483668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:29.493276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:29.494027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:29.494640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:29.496241 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8afcd50a-32f5-4906-bf52-0bd1b6bc35c5 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036703 Oct 05 17:35:29.496521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:29.497076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:29.497509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:29.497644 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 602/1168] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:35:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:29.521450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e89c8c8-2481-4352-a4ad-376c0a8ebe0c tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1053900430", "id": 1770927228, "os-flavor-access:is_public": "False"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:29.545627 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e89c8c8-2481-4352-a4ad-376c0a8ebe0c tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.031508 Oct 05 17:35:29.546624 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 603/1169] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:35:29 2022] POST /compute/v2.1/flavors => generated 439 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:35:29.564080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48d8c65d-7a71-4466-868c-cf192f5da88f tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "72a9c705cdfa4a388f12acc5c616a3ee"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:29.576929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:35:29.577537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquired lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:35:29.640861 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-48d8c65d-7a71-4466-868c-cf192f5da88f tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] HTTP exception thrown: Flavor access not found for 40 / 72a9c705cdfa4a388f12acc5c616a3ee combination. Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48d8c65d-7a71-4466-868c-cf192f5da88f tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Request method failure captured: Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/flavors/1770927228/action HTTP/1.1 Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 70 Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBVzf94fSxe5_fFYdbbeQOJ9uAh6wvo95KcJGMQQkKyLm5rqP5-H2Wpw6zyLZdlqKzmfvCP99TGxgvFjdw9Ciu3Y3DVKJoN2fhAHWEMyYbt4aFieFyEvNYna2QBaK-UFrfL71RN0vrn7Q2hc-2_mIt9qAxg2Hmdz_5POmS9ar9-4TU Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 72f7b2a33acb4a9fbfa41f57d92a2d8d Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-884418649 Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:35:29.647806 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/72f7b2a33acb4a9fbfa41f57d92a2d8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72f7b2a33acb4a9fbfa41f57d92a2d8d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_72f7b2a33acb4a9fbfa41f57d92a2d8d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/72f7b2a33acb4a9fbfa41f57d92a2d8d"}]}] Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-884418649 Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 72f7b2a33acb4a9fbfa41f57d92a2d8d Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-884418649 Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 701cf2911aae4dc0b169633fa85004de Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: {"removeTenantAccess": {"tenant": "72a9c705cdfa4a388f12acc5c616a3ee"}} Oct 05 17:35:29.649369 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: exception: Flavor access not found for 40 / 72a9c705cdfa4a388f12acc5c616a3ee combination. Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '1770927228', 'body': {'removeTenantAccess': {'tenant': '72a9c705cdfa4a388f12acc5c616a3ee'}}} Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 05 17:35:29.650170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 40 / 72a9c705cdfa4a388f12acc5c616a3ee combination. Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 40 / 72a9c705cdfa4a388f12acc5c616a3ee combination. Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.651447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.654665 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:29.654665 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:29.654665 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:29.654665 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:29.654665 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 40 / 72a9c705cdfa4a388f12acc5c616a3ee combination. Oct 05 17:35:29.654665 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.654665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48d8c65d-7a71-4466-868c-cf192f5da88f tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Returning 404 to user: Flavor access not found for 40 / 72a9c705cdfa4a388f12acc5c616a3ee combination. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:29.654665 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48d8c65d-7a71-4466-868c-cf192f5da88f tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors/1770927228/action" status: 404 len: 124 microversion: 2.1 time: 0.092655 Oct 05 17:35:29.654665 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 604/1170] 10.222.0.70 () {60 vars in 1200 bytes} [Wed Oct 5 17:35:29 2022] POST /compute/v2.1/flavors/1770927228/action => generated 124 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:35:29.660869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-61429bf4-b4c4-4d97-afba-c3f3103b864e tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:29.705518 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-61429bf4-b4c4-4d97-afba-c3f3103b864e tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1770927228" status: 202 len: 0 microversion: 2.1 time: 0.050653 Oct 05 17:35:29.706513 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 605/1171] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:35:29 2022] DELETE /compute/v2.1/flavors/1770927228 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:29.714768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd46ff38-0e2a-463d-8d79-43d98e5e5548 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:29.757386 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd46ff38-0e2a-463d-8d79-43d98e5e5548 tempest-FlavorsAccessNegativeTestJSON-884418649 tempest-FlavorsAccessNegativeTestJSON-884418649-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046795 Oct 05 17:35:29.758077 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 606/1172] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:35:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:29.764747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Releasing lock "refresh_cache-51c0b701-73ce-4633-be8b-d2a78230b701" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:35:29.765745 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] HTTP exception thrown: floating IP not found Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Request method failure captured: Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action HTTP/1.1 Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 41 Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcAvW-3zHy31Zk49RJWapq7bc9AS9flZE-SRw7Jnbl8lfCjqFj5rg72ltRf6OpQ_t95Tax_6ss9x5u4M-TqlwGSZp4dd-oTNZPlvsPHOp5lD604r54IKmxAXnmvS6nvRMzH99-WTKdOLHJ6k94ZEh9YgK659ULXUyT1TDxXnHetKoVE Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 065544965253483e8e506c98a39646ce Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:35:29.768351 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/065544965253483e8e506c98a39646ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/065544965253483e8e506c98a39646ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_065544965253483e8e506c98a39646ce", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/065544965253483e8e506c98a39646ce"}]}] Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 065544965253483e8e506c98a39646ce Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 37ac9633604b4bea8e346140bd7915ca Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:35:29.769687 n-d-835595-3 devstack@n-api.service[128843]: exception: floating IP not found Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '51c0b701-73ce-4633-be8b-d2a78230b701', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:29.770892 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 05 17:35:29.772112 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.775390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Returning 404 to user: floating IP not found {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:29.776588 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8e1b2cff-2fa5-4316-ba3b-f9249b674de7 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action" status: 404 len: 67 microversion: 2.1 time: 0.298858 Oct 05 17:35:29.777199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0bb93948-d3c8-46dc-aee7-b65d686609ce tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:29.777831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0bb93948-d3c8-46dc-aee7-b65d686609ce tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:29.782785 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 567/1173] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:29 2022] POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action => generated 67 bytes in 307 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:35:29.789024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f83a220-b97e-440b-a8b9-c25d725a2222 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Action: 'action', calling method: .version_select at 0x7f77779659d0>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:29.792365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bb93948-d3c8-46dc-aee7-b65d686609ce tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:29.795026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bb93948-d3c8-46dc-aee7-b65d686609ce tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:29.795503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bb93948-d3c8-46dc-aee7-b65d686609ce tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:29.796250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bb93948-d3c8-46dc-aee7-b65d686609ce tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:29.796729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bb93948-d3c8-46dc-aee7-b65d686609ce tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:29.797237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bb93948-d3c8-46dc-aee7-b65d686609ce tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:29.894119 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-5f83a220-b97e-440b-a8b9-c25d725a2222 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f83a220-b97e-440b-a8b9-c25d725a2222 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Request method failure captured: Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action HTTP/1.1 Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 44 Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcAvW-3zHy31Zk49RJWapq7bc9AS9flZE-SRw7Jnbl8lfCjqFj5rg72ltRf6OpQ_t95Tax_6ss9x5u4M-TqlwGSZp4dd-oTNZPlvsPHOp5lD604r54IKmxAXnmvS6nvRMzH99-WTKdOLHJ6k94ZEh9YgK659ULXUyT1TDxXnHetKoVE Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 065544965253483e8e506c98a39646ce Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:35:29.896844 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/065544965253483e8e506c98a39646ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/065544965253483e8e506c98a39646ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_065544965253483e8e506c98a39646ce", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/065544965253483e8e506c98a39646ce"}]}] Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 065544965253483e8e506c98a39646ce Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 37ac9633604b4bea8e346140bd7915ca Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:35:29.898503 n-d-835595-3 devstack@n-api.service[128843]: exception: Floating IP not found for address 0.0.0.0. Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '51c0b701-73ce-4633-be8b-d2a78230b701', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:29.899407 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 05 17:35:29.902117 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:29.912831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f83a220-b97e-440b-a8b9-c25d725a2222 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:29.915304 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5f83a220-b97e-440b-a8b9-c25d725a2222 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action" status: 404 len: 88 microversion: 2.1 time: 0.130170 Oct 05 17:35:29.923101 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 568/1174] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:29 2022] POST /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701/action => generated 88 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:35:30.024739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0bb93948-d3c8-46dc-aee7-b65d686609ce tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:30.032476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1467883892", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "5357c32b-eba7-4ec7-8455-454884b5b173"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:30.042668 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0bb93948-d3c8-46dc-aee7-b65d686609ce tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.270990 Oct 05 17:35:30.047010 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 607/1175] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:29 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:30.057558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f76a624-50d4-479e-acec-749499546a28 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:30.058329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f76a624-50d4-479e-acec-749499546a28 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:30.069235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f76a624-50d4-479e-acec-749499546a28 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:30.071048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f76a624-50d4-479e-acec-749499546a28 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:30.078939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f76a624-50d4-479e-acec-749499546a28 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:30.080259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f76a624-50d4-479e-acec-749499546a28 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:30.080259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f76a624-50d4-479e-acec-749499546a28 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:30.080548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f76a624-50d4-479e-acec-749499546a28 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:30.130239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] validate_networks() for [('5357c32b-eba7-4ec7-8455-454884b5b173', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:35:30.148899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f76a624-50d4-479e-acec-749499546a28 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:35:30.272500 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f76a624-50d4-479e-acec-749499546a28 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "DELETE /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 204 len: 0 microversion: 2.1 time: 0.223670 Oct 05 17:35:30.273490 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 608/1176] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:35:30 2022] DELETE /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:35:30.283579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5d74366-e85c-46e9-94dd-a3bcb599c153 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:30.284553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5d74366-e85c-46e9-94dd-a3bcb599c153 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:30.293131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5d74366-e85c-46e9-94dd-a3bcb599c153 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:30.296206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5d74366-e85c-46e9-94dd-a3bcb599c153 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:30.297052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5d74366-e85c-46e9-94dd-a3bcb599c153 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:30.297787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5d74366-e85c-46e9-94dd-a3bcb599c153 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:30.298257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5d74366-e85c-46e9-94dd-a3bcb599c153 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:30.298833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5d74366-e85c-46e9-94dd-a3bcb599c153 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:30.682542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f5d74366-e85c-46e9-94dd-a3bcb599c153 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:30.695720 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5d74366-e85c-46e9-94dd-a3bcb599c153 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1468 microversion: 2.1 time: 0.417215 Oct 05 17:35:30.713368 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 609/1177] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:30 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1468 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:30.727100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-18d53849-6e1c-4240-9d55-6dcf23478b92 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:30.731111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-18d53849-6e1c-4240-9d55-6dcf23478b92 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:30.750632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18d53849-6e1c-4240-9d55-6dcf23478b92 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:30.751295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18d53849-6e1c-4240-9d55-6dcf23478b92 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:30.751880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18d53849-6e1c-4240-9d55-6dcf23478b92 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:30.753020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18d53849-6e1c-4240-9d55-6dcf23478b92 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:30.753605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18d53849-6e1c-4240-9d55-6dcf23478b92 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:30.754126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18d53849-6e1c-4240-9d55-6dcf23478b92 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:30.998022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-18d53849-6e1c-4240-9d55-6dcf23478b92 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:31.010342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-18d53849-6e1c-4240-9d55-6dcf23478b92 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1543 microversion: 2.1 time: 0.292639 Oct 05 17:35:31.033635 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 610/1178] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:30 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1543 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:31.043116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:31.044186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:31.055932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:31.056796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:31.057546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:31.058564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:31.059338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:31.060011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:31.173218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:31.184790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:31.186590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:31.200522 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-864a405a-be2a-44bc-8b68-4a1bfc7510d7 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.164752 Oct 05 17:35:31.209118 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 611/1179] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:31 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:31.209118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-67ab68d3-4075-432a-ae80-c0696399ffa6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:31.209118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-67ab68d3-4075-432a-ae80-c0696399ffa6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:31.225564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ab68d3-4075-432a-ae80-c0696399ffa6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:31.226586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ab68d3-4075-432a-ae80-c0696399ffa6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:31.228652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ab68d3-4075-432a-ae80-c0696399ffa6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:31.229588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ab68d3-4075-432a-ae80-c0696399ffa6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:31.230901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ab68d3-4075-432a-ae80-c0696399ffa6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:31.233283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ab68d3-4075-432a-ae80-c0696399ffa6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:31.283839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:31.427679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-67ab68d3-4075-432a-ae80-c0696399ffa6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:31.439026 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-67ab68d3-4075-432a-ae80-c0696399ffa6 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.235441 Oct 05 17:35:31.442479 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 612/1180] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:31 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:31.725470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-93e57540-6c93-41db-8b01-a002dcbe65e3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:31.726207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-93e57540-6c93-41db-8b01-a002dcbe65e3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:31.738438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93e57540-6c93-41db-8b01-a002dcbe65e3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:31.746315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93e57540-6c93-41db-8b01-a002dcbe65e3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:31.746315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93e57540-6c93-41db-8b01-a002dcbe65e3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:31.748776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93e57540-6c93-41db-8b01-a002dcbe65e3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:31.751174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93e57540-6c93-41db-8b01-a002dcbe65e3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:31.751174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93e57540-6c93-41db-8b01-a002dcbe65e3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:31.989923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-93e57540-6c93-41db-8b01-a002dcbe65e3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:31.998691 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-93e57540-6c93-41db-8b01-a002dcbe65e3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1468 microversion: 2.1 time: 0.278242 Oct 05 17:35:31.999531 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 613/1181] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:31 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1468 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:32.024085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:35:32.024592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:35:32.025059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:35:32.025469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:35:32.025884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:35:32.037383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e3d4178-bf8a-4f53-90cc-165475622d8e tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:32.038014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7e3d4178-bf8a-4f53-90cc-165475622d8e tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:32.045664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e3d4178-bf8a-4f53-90cc-165475622d8e tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:32.046165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e3d4178-bf8a-4f53-90cc-165475622d8e tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:32.048883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e3d4178-bf8a-4f53-90cc-165475622d8e tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:32.049637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e3d4178-bf8a-4f53-90cc-165475622d8e tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:32.050107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e3d4178-bf8a-4f53-90cc-165475622d8e tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:32.050708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e3d4178-bf8a-4f53-90cc-165475622d8e tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:32.059296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:32.059795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:32.060233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:32.060961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:32.061568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:32.062182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:32.088077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Getting quotas for project 7490ef750c964d779a46fb96c08e76e2. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:35:32.093517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Getting quotas for user 2da2db073e774554990184cb1ac05cc5 and project 7490ef750c964d779a46fb96c08e76e2. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:35:32.111544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:35:32.114350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:35:32.173263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:32.204179 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fac3cc72-87d7-4aab-b9c8-35b918ac6a68 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.278358 Oct 05 17:35:32.223454 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 569/1182] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:35:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:35:32.228911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29f8d8cc-a300-42df-bbdf-ad57b9d4b2f8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:32.230491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29f8d8cc-a300-42df-bbdf-ad57b9d4b2f8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:32.264096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7e3d4178-bf8a-4f53-90cc-165475622d8e tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:32.275113 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7e3d4178-bf8a-4f53-90cc-165475622d8e tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1543 microversion: 2.1 time: 0.242049 Oct 05 17:35:32.290307 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 614/1183] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:32 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1543 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:32.290307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:32.290813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:32.302778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:32.303645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:32.304112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:32.307252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:32.307252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:32.307252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:32.315565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29f8d8cc-a300-42df-bbdf-ad57b9d4b2f8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:32.328015 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29f8d8cc-a300-42df-bbdf-ad57b9d4b2f8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1217 microversion: 2.1 time: 0.102281 Oct 05 17:35:32.328625 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 570/1184] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:32 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:32.467454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f81b0c84-df08-4169-a7da-212f07ea5efa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:32.468084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f81b0c84-df08-4169-a7da-212f07ea5efa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:32.496803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81b0c84-df08-4169-a7da-212f07ea5efa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:32.500082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81b0c84-df08-4169-a7da-212f07ea5efa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:32.500588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81b0c84-df08-4169-a7da-212f07ea5efa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:32.503851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81b0c84-df08-4169-a7da-212f07ea5efa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:32.504340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81b0c84-df08-4169-a7da-212f07ea5efa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:32.504793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81b0c84-df08-4169-a7da-212f07ea5efa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:32.513321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:32.527516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:32.537491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:32.555485 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0b4ab417-111f-4408-ab78-10dd4edc7abf tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.277948 Oct 05 17:35:32.574662 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 615/1185] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:32 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:32.760292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f81b0c84-df08-4169-a7da-212f07ea5efa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:32.775103 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f81b0c84-df08-4169-a7da-212f07ea5efa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.315221 Oct 05 17:35:32.778173 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 571/1186] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:32 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:33.022600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cd12b965-3845-4265-a9f4-313eedaae05a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:33.023218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cd12b965-3845-4265-a9f4-313eedaae05a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:33.047438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd12b965-3845-4265-a9f4-313eedaae05a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.051659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd12b965-3845-4265-a9f4-313eedaae05a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.052198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd12b965-3845-4265-a9f4-313eedaae05a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.052995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd12b965-3845-4265-a9f4-313eedaae05a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.054540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd12b965-3845-4265-a9f4-313eedaae05a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.058470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd12b965-3845-4265-a9f4-313eedaae05a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.311828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc8d99a3-a62b-44b0-b182-1ae98854b619 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:33.312553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fc8d99a3-a62b-44b0-b182-1ae98854b619 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:33.344339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8d99a3-a62b-44b0-b182-1ae98854b619 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.351633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8d99a3-a62b-44b0-b182-1ae98854b619 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.354560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8d99a3-a62b-44b0-b182-1ae98854b619 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.355640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8d99a3-a62b-44b0-b182-1ae98854b619 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.358407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8d99a3-a62b-44b0-b182-1ae98854b619 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.365841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8d99a3-a62b-44b0-b182-1ae98854b619 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.377704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cd12b965-3845-4265-a9f4-313eedaae05a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:33.386610 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cd12b965-3845-4265-a9f4-313eedaae05a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1468 microversion: 2.1 time: 0.367972 Oct 05 17:35:33.394943 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 616/1187] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:33 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1468 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:33.412684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac1ff3fd-c428-41c0-9999-e4fdd6bad2ba tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:33.413527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac1ff3fd-c428-41c0-9999-e4fdd6bad2ba tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:33.426681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac1ff3fd-c428-41c0-9999-e4fdd6bad2ba tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.430321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac1ff3fd-c428-41c0-9999-e4fdd6bad2ba tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.431057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac1ff3fd-c428-41c0-9999-e4fdd6bad2ba tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.432203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac1ff3fd-c428-41c0-9999-e4fdd6bad2ba tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.432836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac1ff3fd-c428-41c0-9999-e4fdd6bad2ba tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.433421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac1ff3fd-c428-41c0-9999-e4fdd6bad2ba tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.447187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:33.548998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fc8d99a3-a62b-44b0-b182-1ae98854b619 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:33.563315 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fc8d99a3-a62b-44b0-b182-1ae98854b619 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1501 microversion: 2.1 time: 0.263654 Oct 05 17:35:33.564104 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 572/1188] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:33 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1501 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:33.572215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-27471ee1-92f3-4ae6-9be6-fca6f6bc8534 req-309f5616-9c70-4b28-ba42-dae2709d2610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0b701-73ce-4633-be8b-d2a78230b701", "name": "network-vif-deleted", "tag": "26a9ba3f-e269-4580-b31d-95b12b0c1e21"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:33.595593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-27471ee1-92f3-4ae6-9be6-fca6f6bc8534 req-309f5616-9c70-4b28-ba42-dae2709d2610 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.600010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ac1ff3fd-c428-41c0-9999-e4fdd6bad2ba tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:33.600889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-27471ee1-92f3-4ae6-9be6-fca6f6bc8534 req-309f5616-9c70-4b28-ba42-dae2709d2610 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.601699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-27471ee1-92f3-4ae6-9be6-fca6f6bc8534 req-309f5616-9c70-4b28-ba42-dae2709d2610 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.613924 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac1ff3fd-c428-41c0-9999-e4fdd6bad2ba tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1213 microversion: 2.1 time: 0.216496 Oct 05 17:35:33.630647 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 617/1189] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:33 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1213 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:33.639603 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-27471ee1-92f3-4ae6-9be6-fca6f6bc8534 req-309f5616-9c70-4b28-ba42-dae2709d2610 service nova] Creating event network-vif-deleted:26a9ba3f-e269-4580-b31d-95b12b0c1e21 for instance 51c0b701-73ce-4633-be8b-d2a78230b701 on n-h2-835595-3 Oct 05 17:35:33.646159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:33.646737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:33.656232 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-27471ee1-92f3-4ae6-9be6-fca6f6bc8534 req-309f5616-9c70-4b28-ba42-dae2709d2610 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090371 Oct 05 17:35:33.656878 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 573/1190] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:33.666139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.668493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.669840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.673571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.674337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.676107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.803068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3de98b5f-d52a-42eb-a0eb-e8e056f93e6b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:33.803780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3de98b5f-d52a-42eb-a0eb-e8e056f93e6b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:33.815141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3de98b5f-d52a-42eb-a0eb-e8e056f93e6b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.815649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3de98b5f-d52a-42eb-a0eb-e8e056f93e6b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.816088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3de98b5f-d52a-42eb-a0eb-e8e056f93e6b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.816805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3de98b5f-d52a-42eb-a0eb-e8e056f93e6b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:33.829556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3de98b5f-d52a-42eb-a0eb-e8e056f93e6b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:33.830029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3de98b5f-d52a-42eb-a0eb-e8e056f93e6b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:33.886884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:33.897318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:33.898833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:33.907750 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ccd1f021-64b9-483e-b0b4-76a90d6b26f9 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1544 microversion: 2.91 time: 0.275428 Oct 05 17:35:33.936671 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 618/1191] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:33 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1544 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:34.120977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3de98b5f-d52a-42eb-a0eb-e8e056f93e6b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:34.147020 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3de98b5f-d52a-42eb-a0eb-e8e056f93e6b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.348279 Oct 05 17:35:34.154753 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 574/1192] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:33 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:34.420431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-115eb229-604c-4ae5-ba06-f25ddfd88e99 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:34.421043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-115eb229-604c-4ae5-ba06-f25ddfd88e99 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:34.427660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-115eb229-604c-4ae5-ba06-f25ddfd88e99 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:34.428137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-115eb229-604c-4ae5-ba06-f25ddfd88e99 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:34.428576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-115eb229-604c-4ae5-ba06-f25ddfd88e99 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:34.429449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-115eb229-604c-4ae5-ba06-f25ddfd88e99 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:34.430054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-115eb229-604c-4ae5-ba06-f25ddfd88e99 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:34.430647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-115eb229-604c-4ae5-ba06-f25ddfd88e99 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:34.591463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:34.592060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:34.605200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:34.605690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:34.606117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:34.606953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:34.607404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:34.607819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:34.715141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:34.716616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:34.717377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:34.718112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lazy-loading 'fault' on Instance uuid 51c0b701-73ce-4633-be8b-d2a78230b701 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:35:34.811775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-115eb229-604c-4ae5-ba06-f25ddfd88e99 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:34.813280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ac9633604b4bea8e346140bd7915ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '065544965253483e8e506c98a39646ce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:34.834329 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-115eb229-604c-4ae5-ba06-f25ddfd88e99 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1468 microversion: 2.1 time: 0.417543 Oct 05 17:35:34.839090 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cdabafe0-89c0-4fe7-a540-d9a51ee1dcc0 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 200 len: 1322 microversion: 2.1 time: 0.251550 Oct 05 17:35:34.843047 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 619/1193] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:34 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1468 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:34.862322 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 575/1194] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:34 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:34.863349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b00d5499-09ae-422b-9419-266bd9583ab8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:34.864198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b00d5499-09ae-422b-9419-266bd9583ab8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:34.871510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00d5499-09ae-422b-9419-266bd9583ab8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:34.872207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00d5499-09ae-422b-9419-266bd9583ab8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:34.872831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00d5499-09ae-422b-9419-266bd9583ab8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:34.873727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00d5499-09ae-422b-9419-266bd9583ab8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:34.874446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00d5499-09ae-422b-9419-266bd9583ab8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:34.875137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00d5499-09ae-422b-9419-266bd9583ab8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:34.948504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b00d5499-09ae-422b-9419-266bd9583ab8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:34.957871 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b00d5499-09ae-422b-9419-266bd9583ab8 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1275 microversion: 2.1 time: 0.108310 Oct 05 17:35:34.958793 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 576/1195] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:34 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:34.961514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:34.962417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:34.969123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:34.969728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:34.970261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:34.971112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:34.971661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:34.972353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.045388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:35.054504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:35.056323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:35.062558 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-20f6af28-8c60-4c3c-9894-56b22c891fa6 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1531 microversion: 2.91 time: 0.106434 Oct 05 17:35:35.063404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 620/1196] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:34 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1531 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:35.090144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8f3b0b2d-3376-49d3-ac4f-d0c598fead31 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:35.090841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8f3b0b2d-3376-49d3-ac4f-d0c598fead31 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:35.097029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f3b0b2d-3376-49d3-ac4f-d0c598fead31 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.097520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f3b0b2d-3376-49d3-ac4f-d0c598fead31 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.097954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f3b0b2d-3376-49d3-ac4f-d0c598fead31 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.098656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f3b0b2d-3376-49d3-ac4f-d0c598fead31 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.099460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f3b0b2d-3376-49d3-ac4f-d0c598fead31 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.100041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f3b0b2d-3376-49d3-ac4f-d0c598fead31 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.174074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8bfdb1b-00a6-4b3e-bd72-fc973eea1bcd tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:35.174749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c8bfdb1b-00a6-4b3e-bd72-fc973eea1bcd tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:35.182089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bfdb1b-00a6-4b3e-bd72-fc973eea1bcd tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.182925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bfdb1b-00a6-4b3e-bd72-fc973eea1bcd tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.183732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bfdb1b-00a6-4b3e-bd72-fc973eea1bcd tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.184894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bfdb1b-00a6-4b3e-bd72-fc973eea1bcd tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.185505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bfdb1b-00a6-4b3e-bd72-fc973eea1bcd tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.186567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bfdb1b-00a6-4b3e-bd72-fc973eea1bcd tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.207352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-8f3b0b2d-3376-49d3-ac4f-d0c598fead31 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] Lazy-loading 'services' on Instance uuid bd2347ec-34bb-4815-8968-2c92099344c1 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:35:35.229482 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8f3b0b2d-3376-49d3-ac4f-d0c598fead31 tempest-UnshelveToHostMultiNodesTest-829333001 tempest-UnshelveToHostMultiNodesTest-829333001-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1936 microversion: 2.91 time: 0.143831 Oct 05 17:35:35.252004 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 577/1197] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:35 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1936 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:35.279193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ef9c665-99e7-471c-88a0-20184eda2a5d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:35.283058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ef9c665-99e7-471c-88a0-20184eda2a5d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:35.292596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ef9c665-99e7-471c-88a0-20184eda2a5d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.293337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ef9c665-99e7-471c-88a0-20184eda2a5d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.294031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ef9c665-99e7-471c-88a0-20184eda2a5d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.295181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ef9c665-99e7-471c-88a0-20184eda2a5d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.295857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ef9c665-99e7-471c-88a0-20184eda2a5d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.296633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ef9c665-99e7-471c-88a0-20184eda2a5d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.334499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ef9c665-99e7-471c-88a0-20184eda2a5d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:35:35.385909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8bfdb1b-00a6-4b3e-bd72-fc973eea1bcd tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:35.396196 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c8bfdb1b-00a6-4b3e-bd72-fc973eea1bcd tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.226910 Oct 05 17:35:35.396808 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 621/1198] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:35 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:35.492068 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ef9c665-99e7-471c-88a0-20184eda2a5d tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 204 len: 0 microversion: 2.91 time: 0.219022 Oct 05 17:35:35.492668 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 578/1199] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:35:35 2022] DELETE /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:35:35.506585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:35.507866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:35.515076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.517880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.518574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.519500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.522256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.522877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.674194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:35.697507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:35.703770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:35.725908 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76cdb1fb-f0da-4b8a-a26a-b033c7e25dd1 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.227263 Oct 05 17:35:35.731106 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 622/1200] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:35 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:35.869604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8437b17a-cf2f-4513-b25b-8eba33f9c8a2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:35.870508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8437b17a-cf2f-4513-b25b-8eba33f9c8a2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:35.875958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:35.877022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] [instance: 51c0b701-73ce-4633-be8b-d2a78230b701] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:35.882248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8437b17a-cf2f-4513-b25b-8eba33f9c8a2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.884322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8437b17a-cf2f-4513-b25b-8eba33f9c8a2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.885668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8437b17a-cf2f-4513-b25b-8eba33f9c8a2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.886541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8437b17a-cf2f-4513-b25b-8eba33f9c8a2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.888852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8437b17a-cf2f-4513-b25b-8eba33f9c8a2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.889393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.889874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8437b17a-cf2f-4513-b25b-8eba33f9c8a2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.945623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.946905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.056s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.950875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:35.954906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:35.955489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:35.982432 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] HTTP exception thrown: Instance 51c0b701-73ce-4633-be8b-d2a78230b701 could not be found. Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Request method failure captured: Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 HTTP/1.1 Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcAvW-3zHy31Zk49RJWapq7bc9AS9flZE-SRw7Jnbl8lfCjqFj5rg72ltRf6OpQ_t95Tax_6ss9x5u4M-TqlwGSZp4dd-oTNZPlvsPHOp5lD604r54IKmxAXnmvS6nvRMzH99-WTKdOLHJ6k94ZEh9YgK659ULXUyT1TDxXnHetKoVE Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 065544965253483e8e506c98a39646ce Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:35.984319 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/065544965253483e8e506c98a39646ce"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/065544965253483e8e506c98a39646ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_065544965253483e8e506c98a39646ce", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/065544965253483e8e506c98a39646ce"}]}] Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 065544965253483e8e506c98a39646ce Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 37ac9633604b4bea8e346140bd7915ca Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:35:35.986043 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 51c0b701-73ce-4633-be8b-d2a78230b701 could not be found. Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '51c0b701-73ce-4633-be8b-d2a78230b701'} Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c0b701-73ce-4633-be8b-d2a78230b701 could not be found. Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:35.986767 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c0b701-73ce-4633-be8b-d2a78230b701 could not be found. Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c0b701-73ce-4633-be8b-d2a78230b701 could not be found. Oct 05 17:35:35.987992 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:35.991203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] Returning 404 to user: Instance 51c0b701-73ce-4633-be8b-d2a78230b701 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:35.992331 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-186b96ff-a4c5-417b-9e25-af0d899080a5 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881 tempest-FloatingIPsAssociationNegativeTestJSON-1328831881-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701" status: 404 len: 111 microversion: 2.1 time: 0.121790 Oct 05 17:35:35.996006 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 623/1201] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:35 2022] GET /compute/v2.1/servers/51c0b701-73ce-4633-be8b-d2a78230b701 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:35:36.237691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d7844483-c68f-414d-9b14-c512ff56171b tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Calling method '.version_select at 0x7f77751253a0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.243394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d7844483-c68f-414d-9b14-c512ff56171b tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f011c1769b714d069722579c908305c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e5fbe246ea4587b24ad8a1fbe98902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d7844483-c68f-414d-9b14-c512ff56171b tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Request method failure captured: Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBm6uGS8IN99T-a0L2arx7yf528b9lDqN9AsOpM7_cDmATemfQmevWc8JK5GZS6TWXgHty7uKNXdugjDDW_QANSHeAzdeAZ8rhvIQA6wc73VSj37rD8YmGRH5hU0YWxqqONjTrCYzWwINiEO6TyL_JBBDKURST9WCh2_j1gQtrIBQc Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: a9e5fbe246ea4587b24ad8a1fbe98902 Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:36.247488 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9e5fbe246ea4587b24ad8a1fbe98902"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9e5fbe246ea4587b24ad8a1fbe98902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9e5fbe246ea4587b24ad8a1fbe98902", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9e5fbe246ea4587b24ad8a1fbe98902"}]}] Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: a9e5fbe246ea4587b24ad8a1fbe98902 Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HypervisorAdminNegativeTestJSON-407235883-project Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f011c1769b714d069722579c908305c7 Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-407235883-project Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: action_args: {} Oct 05 17:35:36.249024 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:35:36.250106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 05 17:35:36.251553 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.253293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d7844483-c68f-414d-9b14-c512ff56171b tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:36.254837 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d7844483-c68f-414d-9b14-c512ff56171b tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.256904 Oct 05 17:35:36.259417 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 624/1202] 10.222.0.70 () {58 vars in 1167 bytes} [Wed Oct 5 17:35:35 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 259 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:35:36.267659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d652790f-619b-4cf7-95b6-66dfb28fe7c7 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.269898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d652790f-619b-4cf7-95b6-66dfb28fe7c7 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:36.289649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d652790f-619b-4cf7-95b6-66dfb28fe7c7 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.290264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d652790f-619b-4cf7-95b6-66dfb28fe7c7 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.291742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d652790f-619b-4cf7-95b6-66dfb28fe7c7 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.296957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d652790f-619b-4cf7-95b6-66dfb28fe7c7 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.297493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d652790f-619b-4cf7-95b6-66dfb28fe7c7 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.301293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d652790f-619b-4cf7-95b6-66dfb28fe7c7 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.481218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8437b17a-cf2f-4513-b25b-8eba33f9c8a2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:36.492906 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8437b17a-cf2f-4513-b25b-8eba33f9c8a2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1534 microversion: 2.1 time: 0.629013 Oct 05 17:35:36.493869 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 579/1203] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:35 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1534 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:36.499382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e96f69bc-1f26-4382-b9c1-de198418431e req-f9f9f176-83e7-45b7-b787-8915058da937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ed8f88-a944-458d-8c5a-5264bce6dad6", "name": "network-vif-plugged", "status": "completed", "tag": "b64c94bd-1f5c-4c74-b4ca-f8d4b3407486"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:36.509743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e96f69bc-1f26-4382-b9c1-de198418431e req-f9f9f176-83e7-45b7-b787-8915058da937 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.510785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e96f69bc-1f26-4382-b9c1-de198418431e req-f9f9f176-83e7-45b7-b787-8915058da937 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.511546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e96f69bc-1f26-4382-b9c1-de198418431e req-f9f9f176-83e7-45b7-b787-8915058da937 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.512786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d652790f-619b-4cf7-95b6-66dfb28fe7c7 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:36.522643 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d652790f-619b-4cf7-95b6-66dfb28fe7c7 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1317 microversion: 2.1 time: 0.264699 Oct 05 17:35:36.523842 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 625/1204] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:36.530733 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e96f69bc-1f26-4382-b9c1-de198418431e req-f9f9f176-83e7-45b7-b787-8915058da937 service nova] Creating event network-vif-plugged:b64c94bd-1f5c-4c74-b4ca-f8d4b3407486 for instance 09ed8f88-a944-458d-8c5a-5264bce6dad6 on n-h1-835595-3 Oct 05 17:35:36.536386 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e96f69bc-1f26-4382-b9c1-de198418431e req-f9f9f176-83e7-45b7-b787-8915058da937 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040868 Oct 05 17:35:36.537606 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 580/1205] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:36.540600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ca24262-4c17-4bfb-bfb9-9d60fb49e36d tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Calling method '.version_select at 0x7f7775127d30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.543105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5ca24262-4c17-4bfb-bfb9-9d60fb49e36d tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f011c1769b714d069722579c908305c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e5fbe246ea4587b24ad8a1fbe98902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ca24262-4c17-4bfb-bfb9-9d60fb49e36d tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Request method failure captured: Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBm6uGS8IN99T-a0L2arx7yf528b9lDqN9AsOpM7_cDmATemfQmevWc8JK5GZS6TWXgHty7uKNXdugjDDW_QANSHeAzdeAZ8rhvIQA6wc73VSj37rD8YmGRH5hU0YWxqqONjTrCYzWwINiEO6TyL_JBBDKURST9WCh2_j1gQtrIBQc Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: a9e5fbe246ea4587b24ad8a1fbe98902 Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:36.544939 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9e5fbe246ea4587b24ad8a1fbe98902"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9e5fbe246ea4587b24ad8a1fbe98902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9e5fbe246ea4587b24ad8a1fbe98902", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9e5fbe246ea4587b24ad8a1fbe98902"}]}] Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: a9e5fbe246ea4587b24ad8a1fbe98902 Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HypervisorAdminNegativeTestJSON-407235883-project Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f011c1769b714d069722579c908305c7 Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-407235883-project Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: action_args: {} Oct 05 17:35:36.546768 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:35:36.547814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 05 17:35:36.549191 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.551388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2164e036-cf0c-44f5-a521-af666cb85f25 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.551388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2164e036-cf0c-44f5-a521-af666cb85f25 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:36.551696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ca24262-4c17-4bfb-bfb9-9d60fb49e36d tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:36.552144 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ca24262-4c17-4bfb-bfb9-9d60fb49e36d tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.027171 Oct 05 17:35:36.552711 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 626/1206] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:35:36.556605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2164e036-cf0c-44f5-a521-af666cb85f25 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.556964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2164e036-cf0c-44f5-a521-af666cb85f25 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.557427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2164e036-cf0c-44f5-a521-af666cb85f25 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.558137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2164e036-cf0c-44f5-a521-af666cb85f25 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.558688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2164e036-cf0c-44f5-a521-af666cb85f25 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.559120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2164e036-cf0c-44f5-a521-af666cb85f25 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.563421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2bc6576-0c6a-45ca-8c10-110faa1a52bc tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Calling method '.version_select at 0x7f77751d1820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.565204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f2bc6576-0c6a-45ca-8c10-110faa1a52bc tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f011c1769b714d069722579c908305c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e5fbe246ea4587b24ad8a1fbe98902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2bc6576-0c6a-45ca-8c10-110faa1a52bc tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Request method failure captured: Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBm6uGS8IN99T-a0L2arx7yf528b9lDqN9AsOpM7_cDmATemfQmevWc8JK5GZS6TWXgHty7uKNXdugjDDW_QANSHeAzdeAZ8rhvIQA6wc73VSj37rD8YmGRH5hU0YWxqqONjTrCYzWwINiEO6TyL_JBBDKURST9WCh2_j1gQtrIBQc Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: a9e5fbe246ea4587b24ad8a1fbe98902 Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:36.566797 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9e5fbe246ea4587b24ad8a1fbe98902"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9e5fbe246ea4587b24ad8a1fbe98902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9e5fbe246ea4587b24ad8a1fbe98902", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9e5fbe246ea4587b24ad8a1fbe98902"}]}] Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: a9e5fbe246ea4587b24ad8a1fbe98902 Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HypervisorAdminNegativeTestJSON-407235883-project Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f011c1769b714d069722579c908305c7 Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-407235883-project Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: action_args: {} Oct 05 17:35:36.568314 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:35:36.569174 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 05 17:35:36.570801 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.573873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2bc6576-0c6a-45ca-8c10-110faa1a52bc tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:36.573873 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f2bc6576-0c6a-45ca-8c10-110faa1a52bc tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.009386 Oct 05 17:35:36.574160 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 627/1207] 10.222.0.70 () {58 vars in 1179 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:35:36.633011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Calling method '.version_select at 0x7f77753609d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.634848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.635336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.635777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.650315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.650868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.651308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.663198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.663702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.664139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.671077 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-621414f5-883a-41e1-926a-b50b37954614 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.095978 Oct 05 17:35:36.671718 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 628/1208] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:36.682963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-46043c58-e44c-4596-b2bd-64d0a0b2f0c7 tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Calling method '.version_select at 0x7f77751275e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.684763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46043c58-e44c-4596-b2bd-64d0a0b2f0c7 tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f011c1769b714d069722579c908305c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e5fbe246ea4587b24ad8a1fbe98902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-46043c58-e44c-4596-b2bd-64d0a0b2f0c7 tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Request method failure captured: Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBm6uGS8IN99T-a0L2arx7yf528b9lDqN9AsOpM7_cDmATemfQmevWc8JK5GZS6TWXgHty7uKNXdugjDDW_QANSHeAzdeAZ8rhvIQA6wc73VSj37rD8YmGRH5hU0YWxqqONjTrCYzWwINiEO6TyL_JBBDKURST9WCh2_j1gQtrIBQc Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: a9e5fbe246ea4587b24ad8a1fbe98902 Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:36.686369 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9e5fbe246ea4587b24ad8a1fbe98902"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9e5fbe246ea4587b24ad8a1fbe98902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9e5fbe246ea4587b24ad8a1fbe98902", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9e5fbe246ea4587b24ad8a1fbe98902"}]}] Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: a9e5fbe246ea4587b24ad8a1fbe98902 Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HypervisorAdminNegativeTestJSON-407235883-project Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f011c1769b714d069722579c908305c7 Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-407235883-project Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '1'} Oct 05 17:35:36.687749 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:35:36.688679 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 05 17:35:36.689844 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.691346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-46043c58-e44c-4596-b2bd-64d0a0b2f0c7 tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:36.691346 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-46043c58-e44c-4596-b2bd-64d0a0b2f0c7 tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.008780 Oct 05 17:35:36.691346 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 629/1209] 10.222.0.70 () {58 vars in 1173 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:35:36.698060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27cd28e8-6312-43b4-9019-82dca527cd21 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Calling method '.version_select at 0x7f7775bad700>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.699715 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-27cd28e8-6312-43b4-9019-82dca527cd21 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] HTTP exception thrown: Hypervisor with ID '2727d066-71aa-4f6a-bceb-8fa32d7afa22' could not be found. Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27cd28e8-6312-43b4-9019-82dca527cd21 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Request method failure captured: Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hypervisors/2727d066-71aa-4f6a-bceb-8fa32d7afa22/uptime HTTP/1.1 Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBn4HxXy4NXgWdHon6Z4FXuhbzmDR-QKVTthUVvHjp-iRsSYvxhrfRp-xyGalA6UEFerSnS0WTU-QhQBX-IoC1GpTsnan3ddBJOPyqjmkMeYS8XPWekRj7l3amUXBQntsz2Xg-Ogb3D7MZ86d49knXa7_4DeHR8p_s5c29F8J54IrY Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: b894459370954bd087476943d22d55b4 Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-494012201 Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:35:36.721852 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b894459370954bd087476943d22d55b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b894459370954bd087476943d22d55b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b894459370954bd087476943d22d55b4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b894459370954bd087476943d22d55b4"}]}] Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-494012201 Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: b894459370954bd087476943d22d55b4 Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-494012201 Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: b4f437d7cbd044aaa196a0b0288717f4 Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: exception: Hypervisor with ID '2727d066-71aa-4f6a-bceb-8fa32d7afa22' could not be found. Oct 05 17:35:36.723444 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '2727d066-71aa-4f6a-bceb-8fa32d7afa22'} Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '2727d066-71aa-4f6a-bceb-8fa32d7afa22' Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 05 17:35:36.724278 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '2727d066-71aa-4f6a-bceb-8fa32d7afa22' could not be found. Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.725647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.726957 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.726957 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.726957 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.726957 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:36.726957 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:36.726957 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '2727d066-71aa-4f6a-bceb-8fa32d7afa22' could not be found. Oct 05 17:35:36.726957 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.726957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27cd28e8-6312-43b4-9019-82dca527cd21 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Returning 404 to user: Hypervisor with ID '2727d066-71aa-4f6a-bceb-8fa32d7afa22' could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:36.726957 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27cd28e8-6312-43b4-9019-82dca527cd21 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/2727d066-71aa-4f6a-bceb-8fa32d7afa22/uptime" status: 404 len: 123 microversion: 2.1 time: 0.029293 Oct 05 17:35:36.726957 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 630/1210] 10.222.0.70 () {58 vars in 1278 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/os-hypervisors/2727d066-71aa-4f6a-bceb-8fa32d7afa22/uptime => generated 123 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:35:36.734791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Calling method '.version_select at 0x7f77751d1f70>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.736583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.737081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.737521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.751882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.752550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.753016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.763695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.764175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.764606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.770956 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d46ce5b7-0bae-4415-bb32-6a11beba81b3 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040281 Oct 05 17:35:36.771591 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 631/1211] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:36.781047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.781727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:36.787898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.788385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.788818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.789517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:36.789947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:36.790437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:36.868071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:36.876954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:36.878449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:36.884173 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a43b94b4-9a51-4dd1-9695-537cc0846163 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1537 microversion: 2.91 time: 0.111566 Oct 05 17:35:36.884745 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 632/1212] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1537 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:36.898123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a66524a-4103-4832-a869-6ab0b16576e8 tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Calling method '.version_select at 0x7f77751279d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.900126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2a66524a-4103-4832-a869-6ab0b16576e8 tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f011c1769b714d069722579c908305c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9e5fbe246ea4587b24ad8a1fbe98902', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a66524a-4103-4832-a869-6ab0b16576e8 tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Request method failure captured: Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBm6uGS8IN99T-a0L2arx7yf528b9lDqN9AsOpM7_cDmATemfQmevWc8JK5GZS6TWXgHty7uKNXdugjDDW_QANSHeAzdeAZ8rhvIQA6wc73VSj37rD8YmGRH5hU0YWxqqONjTrCYzWwINiEO6TyL_JBBDKURST9WCh2_j1gQtrIBQc Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: a9e5fbe246ea4587b24ad8a1fbe98902 Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:36.901886 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a9e5fbe246ea4587b24ad8a1fbe98902"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9e5fbe246ea4587b24ad8a1fbe98902"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a9e5fbe246ea4587b24ad8a1fbe98902", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a9e5fbe246ea4587b24ad8a1fbe98902"}]}] Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: a9e5fbe246ea4587b24ad8a1fbe98902 Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-407235883 Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HypervisorAdminNegativeTestJSON-407235883-project Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f011c1769b714d069722579c908305c7 Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-407235883-project Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '1'} Oct 05 17:35:36.903391 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:35:36.904215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 05 17:35:36.906022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.907506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a66524a-4103-4832-a869-6ab0b16576e8 tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:36.907506 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2a66524a-4103-4832-a869-6ab0b16576e8 tempest-HypervisorAdminNegativeTestJSON-407235883 tempest-HypervisorAdminNegativeTestJSON-407235883-project] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.017633 Oct 05 17:35:36.907506 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 633/1213] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:35:36.915115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9f1582c-da32-47d6-883b-7e53c0374083 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Calling method '.version_select at 0x7f77750d9160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:36.916711 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b9f1582c-da32-47d6-883b-7e53c0374083 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] HTTP exception thrown: Hypervisor with ID '58c26be9-fb7a-4f7c-af97-59ef222b8223' could not be found. Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9f1582c-da32-47d6-883b-7e53c0374083 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Request method failure captured: Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-hypervisors/58c26be9-fb7a-4f7c-af97-59ef222b8223 HTTP/1.1 Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBn4HxXy4NXgWdHon6Z4FXuhbzmDR-QKVTthUVvHjp-iRsSYvxhrfRp-xyGalA6UEFerSnS0WTU-QhQBX-IoC1GpTsnan3ddBJOPyqjmkMeYS8XPWekRj7l3amUXBQntsz2Xg-Ogb3D7MZ86d49knXa7_4DeHR8p_s5c29F8J54IrY Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: b894459370954bd087476943d22d55b4 Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-494012201 Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:35:36.918524 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b894459370954bd087476943d22d55b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b894459370954bd087476943d22d55b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b894459370954bd087476943d22d55b4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b894459370954bd087476943d22d55b4"}]}] Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-494012201 Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: b894459370954bd087476943d22d55b4 Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-494012201 Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: b4f437d7cbd044aaa196a0b0288717f4 Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: exception: Hypervisor with ID '58c26be9-fb7a-4f7c-af97-59ef222b8223' could not be found. Oct 05 17:35:36.920069 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '58c26be9-fb7a-4f7c-af97-59ef222b8223'} Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '58c26be9-fb7a-4f7c-af97-59ef222b8223' Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 05 17:35:36.920860 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:35:36.923321 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '58c26be9-fb7a-4f7c-af97-59ef222b8223' could not be found. Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '58c26be9-fb7a-4f7c-af97-59ef222b8223' could not be found. Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9f1582c-da32-47d6-883b-7e53c0374083 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] Returning 404 to user: Hypervisor with ID '58c26be9-fb7a-4f7c-af97-59ef222b8223' could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b9f1582c-da32-47d6-883b-7e53c0374083 tempest-HypervisorAdminNegativeTestJSON-494012201 tempest-HypervisorAdminNegativeTestJSON-494012201-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors/58c26be9-fb7a-4f7c-af97-59ef222b8223" status: 404 len: 123 microversion: 2.1 time: 0.008615 Oct 05 17:35:36.925762 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 634/1214] 10.222.0.70 () {58 vars in 1257 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/os-hypervisors/58c26be9-fb7a-4f7c-af97-59ef222b8223 => generated 123 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:35:37.038605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2164e036-cf0c-44f5-a521-af666cb85f25 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:37.046553 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2164e036-cf0c-44f5-a521-af666cb85f25 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.504173 Oct 05 17:35:37.053337 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 581/1215] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:36 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:37.514304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:37.518074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bcd8fe03-2f11-4bc3-8095-dc0723563938 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:37.519679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bcd8fe03-2f11-4bc3-8095-dc0723563938 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:37.526784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcd8fe03-2f11-4bc3-8095-dc0723563938 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:37.527574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcd8fe03-2f11-4bc3-8095-dc0723563938 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:37.528259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcd8fe03-2f11-4bc3-8095-dc0723563938 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:37.529212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcd8fe03-2f11-4bc3-8095-dc0723563938 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:37.529912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcd8fe03-2f11-4bc3-8095-dc0723563938 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:37.530653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcd8fe03-2f11-4bc3-8095-dc0723563938 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:37.549645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-17b85ee2-7794-4913-90c7-8492f0ce1d7a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:37.550785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-17b85ee2-7794-4913-90c7-8492f0ce1d7a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:37.559784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b85ee2-7794-4913-90c7-8492f0ce1d7a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:37.572238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b85ee2-7794-4913-90c7-8492f0ce1d7a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:37.573159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b85ee2-7794-4913-90c7-8492f0ce1d7a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:37.574144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b85ee2-7794-4913-90c7-8492f0ce1d7a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:37.574697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b85ee2-7794-4913-90c7-8492f0ce1d7a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:37.575414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b85ee2-7794-4913-90c7-8492f0ce1d7a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:37.828227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bcd8fe03-2f11-4bc3-8095-dc0723563938 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:37.837888 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bcd8fe03-2f11-4bc3-8095-dc0723563938 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1534 microversion: 2.1 time: 0.324762 Oct 05 17:35:37.838684 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 635/1216] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:37 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1534 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:37.849050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-17b85ee2-7794-4913-90c7-8492f0ce1d7a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:37.865673 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-17b85ee2-7794-4913-90c7-8492f0ce1d7a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1317 microversion: 2.1 time: 0.320014 Oct 05 17:35:37.870231 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 582/1217] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:37 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:37.919346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:37.919446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:37.933246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:37.934385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:37.934832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:37.935737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:37.936212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:37.936657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:37.967603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:37.982981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=8,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:37.986071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:37.986863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:37.987465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:37.988083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lazy-loading 'fault' on Instance uuid bd2347ec-34bb-4815-8968-2c92099344c1 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:35:38.060566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:38.070954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:38.072673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9e4c5812-6aef-457b-a1bb-a114930f03c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:38.073916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9e4c5812-6aef-457b-a1bb-a114930f03c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:38.074618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570fc4032e2e4607ab3017364f22e8fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a375e05788045cf81f99be3b4c17ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:38.083403 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-11a2da37-c04c-408a-a664-68ed29fcee96 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 200 len: 1542 microversion: 2.91 time: 0.171647 Oct 05 17:35:38.086346 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 636/1218] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:37 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 1542 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:35:38.116020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e4c5812-6aef-457b-a1bb-a114930f03c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:38.118078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e4c5812-6aef-457b-a1bb-a114930f03c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:38.118923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e4c5812-6aef-457b-a1bb-a114930f03c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:38.120976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e4c5812-6aef-457b-a1bb-a114930f03c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:38.121680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e4c5812-6aef-457b-a1bb-a114930f03c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:38.122328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e4c5812-6aef-457b-a1bb-a114930f03c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:38.350759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-591974f4-8ffd-4748-96e7-2cc800351526 req-84158dfc-b971-4fda-9fcc-e3980f9c8e6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb7199d2-b000-4a07-abe4-4d76d42b430d", "tag": "efdb1b94-fda9-4a7a-b551-ba58af93ae12"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:38.369873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-591974f4-8ffd-4748-96e7-2cc800351526 req-84158dfc-b971-4fda-9fcc-e3980f9c8e6f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:38.370460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-591974f4-8ffd-4748-96e7-2cc800351526 req-84158dfc-b971-4fda-9fcc-e3980f9c8e6f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:38.374763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-591974f4-8ffd-4748-96e7-2cc800351526 req-84158dfc-b971-4fda-9fcc-e3980f9c8e6f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:38.405648 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-591974f4-8ffd-4748-96e7-2cc800351526 req-84158dfc-b971-4fda-9fcc-e3980f9c8e6f service nova] Creating event network-changed:efdb1b94-fda9-4a7a-b551-ba58af93ae12 for instance fb7199d2-b000-4a07-abe4-4d76d42b430d on n-h2-835595-3 Oct 05 17:35:38.413066 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-591974f4-8ffd-4748-96e7-2cc800351526 req-84158dfc-b971-4fda-9fcc-e3980f9c8e6f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065311 Oct 05 17:35:38.414264 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 637/1219] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:35:38.557363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5641d8d6-b48d-420d-8ea6-3b33e8bb162b req-b5105a79-5c08-4527-97ed-ef711869b4ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3793214f-3607-4041-8f62-fd2b36f1b171", "name": "network-vif-unplugged", "status": "completed", "tag": "8fd18242-e1fd-42af-9db6-62c95ec947e4"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:38.574083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5641d8d6-b48d-420d-8ea6-3b33e8bb162b req-b5105a79-5c08-4527-97ed-ef711869b4ad service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:38.574909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5641d8d6-b48d-420d-8ea6-3b33e8bb162b req-b5105a79-5c08-4527-97ed-ef711869b4ad service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:38.575552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5641d8d6-b48d-420d-8ea6-3b33e8bb162b req-b5105a79-5c08-4527-97ed-ef711869b4ad service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:38.593522 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5641d8d6-b48d-420d-8ea6-3b33e8bb162b req-b5105a79-5c08-4527-97ed-ef711869b4ad service nova] Creating event network-vif-unplugged:8fd18242-e1fd-42af-9db6-62c95ec947e4 for instance 3793214f-3607-4041-8f62-fd2b36f1b171 on n-h1-835595-3 Oct 05 17:35:38.596014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9e4c5812-6aef-457b-a1bb-a114930f03c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:38.605334 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5641d8d6-b48d-420d-8ea6-3b33e8bb162b req-b5105a79-5c08-4527-97ed-ef711869b4ad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052327 Oct 05 17:35:38.607264 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 638/1220] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:35:38.611408 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9e4c5812-6aef-457b-a1bb-a114930f03c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.545712 Oct 05 17:35:38.621348 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 583/1221] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:38 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:38.871598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d41f928-e2dc-47ed-b62d-f99418d96629 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:38.872668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d41f928-e2dc-47ed-b62d-f99418d96629 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:38.886199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d41f928-e2dc-47ed-b62d-f99418d96629 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:38.886742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d41f928-e2dc-47ed-b62d-f99418d96629 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:38.887180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d41f928-e2dc-47ed-b62d-f99418d96629 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:38.887900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d41f928-e2dc-47ed-b62d-f99418d96629 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:38.888384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d41f928-e2dc-47ed-b62d-f99418d96629 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:38.890225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d41f928-e2dc-47ed-b62d-f99418d96629 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:38.896978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9b7c2cc-b404-45d1-b3ab-a59130af62fc tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:38.897664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b9b7c2cc-b404-45d1-b3ab-a59130af62fc tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:38.906970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9b7c2cc-b404-45d1-b3ab-a59130af62fc tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:38.910671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9b7c2cc-b404-45d1-b3ab-a59130af62fc tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:38.911117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9b7c2cc-b404-45d1-b3ab-a59130af62fc tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:38.911933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9b7c2cc-b404-45d1-b3ab-a59130af62fc tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:38.912279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9b7c2cc-b404-45d1-b3ab-a59130af62fc tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:38.912693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9b7c2cc-b404-45d1-b3ab-a59130af62fc tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:39.126780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d41f928-e2dc-47ed-b62d-f99418d96629 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:39.154149 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d41f928-e2dc-47ed-b62d-f99418d96629 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1527 microversion: 2.1 time: 0.287821 Oct 05 17:35:39.157272 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 639/1222] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:38 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1527 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:39.162628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:39.163493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] [instance: bd2347ec-34bb-4815-8968-2c92099344c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:39.169933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:39.170685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:39.171322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:39.172277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:39.172947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:39.173607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:39.190608 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] HTTP exception thrown: Instance bd2347ec-34bb-4815-8968-2c92099344c1 could not be found. Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Request method failure captured: Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 HTTP/1.1 Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-_WEQMNbRmZCDq7Vt-XiVB0-PwZgOq93gUe83vyCk6uvNGmPcwt7jonuUdgXFS1GZ79NUaaKsEobNnvD2W7qu40zvqVH6H_T5fYF5tePuAPMFxnNw5jX0UYAa_aXr5hK_K7l6JcguEsVyarVKbcaR3kwS8m3Pgh34V-4JdwmuL2uY Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.91 Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 9a375e05788045cf81f99be3b4c17ed7 Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1438190567 Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:39.192262 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/9a375e05788045cf81f99be3b4c17ed7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9a375e05788045cf81f99be3b4c17ed7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_9a375e05788045cf81f99be3b4c17ed7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/9a375e05788045cf81f99be3b4c17ed7"}]}] Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1438190567 Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 9a375e05788045cf81f99be3b4c17ed7 Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1438190567 Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-UnshelveToHostMultiNodesTest-1438190567-project Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 570fc4032e2e4607ab3017364f22e8fe Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1438190567-project Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance bd2347ec-34bb-4815-8968-2c92099344c1 could not be found. Oct 05 17:35:39.194009 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'bd2347ec-34bb-4815-8968-2c92099344c1'} Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2347ec-34bb-4815-8968-2c92099344c1 could not be found. Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:39.195557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2347ec-34bb-4815-8968-2c92099344c1 could not be found. Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2347ec-34bb-4815-8968-2c92099344c1 could not be found. Oct 05 17:35:39.197777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:39.199214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] Returning 404 to user: Instance bd2347ec-34bb-4815-8968-2c92099344c1 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:39.199214 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1a7aba09-a07c-4aed-a6f0-af05242554f5 tempest-UnshelveToHostMultiNodesTest-1438190567 tempest-UnshelveToHostMultiNodesTest-1438190567-project] 10.222.0.70 "GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1" status: 404 len: 111 microversion: 2.91 time: 0.035322 Oct 05 17:35:39.199214 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 640/1223] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:35:39 2022] GET /compute/v2.1/servers/bd2347ec-34bb-4815-8968-2c92099344c1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:35:39.202201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e508caee-7ceb-4c60-8d3e-b660086eb01f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:39.203061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e508caee-7ceb-4c60-8d3e-b660086eb01f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:39.216974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9b7c2cc-b404-45d1-b3ab-a59130af62fc tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:39.229557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e508caee-7ceb-4c60-8d3e-b660086eb01f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:39.230205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e508caee-7ceb-4c60-8d3e-b660086eb01f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:39.230746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e508caee-7ceb-4c60-8d3e-b660086eb01f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:39.231662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e508caee-7ceb-4c60-8d3e-b660086eb01f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:39.232193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e508caee-7ceb-4c60-8d3e-b660086eb01f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:39.232802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e508caee-7ceb-4c60-8d3e-b660086eb01f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:39.255732 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9b7c2cc-b404-45d1-b3ab-a59130af62fc tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1317 microversion: 2.1 time: 0.362355 Oct 05 17:35:39.258041 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 584/1224] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:38 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:39.548197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e508caee-7ceb-4c60-8d3e-b660086eb01f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:39.557752 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e508caee-7ceb-4c60-8d3e-b660086eb01f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1527 microversion: 2.1 time: 0.357380 Oct 05 17:35:39.559004 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 641/1225] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:39 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1527 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:39.585410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76272193-acb1-468e-9642-e4f2a48a9903 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:39.591432 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-76272193-acb1-468e-9642-e4f2a48a9903 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] HTTP exception thrown: Flavor 6403527e-38a9-40d5-82c1-5ca19de08c4b could not be found. Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76272193-acb1-468e-9642-e4f2a48a9903 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Request method failure captured: Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/flavors/6403527e-38a9-40d5-82c1-5ca19de08c4b HTTP/1.1 Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-gFWWQ5soZr3wqBm109OYGHuNsaWkKivGozCJs5SL5MsiF5EHd92dnq904W3uJ6D1RMn0YoBLx9rK0ic-M075OMoa3wv6AdWco1ZbgrTRBr_NbatvQhGB_KR-s_dZwmeIJgw3dbTVMEO8j6YqHtMYYMi9ovMqPht9fGV_AScp50k4 Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 6c6f93d534014f37a2527e4d0a6953e2 Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-MigrationsAdminTest-488447416 Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:35:39.593842 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6c6f93d534014f37a2527e4d0a6953e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6c6f93d534014f37a2527e4d0a6953e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6c6f93d534014f37a2527e4d0a6953e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6c6f93d534014f37a2527e4d0a6953e2"}]}] Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-MigrationsAdminTest-488447416 Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 6c6f93d534014f37a2527e4d0a6953e2 Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-MigrationsAdminTest-488447416 Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-MigrationsAdminTest-488447416-project-admin Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 80d5eab89e6240caaa54a381b4d2af4f Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-MigrationsAdminTest-488447416-project-admin Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: exception: Flavor 6403527e-38a9-40d5-82c1-5ca19de08c4b could not be found. Oct 05 17:35:39.595514 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '6403527e-38a9-40d5-82c1-5ca19de08c4b'} Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 6403527e-38a9-40d5-82c1-5ca19de08c4b could not be found. Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:39.596465 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 6403527e-38a9-40d5-82c1-5ca19de08c4b could not be found. Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 6403527e-38a9-40d5-82c1-5ca19de08c4b could not be found. Oct 05 17:35:39.597942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:39.599409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76272193-acb1-468e-9642-e4f2a48a9903 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Returning 404 to user: Flavor 6403527e-38a9-40d5-82c1-5ca19de08c4b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:39.599409 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76272193-acb1-468e-9642-e4f2a48a9903 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/6403527e-38a9-40d5-82c1-5ca19de08c4b" status: 404 len: 109 microversion: 2.1 time: 0.015687 Oct 05 17:35:39.599981 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 585/1226] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:35:39 2022] DELETE /compute/v2.1/flavors/6403527e-38a9-40d5-82c1-5ca19de08c4b => generated 109 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:35:39.640511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-11887b4b-f543-4738-bca9-2a1acd7aa495 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:39.641129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-11887b4b-f543-4738-bca9-2a1acd7aa495 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:39.653742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11887b4b-f543-4738-bca9-2a1acd7aa495 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:39.653742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11887b4b-f543-4738-bca9-2a1acd7aa495 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:39.658340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11887b4b-f543-4738-bca9-2a1acd7aa495 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:39.666502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11887b4b-f543-4738-bca9-2a1acd7aa495 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:39.666502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11887b4b-f543-4738-bca9-2a1acd7aa495 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:39.666502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11887b4b-f543-4738-bca9-2a1acd7aa495 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:39.812728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-46493772", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:39.937691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:35:40.230601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11887b4b-f543-4738-bca9-2a1acd7aa495 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:40.241505 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-11887b4b-f543-4738-bca9-2a1acd7aa495 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1314 microversion: 2.1 time: 0.602927 Oct 05 17:35:40.245407 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 642/1227] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:39 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1314 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:40.282253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5aad31c8-c9d2-482d-a8f7-876784adf476 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:40.282888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5aad31c8-c9d2-482d-a8f7-876784adf476 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:40.295768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5aad31c8-c9d2-482d-a8f7-876784adf476 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:40.296267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5aad31c8-c9d2-482d-a8f7-876784adf476 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:40.306654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5aad31c8-c9d2-482d-a8f7-876784adf476 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:40.307449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5aad31c8-c9d2-482d-a8f7-876784adf476 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:40.307935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5aad31c8-c9d2-482d-a8f7-876784adf476 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:40.308377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5aad31c8-c9d2-482d-a8f7-876784adf476 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:40.565117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:35:40.565602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:35:40.565990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:35:40.566415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:35:40.567293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:35:40.582326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:40.583014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:40.583449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:40.584863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:40.585327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:40.585743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:40.624990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for project afc6422679664e47892eef7185291846. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:35:40.634790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Getting quotas for user 15a6bfffd8fb473b83de94858676f8ed and project afc6422679664e47892eef7185291846. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:35:40.647844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:35:40.650339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:35:40.711194 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0bed4b6d-4b14-4f46-85fc-2ef881ee81fd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903023 Oct 05 17:35:40.712488 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 586/1228] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:35:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 17:35:40.728361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8fd67ce6-0dc1-4624-884a-dfed8c8e6110 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:40.729503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8fd67ce6-0dc1-4624-884a-dfed8c8e6110 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:40.914982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8fd67ce6-0dc1-4624-884a-dfed8c8e6110 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:40.932274 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8fd67ce6-0dc1-4624-884a-dfed8c8e6110 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1211 microversion: 2.1 time: 0.208623 Oct 05 17:35:40.951902 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 587/1229] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:40 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1211 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:41.275201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c7021ea-addf-457d-8d02-ead8affdfef3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:41.275826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0c7021ea-addf-457d-8d02-ead8affdfef3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:41.287629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c7021ea-addf-457d-8d02-ead8affdfef3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:41.288055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c7021ea-addf-457d-8d02-ead8affdfef3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:41.288496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c7021ea-addf-457d-8d02-ead8affdfef3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:41.289215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c7021ea-addf-457d-8d02-ead8affdfef3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:41.289674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c7021ea-addf-457d-8d02-ead8affdfef3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:41.290098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c7021ea-addf-457d-8d02-ead8affdfef3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:41.730647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5aad31c8-c9d2-482d-a8f7-876784adf476 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:41.736591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0c7021ea-addf-457d-8d02-ead8affdfef3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:41.761390 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5aad31c8-c9d2-482d-a8f7-876784adf476 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1317 microversion: 2.1 time: 1.484061 Oct 05 17:35:41.763937 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 643/1230] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:40 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1317 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:41.765117 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c7021ea-addf-457d-8d02-ead8affdfef3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1463 microversion: 2.1 time: 0.492154 Oct 05 17:35:41.768144 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 588/1231] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:41 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1463 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:41.962250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab707aae-3b21-4a5b-8652-d72ebb8cbbe3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:41.962923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ab707aae-3b21-4a5b-8652-d72ebb8cbbe3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:41.977498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab707aae-3b21-4a5b-8652-d72ebb8cbbe3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:41.978419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab707aae-3b21-4a5b-8652-d72ebb8cbbe3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:41.979166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab707aae-3b21-4a5b-8652-d72ebb8cbbe3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:41.983702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab707aae-3b21-4a5b-8652-d72ebb8cbbe3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:41.984996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab707aae-3b21-4a5b-8652-d72ebb8cbbe3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:41.985723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab707aae-3b21-4a5b-8652-d72ebb8cbbe3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:42.106742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ab707aae-3b21-4a5b-8652-d72ebb8cbbe3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:42.121921 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ab707aae-3b21-4a5b-8652-d72ebb8cbbe3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1215 microversion: 2.1 time: 0.165615 Oct 05 17:35:42.123375 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 589/1232] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:41 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:42.403618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-62418c5f-ae00-49bb-a6aa-0f25db024e72 req-e45f9b8f-ca75-43dc-9f97-5808ba94f195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3793214f-3607-4041-8f62-fd2b36f1b171", "name": "network-vif-plugged", "status": "completed", "tag": "8fd18242-e1fd-42af-9db6-62c95ec947e4"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:42.426901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-62418c5f-ae00-49bb-a6aa-0f25db024e72 req-e45f9b8f-ca75-43dc-9f97-5808ba94f195 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:42.427308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-62418c5f-ae00-49bb-a6aa-0f25db024e72 req-e45f9b8f-ca75-43dc-9f97-5808ba94f195 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:42.429901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-62418c5f-ae00-49bb-a6aa-0f25db024e72 req-e45f9b8f-ca75-43dc-9f97-5808ba94f195 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:42.467369 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-62418c5f-ae00-49bb-a6aa-0f25db024e72 req-e45f9b8f-ca75-43dc-9f97-5808ba94f195 service nova] Creating event network-vif-plugged:8fd18242-e1fd-42af-9db6-62c95ec947e4 for instance 3793214f-3607-4041-8f62-fd2b36f1b171 on n-h1-835595-3 Oct 05 17:35:42.486200 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-62418c5f-ae00-49bb-a6aa-0f25db024e72 req-e45f9b8f-ca75-43dc-9f97-5808ba94f195 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089392 Oct 05 17:35:42.491945 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 590/1233] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:42.568064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c8a7041-1c91-4385-a8da-e8ac93e19fdb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:42.574175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3c8a7041-1c91-4385-a8da-e8ac93e19fdb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Searching by: {'deleted': False, 'project_id': '88777f083a5a4e6e9bc773a1d4493c53'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:35:42.589628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a33ac94-e227-47ce-a262-17154c7f26e4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c87b1675-2510-499b-b4fa-a72a3378c028"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:42.592297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a33ac94-e227-47ce-a262-17154c7f26e4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:42.600327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c8a7041-1c91-4385-a8da-e8ac93e19fdb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:42.600812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c8a7041-1c91-4385-a8da-e8ac93e19fdb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:42.602394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c8a7041-1c91-4385-a8da-e8ac93e19fdb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:42.602394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c8a7041-1c91-4385-a8da-e8ac93e19fdb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:42.603795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c8a7041-1c91-4385-a8da-e8ac93e19fdb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:42.605198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c8a7041-1c91-4385-a8da-e8ac93e19fdb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:42.610826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a33ac94-e227-47ce-a262-17154c7f26e4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:42.611335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a33ac94-e227-47ce-a262-17154c7f26e4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:42.611778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a33ac94-e227-47ce-a262-17154c7f26e4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:42.612539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a33ac94-e227-47ce-a262-17154c7f26e4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:42.613001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a33ac94-e227-47ce-a262-17154c7f26e4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:42.613427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a33ac94-e227-47ce-a262-17154c7f26e4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:42.643328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:42.881703 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c8a7041-1c91-4385-a8da-e8ac93e19fdb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 1.088159 Oct 05 17:35:42.883296 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 644/1234] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:35:41 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:42.891595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48b39231-2bda-484b-b75a-3781d9ba996a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:42.893933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-48b39231-2bda-484b-b75a-3781d9ba996a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:42.902615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b39231-2bda-484b-b75a-3781d9ba996a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:42.903441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b39231-2bda-484b-b75a-3781d9ba996a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:42.904102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b39231-2bda-484b-b75a-3781d9ba996a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:42.905203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b39231-2bda-484b-b75a-3781d9ba996a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:42.906555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b39231-2bda-484b-b75a-3781d9ba996a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:42.907284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b39231-2bda-484b-b75a-3781d9ba996a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:43.275786 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a33ac94-e227-47ce-a262-17154c7f26e4 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "POST /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689875 Oct 05 17:35:43.277783 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 591/1235] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 17:35:42 2022] POST /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments => generated 194 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:35:43.313437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:43.355559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Searching by: {'deleted': False} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:35:43.392519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:43.393134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:43.393593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:43.397310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:43.397859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:43.403957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:43.465167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-48b39231-2bda-484b-b75a-3781d9ba996a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:43.475083 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48b39231-2bda-484b-b75a-3781d9ba996a tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1317 microversion: 2.1 time: 0.590018 Oct 05 17:35:43.476645 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 645/1236] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:42 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1317 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:43.481637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90972166-a9ba-4e5a-a6c8-a4e448a94f25 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:43.482530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90972166-a9ba-4e5a-a6c8-a4e448a94f25 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:43.491213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90972166-a9ba-4e5a-a6c8-a4e448a94f25 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:43.491948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90972166-a9ba-4e5a-a6c8-a4e448a94f25 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:43.493105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90972166-a9ba-4e5a-a6c8-a4e448a94f25 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:43.494473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90972166-a9ba-4e5a-a6c8-a4e448a94f25 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:43.495147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90972166-a9ba-4e5a-a6c8-a4e448a94f25 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:43.495928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90972166-a9ba-4e5a-a6c8-a4e448a94f25 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:43.664463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:35:43.746240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90972166-a9ba-4e5a-a6c8-a4e448a94f25 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:43.756550 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90972166-a9ba-4e5a-a6c8-a4e448a94f25 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1269 microversion: 2.1 time: 0.278490 Oct 05 17:35:43.759947 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 646/1237] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:43 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1269 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:43.851643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:43.852936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:43.853386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:44.281921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0080236d-f3f7-461d-a27e-ffe6c247f95d tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Action: 'update', calling method: .version_select at 0x7f77751373a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:44.448932 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2122915d-d7f2-44b8-9ae2-02f5f899d29a tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19562 microversion: 2.1 time: 1.169740 Oct 05 17:35:44.450884 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 592/1238] 10.222.0.70 () {58 vars in 1171 bytes} [Wed Oct 5 17:35:43 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19562 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:35:44.503966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-45aaff56-5340-435c-8712-558abbbcad01 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:44.514449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-45aaff56-5340-435c-8712-558abbbcad01 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Searching by: {'deleted': False, 'project_id': '88777f083a5a4e6e9bc773a1d4493c53'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:35:44.523418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45aaff56-5340-435c-8712-558abbbcad01 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:44.524226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45aaff56-5340-435c-8712-558abbbcad01 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:44.525980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45aaff56-5340-435c-8712-558abbbcad01 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:44.527206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45aaff56-5340-435c-8712-558abbbcad01 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:44.528317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45aaff56-5340-435c-8712-558abbbcad01 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:44.528907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45aaff56-5340-435c-8712-558abbbcad01 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:44.729900 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-45aaff56-5340-435c-8712-558abbbcad01 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?tenant_id=1c79b829a6194b7fbfe07a1c77cd2464" status: 200 len: 15 microversion: 2.1 time: 0.233298 Oct 05 17:35:44.730842 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 593/1239] 10.222.0.70 () {58 vars in 1231 bytes} [Wed Oct 5 17:35:44 2022] GET /compute/v2.1/servers/detail?tenant_id=1c79b829a6194b7fbfe07a1c77cd2464 => generated 15 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:44.735825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7d6536a2-e5f0-4733-a9cb-05523465bb81 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:44.736557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7d6536a2-e5f0-4733-a9cb-05523465bb81 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:44.748677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0080236d-f3f7-461d-a27e-ffe6c247f95d tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:44.749182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0080236d-f3f7-461d-a27e-ffe6c247f95d tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:44.749616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0080236d-f3f7-461d-a27e-ffe6c247f95d tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:44.751367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0080236d-f3f7-461d-a27e-ffe6c247f95d tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:44.752472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0080236d-f3f7-461d-a27e-ffe6c247f95d tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:44.753911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0080236d-f3f7-461d-a27e-ffe6c247f95d tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:44.755185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d6536a2-e5f0-4733-a9cb-05523465bb81 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:44.755986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d6536a2-e5f0-4733-a9cb-05523465bb81 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:44.756134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d6536a2-e5f0-4733-a9cb-05523465bb81 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:44.756773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d6536a2-e5f0-4733-a9cb-05523465bb81 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:44.757225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d6536a2-e5f0-4733-a9cb-05523465bb81 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:44.762734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d6536a2-e5f0-4733-a9cb-05523465bb81 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:44.832257 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0080236d-f3f7-461d-a27e-ffe6c247f95d tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/51a212d521f4476991c2d4b2d1e9e233" status: 200 len: 240 microversion: 2.36 time: 1.069974 Oct 05 17:35:44.833712 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 647/1240] 10.222.0.70 () {62 vars in 1303 bytes} [Wed Oct 5 17:35:43 2022] PUT /compute/v2.1/os-quota-sets/51a212d521f4476991c2d4b2d1e9e233 => generated 240 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:35:44.846366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-bf58ebe8-064b-4f28-af67-9bc2baadc200 req-fd253d0c-d9b6-4206-a24c-ec13a23715b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7199d2-b000-4a07-abe4-4d76d42b430d", "name": "network-vif-plugged", "status": "completed", "tag": "efdb1b94-fda9-4a7a-b551-ba58af93ae12"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:44.857448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bf58ebe8-064b-4f28-af67-9bc2baadc200 req-fd253d0c-d9b6-4206-a24c-ec13a23715b1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:44.858705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bf58ebe8-064b-4f28-af67-9bc2baadc200 req-fd253d0c-d9b6-4206-a24c-ec13a23715b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:44.859870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bf58ebe8-064b-4f28-af67-9bc2baadc200 req-fd253d0c-d9b6-4206-a24c-ec13a23715b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:44.874557 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-bf58ebe8-064b-4f28-af67-9bc2baadc200 req-fd253d0c-d9b6-4206-a24c-ec13a23715b1 service nova] Creating event network-vif-plugged:efdb1b94-fda9-4a7a-b551-ba58af93ae12 for instance fb7199d2-b000-4a07-abe4-4d76d42b430d on n-h2-835595-3 Oct 05 17:35:44.880259 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-bf58ebe8-064b-4f28-af67-9bc2baadc200 req-fd253d0c-d9b6-4206-a24c-ec13a23715b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038297 Oct 05 17:35:44.886040 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 648/1241] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:44.893721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:44.902749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Searching by: {'tenant_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'deleted': False} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:35:44.926933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:44.927795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:44.929071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:44.930381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:44.931029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:44.931760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:45.004380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:35:45.047166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d6536a2-e5f0-4733-a9cb-05523465bb81 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:45.056060 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7d6536a2-e5f0-4733-a9cb-05523465bb81 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1317 microversion: 2.1 time: 0.323736 Oct 05 17:35:45.077102 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 594/1242] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:44 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1317 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:45.090991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6fae021c-0d09-4c3a-b2f2-381d58cd605e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:45.093876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6fae021c-0d09-4c3a-b2f2-381d58cd605e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:45.107307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fae021c-0d09-4c3a-b2f2-381d58cd605e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:45.107801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fae021c-0d09-4c3a-b2f2-381d58cd605e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:45.110519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fae021c-0d09-4c3a-b2f2-381d58cd605e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:45.114970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fae021c-0d09-4c3a-b2f2-381d58cd605e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:45.115461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fae021c-0d09-4c3a-b2f2-381d58cd605e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:45.117631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fae021c-0d09-4c3a-b2f2-381d58cd605e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:45.174868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:45.175352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:45.175783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:45.321775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6fae021c-0d09-4c3a-b2f2-381d58cd605e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:45.336848 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6fae021c-0d09-4c3a-b2f2-381d58cd605e tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1311 microversion: 2.1 time: 0.257824 Oct 05 17:35:45.337953 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 595/1243] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:45 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1311 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:45.342817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52d2e0aa-3e70-429c-b792-51648a6086b1 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Calling method '.version_select at 0x7f77758965e0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:45.480182 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b4f0665-6295-4ab1-9c12-4cbefb39f831 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1c79b829a6194b7fbfe07a1c77cd2464" status: 200 len: 4825 microversion: 2.1 time: 0.592200 Oct 05 17:35:45.480633 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 649/1244] 10.222.0.70 () {58 vars in 1257 bytes} [Wed Oct 5 17:35:44 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=1c79b829a6194b7fbfe07a1c77cd2464 => generated 4825 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:45.950638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d2e0aa-3e70-429c-b792-51648a6086b1 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:45.954552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d2e0aa-3e70-429c-b792-51648a6086b1 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:45.955006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d2e0aa-3e70-429c-b792-51648a6086b1 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:45.955780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d2e0aa-3e70-429c-b792-51648a6086b1 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:45.958727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d2e0aa-3e70-429c-b792-51648a6086b1 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:45.959659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d2e0aa-3e70-429c-b792-51648a6086b1 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:45.997939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2019824443", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:46.021032 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-52d2e0aa-3e70-429c-b792-51648a6086b1 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/51a212d521f4476991c2d4b2d1e9e233/detail" status: 200 len: 672 microversion: 2.36 time: 0.681712 Oct 05 17:35:46.036314 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 596/1245] 10.222.0.70 () {60 vars in 1304 bytes} [Wed Oct 5 17:35:45 2022] GET /compute/v2.1/os-quota-sets/51a212d521f4476991c2d4b2d1e9e233/detail => generated 672 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:35:46.041371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d618a86c-1115-4078-b631-4b746c514c87 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:46.048931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d618a86c-1115-4078-b631-4b746c514c87 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Searching by: {'tenant_id': '88777f083a5a4e6e9bc773a1d4493c53', 'deleted': False} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:35:46.068761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:35:46.084838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d618a86c-1115-4078-b631-4b746c514c87 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.086682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d618a86c-1115-4078-b631-4b746c514c87 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.088370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d618a86c-1115-4078-b631-4b746c514c87 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.089282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d618a86c-1115-4078-b631-4b746c514c87 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.091565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d618a86c-1115-4078-b631-4b746c514c87 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.095621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d618a86c-1115-4078-b631-4b746c514c87 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.157139 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d618a86c-1115-4078-b631-4b746c514c87 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=88777f083a5a4e6e9bc773a1d4493c53" status: 200 len: 15 microversion: 2.1 time: 0.119443 Oct 05 17:35:46.158479 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 597/1246] 10.222.0.70 () {58 vars in 1257 bytes} [Wed Oct 5 17:35:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=88777f083a5a4e6e9bc773a1d4493c53 => generated 15 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:46.163547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b070b2ef-baca-49c5-9b6f-2cb4c22eff1c tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:46.164398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b070b2ef-baca-49c5-9b6f-2cb4c22eff1c tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:46.171845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b070b2ef-baca-49c5-9b6f-2cb4c22eff1c tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.172648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b070b2ef-baca-49c5-9b6f-2cb4c22eff1c tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.173277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b070b2ef-baca-49c5-9b6f-2cb4c22eff1c tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.174378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b070b2ef-baca-49c5-9b6f-2cb4c22eff1c tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.174973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b070b2ef-baca-49c5-9b6f-2cb4c22eff1c tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.175636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b070b2ef-baca-49c5-9b6f-2cb4c22eff1c tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.385882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b070b2ef-baca-49c5-9b6f-2cb4c22eff1c tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:46.396363 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b070b2ef-baca-49c5-9b6f-2cb4c22eff1c tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1317 microversion: 2.1 time: 0.236459 Oct 05 17:35:46.397772 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 598/1247] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:46 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:46.402618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4989f466-7c77-4f93-b6cb-2d4c8cd20a88 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:46.410012 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4989f466-7c77-4f93-b6cb-2d4c8cd20a88 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009717 Oct 05 17:35:46.410914 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 599/1248] 10.222.0.70 () {58 vars in 1189 bytes} [Wed Oct 5 17:35:46 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:46.418346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Action: 'update', calling method: .version_select at 0x7f77754248b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:46.578819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:35:46.579393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:35:46.579699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:35:46.580107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:35:46.580516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:35:46.600692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.601386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.603222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.604727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.606845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.607611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.646051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Getting quotas for project 741b444ad58d47b296e4d70d0d94587a. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:35:46.650867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Getting quotas for user c15fb4681498409fa6409b5d5de686ca and project 741b444ad58d47b296e4d70d0d94587a. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:35:46.666742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:35:46.669759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:35:46.721994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.723630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.724426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.725429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.726031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.726640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.749461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:46.756042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7666b430-0656-4de9-b5f8-646a6a889c92 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274007 Oct 05 17:35:46.763420 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 650/1249] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:35:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:35:46.769900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-68531722-bb6e-4537-8992-2d97de12110d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:46.770776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-68531722-bb6e-4537-8992-2d97de12110d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:46.779334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68531722-bb6e-4537-8992-2d97de12110d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.780106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68531722-bb6e-4537-8992-2d97de12110d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.780549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68531722-bb6e-4537-8992-2d97de12110d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.781511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68531722-bb6e-4537-8992-2d97de12110d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.781979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68531722-bb6e-4537-8992-2d97de12110d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.782676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68531722-bb6e-4537-8992-2d97de12110d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.812895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.813395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.813839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.814637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.815097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.815522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.885028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-792f1d5b-ccbd-4ace-af51-b9c65b6e1964 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-sets/51a212d521f4476991c2d4b2d1e9e233?user_id=630b18f1009e4e8282ab578ee34e5929" status: 200 len: 240 microversion: 2.36 time: 0.472920 Oct 05 17:35:46.885684 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 600/1250] 10.222.0.70 () {62 vars in 1384 bytes} [Wed Oct 5 17:35:46 2022] PUT /compute/v2.1/os-quota-sets/51a212d521f4476991c2d4b2d1e9e233?user_id=630b18f1009e4e8282ab578ee34e5929 => generated 240 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:35:46.898258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-71c8b48f-02c5-4202-a94f-0d0e8ba0a4e2 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:46.900547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-71c8b48f-02c5-4202-a94f-0d0e8ba0a4e2 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:46.918429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71c8b48f-02c5-4202-a94f-0d0e8ba0a4e2 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.918932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71c8b48f-02c5-4202-a94f-0d0e8ba0a4e2 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.919372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71c8b48f-02c5-4202-a94f-0d0e8ba0a4e2 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:46.920165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71c8b48f-02c5-4202-a94f-0d0e8ba0a4e2 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:46.920526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71c8b48f-02c5-4202-a94f-0d0e8ba0a4e2 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:46.921052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71c8b48f-02c5-4202-a94f-0d0e8ba0a4e2 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:47.053829 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-71c8b48f-02c5-4202-a94f-0d0e8ba0a4e2 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action" status: 202 len: 0 microversion: 2.1 time: 0.159622 Oct 05 17:35:47.070973 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 601/1251] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:46 2022] POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:47.078527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c89036e-2bee-4bd8-ae9e-0d9b47149344 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:47.082667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0c89036e-2bee-4bd8-ae9e-0d9b47149344 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:47.160805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0c89036e-2bee-4bd8-ae9e-0d9b47149344 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:47.177606 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c89036e-2bee-4bd8-ae9e-0d9b47149344 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1214 microversion: 2.1 time: 0.101674 Oct 05 17:35:47.179300 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 602/1252] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:47 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1214 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:47.180755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-68531722-bb6e-4537-8992-2d97de12110d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:47.202128 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-68531722-bb6e-4537-8992-2d97de12110d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1311 microversion: 2.1 time: 0.437338 Oct 05 17:35:47.203098 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 651/1253] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:46 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1311 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:47.214614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a56f337c-c2dc-40b0-b7ac-818f2509a641 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] Calling method '.version_select at 0x7f7775424ca0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:47.227846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:47.233933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:47.235379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:35:47.242847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:47.243736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:47.244330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:47.245256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:47.245933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:47.246552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:47.438517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:35:47.523701 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0b2168b-cb4b-4dc6-907e-d41e6d2de858 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.306031 Oct 05 17:35:47.526429 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 652/1254] 10.222.0.70 () {58 vars in 1150 bytes} [Wed Oct 5 17:35:47 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:47.536339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-91e25786-1e0d-48fb-96cd-8e48c6f0f771 req-cf546cc6-0689-4023-9df1-e1c2fd657fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2deb41c1-aad2-44ec-890d-ee629b7026a8", "tag": "662f062f-3156-4f24-b7bb-57e88b7f1361"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:47.549135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-91e25786-1e0d-48fb-96cd-8e48c6f0f771 req-cf546cc6-0689-4023-9df1-e1c2fd657fc5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:47.549740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-91e25786-1e0d-48fb-96cd-8e48c6f0f771 req-cf546cc6-0689-4023-9df1-e1c2fd657fc5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:47.550393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-91e25786-1e0d-48fb-96cd-8e48c6f0f771 req-cf546cc6-0689-4023-9df1-e1c2fd657fc5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:47.564303 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-91e25786-1e0d-48fb-96cd-8e48c6f0f771 req-cf546cc6-0689-4023-9df1-e1c2fd657fc5 service nova] Creating event network-changed:662f062f-3156-4f24-b7bb-57e88b7f1361 for instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 on n-h2-835595-3 Oct 05 17:35:47.570269 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-91e25786-1e0d-48fb-96cd-8e48c6f0f771 req-cf546cc6-0689-4023-9df1-e1c2fd657fc5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044113 Oct 05 17:35:47.571459 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 653/1255] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:47.578634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6107b6f5-0ac1-4f62-8b6a-292a17bbd2d6 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:47.579585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6107b6f5-0ac1-4f62-8b6a-292a17bbd2d6 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:47.603023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6107b6f5-0ac1-4f62-8b6a-292a17bbd2d6 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:47.604348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6107b6f5-0ac1-4f62-8b6a-292a17bbd2d6 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:47.605766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6107b6f5-0ac1-4f62-8b6a-292a17bbd2d6 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:47.608571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6107b6f5-0ac1-4f62-8b6a-292a17bbd2d6 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:47.610603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6107b6f5-0ac1-4f62-8b6a-292a17bbd2d6 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:47.611149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6107b6f5-0ac1-4f62-8b6a-292a17bbd2d6 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:47.703984 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a56f337c-c2dc-40b0-b7ac-818f2509a641 tempest-QuotasAdminTestV236-1467832277 tempest-QuotasAdminTestV236-1467832277-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/51a212d521f4476991c2d4b2d1e9e233?user_id=630b18f1009e4e8282ab578ee34e5929" status: 200 len: 282 microversion: 2.36 time: 0.520130 Oct 05 17:35:47.705375 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 603/1256] 10.222.0.70 () {60 vars in 1364 bytes} [Wed Oct 5 17:35:47 2022] GET /compute/v2.1/os-quota-sets/51a212d521f4476991c2d4b2d1e9e233?user_id=630b18f1009e4e8282ab578ee34e5929 => generated 282 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:35:47.710216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c0d0b83d-1f92-4ba8-9186-dfa490b2216c tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:47.712471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c0d0b83d-1f92-4ba8-9186-dfa490b2216c tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:47.721195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d0b83d-1f92-4ba8-9186-dfa490b2216c tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:47.721856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d0b83d-1f92-4ba8-9186-dfa490b2216c tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:47.722587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d0b83d-1f92-4ba8-9186-dfa490b2216c tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:47.723784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d0b83d-1f92-4ba8-9186-dfa490b2216c tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:47.724282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d0b83d-1f92-4ba8-9186-dfa490b2216c tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:47.726335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d0b83d-1f92-4ba8-9186-dfa490b2216c tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:47.857953 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c0d0b83d-1f92-4ba8-9186-dfa490b2216c tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action" status: 202 len: 0 microversion: 2.1 time: 0.151137 Oct 05 17:35:47.860858 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 604/1257] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:47 2022] POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:47.915996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6107b6f5-0ac1-4f62-8b6a-292a17bbd2d6 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:47.928480 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6107b6f5-0ac1-4f62-8b6a-292a17bbd2d6 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1504 microversion: 2.1 time: 0.355572 Oct 05 17:35:47.951430 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 654/1258] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:47 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1504 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:47.964390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-91f7aeab-db39-43b0-99f3-5b710b45a401 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:47.965012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-91f7aeab-db39-43b0-99f3-5b710b45a401 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:47.985560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f7aeab-db39-43b0-99f3-5b710b45a401 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:47.985560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f7aeab-db39-43b0-99f3-5b710b45a401 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:47.986394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f7aeab-db39-43b0-99f3-5b710b45a401 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:47.993993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f7aeab-db39-43b0-99f3-5b710b45a401 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:47.994527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f7aeab-db39-43b0-99f3-5b710b45a401 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:47.994964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f7aeab-db39-43b0-99f3-5b710b45a401 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.264367 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-91f7aeab-db39-43b0-99f3-5b710b45a401 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1614 microversion: 2.1 time: 0.311542 Oct 05 17:35:48.265645 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 655/1259] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:47 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1614 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:48.267798 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e8fd07c7-f6da-457b-b80d-9b08c28d0e2b tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] 10.222.0.70 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.405966 Oct 05 17:35:48.268975 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 605/1260] 10.222.0.70 () {58 vars in 1128 bytes} [Wed Oct 5 17:35:47 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 17:35:48.274792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cccad5ed-5173-48f7-a470-9d3763b3a8ff tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.275694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cccad5ed-5173-48f7-a470-9d3763b3a8ff tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:48.277449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b462aa02-cf5e-4539-94bb-1daec2510d87 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.277736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b462aa02-cf5e-4539-94bb-1daec2510d87 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:48.283511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccad5ed-5173-48f7-a470-9d3763b3a8ff tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.284260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccad5ed-5173-48f7-a470-9d3763b3a8ff tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.285057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccad5ed-5173-48f7-a470-9d3763b3a8ff tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.285965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccad5ed-5173-48f7-a470-9d3763b3a8ff tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.286936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccad5ed-5173-48f7-a470-9d3763b3a8ff tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.287423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccad5ed-5173-48f7-a470-9d3763b3a8ff tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.292324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b462aa02-cf5e-4539-94bb-1daec2510d87 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.292967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b462aa02-cf5e-4539-94bb-1daec2510d87 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.293412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b462aa02-cf5e-4539-94bb-1daec2510d87 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.294225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b462aa02-cf5e-4539-94bb-1daec2510d87 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.294781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b462aa02-cf5e-4539-94bb-1daec2510d87 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.295212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b462aa02-cf5e-4539-94bb-1daec2510d87 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.319744 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cccad5ed-5173-48f7-a470-9d3763b3a8ff tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d/ips" status: 200 len: 107 microversion: 2.1 time: 0.052824 Oct 05 17:35:48.327594 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 656/1261] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:35:48 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d/ips => generated 107 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:48.332418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b16c8c7c-6fdf-4bb1-8b99-63cdc58d0a2f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.333026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b16c8c7c-6fdf-4bb1-8b99-63cdc58d0a2f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:48.339062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b16c8c7c-6fdf-4bb1-8b99-63cdc58d0a2f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.339736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b16c8c7c-6fdf-4bb1-8b99-63cdc58d0a2f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.340358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b16c8c7c-6fdf-4bb1-8b99-63cdc58d0a2f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.341217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b16c8c7c-6fdf-4bb1-8b99-63cdc58d0a2f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.341890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b16c8c7c-6fdf-4bb1-8b99-63cdc58d0a2f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.342554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b16c8c7c-6fdf-4bb1-8b99-63cdc58d0a2f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.364465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:48.377625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b462aa02-cf5e-4539-94bb-1daec2510d87 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:48.386319 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b462aa02-cf5e-4539-94bb-1daec2510d87 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1266 microversion: 2.1 time: 0.116011 Oct 05 17:35:48.387506 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 606/1262] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:48 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:48.393091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-54f0e578-e62c-4b98-bafe-647c439845eb tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Calling method '.version_select at 0x7f7775438c10>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.473006 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-54f0e578-e62c-4b98-bafe-647c439845eb tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] HTTP exception thrown: Image not found. Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-54f0e578-e62c-4b98-bafe-647c439845eb tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Request method failure captured: Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcBzCAq48Onocv4nYdEFCw_cYK3sv0KGJP2NVOApkMcgK367KfRhZ2zy2jXBuFGqn5mUAZsvdROl9FAwHwzNWM0FMsN1U3WLof35l6qNKqIDafnoSy4PHdCmZEIEE3Ionpx-uRjOKn-AuvhqCQ9voc9Avr-2dH24chVG6cGxXVUbR1M Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 33758a5dd94242368b0d9966f979de1d Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:35:48.483338 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33758a5dd94242368b0d9966f979de1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33758a5dd94242368b0d9966f979de1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33758a5dd94242368b0d9966f979de1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33758a5dd94242368b0d9966f979de1d"}]}] Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 33758a5dd94242368b0d9966f979de1d Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesDeleteNegativeTestJSON-455530806-project Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: af0e8e41339049488508ccbdd71eec4c Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-455530806-project Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: exception: Image not found. Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '-1'} Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:48.485590 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.486640 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:48.487819 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.489215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-54f0e578-e62c-4b98-bafe-647c439845eb tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Returning 404 to user: Image not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:48.495787 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-54f0e578-e62c-4b98-bafe-647c439845eb tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] 10.222.0.70 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.096501 Oct 05 17:35:48.500123 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 607/1263] 10.222.0.70 () {58 vars in 1134 bytes} [Wed Oct 5 17:35:48 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:35:48.508679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b16c8c7c-6fdf-4bb1-8b99-63cdc58d0a2f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:48.513586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d12eebf-7fb0-4bf1-ac92-a5274571a630 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.514186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6d12eebf-7fb0-4bf1-ac92-a5274571a630 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:48.518311 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b16c8c7c-6fdf-4bb1-8b99-63cdc58d0a2f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1311 microversion: 2.1 time: 0.189506 Oct 05 17:35:48.520858 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 657/1264] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:48 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1311 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:48.526010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d12eebf-7fb0-4bf1-ac92-a5274571a630 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.526545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d12eebf-7fb0-4bf1-ac92-a5274571a630 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.527097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d12eebf-7fb0-4bf1-ac92-a5274571a630 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.527764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d12eebf-7fb0-4bf1-ac92-a5274571a630 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.528185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d12eebf-7fb0-4bf1-ac92-a5274571a630 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.528630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d12eebf-7fb0-4bf1-ac92-a5274571a630 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.542838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c060b2ef-0e14-4bc8-90b9-fac0d8661f53 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.543771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c060b2ef-0e14-4bc8-90b9-fac0d8661f53 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:48.558898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c060b2ef-0e14-4bc8-90b9-fac0d8661f53 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.559718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c060b2ef-0e14-4bc8-90b9-fac0d8661f53 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.560339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c060b2ef-0e14-4bc8-90b9-fac0d8661f53 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.561245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c060b2ef-0e14-4bc8-90b9-fac0d8661f53 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.561882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c060b2ef-0e14-4bc8-90b9-fac0d8661f53 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.563116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c060b2ef-0e14-4bc8-90b9-fac0d8661f53 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.597307 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c060b2ef-0e14-4bc8-90b9-fac0d8661f53 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d/ips" status: 200 len: 107 microversion: 2.1 time: 0.072857 Oct 05 17:35:48.599216 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 658/1265] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:35:48 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d/ips => generated 107 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:48.622196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e6ae88b-23ee-45a8-bfd9-919143971546 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Calling method '.version_select at 0x7f7774fa7c10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.656638 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-4e6ae88b-23ee-45a8-bfd9-919143971546 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] HTTP exception thrown: Image not found. Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e6ae88b-23ee-45a8-bfd9-919143971546 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Request method failure captured: Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/images/1736cd0a-c19f-4177-b8f8-4e852fbc294j HTTP/1.1 Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBzCAq48Onocv4nYdEFCw_cYK3sv0KGJP2NVOApkMcgK367KfRhZ2zy2jXBuFGqn5mUAZsvdROl9FAwHwzNWM0FMsN1U3WLof35l6qNKqIDafnoSy4PHdCmZEIEE3Ionpx-uRjOKn-AuvhqCQ9voc9Avr-2dH24chVG6cGxXVUbR1M Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 33758a5dd94242368b0d9966f979de1d Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:48.661534 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33758a5dd94242368b0d9966f979de1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33758a5dd94242368b0d9966f979de1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33758a5dd94242368b0d9966f979de1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33758a5dd94242368b0d9966f979de1d"}]}] Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 33758a5dd94242368b0d9966f979de1d Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesDeleteNegativeTestJSON-455530806-project Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: af0e8e41339049488508ccbdd71eec4c Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-455530806-project Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '1736cd0a-c19f-4177-b8f8-4e852fbc294j'} Oct 05 17:35:48.663271 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1736cd0a-c19f-4177-b8f8-4e852fbc294j to delete Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:48.664297 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1736cd0a-c19f-4177-b8f8-4e852fbc294j could not be found. Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:48.665512 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:35:48.668244 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.671035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e6ae88b-23ee-45a8-bfd9-919143971546 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:48.672542 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e6ae88b-23ee-45a8-bfd9-919143971546 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] 10.222.0.70 "DELETE /compute/v2.1/images/1736cd0a-c19f-4177-b8f8-4e852fbc294j" status: 404 len: 62 microversion: 2.1 time: 0.071942 Oct 05 17:35:48.677759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 659/1266] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:48 2022] DELETE /compute/v2.1/images/1736cd0a-c19f-4177-b8f8-4e852fbc294j => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:35:48.683244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-144d8a3b-8393-459c-9610-39e65121a0bf tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.683973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-144d8a3b-8393-459c-9610-39e65121a0bf tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:48.692972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-144d8a3b-8393-459c-9610-39e65121a0bf tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.693601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-144d8a3b-8393-459c-9610-39e65121a0bf tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.694308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-144d8a3b-8393-459c-9610-39e65121a0bf tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.695121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-144d8a3b-8393-459c-9610-39e65121a0bf tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.695653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-144d8a3b-8393-459c-9610-39e65121a0bf tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.696206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-144d8a3b-8393-459c-9610-39e65121a0bf tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.746463 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-144d8a3b-8393-459c-9610-39e65121a0bf tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d/ips/tempest-ServerAddressesTestJSON-78719022-network" status: 200 len: 92 microversion: 2.1 time: 0.071220 Oct 05 17:35:48.755484 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 660/1267] 10.222.0.70 () {58 vars in 1395 bytes} [Wed Oct 5 17:35:48 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d/ips/tempest-ServerAddressesTestJSON-78719022-network => generated 92 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:48.767102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec903100-6ae2-4007-83b6-bd46f999af19 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Calling method '.version_select at 0x7f77751d1e50>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.795524 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ec903100-6ae2-4007-83b6-bd46f999af19 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] HTTP exception thrown: Image not found. Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec903100-6ae2-4007-83b6-bd46f999af19 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Request method failure captured: Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/images/46edd1f9-bd36-44d8-96aa-940824f2bec01 HTTP/1.1 Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBzCAq48Onocv4nYdEFCw_cYK3sv0KGJP2NVOApkMcgK367KfRhZ2zy2jXBuFGqn5mUAZsvdROl9FAwHwzNWM0FMsN1U3WLof35l6qNKqIDafnoSy4PHdCmZEIEE3Ionpx-uRjOKn-AuvhqCQ9voc9Avr-2dH24chVG6cGxXVUbR1M Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 33758a5dd94242368b0d9966f979de1d Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:48.797714 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33758a5dd94242368b0d9966f979de1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33758a5dd94242368b0d9966f979de1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33758a5dd94242368b0d9966f979de1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33758a5dd94242368b0d9966f979de1d"}]}] Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 33758a5dd94242368b0d9966f979de1d Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesDeleteNegativeTestJSON-455530806-project Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: af0e8e41339049488508ccbdd71eec4c Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-455530806-project Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '46edd1f9-bd36-44d8-96aa-940824f2bec01'} Oct 05 17:35:48.799135 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 46edd1f9-bd36-44d8-96aa-940824f2bec01 to delete Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:48.799938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 46edd1f9-bd36-44d8-96aa-940824f2bec01 could not be found. Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:48.802012 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec903100-6ae2-4007-83b6-bd46f999af19 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:48.804515 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ec903100-6ae2-4007-83b6-bd46f999af19 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] 10.222.0.70 "DELETE /compute/v2.1/images/46edd1f9-bd36-44d8-96aa-940824f2bec01" status: 404 len: 62 microversion: 2.1 time: 0.047786 Oct 05 17:35:48.806650 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 661/1268] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:35:48 2022] DELETE /compute/v2.1/images/46edd1f9-bd36-44d8-96aa-940824f2bec01 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:35:48.810774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0a7e60bb-29c3-4743-b6b1-043c09b87ff9 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.811330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0a7e60bb-29c3-4743-b6b1-043c09b87ff9 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:48.819044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a7e60bb-29c3-4743-b6b1-043c09b87ff9 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.819545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a7e60bb-29c3-4743-b6b1-043c09b87ff9 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.820207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a7e60bb-29c3-4743-b6b1-043c09b87ff9 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.820934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a7e60bb-29c3-4743-b6b1-043c09b87ff9 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:48.821396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a7e60bb-29c3-4743-b6b1-043c09b87ff9 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:48.821824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a7e60bb-29c3-4743-b6b1-043c09b87ff9 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:48.857726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0a7e60bb-29c3-4743-b6b1-043c09b87ff9 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:35:48.946525 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6d12eebf-7fb0-4bf1-ac92-a5274571a630 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1614 microversion: 2.1 time: 0.446055 Oct 05 17:35:48.950483 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 608/1269] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:48 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1614 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:48.956561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58aaeb17-6784-4d1c-9303-7c50143929af tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Calling method '.version_select at 0x7f7775424af0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:48.995076 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-58aaeb17-6784-4d1c-9303-7c50143929af tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] HTTP exception thrown: Image not found. Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58aaeb17-6784-4d1c-9303-7c50143929af tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Request method failure captured: Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/images/tempest-invalid-1429787099 HTTP/1.1 Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcBzCAq48Onocv4nYdEFCw_cYK3sv0KGJP2NVOApkMcgK367KfRhZ2zy2jXBuFGqn5mUAZsvdROl9FAwHwzNWM0FMsN1U3WLof35l6qNKqIDafnoSy4PHdCmZEIEE3Ionpx-uRjOKn-AuvhqCQ9voc9Avr-2dH24chVG6cGxXVUbR1M Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 33758a5dd94242368b0d9966f979de1d Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:35:48.997739 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33758a5dd94242368b0d9966f979de1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33758a5dd94242368b0d9966f979de1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33758a5dd94242368b0d9966f979de1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33758a5dd94242368b0d9966f979de1d"}]}] Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 33758a5dd94242368b0d9966f979de1d Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesDeleteNegativeTestJSON-455530806-project Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: af0e8e41339049488508ccbdd71eec4c Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-455530806-project Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: exception: Image not found. Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'tempest-invalid-1429787099'} Oct 05 17:35:48.999164 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1429787099 to delete Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:49.000129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1429787099 could not be found. Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:49.001303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:35:49.002550 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.004330 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0a7e60bb-29c3-4743-b6b1-043c09b87ff9 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 204 len: 0 microversion: 2.1 time: 0.197028 Oct 05 17:35:49.005735 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 662/1270] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:35:48 2022] DELETE /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:35:49.005881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58aaeb17-6784-4d1c-9303-7c50143929af tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Returning 404 to user: Image not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:49.009301 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-58aaeb17-6784-4d1c-9303-7c50143929af tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] 10.222.0.70 "DELETE /compute/v2.1/images/tempest-invalid-1429787099" status: 404 len: 62 microversion: 2.1 time: 0.057100 Oct 05 17:35:49.014372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ffb7fad2-5d78-436d-9648-4b3263232b08 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:49.019619 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 609/1271] 10.222.0.70 () {58 vars in 1206 bytes} [Wed Oct 5 17:35:48 2022] DELETE /compute/v2.1/images/tempest-invalid-1429787099 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:35:49.024455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-26689257-b583-4d09-81be-105de4f62ed4 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:49.025896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-26689257-b583-4d09-81be-105de4f62ed4 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:49.028139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ffb7fad2-5d78-436d-9648-4b3263232b08 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Searching by: {'host': 'n-h1-835595-3', 'deleted': False} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:35:49.035516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffb7fad2-5d78-436d-9648-4b3263232b08 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.036017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffb7fad2-5d78-436d-9648-4b3263232b08 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.036497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffb7fad2-5d78-436d-9648-4b3263232b08 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.037319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffb7fad2-5d78-436d-9648-4b3263232b08 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.038517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffb7fad2-5d78-436d-9648-4b3263232b08 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.039279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffb7fad2-5d78-436d-9648-4b3263232b08 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.040748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26689257-b583-4d09-81be-105de4f62ed4 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.041260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26689257-b583-4d09-81be-105de4f62ed4 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.041705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26689257-b583-4d09-81be-105de4f62ed4 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.045930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26689257-b583-4d09-81be-105de4f62ed4 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.056627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26689257-b583-4d09-81be-105de4f62ed4 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.057096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26689257-b583-4d09-81be-105de4f62ed4 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.192251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-ffb7fad2-5d78-436d-9648-4b3263232b08 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:35:49.269895 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ffb7fad2-5d78-436d-9648-4b3263232b08 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers?host=n-h1-835595-3&all_tenants=1" status: 200 len: 2646 microversion: 2.1 time: 0.260961 Oct 05 17:35:49.271152 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 663/1272] 10.222.0.70 () {58 vars in 1190 bytes} [Wed Oct 5 17:35:49 2022] GET /compute/v2.1/servers?host=n-h1-835595-3&all_tenants=1 => generated 2646 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:49.276504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87acee02-0a35-47a8-8c71-0e4830b3aaf1 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Calling method '.version_select at 0x7f7775127700>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:49.307486 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-87acee02-0a35-47a8-8c71-0e4830b3aaf1 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] HTTP exception thrown: Image not found. Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87acee02-0a35-47a8-8c71-0e4830b3aaf1 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Request method failure captured: Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/images/42bb56bb-a833-4383-bc5f-8fd3ec754fff HTTP/1.1 Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBzCAq48Onocv4nYdEFCw_cYK3sv0KGJP2NVOApkMcgK367KfRhZ2zy2jXBuFGqn5mUAZsvdROl9FAwHwzNWM0FMsN1U3WLof35l6qNKqIDafnoSy4PHdCmZEIEE3Ionpx-uRjOKn-AuvhqCQ9voc9Avr-2dH24chVG6cGxXVUbR1M Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 33758a5dd94242368b0d9966f979de1d Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:49.313556 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/33758a5dd94242368b0d9966f979de1d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33758a5dd94242368b0d9966f979de1d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_33758a5dd94242368b0d9966f979de1d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/33758a5dd94242368b0d9966f979de1d"}]}] Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 33758a5dd94242368b0d9966f979de1d Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-455530806 Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesDeleteNegativeTestJSON-455530806-project Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: af0e8e41339049488508ccbdd71eec4c Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-455530806-project Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '42bb56bb-a833-4383-bc5f-8fd3ec754fff'} Oct 05 17:35:49.315204 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 42bb56bb-a833-4383-bc5f-8fd3ec754fff to delete Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:49.316110 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 42bb56bb-a833-4383-bc5f-8fd3ec754fff could not be found. Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:49.317270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87acee02-0a35-47a8-8c71-0e4830b3aaf1 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:49.318535 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87acee02-0a35-47a8-8c71-0e4830b3aaf1 tempest-ImagesDeleteNegativeTestJSON-455530806 tempest-ImagesDeleteNegativeTestJSON-455530806-project] 10.222.0.70 "DELETE /compute/v2.1/images/42bb56bb-a833-4383-bc5f-8fd3ec754fff" status: 404 len: 62 microversion: 2.1 time: 0.043738 Oct 05 17:35:49.319480 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 664/1273] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:49 2022] DELETE /compute/v2.1/images/42bb56bb-a833-4383-bc5f-8fd3ec754fff => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:35:49.321809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54c10a4c-7063-4b20-bb3a-f6d1772893c8 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:49.330457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54c10a4c-7063-4b20-bb3a-f6d1772893c8 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:35:49.337716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54c10a4c-7063-4b20-bb3a-f6d1772893c8 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.338479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54c10a4c-7063-4b20-bb3a-f6d1772893c8 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.339062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54c10a4c-7063-4b20-bb3a-f6d1772893c8 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.340605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54c10a4c-7063-4b20-bb3a-f6d1772893c8 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.341213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54c10a4c-7063-4b20-bb3a-f6d1772893c8 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.341932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54c10a4c-7063-4b20-bb3a-f6d1772893c8 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.350027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-26689257-b583-4d09-81be-105de4f62ed4 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:49.365611 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-26689257-b583-4d09-81be-105de4f62ed4 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1510 microversion: 2.1 time: 0.348553 Oct 05 17:35:49.366203 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 610/1274] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:49 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:49.370368 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54c10a4c-7063-4b20-bb3a-f6d1772893c8 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.051908 Oct 05 17:35:49.371008 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 665/1275] 10.222.0.70 () {58 vars in 1196 bytes} [Wed Oct 5 17:35:49 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:49.384126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6043f3a-84b2-4061-b575-ecd477b3eb07 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:49.386448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c6043f3a-84b2-4061-b575-ecd477b3eb07 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:49.393196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6043f3a-84b2-4061-b575-ecd477b3eb07 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.393673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6043f3a-84b2-4061-b575-ecd477b3eb07 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.394545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6043f3a-84b2-4061-b575-ecd477b3eb07 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.395467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6043f3a-84b2-4061-b575-ecd477b3eb07 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.396112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6043f3a-84b2-4061-b575-ecd477b3eb07 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.396727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6043f3a-84b2-4061-b575-ecd477b3eb07 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.401457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:49.420925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a786dcb3-cbee-4f1e-bbb4-024966b6c4ea tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:49.422008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a786dcb3-cbee-4f1e-bbb4-024966b6c4ea tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:49.429865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a786dcb3-cbee-4f1e-bbb4-024966b6c4ea tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.430707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a786dcb3-cbee-4f1e-bbb4-024966b6c4ea tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.431138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a786dcb3-cbee-4f1e-bbb4-024966b6c4ea tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.431832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a786dcb3-cbee-4f1e-bbb4-024966b6c4ea tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.432764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a786dcb3-cbee-4f1e-bbb4-024966b6c4ea tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.433402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a786dcb3-cbee-4f1e-bbb4-024966b6c4ea tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.521510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a786dcb3-cbee-4f1e-bbb4-024966b6c4ea tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:49.522877 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c6043f3a-84b2-4061-b575-ecd477b3eb07 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action" status: 202 len: 0 microversion: 2.1 time: 0.142910 Oct 05 17:35:49.523979 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 611/1276] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:49 2022] POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:35:49.532325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:49.532704 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a786dcb3-cbee-4f1e-bbb4-024966b6c4ea tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1272 microversion: 2.1 time: 0.124775 Oct 05 17:35:49.533438 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 666/1277] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:49 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:49.535123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:49.543240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c818325-be0b-41b5-bb82-5a19363e71cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:49.544059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c818325-be0b-41b5-bb82-5a19363e71cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:49.550851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c818325-be0b-41b5-bb82-5a19363e71cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.551572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c818325-be0b-41b5-bb82-5a19363e71cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.552183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c818325-be0b-41b5-bb82-5a19363e71cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.553062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c818325-be0b-41b5-bb82-5a19363e71cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.553694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c818325-be0b-41b5-bb82-5a19363e71cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.554310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c818325-be0b-41b5-bb82-5a19363e71cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.555477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.555976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.556481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.557345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.557804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.558435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.693500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:35:49.693935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:35:49.694449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:35:49.694862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:35:49.701995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:35:49.872657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:49.885965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.894794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.895939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.901499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:49.902891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:49.904244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:49.912295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9c818325-be0b-41b5-bb82-5a19363e71cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:49.924070 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c818325-be0b-41b5-bb82-5a19363e71cd tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1311 microversion: 2.1 time: 0.384452 Oct 05 17:35:49.924675 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 667/1278] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:49 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1311 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:49.988085 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-88fb8449-678a-4989-a585-4513d230f833 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action" status: 202 len: 1067 microversion: 2.1 time: 0.460040 Oct 05 17:35:50.002076 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 612/1279] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:49 2022] POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action => generated 1067 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 05 17:35:50.009681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-269fe371-0a11-493b-91d0-ed3109acf3ca tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:50.010739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-269fe371-0a11-493b-91d0-ed3109acf3ca tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:50.018796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-269fe371-0a11-493b-91d0-ed3109acf3ca tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:50.019815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-269fe371-0a11-493b-91d0-ed3109acf3ca tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:50.020590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-269fe371-0a11-493b-91d0-ed3109acf3ca tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:50.021529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-269fe371-0a11-493b-91d0-ed3109acf3ca tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:50.022441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-269fe371-0a11-493b-91d0-ed3109acf3ca tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:50.024095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-269fe371-0a11-493b-91d0-ed3109acf3ca tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:50.361742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-269fe371-0a11-493b-91d0-ed3109acf3ca tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:50.371761 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-269fe371-0a11-493b-91d0-ed3109acf3ca tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.366173 Oct 05 17:35:50.387247 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 668/1280] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:50 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:50.391557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc45e8ba-0f3b-49a0-8af2-9770f6953cc5 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:50.392208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cc45e8ba-0f3b-49a0-8af2-9770f6953cc5 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:50.415067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc45e8ba-0f3b-49a0-8af2-9770f6953cc5 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:50.415656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc45e8ba-0f3b-49a0-8af2-9770f6953cc5 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:50.416099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc45e8ba-0f3b-49a0-8af2-9770f6953cc5 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:50.421238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc45e8ba-0f3b-49a0-8af2-9770f6953cc5 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:50.423904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc45e8ba-0f3b-49a0-8af2-9770f6953cc5 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:50.424405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc45e8ba-0f3b-49a0-8af2-9770f6953cc5 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:50.560337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86d7ab6f-0d03-4985-9df9-283247342067 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:50.560955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-86d7ab6f-0d03-4985-9df9-283247342067 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:50.576321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86d7ab6f-0d03-4985-9df9-283247342067 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:50.576827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86d7ab6f-0d03-4985-9df9-283247342067 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:50.577284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86d7ab6f-0d03-4985-9df9-283247342067 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:50.578137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86d7ab6f-0d03-4985-9df9-283247342067 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:50.578627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86d7ab6f-0d03-4985-9df9-283247342067 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:50.579056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86d7ab6f-0d03-4985-9df9-283247342067 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:50.789168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cc45e8ba-0f3b-49a0-8af2-9770f6953cc5 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:50.801830 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cc45e8ba-0f3b-49a0-8af2-9770f6953cc5 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1510 microversion: 2.1 time: 0.412389 Oct 05 17:35:50.803812 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 613/1281] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:50 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:50.950931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d1338533-3de8-4690-80d3-677a5d22b07c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:50.952433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d1338533-3de8-4690-80d3-677a5d22b07c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:50.960119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1338533-3de8-4690-80d3-677a5d22b07c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:50.962601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1338533-3de8-4690-80d3-677a5d22b07c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:50.963286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1338533-3de8-4690-80d3-677a5d22b07c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:50.964247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1338533-3de8-4690-80d3-677a5d22b07c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:50.964932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1338533-3de8-4690-80d3-677a5d22b07c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:50.965604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1338533-3de8-4690-80d3-677a5d22b07c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:51.551852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-86d7ab6f-0d03-4985-9df9-283247342067 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:51.576853 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-86d7ab6f-0d03-4985-9df9-283247342067 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1314 microversion: 2.1 time: 1.021071 Oct 05 17:35:51.582413 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 669/1282] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:50 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1314 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:51.590251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb471051-4bd0-43bb-9f59-89be5cb87880 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:51.592961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eb471051-4bd0-43bb-9f59-89be5cb87880 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:51.595144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:51.610622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb471051-4bd0-43bb-9f59-89be5cb87880 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:51.611125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb471051-4bd0-43bb-9f59-89be5cb87880 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:51.611672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb471051-4bd0-43bb-9f59-89be5cb87880 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:51.612404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb471051-4bd0-43bb-9f59-89be5cb87880 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:51.612980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb471051-4bd0-43bb-9f59-89be5cb87880 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:51.613406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb471051-4bd0-43bb-9f59-89be5cb87880 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:51.777772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d1338533-3de8-4690-80d3-677a5d22b07c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:51.797682 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d1338533-3de8-4690-80d3-677a5d22b07c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1311 microversion: 2.1 time: 0.849332 Oct 05 17:35:51.798605 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 614/1283] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:50 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1311 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:51.833807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd30122d-e660-4983-aaad-2efb4ea90591 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:51.835793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd30122d-e660-4983-aaad-2efb4ea90591 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:51.856737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd30122d-e660-4983-aaad-2efb4ea90591 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:51.857383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd30122d-e660-4983-aaad-2efb4ea90591 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:51.858967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd30122d-e660-4983-aaad-2efb4ea90591 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:51.861322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd30122d-e660-4983-aaad-2efb4ea90591 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:51.861880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd30122d-e660-4983-aaad-2efb4ea90591 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:51.864447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd30122d-e660-4983-aaad-2efb4ea90591 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:51.973943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eb471051-4bd0-43bb-9f59-89be5cb87880 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:51.982100 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb471051-4bd0-43bb-9f59-89be5cb87880 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.398602 Oct 05 17:35:51.998443 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 670/1284] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:51 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:52.161254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fd30122d-e660-4983-aaad-2efb4ea90591 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:52.195387 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fd30122d-e660-4983-aaad-2efb4ea90591 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1510 microversion: 2.1 time: 0.369907 Oct 05 17:35:52.198315 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 615/1285] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:51 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:52.305948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ff7fade-a771-457c-ab39-6455cf64849d tempest-AbsoluteLimitsTestJSON-685852769 tempest-AbsoluteLimitsTestJSON-685852769-project] Calling method '.version_select at 0x7f7775137ee0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:52.326566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ff7fade-a771-457c-ab39-6455cf64849d tempest-AbsoluteLimitsTestJSON-685852769 tempest-AbsoluteLimitsTestJSON-685852769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:52.327066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ff7fade-a771-457c-ab39-6455cf64849d tempest-AbsoluteLimitsTestJSON-685852769 tempest-AbsoluteLimitsTestJSON-685852769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:52.327606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ff7fade-a771-457c-ab39-6455cf64849d tempest-AbsoluteLimitsTestJSON-685852769 tempest-AbsoluteLimitsTestJSON-685852769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:52.340748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ff7fade-a771-457c-ab39-6455cf64849d tempest-AbsoluteLimitsTestJSON-685852769 tempest-AbsoluteLimitsTestJSON-685852769-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:52.341493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ff7fade-a771-457c-ab39-6455cf64849d tempest-AbsoluteLimitsTestJSON-685852769 tempest-AbsoluteLimitsTestJSON-685852769-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:52.342132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ff7fade-a771-457c-ab39-6455cf64849d tempest-AbsoluteLimitsTestJSON-685852769 tempest-AbsoluteLimitsTestJSON-685852769-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:52.406631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-467378ec-b760-4b23-9392-0a2fec744d10 req-d82b4cf8-3423-4254-a1c4-a787cbcc456a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3", "tag": "bcb09376-6de9-4f05-ab2a-0ceb4077ce59"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:52.415559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1ff7fade-a771-457c-ab39-6455cf64849d tempest-AbsoluteLimitsTestJSON-685852769 tempest-AbsoluteLimitsTestJSON-685852769-project] 10.222.0.70 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.319892 Oct 05 17:35:52.417135 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 671/1286] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Oct 5 17:35:52 2022] GET /compute/v2.1/limits => generated 511 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:35:52.444193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-467378ec-b760-4b23-9392-0a2fec744d10 req-d82b4cf8-3423-4254-a1c4-a787cbcc456a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:52.459583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-467378ec-b760-4b23-9392-0a2fec744d10 req-d82b4cf8-3423-4254-a1c4-a787cbcc456a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:52.460197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-467378ec-b760-4b23-9392-0a2fec744d10 req-d82b4cf8-3423-4254-a1c4-a787cbcc456a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:52.495125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b923f456-b9af-41ad-87de-acb2ad5f6f16 req-5716fb7c-5843-4d50-a4bb-08920163cd21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2deb41c1-aad2-44ec-890d-ee629b7026a8", "name": "network-vif-plugged", "status": "completed", "tag": "662f062f-3156-4f24-b7bb-57e88b7f1361"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:52.522897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b923f456-b9af-41ad-87de-acb2ad5f6f16 req-5716fb7c-5843-4d50-a4bb-08920163cd21 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:52.523409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b923f456-b9af-41ad-87de-acb2ad5f6f16 req-5716fb7c-5843-4d50-a4bb-08920163cd21 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:52.533572 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-467378ec-b760-4b23-9392-0a2fec744d10 req-d82b4cf8-3423-4254-a1c4-a787cbcc456a service nova] Creating event network-changed:bcb09376-6de9-4f05-ab2a-0ceb4077ce59 for instance a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 on n-h1-835595-3 Oct 05 17:35:52.538498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b923f456-b9af-41ad-87de-acb2ad5f6f16 req-5716fb7c-5843-4d50-a4bb-08920163cd21 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:52.545203 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-467378ec-b760-4b23-9392-0a2fec744d10 req-d82b4cf8-3423-4254-a1c4-a787cbcc456a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152494 Oct 05 17:35:52.553417 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 616/1287] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:52.563373 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b923f456-b9af-41ad-87de-acb2ad5f6f16 req-5716fb7c-5843-4d50-a4bb-08920163cd21 service nova] Creating event network-vif-plugged:662f062f-3156-4f24-b7bb-57e88b7f1361 for instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 on n-h2-835595-3 Oct 05 17:35:52.566564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-58677ef5-7a2c-4eee-a4e3-8777c60ad528 req-eeecca66-4f10-429b-9624-b8962378d4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb7199d2-b000-4a07-abe4-4d76d42b430d", "name": "network-vif-deleted", "tag": "efdb1b94-fda9-4a7a-b551-ba58af93ae12"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:52.575898 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b923f456-b9af-41ad-87de-acb2ad5f6f16 req-5716fb7c-5843-4d50-a4bb-08920163cd21 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095379 Oct 05 17:35:52.576453 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 672/1288] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:35:52.582768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-58677ef5-7a2c-4eee-a4e3-8777c60ad528 req-eeecca66-4f10-429b-9624-b8962378d4f5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:52.583467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-58677ef5-7a2c-4eee-a4e3-8777c60ad528 req-eeecca66-4f10-429b-9624-b8962378d4f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:52.584057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-58677ef5-7a2c-4eee-a4e3-8777c60ad528 req-eeecca66-4f10-429b-9624-b8962378d4f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:52.600707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c2f1ca6-860b-4ad0-9ea8-f28fb1c8b88a tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:52.601400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5c2f1ca6-860b-4ad0-9ea8-f28fb1c8b88a tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:52.609098 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-58677ef5-7a2c-4eee-a4e3-8777c60ad528 req-eeecca66-4f10-429b-9624-b8962378d4f5 service nova] Creating event network-vif-deleted:efdb1b94-fda9-4a7a-b551-ba58af93ae12 for instance fb7199d2-b000-4a07-abe4-4d76d42b430d on n-h2-835595-3 Oct 05 17:35:52.615795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c2f1ca6-860b-4ad0-9ea8-f28fb1c8b88a tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:52.616775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c2f1ca6-860b-4ad0-9ea8-f28fb1c8b88a tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:52.617226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c2f1ca6-860b-4ad0-9ea8-f28fb1c8b88a tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:52.618095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c2f1ca6-860b-4ad0-9ea8-f28fb1c8b88a tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:52.618597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c2f1ca6-860b-4ad0-9ea8-f28fb1c8b88a tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:52.619026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c2f1ca6-860b-4ad0-9ea8-f28fb1c8b88a tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:52.627149 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-58677ef5-7a2c-4eee-a4e3-8777c60ad528 req-eeecca66-4f10-429b-9624-b8962378d4f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072181 Oct 05 17:35:52.634704 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 617/1289] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:35:52.822799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8f51b06f-ae43-4503-bb79-984b44bd3dc6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:52.823589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8f51b06f-ae43-4503-bb79-984b44bd3dc6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:52.837915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f51b06f-ae43-4503-bb79-984b44bd3dc6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:52.838757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f51b06f-ae43-4503-bb79-984b44bd3dc6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:52.839606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f51b06f-ae43-4503-bb79-984b44bd3dc6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:52.842395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f51b06f-ae43-4503-bb79-984b44bd3dc6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:52.844374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f51b06f-ae43-4503-bb79-984b44bd3dc6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:52.846097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f51b06f-ae43-4503-bb79-984b44bd3dc6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:52.893550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5c2f1ca6-860b-4ad0-9ea8-f28fb1c8b88a tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:52.904865 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c2f1ca6-860b-4ad0-9ea8-f28fb1c8b88a tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1314 microversion: 2.1 time: 0.308337 Oct 05 17:35:52.907648 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 673/1290] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:52 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:53.008209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1cffc8cc-e6f8-4cb2-8a88-55ec7fbe329d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:53.008839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1cffc8cc-e6f8-4cb2-8a88-55ec7fbe329d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:53.016293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cffc8cc-e6f8-4cb2-8a88-55ec7fbe329d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:53.016795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cffc8cc-e6f8-4cb2-8a88-55ec7fbe329d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:53.017228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cffc8cc-e6f8-4cb2-8a88-55ec7fbe329d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:53.018596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cffc8cc-e6f8-4cb2-8a88-55ec7fbe329d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:53.019058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cffc8cc-e6f8-4cb2-8a88-55ec7fbe329d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:53.019480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cffc8cc-e6f8-4cb2-8a88-55ec7fbe329d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:53.089343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f51b06f-ae43-4503-bb79-984b44bd3dc6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:53.106597 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8f51b06f-ae43-4503-bb79-984b44bd3dc6 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1311 microversion: 2.1 time: 0.287534 Oct 05 17:35:53.119288 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 618/1291] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:52 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1311 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:53.180947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1cffc8cc-e6f8-4cb2-8a88-55ec7fbe329d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:53.193676 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1cffc8cc-e6f8-4cb2-8a88-55ec7fbe329d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.191768 Oct 05 17:35:53.210729 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 674/1292] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:53 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:53.221451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:53.222064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:53.230194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:53.230796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:53.231301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:53.232522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:53.233074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:53.233655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:53.268634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:53.269137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:53.269569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:53.270016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lazy-loading 'fault' on Instance uuid fb7199d2-b000-4a07-abe4-4d76d42b430d {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:35:53.323371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2da2db073e774554990184cb1ac05cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7490ef750c964d779a46fb96c08e76e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:53.331976 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-484afde5-cfea-4105-9912-a66afb912223 tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 200 len: 1307 microversion: 2.1 time: 0.114534 Oct 05 17:35:53.332566 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 619/1293] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:53 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:53.929766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8d081035-3a3b-4c49-931f-2ee177cef520 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:53.931075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8d081035-3a3b-4c49-931f-2ee177cef520 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:53.942269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d081035-3a3b-4c49-931f-2ee177cef520 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:53.947002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d081035-3a3b-4c49-931f-2ee177cef520 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:53.947686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d081035-3a3b-4c49-931f-2ee177cef520 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:53.948432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d081035-3a3b-4c49-931f-2ee177cef520 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:53.949839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d081035-3a3b-4c49-931f-2ee177cef520 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:53.950365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d081035-3a3b-4c49-931f-2ee177cef520 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:54.124194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8d081035-3a3b-4c49-931f-2ee177cef520 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:54.132633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-302eb414-38d3-424e-a872-d657a3f5b1b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:54.133197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-302eb414-38d3-424e-a872-d657a3f5b1b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:54.134839 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8d081035-3a3b-4c49-931f-2ee177cef520 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1314 microversion: 2.1 time: 0.209240 Oct 05 17:35:54.150304 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 675/1294] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:53 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:54.151814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302eb414-38d3-424e-a872-d657a3f5b1b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:54.153290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302eb414-38d3-424e-a872-d657a3f5b1b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:54.154156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302eb414-38d3-424e-a872-d657a3f5b1b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:54.155213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302eb414-38d3-424e-a872-d657a3f5b1b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:54.155862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302eb414-38d3-424e-a872-d657a3f5b1b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:54.157024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302eb414-38d3-424e-a872-d657a3f5b1b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:54.223007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-749eede0-5881-4be6-9843-9ecbb9282628 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:54.223910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-749eede0-5881-4be6-9843-9ecbb9282628 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:54.232929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749eede0-5881-4be6-9843-9ecbb9282628 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:54.234943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749eede0-5881-4be6-9843-9ecbb9282628 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:54.235436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749eede0-5881-4be6-9843-9ecbb9282628 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:54.236226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749eede0-5881-4be6-9843-9ecbb9282628 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:54.237635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749eede0-5881-4be6-9843-9ecbb9282628 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:54.238117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749eede0-5881-4be6-9843-9ecbb9282628 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:54.327306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-302eb414-38d3-424e-a872-d657a3f5b1b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:54.338424 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-302eb414-38d3-424e-a872-d657a3f5b1b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1311 microversion: 2.1 time: 0.209574 Oct 05 17:35:54.340034 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 620/1295] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:54 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1311 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:54.407767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-749eede0-5881-4be6-9843-9ecbb9282628 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:54.415526 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-749eede0-5881-4be6-9843-9ecbb9282628 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.198373 Oct 05 17:35:54.416100 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 676/1296] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:54 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:54.420743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:54.421744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] [instance: fb7199d2-b000-4a07-abe4-4d76d42b430d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:54.427878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:54.428594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:54.429203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:54.430071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:54.430720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:54.431141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:54.445513 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] HTTP exception thrown: Instance fb7199d2-b000-4a07-abe4-4d76d42b430d could not be found. Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Request method failure captured: Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d HTTP/1.1 Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBh-adoFcYWSh1CixgfSc6VYPd6Sdaro6ZcgKuHl9gDhRbn9XrjvVY5dUUIudK1T6Xj8nQH9W_KaGKFQT2Hzj0BQe_4e4BN_fcY3ONrsZ9IJQFwRpPJlZHhGxbQvcdLOwJt-6C5DKqrqyEESxU4jsjUtyYTQFLxckM-HJFIscJOODk Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7490ef750c964d779a46fb96c08e76e2 Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerAddressesTestJSON-918223960 Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:35:54.447574 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7490ef750c964d779a46fb96c08e76e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7490ef750c964d779a46fb96c08e76e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7490ef750c964d779a46fb96c08e76e2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7490ef750c964d779a46fb96c08e76e2"}]}] Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerAddressesTestJSON-918223960 Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7490ef750c964d779a46fb96c08e76e2 Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerAddressesTestJSON-918223960 Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerAddressesTestJSON-918223960-project Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 2da2db073e774554990184cb1ac05cc5 Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerAddressesTestJSON-918223960-project Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance fb7199d2-b000-4a07-abe4-4d76d42b430d could not be found. Oct 05 17:35:54.449038 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'fb7199d2-b000-4a07-abe4-4d76d42b430d'} Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb7199d2-b000-4a07-abe4-4d76d42b430d could not be found. Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:35:54.449949 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb7199d2-b000-4a07-abe4-4d76d42b430d could not be found. Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb7199d2-b000-4a07-abe4-4d76d42b430d could not be found. Oct 05 17:35:54.451459 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:35:54.453901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] Returning 404 to user: Instance fb7199d2-b000-4a07-abe4-4d76d42b430d could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:35:54.455144 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f8047985-a3c9-48b4-8ed5-b5d16f2ba0df tempest-ServerAddressesTestJSON-918223960 tempest-ServerAddressesTestJSON-918223960-project] 10.222.0.70 "GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d" status: 404 len: 111 microversion: 2.1 time: 0.037793 Oct 05 17:35:54.459349 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 677/1297] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:54 2022] GET /compute/v2.1/servers/fb7199d2-b000-4a07-abe4-4d76d42b430d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:35:54.609372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-31d3a8c9-5a3c-4da5-aed0-6a5f3333fe71 tempest-AZV2TestJSON-910566040 tempest-AZV2TestJSON-910566040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:54.612203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31d3a8c9-5a3c-4da5-aed0-6a5f3333fe71 tempest-AZV2TestJSON-910566040 tempest-AZV2TestJSON-910566040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:54.612703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31d3a8c9-5a3c-4da5-aed0-6a5f3333fe71 tempest-AZV2TestJSON-910566040 tempest-AZV2TestJSON-910566040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:54.613338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31d3a8c9-5a3c-4da5-aed0-6a5f3333fe71 tempest-AZV2TestJSON-910566040 tempest-AZV2TestJSON-910566040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:54.613873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31d3a8c9-5a3c-4da5-aed0-6a5f3333fe71 tempest-AZV2TestJSON-910566040 tempest-AZV2TestJSON-910566040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:54.615447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31d3a8c9-5a3c-4da5-aed0-6a5f3333fe71 tempest-AZV2TestJSON-910566040 tempest-AZV2TestJSON-910566040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:54.616036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31d3a8c9-5a3c-4da5-aed0-6a5f3333fe71 tempest-AZV2TestJSON-910566040 tempest-AZV2TestJSON-910566040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:54.660737 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-31d3a8c9-5a3c-4da5-aed0-6a5f3333fe71 tempest-AZV2TestJSON-910566040 tempest-AZV2TestJSON-910566040-project] 10.222.0.70 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.199844 Oct 05 17:35:54.661667 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 678/1298] 10.222.0.70 () {58 vars in 1164 bytes} [Wed Oct 5 17:35:54 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:35:54.663053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-701651406", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:54.724242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:35:55.164701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a40c20a9-2bac-49b5-8040-a24fa835db46 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:55.165267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a40c20a9-2bac-49b5-8040-a24fa835db46 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:55.173768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40c20a9-2bac-49b5-8040-a24fa835db46 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.174260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40c20a9-2bac-49b5-8040-a24fa835db46 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.174714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40c20a9-2bac-49b5-8040-a24fa835db46 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.175588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40c20a9-2bac-49b5-8040-a24fa835db46 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.176190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40c20a9-2bac-49b5-8040-a24fa835db46 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.176780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40c20a9-2bac-49b5-8040-a24fa835db46 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.181720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:55.201217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:35:55.203801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:35:55.204510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:35:55.205326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:35:55.205945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:35:55.218925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=39 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:55.220945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.221469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.222030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.223064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.223673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.224791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.235767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=18 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:55.247846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Getting quotas for project 7b69477a606d4b968b90a04c3194be91. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:35:55.254056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Getting quotas for user 32f940b1b6bb469dbf4b6a7c66f20d5e and project 7b69477a606d4b968b90a04c3194be91. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:35:55.266851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:35:55.269667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:35:55.321107 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b272e4e6-3d8f-4c24-9715-2b2583c90c9f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.979312 Oct 05 17:35:55.321768 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 621/1299] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:35:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 981 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:35:55.334258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4294dd53-975a-431f-84a5-4de4de8b64ec tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:55.335125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4294dd53-975a-431f-84a5-4de4de8b64ec tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:55.346581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a40c20a9-2bac-49b5-8040-a24fa835db46 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:55.366742 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a40c20a9-2bac-49b5-8040-a24fa835db46 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1314 microversion: 2.1 time: 0.206589 Oct 05 17:35:55.371278 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 679/1300] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:55 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:55.378335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-94fe2d0a-7107-44fe-bfd9-bb89035ab5a9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:55.379681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-94fe2d0a-7107-44fe-bfd9-bb89035ab5a9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:55.387418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94fe2d0a-7107-44fe-bfd9-bb89035ab5a9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.387418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94fe2d0a-7107-44fe-bfd9-bb89035ab5a9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.387726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94fe2d0a-7107-44fe-bfd9-bb89035ab5a9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.388446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94fe2d0a-7107-44fe-bfd9-bb89035ab5a9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.389060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94fe2d0a-7107-44fe-bfd9-bb89035ab5a9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.389559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94fe2d0a-7107-44fe-bfd9-bb89035ab5a9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.468193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4294dd53-975a-431f-84a5-4de4de8b64ec tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:55.491038 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4294dd53-975a-431f-84a5-4de4de8b64ec tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1222 microversion: 2.1 time: 0.158984 Oct 05 17:35:55.493197 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 622/1301] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:55 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1222 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:55.500557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9004041d-0a12-481a-aec7-84255f8f6f64 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:55.501371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9004041d-0a12-481a-aec7-84255f8f6f64 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:55.509644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004041d-0a12-481a-aec7-84255f8f6f64 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.510520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004041d-0a12-481a-aec7-84255f8f6f64 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.511106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004041d-0a12-481a-aec7-84255f8f6f64 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.511985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004041d-0a12-481a-aec7-84255f8f6f64 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.512596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004041d-0a12-481a-aec7-84255f8f6f64 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.513181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004041d-0a12-481a-aec7-84255f8f6f64 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.586702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-94fe2d0a-7107-44fe-bfd9-bb89035ab5a9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:55.595368 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-94fe2d0a-7107-44fe-bfd9-bb89035ab5a9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1461 microversion: 2.1 time: 0.220952 Oct 05 17:35:55.596079 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 680/1302] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:55 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1461 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:55.619715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-74ee0ff0-0906-440a-8b4f-5146e64ff013 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:55.620342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-74ee0ff0-0906-440a-8b4f-5146e64ff013 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:55.627553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ee0ff0-0906-440a-8b4f-5146e64ff013 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.628125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ee0ff0-0906-440a-8b4f-5146e64ff013 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.628839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ee0ff0-0906-440a-8b4f-5146e64ff013 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.630005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ee0ff0-0906-440a-8b4f-5146e64ff013 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.630944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ee0ff0-0906-440a-8b4f-5146e64ff013 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.631434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ee0ff0-0906-440a-8b4f-5146e64ff013 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.800959 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-74ee0ff0-0906-440a-8b4f-5146e64ff013 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1612 microversion: 2.1 time: 0.186218 Oct 05 17:35:55.810314 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 681/1303] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:55 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1612 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:55.826595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:35:55.827173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:55.833232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.833718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.834459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.835162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:55.835608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:55.836034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:55.867873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '80d5eab89e6240caaa54a381b4d2af4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c6f93d534014f37a2527e4d0a6953e2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:55.868829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] flavor_id is None. Assuming migration. {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 05 17:35:55.869217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 17:35:55.940656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9004041d-0a12-481a-aec7-84255f8f6f64 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:55.951835 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9004041d-0a12-481a-aec7-84255f8f6f64 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.457270 Oct 05 17:35:55.972955 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 623/1304] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:55 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:56.037606 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d6e3f16e-19a2-4dc4-9c59-b3bf6574dd81 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8/action" status: 202 len: 0 microversion: 2.1 time: 0.214743 Oct 05 17:35:56.038086 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 682/1305] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:35:55 2022] POST /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:35:56.047249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-db8400dd-819f-4551-948b-bce1f2697b48 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:56.047945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-db8400dd-819f-4551-948b-bce1f2697b48 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:56.059715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db8400dd-819f-4551-948b-bce1f2697b48 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:56.060542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db8400dd-819f-4551-948b-bce1f2697b48 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:56.061448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db8400dd-819f-4551-948b-bce1f2697b48 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:56.062764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db8400dd-819f-4551-948b-bce1f2697b48 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:56.063402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db8400dd-819f-4551-948b-bce1f2697b48 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:56.063991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db8400dd-819f-4551-948b-bce1f2697b48 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:56.301410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-db8400dd-819f-4551-948b-bce1f2697b48 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:56.309595 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-db8400dd-819f-4551-948b-bce1f2697b48 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1470 microversion: 2.1 time: 0.267138 Oct 05 17:35:56.311579 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 624/1306] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:56 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1470 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:56.393736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fdd4de6d-f6cf-475a-9544-96b2073c0b8c tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:56.394380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fdd4de6d-f6cf-475a-9544-96b2073c0b8c tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:56.403050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fdd4de6d-f6cf-475a-9544-96b2073c0b8c tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:56.403563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fdd4de6d-f6cf-475a-9544-96b2073c0b8c tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:56.403927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fdd4de6d-f6cf-475a-9544-96b2073c0b8c tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:56.404938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fdd4de6d-f6cf-475a-9544-96b2073c0b8c tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:56.408124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fdd4de6d-f6cf-475a-9544-96b2073c0b8c tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:56.408627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fdd4de6d-f6cf-475a-9544-96b2073c0b8c tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:56.517147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2fc7afd8-614e-4d1c-a720-ca2dd89c6c7f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:56.517755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2fc7afd8-614e-4d1c-a720-ca2dd89c6c7f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:56.534357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc7afd8-614e-4d1c-a720-ca2dd89c6c7f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:56.535271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc7afd8-614e-4d1c-a720-ca2dd89c6c7f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:56.535886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc7afd8-614e-4d1c-a720-ca2dd89c6c7f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:56.536798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc7afd8-614e-4d1c-a720-ca2dd89c6c7f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:56.537253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc7afd8-614e-4d1c-a720-ca2dd89c6c7f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:56.537673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc7afd8-614e-4d1c-a720-ca2dd89c6c7f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:56.628035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fdd4de6d-f6cf-475a-9544-96b2073c0b8c tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:56.637913 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fdd4de6d-f6cf-475a-9544-96b2073c0b8c tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1314 microversion: 2.1 time: 0.248738 Oct 05 17:35:56.641769 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 683/1307] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:56 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:56.705060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2fc7afd8-614e-4d1c-a720-ca2dd89c6c7f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:56.741653 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2fc7afd8-614e-4d1c-a720-ca2dd89c6c7f tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1274 microversion: 2.1 time: 0.228287 Oct 05 17:35:56.742537 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 625/1308] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:56 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1274 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:56.980846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9fc48f12-13a8-463b-9022-b1f63657ad22 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:56.983548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9fc48f12-13a8-463b-9022-b1f63657ad22 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:57.000241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc48f12-13a8-463b-9022-b1f63657ad22 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:57.002223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc48f12-13a8-463b-9022-b1f63657ad22 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:57.003723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc48f12-13a8-463b-9022-b1f63657ad22 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:57.006549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc48f12-13a8-463b-9022-b1f63657ad22 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:57.007238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc48f12-13a8-463b-9022-b1f63657ad22 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:57.008826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fc48f12-13a8-463b-9022-b1f63657ad22 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:57.230192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9fc48f12-13a8-463b-9022-b1f63657ad22 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:57.242141 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9fc48f12-13a8-463b-9022-b1f63657ad22 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.265968 Oct 05 17:35:57.244704 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 684/1309] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:56 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:57.339005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-397394e5-e7a0-46fb-be73-bb9e781f8c22 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:57.341342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-397394e5-e7a0-46fb-be73-bb9e781f8c22 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:57.352318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-397394e5-e7a0-46fb-be73-bb9e781f8c22 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:57.353619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-397394e5-e7a0-46fb-be73-bb9e781f8c22 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:57.354657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-397394e5-e7a0-46fb-be73-bb9e781f8c22 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:57.355646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-397394e5-e7a0-46fb-be73-bb9e781f8c22 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:57.357295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-397394e5-e7a0-46fb-be73-bb9e781f8c22 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:57.358186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-397394e5-e7a0-46fb-be73-bb9e781f8c22 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:57.660814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42c1e95b-091b-4760-8537-19362406cd89 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:57.661650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-42c1e95b-091b-4760-8537-19362406cd89 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:57.674082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42c1e95b-091b-4760-8537-19362406cd89 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:57.676876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42c1e95b-091b-4760-8537-19362406cd89 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:57.677349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42c1e95b-091b-4760-8537-19362406cd89 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:57.678108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42c1e95b-091b-4760-8537-19362406cd89 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:57.680890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42c1e95b-091b-4760-8537-19362406cd89 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:57.681362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42c1e95b-091b-4760-8537-19362406cd89 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:57.938352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-397394e5-e7a0-46fb-be73-bb9e781f8c22 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:57.949894 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-397394e5-e7a0-46fb-be73-bb9e781f8c22 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1470 microversion: 2.1 time: 0.616063 Oct 05 17:35:57.951643 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 626/1310] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:57 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1470 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:57.973810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2a65460-efbf-4407-b6a1-6832f34fb237 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:57.974667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d2a65460-efbf-4407-b6a1-6832f34fb237 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:57.985067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2a65460-efbf-4407-b6a1-6832f34fb237 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:57.986781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2a65460-efbf-4407-b6a1-6832f34fb237 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:57.987653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2a65460-efbf-4407-b6a1-6832f34fb237 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:57.988648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2a65460-efbf-4407-b6a1-6832f34fb237 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:57.989504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2a65460-efbf-4407-b6a1-6832f34fb237 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:57.990493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2a65460-efbf-4407-b6a1-6832f34fb237 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:57.996065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:58.035104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-42c1e95b-091b-4760-8537-19362406cd89 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:58.042888 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-42c1e95b-091b-4760-8537-19362406cd89 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1314 microversion: 2.1 time: 0.385948 Oct 05 17:35:58.059626 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 685/1311] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:57 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:58.113790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d2a65460-efbf-4407-b6a1-6832f34fb237 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:58.127028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d2a65460-efbf-4407-b6a1-6832f34fb237 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1280 microversion: 2.1 time: 0.171818 Oct 05 17:35:58.129435 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 627/1312] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:57 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1280 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:58.279719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e06c4828-6e9b-4e93-9e53-3bebf31f5551 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:58.284985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e06c4828-6e9b-4e93-9e53-3bebf31f5551 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:58.298388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06c4828-6e9b-4e93-9e53-3bebf31f5551 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:58.299310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06c4828-6e9b-4e93-9e53-3bebf31f5551 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:58.301067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06c4828-6e9b-4e93-9e53-3bebf31f5551 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:58.302026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06c4828-6e9b-4e93-9e53-3bebf31f5551 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:58.303854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06c4828-6e9b-4e93-9e53-3bebf31f5551 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:58.304549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06c4828-6e9b-4e93-9e53-3bebf31f5551 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:58.556114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e06c4828-6e9b-4e93-9e53-3bebf31f5551 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:58.565890 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e06c4828-6e9b-4e93-9e53-3bebf31f5551 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.297294 Oct 05 17:35:58.580348 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 686/1313] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:58 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:35:58.982647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-149af0fb-8f6e-461c-a9b5-4db803db6b94 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:58.986702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-149af0fb-8f6e-461c-a9b5-4db803db6b94 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:58.996046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-149af0fb-8f6e-461c-a9b5-4db803db6b94 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:58.996791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-149af0fb-8f6e-461c-a9b5-4db803db6b94 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:58.998693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-149af0fb-8f6e-461c-a9b5-4db803db6b94 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:58.999856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-149af0fb-8f6e-461c-a9b5-4db803db6b94 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:59.000850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-149af0fb-8f6e-461c-a9b5-4db803db6b94 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:59.001505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-149af0fb-8f6e-461c-a9b5-4db803db6b94 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:59.068158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-31857cfe-a5ed-4d16-b879-9b737aa637a6 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:59.069458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-31857cfe-a5ed-4d16-b879-9b737aa637a6 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:59.084158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31857cfe-a5ed-4d16-b879-9b737aa637a6 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:59.085534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31857cfe-a5ed-4d16-b879-9b737aa637a6 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:59.086107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31857cfe-a5ed-4d16-b879-9b737aa637a6 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:59.089705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31857cfe-a5ed-4d16-b879-9b737aa637a6 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:59.090398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31857cfe-a5ed-4d16-b879-9b737aa637a6 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:59.091861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31857cfe-a5ed-4d16-b879-9b737aa637a6 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:59.379412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-149af0fb-8f6e-461c-a9b5-4db803db6b94 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:59.396578 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-149af0fb-8f6e-461c-a9b5-4db803db6b94 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1470 microversion: 2.1 time: 0.423604 Oct 05 17:35:59.398534 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 628/1314] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:58 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1470 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:59.417464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa6235a6-e7a5-4c9f-9433-f779d3223961 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:59.419161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fa6235a6-e7a5-4c9f-9433-f779d3223961 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:59.426109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:35:59.444812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa6235a6-e7a5-4c9f-9433-f779d3223961 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:59.445328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa6235a6-e7a5-4c9f-9433-f779d3223961 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:59.445815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa6235a6-e7a5-4c9f-9433-f779d3223961 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:59.446578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa6235a6-e7a5-4c9f-9433-f779d3223961 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:59.447034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa6235a6-e7a5-4c9f-9433-f779d3223961 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:59.451873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa6235a6-e7a5-4c9f-9433-f779d3223961 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:59.753426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa6235a6-e7a5-4c9f-9433-f779d3223961 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:35:59.803210 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa6235a6-e7a5-4c9f-9433-f779d3223961 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1322 microversion: 2.1 time: 0.396816 Oct 05 17:35:59.803635 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 629/1315] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:59 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:35:59.819608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6f89f300-dd80-4618-855b-6b8557b06e19 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:35:59.820222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6f89f300-dd80-4618-855b-6b8557b06e19 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:35:59.833226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f89f300-dd80-4618-855b-6b8557b06e19 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:59.833731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f89f300-dd80-4618-855b-6b8557b06e19 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:59.834162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f89f300-dd80-4618-855b-6b8557b06e19 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:35:59.839732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f89f300-dd80-4618-855b-6b8557b06e19 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:35:59.840230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f89f300-dd80-4618-855b-6b8557b06e19 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:35:59.840674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f89f300-dd80-4618-855b-6b8557b06e19 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:00.132965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31857cfe-a5ed-4d16-b879-9b737aa637a6 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:00.133606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6f89f300-dd80-4618-855b-6b8557b06e19 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:00.142681 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-31857cfe-a5ed-4d16-b879-9b737aa637a6 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1314 microversion: 2.1 time: 1.080953 Oct 05 17:36:00.143315 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 687/1316] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:59 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1314 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:00.176857 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6f89f300-dd80-4618-855b-6b8557b06e19 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.353636 Oct 05 17:36:00.178754 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 630/1317] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:35:59 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:00.426696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e15cb148-43d3-4860-a3ad-da8a48e0dfba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:00.427532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e15cb148-43d3-4860-a3ad-da8a48e0dfba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:00.453038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e15cb148-43d3-4860-a3ad-da8a48e0dfba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:00.453872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e15cb148-43d3-4860-a3ad-da8a48e0dfba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:00.454613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e15cb148-43d3-4860-a3ad-da8a48e0dfba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:00.455570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e15cb148-43d3-4860-a3ad-da8a48e0dfba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:00.456243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e15cb148-43d3-4860-a3ad-da8a48e0dfba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:00.456887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e15cb148-43d3-4860-a3ad-da8a48e0dfba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:00.800436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8687183f-ff26-4f1d-9eeb-a9a7b8cb1fa8"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:00.804295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e15cb148-43d3-4860-a3ad-da8a48e0dfba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:00.804476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:00.814931 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e15cb148-43d3-4860-a3ad-da8a48e0dfba tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1470 microversion: 2.1 time: 0.393994 Oct 05 17:36:00.816199 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 631/1318] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:00 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:00.822094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ec5f6959-e7db-4dcd-83c8-50a2a1c65a50 req-16effd43-cc92-4ca2-a48d-84276665050c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3", "name": "network-vif-plugged", "status": "completed", "tag": "bcb09376-6de9-4f05-ab2a-0ceb4077ce59"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:00.824031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:00.824031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:00.825455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:00.827686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:00.828185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:00.829362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:00.837788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ec5f6959-e7db-4dcd-83c8-50a2a1c65a50 req-16effd43-cc92-4ca2-a48d-84276665050c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:00.838706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ec5f6959-e7db-4dcd-83c8-50a2a1c65a50 req-16effd43-cc92-4ca2-a48d-84276665050c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:00.839322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ec5f6959-e7db-4dcd-83c8-50a2a1c65a50 req-16effd43-cc92-4ca2-a48d-84276665050c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:00.854630 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ec5f6959-e7db-4dcd-83c8-50a2a1c65a50 req-16effd43-cc92-4ca2-a48d-84276665050c service nova] Creating event network-vif-plugged:bcb09376-6de9-4f05-ab2a-0ceb4077ce59 for instance a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 on n-h1-835595-3 Oct 05 17:36:00.862034 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ec5f6959-e7db-4dcd-83c8-50a2a1c65a50 req-16effd43-cc92-4ca2-a48d-84276665050c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044330 Oct 05 17:36:00.863206 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 632/1319] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:00.870743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2b505dd1-bbe1-4c4a-9261-84a7a2fc1615 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:00.871915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2b505dd1-bbe1-4c4a-9261-84a7a2fc1615 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:00.885570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b505dd1-bbe1-4c4a-9261-84a7a2fc1615 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:00.886741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b505dd1-bbe1-4c4a-9261-84a7a2fc1615 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:00.887364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b505dd1-bbe1-4c4a-9261-84a7a2fc1615 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:00.888328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b505dd1-bbe1-4c4a-9261-84a7a2fc1615 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:00.888979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b505dd1-bbe1-4c4a-9261-84a7a2fc1615 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:00.889615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b505dd1-bbe1-4c4a-9261-84a7a2fc1615 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:01.094538 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] HTTP exception thrown: Volume 8687183f-ff26-4f1d-9eeb-a9a7b8cb1fa8 could not be found. Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Request method failure captured: Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments/c87b1675-2510-499b-b4fa-a72a3378c028 HTTP/1.1 Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 74 Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcAl9Qeny3pOot_n7ZicV74bbMXRU7GXofvVdeXVvtezE7QnIxnOLLOAXXowc0egwmLlgdhbxU-tyOMok4nYj9qiCJZ9g07cgNkNUs1UM-VoreW9OXpCXG1yRqCCX3gAmJWzUTSnrAl0fZrYN1AN18ts03ge0__oqFLUfD1b86H6F6E Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: a0749fd979ff452993b04da8093285cf Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesAdminNegativeTest-192962423 Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:36:01.099317 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a0749fd979ff452993b04da8093285cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0749fd979ff452993b04da8093285cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a0749fd979ff452993b04da8093285cf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0749fd979ff452993b04da8093285cf"}]}] Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesAdminNegativeTest-192962423 Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: a0749fd979ff452993b04da8093285cf Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-192962423 Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesAdminNegativeTest-192962423-project-admin Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 85f54e7861264875b8b9b159474bc48d Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesAdminNegativeTest-192962423-project-admin Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: {"volumeAttachment": {"volumeId": "8687183f-ff26-4f1d-9eeb-a9a7b8cb1fa8"}} Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:36:01.100750 n-d-835595-3 devstack@n-api.service[128844]: exception: Volume 8687183f-ff26-4f1d-9eeb-a9a7b8cb1fa8 could not be found. Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': 'df1c2e18-968f-4926-a47b-8e73ea54b4fa', 'id': 'c87b1675-2510-499b-b4fa-a72a3378c028', 'body': {'volumeAttachment': {'volumeId': '8687183f-ff26-4f1d-9eeb-a9a7b8cb1fa8'}}} Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:36:01.101662 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8687183f-ff26-4f1d-9eeb-a9a7b8cb1fa8 could not be found. (HTTP 404) (Request-ID: req-32e91bb0-1a61-4c36-9d9d-fc7ec1085138) Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:36:01.104744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8687183f-ff26-4f1d-9eeb-a9a7b8cb1fa8 could not be found. Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:36:01.106001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 8687183f-ff26-4f1d-9eeb-a9a7b8cb1fa8 could not be found. Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8687183f-ff26-4f1d-9eeb-a9a7b8cb1fa8 could not be found. Oct 05 17:36:01.107221 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:01.111651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Returning 400 to user: Volume 8687183f-ff26-4f1d-9eeb-a9a7b8cb1fa8 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:36:01.113158 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-24f0541f-109e-4f96-927d-669676c213ac tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] 10.222.0.70 "PUT /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments/c87b1675-2510-499b-b4fa-a72a3378c028" status: 400 len: 107 microversion: 2.1 time: 0.716946 Oct 05 17:36:01.113857 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 688/1320] 10.222.0.70 () {60 vars in 1433 bytes} [Wed Oct 5 17:36:00 2022] PUT /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments/c87b1675-2510-499b-b4fa-a72a3378c028 => generated 107 bytes in 718 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:36:01.174120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-347341ab-3e27-4b4e-958e-595cfa582dc0 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:01.175633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-347341ab-3e27-4b4e-958e-595cfa582dc0 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:01.185164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-347341ab-3e27-4b4e-958e-595cfa582dc0 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:01.185946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-347341ab-3e27-4b4e-958e-595cfa582dc0 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:01.186627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-347341ab-3e27-4b4e-958e-595cfa582dc0 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:01.187798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-347341ab-3e27-4b4e-958e-595cfa582dc0 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:01.188559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-347341ab-3e27-4b4e-958e-595cfa582dc0 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:01.189202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-347341ab-3e27-4b4e-958e-595cfa582dc0 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:01.211699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b505dd1-bbe1-4c4a-9261-84a7a2fc1615 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:01.223388 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2b505dd1-bbe1-4c4a-9261-84a7a2fc1615 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1322 microversion: 2.1 time: 0.358709 Oct 05 17:36:01.237556 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 633/1321] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:00 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:01.246157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a487b4dd-2f08-4f51-8ae7-395c0b617875 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:01.248225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a487b4dd-2f08-4f51-8ae7-395c0b617875 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:01.255783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a487b4dd-2f08-4f51-8ae7-395c0b617875 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:01.256545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a487b4dd-2f08-4f51-8ae7-395c0b617875 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:01.257962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a487b4dd-2f08-4f51-8ae7-395c0b617875 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:01.259044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a487b4dd-2f08-4f51-8ae7-395c0b617875 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:01.259681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a487b4dd-2f08-4f51-8ae7-395c0b617875 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:01.260882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a487b4dd-2f08-4f51-8ae7-395c0b617875 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:01.533649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a487b4dd-2f08-4f51-8ae7-395c0b617875 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:01.547202 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a487b4dd-2f08-4f51-8ae7-395c0b617875 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.308141 Oct 05 17:36:01.552714 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 634/1322] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:01 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:01.563078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ef81b12-55cc-4bd7-955a-a356584836bf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:01.571365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7ef81b12-55cc-4bd7-955a-a356584836bf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:01.584278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-347341ab-3e27-4b4e-958e-595cfa582dc0 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:01.598759 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-347341ab-3e27-4b4e-958e-595cfa582dc0 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1314 microversion: 2.1 time: 0.429172 Oct 05 17:36:01.601392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ef81b12-55cc-4bd7-955a-a356584836bf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:01.601884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ef81b12-55cc-4bd7-955a-a356584836bf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:01.602329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ef81b12-55cc-4bd7-955a-a356584836bf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:01.619551 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 689/1323] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:01 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:01.620872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ef81b12-55cc-4bd7-955a-a356584836bf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:01.621569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ef81b12-55cc-4bd7-955a-a356584836bf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:01.622012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ef81b12-55cc-4bd7-955a-a356584836bf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:01.825975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-7ef81b12-55cc-4bd7-955a-a356584836bf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lazy-loading 'services' on Instance uuid df1c2e18-968f-4926-a47b-8e73ea54b4fa {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:36:01.845575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-505f7caf-4f8c-4b39-a8c6-61237ff92e1d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:01.846805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-505f7caf-4f8c-4b39-a8c6-61237ff92e1d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:01.858664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-505f7caf-4f8c-4b39-a8c6-61237ff92e1d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:01.861317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-505f7caf-4f8c-4b39-a8c6-61237ff92e1d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:01.863362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-505f7caf-4f8c-4b39-a8c6-61237ff92e1d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:01.865988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-505f7caf-4f8c-4b39-a8c6-61237ff92e1d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:01.868457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-505f7caf-4f8c-4b39-a8c6-61237ff92e1d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:01.870507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-505f7caf-4f8c-4b39-a8c6-61237ff92e1d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.099932 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ef81b12-55cc-4bd7-955a-a356584836bf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments/c87b1675-2510-499b-b4fa-a72a3378c028" status: 202 len: 0 microversion: 2.1 time: 0.545152 Oct 05 17:36:02.102632 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 635/1324] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 17:36:01 2022] DELETE /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments/c87b1675-2510-499b-b4fa-a72a3378c028 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:36:02.119048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-54cf901a-8b95-4326-9c44-1499134ff698 req-3608a3db-1bd4-4ae7-96b2-fb3f7498c606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b315f5c-1479-4048-9c8e-306dc2a1927d", "tag": "2f8ce7da-9e01-466b-9bd0-66ba30a1ed42"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:02.138815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-54cf901a-8b95-4326-9c44-1499134ff698 req-3608a3db-1bd4-4ae7-96b2-fb3f7498c606 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.139970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-54cf901a-8b95-4326-9c44-1499134ff698 req-3608a3db-1bd4-4ae7-96b2-fb3f7498c606 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.141294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-54cf901a-8b95-4326-9c44-1499134ff698 req-3608a3db-1bd4-4ae7-96b2-fb3f7498c606 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.160526 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-54cf901a-8b95-4326-9c44-1499134ff698 req-3608a3db-1bd4-4ae7-96b2-fb3f7498c606 service nova] Creating event network-changed:2f8ce7da-9e01-466b-9bd0-66ba30a1ed42 for instance 9b315f5c-1479-4048-9c8e-306dc2a1927d on n-h2-835595-3 Oct 05 17:36:02.168164 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-54cf901a-8b95-4326-9c44-1499134ff698 req-3608a3db-1bd4-4ae7-96b2-fb3f7498c606 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059608 Oct 05 17:36:02.170161 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 636/1325] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:02.178398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6231dccb-b620-4b64-948f-280facb8e208 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:02.184555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6231dccb-b620-4b64-948f-280facb8e208 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:02.196437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6231dccb-b620-4b64-948f-280facb8e208 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.196989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6231dccb-b620-4b64-948f-280facb8e208 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.197771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6231dccb-b620-4b64-948f-280facb8e208 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.198567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6231dccb-b620-4b64-948f-280facb8e208 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.199175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6231dccb-b620-4b64-948f-280facb8e208 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.212770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6231dccb-b620-4b64-948f-280facb8e208 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.292094 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6231dccb-b620-4b64-948f-280facb8e208 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120350 Oct 05 17:36:02.294797 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 637/1326] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:36:02 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:02.312640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d25b3472-6f1d-48a9-8466-89b7f03136d1 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:02.313290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d25b3472-6f1d-48a9-8466-89b7f03136d1 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:02.326248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d25b3472-6f1d-48a9-8466-89b7f03136d1 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.327322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d25b3472-6f1d-48a9-8466-89b7f03136d1 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.328839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d25b3472-6f1d-48a9-8466-89b7f03136d1 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.329896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d25b3472-6f1d-48a9-8466-89b7f03136d1 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.331156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d25b3472-6f1d-48a9-8466-89b7f03136d1 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.331391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=18 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:02.332789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d25b3472-6f1d-48a9-8466-89b7f03136d1 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.533847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d25b3472-6f1d-48a9-8466-89b7f03136d1 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:02.543973 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d25b3472-6f1d-48a9-8466-89b7f03136d1 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1322 microversion: 2.1 time: 0.246547 Oct 05 17:36:02.547095 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 638/1327] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:02 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:02.576637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-634f1f29-c269-426b-97dd-cb427164c0f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:02.577337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-634f1f29-c269-426b-97dd-cb427164c0f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:02.584049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634f1f29-c269-426b-97dd-cb427164c0f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.584809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634f1f29-c269-426b-97dd-cb427164c0f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.585480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634f1f29-c269-426b-97dd-cb427164c0f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.586628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634f1f29-c269-426b-97dd-cb427164c0f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.587458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634f1f29-c269-426b-97dd-cb427164c0f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.588262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634f1f29-c269-426b-97dd-cb427164c0f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.672732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-505f7caf-4f8c-4b39-a8c6-61237ff92e1d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:02.689002 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-505f7caf-4f8c-4b39-a8c6-61237ff92e1d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1470 microversion: 2.1 time: 0.849188 Oct 05 17:36:02.702526 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 690/1328] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:01 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1470 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:02.708479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-614d59ca-57f6-4197-b0e8-c4555f361033 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:02.709110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-614d59ca-57f6-4197-b0e8-c4555f361033 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:02.722063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-614d59ca-57f6-4197-b0e8-c4555f361033 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.722605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-614d59ca-57f6-4197-b0e8-c4555f361033 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.723051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-614d59ca-57f6-4197-b0e8-c4555f361033 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.723773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-614d59ca-57f6-4197-b0e8-c4555f361033 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.726494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-614d59ca-57f6-4197-b0e8-c4555f361033 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.726975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-614d59ca-57f6-4197-b0e8-c4555f361033 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.781095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-634f1f29-c269-426b-97dd-cb427164c0f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:02.790430 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-634f1f29-c269-426b-97dd-cb427164c0f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.217798 Oct 05 17:36:02.791282 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 639/1329] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:02 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:02.817241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a7639465-2ee7-47d0-934c-21c3bc1f97e4 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:02.817851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a7639465-2ee7-47d0-934c-21c3bc1f97e4 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:02.826644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7639465-2ee7-47d0-934c-21c3bc1f97e4 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.827624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7639465-2ee7-47d0-934c-21c3bc1f97e4 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.828287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7639465-2ee7-47d0-934c-21c3bc1f97e4 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:02.829290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7639465-2ee7-47d0-934c-21c3bc1f97e4 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:02.830050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7639465-2ee7-47d0-934c-21c3bc1f97e4 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:02.830739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7639465-2ee7-47d0-934c-21c3bc1f97e4 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:03.068579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-a7639465-2ee7-47d0-934c-21c3bc1f97e4 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid a63958af-abf6-42db-be31-d666ae842191 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:36:03.090789 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a7639465-2ee7-47d0-934c-21c3bc1f97e4 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 2343 microversion: 2.25 time: 0.278236 Oct 05 17:36:03.091621 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 640/1330] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:02 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 2343 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:03.125020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9ce67062-2f16-4c2c-b43e-842d8059ba7a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:03.134504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ce67062-2f16-4c2c-b43e-842d8059ba7a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:03.136342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ce67062-2f16-4c2c-b43e-842d8059ba7a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:03.137629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ce67062-2f16-4c2c-b43e-842d8059ba7a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:03.141750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ce67062-2f16-4c2c-b43e-842d8059ba7a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:03.143460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ce67062-2f16-4c2c-b43e-842d8059ba7a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:03.144159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ce67062-2f16-4c2c-b43e-842d8059ba7a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:03.196481 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9ce67062-2f16-4c2c-b43e-842d8059ba7a tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.078153 Oct 05 17:36:03.199382 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 641/1331] 10.222.0.70 () {60 vars in 1217 bytes} [Wed Oct 5 17:36:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:36:03.204235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-614d59ca-57f6-4197-b0e8-c4555f361033 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:03.227336 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-614d59ca-57f6-4197-b0e8-c4555f361033 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1314 microversion: 2.1 time: 0.531919 Oct 05 17:36:03.231437 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 691/1332] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:02 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:03.308466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8a8b188b-99e5-4ff9-a4b1-46f4fd5d7657 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:03.311869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8a8b188b-99e5-4ff9-a4b1-46f4fd5d7657 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:03.332808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8b188b-99e5-4ff9-a4b1-46f4fd5d7657 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:03.334375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8b188b-99e5-4ff9-a4b1-46f4fd5d7657 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:03.336164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8b188b-99e5-4ff9-a4b1-46f4fd5d7657 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:03.337720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8b188b-99e5-4ff9-a4b1-46f4fd5d7657 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:03.340335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8b188b-99e5-4ff9-a4b1-46f4fd5d7657 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:03.340987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8b188b-99e5-4ff9-a4b1-46f4fd5d7657 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:03.448697 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8a8b188b-99e5-4ff9-a4b1-46f4fd5d7657 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145348 Oct 05 17:36:03.449907 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 642/1333] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:36:03 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:03.570906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9efd972-4c32-4cf6-9363-97df16dd8188 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:03.572212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9efd972-4c32-4cf6-9363-97df16dd8188 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:03.587476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9efd972-4c32-4cf6-9363-97df16dd8188 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:03.589739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9efd972-4c32-4cf6-9363-97df16dd8188 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:03.590839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9efd972-4c32-4cf6-9363-97df16dd8188 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:03.592909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9efd972-4c32-4cf6-9363-97df16dd8188 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:03.595058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9efd972-4c32-4cf6-9363-97df16dd8188 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:03.596343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9efd972-4c32-4cf6-9363-97df16dd8188 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:03.716102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f1e9f76e-1fe0-4008-9237-9c190f993643 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:03.717186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1e9f76e-1fe0-4008-9237-9c190f993643 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:03.725747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e9f76e-1fe0-4008-9237-9c190f993643 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:03.728799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e9f76e-1fe0-4008-9237-9c190f993643 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:03.731256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e9f76e-1fe0-4008-9237-9c190f993643 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:03.732256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e9f76e-1fe0-4008-9237-9c190f993643 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:03.732742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e9f76e-1fe0-4008-9237-9c190f993643 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:03.733169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e9f76e-1fe0-4008-9237-9c190f993643 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:04.168970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9efd972-4c32-4cf6-9363-97df16dd8188 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:04.185024 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9efd972-4c32-4cf6-9363-97df16dd8188 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1322 microversion: 2.1 time: 0.613981 Oct 05 17:36:04.188044 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 692/1334] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:03 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1322 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:04.196755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a7825281-11a0-4b0a-9b05-0bb5882c2660 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:04.202043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a7825281-11a0-4b0a-9b05-0bb5882c2660 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:04.215877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1e9f76e-1fe0-4008-9237-9c190f993643 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:04.217194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7825281-11a0-4b0a-9b05-0bb5882c2660 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:04.218687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7825281-11a0-4b0a-9b05-0bb5882c2660 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:04.219112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7825281-11a0-4b0a-9b05-0bb5882c2660 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:04.222169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7825281-11a0-4b0a-9b05-0bb5882c2660 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:04.227645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7825281-11a0-4b0a-9b05-0bb5882c2660 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:04.228692 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f1e9f76e-1fe0-4008-9237-9c190f993643 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1475 microversion: 2.1 time: 0.516489 Oct 05 17:36:04.229038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7825281-11a0-4b0a-9b05-0bb5882c2660 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:04.229803 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 643/1335] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:03 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1475 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:04.260029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-08d29cd3-0cb3-48f9-85f6-7bad70323bfb tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:04.260894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-08d29cd3-0cb3-48f9-85f6-7bad70323bfb tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:04.275744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d29cd3-0cb3-48f9-85f6-7bad70323bfb tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:04.276777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d29cd3-0cb3-48f9-85f6-7bad70323bfb tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:04.277373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d29cd3-0cb3-48f9-85f6-7bad70323bfb tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:04.278674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d29cd3-0cb3-48f9-85f6-7bad70323bfb tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:04.279593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d29cd3-0cb3-48f9-85f6-7bad70323bfb tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:04.280347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d29cd3-0cb3-48f9-85f6-7bad70323bfb tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:04.630066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=18 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:04.738186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7825281-11a0-4b0a-9b05-0bb5882c2660 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:04.751965 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a7825281-11a0-4b0a-9b05-0bb5882c2660 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.562575 Oct 05 17:36:04.771549 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 693/1336] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:04 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:04.784399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08d29cd3-0cb3-48f9-85f6-7bad70323bfb tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:04.788963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:04.791022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c0d3c194-6d8b-46f5-ad1d-d2230f167b65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:04.799970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c0d3c194-6d8b-46f5-ad1d-d2230f167b65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:04.800830 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-08d29cd3-0cb3-48f9-85f6-7bad70323bfb tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1464 microversion: 2.1 time: 0.540378 Oct 05 17:36:04.816035 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 644/1337] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:04 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1464 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:04.830056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0d3c194-6d8b-46f5-ad1d-d2230f167b65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:04.831197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0d3c194-6d8b-46f5-ad1d-d2230f167b65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:04.832623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0d3c194-6d8b-46f5-ad1d-d2230f167b65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:04.834709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0d3c194-6d8b-46f5-ad1d-d2230f167b65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:04.835392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0d3c194-6d8b-46f5-ad1d-d2230f167b65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:04.836047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0d3c194-6d8b-46f5-ad1d-d2230f167b65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:04.864129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:04.880981 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c0d3c194-6d8b-46f5-ad1d-d2230f167b65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107224 Oct 05 17:36:04.888838 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 694/1338] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:36:04 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:05.180335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa2d0753-be06-427f-8ce6-d44d64a769fb tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Calling method '.version_select at 0x7f77753e7820>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:05.195298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2d0753-be06-427f-8ce6-d44d64a769fb tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:05.199684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2d0753-be06-427f-8ce6-d44d64a769fb tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:05.200227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2d0753-be06-427f-8ce6-d44d64a769fb tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:05.211378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4813479a-7b82-43f3-8ab4-60d2337f5f68 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:05.212362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4813479a-7b82-43f3-8ab4-60d2337f5f68 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:05.222565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4813479a-7b82-43f3-8ab4-60d2337f5f68 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:05.225249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4813479a-7b82-43f3-8ab4-60d2337f5f68 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:05.226716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4813479a-7b82-43f3-8ab4-60d2337f5f68 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:05.227713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4813479a-7b82-43f3-8ab4-60d2337f5f68 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:05.229696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4813479a-7b82-43f3-8ab4-60d2337f5f68 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:05.230510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4813479a-7b82-43f3-8ab4-60d2337f5f68 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:05.239607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2d0753-be06-427f-8ce6-d44d64a769fb tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:05.241777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2d0753-be06-427f-8ce6-d44d64a769fb tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:05.242703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2d0753-be06-427f-8ce6-d44d64a769fb tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:05.308784 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa2d0753-be06-427f-8ce6-d44d64a769fb tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/741b444ad58d47b296e4d70d0d94587a?start=2022-10-04T17%3A36%3A04.822493&end=2022-10-06T17%3A36%3A04.822493" status: 200 len: 695 microversion: 2.1 time: 0.479128 Oct 05 17:36:05.312068 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 645/1339] 10.222.0.70 () {58 vars in 1412 bytes} [Wed Oct 5 17:36:04 2022] GET /compute/v2.1/os-simple-tenant-usage/741b444ad58d47b296e4d70d0d94587a?start=2022-10-04T17%3A36%3A04.822493&end=2022-10-06T17%3A36%3A04.822493 => generated 695 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:05.327324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8fe7700a-0698-410e-a513-5a0d24f2e371 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:05.327996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8fe7700a-0698-410e-a513-5a0d24f2e371 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:05.349940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fe7700a-0698-410e-a513-5a0d24f2e371 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:05.356884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fe7700a-0698-410e-a513-5a0d24f2e371 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:05.357345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fe7700a-0698-410e-a513-5a0d24f2e371 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:05.358111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fe7700a-0698-410e-a513-5a0d24f2e371 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:05.358583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fe7700a-0698-410e-a513-5a0d24f2e371 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:05.359081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fe7700a-0698-410e-a513-5a0d24f2e371 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:05.483078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=7 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:05.699654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4813479a-7b82-43f3-8ab4-60d2337f5f68 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:05.713910 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4813479a-7b82-43f3-8ab4-60d2337f5f68 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1322 microversion: 2.1 time: 0.508604 Oct 05 17:36:05.726309 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 695/1340] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:05 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1322 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:05.726309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90512d75-dbc4-49d2-9d90-f868c31e8a73 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '.version_select at 0x7f7775001af0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:05.753890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90512d75-dbc4-49d2-9d90-f868c31e8a73 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:05.754412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90512d75-dbc4-49d2-9d90-f868c31e8a73 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:05.754849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90512d75-dbc4-49d2-9d90-f868c31e8a73 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:05.793257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90512d75-dbc4-49d2-9d90-f868c31e8a73 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:05.793744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90512d75-dbc4-49d2-9d90-f868c31e8a73 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:05.794500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90512d75-dbc4-49d2-9d90-f868c31e8a73 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:05.833525 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90512d75-dbc4-49d2-9d90-f868c31e8a73 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/741b444ad58d47b296e4d70d0d94587a?start=2022-10-04T17%3A36%3A04.822493&end=2022-10-06T17%3A36%3A04.822493" status: 200 len: 695 microversion: 2.1 time: 0.111684 Oct 05 17:36:05.838336 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 696/1341] 10.222.0.70 () {58 vars in 1412 bytes} [Wed Oct 5 17:36:05 2022] GET /compute/v2.1/os-simple-tenant-usage/741b444ad58d47b296e4d70d0d94587a?start=2022-10-04T17%3A36%3A04.822493&end=2022-10-06T17%3A36%3A04.822493 => generated 695 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:05.843636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4339cea1-e9d5-4a30-afdb-2e2e3115867b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:05.850355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4339cea1-e9d5-4a30-afdb-2e2e3115867b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:05.859936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4339cea1-e9d5-4a30-afdb-2e2e3115867b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:05.865639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4339cea1-e9d5-4a30-afdb-2e2e3115867b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:05.866386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4339cea1-e9d5-4a30-afdb-2e2e3115867b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:05.867342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4339cea1-e9d5-4a30-afdb-2e2e3115867b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:05.867968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4339cea1-e9d5-4a30-afdb-2e2e3115867b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:05.868558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4339cea1-e9d5-4a30-afdb-2e2e3115867b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:05.945957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8fe7700a-0698-410e-a513-5a0d24f2e371 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:05.976329 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8fe7700a-0698-410e-a513-5a0d24f2e371 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1475 microversion: 2.1 time: 0.662643 Oct 05 17:36:05.977156 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 646/1342] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:05 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1475 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:05.994349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c70a08d-f859-4b7f-995b-f8dc9e90cc79 tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Calling method '.version_select at 0x7f777535d430>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:06.006934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c70a08d-f859-4b7f-995b-f8dc9e90cc79 tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:06.007426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c70a08d-f859-4b7f-995b-f8dc9e90cc79 tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:06.007854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c70a08d-f859-4b7f-995b-f8dc9e90cc79 tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:06.026966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c70a08d-f859-4b7f-995b-f8dc9e90cc79 tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:06.027449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c70a08d-f859-4b7f-995b-f8dc9e90cc79 tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:06.028203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c70a08d-f859-4b7f-995b-f8dc9e90cc79 tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:06.357192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4339cea1-e9d5-4a30-afdb-2e2e3115867b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:06.378882 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4339cea1-e9d5-4a30-afdb-2e2e3115867b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.539114 Oct 05 17:36:06.392427 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 697/1343] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:05 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:06.411695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c5e4920-ca79-49a9-994f-c2f7d9db0915 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:06.422885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c5e4920-ca79-49a9-994f-c2f7d9db0915 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:06.442004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c5e4920-ca79-49a9-994f-c2f7d9db0915 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:06.446169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c5e4920-ca79-49a9-994f-c2f7d9db0915 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:06.449467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c5e4920-ca79-49a9-994f-c2f7d9db0915 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:06.450405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c5e4920-ca79-49a9-994f-c2f7d9db0915 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:06.459045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c5e4920-ca79-49a9-994f-c2f7d9db0915 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:06.459691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c5e4920-ca79-49a9-994f-c2f7d9db0915 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:06.546672 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c5e4920-ca79-49a9-994f-c2f7d9db0915 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148950 Oct 05 17:36:06.550475 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 698/1344] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:36:06 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:06.561791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1e6589dc-19d2-40df-bb3b-29dd8e94ba93 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bcd21b1-ecd8-4785-86ab-1f2ff730f07c", "device": "/dev/xvdb"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:06.568769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1e6589dc-19d2-40df-bb3b-29dd8e94ba93 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:06.584872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e6589dc-19d2-40df-bb3b-29dd8e94ba93 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:06.585818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e6589dc-19d2-40df-bb3b-29dd8e94ba93 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:06.586667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e6589dc-19d2-40df-bb3b-29dd8e94ba93 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:06.587828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e6589dc-19d2-40df-bb3b-29dd8e94ba93 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:06.588531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e6589dc-19d2-40df-bb3b-29dd8e94ba93 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:06.589184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e6589dc-19d2-40df-bb3b-29dd8e94ba93 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:06.627318 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7c70a08d-f859-4b7f-995b-f8dc9e90cc79 tempest-TenantUsagesTestJSON-881324319 tempest-TenantUsagesTestJSON-881324319-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-04T17%3A36%3A04.822493&end=2022-10-06T17%3A36%3A04.822493&detailed=1" status: 200 len: 15038 microversion: 2.1 time: 0.647891 Oct 05 17:36:06.642732 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 647/1345] 10.222.0.70 () {58 vars in 1335 bytes} [Wed Oct 5 17:36:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-04T17%3A36%3A04.822493&end=2022-10-06T17%3A36%3A04.822493&detailed=1 => generated 15038 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:36:06.666805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7e997b29-ffd3-46f3-b634-611a3a789fd5 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:06.668718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7e997b29-ffd3-46f3-b634-611a3a789fd5 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:06.684326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e997b29-ffd3-46f3-b634-611a3a789fd5 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:06.686582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e997b29-ffd3-46f3-b634-611a3a789fd5 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:06.691197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e997b29-ffd3-46f3-b634-611a3a789fd5 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:06.691983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e997b29-ffd3-46f3-b634-611a3a789fd5 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:06.694130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e997b29-ffd3-46f3-b634-611a3a789fd5 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:06.694803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e997b29-ffd3-46f3-b634-611a3a789fd5 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:06.764931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7e997b29-ffd3-46f3-b634-611a3a789fd5 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:36:06.952550 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7e997b29-ffd3-46f3-b634-611a3a789fd5 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 204 len: 0 microversion: 2.1 time: 0.291963 Oct 05 17:36:06.953574 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 648/1346] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:36:06 2022] DELETE /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:36:06.963214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3213de2b-f1cf-4316-b15c-0fde84c2110b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:06.966858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3213de2b-f1cf-4316-b15c-0fde84c2110b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:06.977863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3213de2b-f1cf-4316-b15c-0fde84c2110b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:06.982947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3213de2b-f1cf-4316-b15c-0fde84c2110b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:06.983662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3213de2b-f1cf-4316-b15c-0fde84c2110b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:06.984925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3213de2b-f1cf-4316-b15c-0fde84c2110b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:06.986791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3213de2b-f1cf-4316-b15c-0fde84c2110b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:06.988155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3213de2b-f1cf-4316-b15c-0fde84c2110b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:07.476925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3213de2b-f1cf-4316-b15c-0fde84c2110b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:07.488401 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3213de2b-f1cf-4316-b15c-0fde84c2110b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1322 microversion: 2.1 time: 0.532471 Oct 05 17:36:07.489233 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 649/1347] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:06 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:07.507303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-faa71705-c4eb-4be2-9ac6-fe4228ef7288 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:07.507931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-faa71705-c4eb-4be2-9ac6-fe4228ef7288 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:07.516571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faa71705-c4eb-4be2-9ac6-fe4228ef7288 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:07.517735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faa71705-c4eb-4be2-9ac6-fe4228ef7288 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:07.518497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faa71705-c4eb-4be2-9ac6-fe4228ef7288 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:07.519535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faa71705-c4eb-4be2-9ac6-fe4228ef7288 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:07.520161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faa71705-c4eb-4be2-9ac6-fe4228ef7288 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:07.520973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faa71705-c4eb-4be2-9ac6-fe4228ef7288 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:07.863374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-faa71705-c4eb-4be2-9ac6-fe4228ef7288 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:07.874652 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-faa71705-c4eb-4be2-9ac6-fe4228ef7288 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1470 microversion: 2.1 time: 0.384051 Oct 05 17:36:07.889808 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 650/1348] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:07 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1470 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:07.889808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab2e0140-eb71-46d7-991d-1612c00152c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:07.889808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ab2e0140-eb71-46d7-991d-1612c00152c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:07.902094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab2e0140-eb71-46d7-991d-1612c00152c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:07.902640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab2e0140-eb71-46d7-991d-1612c00152c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:07.906336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab2e0140-eb71-46d7-991d-1612c00152c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:07.907171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab2e0140-eb71-46d7-991d-1612c00152c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:07.907658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab2e0140-eb71-46d7-991d-1612c00152c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:07.908100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab2e0140-eb71-46d7-991d-1612c00152c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:08.233109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ab2e0140-eb71-46d7-991d-1612c00152c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:08.244152 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ab2e0140-eb71-46d7-991d-1612c00152c0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1475 microversion: 2.1 time: 0.367307 Oct 05 17:36:08.245038 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 651/1349] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:07 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1475 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:08.250027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5be57298-faa2-4568-87df-3d2a620e4652 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:08.250688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5be57298-faa2-4568-87df-3d2a620e4652 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:08.256534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5be57298-faa2-4568-87df-3d2a620e4652 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:08.257222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5be57298-faa2-4568-87df-3d2a620e4652 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:08.257805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5be57298-faa2-4568-87df-3d2a620e4652 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:08.258696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5be57298-faa2-4568-87df-3d2a620e4652 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:08.259295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5be57298-faa2-4568-87df-3d2a620e4652 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:08.259875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5be57298-faa2-4568-87df-3d2a620e4652 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:08.533241 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1e6589dc-19d2-40df-bb3b-29dd8e94ba93 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "POST /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.981078 Oct 05 17:36:08.535282 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 699/1350] 10.222.0.70 () {62 vars in 1364 bytes} [Wed Oct 5 17:36:06 2022] POST /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments => generated 194 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:36:08.561434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5be57298-faa2-4568-87df-3d2a620e4652 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:08.574650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-536caef0-8187-4f9b-9969-cd9a24c5816f tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:08.575569 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5be57298-faa2-4568-87df-3d2a620e4652 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1471 microversion: 2.1 time: 0.328984 Oct 05 17:36:08.576285 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 652/1351] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:08 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:08.583345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-536caef0-8187-4f9b-9969-cd9a24c5816f tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:08.596125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-536caef0-8187-4f9b-9969-cd9a24c5816f tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:08.597045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-536caef0-8187-4f9b-9969-cd9a24c5816f tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:08.599245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-536caef0-8187-4f9b-9969-cd9a24c5816f tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:08.600182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-536caef0-8187-4f9b-9969-cd9a24c5816f tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:08.601761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-536caef0-8187-4f9b-9969-cd9a24c5816f tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:08.604389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-536caef0-8187-4f9b-9969-cd9a24c5816f tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:08.667681 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-536caef0-8187-4f9b-9969-cd9a24c5816f tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129302 Oct 05 17:36:08.668275 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 700/1352] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:36:08 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:08.673622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-255025f8-aba9-479a-ae93-92cd37c35f16 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:08.674246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-255025f8-aba9-479a-ae93-92cd37c35f16 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:08.690383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-255025f8-aba9-479a-ae93-92cd37c35f16 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:08.690882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-255025f8-aba9-479a-ae93-92cd37c35f16 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:08.691318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-255025f8-aba9-479a-ae93-92cd37c35f16 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:08.692333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-255025f8-aba9-479a-ae93-92cd37c35f16 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:08.692807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-255025f8-aba9-479a-ae93-92cd37c35f16 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:08.693239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-255025f8-aba9-479a-ae93-92cd37c35f16 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:08.709815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bf5e9077-81b0-424f-af7d-8371973e0d14 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Action: 'create', calling method: .version_select at 0x7f7775424b80>, body: {"keypair": {"name": "tempest-keypair-1005206645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEevYZZWBbWCKR7pymTHMk0S6Vm9+Htb4Mu27BVV6RTiMNM/iZJsH3lBheCoAE/6CVpgM4kb/FZXEX8kuBtw0Yg6a+PaujRZx6XDwZLo/mAzADYJevDtOZc0Pn2wgcvSpA=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:08.742965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-bf5e9077-81b0-424f-af7d-8371973e0d14 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Getting quotas for project 605b47c049e84f9fb6f291d5c29779df. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:36:08.753660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-bf5e9077-81b0-424f-af7d-8371973e0d14 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Getting quotas for user 624f7f9915d4447b95d2602a13bc5174 and project 605b47c049e84f9fb6f291d5c29779df. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:36:08.803348 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bf5e9077-81b0-424f-af7d-8371973e0d14 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.210466 Oct 05 17:36:08.806059 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 653/1353] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:36:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:08.814537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-9570dffa-ba8a-4077-a243-2b9006b5b15a req-4d7df5ed-9c7c-4362-b491-8c58e49c2bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b315f5c-1479-4048-9c8e-306dc2a1927d", "name": "network-vif-plugged", "status": "completed", "tag": "2f8ce7da-9e01-466b-9bd0-66ba30a1ed42"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:08.844806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9570dffa-ba8a-4077-a243-2b9006b5b15a req-4d7df5ed-9c7c-4362-b491-8c58e49c2bce service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:08.848130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9570dffa-ba8a-4077-a243-2b9006b5b15a req-4d7df5ed-9c7c-4362-b491-8c58e49c2bce service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:08.848599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9570dffa-ba8a-4077-a243-2b9006b5b15a req-4d7df5ed-9c7c-4362-b491-8c58e49c2bce service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:08.865391 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9570dffa-ba8a-4077-a243-2b9006b5b15a req-4d7df5ed-9c7c-4362-b491-8c58e49c2bce service nova] Creating event network-vif-plugged:2f8ce7da-9e01-466b-9bd0-66ba30a1ed42 for instance 9b315f5c-1479-4048-9c8e-306dc2a1927d on n-h2-835595-3 Oct 05 17:36:08.881673 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-9570dffa-ba8a-4077-a243-2b9006b5b15a req-4d7df5ed-9c7c-4362-b491-8c58e49c2bce service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074425 Oct 05 17:36:08.882929 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 654/1354] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:08.899852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58ca2951-d783-4e0e-b6c4-3c1f26b05cff tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:08.900846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-58ca2951-d783-4e0e-b6c4-3c1f26b05cff tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:08.933502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58ca2951-d783-4e0e-b6c4-3c1f26b05cff tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:08.937006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58ca2951-d783-4e0e-b6c4-3c1f26b05cff tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:08.937459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58ca2951-d783-4e0e-b6c4-3c1f26b05cff tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:08.938201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58ca2951-d783-4e0e-b6c4-3c1f26b05cff tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:08.938693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58ca2951-d783-4e0e-b6c4-3c1f26b05cff tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:08.939377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58ca2951-d783-4e0e-b6c4-3c1f26b05cff tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:09.349495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58ca2951-d783-4e0e-b6c4-3c1f26b05cff tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:09.358150 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-58ca2951-d783-4e0e-b6c4-3c1f26b05cff tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1470 microversion: 2.1 time: 0.464673 Oct 05 17:36:09.367725 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 655/1355] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:08 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1470 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:09.426207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7046c01f-9548-49b1-9314-81683d5be1aa tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:09.428433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7046c01f-9548-49b1-9314-81683d5be1aa tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:09.439947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7046c01f-9548-49b1-9314-81683d5be1aa tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:09.443532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7046c01f-9548-49b1-9314-81683d5be1aa tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:09.449539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7046c01f-9548-49b1-9314-81683d5be1aa tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:09.450525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7046c01f-9548-49b1-9314-81683d5be1aa tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:09.453283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7046c01f-9548-49b1-9314-81683d5be1aa tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:09.454735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7046c01f-9548-49b1-9314-81683d5be1aa tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:09.604816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-255025f8-aba9-479a-ae93-92cd37c35f16 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:09.614262 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-255025f8-aba9-479a-ae93-92cd37c35f16 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1322 microversion: 2.1 time: 0.944852 Oct 05 17:36:09.618786 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 701/1356] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:08 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1322 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:09.644827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-127261f0-1baf-4e0c-b3bd-ff925277b53e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:09.646041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-127261f0-1baf-4e0c-b3bd-ff925277b53e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:09.662070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-127261f0-1baf-4e0c-b3bd-ff925277b53e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:09.685732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-127261f0-1baf-4e0c-b3bd-ff925277b53e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:09.689421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-127261f0-1baf-4e0c-b3bd-ff925277b53e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:09.690570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-127261f0-1baf-4e0c-b3bd-ff925277b53e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:09.696556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-127261f0-1baf-4e0c-b3bd-ff925277b53e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:09.698093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-127261f0-1baf-4e0c-b3bd-ff925277b53e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:10.108086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7046c01f-9548-49b1-9314-81683d5be1aa tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:10.122354 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7046c01f-9548-49b1-9314-81683d5be1aa tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1475 microversion: 2.1 time: 0.721350 Oct 05 17:36:10.141164 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 656/1357] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:09 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1475 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:10.154989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ed02b31-eccc-4589-ade9-2b081c5f2c33 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:10.164364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6ed02b31-eccc-4589-ade9-2b081c5f2c33 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:10.186134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ed02b31-eccc-4589-ade9-2b081c5f2c33 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:10.186586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ed02b31-eccc-4589-ade9-2b081c5f2c33 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:10.187408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ed02b31-eccc-4589-ade9-2b081c5f2c33 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:10.189067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ed02b31-eccc-4589-ade9-2b081c5f2c33 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:10.189536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ed02b31-eccc-4589-ade9-2b081c5f2c33 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:10.190234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ed02b31-eccc-4589-ade9-2b081c5f2c33 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:10.275679 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6ed02b31-eccc-4589-ade9-2b081c5f2c33 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133287 Oct 05 17:36:10.276245 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 657/1358] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:36:10 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:10.287844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-08ed7c00-631c-4d44-bf5d-820ed26d7ad2 req-80bac142-517a-4d61-9950-968c93fa7f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3", "name": "network-vif-deleted", "tag": "bcb09376-6de9-4f05-ab2a-0ceb4077ce59"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:10.326071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-08ed7c00-631c-4d44-bf5d-820ed26d7ad2 req-80bac142-517a-4d61-9950-968c93fa7f72 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:10.330642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-08ed7c00-631c-4d44-bf5d-820ed26d7ad2 req-80bac142-517a-4d61-9950-968c93fa7f72 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:10.333061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-08ed7c00-631c-4d44-bf5d-820ed26d7ad2 req-80bac142-517a-4d61-9950-968c93fa7f72 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:10.384292 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-08ed7c00-631c-4d44-bf5d-820ed26d7ad2 req-80bac142-517a-4d61-9950-968c93fa7f72 service nova] Creating event network-vif-deleted:bcb09376-6de9-4f05-ab2a-0ceb4077ce59 for instance a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 on n-h1-835595-3 Oct 05 17:36:10.407096 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-08ed7c00-631c-4d44-bf5d-820ed26d7ad2 req-80bac142-517a-4d61-9950-968c93fa7f72 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125622 Oct 05 17:36:10.409996 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 658/1359] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:10.424355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:10.425079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:10.446115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:10.446674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:10.449020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:10.453727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:10.454883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:10.455345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:10.513300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:10.516186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:10.516722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:10.517832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lazy-loading 'fault' on Instance uuid a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:36:10.568724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-127261f0-1baf-4e0c-b3bd-ff925277b53e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:10.580998 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-127261f0-1baf-4e0c-b3bd-ff925277b53e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1477 microversion: 2.1 time: 0.956616 Oct 05 17:36:10.582852 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 702/1360] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:09 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1477 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:10.639643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c15fb4681498409fa6409b5d5de686ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '741b444ad58d47b296e4d70d0d94587a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:10.655234 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de8d76c3-259c-4dec-af3d-56dc1f8906d1 tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 200 len: 1304 microversion: 2.1 time: 0.243650 Oct 05 17:36:10.658478 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 659/1361] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:10 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 1304 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:10.673155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b049716-53d0-4b1a-b42d-c9e5b58add0b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:10.673842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b049716-53d0-4b1a-b42d-c9e5b58add0b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:10.683789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b049716-53d0-4b1a-b42d-c9e5b58add0b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:10.687295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b049716-53d0-4b1a-b42d-c9e5b58add0b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:10.687950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b049716-53d0-4b1a-b42d-c9e5b58add0b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:10.689749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b049716-53d0-4b1a-b42d-c9e5b58add0b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:10.692411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b049716-53d0-4b1a-b42d-c9e5b58add0b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:10.693127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b049716-53d0-4b1a-b42d-c9e5b58add0b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:11.157774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d3d9cc74-e834-4e12-ba71-e53704580ef3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:11.158820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d3d9cc74-e834-4e12-ba71-e53704580ef3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:11.203249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3d9cc74-e834-4e12-ba71-e53704580ef3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:11.203738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3d9cc74-e834-4e12-ba71-e53704580ef3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:11.205335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3d9cc74-e834-4e12-ba71-e53704580ef3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:11.206121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3d9cc74-e834-4e12-ba71-e53704580ef3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:11.206617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3d9cc74-e834-4e12-ba71-e53704580ef3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:11.211578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3d9cc74-e834-4e12-ba71-e53704580ef3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:11.605242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d3d9cc74-e834-4e12-ba71-e53704580ef3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:11.619313 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d3d9cc74-e834-4e12-ba71-e53704580ef3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1475 microversion: 2.1 time: 0.469306 Oct 05 17:36:11.634760 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 660/1362] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:11 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1475 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:11.646089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aedd172b-5c67-4ba6-bd03-ebfaf8c55f45 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:11.648533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aedd172b-5c67-4ba6-bd03-ebfaf8c55f45 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:11.670618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedd172b-5c67-4ba6-bd03-ebfaf8c55f45 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:11.671728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedd172b-5c67-4ba6-bd03-ebfaf8c55f45 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:11.673993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedd172b-5c67-4ba6-bd03-ebfaf8c55f45 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:11.675387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedd172b-5c67-4ba6-bd03-ebfaf8c55f45 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:11.676501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedd172b-5c67-4ba6-bd03-ebfaf8c55f45 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:11.677097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedd172b-5c67-4ba6-bd03-ebfaf8c55f45 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:11.729261 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aedd172b-5c67-4ba6-bd03-ebfaf8c55f45 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090330 Oct 05 17:36:11.735005 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 661/1363] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:36:11 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:36:11.752488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bbd7c9ac-f26a-4041-ae88-ad8db63292b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:11.753226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bbd7c9ac-f26a-4041-ae88-ad8db63292b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:11.779294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbd7c9ac-f26a-4041-ae88-ad8db63292b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:11.779810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbd7c9ac-f26a-4041-ae88-ad8db63292b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:11.785670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbd7c9ac-f26a-4041-ae88-ad8db63292b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:11.786804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbd7c9ac-f26a-4041-ae88-ad8db63292b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:11.787682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbd7c9ac-f26a-4041-ae88-ad8db63292b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:11.789855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbd7c9ac-f26a-4041-ae88-ad8db63292b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:11.933912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b049716-53d0-4b1a-b42d-c9e5b58add0b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:11.981265 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b049716-53d0-4b1a-b42d-c9e5b58add0b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1322 microversion: 2.1 time: 1.327857 Oct 05 17:36:11.982509 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 703/1364] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:10 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1322 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:11.993204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:11.998188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] [instance: a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:12.026522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:12.027353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:12.027808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:12.028545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:12.029001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:12.029422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:12.090847 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] HTTP exception thrown: Instance a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 could not be found. Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Request method failure captured: Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 HTTP/1.1 Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcBvW6pQuaCaTYstWN8opOq7cBiF5GfkYVqdJCcdJEKdOBH23QR2tsJHNFJPmAJ8w4cVNm8Rhhy-w98JymhpEzxwfkRbV4hTrSH4ukfh2vdjNnhDbsivKnWt6rQPkYHlBhPSPmDN-gBb0biJfjoNYIWS5zMAYi70_3mPYvCJVHuSjDY Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 741b444ad58d47b296e4d70d0d94587a Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TenantUsagesTestJSON-1055481923 Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:36:12.095529 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/741b444ad58d47b296e4d70d0d94587a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/741b444ad58d47b296e4d70d0d94587a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_741b444ad58d47b296e4d70d0d94587a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/741b444ad58d47b296e4d70d0d94587a"}]}] Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TenantUsagesTestJSON-1055481923 Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 741b444ad58d47b296e4d70d0d94587a Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1055481923 Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TenantUsagesTestJSON-1055481923-project Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: c15fb4681498409fa6409b5d5de686ca Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TenantUsagesTestJSON-1055481923-project Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 could not be found. Oct 05 17:36:12.096969 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3'} Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 could not be found. Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:36:12.097779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 could not be found. Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 could not be found. Oct 05 17:36:12.099075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:12.105642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] Returning 404 to user: Instance a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:36:12.110074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f347d8a9-c8bc-4b58-b845-df819825d08d tempest-TenantUsagesTestJSON-1055481923 tempest-TenantUsagesTestJSON-1055481923-project] 10.222.0.70 "GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3" status: 404 len: 111 microversion: 2.1 time: 0.126151 Oct 05 17:36:12.112022 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 704/1365] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:11 2022] GET /compute/v2.1/servers/a0a3b6dc-9991-4b4a-9aa5-9bc5a29d8db3 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:36:12.191663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1021160527", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "9681e21a-0d48-466d-973b-d73679e29ebc"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:12.317338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] validate_networks() for [('9681e21a-0d48-466d-973b-d73679e29ebc', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:36:12.390458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bbd7c9ac-f26a-4041-ae88-ad8db63292b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:12.403195 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bbd7c9ac-f26a-4041-ae88-ad8db63292b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1477 microversion: 2.1 time: 0.666989 Oct 05 17:36:12.411764 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 662/1366] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:11 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1477 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:12.649263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b6c243b-225d-45bd-8d17-6709b582c49f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:12.650999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5b6c243b-225d-45bd-8d17-6709b582c49f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:12.660008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b6c243b-225d-45bd-8d17-6709b582c49f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:12.664576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b6c243b-225d-45bd-8d17-6709b582c49f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:12.665360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b6c243b-225d-45bd-8d17-6709b582c49f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:12.667858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b6c243b-225d-45bd-8d17-6709b582c49f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:12.671171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b6c243b-225d-45bd-8d17-6709b582c49f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:12.673654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b6c243b-225d-45bd-8d17-6709b582c49f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:12.685547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:13.213707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5b6c243b-225d-45bd-8d17-6709b582c49f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:13.224186 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b6c243b-225d-45bd-8d17-6709b582c49f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1475 microversion: 2.1 time: 0.579219 Oct 05 17:36:13.229769 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 663/1367] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:12 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1475 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:13.239910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-03ac5703-0d83-4864-8533-062d4bbf8bba tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:13.240673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-03ac5703-0d83-4864-8533-062d4bbf8bba tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:13.260424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03ac5703-0d83-4864-8533-062d4bbf8bba tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:13.264265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03ac5703-0d83-4864-8533-062d4bbf8bba tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:13.264838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03ac5703-0d83-4864-8533-062d4bbf8bba tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:13.267385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03ac5703-0d83-4864-8533-062d4bbf8bba tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:13.269016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03ac5703-0d83-4864-8533-062d4bbf8bba tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:13.271085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03ac5703-0d83-4864-8533-062d4bbf8bba tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:13.539191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-03ac5703-0d83-4864-8533-062d4bbf8bba tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:13.549108 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-03ac5703-0d83-4864-8533-062d4bbf8bba tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1472 microversion: 2.1 time: 0.318112 Oct 05 17:36:13.561837 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 664/1368] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:13 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1472 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:13.561837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72c2d765-b51d-4040-81b5-eeddda1d685d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:13.561837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-72c2d765-b51d-4040-81b5-eeddda1d685d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:13.565777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:36:13.566876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:36:13.567511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:36:13.568112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:36:13.568690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:36:13.580633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:13.581336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:13.581997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:13.583024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:13.583892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:13.584477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:13.588358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2d765-b51d-4040-81b5-eeddda1d685d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:13.590939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2d765-b51d-4040-81b5-eeddda1d685d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:13.591594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2d765-b51d-4040-81b5-eeddda1d685d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:13.594271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2d765-b51d-4040-81b5-eeddda1d685d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:13.594932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2d765-b51d-4040-81b5-eeddda1d685d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:13.596155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2d765-b51d-4040-81b5-eeddda1d685d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:13.630664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Getting quotas for project 1164570e81d8431f882d07b9fa9e8056. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:36:13.646556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Getting quotas for user e97eb363a60947e9b2d2d12494714aae and project 1164570e81d8431f882d07b9fa9e8056. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:36:13.679098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:36:13.681587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:36:13.810757 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-899fc4da-3104-4c6d-996f-9d489bd271cf tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.619874 Oct 05 17:36:13.812728 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 705/1369] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:36:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:36:13.823266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "96bb62d6-fa8d-4376-b129-b0c64cabfc97"}], "security_groups": [{"name": "tempest-securitygroup--807913260"}], "key_name": "tempest-keypair-1005206645", "user_data": "}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:13.970955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-72c2d765-b51d-4040-81b5-eeddda1d685d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:13.980226 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-72c2d765-b51d-4040-81b5-eeddda1d685d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1477 microversion: 2.1 time: 0.426174 Oct 05 17:36:13.982100 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 665/1370] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:13 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1477 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:13.998020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:13.999724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:14.012178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:14.017191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:14.017717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:14.018516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:14.019001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:14.019451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:14.079487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] validate_networks() for [('96bb62d6-fa8d-4376-b129-b0c64cabfc97', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:36:14.097016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Request method failure captured: Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d/diagnostics HTTP/1.1 Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcB5te6MOknhMsnAAxeY8m0Ij6GrzsYxxQEH9lsC3St5tNj7hY141GWK_IsM3P6q_23_k5Q-9nnaKezdwF8-GhS6N4iWhMrmDhFItuTb50c_gxBV6_DP2XC1Sjzsr2EQJeYowVYWnHEP58g4fjCcnhEuWMdueAPkueBaiFn3Pj01pBI Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7b69477a606d4b968b90a04c3194be91 Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2005196644 Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:36:14.099618 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b69477a606d4b968b90a04c3194be91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b69477a606d4b968b90a04c3194be91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b69477a606d4b968b90a04c3194be91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b69477a606d4b968b90a04c3194be91"}]}] Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2005196644 Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7b69477a606d4b968b90a04c3194be91 Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2005196644 Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerDiagnosticsNegativeTest-2005196644-project Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 32f940b1b6bb469dbf4b6a7c66f20d5e Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2005196644-project Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:36:14.101244 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'server_id': '9b315f5c-1479-4048-9c8e-306dc2a1927d'} Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:36:14.102085 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 05 17:36:14.103673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:14.106152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:36:14.108831 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-42c10e52-fd71-4fe3-ad89-a8b66412e815 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.123010 Oct 05 17:36:14.109607 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 666/1371] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:36:13 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d/diagnostics => generated 117 bytes in 125 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:36:14.115484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5eda2636-0abf-49bc-8695-494a84e95745 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:14.116330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5eda2636-0abf-49bc-8695-494a84e95745 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:14.258466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5eda2636-0abf-49bc-8695-494a84e95745 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:14.281911 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5eda2636-0abf-49bc-8695-494a84e95745 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1218 microversion: 2.1 time: 0.170244 Oct 05 17:36:14.283502 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 667/1372] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:14 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1218 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:14.926174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:36:14.926719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:36:14.927184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:36:14.927596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:36:14.928000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:36:14.947636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:14.948141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:14.948566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:14.950971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:14.953208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:14.954083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:14.980276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1594087002", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:15.003083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:15.010324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:15.023349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Getting quotas for project 605b47c049e84f9fb6f291d5c29779df. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:36:15.033037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Getting quotas for user 624f7f9915d4447b95d2602a13bc5174 and project 605b47c049e84f9fb6f291d5c29779df. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:36:15.061625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:36:15.063845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:36:15.088055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] validate_networks() for [('8b1f8380-13c4-4d5f-a76e-d3de024d9800', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:36:15.167918 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dc9aaa00-f3d1-4b33-a744-38e0ffec3ee1 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.353949 Oct 05 17:36:15.169037 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 706/1373] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:36:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:36:15.177963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7c6824c7-f78e-4675-bc50-9cefa3bff34b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:15.183545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7c6824c7-f78e-4675-bc50-9cefa3bff34b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:15.196310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c6824c7-f78e-4675-bc50-9cefa3bff34b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:15.199266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c6824c7-f78e-4675-bc50-9cefa3bff34b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:15.199900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c6824c7-f78e-4675-bc50-9cefa3bff34b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:15.201190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c6824c7-f78e-4675-bc50-9cefa3bff34b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:15.204023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c6824c7-f78e-4675-bc50-9cefa3bff34b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:15.204654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c6824c7-f78e-4675-bc50-9cefa3bff34b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:15.246366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7c6824c7-f78e-4675-bc50-9cefa3bff34b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:36:15.428477 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7c6824c7-f78e-4675-bc50-9cefa3bff34b tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 204 len: 0 microversion: 2.1 time: 0.257747 Oct 05 17:36:15.430353 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 707/1374] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:36:15 2022] DELETE /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:36:15.444182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70ad86d6-9031-4058-907f-b7389d93596c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:15.447836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-70ad86d6-9031-4058-907f-b7389d93596c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:15.464972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ad86d6-9031-4058-907f-b7389d93596c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:15.465478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ad86d6-9031-4058-907f-b7389d93596c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:15.465920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ad86d6-9031-4058-907f-b7389d93596c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:15.472923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ad86d6-9031-4058-907f-b7389d93596c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:15.475005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ad86d6-9031-4058-907f-b7389d93596c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:15.475622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ad86d6-9031-4058-907f-b7389d93596c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:15.770273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-70ad86d6-9031-4058-907f-b7389d93596c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:15.783448 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-70ad86d6-9031-4058-907f-b7389d93596c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1475 microversion: 2.1 time: 0.350391 Oct 05 17:36:15.787009 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 708/1375] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:15 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1475 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:15.798194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f1c7c19-e65f-4ef6-b5ff-6f89cb275851 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:15.800623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2f1c7c19-e65f-4ef6-b5ff-6f89cb275851 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:15.813797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1c7c19-e65f-4ef6-b5ff-6f89cb275851 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:15.818962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1c7c19-e65f-4ef6-b5ff-6f89cb275851 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:15.819998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1c7c19-e65f-4ef6-b5ff-6f89cb275851 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:15.821604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1c7c19-e65f-4ef6-b5ff-6f89cb275851 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:15.825682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1c7c19-e65f-4ef6-b5ff-6f89cb275851 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:15.831017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1c7c19-e65f-4ef6-b5ff-6f89cb275851 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:15.852312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:36:15.852807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:36:15.853348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:36:15.853831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:36:15.855233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:36:15.873488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:15.874086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:15.874682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:15.875484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:15.876239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:15.878982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:15.941014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Getting quotas for project 2331c2d84b054fdb9ffad3823856cd06. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:36:15.950791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Getting quotas for user 3c18411229884326b815e7f325ef37ec and project 2331c2d84b054fdb9ffad3823856cd06. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:36:15.975740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:36:15.982746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:36:16.081465 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ba46edfb-4ce6-4ce5-aaf5-be505dabf3d6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.794269 Oct 05 17:36:16.082585 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 668/1376] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:36:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:36:16.096099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-87e50101-54f4-43f2-9319-c5e1b425823f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:16.098902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-87e50101-54f4-43f2-9319-c5e1b425823f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:16.112805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f1c7c19-e65f-4ef6-b5ff-6f89cb275851 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:16.140456 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f1c7c19-e65f-4ef6-b5ff-6f89cb275851 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1477 microversion: 2.1 time: 0.349997 Oct 05 17:36:16.144376 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 709/1377] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:15 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1477 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:16.170726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d1c9c754-19d1-402d-a429-527303b90b08 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:16.177707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d1c9c754-19d1-402d-a429-527303b90b08 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:16.190336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c9c754-19d1-402d-a429-527303b90b08 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:16.191138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c9c754-19d1-402d-a429-527303b90b08 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:16.196001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c9c754-19d1-402d-a429-527303b90b08 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:16.197836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c9c754-19d1-402d-a429-527303b90b08 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:16.199502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c9c754-19d1-402d-a429-527303b90b08 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:16.200905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c9c754-19d1-402d-a429-527303b90b08 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:16.222504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-87e50101-54f4-43f2-9319-c5e1b425823f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:16.232418 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-87e50101-54f4-43f2-9319-c5e1b425823f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1226 microversion: 2.1 time: 0.148667 Oct 05 17:36:16.235748 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 669/1378] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:16 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1226 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:16.240789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-883e7dcc-cefe-4a6d-a5c5-68b764ccf517 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:16.248237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-883e7dcc-cefe-4a6d-a5c5-68b764ccf517 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:16.265998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-883e7dcc-cefe-4a6d-a5c5-68b764ccf517 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:16.267632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-883e7dcc-cefe-4a6d-a5c5-68b764ccf517 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:16.268255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-883e7dcc-cefe-4a6d-a5c5-68b764ccf517 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:16.269359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-883e7dcc-cefe-4a6d-a5c5-68b764ccf517 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:16.269993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-883e7dcc-cefe-4a6d-a5c5-68b764ccf517 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:16.271388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-883e7dcc-cefe-4a6d-a5c5-68b764ccf517 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:16.370109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d1c9c754-19d1-402d-a429-527303b90b08 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:16.374555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:16.381678 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d1c9c754-19d1-402d-a429-527303b90b08 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1270 microversion: 2.1 time: 0.235774 Oct 05 17:36:16.382762 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 710/1379] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:16 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1270 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:16.391182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-56bc640a-1869-4794-af0a-52ed0f4f5025 req-c512ed90-7c55-418c-881e-c2c577c73c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6321627d-1957-42b5-a223-da558b58bbdf", "name": "network-vif-plugged", "status": "completed", "tag": "9752d52f-5ec4-412b-ae98-2e0cd46d439f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:16.406569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-56bc640a-1869-4794-af0a-52ed0f4f5025 req-c512ed90-7c55-418c-881e-c2c577c73c3a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:16.407427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-56bc640a-1869-4794-af0a-52ed0f4f5025 req-c512ed90-7c55-418c-881e-c2c577c73c3a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:16.408080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-56bc640a-1869-4794-af0a-52ed0f4f5025 req-c512ed90-7c55-418c-881e-c2c577c73c3a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:16.437396 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-56bc640a-1869-4794-af0a-52ed0f4f5025 req-c512ed90-7c55-418c-881e-c2c577c73c3a service nova] Creating event network-vif-plugged:9752d52f-5ec4-412b-ae98-2e0cd46d439f for instance 6321627d-1957-42b5-a223-da558b58bbdf on n-h1-835595-3 Oct 05 17:36:16.443279 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-56bc640a-1869-4794-af0a-52ed0f4f5025 req-c512ed90-7c55-418c-881e-c2c577c73c3a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059054 Oct 05 17:36:16.445092 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 711/1380] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:16.476136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47adfe1d-dc86-44bc-86e0-85ef9deff0da tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:16.477171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-47adfe1d-dc86-44bc-86e0-85ef9deff0da tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:16.576165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-47adfe1d-dc86-44bc-86e0-85ef9deff0da tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:16.587919 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-47adfe1d-dc86-44bc-86e0-85ef9deff0da tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1214 microversion: 2.1 time: 0.141342 Oct 05 17:36:16.589056 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 712/1381] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:16 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:16.795823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-883e7dcc-cefe-4a6d-a5c5-68b764ccf517 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:16.815220 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-883e7dcc-cefe-4a6d-a5c5-68b764ccf517 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1478 microversion: 2.1 time: 0.576630 Oct 05 17:36:16.830938 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 670/1382] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:16 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1478 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:16.831699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3756b760-76aa-4225-b7e7-0bae8888dc4a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:16.831699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3756b760-76aa-4225-b7e7-0bae8888dc4a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:16.832661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3756b760-76aa-4225-b7e7-0bae8888dc4a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:16.833159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3756b760-76aa-4225-b7e7-0bae8888dc4a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:16.833593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3756b760-76aa-4225-b7e7-0bae8888dc4a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:16.834325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3756b760-76aa-4225-b7e7-0bae8888dc4a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:16.834788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3756b760-76aa-4225-b7e7-0bae8888dc4a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:16.842476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3756b760-76aa-4225-b7e7-0bae8888dc4a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.168692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cb6a33c3-3519-4023-9028-e346b2bf2575 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:17.169305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cb6a33c3-3519-4023-9028-e346b2bf2575 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:17.182032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6a33c3-3519-4023-9028-e346b2bf2575 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:17.183065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6a33c3-3519-4023-9028-e346b2bf2575 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:17.183423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6a33c3-3519-4023-9028-e346b2bf2575 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.184343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6a33c3-3519-4023-9028-e346b2bf2575 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:17.184798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6a33c3-3519-4023-9028-e346b2bf2575 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:17.185224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6a33c3-3519-4023-9028-e346b2bf2575 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.361195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3756b760-76aa-4225-b7e7-0bae8888dc4a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:17.370299 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3756b760-76aa-4225-b7e7-0bae8888dc4a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1475 microversion: 2.1 time: 0.557523 Oct 05 17:36:17.371921 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 713/1383] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:16 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1475 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:17.376976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-df75a58e-95ff-4c6e-8867-65b0120355ec tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:17.377785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-df75a58e-95ff-4c6e-8867-65b0120355ec tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:17.385266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df75a58e-95ff-4c6e-8867-65b0120355ec tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:17.386680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df75a58e-95ff-4c6e-8867-65b0120355ec tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:17.387275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df75a58e-95ff-4c6e-8867-65b0120355ec tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.388135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df75a58e-95ff-4c6e-8867-65b0120355ec tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:17.388755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df75a58e-95ff-4c6e-8867-65b0120355ec tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:17.389426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df75a58e-95ff-4c6e-8867-65b0120355ec tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.498987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-df75a58e-95ff-4c6e-8867-65b0120355ec tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:17.508509 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-df75a58e-95ff-4c6e-8867-65b0120355ec tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1278 microversion: 2.1 time: 0.135330 Oct 05 17:36:17.512474 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 714/1384] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:17 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1278 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:17.520039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b59d11fe-3f1f-418d-b874-eac1b8e71baa tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:17.522999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b59d11fe-3f1f-418d-b874-eac1b8e71baa tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:17.552021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b59d11fe-3f1f-418d-b874-eac1b8e71baa tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:17.552835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b59d11fe-3f1f-418d-b874-eac1b8e71baa tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:17.553417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b59d11fe-3f1f-418d-b874-eac1b8e71baa tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.554301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b59d11fe-3f1f-418d-b874-eac1b8e71baa tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:17.554930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b59d11fe-3f1f-418d-b874-eac1b8e71baa tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:17.555527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b59d11fe-3f1f-418d-b874-eac1b8e71baa tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.588880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cb6a33c3-3519-4023-9028-e346b2bf2575 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:17.602471 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cb6a33c3-3519-4023-9028-e346b2bf2575 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1477 microversion: 2.1 time: 0.436998 Oct 05 17:36:17.605453 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 671/1385] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:17 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1477 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:17.616696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ebc43d8-dad4-42b4-bc57-c6fe79973850 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:17.617264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0ebc43d8-dad4-42b4-bc57-c6fe79973850 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:17.639177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ebc43d8-dad4-42b4-bc57-c6fe79973850 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:17.641410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ebc43d8-dad4-42b4-bc57-c6fe79973850 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:17.642140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ebc43d8-dad4-42b4-bc57-c6fe79973850 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.645561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ebc43d8-dad4-42b4-bc57-c6fe79973850 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:17.648172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ebc43d8-dad4-42b4-bc57-c6fe79973850 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:17.648783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ebc43d8-dad4-42b4-bc57-c6fe79973850 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.667655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b59d11fe-3f1f-418d-b874-eac1b8e71baa tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:17.688478 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b59d11fe-3f1f-418d-b874-eac1b8e71baa tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1276 microversion: 2.1 time: 0.171145 Oct 05 17:36:17.691803 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 715/1386] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:17 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:17.831215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0ebc43d8-dad4-42b4-bc57-c6fe79973850 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:17.840211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5646be96-ccbc-4269-b565-f3ba88ae00e0 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:17.841475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5646be96-ccbc-4269-b565-f3ba88ae00e0 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:17.843591 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0ebc43d8-dad4-42b4-bc57-c6fe79973850 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1218 microversion: 2.1 time: 0.235356 Oct 05 17:36:17.849648 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 672/1387] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:17 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:17.854231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5646be96-ccbc-4269-b565-f3ba88ae00e0 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:17.855695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5646be96-ccbc-4269-b565-f3ba88ae00e0 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:17.856615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5646be96-ccbc-4269-b565-f3ba88ae00e0 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.858365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5646be96-ccbc-4269-b565-f3ba88ae00e0 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:17.860313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5646be96-ccbc-4269-b565-f3ba88ae00e0 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:17.860924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5646be96-ccbc-4269-b565-f3ba88ae00e0 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:17.989003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1d3fe633-b114-49f7-ada1-aa2eccdb36d3 req-e7b75043-6f4d-422b-afe2-bdb771abf195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b315f5c-1479-4048-9c8e-306dc2a1927d", "name": "network-vif-deleted", "tag": "2f8ce7da-9e01-466b-9bd0-66ba30a1ed42"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:18.003507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5646be96-ccbc-4269-b565-f3ba88ae00e0 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:18.014476 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5646be96-ccbc-4269-b565-f3ba88ae00e0 tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1436 microversion: 2.1 time: 0.178179 Oct 05 17:36:18.017640 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 716/1388] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:17 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1436 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:18.034000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1d3fe633-b114-49f7-ada1-aa2eccdb36d3 req-e7b75043-6f4d-422b-afe2-bdb771abf195 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:18.035972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1d3fe633-b114-49f7-ada1-aa2eccdb36d3 req-e7b75043-6f4d-422b-afe2-bdb771abf195 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:18.036696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1d3fe633-b114-49f7-ada1-aa2eccdb36d3 req-e7b75043-6f4d-422b-afe2-bdb771abf195 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:18.053472 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1d3fe633-b114-49f7-ada1-aa2eccdb36d3 req-e7b75043-6f4d-422b-afe2-bdb771abf195 service nova] Creating event network-vif-deleted:2f8ce7da-9e01-466b-9bd0-66ba30a1ed42 for instance 9b315f5c-1479-4048-9c8e-306dc2a1927d on n-h2-835595-3 Oct 05 17:36:18.060268 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1d3fe633-b114-49f7-ada1-aa2eccdb36d3 req-e7b75043-6f4d-422b-afe2-bdb771abf195 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075480 Oct 05 17:36:18.064609 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 673/1389] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:36:18.409037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c1660257-068a-4ceb-8d0c-a3d604326329 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:18.410264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c1660257-068a-4ceb-8d0c-a3d604326329 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:18.426606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1660257-068a-4ceb-8d0c-a3d604326329 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:18.427426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1660257-068a-4ceb-8d0c-a3d604326329 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:18.429364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1660257-068a-4ceb-8d0c-a3d604326329 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:18.432530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1660257-068a-4ceb-8d0c-a3d604326329 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:18.433141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1660257-068a-4ceb-8d0c-a3d604326329 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:18.433851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1660257-068a-4ceb-8d0c-a3d604326329 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:18.543405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4abf0a0-b211-4108-97a3-253ed38a2799 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:18.544329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e4abf0a0-b211-4108-97a3-253ed38a2799 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:18.558119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4abf0a0-b211-4108-97a3-253ed38a2799 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:18.559781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4abf0a0-b211-4108-97a3-253ed38a2799 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:18.560253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4abf0a0-b211-4108-97a3-253ed38a2799 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:18.564279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4abf0a0-b211-4108-97a3-253ed38a2799 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:18.564818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4abf0a0-b211-4108-97a3-253ed38a2799 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:18.565254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4abf0a0-b211-4108-97a3-253ed38a2799 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:18.837239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e4abf0a0-b211-4108-97a3-253ed38a2799 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:18.846854 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e4abf0a0-b211-4108-97a3-253ed38a2799 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1278 microversion: 2.1 time: 0.308253 Oct 05 17:36:18.873132 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 674/1390] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:18 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1278 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:18.880950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c1660257-068a-4ceb-8d0c-a3d604326329 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:18.881984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-86431f8d-8adb-4852-9609-5320252927fe tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:18.882620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-86431f8d-8adb-4852-9609-5320252927fe tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:18.893262 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c1660257-068a-4ceb-8d0c-a3d604326329 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1475 microversion: 2.1 time: 0.497182 Oct 05 17:36:18.895139 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 717/1391] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:18 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1475 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:18.934988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86431f8d-8adb-4852-9609-5320252927fe tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:18.935494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86431f8d-8adb-4852-9609-5320252927fe tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:18.935934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86431f8d-8adb-4852-9609-5320252927fe tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:18.936648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86431f8d-8adb-4852-9609-5320252927fe tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:18.942007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86431f8d-8adb-4852-9609-5320252927fe tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:18.943061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86431f8d-8adb-4852-9609-5320252927fe tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:18.953192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d01a9b6-2d1d-48a4-99ff-46948b2c07a6 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:18.954253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9d01a9b6-2d1d-48a4-99ff-46948b2c07a6 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:18.971928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d01a9b6-2d1d-48a4-99ff-46948b2c07a6 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:18.974889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d01a9b6-2d1d-48a4-99ff-46948b2c07a6 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:18.975757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d01a9b6-2d1d-48a4-99ff-46948b2c07a6 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:18.977664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d01a9b6-2d1d-48a4-99ff-46948b2c07a6 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:18.978665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d01a9b6-2d1d-48a4-99ff-46948b2c07a6 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:18.979329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d01a9b6-2d1d-48a4-99ff-46948b2c07a6 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:19.408354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9d01a9b6-2d1d-48a4-99ff-46948b2c07a6 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:19.419375 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9d01a9b6-2d1d-48a4-99ff-46948b2c07a6 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 0.522886 Oct 05 17:36:19.430436 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 718/1392] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:18 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:19.448340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d25cc486-1247-47dc-9e42-c90c7d2fd22f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:19.449148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d25cc486-1247-47dc-9e42-c90c7d2fd22f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:19.468144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d25cc486-1247-47dc-9e42-c90c7d2fd22f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:19.468879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d25cc486-1247-47dc-9e42-c90c7d2fd22f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:19.470099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d25cc486-1247-47dc-9e42-c90c7d2fd22f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:19.471374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d25cc486-1247-47dc-9e42-c90c7d2fd22f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:19.472114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d25cc486-1247-47dc-9e42-c90c7d2fd22f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:19.472770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d25cc486-1247-47dc-9e42-c90c7d2fd22f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:19.582557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d25cc486-1247-47dc-9e42-c90c7d2fd22f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:19.594386 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d25cc486-1247-47dc-9e42-c90c7d2fd22f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1266 microversion: 2.1 time: 0.162382 Oct 05 17:36:19.594919 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 719/1393] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:19 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:19.601407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:19.606897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:19.624550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:19.625056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:19.625496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:19.626221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:19.626714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:19.627144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:19.630642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86431f8d-8adb-4852-9609-5320252927fe tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:19.640190 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-86431f8d-8adb-4852-9609-5320252927fe tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1463 microversion: 2.1 time: 0.765728 Oct 05 17:36:19.647106 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 675/1394] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:18 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1463 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:19.674457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7836170e-6df6-4501-a5e0-9ad74b7532cb tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:19.675441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7836170e-6df6-4501-a5e0-9ad74b7532cb tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:19.684569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7836170e-6df6-4501-a5e0-9ad74b7532cb tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:19.690240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7836170e-6df6-4501-a5e0-9ad74b7532cb tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:19.690901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7836170e-6df6-4501-a5e0-9ad74b7532cb tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:19.691802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7836170e-6df6-4501-a5e0-9ad74b7532cb tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:19.692626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7836170e-6df6-4501-a5e0-9ad74b7532cb tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:19.693373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7836170e-6df6-4501-a5e0-9ad74b7532cb tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:19.704891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:19.705662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:19.706314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:19.707011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lazy-loading 'fault' on Instance uuid 9b315f5c-1479-4048-9c8e-306dc2a1927d {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:36:19.765650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32f940b1b6bb469dbf4b6a7c66f20d5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b69477a606d4b968b90a04c3194be91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:19.784538 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-97834b95-f0f8-4b7f-acf6-613cbadc07bf tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 200 len: 1312 microversion: 2.1 time: 0.186187 Oct 05 17:36:19.786635 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 720/1395] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:19 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 1312 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:19.876512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6792e9ef-7ecc-46a8-924e-aeb23970a2b7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:19.877129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6792e9ef-7ecc-46a8-924e-aeb23970a2b7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:19.907350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6792e9ef-7ecc-46a8-924e-aeb23970a2b7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:19.908054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6792e9ef-7ecc-46a8-924e-aeb23970a2b7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:19.912553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6792e9ef-7ecc-46a8-924e-aeb23970a2b7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:19.914194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6792e9ef-7ecc-46a8-924e-aeb23970a2b7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:19.915174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6792e9ef-7ecc-46a8-924e-aeb23970a2b7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:19.915772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6792e9ef-7ecc-46a8-924e-aeb23970a2b7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:20.279469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6792e9ef-7ecc-46a8-924e-aeb23970a2b7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:20.289233 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6792e9ef-7ecc-46a8-924e-aeb23970a2b7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1284 microversion: 2.1 time: 0.416660 Oct 05 17:36:20.305609 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 721/1396] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:19 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1284 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:20.316022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7f6a13fd-784b-4e8d-b0d2-bcfeb6dca843 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:20.319371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7f6a13fd-784b-4e8d-b0d2-bcfeb6dca843 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:20.329635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f6a13fd-784b-4e8d-b0d2-bcfeb6dca843 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:20.330239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f6a13fd-784b-4e8d-b0d2-bcfeb6dca843 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:20.330768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f6a13fd-784b-4e8d-b0d2-bcfeb6dca843 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:20.331705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f6a13fd-784b-4e8d-b0d2-bcfeb6dca843 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:20.333279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f6a13fd-784b-4e8d-b0d2-bcfeb6dca843 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:20.334856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f6a13fd-784b-4e8d-b0d2-bcfeb6dca843 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:20.409537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7836170e-6df6-4501-a5e0-9ad74b7532cb tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:20.425445 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7836170e-6df6-4501-a5e0-9ad74b7532cb tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1463 microversion: 2.1 time: 0.754028 Oct 05 17:36:20.438478 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 676/1397] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:19 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1463 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:20.454548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b36b45ba-a02e-42be-abab-3917d62b73fc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:20.461483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b36b45ba-a02e-42be-abab-3917d62b73fc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:20.469762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b36b45ba-a02e-42be-abab-3917d62b73fc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:20.477375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b36b45ba-a02e-42be-abab-3917d62b73fc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:20.477928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b36b45ba-a02e-42be-abab-3917d62b73fc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:20.478972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b36b45ba-a02e-42be-abab-3917d62b73fc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:20.479538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b36b45ba-a02e-42be-abab-3917d62b73fc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:20.480376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b36b45ba-a02e-42be-abab-3917d62b73fc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:20.843521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7f6a13fd-784b-4e8d-b0d2-bcfeb6dca843 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:20.852648 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7f6a13fd-784b-4e8d-b0d2-bcfeb6dca843 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1474 microversion: 2.1 time: 0.556813 Oct 05 17:36:20.858363 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 722/1398] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:20 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1474 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:20.875790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:20.901362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:20.909089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:20.909920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:20.910663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:20.912336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:20.913014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:20.913746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.029827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b36b45ba-a02e-42be-abab-3917d62b73fc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:21.072640 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b36b45ba-a02e-42be-abab-3917d62b73fc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 0.623135 Oct 05 17:36:21.076356 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 677/1399] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:20 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:21.092005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c3a9e24b-160b-406a-8096-74a89f0f64dc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:21.092634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3a9e24b-160b-406a-8096-74a89f0f64dc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:21.112145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:36:21.112644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:36:21.115872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:36:21.118940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:36:21.119808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:36:21.125890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3a9e24b-160b-406a-8096-74a89f0f64dc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.129267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3a9e24b-160b-406a-8096-74a89f0f64dc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.130636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3a9e24b-160b-406a-8096-74a89f0f64dc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.136090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3a9e24b-160b-406a-8096-74a89f0f64dc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.139299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3a9e24b-160b-406a-8096-74a89f0f64dc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.144610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3a9e24b-160b-406a-8096-74a89f0f64dc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.314823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:21.331521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c3a9e24b-160b-406a-8096-74a89f0f64dc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:21.333001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.334214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.334696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.337920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.339261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.339660 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c3a9e24b-160b-406a-8096-74a89f0f64dc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1272 microversion: 2.1 time: 0.261703 Oct 05 17:36:21.341539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.343343 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 678/1400] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:21 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:21.356622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:21.357468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] [instance: 9b315f5c-1479-4048-9c8e-306dc2a1927d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:21.376264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.377092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.378360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.379274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.381110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.385917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.417524 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] HTTP exception thrown: Instance 9b315f5c-1479-4048-9c8e-306dc2a1927d could not be found. Oct 05 17:36:21.426873 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8cacf066-6a1f-4993-aa65-f2f320291113 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action" status: 202 len: 1067 microversion: 2.1 time: 0.566929 Oct 05 17:36:21.429363 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 723/1401] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:36:20 2022] POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action => generated 1067 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Request method failure captured: Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d HTTP/1.1 Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcB5te6MOknhMsnAAxeY8m0Ij6GrzsYxxQEH9lsC3St5tNj7hY141GWK_IsM3P6q_23_k5Q-9nnaKezdwF8-GhS6N4iWhMrmDhFItuTb50c_gxBV6_DP2XC1Sjzsr2EQJeYowVYWnHEP58g4fjCcnhEuWMdueAPkueBaiFn3Pj01pBI Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7b69477a606d4b968b90a04c3194be91 Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-2005196644 Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:36:21.430056 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7b69477a606d4b968b90a04c3194be91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b69477a606d4b968b90a04c3194be91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7b69477a606d4b968b90a04c3194be91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7b69477a606d4b968b90a04c3194be91"}]}] Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-2005196644 Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7b69477a606d4b968b90a04c3194be91 Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-2005196644 Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerDiagnosticsNegativeTest-2005196644-project Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 32f940b1b6bb469dbf4b6a7c66f20d5e Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-2005196644-project Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 9b315f5c-1479-4048-9c8e-306dc2a1927d could not be found. Oct 05 17:36:21.431471 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '9b315f5c-1479-4048-9c8e-306dc2a1927d'} Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b315f5c-1479-4048-9c8e-306dc2a1927d could not be found. Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:36:21.432238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b315f5c-1479-4048-9c8e-306dc2a1927d could not be found. Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b315f5c-1479-4048-9c8e-306dc2a1927d could not be found. Oct 05 17:36:21.433546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:21.434796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] Returning 404 to user: Instance 9b315f5c-1479-4048-9c8e-306dc2a1927d could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:36:21.434796 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ddc0fbe2-3302-423d-9707-ab20cd092e1d tempest-ServerDiagnosticsNegativeTest-2005196644 tempest-ServerDiagnosticsNegativeTest-2005196644-project] 10.222.0.70 "GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d" status: 404 len: 111 microversion: 2.1 time: 0.086446 Oct 05 17:36:21.434796 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 679/1402] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:21 2022] GET /compute/v2.1/servers/9b315f5c-1479-4048-9c8e-306dc2a1927d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:36:21.439361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4bde8acc-cc54-4cbc-b5eb-5bdc6f5cc498 req-240b4738-a75d-472c-8205-7be3b8ac531b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2deb41c1-aad2-44ec-890d-ee629b7026a8", "name": "network-vif-unplugged", "status": "completed", "tag": "662f062f-3156-4f24-b7bb-57e88b7f1361"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:21.469699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4bde8acc-cc54-4cbc-b5eb-5bdc6f5cc498 req-240b4738-a75d-472c-8205-7be3b8ac531b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.470193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4bde8acc-cc54-4cbc-b5eb-5bdc6f5cc498 req-240b4738-a75d-472c-8205-7be3b8ac531b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.472817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4bde8acc-cc54-4cbc-b5eb-5bdc6f5cc498 req-240b4738-a75d-472c-8205-7be3b8ac531b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.474381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2685ee62-d78a-42b1-bb8a-d922298f37b3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:21.475345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2685ee62-d78a-42b1-bb8a-d922298f37b3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:21.498218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2685ee62-d78a-42b1-bb8a-d922298f37b3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.499094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2685ee62-d78a-42b1-bb8a-d922298f37b3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.500543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2685ee62-d78a-42b1-bb8a-d922298f37b3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.501791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2685ee62-d78a-42b1-bb8a-d922298f37b3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.506083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2685ee62-d78a-42b1-bb8a-d922298f37b3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.506683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2685ee62-d78a-42b1-bb8a-d922298f37b3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.509653 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4bde8acc-cc54-4cbc-b5eb-5bdc6f5cc498 req-240b4738-a75d-472c-8205-7be3b8ac531b service nova] Creating event network-vif-unplugged:662f062f-3156-4f24-b7bb-57e88b7f1361 for instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 on n-h1-835595-3 Oct 05 17:36:21.526082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-4bde8acc-cc54-4cbc-b5eb-5bdc6f5cc498 req-240b4738-a75d-472c-8205-7be3b8ac531b service nova] Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:36:21.553852 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4bde8acc-cc54-4cbc-b5eb-5bdc6f5cc498 req-240b4738-a75d-472c-8205-7be3b8ac531b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.124727 Oct 05 17:36:21.554786 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 724/1403] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:21.566881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-93a69ccd-1400-4048-9fd9-1133ff5b86f1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:21.567509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-93a69ccd-1400-4048-9fd9-1133ff5b86f1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:21.582602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a69ccd-1400-4048-9fd9-1133ff5b86f1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.583093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a69ccd-1400-4048-9fd9-1133ff5b86f1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.583532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a69ccd-1400-4048-9fd9-1133ff5b86f1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.584412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a69ccd-1400-4048-9fd9-1133ff5b86f1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.593286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a69ccd-1400-4048-9fd9-1133ff5b86f1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.593939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93a69ccd-1400-4048-9fd9-1133ff5b86f1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.902835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-93a69ccd-1400-4048-9fd9-1133ff5b86f1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:21.930925 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-93a69ccd-1400-4048-9fd9-1133ff5b86f1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.374691 Oct 05 17:36:21.931736 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 725/1404] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:21 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:21.938132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d53b8ed6-82ab-4b0d-b7e3-ee5aaa06f68f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:21.939043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d53b8ed6-82ab-4b0d-b7e3-ee5aaa06f68f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:21.949683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d53b8ed6-82ab-4b0d-b7e3-ee5aaa06f68f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.954417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d53b8ed6-82ab-4b0d-b7e3-ee5aaa06f68f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.955181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d53b8ed6-82ab-4b0d-b7e3-ee5aaa06f68f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:21.957909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d53b8ed6-82ab-4b0d-b7e3-ee5aaa06f68f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:21.958554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d53b8ed6-82ab-4b0d-b7e3-ee5aaa06f68f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:21.959101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d53b8ed6-82ab-4b0d-b7e3-ee5aaa06f68f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:22.405158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d53b8ed6-82ab-4b0d-b7e3-ee5aaa06f68f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:22.413670 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d53b8ed6-82ab-4b0d-b7e3-ee5aaa06f68f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1474 microversion: 2.1 time: 0.480645 Oct 05 17:36:22.414600 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 726/1405] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:21 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1474 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:22.419518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48001eb1-1c1c-4314-98b1-097fc5dd2503 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:22.420306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-48001eb1-1c1c-4314-98b1-097fc5dd2503 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:22.426357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48001eb1-1c1c-4314-98b1-097fc5dd2503 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:22.427036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48001eb1-1c1c-4314-98b1-097fc5dd2503 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:22.427653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48001eb1-1c1c-4314-98b1-097fc5dd2503 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:22.428521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48001eb1-1c1c-4314-98b1-097fc5dd2503 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:22.429137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48001eb1-1c1c-4314-98b1-097fc5dd2503 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:22.429697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48001eb1-1c1c-4314-98b1-097fc5dd2503 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:22.434817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:22.502946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2685ee62-d78a-42b1-bb8a-d922298f37b3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:22.516879 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2685ee62-d78a-42b1-bb8a-d922298f37b3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1351 microversion: 2.1 time: 1.059494 Oct 05 17:36:22.545811 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 680/1406] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:21 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1351 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:22.557721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f75a91b6-137f-48d0-8c52-d392d53f55f1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:22.561645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f75a91b6-137f-48d0-8c52-d392d53f55f1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:22.573790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75a91b6-137f-48d0-8c52-d392d53f55f1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:22.576825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75a91b6-137f-48d0-8c52-d392d53f55f1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:22.578412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75a91b6-137f-48d0-8c52-d392d53f55f1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:22.579382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75a91b6-137f-48d0-8c52-d392d53f55f1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:22.580221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75a91b6-137f-48d0-8c52-d392d53f55f1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:22.580887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75a91b6-137f-48d0-8c52-d392d53f55f1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:23.034428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f75a91b6-137f-48d0-8c52-d392d53f55f1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:23.044573 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f75a91b6-137f-48d0-8c52-d392d53f55f1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1314 microversion: 2.1 time: 0.496838 Oct 05 17:36:23.045257 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 681/1407] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:22 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:23.051975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2b7af294-8df2-4329-b128-38205664b3fa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:23.053886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2b7af294-8df2-4329-b128-38205664b3fa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:23.063214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b7af294-8df2-4329-b128-38205664b3fa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:23.063822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b7af294-8df2-4329-b128-38205664b3fa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:23.064490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b7af294-8df2-4329-b128-38205664b3fa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:23.065313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b7af294-8df2-4329-b128-38205664b3fa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:23.065873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b7af294-8df2-4329-b128-38205664b3fa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:23.066945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b7af294-8df2-4329-b128-38205664b3fa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:23.095568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-48001eb1-1c1c-4314-98b1-097fc5dd2503 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:23.106888 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48001eb1-1c1c-4314-98b1-097fc5dd2503 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 0.690924 Oct 05 17:36:23.107484 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 727/1408] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:22 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:23.448951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d3c3724-e23d-4e22-966d-ef94cfdf0ccc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:23.456250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2d3c3724-e23d-4e22-966d-ef94cfdf0ccc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:23.475687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d3c3724-e23d-4e22-966d-ef94cfdf0ccc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:23.476206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d3c3724-e23d-4e22-966d-ef94cfdf0ccc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:23.476656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d3c3724-e23d-4e22-966d-ef94cfdf0ccc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:23.480324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d3c3724-e23d-4e22-966d-ef94cfdf0ccc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:23.482177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d3c3724-e23d-4e22-966d-ef94cfdf0ccc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:23.482697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d3c3724-e23d-4e22-966d-ef94cfdf0ccc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:23.880018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2d3c3724-e23d-4e22-966d-ef94cfdf0ccc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:23.899729 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2d3c3724-e23d-4e22-966d-ef94cfdf0ccc tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1474 microversion: 2.1 time: 0.460993 Oct 05 17:36:23.944629 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 728/1409] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:23 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1474 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:23.957353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-73804337-5a0e-42ca-8eb2-fed326df9515 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:23.958169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-73804337-5a0e-42ca-8eb2-fed326df9515 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:23.968325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73804337-5a0e-42ca-8eb2-fed326df9515 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:23.969116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73804337-5a0e-42ca-8eb2-fed326df9515 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:23.970031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73804337-5a0e-42ca-8eb2-fed326df9515 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:23.971619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73804337-5a0e-42ca-8eb2-fed326df9515 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:23.973541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73804337-5a0e-42ca-8eb2-fed326df9515 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:23.973980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73804337-5a0e-42ca-8eb2-fed326df9515 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:24.119295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b7af294-8df2-4329-b128-38205664b3fa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:24.133394 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2b7af294-8df2-4329-b128-38205664b3fa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 1.085960 Oct 05 17:36:24.134394 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 682/1410] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:23 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:24.139940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-0b142dc6-eb56-4144-bb26-e0018e12a93b req-1c235d7a-19b0-4f3c-99a3-75f8f120296b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2deb41c1-aad2-44ec-890d-ee629b7026a8", "tag": "662f062f-3156-4f24-b7bb-57e88b7f1361"}, {"name": "network-changed", "server_uuid": "012a21d9-0f94-4075-b433-d8d3120e1356", "tag": "209c3636-f5f8-4d30-848f-c1dabd3dd2a6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:24.153841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0b142dc6-eb56-4144-bb26-e0018e12a93b req-1c235d7a-19b0-4f3c-99a3-75f8f120296b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:24.154770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0b142dc6-eb56-4144-bb26-e0018e12a93b req-1c235d7a-19b0-4f3c-99a3-75f8f120296b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:24.155503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0b142dc6-eb56-4144-bb26-e0018e12a93b req-1c235d7a-19b0-4f3c-99a3-75f8f120296b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:24.178316 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-0b142dc6-eb56-4144-bb26-e0018e12a93b req-1c235d7a-19b0-4f3c-99a3-75f8f120296b service nova] Creating event network-changed:662f062f-3156-4f24-b7bb-57e88b7f1361 for instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 on n-h1-835595-3 Oct 05 17:36:24.179212 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-0b142dc6-eb56-4144-bb26-e0018e12a93b req-1c235d7a-19b0-4f3c-99a3-75f8f120296b service nova] Creating event network-changed:209c3636-f5f8-4d30-848f-c1dabd3dd2a6 for instance 012a21d9-0f94-4075-b433-d8d3120e1356 on n-h1-835595-3 Oct 05 17:36:24.185263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-0b142dc6-eb56-4144-bb26-e0018e12a93b req-1c235d7a-19b0-4f3c-99a3-75f8f120296b service nova] Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:36:24.201980 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-0b142dc6-eb56-4144-bb26-e0018e12a93b req-1c235d7a-19b0-4f3c-99a3-75f8f120296b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.065997 Oct 05 17:36:24.203343 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 683/1411] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:24.210375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f7addc19-e70f-4851-997e-b0bb41459394 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:24.223305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f7addc19-e70f-4851-997e-b0bb41459394 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:24.235514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7addc19-e70f-4851-997e-b0bb41459394 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:24.236609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7addc19-e70f-4851-997e-b0bb41459394 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:24.237896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7addc19-e70f-4851-997e-b0bb41459394 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:24.239243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7addc19-e70f-4851-997e-b0bb41459394 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:24.240142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7addc19-e70f-4851-997e-b0bb41459394 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:24.240819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7addc19-e70f-4851-997e-b0bb41459394 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:24.259835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:24.384289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-73804337-5a0e-42ca-8eb2-fed326df9515 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:24.402763 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-73804337-5a0e-42ca-8eb2-fed326df9515 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1351 microversion: 2.1 time: 0.456161 Oct 05 17:36:24.413152 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 729/1412] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:23 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1351 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:24.429665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e74a4b3-a353-41fe-aaa4-e1329fba208b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:24.430335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e74a4b3-a353-41fe-aaa4-e1329fba208b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:24.437718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b3-a353-41fe-aaa4-e1329fba208b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:24.438214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b3-a353-41fe-aaa4-e1329fba208b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:24.438711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b3-a353-41fe-aaa4-e1329fba208b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:24.439647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b3-a353-41fe-aaa4-e1329fba208b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:24.440201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b3-a353-41fe-aaa4-e1329fba208b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:24.440799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e74a4b3-a353-41fe-aaa4-e1329fba208b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:24.925871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e74a4b3-a353-41fe-aaa4-e1329fba208b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:24.951655 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e74a4b3-a353-41fe-aaa4-e1329fba208b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 0.526124 Oct 05 17:36:24.952678 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 730/1413] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:24 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:24.972745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8a42be58-d0c6-4515-b6b6-496f1c5bced7 req-0aa646e9-c39a-4958-97c2-d61a1907ebc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4b15d9-16c8-4d05-b9ca-5e55543861e8", "tag": "986e6906-42b8-4dea-9619-4e506d550703"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:24.982686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8a42be58-d0c6-4515-b6b6-496f1c5bced7 req-0aa646e9-c39a-4958-97c2-d61a1907ebc0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:24.983482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8a42be58-d0c6-4515-b6b6-496f1c5bced7 req-0aa646e9-c39a-4958-97c2-d61a1907ebc0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:24.984086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8a42be58-d0c6-4515-b6b6-496f1c5bced7 req-0aa646e9-c39a-4958-97c2-d61a1907ebc0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:24.996033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:24.998674 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8a42be58-d0c6-4515-b6b6-496f1c5bced7 req-0aa646e9-c39a-4958-97c2-d61a1907ebc0 service nova] Creating event network-changed:986e6906-42b8-4dea-9619-4e506d550703 for instance 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 on n-h2-835595-3 Oct 05 17:36:25.009178 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8a42be58-d0c6-4515-b6b6-496f1c5bced7 req-0aa646e9-c39a-4958-97c2-d61a1907ebc0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040090 Oct 05 17:36:25.009993 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 731/1414] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:25.028821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ff6dea7-fcdb-4e49-84da-be7abc82929d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:25.031852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3ff6dea7-fcdb-4e49-84da-be7abc82929d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:25.042176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff6dea7-fcdb-4e49-84da-be7abc82929d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:25.043999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff6dea7-fcdb-4e49-84da-be7abc82929d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:25.044748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff6dea7-fcdb-4e49-84da-be7abc82929d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:25.046249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff6dea7-fcdb-4e49-84da-be7abc82929d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:25.047035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff6dea7-fcdb-4e49-84da-be7abc82929d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:25.047642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff6dea7-fcdb-4e49-84da-be7abc82929d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:25.112583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f7addc19-e70f-4851-997e-b0bb41459394 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:25.123000 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f7addc19-e70f-4851-997e-b0bb41459394 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1314 microversion: 2.1 time: 0.917415 Oct 05 17:36:25.125424 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 684/1415] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:24 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:25.159208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fe0aa1d3-074e-4a9b-a0b3-8652ed3ac01d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:25.161101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fe0aa1d3-074e-4a9b-a0b3-8652ed3ac01d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:25.180676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe0aa1d3-074e-4a9b-a0b3-8652ed3ac01d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:25.181426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe0aa1d3-074e-4a9b-a0b3-8652ed3ac01d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:25.182021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe0aa1d3-074e-4a9b-a0b3-8652ed3ac01d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:25.183939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe0aa1d3-074e-4a9b-a0b3-8652ed3ac01d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:25.185035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe0aa1d3-074e-4a9b-a0b3-8652ed3ac01d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:25.185683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe0aa1d3-074e-4a9b-a0b3-8652ed3ac01d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:25.492059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3ff6dea7-fcdb-4e49-84da-be7abc82929d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:25.500417 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ff6dea7-fcdb-4e49-84da-be7abc82929d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1474 microversion: 2.1 time: 0.489387 Oct 05 17:36:25.501227 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 732/1416] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:25 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1474 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:25.518092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4dae144e-53f3-4282-add1-c8a4bc7a09b5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:25.518092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4dae144e-53f3-4282-add1-c8a4bc7a09b5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:25.518092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dae144e-53f3-4282-add1-c8a4bc7a09b5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:25.518092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dae144e-53f3-4282-add1-c8a4bc7a09b5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:25.518606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dae144e-53f3-4282-add1-c8a4bc7a09b5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:25.518606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dae144e-53f3-4282-add1-c8a4bc7a09b5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:25.518606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dae144e-53f3-4282-add1-c8a4bc7a09b5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:25.518606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dae144e-53f3-4282-add1-c8a4bc7a09b5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:25.744094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe0aa1d3-074e-4a9b-a0b3-8652ed3ac01d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:25.752771 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fe0aa1d3-074e-4a9b-a0b3-8652ed3ac01d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.599519 Oct 05 17:36:25.762653 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 685/1417] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:25 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:25.854647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4dae144e-53f3-4282-add1-c8a4bc7a09b5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:25.873087 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4dae144e-53f3-4282-add1-c8a4bc7a09b5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1351 microversion: 2.1 time: 0.370744 Oct 05 17:36:25.884305 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 733/1418] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:25 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1351 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:25.977858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-810b1cca-fa3f-4fb9-ac2a-1a427f6d6c58 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:25.978734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-810b1cca-fa3f-4fb9-ac2a-1a427f6d6c58 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:25.988588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=9 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:25.992869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b1cca-fa3f-4fb9-ac2a-1a427f6d6c58 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:25.993427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b1cca-fa3f-4fb9-ac2a-1a427f6d6c58 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:25.993797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b1cca-fa3f-4fb9-ac2a-1a427f6d6c58 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:25.994867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b1cca-fa3f-4fb9-ac2a-1a427f6d6c58 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:25.995319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b1cca-fa3f-4fb9-ac2a-1a427f6d6c58 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:25.995907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b1cca-fa3f-4fb9-ac2a-1a427f6d6c58 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:26.154740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-693e5d76-ec30-4a4e-b333-ca45a26d329d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:26.155530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-693e5d76-ec30-4a4e-b333-ca45a26d329d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:26.162034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-693e5d76-ec30-4a4e-b333-ca45a26d329d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:26.162542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-693e5d76-ec30-4a4e-b333-ca45a26d329d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:26.163212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-693e5d76-ec30-4a4e-b333-ca45a26d329d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:26.163985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-693e5d76-ec30-4a4e-b333-ca45a26d329d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:26.165020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-693e5d76-ec30-4a4e-b333-ca45a26d329d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:26.165453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-693e5d76-ec30-4a4e-b333-ca45a26d329d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:26.229095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=14 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:26.257737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-810b1cca-fa3f-4fb9-ac2a-1a427f6d6c58 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:26.267672 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-810b1cca-fa3f-4fb9-ac2a-1a427f6d6c58 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 0.296230 Oct 05 17:36:26.268823 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 686/1419] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:25 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:26.324096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-693e5d76-ec30-4a4e-b333-ca45a26d329d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:26.333487 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-693e5d76-ec30-4a4e-b333-ca45a26d329d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1314 microversion: 2.1 time: 0.185770 Oct 05 17:36:26.333487 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 734/1420] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:26 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:26.523610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-67536d8c-2448-4cbe-9d14-7a9a3a855267 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:26.524231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-67536d8c-2448-4cbe-9d14-7a9a3a855267 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:26.531650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67536d8c-2448-4cbe-9d14-7a9a3a855267 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:26.532127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67536d8c-2448-4cbe-9d14-7a9a3a855267 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:26.532772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67536d8c-2448-4cbe-9d14-7a9a3a855267 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:26.533485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67536d8c-2448-4cbe-9d14-7a9a3a855267 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:26.533925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67536d8c-2448-4cbe-9d14-7a9a3a855267 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:26.534575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67536d8c-2448-4cbe-9d14-7a9a3a855267 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:26.783256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fbb5bea2-08be-4d0b-8d47-18bd28d78125 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:26.785177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fbb5bea2-08be-4d0b-8d47-18bd28d78125 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:26.788324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=14 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:26.794505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb5bea2-08be-4d0b-8d47-18bd28d78125 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:26.795438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb5bea2-08be-4d0b-8d47-18bd28d78125 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:26.796183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb5bea2-08be-4d0b-8d47-18bd28d78125 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:26.796995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb5bea2-08be-4d0b-8d47-18bd28d78125 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:26.797530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb5bea2-08be-4d0b-8d47-18bd28d78125 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:26.798179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbb5bea2-08be-4d0b-8d47-18bd28d78125 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:26.959744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fbb5bea2-08be-4d0b-8d47-18bd28d78125 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:26.978948 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fbb5bea2-08be-4d0b-8d47-18bd28d78125 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.199976 Oct 05 17:36:26.991681 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 735/1421] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:26 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:26.996701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fee2ef72-195c-4e49-9571-7e6a412dddf7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:27.004144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fee2ef72-195c-4e49-9571-7e6a412dddf7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:27.012924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fee2ef72-195c-4e49-9571-7e6a412dddf7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:27.013809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fee2ef72-195c-4e49-9571-7e6a412dddf7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:27.014528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fee2ef72-195c-4e49-9571-7e6a412dddf7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:27.015655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fee2ef72-195c-4e49-9571-7e6a412dddf7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:27.016345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fee2ef72-195c-4e49-9571-7e6a412dddf7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:27.017355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fee2ef72-195c-4e49-9571-7e6a412dddf7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:27.073991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-67536d8c-2448-4cbe-9d14-7a9a3a855267 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:27.083530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-67536d8c-2448-4cbe-9d14-7a9a3a855267 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1474 microversion: 2.1 time: 0.563928 Oct 05 17:36:27.084583 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 687/1422] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:26 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1474 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:27.090359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d1a09714-25ae-48aa-afed-949092b645b4 req-41da3ad5-638b-46c7-ab66-2d3dce7be471 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a5d378-bcc8-48b4-a494-65ca945e6410", "tag": "2b178db8-2785-4391-803e-088175679149"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:27.101854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d1a09714-25ae-48aa-afed-949092b645b4 req-41da3ad5-638b-46c7-ab66-2d3dce7be471 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:27.102670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d1a09714-25ae-48aa-afed-949092b645b4 req-41da3ad5-638b-46c7-ab66-2d3dce7be471 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:27.103264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d1a09714-25ae-48aa-afed-949092b645b4 req-41da3ad5-638b-46c7-ab66-2d3dce7be471 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:27.118409 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d1a09714-25ae-48aa-afed-949092b645b4 req-41da3ad5-638b-46c7-ab66-2d3dce7be471 service nova] Creating event network-changed:2b178db8-2785-4391-803e-088175679149 for instance 95a5d378-bcc8-48b4-a494-65ca945e6410 on n-h2-835595-3 Oct 05 17:36:27.123832 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d1a09714-25ae-48aa-afed-949092b645b4 req-41da3ad5-638b-46c7-ab66-2d3dce7be471 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037650 Oct 05 17:36:27.125097 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 688/1423] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:27.294814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23f7559f-2ffc-4c70-a347-d14b4fb54365 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:27.296457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23f7559f-2ffc-4c70-a347-d14b4fb54365 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:27.305104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f7559f-2ffc-4c70-a347-d14b4fb54365 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:27.306025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f7559f-2ffc-4c70-a347-d14b4fb54365 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:27.306680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f7559f-2ffc-4c70-a347-d14b4fb54365 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:27.307652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f7559f-2ffc-4c70-a347-d14b4fb54365 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:27.308326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f7559f-2ffc-4c70-a347-d14b4fb54365 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:27.308903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f7559f-2ffc-4c70-a347-d14b4fb54365 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:27.400039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fee2ef72-195c-4e49-9571-7e6a412dddf7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:27.408203 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fee2ef72-195c-4e49-9571-7e6a412dddf7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1351 microversion: 2.1 time: 0.415287 Oct 05 17:36:27.408792 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 736/1424] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:26 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1351 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:27.426952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-51b6bca7-bb50-41ef-8295-842fafd838f6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:27.427654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-51b6bca7-bb50-41ef-8295-842fafd838f6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:27.433826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51b6bca7-bb50-41ef-8295-842fafd838f6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:27.434736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51b6bca7-bb50-41ef-8295-842fafd838f6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:27.435237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51b6bca7-bb50-41ef-8295-842fafd838f6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:27.436129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51b6bca7-bb50-41ef-8295-842fafd838f6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:27.436589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51b6bca7-bb50-41ef-8295-842fafd838f6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:27.437021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51b6bca7-bb50-41ef-8295-842fafd838f6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:27.518586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23f7559f-2ffc-4c70-a347-d14b4fb54365 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:27.531568 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23f7559f-2ffc-4c70-a347-d14b4fb54365 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 0.242380 Oct 05 17:36:27.546813 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 689/1425] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:27 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:27.729480 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-062b7540-a7f3-439d-b5af-eb4525c9e27b tempest-TenantUsagesNegativeTestJSON-968895756 tempest-TenantUsagesNegativeTestJSON-968895756-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-04T17%3A36%3A27.398508&end=2022-10-06T17%3A36%3A27.398508" status: 404 len: 112 microversion: - time: 0.180768 Oct 05 17:36:27.736499 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 690/1426] 10.222.0.70 () {58 vars in 1316 bytes} [Wed Oct 5 17:36:27 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-04T17%3A36%3A27.398508&end=2022-10-06T17%3A36%3A27.398508 => generated 112 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 17:36:27.746822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca3c2572-e66d-463e-8a45-9ee5a5048b79 tempest-TenantUsagesNegativeTestJSON-968895756 tempest-TenantUsagesNegativeTestJSON-968895756-project-admin] Calling method '.version_select at 0x7f77756daee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:27.759730 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-ca3c2572-e66d-463e-8a45-9ee5a5048b79 tempest-TenantUsagesNegativeTestJSON-968895756 tempest-TenantUsagesNegativeTestJSON-968895756-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca3c2572-e66d-463e-8a45-9ee5a5048b79 tempest-TenantUsagesNegativeTestJSON-968895756 tempest-TenantUsagesNegativeTestJSON-968895756-project-admin] Request method failure captured: Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-simple-tenant-usage/1c25611322c549f3924a3becfcd160e1?start=2022-10-06T17%3A36%3A27.398508&end=2022-10-04T17%3A36%3A27.398508 HTTP/1.1 Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcCb4D672Dt7T-fWMxNhWhnVrr5CkXD0DlGb_RKInYgwDtlutVEKR483W0DomJ1UDVqdny12xR6aiNWenPlbpghwFE171B5FaBww_gUDFljADxPMSjewCQX3wufxSe9rKFFgPIPu_-M0wKFZKlyXuJctIqkLpqu1UFwk2tkKHIg_a5E Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 790175b7b85748809b45de50b17d3058 Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-968895756 Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 17:36:27.762016 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/790175b7b85748809b45de50b17d3058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/790175b7b85748809b45de50b17d3058"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_790175b7b85748809b45de50b17d3058", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/790175b7b85748809b45de50b17d3058"}]}] Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-968895756 Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 790175b7b85748809b45de50b17d3058 Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-968895756 Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TenantUsagesNegativeTestJSON-968895756-project-admin Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 15b8fbba69034bb59cc0f817d9eec3d7 Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-968895756-project-admin Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid start time. The start time cannot occur after the end time. Oct 05 17:36:27.763509 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '1c25611322c549f3924a3becfcd160e1'} Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 05 17:36:27.764395 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 05 17:36:27.765841 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:27.765841 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:27.765841 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:27.765841 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:27.765841 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:27.765841 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:27.765841 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:36:27.765841 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:36:27.765841 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 05 17:36:27.765841 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:27.768481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca3c2572-e66d-463e-8a45-9ee5a5048b79 tempest-TenantUsagesNegativeTestJSON-968895756 tempest-TenantUsagesNegativeTestJSON-968895756-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:36:27.769693 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ca3c2572-e66d-463e-8a45-9ee5a5048b79 tempest-TenantUsagesNegativeTestJSON-968895756 tempest-TenantUsagesNegativeTestJSON-968895756-project-admin] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage/1c25611322c549f3924a3becfcd160e1?start=2022-10-06T17%3A36%3A27.398508&end=2022-10-04T17%3A36%3A27.398508" status: 400 len: 111 microversion: 2.1 time: 0.031957 Oct 05 17:36:27.770456 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 691/1427] 10.222.0.70 () {58 vars in 1412 bytes} [Wed Oct 5 17:36:27 2022] GET /compute/v2.1/os-simple-tenant-usage/1c25611322c549f3924a3becfcd160e1?start=2022-10-06T17%3A36%3A27.398508&end=2022-10-04T17%3A36%3A27.398508 => generated 111 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:36:27.780261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-51b6bca7-bb50-41ef-8295-842fafd838f6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:27.792058 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-51b6bca7-bb50-41ef-8295-842fafd838f6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1314 microversion: 2.1 time: 0.381489 Oct 05 17:36:27.794858 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 737/1428] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:27 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:27.953588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7651b5d5-f709-4acf-a46a-dcbb715f875b tempest-TenantUsagesNegativeTestJSON-2101328304 tempest-TenantUsagesNegativeTestJSON-2101328304-project] Calling method '.version_select at 0x7f77753e7d30>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:27.957317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7651b5d5-f709-4acf-a46a-dcbb715f875b tempest-TenantUsagesNegativeTestJSON-2101328304 tempest-TenantUsagesNegativeTestJSON-2101328304-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'abd21a0f173a4a8a90c8f68da637930c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c25611322c549f3924a3becfcd160e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7651b5d5-f709-4acf-a46a-dcbb715f875b tempest-TenantUsagesNegativeTestJSON-2101328304 tempest-TenantUsagesNegativeTestJSON-2101328304-project] Request method failure captured: Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-04T17%3A36%3A27.398508&end=2022-10-06T17%3A36%3A27.398508&detailed=1 HTTP/1.1 Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcCafqMqx-DlyKdcWZ0y7pdeWPU9vH0NET26ndu0U-6lmswMr-AeJdFoS9LYUN0KW_1DBpB4khUd4fosyfYpOMt1wR5X_2k-2AEcNCbPS7IVssTE8ZqP3xtFjJHqXgoHDywbxA0nfpO4eLj9XBeBvD7D0e41JOfjA9jKu-LGRhIf9iU Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 1c25611322c549f3924a3becfcd160e1 Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-2101328304 Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:36:27.961654 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1c25611322c549f3924a3becfcd160e1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1c25611322c549f3924a3becfcd160e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1c25611322c549f3924a3becfcd160e1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1c25611322c549f3924a3becfcd160e1"}]}] Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-2101328304 Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 1c25611322c549f3924a3becfcd160e1 Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-2101328304 Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TenantUsagesNegativeTestJSON-2101328304-project Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: abd21a0f173a4a8a90c8f68da637930c Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-2101328304-project Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: action_args: {} Oct 05 17:36:27.963444 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:36:27.964344 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:36:27.965781 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:36:27.967243 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 05 17:36:27.967243 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:27.967243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7651b5d5-f709-4acf-a46a-dcbb715f875b tempest-TenantUsagesNegativeTestJSON-2101328304 tempest-TenantUsagesNegativeTestJSON-2101328304-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:36:27.967659 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7651b5d5-f709-4acf-a46a-dcbb715f875b tempest-TenantUsagesNegativeTestJSON-2101328304 tempest-TenantUsagesNegativeTestJSON-2101328304-project] 10.222.0.70 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-04T17%3A36%3A27.398508&end=2022-10-06T17%3A36%3A27.398508&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.182039 Oct 05 17:36:27.968586 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 692/1429] 10.222.0.70 () {58 vars in 1335 bytes} [Wed Oct 5 17:36:27 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-04T17%3A36%3A27.398508&end=2022-10-06T17%3A36%3A27.398508&detailed=1 => generated 123 bytes in 184 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:36:28.013856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a4c1417d-e2bd-41f1-9e56-683bef72e9f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:28.014300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a4c1417d-e2bd-41f1-9e56-683bef72e9f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:28.025087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4c1417d-e2bd-41f1-9e56-683bef72e9f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:28.025590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4c1417d-e2bd-41f1-9e56-683bef72e9f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:28.026026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4c1417d-e2bd-41f1-9e56-683bef72e9f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:28.026769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4c1417d-e2bd-41f1-9e56-683bef72e9f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:28.031599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4c1417d-e2bd-41f1-9e56-683bef72e9f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:28.032138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4c1417d-e2bd-41f1-9e56-683bef72e9f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:28.128239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b065dff-ea34-4593-a238-14fc3d7ce32b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:28.132132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b065dff-ea34-4593-a238-14fc3d7ce32b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:28.146122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b065dff-ea34-4593-a238-14fc3d7ce32b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:28.147384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b065dff-ea34-4593-a238-14fc3d7ce32b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:28.148483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b065dff-ea34-4593-a238-14fc3d7ce32b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:28.149594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b065dff-ea34-4593-a238-14fc3d7ce32b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:28.150231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b065dff-ea34-4593-a238-14fc3d7ce32b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:28.150842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b065dff-ea34-4593-a238-14fc3d7ce32b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:28.608565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8b065dff-ea34-4593-a238-14fc3d7ce32b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:28.619813 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b065dff-ea34-4593-a238-14fc3d7ce32b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1472 microversion: 2.1 time: 0.514912 Oct 05 17:36:28.620448 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 693/1430] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:28 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1472 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:28.635409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a03dc482-dc85-4a55-8601-94a65240ae91 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:28.636232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a03dc482-dc85-4a55-8601-94a65240ae91 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:28.654273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a03dc482-dc85-4a55-8601-94a65240ae91 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:28.655103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a03dc482-dc85-4a55-8601-94a65240ae91 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:28.655612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a03dc482-dc85-4a55-8601-94a65240ae91 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:28.656311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a03dc482-dc85-4a55-8601-94a65240ae91 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:28.659431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a03dc482-dc85-4a55-8601-94a65240ae91 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:28.660280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a03dc482-dc85-4a55-8601-94a65240ae91 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:28.781803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a4c1417d-e2bd-41f1-9e56-683bef72e9f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:28.803785 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a4c1417d-e2bd-41f1-9e56-683bef72e9f5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.797913 Oct 05 17:36:28.805550 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 738/1431] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:28 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:28.830854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2499f68b-883f-4cde-b936-b0e8dc2d0990 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:28.836388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2499f68b-883f-4cde-b936-b0e8dc2d0990 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:28.848781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2499f68b-883f-4cde-b936-b0e8dc2d0990 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:28.856643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2499f68b-883f-4cde-b936-b0e8dc2d0990 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:28.857112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2499f68b-883f-4cde-b936-b0e8dc2d0990 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:28.860510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2499f68b-883f-4cde-b936-b0e8dc2d0990 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:28.860984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2499f68b-883f-4cde-b936-b0e8dc2d0990 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:28.861827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2499f68b-883f-4cde-b936-b0e8dc2d0990 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:29.075554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a03dc482-dc85-4a55-8601-94a65240ae91 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:29.102642 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a03dc482-dc85-4a55-8601-94a65240ae91 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1351 microversion: 2.1 time: 0.476099 Oct 05 17:36:29.103632 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 694/1432] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:28 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1351 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:29.109108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fdbb7499-a8c9-4ed6-97f6-d701eda9ac5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:29.110441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fdbb7499-a8c9-4ed6-97f6-d701eda9ac5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:29.125665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdbb7499-a8c9-4ed6-97f6-d701eda9ac5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:29.126230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdbb7499-a8c9-4ed6-97f6-d701eda9ac5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:29.127266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdbb7499-a8c9-4ed6-97f6-d701eda9ac5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:29.128178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdbb7499-a8c9-4ed6-97f6-d701eda9ac5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:29.128650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdbb7499-a8c9-4ed6-97f6-d701eda9ac5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:29.129978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdbb7499-a8c9-4ed6-97f6-d701eda9ac5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:29.211124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2499f68b-883f-4cde-b936-b0e8dc2d0990 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:29.220526 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2499f68b-883f-4cde-b936-b0e8dc2d0990 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 0.413257 Oct 05 17:36:29.221123 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 739/1433] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:28 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:29.234112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-52162bbe-df73-4780-8eff-7fff90f32662 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:29.237020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-52162bbe-df73-4780-8eff-7fff90f32662 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:29.254530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52162bbe-df73-4780-8eff-7fff90f32662 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:29.255428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52162bbe-df73-4780-8eff-7fff90f32662 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:29.255880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52162bbe-df73-4780-8eff-7fff90f32662 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:29.256800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52162bbe-df73-4780-8eff-7fff90f32662 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:29.257425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52162bbe-df73-4780-8eff-7fff90f32662 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:29.257868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52162bbe-df73-4780-8eff-7fff90f32662 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:29.494480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fdbb7499-a8c9-4ed6-97f6-d701eda9ac5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:29.503970 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fdbb7499-a8c9-4ed6-97f6-d701eda9ac5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1314 microversion: 2.1 time: 0.399024 Oct 05 17:36:29.505571 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 695/1434] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:29 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:29.590188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-52162bbe-df73-4780-8eff-7fff90f32662 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid a63958af-abf6-42db-be31-d666ae842191 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:36:29.606820 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-52162bbe-df73-4780-8eff-7fff90f32662 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 2421 microversion: 2.25 time: 0.380471 Oct 05 17:36:29.619597 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 740/1435] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:29 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 2421 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:29.636165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-835595-3", "block_migration": "auto"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:29.639253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:29.650704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6a98553a-2498-46fa-8fec-04d5d7265e06 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:29.652691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:29.655067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:29.655296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6a98553a-2498-46fa-8fec-04d5d7265e06 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:29.658111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:29.659150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:29.659824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:29.660469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:29.679490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98553a-2498-46fa-8fec-04d5d7265e06 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:29.680001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98553a-2498-46fa-8fec-04d5d7265e06 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:29.680452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98553a-2498-46fa-8fec-04d5d7265e06 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:29.681549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98553a-2498-46fa-8fec-04d5d7265e06 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:29.682014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98553a-2498-46fa-8fec-04d5d7265e06 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:29.682483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98553a-2498-46fa-8fec-04d5d7265e06 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:29.739314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'flavor' on Instance uuid a63958af-abf6-42db-be31-d666ae842191 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:36:29.773804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: a63958af-abf6-42db-be31-d666ae842191] Going to try to live migrate instance to n-h2-835595-3 {{(pid=128843) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 17:36:30.114803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6a98553a-2498-46fa-8fec-04d5d7265e06 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:30.135061 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6a98553a-2498-46fa-8fec-04d5d7265e06 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1472 microversion: 2.1 time: 0.488143 Oct 05 17:36:30.136336 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 741/1436] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:29 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1472 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:30.155832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9fc791d-9830-4823-bca9-4567b9d88741 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:30.158860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b9fc791d-9830-4823-bca9-4567b9d88741 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:30.169757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9fc791d-9830-4823-bca9-4567b9d88741 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:30.174336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9fc791d-9830-4823-bca9-4567b9d88741 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:30.175052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9fc791d-9830-4823-bca9-4567b9d88741 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:30.175956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9fc791d-9830-4823-bca9-4567b9d88741 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:30.176895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9fc791d-9830-4823-bca9-4567b9d88741 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:30.177488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9fc791d-9830-4823-bca9-4567b9d88741 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:30.472164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b9fc791d-9830-4823-bca9-4567b9d88741 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:30.500005 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b9fc791d-9830-4823-bca9-4567b9d88741 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.361931 Oct 05 17:36:30.500618 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 742/1437] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:30 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:30.514826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ef7a91b2-863c-46f0-8b03-b0933e0616d5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:30.515773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ef7a91b2-863c-46f0-8b03-b0933e0616d5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:30.528696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7a91b2-863c-46f0-8b03-b0933e0616d5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:30.529478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7a91b2-863c-46f0-8b03-b0933e0616d5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:30.530349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7a91b2-863c-46f0-8b03-b0933e0616d5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:30.534068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7a91b2-863c-46f0-8b03-b0933e0616d5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:30.535815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7a91b2-863c-46f0-8b03-b0933e0616d5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:30.537091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7a91b2-863c-46f0-8b03-b0933e0616d5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:31.153847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ef7a91b2-863c-46f0-8b03-b0933e0616d5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:31.172560 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ef7a91b2-863c-46f0-8b03-b0933e0616d5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1351 microversion: 2.1 time: 0.669972 Oct 05 17:36:31.180303 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 743/1438] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:30 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1351 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:31.197157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b965f1bb-16d1-466b-9314-9fdecca277d5 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:31.197792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b965f1bb-16d1-466b-9314-9fdecca277d5 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:31.207999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:31.218747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b965f1bb-16d1-466b-9314-9fdecca277d5 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:31.219253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b965f1bb-16d1-466b-9314-9fdecca277d5 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:31.222089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b965f1bb-16d1-466b-9314-9fdecca277d5 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:31.223716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b965f1bb-16d1-466b-9314-9fdecca277d5 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:31.224206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b965f1bb-16d1-466b-9314-9fdecca277d5 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:31.224646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b965f1bb-16d1-466b-9314-9fdecca277d5 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:31.242791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:31.625988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b965f1bb-16d1-466b-9314-9fdecca277d5 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:31.636835 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b965f1bb-16d1-466b-9314-9fdecca277d5 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 0.449392 Oct 05 17:36:31.650304 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 744/1439] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:31 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:31.650304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-309a779f-b0fa-4513-838f-6485208a6af9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:31.650304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-309a779f-b0fa-4513-838f-6485208a6af9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:31.650304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-309a779f-b0fa-4513-838f-6485208a6af9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:31.650822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-309a779f-b0fa-4513-838f-6485208a6af9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:31.651326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-309a779f-b0fa-4513-838f-6485208a6af9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:31.652138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-309a779f-b0fa-4513-838f-6485208a6af9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:31.652724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-309a779f-b0fa-4513-838f-6485208a6af9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:31.653260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-309a779f-b0fa-4513-838f-6485208a6af9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:31.877594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-309a779f-b0fa-4513-838f-6485208a6af9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:31.896445 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-309a779f-b0fa-4513-838f-6485208a6af9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1314 microversion: 2.1 time: 0.257077 Oct 05 17:36:31.912018 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 745/1440] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:31 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:31.944245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9bc8208-0fed-421b-bffa-44b3ff6a217b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:31.944886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b9bc8208-0fed-421b-bffa-44b3ff6a217b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:31.964134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bc8208-0fed-421b-bffa-44b3ff6a217b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:31.964636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bc8208-0fed-421b-bffa-44b3ff6a217b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:31.965081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bc8208-0fed-421b-bffa-44b3ff6a217b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:31.971724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bc8208-0fed-421b-bffa-44b3ff6a217b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:31.972233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bc8208-0fed-421b-bffa-44b3ff6a217b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:31.973663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bc8208-0fed-421b-bffa-44b3ff6a217b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:32.491576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b9bc8208-0fed-421b-bffa-44b3ff6a217b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:32.506012 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b9bc8208-0fed-421b-bffa-44b3ff6a217b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1469 microversion: 2.1 time: 0.581524 Oct 05 17:36:32.507000 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 746/1441] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:31 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1469 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:32.511634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6476671c-0206-499d-a372-6b1126e7effc req-7d550dc6-0fbb-4a84-976f-e1d22b0b3523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4b15d9-16c8-4d05-b9ca-5e55543861e8", "name": "network-vif-plugged", "status": "completed", "tag": "986e6906-42b8-4dea-9619-4e506d550703"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:32.541086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6476671c-0206-499d-a372-6b1126e7effc req-7d550dc6-0fbb-4a84-976f-e1d22b0b3523 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:32.541573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6476671c-0206-499d-a372-6b1126e7effc req-7d550dc6-0fbb-4a84-976f-e1d22b0b3523 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:32.542195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6476671c-0206-499d-a372-6b1126e7effc req-7d550dc6-0fbb-4a84-976f-e1d22b0b3523 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:32.558141 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6476671c-0206-499d-a372-6b1126e7effc req-7d550dc6-0fbb-4a84-976f-e1d22b0b3523 service nova] Creating event network-vif-plugged:986e6906-42b8-4dea-9619-4e506d550703 for instance 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 on n-h2-835595-3 Oct 05 17:36:32.563970 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6476671c-0206-499d-a372-6b1126e7effc req-7d550dc6-0fbb-4a84-976f-e1d22b0b3523 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055665 Oct 05 17:36:32.564990 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 747/1442] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:32.570120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb82404b-ed41-4d52-b347-dbfb3ede1639 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:32.570997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eb82404b-ed41-4d52-b347-dbfb3ede1639 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:32.577668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb82404b-ed41-4d52-b347-dbfb3ede1639 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:32.578165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb82404b-ed41-4d52-b347-dbfb3ede1639 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:32.578641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb82404b-ed41-4d52-b347-dbfb3ede1639 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:32.579359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb82404b-ed41-4d52-b347-dbfb3ede1639 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:32.579816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb82404b-ed41-4d52-b347-dbfb3ede1639 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:32.580242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb82404b-ed41-4d52-b347-dbfb3ede1639 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:32.839081 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b865d787-145b-49a2-b884-46f895a36b95 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/action" status: 202 len: 0 microversion: 2.25 time: 3.206482 Oct 05 17:36:32.839881 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 696/1443] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:36:29 2022] POST /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/action => generated 0 bytes in 3209 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:36:32.849056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa8ee1a6-9ec6-46a1-82f9-2ef236ae00f8 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:32.851912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fa8ee1a6-9ec6-46a1-82f9-2ef236ae00f8 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:32.875160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa8ee1a6-9ec6-46a1-82f9-2ef236ae00f8 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:32.875687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa8ee1a6-9ec6-46a1-82f9-2ef236ae00f8 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:32.880858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa8ee1a6-9ec6-46a1-82f9-2ef236ae00f8 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:32.881944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa8ee1a6-9ec6-46a1-82f9-2ef236ae00f8 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:32.882544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa8ee1a6-9ec6-46a1-82f9-2ef236ae00f8 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:32.883766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa8ee1a6-9ec6-46a1-82f9-2ef236ae00f8 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:33.044134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eb82404b-ed41-4d52-b347-dbfb3ede1639 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:33.065046 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb82404b-ed41-4d52-b347-dbfb3ede1639 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.490794 Oct 05 17:36:33.091680 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 748/1444] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:32 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:33.099468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-096e0657-2e71-407c-8081-b2343a331885 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:33.100387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-096e0657-2e71-407c-8081-b2343a331885 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:33.121354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-096e0657-2e71-407c-8081-b2343a331885 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:33.122112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-096e0657-2e71-407c-8081-b2343a331885 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:33.122833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-096e0657-2e71-407c-8081-b2343a331885 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:33.123809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-096e0657-2e71-407c-8081-b2343a331885 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:33.124606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-096e0657-2e71-407c-8081-b2343a331885 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:33.125783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-096e0657-2e71-407c-8081-b2343a331885 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:33.301161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa8ee1a6-9ec6-46a1-82f9-2ef236ae00f8 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:33.321052 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa8ee1a6-9ec6-46a1-82f9-2ef236ae00f8 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1351 microversion: 2.1 time: 0.477097 Oct 05 17:36:33.324510 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 697/1445] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:32 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1351 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:33.340673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e041bc5d-3d7a-47b3-8c8a-3e0e04e3608e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:33.343108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e041bc5d-3d7a-47b3-8c8a-3e0e04e3608e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:33.362453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e041bc5d-3d7a-47b3-8c8a-3e0e04e3608e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:33.363344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e041bc5d-3d7a-47b3-8c8a-3e0e04e3608e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:33.364137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e041bc5d-3d7a-47b3-8c8a-3e0e04e3608e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:33.366583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e041bc5d-3d7a-47b3-8c8a-3e0e04e3608e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:33.367638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e041bc5d-3d7a-47b3-8c8a-3e0e04e3608e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:33.371205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e041bc5d-3d7a-47b3-8c8a-3e0e04e3608e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:33.403751 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-096e0657-2e71-407c-8081-b2343a331885 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "POST /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8/action" status: 202 len: 0 microversion: 2.1 time: 0.308918 Oct 05 17:36:33.406470 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 749/1446] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:36:33 2022] POST /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:36:33.431631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:33.442263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:33.453221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:33.454159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:33.455178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:33.456671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:33.457367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:33.458013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:33.840033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e041bc5d-3d7a-47b3-8c8a-3e0e04e3608e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:33.849640 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e041bc5d-3d7a-47b3-8c8a-3e0e04e3608e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 0.521491 Oct 05 17:36:33.850510 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 698/1447] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:33 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:33.855631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6477b34b-86f3-4203-8ee8-c4af2feaf29d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:33.856247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6477b34b-86f3-4203-8ee8-c4af2feaf29d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:33.862740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6477b34b-86f3-4203-8ee8-c4af2feaf29d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:33.863498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6477b34b-86f3-4203-8ee8-c4af2feaf29d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:33.864103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6477b34b-86f3-4203-8ee8-c4af2feaf29d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:33.864993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6477b34b-86f3-4203-8ee8-c4af2feaf29d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:33.865702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6477b34b-86f3-4203-8ee8-c4af2feaf29d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:33.866302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6477b34b-86f3-4203-8ee8-c4af2feaf29d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:33.871724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:33.884222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:33.885884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:33.887603 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9501885f-400f-47da-9b1f-1dd99c91b8ef tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.464410 Oct 05 17:36:33.889307 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 750/1448] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:33 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:33.895765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d03d8b8-8ff6-424d-b4bc-cac0940c1de0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:33.896799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2d03d8b8-8ff6-424d-b4bc-cac0940c1de0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:33.920655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d03d8b8-8ff6-424d-b4bc-cac0940c1de0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:33.929964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d03d8b8-8ff6-424d-b4bc-cac0940c1de0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:33.930708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d03d8b8-8ff6-424d-b4bc-cac0940c1de0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:33.931653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d03d8b8-8ff6-424d-b4bc-cac0940c1de0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:33.932477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d03d8b8-8ff6-424d-b4bc-cac0940c1de0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:33.933251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d03d8b8-8ff6-424d-b4bc-cac0940c1de0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:34.188862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2d03d8b8-8ff6-424d-b4bc-cac0940c1de0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:34.204776 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2d03d8b8-8ff6-424d-b4bc-cac0940c1de0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1468 microversion: 2.1 time: 0.312561 Oct 05 17:36:34.207726 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 751/1449] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:33 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:34.223701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a3733b7a-8a86-43fc-b49f-7138975bcff5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:34.225279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a3733b7a-8a86-43fc-b49f-7138975bcff5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:34.239198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3733b7a-8a86-43fc-b49f-7138975bcff5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:34.240395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3733b7a-8a86-43fc-b49f-7138975bcff5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:34.241074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3733b7a-8a86-43fc-b49f-7138975bcff5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:34.242093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3733b7a-8a86-43fc-b49f-7138975bcff5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:34.242871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3733b7a-8a86-43fc-b49f-7138975bcff5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:34.243660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3733b7a-8a86-43fc-b49f-7138975bcff5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:34.439008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6477b34b-86f3-4203-8ee8-c4af2feaf29d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:34.453525 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6477b34b-86f3-4203-8ee8-c4af2feaf29d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1314 microversion: 2.1 time: 0.601576 Oct 05 17:36:34.454108 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 699/1450] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:33 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1314 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:34.458948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80520c68-4e4e-4c3c-b5da-d89a9bdb6e09 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:34.467729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-80520c68-4e4e-4c3c-b5da-d89a9bdb6e09 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:34.480184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80520c68-4e4e-4c3c-b5da-d89a9bdb6e09 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:34.480688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80520c68-4e4e-4c3c-b5da-d89a9bdb6e09 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:34.481126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80520c68-4e4e-4c3c-b5da-d89a9bdb6e09 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:34.481900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80520c68-4e4e-4c3c-b5da-d89a9bdb6e09 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:34.482989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80520c68-4e4e-4c3c-b5da-d89a9bdb6e09 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:34.483564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80520c68-4e4e-4c3c-b5da-d89a9bdb6e09 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:34.504711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a3733b7a-8a86-43fc-b49f-7138975bcff5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:34.532673 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a3733b7a-8a86-43fc-b49f-7138975bcff5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.323225 Oct 05 17:36:34.542312 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 752/1451] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:34 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:34.625337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f095b63b-4dc1-4702-a01b-082e7710d0cd req-8f9bf0d7-704d-4569-9245-afd979acf6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012a21d9-0f94-4075-b433-d8d3120e1356", "name": "network-vif-plugged", "status": "completed", "tag": "209c3636-f5f8-4d30-848f-c1dabd3dd2a6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:34.635454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f095b63b-4dc1-4702-a01b-082e7710d0cd req-8f9bf0d7-704d-4569-9245-afd979acf6cd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:34.636411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f095b63b-4dc1-4702-a01b-082e7710d0cd req-8f9bf0d7-704d-4569-9245-afd979acf6cd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:34.637098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f095b63b-4dc1-4702-a01b-082e7710d0cd req-8f9bf0d7-704d-4569-9245-afd979acf6cd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:34.651043 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f095b63b-4dc1-4702-a01b-082e7710d0cd req-8f9bf0d7-704d-4569-9245-afd979acf6cd service nova] Creating event network-vif-plugged:209c3636-f5f8-4d30-848f-c1dabd3dd2a6 for instance 012a21d9-0f94-4075-b433-d8d3120e1356 on n-h1-835595-3 Oct 05 17:36:34.656913 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f095b63b-4dc1-4702-a01b-082e7710d0cd req-8f9bf0d7-704d-4569-9245-afd979acf6cd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035369 Oct 05 17:36:34.658174 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 753/1452] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:34.875571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1d441157-0a45-401a-8b3c-529b4a28a48a tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:34.875571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1d441157-0a45-401a-8b3c-529b4a28a48a tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:34.888894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d441157-0a45-401a-8b3c-529b4a28a48a tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:34.891809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d441157-0a45-401a-8b3c-529b4a28a48a tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:34.893088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d441157-0a45-401a-8b3c-529b4a28a48a tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:34.894522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d441157-0a45-401a-8b3c-529b4a28a48a tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:34.896163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d441157-0a45-401a-8b3c-529b4a28a48a tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:34.896806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d441157-0a45-401a-8b3c-529b4a28a48a tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:35.222346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d441157-0a45-401a-8b3c-529b4a28a48a tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:35.233173 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1d441157-0a45-401a-8b3c-529b4a28a48a tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 0.363622 Oct 05 17:36:35.238327 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 754/1453] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:34 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:35.258497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:35.259796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:35.268332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:35.269304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:35.271303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:35.272853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:35.273881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:35.274553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:35.365640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-80520c68-4e4e-4c3c-b5da-d89a9bdb6e09 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:35.399560 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-80520c68-4e4e-4c3c-b5da-d89a9bdb6e09 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1540 microversion: 2.1 time: 0.943918 Oct 05 17:36:35.401957 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 700/1454] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:34 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1540 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:35.411369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2def3e9-f4b4-480a-a17e-cfd4b21bd8d3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:35.418182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2def3e9-f4b4-480a-a17e-cfd4b21bd8d3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:35.434064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2def3e9-f4b4-480a-a17e-cfd4b21bd8d3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:35.438771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2def3e9-f4b4-480a-a17e-cfd4b21bd8d3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:35.440069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2def3e9-f4b4-480a-a17e-cfd4b21bd8d3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:35.441848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2def3e9-f4b4-480a-a17e-cfd4b21bd8d3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:35.445135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2def3e9-f4b4-480a-a17e-cfd4b21bd8d3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:35.446452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2def3e9-f4b4-480a-a17e-cfd4b21bd8d3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:35.603184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:35.614071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:35.619652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:35.623688 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b5edbc7a-d983-4f08-965d-128046c6d358 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.388450 Oct 05 17:36:35.629289 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 755/1455] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:35 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:35.634801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a25ed55d-228d-4c78-8595-785ff365f1a5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:35.637210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a25ed55d-228d-4c78-8595-785ff365f1a5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:35.655273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a25ed55d-228d-4c78-8595-785ff365f1a5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:35.657465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a25ed55d-228d-4c78-8595-785ff365f1a5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:35.657954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a25ed55d-228d-4c78-8595-785ff365f1a5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:35.659266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a25ed55d-228d-4c78-8595-785ff365f1a5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:35.659266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a25ed55d-228d-4c78-8595-785ff365f1a5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:35.659694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a25ed55d-228d-4c78-8595-785ff365f1a5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:36.060873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2def3e9-f4b4-480a-a17e-cfd4b21bd8d3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:36.072263 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c2def3e9-f4b4-480a-a17e-cfd4b21bd8d3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1468 microversion: 2.1 time: 0.669022 Oct 05 17:36:36.072865 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 701/1456] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:35 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1468 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:36.077616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-670e91ce-78d6-4535-9ace-9ef34c7fd706 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:36.081916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-670e91ce-78d6-4535-9ace-9ef34c7fd706 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:36.092868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-670e91ce-78d6-4535-9ace-9ef34c7fd706 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:36.093370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-670e91ce-78d6-4535-9ace-9ef34c7fd706 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:36.093815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-670e91ce-78d6-4535-9ace-9ef34c7fd706 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:36.099079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-670e91ce-78d6-4535-9ace-9ef34c7fd706 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:36.099805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-670e91ce-78d6-4535-9ace-9ef34c7fd706 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:36.100414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-670e91ce-78d6-4535-9ace-9ef34c7fd706 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:36.311282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-670e91ce-78d6-4535-9ace-9ef34c7fd706 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:36.321359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:36.324649 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-670e91ce-78d6-4535-9ace-9ef34c7fd706 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1314 microversion: 2.1 time: 0.250609 Oct 05 17:36:36.325775 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 702/1457] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:36 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:36.331039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e258640c-9771-4c97-86ea-f961ed2ff476 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:36.332095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e258640c-9771-4c97-86ea-f961ed2ff476 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:36.340507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e258640c-9771-4c97-86ea-f961ed2ff476 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:36.341654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e258640c-9771-4c97-86ea-f961ed2ff476 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:36.342292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e258640c-9771-4c97-86ea-f961ed2ff476 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:36.343282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e258640c-9771-4c97-86ea-f961ed2ff476 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:36.344096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e258640c-9771-4c97-86ea-f961ed2ff476 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:36.344674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e258640c-9771-4c97-86ea-f961ed2ff476 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:36.429245 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a25ed55d-228d-4c78-8595-785ff365f1a5 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.798717 Oct 05 17:36:36.432011 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 756/1458] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:36:35 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8/os-interface => generated 284 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:36.438230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d2fe960a-976b-4df1-9cdf-4a29c6ddc25b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:36.440451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d2fe960a-976b-4df1-9cdf-4a29c6ddc25b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:36.455476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2fe960a-976b-4df1-9cdf-4a29c6ddc25b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:36.455902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2fe960a-976b-4df1-9cdf-4a29c6ddc25b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:36.456324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2fe960a-976b-4df1-9cdf-4a29c6ddc25b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:36.457046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2fe960a-976b-4df1-9cdf-4a29c6ddc25b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:36.461714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2fe960a-976b-4df1-9cdf-4a29c6ddc25b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:36.462220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2fe960a-976b-4df1-9cdf-4a29c6ddc25b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:36.573406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e258640c-9771-4c97-86ea-f961ed2ff476 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:36.585660 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e258640c-9771-4c97-86ea-f961ed2ff476 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.258524 Oct 05 17:36:36.587277 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 703/1459] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:36 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:36.659970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:36.660700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:36.669229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:36.669876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:36.671346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:36.672189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:36.675787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:36.676683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:36.974578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:36.985193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:36.987088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:36.988502 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c9ba6b4-4d1b-4af6-9d47-d9af9050a3a3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.338136 Oct 05 17:36:36.997839 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 704/1460] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:36 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:37.027366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5cb1400e-dc35-4737-a74e-96f1d1b78db1 req-f49c5f7a-7dad-498c-af1c-eaa56998a77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a5d378-bcc8-48b4-a494-65ca945e6410", "name": "network-vif-plugged", "status": "completed", "tag": "2b178db8-2785-4391-803e-088175679149"}, {"server_uuid": "2deb41c1-aad2-44ec-890d-ee629b7026a8", "name": "network-vif-plugged", "status": "completed", "tag": "662f062f-3156-4f24-b7bb-57e88b7f1361"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:37.048800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5cb1400e-dc35-4737-a74e-96f1d1b78db1 req-f49c5f7a-7dad-498c-af1c-eaa56998a77f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:37.051329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5cb1400e-dc35-4737-a74e-96f1d1b78db1 req-f49c5f7a-7dad-498c-af1c-eaa56998a77f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:37.051972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5cb1400e-dc35-4737-a74e-96f1d1b78db1 req-f49c5f7a-7dad-498c-af1c-eaa56998a77f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:37.082869 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5cb1400e-dc35-4737-a74e-96f1d1b78db1 req-f49c5f7a-7dad-498c-af1c-eaa56998a77f service nova] Creating event network-vif-plugged:2b178db8-2785-4391-803e-088175679149 for instance 95a5d378-bcc8-48b4-a494-65ca945e6410 on n-h2-835595-3 Oct 05 17:36:37.083657 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5cb1400e-dc35-4737-a74e-96f1d1b78db1 req-f49c5f7a-7dad-498c-af1c-eaa56998a77f service nova] Creating event network-vif-plugged:662f062f-3156-4f24-b7bb-57e88b7f1361 for instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 on n-h1-835595-3 Oct 05 17:36:37.099983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-5cb1400e-dc35-4737-a74e-96f1d1b78db1 req-f49c5f7a-7dad-498c-af1c-eaa56998a77f service nova] Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:36:37.131147 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5cb1400e-dc35-4737-a74e-96f1d1b78db1 req-f49c5f7a-7dad-498c-af1c-eaa56998a77f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.113326 Oct 05 17:36:37.143270 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 705/1461] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:37.176107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b6c5bb3f-a193-4d21-b98d-d5ecfd9bc1e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:37.177485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b6c5bb3f-a193-4d21-b98d-d5ecfd9bc1e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:37.188600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c5bb3f-a193-4d21-b98d-d5ecfd9bc1e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:37.189400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c5bb3f-a193-4d21-b98d-d5ecfd9bc1e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:37.190106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c5bb3f-a193-4d21-b98d-d5ecfd9bc1e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:37.191259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c5bb3f-a193-4d21-b98d-d5ecfd9bc1e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:37.192068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c5bb3f-a193-4d21-b98d-d5ecfd9bc1e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:37.193333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6c5bb3f-a193-4d21-b98d-d5ecfd9bc1e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:37.594717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b6c5bb3f-a193-4d21-b98d-d5ecfd9bc1e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:37.609323 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b6c5bb3f-a193-4d21-b98d-d5ecfd9bc1e9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1468 microversion: 2.1 time: 0.463953 Oct 05 17:36:37.610928 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 706/1462] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:37 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1468 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:37.618406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65e445f0-21c3-495e-b9a3-a8bbc446ee81 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:37.619027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-65e445f0-21c3-495e-b9a3-a8bbc446ee81 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:37.636919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65e445f0-21c3-495e-b9a3-a8bbc446ee81 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:37.643769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65e445f0-21c3-495e-b9a3-a8bbc446ee81 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:37.644587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65e445f0-21c3-495e-b9a3-a8bbc446ee81 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:37.651285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65e445f0-21c3-495e-b9a3-a8bbc446ee81 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:37.652056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65e445f0-21c3-495e-b9a3-a8bbc446ee81 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:37.652750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65e445f0-21c3-495e-b9a3-a8bbc446ee81 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:37.833995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d2fe960a-976b-4df1-9cdf-4a29c6ddc25b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:37.870883 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d2fe960a-976b-4df1-9cdf-4a29c6ddc25b tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1318 microversion: 2.1 time: 1.439055 Oct 05 17:36:37.878103 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 757/1463] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:36 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1318 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:37.887120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d4fda4ee-0fd7-4321-9f34-7295492f062f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:37.889900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d4fda4ee-0fd7-4321-9f34-7295492f062f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:37.897517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4fda4ee-0fd7-4321-9f34-7295492f062f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:37.898186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4fda4ee-0fd7-4321-9f34-7295492f062f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:37.917129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4fda4ee-0fd7-4321-9f34-7295492f062f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:37.918115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4fda4ee-0fd7-4321-9f34-7295492f062f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:37.918823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4fda4ee-0fd7-4321-9f34-7295492f062f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:37.919365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4fda4ee-0fd7-4321-9f34-7295492f062f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:38.149582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65e445f0-21c3-495e-b9a3-a8bbc446ee81 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:38.166093 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-65e445f0-21c3-495e-b9a3-a8bbc446ee81 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1314 microversion: 2.1 time: 0.548499 Oct 05 17:36:38.166785 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 707/1464] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:37 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1314 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:38.179368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:38.179997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:38.207302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:38.207819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:38.208256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:38.208979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:38.209437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:38.209874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:38.694866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:38.711499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:38.714074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:38.716397 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7f1e23df-0c09-4cad-b0d0-f844581cacee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.548391 Oct 05 17:36:38.718544 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 708/1465] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:38 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:38.735387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-780e1657-22a1-4c59-8af1-41addc75b49d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:38.739460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-780e1657-22a1-4c59-8af1-41addc75b49d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:38.756408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780e1657-22a1-4c59-8af1-41addc75b49d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:38.757483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780e1657-22a1-4c59-8af1-41addc75b49d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:38.758602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780e1657-22a1-4c59-8af1-41addc75b49d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:38.759935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780e1657-22a1-4c59-8af1-41addc75b49d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:38.764249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780e1657-22a1-4c59-8af1-41addc75b49d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:38.765237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780e1657-22a1-4c59-8af1-41addc75b49d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:39.149617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d4fda4ee-0fd7-4321-9f34-7295492f062f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:39.163363 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d4fda4ee-0fd7-4321-9f34-7295492f062f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 1.283026 Oct 05 17:36:39.174313 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 758/1466] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:37 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:39.193645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f157246-9847-451c-8534-55dfc7c9b231 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:39.196589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2f157246-9847-451c-8534-55dfc7c9b231 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:39.214202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f157246-9847-451c-8534-55dfc7c9b231 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:39.217949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f157246-9847-451c-8534-55dfc7c9b231 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:39.220032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f157246-9847-451c-8534-55dfc7c9b231 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:39.221559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f157246-9847-451c-8534-55dfc7c9b231 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:39.222039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f157246-9847-451c-8534-55dfc7c9b231 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:39.225816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f157246-9847-451c-8534-55dfc7c9b231 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:39.417666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-780e1657-22a1-4c59-8af1-41addc75b49d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:39.432397 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-780e1657-22a1-4c59-8af1-41addc75b49d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1468 microversion: 2.1 time: 0.712111 Oct 05 17:36:39.434947 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 709/1467] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:38 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1468 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:39.457079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-490c4d25-e152-4a6e-9f1c-6995aa097d44 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:39.458269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-490c4d25-e152-4a6e-9f1c-6995aa097d44 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:39.474117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-490c4d25-e152-4a6e-9f1c-6995aa097d44 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:39.476821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-490c4d25-e152-4a6e-9f1c-6995aa097d44 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:39.477411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-490c4d25-e152-4a6e-9f1c-6995aa097d44 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:39.480160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-490c4d25-e152-4a6e-9f1c-6995aa097d44 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:39.482747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-490c4d25-e152-4a6e-9f1c-6995aa097d44 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:39.483230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-490c4d25-e152-4a6e-9f1c-6995aa097d44 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:40.266233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f157246-9847-451c-8534-55dfc7c9b231 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:40.281381 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f157246-9847-451c-8534-55dfc7c9b231 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1508 microversion: 2.1 time: 1.113787 Oct 05 17:36:40.282205 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 759/1468] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:39 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1508 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:40.310169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:40.311160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:40.322125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-490c4d25-e152-4a6e-9f1c-6995aa097d44 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:40.327469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:40.329933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:40.334151 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-490c4d25-e152-4a6e-9f1c-6995aa097d44 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1501 microversion: 2.1 time: 0.891790 Oct 05 17:36:40.334380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:40.335218 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 710/1469] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:39 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1501 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:40.335924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:40.336559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:40.337199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:40.343781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e3e5cbf-da94-4c10-a2db-bbf73392dad8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:40.348117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6e3e5cbf-da94-4c10-a2db-bbf73392dad8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:40.364004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e3e5cbf-da94-4c10-a2db-bbf73392dad8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:40.364671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e3e5cbf-da94-4c10-a2db-bbf73392dad8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:40.365215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e3e5cbf-da94-4c10-a2db-bbf73392dad8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:40.366041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e3e5cbf-da94-4c10-a2db-bbf73392dad8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:40.366723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e3e5cbf-da94-4c10-a2db-bbf73392dad8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:40.368557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e3e5cbf-da94-4c10-a2db-bbf73392dad8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:40.689189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6e3e5cbf-da94-4c10-a2db-bbf73392dad8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:40.700216 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6e3e5cbf-da94-4c10-a2db-bbf73392dad8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.362686 Oct 05 17:36:40.715805 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 711/1470] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:40 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:40.733113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-35ea5437-81fb-40f6-b589-bbb31702f822 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:40.742964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-35ea5437-81fb-40f6-b589-bbb31702f822 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:40.757018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:40.760683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ea5437-81fb-40f6-b589-bbb31702f822 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:40.763841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ea5437-81fb-40f6-b589-bbb31702f822 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:40.766341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ea5437-81fb-40f6-b589-bbb31702f822 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:40.767942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ea5437-81fb-40f6-b589-bbb31702f822 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:40.769403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ea5437-81fb-40f6-b589-bbb31702f822 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:40.770131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ea5437-81fb-40f6-b589-bbb31702f822 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:40.854650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-35ea5437-81fb-40f6-b589-bbb31702f822 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lazy-loading 'flavor' on Instance uuid 95a5d378-bcc8-48b4-a494-65ca945e6410 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:36:41.187113 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-35ea5437-81fb-40f6-b589-bbb31702f822 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "POST /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410/action" status: 200 len: 32 microversion: 2.1 time: 0.466778 Oct 05 17:36:41.192839 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 712/1471] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:36:40 2022] POST /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410/action => generated 32 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:36:41.234320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-01f8b441-892b-4a89-9581-3be7033e804b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:41.235940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-01f8b441-892b-4a89-9581-3be7033e804b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:41.262128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01f8b441-892b-4a89-9581-3be7033e804b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:41.263891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01f8b441-892b-4a89-9581-3be7033e804b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:41.265924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01f8b441-892b-4a89-9581-3be7033e804b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:41.267788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01f8b441-892b-4a89-9581-3be7033e804b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:41.269059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01f8b441-892b-4a89-9581-3be7033e804b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:41.270087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01f8b441-892b-4a89-9581-3be7033e804b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:41.324194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:41.327855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:41.341888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:41.347385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:41.348878 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2440e6e5-74a4-4be8-9d7a-2fa82a449648 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 1.065235 Oct 05 17:36:41.355236 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 760/1472] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:40 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:41.362232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-200c5946-ed8b-4edf-84a8-87b1b6eb6088 req-7713779b-6032-46be-a902-1b43c8c646e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2deb41c1-aad2-44ec-890d-ee629b7026a8", "name": "network-vif-unplugged", "status": "completed", "tag": "662f062f-3156-4f24-b7bb-57e88b7f1361"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:41.392310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-200c5946-ed8b-4edf-84a8-87b1b6eb6088 req-7713779b-6032-46be-a902-1b43c8c646e8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:41.393077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-200c5946-ed8b-4edf-84a8-87b1b6eb6088 req-7713779b-6032-46be-a902-1b43c8c646e8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:41.393757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-200c5946-ed8b-4edf-84a8-87b1b6eb6088 req-7713779b-6032-46be-a902-1b43c8c646e8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:41.430923 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-200c5946-ed8b-4edf-84a8-87b1b6eb6088 req-7713779b-6032-46be-a902-1b43c8c646e8 service nova] Creating event network-vif-unplugged:662f062f-3156-4f24-b7bb-57e88b7f1361 for instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 on n-h2-835595-3 Oct 05 17:36:41.444835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-200c5946-ed8b-4edf-84a8-87b1b6eb6088 req-7713779b-6032-46be-a902-1b43c8c646e8 service nova] Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:36:41.484895 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-200c5946-ed8b-4edf-84a8-87b1b6eb6088 req-7713779b-6032-46be-a902-1b43c8c646e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126715 Oct 05 17:36:41.486000 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 761/1473] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:41.500037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a6f8df2e-3d43-4531-b4ad-a1e5eb4b7e5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:41.501064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a6f8df2e-3d43-4531-b4ad-a1e5eb4b7e5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:41.516217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6f8df2e-3d43-4531-b4ad-a1e5eb4b7e5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:41.516887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6f8df2e-3d43-4531-b4ad-a1e5eb4b7e5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:41.517476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6f8df2e-3d43-4531-b4ad-a1e5eb4b7e5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:41.519137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6f8df2e-3d43-4531-b4ad-a1e5eb4b7e5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:41.523997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6f8df2e-3d43-4531-b4ad-a1e5eb4b7e5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:41.524629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6f8df2e-3d43-4531-b4ad-a1e5eb4b7e5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:41.925768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a6f8df2e-3d43-4531-b4ad-a1e5eb4b7e5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:41.934691 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a6f8df2e-3d43-4531-b4ad-a1e5eb4b7e5b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.445562 Oct 05 17:36:41.943568 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 762/1474] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:41 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:41.953662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-1401d09b-5b79-496d-9eb9-7ccd890d4774 req-e47d6c6f-7afc-40fd-b29a-46cbb92cf2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b4b15d9-16c8-4d05-b9ca-5e55543861e8", "tag": "986e6906-42b8-4dea-9619-4e506d550703"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:41.991308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1401d09b-5b79-496d-9eb9-7ccd890d4774 req-e47d6c6f-7afc-40fd-b29a-46cbb92cf2dc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:41.998517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1401d09b-5b79-496d-9eb9-7ccd890d4774 req-e47d6c6f-7afc-40fd-b29a-46cbb92cf2dc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:42.001680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1401d09b-5b79-496d-9eb9-7ccd890d4774 req-e47d6c6f-7afc-40fd-b29a-46cbb92cf2dc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:42.032034 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-1401d09b-5b79-496d-9eb9-7ccd890d4774 req-e47d6c6f-7afc-40fd-b29a-46cbb92cf2dc service nova] Creating event network-changed:986e6906-42b8-4dea-9619-4e506d550703 for instance 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 on n-h2-835595-3 Oct 05 17:36:42.044859 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-1401d09b-5b79-496d-9eb9-7ccd890d4774 req-e47d6c6f-7afc-40fd-b29a-46cbb92cf2dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097873 Oct 05 17:36:42.046218 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 763/1475] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:42.052117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-69cda409-3780-4404-a72a-59c6c4ac44db tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:42.057686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-69cda409-3780-4404-a72a-59c6c4ac44db tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:42.080714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69cda409-3780-4404-a72a-59c6c4ac44db tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:42.082172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69cda409-3780-4404-a72a-59c6c4ac44db tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:42.082910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69cda409-3780-4404-a72a-59c6c4ac44db tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:42.083898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69cda409-3780-4404-a72a-59c6c4ac44db tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:42.084588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69cda409-3780-4404-a72a-59c6c4ac44db tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:42.085265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69cda409-3780-4404-a72a-59c6c4ac44db tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:42.357285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-01f8b441-892b-4a89-9581-3be7033e804b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:42.376433 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-01f8b441-892b-4a89-9581-3be7033e804b tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1468 microversion: 2.1 time: 1.179116 Oct 05 17:36:42.382182 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 713/1476] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:41 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1468 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:42.397673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:42.399187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:42.418003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:42.420234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:42.424087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:42.424875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:42.425358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:42.425793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:42.949244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:42.965691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:42.970769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:42.974070 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ff0be280-40c4-473d-9183-d79345b577ff tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.584848 Oct 05 17:36:42.976233 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 714/1477] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:42 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:42.989464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7704dc72-5a0b-4e59-b8ab-62a94c61821b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:42.990446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7704dc72-5a0b-4e59-b8ab-62a94c61821b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:43.006949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7704dc72-5a0b-4e59-b8ab-62a94c61821b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:43.008014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7704dc72-5a0b-4e59-b8ab-62a94c61821b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:43.010117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7704dc72-5a0b-4e59-b8ab-62a94c61821b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:43.011010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7704dc72-5a0b-4e59-b8ab-62a94c61821b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:43.013759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7704dc72-5a0b-4e59-b8ab-62a94c61821b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:43.014362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7704dc72-5a0b-4e59-b8ab-62a94c61821b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:43.280346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-69cda409-3780-4404-a72a-59c6c4ac44db tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:43.289879 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-69cda409-3780-4404-a72a-59c6c4ac44db tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 1.242153 Oct 05 17:36:43.293860 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 764/1478] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:42 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:43.322852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "200d457e-39f4-4311-9a43-1f8e6e6115bb"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:43.331017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:43.351904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:43.352866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:43.353544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:43.355513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:43.358605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:43.359339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:43.466609 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] HTTP exception thrown: Volume 7d7148b8-fcb7-4d30-81e0-f9ab366caecf could not be found. Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Request method failure captured: Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356/os-volume_attachments/7d7148b8-fcb7-4d30-81e0-f9ab366caecf HTTP/1.1 Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 74 Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcAl9Qeny3pOot_n7ZicV74bbMXRU7GXofvVdeXVvtezE7QnIxnOLLOAXXowc0egwmLlgdhbxU-tyOMok4nYj9qiCJZ9g07cgNkNUs1UM-VoreW9OXpCXG1yRqCCX3gAmJWzUTSnrAl0fZrYN1AN18ts03ge0__oqFLUfD1b86H6F6E Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: a0749fd979ff452993b04da8093285cf Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesAdminNegativeTest-192962423 Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 17:36:43.468940 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a0749fd979ff452993b04da8093285cf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0749fd979ff452993b04da8093285cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a0749fd979ff452993b04da8093285cf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a0749fd979ff452993b04da8093285cf"}]}] Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesAdminNegativeTest-192962423 Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: a0749fd979ff452993b04da8093285cf Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-192962423 Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesAdminNegativeTest-192962423-project-admin Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 85f54e7861264875b8b9b159474bc48d Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesAdminNegativeTest-192962423-project-admin Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: {"volumeAttachment": {"volumeId": "200d457e-39f4-4311-9a43-1f8e6e6115bb"}} Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:36:43.470659 n-d-835595-3 devstack@n-api.service[128844]: exception: Volume 7d7148b8-fcb7-4d30-81e0-f9ab366caecf could not be found. Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': '012a21d9-0f94-4075-b433-d8d3120e1356', 'id': '7d7148b8-fcb7-4d30-81e0-f9ab366caecf', 'body': {'volumeAttachment': {'volumeId': '200d457e-39f4-4311-9a43-1f8e6e6115bb'}}} Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:36:43.471690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7d7148b8-fcb7-4d30-81e0-f9ab366caecf could not be found. (HTTP 404) (Request-ID: req-cb68ee4c-bed8-44a1-9b69-949d81c897c5) Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:36:43.473162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7d7148b8-fcb7-4d30-81e0-f9ab366caecf could not be found. Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:36:43.474725 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7d7148b8-fcb7-4d30-81e0-f9ab366caecf could not be found. Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7d7148b8-fcb7-4d30-81e0-f9ab366caecf could not be found. Oct 05 17:36:43.476396 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:43.478487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] Returning 404 to user: Volume 7d7148b8-fcb7-4d30-81e0-f9ab366caecf could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:36:43.478487 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-730ba3f2-781a-4d4d-8ce5-721503e18800 tempest-VolumesAdminNegativeTest-192962423 tempest-VolumesAdminNegativeTest-192962423-project-admin] 10.222.0.70 "PUT /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356/os-volume_attachments/7d7148b8-fcb7-4d30-81e0-f9ab366caecf" status: 404 len: 109 microversion: 2.1 time: 0.167591 Oct 05 17:36:43.478487 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 765/1479] 10.222.0.70 () {60 vars in 1433 bytes} [Wed Oct 5 17:36:43 2022] PUT /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356/os-volume_attachments/7d7148b8-fcb7-4d30-81e0-f9ab366caecf => generated 109 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:36:43.488999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fefdabd9-9c8c-4ab5-9403-960ecc6a4693 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:43.489611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fefdabd9-9c8c-4ab5-9403-960ecc6a4693 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:43.514987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fefdabd9-9c8c-4ab5-9403-960ecc6a4693 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:43.515489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fefdabd9-9c8c-4ab5-9403-960ecc6a4693 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:43.515924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fefdabd9-9c8c-4ab5-9403-960ecc6a4693 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:43.517109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fefdabd9-9c8c-4ab5-9403-960ecc6a4693 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:43.517109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fefdabd9-9c8c-4ab5-9403-960ecc6a4693 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:43.517494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fefdabd9-9c8c-4ab5-9403-960ecc6a4693 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:44.433218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fefdabd9-9c8c-4ab5-9403-960ecc6a4693 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:44.443717 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fefdabd9-9c8c-4ab5-9403-960ecc6a4693 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1468 microversion: 2.1 time: 0.964694 Oct 05 17:36:44.462483 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 766/1480] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:43 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1468 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:44.478317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-750dc859-9e70-46bb-8183-7bce82c7bfee req-541704dd-8c84-4814-996f-bb75f15c8d25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2deb41c1-aad2-44ec-890d-ee629b7026a8", "tag": "662f062f-3156-4f24-b7bb-57e88b7f1361"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:44.521843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-750dc859-9e70-46bb-8183-7bce82c7bfee req-541704dd-8c84-4814-996f-bb75f15c8d25 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:44.522363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-750dc859-9e70-46bb-8183-7bce82c7bfee req-541704dd-8c84-4814-996f-bb75f15c8d25 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:44.530633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-750dc859-9e70-46bb-8183-7bce82c7bfee req-541704dd-8c84-4814-996f-bb75f15c8d25 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:44.587046 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-750dc859-9e70-46bb-8183-7bce82c7bfee req-541704dd-8c84-4814-996f-bb75f15c8d25 service nova] Creating event network-changed:662f062f-3156-4f24-b7bb-57e88b7f1361 for instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 on n-h2-835595-3 Oct 05 17:36:44.611524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-750dc859-9e70-46bb-8183-7bce82c7bfee req-541704dd-8c84-4814-996f-bb75f15c8d25 service nova] Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:36:44.639959 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-750dc859-9e70-46bb-8183-7bce82c7bfee req-541704dd-8c84-4814-996f-bb75f15c8d25 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186269 Oct 05 17:36:44.643250 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 767/1481] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:44.658470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:44.661212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:44.678332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:44.680080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:44.680782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:44.682824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:44.683731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:44.685260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:44.872762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7704dc72-5a0b-4e59-b8ab-62a94c61821b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:44.887003 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7704dc72-5a0b-4e59-b8ab-62a94c61821b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 1.907629 Oct 05 17:36:44.889393 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 715/1482] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:42 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:44.907846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8afd7cb6-ff04-42fc-913f-898f52a7ecc5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:44.907846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8afd7cb6-ff04-42fc-913f-898f52a7ecc5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:44.934198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8afd7cb6-ff04-42fc-913f-898f52a7ecc5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:44.934744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8afd7cb6-ff04-42fc-913f-898f52a7ecc5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:44.937739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8afd7cb6-ff04-42fc-913f-898f52a7ecc5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:44.938677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8afd7cb6-ff04-42fc-913f-898f52a7ecc5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:44.940239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8afd7cb6-ff04-42fc-913f-898f52a7ecc5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:44.940857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8afd7cb6-ff04-42fc-913f-898f52a7ecc5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:45.422819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:45.435185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:45.437567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:45.439458 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-de8a7016-e19e-4795-bef9-58292af6db40 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.792430 Oct 05 17:36:45.440438 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 768/1483] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:44 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:45.462669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8afd7cb6-ff04-42fc-913f-898f52a7ecc5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:45.477440 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8afd7cb6-ff04-42fc-913f-898f52a7ecc5 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.584847 Oct 05 17:36:45.488405 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 716/1484] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:44 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:45.497638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a9b3e310-86b8-42f3-be99-edb83766633d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:45.498383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a9b3e310-86b8-42f3-be99-edb83766633d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:45.512762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9b3e310-86b8-42f3-be99-edb83766633d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:45.513259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9b3e310-86b8-42f3-be99-edb83766633d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:45.513705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9b3e310-86b8-42f3-be99-edb83766633d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:45.514505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9b3e310-86b8-42f3-be99-edb83766633d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:45.514974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9b3e310-86b8-42f3-be99-edb83766633d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:45.515405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9b3e310-86b8-42f3-be99-edb83766633d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:45.863734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a9b3e310-86b8-42f3-be99-edb83766633d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:45.891405 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a9b3e310-86b8-42f3-be99-edb83766633d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1468 microversion: 2.1 time: 0.418667 Oct 05 17:36:45.898081 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 769/1485] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:45 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1468 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:45.924984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1268c47b-6c0c-4a68-a88a-acaeb28fd148 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:45.925504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1268c47b-6c0c-4a68-a88a-acaeb28fd148 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:45.940357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1268c47b-6c0c-4a68-a88a-acaeb28fd148 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:45.940857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1268c47b-6c0c-4a68-a88a-acaeb28fd148 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:45.941296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1268c47b-6c0c-4a68-a88a-acaeb28fd148 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:45.942013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1268c47b-6c0c-4a68-a88a-acaeb28fd148 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:45.942503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1268c47b-6c0c-4a68-a88a-acaeb28fd148 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:45.942933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1268c47b-6c0c-4a68-a88a-acaeb28fd148 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:46.474820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:46.475656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:46.479486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1268c47b-6c0c-4a68-a88a-acaeb28fd148 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:46.482754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:46.488944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:46.489149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:46.489591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:46.490327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:46.490780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:46.491206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:46.499067 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1268c47b-6c0c-4a68-a88a-acaeb28fd148 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.577916 Oct 05 17:36:46.510795 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 717/1486] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:45 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:46.522608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc0822ed-1b05-4418-912b-24797a7c9118 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:46.523549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cc0822ed-1b05-4418-912b-24797a7c9118 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:46.532017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc0822ed-1b05-4418-912b-24797a7c9118 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:46.533014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc0822ed-1b05-4418-912b-24797a7c9118 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:46.533940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc0822ed-1b05-4418-912b-24797a7c9118 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:46.535045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc0822ed-1b05-4418-912b-24797a7c9118 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:46.535724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc0822ed-1b05-4418-912b-24797a7c9118 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:46.536432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc0822ed-1b05-4418-912b-24797a7c9118 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:46.899431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cc0822ed-1b05-4418-912b-24797a7c9118 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:46.924224 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cc0822ed-1b05-4418-912b-24797a7c9118 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.408883 Oct 05 17:36:46.925144 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 718/1487] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:46 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:46.930893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:46.937350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5138d783-9296-4faa-85e6-7ecca3219344 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:46.938165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5138d783-9296-4faa-85e6-7ecca3219344 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:46.948789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:46.952137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:46.955864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5138d783-9296-4faa-85e6-7ecca3219344 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:46.956394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5138d783-9296-4faa-85e6-7ecca3219344 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:46.957007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5138d783-9296-4faa-85e6-7ecca3219344 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:46.957982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5138d783-9296-4faa-85e6-7ecca3219344 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:46.958658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5138d783-9296-4faa-85e6-7ecca3219344 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:46.958872 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4c404e10-add4-4826-a4d4-4ac27d3c6d31 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.487857 Oct 05 17:36:46.959426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5138d783-9296-4faa-85e6-7ecca3219344 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:46.961224 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 770/1488] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:46 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:36:47.309394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5138d783-9296-4faa-85e6-7ecca3219344 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:47.340393 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5138d783-9296-4faa-85e6-7ecca3219344 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1468 microversion: 2.1 time: 0.413414 Oct 05 17:36:47.341017 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 719/1489] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:46 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1468 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:47.542603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8d010d42-a153-4a71-97d8-043b82a4e399 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:47.544035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8d010d42-a153-4a71-97d8-043b82a4e399 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:47.567720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d010d42-a153-4a71-97d8-043b82a4e399 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:47.568991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d010d42-a153-4a71-97d8-043b82a4e399 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:47.572022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d010d42-a153-4a71-97d8-043b82a4e399 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:47.573075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d010d42-a153-4a71-97d8-043b82a4e399 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:47.574047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d010d42-a153-4a71-97d8-043b82a4e399 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:47.578968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d010d42-a153-4a71-97d8-043b82a4e399 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:47.703760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1a839a82-bc14-4ac9-9342-d904e11265d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'create', calling method: .version_select at 0x7f7775d93160>, body: {"keypair": {"name": "tempest-keypair-989299184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQYaqpIeHkqKVbM+quQ1g5MaWY3izCQNlgEYK2bSIErkeOhDm+KmR013jYlgLby9T1zOReF3WfRBwASPkdhMosa81mPBzJeqGo2qdqQHdoVuMSD0y1dhfGrJh8S9p3CnQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:47.721814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1a839a82-bc14-4ac9-9342-d904e11265d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:36:47.727335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1a839a82-bc14-4ac9-9342-d904e11265d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for user 1c5f58a618c04b09815dea8f54504c7c and project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:36:47.783536 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1a839a82-bc14-4ac9-9342-d904e11265d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187106 Oct 05 17:36:47.786048 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 720/1490] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:36:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:36:47.955134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a0e08eb9-e395-4e0c-8ddf-f217dfc25da3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:47.955848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a0e08eb9-e395-4e0c-8ddf-f217dfc25da3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:47.972388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e08eb9-e395-4e0c-8ddf-f217dfc25da3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:47.973019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e08eb9-e395-4e0c-8ddf-f217dfc25da3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:47.973483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e08eb9-e395-4e0c-8ddf-f217dfc25da3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:47.974225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e08eb9-e395-4e0c-8ddf-f217dfc25da3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:47.975871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e08eb9-e395-4e0c-8ddf-f217dfc25da3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:47.977320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0e08eb9-e395-4e0c-8ddf-f217dfc25da3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:48.028694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8d010d42-a153-4a71-97d8-043b82a4e399 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:48.039291 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8d010d42-a153-4a71-97d8-043b82a4e399 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.515655 Oct 05 17:36:48.041638 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 771/1491] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:47 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:48.049735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:48.058175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:48.075070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:48.075660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:48.076156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:48.077351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:48.078122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:48.078771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:48.242332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0e08eb9-e395-4e0c-8ddf-f217dfc25da3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:48.273467 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a0e08eb9-e395-4e0c-8ddf-f217dfc25da3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.324499 Oct 05 17:36:48.274075 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 721/1492] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:47 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:48.283701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-32c28c15-9d1f-408b-85f6-71f14b254262 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:48.284131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-32c28c15-9d1f-408b-85f6-71f14b254262 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:48.298402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32c28c15-9d1f-408b-85f6-71f14b254262 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:48.298902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32c28c15-9d1f-408b-85f6-71f14b254262 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:48.299335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32c28c15-9d1f-408b-85f6-71f14b254262 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:48.300079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32c28c15-9d1f-408b-85f6-71f14b254262 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:48.300530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32c28c15-9d1f-408b-85f6-71f14b254262 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:48.300950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32c28c15-9d1f-408b-85f6-71f14b254262 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:48.339538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-32c28c15-9d1f-408b-85f6-71f14b254262 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:36:48.472778 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-32c28c15-9d1f-408b-85f6-71f14b254262 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 204 len: 0 microversion: 2.1 time: 0.194600 Oct 05 17:36:48.473995 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 722/1493] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:36:48 2022] DELETE /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:36:48.484597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-edf4ad02-6662-4736-9ef0-6c020cc69ec9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:48.485990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-edf4ad02-6662-4736-9ef0-6c020cc69ec9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:48.498888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edf4ad02-6662-4736-9ef0-6c020cc69ec9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:48.499580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edf4ad02-6662-4736-9ef0-6c020cc69ec9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:48.500009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edf4ad02-6662-4736-9ef0-6c020cc69ec9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:48.500784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edf4ad02-6662-4736-9ef0-6c020cc69ec9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:48.501396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edf4ad02-6662-4736-9ef0-6c020cc69ec9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:48.502970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edf4ad02-6662-4736-9ef0-6c020cc69ec9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:48.705555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-edf4ad02-6662-4736-9ef0-6c020cc69ec9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:48.717545 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-edf4ad02-6662-4736-9ef0-6c020cc69ec9 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1461 microversion: 2.1 time: 0.241923 Oct 05 17:36:48.719038 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 723/1494] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:48 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1461 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:48.732912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5627ce8-5383-4587-9a20-a6b23131cece tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:48.734004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5627ce8-5383-4587-9a20-a6b23131cece tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:48.759818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5627ce8-5383-4587-9a20-a6b23131cece tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:48.760713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5627ce8-5383-4587-9a20-a6b23131cece tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:48.761527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5627ce8-5383-4587-9a20-a6b23131cece tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:48.763080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5627ce8-5383-4587-9a20-a6b23131cece tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:48.763968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5627ce8-5383-4587-9a20-a6b23131cece tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:48.765883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5627ce8-5383-4587-9a20-a6b23131cece tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:48.865309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:48.877136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:48.878752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:48.881080 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab3d98ee-6dc4-4b35-9085-f5e5c70a0b37 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.837108 Oct 05 17:36:48.903760 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 772/1495] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:48 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:48.915356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-14d356a2-b21d-40e0-b274-63419da07916 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:48.931231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-14d356a2-b21d-40e0-b274-63419da07916 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:48.938992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14d356a2-b21d-40e0-b274-63419da07916 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:48.940388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14d356a2-b21d-40e0-b274-63419da07916 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:48.941274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14d356a2-b21d-40e0-b274-63419da07916 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:48.942264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14d356a2-b21d-40e0-b274-63419da07916 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:48.943039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14d356a2-b21d-40e0-b274-63419da07916 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:48.945085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14d356a2-b21d-40e0-b274-63419da07916 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:49.089916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c5627ce8-5383-4587-9a20-a6b23131cece tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:49.099630 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c5627ce8-5383-4587-9a20-a6b23131cece tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1514 microversion: 2.1 time: 0.379168 Oct 05 17:36:49.106448 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 724/1496] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:48 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1514 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:49.106448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-050c3825-194e-4d61-96cc-967535e857f8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:49.106771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-050c3825-194e-4d61-96cc-967535e857f8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:49.121473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050c3825-194e-4d61-96cc-967535e857f8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:49.122098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050c3825-194e-4d61-96cc-967535e857f8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:49.122626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050c3825-194e-4d61-96cc-967535e857f8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:49.123448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050c3825-194e-4d61-96cc-967535e857f8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:49.124159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050c3825-194e-4d61-96cc-967535e857f8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:49.124669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-050c3825-194e-4d61-96cc-967535e857f8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:49.390183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-050c3825-194e-4d61-96cc-967535e857f8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:49.400313 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-050c3825-194e-4d61-96cc-967535e857f8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.298369 Oct 05 17:36:49.400902 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 725/1497] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:49 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:49.411466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5cdc17e5-800a-4da4-a72b-b0e555c5d42b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:49.412118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5cdc17e5-800a-4da4-a72b-b0e555c5d42b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:49.426462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cdc17e5-800a-4da4-a72b-b0e555c5d42b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:49.426961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cdc17e5-800a-4da4-a72b-b0e555c5d42b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:49.427400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cdc17e5-800a-4da4-a72b-b0e555c5d42b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:49.428109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cdc17e5-800a-4da4-a72b-b0e555c5d42b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:49.428564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cdc17e5-800a-4da4-a72b-b0e555c5d42b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:49.428986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cdc17e5-800a-4da4-a72b-b0e555c5d42b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:49.545778 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-14d356a2-b21d-40e0-b274-63419da07916 tempest-MigrationsAdminTest-488447416 tempest-MigrationsAdminTest-488447416-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1612 microversion: 2.1 time: 0.640505 Oct 05 17:36:49.546524 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 773/1498] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:48 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1612 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:49.577166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a0f8c0d9-44e0-42e8-8355-9292336479ff tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:49.577670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a0f8c0d9-44e0-42e8-8355-9292336479ff tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:49.592537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0f8c0d9-44e0-42e8-8355-9292336479ff tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:49.593049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0f8c0d9-44e0-42e8-8355-9292336479ff tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:49.593499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0f8c0d9-44e0-42e8-8355-9292336479ff tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:49.603722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0f8c0d9-44e0-42e8-8355-9292336479ff tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:49.604339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0f8c0d9-44e0-42e8-8355-9292336479ff tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:49.604791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0f8c0d9-44e0-42e8-8355-9292336479ff tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:49.659794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a0f8c0d9-44e0-42e8-8355-9292336479ff tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:36:49.706159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5cdc17e5-800a-4da4-a72b-b0e555c5d42b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:49.714986 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5cdc17e5-800a-4da4-a72b-b0e555c5d42b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.313032 Oct 05 17:36:49.723634 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 726/1499] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:49 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:49.857319 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a0f8c0d9-44e0-42e8-8355-9292336479ff tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 204 len: 0 microversion: 2.1 time: 0.283679 Oct 05 17:36:49.865159 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 774/1500] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:36:49 2022] DELETE /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:36:49.876025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa34c11f-438a-4cbd-8861-a01dceb31a0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:49.877036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa34c11f-438a-4cbd-8861-a01dceb31a0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:49.905880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa34c11f-438a-4cbd-8861-a01dceb31a0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:49.907227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa34c11f-438a-4cbd-8861-a01dceb31a0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:49.912942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa34c11f-438a-4cbd-8861-a01dceb31a0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:49.914016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa34c11f-438a-4cbd-8861-a01dceb31a0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:49.916298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa34c11f-438a-4cbd-8861-a01dceb31a0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:49.916954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa34c11f-438a-4cbd-8861-a01dceb31a0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:49.919256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:49.919964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:49.929711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:49.930206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:49.930668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:49.935224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:49.935722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:49.936160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:50.201697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:50.220550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:50.226132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:50.227621 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e2a5bc45-9452-410b-945a-2b1a42a2907b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.313033 Oct 05 17:36:50.270134 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 775/1501] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:49 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:50.279428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-136e5e43-31f5-4ee7-a170-92920eaea1a2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:50.297256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-136e5e43-31f5-4ee7-a170-92920eaea1a2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:50.305987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-136e5e43-31f5-4ee7-a170-92920eaea1a2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:50.319810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-136e5e43-31f5-4ee7-a170-92920eaea1a2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:50.320619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-136e5e43-31f5-4ee7-a170-92920eaea1a2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:50.321591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-136e5e43-31f5-4ee7-a170-92920eaea1a2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:50.322385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-136e5e43-31f5-4ee7-a170-92920eaea1a2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:50.323064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-136e5e43-31f5-4ee7-a170-92920eaea1a2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:50.625371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-136e5e43-31f5-4ee7-a170-92920eaea1a2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:50.640029 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-136e5e43-31f5-4ee7-a170-92920eaea1a2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1514 microversion: 2.1 time: 0.365315 Oct 05 17:36:50.640906 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 776/1502] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:50 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1514 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:50.661568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4501cfd9-87f2-4eb6-bd51-283cdf3c2966 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:50.662179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4501cfd9-87f2-4eb6-bd51-283cdf3c2966 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:50.676664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4501cfd9-87f2-4eb6-bd51-283cdf3c2966 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:50.677162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4501cfd9-87f2-4eb6-bd51-283cdf3c2966 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:50.677591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4501cfd9-87f2-4eb6-bd51-283cdf3c2966 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:50.678208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa34c11f-438a-4cbd-8861-a01dceb31a0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:50.678686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4501cfd9-87f2-4eb6-bd51-283cdf3c2966 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:50.678822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4501cfd9-87f2-4eb6-bd51-283cdf3c2966 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:50.679246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4501cfd9-87f2-4eb6-bd51-283cdf3c2966 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:50.686165 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa34c11f-438a-4cbd-8861-a01dceb31a0a tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1467 microversion: 2.1 time: 0.816421 Oct 05 17:36:50.699818 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 727/1503] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:49 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1467 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:50.718722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-09d38773-0c44-40ed-ae71-54bf7bcb545c req-42d26cc6-af3f-44bd-b96b-c2bc0063aebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2deb41c1-aad2-44ec-890d-ee629b7026a8", "name": "network-vif-plugged", "status": "completed", "tag": "662f062f-3156-4f24-b7bb-57e88b7f1361"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:50.720199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:50.732898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-09d38773-0c44-40ed-ae71-54bf7bcb545c req-42d26cc6-af3f-44bd-b96b-c2bc0063aebc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:50.733396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-09d38773-0c44-40ed-ae71-54bf7bcb545c req-42d26cc6-af3f-44bd-b96b-c2bc0063aebc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:50.733827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-09d38773-0c44-40ed-ae71-54bf7bcb545c req-42d26cc6-af3f-44bd-b96b-c2bc0063aebc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:50.761113 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-09d38773-0c44-40ed-ae71-54bf7bcb545c req-42d26cc6-af3f-44bd-b96b-c2bc0063aebc service nova] Creating event network-vif-plugged:662f062f-3156-4f24-b7bb-57e88b7f1361 for instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 on n-h2-835595-3 Oct 05 17:36:50.786303 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-09d38773-0c44-40ed-ae71-54bf7bcb545c req-42d26cc6-af3f-44bd-b96b-c2bc0063aebc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074667 Oct 05 17:36:50.788650 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 728/1504] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:50.809745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-79ba41ea-6608-4abe-b73e-8b5fa47309c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:50.816706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-79ba41ea-6608-4abe-b73e-8b5fa47309c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:50.844454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79ba41ea-6608-4abe-b73e-8b5fa47309c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:50.847057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79ba41ea-6608-4abe-b73e-8b5fa47309c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:50.847617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79ba41ea-6608-4abe-b73e-8b5fa47309c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:50.848458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79ba41ea-6608-4abe-b73e-8b5fa47309c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:50.849353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79ba41ea-6608-4abe-b73e-8b5fa47309c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:50.856723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79ba41ea-6608-4abe-b73e-8b5fa47309c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:51.011658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4501cfd9-87f2-4eb6-bd51-283cdf3c2966 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:51.037313 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4501cfd9-87f2-4eb6-bd51-283cdf3c2966 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.381222 Oct 05 17:36:51.053354 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 777/1505] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:50 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:51.261184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:51.262320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:51.272777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:51.273480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:51.275952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:51.276936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:51.277580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:51.279309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:51.479110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-79ba41ea-6608-4abe-b73e-8b5fa47309c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:51.489607 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-79ba41ea-6608-4abe-b73e-8b5fa47309c8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.688995 Oct 05 17:36:51.513585 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 729/1506] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:50 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:51.637496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-76db7a48-f3a9-4d15-8b24-06d8b283af73 req-28af028d-edae-48c5-a958-0cbc35c52fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "012a21d9-0f94-4075-b433-d8d3120e1356", "name": "network-vif-deleted", "tag": "209c3636-f5f8-4d30-848f-c1dabd3dd2a6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:51.656409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:51.668341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-76db7a48-f3a9-4d15-8b24-06d8b283af73 req-28af028d-edae-48c5-a958-0cbc35c52fe5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:51.669037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-76db7a48-f3a9-4d15-8b24-06d8b283af73 req-28af028d-edae-48c5-a958-0cbc35c52fe5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:51.669482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-76db7a48-f3a9-4d15-8b24-06d8b283af73 req-28af028d-edae-48c5-a958-0cbc35c52fe5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:51.692360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:51.694961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:51.706063 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-76db7a48-f3a9-4d15-8b24-06d8b283af73 req-28af028d-edae-48c5-a958-0cbc35c52fe5 service nova] Creating event network-vif-deleted:209c3636-f5f8-4d30-848f-c1dabd3dd2a6 for instance 012a21d9-0f94-4075-b433-d8d3120e1356 on n-h1-835595-3 Oct 05 17:36:51.714915 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dbf87f69-5914-4fcd-ad57-6ff780883add tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.446922 Oct 05 17:36:51.717540 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 778/1507] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:51 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:36:51.725224 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-76db7a48-f3a9-4d15-8b24-06d8b283af73 req-28af028d-edae-48c5-a958-0cbc35c52fe5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091411 Oct 05 17:36:51.729062 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 730/1508] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:36:51.731414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d7ed6a5-b4b7-4b5a-9444-db407fdb5dc2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:51.734478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d7ed6a5-b4b7-4b5a-9444-db407fdb5dc2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:51.741755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c357ed5d-524f-4dc7-9c5d-e17cdc60e0ac tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:51.769985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c357ed5d-524f-4dc7-9c5d-e17cdc60e0ac tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:51.771917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d7ed6a5-b4b7-4b5a-9444-db407fdb5dc2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:51.779285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d7ed6a5-b4b7-4b5a-9444-db407fdb5dc2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:51.780307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d7ed6a5-b4b7-4b5a-9444-db407fdb5dc2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:51.781797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d7ed6a5-b4b7-4b5a-9444-db407fdb5dc2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:51.782527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d7ed6a5-b4b7-4b5a-9444-db407fdb5dc2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:51.783180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d7ed6a5-b4b7-4b5a-9444-db407fdb5dc2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:51.790581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c357ed5d-524f-4dc7-9c5d-e17cdc60e0ac tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:51.791079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c357ed5d-524f-4dc7-9c5d-e17cdc60e0ac tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:51.791517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c357ed5d-524f-4dc7-9c5d-e17cdc60e0ac tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:51.792274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c357ed5d-524f-4dc7-9c5d-e17cdc60e0ac tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:51.804441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c357ed5d-524f-4dc7-9c5d-e17cdc60e0ac tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:51.808148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c357ed5d-524f-4dc7-9c5d-e17cdc60e0ac tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:52.197204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d7ed6a5-b4b7-4b5a-9444-db407fdb5dc2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:52.211852 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d7ed6a5-b4b7-4b5a-9444-db407fdb5dc2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1303 microversion: 2.1 time: 0.492107 Oct 05 17:36:52.218711 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 779/1509] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:51 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1303 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:52.257488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a9370c4-433b-413e-b3ee-833b2f7c12ed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:52.258199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1a9370c4-433b-413e-b3ee-833b2f7c12ed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:52.293764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9370c4-433b-413e-b3ee-833b2f7c12ed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:52.296771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9370c4-433b-413e-b3ee-833b2f7c12ed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:52.300461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9370c4-433b-413e-b3ee-833b2f7c12ed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:52.301517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9370c4-433b-413e-b3ee-833b2f7c12ed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:52.304464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9370c4-433b-413e-b3ee-833b2f7c12ed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:52.304916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9370c4-433b-413e-b3ee-833b2f7c12ed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:52.509922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c357ed5d-524f-4dc7-9c5d-e17cdc60e0ac tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:52.523235 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c357ed5d-524f-4dc7-9c5d-e17cdc60e0ac tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 200 len: 1467 microversion: 2.1 time: 0.790740 Oct 05 17:36:52.523906 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 731/1510] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:51 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 1467 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:52.545997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2138096270", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "43b14ad7-066f-4366-a6d9-9f817db2441a"}], "security_groups": [{"name": "tempest-securitygroup--657081837"}], "key_name": "tempest-keypair-989299184", "user_data": "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:52.611734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1a9370c4-433b-413e-b3ee-833b2f7c12ed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:52.621164 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1a9370c4-433b-413e-b3ee-833b2f7c12ed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.395471 Oct 05 17:36:52.624045 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 780/1511] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:52 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:52.635979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0041e3c6-9ce8-47d2-881c-45c3c69ac76b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:52.636610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0041e3c6-9ce8-47d2-881c-45c3c69ac76b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:52.652525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0041e3c6-9ce8-47d2-881c-45c3c69ac76b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:52.653296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0041e3c6-9ce8-47d2-881c-45c3c69ac76b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:52.653933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0041e3c6-9ce8-47d2-881c-45c3c69ac76b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:52.654853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0041e3c6-9ce8-47d2-881c-45c3c69ac76b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:52.655538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0041e3c6-9ce8-47d2-881c-45c3c69ac76b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:52.656129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0041e3c6-9ce8-47d2-881c-45c3c69ac76b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:52.728808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] validate_networks() for [('43b14ad7-066f-4366-a6d9-9f817db2441a', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:36:53.030744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0041e3c6-9ce8-47d2-881c-45c3c69ac76b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:53.058501 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0041e3c6-9ce8-47d2-881c-45c3c69ac76b tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1472 microversion: 2.1 time: 0.433165 Oct 05 17:36:53.067215 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 781/1512] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:52 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1472 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:53.086334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:53.086967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:53.100194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:53.100980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:53.101603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:53.106536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:53.107278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:53.107875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:53.384918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:53.406946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:53.408391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:53.412515 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ababc314-967c-4796-958a-16c76c397ea4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.343984 Oct 05 17:36:53.423827 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 782/1513] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:53 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:53.703423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9fe5ebce-f821-48fc-a0ed-8c2e93a97b05 req-195ecc5e-1f81-4013-a344-6fde20a2f51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2deb41c1-aad2-44ec-890d-ee629b7026a8", "name": "network-vif-deleted", "tag": "662f062f-3156-4f24-b7bb-57e88b7f1361"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:53.720129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9fe5ebce-f821-48fc-a0ed-8c2e93a97b05 req-195ecc5e-1f81-4013-a344-6fde20a2f51b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:53.720614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9fe5ebce-f821-48fc-a0ed-8c2e93a97b05 req-195ecc5e-1f81-4013-a344-6fde20a2f51b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:53.721072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9fe5ebce-f821-48fc-a0ed-8c2e93a97b05 req-195ecc5e-1f81-4013-a344-6fde20a2f51b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:53.753529 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9fe5ebce-f821-48fc-a0ed-8c2e93a97b05 req-195ecc5e-1f81-4013-a344-6fde20a2f51b service nova] Creating event network-vif-deleted:662f062f-3156-4f24-b7bb-57e88b7f1361 for instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 on n-h2-835595-3 Oct 05 17:36:53.778682 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9fe5ebce-f821-48fc-a0ed-8c2e93a97b05 req-195ecc5e-1f81-4013-a344-6fde20a2f51b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.353436 Oct 05 17:36:53.784616 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 783/1514] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:53.801963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:53.803099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:53.829989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:53.836355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:53.836823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:53.837792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:53.838510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:53.839106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:53.946005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:53.946850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:53.947253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:53.949299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lazy-loading 'fault' on Instance uuid 012a21d9-0f94-4075-b433-d8d3120e1356 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:36:54.032268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:54.054444 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d022633d-d347-47fc-9e5f-c5076eeeec0e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 200 len: 1308 microversion: 2.1 time: 0.267340 Oct 05 17:36:54.055078 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 784/1515] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:53 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 1308 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:54.076707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:54.081500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 2deb41c1-aad2-44ec-890d-ee629b7026a8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:54.093353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.099866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.100743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.101800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.102460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.111110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.130054 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] HTTP exception thrown: Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 could not be found. Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Request method failure captured: Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 HTTP/1.1 Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb-eK08n4ubXHJuqfUk83qu8miLN4lCyPwZAF1o9Bzmf7bQI5wmD0Qlm5-gv5b1FFLhasa_6LfBKPOLiyAx2SQMs-djP-iXweC4cYqbBrq32cw7plgEVezliV8ZXZh5LCwLeHlvyajYmipSWf0Dqo5gsl-4fy_uVDDCdWDgazp566H8 Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: afc6422679664e47892eef7185291846 Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-MigrationsAdminTest-311365351 Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:36:54.132180 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/afc6422679664e47892eef7185291846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc6422679664e47892eef7185291846"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_afc6422679664e47892eef7185291846", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc6422679664e47892eef7185291846"}]}] Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-MigrationsAdminTest-311365351 Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: afc6422679664e47892eef7185291846 Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-MigrationsAdminTest-311365351 Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-MigrationsAdminTest-311365351-project Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 15a6bfffd8fb473b83de94858676f8ed Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-MigrationsAdminTest-311365351-project Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 could not be found. Oct 05 17:36:54.134090 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '2deb41c1-aad2-44ec-890d-ee629b7026a8'} Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 could not be found. Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:36:54.135183 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 could not be found. Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 could not be found. Oct 05 17:36:54.136994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:36:54.139312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Returning 404 to user: Instance 2deb41c1-aad2-44ec-890d-ee629b7026a8 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:36:54.140595 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-71c566b1-0d94-4dda-83f1-a2dd41a607f3 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8" status: 404 len: 111 microversion: 2.1 time: 0.072105 Oct 05 17:36:54.144922 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 785/1516] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:54 2022] GET /compute/v2.1/servers/2deb41c1-aad2-44ec-890d-ee629b7026a8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:36:54.150432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9485e441-797f-471b-82d1-9832ec642b14 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:54.151426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9485e441-797f-471b-82d1-9832ec642b14 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:54.162430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9485e441-797f-471b-82d1-9832ec642b14 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.163214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9485e441-797f-471b-82d1-9832ec642b14 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.168157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9485e441-797f-471b-82d1-9832ec642b14 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.169266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9485e441-797f-471b-82d1-9832ec642b14 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.170177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9485e441-797f-471b-82d1-9832ec642b14 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.170827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9485e441-797f-471b-82d1-9832ec642b14 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.312323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:36:54.313438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:36:54.314123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:36:54.336911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:36:54.337650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:36:54.358594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.359088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.359531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.360593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.361052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.361479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.414454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:36:54.428646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for user 1c5f58a618c04b09815dea8f54504c7c and project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:36:54.458922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:36:54.461289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:36:54.466528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9485e441-797f-471b-82d1-9832ec642b14 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:54.481863 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9485e441-797f-471b-82d1-9832ec642b14 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.335460 Oct 05 17:36:54.483250 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 786/1517] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:54 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:54.489309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6381190e-d891-4d8a-8d62-b22142740a21 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:54.490949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6381190e-d891-4d8a-8d62-b22142740a21 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:54.499764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6381190e-d891-4d8a-8d62-b22142740a21 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.501453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6381190e-d891-4d8a-8d62-b22142740a21 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.501905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6381190e-d891-4d8a-8d62-b22142740a21 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.502826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6381190e-d891-4d8a-8d62-b22142740a21 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.503395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6381190e-d891-4d8a-8d62-b22142740a21 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.503884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6381190e-d891-4d8a-8d62-b22142740a21 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.602095 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51474958-94db-4b57-ad37-7efa6b4aff4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.069226 Oct 05 17:36:54.606511 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 732/1518] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:36:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 2074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:36:54.620949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e225931-433a-4019-9e21-0cab5f37d327 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:54.621723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e225931-433a-4019-9e21-0cab5f37d327 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:54.634675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e225931-433a-4019-9e21-0cab5f37d327 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.635358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e225931-433a-4019-9e21-0cab5f37d327 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.635809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e225931-433a-4019-9e21-0cab5f37d327 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.636796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e225931-433a-4019-9e21-0cab5f37d327 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.637468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e225931-433a-4019-9e21-0cab5f37d327 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.638119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e225931-433a-4019-9e21-0cab5f37d327 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.743843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e225931-433a-4019-9e21-0cab5f37d327 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:36:54.861090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6381190e-d891-4d8a-8d62-b22142740a21 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:54.877712 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6381190e-d891-4d8a-8d62-b22142740a21 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1478 microversion: 2.1 time: 0.392549 Oct 05 17:36:54.887747 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 787/1519] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:54 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1478 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:54.891027 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e225931-433a-4019-9e21-0cab5f37d327 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 204 len: 0 microversion: 2.1 time: 0.282660 Oct 05 17:36:54.894893 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 733/1520] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:36:54 2022] DELETE /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:36:54.907886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:54.909993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:54.910177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-07e24f6c-189d-4bc7-aec7-069a75abc98f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:54.911080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-07e24f6c-189d-4bc7-aec7-069a75abc98f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:54.930129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:54.938713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.939312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.943162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:54.944045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:54.944548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:54.945114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:55.241317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-07e24f6c-189d-4bc7-aec7-069a75abc98f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:55.255914 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-07e24f6c-189d-4bc7-aec7-069a75abc98f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1238 microversion: 2.1 time: 0.357821 Oct 05 17:36:55.257005 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 734/1521] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:54 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1238 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:55.290237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:55.304957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:55.306435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:55.307998 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-31665b51-c9f6-4740-8ca7-0e4b43c225db tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.417789 Oct 05 17:36:55.334555 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 788/1522] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:54 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:55.340738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4bec1052-8bd6-4f53-a52f-3a4567fca308 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:55.341873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4bec1052-8bd6-4f53-a52f-3a4567fca308 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:55.359492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bec1052-8bd6-4f53-a52f-3a4567fca308 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:55.359878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bec1052-8bd6-4f53-a52f-3a4567fca308 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:55.360625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bec1052-8bd6-4f53-a52f-3a4567fca308 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:55.361342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bec1052-8bd6-4f53-a52f-3a4567fca308 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:55.361875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bec1052-8bd6-4f53-a52f-3a4567fca308 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:55.362243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bec1052-8bd6-4f53-a52f-3a4567fca308 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:55.438506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c6699ba1-30b3-4dcd-90ea-aadd63c12089 req-c53b71d1-af15-4912-a06a-05d800cc97af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63958af-abf6-42db-be31-d666ae842191", "name": "network-vif-unplugged", "status": "completed", "tag": "341a9f89-e472-44f2-8da1-34fc17c91f7b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:55.462270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c6699ba1-30b3-4dcd-90ea-aadd63c12089 req-c53b71d1-af15-4912-a06a-05d800cc97af service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:55.462818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c6699ba1-30b3-4dcd-90ea-aadd63c12089 req-c53b71d1-af15-4912-a06a-05d800cc97af service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:55.463257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c6699ba1-30b3-4dcd-90ea-aadd63c12089 req-c53b71d1-af15-4912-a06a-05d800cc97af service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:55.510381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:55.516516 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c6699ba1-30b3-4dcd-90ea-aadd63c12089 req-c53b71d1-af15-4912-a06a-05d800cc97af service nova] Creating event network-vif-unplugged:341a9f89-e472-44f2-8da1-34fc17c91f7b for instance a63958af-abf6-42db-be31-d666ae842191 on n-h1-835595-3 Oct 05 17:36:55.532574 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c6699ba1-30b3-4dcd-90ea-aadd63c12089 req-c53b71d1-af15-4912-a06a-05d800cc97af service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.273093 Oct 05 17:36:55.534464 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 735/1523] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:36:55.541654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:55.543657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: 012a21d9-0f94-4075-b433-d8d3120e1356] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:55.551831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:55.552648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:55.553280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:55.554484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:55.556087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:55.556746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:55.576292 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] HTTP exception thrown: Instance 012a21d9-0f94-4075-b433-d8d3120e1356 could not be found. Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Request method failure captured: Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 HTTP/1.1 Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcAVAq7sxUW8j_89-liG_KtHQOBNdU5OGq_onNdK13p6VY2qWIyIppLAJgOX2aPSpXYM-MsrbwMY3LHr4t-ALKVV47AGJBM5KrXVTT8EIEiJ5uro3qmuReoA6UF0fVGyLas5jpCe-LVpCW2bltOq0-Vtzx9tiEP2ptaPLpmerpTFchU Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 1164570e81d8431f882d07b9fa9e8056 Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-VolumesAdminNegativeTest-1896059713 Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:36:55.578683 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1164570e81d8431f882d07b9fa9e8056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1164570e81d8431f882d07b9fa9e8056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1164570e81d8431f882d07b9fa9e8056", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1164570e81d8431f882d07b9fa9e8056"}]}] Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-VolumesAdminNegativeTest-1896059713 Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 1164570e81d8431f882d07b9fa9e8056 Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1896059713 Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-VolumesAdminNegativeTest-1896059713-project Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: e97eb363a60947e9b2d2d12494714aae Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-VolumesAdminNegativeTest-1896059713-project Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 012a21d9-0f94-4075-b433-d8d3120e1356 could not be found. Oct 05 17:36:55.580499 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '012a21d9-0f94-4075-b433-d8d3120e1356'} Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 012a21d9-0f94-4075-b433-d8d3120e1356 could not be found. Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:36:55.581349 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 012a21d9-0f94-4075-b433-d8d3120e1356 could not be found. Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 012a21d9-0f94-4075-b433-d8d3120e1356 could not be found. Oct 05 17:36:55.582916 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:36:55.585308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Returning 404 to user: Instance 012a21d9-0f94-4075-b433-d8d3120e1356 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:36:55.586384 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-384c705c-b71b-48e2-9697-598134f021f9 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356" status: 404 len: 111 microversion: 2.1 time: 0.050202 Oct 05 17:36:55.587570 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 736/1524] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:55 2022] GET /compute/v2.1/servers/012a21d9-0f94-4075-b433-d8d3120e1356 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:36:55.595178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b200f8f-0a80-413e-b13b-55b28f07b392 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:55.596465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b200f8f-0a80-413e-b13b-55b28f07b392 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:55.604426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b200f8f-0a80-413e-b13b-55b28f07b392 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:55.605314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b200f8f-0a80-413e-b13b-55b28f07b392 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:55.605929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b200f8f-0a80-413e-b13b-55b28f07b392 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:55.606881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b200f8f-0a80-413e-b13b-55b28f07b392 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:55.607613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b200f8f-0a80-413e-b13b-55b28f07b392 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:55.608400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b200f8f-0a80-413e-b13b-55b28f07b392 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:55.709477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4bec1052-8bd6-4f53-a52f-3a4567fca308 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:55.723873 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4bec1052-8bd6-4f53-a52f-3a4567fca308 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1533 microversion: 2.1 time: 0.383404 Oct 05 17:36:55.736079 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 789/1525] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:55 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1533 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:55.852842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b200f8f-0a80-413e-b13b-55b28f07b392 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:55.862993 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b200f8f-0a80-413e-b13b-55b28f07b392 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.274215 Oct 05 17:36:55.884313 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 737/1526] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:55 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:55.913151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-61382519-0ef4-48c8-b7d7-dbf1797846f3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:55.913845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-61382519-0ef4-48c8-b7d7-dbf1797846f3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:55.928764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61382519-0ef4-48c8-b7d7-dbf1797846f3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:55.930013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61382519-0ef4-48c8-b7d7-dbf1797846f3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:55.932232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61382519-0ef4-48c8-b7d7-dbf1797846f3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:55.934269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61382519-0ef4-48c8-b7d7-dbf1797846f3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:55.935991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61382519-0ef4-48c8-b7d7-dbf1797846f3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:55.937925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61382519-0ef4-48c8-b7d7-dbf1797846f3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:56.288123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f7ff45d5-e32a-4a9d-9ba0-90017ca5192b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:56.295599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f7ff45d5-e32a-4a9d-9ba0-90017ca5192b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:56.299524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-61382519-0ef4-48c8-b7d7-dbf1797846f3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:56.312075 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-61382519-0ef4-48c8-b7d7-dbf1797846f3 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1478 microversion: 2.1 time: 0.406727 Oct 05 17:36:56.314418 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 790/1527] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:55 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1478 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:56.320566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7ff45d5-e32a-4a9d-9ba0-90017ca5192b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:56.321060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7ff45d5-e32a-4a9d-9ba0-90017ca5192b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:56.321497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7ff45d5-e32a-4a9d-9ba0-90017ca5192b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:56.322200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7ff45d5-e32a-4a9d-9ba0-90017ca5192b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:56.322682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7ff45d5-e32a-4a9d-9ba0-90017ca5192b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:56.323104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7ff45d5-e32a-4a9d-9ba0-90017ca5192b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:56.344806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:56.347760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:56.358619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:56.359564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:56.361349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:56.362709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:56.363474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:56.364394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:56.548609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f7ff45d5-e32a-4a9d-9ba0-90017ca5192b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:56.565674 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f7ff45d5-e32a-4a9d-9ba0-90017ca5192b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1234 microversion: 2.1 time: 0.284980 Oct 05 17:36:56.568630 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 738/1528] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:56 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1234 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:36:56.752806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-427dce6f-79c6-445d-8ea6-570dc6379607 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:56.753427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-427dce6f-79c6-445d-8ea6-570dc6379607 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:56.787849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-427dce6f-79c6-445d-8ea6-570dc6379607 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:56.788354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-427dce6f-79c6-445d-8ea6-570dc6379607 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:56.788813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-427dce6f-79c6-445d-8ea6-570dc6379607 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:56.789550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-427dce6f-79c6-445d-8ea6-570dc6379607 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:56.789988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-427dce6f-79c6-445d-8ea6-570dc6379607 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:56.790466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-427dce6f-79c6-445d-8ea6-570dc6379607 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:56.813653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:56.838329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:56.840854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:56.844321 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f6332771-91c2-4ac6-bede-fd2540ad54bf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.507186 Oct 05 17:36:56.852815 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 791/1529] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:56 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:56.899122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f838b22-1b22-446e-9afa-c8125d16b4cb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:56.901083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f838b22-1b22-446e-9afa-c8125d16b4cb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:56.932996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f838b22-1b22-446e-9afa-c8125d16b4cb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:56.935041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f838b22-1b22-446e-9afa-c8125d16b4cb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:56.938697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f838b22-1b22-446e-9afa-c8125d16b4cb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:56.941734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f838b22-1b22-446e-9afa-c8125d16b4cb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:56.942910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f838b22-1b22-446e-9afa-c8125d16b4cb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:56.945470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f838b22-1b22-446e-9afa-c8125d16b4cb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:57.283515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-427dce6f-79c6-445d-8ea6-570dc6379607 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:57.296084 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-427dce6f-79c6-445d-8ea6-570dc6379607 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1533 microversion: 2.1 time: 0.543870 Oct 05 17:36:57.297046 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 739/1530] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:56 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1533 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:57.312839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f838b22-1b22-446e-9afa-c8125d16b4cb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:57.330308 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f838b22-1b22-446e-9afa-c8125d16b4cb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.442616 Oct 05 17:36:57.338570 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 792/1531] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:56 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:57.348118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3dccde5b-98ab-4dad-b8bc-5fc59605cc95 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:57.349076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3dccde5b-98ab-4dad-b8bc-5fc59605cc95 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:57.361933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dccde5b-98ab-4dad-b8bc-5fc59605cc95 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:57.364599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dccde5b-98ab-4dad-b8bc-5fc59605cc95 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:57.365162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dccde5b-98ab-4dad-b8bc-5fc59605cc95 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:57.369371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dccde5b-98ab-4dad-b8bc-5fc59605cc95 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:57.370226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dccde5b-98ab-4dad-b8bc-5fc59605cc95 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:57.370928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dccde5b-98ab-4dad-b8bc-5fc59605cc95 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:57.604836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c4323221-4eea-43c0-af00-b03915681c89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:57.607142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c4323221-4eea-43c0-af00-b03915681c89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:57.621955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4323221-4eea-43c0-af00-b03915681c89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:57.625454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4323221-4eea-43c0-af00-b03915681c89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:57.632756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4323221-4eea-43c0-af00-b03915681c89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:57.633704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4323221-4eea-43c0-af00-b03915681c89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:57.634321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4323221-4eea-43c0-af00-b03915681c89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:57.634889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4323221-4eea-43c0-af00-b03915681c89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:57.763659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c4323221-4eea-43c0-af00-b03915681c89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:57.777973 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c4323221-4eea-43c0-af00-b03915681c89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1298 microversion: 2.1 time: 0.177423 Oct 05 17:36:57.786313 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 793/1532] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:57 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1298 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:57.791737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9f4929c9-5ffb-4799-b44b-2b2523361319 req-7ff869f5-8622-4714-a592-1a3ee4cb0519 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a63958af-abf6-42db-be31-d666ae842191", "tag": "341a9f89-e472-44f2-8da1-34fc17c91f7b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:57.806398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9f4929c9-5ffb-4799-b44b-2b2523361319 req-7ff869f5-8622-4714-a592-1a3ee4cb0519 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:57.806398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9f4929c9-5ffb-4799-b44b-2b2523361319 req-7ff869f5-8622-4714-a592-1a3ee4cb0519 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:57.806398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9f4929c9-5ffb-4799-b44b-2b2523361319 req-7ff869f5-8622-4714-a592-1a3ee4cb0519 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:57.824706 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9f4929c9-5ffb-4799-b44b-2b2523361319 req-7ff869f5-8622-4714-a592-1a3ee4cb0519 service nova] Creating event network-changed:341a9f89-e472-44f2-8da1-34fc17c91f7b for instance a63958af-abf6-42db-be31-d666ae842191 on n-h1-835595-3 Oct 05 17:36:57.830463 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9f4929c9-5ffb-4799-b44b-2b2523361319 req-7ff869f5-8622-4714-a592-1a3ee4cb0519 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043593 Oct 05 17:36:57.831626 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 794/1533] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:36:57.879429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:57.881195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:57.890146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:57.890898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:57.891451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:57.892317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:57.893407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:57.893407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:57.921016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3dccde5b-98ab-4dad-b8bc-5fc59605cc95 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:57.932911 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3dccde5b-98ab-4dad-b8bc-5fc59605cc95 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1478 microversion: 2.1 time: 0.591476 Oct 05 17:36:57.935819 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 740/1534] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:57 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1478 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:58.219474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:58.223268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:58.240511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:58.242713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:58.244235 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-09104295-628a-43da-90e8-1ef24185bd5f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.370694 Oct 05 17:36:58.245415 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 795/1535] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:57 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:58.335747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-09d84e4f-1107-40f8-b806-887206016b05 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:58.338197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-09d84e4f-1107-40f8-b806-887206016b05 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:58.356219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d84e4f-1107-40f8-b806-887206016b05 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:58.366450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2cd9b94b-99c3-411a-9d55-7aa334b01aea tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:58.368146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2cd9b94b-99c3-411a-9d55-7aa334b01aea tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:58.391944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d84e4f-1107-40f8-b806-887206016b05 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:58.393211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d84e4f-1107-40f8-b806-887206016b05 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:58.394179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d84e4f-1107-40f8-b806-887206016b05 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:58.396074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d84e4f-1107-40f8-b806-887206016b05 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:58.397087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09d84e4f-1107-40f8-b806-887206016b05 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:58.404990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cd9b94b-99c3-411a-9d55-7aa334b01aea tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:58.406012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cd9b94b-99c3-411a-9d55-7aa334b01aea tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:58.409130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cd9b94b-99c3-411a-9d55-7aa334b01aea tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:58.410181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cd9b94b-99c3-411a-9d55-7aa334b01aea tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:58.410870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cd9b94b-99c3-411a-9d55-7aa334b01aea tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:58.414641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cd9b94b-99c3-411a-9d55-7aa334b01aea tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:58.681025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2cd9b94b-99c3-411a-9d55-7aa334b01aea tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:58.699341 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2cd9b94b-99c3-411a-9d55-7aa334b01aea tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.338397 Oct 05 17:36:58.700707 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 796/1536] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:58 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:58.765796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09d84e4f-1107-40f8-b806-887206016b05 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:58.776897 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-09d84e4f-1107-40f8-b806-887206016b05 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1491 microversion: 2.1 time: 0.445429 Oct 05 17:36:58.783459 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 741/1537] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:58 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1491 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:58.822874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-da3f8f57-4c1d-46a6-8719-640fa50d0f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:58.823515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-da3f8f57-4c1d-46a6-8719-640fa50d0f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:58.831548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da3f8f57-4c1d-46a6-8719-640fa50d0f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:58.834612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da3f8f57-4c1d-46a6-8719-640fa50d0f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:58.835253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da3f8f57-4c1d-46a6-8719-640fa50d0f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:58.836812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da3f8f57-4c1d-46a6-8719-640fa50d0f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:58.841699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da3f8f57-4c1d-46a6-8719-640fa50d0f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:58.843547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da3f8f57-4c1d-46a6-8719-640fa50d0f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:58.972760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-da3f8f57-4c1d-46a6-8719-640fa50d0f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:58.978916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97a28e8d-b508-4503-8565-d5f7a2e2cbb1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:58.979705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-97a28e8d-b508-4503-8565-d5f7a2e2cbb1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:58.984434 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-da3f8f57-4c1d-46a6-8719-640fa50d0f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1296 microversion: 2.1 time: 0.168394 Oct 05 17:36:58.985599 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 797/1538] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:58 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1296 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:58.996693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:36:58.999524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97a28e8d-b508-4503-8565-d5f7a2e2cbb1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:59.000229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97a28e8d-b508-4503-8565-d5f7a2e2cbb1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:59.000853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97a28e8d-b508-4503-8565-d5f7a2e2cbb1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:59.001755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97a28e8d-b508-4503-8565-d5f7a2e2cbb1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:59.002441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97a28e8d-b508-4503-8565-d5f7a2e2cbb1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:59.003167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97a28e8d-b508-4503-8565-d5f7a2e2cbb1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:59.093958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ca0a110d-5a0d-4847-88c7-fcb76a4c1980 req-7732002f-a9bd-4b12-b87c-d39d3a0698c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6321627d-1957-42b5-a223-da558b58bbdf", "name": "network-vif-unplugged", "status": "completed", "tag": "9752d52f-5ec4-412b-ae98-2e0cd46d439f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:36:59.130595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ca0a110d-5a0d-4847-88c7-fcb76a4c1980 req-7732002f-a9bd-4b12-b87c-d39d3a0698c7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:59.143548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ca0a110d-5a0d-4847-88c7-fcb76a4c1980 req-7732002f-a9bd-4b12-b87c-d39d3a0698c7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:59.145557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ca0a110d-5a0d-4847-88c7-fcb76a4c1980 req-7732002f-a9bd-4b12-b87c-d39d3a0698c7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:59.166371 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ca0a110d-5a0d-4847-88c7-fcb76a4c1980 req-7732002f-a9bd-4b12-b87c-d39d3a0698c7 service nova] Creating event network-vif-unplugged:9752d52f-5ec4-412b-ae98-2e0cd46d439f for instance 6321627d-1957-42b5-a223-da558b58bbdf on n-h1-835595-3 Oct 05 17:36:59.183375 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ca0a110d-5a0d-4847-88c7-fcb76a4c1980 req-7732002f-a9bd-4b12-b87c-d39d3a0698c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100780 Oct 05 17:36:59.184911 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 798/1539] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:36:59.288030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:59.289103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:59.303786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:59.304291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:59.304729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:59.307219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:59.314047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:59.314651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:59.653848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:59.680358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:59.681749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:59.683843 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4c3e50dd-2aae-4609-8ed3-ec9bc921ff53 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.403594 Oct 05 17:36:59.684959 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 799/1540] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:36:59 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:36:59.717608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-97a28e8d-b508-4503-8565-d5f7a2e2cbb1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:36:59.729419 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-97a28e8d-b508-4503-8565-d5f7a2e2cbb1 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1478 microversion: 2.1 time: 0.761608 Oct 05 17:36:59.731644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a3964886-52e8-4075-81d4-76b6c7a73033 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:59.732269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a3964886-52e8-4075-81d4-76b6c7a73033 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:59.734353 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 742/1541] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:58 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1478 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:36:59.764917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3964886-52e8-4075-81d4-76b6c7a73033 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:59.765973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3964886-52e8-4075-81d4-76b6c7a73033 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:59.766773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3964886-52e8-4075-81d4-76b6c7a73033 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:59.767698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3964886-52e8-4075-81d4-76b6c7a73033 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:59.768236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3964886-52e8-4075-81d4-76b6c7a73033 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:59.769823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3964886-52e8-4075-81d4-76b6c7a73033 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:59.816759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:36:59.817567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:36:59.831992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:59.839917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:59.845382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:59.846642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:59.848783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:59.851633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:59.971796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:36:59.973592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:36:59.974249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:36:59.975254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lazy-loading 'fault' on Instance uuid 3793214f-3607-4041-8f62-fd2b36f1b171 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:00.132429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a3964886-52e8-4075-81d4-76b6c7a73033 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:00.145414 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a3964886-52e8-4075-81d4-76b6c7a73033 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.418575 Oct 05 17:37:00.164321 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 800/1542] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:59 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:00.195947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:00.204933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b771faef-91ff-4251-8553-804c401fae4e req-eb74058e-d365-4550-95c5-7c6dfc389460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3793214f-3607-4041-8f62-fd2b36f1b171", "name": "network-vif-deleted", "tag": "8fd18242-e1fd-42af-9db6-62c95ec947e4"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:00.212084 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0bdc2c15-6de5-42f6-9cb6-4393d260a27d tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 200 len: 1368 microversion: 2.1 time: 0.399251 Oct 05 17:37:00.213258 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 743/1543] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:36:59 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 1368 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:00.223232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a2306959-2342-4577-add0-ac57ef681509 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:00.224266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a2306959-2342-4577-add0-ac57ef681509 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:00.228464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b771faef-91ff-4251-8553-804c401fae4e req-eb74058e-d365-4550-95c5-7c6dfc389460 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:00.231189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b771faef-91ff-4251-8553-804c401fae4e req-eb74058e-d365-4550-95c5-7c6dfc389460 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:00.232711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b771faef-91ff-4251-8553-804c401fae4e req-eb74058e-d365-4550-95c5-7c6dfc389460 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:00.245726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2306959-2342-4577-add0-ac57ef681509 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:00.246758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2306959-2342-4577-add0-ac57ef681509 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:00.247430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2306959-2342-4577-add0-ac57ef681509 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:00.248414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2306959-2342-4577-add0-ac57ef681509 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:00.249200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2306959-2342-4577-add0-ac57ef681509 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:00.249851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2306959-2342-4577-add0-ac57ef681509 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:00.267919 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b771faef-91ff-4251-8553-804c401fae4e req-eb74058e-d365-4550-95c5-7c6dfc389460 service nova] Creating event network-vif-deleted:8fd18242-e1fd-42af-9db6-62c95ec947e4 for instance 3793214f-3607-4041-8f62-fd2b36f1b171 on n-h1-835595-3 Oct 05 17:37:00.285580 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b771faef-91ff-4251-8553-804c401fae4e req-eb74058e-d365-4550-95c5-7c6dfc389460 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119606 Oct 05 17:37:00.287729 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 801/1544] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:00.365574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a2306959-2342-4577-add0-ac57ef681509 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:00.377627 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a2306959-2342-4577-add0-ac57ef681509 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1296 microversion: 2.1 time: 0.162966 Oct 05 17:37:00.386661 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 744/1545] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:00 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1296 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:00.726851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:00.728158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:00.737530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:00.738515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:00.739553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:00.741220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:00.741966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:00.742845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:00.792560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b6c6513-b450-49bf-8f96-36edc7113597 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:00.798711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b6c6513-b450-49bf-8f96-36edc7113597 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:00.836919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b6c6513-b450-49bf-8f96-36edc7113597 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:00.838520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b6c6513-b450-49bf-8f96-36edc7113597 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:00.845654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b6c6513-b450-49bf-8f96-36edc7113597 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:00.846618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b6c6513-b450-49bf-8f96-36edc7113597 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:00.847205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b6c6513-b450-49bf-8f96-36edc7113597 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:00.847746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b6c6513-b450-49bf-8f96-36edc7113597 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:01.163162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:01.185290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:01.187158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:01.188743 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92f474a9-b0e9-4088-8582-5e9090c03923 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.470022 Oct 05 17:37:01.189864 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 802/1546] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:00 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:01.199780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fa91b9cc-b004-47b2-afa1-5339e9c6166b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:01.202730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fa91b9cc-b004-47b2-afa1-5339e9c6166b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:01.211966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa91b9cc-b004-47b2-afa1-5339e9c6166b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:01.216620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa91b9cc-b004-47b2-afa1-5339e9c6166b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:01.217312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa91b9cc-b004-47b2-afa1-5339e9c6166b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:01.218784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa91b9cc-b004-47b2-afa1-5339e9c6166b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:01.223119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa91b9cc-b004-47b2-afa1-5339e9c6166b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:01.223750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa91b9cc-b004-47b2-afa1-5339e9c6166b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:01.444067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3b6c6513-b450-49bf-8f96-36edc7113597 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:01.449781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fa91b9cc-b004-47b2-afa1-5339e9c6166b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:01.455199 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b6c6513-b450-49bf-8f96-36edc7113597 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1478 microversion: 2.1 time: 0.693659 Oct 05 17:37:01.457603 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 745/1547] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:00 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1478 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:01.469706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:01.470812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: 3793214f-3607-4041-8f62-fd2b36f1b171] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:01.473640 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fa91b9cc-b004-47b2-afa1-5339e9c6166b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.277813 Oct 05 17:37:01.475303 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 803/1548] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:01 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:01.482735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:01.485439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:01.486847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:01.488219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:01.491194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:01.491804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:01.498821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-138a1b58-67d3-4ac7-b44f-82845d06c1f2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:01.502703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-138a1b58-67d3-4ac7-b44f-82845d06c1f2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:01.516094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-138a1b58-67d3-4ac7-b44f-82845d06c1f2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:01.516768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-138a1b58-67d3-4ac7-b44f-82845d06c1f2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:01.517307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-138a1b58-67d3-4ac7-b44f-82845d06c1f2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:01.518123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-138a1b58-67d3-4ac7-b44f-82845d06c1f2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:01.518710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-138a1b58-67d3-4ac7-b44f-82845d06c1f2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:01.519236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-138a1b58-67d3-4ac7-b44f-82845d06c1f2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:01.521840 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] HTTP exception thrown: Instance 3793214f-3607-4041-8f62-fd2b36f1b171 could not be found. Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Request method failure captured: Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 HTTP/1.1 Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-eK08n4ubXHJuqfUk83qu8miLN4lCyPwZAF1o9Bzmf7bQI5wmD0Qlm5-gv5b1FFLhasa_6LfBKPOLiyAx2SQMs-djP-iXweC4cYqbBrq32cw7plgEVezliV8ZXZh5LCwLeHlvyajYmipSWf0Dqo5gsl-4fy_uVDDCdWDgazp566H8 Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: afc6422679664e47892eef7185291846 Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-MigrationsAdminTest-311365351 Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:37:01.532214 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/afc6422679664e47892eef7185291846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc6422679664e47892eef7185291846"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_afc6422679664e47892eef7185291846", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc6422679664e47892eef7185291846"}]}] Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-MigrationsAdminTest-311365351 Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: afc6422679664e47892eef7185291846 Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-MigrationsAdminTest-311365351 Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-MigrationsAdminTest-311365351-project Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 15a6bfffd8fb473b83de94858676f8ed Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-MigrationsAdminTest-311365351-project Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 3793214f-3607-4041-8f62-fd2b36f1b171 could not be found. Oct 05 17:37:01.533895 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '3793214f-3607-4041-8f62-fd2b36f1b171'} Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3793214f-3607-4041-8f62-fd2b36f1b171 could not be found. Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:37:01.534861 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3793214f-3607-4041-8f62-fd2b36f1b171 could not be found. Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3793214f-3607-4041-8f62-fd2b36f1b171 could not be found. Oct 05 17:37:01.536378 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:01.540075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Returning 404 to user: Instance 3793214f-3607-4041-8f62-fd2b36f1b171 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:37:01.541191 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5cd2cada-65f7-49b4-b240-63683008edd8 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171" status: 404 len: 111 microversion: 2.1 time: 0.080382 Oct 05 17:37:01.546394 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 746/1549] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:01 2022] GET /compute/v2.1/servers/3793214f-3607-4041-8f62-fd2b36f1b171 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:37:01.557506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1bfa2756-83de-41d4-91d7-d0297c7b4c07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '.version_select at 0x7f777598bb80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:01.607882 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1bfa2756-83de-41d4-91d7-d0297c7b4c07 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426769608" status: 202 len: 0 microversion: 2.1 time: 0.057205 Oct 05 17:37:01.612590 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 747/1550] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 17:37:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1426769608 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:37:02.182797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-138a1b58-67d3-4ac7-b44f-82845d06c1f2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:02.196561 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-138a1b58-67d3-4ac7-b44f-82845d06c1f2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.719915 Oct 05 17:37:02.197397 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 804/1551] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:01 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:02.225536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:02.226434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:02.242536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:02.243334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:02.243971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:02.244829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:02.245289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:02.249526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:02.368193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5ebce283-b4bf-41a9-aea6-be0499374bdb req-598aa399-96d2-4719-85ac-66ae85277235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586258bf-c661-4819-804b-504089c77dc6", "tag": "cfd34f5d-5af2-4330-b921-2091d3e274be"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:02.395224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ebce283-b4bf-41a9-aea6-be0499374bdb req-598aa399-96d2-4719-85ac-66ae85277235 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:02.395911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ebce283-b4bf-41a9-aea6-be0499374bdb req-598aa399-96d2-4719-85ac-66ae85277235 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:02.396365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ebce283-b4bf-41a9-aea6-be0499374bdb req-598aa399-96d2-4719-85ac-66ae85277235 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:02.419342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5ebce283-b4bf-41a9-aea6-be0499374bdb req-598aa399-96d2-4719-85ac-66ae85277235 service nova] Creating event network-changed:cfd34f5d-5af2-4330-b921-2091d3e274be for instance 586258bf-c661-4819-804b-504089c77dc6 on n-h2-835595-3 Oct 05 17:37:02.432621 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5ebce283-b4bf-41a9-aea6-be0499374bdb req-598aa399-96d2-4719-85ac-66ae85277235 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067921 Oct 05 17:37:02.434129 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 805/1552] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:02.482105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6841b956-2dd2-48cd-ba86-f61a5a5e006d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:02.483437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6841b956-2dd2-48cd-ba86-f61a5a5e006d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:02.495974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6841b956-2dd2-48cd-ba86-f61a5a5e006d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:02.496900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6841b956-2dd2-48cd-ba86-f61a5a5e006d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:02.503963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6841b956-2dd2-48cd-ba86-f61a5a5e006d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:02.505088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6841b956-2dd2-48cd-ba86-f61a5a5e006d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:02.505871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6841b956-2dd2-48cd-ba86-f61a5a5e006d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:02.506533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6841b956-2dd2-48cd-ba86-f61a5a5e006d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:03.179488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6841b956-2dd2-48cd-ba86-f61a5a5e006d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:03.191918 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6841b956-2dd2-48cd-ba86-f61a5a5e006d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1478 microversion: 2.1 time: 0.714261 Oct 05 17:37:03.198131 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 806/1553] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:02 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1478 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:03.211331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a6f4a13-da5e-4c4b-8a31-26212e313a80 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:03.212372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2a6f4a13-da5e-4c4b-8a31-26212e313a80 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:03.232246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a6f4a13-da5e-4c4b-8a31-26212e313a80 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:03.233210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a6f4a13-da5e-4c4b-8a31-26212e313a80 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:03.233869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a6f4a13-da5e-4c4b-8a31-26212e313a80 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:03.234871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a6f4a13-da5e-4c4b-8a31-26212e313a80 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:03.235873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a6f4a13-da5e-4c4b-8a31-26212e313a80 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:03.236526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a6f4a13-da5e-4c4b-8a31-26212e313a80 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:03.448035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:03.463373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:03.469472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:03.471797 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ae02386d-f8ac-48cc-ba2f-1261aeae1d8c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 1.250634 Oct 05 17:37:03.487427 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 748/1554] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:02 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:03.492776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-641ea37c-5219-4cad-b634-3dfd48e43418 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:03.512345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-641ea37c-5219-4cad-b634-3dfd48e43418 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:03.520885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641ea37c-5219-4cad-b634-3dfd48e43418 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:03.526426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641ea37c-5219-4cad-b634-3dfd48e43418 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:03.527231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641ea37c-5219-4cad-b634-3dfd48e43418 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:03.528221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641ea37c-5219-4cad-b634-3dfd48e43418 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:03.528900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641ea37c-5219-4cad-b634-3dfd48e43418 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:03.529558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-641ea37c-5219-4cad-b634-3dfd48e43418 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:03.567861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2a6f4a13-da5e-4c4b-8a31-26212e313a80 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:03.583315 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2a6f4a13-da5e-4c4b-8a31-26212e313a80 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.383678 Oct 05 17:37:03.584494 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 807/1555] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:03 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:03.610545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b17996b0-9304-4d2a-803a-7bd376a164e2 req-35b6430c-151c-4575-9e34-87cc2934c801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6321627d-1957-42b5-a223-da558b58bbdf", "name": "network-vif-plugged", "status": "completed", "tag": "9752d52f-5ec4-412b-ae98-2e0cd46d439f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:03.630456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-641ea37c-5219-4cad-b634-3dfd48e43418 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:37:03.652253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b17996b0-9304-4d2a-803a-7bd376a164e2 req-35b6430c-151c-4575-9e34-87cc2934c801 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:03.658114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b17996b0-9304-4d2a-803a-7bd376a164e2 req-35b6430c-151c-4575-9e34-87cc2934c801 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:03.659121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b17996b0-9304-4d2a-803a-7bd376a164e2 req-35b6430c-151c-4575-9e34-87cc2934c801 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:03.703917 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b17996b0-9304-4d2a-803a-7bd376a164e2 req-35b6430c-151c-4575-9e34-87cc2934c801 service nova] Creating event network-vif-plugged:9752d52f-5ec4-412b-ae98-2e0cd46d439f for instance 6321627d-1957-42b5-a223-da558b58bbdf on n-h1-835595-3 Oct 05 17:37:03.732391 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b17996b0-9304-4d2a-803a-7bd376a164e2 req-35b6430c-151c-4575-9e34-87cc2934c801 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146333 Oct 05 17:37:03.741401 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 808/1556] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:03.761108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78a3dc08-5fbb-40e5-b329-016853d79f19 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:03.762174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-78a3dc08-5fbb-40e5-b329-016853d79f19 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:03.817827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78a3dc08-5fbb-40e5-b329-016853d79f19 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:03.817827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78a3dc08-5fbb-40e5-b329-016853d79f19 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:03.817827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78a3dc08-5fbb-40e5-b329-016853d79f19 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:03.817827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78a3dc08-5fbb-40e5-b329-016853d79f19 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:03.818406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78a3dc08-5fbb-40e5-b329-016853d79f19 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:03.818406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78a3dc08-5fbb-40e5-b329-016853d79f19 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:03.838176 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-641ea37c-5219-4cad-b634-3dfd48e43418 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "DELETE /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 204 len: 0 microversion: 2.1 time: 0.348577 Oct 05 17:37:03.840780 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 749/1557] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:37:03 2022] DELETE /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:37:03.848266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27f884a9-1156-489d-973b-2cfa0e090fa2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:03.862518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-27f884a9-1156-489d-973b-2cfa0e090fa2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:03.879843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f884a9-1156-489d-973b-2cfa0e090fa2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:03.880348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f884a9-1156-489d-973b-2cfa0e090fa2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:03.880790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f884a9-1156-489d-973b-2cfa0e090fa2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:03.882032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f884a9-1156-489d-973b-2cfa0e090fa2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:03.882950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f884a9-1156-489d-973b-2cfa0e090fa2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:03.883545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f884a9-1156-489d-973b-2cfa0e090fa2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:03.948895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-27f884a9-1156-489d-973b-2cfa0e090fa2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:37:04.046114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78a3dc08-5fbb-40e5-b329-016853d79f19 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:04.056432 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78a3dc08-5fbb-40e5-b329-016853d79f19 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.312452 Oct 05 17:37:04.062354 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 809/1558] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:03 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:04.063085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9dbc789f-70b2-4215-9c65-24aad89f7536 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:04.063615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9dbc789f-70b2-4215-9c65-24aad89f7536 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:04.070503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dbc789f-70b2-4215-9c65-24aad89f7536 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:04.071147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dbc789f-70b2-4215-9c65-24aad89f7536 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:04.071680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dbc789f-70b2-4215-9c65-24aad89f7536 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:04.072474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dbc789f-70b2-4215-9c65-24aad89f7536 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:04.073022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dbc789f-70b2-4215-9c65-24aad89f7536 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:04.073538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dbc789f-70b2-4215-9c65-24aad89f7536 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:04.279495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9dbc789f-70b2-4215-9c65-24aad89f7536 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:04.283876 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-27f884a9-1156-489d-973b-2cfa0e090fa2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 204 len: 0 microversion: 2.1 time: 0.440943 Oct 05 17:37:04.286864 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 750/1559] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:37:03 2022] DELETE /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:37:04.294981 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9dbc789f-70b2-4215-9c65-24aad89f7536 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1682 microversion: 2.1 time: 0.236567 Oct 05 17:37:04.296129 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 810/1560] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:04 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1682 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:04.302874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e074b7ac-38ff-454b-819d-cf9b97d1a0e5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:04.303571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e074b7ac-38ff-454b-819d-cf9b97d1a0e5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:04.310381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e074b7ac-38ff-454b-819d-cf9b97d1a0e5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:04.311400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e074b7ac-38ff-454b-819d-cf9b97d1a0e5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:04.312456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e074b7ac-38ff-454b-819d-cf9b97d1a0e5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:04.313360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e074b7ac-38ff-454b-819d-cf9b97d1a0e5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:04.314041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e074b7ac-38ff-454b-819d-cf9b97d1a0e5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:04.314668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e074b7ac-38ff-454b-819d-cf9b97d1a0e5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:04.315906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-334cb6f1-2adc-451a-86e6-614b3820ba6f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:04.333516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-334cb6f1-2adc-451a-86e6-614b3820ba6f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:04.348242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-334cb6f1-2adc-451a-86e6-614b3820ba6f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:04.348902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-334cb6f1-2adc-451a-86e6-614b3820ba6f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:04.349430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-334cb6f1-2adc-451a-86e6-614b3820ba6f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:04.350240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-334cb6f1-2adc-451a-86e6-614b3820ba6f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:04.352526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-334cb6f1-2adc-451a-86e6-614b3820ba6f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:04.353562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-334cb6f1-2adc-451a-86e6-614b3820ba6f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:04.364948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:04.391526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:04.519108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e074b7ac-38ff-454b-819d-cf9b97d1a0e5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:04.529566 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e074b7ac-38ff-454b-819d-cf9b97d1a0e5 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1468 microversion: 2.1 time: 0.232106 Oct 05 17:37:04.530953 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 811/1561] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:04 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1468 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:04.537950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:04.538764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:04.547482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:04.547983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:04.548682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:04.549994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:04.550490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:04.550927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:04.567429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-334cb6f1-2adc-451a-86e6-614b3820ba6f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:04.576183 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-334cb6f1-2adc-451a-86e6-614b3820ba6f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1478 microversion: 2.1 time: 0.287172 Oct 05 17:37:04.582777 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 751/1562] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:04 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1478 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:04.617032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64427c93-202c-473b-a455-566f6e3d1d50 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:04.617716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-64427c93-202c-473b-a455-566f6e3d1d50 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:04.625591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64427c93-202c-473b-a455-566f6e3d1d50 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:04.626148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64427c93-202c-473b-a455-566f6e3d1d50 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:04.626671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64427c93-202c-473b-a455-566f6e3d1d50 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:04.627443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64427c93-202c-473b-a455-566f6e3d1d50 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:04.627960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64427c93-202c-473b-a455-566f6e3d1d50 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:04.628443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64427c93-202c-473b-a455-566f6e3d1d50 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:04.758894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:04.770536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:04.772464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:04.774120 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f2f6a58d-d8ce-4ad0-9674-eb7696d68084 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.241650 Oct 05 17:37:04.775232 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 812/1563] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:04 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:04.815080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-64427c93-202c-473b-a455-566f6e3d1d50 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:04.824472 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-64427c93-202c-473b-a455-566f6e3d1d50 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.214013 Oct 05 17:37:04.825372 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 752/1564] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:04 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:05.089004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dfec7e21-5570-41b3-8910-b7cf8bd7c3da tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:05.089530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dfec7e21-5570-41b3-8910-b7cf8bd7c3da tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:05.096928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfec7e21-5570-41b3-8910-b7cf8bd7c3da tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:05.097933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfec7e21-5570-41b3-8910-b7cf8bd7c3da tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:05.097933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfec7e21-5570-41b3-8910-b7cf8bd7c3da tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:05.098597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfec7e21-5570-41b3-8910-b7cf8bd7c3da tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:05.099475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfec7e21-5570-41b3-8910-b7cf8bd7c3da tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:05.099475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfec7e21-5570-41b3-8910-b7cf8bd7c3da tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:05.251016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dfec7e21-5570-41b3-8910-b7cf8bd7c3da tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:05.259218 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dfec7e21-5570-41b3-8910-b7cf8bd7c3da tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.174028 Oct 05 17:37:05.259807 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 813/1565] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:05 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:05.330576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b7c7782c-87e1-4d18-aa90-182a159d5f80 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:05.331577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b7c7782c-87e1-4d18-aa90-182a159d5f80 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:05.345019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=12 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:05.347813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7c7782c-87e1-4d18-aa90-182a159d5f80 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:05.348591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7c7782c-87e1-4d18-aa90-182a159d5f80 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:05.349300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7c7782c-87e1-4d18-aa90-182a159d5f80 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:05.350259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7c7782c-87e1-4d18-aa90-182a159d5f80 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:05.350929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7c7782c-87e1-4d18-aa90-182a159d5f80 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:05.351703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7c7782c-87e1-4d18-aa90-182a159d5f80 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:05.565551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-00072b4b-f58e-4f03-bda9-6b8850c00285 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:05.571570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-00072b4b-f58e-4f03-bda9-6b8850c00285 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:05.590791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00072b4b-f58e-4f03-bda9-6b8850c00285 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:05.594513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00072b4b-f58e-4f03-bda9-6b8850c00285 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:05.595969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00072b4b-f58e-4f03-bda9-6b8850c00285 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:05.597466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00072b4b-f58e-4f03-bda9-6b8850c00285 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:05.607032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00072b4b-f58e-4f03-bda9-6b8850c00285 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:05.608218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00072b4b-f58e-4f03-bda9-6b8850c00285 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:05.770448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7c7782c-87e1-4d18-aa90-182a159d5f80 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:05.782712 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b7c7782c-87e1-4d18-aa90-182a159d5f80 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1682 microversion: 2.1 time: 0.458094 Oct 05 17:37:05.783939 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 753/1566] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:05 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1682 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:05.789118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fcabcb5b-da68-4246-93bb-0eccaa1afbfa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:05.790095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fcabcb5b-da68-4246-93bb-0eccaa1afbfa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:05.799701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcabcb5b-da68-4246-93bb-0eccaa1afbfa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:05.806064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcabcb5b-da68-4246-93bb-0eccaa1afbfa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:05.806956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcabcb5b-da68-4246-93bb-0eccaa1afbfa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:05.807935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcabcb5b-da68-4246-93bb-0eccaa1afbfa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:05.808607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcabcb5b-da68-4246-93bb-0eccaa1afbfa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:05.809240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcabcb5b-da68-4246-93bb-0eccaa1afbfa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:05.883319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-00072b4b-f58e-4f03-bda9-6b8850c00285 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:05.893340 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-00072b4b-f58e-4f03-bda9-6b8850c00285 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1468 microversion: 2.1 time: 0.334538 Oct 05 17:37:05.894033 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 814/1567] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:05 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:05.898927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:05.899616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:05.906505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:05.907022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:05.907839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:05.908303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:05.910804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:05.911818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:05.916834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:06.080883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:06.094269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:06.096252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:06.097699 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ba62416f-a250-4abf-917e-cfa7910ededd tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.202656 Oct 05 17:37:06.114309 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 815/1568] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:05 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:06.122799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7b5453a2-e58f-4185-a2ff-88ffed0d2fde tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:06.122799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7b5453a2-e58f-4185-a2ff-88ffed0d2fde tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:06.133311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b5453a2-e58f-4185-a2ff-88ffed0d2fde tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.133823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b5453a2-e58f-4185-a2ff-88ffed0d2fde tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.134430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b5453a2-e58f-4185-a2ff-88ffed0d2fde tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.135163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b5453a2-e58f-4185-a2ff-88ffed0d2fde tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.135892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b5453a2-e58f-4185-a2ff-88ffed0d2fde tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.136324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b5453a2-e58f-4185-a2ff-88ffed0d2fde tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.157086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fcabcb5b-da68-4246-93bb-0eccaa1afbfa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:06.167399 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fcabcb5b-da68-4246-93bb-0eccaa1afbfa tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1463 microversion: 2.1 time: 0.382163 Oct 05 17:37:06.176325 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 754/1569] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:05 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1463 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:06.208005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-848b9296-6658-43e8-88c3-b6d2488b63cb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:06.210602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-848b9296-6658-43e8-88c3-b6d2488b63cb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:06.224518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-848b9296-6658-43e8-88c3-b6d2488b63cb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.225068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-848b9296-6658-43e8-88c3-b6d2488b63cb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.225516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-848b9296-6658-43e8-88c3-b6d2488b63cb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.226250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-848b9296-6658-43e8-88c3-b6d2488b63cb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.227005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-848b9296-6658-43e8-88c3-b6d2488b63cb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.227437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-848b9296-6658-43e8-88c3-b6d2488b63cb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.323239 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-848b9296-6658-43e8-88c3-b6d2488b63cb tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action" status: 202 len: 0 microversion: 2.1 time: 0.119240 Oct 05 17:37:06.324676 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 755/1570] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:37:06 2022] POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:37:06.331116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-94241524-dea5-47fc-8918-ac3c8c3d2dae tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:06.332119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-94241524-dea5-47fc-8918-ac3c8c3d2dae tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:06.341189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94241524-dea5-47fc-8918-ac3c8c3d2dae tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.342181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94241524-dea5-47fc-8918-ac3c8c3d2dae tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.342895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94241524-dea5-47fc-8918-ac3c8c3d2dae tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.343804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94241524-dea5-47fc-8918-ac3c8c3d2dae tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.344491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94241524-dea5-47fc-8918-ac3c8c3d2dae tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.345156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94241524-dea5-47fc-8918-ac3c8c3d2dae tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.351842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7b5453a2-e58f-4185-a2ff-88ffed0d2fde tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:06.365540 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7b5453a2-e58f-4185-a2ff-88ffed0d2fde tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.265589 Oct 05 17:37:06.367679 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 816/1571] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:06 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:06.373719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:06.373878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:06.388468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.389022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.389558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.390310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.390776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.394601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.430090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.430894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.431548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.432268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lazy-loading 'fault' on Instance uuid 6321627d-1957-42b5-a223-da558b58bbdf {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:06.604394 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a8d19c63-68c6-4d8b-a896-56dea0c09a25 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1597 microversion: 2.1 time: 0.235796 Oct 05 17:37:06.604978 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 817/1572] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:06 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1597 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:06.623286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-94241524-dea5-47fc-8918-ac3c8c3d2dae tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:06.631251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02d86b51-034c-41b1-8dfa-10161ee12114 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:06.633653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02d86b51-034c-41b1-8dfa-10161ee12114 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:06.639602 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-94241524-dea5-47fc-8918-ac3c8c3d2dae tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.313319 Oct 05 17:37:06.640202 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 756/1573] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:06 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:06.658486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d86b51-034c-41b1-8dfa-10161ee12114 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.658985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d86b51-034c-41b1-8dfa-10161ee12114 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.659416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d86b51-034c-41b1-8dfa-10161ee12114 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.665749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d86b51-034c-41b1-8dfa-10161ee12114 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.667184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d86b51-034c-41b1-8dfa-10161ee12114 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.667635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d86b51-034c-41b1-8dfa-10161ee12114 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.767544 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02d86b51-034c-41b1-8dfa-10161ee12114 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action" status: 202 len: 0 microversion: 2.1 time: 0.141712 Oct 05 17:37:06.769015 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 818/1574] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:37:06 2022] POST /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:37:06.779619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-87ca088b-44d3-4318-bd31-26be5b46a4d6 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:06.780406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-87ca088b-44d3-4318-bd31-26be5b46a4d6 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:06.786616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87ca088b-44d3-4318-bd31-26be5b46a4d6 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.787095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87ca088b-44d3-4318-bd31-26be5b46a4d6 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.787658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87ca088b-44d3-4318-bd31-26be5b46a4d6 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.788823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87ca088b-44d3-4318-bd31-26be5b46a4d6 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.789426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87ca088b-44d3-4318-bd31-26be5b46a4d6 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.789995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87ca088b-44d3-4318-bd31-26be5b46a4d6 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.809763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7d5318eb-a2a1-4fa8-a02e-76ef48bf427d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:06.810435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7d5318eb-a2a1-4fa8-a02e-76ef48bf427d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:06.824102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d5318eb-a2a1-4fa8-a02e-76ef48bf427d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.824708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d5318eb-a2a1-4fa8-a02e-76ef48bf427d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.825309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d5318eb-a2a1-4fa8-a02e-76ef48bf427d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.826049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d5318eb-a2a1-4fa8-a02e-76ef48bf427d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:06.828458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d5318eb-a2a1-4fa8-a02e-76ef48bf427d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:06.828911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d5318eb-a2a1-4fa8-a02e-76ef48bf427d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:06.978837 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-87ca088b-44d3-4318-bd31-26be5b46a4d6 tempest-ServersAdminTestJSON-1029539515 tempest-ServersAdminTestJSON-1029539515-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1614 microversion: 2.1 time: 0.205885 Oct 05 17:37:07.002372 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 757/1575] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:06 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1614 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:07.005187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7d5318eb-a2a1-4fa8-a02e-76ef48bf427d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:07.014360 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7d5318eb-a2a1-4fa8-a02e-76ef48bf427d tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1682 microversion: 2.1 time: 0.209109 Oct 05 17:37:07.017324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-153575b7-4f13-4175-83b9-9d741c37279c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:07.018132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-153575b7-4f13-4175-83b9-9d741c37279c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:07.022764 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 819/1576] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:06 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:07.028136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-153575b7-4f13-4175-83b9-9d741c37279c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.028798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-153575b7-4f13-4175-83b9-9d741c37279c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.029408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-153575b7-4f13-4175-83b9-9d741c37279c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.030448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-153575b7-4f13-4175-83b9-9d741c37279c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.031120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-153575b7-4f13-4175-83b9-9d741c37279c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.031694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-153575b7-4f13-4175-83b9-9d741c37279c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.038232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c0a098fd-f1a9-4491-adc0-d78a803ec014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:07.038795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c0a098fd-f1a9-4491-adc0-d78a803ec014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:07.045274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a098fd-f1a9-4491-adc0-d78a803ec014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.045822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a098fd-f1a9-4491-adc0-d78a803ec014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.046258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a098fd-f1a9-4491-adc0-d78a803ec014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.047002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a098fd-f1a9-4491-adc0-d78a803ec014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.047457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a098fd-f1a9-4491-adc0-d78a803ec014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.047879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a098fd-f1a9-4491-adc0-d78a803ec014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.076537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c0a098fd-f1a9-4491-adc0-d78a803ec014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:37:07.197259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-153575b7-4f13-4175-83b9-9d741c37279c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:07.207013 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-153575b7-4f13-4175-83b9-9d741c37279c tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1468 microversion: 2.1 time: 0.203031 Oct 05 17:37:07.208040 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 758/1577] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:07 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1468 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:07.215711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:07.216708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:07.223444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.224123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.224781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.225710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.226452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.226929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.228841 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c0a098fd-f1a9-4491-adc0-d78a803ec014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "DELETE /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 204 len: 0 microversion: 2.1 time: 0.204732 Oct 05 17:37:07.229629 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 820/1578] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:37:07 2022] DELETE /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:37:07.240011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-697cb62b-7fb4-41f6-a6cf-9dc5deb859b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:07.240733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-697cb62b-7fb4-41f6-a6cf-9dc5deb859b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:07.248969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-697cb62b-7fb4-41f6-a6cf-9dc5deb859b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.249443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-697cb62b-7fb4-41f6-a6cf-9dc5deb859b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.249884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-697cb62b-7fb4-41f6-a6cf-9dc5deb859b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.250686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-697cb62b-7fb4-41f6-a6cf-9dc5deb859b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.251661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-697cb62b-7fb4-41f6-a6cf-9dc5deb859b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.251661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-697cb62b-7fb4-41f6-a6cf-9dc5deb859b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.385333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:07.395448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:07.397327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:07.398793 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cf32964b-2d04-4848-9a4b-b2f0903994b1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.189696 Oct 05 17:37:07.399621 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 759/1579] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:07 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:07.404540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ecd53889-f6ad-4c2a-9341-92b1ecc71e17 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:07.405418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ecd53889-f6ad-4c2a-9341-92b1ecc71e17 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:07.412099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecd53889-f6ad-4c2a-9341-92b1ecc71e17 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.412831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecd53889-f6ad-4c2a-9341-92b1ecc71e17 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.413433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecd53889-f6ad-4c2a-9341-92b1ecc71e17 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.414333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecd53889-f6ad-4c2a-9341-92b1ecc71e17 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.414949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecd53889-f6ad-4c2a-9341-92b1ecc71e17 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.415535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecd53889-f6ad-4c2a-9341-92b1ecc71e17 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.437682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-697cb62b-7fb4-41f6-a6cf-9dc5deb859b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:07.450448 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-697cb62b-7fb4-41f6-a6cf-9dc5deb859b8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1469 microversion: 2.1 time: 0.216043 Oct 05 17:37:07.452113 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 821/1580] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:07 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:07.568440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ecd53889-f6ad-4c2a-9341-92b1ecc71e17 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:07.577155 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ecd53889-f6ad-4c2a-9341-92b1ecc71e17 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.176141 Oct 05 17:37:07.578396 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 760/1581] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:07 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:07.667536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-476dd2b1-b840-4636-bd68-dce1a108a05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:07.668411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-476dd2b1-b840-4636-bd68-dce1a108a05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:07.676500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476dd2b1-b840-4636-bd68-dce1a108a05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.676994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476dd2b1-b840-4636-bd68-dce1a108a05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.677427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476dd2b1-b840-4636-bd68-dce1a108a05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.678105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476dd2b1-b840-4636-bd68-dce1a108a05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:07.678778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476dd2b1-b840-4636-bd68-dce1a108a05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:07.679199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476dd2b1-b840-4636-bd68-dce1a108a05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:07.829299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-476dd2b1-b840-4636-bd68-dce1a108a05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:07.837999 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-476dd2b1-b840-4636-bd68-dce1a108a05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.174438 Oct 05 17:37:07.853275 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 822/1582] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:07 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:08.041507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e282506-24dc-4a18-987a-6f00d8d665d1 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:08.042404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e282506-24dc-4a18-987a-6f00d8d665d1 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:08.048788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e282506-24dc-4a18-987a-6f00d8d665d1 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:08.050062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e282506-24dc-4a18-987a-6f00d8d665d1 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:08.050529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e282506-24dc-4a18-987a-6f00d8d665d1 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:08.053513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e282506-24dc-4a18-987a-6f00d8d665d1 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:08.053997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e282506-24dc-4a18-987a-6f00d8d665d1 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:08.054463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e282506-24dc-4a18-987a-6f00d8d665d1 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:08.206693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8e282506-24dc-4a18-987a-6f00d8d665d1 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:08.215169 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8e282506-24dc-4a18-987a-6f00d8d665d1 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1682 microversion: 2.1 time: 0.177714 Oct 05 17:37:08.215778 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 761/1583] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:08 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:08.231402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ba8824b-d677-4069-a0ce-ae0a67dce906 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:08.232016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ba8824b-d677-4069-a0ce-ae0a67dce906 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:08.239935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ba8824b-d677-4069-a0ce-ae0a67dce906 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:08.240559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ba8824b-d677-4069-a0ce-ae0a67dce906 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:08.240993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ba8824b-d677-4069-a0ce-ae0a67dce906 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:08.241690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ba8824b-d677-4069-a0ce-ae0a67dce906 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:08.242147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ba8824b-d677-4069-a0ce-ae0a67dce906 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:08.242606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ba8824b-d677-4069-a0ce-ae0a67dce906 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:08.438003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:08.440235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:08.461924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:08.462416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:08.463196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:08.464111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:08.464714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:08.465288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:08.613037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0ba8824b-d677-4069-a0ce-ae0a67dce906 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:08.621348 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ba8824b-d677-4069-a0ce-ae0a67dce906 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1468 microversion: 2.1 time: 0.393927 Oct 05 17:37:08.634351 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 823/1584] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:08 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1468 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:08.640522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0fc6b9f4-1c66-434b-86c9-997cc6d3a67e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:08.640522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0fc6b9f4-1c66-434b-86c9-997cc6d3a67e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:08.652861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fc6b9f4-1c66-434b-86c9-997cc6d3a67e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:08.653389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fc6b9f4-1c66-434b-86c9-997cc6d3a67e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:08.653811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fc6b9f4-1c66-434b-86c9-997cc6d3a67e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:08.654594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fc6b9f4-1c66-434b-86c9-997cc6d3a67e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:08.655112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fc6b9f4-1c66-434b-86c9-997cc6d3a67e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:08.655542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fc6b9f4-1c66-434b-86c9-997cc6d3a67e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:08.945057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:08.960710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:08.963700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:08.965032 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-98a10a83-4b42-472f-8aec-6347757c8720 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.542207 Oct 05 17:37:08.970414 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 762/1585] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:08 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:37:08.980351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1e37f76d-87c8-41fe-9c75-04661af5967a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:08.981130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1e37f76d-87c8-41fe-9c75-04661af5967a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:08.997188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e37f76d-87c8-41fe-9c75-04661af5967a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:08.998384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e37f76d-87c8-41fe-9c75-04661af5967a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:08.998981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e37f76d-87c8-41fe-9c75-04661af5967a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:08.999798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e37f76d-87c8-41fe-9c75-04661af5967a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:09.000340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e37f76d-87c8-41fe-9c75-04661af5967a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:09.000858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e37f76d-87c8-41fe-9c75-04661af5967a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:09.160918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0fc6b9f4-1c66-434b-86c9-997cc6d3a67e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:09.175578 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0fc6b9f4-1c66-434b-86c9-997cc6d3a67e tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1469 microversion: 2.1 time: 0.543737 Oct 05 17:37:09.207079 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 824/1586] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:08 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1469 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:09.212254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f10ec982-9f75-449d-ac8a-3ce503e80e9b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:09.213175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f10ec982-9f75-449d-ac8a-3ce503e80e9b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:09.257391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10ec982-9f75-449d-ac8a-3ce503e80e9b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:09.258181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10ec982-9f75-449d-ac8a-3ce503e80e9b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:09.259745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10ec982-9f75-449d-ac8a-3ce503e80e9b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:09.261476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10ec982-9f75-449d-ac8a-3ce503e80e9b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:09.266061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10ec982-9f75-449d-ac8a-3ce503e80e9b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:09.266757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10ec982-9f75-449d-ac8a-3ce503e80e9b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:09.449014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1e37f76d-87c8-41fe-9c75-04661af5967a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:09.457964 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1e37f76d-87c8-41fe-9c75-04661af5967a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.489496 Oct 05 17:37:09.471623 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 763/1587] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:08 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:09.476759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f6220160-f998-481d-a76b-b27cd36797c2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:09.477565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f6220160-f998-481d-a76b-b27cd36797c2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:09.488354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6220160-f998-481d-a76b-b27cd36797c2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:09.488864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6220160-f998-481d-a76b-b27cd36797c2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:09.489301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6220160-f998-481d-a76b-b27cd36797c2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:09.490011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6220160-f998-481d-a76b-b27cd36797c2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:09.498715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6220160-f998-481d-a76b-b27cd36797c2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:09.499267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6220160-f998-481d-a76b-b27cd36797c2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:09.511958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f10ec982-9f75-449d-ac8a-3ce503e80e9b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:09.522199 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f10ec982-9f75-449d-ac8a-3ce503e80e9b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.313760 Oct 05 17:37:09.541593 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 825/1588] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:09 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:09.648036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a2ac4e27-83a3-4a9c-b7b2-5d7f54bb0943 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:09.649038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a2ac4e27-83a3-4a9c-b7b2-5d7f54bb0943 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:09.655622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ac4e27-83a3-4a9c-b7b2-5d7f54bb0943 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:09.656475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ac4e27-83a3-4a9c-b7b2-5d7f54bb0943 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:09.657123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ac4e27-83a3-4a9c-b7b2-5d7f54bb0943 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:09.658059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ac4e27-83a3-4a9c-b7b2-5d7f54bb0943 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:09.658766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ac4e27-83a3-4a9c-b7b2-5d7f54bb0943 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:09.659401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ac4e27-83a3-4a9c-b7b2-5d7f54bb0943 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:09.948928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a2ac4e27-83a3-4a9c-b7b2-5d7f54bb0943 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:09.959729 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a2ac4e27-83a3-4a9c-b7b2-5d7f54bb0943 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1468 microversion: 2.1 time: 0.315671 Oct 05 17:37:09.960270 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 826/1589] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:09 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1468 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:09.993412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:09.994352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:10.004017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:10.006473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:10.007173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:10.009412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:10.011280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:10.012624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:10.051796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f6220160-f998-481d-a76b-b27cd36797c2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:10.088339 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f6220160-f998-481d-a76b-b27cd36797c2 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1682 microversion: 2.1 time: 0.615251 Oct 05 17:37:10.095335 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 764/1590] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:09 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1682 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:10.198138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-45dd0b23-13be-4363-acd5-c676e3cafe73 req-30f58225-1672-4dad-846c-d89169e0cc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6f8884c-4ca4-429c-aa7b-df2fc97a928c", "name": "network-vif-deleted", "tag": "a18e8b53-aade-42fb-9dfa-55dfdd67d235"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:10.223288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-45dd0b23-13be-4363-acd5-c676e3cafe73 req-30f58225-1672-4dad-846c-d89169e0cc35 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:10.226865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-45dd0b23-13be-4363-acd5-c676e3cafe73 req-30f58225-1672-4dad-846c-d89169e0cc35 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:10.227474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-45dd0b23-13be-4363-acd5-c676e3cafe73 req-30f58225-1672-4dad-846c-d89169e0cc35 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:10.236999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:10.272440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:10.274020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:10.276349 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-45dd0b23-13be-4363-acd5-c676e3cafe73 req-30f58225-1672-4dad-846c-d89169e0cc35 service nova] Creating event network-vif-deleted:a18e8b53-aade-42fb-9dfa-55dfdd67d235 for instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c on n-h2-835595-3 Oct 05 17:37:10.279389 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c78bdeb6-897e-494d-b702-c30426d0820b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1813 microversion: 2.25 time: 0.290232 Oct 05 17:37:10.280423 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 827/1591] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:09 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1813 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:10.294438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cc2e123d-5c71-4cc4-9fef-792d5913bdd8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:10.294438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cc2e123d-5c71-4cc4-9fef-792d5913bdd8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:10.294690 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-45dd0b23-13be-4363-acd5-c676e3cafe73 req-30f58225-1672-4dad-846c-d89169e0cc35 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096041 Oct 05 17:37:10.294690 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 765/1592] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:37:10.331608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc2e123d-5c71-4cc4-9fef-792d5913bdd8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:10.332233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc2e123d-5c71-4cc4-9fef-792d5913bdd8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:10.332678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc2e123d-5c71-4cc4-9fef-792d5913bdd8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:10.333436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc2e123d-5c71-4cc4-9fef-792d5913bdd8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:10.333901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc2e123d-5c71-4cc4-9fef-792d5913bdd8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:10.334355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc2e123d-5c71-4cc4-9fef-792d5913bdd8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:10.357594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:10.495803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da198b89-746d-4e77-8c74-c460fd1cc34c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:10.497230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da198b89-746d-4e77-8c74-c460fd1cc34c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:10.508167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cc2e123d-5c71-4cc4-9fef-792d5913bdd8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:10.523646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da198b89-746d-4e77-8c74-c460fd1cc34c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:10.529632 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cc2e123d-5c71-4cc4-9fef-792d5913bdd8 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 200 len: 1427 microversion: 2.1 time: 0.247602 Oct 05 17:37:10.530439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da198b89-746d-4e77-8c74-c460fd1cc34c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:10.531207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da198b89-746d-4e77-8c74-c460fd1cc34c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:10.532206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da198b89-746d-4e77-8c74-c460fd1cc34c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:10.541077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da198b89-746d-4e77-8c74-c460fd1cc34c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:10.541904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da198b89-746d-4e77-8c74-c460fd1cc34c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:10.551531 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 828/1593] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:10 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 1427 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:10.559203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5cb7655e-2b4d-4a53-ad17-b5445bb1bcc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:10.567712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5cb7655e-2b4d-4a53-ad17-b5445bb1bcc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:10.598816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb7655e-2b4d-4a53-ad17-b5445bb1bcc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:10.599280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb7655e-2b4d-4a53-ad17-b5445bb1bcc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:10.599733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb7655e-2b4d-4a53-ad17-b5445bb1bcc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:10.600571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb7655e-2b4d-4a53-ad17-b5445bb1bcc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:10.600978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb7655e-2b4d-4a53-ad17-b5445bb1bcc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:10.601405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5cb7655e-2b4d-4a53-ad17-b5445bb1bcc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:10.965658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5cb7655e-2b4d-4a53-ad17-b5445bb1bcc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:10.976211 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5cb7655e-2b4d-4a53-ad17-b5445bb1bcc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.422258 Oct 05 17:37:10.976800 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 829/1594] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:10 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:10.999334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:11.000781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:11.009129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.009789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.010405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.011345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.011954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.012554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.071681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.072405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.073048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.074085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lazy-loading 'fault' on Instance uuid b6f8884c-4ca4-429c-aa7b-df2fc97a928c {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:11.131301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:11.141196 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c955a20e-765f-44b8-9548-add5b1312ee2 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 200 len: 1303 microversion: 2.1 time: 0.146059 Oct 05 17:37:11.143001 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 830/1595] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:10 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:11.148972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f98c66da-962b-483c-97de-26993676cca7 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:11.149842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f98c66da-962b-483c-97de-26993676cca7 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:11.158303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f98c66da-962b-483c-97de-26993676cca7 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.159133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f98c66da-962b-483c-97de-26993676cca7 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.159772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f98c66da-962b-483c-97de-26993676cca7 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.160657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f98c66da-962b-483c-97de-26993676cca7 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.161270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f98c66da-962b-483c-97de-26993676cca7 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.161937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f98c66da-962b-483c-97de-26993676cca7 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.324930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f98c66da-962b-483c-97de-26993676cca7 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:11.338792 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f98c66da-962b-483c-97de-26993676cca7 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1614 microversion: 2.1 time: 0.194390 Oct 05 17:37:11.339391 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 831/1596] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:11 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1614 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:11.362342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:11.362984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:11.371598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.372526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.376085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.377045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.377684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.378270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.602384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:11.617090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:11.618193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:11.619996 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dc89c9ba-a6dd-4b4d-a1e5-f83c190ffa92 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1803 microversion: 2.25 time: 0.267875 Oct 05 17:37:11.622670 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 832/1597] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:11 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1803 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:11.636223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:11.638250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 09ed8f88-a944-458d-8c5a-5264bce6dad6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:11.650503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:11.654732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.655700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.657402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.658896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.660140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.661384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.705509 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] HTTP exception thrown: Instance 09ed8f88-a944-458d-8c5a-5264bce6dad6 could not be found. Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Request method failure captured: Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 HTTP/1.1 Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcAyhQzsR1g3Z9PIjReuZKMBl-sMQOulT_gDlsWNlY2mzl5ZVY5G2Hw6Imp0LGrevU0WbCDNea5ghCqYwFq4KpZbYCG3bINQ5hkVzcqPe6OjqZB9exkj07974Gev6j-UYbdd9UaUd4qBdgUr8FNbyRQB-jPqn8c1nXbJktp77oWLQM4 Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 1c79b829a6194b7fbfe07a1c77cd2464 Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersAdminTestJSON-693287786 Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:37:11.708339 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1c79b829a6194b7fbfe07a1c77cd2464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1c79b829a6194b7fbfe07a1c77cd2464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1c79b829a6194b7fbfe07a1c77cd2464", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1c79b829a6194b7fbfe07a1c77cd2464"}]}] Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersAdminTestJSON-693287786 Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 1c79b829a6194b7fbfe07a1c77cd2464 Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersAdminTestJSON-693287786 Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersAdminTestJSON-693287786-project Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0683f65832f146b0bb85a984370186be Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersAdminTestJSON-693287786-project Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 09ed8f88-a944-458d-8c5a-5264bce6dad6 could not be found. Oct 05 17:37:11.709876 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '09ed8f88-a944-458d-8c5a-5264bce6dad6'} Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ed8f88-a944-458d-8c5a-5264bce6dad6 could not be found. Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:37:11.710804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ed8f88-a944-458d-8c5a-5264bce6dad6 could not be found. Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ed8f88-a944-458d-8c5a-5264bce6dad6 could not be found. Oct 05 17:37:11.714515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:11.717638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Returning 404 to user: Instance 09ed8f88-a944-458d-8c5a-5264bce6dad6 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:37:11.717638 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3974e137-bcb4-4fcb-a80d-7aa190796fb9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6" status: 404 len: 111 microversion: 2.1 time: 0.087321 Oct 05 17:37:11.717638 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 833/1598] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:11 2022] GET /compute/v2.1/servers/09ed8f88-a944-458d-8c5a-5264bce6dad6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:37:11.727085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ff190ca-8423-4bc5-ba2b-5073e8fb476b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '.version_select at 0x7f77753e8310>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:11.731123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ff190ca-8423-4bc5-ba2b-5073e8fb476b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.731639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ff190ca-8423-4bc5-ba2b-5073e8fb476b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.732174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ff190ca-8423-4bc5-ba2b-5073e8fb476b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.746309 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ff190ca-8423-4bc5-ba2b-5073e8fb476b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1944 microversion: 2.25 time: 0.027600 Oct 05 17:37:11.747210 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 834/1599] 10.222.0.70 () {60 vars in 1184 bytes} [Wed Oct 5 17:37:11 2022] GET /compute/v2.1/os-migrations => generated 1944 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:11.752549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-80bb202c-4440-4c3a-803d-898696eb91b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:11.753318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-80bb202c-4440-4c3a-803d-898696eb91b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:11.760511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80bb202c-4440-4c3a-803d-898696eb91b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.761306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80bb202c-4440-4c3a-803d-898696eb91b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.761785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80bb202c-4440-4c3a-803d-898696eb91b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.762926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80bb202c-4440-4c3a-803d-898696eb91b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.763582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80bb202c-4440-4c3a-803d-898696eb91b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.764233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80bb202c-4440-4c3a-803d-898696eb91b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.798263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-80bb202c-4440-4c3a-803d-898696eb91b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:37:11.877513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-da198b89-746d-4e77-8c74-c460fd1cc34c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:11.885046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:11.888079 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da198b89-746d-4e77-8c74-c460fd1cc34c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 1.398061 Oct 05 17:37:11.904527 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 766/1600] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:10 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:11.909770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b00bc83-7e1c-422e-bb6b-d1317ac26169 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:11.911893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5b00bc83-7e1c-422e-bb6b-d1317ac26169 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:11.919456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b00bc83-7e1c-422e-bb6b-d1317ac26169 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.920290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b00bc83-7e1c-422e-bb6b-d1317ac26169 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.921265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b00bc83-7e1c-422e-bb6b-d1317ac26169 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.923495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b00bc83-7e1c-422e-bb6b-d1317ac26169 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.924737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b00bc83-7e1c-422e-bb6b-d1317ac26169 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.926424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b00bc83-7e1c-422e-bb6b-d1317ac26169 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.927587 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-80bb202c-4440-4c3a-803d-898696eb91b9 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 204 len: 0 microversion: 2.1 time: 0.178891 Oct 05 17:37:11.928187 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 835/1601] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:37:11 2022] DELETE /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:37:11.946174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21378a7b-638c-41e3-a2ed-c3fe4b356a8d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:11.946942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21378a7b-638c-41e3-a2ed-c3fe4b356a8d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:11.961568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21378a7b-638c-41e3-a2ed-c3fe4b356a8d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.962092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21378a7b-638c-41e3-a2ed-c3fe4b356a8d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.962558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21378a7b-638c-41e3-a2ed-c3fe4b356a8d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:11.969397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21378a7b-638c-41e3-a2ed-c3fe4b356a8d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:11.969980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21378a7b-638c-41e3-a2ed-c3fe4b356a8d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:11.970454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21378a7b-638c-41e3-a2ed-c3fe4b356a8d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.158632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21378a7b-638c-41e3-a2ed-c3fe4b356a8d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:12.169620 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21378a7b-638c-41e3-a2ed-c3fe4b356a8d tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1469 microversion: 2.1 time: 0.234677 Oct 05 17:37:12.172187 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 836/1602] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:11 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1469 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:12.177485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7426f198-442a-4d65-9924-1cdf7d91568b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:12.178453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7426f198-442a-4d65-9924-1cdf7d91568b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:12.197760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7426f198-442a-4d65-9924-1cdf7d91568b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.198269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7426f198-442a-4d65-9924-1cdf7d91568b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.204201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7426f198-442a-4d65-9924-1cdf7d91568b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.206700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7426f198-442a-4d65-9924-1cdf7d91568b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.207217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7426f198-442a-4d65-9924-1cdf7d91568b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.207659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7426f198-442a-4d65-9924-1cdf7d91568b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.254678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-5b00bc83-7e1c-422e-bb6b-d1317ac26169 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid a63958af-abf6-42db-be31-d666ae842191 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:12.271590 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b00bc83-7e1c-422e-bb6b-d1317ac26169 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 2421 microversion: 2.25 time: 0.365532 Oct 05 17:37:12.272482 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 767/1603] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:11 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 2421 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:12.277999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:12.278891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b6f8884c-4ca4-429c-aa7b-df2fc97a928c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:12.285832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.286714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.287317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.288287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.288938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.289520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.317456 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] HTTP exception thrown: Instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c could not be found. Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Request method failure captured: Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c HTTP/1.1 Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-eK08n4ubXHJuqfUk83qu8miLN4lCyPwZAF1o9Bzmf7bQI5wmD0Qlm5-gv5b1FFLhasa_6LfBKPOLiyAx2SQMs-djP-iXweC4cYqbBrq32cw7plgEVezliV8ZXZh5LCwLeHlvyajYmipSWf0Dqo5gsl-4fy_uVDDCdWDgazp566H8 Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: afc6422679664e47892eef7185291846 Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-MigrationsAdminTest-311365351 Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:37:12.319502 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/afc6422679664e47892eef7185291846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc6422679664e47892eef7185291846"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_afc6422679664e47892eef7185291846", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc6422679664e47892eef7185291846"}]}] Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-MigrationsAdminTest-311365351 Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: afc6422679664e47892eef7185291846 Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-MigrationsAdminTest-311365351 Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-MigrationsAdminTest-311365351-project Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 15a6bfffd8fb473b83de94858676f8ed Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-MigrationsAdminTest-311365351-project Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c could not be found. Oct 05 17:37:12.321168 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'b6f8884c-4ca4-429c-aa7b-df2fc97a928c'} Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c could not be found. Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:37:12.322087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c could not be found. Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c could not be found. Oct 05 17:37:12.323662 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:12.325773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Returning 404 to user: Instance b6f8884c-4ca4-429c-aa7b-df2fc97a928c could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:37:12.327217 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-73e9eb94-97a1-4057-a3df-22d838b10612 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c" status: 404 len: 111 microversion: 2.1 time: 0.053509 Oct 05 17:37:12.328325 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 768/1604] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:12 2022] GET /compute/v2.1/servers/b6f8884c-4ca4-429c-aa7b-df2fc97a928c => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:37:12.333208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e89dc16-3500-41ba-b5c4-38e7de414ede tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:12.334035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e89dc16-3500-41ba-b5c4-38e7de414ede tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:12.341248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e89dc16-3500-41ba-b5c4-38e7de414ede tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.341934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e89dc16-3500-41ba-b5c4-38e7de414ede tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.342662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e89dc16-3500-41ba-b5c4-38e7de414ede tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.343552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e89dc16-3500-41ba-b5c4-38e7de414ede tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.344168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e89dc16-3500-41ba-b5c4-38e7de414ede tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.344756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e89dc16-3500-41ba-b5c4-38e7de414ede tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.424898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7426f198-442a-4d65-9924-1cdf7d91568b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:12.435776 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7426f198-442a-4d65-9924-1cdf7d91568b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.262232 Oct 05 17:37:12.436963 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 837/1605] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:12 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:12.452594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-56be8861-9651-48a9-aec0-48ebd6df38fe req-bb546b48-ccb5-4a4e-b6a9-cf0c98df7794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ed8f88-a944-458d-8c5a-5264bce6dad6", "name": "network-vif-deleted", "tag": "b64c94bd-1f5c-4c74-b4ca-f8d4b3407486"}, {"server_uuid": "df1c2e18-968f-4926-a47b-8e73ea54b4fa", "name": "network-vif-deleted", "tag": "d8268a63-1db3-4a60-8640-16a2a12e466b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:12.466597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-56be8861-9651-48a9-aec0-48ebd6df38fe req-bb546b48-ccb5-4a4e-b6a9-cf0c98df7794 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.467272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-56be8861-9651-48a9-aec0-48ebd6df38fe req-bb546b48-ccb5-4a4e-b6a9-cf0c98df7794 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.467805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-56be8861-9651-48a9-aec0-48ebd6df38fe req-bb546b48-ccb5-4a4e-b6a9-cf0c98df7794 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.491266 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-56be8861-9651-48a9-aec0-48ebd6df38fe req-bb546b48-ccb5-4a4e-b6a9-cf0c98df7794 service nova] Creating event network-vif-deleted:b64c94bd-1f5c-4c74-b4ca-f8d4b3407486 for instance 09ed8f88-a944-458d-8c5a-5264bce6dad6 on n-h1-835595-3 Oct 05 17:37:12.491941 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-56be8861-9651-48a9-aec0-48ebd6df38fe req-bb546b48-ccb5-4a4e-b6a9-cf0c98df7794 service nova] Creating event network-vif-deleted:d8268a63-1db3-4a60-8640-16a2a12e466b for instance df1c2e18-968f-4926-a47b-8e73ea54b4fa on n-h2-835595-3 Oct 05 17:37:12.503015 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-56be8861-9651-48a9-aec0-48ebd6df38fe req-bb546b48-ccb5-4a4e-b6a9-cf0c98df7794 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064620 Oct 05 17:37:12.503941 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 838/1606] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:12.509625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4b50eaee-9681-44e7-890e-38f1131759b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:12.510354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4b50eaee-9681-44e7-890e-38f1131759b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:12.518532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b50eaee-9681-44e7-890e-38f1131759b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.519132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b50eaee-9681-44e7-890e-38f1131759b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.519888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b50eaee-9681-44e7-890e-38f1131759b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.520657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b50eaee-9681-44e7-890e-38f1131759b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.521377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b50eaee-9681-44e7-890e-38f1131759b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.521939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b50eaee-9681-44e7-890e-38f1131759b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.564968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-2e89dc16-3500-41ba-b5c4-38e7de414ede tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid a63958af-abf6-42db-be31-d666ae842191 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:12.580731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4b50eaee-9681-44e7-890e-38f1131759b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:37:12.584589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e89dc16-3500-41ba-b5c4-38e7de414ede tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 2421 microversion: 2.25 time: 0.254793 Oct 05 17:37:12.598303 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 769/1607] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:12 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 2421 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:12.598303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ce3de4b6-44f5-4f97-9f89-ff1c5a9495dc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:12.598303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ce3de4b6-44f5-4f97-9f89-ff1c5a9495dc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:12.600532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce3de4b6-44f5-4f97-9f89-ff1c5a9495dc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.601338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce3de4b6-44f5-4f97-9f89-ff1c5a9495dc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.602018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce3de4b6-44f5-4f97-9f89-ff1c5a9495dc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.602930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce3de4b6-44f5-4f97-9f89-ff1c5a9495dc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.603587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce3de4b6-44f5-4f97-9f89-ff1c5a9495dc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.604152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce3de4b6-44f5-4f97-9f89-ff1c5a9495dc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.741773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ce3de4b6-44f5-4f97-9f89-ff1c5a9495dc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:12.753693 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ce3de4b6-44f5-4f97-9f89-ff1c5a9495dc tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1614 microversion: 2.1 time: 0.166610 Oct 05 17:37:12.755138 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 770/1608] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:12 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1614 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:12.761516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c891b0f-54ff-4757-bcf6-51a518a06763 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:12.762624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c891b0f-54ff-4757-bcf6-51a518a06763 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:12.765771 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4b50eaee-9681-44e7-890e-38f1131759b0 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 204 len: 0 microversion: 2.1 time: 0.260262 Oct 05 17:37:12.769482 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 839/1609] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:37:12 2022] DELETE /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:37:12.772271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c891b0f-54ff-4757-bcf6-51a518a06763 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.772767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c891b0f-54ff-4757-bcf6-51a518a06763 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.773297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c891b0f-54ff-4757-bcf6-51a518a06763 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.774289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c891b0f-54ff-4757-bcf6-51a518a06763 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.774769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c891b0f-54ff-4757-bcf6-51a518a06763 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.775384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c891b0f-54ff-4757-bcf6-51a518a06763 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.775696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7998c15c-041e-4f40-b25d-39dd1a8ec12f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:12.776416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7998c15c-041e-4f40-b25d-39dd1a8ec12f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:12.787515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7998c15c-041e-4f40-b25d-39dd1a8ec12f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.788014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7998c15c-041e-4f40-b25d-39dd1a8ec12f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.791558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7998c15c-041e-4f40-b25d-39dd1a8ec12f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.792373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7998c15c-041e-4f40-b25d-39dd1a8ec12f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:12.792862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7998c15c-041e-4f40-b25d-39dd1a8ec12f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:12.793304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7998c15c-041e-4f40-b25d-39dd1a8ec12f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:12.897870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-6c891b0f-54ff-4757-bcf6-51a518a06763 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lazy-loading 'services' on Instance uuid a63958af-abf6-42db-be31-d666ae842191 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:13.000924 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c891b0f-54ff-4757-bcf6-51a518a06763 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments/9bcd21b1-ecd8-4785-86ab-1f2ff730f07c" status: 202 len: 0 microversion: 2.25 time: 0.244770 Oct 05 17:37:13.001836 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 771/1610] 10.222.0.70 () {60 vars in 1457 bytes} [Wed Oct 5 17:37:12 2022] DELETE /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments/9bcd21b1-ecd8-4785-86ab-1f2ff730f07c => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:37:13.012635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7998c15c-041e-4f40-b25d-39dd1a8ec12f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:13.022690 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7998c15c-041e-4f40-b25d-39dd1a8ec12f tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1468 microversion: 2.1 time: 0.251573 Oct 05 17:37:13.035923 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 840/1611] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:12 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1468 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:13.047081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e2bd86ae-ac70-4d1e-9dee-228456a81cef tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:13.047796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e2bd86ae-ac70-4d1e-9dee-228456a81cef tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:13.055174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2bd86ae-ac70-4d1e-9dee-228456a81cef tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.056050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2bd86ae-ac70-4d1e-9dee-228456a81cef tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.056580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2bd86ae-ac70-4d1e-9dee-228456a81cef tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.057386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2bd86ae-ac70-4d1e-9dee-228456a81cef tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.057918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2bd86ae-ac70-4d1e-9dee-228456a81cef tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.058442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2bd86ae-ac70-4d1e-9dee-228456a81cef tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.099667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-bfeedd8c-b3ba-4911-99ae-16aedb116976 req-0303dac2-2e4e-48f1-8110-3794afec52f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586258bf-c661-4819-804b-504089c77dc6", "name": "network-vif-plugged", "status": "completed", "tag": "cfd34f5d-5af2-4330-b921-2091d3e274be"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:13.110162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bfeedd8c-b3ba-4911-99ae-16aedb116976 req-0303dac2-2e4e-48f1-8110-3794afec52f4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.110997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bfeedd8c-b3ba-4911-99ae-16aedb116976 req-0303dac2-2e4e-48f1-8110-3794afec52f4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.111423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bfeedd8c-b3ba-4911-99ae-16aedb116976 req-0303dac2-2e4e-48f1-8110-3794afec52f4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.127274 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-bfeedd8c-b3ba-4911-99ae-16aedb116976 req-0303dac2-2e4e-48f1-8110-3794afec52f4 service nova] Creating event network-vif-plugged:cfd34f5d-5af2-4330-b921-2091d3e274be for instance 586258bf-c661-4819-804b-504089c77dc6 on n-h2-835595-3 Oct 05 17:37:13.134620 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-bfeedd8c-b3ba-4911-99ae-16aedb116976 req-0303dac2-2e4e-48f1-8110-3794afec52f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131157 Oct 05 17:37:13.136042 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 772/1612] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:13.145388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d1100307-cad2-4dbd-b55c-5ee59d84db5a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:13.148044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d1100307-cad2-4dbd-b55c-5ee59d84db5a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:13.154674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1100307-cad2-4dbd-b55c-5ee59d84db5a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.155168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1100307-cad2-4dbd-b55c-5ee59d84db5a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.155599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1100307-cad2-4dbd-b55c-5ee59d84db5a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.156310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1100307-cad2-4dbd-b55c-5ee59d84db5a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.156762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1100307-cad2-4dbd-b55c-5ee59d84db5a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.157377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1100307-cad2-4dbd-b55c-5ee59d84db5a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.202581 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d1100307-cad2-4dbd-b55c-5ee59d84db5a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064039 Oct 05 17:37:13.203472 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 773/1613] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 17:37:13 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:37:13.208601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dbd120e0-a236-47ff-8053-1d710e1f330c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:13.209234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dbd120e0-a236-47ff-8053-1d710e1f330c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:13.217075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbd120e0-a236-47ff-8053-1d710e1f330c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.218191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbd120e0-a236-47ff-8053-1d710e1f330c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.218191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbd120e0-a236-47ff-8053-1d710e1f330c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.219694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbd120e0-a236-47ff-8053-1d710e1f330c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.220590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbd120e0-a236-47ff-8053-1d710e1f330c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.221033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbd120e0-a236-47ff-8053-1d710e1f330c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.270601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e2bd86ae-ac70-4d1e-9dee-228456a81cef tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:13.294925 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e2bd86ae-ac70-4d1e-9dee-228456a81cef tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.253124 Oct 05 17:37:13.310510 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 841/1614] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:13 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:13.426312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dbd120e0-a236-47ff-8053-1d710e1f330c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:13.437528 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dbd120e0-a236-47ff-8053-1d710e1f330c tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1469 microversion: 2.1 time: 0.232783 Oct 05 17:37:13.438200 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 774/1615] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:13 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1469 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:13.461326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36e08fff-1d45-4cdd-938f-39d312abd1d2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:13.461948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-36e08fff-1d45-4cdd-938f-39d312abd1d2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:13.468304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36e08fff-1d45-4cdd-938f-39d312abd1d2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.468790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36e08fff-1d45-4cdd-938f-39d312abd1d2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.469220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36e08fff-1d45-4cdd-938f-39d312abd1d2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.469928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36e08fff-1d45-4cdd-938f-39d312abd1d2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.470409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36e08fff-1d45-4cdd-938f-39d312abd1d2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.471175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36e08fff-1d45-4cdd-938f-39d312abd1d2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.721566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-36e08fff-1d45-4cdd-938f-39d312abd1d2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:13.734601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-36e08fff-1d45-4cdd-938f-39d312abd1d2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.276944 Oct 05 17:37:13.751339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 842/1616] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:13 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:13.784413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:13.785087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:13.808303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.808303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.808303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.808303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.808775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.808775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.865990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:13.867135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:13.867782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:13.868448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lazy-loading 'fault' on Instance uuid df1c2e18-968f-4926-a47b-8e73ea54b4fa {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:13.995904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:14.015408 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c68ad250-f37a-41aa-a365-c28f27c480ed tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1331 microversion: 2.1 time: 0.237853 Oct 05 17:37:14.016003 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 775/1617] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:13 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1331 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:14.054740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d25a50a-4b1e-445a-abb9-699896a80191 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:14.055586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d25a50a-4b1e-445a-abb9-699896a80191 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:14.063793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d25a50a-4b1e-445a-abb9-699896a80191 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.064847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d25a50a-4b1e-445a-abb9-699896a80191 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.065378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d25a50a-4b1e-445a-abb9-699896a80191 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:14.066180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d25a50a-4b1e-445a-abb9-699896a80191 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.066756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d25a50a-4b1e-445a-abb9-699896a80191 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.067409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d25a50a-4b1e-445a-abb9-699896a80191 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:14.082846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:14.215901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4069f099-58a9-4cca-9317-9ad9ce53ca69 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:14.234410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4069f099-58a9-4cca-9317-9ad9ce53ca69 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:14.249159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4069f099-58a9-4cca-9317-9ad9ce53ca69 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.249745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4069f099-58a9-4cca-9317-9ad9ce53ca69 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.250548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4069f099-58a9-4cca-9317-9ad9ce53ca69 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:14.251409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4069f099-58a9-4cca-9317-9ad9ce53ca69 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.252440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4069f099-58a9-4cca-9317-9ad9ce53ca69 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.253338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4069f099-58a9-4cca-9317-9ad9ce53ca69 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:14.263860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3d25a50a-4b1e-445a-abb9-699896a80191 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:14.272145 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d25a50a-4b1e-445a-abb9-699896a80191 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1468 microversion: 2.1 time: 0.223934 Oct 05 17:37:14.272942 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 843/1618] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:14 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1468 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:14.319963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-765597a6-ee69-474d-86dc-f884d9558824 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:14.320576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-765597a6-ee69-474d-86dc-f884d9558824 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:14.333922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-765597a6-ee69-474d-86dc-f884d9558824 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.334749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-765597a6-ee69-474d-86dc-f884d9558824 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.335349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-765597a6-ee69-474d-86dc-f884d9558824 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:14.336256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-765597a6-ee69-474d-86dc-f884d9558824 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.337006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-765597a6-ee69-474d-86dc-f884d9558824 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.337711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-765597a6-ee69-474d-86dc-f884d9558824 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:14.353133 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4069f099-58a9-4cca-9317-9ad9ce53ca69 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141414 Oct 05 17:37:14.363291 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 776/1619] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 17:37:14 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:37:14.466437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c7396fa-e8d5-48b0-a568-7274347f7177 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:14.467388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3c7396fa-e8d5-48b0-a568-7274347f7177 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:14.481891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c7396fa-e8d5-48b0-a568-7274347f7177 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.482523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c7396fa-e8d5-48b0-a568-7274347f7177 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.491685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c7396fa-e8d5-48b0-a568-7274347f7177 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:14.492561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c7396fa-e8d5-48b0-a568-7274347f7177 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.493137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c7396fa-e8d5-48b0-a568-7274347f7177 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.493577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c7396fa-e8d5-48b0-a568-7274347f7177 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:14.634040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-765597a6-ee69-474d-86dc-f884d9558824 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:14.665932 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-765597a6-ee69-474d-86dc-f884d9558824 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.349863 Oct 05 17:37:14.670396 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 844/1620] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:14 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:14.684056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-543c53f3-20b0-43f0-a345-5a14bbe3ed2a req-a46e1216-3f2b-4915-b617-f5c22892bf98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3dfaed00-73fb-45f1-8690-fd6cd745ec22", "name": "network-vif-deleted", "tag": "9cabd191-2500-4d11-a1fb-9ebe696a3704"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:14.696807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-543c53f3-20b0-43f0-a345-5a14bbe3ed2a req-a46e1216-3f2b-4915-b617-f5c22892bf98 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.697581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-543c53f3-20b0-43f0-a345-5a14bbe3ed2a req-a46e1216-3f2b-4915-b617-f5c22892bf98 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.698248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-543c53f3-20b0-43f0-a345-5a14bbe3ed2a req-a46e1216-3f2b-4915-b617-f5c22892bf98 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:14.709201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3c7396fa-e8d5-48b0-a568-7274347f7177 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:14.712430 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-543c53f3-20b0-43f0-a345-5a14bbe3ed2a req-a46e1216-3f2b-4915-b617-f5c22892bf98 service nova] Creating event network-vif-deleted:9cabd191-2500-4d11-a1fb-9ebe696a3704 for instance 3dfaed00-73fb-45f1-8690-fd6cd745ec22 on n-h2-835595-3 Oct 05 17:37:14.718881 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-543c53f3-20b0-43f0-a345-5a14bbe3ed2a req-a46e1216-3f2b-4915-b617-f5c22892bf98 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046916 Oct 05 17:37:14.719193 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c7396fa-e8d5-48b0-a568-7274347f7177 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1427 microversion: 2.1 time: 0.259848 Oct 05 17:37:14.719690 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 777/1621] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:14 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1427 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:14.720477 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 845/1622] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:14.759693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-59a5e0f6-a261-4276-90f9-d84164109621 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:14.760321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-59a5e0f6-a261-4276-90f9-d84164109621 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:14.769957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59a5e0f6-a261-4276-90f9-d84164109621 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.770504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59a5e0f6-a261-4276-90f9-d84164109621 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.770947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59a5e0f6-a261-4276-90f9-d84164109621 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:14.771666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59a5e0f6-a261-4276-90f9-d84164109621 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:14.772123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59a5e0f6-a261-4276-90f9-d84164109621 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:14.772550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59a5e0f6-a261-4276-90f9-d84164109621 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.039326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:15.039956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:15.057420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.057924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.058390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.059118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.059575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.060002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.160370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.160863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.161300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.161755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lazy-loading 'fault' on Instance uuid df1c2e18-968f-4926-a47b-8e73ea54b4fa {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:15.165525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-59a5e0f6-a261-4276-90f9-d84164109621 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:15.173570 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-59a5e0f6-a261-4276-90f9-d84164109621 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.417760 Oct 05 17:37:15.174158 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 778/1623] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:14 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:15.241714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:15.256912 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-64d75e7a-0683-4b6e-8051-c744cf370d65 tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1331 microversion: 2.1 time: 0.221550 Oct 05 17:37:15.268764 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 846/1624] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:15 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1331 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:15.308208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-541a4662-ef68-4989-aa75-9e2321131811 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:15.309228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-541a4662-ef68-4989-aa75-9e2321131811 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:15.321207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-541a4662-ef68-4989-aa75-9e2321131811 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.322082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-541a4662-ef68-4989-aa75-9e2321131811 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.322777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-541a4662-ef68-4989-aa75-9e2321131811 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.324214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-541a4662-ef68-4989-aa75-9e2321131811 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.325286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-541a4662-ef68-4989-aa75-9e2321131811 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.326123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-541a4662-ef68-4989-aa75-9e2321131811 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.370706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-978e1d80-7b12-4c38-8290-3bd96843a2c6 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:15.373981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-978e1d80-7b12-4c38-8290-3bd96843a2c6 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:15.399921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-978e1d80-7b12-4c38-8290-3bd96843a2c6 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.405830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-978e1d80-7b12-4c38-8290-3bd96843a2c6 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.406803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-978e1d80-7b12-4c38-8290-3bd96843a2c6 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.408240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-978e1d80-7b12-4c38-8290-3bd96843a2c6 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.410022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-978e1d80-7b12-4c38-8290-3bd96843a2c6 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.413285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-978e1d80-7b12-4c38-8290-3bd96843a2c6 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.498913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-541a4662-ef68-4989-aa75-9e2321131811 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15a6bfffd8fb473b83de94858676f8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc6422679664e47892eef7185291846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:15.504623 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-978e1d80-7b12-4c38-8290-3bd96843a2c6 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138999 Oct 05 17:37:15.509990 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 847/1625] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 17:37:15 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:37:15.523035 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-541a4662-ef68-4989-aa75-9e2321131811 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 200 len: 1426 microversion: 2.1 time: 0.228768 Oct 05 17:37:15.524007 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 779/1626] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:15 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 1426 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:15.692724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a407e799-35e3-45d3-96a5-4ca1f2123d27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:15.693382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a407e799-35e3-45d3-96a5-4ca1f2123d27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:15.712334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a407e799-35e3-45d3-96a5-4ca1f2123d27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.712839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a407e799-35e3-45d3-96a5-4ca1f2123d27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.713286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a407e799-35e3-45d3-96a5-4ca1f2123d27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.713995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a407e799-35e3-45d3-96a5-4ca1f2123d27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.714508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a407e799-35e3-45d3-96a5-4ca1f2123d27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.714935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a407e799-35e3-45d3-96a5-4ca1f2123d27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.745048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0fae4f3-1676-47db-bcf8-c489b8aa9e49 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:15.745662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e0fae4f3-1676-47db-bcf8-c489b8aa9e49 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:15.757486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0fae4f3-1676-47db-bcf8-c489b8aa9e49 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.758357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0fae4f3-1676-47db-bcf8-c489b8aa9e49 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.759543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0fae4f3-1676-47db-bcf8-c489b8aa9e49 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.760513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0fae4f3-1676-47db-bcf8-c489b8aa9e49 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:15.761522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0fae4f3-1676-47db-bcf8-c489b8aa9e49 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:15.762847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0fae4f3-1676-47db-bcf8-c489b8aa9e49 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:15.878595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e0fae4f3-1676-47db-bcf8-c489b8aa9e49 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:15.894008 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e0fae4f3-1676-47db-bcf8-c489b8aa9e49 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1299 microversion: 2.1 time: 0.149027 Oct 05 17:37:15.895395 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 780/1627] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:15 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:16.035768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a407e799-35e3-45d3-96a5-4ca1f2123d27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:16.044878 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a407e799-35e3-45d3-96a5-4ca1f2123d27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.356308 Oct 05 17:37:16.046512 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 848/1628] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:15 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:16.200177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-77579710-3eb8-485f-b4e9-34d25a169f42 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:16.200886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-77579710-3eb8-485f-b4e9-34d25a169f42 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:16.207622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77579710-3eb8-485f-b4e9-34d25a169f42 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.208375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77579710-3eb8-485f-b4e9-34d25a169f42 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.209456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77579710-3eb8-485f-b4e9-34d25a169f42 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.210418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77579710-3eb8-485f-b4e9-34d25a169f42 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.211031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77579710-3eb8-485f-b4e9-34d25a169f42 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.211795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77579710-3eb8-485f-b4e9-34d25a169f42 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.292473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:16.295611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:16.326011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.327296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.331279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.332562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.339953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.341492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.498613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.499370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.502268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.503049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lazy-loading 'fault' on Instance uuid df1c2e18-968f-4926-a47b-8e73ea54b4fa {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:16.598938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97eb363a60947e9b2d2d12494714aae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1164570e81d8431f882d07b9fa9e8056', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:16.608022 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ac0dae7-20bc-4c91-979a-15d11121853e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 200 len: 1331 microversion: 2.1 time: 0.330421 Oct 05 17:37:16.613602 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 849/1629] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:16 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 1331 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:16.633279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27f86620-d5cf-4ebb-877f-808607d8dbd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:16.635926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-27f86620-d5cf-4ebb-877f-808607d8dbd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:16.645385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-77579710-3eb8-485f-b4e9-34d25a169f42 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:16.652940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f86620-d5cf-4ebb-877f-808607d8dbd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.653886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f86620-d5cf-4ebb-877f-808607d8dbd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.655711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f86620-d5cf-4ebb-877f-808607d8dbd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.656344 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-77579710-3eb8-485f-b4e9-34d25a169f42 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1363 microversion: 2.1 time: 0.459966 Oct 05 17:37:16.658410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f86620-d5cf-4ebb-877f-808607d8dbd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.659263 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 781/1630] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:16 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1363 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:16.673067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f86620-d5cf-4ebb-877f-808607d8dbd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.674386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f86620-d5cf-4ebb-877f-808607d8dbd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.786409 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27f86620-d5cf-4ebb-877f-808607d8dbd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.167918 Oct 05 17:37:16.791495 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 850/1631] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 17:37:16 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:37:16.802390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a669e756-ca7e-49ea-bbec-246abe3f8442 req-0acf1938-ab7d-472a-b5b0-fc47fc66ebbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d6f375-344a-4460-a8bd-dc5e9c7af8e6", "name": "network-vif-deleted", "tag": "16de15df-aa59-4811-a979-bf656b358834"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:16.816782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a669e756-ca7e-49ea-bbec-246abe3f8442 req-0acf1938-ab7d-472a-b5b0-fc47fc66ebbc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.817670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a669e756-ca7e-49ea-bbec-246abe3f8442 req-0acf1938-ab7d-472a-b5b0-fc47fc66ebbc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.819586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a669e756-ca7e-49ea-bbec-246abe3f8442 req-0acf1938-ab7d-472a-b5b0-fc47fc66ebbc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.834965 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a669e756-ca7e-49ea-bbec-246abe3f8442 req-0acf1938-ab7d-472a-b5b0-fc47fc66ebbc service nova] Creating event network-vif-deleted:16de15df-aa59-4811-a979-bf656b358834 for instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 on n-h1-835595-3 Oct 05 17:37:16.840380 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a669e756-ca7e-49ea-bbec-246abe3f8442 req-0acf1938-ab7d-472a-b5b0-fc47fc66ebbc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049416 Oct 05 17:37:16.844535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:16.845176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] [instance: b2d6f375-344a-4460-a8bd-dc5e9c7af8e6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:16.847455 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 851/1632] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:16.852269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.852769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.853205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.853954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.854436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.854961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.871691 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] HTTP exception thrown: Instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 could not be found. Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Request method failure captured: Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 HTTP/1.1 Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb-eK08n4ubXHJuqfUk83qu8miLN4lCyPwZAF1o9Bzmf7bQI5wmD0Qlm5-gv5b1FFLhasa_6LfBKPOLiyAx2SQMs-djP-iXweC4cYqbBrq32cw7plgEVezliV8ZXZh5LCwLeHlvyajYmipSWf0Dqo5gsl-4fy_uVDDCdWDgazp566H8 Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: afc6422679664e47892eef7185291846 Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-MigrationsAdminTest-311365351 Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:37:16.873603 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/afc6422679664e47892eef7185291846"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc6422679664e47892eef7185291846"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_afc6422679664e47892eef7185291846", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/afc6422679664e47892eef7185291846"}]}] Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-MigrationsAdminTest-311365351 Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: afc6422679664e47892eef7185291846 Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-MigrationsAdminTest-311365351 Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-MigrationsAdminTest-311365351-project Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 15a6bfffd8fb473b83de94858676f8ed Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-MigrationsAdminTest-311365351-project Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 could not be found. Oct 05 17:37:16.875497 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'b2d6f375-344a-4460-a8bd-dc5e9c7af8e6'} Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 could not be found. Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:37:16.876453 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 could not be found. Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 could not be found. Oct 05 17:37:16.877982 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:16.879242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] Returning 404 to user: Instance b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:37:16.879242 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3e5791a3-ba15-4422-9315-9f090cd80941 tempest-MigrationsAdminTest-311365351 tempest-MigrationsAdminTest-311365351-project] 10.222.0.70 "GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6" status: 404 len: 111 microversion: 2.1 time: 0.214687 Oct 05 17:37:16.879242 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 782/1633] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:16 2022] GET /compute/v2.1/servers/b2d6f375-344a-4460-a8bd-dc5e9c7af8e6 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:37:16.919462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:16.920168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:16.954629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.955212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.955655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:16.956390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:16.956854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:16.957598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:17.018397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:17.018746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:17.019190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:17.019705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lazy-loading 'fault' on Instance uuid 3dfaed00-73fb-45f1-8690-fd6cd745ec22 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:17.070088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-be05230b-d069-4c85-a1ca-f9ef7cf8d951 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:17.071615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-be05230b-d069-4c85-a1ca-f9ef7cf8d951 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:17.080564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:17.083367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be05230b-d069-4c85-a1ca-f9ef7cf8d951 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:17.084176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be05230b-d069-4c85-a1ca-f9ef7cf8d951 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:17.084933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be05230b-d069-4c85-a1ca-f9ef7cf8d951 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:17.091057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:17.099403 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-538e8405-59c1-4b21-b830-abfb83e0e014 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 200 len: 1304 microversion: 2.1 time: 0.185333 Oct 05 17:37:17.099974 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 852/1634] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:16 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 1304 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:17.108605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be05230b-d069-4c85-a1ca-f9ef7cf8d951 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:17.111975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be05230b-d069-4c85-a1ca-f9ef7cf8d951 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:17.113048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be05230b-d069-4c85-a1ca-f9ef7cf8d951 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:17.291809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-be05230b-d069-4c85-a1ca-f9ef7cf8d951 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:17.298195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:17.302007 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-be05230b-d069-4c85-a1ca-f9ef7cf8d951 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1507 microversion: 2.1 time: 0.236901 Oct 05 17:37:17.304025 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 783/1635] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:17 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:17.637297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:17.638433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] [instance: df1c2e18-968f-4926-a47b-8e73ea54b4fa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:17.652564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:17.653127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:17.654046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:17.654985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:17.656772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:17.657795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:17.679621 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] HTTP exception thrown: Instance df1c2e18-968f-4926-a47b-8e73ea54b4fa could not be found. Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Request method failure captured: Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa HTTP/1.1 Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcAVAq7sxUW8j_89-liG_KtHQOBNdU5OGq_onNdK13p6VY2qWIyIppLAJgOX2aPSpXYM-MsrbwMY3LHr4t-ALKVV47AGJBM5KrXVTT8EIEiJ5uro3qmuReoA6UF0fVGyLas5jpCe-LVpCW2bltOq0-Vtzx9tiEP2ptaPLpmerpTFchU Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 1164570e81d8431f882d07b9fa9e8056 Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesAdminNegativeTest-1896059713 Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:37:17.681892 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1164570e81d8431f882d07b9fa9e8056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1164570e81d8431f882d07b9fa9e8056"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1164570e81d8431f882d07b9fa9e8056", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1164570e81d8431f882d07b9fa9e8056"}]}] Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesAdminNegativeTest-1896059713 Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 1164570e81d8431f882d07b9fa9e8056 Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1896059713 Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesAdminNegativeTest-1896059713-project Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: e97eb363a60947e9b2d2d12494714aae Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesAdminNegativeTest-1896059713-project Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance df1c2e18-968f-4926-a47b-8e73ea54b4fa could not be found. Oct 05 17:37:17.683765 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'df1c2e18-968f-4926-a47b-8e73ea54b4fa'} Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df1c2e18-968f-4926-a47b-8e73ea54b4fa could not be found. Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:37:17.684869 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df1c2e18-968f-4926-a47b-8e73ea54b4fa could not be found. Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df1c2e18-968f-4926-a47b-8e73ea54b4fa could not be found. Oct 05 17:37:17.686511 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:17.688008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bc9d1793-f733-46e3-8051-d1def7c37f6b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:17.689011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bc9d1793-f733-46e3-8051-d1def7c37f6b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:17.689726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Returning 404 to user: Instance df1c2e18-968f-4926-a47b-8e73ea54b4fa could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:37:17.690925 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0633fdc9-7252-4e55-9db5-15d49861ee3e tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa" status: 404 len: 111 microversion: 2.1 time: 0.059163 Oct 05 17:37:17.692142 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 853/1636] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:17 2022] GET /compute/v2.1/servers/df1c2e18-968f-4926-a47b-8e73ea54b4fa => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:37:17.700830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9d1793-f733-46e3-8051-d1def7c37f6b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:17.701143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82767e2f-17ac-4bcd-96f5-fb9cc68d2cbb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] Calling method '.version_select at 0x7f77751d65e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:17.704207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9d1793-f733-46e3-8051-d1def7c37f6b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:17.704694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9d1793-f733-46e3-8051-d1def7c37f6b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:17.706357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9d1793-f733-46e3-8051-d1def7c37f6b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:17.708498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9d1793-f733-46e3-8051-d1def7c37f6b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:17.709141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9d1793-f733-46e3-8051-d1def7c37f6b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:17.740605 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-82767e2f-17ac-4bcd-96f5-fb9cc68d2cbb tempest-VolumesAdminNegativeTest-1896059713 tempest-VolumesAdminNegativeTest-1896059713-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031472713" status: 202 len: 0 microversion: 2.1 time: 0.044251 Oct 05 17:37:17.741665 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 854/1637] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 17:37:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031472713 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:37:17.799698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-deff79f6-c157-4c4f-8178-b5604784a08e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:17.802747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-deff79f6-c157-4c4f-8178-b5604784a08e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:17.814085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deff79f6-c157-4c4f-8178-b5604784a08e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:17.814655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deff79f6-c157-4c4f-8178-b5604784a08e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:17.815966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deff79f6-c157-4c4f-8178-b5604784a08e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:17.816611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deff79f6-c157-4c4f-8178-b5604784a08e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:17.817170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deff79f6-c157-4c4f-8178-b5604784a08e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:17.817675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deff79f6-c157-4c4f-8178-b5604784a08e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:17.854980 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-deff79f6-c157-4c4f-8178-b5604784a08e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.059739 Oct 05 17:37:17.856046 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 855/1638] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 17:37:17 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:37:18.061504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bc9d1793-f733-46e3-8051-d1def7c37f6b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:18.069979 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bc9d1793-f733-46e3-8051-d1def7c37f6b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1551 microversion: 2.1 time: 0.387767 Oct 05 17:37:18.082312 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 784/1639] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:17 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1551 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:18.100121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9bf88881-19b3-4d49-996b-5a365bb172b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:18.100897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9bf88881-19b3-4d49-996b-5a365bb172b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:18.114137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bf88881-19b3-4d49-996b-5a365bb172b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.115554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bf88881-19b3-4d49-996b-5a365bb172b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.116929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bf88881-19b3-4d49-996b-5a365bb172b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.119444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bf88881-19b3-4d49-996b-5a365bb172b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.120452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bf88881-19b3-4d49-996b-5a365bb172b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.122954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bf88881-19b3-4d49-996b-5a365bb172b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.125109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:18.125734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 3dfaed00-73fb-45f1-8690-fd6cd745ec22] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:18.133999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.134914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.135522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.136414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.137750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.150217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.180083 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] HTTP exception thrown: Instance 3dfaed00-73fb-45f1-8690-fd6cd745ec22 could not be found. Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Request method failure captured: Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 HTTP/1.1 Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcAyhQzsR1g3Z9PIjReuZKMBl-sMQOulT_gDlsWNlY2mzl5ZVY5G2Hw6Imp0LGrevU0WbCDNea5ghCqYwFq4KpZbYCG3bINQ5hkVzcqPe6OjqZB9exkj07974Gev6j-UYbdd9UaUd4qBdgUr8FNbyRQB-jPqn8c1nXbJktp77oWLQM4 Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 1c79b829a6194b7fbfe07a1c77cd2464 Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersAdminTestJSON-693287786 Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:37:18.193740 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1c79b829a6194b7fbfe07a1c77cd2464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1c79b829a6194b7fbfe07a1c77cd2464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1c79b829a6194b7fbfe07a1c77cd2464", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1c79b829a6194b7fbfe07a1c77cd2464"}]}] Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersAdminTestJSON-693287786 Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 1c79b829a6194b7fbfe07a1c77cd2464 Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersAdminTestJSON-693287786 Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersAdminTestJSON-693287786-project Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0683f65832f146b0bb85a984370186be Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersAdminTestJSON-693287786-project Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 3dfaed00-73fb-45f1-8690-fd6cd745ec22 could not be found. Oct 05 17:37:18.195525 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '3dfaed00-73fb-45f1-8690-fd6cd745ec22'} Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3dfaed00-73fb-45f1-8690-fd6cd745ec22 could not be found. Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:37:18.196549 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3dfaed00-73fb-45f1-8690-fd6cd745ec22 could not be found. Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3dfaed00-73fb-45f1-8690-fd6cd745ec22 could not be found. Oct 05 17:37:18.198065 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:18.201462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Returning 404 to user: Instance 3dfaed00-73fb-45f1-8690-fd6cd745ec22 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:37:18.202412 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da6013b1-3972-4ba0-bba8-0cf82bec5a71 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22" status: 404 len: 111 microversion: 2.1 time: 0.081371 Oct 05 17:37:18.203844 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 785/1640] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:18 2022] GET /compute/v2.1/servers/3dfaed00-73fb-45f1-8690-fd6cd745ec22 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:37:18.213786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-88cfa926-2518-46b0-afd4-2ebec6513648 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:18.214522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-88cfa926-2518-46b0-afd4-2ebec6513648 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:18.224395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cfa926-2518-46b0-afd4-2ebec6513648 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.225144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cfa926-2518-46b0-afd4-2ebec6513648 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.225672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cfa926-2518-46b0-afd4-2ebec6513648 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.226535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cfa926-2518-46b0-afd4-2ebec6513648 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.227249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cfa926-2518-46b0-afd4-2ebec6513648 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.228075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88cfa926-2518-46b0-afd4-2ebec6513648 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.264343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-88cfa926-2518-46b0-afd4-2ebec6513648 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:37:18.350681 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9bf88881-19b3-4d49-996b-5a365bb172b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.255814 Oct 05 17:37:18.351516 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 856/1641] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:37:18 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/os-interface => generated 285 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:18.364809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc22ad21-77b5-4cb5-be2e-ea41b1bbb9e8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:18.366625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc22ad21-77b5-4cb5-be2e-ea41b1bbb9e8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:18.375649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc22ad21-77b5-4cb5-be2e-ea41b1bbb9e8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.376497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc22ad21-77b5-4cb5-be2e-ea41b1bbb9e8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.377208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc22ad21-77b5-4cb5-be2e-ea41b1bbb9e8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.378194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc22ad21-77b5-4cb5-be2e-ea41b1bbb9e8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.378952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc22ad21-77b5-4cb5-be2e-ea41b1bbb9e8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.379591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc22ad21-77b5-4cb5-be2e-ea41b1bbb9e8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.406716 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-88cfa926-2518-46b0-afd4-2ebec6513648 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 204 len: 0 microversion: 2.1 time: 0.197426 Oct 05 17:37:18.412558 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 786/1642] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:37:18 2022] DELETE /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:37:18.420662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9aba3ce1-f602-41d6-b924-bb6fb5790b92 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:18.421375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9aba3ce1-f602-41d6-b924-bb6fb5790b92 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:18.438513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9aba3ce1-f602-41d6-b924-bb6fb5790b92 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.439370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9aba3ce1-f602-41d6-b924-bb6fb5790b92 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.440017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9aba3ce1-f602-41d6-b924-bb6fb5790b92 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.441014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9aba3ce1-f602-41d6-b924-bb6fb5790b92 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.441678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9aba3ce1-f602-41d6-b924-bb6fb5790b92 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.443191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9aba3ce1-f602-41d6-b924-bb6fb5790b92 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.757579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc22ad21-77b5-4cb5-be2e-ea41b1bbb9e8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:18.766122 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc22ad21-77b5-4cb5-be2e-ea41b1bbb9e8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1487 microversion: 2.1 time: 0.405965 Oct 05 17:37:18.772904 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 857/1643] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:18 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1487 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:18.868260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b1c0b884-17f5-4343-87d0-9fe5d393d343 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:18.870621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b1c0b884-17f5-4343-87d0-9fe5d393d343 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:18.887917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c0b884-17f5-4343-87d0-9fe5d393d343 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.888801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c0b884-17f5-4343-87d0-9fe5d393d343 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.889577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c0b884-17f5-4343-87d0-9fe5d393d343 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.891125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c0b884-17f5-4343-87d0-9fe5d393d343 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:18.891819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c0b884-17f5-4343-87d0-9fe5d393d343 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:18.893440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1c0b884-17f5-4343-87d0-9fe5d393d343 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:18.900564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9aba3ce1-f602-41d6-b924-bb6fb5790b92 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:18.929042 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9aba3ce1-f602-41d6-b924-bb6fb5790b92 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1469 microversion: 2.1 time: 0.514712 Oct 05 17:37:18.943286 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 787/1644] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:18 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1469 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:18.959946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2065942844", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:18.963406 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b1c0b884-17f5-4343-87d0-9fe5d393d343 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.099735 Oct 05 17:37:18.969615 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 858/1645] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 17:37:18 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:37:19.053806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] validate_networks() for [('8b1f8380-13c4-4d5f-a76e-d3de024d9800', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:37:19.958909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a59b07c-38b1-4047-9f37-b997662b62ff tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:19.959652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2a59b07c-38b1-4047-9f37-b997662b62ff tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:19.980592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a59b07c-38b1-4047-9f37-b997662b62ff tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:19.981089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a59b07c-38b1-4047-9f37-b997662b62ff tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:19.982920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a59b07c-38b1-4047-9f37-b997662b62ff tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:19.983651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a59b07c-38b1-4047-9f37-b997662b62ff tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:19.986759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a59b07c-38b1-4047-9f37-b997662b62ff tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:19.987725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a59b07c-38b1-4047-9f37-b997662b62ff tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:20.486418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2a59b07c-38b1-4047-9f37-b997662b62ff tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:20.495268 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2a59b07c-38b1-4047-9f37-b997662b62ff tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1469 microversion: 2.1 time: 0.540177 Oct 05 17:37:20.501623 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 859/1646] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:19 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1469 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:20.502647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:37:20.503101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:37:20.503533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:37:20.503962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:37:20.504578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:37:20.522861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-80e716d6-d13d-4ae1-bf34-450c9628f3cf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:20.526397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:20.526849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:20.527289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:20.528030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:20.528532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:20.528964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:20.532172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-80e716d6-d13d-4ae1-bf34-450c9628f3cf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:20.561129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80e716d6-d13d-4ae1-bf34-450c9628f3cf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:20.562144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80e716d6-d13d-4ae1-bf34-450c9628f3cf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:20.562848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80e716d6-d13d-4ae1-bf34-450c9628f3cf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:20.564030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80e716d6-d13d-4ae1-bf34-450c9628f3cf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:20.567914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80e716d6-d13d-4ae1-bf34-450c9628f3cf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:20.568633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80e716d6-d13d-4ae1-bf34-450c9628f3cf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:20.576556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Getting quotas for project 2331c2d84b054fdb9ffad3823856cd06. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:37:20.584704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Getting quotas for user 3c18411229884326b815e7f325ef37ec and project 2331c2d84b054fdb9ffad3823856cd06. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:37:20.610686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:37:20.613041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:37:20.659427 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-80e716d6-d13d-4ae1-bf34-450c9628f3cf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.149053 Oct 05 17:37:20.682673 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 860/1647] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 17:37:20 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:37:20.704588 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c40db83e-f256-4e21-96fc-bc03fd168e1d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.748726 Oct 05 17:37:20.711367 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 788/1648] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:37:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:37:20.717854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a966ed0-ece0-44b4-9814-4cec94e50009 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:20.718821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9a966ed0-ece0-44b4-9814-4cec94e50009 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:20.804392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-572850cd-264b-43b8-94f4-49cccfde80a2 req-fd38df2d-636e-42f7-b4ab-dc9084f83274 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586258bf-c661-4819-804b-504089c77dc6", "tag": "cfd34f5d-5af2-4330-b921-2091d3e274be"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:20.831290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-572850cd-264b-43b8-94f4-49cccfde80a2 req-fd38df2d-636e-42f7-b4ab-dc9084f83274 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:20.831581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-572850cd-264b-43b8-94f4-49cccfde80a2 req-fd38df2d-636e-42f7-b4ab-dc9084f83274 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:20.832017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-572850cd-264b-43b8-94f4-49cccfde80a2 req-fd38df2d-636e-42f7-b4ab-dc9084f83274 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:20.847778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9a966ed0-ece0-44b4-9814-4cec94e50009 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:20.857272 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a966ed0-ece0-44b4-9814-4cec94e50009 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1214 microversion: 2.1 time: 0.142812 Oct 05 17:37:20.870317 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-572850cd-264b-43b8-94f4-49cccfde80a2 req-fd38df2d-636e-42f7-b4ab-dc9084f83274 service nova] Creating event network-changed:cfd34f5d-5af2-4330-b921-2091d3e274be for instance 586258bf-c661-4819-804b-504089c77dc6 on n-h2-835595-3 Oct 05 17:37:20.871872 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-572850cd-264b-43b8-94f4-49cccfde80a2 req-fd38df2d-636e-42f7-b4ab-dc9084f83274 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071745 Oct 05 17:37:20.872112 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 861/1649] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:20 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:20.872789 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 789/1650] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:21.524878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-39e13df2-0546-4e3d-8944-be51c0022042 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:21.526489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-39e13df2-0546-4e3d-8944-be51c0022042 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:21.536506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39e13df2-0546-4e3d-8944-be51c0022042 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:21.538459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39e13df2-0546-4e3d-8944-be51c0022042 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:21.542810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39e13df2-0546-4e3d-8944-be51c0022042 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:21.544067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39e13df2-0546-4e3d-8944-be51c0022042 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:21.544764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39e13df2-0546-4e3d-8944-be51c0022042 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:21.545492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39e13df2-0546-4e3d-8944-be51c0022042 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:21.837348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dc77490a-5c29-41bc-8408-826f9ff1ee0e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Action: 'create', calling method: .version_select at 0x7f7774f009d0>, body: {"keypair": {"name": "tempest-keypair-904172646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6jUwKeQUndKvzsU02yUv62Q4bxQGIJLhoU9fcGbd02iN666W+9z4/aCzAAoshR8mn87hhloNRIOFXg4diwUjk/pgnVQoh8dHh3OBrlpl5WoaC+Ng7t/Wf014mCRID8xw=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:21.877954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-dc77490a-5c29-41bc-8408-826f9ff1ee0e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Getting quotas for project 0fc3993200f84751abc9ed6c79c764cc. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:37:21.885792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-dc77490a-5c29-41bc-8408-826f9ff1ee0e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Getting quotas for user 5177f088849043638c7f1f6c9196293a and project 0fc3993200f84751abc9ed6c79c764cc. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:37:21.949714 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dc77490a-5c29-41bc-8408-826f9ff1ee0e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.446006 Oct 05 17:37:21.950688 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 862/1651] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:37:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:21.961790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-257b365c-31b1-4174-b924-9ce3a27f4c7a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:21.968323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-257b365c-31b1-4174-b924-9ce3a27f4c7a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:21.981293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257b365c-31b1-4174-b924-9ce3a27f4c7a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:21.984629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257b365c-31b1-4174-b924-9ce3a27f4c7a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:21.986114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257b365c-31b1-4174-b924-9ce3a27f4c7a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:21.987988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257b365c-31b1-4174-b924-9ce3a27f4c7a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:21.989714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257b365c-31b1-4174-b924-9ce3a27f4c7a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:21.991878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257b365c-31b1-4174-b924-9ce3a27f4c7a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:22.066617 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-257b365c-31b1-4174-b924-9ce3a27f4c7a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.112308 Oct 05 17:37:22.067947 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 863/1652] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 17:37:21 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:22.078357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c90eb7f-1db2-438e-a8c6-f99e85a4f696 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:22.080766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6c90eb7f-1db2-438e-a8c6-f99e85a4f696 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:22.090023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c90eb7f-1db2-438e-a8c6-f99e85a4f696 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:22.090965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c90eb7f-1db2-438e-a8c6-f99e85a4f696 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:22.091630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c90eb7f-1db2-438e-a8c6-f99e85a4f696 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:22.092621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c90eb7f-1db2-438e-a8c6-f99e85a4f696 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:22.093282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c90eb7f-1db2-438e-a8c6-f99e85a4f696 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:22.093901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c90eb7f-1db2-438e-a8c6-f99e85a4f696 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:22.111900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-39e13df2-0546-4e3d-8944-be51c0022042 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:22.121258 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-39e13df2-0546-4e3d-8944-be51c0022042 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1469 microversion: 2.1 time: 0.600838 Oct 05 17:37:22.139984 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 790/1653] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:21 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:22.159285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:22.278615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6c90eb7f-1db2-438e-a8c6-f99e85a4f696 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:22.290534 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6c90eb7f-1db2-438e-a8c6-f99e85a4f696 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1266 microversion: 2.1 time: 0.220530 Oct 05 17:37:22.291875 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 864/1654] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:22 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:22.512296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d5244b02-1781-4f42-b5eb-f234a8bf61f6 tempest-QuotaClassesAdmin257Test-2145175371 tempest-QuotaClassesAdmin257Test-2145175371-project-admin] Calling method '.version_select at 0x7f7775813c10>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:22.575387 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d5244b02-1781-4f42-b5eb-f234a8bf61f6 tempest-QuotaClassesAdmin257Test-2145175371 tempest-QuotaClassesAdmin257Test-2145175371-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.433895 Oct 05 17:37:22.578726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8a7ba027-aa68-4f20-b95c-6c2b72bf54c8 req-c1b669d5-94ad-4407-9fe4-6bc9cb95ae15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6321627d-1957-42b5-a223-da558b58bbdf", "name": "network-vif-deleted", "tag": "9752d52f-5ec4-412b-ae98-2e0cd46d439f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:22.585256 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 791/1655] 10.222.0.70 () {60 vars in 1226 bytes} [Wed Oct 5 17:37:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:37:22.597439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-92c71a03-077e-4a6e-ae7e-8b8240215058 tempest-QuotaClassesAdmin257Test-2145175371 tempest-QuotaClassesAdmin257Test-2145175371-project-admin] Action: 'update', calling method: .version_select at 0x7f7775813dc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:22.606790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8a7ba027-aa68-4f20-b95c-6c2b72bf54c8 req-c1b669d5-94ad-4407-9fe4-6bc9cb95ae15 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:22.607352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8a7ba027-aa68-4f20-b95c-6c2b72bf54c8 req-c1b669d5-94ad-4407-9fe4-6bc9cb95ae15 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:22.607880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8a7ba027-aa68-4f20-b95c-6c2b72bf54c8 req-c1b669d5-94ad-4407-9fe4-6bc9cb95ae15 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:22.641500 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8a7ba027-aa68-4f20-b95c-6c2b72bf54c8 req-c1b669d5-94ad-4407-9fe4-6bc9cb95ae15 service nova] Creating event network-vif-deleted:9752d52f-5ec4-412b-ae98-2e0cd46d439f for instance 6321627d-1957-42b5-a223-da558b58bbdf on n-h1-835595-3 Oct 05 17:37:22.662471 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8a7ba027-aa68-4f20-b95c-6c2b72bf54c8 req-c1b669d5-94ad-4407-9fe4-6bc9cb95ae15 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085718 Oct 05 17:37:22.664729 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 865/1656] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:37:23.005507 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-92c71a03-077e-4a6e-ae7e-8b8240215058 tempest-QuotaClassesAdmin257Test-2145175371 tempest-QuotaClassesAdmin257Test-2145175371-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.418277 Oct 05 17:37:23.012404 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 792/1657] 10.222.0.70 () {62 vars in 1247 bytes} [Wed Oct 5 17:37:22 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:37:23.017913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-247306df-144c-4790-ad5c-aa4fa4c8840b tempest-QuotaClassesAdmin257Test-2145175371 tempest-QuotaClassesAdmin257Test-2145175371-project-admin] Calling method '.version_select at 0x7f7775f7c820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:23.044432 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-247306df-144c-4790-ad5c-aa4fa4c8840b tempest-QuotaClassesAdmin257Test-2145175371 tempest-QuotaClassesAdmin257Test-2145175371-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.030619 Oct 05 17:37:23.045866 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 866/1658] 10.222.0.70 () {60 vars in 1226 bytes} [Wed Oct 5 17:37:23 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:37:23.067697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2757cd9f-53fd-43ba-965a-4cad0b5156ed tempest-QuotaClassesAdmin257Test-2145175371 tempest-QuotaClassesAdmin257Test-2145175371-project-admin] Action: 'update', calling method: .version_select at 0x7f7775d1d3a0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:23.154318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:23.155201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:23.169960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:23.171107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:23.197158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:23.198015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:23.198537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:23.199306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:23.230845 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2757cd9f-53fd-43ba-965a-4cad0b5156ed tempest-QuotaClassesAdmin257Test-2145175371 tempest-QuotaClassesAdmin257Test-2145175371-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.177259 Oct 05 17:37:23.241546 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 793/1659] 10.222.0.70 () {62 vars in 1247 bytes} [Wed Oct 5 17:37:23 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:37:23.267652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:23.273680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:23.274192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:23.274847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:23.277371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lazy-loading 'fault' on Instance uuid 6321627d-1957-42b5-a223-da558b58bbdf {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:23.320454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2dbd2f60-7581-4692-b5fe-83a0998da78c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:23.321399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2dbd2f60-7581-4692-b5fe-83a0998da78c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:23.331252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dbd2f60-7581-4692-b5fe-83a0998da78c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:23.332603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dbd2f60-7581-4692-b5fe-83a0998da78c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:23.333210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dbd2f60-7581-4692-b5fe-83a0998da78c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:23.334098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dbd2f60-7581-4692-b5fe-83a0998da78c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:23.334749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dbd2f60-7581-4692-b5fe-83a0998da78c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:23.335632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dbd2f60-7581-4692-b5fe-83a0998da78c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:23.379612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0683f65832f146b0bb85a984370186be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c79b829a6194b7fbfe07a1c77cd2464', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:23.392503 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab3dd865-5278-42bf-a5aa-9233a0c2ee2f tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 200 len: 1304 microversion: 2.1 time: 0.242826 Oct 05 17:37:23.394597 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 867/1660] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:23 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 1304 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:23.582678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2dbd2f60-7581-4692-b5fe-83a0998da78c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:23.595796 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2dbd2f60-7581-4692-b5fe-83a0998da78c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1272 microversion: 2.1 time: 0.280766 Oct 05 17:37:23.597722 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 794/1661] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:23 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:24.418156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:24.418912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] [instance: 6321627d-1957-42b5-a223-da558b58bbdf] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:24.427462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:24.428095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:24.428817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:24.429900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:24.430719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:24.432132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:24.453968 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] HTTP exception thrown: Instance 6321627d-1957-42b5-a223-da558b58bbdf could not be found. Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Request method failure captured: Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf HTTP/1.1 Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcAyhQzsR1g3Z9PIjReuZKMBl-sMQOulT_gDlsWNlY2mzl5ZVY5G2Hw6Imp0LGrevU0WbCDNea5ghCqYwFq4KpZbYCG3bINQ5hkVzcqPe6OjqZB9exkj07974Gev6j-UYbdd9UaUd4qBdgUr8FNbyRQB-jPqn8c1nXbJktp77oWLQM4 Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 1c79b829a6194b7fbfe07a1c77cd2464 Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersAdminTestJSON-693287786 Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:37:24.456157 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1c79b829a6194b7fbfe07a1c77cd2464"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1c79b829a6194b7fbfe07a1c77cd2464"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1c79b829a6194b7fbfe07a1c77cd2464", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1c79b829a6194b7fbfe07a1c77cd2464"}]}] Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersAdminTestJSON-693287786 Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 1c79b829a6194b7fbfe07a1c77cd2464 Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersAdminTestJSON-693287786 Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersAdminTestJSON-693287786-project Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0683f65832f146b0bb85a984370186be Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersAdminTestJSON-693287786-project Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 6321627d-1957-42b5-a223-da558b58bbdf could not be found. Oct 05 17:37:24.457922 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '6321627d-1957-42b5-a223-da558b58bbdf'} Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6321627d-1957-42b5-a223-da558b58bbdf could not be found. Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:37:24.458934 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6321627d-1957-42b5-a223-da558b58bbdf could not be found. Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6321627d-1957-42b5-a223-da558b58bbdf could not be found. Oct 05 17:37:24.460312 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:24.463616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] Returning 404 to user: Instance 6321627d-1957-42b5-a223-da558b58bbdf could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:37:24.464846 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b509809-2f41-479d-bddb-ae3122e55079 tempest-ServersAdminTestJSON-693287786 tempest-ServersAdminTestJSON-693287786-project] 10.222.0.70 "GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf" status: 404 len: 111 microversion: 2.1 time: 0.051458 Oct 05 17:37:24.465961 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 868/1662] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:24 2022] GET /compute/v2.1/servers/6321627d-1957-42b5-a223-da558b58bbdf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:37:24.626829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c0b46f6b-0999-4b74-b74f-b3fdbd430bf3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:24.627539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c0b46f6b-0999-4b74-b74f-b3fdbd430bf3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:24.647682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0b46f6b-0999-4b74-b74f-b3fdbd430bf3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:24.649731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0b46f6b-0999-4b74-b74f-b3fdbd430bf3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:24.650255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0b46f6b-0999-4b74-b74f-b3fdbd430bf3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:24.654046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0b46f6b-0999-4b74-b74f-b3fdbd430bf3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:24.656621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0b46f6b-0999-4b74-b74f-b3fdbd430bf3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:24.657082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0b46f6b-0999-4b74-b74f-b3fdbd430bf3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:24.693438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce7d2a98-06c1-45da-ab5f-633096cf243f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:24.694789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ce7d2a98-06c1-45da-ab5f-633096cf243f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:24.722807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce7d2a98-06c1-45da-ab5f-633096cf243f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:24.728015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce7d2a98-06c1-45da-ab5f-633096cf243f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:24.737918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce7d2a98-06c1-45da-ab5f-633096cf243f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:24.740075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce7d2a98-06c1-45da-ab5f-633096cf243f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:24.742185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce7d2a98-06c1-45da-ab5f-633096cf243f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:24.743895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce7d2a98-06c1-45da-ab5f-633096cf243f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:24.842762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ce7d2a98-06c1-45da-ab5f-633096cf243f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:37:24.869342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c0b46f6b-0999-4b74-b74f-b3fdbd430bf3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:24.879654 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c0b46f6b-0999-4b74-b74f-b3fdbd430bf3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1272 microversion: 2.1 time: 0.260884 Oct 05 17:37:24.881366 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 795/1663] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:24 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1272 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:25.141645 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ce7d2a98-06c1-45da-ab5f-633096cf243f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 204 len: 0 microversion: 2.1 time: 0.451812 Oct 05 17:37:25.147555 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 869/1664] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:37:24 2022] DELETE /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:37:25.159671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-17e80aa2-148c-4b79-b4e4-505f2b58d46f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:25.160705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-17e80aa2-148c-4b79-b4e4-505f2b58d46f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:25.169362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17e80aa2-148c-4b79-b4e4-505f2b58d46f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:25.171149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17e80aa2-148c-4b79-b4e4-505f2b58d46f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:25.171834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17e80aa2-148c-4b79-b4e4-505f2b58d46f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:25.173068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17e80aa2-148c-4b79-b4e4-505f2b58d46f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:25.173901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17e80aa2-148c-4b79-b4e4-505f2b58d46f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:25.174658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17e80aa2-148c-4b79-b4e4-505f2b58d46f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:25.910592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb3710b9-75a3-4cd9-8890-31000f5e5a89 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:25.911971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb3710b9-75a3-4cd9-8890-31000f5e5a89 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:25.927369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3710b9-75a3-4cd9-8890-31000f5e5a89 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:25.928430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3710b9-75a3-4cd9-8890-31000f5e5a89 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:25.933161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3710b9-75a3-4cd9-8890-31000f5e5a89 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:25.935675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3710b9-75a3-4cd9-8890-31000f5e5a89 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:25.936710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3710b9-75a3-4cd9-8890-31000f5e5a89 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:25.940429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3710b9-75a3-4cd9-8890-31000f5e5a89 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:26.231609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fb3710b9-75a3-4cd9-8890-31000f5e5a89 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:26.242496 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb3710b9-75a3-4cd9-8890-31000f5e5a89 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 0.338460 Oct 05 17:37:26.258768 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 870/1665] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:25 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:26.418455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-17e80aa2-148c-4b79-b4e4-505f2b58d46f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:26.431452 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-17e80aa2-148c-4b79-b4e4-505f2b58d46f tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1665 microversion: 2.1 time: 1.275175 Oct 05 17:37:26.433528 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 796/1666] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:25 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1665 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:26.940537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-126740652", "imageRef": "e445e477-b341-4162-8aac-1697471926ae", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4ff78cb3-60f7-47ba-b025-feab7b21f3ac"}], "security_groups": [{"name": "tempest-securitygroup--113224493"}], "key_name": "tempest-keypair-904172646", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:27.266548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f2841b11-cdf2-4680-a449-fdcd013c8c27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:27.267280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f2841b11-cdf2-4680-a449-fdcd013c8c27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:27.284269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2841b11-cdf2-4680-a449-fdcd013c8c27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:27.288598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2841b11-cdf2-4680-a449-fdcd013c8c27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:27.290058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2841b11-cdf2-4680-a449-fdcd013c8c27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:27.302895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2841b11-cdf2-4680-a449-fdcd013c8c27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:27.304550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2841b11-cdf2-4680-a449-fdcd013c8c27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:27.305775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2841b11-cdf2-4680-a449-fdcd013c8c27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:27.318776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] validate_networks() for [('4ff78cb3-60f7-47ba-b025-feab7b21f3ac', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:37:28.209697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f2841b11-cdf2-4680-a449-fdcd013c8c27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:28.221633 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f2841b11-cdf2-4680-a449-fdcd013c8c27 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 0.959687 Oct 05 17:37:28.223861 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 797/1667] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:27 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:28.243117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-35dc344d-c87f-4d23-a543-114b65e6f375 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:28.245853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-35dc344d-c87f-4d23-a543-114b65e6f375 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:28.258149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35dc344d-c87f-4d23-a543-114b65e6f375 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.259463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35dc344d-c87f-4d23-a543-114b65e6f375 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.260849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35dc344d-c87f-4d23-a543-114b65e6f375 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.264442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35dc344d-c87f-4d23-a543-114b65e6f375 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.265885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35dc344d-c87f-4d23-a543-114b65e6f375 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.267293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35dc344d-c87f-4d23-a543-114b65e6f375 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.277089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:37:28.277569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:37:28.278080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:37:28.278604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:37:28.278917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:37:28.300488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.302846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.303330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.304145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.304610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.305048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.366728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Getting quotas for project 0fc3993200f84751abc9ed6c79c764cc. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:37:28.375986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Getting quotas for user 5177f088849043638c7f1f6c9196293a and project 0fc3993200f84751abc9ed6c79c764cc. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:37:28.402931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:37:28.410897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e445e477-b341-4162-8aac-1697471926ae',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:37:28.478640 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-17fb167e-ee49-46db-93ef-fb202ff96be5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.542055 Oct 05 17:37:28.479977 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 871/1668] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:37:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:37:28.526478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-35dc344d-c87f-4d23-a543-114b65e6f375 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:28.542311 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-35dc344d-c87f-4d23-a543-114b65e6f375 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1598 microversion: 2.1 time: 0.315074 Oct 05 17:37:28.547362 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 798/1669] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:28 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1598 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:28.553990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-572cdabb-0402-41c2-af55-d06ae851db20 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:28.558313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-572cdabb-0402-41c2-af55-d06ae851db20 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:28.565151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=15,nova_api:INSERT=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:28.687999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-66a6dcec-988d-466e-8085-601e9400de07 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:28.693950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66a6dcec-988d-466e-8085-601e9400de07 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.694646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66a6dcec-988d-466e-8085-601e9400de07 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.695288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66a6dcec-988d-466e-8085-601e9400de07 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.696764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66a6dcec-988d-466e-8085-601e9400de07 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.697581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66a6dcec-988d-466e-8085-601e9400de07 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.698573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66a6dcec-988d-466e-8085-601e9400de07 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.734882 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-66a6dcec-988d-466e-8085-601e9400de07 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.250292 Oct 05 17:37:28.738300 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 872/1670] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:28.761011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4b007a1f-3bae-4e97-8863-5935df085c79 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:28.765831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b007a1f-3bae-4e97-8863-5935df085c79 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.767059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b007a1f-3bae-4e97-8863-5935df085c79 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.767772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b007a1f-3bae-4e97-8863-5935df085c79 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.768786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b007a1f-3bae-4e97-8863-5935df085c79 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.769680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b007a1f-3bae-4e97-8863-5935df085c79 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.770696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b007a1f-3bae-4e97-8863-5935df085c79 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.814458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-572cdabb-0402-41c2-af55-d06ae851db20 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:28.817136 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4b007a1f-3bae-4e97-8863-5935df085c79 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.059988 Oct 05 17:37:28.818099 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 873/1671] 10.222.0.70 () {58 vars in 1170 bytes} [Wed Oct 5 17:37:28 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 944 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:28.829169 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-572cdabb-0402-41c2-af55-d06ae851db20 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1244 microversion: 2.1 time: 0.280075 Oct 05 17:37:28.830273 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 799/1672] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:28 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1244 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:28.838495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fa83ddd6-c490-4a8d-ba62-d5c32a61c1fa tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:28.838495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa83ddd6-c490-4a8d-ba62-d5c32a61c1fa tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.838495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa83ddd6-c490-4a8d-ba62-d5c32a61c1fa tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.838495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa83ddd6-c490-4a8d-ba62-d5c32a61c1fa tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.847307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa83ddd6-c490-4a8d-ba62-d5c32a61c1fa tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.848888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa83ddd6-c490-4a8d-ba62-d5c32a61c1fa tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.853675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa83ddd6-c490-4a8d-ba62-d5c32a61c1fa tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.905374 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fa83ddd6-c490-4a8d-ba62-d5c32a61c1fa tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.077734 Oct 05 17:37:28.906144 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 874/1673] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:37:28.919047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a2f24743-df5d-4e7f-912d-4e673358b79b tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:28.923722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2f24743-df5d-4e7f-912d-4e673358b79b tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.924617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2f24743-df5d-4e7f-912d-4e673358b79b tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.925357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2f24743-df5d-4e7f-912d-4e673358b79b tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.926328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2f24743-df5d-4e7f-912d-4e673358b79b tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:28.926978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2f24743-df5d-4e7f-912d-4e673358b79b tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:28.927733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2f24743-df5d-4e7f-912d-4e673358b79b tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:28.971694 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a2f24743-df5d-4e7f-912d-4e673358b79b tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-835595-3&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.056840 Oct 05 17:37:28.973188 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 800/1674] 10.222.0.70 () {58 vars in 1194 bytes} [Wed Oct 5 17:37:28 2022] GET /compute/v2.1/os-services?host=n-d-835595-3&binary=xxx => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:37:28.988852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5a6b218-d1e8-4bb5-b1fa-4eba4e617993 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:29.013080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a6b218-d1e8-4bb5-b1fa-4eba4e617993 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:29.016865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a6b218-d1e8-4bb5-b1fa-4eba4e617993 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:29.017458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a6b218-d1e8-4bb5-b1fa-4eba4e617993 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:29.021020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a6b218-d1e8-4bb5-b1fa-4eba4e617993 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:29.021505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a6b218-d1e8-4bb5-b1fa-4eba4e617993 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:29.021942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a6b218-d1e8-4bb5-b1fa-4eba4e617993 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:29.093010 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5a6b218-d1e8-4bb5-b1fa-4eba4e617993 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.106343 Oct 05 17:37:29.098519 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 875/1675] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:28 2022] GET /compute/v2.1/os-services => generated 944 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:29.114045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2bb02c2e-1325-4ffe-ba17-d6e1de7149b8 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:29.121020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bb02c2e-1325-4ffe-ba17-d6e1de7149b8 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:29.121718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bb02c2e-1325-4ffe-ba17-d6e1de7149b8 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:29.122383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bb02c2e-1325-4ffe-ba17-d6e1de7149b8 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:29.123935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bb02c2e-1325-4ffe-ba17-d6e1de7149b8 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:29.124577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bb02c2e-1325-4ffe-ba17-d6e1de7149b8 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:29.125174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bb02c2e-1325-4ffe-ba17-d6e1de7149b8 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:29.163752 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2bb02c2e-1325-4ffe-ba17-d6e1de7149b8 tempest-ServicesAdminNegativeTestJSON-2042774189 tempest-ServicesAdminNegativeTestJSON-2042774189-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.055498 Oct 05 17:37:29.165027 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 801/1676] 10.222.0.70 () {58 vars in 1198 bytes} [Wed Oct 5 17:37:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 17:37:29.255214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ec2e2a2e-f463-4f3b-949d-104ae99b582f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:29.255924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ec2e2a2e-f463-4f3b-949d-104ae99b582f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:29.270835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec2e2a2e-f463-4f3b-949d-104ae99b582f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:29.271349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec2e2a2e-f463-4f3b-949d-104ae99b582f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:29.271804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec2e2a2e-f463-4f3b-949d-104ae99b582f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:29.275177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec2e2a2e-f463-4f3b-949d-104ae99b582f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:29.276685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec2e2a2e-f463-4f3b-949d-104ae99b582f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:29.277838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec2e2a2e-f463-4f3b-949d-104ae99b582f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:29.532676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ec35efb-3879-4044-b463-2a9c8059c161 tempest-ServicesAdminNegativeTestJSON-1206897425 tempest-ServicesAdminNegativeTestJSON-1206897425-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:29.536479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1ec35efb-3879-4044-b463-2a9c8059c161 tempest-ServicesAdminNegativeTestJSON-1206897425 tempest-ServicesAdminNegativeTestJSON-1206897425-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '29f0679d575c4a6382da93c9ae54e134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f0d111ab0a04c5184fe5020fefd14c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ec35efb-3879-4044-b463-2a9c8059c161 tempest-ServicesAdminNegativeTestJSON-1206897425 tempest-ServicesAdminNegativeTestJSON-1206897425-project] Request method failure captured: Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcDWcxcoMfEeP-1v8KsCdKMPVES_pDMw2HvKfHbLpQSDSXzlOby_FgWZ9sSuY7tsNmKUuhyxaG4-q-gFKBVUYBbnqfx0c-CHAcxmFybvD5Z9fBjSbU4uyhF8ghiK6Iosn1iPJaxJPzCEHgmOWBbZd1B_oYc4RASutqqtJ8qC0biIgAU Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 1f0d111ab0a04c5184fe5020fefd14c6 Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1206897425 Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:37:29.538239 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1f0d111ab0a04c5184fe5020fefd14c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f0d111ab0a04c5184fe5020fefd14c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1f0d111ab0a04c5184fe5020fefd14c6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1f0d111ab0a04c5184fe5020fefd14c6"}]}] Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1206897425 Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 1f0d111ab0a04c5184fe5020fefd14c6 Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1206897425 Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServicesAdminNegativeTestJSON-1206897425-project Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 29f0679d575c4a6382da93c9ae54e134 Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1206897425-project Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 17:37:29.540110 n-d-835595-3 devstack@n-api.service[128844]: action_args: {} Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 05 17:37:29.541104 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 05 17:37:29.542601 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:37:29.544114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ec35efb-3879-4044-b463-2a9c8059c161 tempest-ServicesAdminNegativeTestJSON-1206897425 tempest-ServicesAdminNegativeTestJSON-1206897425-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:37:29.544114 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1ec35efb-3879-4044-b463-2a9c8059c161 tempest-ServicesAdminNegativeTestJSON-1206897425 tempest-ServicesAdminNegativeTestJSON-1206897425-project] 10.222.0.70 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.365985 Oct 05 17:37:29.544114 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 876/1677] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 369 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:37:29.575351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eba4ddcf-b725-48ff-aa24-64da7ed0c780 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:29.575991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eba4ddcf-b725-48ff-aa24-64da7ed0c780 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:29.593632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba4ddcf-b725-48ff-aa24-64da7ed0c780 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:29.594979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba4ddcf-b725-48ff-aa24-64da7ed0c780 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:29.596859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba4ddcf-b725-48ff-aa24-64da7ed0c780 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:29.597648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba4ddcf-b725-48ff-aa24-64da7ed0c780 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:29.598134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba4ddcf-b725-48ff-aa24-64da7ed0c780 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:29.598606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba4ddcf-b725-48ff-aa24-64da7ed0c780 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:29.704132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eba4ddcf-b725-48ff-aa24-64da7ed0c780 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:29.730625 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eba4ddcf-b725-48ff-aa24-64da7ed0c780 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1598 microversion: 2.1 time: 0.160818 Oct 05 17:37:29.743033 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 877/1678] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:29 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1598 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:29.859169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2dcb6d40-a2bf-4de9-9819-3ac4aa62ec8a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:29.860911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2dcb6d40-a2bf-4de9-9819-3ac4aa62ec8a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:29.889408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2dcb6d40-a2bf-4de9-9819-3ac4aa62ec8a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:29.890929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2dcb6d40-a2bf-4de9-9819-3ac4aa62ec8a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:29.891466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2dcb6d40-a2bf-4de9-9819-3ac4aa62ec8a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:29.897540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2dcb6d40-a2bf-4de9-9819-3ac4aa62ec8a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:29.898409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2dcb6d40-a2bf-4de9-9819-3ac4aa62ec8a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:29.898868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2dcb6d40-a2bf-4de9-9819-3ac4aa62ec8a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:30.030219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ec2e2a2e-f463-4f3b-949d-104ae99b582f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:30.042604 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ec2e2a2e-f463-4f3b-949d-104ae99b582f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 0.791975 Oct 05 17:37:30.044575 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 802/1679] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:29 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:30.050040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e4cc1062-3951-40b8-bcfc-2b8a0f443629 req-2e19ae95-a41a-499a-a521-e955ffbbe0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b4b15d9-16c8-4d05-b9ca-5e55543861e8", "name": "network-vif-deleted", "tag": "986e6906-42b8-4dea-9619-4e506d550703"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:30.111744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e4cc1062-3951-40b8-bcfc-2b8a0f443629 req-2e19ae95-a41a-499a-a521-e955ffbbe0f7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:30.112561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e4cc1062-3951-40b8-bcfc-2b8a0f443629 req-2e19ae95-a41a-499a-a521-e955ffbbe0f7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:30.115304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e4cc1062-3951-40b8-bcfc-2b8a0f443629 req-2e19ae95-a41a-499a-a521-e955ffbbe0f7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:30.154342 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e4cc1062-3951-40b8-bcfc-2b8a0f443629 req-2e19ae95-a41a-499a-a521-e955ffbbe0f7 service nova] Creating event network-vif-deleted:986e6906-42b8-4dea-9619-4e506d550703 for instance 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 on n-h2-835595-3 Oct 05 17:37:30.164086 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e4cc1062-3951-40b8-bcfc-2b8a0f443629 req-2e19ae95-a41a-499a-a521-e955ffbbe0f7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116871 Oct 05 17:37:30.165263 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 803/1680] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:30.198044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2dcb6d40-a2bf-4de9-9819-3ac4aa62ec8a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:30.213751 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2dcb6d40-a2bf-4de9-9819-3ac4aa62ec8a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1296 microversion: 2.1 time: 0.362110 Oct 05 17:37:30.214825 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 878/1681] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:29 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1296 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:30.713505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3fdf1136-95ac-45f6-9598-2a19e4a393b6 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:30.734519 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3fdf1136-95ac-45f6-9598-2a19e4a393b6 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.333607 Oct 05 17:37:30.747588 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 804/1682] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:30.755165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2a64a11-d33e-4999-bd6e-1cc1c9bcf957 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:30.780465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:30.783171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:30.820046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:30.822361 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f2a64a11-d33e-4999-bd6e-1cc1c9bcf957 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.076153 Oct 05 17:37:30.823511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:30.824015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:30.826065 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 879/1683] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:37:30 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:30.827311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:30.827803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:30.833839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:30.852074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-af3659a2-decd-4c05-807a-a0617c91d4bc tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:30.882085 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-af3659a2-decd-4c05-807a-a0617c91d4bc tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043780 Oct 05 17:37:30.892690 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 880/1684] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:30.910321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a3586e1-9078-4755-b2dc-0c53e83102a9 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:30.941114 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2a3586e1-9078-4755-b2dc-0c53e83102a9 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.042622 Oct 05 17:37:30.942843 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 881/1685] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:30.959348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-608b43f4-65e8-4b54-a092-2bedb7f192dd tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:30.971175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:30.972719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:30.975928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:30.978937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lazy-loading 'fault' on Instance uuid 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:31.064953 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-608b43f4-65e8-4b54-a092-2bedb7f192dd tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.113357 Oct 05 17:37:31.082848 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 882/1686] 10.222.0.70 () {58 vars in 1165 bytes} [Wed Oct 5 17:37:30 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:31.112101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a151dff3-452f-4175-a93b-df28bf4a363c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:31.117106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a151dff3-452f-4175-a93b-df28bf4a363c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:31.148965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a151dff3-452f-4175-a93b-df28bf4a363c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:31.153351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a151dff3-452f-4175-a93b-df28bf4a363c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:31.157183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a151dff3-452f-4175-a93b-df28bf4a363c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:31.158055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a151dff3-452f-4175-a93b-df28bf4a363c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:31.161841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a151dff3-452f-4175-a93b-df28bf4a363c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:31.164058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a151dff3-452f-4175-a93b-df28bf4a363c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:31.479961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '624f7f9915d4447b95d2602a13bc5174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '605b47c049e84f9fb6f291d5c29779df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:31.491113 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4b25b5d6-1951-4100-bd4b-832232f9adc3 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 200 len: 1316 microversion: 2.1 time: 0.726969 Oct 05 17:37:31.492524 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 805/1687] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:30 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:31.498910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-45187d6b-33fa-49de-968a-92e0bcc07ae9 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:31.522329 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-45187d6b-33fa-49de-968a-92e0bcc07ae9 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027095 Oct 05 17:37:31.523042 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 806/1688] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:31.527935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53877378-7e45-44f1-8a34-4a0c80663ac5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:31.528843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-53877378-7e45-44f1-8a34-4a0c80663ac5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:31.537074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53877378-7e45-44f1-8a34-4a0c80663ac5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:31.538030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53877378-7e45-44f1-8a34-4a0c80663ac5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:31.538689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53877378-7e45-44f1-8a34-4a0c80663ac5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:31.539860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53877378-7e45-44f1-8a34-4a0c80663ac5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:31.540914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53877378-7e45-44f1-8a34-4a0c80663ac5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:31.541653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53877378-7e45-44f1-8a34-4a0c80663ac5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:31.595506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a151dff3-452f-4175-a93b-df28bf4a363c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:31.618481 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a151dff3-452f-4175-a93b-df28bf4a363c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 0.531909 Oct 05 17:37:31.619831 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 883/1689] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:31 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:31.636254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ef6f47d1-8bbe-4993-9d78-f7be43888ba2 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:31.757288 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ef6f47d1-8bbe-4993-9d78-f7be43888ba2 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.133068 Oct 05 17:37:31.760404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 884/1690] 10.222.0.70 () {58 vars in 1169 bytes} [Wed Oct 5 17:37:31 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:31.777791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64fb7b5d-a91a-48b0-8222-1eb46e71c7e2 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:31.792403 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-64fb7b5d-a91a-48b0-8222-1eb46e71c7e2 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.018931 Oct 05 17:37:31.803836 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 885/1691] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:37:31 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:31.810717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35047ec5-ae95-42ff-8292-aea950ccd42c tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:31.821229 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35047ec5-ae95-42ff-8292-aea950ccd42c tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015173 Oct 05 17:37:31.829903 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 886/1692] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:31.836318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5140652-89a7-4478-b1f0-aeb9d5ab4c54 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:31.840206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-53877378-7e45-44f1-8a34-4a0c80663ac5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:31.854916 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53877378-7e45-44f1-8a34-4a0c80663ac5 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1302 microversion: 2.1 time: 0.327436 Oct 05 17:37:31.855989 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 807/1693] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:31 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1302 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:31.920409 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5140652-89a7-4478-b1f0-aeb9d5ab4c54 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.088109 Oct 05 17:37:31.921045 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 887/1694] 10.222.0.70 () {58 vars in 1167 bytes} [Wed Oct 5 17:37:31 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:31.952591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8863eb6e-6ad2-46c4-a1e9-2353e6bf42fa tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:31.992397 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8863eb6e-6ad2-46c4-a1e9-2353e6bf42fa tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.044598 Oct 05 17:37:31.993777 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 808/1695] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:32.008835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8186b6c2-d927-46f0-9def-28ae18b64744 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.089094 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8186b6c2-d927-46f0-9def-28ae18b64744 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.086524 Oct 05 17:37:32.101838 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 888/1696] 10.222.0.70 () {58 vars in 1144 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:32.115289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b018100b-6d43-4612-9807-b06624846cdc tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.150732 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b018100b-6d43-4612-9807-b06624846cdc tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.040832 Oct 05 17:37:32.171405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9352aa30-b690-4bb2-8448-902e949220d0 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.175249 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 809/1697] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:32.235168 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9352aa30-b690-4bb2-8448-902e949220d0 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.067632 Oct 05 17:37:32.240805 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 889/1698] 10.222.0.70 () {58 vars in 1148 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:32.278146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1c836792-3fc3-4f78-b4b5-529eb20dc6dd tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.280488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1217ec10-2fe3-4b64-83e0-051009454314 req-c0e7a4ac-cf1b-4a02-ab24-6d83ebc144f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed889508-b94f-4d12-b1e8-d8566a8b1d87", "tag": "cc54401a-e03e-41e0-9f0e-4450adb99fff"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:32.306632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1217ec10-2fe3-4b64-83e0-051009454314 req-c0e7a4ac-cf1b-4a02-ab24-6d83ebc144f0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:32.312052 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1c836792-3fc3-4f78-b4b5-529eb20dc6dd tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.043031 Oct 05 17:37:32.312971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1217ec10-2fe3-4b64-83e0-051009454314 req-c0e7a4ac-cf1b-4a02-ab24-6d83ebc144f0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:32.313580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1217ec10-2fe3-4b64-83e0-051009454314 req-c0e7a4ac-cf1b-4a02-ab24-6d83ebc144f0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:32.325037 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 890/1699] 10.222.0.70 () {58 vars in 1140 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:32.330945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-667c4182-1d4c-44f6-804a-d7f0a5410ed7 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.340348 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-667c4182-1d4c-44f6-804a-d7f0a5410ed7 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013712 Oct 05 17:37:32.341381 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 891/1700] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:32.355029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d95a04a-7eca-4b6c-b5cc-1dcfa2a2791b tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.364282 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1217ec10-2fe3-4b64-83e0-051009454314 req-c0e7a4ac-cf1b-4a02-ab24-6d83ebc144f0 service nova] Creating event network-changed:cc54401a-e03e-41e0-9f0e-4450adb99fff for instance ed889508-b94f-4d12-b1e8-d8566a8b1d87 on n-h1-835595-3 Oct 05 17:37:32.380275 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1217ec10-2fe3-4b64-83e0-051009454314 req-c0e7a4ac-cf1b-4a02-ab24-6d83ebc144f0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113934 Oct 05 17:37:32.381240 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 810/1701] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:32.391136 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d95a04a-7eca-4b6c-b5cc-1dcfa2a2791b tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.039494 Oct 05 17:37:32.392175 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 892/1702] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:32.407181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9ed73dd6-f47a-43ac-b62c-f1877b82c5b1 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.471146 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9ed73dd6-f47a-43ac-b62c-f1877b82c5b1 tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.069255 Oct 05 17:37:32.472060 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 811/1703] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:32.497249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6169bc23-89ee-49a7-8e60-c924701ade0f tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.514014 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6169bc23-89ee-49a7-8e60-c924701ade0f tempest-FlavorsV2TestJSON-300067363 tempest-FlavorsV2TestJSON-300067363-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020797 Oct 05 17:37:32.515305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.516235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] [instance: 9b4b15d9-16c8-4d05-b9ca-5e55543861e8] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:32.516723 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 893/1704] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:32.530429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:32.531070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:32.531516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:32.532280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:32.532741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:32.533161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:32.544611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:32.584260 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] HTTP exception thrown: Instance 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 could not be found. Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Request method failure captured: Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 HTTP/1.1 Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcCIqoUs9Z2mVWDSGbDEXusk0o38nkI_Fk-YJXk3DfavVdjkKel4uc-yw2snqsLChcoyDODOffFy1U8CmLgILUxc1vV6Xd5qpc85YEetlbdZAd3awSkyIhbWQ1-FIBjVVL3aW3kBPx49OvKCInri1Lfof8LDlAUu4VpZyjG9FtfzG2M Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 605b47c049e84f9fb6f291d5c29779df Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestFqdnHostnames-1327179746 Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:37:32.587164 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/605b47c049e84f9fb6f291d5c29779df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/605b47c049e84f9fb6f291d5c29779df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_605b47c049e84f9fb6f291d5c29779df", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/605b47c049e84f9fb6f291d5c29779df"}]}] Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestFqdnHostnames-1327179746 Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 605b47c049e84f9fb6f291d5c29779df Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1327179746 Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestFqdnHostnames-1327179746-project Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 624f7f9915d4447b95d2602a13bc5174 Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestFqdnHostnames-1327179746-project Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 could not be found. Oct 05 17:37:32.588875 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '9b4b15d9-16c8-4d05-b9ca-5e55543861e8'} Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 could not be found. Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:37:32.590046 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 could not be found. Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 could not be found. Oct 05 17:37:32.592347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:37:32.601846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Returning 404 to user: Instance 9b4b15d9-16c8-4d05-b9ca-5e55543861e8 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:37:32.603023 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a37f554f-a8d5-4561-a115-799d91ec38a7 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8" status: 404 len: 111 microversion: 2.1 time: 0.091881 Oct 05 17:37:32.605181 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 812/1705] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/servers/9b4b15d9-16c8-4d05-b9ca-5e55543861e8 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:37:32.614850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-71448299-6f52-480d-a882-affe487d47a4 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] Calling method '.version_select at 0x7f77753e8b80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.650840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ba215025-82c8-4404-939b-d389f5d4b0d3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.651839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ba215025-82c8-4404-939b-d389f5d4b0d3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:32.675579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba215025-82c8-4404-939b-d389f5d4b0d3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:32.676048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba215025-82c8-4404-939b-d389f5d4b0d3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:32.682428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba215025-82c8-4404-939b-d389f5d4b0d3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:32.683943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba215025-82c8-4404-939b-d389f5d4b0d3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:32.685590 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-71448299-6f52-480d-a882-affe487d47a4 tempest-ServersTestFqdnHostnames-1327179746 tempest-ServersTestFqdnHostnames-1327179746-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005206645" status: 202 len: 0 microversion: 2.1 time: 0.075612 Oct 05 17:37:32.686677 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 894/1706] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 17:37:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1005206645 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:37:32.687395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba215025-82c8-4404-939b-d389f5d4b0d3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:32.689949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba215025-82c8-4404-939b-d389f5d4b0d3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:32.888076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81cc27e5-d4e8-4e52-846e-5d3a3f7fb1b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:32.889647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-81cc27e5-d4e8-4e52-846e-5d3a3f7fb1b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:32.905296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81cc27e5-d4e8-4e52-846e-5d3a3f7fb1b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:32.909405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81cc27e5-d4e8-4e52-846e-5d3a3f7fb1b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:32.910070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81cc27e5-d4e8-4e52-846e-5d3a3f7fb1b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:32.925081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81cc27e5-d4e8-4e52-846e-5d3a3f7fb1b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:32.926050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81cc27e5-d4e8-4e52-846e-5d3a3f7fb1b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:32.926710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81cc27e5-d4e8-4e52-846e-5d3a3f7fb1b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:33.214106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81cc27e5-d4e8-4e52-846e-5d3a3f7fb1b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:33.222762 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81cc27e5-d4e8-4e52-846e-5d3a3f7fb1b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1302 microversion: 2.1 time: 0.340241 Oct 05 17:37:33.227351 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 895/1707] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1302 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:33.265639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ba215025-82c8-4404-939b-d389f5d4b0d3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:33.278598 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ba215025-82c8-4404-939b-d389f5d4b0d3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 0.636937 Oct 05 17:37:33.280267 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 813/1708] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:32 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:34.249148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0bed769-fb01-44a9-b3d5-e23c3c4d82b6 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:34.250612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0bed769-fb01-44a9-b3d5-e23c3c4d82b6 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:34.265072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0bed769-fb01-44a9-b3d5-e23c3c4d82b6 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:34.266882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0bed769-fb01-44a9-b3d5-e23c3c4d82b6 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:34.267511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0bed769-fb01-44a9-b3d5-e23c3c4d82b6 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:34.268950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0bed769-fb01-44a9-b3d5-e23c3c4d82b6 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:34.270727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0bed769-fb01-44a9-b3d5-e23c3c4d82b6 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:34.273884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0bed769-fb01-44a9-b3d5-e23c3c4d82b6 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:34.304444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8742b5fb-a42a-49b1-8b0a-4db01b189603 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:34.305827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8742b5fb-a42a-49b1-8b0a-4db01b189603 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:34.319784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8742b5fb-a42a-49b1-8b0a-4db01b189603 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:34.320746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8742b5fb-a42a-49b1-8b0a-4db01b189603 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:34.326880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8742b5fb-a42a-49b1-8b0a-4db01b189603 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:34.328575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8742b5fb-a42a-49b1-8b0a-4db01b189603 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:34.331054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8742b5fb-a42a-49b1-8b0a-4db01b189603 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:34.331705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8742b5fb-a42a-49b1-8b0a-4db01b189603 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:34.465811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0bed769-fb01-44a9-b3d5-e23c3c4d82b6 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:34.476112 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0bed769-fb01-44a9-b3d5-e23c3c4d82b6 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1302 microversion: 2.1 time: 0.230978 Oct 05 17:37:34.485742 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 896/1709] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:34 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1302 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:35.016212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8742b5fb-a42a-49b1-8b0a-4db01b189603 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:35.032320 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8742b5fb-a42a-49b1-8b0a-4db01b189603 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 0.731889 Oct 05 17:37:35.033544 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 814/1710] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:34 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:35.515695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7886a011-dae5-4a8d-a244-eda1f5461267 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:35.515695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7886a011-dae5-4a8d-a244-eda1f5461267 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:35.531085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7886a011-dae5-4a8d-a244-eda1f5461267 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:35.533352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7886a011-dae5-4a8d-a244-eda1f5461267 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:35.534143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7886a011-dae5-4a8d-a244-eda1f5461267 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:35.540177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7886a011-dae5-4a8d-a244-eda1f5461267 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:35.542216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7886a011-dae5-4a8d-a244-eda1f5461267 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:35.546840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7886a011-dae5-4a8d-a244-eda1f5461267 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:36.070241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dc64cdcf-b466-4773-93ca-cef3730000fa tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:36.071029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dc64cdcf-b466-4773-93ca-cef3730000fa tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:36.092006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc64cdcf-b466-4773-93ca-cef3730000fa tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:36.093387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc64cdcf-b466-4773-93ca-cef3730000fa tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:36.094072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc64cdcf-b466-4773-93ca-cef3730000fa tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:36.095812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc64cdcf-b466-4773-93ca-cef3730000fa tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:36.096609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc64cdcf-b466-4773-93ca-cef3730000fa tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:36.097999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc64cdcf-b466-4773-93ca-cef3730000fa tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:36.505417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7886a011-dae5-4a8d-a244-eda1f5461267 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:36.562074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7886a011-dae5-4a8d-a244-eda1f5461267 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 1.033441 Oct 05 17:37:36.568257 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 897/1711] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:35 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:37.591531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0229dff-eb3c-478a-9eb7-77bc704d20c9 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:37.592327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0229dff-eb3c-478a-9eb7-77bc704d20c9 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:37.617600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0229dff-eb3c-478a-9eb7-77bc704d20c9 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:37.623312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0229dff-eb3c-478a-9eb7-77bc704d20c9 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:37.628483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0229dff-eb3c-478a-9eb7-77bc704d20c9 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:37.631072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0229dff-eb3c-478a-9eb7-77bc704d20c9 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:37.633548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0229dff-eb3c-478a-9eb7-77bc704d20c9 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:37.634671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0229dff-eb3c-478a-9eb7-77bc704d20c9 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:37.657971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dc64cdcf-b466-4773-93ca-cef3730000fa tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:37.666113 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dc64cdcf-b466-4773-93ca-cef3730000fa tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 1.609345 Oct 05 17:37:37.682529 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 815/1712] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:36 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:38.053254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0229dff-eb3c-478a-9eb7-77bc704d20c9 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:38.062453 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0229dff-eb3c-478a-9eb7-77bc704d20c9 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 0.475350 Oct 05 17:37:38.071427 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 898/1713] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:37 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:38.709189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed0246d9-4c88-4978-b39d-4503784b1613 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:38.710468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed0246d9-4c88-4978-b39d-4503784b1613 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:38.727005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed0246d9-4c88-4978-b39d-4503784b1613 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:38.729113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed0246d9-4c88-4978-b39d-4503784b1613 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:38.731900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed0246d9-4c88-4978-b39d-4503784b1613 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:38.732915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed0246d9-4c88-4978-b39d-4503784b1613 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:38.738187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed0246d9-4c88-4978-b39d-4503784b1613 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:38.741482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed0246d9-4c88-4978-b39d-4503784b1613 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:38.852752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=35,nova_cell0:UPDATE=7 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:39.100340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ce9daaa-3259-4715-a097-9bb8cc82650f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:39.100955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ce9daaa-3259-4715-a097-9bb8cc82650f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:39.108743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=14 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:39.114361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=10 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:39.119575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ce9daaa-3259-4715-a097-9bb8cc82650f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:39.122487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ce9daaa-3259-4715-a097-9bb8cc82650f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:39.123860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ce9daaa-3259-4715-a097-9bb8cc82650f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:39.126166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ce9daaa-3259-4715-a097-9bb8cc82650f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:39.127470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ce9daaa-3259-4715-a097-9bb8cc82650f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:39.128716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ce9daaa-3259-4715-a097-9bb8cc82650f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:39.135529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:39.751216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ed0246d9-4c88-4978-b39d-4503784b1613 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:39.762759 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed0246d9-4c88-4978-b39d-4503784b1613 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 1.054921 Oct 05 17:37:39.764151 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 816/1714] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:38 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:39.899310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9ce9daaa-3259-4715-a097-9bb8cc82650f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:39.927773 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ce9daaa-3259-4715-a097-9bb8cc82650f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 0.830708 Oct 05 17:37:39.943296 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 899/1715] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:39 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:40.164319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-69841cd7-1cf6-4555-a947-c1605cc5bf81 req-37cc76c9-f9d6-41a3-807f-7cb401896500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb9c26e4-6a60-4b8f-8268-7ec8034ca709", "tag": "e589215e-5a42-4222-bbff-7205d8e11675"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:40.206116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-69841cd7-1cf6-4555-a947-c1605cc5bf81 req-37cc76c9-f9d6-41a3-807f-7cb401896500 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:40.218946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-69841cd7-1cf6-4555-a947-c1605cc5bf81 req-37cc76c9-f9d6-41a3-807f-7cb401896500 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:40.224835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-69841cd7-1cf6-4555-a947-c1605cc5bf81 req-37cc76c9-f9d6-41a3-807f-7cb401896500 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:40.278487 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-69841cd7-1cf6-4555-a947-c1605cc5bf81 req-37cc76c9-f9d6-41a3-807f-7cb401896500 service nova] Creating event network-changed:e589215e-5a42-4222-bbff-7205d8e11675 for instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 on n-h1-835595-3 Oct 05 17:37:40.291839 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-69841cd7-1cf6-4555-a947-c1605cc5bf81 req-37cc76c9-f9d6-41a3-807f-7cb401896500 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131942 Oct 05 17:37:40.293165 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 817/1716] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:37:40.795214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-754d9547-7f07-4e55-ab3f-13258550298c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:40.796186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-754d9547-7f07-4e55-ab3f-13258550298c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:40.841087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-754d9547-7f07-4e55-ab3f-13258550298c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:40.843322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-754d9547-7f07-4e55-ab3f-13258550298c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:40.851686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-754d9547-7f07-4e55-ab3f-13258550298c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:40.860934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-754d9547-7f07-4e55-ab3f-13258550298c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:40.861540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-754d9547-7f07-4e55-ab3f-13258550298c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:40.870854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-754d9547-7f07-4e55-ab3f-13258550298c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:40.953974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-420e78aa-a693-4d44-ac22-ae1ac481246a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:40.954704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-420e78aa-a693-4d44-ac22-ae1ac481246a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:40.988777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-420e78aa-a693-4d44-ac22-ae1ac481246a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:40.989281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-420e78aa-a693-4d44-ac22-ae1ac481246a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:40.989763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-420e78aa-a693-4d44-ac22-ae1ac481246a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:40.990634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-420e78aa-a693-4d44-ac22-ae1ac481246a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:40.991117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-420e78aa-a693-4d44-ac22-ae1ac481246a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:40.991668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-420e78aa-a693-4d44-ac22-ae1ac481246a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:41.049158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:41.812536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-754d9547-7f07-4e55-ab3f-13258550298c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:41.829945 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-754d9547-7f07-4e55-ab3f-13258550298c tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 1.040034 Oct 05 17:37:41.850741 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 900/1717] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:40 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:41.935397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a30effc9-0e47-4f5e-8952-90e6bac05e25 req-432a8bc1-fd2a-497d-af07-1f082dc901f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed889508-b94f-4d12-b1e8-d8566a8b1d87", "name": "network-vif-plugged", "status": "completed", "tag": "cc54401a-e03e-41e0-9f0e-4450adb99fff"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:41.941844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:41.954176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a30effc9-0e47-4f5e-8952-90e6bac05e25 req-432a8bc1-fd2a-497d-af07-1f082dc901f8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:41.961276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a30effc9-0e47-4f5e-8952-90e6bac05e25 req-432a8bc1-fd2a-497d-af07-1f082dc901f8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:41.964545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a30effc9-0e47-4f5e-8952-90e6bac05e25 req-432a8bc1-fd2a-497d-af07-1f082dc901f8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:41.999552 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a30effc9-0e47-4f5e-8952-90e6bac05e25 req-432a8bc1-fd2a-497d-af07-1f082dc901f8 service nova] Creating event network-vif-plugged:cc54401a-e03e-41e0-9f0e-4450adb99fff for instance ed889508-b94f-4d12-b1e8-d8566a8b1d87 on n-h1-835595-3 Oct 05 17:37:42.012152 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a30effc9-0e47-4f5e-8952-90e6bac05e25 req-432a8bc1-fd2a-497d-af07-1f082dc901f8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084105 Oct 05 17:37:42.015207 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 901/1718] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:37:42.195472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-420e78aa-a693-4d44-ac22-ae1ac481246a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:42.207415 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-420e78aa-a693-4d44-ac22-ae1ac481246a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 1.258928 Oct 05 17:37:42.225581 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 818/1719] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:40 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:42.863297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a9b5fea-8b79-4152-8397-a6c7d18d38c3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:42.864619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9a9b5fea-8b79-4152-8397-a6c7d18d38c3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:42.879490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a9b5fea-8b79-4152-8397-a6c7d18d38c3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:42.882890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a9b5fea-8b79-4152-8397-a6c7d18d38c3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:42.883559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a9b5fea-8b79-4152-8397-a6c7d18d38c3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:42.885895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a9b5fea-8b79-4152-8397-a6c7d18d38c3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:42.886618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a9b5fea-8b79-4152-8397-a6c7d18d38c3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:42.889330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a9b5fea-8b79-4152-8397-a6c7d18d38c3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:43.239997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9c90a00-4b38-4a9c-bc22-8d81c5748f9d tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:43.241546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a9c90a00-4b38-4a9c-bc22-8d81c5748f9d tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:43.257464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9c90a00-4b38-4a9c-bc22-8d81c5748f9d tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:43.258311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9c90a00-4b38-4a9c-bc22-8d81c5748f9d tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:43.258940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9c90a00-4b38-4a9c-bc22-8d81c5748f9d tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:43.259880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9c90a00-4b38-4a9c-bc22-8d81c5748f9d tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:43.260783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9c90a00-4b38-4a9c-bc22-8d81c5748f9d tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:43.261408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9c90a00-4b38-4a9c-bc22-8d81c5748f9d tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:43.352433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9a9b5fea-8b79-4152-8397-a6c7d18d38c3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:43.394025 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a9b5fea-8b79-4152-8397-a6c7d18d38c3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 0.520592 Oct 05 17:37:43.395802 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 902/1720] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:42 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:44.421904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-61fa8c92-a17e-4a23-ae17-7e61a70aa4fb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:44.423388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-61fa8c92-a17e-4a23-ae17-7e61a70aa4fb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:44.449925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fa8c92-a17e-4a23-ae17-7e61a70aa4fb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:44.450972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fa8c92-a17e-4a23-ae17-7e61a70aa4fb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:44.451821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fa8c92-a17e-4a23-ae17-7e61a70aa4fb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:44.453768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fa8c92-a17e-4a23-ae17-7e61a70aa4fb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:44.456186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fa8c92-a17e-4a23-ae17-7e61a70aa4fb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:44.456978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fa8c92-a17e-4a23-ae17-7e61a70aa4fb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:44.607801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a9c90a00-4b38-4a9c-bc22-8d81c5748f9d tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:44.623415 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a9c90a00-4b38-4a9c-bc22-8d81c5748f9d tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 1.387144 Oct 05 17:37:44.625245 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 819/1721] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:43 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:44.937468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-61fa8c92-a17e-4a23-ae17-7e61a70aa4fb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:44.959531 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-61fa8c92-a17e-4a23-ae17-7e61a70aa4fb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 0.542161 Oct 05 17:37:44.961494 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 903/1722] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:44 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:45.657564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00576282-6aa7-4a85-93e6-78696f343a56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:45.658258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00576282-6aa7-4a85-93e6-78696f343a56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:45.692433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00576282-6aa7-4a85-93e6-78696f343a56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:45.699538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00576282-6aa7-4a85-93e6-78696f343a56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:45.701026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00576282-6aa7-4a85-93e6-78696f343a56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:45.701932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00576282-6aa7-4a85-93e6-78696f343a56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:45.702761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00576282-6aa7-4a85-93e6-78696f343a56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:45.705965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00576282-6aa7-4a85-93e6-78696f343a56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:45.986406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b57b01b1-b586-442a-8fab-0e5525056aa2 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:45.987962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b57b01b1-b586-442a-8fab-0e5525056aa2 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:45.998851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b57b01b1-b586-442a-8fab-0e5525056aa2 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:45.999660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b57b01b1-b586-442a-8fab-0e5525056aa2 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:46.000409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b57b01b1-b586-442a-8fab-0e5525056aa2 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:46.009093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b57b01b1-b586-442a-8fab-0e5525056aa2 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:46.010147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b57b01b1-b586-442a-8fab-0e5525056aa2 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:46.012879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b57b01b1-b586-442a-8fab-0e5525056aa2 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:46.443317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b57b01b1-b586-442a-8fab-0e5525056aa2 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:46.460841 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b57b01b1-b586-442a-8fab-0e5525056aa2 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1314 microversion: 2.1 time: 0.479379 Oct 05 17:37:46.464742 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 904/1723] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:45 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:46.485778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-00576282-6aa7-4a85-93e6-78696f343a56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:46.497013 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00576282-6aa7-4a85-93e6-78696f343a56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 0.848142 Oct 05 17:37:46.508863 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 820/1724] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:45 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:47.490437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6a093dea-5e47-4c43-9fc1-19b93463f5d8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:47.491888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6a093dea-5e47-4c43-9fc1-19b93463f5d8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:47.513748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a093dea-5e47-4c43-9fc1-19b93463f5d8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:47.514330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a093dea-5e47-4c43-9fc1-19b93463f5d8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:47.514792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a093dea-5e47-4c43-9fc1-19b93463f5d8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:47.519106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a093dea-5e47-4c43-9fc1-19b93463f5d8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:47.519652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a093dea-5e47-4c43-9fc1-19b93463f5d8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:47.520255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a093dea-5e47-4c43-9fc1-19b93463f5d8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:47.523314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-36834846-e39e-4c55-ba75-9b2cfd1ec8dc tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:47.524510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-36834846-e39e-4c55-ba75-9b2cfd1ec8dc tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:47.533572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36834846-e39e-4c55-ba75-9b2cfd1ec8dc tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:47.540211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36834846-e39e-4c55-ba75-9b2cfd1ec8dc tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:47.540910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36834846-e39e-4c55-ba75-9b2cfd1ec8dc tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:47.546226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36834846-e39e-4c55-ba75-9b2cfd1ec8dc tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:47.547140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36834846-e39e-4c55-ba75-9b2cfd1ec8dc tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:47.547805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36834846-e39e-4c55-ba75-9b2cfd1ec8dc tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:48.045304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6a093dea-5e47-4c43-9fc1-19b93463f5d8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:48.059534 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6a093dea-5e47-4c43-9fc1-19b93463f5d8 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1501 microversion: 2.1 time: 0.574636 Oct 05 17:37:48.070410 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 905/1725] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:47 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1501 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:48.097112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cf8dfb72-f1a6-4dd7-9c5c-85f94c9f5dd9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:48.101095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cf8dfb72-f1a6-4dd7-9c5c-85f94c9f5dd9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:48.115701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf8dfb72-f1a6-4dd7-9c5c-85f94c9f5dd9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:48.116205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf8dfb72-f1a6-4dd7-9c5c-85f94c9f5dd9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:48.118368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf8dfb72-f1a6-4dd7-9c5c-85f94c9f5dd9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:48.119140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf8dfb72-f1a6-4dd7-9c5c-85f94c9f5dd9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:48.119757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf8dfb72-f1a6-4dd7-9c5c-85f94c9f5dd9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:48.123307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf8dfb72-f1a6-4dd7-9c5c-85f94c9f5dd9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:48.177851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-cf8dfb72-f1a6-4dd7-9c5c-85f94c9f5dd9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lazy-loading 'flavor' on Instance uuid ed889508-b94f-4d12-b1e8-d8566a8b1d87 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:37:48.326235 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cf8dfb72-f1a6-4dd7-9c5c-85f94c9f5dd9 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "POST /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87/action" status: 200 len: 32 microversion: 2.1 time: 0.239293 Oct 05 17:37:48.326802 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 906/1726] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:37:48 2022] POST /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:37:48.341302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3e4cf659-dc27-4821-b9f7-6c2359f10482 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:48.342977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3e4cf659-dc27-4821-b9f7-6c2359f10482 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:48.356105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e4cf659-dc27-4821-b9f7-6c2359f10482 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:48.356692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e4cf659-dc27-4821-b9f7-6c2359f10482 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:48.357140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e4cf659-dc27-4821-b9f7-6c2359f10482 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:48.358404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e4cf659-dc27-4821-b9f7-6c2359f10482 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:48.359042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e4cf659-dc27-4821-b9f7-6c2359f10482 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:48.359543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e4cf659-dc27-4821-b9f7-6c2359f10482 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:48.379179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-36834846-e39e-4c55-ba75-9b2cfd1ec8dc tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:48.412503 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-36834846-e39e-4c55-ba75-9b2cfd1ec8dc tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 0.891089 Oct 05 17:37:48.428561 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 821/1727] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:47 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:49.192259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3e4cf659-dc27-4821-b9f7-6c2359f10482 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:49.203432 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3e4cf659-dc27-4821-b9f7-6c2359f10482 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.870071 Oct 05 17:37:49.204038 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 907/1728] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:48 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:49.456417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4fe340c3-bd2f-4e63-98fb-f8a7b4927115 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:49.457718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4fe340c3-bd2f-4e63-98fb-f8a7b4927115 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:49.490015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fe340c3-bd2f-4e63-98fb-f8a7b4927115 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:49.490802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fe340c3-bd2f-4e63-98fb-f8a7b4927115 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:49.492309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fe340c3-bd2f-4e63-98fb-f8a7b4927115 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:49.493361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fe340c3-bd2f-4e63-98fb-f8a7b4927115 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:49.494018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fe340c3-bd2f-4e63-98fb-f8a7b4927115 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:49.494663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fe340c3-bd2f-4e63-98fb-f8a7b4927115 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:50.230821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ed574432-8e5f-499c-8646-98b14ba158f5 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:50.231436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ed574432-8e5f-499c-8646-98b14ba158f5 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:50.242787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed574432-8e5f-499c-8646-98b14ba158f5 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:50.243283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed574432-8e5f-499c-8646-98b14ba158f5 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:50.243719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed574432-8e5f-499c-8646-98b14ba158f5 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:50.244427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed574432-8e5f-499c-8646-98b14ba158f5 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:50.244883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed574432-8e5f-499c-8646-98b14ba158f5 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:50.245319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed574432-8e5f-499c-8646-98b14ba158f5 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:50.465688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4fe340c3-bd2f-4e63-98fb-f8a7b4927115 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:50.487099 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4fe340c3-bd2f-4e63-98fb-f8a7b4927115 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 1.051245 Oct 05 17:37:50.488350 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 822/1729] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:49 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:50.490319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ed574432-8e5f-499c-8646-98b14ba158f5 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:50.509020 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ed574432-8e5f-499c-8646-98b14ba158f5 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.282282 Oct 05 17:37:50.509611 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 908/1730] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:50 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:51.512653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b2b62f7e-529d-4339-b679-cf109d4cf763 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:51.514991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b2b62f7e-529d-4339-b679-cf109d4cf763 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:51.532996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9fba5bd0-748b-41b3-9c0c-27284f8ec30a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:51.533605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9fba5bd0-748b-41b3-9c0c-27284f8ec30a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:51.535249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b62f7e-529d-4339-b679-cf109d4cf763 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:51.536709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b62f7e-529d-4339-b679-cf109d4cf763 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:51.541226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fba5bd0-748b-41b3-9c0c-27284f8ec30a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:51.541716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fba5bd0-748b-41b3-9c0c-27284f8ec30a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:51.542014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b62f7e-529d-4339-b679-cf109d4cf763 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:51.542154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fba5bd0-748b-41b3-9c0c-27284f8ec30a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:51.545491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b62f7e-529d-4339-b679-cf109d4cf763 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:51.550724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fba5bd0-748b-41b3-9c0c-27284f8ec30a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:51.551453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fba5bd0-748b-41b3-9c0c-27284f8ec30a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:51.552051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fba5bd0-748b-41b3-9c0c-27284f8ec30a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:51.552343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b62f7e-529d-4339-b679-cf109d4cf763 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:51.552966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b62f7e-529d-4339-b679-cf109d4cf763 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:51.916842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9fba5bd0-748b-41b3-9c0c-27284f8ec30a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:51.926058 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9fba5bd0-748b-41b3-9c0c-27284f8ec30a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.396900 Oct 05 17:37:51.947205 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 909/1731] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:51 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:52.122683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2b62f7e-529d-4339-b679-cf109d4cf763 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:52.136054 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b2b62f7e-529d-4339-b679-cf109d4cf763 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 0.627966 Oct 05 17:37:52.138961 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 823/1732] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:51 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:52.952603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9b455506-d2b4-4a24-b93c-d2a2f5665335 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:52.953357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9b455506-d2b4-4a24-b93c-d2a2f5665335 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:52.964119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b455506-d2b4-4a24-b93c-d2a2f5665335 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:52.964726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b455506-d2b4-4a24-b93c-d2a2f5665335 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:52.965574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b455506-d2b4-4a24-b93c-d2a2f5665335 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:52.968222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b455506-d2b4-4a24-b93c-d2a2f5665335 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:52.969386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b455506-d2b4-4a24-b93c-d2a2f5665335 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:52.970023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b455506-d2b4-4a24-b93c-d2a2f5665335 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:53.161254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2168dbee-ad8b-492d-a480-38992b1dc8bf tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:53.162813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2168dbee-ad8b-492d-a480-38992b1dc8bf tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:53.176020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2168dbee-ad8b-492d-a480-38992b1dc8bf tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:53.177465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2168dbee-ad8b-492d-a480-38992b1dc8bf tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:53.179658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2168dbee-ad8b-492d-a480-38992b1dc8bf tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:53.180880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2168dbee-ad8b-492d-a480-38992b1dc8bf tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:53.183574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2168dbee-ad8b-492d-a480-38992b1dc8bf tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:53.185418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2168dbee-ad8b-492d-a480-38992b1dc8bf tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:53.426454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9b455506-d2b4-4a24-b93c-d2a2f5665335 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:53.442506 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9b455506-d2b4-4a24-b93c-d2a2f5665335 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.496409 Oct 05 17:37:53.461711 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 910/1733] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:52 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:53.534719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2168dbee-ad8b-492d-a480-38992b1dc8bf tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:53.546645 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2168dbee-ad8b-492d-a480-38992b1dc8bf tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 0.390058 Oct 05 17:37:53.552318 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 824/1734] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:53 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:54.478396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-45f16eba-9595-4fc1-ba31-80983f6ec866 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:54.479021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-45f16eba-9595-4fc1-ba31-80983f6ec866 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:54.489115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45f16eba-9595-4fc1-ba31-80983f6ec866 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:54.489914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45f16eba-9595-4fc1-ba31-80983f6ec866 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:54.490576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45f16eba-9595-4fc1-ba31-80983f6ec866 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:54.491493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45f16eba-9595-4fc1-ba31-80983f6ec866 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:54.492120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45f16eba-9595-4fc1-ba31-80983f6ec866 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:54.492719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45f16eba-9595-4fc1-ba31-80983f6ec866 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:54.579749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1d56234d-2e8d-4851-b027-0e455d010faa tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:54.580927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1d56234d-2e8d-4851-b027-0e455d010faa tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:54.592490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d56234d-2e8d-4851-b027-0e455d010faa tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:54.595236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d56234d-2e8d-4851-b027-0e455d010faa tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:54.595935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d56234d-2e8d-4851-b027-0e455d010faa tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:54.596904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d56234d-2e8d-4851-b027-0e455d010faa tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:54.600498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d56234d-2e8d-4851-b027-0e455d010faa tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:54.601184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d56234d-2e8d-4851-b027-0e455d010faa tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:54.986982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1d56234d-2e8d-4851-b027-0e455d010faa tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:55.002013 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1d56234d-2e8d-4851-b027-0e455d010faa tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 0.426082 Oct 05 17:37:55.002911 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 825/1735] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:54 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:37:55.316321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-fb21667e-fe24-4ccd-8f26-1f7550fa1da1 req-ccbd6680-f073-40b7-996b-1f88cad1dda4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9c26e4-6a60-4b8f-8268-7ec8034ca709", "name": "network-vif-plugged", "status": "completed", "tag": "e589215e-5a42-4222-bbff-7205d8e11675"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:55.339437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fb21667e-fe24-4ccd-8f26-1f7550fa1da1 req-ccbd6680-f073-40b7-996b-1f88cad1dda4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:55.339925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fb21667e-fe24-4ccd-8f26-1f7550fa1da1 req-ccbd6680-f073-40b7-996b-1f88cad1dda4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:55.340357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fb21667e-fe24-4ccd-8f26-1f7550fa1da1 req-ccbd6680-f073-40b7-996b-1f88cad1dda4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:55.360876 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-fb21667e-fe24-4ccd-8f26-1f7550fa1da1 req-ccbd6680-f073-40b7-996b-1f88cad1dda4 service nova] Creating event network-vif-plugged:e589215e-5a42-4222-bbff-7205d8e11675 for instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 on n-h1-835595-3 Oct 05 17:37:55.379396 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-fb21667e-fe24-4ccd-8f26-1f7550fa1da1 req-ccbd6680-f073-40b7-996b-1f88cad1dda4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069021 Oct 05 17:37:55.380363 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 826/1736] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:37:55.399419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-45f16eba-9595-4fc1-ba31-80983f6ec866 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:55.412723 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-45f16eba-9595-4fc1-ba31-80983f6ec866 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.938838 Oct 05 17:37:55.432978 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 911/1737] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:54 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:55.694800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-890402296", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "71625936-48e5-43f1-8d04-88ba77014c3c"}], "block_device_mapping_v2": [{"uuid": "0ee4444f-72e5-40c6-9764-2e438b22f6a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:37:55.792459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] validate_networks() for [('71625936-48e5-43f1-8d04-88ba77014c3c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:37:56.025572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-045fdfdf-d792-4818-a8cc-9d0d4756390f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:56.026446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-045fdfdf-d792-4818-a8cc-9d0d4756390f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:56.041628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-045fdfdf-d792-4818-a8cc-9d0d4756390f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:56.042580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-045fdfdf-d792-4818-a8cc-9d0d4756390f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:56.044356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-045fdfdf-d792-4818-a8cc-9d0d4756390f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:56.046963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-045fdfdf-d792-4818-a8cc-9d0d4756390f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:56.047579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-045fdfdf-d792-4818-a8cc-9d0d4756390f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:56.049253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-045fdfdf-d792-4818-a8cc-9d0d4756390f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:56.664525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-045fdfdf-d792-4818-a8cc-9d0d4756390f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:56.676564 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-045fdfdf-d792-4818-a8cc-9d0d4756390f tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1369 microversion: 2.1 time: 0.654423 Oct 05 17:37:56.677949 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 912/1738] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:56 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1369 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:56.684234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ca6bb588-b4ec-482d-a594-ff92401d0bed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:56.685973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ca6bb588-b4ec-482d-a594-ff92401d0bed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:56.694465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca6bb588-b4ec-482d-a594-ff92401d0bed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:56.695417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca6bb588-b4ec-482d-a594-ff92401d0bed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:56.696299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca6bb588-b4ec-482d-a594-ff92401d0bed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:56.698827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca6bb588-b4ec-482d-a594-ff92401d0bed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:56.699607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca6bb588-b4ec-482d-a594-ff92401d0bed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:56.700519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca6bb588-b4ec-482d-a594-ff92401d0bed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:57.047241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:37:57.049475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:37:57.050221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:37:57.050905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:37:57.051602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:37:57.085327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:57.086712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:57.087419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:57.088406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:57.089103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:57.090223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:57.147365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Getting quotas for project 51a14f79344f4986a6c54001c3d7590c. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:37:57.161592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Getting quotas for user 205777d0702b45d1b400045c3a2fd47b and project 51a14f79344f4986a6c54001c3d7590c. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:37:57.281096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:37:57.283609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0ee4444f-72e5-40c6-9764-2e438b22f6a4',volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:37:57.506863 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a46e1697-0a4e-4a98-b9a9-2f0051f87a13 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.820487 Oct 05 17:37:57.508786 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 827/1739] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:37:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1824 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:37:57.524198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-20d32391-e9f9-47a7-a9ae-1438bc0c7585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:57.525155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-20d32391-e9f9-47a7-a9ae-1438bc0c7585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:57.755882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-20d32391-e9f9-47a7-a9ae-1438bc0c7585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:57.772648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-20d32391-e9f9-47a7-a9ae-1438bc0c7585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:57.774418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-20d32391-e9f9-47a7-a9ae-1438bc0c7585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:57.775907 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-20d32391-e9f9-47a7-a9ae-1438bc0c7585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1103 microversion: 2.25 time: 0.257695 Oct 05 17:37:57.778021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ca6bb588-b4ec-482d-a594-ff92401d0bed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:57.779640 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 828/1740] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:57 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1103 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:57.792959 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ca6bb588-b4ec-482d-a594-ff92401d0bed tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 1.113411 Oct 05 17:37:57.793377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-46132d9a-db88-48e1-b82f-8b8875b82fb7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:57.795459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-46132d9a-db88-48e1-b82f-8b8875b82fb7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:57.799470 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 913/1741] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:56 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:57.812172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46132d9a-db88-48e1-b82f-8b8875b82fb7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:57.814934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c140f53d-2eec-49b2-aa8d-877db3bb3a7c tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:57.815573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c140f53d-2eec-49b2-aa8d-877db3bb3a7c tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:57.819396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46132d9a-db88-48e1-b82f-8b8875b82fb7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:57.820474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46132d9a-db88-48e1-b82f-8b8875b82fb7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:57.821687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46132d9a-db88-48e1-b82f-8b8875b82fb7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:57.822996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46132d9a-db88-48e1-b82f-8b8875b82fb7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:57.825773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46132d9a-db88-48e1-b82f-8b8875b82fb7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:57.835690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c140f53d-2eec-49b2-aa8d-877db3bb3a7c tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:57.838441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c140f53d-2eec-49b2-aa8d-877db3bb3a7c tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:57.840314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c140f53d-2eec-49b2-aa8d-877db3bb3a7c tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:57.841953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c140f53d-2eec-49b2-aa8d-877db3bb3a7c tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:57.843450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c140f53d-2eec-49b2-aa8d-877db3bb3a7c tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:57.845137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c140f53d-2eec-49b2-aa8d-877db3bb3a7c tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:58.485397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-46132d9a-db88-48e1-b82f-8b8875b82fb7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:58.506137 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-46132d9a-db88-48e1-b82f-8b8875b82fb7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.724984 Oct 05 17:37:58.562391 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 829/1742] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:57 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:58.592899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e81ecad-e785-4fdf-881a-dcb0ed006a53 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:58.593720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e81ecad-e785-4fdf-881a-dcb0ed006a53 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:58.605518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e81ecad-e785-4fdf-881a-dcb0ed006a53 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:58.608619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e81ecad-e785-4fdf-881a-dcb0ed006a53 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:58.609259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e81ecad-e785-4fdf-881a-dcb0ed006a53 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:58.611613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e81ecad-e785-4fdf-881a-dcb0ed006a53 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:58.613498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e81ecad-e785-4fdf-881a-dcb0ed006a53 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:58.614354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e81ecad-e785-4fdf-881a-dcb0ed006a53 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:59.203348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2e81ecad-e785-4fdf-881a-dcb0ed006a53 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:59.246963 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e81ecad-e785-4fdf-881a-dcb0ed006a53 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.672340 Oct 05 17:37:59.250401 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 830/1743] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:58 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:37:59.285214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:59.293068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:37:59.303272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:37:59.329770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:59.330180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:59.330640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:59.331350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:37:59.331799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:37:59.332223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:37:59.931998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:59.960383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:59.962475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:37:59.964100 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6518b8cc-7748-4158-982b-860c84e43472 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1232 microversion: 2.25 time: 0.712391 Oct 05 17:37:59.980286 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 831/1744] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:37:59 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1232 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:37:59.993748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f890687-f330-465c-8ced-971a09a1563d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:37:59.994893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f890687-f330-465c-8ced-971a09a1563d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:00.003490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f890687-f330-465c-8ced-971a09a1563d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:00.007016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f890687-f330-465c-8ced-971a09a1563d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:00.007779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f890687-f330-465c-8ced-971a09a1563d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:00.010228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f890687-f330-465c-8ced-971a09a1563d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:00.011994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f890687-f330-465c-8ced-971a09a1563d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:00.012452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f890687-f330-465c-8ced-971a09a1563d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:00.063654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:00.159745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c140f53d-2eec-49b2-aa8d-877db3bb3a7c tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:00.170395 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c140f53d-2eec-49b2-aa8d-877db3bb3a7c tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1555 microversion: 2.1 time: 2.368325 Oct 05 17:38:00.171000 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 914/1745] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:57 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1555 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:00.200700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c417b43e-0553-4a8e-88d6-157cc5dbd817 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:00.203662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c417b43e-0553-4a8e-88d6-157cc5dbd817 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:00.221474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c417b43e-0553-4a8e-88d6-157cc5dbd817 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:00.221989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c417b43e-0553-4a8e-88d6-157cc5dbd817 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:00.222462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c417b43e-0553-4a8e-88d6-157cc5dbd817 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:00.224808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c417b43e-0553-4a8e-88d6-157cc5dbd817 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:00.225288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c417b43e-0553-4a8e-88d6-157cc5dbd817 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:00.225713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c417b43e-0553-4a8e-88d6-157cc5dbd817 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:00.774018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4f890687-f330-465c-8ced-971a09a1563d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:00.787721 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f890687-f330-465c-8ced-971a09a1563d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.806191 Oct 05 17:38:00.793009 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 832/1746] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:37:59 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:00.810907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51c30ab5-8986-4dbf-8047-696cee1c46fe tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:00.811412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51c30ab5-8986-4dbf-8047-696cee1c46fe tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:00.848962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51c30ab5-8986-4dbf-8047-696cee1c46fe tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:00.849473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51c30ab5-8986-4dbf-8047-696cee1c46fe tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:00.850000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51c30ab5-8986-4dbf-8047-696cee1c46fe tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:00.856538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51c30ab5-8986-4dbf-8047-696cee1c46fe tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:00.858036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51c30ab5-8986-4dbf-8047-696cee1c46fe tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:00.859044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51c30ab5-8986-4dbf-8047-696cee1c46fe tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:01.144778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c417b43e-0553-4a8e-88d6-157cc5dbd817 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:01.148766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:01.166749 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c417b43e-0553-4a8e-88d6-157cc5dbd817 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.991745 Oct 05 17:38:01.171334 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 915/1747] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:00 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:01.382266 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51c30ab5-8986-4dbf-8047-696cee1c46fe tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.581349 Oct 05 17:38:01.384071 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 833/1748] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:38:00 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-interface => generated 285 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:01.404623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:01.408279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:01.436470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:01.437991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:01.439324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:01.443461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:01.444922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:01.447135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:01.601592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-61b5ca8b-51e2-40a6-aeda-3991e61b0b49 tempest-FloatingIPDetailsNegativeTestJSON-379412143 tempest-FloatingIPDetailsNegativeTestJSON-379412143-project] Calling method '.version_select at 0x7f77796215e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:01.962617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG neutronclient.v2_0.client [None req-61b5ca8b-51e2-40a6-aeda-3991e61b0b49 tempest-FloatingIPDetailsNegativeTestJSON-379412143 tempest-FloatingIPDetailsNegativeTestJSON-379412143-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b6fb2d2c-7886-4c4d-accf-6d22427e3f56 could not be found", "detail": ""}} {{(pid=128844) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:38:01.964320 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-61b5ca8b-51e2-40a6-aeda-3991e61b0b49 tempest-FloatingIPDetailsNegativeTestJSON-379412143 tempest-FloatingIPDetailsNegativeTestJSON-379412143-project] HTTP exception thrown: Floating IP not found for ID b6fb2d2c-7886-4c4d-accf-6d22427e3f56 Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-61b5ca8b-51e2-40a6-aeda-3991e61b0b49 tempest-FloatingIPDetailsNegativeTestJSON-379412143 tempest-FloatingIPDetailsNegativeTestJSON-379412143-project] Request method failure captured: Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-floating-ips/b6fb2d2c-7886-4c4d-accf-6d22427e3f56 HTTP/1.1 Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcD4LZBeRFpre3gSTqnkIUpa-gyZ-nS5Pdy6PFagrocy54Z9o4uVCD79lp6w7gNgfeMOGsKIY4A07fN8VwJnuuSVQGxZ0UZdlmO7oOuuPIqiGnPJ8CHgT-AgeT1Q58uc8_zWMximJd9iYCGyR-lsGyE0RSuiUPQ09lY4rVm788-24g8 Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c8bcb14c78f14f738767f6ba4c0c92d9 Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-379412143 Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:38:01.966928 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c8bcb14c78f14f738767f6ba4c0c92d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c8bcb14c78f14f738767f6ba4c0c92d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c8bcb14c78f14f738767f6ba4c0c92d9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c8bcb14c78f14f738767f6ba4c0c92d9"}]}] Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-379412143 Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c8bcb14c78f14f738767f6ba4c0c92d9 Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-379412143 Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-379412143-project Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: d3b0eebc97f941df9cb8a940265c5d5d Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-379412143-project Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: exception: Floating IP not found for ID b6fb2d2c-7886-4c4d-accf-6d22427e3f56 Oct 05 17:38:01.968680 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'b6fb2d2c-7886-4c4d-accf-6d22427e3f56'} Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:01.969682 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b6fb2d2c-7886-4c4d-accf-6d22427e3f56 could not be found Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f0e86a7b-b734-492d-88a7-4aa83098a9aa'] Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b6fb2d2c-7886-4c4d-accf-6d22427e3f56. Oct 05 17:38:01.971106 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b6fb2d2c-7886-4c4d-accf-6d22427e3f56 Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:01.972446 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:01.974144 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:01.974144 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b6fb2d2c-7886-4c4d-accf-6d22427e3f56 Oct 05 17:38:01.974144 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:01.978512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-61b5ca8b-51e2-40a6-aeda-3991e61b0b49 tempest-FloatingIPDetailsNegativeTestJSON-379412143 tempest-FloatingIPDetailsNegativeTestJSON-379412143-project] Returning 404 to user: Floating IP not found for ID b6fb2d2c-7886-4c4d-accf-6d22427e3f56 {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:01.978512 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-61b5ca8b-51e2-40a6-aeda-3991e61b0b49 tempest-FloatingIPDetailsNegativeTestJSON-379412143 tempest-FloatingIPDetailsNegativeTestJSON-379412143-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/b6fb2d2c-7886-4c4d-accf-6d22427e3f56" status: 404 len: 111 microversion: 2.1 time: 0.804390 Oct 05 17:38:01.978512 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 916/1749] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:38:01 2022] GET /compute/v2.1/os-floating-ips/b6fb2d2c-7886-4c4d-accf-6d22427e3f56 => generated 111 bytes in 805 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:38:01.996146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27cf0234-0d06-4bfc-834a-f8c8e2c4db57 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1433416690"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:02.002153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-27cf0234-0d06-4bfc-834a-f8c8e2c4db57 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:02.036042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27cf0234-0d06-4bfc-834a-f8c8e2c4db57 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:02.036896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27cf0234-0d06-4bfc-834a-f8c8e2c4db57 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:02.037524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27cf0234-0d06-4bfc-834a-f8c8e2c4db57 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:02.038502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27cf0234-0d06-4bfc-834a-f8c8e2c4db57 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:02.039373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27cf0234-0d06-4bfc-834a-f8c8e2c4db57 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:02.039983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27cf0234-0d06-4bfc-834a-f8c8e2c4db57 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:02.454545 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27cf0234-0d06-4bfc-834a-f8c8e2c4db57 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.475686 Oct 05 17:38:02.467864 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 917/1750] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:38:01 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 05 17:38:02.601964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24672dd2-b687-4caf-ae53-d1130d6e3a40 tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] Calling method '.version_select at 0x7f777962c9d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:02.791832 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-24672dd2-b687-4caf-ae53-d1130d6e3a40 tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.322137 Oct 05 17:38:02.792970 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 918/1751] 10.222.0.70 () {58 vars in 1149 bytes} [Wed Oct 5 17:38:02 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:38:02.798492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bdddacef-8f85-4a2a-b583-d50886fab000 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:02.799316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bdddacef-8f85-4a2a-b583-d50886fab000 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:02.816437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdddacef-8f85-4a2a-b583-d50886fab000 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:02.818907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdddacef-8f85-4a2a-b583-d50886fab000 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:02.822867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdddacef-8f85-4a2a-b583-d50886fab000 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:02.825537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdddacef-8f85-4a2a-b583-d50886fab000 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:02.826090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdddacef-8f85-4a2a-b583-d50886fab000 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:02.826556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdddacef-8f85-4a2a-b583-d50886fab000 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:03.269741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bdddacef-8f85-4a2a-b583-d50886fab000 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:03.282942 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bdddacef-8f85-4a2a-b583-d50886fab000 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.488593 Oct 05 17:38:03.286805 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 919/1752] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:02 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:03.415567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92b2dcf3-001f-46d3-935f-e69375cbd823 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Action: 'create', calling method: .version_select at 0x7f777963e5e0>, body: {"pool": null} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:03.644502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:03.656381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:03.665737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:03.667932 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b45a79e-2176-4560-9eda-b3252be0fd50 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1292 microversion: 2.25 time: 2.274682 Oct 05 17:38:03.675736 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 834/1753] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:01 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1292 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:03.690493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27330c1d-e6f5-448a-84c5-71ad6f0d43e5 tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] Action: 'create', calling method: .version_select at 0x7f7779652940>, body: {"pool": "non_exist_pool"} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:04.029745 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-27330c1d-e6f5-448a-84c5-71ad6f0d43e5 tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] HTTP exception thrown: Floating IP pool not found. Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27330c1d-e6f5-448a-84c5-71ad6f0d43e5 tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] Request method failure captured: Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 26 Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcD51W3cK8M6zBPYmAPDpzrh7s0Z7Dsz2nP9BFxFB5r3BGDNpYFEw7SwHLR1UPfQWKj39WhANPNEKoTbNLNeIW2bb0M0hAKbS031xw4B0e6mRiPTb_HY12YgxCLyYBlKs96fBgTEBn5v4z1bFYQdVniXCailnOdlg1RCr5u9s_OpJWg Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8623ea73ee0e449b8e4887eb5f893c40 Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1584609773 Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:38:04.039146 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8623ea73ee0e449b8e4887eb5f893c40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8623ea73ee0e449b8e4887eb5f893c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8623ea73ee0e449b8e4887eb5f893c40", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8623ea73ee0e449b8e4887eb5f893c40"}]}] Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1584609773 Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8623ea73ee0e449b8e4887eb5f893c40 Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1584609773 Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FloatingIPsNegativeTestJSON-1584609773-project Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0df3f01745c94e4dab68aeeeb78183b7 Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1584609773-project Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: {"pool": "non_exist_pool"} Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: exception: Floating IP pool not found. Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 05 17:38:04.041125 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:04.042440 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 05 17:38:04.044173 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.049833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27330c1d-e6f5-448a-84c5-71ad6f0d43e5 tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] Returning 404 to user: Floating IP pool not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:04.055363 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-27330c1d-e6f5-448a-84c5-71ad6f0d43e5 tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.376455 Oct 05 17:38:04.056939 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 835/1754] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:38:03 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 380 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:38:04.080032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b69c477b-60aa-4405-83f1-db356c1314cb tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] Calling method '.version_select at 0x7f777613b310>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:04.231571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-b69c477b-60aa-4405-83f1-db356c1314cb tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3066ea4e-da6b-4bae-9fed-1f53ca05988f could not be found", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:38:04.233224 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-b69c477b-60aa-4405-83f1-db356c1314cb tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] HTTP exception thrown: Floating IP not found for ID 3066ea4e-da6b-4bae-9fed-1f53ca05988f Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b69c477b-60aa-4405-83f1-db356c1314cb tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] Request method failure captured: Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-floating-ips/3066ea4e-da6b-4bae-9fed-1f53ca05988f HTTP/1.1 Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcD51W3cK8M6zBPYmAPDpzrh7s0Z7Dsz2nP9BFxFB5r3BGDNpYFEw7SwHLR1UPfQWKj39WhANPNEKoTbNLNeIW2bb0M0hAKbS031xw4B0e6mRiPTb_HY12YgxCLyYBlKs96fBgTEBn5v4z1bFYQdVniXCailnOdlg1RCr5u9s_OpJWg Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8623ea73ee0e449b8e4887eb5f893c40 Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1584609773 Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:38:04.237397 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8623ea73ee0e449b8e4887eb5f893c40"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8623ea73ee0e449b8e4887eb5f893c40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8623ea73ee0e449b8e4887eb5f893c40", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8623ea73ee0e449b8e4887eb5f893c40"}]}] Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1584609773 Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8623ea73ee0e449b8e4887eb5f893c40 Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1584609773 Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FloatingIPsNegativeTestJSON-1584609773-project Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0df3f01745c94e4dab68aeeeb78183b7 Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1584609773-project Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: exception: Floating IP not found for ID 3066ea4e-da6b-4bae-9fed-1f53ca05988f Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '3066ea4e-da6b-4bae-9fed-1f53ca05988f'} Oct 05 17:38:04.239887 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:38:04.240976 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3066ea4e-da6b-4bae-9fed-1f53ca05988f could not be found Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8cd7bbab-ecaf-4f0a-b3d3-d9240608c740'] Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3066ea4e-da6b-4bae-9fed-1f53ca05988f. Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:04.242700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3066ea4e-da6b-4bae-9fed-1f53ca05988f Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:04.244309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:04.245906 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3066ea4e-da6b-4bae-9fed-1f53ca05988f Oct 05 17:38:04.245906 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:04.253424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b69c477b-60aa-4405-83f1-db356c1314cb tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] Returning 404 to user: Floating IP not found for ID 3066ea4e-da6b-4bae-9fed-1f53ca05988f {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:04.254605 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b69c477b-60aa-4405-83f1-db356c1314cb tempest-FloatingIPsNegativeTestJSON-1584609773 tempest-FloatingIPsNegativeTestJSON-1584609773-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/3066ea4e-da6b-4bae-9fed-1f53ca05988f" status: 404 len: 111 microversion: 2.1 time: 0.191612 Oct 05 17:38:04.255820 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 836/1755] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:38:04 2022] DELETE /compute/v2.1/os-floating-ips/3066ea4e-da6b-4bae-9fed-1f53ca05988f => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:38:04.312373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8657455e-b202-4b02-9483-4cc464dcfe70 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:04.313389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8657455e-b202-4b02-9483-4cc464dcfe70 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:04.324500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8657455e-b202-4b02-9483-4cc464dcfe70 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:04.327351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8657455e-b202-4b02-9483-4cc464dcfe70 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:04.327999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8657455e-b202-4b02-9483-4cc464dcfe70 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:04.331199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8657455e-b202-4b02-9483-4cc464dcfe70 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:04.331690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8657455e-b202-4b02-9483-4cc464dcfe70 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:04.332129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8657455e-b202-4b02-9483-4cc464dcfe70 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:05.253634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8657455e-b202-4b02-9483-4cc464dcfe70 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:05.262390 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8657455e-b202-4b02-9483-4cc464dcfe70 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.955861 Oct 05 17:38:05.267247 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 837/1756] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:04 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:05.277885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:05.283656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:05.299765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:05.300272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:05.300699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:05.301418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:05.301872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:05.302327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:05.864820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:05.882453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:05.884114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:05.885664 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ff4e654e-88a9-4b59-a960-1c54e739342b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1292 microversion: 2.25 time: 0.617104 Oct 05 17:38:05.886934 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 838/1757] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:05 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1292 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:06.289375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ef3768e-13fd-48a7-8d45-31193ff0f9bc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:06.290668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2ef3768e-13fd-48a7-8d45-31193ff0f9bc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:06.301422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ef3768e-13fd-48a7-8d45-31193ff0f9bc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:06.312838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ef3768e-13fd-48a7-8d45-31193ff0f9bc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:06.313473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ef3768e-13fd-48a7-8d45-31193ff0f9bc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:06.314434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ef3768e-13fd-48a7-8d45-31193ff0f9bc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:06.315124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ef3768e-13fd-48a7-8d45-31193ff0f9bc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:06.315718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ef3768e-13fd-48a7-8d45-31193ff0f9bc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:07.115768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:07.140839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2ef3768e-13fd-48a7-8d45-31193ff0f9bc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:07.148937 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2ef3768e-13fd-48a7-8d45-31193ff0f9bc tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.863514 Oct 05 17:38:07.149539 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 839/1758] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:06 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:07.182927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:07.192025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:07.209424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:07.210900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:07.213080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:07.215841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:07.219838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:07.220442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:07.761260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:08.860245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:08.876676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:08.885439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:08.887347 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0a3f0c00-097d-42f2-9f81-d329bce35ddf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1292 microversion: 2.25 time: 1.727847 Oct 05 17:38:08.888126 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 840/1759] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:07 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1292 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:09.088870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d4bdeb6-8b50-4cee-ae4b-82b6073dc773 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Action: 'create', calling method: .version_select at 0x7f777964fee0>, body: {"keypair": {"name": "tempest-keypair-1971092793", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGY+YBIeCdoZ7b7c3yzilQkEh9ofDXxeAT2Z6iLQz+B8xD7NxBAo414c8oLz7ChylUAamLnBpSDbBFx1pFv5WYIu3iF7hzidVZs9o2uG+KmoxWwipZdkQJ0jYBqzCxQzQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:09.140626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-4d4bdeb6-8b50-4cee-ae4b-82b6073dc773 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Getting quotas for project e45130e1ffed4fb4a10f5cab79f839c2. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:38:09.184418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-4d4bdeb6-8b50-4cee-ae4b-82b6073dc773 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Getting quotas for user ad3d7ffb346645a4be9e09ac320031bd and project e45130e1ffed4fb4a10f5cab79f839c2. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:38:09.321938 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4d4bdeb6-8b50-4cee-ae4b-82b6073dc773 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.419226 Oct 05 17:38:09.323282 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 841/1760] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:38:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:09.374223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd27d04c-a86e-4f24-9f8f-3f544c00a28d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:09.380100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bd27d04c-a86e-4f24-9f8f-3f544c00a28d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:09.422459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd27d04c-a86e-4f24-9f8f-3f544c00a28d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:09.423060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd27d04c-a86e-4f24-9f8f-3f544c00a28d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:09.423524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd27d04c-a86e-4f24-9f8f-3f544c00a28d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:09.425026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd27d04c-a86e-4f24-9f8f-3f544c00a28d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:09.427434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd27d04c-a86e-4f24-9f8f-3f544c00a28d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:09.428004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd27d04c-a86e-4f24-9f8f-3f544c00a28d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:10.047427 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92b2dcf3-001f-46d3-935f-e69375cbd823 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.759463 Oct 05 17:38:10.048968 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 920/1761] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:38:03 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:10.054478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4d0cdaf4-db2e-4836-9779-43e6518620da req-d8a19ae1-02cc-4c92-a484-4a1cb0267f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410bc024-ca08-46da-8f57-0a2b8d440307", "tag": "2f01703e-a65e-4077-8843-eb2be80875d6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:10.086936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4d0cdaf4-db2e-4836-9779-43e6518620da req-d8a19ae1-02cc-4c92-a484-4a1cb0267f74 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:10.094926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4d0cdaf4-db2e-4836-9779-43e6518620da req-d8a19ae1-02cc-4c92-a484-4a1cb0267f74 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:10.097230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4d0cdaf4-db2e-4836-9779-43e6518620da req-d8a19ae1-02cc-4c92-a484-4a1cb0267f74 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:10.141774 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4d0cdaf4-db2e-4836-9779-43e6518620da req-d8a19ae1-02cc-4c92-a484-4a1cb0267f74 service nova] Creating event network-changed:2f01703e-a65e-4077-8843-eb2be80875d6 for instance 410bc024-ca08-46da-8f57-0a2b8d440307 on n-h2-835595-3 Oct 05 17:38:10.161731 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4d0cdaf4-db2e-4836-9779-43e6518620da req-d8a19ae1-02cc-4c92-a484-4a1cb0267f74 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103416 Oct 05 17:38:10.162466 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 921/1762] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:10.185455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:10.186585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:10.219612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:10.220421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:10.223393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:10.225092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:10.229777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:10.235271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:10.399999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bd27d04c-a86e-4f24-9f8f-3f544c00a28d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:10.415317 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bd27d04c-a86e-4f24-9f8f-3f544c00a28d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 1.087867 Oct 05 17:38:10.417287 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 842/1763] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:09 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:10.435616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ced1aefc-9832-47b8-a911-a05e22563451 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Calling method '.version_select at 0x7f7775813dc0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:11.153771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:11.171685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:11.176875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:11.193247 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8fc8ca59-a4c8-4bde-a275-a30cab870ca4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1292 microversion: 2.25 time: 1.019026 Oct 05 17:38:11.196928 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 922/1764] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:10 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1292 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:11.441093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87c35902-92d7-40d8-ad2d-4a256f821aa0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:11.441718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-87c35902-92d7-40d8-ad2d-4a256f821aa0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:11.457408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87c35902-92d7-40d8-ad2d-4a256f821aa0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:11.457912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87c35902-92d7-40d8-ad2d-4a256f821aa0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:11.463909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87c35902-92d7-40d8-ad2d-4a256f821aa0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:11.467087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87c35902-92d7-40d8-ad2d-4a256f821aa0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:11.471614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87c35902-92d7-40d8-ad2d-4a256f821aa0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:11.475020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87c35902-92d7-40d8-ad2d-4a256f821aa0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:11.618219 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ced1aefc-9832-47b8-a911-a05e22563451 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/5ff821c4-c1cc-4244-a39d-b02a37501785" status: 200 len: 142 microversion: 2.1 time: 1.196529 Oct 05 17:38:11.627385 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 843/1765] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:38:10 2022] GET /compute/v2.1/os-floating-ips/5ff821c4-c1cc-4244-a39d-b02a37501785 => generated 142 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:11.632278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-255aee19-bb71-49ee-8df7-a075b1d058a5 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Calling method '.version_select at 0x7f77752efa60>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:12.403549 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-255aee19-bb71-49ee-8df7-a075b1d058a5 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.774602 Oct 05 17:38:12.412943 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 844/1766] 10.222.0.70 () {58 vars in 1149 bytes} [Wed Oct 5 17:38:11 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:12.418389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-073a37be-c17a-4d92-bfa8-c6d980f1e440 req-c4ab9337-9825-4801-8262-360cbc5d8754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586258bf-c661-4819-804b-504089c77dc6", "name": "network-vif-plugged", "status": "completed", "tag": "cfd34f5d-5af2-4330-b921-2091d3e274be"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:12.438427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-073a37be-c17a-4d92-bfa8-c6d980f1e440 req-c4ab9337-9825-4801-8262-360cbc5d8754 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:12.443128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-073a37be-c17a-4d92-bfa8-c6d980f1e440 req-c4ab9337-9825-4801-8262-360cbc5d8754 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:12.444150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-073a37be-c17a-4d92-bfa8-c6d980f1e440 req-c4ab9337-9825-4801-8262-360cbc5d8754 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:12.475337 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-073a37be-c17a-4d92-bfa8-c6d980f1e440 req-c4ab9337-9825-4801-8262-360cbc5d8754 service nova] Creating event network-vif-plugged:cfd34f5d-5af2-4330-b921-2091d3e274be for instance 586258bf-c661-4819-804b-504089c77dc6 on n-h2-835595-3 Oct 05 17:38:12.500575 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-073a37be-c17a-4d92-bfa8-c6d980f1e440 req-c4ab9337-9825-4801-8262-360cbc5d8754 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086021 Oct 05 17:38:12.501914 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 845/1767] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:12.515352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:12.520984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:12.544375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:12.546553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:12.547253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:12.548237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:12.548983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:12.549642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:12.984721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:13.011044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:13.019865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:13.022743 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0727f54b-1c91-4191-886a-6512503e0d1b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1292 microversion: 2.25 time: 0.519311 Oct 05 17:38:13.045447 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 846/1768] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:12 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1292 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:13.052060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3070d16c-01e4-41e3-ae50-dbb5a8bfface req-655451b0-02fe-4586-9022-eec64c7a4c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb9c26e4-6a60-4b8f-8268-7ec8034ca709", "tag": "e589215e-5a42-4222-bbff-7205d8e11675"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:13.076651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3070d16c-01e4-41e3-ae50-dbb5a8bfface req-655451b0-02fe-4586-9022-eec64c7a4c83 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:13.080701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3070d16c-01e4-41e3-ae50-dbb5a8bfface req-655451b0-02fe-4586-9022-eec64c7a4c83 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:13.081884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3070d16c-01e4-41e3-ae50-dbb5a8bfface req-655451b0-02fe-4586-9022-eec64c7a4c83 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:13.106818 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3070d16c-01e4-41e3-ae50-dbb5a8bfface req-655451b0-02fe-4586-9022-eec64c7a4c83 service nova] Creating event network-changed:e589215e-5a42-4222-bbff-7205d8e11675 for instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 on n-h1-835595-3 Oct 05 17:38:13.116891 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3070d16c-01e4-41e3-ae50-dbb5a8bfface req-655451b0-02fe-4586-9022-eec64c7a4c83 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068842 Oct 05 17:38:13.119822 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 847/1769] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:13.134002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4144da39-53f7-4898-bcb9-e17c1249bc61 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Calling method '.version_select at 0x7f7779651940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:13.337957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-87c35902-92d7-40d8-ad2d-4a256f821aa0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:13.352564 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87c35902-92d7-40d8-ad2d-4a256f821aa0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 1.915282 Oct 05 17:38:13.357127 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 923/1770] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:11 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:14.061872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:14.063048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:14.069434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=40 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:14.079645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:14.091719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:14.094588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:14.098832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:14.103313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:14.103798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:14.649540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:14.667892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:14.677537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:14.681096 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c5cd9b55-48f6-44c4-97fd-728cc10443d3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1280 microversion: 2.25 time: 0.630221 Oct 05 17:38:14.698383 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 924/1771] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:14 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1280 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:14.698383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78870c37-a0ea-456e-a20a-6bbf6a4efa7e tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:14.698732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-78870c37-a0ea-456e-a20a-6bbf6a4efa7e tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:14.711967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78870c37-a0ea-456e-a20a-6bbf6a4efa7e tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:14.712432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78870c37-a0ea-456e-a20a-6bbf6a4efa7e tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:14.712884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78870c37-a0ea-456e-a20a-6bbf6a4efa7e tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:14.713607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78870c37-a0ea-456e-a20a-6bbf6a4efa7e tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:14.719110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78870c37-a0ea-456e-a20a-6bbf6a4efa7e tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:14.721392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78870c37-a0ea-456e-a20a-6bbf6a4efa7e tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:15.178981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78870c37-a0ea-456e-a20a-6bbf6a4efa7e tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:15.194425 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78870c37-a0ea-456e-a20a-6bbf6a4efa7e tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.506259 Oct 05 17:38:15.197149 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 925/1772] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:14 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:16.133748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:16.135199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:16.165998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:16.182710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:16.192008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:16.198050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:16.201632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:16.202126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:16.598182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:16.615316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:16.621276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:16.626818 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ca802b9d-f9ad-4096-b9d9-09d100f79644 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1280 microversion: 2.25 time: 0.914434 Oct 05 17:38:16.631880 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 926/1773] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:15 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1280 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:16.637751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0d0483e9-83c6-4139-a351-611ad0668cce tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:16.646861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0d0483e9-83c6-4139-a351-611ad0668cce tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:16.664307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d0483e9-83c6-4139-a351-611ad0668cce tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:16.665010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d0483e9-83c6-4139-a351-611ad0668cce tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:16.665637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d0483e9-83c6-4139-a351-611ad0668cce tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:16.667313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d0483e9-83c6-4139-a351-611ad0668cce tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:16.671547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d0483e9-83c6-4139-a351-611ad0668cce tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:16.675494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d0483e9-83c6-4139-a351-611ad0668cce tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:16.858148 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4144da39-53f7-4898-bcb9-e17c1249bc61 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/5ff821c4-c1cc-4244-a39d-b02a37501785" status: 202 len: 0 microversion: 2.1 time: 3.732055 Oct 05 17:38:16.866665 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 848/1774] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:38:13 2022] DELETE /compute/v2.1/os-floating-ips/5ff821c4-c1cc-4244-a39d-b02a37501785 => generated 0 bytes in 3741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:38:16.872010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-07ab9559-970d-476d-9080-08afeb3969b4 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Action: 'create', calling method: .version_select at 0x7f7775813dc0>, body: {"pool": null} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:17.330099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0d0483e9-83c6-4139-a351-611ad0668cce tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:17.351297 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0d0483e9-83c6-4139-a351-611ad0668cce tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.717941 Oct 05 17:38:17.357729 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 927/1775] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:16 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:17.585577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1084183884", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bb2349f2-5ba0-49bb-a6ba-219bd4136ca0"}], "security_groups": [{"name": "tempest-securitygroup--1642808614"}], "key_name": "tempest-keypair-1971092793", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:18.115800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] validate_networks() for [('bb2349f2-5ba0-49bb-a6ba-219bd4136ca0', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:38:19.027111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Getting quotas for project e45130e1ffed4fb4a10f5cab79f839c2. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:38:19.035528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Getting quotas for user ad3d7ffb346645a4be9e09ac320031bd and project e45130e1ffed4fb4a10f5cab79f839c2. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:38:19.052628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:38:19.053299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:38:19.053969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:38:19.054621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:38:19.055239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:38:19.065773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:19.066590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:19.067269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:19.068185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:19.068825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:19.069257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:19.101151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Getting quotas for project e45130e1ffed4fb4a10f5cab79f839c2. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:38:19.108204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Getting quotas for user ad3d7ffb346645a4be9e09ac320031bd and project e45130e1ffed4fb4a10f5cab79f839c2. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:38:19.123926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:38:19.127836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:38:19.219714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:19.222901 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f908a795-f8c6-457a-954b-e3f2bee1ae0c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.641356 Oct 05 17:38:19.231729 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 928/1776] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:38:17 2022] POST /compute/v2.1/servers => generated 409 bytes in 1651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:38:19.237760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:19.238672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:19.249940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:19.250844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:19.251449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:19.252184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:19.252654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:19.253076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:19.576008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:19.588792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:19.591601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:19.593584 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7558e4f0-8d40-46c6-b7ca-38e60c316ec3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1280 microversion: 2.25 time: 0.360162 Oct 05 17:38:19.595436 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 929/1777] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:19 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1280 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:19.601011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e8560f10-9b0a-414e-a067-fcdb068416bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:19.602538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e8560f10-9b0a-414e-a067-fcdb068416bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:19.609617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8560f10-9b0a-414e-a067-fcdb068416bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:19.610487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8560f10-9b0a-414e-a067-fcdb068416bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:19.611505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8560f10-9b0a-414e-a067-fcdb068416bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:19.612602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8560f10-9b0a-414e-a067-fcdb068416bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:19.613717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8560f10-9b0a-414e-a067-fcdb068416bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:19.614906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8560f10-9b0a-414e-a067-fcdb068416bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:19.881643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e8560f10-9b0a-414e-a067-fcdb068416bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:19.890890 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e8560f10-9b0a-414e-a067-fcdb068416bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1487 microversion: 2.1 time: 0.294073 Oct 05 17:38:19.902813 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 930/1778] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:19 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1487 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:19.933261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-db2ea9c7-ecd1-4210-ba92-4b2f50cfa965 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:19.942460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-db2ea9c7-ecd1-4210-ba92-4b2f50cfa965 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:20.053304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-db2ea9c7-ecd1-4210-ba92-4b2f50cfa965 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:20.062010 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-db2ea9c7-ecd1-4210-ba92-4b2f50cfa965 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1278 microversion: 2.1 time: 0.157703 Oct 05 17:38:20.078801 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 931/1779] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:19 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1278 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:20.092087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d4dd6a03-62ae-44ba-a2cf-cdb9b89fea05 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:20.093036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d4dd6a03-62ae-44ba-a2cf-cdb9b89fea05 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:20.102662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a03-62ae-44ba-a2cf-cdb9b89fea05 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:20.104084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a03-62ae-44ba-a2cf-cdb9b89fea05 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:20.104699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a03-62ae-44ba-a2cf-cdb9b89fea05 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:20.105823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a03-62ae-44ba-a2cf-cdb9b89fea05 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:20.106682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a03-62ae-44ba-a2cf-cdb9b89fea05 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:20.107424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dd6a03-62ae-44ba-a2cf-cdb9b89fea05 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:20.200807 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d4dd6a03-62ae-44ba-a2cf-cdb9b89fea05 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "POST /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87/action" status: 202 len: 0 microversion: 2.1 time: 0.120281 Oct 05 17:38:20.203110 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 932/1780] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:38:20 2022] POST /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:38:20.223216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d85cfae-fbda-4972-91f1-d49f3862947a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:20.225828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9d85cfae-fbda-4972-91f1-d49f3862947a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:20.238634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d85cfae-fbda-4972-91f1-d49f3862947a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:20.240664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d85cfae-fbda-4972-91f1-d49f3862947a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:20.246087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d85cfae-fbda-4972-91f1-d49f3862947a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:20.247120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d85cfae-fbda-4972-91f1-d49f3862947a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:20.247817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d85cfae-fbda-4972-91f1-d49f3862947a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:20.248413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d85cfae-fbda-4972-91f1-d49f3862947a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:20.607378 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-07ab9559-970d-476d-9080-08afeb3969b4 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.739421 Oct 05 17:38:20.615683 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 849/1781] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:38:16 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:20.617007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9d85cfae-fbda-4972-91f1-d49f3862947a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:20.628634 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9d85cfae-fbda-4972-91f1-d49f3862947a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1495 microversion: 2.1 time: 0.414666 Oct 05 17:38:20.646505 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 933/1782] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:20 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1495 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:20.679832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-91117ec5-2d1c-447c-a1d3-0478059bddb1 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Calling method '.version_select at 0x7f77753b2310>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:20.858230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2d59e5bf-321e-458e-938a-74752b620705 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Calling method '.version_select at 0x7f7779651f70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:20.893818 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-2d59e5bf-321e-458e-938a-74752b620705 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] HTTP exception thrown: Image not found. Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2d59e5bf-321e-458e-938a-74752b620705 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Request method failure captured: Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/images/2bb03c09-a75d-4a70-884d-4105f8c3016f/metadata/os_distro HTTP/1.1 Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcEMLnKLmDgpNRuW8nEHbHTsEGjgZ9navuNFEHTvlLqhT-9pjvw7O5ge1nzIvgRKTtBwa4KeLYBSOp9d6Jsn4FEw5PkV_IOtHxyOoNLonRRZ9Sjc__zK1-zDSKcJnns4MIK0lvQdkeDfGDvp6-EGJA8srUbwZBd7qTBYB0ylHXbLT-I Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:38:20.902420 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e011f29927b6470e86b661d98d425482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e011f29927b6470e86b661d98d425482", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}] Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: e7c55ae04e92403c873515ea45572ec3 Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: exception: Image not found. Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'image_id': '2bb03c09-a75d-4a70-884d-4105f8c3016f', 'id': 'os_distro'} Oct 05 17:38:20.904231 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:20.905311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2bb03c09-a75d-4a70-884d-4105f8c3016f Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:20.906679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2bb03c09-a75d-4a70-884d-4105f8c3016f could not be found. Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:20.917668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:20.919700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2d59e5bf-321e-458e-938a-74752b620705 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Returning 404 to user: Image not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:20.921289 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2d59e5bf-321e-458e-938a-74752b620705 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] 10.222.0.70 "DELETE /compute/v2.1/images/2bb03c09-a75d-4a70-884d-4105f8c3016f/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.289254 Oct 05 17:38:20.921289 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 850/1783] 10.222.0.70 () {58 vars in 1293 bytes} [Wed Oct 5 17:38:20 2022] DELETE /compute/v2.1/images/2bb03c09-a75d-4a70-884d-4105f8c3016f/metadata/os_distro => generated 62 bytes in 298 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:38:20.932296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:20.933255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:20.941233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:20.941735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:20.942181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:20.942958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:20.943412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:20.943834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:21.975902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:21.996652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:22.002526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:22.007052 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ad1c2f04-ddc5-4d71-915d-d94397e13dd8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1280 microversion: 2.25 time: 1.091725 Oct 05 17:38:22.008847 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 851/1784] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:20 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1280 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:22.014769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ea6d32e-a7c5-4680-9705-5ac4d9d51570 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Calling method '.version_select at 0x7f7779652160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:22.052880 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0ea6d32e-a7c5-4680-9705-5ac4d9d51570 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] HTTP exception thrown: Image not found. Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ea6d32e-a7c5-4680-9705-5ac4d9d51570 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Request method failure captured: Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/images/3110b7fb-3356-48b0-90ed-688feb5696f0/metadata/os_version HTTP/1.1 Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcEMLnKLmDgpNRuW8nEHbHTsEGjgZ9navuNFEHTvlLqhT-9pjvw7O5ge1nzIvgRKTtBwa4KeLYBSOp9d6Jsn4FEw5PkV_IOtHxyOoNLonRRZ9Sjc__zK1-zDSKcJnns4MIK0lvQdkeDfGDvp6-EGJA8srUbwZBd7qTBYB0ylHXbLT-I Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:38:22.055147 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e011f29927b6470e86b661d98d425482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e011f29927b6470e86b661d98d425482", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}] Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: e7c55ae04e92403c873515ea45572ec3 Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: exception: Image not found. Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'image_id': '3110b7fb-3356-48b0-90ed-688feb5696f0', 'id': 'os_version'} Oct 05 17:38:22.056724 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:22.057655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3110b7fb-3356-48b0-90ed-688feb5696f0 Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:22.060069 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3110b7fb-3356-48b0-90ed-688feb5696f0 could not be found. Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:22.061457 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.064525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ea6d32e-a7c5-4680-9705-5ac4d9d51570 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Returning 404 to user: Image not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:22.067103 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0ea6d32e-a7c5-4680-9705-5ac4d9d51570 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] 10.222.0.70 "GET /compute/v2.1/images/3110b7fb-3356-48b0-90ed-688feb5696f0/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.046926 Oct 05 17:38:22.067103 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 852/1785] 10.222.0.70 () {58 vars in 1293 bytes} [Wed Oct 5 17:38:22 2022] GET /compute/v2.1/images/3110b7fb-3356-48b0-90ed-688feb5696f0/metadata/os_version => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:38:22.068084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b556c7d6-2263-40f4-adc5-0fcc0b596f2a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:22.068879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b556c7d6-2263-40f4-adc5-0fcc0b596f2a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:22.089788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b556c7d6-2263-40f4-adc5-0fcc0b596f2a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:22.090355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b556c7d6-2263-40f4-adc5-0fcc0b596f2a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:22.090840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b556c7d6-2263-40f4-adc5-0fcc0b596f2a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:22.094345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b556c7d6-2263-40f4-adc5-0fcc0b596f2a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:22.094831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b556c7d6-2263-40f4-adc5-0fcc0b596f2a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:22.095545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b556c7d6-2263-40f4-adc5-0fcc0b596f2a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:22.097454 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-91117ec5-2d1c-447c-a1d3-0478059bddb1 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/7dd2b534-3cda-4948-b6b4-44634c742699" status: 202 len: 0 microversion: 2.1 time: 1.448536 Oct 05 17:38:22.098804 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 934/1786] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:38:20 2022] DELETE /compute/v2.1/os-floating-ips/7dd2b534-3cda-4948-b6b4-44634c742699 => generated 0 bytes in 1451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:38:22.193071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b556c7d6-2263-40f4-adc5-0fcc0b596f2a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:22.205751 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b556c7d6-2263-40f4-adc5-0fcc0b596f2a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1336 microversion: 2.1 time: 0.146440 Oct 05 17:38:22.227190 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 853/1787] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:22 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1336 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:22.235561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-195c2bc1-ad91-403e-8c08-4d038574c1c1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:22.236874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-195c2bc1-ad91-403e-8c08-4d038574c1c1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:22.244188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-195c2bc1-ad91-403e-8c08-4d038574c1c1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:22.244938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-195c2bc1-ad91-403e-8c08-4d038574c1c1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:22.245909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-195c2bc1-ad91-403e-8c08-4d038574c1c1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:22.246926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-195c2bc1-ad91-403e-8c08-4d038574c1c1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:22.248506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-195c2bc1-ad91-403e-8c08-4d038574c1c1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:22.249811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-195c2bc1-ad91-403e-8c08-4d038574c1c1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:22.298534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1809577006", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:22.368268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:38:22.478216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-195c2bc1-ad91-403e-8c08-4d038574c1c1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:22.496695 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-195c2bc1-ad91-403e-8c08-4d038574c1c1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1495 microversion: 2.1 time: 0.267537 Oct 05 17:38:22.500936 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 854/1788] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:22 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1495 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:22.506043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d89d78d8-3116-4ce7-9c90-0dd91613cefa tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Calling method '.version_select at 0x7f777961b5e0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:22.549757 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-d89d78d8-3116-4ce7-9c90-0dd91613cefa tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] HTTP exception thrown: Image not found. Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d89d78d8-3116-4ce7-9c90-0dd91613cefa tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Request method failure captured: Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/images/12d85dee-9851-4031-8acf-1383b79677ec/metadata HTTP/1.1 Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcEMLnKLmDgpNRuW8nEHbHTsEGjgZ9navuNFEHTvlLqhT-9pjvw7O5ge1nzIvgRKTtBwa4KeLYBSOp9d6Jsn4FEw5PkV_IOtHxyOoNLonRRZ9Sjc__zK1-zDSKcJnns4MIK0lvQdkeDfGDvp6-EGJA8srUbwZBd7qTBYB0ylHXbLT-I Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:38:22.553313 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e011f29927b6470e86b661d98d425482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e011f29927b6470e86b661d98d425482", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}] Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: e7c55ae04e92403c873515ea45572ec3 Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: exception: Image not found. Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'image_id': '12d85dee-9851-4031-8acf-1383b79677ec'} Oct 05 17:38:22.554959 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:22.555953 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 12d85dee-9851-4031-8acf-1383b79677ec Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:22.557242 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 12d85dee-9851-4031-8acf-1383b79677ec could not be found. Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:22.558654 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:38:22.560036 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.563634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d89d78d8-3116-4ce7-9c90-0dd91613cefa tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Returning 404 to user: Image not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:22.564762 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d89d78d8-3116-4ce7-9c90-0dd91613cefa tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] 10.222.0.70 "GET /compute/v2.1/images/12d85dee-9851-4031-8acf-1383b79677ec/metadata" status: 404 len: 62 microversion: 2.1 time: 0.062600 Oct 05 17:38:22.573214 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 855/1789] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:38:22 2022] GET /compute/v2.1/images/12d85dee-9851-4031-8acf-1383b79677ec/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:38:22.579846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-189cba26-13cf-405b-8c1f-448a46bb5408 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Calling method '.version_select at 0x7f777961e8b0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:22.640871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:38:22.641308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:38:22.641788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:38:22.642199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:38:22.642641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:38:22.653053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:22.653537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:22.654028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:22.654811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:22.655441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:22.655874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:22.678114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-189cba26-13cf-405b-8c1f-448a46bb5408 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7dd2b534-3cda-4948-b6b4-44634c742699 could not be found", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:38:22.678863 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-189cba26-13cf-405b-8c1f-448a46bb5408 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] HTTP exception thrown: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699 Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-189cba26-13cf-405b-8c1f-448a46bb5408 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Request method failure captured: Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-floating-ips/7dd2b534-3cda-4948-b6b4-44634c742699 HTTP/1.1 Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcD66fIex8B9b6q_XOB0ve16mgMyz6Fs-0ZwZG5VcqE8lpPOzj0XUXSmR-8Y8MoqzpvMSEZU32VkZ1n1j717l1o_y7HdLJEHqI8Yig1J4Pf19qnnoXRPN3A-e4pfPJzR3XXGuJDVa9klhJ-V8dZXnXUlkXFd1S8Lo1YtMYxmn3Dne40 Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4027b800e44547dbaeefe0b9867296a7 Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FloatingIPsTestJSON-2007918286 Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:38:22.681670 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4027b800e44547dbaeefe0b9867296a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4027b800e44547dbaeefe0b9867296a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4027b800e44547dbaeefe0b9867296a7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4027b800e44547dbaeefe0b9867296a7"}]}] Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FloatingIPsTestJSON-2007918286 Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4027b800e44547dbaeefe0b9867296a7 Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2007918286 Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FloatingIPsTestJSON-2007918286-project Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: a64f4c2a316746f585daac29118c8e00 Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FloatingIPsTestJSON-2007918286-project Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: exception: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699 Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '7dd2b534-3cda-4948-b6b4-44634c742699'} Oct 05 17:38:22.683265 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:38:22.684231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7dd2b534-3cda-4948-b6b4-44634c742699 could not be found Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14149d0c-6a3b-497c-b031-224fc91c5ef0'] Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699. Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.686233 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699 Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:22.691318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:22.694330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699 Oct 05 17:38:22.694330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.694330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-189cba26-13cf-405b-8c1f-448a46bb5408 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Returning 404 to user: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699 {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:22.694330 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-189cba26-13cf-405b-8c1f-448a46bb5408 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/7dd2b534-3cda-4948-b6b4-44634c742699" status: 404 len: 111 microversion: 2.1 time: 0.109129 Oct 05 17:38:22.694330 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 856/1790] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:38:22 2022] GET /compute/v2.1/os-floating-ips/7dd2b534-3cda-4948-b6b4-44634c742699 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:38:22.695797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Getting quotas for project e09b9e18087143a6863bd26d55ced3d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:38:22.699057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cb20f0ed-0879-4517-865c-40e758108a90 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Action: 'update_all', calling method: .version_select at 0x7f77795fb550>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:22.699462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Getting quotas for user 3f47c095840642cfba9edb55fb8fc656 and project e09b9e18087143a6863bd26d55ced3d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:38:22.722095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:38:22.724953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:38:22.726251 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-cb20f0ed-0879-4517-865c-40e758108a90 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] HTTP exception thrown: Image not found. Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cb20f0ed-0879-4517-865c-40e758108a90 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Request method failure captured: Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: request: PUT /compute/v2.1/images/60025b9c-828f-4f6a-9f96-b08c34883ae9/metadata HTTP/1.1 Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 57 Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcEMLnKLmDgpNRuW8nEHbHTsEGjgZ9navuNFEHTvlLqhT-9pjvw7O5ge1nzIvgRKTtBwa4KeLYBSOp9d6Jsn4FEw5PkV_IOtHxyOoNLonRRZ9Sjc__zK1-zDSKcJnns4MIK0lvQdkeDfGDvp6-EGJA8srUbwZBd7qTBYB0ylHXbLT-I Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:38:22.729025 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e011f29927b6470e86b661d98d425482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e011f29927b6470e86b661d98d425482", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}] Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: e7c55ae04e92403c873515ea45572ec3 Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:38:22.730620 n-d-835595-3 devstack@n-api.service[128843]: exception: Image not found. Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'image_id': '60025b9c-828f-4f6a-9f96-b08c34883ae9', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:22.732061 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 60025b9c-828f-4f6a-9f96-b08c34883ae9 Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:22.734120 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 60025b9c-828f-4f6a-9f96-b08c34883ae9 could not be found. Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:22.737171 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:38:22.740325 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.743183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cb20f0ed-0879-4517-865c-40e758108a90 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Returning 404 to user: Image not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:22.743183 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cb20f0ed-0879-4517-865c-40e758108a90 tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] 10.222.0.70 "PUT /compute/v2.1/images/60025b9c-828f-4f6a-9f96-b08c34883ae9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041539 Oct 05 17:38:22.743183 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 857/1791] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:38:22 2022] PUT /compute/v2.1/images/60025b9c-828f-4f6a-9f96-b08c34883ae9/metadata => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:38:22.743183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e51df10f-8a2c-4aaa-83f8-073e984a8032 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Calling method '.version_select at 0x7f77753f08b0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:22.799286 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-317f7c6c-db5b-4a27-8bf0-d1e418742410 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699156 Oct 05 17:38:22.801396 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 935/1792] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:38:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:38:22.811865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30fedc57-19ef-489b-a2e9-b972e841cbff tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Action: 'update', calling method: .version_select at 0x7f77795cab80>, body: {"meta": {"os_distro": "alt"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:22.813921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-e51df10f-8a2c-4aaa-83f8-073e984a8032 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7dd2b534-3cda-4948-b6b4-44634c742699 could not be found", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:38:22.814861 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e51df10f-8a2c-4aaa-83f8-073e984a8032 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] HTTP exception thrown: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699 Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e51df10f-8a2c-4aaa-83f8-073e984a8032 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Request method failure captured: Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-floating-ips/7dd2b534-3cda-4948-b6b4-44634c742699 HTTP/1.1 Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcD66fIex8B9b6q_XOB0ve16mgMyz6Fs-0ZwZG5VcqE8lpPOzj0XUXSmR-8Y8MoqzpvMSEZU32VkZ1n1j717l1o_y7HdLJEHqI8Yig1J4Pf19qnnoXRPN3A-e4pfPJzR3XXGuJDVa9klhJ-V8dZXnXUlkXFd1S8Lo1YtMYxmn3Dne40 Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4027b800e44547dbaeefe0b9867296a7 Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FloatingIPsTestJSON-2007918286 Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:38:22.818047 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4027b800e44547dbaeefe0b9867296a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4027b800e44547dbaeefe0b9867296a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4027b800e44547dbaeefe0b9867296a7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4027b800e44547dbaeefe0b9867296a7"}]}] Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FloatingIPsTestJSON-2007918286 Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4027b800e44547dbaeefe0b9867296a7 Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2007918286 Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FloatingIPsTestJSON-2007918286-project Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: a64f4c2a316746f585daac29118c8e00 Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FloatingIPsTestJSON-2007918286-project Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: exception: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699 Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '7dd2b534-3cda-4948-b6b4-44634c742699'} Oct 05 17:38:22.820007 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:38:22.821108 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7dd2b534-3cda-4948-b6b4-44634c742699 could not be found Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9fe65906-d5ab-446c-ab8e-450069a144ea'] Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699. Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.823087 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699 Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:22.827561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:22.830417 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699 Oct 05 17:38:22.830417 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.830417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e51df10f-8a2c-4aaa-83f8-073e984a8032 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] Returning 404 to user: Floating IP not found for ID 7dd2b534-3cda-4948-b6b4-44634c742699 {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:22.831962 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e51df10f-8a2c-4aaa-83f8-073e984a8032 tempest-FloatingIPsTestJSON-2007918286 tempest-FloatingIPsTestJSON-2007918286-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/7dd2b534-3cda-4948-b6b4-44634c742699" status: 404 len: 111 microversion: 2.1 time: 0.099654 Oct 05 17:38:22.833214 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 858/1793] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:38:22 2022] DELETE /compute/v2.1/os-floating-ips/7dd2b534-3cda-4948-b6b4-44634c742699 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:38:22.843260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b413eb3c-b310-416b-b2c7-0a79fe22b2ba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:22.848286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b413eb3c-b310-416b-b2c7-0a79fe22b2ba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:22.877192 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-30fedc57-19ef-489b-a2e9-b972e841cbff tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] HTTP exception thrown: Image not found. Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30fedc57-19ef-489b-a2e9-b972e841cbff tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Request method failure captured: Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/images/0a788243-9201-433a-9d04-298be229adf6/metadata/os_distro HTTP/1.1 Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 30 Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcEMLnKLmDgpNRuW8nEHbHTsEGjgZ9navuNFEHTvlLqhT-9pjvw7O5ge1nzIvgRKTtBwa4KeLYBSOp9d6Jsn4FEw5PkV_IOtHxyOoNLonRRZ9Sjc__zK1-zDSKcJnns4MIK0lvQdkeDfGDvp6-EGJA8srUbwZBd7qTBYB0ylHXbLT-I Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:38:22.879770 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e011f29927b6470e86b661d98d425482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e011f29927b6470e86b661d98d425482", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}] Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: e7c55ae04e92403c873515ea45572ec3 Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: {"meta": {"os_distro": "alt"}} Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:38:22.881314 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'image_id': '0a788243-9201-433a-9d04-298be229adf6', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:22.882489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0a788243-9201-433a-9d04-298be229adf6 Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:22.883891 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0a788243-9201-433a-9d04-298be229adf6 could not be found. Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:22.885252 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:38:22.886857 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.891985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30fedc57-19ef-489b-a2e9-b972e841cbff tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:22.891985 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-30fedc57-19ef-489b-a2e9-b972e841cbff tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] 10.222.0.70 "PUT /compute/v2.1/images/0a788243-9201-433a-9d04-298be229adf6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.078801 Oct 05 17:38:22.891985 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 936/1794] 10.222.0.70 () {60 vars in 1310 bytes} [Wed Oct 5 17:38:22 2022] PUT /compute/v2.1/images/0a788243-9201-433a-9d04-298be229adf6/metadata/os_distro => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:38:22.924392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5eadd10c-2d11-4e6f-b232-aaaef5861c2d tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Action: 'create', calling method: .version_select at 0x7f777963e790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:22.957534 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5eadd10c-2d11-4e6f-b232-aaaef5861c2d tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] HTTP exception thrown: Image not found. Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5eadd10c-2d11-4e6f-b232-aaaef5861c2d tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Request method failure captured: Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/images/ab49e251-19a1-48da-9548-1ad3556e1871/metadata HTTP/1.1 Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 57 Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcEMLnKLmDgpNRuW8nEHbHTsEGjgZ9navuNFEHTvlLqhT-9pjvw7O5ge1nzIvgRKTtBwa4KeLYBSOp9d6Jsn4FEw5PkV_IOtHxyOoNLonRRZ9Sjc__zK1-zDSKcJnns4MIK0lvQdkeDfGDvp6-EGJA8srUbwZBd7qTBYB0ylHXbLT-I Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:38:22.959720 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e011f29927b6470e86b661d98d425482"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e011f29927b6470e86b661d98d425482", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e011f29927b6470e86b661d98d425482"}]}] Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: e011f29927b6470e86b661d98d425482 Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523 Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: e7c55ae04e92403c873515ea45572ec3 Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1991527523-project Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:38:22.961264 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'image_id': 'ab49e251-19a1-48da-9548-1ad3556e1871', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:22.965143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ab49e251-19a1-48da-9548-1ad3556e1871 Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:38:22.967916 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ab49e251-19a1-48da-9548-1ad3556e1871 could not be found. Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:22.969470 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:38:22.972852 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:22.979191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5eadd10c-2d11-4e6f-b232-aaaef5861c2d tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:22.979191 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5eadd10c-2d11-4e6f-b232-aaaef5861c2d tempest-ImagesMetadataNegativeTestJSON-1991527523 tempest-ImagesMetadataNegativeTestJSON-1991527523-project] 10.222.0.70 "POST /compute/v2.1/images/ab49e251-19a1-48da-9548-1ad3556e1871/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069963 Oct 05 17:38:22.979191 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 937/1795] 10.222.0.70 () {60 vars in 1281 bytes} [Wed Oct 5 17:38:22 2022] POST /compute/v2.1/images/ab49e251-19a1-48da-9548-1ad3556e1871/metadata => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:38:23.027103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b413eb3c-b310-416b-b2c7-0a79fe22b2ba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:23.042637 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b413eb3c-b310-416b-b2c7-0a79fe22b2ba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1217 microversion: 2.1 time: 0.208066 Oct 05 17:38:23.043685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:23.045133 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 859/1796] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:22 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1217 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:23.047642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:23.078509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:23.079180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:23.083222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:23.084464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:23.085023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:23.085376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:23.241796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-be972179-b400-467c-bea9-28acd3427cff tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:23.242826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-be972179-b400-467c-bea9-28acd3427cff tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:23.268649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be972179-b400-467c-bea9-28acd3427cff tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:23.272625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be972179-b400-467c-bea9-28acd3427cff tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:23.274498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be972179-b400-467c-bea9-28acd3427cff tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:23.279776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be972179-b400-467c-bea9-28acd3427cff tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:23.282113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be972179-b400-467c-bea9-28acd3427cff tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:23.284134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be972179-b400-467c-bea9-28acd3427cff tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:23.895708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-be972179-b400-467c-bea9-28acd3427cff tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:23.908538 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-be972179-b400-467c-bea9-28acd3427cff tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1404 microversion: 2.1 time: 0.677510 Oct 05 17:38:23.910924 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 860/1797] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:23 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1404 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:23.936141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-514501e6-368a-4330-a1af-71f16f828d86 req-bb85f5a8-e0ef-42cf-9b98-c027f053d223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410bc024-ca08-46da-8f57-0a2b8d440307", "name": "network-vif-plugged", "status": "completed", "tag": "2f01703e-a65e-4077-8843-eb2be80875d6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:23.964807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-514501e6-368a-4330-a1af-71f16f828d86 req-bb85f5a8-e0ef-42cf-9b98-c027f053d223 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:23.965674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-514501e6-368a-4330-a1af-71f16f828d86 req-bb85f5a8-e0ef-42cf-9b98-c027f053d223 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:23.966348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-514501e6-368a-4330-a1af-71f16f828d86 req-bb85f5a8-e0ef-42cf-9b98-c027f053d223 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:23.995311 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-514501e6-368a-4330-a1af-71f16f828d86 req-bb85f5a8-e0ef-42cf-9b98-c027f053d223 service nova] Creating event network-vif-plugged:2f01703e-a65e-4077-8843-eb2be80875d6 for instance 410bc024-ca08-46da-8f57-0a2b8d440307 on n-h2-835595-3 Oct 05 17:38:24.000853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:24.007930 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-514501e6-368a-4330-a1af-71f16f828d86 req-bb85f5a8-e0ef-42cf-9b98-c027f053d223 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096218 Oct 05 17:38:24.012455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:24.014919 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 861/1798] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:24.018690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:24.019878 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0c3c4fd-6275-486f-8109-c64271e897a8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1280 microversion: 2.25 time: 0.986785 Oct 05 17:38:24.025589 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 938/1799] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:23 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1280 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:38:24.055090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bacb49cb-9c87-4ba9-bbbd-470ab59acd0a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:24.063001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bacb49cb-9c87-4ba9-bbbd-470ab59acd0a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:24.067447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-05f0f8f7-4b81-405a-affd-3684d279922a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:24.068380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-05f0f8f7-4b81-405a-affd-3684d279922a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:24.077310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05f0f8f7-4b81-405a-affd-3684d279922a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:24.079039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05f0f8f7-4b81-405a-affd-3684d279922a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:24.081430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05f0f8f7-4b81-405a-affd-3684d279922a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:24.082198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bacb49cb-9c87-4ba9-bbbd-470ab59acd0a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:24.083231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05f0f8f7-4b81-405a-affd-3684d279922a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:24.085052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05f0f8f7-4b81-405a-affd-3684d279922a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:24.085719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05f0f8f7-4b81-405a-affd-3684d279922a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:24.086671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bacb49cb-9c87-4ba9-bbbd-470ab59acd0a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:24.088145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bacb49cb-9c87-4ba9-bbbd-470ab59acd0a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:24.093496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:24.103061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bacb49cb-9c87-4ba9-bbbd-470ab59acd0a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:24.103629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bacb49cb-9c87-4ba9-bbbd-470ab59acd0a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:24.104066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bacb49cb-9c87-4ba9-bbbd-470ab59acd0a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:24.233144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-05f0f8f7-4b81-405a-affd-3684d279922a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:24.255472 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-05f0f8f7-4b81-405a-affd-3684d279922a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1221 microversion: 2.1 time: 0.194212 Oct 05 17:38:24.258272 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 939/1800] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:24 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1221 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:24.538999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bacb49cb-9c87-4ba9-bbbd-470ab59acd0a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:24.552509 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bacb49cb-9c87-4ba9-bbbd-470ab59acd0a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1501 microversion: 2.1 time: 0.535367 Oct 05 17:38:24.554051 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 862/1801] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:24 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1501 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:24.580684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42876431-3c5b-4a6b-80eb-3109afc24cc0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:24.581634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-42876431-3c5b-4a6b-80eb-3109afc24cc0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:24.591603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42876431-3c5b-4a6b-80eb-3109afc24cc0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:24.592312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42876431-3c5b-4a6b-80eb-3109afc24cc0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:24.592928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42876431-3c5b-4a6b-80eb-3109afc24cc0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:24.593796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42876431-3c5b-4a6b-80eb-3109afc24cc0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:24.594569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42876431-3c5b-4a6b-80eb-3109afc24cc0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:24.595151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42876431-3c5b-4a6b-80eb-3109afc24cc0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:24.628420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-42876431-3c5b-4a6b-80eb-3109afc24cc0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:38:24.750694 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-42876431-3c5b-4a6b-80eb-3109afc24cc0 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 204 len: 0 microversion: 2.1 time: 0.174714 Oct 05 17:38:24.760093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b2b885d5-7216-488d-9a54-45aa5eb3388f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:24.760786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b2b885d5-7216-488d-9a54-45aa5eb3388f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:24.764825 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 940/1802] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:38:24 2022] DELETE /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:38:24.767372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b885d5-7216-488d-9a54-45aa5eb3388f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:24.767853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b885d5-7216-488d-9a54-45aa5eb3388f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:24.768831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b885d5-7216-488d-9a54-45aa5eb3388f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:24.769708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b885d5-7216-488d-9a54-45aa5eb3388f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:24.770375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b885d5-7216-488d-9a54-45aa5eb3388f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:24.771017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2b885d5-7216-488d-9a54-45aa5eb3388f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:24.942162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7a9b8a8a-c841-4e27-bd33-36c4b514c27a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:24.943062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7a9b8a8a-c841-4e27-bd33-36c4b514c27a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:24.985775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a9b8a8a-c841-4e27-bd33-36c4b514c27a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:24.994875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a9b8a8a-c841-4e27-bd33-36c4b514c27a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:24.996370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a9b8a8a-c841-4e27-bd33-36c4b514c27a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:24.999470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a9b8a8a-c841-4e27-bd33-36c4b514c27a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:25.000872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a9b8a8a-c841-4e27-bd33-36c4b514c27a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:25.001559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a9b8a8a-c841-4e27-bd33-36c4b514c27a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:25.057643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2b885d5-7216-488d-9a54-45aa5eb3388f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:25.092763 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b2b885d5-7216-488d-9a54-45aa5eb3388f tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.334700 Oct 05 17:38:25.110728 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 863/1803] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:24 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:25.123606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:25.124568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:25.133479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:25.135112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:25.135748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:25.136648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:25.137299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:25.138371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:25.361560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:25.374850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:25.380982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:25.383170 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0ed73ec9-3bef-4f7f-b1bb-de97a17fb106 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1280 microversion: 2.25 time: 0.269915 Oct 05 17:38:25.383616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7a9b8a8a-c841-4e27-bd33-36c4b514c27a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:25.384330 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 864/1804] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:25 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:25.414152 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7a9b8a8a-c841-4e27-bd33-36c4b514c27a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1404 microversion: 2.1 time: 0.480697 Oct 05 17:38:25.415059 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 941/1805] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:24 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:25.429778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b13e0fa6-ce65-4a20-ac60-269b4cef77e4 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:25.430998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b13e0fa6-ce65-4a20-ac60-269b4cef77e4 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:25.443780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b13e0fa6-ce65-4a20-ac60-269b4cef77e4 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:25.447114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b13e0fa6-ce65-4a20-ac60-269b4cef77e4 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:25.448240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b13e0fa6-ce65-4a20-ac60-269b4cef77e4 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:25.449587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b13e0fa6-ce65-4a20-ac60-269b4cef77e4 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:25.450792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b13e0fa6-ce65-4a20-ac60-269b4cef77e4 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:25.451629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b13e0fa6-ce65-4a20-ac60-269b4cef77e4 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:25.483997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-2759a84a-df4c-46f3-b213-9f6319c89521 req-0ebf1c2f-387a-40fa-85ed-df39482e0789 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5532aadd-9b7e-4272-a9c7-974410a0ad38", "tag": "9d178668-98f3-46ad-bb73-283d8c27f114"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:25.499432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:25.504087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2759a84a-df4c-46f3-b213-9f6319c89521 req-0ebf1c2f-387a-40fa-85ed-df39482e0789 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:25.507764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2759a84a-df4c-46f3-b213-9f6319c89521 req-0ebf1c2f-387a-40fa-85ed-df39482e0789 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:25.508463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2759a84a-df4c-46f3-b213-9f6319c89521 req-0ebf1c2f-387a-40fa-85ed-df39482e0789 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:25.541539 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-2759a84a-df4c-46f3-b213-9f6319c89521 req-0ebf1c2f-387a-40fa-85ed-df39482e0789 service nova] Creating event network-changed:9d178668-98f3-46ad-bb73-283d8c27f114 for instance 5532aadd-9b7e-4272-a9c7-974410a0ad38 on n-h2-835595-3 Oct 05 17:38:25.548513 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-2759a84a-df4c-46f3-b213-9f6319c89521 req-0ebf1c2f-387a-40fa-85ed-df39482e0789 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068187 Oct 05 17:38:25.552804 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 942/1806] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:25.690064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b13e0fa6-ce65-4a20-ac60-269b4cef77e4 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:25.713141 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b13e0fa6-ce65-4a20-ac60-269b4cef77e4 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1269 microversion: 2.1 time: 0.295247 Oct 05 17:38:25.718144 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 865/1807] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:25 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1269 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:26.122477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c7d382bb-fdbb-4ea1-9f62-7d76e4af02fe tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:26.124261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c7d382bb-fdbb-4ea1-9f62-7d76e4af02fe tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:26.134166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d382bb-fdbb-4ea1-9f62-7d76e4af02fe tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:26.135734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d382bb-fdbb-4ea1-9f62-7d76e4af02fe tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:26.136348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d382bb-fdbb-4ea1-9f62-7d76e4af02fe tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:26.137259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d382bb-fdbb-4ea1-9f62-7d76e4af02fe tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:26.137917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d382bb-fdbb-4ea1-9f62-7d76e4af02fe tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:26.138573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d382bb-fdbb-4ea1-9f62-7d76e4af02fe tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:26.384916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c7d382bb-fdbb-4ea1-9f62-7d76e4af02fe tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:26.394404 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c7d382bb-fdbb-4ea1-9f62-7d76e4af02fe tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.276626 Oct 05 17:38:26.408588 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 943/1808] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:26 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:26.415611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:26.416222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:26.422716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:26.423204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:26.423856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:26.424760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:26.425381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:26.425973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:26.439436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e2f583e6-a4a3-4af7-b1a8-af7b02e58a50 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:26.440309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e2f583e6-a4a3-4af7-b1a8-af7b02e58a50 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:26.452552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f583e6-a4a3-4af7-b1a8-af7b02e58a50 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:26.453583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f583e6-a4a3-4af7-b1a8-af7b02e58a50 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:26.454201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f583e6-a4a3-4af7-b1a8-af7b02e58a50 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:26.458456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f583e6-a4a3-4af7-b1a8-af7b02e58a50 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:26.459136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f583e6-a4a3-4af7-b1a8-af7b02e58a50 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:26.459780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f583e6-a4a3-4af7-b1a8-af7b02e58a50 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:26.771940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e2f583e6-a4a3-4af7-b1a8-af7b02e58a50 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:26.783440 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e2f583e6-a4a3-4af7-b1a8-af7b02e58a50 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1404 microversion: 2.1 time: 0.347728 Oct 05 17:38:26.809090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:26.810421 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 944/1809] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:26 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1404 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:26.825473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:26.829275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:26.831814 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e346825a-3e52-47b0-8214-5b53dfa754fe tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1476 microversion: 2.25 time: 0.420174 Oct 05 17:38:26.834589 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 866/1810] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:26 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1476 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:26.844688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c9a5157-4154-4826-8c36-23ebf1f1b9cb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:26.850022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3c9a5157-4154-4826-8c36-23ebf1f1b9cb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:26.867188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c9a5157-4154-4826-8c36-23ebf1f1b9cb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:26.867676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c9a5157-4154-4826-8c36-23ebf1f1b9cb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:26.868109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c9a5157-4154-4826-8c36-23ebf1f1b9cb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:26.880870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c9a5157-4154-4826-8c36-23ebf1f1b9cb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:26.882575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c9a5157-4154-4826-8c36-23ebf1f1b9cb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:26.888754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c9a5157-4154-4826-8c36-23ebf1f1b9cb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.008193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3c9a5157-4154-4826-8c36-23ebf1f1b9cb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:27.022888 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c9a5157-4154-4826-8c36-23ebf1f1b9cb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1269 microversion: 2.1 time: 0.181000 Oct 05 17:38:27.023434 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 867/1811] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:26 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1269 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:27.040186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ce72cebf-ccae-4e5f-a826-404448d5df4b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:27.040815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ce72cebf-ccae-4e5f-a826-404448d5df4b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:27.047061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce72cebf-ccae-4e5f-a826-404448d5df4b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.047558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce72cebf-ccae-4e5f-a826-404448d5df4b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.047992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce72cebf-ccae-4e5f-a826-404448d5df4b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.048856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce72cebf-ccae-4e5f-a826-404448d5df4b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.049376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce72cebf-ccae-4e5f-a826-404448d5df4b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.049744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce72cebf-ccae-4e5f-a826-404448d5df4b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.097857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49fc7cfd-e7be-4830-8a34-33690c79f12b tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Calling method '.version_select at 0x7f777964be50>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:27.117953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49fc7cfd-e7be-4830-8a34-33690c79f12b tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.118507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49fc7cfd-e7be-4830-8a34-33690c79f12b tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.118950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49fc7cfd-e7be-4830-8a34-33690c79f12b tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.119683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49fc7cfd-e7be-4830-8a34-33690c79f12b tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.120142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49fc7cfd-e7be-4830-8a34-33690c79f12b tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.120563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49fc7cfd-e7be-4830-8a34-33690c79f12b tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.172712 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49fc7cfd-e7be-4830-8a34-33690c79f12b tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] 10.222.0.70 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.360678 Oct 05 17:38:27.201616 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 945/1812] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Oct 5 17:38:26 2022] GET /compute/v2.1/limits => generated 511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:27.256514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86d08a3a-8831-44b3-96f6-df012e7e5390 tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1143103105", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:27.318408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-ce72cebf-ccae-4e5f-a826-404448d5df4b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid 410bc024-ca08-46da-8f57-0a2b8d440307 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:38:27.344433 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ce72cebf-ccae-4e5f-a826-404448d5df4b tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1968 microversion: 2.25 time: 0.319892 Oct 05 17:38:27.349335 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 868/1813] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:27 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1968 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:27.355164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-86d08a3a-8831-44b3-96f6-df012e7e5390 tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:38:27.381293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f119cd2-3d3a-4116-951e-67c7ebb724dc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:27.382002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3f119cd2-3d3a-4116-951e-67c7ebb724dc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:27.389371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f119cd2-3d3a-4116-951e-67c7ebb724dc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.389947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f119cd2-3d3a-4116-951e-67c7ebb724dc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.390480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f119cd2-3d3a-4116-951e-67c7ebb724dc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.391904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f119cd2-3d3a-4116-951e-67c7ebb724dc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.392404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f119cd2-3d3a-4116-951e-67c7ebb724dc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.392890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f119cd2-3d3a-4116-951e-67c7ebb724dc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.582947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-3f119cd2-3d3a-4116-951e-67c7ebb724dc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid 410bc024-ca08-46da-8f57-0a2b8d440307 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:38:27.602272 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3f119cd2-3d3a-4116-951e-67c7ebb724dc tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1968 microversion: 2.25 time: 0.224680 Oct 05 17:38:27.603158 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 869/1814] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:27 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1968 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:38:27.612085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c04837f-3fc0-47e1-b7cb-a3e49e2de8a1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:27.612833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c04837f-3fc0-47e1-b7cb-a3e49e2de8a1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:27.620417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c04837f-3fc0-47e1-b7cb-a3e49e2de8a1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.621071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c04837f-3fc0-47e1-b7cb-a3e49e2de8a1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.621646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c04837f-3fc0-47e1-b7cb-a3e49e2de8a1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.623182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c04837f-3fc0-47e1-b7cb-a3e49e2de8a1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.623931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c04837f-3fc0-47e1-b7cb-a3e49e2de8a1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.624974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c04837f-3fc0-47e1-b7cb-a3e49e2de8a1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.813803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-86d08a3a-8831-44b3-96f6-df012e7e5390 tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Getting quotas for project 176efcfd863a4546805823ce7f81bb9d. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:38:27.815183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6c04837f-3fc0-47e1-b7cb-a3e49e2de8a1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:27.825566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-86d08a3a-8831-44b3-96f6-df012e7e5390 tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Getting quotas for user 02b9f7a3e7474dbe8327b60bc6d9f248 and project 176efcfd863a4546805823ce7f81bb9d. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:38:27.826601 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c04837f-3fc0-47e1-b7cb-a3e49e2de8a1 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.218839 Oct 05 17:38:27.827254 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 870/1815] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:27 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:27.843519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2f93c638-6ba0-4481-be3e-3bae7bfb5e45 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:27.847616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f93c638-6ba0-4481-be3e-3bae7bfb5e45 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.852538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f93c638-6ba0-4481-be3e-3bae7bfb5e45 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.853255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f93c638-6ba0-4481-be3e-3bae7bfb5e45 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.854213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f93c638-6ba0-4481-be3e-3bae7bfb5e45 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.856996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f93c638-6ba0-4481-be3e-3bae7bfb5e45 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.861928 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-86d08a3a-8831-44b3-96f6-df012e7e5390 tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 05 17:38:27.862149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f93c638-6ba0-4481-be3e-3bae7bfb5e45 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86d08a3a-8831-44b3-96f6-df012e7e5390 tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Request method failure captured: Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 1752 Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcESYefaSpmcT4sfDhHTmQY2q_iBrtF5uQ_mwB8nHdGxvTdq5aTFhYUfP8HGoatYgnfjV0NiF4qHMDfHd8TNPb4eiS6KJxfV9QQcuECHKBZrpiI9f1bFIOH8hSmVwy04mN8g_Koj4QGeT658yWsyGt_VhNt4e_2SiETJ3KqXna_spNs Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 176efcfd863a4546805823ce7f81bb9d Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-528000969 Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/176efcfd863a4546805823ce7f81bb9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/176efcfd863a4546805823ce7f81bb9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_176efcfd863a4546805823ce7f81bb9d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/176efcfd863a4546805823ce7f81bb9d"}]}] Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-528000969 Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 176efcfd863a4546805823ce7f81bb9d Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-528000969 Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-528000969-project Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 02b9f7a3e7474dbe8327b60bc6d9f248 Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-528000969-project Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1143103105", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:38:27.864796 n-d-835595-3 devstack@n-api.service[128844]: exception: Maximum number of metadata items exceeds 128 Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1143103105', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:38:27.867433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:27.870732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86d08a3a-8831-44b3-96f6-df012e7e5390 tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:27.875567 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-86d08a3a-8831-44b3-96f6-df012e7e5390 tempest-AbsoluteLimitsNegativeTestJSON-528000969 tempest-AbsoluteLimitsNegativeTestJSON-528000969-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.623217 Oct 05 17:38:27.882326 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 946/1816] 10.222.0.70 () {60 vars in 1148 bytes} [Wed Oct 5 17:38:27 2022] POST /compute/v2.1/servers => generated 87 bytes in 625 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:38:27.916642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49eac831-3ef2-45f1-b7c5-8846f9f70e06 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:27.919923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-49eac831-3ef2-45f1-b7c5-8846f9f70e06 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:27.934855 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2f93c638-6ba0-4481-be3e-3bae7bfb5e45 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.102205 Oct 05 17:38:27.935500 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 871/1817] 10.222.0.70 () {60 vars in 1217 bytes} [Wed Oct 5 17:38:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:38:27.960114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-835595-3", "block_migration": "auto"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:27.980064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:27.982074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eac831-3ef2-45f1-b7c5-8846f9f70e06 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.982655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eac831-3ef2-45f1-b7c5-8846f9f70e06 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.983102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eac831-3ef2-45f1-b7c5-8846f9f70e06 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:27.990014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eac831-3ef2-45f1-b7c5-8846f9f70e06 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:27.992122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eac831-3ef2-45f1-b7c5-8846f9f70e06 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:27.996011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eac831-3ef2-45f1-b7c5-8846f9f70e06 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:28.007240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:28.007746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:28.008192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:28.008910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:28.009364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:28.022908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:28.101528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'flavor' on Instance uuid 410bc024-ca08-46da-8f57-0a2b8d440307 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:38:28.167906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Going to try to live migrate instance to n-h1-835595-3 {{(pid=128843) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 17:38:28.324707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-49eac831-3ef2-45f1-b7c5-8846f9f70e06 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:28.334525 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49eac831-3ef2-45f1-b7c5-8846f9f70e06 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1404 microversion: 2.1 time: 0.450709 Oct 05 17:38:28.335775 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 947/1818] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:27 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:28.341630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-65953a52-bb18-487f-85ae-7c2b035cebba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:28.342609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-65953a52-bb18-487f-85ae-7c2b035cebba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:28.348923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:28.351367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65953a52-bb18-487f-85ae-7c2b035cebba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:28.352248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65953a52-bb18-487f-85ae-7c2b035cebba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:28.353044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65953a52-bb18-487f-85ae-7c2b035cebba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:28.354052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65953a52-bb18-487f-85ae-7c2b035cebba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:28.354803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65953a52-bb18-487f-85ae-7c2b035cebba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:28.355585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65953a52-bb18-487f-85ae-7c2b035cebba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:28.458604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65953a52-bb18-487f-85ae-7c2b035cebba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:28.475134 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-65953a52-bb18-487f-85ae-7c2b035cebba tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1275 microversion: 2.1 time: 0.137822 Oct 05 17:38:28.495467 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 948/1819] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:28 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:28.855686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b07ee481-f185-4eff-aa77-8ef76a7d218a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:28.857143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b07ee481-f185-4eff-aa77-8ef76a7d218a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:28.883410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07ee481-f185-4eff-aa77-8ef76a7d218a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:28.884954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07ee481-f185-4eff-aa77-8ef76a7d218a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:28.886901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07ee481-f185-4eff-aa77-8ef76a7d218a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:28.889499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07ee481-f185-4eff-aa77-8ef76a7d218a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:28.890242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07ee481-f185-4eff-aa77-8ef76a7d218a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:28.891452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07ee481-f185-4eff-aa77-8ef76a7d218a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:29.340302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b07ee481-f185-4eff-aa77-8ef76a7d218a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:29.357406 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b07ee481-f185-4eff-aa77-8ef76a7d218a tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.506902 Oct 05 17:38:29.372534 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 949/1820] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:28 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:29.394207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81677666-9c8f-4d58-8dca-ca229dc3a822 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:29.395806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-81677666-9c8f-4d58-8dca-ca229dc3a822 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:29.411255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81677666-9c8f-4d58-8dca-ca229dc3a822 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:29.412622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81677666-9c8f-4d58-8dca-ca229dc3a822 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:29.413341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81677666-9c8f-4d58-8dca-ca229dc3a822 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:29.414336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81677666-9c8f-4d58-8dca-ca229dc3a822 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:29.415143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81677666-9c8f-4d58-8dca-ca229dc3a822 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:29.415845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81677666-9c8f-4d58-8dca-ca229dc3a822 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:29.705001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81677666-9c8f-4d58-8dca-ca229dc3a822 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:29.719367 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81677666-9c8f-4d58-8dca-ca229dc3a822 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1404 microversion: 2.1 time: 0.343516 Oct 05 17:38:29.723187 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 950/1821] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:29 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1404 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:29.750437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d4b321e-2572-41ad-9198-7c1c3586e30c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:29.751758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d4b321e-2572-41ad-9198-7c1c3586e30c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:29.774861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d4b321e-2572-41ad-9198-7c1c3586e30c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:29.776717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d4b321e-2572-41ad-9198-7c1c3586e30c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:29.777671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d4b321e-2572-41ad-9198-7c1c3586e30c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:29.778981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d4b321e-2572-41ad-9198-7c1c3586e30c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:29.779689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d4b321e-2572-41ad-9198-7c1c3586e30c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:29.784863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d4b321e-2572-41ad-9198-7c1c3586e30c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:29.928056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d4b321e-2572-41ad-9198-7c1c3586e30c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:29.942048 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d4b321e-2572-41ad-9198-7c1c3586e30c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1275 microversion: 2.1 time: 0.216992 Oct 05 17:38:29.942998 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 951/1822] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:29 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:30.387378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ba8c0fec-2b3a-40e2-a15b-4bbbbe64934b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:30.388216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ba8c0fec-2b3a-40e2-a15b-4bbbbe64934b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:30.405228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba8c0fec-2b3a-40e2-a15b-4bbbbe64934b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:30.406520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba8c0fec-2b3a-40e2-a15b-4bbbbe64934b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:30.409190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba8c0fec-2b3a-40e2-a15b-4bbbbe64934b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:30.411013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba8c0fec-2b3a-40e2-a15b-4bbbbe64934b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:30.411729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba8c0fec-2b3a-40e2-a15b-4bbbbe64934b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:30.412380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba8c0fec-2b3a-40e2-a15b-4bbbbe64934b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:30.678528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba8c0fec-2b3a-40e2-a15b-4bbbbe64934b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:30.688701 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ba8c0fec-2b3a-40e2-a15b-4bbbbe64934b tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1507 microversion: 2.1 time: 0.307089 Oct 05 17:38:30.693839 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 952/1823] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:30 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:30.745316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c98297e-6d6f-4da4-932b-72c65527f51c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:30.746306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3c98297e-6d6f-4da4-932b-72c65527f51c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:30.759334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c98297e-6d6f-4da4-932b-72c65527f51c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:30.763363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c98297e-6d6f-4da4-932b-72c65527f51c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:30.764708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c98297e-6d6f-4da4-932b-72c65527f51c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:30.768980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c98297e-6d6f-4da4-932b-72c65527f51c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:30.769515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c98297e-6d6f-4da4-932b-72c65527f51c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:30.769968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c98297e-6d6f-4da4-932b-72c65527f51c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:30.932946 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a18054e3-da4f-4b8f-8fe0-8e307a951236 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307/action" status: 202 len: 0 microversion: 2.25 time: 2.979183 Oct 05 17:38:30.937324 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 872/1824] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:38:27 2022] POST /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307/action => generated 0 bytes in 2985 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:38:30.951380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:30.953021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:30.983451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:30.992658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:30.993646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:30.994693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:30.995443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:30.995903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:30.996332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:31.014901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3c98297e-6d6f-4da4-932b-72c65527f51c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:31.028960 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c98297e-6d6f-4da4-932b-72c65527f51c tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1404 microversion: 2.1 time: 0.287655 Oct 05 17:38:31.029971 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 953/1825] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:30 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1404 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:31.035544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7bd586de-0624-499f-b537-d5f67497fa06 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:31.036633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7bd586de-0624-499f-b537-d5f67497fa06 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:31.051932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bd586de-0624-499f-b537-d5f67497fa06 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:31.052898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bd586de-0624-499f-b537-d5f67497fa06 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:31.053611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bd586de-0624-499f-b537-d5f67497fa06 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:31.055696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bd586de-0624-499f-b537-d5f67497fa06 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:31.057163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bd586de-0624-499f-b537-d5f67497fa06 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:31.079522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bd586de-0624-499f-b537-d5f67497fa06 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:31.246035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7bd586de-0624-499f-b537-d5f67497fa06 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:31.265137 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7bd586de-0624-499f-b537-d5f67497fa06 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1275 microversion: 2.1 time: 0.230981 Oct 05 17:38:31.285865 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 954/1826] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:31 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:31.722117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13431f6c-1006-40a2-837c-9235ff32b925 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:31.729645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13431f6c-1006-40a2-837c-9235ff32b925 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:31.749332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13431f6c-1006-40a2-837c-9235ff32b925 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:31.752078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13431f6c-1006-40a2-837c-9235ff32b925 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:31.752733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13431f6c-1006-40a2-837c-9235ff32b925 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:31.755487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13431f6c-1006-40a2-837c-9235ff32b925 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:31.756180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13431f6c-1006-40a2-837c-9235ff32b925 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:31.757180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13431f6c-1006-40a2-837c-9235ff32b925 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:31.939818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:31.955118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:31.959455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:31.964781 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-65b05e2f-8be9-46c9-8e69-c0e4233c5bc1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 1.021622 Oct 05 17:38:31.968182 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 873/1827] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:30 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:31.985095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-213df327-12d2-4dab-b945-c99e9d6f087f req-d253c69e-9a3b-4fe7-afa2-c9a4fb6b8fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5532aadd-9b7e-4272-a9c7-974410a0ad38", "name": "network-vif-plugged", "status": "completed", "tag": "9d178668-98f3-46ad-bb73-283d8c27f114"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:32.005842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-213df327-12d2-4dab-b945-c99e9d6f087f req-d253c69e-9a3b-4fe7-afa2-c9a4fb6b8fb5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:32.006630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-213df327-12d2-4dab-b945-c99e9d6f087f req-d253c69e-9a3b-4fe7-afa2-c9a4fb6b8fb5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:32.007221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-213df327-12d2-4dab-b945-c99e9d6f087f req-d253c69e-9a3b-4fe7-afa2-c9a4fb6b8fb5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:32.038716 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-213df327-12d2-4dab-b945-c99e9d6f087f req-d253c69e-9a3b-4fe7-afa2-c9a4fb6b8fb5 service nova] Creating event network-vif-plugged:9d178668-98f3-46ad-bb73-283d8c27f114 for instance 5532aadd-9b7e-4272-a9c7-974410a0ad38 on n-h2-835595-3 Oct 05 17:38:32.040053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-13431f6c-1006-40a2-837c-9235ff32b925 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:32.047238 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-213df327-12d2-4dab-b945-c99e9d6f087f req-d253c69e-9a3b-4fe7-afa2-c9a4fb6b8fb5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075316 Oct 05 17:38:32.050787 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 874/1828] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:32.061842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-559c28e5-15bb-45da-89c5-49bc6105efd4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:32.064174 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13431f6c-1006-40a2-837c-9235ff32b925 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 200 len: 1465 microversion: 2.1 time: 0.346402 Oct 05 17:38:32.076075 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 955/1829] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:31 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 1465 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:32.077710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-559c28e5-15bb-45da-89c5-49bc6105efd4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:32.077994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90da536e-adfd-4a39-8808-c2e46e747ea2 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:32.077994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90da536e-adfd-4a39-8808-c2e46e747ea2 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:32.078985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-559c28e5-15bb-45da-89c5-49bc6105efd4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:32.079217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-559c28e5-15bb-45da-89c5-49bc6105efd4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:32.081399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-559c28e5-15bb-45da-89c5-49bc6105efd4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:32.082563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-559c28e5-15bb-45da-89c5-49bc6105efd4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:32.083301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-559c28e5-15bb-45da-89c5-49bc6105efd4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:32.083923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-559c28e5-15bb-45da-89c5-49bc6105efd4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:32.094898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90da536e-adfd-4a39-8808-c2e46e747ea2 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:32.098991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90da536e-adfd-4a39-8808-c2e46e747ea2 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:32.099778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90da536e-adfd-4a39-8808-c2e46e747ea2 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:32.102769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90da536e-adfd-4a39-8808-c2e46e747ea2 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:32.107042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90da536e-adfd-4a39-8808-c2e46e747ea2 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:32.107636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90da536e-adfd-4a39-8808-c2e46e747ea2 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:32.136769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:32.369556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90da536e-adfd-4a39-8808-c2e46e747ea2 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:32.379105 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90da536e-adfd-4a39-8808-c2e46e747ea2 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1404 microversion: 2.1 time: 0.313229 Oct 05 17:38:32.381472 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 956/1830] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:32 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1404 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:32.386271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-1e9b3f4c-55cf-4273-bff0-9cb0d8b0cff9 req-2bfde1e8-e2c4-41a6-9a82-4c170c8a20f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed889508-b94f-4d12-b1e8-d8566a8b1d87", "name": "network-vif-deleted", "tag": "cc54401a-e03e-41e0-9f0e-4450adb99fff"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:32.412937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1e9b3f4c-55cf-4273-bff0-9cb0d8b0cff9 req-2bfde1e8-e2c4-41a6-9a82-4c170c8a20f6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:32.413618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1e9b3f4c-55cf-4273-bff0-9cb0d8b0cff9 req-2bfde1e8-e2c4-41a6-9a82-4c170c8a20f6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:32.414417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1e9b3f4c-55cf-4273-bff0-9cb0d8b0cff9 req-2bfde1e8-e2c4-41a6-9a82-4c170c8a20f6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:32.430223 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-1e9b3f4c-55cf-4273-bff0-9cb0d8b0cff9 req-2bfde1e8-e2c4-41a6-9a82-4c170c8a20f6 service nova] Creating event network-vif-deleted:cc54401a-e03e-41e0-9f0e-4450adb99fff for instance ed889508-b94f-4d12-b1e8-d8566a8b1d87 on n-h1-835595-3 Oct 05 17:38:32.442104 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-1e9b3f4c-55cf-4273-bff0-9cb0d8b0cff9 req-2bfde1e8-e2c4-41a6-9a82-4c170c8a20f6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058973 Oct 05 17:38:32.443212 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 957/1831] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:32.453623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-efe7f70d-8f26-4f73-9788-f86ab5b42e89 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:32.454352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-efe7f70d-8f26-4f73-9788-f86ab5b42e89 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:32.467879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe7f70d-8f26-4f73-9788-f86ab5b42e89 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:32.468397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe7f70d-8f26-4f73-9788-f86ab5b42e89 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:32.468769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe7f70d-8f26-4f73-9788-f86ab5b42e89 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:32.469478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe7f70d-8f26-4f73-9788-f86ab5b42e89 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:32.469980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe7f70d-8f26-4f73-9788-f86ab5b42e89 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:32.472235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe7f70d-8f26-4f73-9788-f86ab5b42e89 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:32.547295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-559c28e5-15bb-45da-89c5-49bc6105efd4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:32.559790 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-559c28e5-15bb-45da-89c5-49bc6105efd4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.507273 Oct 05 17:38:32.560941 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 875/1832] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:32 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:32.587377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-efe7f70d-8f26-4f73-9788-f86ab5b42e89 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:32.598452 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-efe7f70d-8f26-4f73-9788-f86ab5b42e89 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1275 microversion: 2.1 time: 0.153611 Oct 05 17:38:32.599480 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 958/1833] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:32 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:32.997067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:32.997757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:33.007737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.009277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.010713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.014933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.015698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.016122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.035690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:33.093193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:33.093999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: ed889508-b94f-4d12-b1e8-d8566a8b1d87] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:33.101493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.102423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.103601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.104607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.105336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.106040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.121597 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] HTTP exception thrown: Instance ed889508-b94f-4d12-b1e8-d8566a8b1d87 could not be found. Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Request method failure captured: Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 HTTP/1.1 Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcCNNM7ABsX8d5r9NqCfB604SUSkN50W6Gk8DN218vddgH5Ux03U6J2kdLSnHRGxP1ulVuGQmOs-TINu4J7JPmmaI--e9DwfqKc-5qT6x0_WQL9PfAA3twJLLC5l0YEU9g2NH3zukyhXuSPiapeZBtmpXUrZOEX_ABlZE0yFV9T3gGw Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 2331c2d84b054fdb9ffad3823856cd06 Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerRescueTestJSON-1393515830 Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2331c2d84b054fdb9ffad3823856cd06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2331c2d84b054fdb9ffad3823856cd06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2331c2d84b054fdb9ffad3823856cd06", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2331c2d84b054fdb9ffad3823856cd06"}]}] Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerRescueTestJSON-1393515830 Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 2331c2d84b054fdb9ffad3823856cd06 Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerRescueTestJSON-1393515830 Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerRescueTestJSON-1393515830-project Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 3c18411229884326b815e7f325ef37ec Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerRescueTestJSON-1393515830-project Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance ed889508-b94f-4d12-b1e8-d8566a8b1d87 could not be found. Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'ed889508-b94f-4d12-b1e8-d8566a8b1d87'} Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed889508-b94f-4d12-b1e8-d8566a8b1d87 could not be found. Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed889508-b94f-4d12-b1e8-d8566a8b1d87 could not be found. Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:33.123785 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:33.128541 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:33.128541 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:33.128541 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:33.128541 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:33.128541 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:33.128541 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed889508-b94f-4d12-b1e8-d8566a8b1d87 could not be found. Oct 05 17:38:33.128541 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:38:33.132611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Returning 404 to user: Instance ed889508-b94f-4d12-b1e8-d8566a8b1d87 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:33.133814 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-22eb024e-2801-467b-95a7-e33a4a438af6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87" status: 404 len: 111 microversion: 2.1 time: 0.044684 Oct 05 17:38:33.134996 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 959/1834] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:33 2022] GET /compute/v2.1/servers/ed889508-b94f-4d12-b1e8-d8566a8b1d87 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:38:33.159345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c1818141-ea5a-4bb8-ab16-25a34b37cf08 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:33.161173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c1818141-ea5a-4bb8-ab16-25a34b37cf08 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:33.181582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1818141-ea5a-4bb8-ab16-25a34b37cf08 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.182383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1818141-ea5a-4bb8-ab16-25a34b37cf08 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.183318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1818141-ea5a-4bb8-ab16-25a34b37cf08 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.184320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1818141-ea5a-4bb8-ab16-25a34b37cf08 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.185159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1818141-ea5a-4bb8-ab16-25a34b37cf08 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.185825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1818141-ea5a-4bb8-ab16-25a34b37cf08 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.234821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c1818141-ea5a-4bb8-ab16-25a34b37cf08 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:38:33.350571 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c1818141-ea5a-4bb8-ab16-25a34b37cf08 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "DELETE /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 204 len: 0 microversion: 2.1 time: 0.198325 Oct 05 17:38:33.351481 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 960/1835] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:38:33 2022] DELETE /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:38:33.361755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f250e315-145a-444a-8667-c41e40688ed7 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:33.362489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f250e315-145a-444a-8667-c41e40688ed7 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:33.369257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f250e315-145a-444a-8667-c41e40688ed7 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.369748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f250e315-145a-444a-8667-c41e40688ed7 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.370178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f250e315-145a-444a-8667-c41e40688ed7 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.371041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f250e315-145a-444a-8667-c41e40688ed7 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.371488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f250e315-145a-444a-8667-c41e40688ed7 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.372099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f250e315-145a-444a-8667-c41e40688ed7 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.655628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:33.673160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:33.683077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:33.687598 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8ebac591-6e5f-44f8-bb72-80711581003e tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.692079 Oct 05 17:38:33.688724 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 876/1836] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:32 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:33.701968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-662f9c10-5728-404d-b9e3-ce1e545f633f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:33.703145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-662f9c10-5728-404d-b9e3-ce1e545f633f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:33.726021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-662f9c10-5728-404d-b9e3-ce1e545f633f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.728346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-662f9c10-5728-404d-b9e3-ce1e545f633f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.730479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-662f9c10-5728-404d-b9e3-ce1e545f633f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.731229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-662f9c10-5728-404d-b9e3-ce1e545f633f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.731776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-662f9c10-5728-404d-b9e3-ce1e545f633f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.732210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-662f9c10-5728-404d-b9e3-ce1e545f633f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.830380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f250e315-145a-444a-8667-c41e40688ed7 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:33.845484 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f250e315-145a-444a-8667-c41e40688ed7 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1493 microversion: 2.1 time: 0.486224 Oct 05 17:38:33.846680 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 961/1837] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:33 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1493 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:33.852030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84d16674-fd43-4fce-9b33-c5ba2c5f4c26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:33.852620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-84d16674-fd43-4fce-9b33-c5ba2c5f4c26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:33.872604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d16674-fd43-4fce-9b33-c5ba2c5f4c26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.873110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d16674-fd43-4fce-9b33-c5ba2c5f4c26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.873548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d16674-fd43-4fce-9b33-c5ba2c5f4c26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:33.878092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d16674-fd43-4fce-9b33-c5ba2c5f4c26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:33.881058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d16674-fd43-4fce-9b33-c5ba2c5f4c26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:33.882528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d16674-fd43-4fce-9b33-c5ba2c5f4c26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:34.241486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-84d16674-fd43-4fce-9b33-c5ba2c5f4c26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:34.252452 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84d16674-fd43-4fce-9b33-c5ba2c5f4c26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.401869 Oct 05 17:38:34.255579 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 962/1838] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:33 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:34.264875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-efe41327-247d-4bd8-b0d7-b01ba5eca040 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:34.265988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-efe41327-247d-4bd8-b0d7-b01ba5eca040 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:34.328788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe41327-247d-4bd8-b0d7-b01ba5eca040 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:34.329659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe41327-247d-4bd8-b0d7-b01ba5eca040 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:34.342648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe41327-247d-4bd8-b0d7-b01ba5eca040 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:34.345492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe41327-247d-4bd8-b0d7-b01ba5eca040 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:34.346016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe41327-247d-4bd8-b0d7-b01ba5eca040 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:34.350790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efe41327-247d-4bd8-b0d7-b01ba5eca040 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:34.763609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-662f9c10-5728-404d-b9e3-ce1e545f633f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:34.781266 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-662f9c10-5728-404d-b9e3-ce1e545f633f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1404 microversion: 2.1 time: 1.090181 Oct 05 17:38:34.783615 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 877/1839] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:33 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1404 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:34.788885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-02321f3b-95b0-4916-bfc2-bd249b6aa34c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-2030639348"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:34.791630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-02321f3b-95b0-4916-bfc2-bd249b6aa34c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:34.800520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02321f3b-95b0-4916-bfc2-bd249b6aa34c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:34.801375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02321f3b-95b0-4916-bfc2-bd249b6aa34c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:34.802103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02321f3b-95b0-4916-bfc2-bd249b6aa34c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:34.803060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02321f3b-95b0-4916-bfc2-bd249b6aa34c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:34.803829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02321f3b-95b0-4916-bfc2-bd249b6aa34c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:34.804418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02321f3b-95b0-4916-bfc2-bd249b6aa34c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:35.054073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-efe41327-247d-4bd8-b0d7-b01ba5eca040 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:35.066258 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-efe41327-247d-4bd8-b0d7-b01ba5eca040 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1317 microversion: 2.1 time: 0.809181 Oct 05 17:38:35.066685 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 963/1840] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:34 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1317 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:35.087927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:35.095284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:35.127677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:35.128197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:35.128641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:35.129374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:35.129829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:35.130258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:35.267980 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-02321f3b-95b0-4916-bfc2-bd249b6aa34c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.481812 Oct 05 17:38:35.268701 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 878/1841] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:38:34 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 05 17:38:35.287033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00b1693b-a0a0-4cda-a366-0fe7f4f8c25d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:35.291151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00b1693b-a0a0-4cda-a366-0fe7f4f8c25d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:35.306269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b1693b-a0a0-4cda-a366-0fe7f4f8c25d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:35.307058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b1693b-a0a0-4cda-a366-0fe7f4f8c25d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:35.307680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b1693b-a0a0-4cda-a366-0fe7f4f8c25d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:35.308880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b1693b-a0a0-4cda-a366-0fe7f4f8c25d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:35.310606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b1693b-a0a0-4cda-a366-0fe7f4f8c25d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:35.335116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00b1693b-a0a0-4cda-a366-0fe7f4f8c25d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:35.398137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:35.591153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:35.606662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:35.608809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:35.610298 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a7144c64-e89b-4ade-90bf-9d4f07962371 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.540380 Oct 05 17:38:35.611458 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 964/1842] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:35 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:35.617222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c77650c7-9b1c-43e1-9d65-7e4afed6e52f req-38657c13-bf2f-4164-ad8a-edf344bde5d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586258bf-c661-4819-804b-504089c77dc6", "name": "network-vif-unplugged", "status": "completed", "tag": "cfd34f5d-5af2-4330-b921-2091d3e274be"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:35.630745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c77650c7-9b1c-43e1-9d65-7e4afed6e52f req-38657c13-bf2f-4164-ad8a-edf344bde5d0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:35.632032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c77650c7-9b1c-43e1-9d65-7e4afed6e52f req-38657c13-bf2f-4164-ad8a-edf344bde5d0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:35.632954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c77650c7-9b1c-43e1-9d65-7e4afed6e52f req-38657c13-bf2f-4164-ad8a-edf344bde5d0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:35.659827 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c77650c7-9b1c-43e1-9d65-7e4afed6e52f req-38657c13-bf2f-4164-ad8a-edf344bde5d0 service nova] Creating event network-vif-unplugged:cfd34f5d-5af2-4330-b921-2091d3e274be for instance 586258bf-c661-4819-804b-504089c77dc6 on n-h2-835595-3 Oct 05 17:38:35.678733 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c77650c7-9b1c-43e1-9d65-7e4afed6e52f req-38657c13-bf2f-4164-ad8a-edf344bde5d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059586 Oct 05 17:38:35.679440 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 965/1843] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:35.722614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a5219292-0440-4eb7-a548-6c59315b4a44 req-6b067276-72c0-471a-b74a-5ad73591fe7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67baad57-2eba-46d5-94df-c10ae7590a6a", "tag": "a6701176-0529-4a5b-9027-de7e2d50b2f4"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:35.746590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a5219292-0440-4eb7-a548-6c59315b4a44 req-6b067276-72c0-471a-b74a-5ad73591fe7c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:35.747835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a5219292-0440-4eb7-a548-6c59315b4a44 req-6b067276-72c0-471a-b74a-5ad73591fe7c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:35.748570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a5219292-0440-4eb7-a548-6c59315b4a44 req-6b067276-72c0-471a-b74a-5ad73591fe7c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:35.766202 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a5219292-0440-4eb7-a548-6c59315b4a44 req-6b067276-72c0-471a-b74a-5ad73591fe7c service nova] Creating event network-changed:a6701176-0529-4a5b-9027-de7e2d50b2f4 for instance 67baad57-2eba-46d5-94df-c10ae7590a6a on n-h1-835595-3 Oct 05 17:38:35.775428 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a5219292-0440-4eb7-a548-6c59315b4a44 req-6b067276-72c0-471a-b74a-5ad73591fe7c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093481 Oct 05 17:38:35.777018 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 966/1844] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:35.813544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e1167ac-3eb6-4ca3-a2b4-306eb6c22ef0 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:35.815078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5e1167ac-3eb6-4ca3-a2b4-306eb6c22ef0 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:35.844645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e1167ac-3eb6-4ca3-a2b4-306eb6c22ef0 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:35.851454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e1167ac-3eb6-4ca3-a2b4-306eb6c22ef0 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:35.855567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e1167ac-3eb6-4ca3-a2b4-306eb6c22ef0 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:35.858314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e1167ac-3eb6-4ca3-a2b4-306eb6c22ef0 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:35.860234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e1167ac-3eb6-4ca3-a2b4-306eb6c22ef0 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:35.862200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e1167ac-3eb6-4ca3-a2b4-306eb6c22ef0 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:36.288121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5e1167ac-3eb6-4ca3-a2b4-306eb6c22ef0 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:36.302088 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e1167ac-3eb6-4ca3-a2b4-306eb6c22ef0 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1591 microversion: 2.1 time: 0.491392 Oct 05 17:38:36.303348 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 967/1845] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:35 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1591 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:36.320095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3f62c1a-7580-4d4b-89e9-8cd7b9f9f200 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc89b3e2-cfc5-4ff6-85a9-68f39f61523e"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:36.323718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c3f62c1a-7580-4d4b-89e9-8cd7b9f9f200 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:36.343862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3f62c1a-7580-4d4b-89e9-8cd7b9f9f200 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:36.344351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3f62c1a-7580-4d4b-89e9-8cd7b9f9f200 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:36.344795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3f62c1a-7580-4d4b-89e9-8cd7b9f9f200 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:36.345496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3f62c1a-7580-4d4b-89e9-8cd7b9f9f200 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:36.345945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3f62c1a-7580-4d4b-89e9-8cd7b9f9f200 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:36.350331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3f62c1a-7580-4d4b-89e9-8cd7b9f9f200 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:36.449961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-00b1693b-a0a0-4cda-a366-0fe7f4f8c25d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:36.461884 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00b1693b-a0a0-4cda-a366-0fe7f4f8c25d tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1493 microversion: 2.1 time: 1.190777 Oct 05 17:38:36.466419 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 879/1846] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:35 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1493 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:36.472525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8c69a336-c753-4664-b92d-0f3a9f664e4e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:36.473146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8c69a336-c753-4664-b92d-0f3a9f664e4e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:36.496217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c69a336-c753-4664-b92d-0f3a9f664e4e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:36.497194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c69a336-c753-4664-b92d-0f3a9f664e4e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:36.498044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c69a336-c753-4664-b92d-0f3a9f664e4e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:36.498979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c69a336-c753-4664-b92d-0f3a9f664e4e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:36.499600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c69a336-c753-4664-b92d-0f3a9f664e4e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:36.501021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c69a336-c753-4664-b92d-0f3a9f664e4e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:36.765504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3f62c1a-7580-4d4b-89e9-8cd7b9f9f200 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "POST /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460619 Oct 05 17:38:36.786190 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 968/1847] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 17:38:36 2022] POST /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-volume_attachments => generated 194 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:36.800054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7f5f7eae-8f73-46a3-a5bb-2c201cc5168f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:36.800657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7f5f7eae-8f73-46a3-a5bb-2c201cc5168f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:36.815348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f5f7eae-8f73-46a3-a5bb-2c201cc5168f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:36.815848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f5f7eae-8f73-46a3-a5bb-2c201cc5168f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:36.831388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f5f7eae-8f73-46a3-a5bb-2c201cc5168f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:36.832504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f5f7eae-8f73-46a3-a5bb-2c201cc5168f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:36.835811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f5f7eae-8f73-46a3-a5bb-2c201cc5168f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:36.838695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f5f7eae-8f73-46a3-a5bb-2c201cc5168f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:37.140330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:37.322190 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7f5f7eae-8f73-46a3-a5bb-2c201cc5168f tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.533429 Oct 05 17:38:37.322819 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 969/1848] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:38:36 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38/os-interface => generated 284 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:37.328771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:37.329392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:37.344647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:37.345146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:37.345581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:37.346330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:37.346786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:37.347211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:37.810632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c69a336-c753-4664-b92d-0f3a9f664e4e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:37.819889 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8c69a336-c753-4664-b92d-0f3a9f664e4e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1317 microversion: 2.1 time: 1.351989 Oct 05 17:38:37.821223 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 880/1849] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:36 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1317 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:37.830250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d69dcd52-be2e-45ae-9081-315f18fc09bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:37.836481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d69dcd52-be2e-45ae-9081-315f18fc09bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:37.849751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=24 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:37.872464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69dcd52-be2e-45ae-9081-315f18fc09bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:37.874638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69dcd52-be2e-45ae-9081-315f18fc09bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:37.876098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69dcd52-be2e-45ae-9081-315f18fc09bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:37.879965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69dcd52-be2e-45ae-9081-315f18fc09bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:37.880761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69dcd52-be2e-45ae-9081-315f18fc09bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:37.881330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d69dcd52-be2e-45ae-9081-315f18fc09bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:37.882648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:38.585590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d69dcd52-be2e-45ae-9081-315f18fc09bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:38.601834 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d69dcd52-be2e-45ae-9081-315f18fc09bb tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1493 microversion: 2.1 time: 0.778909 Oct 05 17:38:38.602822 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 881/1850] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:37 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1493 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:38.720032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:38.741489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:38.746499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:38.751311 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-66ffe652-2221-4bf5-8f97-2c1928476a14 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 1.425954 Oct 05 17:38:38.752008 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 970/1851] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:37 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:38.856707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d387ae7e-e371-4727-bd95-5aa6b3624f47 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:38.859582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d387ae7e-e371-4727-bd95-5aa6b3624f47 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:38.868672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d387ae7e-e371-4727-bd95-5aa6b3624f47 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:38.870053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d387ae7e-e371-4727-bd95-5aa6b3624f47 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:38.871350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d387ae7e-e371-4727-bd95-5aa6b3624f47 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:38.879406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d387ae7e-e371-4727-bd95-5aa6b3624f47 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:38.881543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d387ae7e-e371-4727-bd95-5aa6b3624f47 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:38.882517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d387ae7e-e371-4727-bd95-5aa6b3624f47 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:39.136657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-83de3a6c-065b-48b2-ba3f-96312742af98 req-15a0edd9-510d-48d7-9c60-d7e170ab76a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a5d378-bcc8-48b4-a494-65ca945e6410", "name": "network-vif-deleted", "tag": "2b178db8-2785-4391-803e-088175679149"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:39.170560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-83de3a6c-065b-48b2-ba3f-96312742af98 req-15a0edd9-510d-48d7-9c60-d7e170ab76a6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:39.171812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-83de3a6c-065b-48b2-ba3f-96312742af98 req-15a0edd9-510d-48d7-9c60-d7e170ab76a6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:39.172418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-83de3a6c-065b-48b2-ba3f-96312742af98 req-15a0edd9-510d-48d7-9c60-d7e170ab76a6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:39.204729 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-83de3a6c-065b-48b2-ba3f-96312742af98 req-15a0edd9-510d-48d7-9c60-d7e170ab76a6 service nova] Creating event network-vif-deleted:2b178db8-2785-4391-803e-088175679149 for instance 95a5d378-bcc8-48b4-a494-65ca945e6410 on n-h2-835595-3 Oct 05 17:38:39.217189 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-83de3a6c-065b-48b2-ba3f-96312742af98 req-15a0edd9-510d-48d7-9c60-d7e170ab76a6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089810 Oct 05 17:38:39.223139 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 971/1852] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:38:39.416691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d387ae7e-e371-4727-bd95-5aa6b3624f47 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:39.428063 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d387ae7e-e371-4727-bd95-5aa6b3624f47 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1317 microversion: 2.1 time: 0.580252 Oct 05 17:38:39.429654 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 882/1853] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:38 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:39.642877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:39.643726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:39.659496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:39.662969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:39.663601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:39.664965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:39.667144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:39.667910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:39.742166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:39.742613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:39.743048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:39.743558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lazy-loading 'fault' on Instance uuid 95a5d378-bcc8-48b4-a494-65ca945e6410 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:38:39.779339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:39.780235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:39.791455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:39.799956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:39.800518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:39.802702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:39.804496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:39.810210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:39.961247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c18411229884326b815e7f325ef37ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2331c2d84b054fdb9ffad3823856cd06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:39.981355 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c75136cc-f3db-46da-bd2c-f8d68b5fe7a6 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 200 len: 1304 microversion: 2.1 time: 0.351701 Oct 05 17:38:39.988352 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 972/1854] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:39 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 1304 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:40.332458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:40.356545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:40.358084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:40.370694 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4ec5286a-8de2-4dd5-b1ae-56b9ce8b0f9f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.593244 Oct 05 17:38:40.377024 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 883/1855] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:39 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:40.454674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d27f8aa2-5561-46e8-8f2b-319d06e35e90 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:40.455459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d27f8aa2-5561-46e8-8f2b-319d06e35e90 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:40.465677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27f8aa2-5561-46e8-8f2b-319d06e35e90 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:40.476906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27f8aa2-5561-46e8-8f2b-319d06e35e90 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:40.477371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27f8aa2-5561-46e8-8f2b-319d06e35e90 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:40.478202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27f8aa2-5561-46e8-8f2b-319d06e35e90 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:40.478701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27f8aa2-5561-46e8-8f2b-319d06e35e90 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:40.479169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27f8aa2-5561-46e8-8f2b-319d06e35e90 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:40.551403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:38:41.017667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:41.019950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] [instance: 95a5d378-bcc8-48b4-a494-65ca945e6410] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:41.037946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:41.038677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:41.040470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:41.045314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:41.046688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:41.047337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:41.077742 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] HTTP exception thrown: Instance 95a5d378-bcc8-48b4-a494-65ca945e6410 could not be found. Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Request method failure captured: Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 HTTP/1.1 Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcCNNM7ABsX8d5r9NqCfB604SUSkN50W6Gk8DN218vddgH5Ux03U6J2kdLSnHRGxP1ulVuGQmOs-TINu4J7JPmmaI--e9DwfqKc-5qT6x0_WQL9PfAA3twJLLC5l0YEU9g2NH3zukyhXuSPiapeZBtmpXUrZOEX_ABlZE0yFV9T3gGw Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 2331c2d84b054fdb9ffad3823856cd06 Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerRescueTestJSON-1393515830 Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2331c2d84b054fdb9ffad3823856cd06"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2331c2d84b054fdb9ffad3823856cd06"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2331c2d84b054fdb9ffad3823856cd06", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2331c2d84b054fdb9ffad3823856cd06"}]}] Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerRescueTestJSON-1393515830 Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 2331c2d84b054fdb9ffad3823856cd06 Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerRescueTestJSON-1393515830 Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerRescueTestJSON-1393515830-project Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 3c18411229884326b815e7f325ef37ec Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerRescueTestJSON-1393515830-project Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 95a5d378-bcc8-48b4-a494-65ca945e6410 could not be found. Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '95a5d378-bcc8-48b4-a494-65ca945e6410'} Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a5d378-bcc8-48b4-a494-65ca945e6410 could not be found. Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a5d378-bcc8-48b4-a494-65ca945e6410 could not be found. Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:38:41.083537 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:41.090615 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:38:41.090615 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:38:41.090615 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:38:41.090615 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:38:41.090615 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:38:41.090615 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a5d378-bcc8-48b4-a494-65ca945e6410 could not be found. Oct 05 17:38:41.090615 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:38:41.118676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d27f8aa2-5561-46e8-8f2b-319d06e35e90 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:41.126553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] Returning 404 to user: Instance 95a5d378-bcc8-48b4-a494-65ca945e6410 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:38:41.128318 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8dffd811-28e2-44e3-ab53-41dfa651bbb3 tempest-ServerRescueTestJSON-1393515830 tempest-ServerRescueTestJSON-1393515830-project] 10.222.0.70 "GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410" status: 404 len: 111 microversion: 2.1 time: 0.115709 Oct 05 17:38:41.129404 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 884/1856] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:41 2022] GET /compute/v2.1/servers/95a5d378-bcc8-48b4-a494-65ca945e6410 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:38:41.140971 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d27f8aa2-5561-46e8-8f2b-319d06e35e90 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1317 microversion: 2.1 time: 0.687903 Oct 05 17:38:41.143241 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 973/1857] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:40 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:41.274632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-480d3a29-8a47-44c5-b0b2-1e8aac5b263b tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:41.275577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-480d3a29-8a47-44c5-b0b2-1e8aac5b263b tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:41.293880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-480d3a29-8a47-44c5-b0b2-1e8aac5b263b tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:41.296787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-480d3a29-8a47-44c5-b0b2-1e8aac5b263b tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:41.297393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-480d3a29-8a47-44c5-b0b2-1e8aac5b263b tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:41.300473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-480d3a29-8a47-44c5-b0b2-1e8aac5b263b tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:41.300971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-480d3a29-8a47-44c5-b0b2-1e8aac5b263b tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:41.305543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-480d3a29-8a47-44c5-b0b2-1e8aac5b263b tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:41.307304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-075434bc-d026-402b-8161-0c2ef69fc511 req-4b2fcbc6-fb84-489c-a6e8-647528b780d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5532aadd-9b7e-4272-a9c7-974410a0ad38", "tag": "9d178668-98f3-46ad-bb73-283d8c27f114"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:41.339808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-075434bc-d026-402b-8161-0c2ef69fc511 req-4b2fcbc6-fb84-489c-a6e8-647528b780d9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:41.341714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-075434bc-d026-402b-8161-0c2ef69fc511 req-4b2fcbc6-fb84-489c-a6e8-647528b780d9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:41.342642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-075434bc-d026-402b-8161-0c2ef69fc511 req-4b2fcbc6-fb84-489c-a6e8-647528b780d9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:41.363324 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-075434bc-d026-402b-8161-0c2ef69fc511 req-4b2fcbc6-fb84-489c-a6e8-647528b780d9 service nova] Creating event network-changed:9d178668-98f3-46ad-bb73-283d8c27f114 for instance 5532aadd-9b7e-4272-a9c7-974410a0ad38 on n-h2-835595-3 Oct 05 17:38:41.374639 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-075434bc-d026-402b-8161-0c2ef69fc511 req-4b2fcbc6-fb84-489c-a6e8-647528b780d9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088170 Oct 05 17:38:41.375927 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 974/1858] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:38:41.427896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:41.428863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:41.453380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:41.453871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:41.454886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:41.456871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:41.463470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:41.464267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:41.862425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:41.875742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:41.877194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:41.891299 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a40219f1-50b6-420c-8edb-74e3eaa2297d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.473154 Oct 05 17:38:41.898676 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 975/1859] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:41 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:42.165725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-29dd08e1-140c-4a9b-b45f-86da0a729cab tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:42.168097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-29dd08e1-140c-4a9b-b45f-86da0a729cab tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:42.177038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29dd08e1-140c-4a9b-b45f-86da0a729cab tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:42.180214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29dd08e1-140c-4a9b-b45f-86da0a729cab tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:42.180959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29dd08e1-140c-4a9b-b45f-86da0a729cab tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:42.181939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29dd08e1-140c-4a9b-b45f-86da0a729cab tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:42.184432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29dd08e1-140c-4a9b-b45f-86da0a729cab tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:42.185242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29dd08e1-140c-4a9b-b45f-86da0a729cab tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:42.489030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-480d3a29-8a47-44c5-b0b2-1e8aac5b263b tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:42.502131 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-480d3a29-8a47-44c5-b0b2-1e8aac5b263b tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1591 microversion: 2.1 time: 1.231006 Oct 05 17:38:42.506986 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 885/1860] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:41 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1591 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:42.558577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-29dd08e1-140c-4a9b-b45f-86da0a729cab tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:42.567759 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-29dd08e1-140c-4a9b-b45f-86da0a729cab tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1317 microversion: 2.1 time: 0.405920 Oct 05 17:38:42.585292 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 976/1861] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:42 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:38:42.918039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:42.919126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:42.930530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:42.934678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:42.935428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:42.936357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:42.937025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:42.937633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:43.832900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d3c8e440-ee71-4dd5-87c0-cfe6ed52f947 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f77795ab280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1162562951", "description": "tempest-description-472984311"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:44.079436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:44.101556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:44.109945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:44.112198 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4157302e-429a-4998-8a07-c14ce9bfa55a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 1.198385 Oct 05 17:38:44.119140 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 886/1862] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:42 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:44.132270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d72a45a8-9946-49b9-a1d3-870c41c77bf3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:44.133739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d72a45a8-9946-49b9-a1d3-870c41c77bf3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:44.168211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d72a45a8-9946-49b9-a1d3-870c41c77bf3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:44.171817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d72a45a8-9946-49b9-a1d3-870c41c77bf3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:44.174676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d72a45a8-9946-49b9-a1d3-870c41c77bf3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:44.177875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d72a45a8-9946-49b9-a1d3-870c41c77bf3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:44.179064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d72a45a8-9946-49b9-a1d3-870c41c77bf3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:44.179531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d72a45a8-9946-49b9-a1d3-870c41c77bf3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:44.319304 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d3c8e440-ee71-4dd5-87c0-cfe6ed52f947 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.794616 Oct 05 17:38:44.319919 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 977/1863] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:38:43 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:38:44.332228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4c1a7f18-ddc8-4770-afa5-a761081c0818 req-c001395f-1cee-4e72-9143-f1a0dbebded7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586258bf-c661-4819-804b-504089c77dc6", "name": "network-vif-plugged", "status": "completed", "tag": "cfd34f5d-5af2-4330-b921-2091d3e274be"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:44.353459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4c1a7f18-ddc8-4770-afa5-a761081c0818 req-c001395f-1cee-4e72-9143-f1a0dbebded7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:44.354153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4c1a7f18-ddc8-4770-afa5-a761081c0818 req-c001395f-1cee-4e72-9143-f1a0dbebded7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:44.354819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4c1a7f18-ddc8-4770-afa5-a761081c0818 req-c001395f-1cee-4e72-9143-f1a0dbebded7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:44.379053 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4c1a7f18-ddc8-4770-afa5-a761081c0818 req-c001395f-1cee-4e72-9143-f1a0dbebded7 service nova] Creating event network-vif-plugged:cfd34f5d-5af2-4330-b921-2091d3e274be for instance 586258bf-c661-4819-804b-504089c77dc6 on n-h2-835595-3 Oct 05 17:38:44.393559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4c1a7f18-ddc8-4770-afa5-a761081c0818 req-c001395f-1cee-4e72-9143-f1a0dbebded7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070257 Oct 05 17:38:44.395719 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 978/1864] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:44.406466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-be1b428c-235d-4383-bb94-2f6e34a4be72 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f777956eee0>, body: {"security_group_rule": {"parent_group_id": "cc54c28b-d8f9-4724-bc9d-27bb6d6a18eb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:44.742348 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-be1b428c-235d-4383-bb94-2f6e34a4be72 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.343959 Oct 05 17:38:44.742963 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 979/1865] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:38:44 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:44.759021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e7199072-5ee9-4946-92b9-38c171c5573b tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f777962c790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1870388737", "description": "tempest-description-822863530"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:45.057557 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e7199072-5ee9-4946-92b9-38c171c5573b tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.304894 Oct 05 17:38:45.058527 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 980/1866] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:38:44 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:45.073202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-659bbb80-50b4-4d6d-bdca-dc072e712747 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f777962cb80>, body: {"security_group_rule": {"parent_group_id": "c66efe22-3a9b-4498-88bf-dcc35957e5ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:45.080655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d72a45a8-9946-49b9-a1d3-870c41c77bf3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:45.095961 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d72a45a8-9946-49b9-a1d3-870c41c77bf3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1317 microversion: 2.1 time: 0.971856 Oct 05 17:38:45.099895 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 887/1867] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:44 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1317 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:45.155541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:45.156493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:45.173553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:45.177994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:45.178799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:45.179938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:45.194088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:45.195336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:45.616487 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-659bbb80-50b4-4d6d-bdca-dc072e712747 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.547646 Oct 05 17:38:45.619524 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 981/1868] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:38:45 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:45.634706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7264dfa5-5c2d-48ff-af6e-9eb22a38ddcb tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f777962e040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1278315376", "description": "tempest-description-106032727"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:46.044256 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7264dfa5-5c2d-48ff-af6e-9eb22a38ddcb tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.414309 Oct 05 17:38:46.053053 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 982/1869] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:38:45 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:46.060056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-00ac4db3-d2c8-4b00-843c-76460cfb9b9a tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f7779572b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-349025464", "description": "tempest-description-958430892"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:46.400231 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-00ac4db3-d2c8-4b00-843c-76460cfb9b9a tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.345429 Oct 05 17:38:46.408639 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 983/1870] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:38:46 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:46.424583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b86f95fe-b13f-4b98-98d2-9b9fb4544f0a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:46.425579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b86f95fe-b13f-4b98-98d2-9b9fb4544f0a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:46.441240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86f95fe-b13f-4b98-98d2-9b9fb4544f0a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:46.441798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86f95fe-b13f-4b98-98d2-9b9fb4544f0a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:46.460877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86f95fe-b13f-4b98-98d2-9b9fb4544f0a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:46.463671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86f95fe-b13f-4b98-98d2-9b9fb4544f0a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:46.464180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86f95fe-b13f-4b98-98d2-9b9fb4544f0a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:46.464659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b86f95fe-b13f-4b98-98d2-9b9fb4544f0a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:46.819945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:46.840179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:46.846022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b86f95fe-b13f-4b98-98d2-9b9fb4544f0a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:46.890612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:46.903942 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b86f95fe-b13f-4b98-98d2-9b9fb4544f0a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1317 microversion: 2.1 time: 0.463408 Oct 05 17:38:46.904249 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5ef503cd-b2c2-4808-b5f5-b88d7cc49698 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 1.749654 Oct 05 17:38:46.920319 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 888/1871] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:45 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:46.924105 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 984/1872] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:46 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1317 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:46.954118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c744fbe6-8e4b-4e0f-bc6a-05b0f163793e req-416cc4d1-1aea-4096-927f-4f9a575c8bac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67baad57-2eba-46d5-94df-c10ae7590a6a", "name": "network-vif-plugged", "status": "completed", "tag": "a6701176-0529-4a5b-9027-de7e2d50b2f4"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:46.957127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dc5f7a25-3c1e-4d96-9f2f-df307b3223cf tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f777964fdc0>, body: {"security_group_rule": {"parent_group_id": "b053bcf4-17fd-4115-8e9e-2b271a1c2c3a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "9e546edc-4bc6-4a05-a43b-e541c360eaf8"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:46.996627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c744fbe6-8e4b-4e0f-bc6a-05b0f163793e req-416cc4d1-1aea-4096-927f-4f9a575c8bac service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:46.997298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c744fbe6-8e4b-4e0f-bc6a-05b0f163793e req-416cc4d1-1aea-4096-927f-4f9a575c8bac service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:46.997927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c744fbe6-8e4b-4e0f-bc6a-05b0f163793e req-416cc4d1-1aea-4096-927f-4f9a575c8bac service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:47.018971 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c744fbe6-8e4b-4e0f-bc6a-05b0f163793e req-416cc4d1-1aea-4096-927f-4f9a575c8bac service nova] Creating event network-vif-plugged:a6701176-0529-4a5b-9027-de7e2d50b2f4 for instance 67baad57-2eba-46d5-94df-c10ae7590a6a on n-h1-835595-3 Oct 05 17:38:47.049301 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c744fbe6-8e4b-4e0f-bc6a-05b0f163793e req-416cc4d1-1aea-4096-927f-4f9a575c8bac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116714 Oct 05 17:38:47.051671 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 985/1873] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:47.929531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d7ad850-5654-40d4-bbb7-2432561fe84d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:47.932647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d7ad850-5654-40d4-bbb7-2432561fe84d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:47.956892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d7ad850-5654-40d4-bbb7-2432561fe84d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:47.958476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d7ad850-5654-40d4-bbb7-2432561fe84d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:47.962723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d7ad850-5654-40d4-bbb7-2432561fe84d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:47.964921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d7ad850-5654-40d4-bbb7-2432561fe84d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:47.968547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d7ad850-5654-40d4-bbb7-2432561fe84d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:47.969605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d7ad850-5654-40d4-bbb7-2432561fe84d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:48.259269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3d7ad850-5654-40d4-bbb7-2432561fe84d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:48.274007 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d7ad850-5654-40d4-bbb7-2432561fe84d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1317 microversion: 2.1 time: 0.348899 Oct 05 17:38:48.281223 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 986/1874] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:47 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:48.288243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:48.290565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:48.299052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:48.299536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:48.300031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:48.301057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:48.301570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:48.302051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:48.661685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:48.677974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:48.680081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:48.681435 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f63e38b-3a2b-49aa-9969-b4060be425fa tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.398992 Oct 05 17:38:48.682512 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 987/1875] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:48 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:49.356577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f251b95a-1ba5-4b15-947c-baa57e713c0b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:49.358809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f251b95a-1ba5-4b15-947c-baa57e713c0b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:49.369651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f251b95a-1ba5-4b15-947c-baa57e713c0b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:49.372440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f251b95a-1ba5-4b15-947c-baa57e713c0b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:49.373414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f251b95a-1ba5-4b15-947c-baa57e713c0b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:49.374367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f251b95a-1ba5-4b15-947c-baa57e713c0b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:49.375472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f251b95a-1ba5-4b15-947c-baa57e713c0b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:49.376129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f251b95a-1ba5-4b15-947c-baa57e713c0b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:49.699765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f251b95a-1ba5-4b15-947c-baa57e713c0b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:49.725220 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f251b95a-1ba5-4b15-947c-baa57e713c0b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1467 microversion: 2.1 time: 0.382021 Oct 05 17:38:49.726587 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 988/1876] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:38:49 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1467 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:49.732925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:49.733806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:49.741437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:49.742428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:49.743069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:49.744173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:49.744965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:49.746544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:49.998507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:50.009672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:50.011146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:50.012335 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-55bdbecc-b688-4642-9766-680de960d741 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.284562 Oct 05 17:38:50.012974 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 989/1877] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:49 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:50.048159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-267747677", "metadata": {"image_type": "test"}}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:50.057214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:50.078231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:50.078765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:50.079198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:50.079914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:50.080365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:50.080786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:50.133521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Getting quotas for project e09b9e18087143a6863bd26d55ced3d7. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:38:50.144556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Getting quotas for user 3f47c095840642cfba9edb55fb8fc656 and project e09b9e18087143a6863bd26d55ced3d7. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:38:50.313021 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dc5f7a25-3c1e-4d96-9f2f-df307b3223cf tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 3.382893 Oct 05 17:38:50.314544 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 889/1878] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:38:46 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 3394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:50.329323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-07c859f7-4981-4b36-bdad-9d8ed1cc73b2 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f77795c98b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-597718897", "description": "tempest-description-1023400409"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:50.558893 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-249fb621-64b1-4103-a5b3-05bba81072d0 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "POST /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a/action" status: 202 len: 0 microversion: 2.1 time: 0.514534 Oct 05 17:38:50.566058 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 990/1879] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:38:50 2022] POST /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a/action => generated 0 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 17:38:50.591441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ff761c28-9497-46df-8676-00f078b74c56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795aba60>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:50.695859 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ff761c28-9497-46df-8676-00f078b74c56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 200 len: 1421 microversion: 2.1 time: 0.121591 Oct 05 17:38:50.700636 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 991/1880] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:38:50 2022] GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 1421 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:51.043005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:51.043780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:51.058016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:51.061385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:51.063626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:51.064458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:51.066120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:51.066613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:51.276381 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-07c859f7-4981-4b36-bdad-9d8ed1cc73b2 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.951391 Oct 05 17:38:51.276982 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 890/1881] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:38:50 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:51.291209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1e0710f3-4349-4c8e-a8c2-bd811f0bfa1e tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f77795da9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1905433668", "description": "tempest-description-1434135237"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:52.085630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:52.100814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:52.114797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:52.116227 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-600f41f0-2f51-4a29-821c-039436246abf tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 1.077678 Oct 05 17:38:52.125644 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 992/1882] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:51 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:38:52.147151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-17213579-a872-4cfc-83cb-8dda18ac4a69 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f7779621dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:52.297629 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1e0710f3-4349-4c8e-a8c2-bd811f0bfa1e tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.010648 Oct 05 17:38:52.298535 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 891/1883] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:38:51 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:52.311685 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-17213579-a872-4cfc-83cb-8dda18ac4a69 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 200 len: 1421 microversion: 2.1 time: 0.184752 Oct 05 17:38:52.312533 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 993/1884] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:38:52 2022] GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 1421 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:52.316465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5dce7200-b063-41a2-8b48-708b10048955 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f77795d9820>, body: {"security_group_rule": {"parent_group_id": "08ad0e09-faff-44af-ab3b-c3729e800ded", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "78d28da6-5053-4464-8ddb-4b5ea3fbcfbb"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:53.150694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:53.152077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:53.169472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:53.170348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:53.172011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:53.172989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:53.173509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:53.173954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:53.590697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:53.610506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:53.613251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:53.615534 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4200b45b-f3a2-48a2-ad30-7e29551cf1ce tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.471805 Oct 05 17:38:53.616478 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 994/1885] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:53 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:53.629187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd4c0711-db3e-4afa-8976-7b7b7f61e0d6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f7779577c10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:53.642184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5dce7200-b063-41a2-8b48-708b10048955 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.333141 Oct 05 17:38:53.645996 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 892/1886] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:38:52 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:38:53.658455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e39632c8-2d92-48a7-9846-b186b5bd1d9e tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f77796523a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:53.741725 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd4c0711-db3e-4afa-8976-7b7b7f61e0d6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 200 len: 1421 microversion: 2.1 time: 0.123559 Oct 05 17:38:53.744782 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 995/1887] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:38:53 2022] GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 1421 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:38:54.380053 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e39632c8-2d92-48a7-9846-b186b5bd1d9e tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/78d28da6-5053-4464-8ddb-4b5ea3fbcfbb" status: 202 len: 0 microversion: 2.1 time: 0.726507 Oct 05 17:38:54.381041 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 893/1888] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:38:53 2022] DELETE /compute/v2.1/os-security-groups/78d28da6-5053-4464-8ddb-4b5ea3fbcfbb => generated 0 bytes in 728 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:38:54.393042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bb3cf24c-2622-48a5-b221-c3ff27a8669f tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f7779537790>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:54.655934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:54.660335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:38:54.700939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:54.703089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:54.705521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:54.711145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:38:54.712996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:38:54.721989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:38:54.804344 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bb3cf24c-2622-48a5-b221-c3ff27a8669f tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/08ad0e09-faff-44af-ab3b-c3729e800ded" status: 200 len: 247 microversion: 2.1 time: 0.419243 Oct 05 17:38:54.806539 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 996/1889] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:38:54 2022] GET /compute/v2.1/os-security-groups/08ad0e09-faff-44af-ab3b-c3729e800ded => generated 247 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:54.811914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6962c69a-77d7-4aeb-9d0d-ae759bb393b3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f7779560940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:38:55.143455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:55.154460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:55.156199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:38:55.157505 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47277f04-b044-438a-b121-78ba15076883 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.514394 Oct 05 17:38:55.158097 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 894/1890] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:38:54 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:38:55.178994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8eb56089-570b-4902-9b4e-c789417c1cee tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f77795d9a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1543313212", "description": "tempest-description-2061472276"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:55.748041 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8eb56089-570b-4902-9b4e-c789417c1cee tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.587619 Oct 05 17:38:55.749396 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 895/1891] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:38:55 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:55.762456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ae429494-3c51-40d7-ad4f-9a8b88c46bbb tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f77795c9700>, body: {"security_group_rule": {"parent_group_id": "69079602-b44d-4500-abb1-925777580e45", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:38:56.143077 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ae429494-3c51-40d7-ad4f-9a8b88c46bbb tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.384632 Oct 05 17:38:56.143981 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 896/1892] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:38:55 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:38:56.831584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cdaa1b9d-1bf6-4193-953d-52f46ee8c25b tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Action: 'create', calling method: .version_select at 0x7f777961be50>, body: {"pool": null} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:01.162963 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cdaa1b9d-1bf6-4193-953d-52f46ee8c25b tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.017310 Oct 05 17:39:01.163645 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 897/1893] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:38:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5019 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:01.177059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d48df279-0a75-4caf-8e9a-601a5d193a93 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Action: 'create', calling method: .version_select at 0x7f7779652310>, body: {"security_group_rule": {"parent_group_id": "69079602-b44d-4500-abb1-925777580e45", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:01.755868 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d48df279-0a75-4caf-8e9a-601a5d193a93 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.583549 Oct 05 17:39:01.756483 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 898/1894] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:39:01 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:01.770502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:01.771132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:01.785213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=34 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:01.788458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:01.795588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:01.796724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:01.798848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:01.799536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:01.800210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:02.202656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:02.233991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:02.240057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:02.241320 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ae95714f-12db-4450-b2dc-081d74223649 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.476387 Oct 05 17:39:02.241901 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 899/1895] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:01 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:02.259209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-00b39b13-61dc-47b1-aeeb-f47093b76bf4 req-c4174e44-0607-40e4-a9fa-605f8c1ba336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410bc024-ca08-46da-8f57-0a2b8d440307", "name": "network-vif-unplugged", "status": "completed", "tag": "2f01703e-a65e-4077-8843-eb2be80875d6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:02.296129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-00b39b13-61dc-47b1-aeeb-f47093b76bf4 req-c4174e44-0607-40e4-a9fa-605f8c1ba336 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:02.296129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-00b39b13-61dc-47b1-aeeb-f47093b76bf4 req-c4174e44-0607-40e4-a9fa-605f8c1ba336 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:02.296129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-00b39b13-61dc-47b1-aeeb-f47093b76bf4 req-c4174e44-0607-40e4-a9fa-605f8c1ba336 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:02.333175 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-00b39b13-61dc-47b1-aeeb-f47093b76bf4 req-c4174e44-0607-40e4-a9fa-605f8c1ba336 service nova] Creating event network-vif-unplugged:2f01703e-a65e-4077-8843-eb2be80875d6 for instance 410bc024-ca08-46da-8f57-0a2b8d440307 on n-h2-835595-3 Oct 05 17:39:02.343772 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-00b39b13-61dc-47b1-aeeb-f47093b76bf4 req-c4174e44-0607-40e4-a9fa-605f8c1ba336 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100092 Oct 05 17:39:02.345431 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 900/1896] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:02.357385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-2b417c5a-4692-45fb-bddf-6012694fe701 req-e15649a0-e7c2-4433-83fc-6ce6b2246bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67baad57-2eba-46d5-94df-c10ae7590a6a", "name": "network-vif-plugged", "status": "completed", "tag": "a6701176-0529-4a5b-9027-de7e2d50b2f4"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:02.391579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2b417c5a-4692-45fb-bddf-6012694fe701 req-e15649a0-e7c2-4433-83fc-6ce6b2246bae service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:02.392183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2b417c5a-4692-45fb-bddf-6012694fe701 req-e15649a0-e7c2-4433-83fc-6ce6b2246bae service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:02.392710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2b417c5a-4692-45fb-bddf-6012694fe701 req-e15649a0-e7c2-4433-83fc-6ce6b2246bae service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:02.405939 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-2b417c5a-4692-45fb-bddf-6012694fe701 req-e15649a0-e7c2-4433-83fc-6ce6b2246bae service nova] Creating event network-vif-plugged:a6701176-0529-4a5b-9027-de7e2d50b2f4 for instance 67baad57-2eba-46d5-94df-c10ae7590a6a on n-h1-835595-3 Oct 05 17:39:02.413330 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-2b417c5a-4692-45fb-bddf-6012694fe701 req-e15649a0-e7c2-4433-83fc-6ce6b2246bae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064330 Oct 05 17:39:02.418484 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 901/1897] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:02.429950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cf464ae4-e78e-4647-afea-e870c1b8ed56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:02.434842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cf464ae4-e78e-4647-afea-e870c1b8ed56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:02.445530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf464ae4-e78e-4647-afea-e870c1b8ed56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:02.446182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf464ae4-e78e-4647-afea-e870c1b8ed56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:02.446845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf464ae4-e78e-4647-afea-e870c1b8ed56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:02.451315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf464ae4-e78e-4647-afea-e870c1b8ed56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:02.451929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf464ae4-e78e-4647-afea-e870c1b8ed56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:02.452483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf464ae4-e78e-4647-afea-e870c1b8ed56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:02.572377 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cf464ae4-e78e-4647-afea-e870c1b8ed56 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152105 Oct 05 17:39:02.586222 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 902/1898] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:39:02 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:02.593998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1891250a-3d99-432b-9a06-188726110b1e tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Action: 'create', calling method: .version_select at 0x7f77795fb160>, body: {"pool": null} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:03.160803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:03.595260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:05.408137 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1891250a-3d99-432b-9a06-188726110b1e tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.818084 Oct 05 17:39:05.444019 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 903/1899] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:39:02 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:05.444019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-330ac4a3-2048-4e68-9dc3-63fc3dabbe15 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f777963fc10>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:05.560232 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-330ac4a3-2048-4e68-9dc3-63fc3dabbe15 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "GET /compute/v2.1/os-security-groups/69079602-b44d-4500-abb1-925777580e45" status: 200 len: 665 microversion: 2.1 time: 0.148995 Oct 05 17:39:05.562144 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 904/1900] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:39:05 2022] GET /compute/v2.1/os-security-groups/69079602-b44d-4500-abb1-925777580e45 => generated 665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:05.577317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fcdb7c77-49c6-48a9-b224-874c183b7bcb tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:05.578011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fcdb7c77-49c6-48a9-b224-874c183b7bcb tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:05.590234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcdb7c77-49c6-48a9-b224-874c183b7bcb tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:05.591396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcdb7c77-49c6-48a9-b224-874c183b7bcb tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:05.592147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcdb7c77-49c6-48a9-b224-874c183b7bcb tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:05.593060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcdb7c77-49c6-48a9-b224-874c183b7bcb tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:05.597073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcdb7c77-49c6-48a9-b224-874c183b7bcb tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:05.597773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcdb7c77-49c6-48a9-b224-874c183b7bcb tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:05.664224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=75 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:05.816090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-fcdb7c77-49c6-48a9-b224-874c183b7bcb tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lazy-loading 'services' on Instance uuid fb9c26e4-6a60-4b8f-8268-7ec8034ca709 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:39:05.980589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fcdb7c77-49c6-48a9-b224-874c183b7bcb tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-volume_attachments/dc89b3e2-cfc5-4ff6-85a9-68f39f61523e" status: 202 len: 0 microversion: 2.1 time: 0.416235 Oct 05 17:39:05.994223 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 905/1901] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 17:39:05 2022] DELETE /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-volume_attachments/dc89b3e2-cfc5-4ff6-85a9-68f39f61523e => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:06.011511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:06.012239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:06.052387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:06.052917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:06.053361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:06.054098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:06.054609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:06.055022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:06.471709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:06.482197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:06.489264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:06.490782 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c549353c-c3e4-4d98-a49a-ecd895da96ee tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.494583 Oct 05 17:39:06.505619 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 906/1902] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:05 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:06.517042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c841b08f-0ae4-43cc-823e-3adfc96600c6 req-1ad6e9e5-07d5-4ce5-8f92-70a44ab395e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "410bc024-ca08-46da-8f57-0a2b8d440307", "tag": "2f01703e-a65e-4077-8843-eb2be80875d6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:06.552600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c841b08f-0ae4-43cc-823e-3adfc96600c6 req-1ad6e9e5-07d5-4ce5-8f92-70a44ab395e2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:06.556832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c841b08f-0ae4-43cc-823e-3adfc96600c6 req-1ad6e9e5-07d5-4ce5-8f92-70a44ab395e2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:06.560084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c841b08f-0ae4-43cc-823e-3adfc96600c6 req-1ad6e9e5-07d5-4ce5-8f92-70a44ab395e2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:06.589307 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c841b08f-0ae4-43cc-823e-3adfc96600c6 req-1ad6e9e5-07d5-4ce5-8f92-70a44ab395e2 service nova] Creating event network-changed:2f01703e-a65e-4077-8843-eb2be80875d6 for instance 410bc024-ca08-46da-8f57-0a2b8d440307 on n-h2-835595-3 Oct 05 17:39:06.595499 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c841b08f-0ae4-43cc-823e-3adfc96600c6 req-1ad6e9e5-07d5-4ce5-8f92-70a44ab395e2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102722 Oct 05 17:39:06.609268 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 907/1903] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:06.619277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0377bd1a-73fe-4fb0-89f1-4d17b365b7d2 tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Action: 'create', calling method: .version_select at 0x7f7779636c10>, body: {"pool": null} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:08.054615 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6962c69a-77d7-4aeb-9d0d-ae759bb393b3 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 200 len: 1421 microversion: 2.1 time: 13.246213 Oct 05 17:39:08.058398 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 997/1904] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:38:54 2022] GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 1421 bytes in 13251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:08.069633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8a02e8f8-5d43-4dd9-a17c-b5ebebe4d8e5 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f7779537dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:08.428126 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8a02e8f8-5d43-4dd9-a17c-b5ebebe4d8e5 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/bf17631f-0835-4c02-9a97-203c55584d9b" status: 202 len: 0 microversion: 2.1 time: 0.368247 Oct 05 17:39:08.429386 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 998/1905] 10.222.0.70 () {58 vars in 1287 bytes} [Wed Oct 5 17:39:08 2022] DELETE /compute/v2.1/os-security-group-rules/bf17631f-0835-4c02-9a97-203c55584d9b => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:08.438971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:08.440041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:08.464824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:08.466925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:08.468672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:08.471160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:08.474388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:08.475142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:08.785251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:08.799275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:08.801425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:08.802890 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9e9b3813-3661-4154-8211-be009b87d4fc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.372333 Oct 05 17:39:08.805527 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 999/1906] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:08 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:08.816578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:08.820274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:08.829570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:08.830572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:08.833926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:08.835028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:08.835769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:08.836216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:09.120900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:09.134846 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.323798 Oct 05 17:39:09.135924 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1000/1907] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:08 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:09.137447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:09.143471 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-527954eb-d660-4342-9f52-a1c1a0ff4003 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006204 Oct 05 17:39:09.144059 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1001/1908] 10.222.0.70 () {56 vars in 886 bytes} [Wed Oct 5 17:39:09 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 05 17:39:09.152147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-718190d9-9e7d-4b35-897a-d592903a01f0 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f77795371f0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:09.859334 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0377bd1a-73fe-4fb0-89f1-4d17b365b7d2 tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.248148 Oct 05 17:39:09.883160 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 908/1909] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:39:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:09.889055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c7b59570-9e45-4d44-b14d-4b9baf6c05fa tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f777966ad30>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:09.954554 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-718190d9-9e7d-4b35-897a-d592903a01f0 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/69079602-b44d-4500-abb1-925777580e45" status: 202 len: 0 microversion: 2.1 time: 0.808940 Oct 05 17:39:09.955156 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1002/1910] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:39:09 2022] DELETE /compute/v2.1/os-security-groups/69079602-b44d-4500-abb1-925777580e45 => generated 0 bytes in 810 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:09.963199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c840c2e-2e53-4796-a989-d1253b39e252 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-208290771"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:09.969288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c840c2e-2e53-4796-a989-d1253b39e252 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:09.986880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c840c2e-2e53-4796-a989-d1253b39e252 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:09.987416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c840c2e-2e53-4796-a989-d1253b39e252 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:09.987912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c840c2e-2e53-4796-a989-d1253b39e252 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:09.988582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c840c2e-2e53-4796-a989-d1253b39e252 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:09.990687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c840c2e-2e53-4796-a989-d1253b39e252 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:09.992049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c840c2e-2e53-4796-a989-d1253b39e252 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:10.016406 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c7b59570-9e45-4d44-b14d-4b9baf6c05fa tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 200 len: 1421 microversion: 2.1 time: 0.132046 Oct 05 17:39:10.017024 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 909/1911] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:09 2022] GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 1421 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:10.032648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:10.033449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:10.041639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:10.042142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:10.042609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:10.067417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:10.068184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:10.068794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:10.595343 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c840c2e-2e53-4796-a989-d1253b39e252 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.637341 Oct 05 17:39:10.612580 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1003/1912] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:39:09 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 05 17:39:10.633896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e7ab783b-c198-4e1f-843b-97efe2d19a07 tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Action: 'create', calling method: .version_select at 0x7f7779572f70>, body: {"pool": null} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:10.661802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:10.672151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:10.674567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:10.676070 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4185f949-8fba-4892-bb89-84e889521d46 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.647637 Oct 05 17:39:10.687665 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 910/1913] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:10 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:10.702595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1c6b3479-61b9-4207-ba98-2c9db0ee6c46 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f777966a5e0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:10.750126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-1c6b3479-61b9-4207-ba98-2c9db0ee6c46 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 78d28da6-5053-4464-8ddb-4b5ea3fbcfbb does not exist", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:39:10.751712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.security_group_api [None req-1c6b3479-61b9-4207-ba98-2c9db0ee6c46 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Neutron security group 78d28da6-5053-4464-8ddb-4b5ea3fbcfbb not found {{(pid=128843) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:39:10.752516 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-1c6b3479-61b9-4207-ba98-2c9db0ee6c46 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] HTTP exception thrown: Security group 78d28da6-5053-4464-8ddb-4b5ea3fbcfbb does not exist Oct 05 17:39:10.752516 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-a0fecdeb-6e50-4979-a870-1c82051bccbf'] Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1c6b3479-61b9-4207-ba98-2c9db0ee6c46 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Request method failure captured: Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-security-groups/78d28da6-5053-4464-8ddb-4b5ea3fbcfbb HTTP/1.1 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcEj0u59to5PzBV0XEYQ2sZV1RKrpmz4Hd5qhJ2sbbFZQpRySa8_4ad5Ccft-H0X9qgX2saRE7bbMP6_KoJg9k5iy_0ZnCDfBlLCghf8mBxfkUGt21cr95iujCLpIZjd3-X83BE4bV7LvfZ4fy0haj2oCiaX3q34Z436tFdkotSgF4A Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 62698e97aa364e778e21728852923fc9 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-503514378 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/62698e97aa364e778e21728852923fc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/62698e97aa364e778e21728852923fc9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_62698e97aa364e778e21728852923fc9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/62698e97aa364e778e21728852923fc9"}]}] Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupRulesTestJSON-503514378 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 62698e97aa364e778e21728852923fc9 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-503514378 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupRulesTestJSON-503514378-project Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 3a4b769b772e41bbbca7d7f074c87af2 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupRulesTestJSON-503514378-project Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: exception: Security group 78d28da6-5053-4464-8ddb-4b5ea3fbcfbb does not exist Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-a0fecdeb-6e50-4979-a870-1c82051bccbf'] Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '78d28da6-5053-4464-8ddb-4b5ea3fbcfbb'} Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:39:10.754888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 78d28da6-5053-4464-8ddb-4b5ea3fbcfbb does not exist Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0fecdeb-6e50-4979-a870-1c82051bccbf'] Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 78d28da6-5053-4464-8ddb-4b5ea3fbcfbb does not exist Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0fecdeb-6e50-4979-a870-1c82051bccbf'] Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 78d28da6-5053-4464-8ddb-4b5ea3fbcfbb does not exist Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0fecdeb-6e50-4979-a870-1c82051bccbf'] Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 78d28da6-5053-4464-8ddb-4b5ea3fbcfbb does not exist Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a0fecdeb-6e50-4979-a870-1c82051bccbf'] Oct 05 17:39:10.760508 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:10.770635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1c6b3479-61b9-4207-ba98-2c9db0ee6c46 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Returning 404 to user: Security group 78d28da6-5053-4464-8ddb-4b5ea3fbcfbb does not exist Oct 05 17:39:10.770635 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-a0fecdeb-6e50-4979-a870-1c82051bccbf'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:39:10.771264 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1c6b3479-61b9-4207-ba98-2c9db0ee6c46 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/78d28da6-5053-4464-8ddb-4b5ea3fbcfbb" status: 404 len: 194 microversion: 2.1 time: 0.082006 Oct 05 17:39:10.772010 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 911/1914] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:39:10 2022] DELETE /compute/v2.1/os-security-groups/78d28da6-5053-4464-8ddb-4b5ea3fbcfbb => generated 194 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:39:10.780832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cba985d5-4f77-4077-86d0-9a08befb7a8d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:10.787092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cba985d5-4f77-4077-86d0-9a08befb7a8d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:10.803412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba985d5-4f77-4077-86d0-9a08befb7a8d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:10.806423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba985d5-4f77-4077-86d0-9a08befb7a8d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:10.808961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba985d5-4f77-4077-86d0-9a08befb7a8d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:10.810497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba985d5-4f77-4077-86d0-9a08befb7a8d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:10.811536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba985d5-4f77-4077-86d0-9a08befb7a8d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:10.812713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba985d5-4f77-4077-86d0-9a08befb7a8d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:11.227411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cba985d5-4f77-4077-86d0-9a08befb7a8d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:11.244450 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cba985d5-4f77-4077-86d0-9a08befb7a8d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.470656 Oct 05 17:39:11.249486 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 912/1915] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:10 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:11.262702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b16f919-25ae-487d-859b-2d0e50c20301 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f7779652d30>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:12.261182 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0b16f919-25ae-487d-859b-2d0e50c20301 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/08ad0e09-faff-44af-ab3b-c3729e800ded" status: 202 len: 0 microversion: 2.1 time: 1.009872 Oct 05 17:39:12.266427 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 913/1916] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:39:11 2022] DELETE /compute/v2.1/os-security-groups/08ad0e09-faff-44af-ab3b-c3729e800ded => generated 0 bytes in 1016 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:12.271686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-96523279-9c55-4a3f-b380-3e312f91931f tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f7779647ee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:12.386499 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-96523279-9c55-4a3f-b380-3e312f91931f tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 200 len: 1421 microversion: 2.1 time: 0.115469 Oct 05 17:39:12.396959 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 914/1917] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:12 2022] GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 1421 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:12.404783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e079eb3b-c07f-4438-953f-b6c024faac5f req-93824944-559f-4226-b0dc-fe1e82cfe578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586258bf-c661-4819-804b-504089c77dc6", "name": "network-vif-unplugged", "status": "completed", "tag": "cfd34f5d-5af2-4330-b921-2091d3e274be"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:12.445313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e079eb3b-c07f-4438-953f-b6c024faac5f req-93824944-559f-4226-b0dc-fe1e82cfe578 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:12.446376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e079eb3b-c07f-4438-953f-b6c024faac5f req-93824944-559f-4226-b0dc-fe1e82cfe578 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:12.447081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e079eb3b-c07f-4438-953f-b6c024faac5f req-93824944-559f-4226-b0dc-fe1e82cfe578 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:12.484484 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e079eb3b-c07f-4438-953f-b6c024faac5f req-93824944-559f-4226-b0dc-fe1e82cfe578 service nova] Creating event network-vif-unplugged:cfd34f5d-5af2-4330-b921-2091d3e274be for instance 586258bf-c661-4819-804b-504089c77dc6 on n-h2-835595-3 Oct 05 17:39:12.508750 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e079eb3b-c07f-4438-953f-b6c024faac5f req-93824944-559f-4226-b0dc-fe1e82cfe578 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109560 Oct 05 17:39:12.515947 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 915/1918] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:12.521509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:12.522211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:12.535844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:12.536341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:12.536781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:12.544384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:12.544880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:12.545326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:12.731413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:12.743027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:12.748851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:12.762885 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b76b620c-9e5c-424d-8bd0-c3d74621d489 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1486 microversion: 2.25 time: 0.244775 Oct 05 17:39:12.765474 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 916/1919] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:12 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1486 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:12.778512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-301ffffe-262b-4c53-a6ff-21edb7487801 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f77795c94c0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:13.962344 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e7ab783b-c198-4e1f-843b-97efe2d19a07 tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.348215 Oct 05 17:39:13.963610 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1004/1920] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:39:10 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:13.979991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2c6b4548-996e-4ca7-a3b4-a51e49bb59e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:13.981516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2c6b4548-996e-4ca7-a3b4-a51e49bb59e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:13.995833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c6b4548-996e-4ca7-a3b4-a51e49bb59e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:13.996675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c6b4548-996e-4ca7-a3b4-a51e49bb59e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:13.998526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c6b4548-996e-4ca7-a3b4-a51e49bb59e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:13.999537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c6b4548-996e-4ca7-a3b4-a51e49bb59e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:14.002232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c6b4548-996e-4ca7-a3b4-a51e49bb59e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:14.003094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c6b4548-996e-4ca7-a3b4-a51e49bb59e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:14.215452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2c6b4548-996e-4ca7-a3b4-a51e49bb59e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:14.228472 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2c6b4548-996e-4ca7-a3b4-a51e49bb59e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1686 microversion: 2.1 time: 0.256016 Oct 05 17:39:14.241970 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1005/1921] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:13 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1686 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:14.256040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e8503bc0-2572-4c45-a2fd-8c147a25258d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f7779572e50>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:14.326202 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e8503bc0-2572-4c45-a2fd-8c147a25258d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 200 len: 1421 microversion: 2.1 time: 0.081927 Oct 05 17:39:14.329407 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1006/1922] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:14 2022] GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 1421 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:14.341284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:14.342264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:14.353563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:14.354695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:14.358978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:14.360302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:14.364595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:14.369187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:14.674865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:14.687456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:14.689938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:14.692021 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-becc14d8-2c74-4377-bc85-d9e4abd5532c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1476 microversion: 2.25 time: 0.361375 Oct 05 17:39:14.692833 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1007/1923] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:14 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:14.704542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-22227f32-74c6-4ec2-96ba-9b49234f3e54 tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Calling method '.version_select at 0x7f7779572700>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:15.477613 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-301ffffe-262b-4c53-a6ff-21edb7487801 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/9e546edc-4bc6-4a05-a43b-e541c360eaf8" status: 202 len: 0 microversion: 2.1 time: 2.710267 Oct 05 17:39:15.486663 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 917/1924] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:39:12 2022] DELETE /compute/v2.1/os-security-groups/9e546edc-4bc6-4a05-a43b-e541c360eaf8 => generated 0 bytes in 2716 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:15.495572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bf8eeec1-8282-4ab0-a740-ed807d6cc1ad tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '.version_select at 0x7f77795e3280>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:15.507089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf8eeec1-8282-4ab0-a740-ed807d6cc1ad tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:15.511828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf8eeec1-8282-4ab0-a740-ed807d6cc1ad tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:15.513882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf8eeec1-8282-4ab0-a740-ed807d6cc1ad tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:15.547710 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bf8eeec1-8282-4ab0-a740-ed807d6cc1ad tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.059659 Oct 05 17:39:15.551189 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 918/1925] 10.222.0.70 () {60 vars in 1184 bytes} [Wed Oct 5 17:39:15 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:15.564602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ffb236e-4514-492f-ad19-47445249e236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:15.572618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0ffb236e-4514-492f-ad19-47445249e236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:15.593042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ffb236e-4514-492f-ad19-47445249e236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:15.596699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ffb236e-4514-492f-ad19-47445249e236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:15.601479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ffb236e-4514-492f-ad19-47445249e236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:15.605460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ffb236e-4514-492f-ad19-47445249e236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:15.606559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ffb236e-4514-492f-ad19-47445249e236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:15.607236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ffb236e-4514-492f-ad19-47445249e236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:16.162028 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-22227f32-74c6-4ec2-96ba-9b49234f3e54 tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/9c1e4294-2bee-488e-a065-ec2588e7256b" status: 200 len: 141 microversion: 2.1 time: 1.464616 Oct 05 17:39:16.170116 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1008/1926] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:39:14 2022] GET /compute/v2.1/os-floating-ips/9c1e4294-2bee-488e-a065-ec2588e7256b => generated 141 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:16.171515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3a412f5-4d14-473c-ab28-c5dc22e7aa5b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795ab670>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:16.268656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0ffb236e-4514-492f-ad19-47445249e236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:16.279087 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0ffb236e-4514-492f-ad19-47445249e236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.719573 Oct 05 17:39:16.290980 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 919/1927] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:15 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:16.298539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-987afbf8-f3e0-4f0e-b6a5-edc0909a7fc1 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f77795e31f0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:16.811515 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-987afbf8-f3e0-4f0e-b6a5-edc0909a7fc1 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/b053bcf4-17fd-4115-8e9e-2b271a1c2c3a" status: 202 len: 0 microversion: 2.1 time: 0.516660 Oct 05 17:39:16.815196 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 920/1928] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:39:16 2022] DELETE /compute/v2.1/os-security-groups/b053bcf4-17fd-4115-8e9e-2b271a1c2c3a => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:16.819937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9ed9e785-9e92-41b4-ba1b-1bbfd3519043 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:16.821375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9ed9e785-9e92-41b4-ba1b-1bbfd3519043 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:16.837546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ed9e785-9e92-41b4-ba1b-1bbfd3519043 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:16.846581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ed9e785-9e92-41b4-ba1b-1bbfd3519043 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:16.847439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ed9e785-9e92-41b4-ba1b-1bbfd3519043 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:16.848469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ed9e785-9e92-41b4-ba1b-1bbfd3519043 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:16.849158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ed9e785-9e92-41b4-ba1b-1bbfd3519043 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:16.850100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ed9e785-9e92-41b4-ba1b-1bbfd3519043 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:17.425427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-9ed9e785-9e92-41b4-ba1b-1bbfd3519043 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] Lazy-loading 'services' on Instance uuid 410bc024-ca08-46da-8f57-0a2b8d440307 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:39:17.529539 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9ed9e785-9e92-41b4-ba1b-1bbfd3519043 tempest-LiveAutoBlockMigrationV225Test-1378572860 tempest-LiveAutoBlockMigrationV225Test-1378572860-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1968 microversion: 2.25 time: 0.701940 Oct 05 17:39:17.532474 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 921/1929] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:16 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1968 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:17.562865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-29bde81d-55c3-433e-8c69-f31b86419d7a req-7014c8fc-d19e-4585-a694-0bd59f4e75bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586258bf-c661-4819-804b-504089c77dc6", "name": "network-vif-plugged", "status": "completed", "tag": "cfd34f5d-5af2-4330-b921-2091d3e274be"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:17.586610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-29bde81d-55c3-433e-8c69-f31b86419d7a req-7014c8fc-d19e-4585-a694-0bd59f4e75bc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:17.587534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-29bde81d-55c3-433e-8c69-f31b86419d7a req-7014c8fc-d19e-4585-a694-0bd59f4e75bc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:17.588075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-29bde81d-55c3-433e-8c69-f31b86419d7a req-7014c8fc-d19e-4585-a694-0bd59f4e75bc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:17.609066 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-29bde81d-55c3-433e-8c69-f31b86419d7a req-7014c8fc-d19e-4585-a694-0bd59f4e75bc service nova] Creating event network-vif-plugged:cfd34f5d-5af2-4330-b921-2091d3e274be for instance 586258bf-c661-4819-804b-504089c77dc6 on n-h2-835595-3 Oct 05 17:39:17.622612 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-29bde81d-55c3-433e-8c69-f31b86419d7a req-7014c8fc-d19e-4585-a694-0bd59f4e75bc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086339 Oct 05 17:39:17.623767 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 922/1930] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:17.631983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b26835ba-d5fc-49be-ad10-080c5bc7fc7f tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Calling method '.version_select at 0x7f777966af70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:18.995315 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b26835ba-d5fc-49be-ad10-080c5bc7fc7f tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/9c1e4294-2bee-488e-a065-ec2588e7256b" status: 202 len: 0 microversion: 2.1 time: 1.368748 Oct 05 17:39:18.995945 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 923/1931] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:39:17 2022] DELETE /compute/v2.1/os-floating-ips/9c1e4294-2bee-488e-a065-ec2588e7256b => generated 0 bytes in 1372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:19.001520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e77f32d-24d6-4554-a442-b57e2d78ae59 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f77795dbb80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:19.400042 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e77f32d-24d6-4554-a442-b57e2d78ae59 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/c66efe22-3a9b-4498-88bf-dcc35957e5ea" status: 202 len: 0 microversion: 2.1 time: 0.402889 Oct 05 17:39:19.400756 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 924/1932] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:39:18 2022] DELETE /compute/v2.1/os-security-groups/c66efe22-3a9b-4498-88bf-dcc35957e5ea => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:19.408694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-81972ee3-52c5-4962-8c72-cc61ffafe353 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:19.409578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-81972ee3-52c5-4962-8c72-cc61ffafe353 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:19.424722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81972ee3-52c5-4962-8c72-cc61ffafe353 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:19.426801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81972ee3-52c5-4962-8c72-cc61ffafe353 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:19.428185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81972ee3-52c5-4962-8c72-cc61ffafe353 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:19.430522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81972ee3-52c5-4962-8c72-cc61ffafe353 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:19.431062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81972ee3-52c5-4962-8c72-cc61ffafe353 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:19.440051 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3a412f5-4d14-473c-ab28-c5dc22e7aa5b tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 200 len: 1430 microversion: 2.1 time: 3.274270 Oct 05 17:39:19.441437 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1009/1933] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:16 2022] GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 1430 bytes in 3276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:19.447007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81972ee3-52c5-4962-8c72-cc61ffafe353 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:19.455365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:19.461677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:19.463018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Searching by: {'deleted': False, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:39:19.469354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:19.470136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:19.470636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:19.471535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:19.471993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:19.472603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:19.570314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:39:19.657172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-81972ee3-52c5-4962-8c72-cc61ffafe353 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:19.664288 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a2c143e2-02bb-4dcc-8027-2e4e058d81b3 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.212639 Oct 05 17:39:19.664885 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1010/1934] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:39:19 2022] GET /compute/v2.1/servers => generated 340 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:19.667097 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-81972ee3-52c5-4962-8c72-cc61ffafe353 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.261204 Oct 05 17:39:19.670185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4646c837-66aa-4f51-8bdd-680ca4d70cbc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:19.672637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4646c837-66aa-4f51-8bdd-680ca4d70cbc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:19.681647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4646c837-66aa-4f51-8bdd-680ca4d70cbc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:19.682407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4646c837-66aa-4f51-8bdd-680ca4d70cbc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:19.683729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4646c837-66aa-4f51-8bdd-680ca4d70cbc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:19.684674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4646c837-66aa-4f51-8bdd-680ca4d70cbc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:19.684815 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 925/1935] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:19 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:19.685448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4646c837-66aa-4f51-8bdd-680ca4d70cbc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:19.686696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4646c837-66aa-4f51-8bdd-680ca4d70cbc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:19.689821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-404065ed-4b35-4432-b0cc-4d4159fa29b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:19.692157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-404065ed-4b35-4432-b0cc-4d4159fa29b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:19.699231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-404065ed-4b35-4432-b0cc-4d4159fa29b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:19.700774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-404065ed-4b35-4432-b0cc-4d4159fa29b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:19.701381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-404065ed-4b35-4432-b0cc-4d4159fa29b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:19.702256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-404065ed-4b35-4432-b0cc-4d4159fa29b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:19.703215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-404065ed-4b35-4432-b0cc-4d4159fa29b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:19.703813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-404065ed-4b35-4432-b0cc-4d4159fa29b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:19.718602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4646c837-66aa-4f51-8bdd-680ca4d70cbc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:39:19.764096 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-404065ed-4b35-4432-b0cc-4d4159fa29b8 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078036 Oct 05 17:39:19.764762 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 926/1936] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:39:19 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:39:19.770510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-14da6eaf-9d90-4b04-9712-3adefcfc8b3d tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Calling method '.version_select at 0x7f77795d91f0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:19.847265 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4646c837-66aa-4f51-8bdd-680ca4d70cbc tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "DELETE /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 204 len: 0 microversion: 2.25 time: 0.176288 Oct 05 17:39:19.848432 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1011/1937] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:39:19 2022] DELETE /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:39:19.863794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-18479cb1-dbce-4160-a3c5-6c9bc5a09781 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] Calling method '.version_select at 0x7f7779537dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:20.161829 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-14da6eaf-9d90-4b04-9712-3adefcfc8b3d tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.395984 Oct 05 17:39:20.162475 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 927/1938] 10.222.0.70 () {58 vars in 1164 bytes} [Wed Oct 5 17:39:19 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:39:20.167264 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-18479cb1-dbce-4160-a3c5-6c9bc5a09781 tempest-SecurityGroupRulesTestJSON-503514378 tempest-SecurityGroupRulesTestJSON-503514378-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/cc54c28b-d8f9-4724-bc9d-27bb6d6a18eb" status: 202 len: 0 microversion: 2.1 time: 0.312515 Oct 05 17:39:20.168042 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1012/1939] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:39:19 2022] DELETE /compute/v2.1/os-security-groups/cc54c28b-d8f9-4724-bc9d-27bb6d6a18eb => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:20.174748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dc2bba7a-f455-4847-8cd4-b2cccd4a2271 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795d9670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:20.175161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:20.181437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:20.183874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Searching by: {'deleted': False, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:39:20.214888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:20.218320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:20.231201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:20.234090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:20.234773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:20.237084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:20.293978 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dc2bba7a-f455-4847-8cd4-b2cccd4a2271 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 200 len: 1430 microversion: 2.1 time: 0.123514 Oct 05 17:39:20.295260 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 928/1940] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:20 2022] GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 1430 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:20.301098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:20.301902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:20.315671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:20.316560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:20.317827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:20.318836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:20.319501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:20.321117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:20.326895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:39:20.400625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:20.409505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:20.410422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:20.411154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:20.599846 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7853fb98-931f-4caf-be92-217fdab8f515 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1713 microversion: 2.1 time: 0.430204 Oct 05 17:39:20.601300 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1013/1941] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:39:20 2022] GET /compute/v2.1/servers/detail => generated 1713 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:20.607459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e7cc523-fea8-461f-b057-9310184e0d69 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:20.610259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e7cc523-fea8-461f-b057-9310184e0d69 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:20.621379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:20.631258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:20.633513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e7cc523-fea8-461f-b057-9310184e0d69 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:20.634257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e7cc523-fea8-461f-b057-9310184e0d69 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:20.635679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e7cc523-fea8-461f-b057-9310184e0d69 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:20.637995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e7cc523-fea8-461f-b057-9310184e0d69 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:20.638499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e7cc523-fea8-461f-b057-9310184e0d69 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:20.638949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e7cc523-fea8-461f-b057-9310184e0d69 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:20.641663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:20.643085 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e596f3a1-178c-4de6-a884-764d1442254b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1482 microversion: 2.25 time: 0.346644 Oct 05 17:39:20.643981 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 929/1942] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:20 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1482 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:20.650553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f5f4a95a-625b-4f94-b59c-752ea947101c tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Calling method '.version_select at 0x7f77795d9f70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:20.684568 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e7cc523-fea8-461f-b057-9310184e0d69 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081769 Oct 05 17:39:20.685495 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1014/1943] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:39:20 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:39:20.694952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae46b2aa-2dd8-43ac-88ff-b9cfa0719994 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:20.695884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae46b2aa-2dd8-43ac-88ff-b9cfa0719994 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:20.705075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae46b2aa-2dd8-43ac-88ff-b9cfa0719994 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:20.705075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae46b2aa-2dd8-43ac-88ff-b9cfa0719994 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:20.705505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae46b2aa-2dd8-43ac-88ff-b9cfa0719994 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:20.706273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae46b2aa-2dd8-43ac-88ff-b9cfa0719994 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:20.706861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae46b2aa-2dd8-43ac-88ff-b9cfa0719994 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:20.707382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae46b2aa-2dd8-43ac-88ff-b9cfa0719994 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:21.005534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ae46b2aa-2dd8-43ac-88ff-b9cfa0719994 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:21.018313 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae46b2aa-2dd8-43ac-88ff-b9cfa0719994 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1467 microversion: 2.1 time: 0.322255 Oct 05 17:39:21.031523 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1015/1944] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:20 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1467 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:21.200404 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f5f4a95a-625b-4f94-b59c-752ea947101c tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.555343 Oct 05 17:39:21.209886 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 930/1945] 10.222.0.70 () {58 vars in 1149 bytes} [Wed Oct 5 17:39:20 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:21.213924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b6b1b65c-b37a-4e54-bd73-89ef7f91888d tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:21.228297 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b6b1b65c-b37a-4e54-bd73-89ef7f91888d tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025849 Oct 05 17:39:21.229037 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 931/1946] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:39:21 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:21.239658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d56cc1ac-3196-4218-85a8-7b5d471dd51c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:21.242625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d56cc1ac-3196-4218-85a8-7b5d471dd51c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:21.252448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aaed669e-a178-419b-9ea2-87485f70a167 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Action: 'create', calling method: .version_select at 0x7f7779569dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-567017054", "metadata": {"Type": "work"}}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:21.260234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d56cc1ac-3196-4218-85a8-7b5d471dd51c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:21.261064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d56cc1ac-3196-4218-85a8-7b5d471dd51c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:21.261625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d56cc1ac-3196-4218-85a8-7b5d471dd51c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:21.267120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d56cc1ac-3196-4218-85a8-7b5d471dd51c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:21.267639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d56cc1ac-3196-4218-85a8-7b5d471dd51c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:21.268074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d56cc1ac-3196-4218-85a8-7b5d471dd51c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:21.485550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d56cc1ac-3196-4218-85a8-7b5d471dd51c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:21.497774 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d56cc1ac-3196-4218-85a8-7b5d471dd51c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.264467 Oct 05 17:39:21.498921 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 932/1947] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:21 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:21.510507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b91ffe04-1fd5-45b6-a1b5-3d3fb925e81e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:21.513280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b91ffe04-1fd5-45b6-a1b5-3d3fb925e81e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:21.525902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b91ffe04-1fd5-45b6-a1b5-3d3fb925e81e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:21.526972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b91ffe04-1fd5-45b6-a1b5-3d3fb925e81e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:21.527639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b91ffe04-1fd5-45b6-a1b5-3d3fb925e81e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:21.528382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b91ffe04-1fd5-45b6-a1b5-3d3fb925e81e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:21.528832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b91ffe04-1fd5-45b6-a1b5-3d3fb925e81e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:21.529429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b91ffe04-1fd5-45b6-a1b5-3d3fb925e81e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:21.587481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b91ffe04-1fd5-45b6-a1b5-3d3fb925e81e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:39:21.751804 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b91ffe04-1fd5-45b6-a1b5-3d3fb925e81e tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 204 len: 0 microversion: 2.1 time: 0.250212 Oct 05 17:39:21.754563 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 933/1948] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:39:21 2022] DELETE /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:39:21.782797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1895582f-cf59-4baa-bda5-684a01673fda tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f777613b310>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:21.878823 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1895582f-cf59-4baa-bda5-684a01673fda tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/0510c978-5936-46d4-9cc7-8d23f52ed26e" status: 200 len: 784 microversion: 2.1 time: 0.122326 Oct 05 17:39:21.882435 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 934/1949] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:21 2022] GET /compute/v2.1/images/0510c978-5936-46d4-9cc7-8d23f52ed26e => generated 784 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:21.889241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53f174f1-cd35-40f9-a24a-3a2d66c89a50 tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Calling method '.version_select at 0x7f77795d7a60>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:21.947571 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aaed669e-a178-419b-9ea2-87485f70a167 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.914784 Oct 05 17:39:21.948482 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1016/1950] 10.222.0.70 () {60 vars in 1156 bytes} [Wed Oct 5 17:39:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 916 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 05 17:39:21.960989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-15dcc095-aedf-4bd7-8fc0-7173791037b1 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:21.961931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15dcc095-aedf-4bd7-8fc0-7173791037b1 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:21.972058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15dcc095-aedf-4bd7-8fc0-7173791037b1 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:21.975485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15dcc095-aedf-4bd7-8fc0-7173791037b1 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:21.976150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15dcc095-aedf-4bd7-8fc0-7173791037b1 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:21.977070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15dcc095-aedf-4bd7-8fc0-7173791037b1 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:21.987343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15dcc095-aedf-4bd7-8fc0-7173791037b1 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:21.988090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15dcc095-aedf-4bd7-8fc0-7173791037b1 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:22.068477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15dcc095-aedf-4bd7-8fc0-7173791037b1 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:39:22.263911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:22.324107 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-15dcc095-aedf-4bd7-8fc0-7173791037b1 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 204 len: 0 microversion: 2.1 time: 0.374018 Oct 05 17:39:22.328837 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1017/1951] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:39:21 2022] DELETE /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:39:22.337087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:22.338401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:22.347122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:22.348084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:22.348780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:22.349899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:22.350917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:22.351970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:22.490251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:22.509475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:22.511323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:22.514744 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-98ab1dac-c63c-4c12-9685-9449d9f9b2b0 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1440 microversion: 2.25 time: 0.183370 Oct 05 17:39:22.516345 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1018/1952] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:22 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1440 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:22.521586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ee2a41f-4400-4012-89f6-bc86d8a7046a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:22.522448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1ee2a41f-4400-4012-89f6-bc86d8a7046a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:22.530315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ee2a41f-4400-4012-89f6-bc86d8a7046a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:22.531129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ee2a41f-4400-4012-89f6-bc86d8a7046a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:22.531783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ee2a41f-4400-4012-89f6-bc86d8a7046a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:22.532704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ee2a41f-4400-4012-89f6-bc86d8a7046a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:22.533610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ee2a41f-4400-4012-89f6-bc86d8a7046a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:22.534073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ee2a41f-4400-4012-89f6-bc86d8a7046a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:22.706466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1ee2a41f-4400-4012-89f6-bc86d8a7046a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:22.716136 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1ee2a41f-4400-4012-89f6-bc86d8a7046a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1679 microversion: 2.1 time: 0.198481 Oct 05 17:39:22.717526 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1019/1953] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:22 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:22.727793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b648c9a7-7fd5-4f49-b078-d604be712a16 req-5f333d03-d8aa-4319-91d4-385239001ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "410bc024-ca08-46da-8f57-0a2b8d440307", "name": "network-vif-deleted", "tag": "2f01703e-a65e-4077-8843-eb2be80875d6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:22.753125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b648c9a7-7fd5-4f49-b078-d604be712a16 req-5f333d03-d8aa-4319-91d4-385239001ab7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:22.753694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b648c9a7-7fd5-4f49-b078-d604be712a16 req-5f333d03-d8aa-4319-91d4-385239001ab7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:22.754135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b648c9a7-7fd5-4f49-b078-d604be712a16 req-5f333d03-d8aa-4319-91d4-385239001ab7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:22.782970 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b648c9a7-7fd5-4f49-b078-d604be712a16 req-5f333d03-d8aa-4319-91d4-385239001ab7 service nova] Creating event network-vif-deleted:2f01703e-a65e-4077-8843-eb2be80875d6 for instance 410bc024-ca08-46da-8f57-0a2b8d440307 on n-h1-835595-3 Oct 05 17:39:22.792631 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b648c9a7-7fd5-4f49-b078-d604be712a16 req-5f333d03-d8aa-4319-91d4-385239001ab7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073261 Oct 05 17:39:22.793660 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1020/1954] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:22.802317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-096597b2-7a19-457a-95f3-56b3326d9e1c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:22.821545 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-096597b2-7a19-457a-95f3-56b3326d9e1c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026482 Oct 05 17:39:22.829658 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1021/1955] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:39:22 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:22.837070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c1acf038-1f36-4880-bba0-c85236a316ee tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Calling method '.version_select at 0x7f77795371f0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:22.954298 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c1acf038-1f36-4880-bba0-c85236a316ee tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee" status: 200 len: 352 microversion: 2.1 time: 0.123208 Oct 05 17:39:22.955870 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1022/1956] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:39:22 2022] GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:22.961516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e21d1c2-d6f6-42e6-9bb4-0b5f179b0205 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:22.964864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e21d1c2-d6f6-42e6-9bb4-0b5f179b0205 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:23.017916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21d1c2-d6f6-42e6-9bb4-0b5f179b0205 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:23.019708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21d1c2-d6f6-42e6-9bb4-0b5f179b0205 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:23.025624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21d1c2-d6f6-42e6-9bb4-0b5f179b0205 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:23.027789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21d1c2-d6f6-42e6-9bb4-0b5f179b0205 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:23.029256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21d1c2-d6f6-42e6-9bb4-0b5f179b0205 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:23.030364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21d1c2-d6f6-42e6-9bb4-0b5f179b0205 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:23.472535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e21d1c2-d6f6-42e6-9bb4-0b5f179b0205 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:23.484946 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e21d1c2-d6f6-42e6-9bb4-0b5f179b0205 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1716 microversion: 2.1 time: 0.527691 Oct 05 17:39:23.486195 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1023/1957] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:22 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1716 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:23.496636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e9f7c65e-17d0-4e74-a64f-8d1df573cb6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:23.497089 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53f174f1-cd35-40f9-a24a-3a2d66c89a50 tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/da66d22e-ee77-4718-9601-ea99c73279fe" status: 202 len: 0 microversion: 2.1 time: 1.612034 Oct 05 17:39:23.498338 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 935/1958] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:39:21 2022] DELETE /compute/v2.1/os-floating-ips/da66d22e-ee77-4718-9601-ea99c73279fe => generated 0 bytes in 1615 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:23.504422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8436235-6b1e-492a-ac0e-65acad96f806 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795fb940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:23.509817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e9f7c65e-17d0-4e74-a64f-8d1df573cb6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:23.547628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9f7c65e-17d0-4e74-a64f-8d1df573cb6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:23.548213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9f7c65e-17d0-4e74-a64f-8d1df573cb6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:23.548660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9f7c65e-17d0-4e74-a64f-8d1df573cb6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:23.549401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9f7c65e-17d0-4e74-a64f-8d1df573cb6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:23.549860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9f7c65e-17d0-4e74-a64f-8d1df573cb6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:23.557979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9f7c65e-17d0-4e74-a64f-8d1df573cb6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:24.018136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e9f7c65e-17d0-4e74-a64f-8d1df573cb6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:24.028261 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e9f7c65e-17d0-4e74-a64f-8d1df573cb6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.540282 Oct 05 17:39:24.032981 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1024/1959] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:23 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:24.043826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-66159321-0f1e-4cec-8591-dfbcbb357161 tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Calling method '.version_select at 0x7f77794658b0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:24.710246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8436235-6b1e-492a-ac0e-65acad96f806 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "DELETE /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 204 len: 0 microversion: 2.1 time: 1.210481 Oct 05 17:39:24.715935 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 936/1960] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:23 2022] DELETE /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 0 bytes in 1213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:39:24.722467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:24.723217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:24.740144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:24.740653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:24.742341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:24.744382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:24.744907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:24.746459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:24.891513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:24.911755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:24.922541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:24.928188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:24.929415 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bc3b5724-524a-4b26-b755-af8fa19a18f3 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1265 microversion: 2.25 time: 0.214864 Oct 05 17:39:24.950220 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 937/1961] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:24 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:24.961426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-587dee84-7284-4f12-bc62-dfe5a5bbe4f1 req-c4435d4a-c3e0-463d-b0f9-72049a7569c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67baad57-2eba-46d5-94df-c10ae7590a6a", "name": "network-vif-unplugged", "status": "completed", "tag": "a6701176-0529-4a5b-9027-de7e2d50b2f4"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:24.999974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-587dee84-7284-4f12-bc62-dfe5a5bbe4f1 req-c4435d4a-c3e0-463d-b0f9-72049a7569c5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:25.000746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-587dee84-7284-4f12-bc62-dfe5a5bbe4f1 req-c4435d4a-c3e0-463d-b0f9-72049a7569c5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:25.001382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-587dee84-7284-4f12-bc62-dfe5a5bbe4f1 req-c4435d4a-c3e0-463d-b0f9-72049a7569c5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:25.025700 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-587dee84-7284-4f12-bc62-dfe5a5bbe4f1 req-c4435d4a-c3e0-463d-b0f9-72049a7569c5 service nova] Creating event network-vif-unplugged:a6701176-0529-4a5b-9027-de7e2d50b2f4 for instance 67baad57-2eba-46d5-94df-c10ae7590a6a on n-h1-835595-3 Oct 05 17:39:25.033899 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-587dee84-7284-4f12-bc62-dfe5a5bbe4f1 req-c4435d4a-c3e0-463d-b0f9-72049a7569c5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082084 Oct 05 17:39:25.039102 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 938/1962] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:25.046089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b00bf3a9-0a1f-4d08-bc47-92aaf031241b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:25.047148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b00bf3a9-0a1f-4d08-bc47-92aaf031241b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:25.056082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00bf3a9-0a1f-4d08-bc47-92aaf031241b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:25.056808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00bf3a9-0a1f-4d08-bc47-92aaf031241b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:25.057456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00bf3a9-0a1f-4d08-bc47-92aaf031241b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:25.058738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00bf3a9-0a1f-4d08-bc47-92aaf031241b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:25.060209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00bf3a9-0a1f-4d08-bc47-92aaf031241b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:25.060734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b00bf3a9-0a1f-4d08-bc47-92aaf031241b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:25.623602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b00bf3a9-0a1f-4d08-bc47-92aaf031241b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:25.643748 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b00bf3a9-0a1f-4d08-bc47-92aaf031241b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1679 microversion: 2.1 time: 0.600935 Oct 05 17:39:25.646524 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 939/1963] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:25 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1679 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:25.662954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8f3394be-43e6-4230-97b5-b8414f45b939 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Calling method '.version_select at 0x7f7779647b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:25.789771 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8f3394be-43e6-4230-97b5-b8414f45b939 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee" status: 200 len: 353 microversion: 2.1 time: 0.139245 Oct 05 17:39:25.793166 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 940/1964] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:39:25 2022] GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:25.798340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d3bd4495-3975-49aa-930d-9239b9785b64 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:25.799188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d3bd4495-3975-49aa-930d-9239b9785b64 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:25.817439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3bd4495-3975-49aa-930d-9239b9785b64 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:25.824440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3bd4495-3975-49aa-930d-9239b9785b64 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:25.829127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3bd4495-3975-49aa-930d-9239b9785b64 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:25.830131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3bd4495-3975-49aa-930d-9239b9785b64 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:25.836273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3bd4495-3975-49aa-930d-9239b9785b64 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:25.837377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3bd4495-3975-49aa-930d-9239b9785b64 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:26.290602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d3bd4495-3975-49aa-930d-9239b9785b64 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:26.320867 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d3bd4495-3975-49aa-930d-9239b9785b64 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1716 microversion: 2.1 time: 0.526228 Oct 05 17:39:26.342308 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 941/1965] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:25 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1716 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:26.344165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c605d0ef-17da-4653-831c-74c66c0096f7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77752cd0d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:26.399873 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c605d0ef-17da-4653-831c-74c66c0096f7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] HTTP exception thrown: Image not found. Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c605d0ef-17da-4653-831c-74c66c0096f7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Request method failure captured: Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db HTTP/1.1 Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcENAI4jKJwkB4waua9TYl4nXzXBeZg5tFZG4auzJtY-9IRrGs26r_x4HYPdM2rlCE0TipQdzRsj_fumM1qZUOymeRadidtscElQidsWFtfy3KjX4Omm97cBthcETcj4rRery6_xCiN1LXYPEfxXPXxTDWls7zENpPOKfTp9Gncnn6M Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: e09b9e18087143a6863bd26d55ced3d7 Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesOneServerTestJSON-733592739 Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e09b9e18087143a6863bd26d55ced3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e09b9e18087143a6863bd26d55ced3d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e09b9e18087143a6863bd26d55ced3d7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e09b9e18087143a6863bd26d55ced3d7"}]}] Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesOneServerTestJSON-733592739 Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: e09b9e18087143a6863bd26d55ced3d7 Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-733592739 Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesOneServerTestJSON-733592739-project Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 3f47c095840642cfba9edb55fb8fc656 Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesOneServerTestJSON-733592739-project Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: exception: Image not found. Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db'} Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 17:39:26.402151 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db could not be found. Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:26.409588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c605d0ef-17da-4653-831c-74c66c0096f7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Returning 404 to user: Image not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:39:26.417154 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c605d0ef-17da-4653-831c-74c66c0096f7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 404 len: 62 microversion: 2.1 time: 0.078669 Oct 05 17:39:26.419240 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 942/1966] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:26 2022] GET /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:39:26.434806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25277a85-77fd-4193-a1a1-092aaae440f9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:26.436850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-25277a85-77fd-4193-a1a1-092aaae440f9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:26.464765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25277a85-77fd-4193-a1a1-092aaae440f9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:26.465732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25277a85-77fd-4193-a1a1-092aaae440f9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:26.466772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25277a85-77fd-4193-a1a1-092aaae440f9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:26.471201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25277a85-77fd-4193-a1a1-092aaae440f9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:26.471969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25277a85-77fd-4193-a1a1-092aaae440f9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:26.472623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25277a85-77fd-4193-a1a1-092aaae440f9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:26.634019 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-66159321-0f1e-4cec-8591-dfbcbb357161 tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/24ff55e1-76ab-4989-87b3-700db87a752d" status: 202 len: 0 microversion: 2.1 time: 2.599640 Oct 05 17:39:26.640778 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1025/1967] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:39:24 2022] DELETE /compute/v2.1/os-floating-ips/24ff55e1-76ab-4989-87b3-700db87a752d => generated 0 bytes in 2607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:26.651257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-61c52d58-4696-4f06-a741-a87547e3b024 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Calling method '.version_select at 0x7f7779560820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:26.732308 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-61c52d58-4696-4f06-a741-a87547e3b024 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee" status: 200 len: 353 microversion: 2.1 time: 0.090492 Oct 05 17:39:26.742777 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1026/1968] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:39:26 2022] GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:26.748118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:26.749553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:26.773500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:26.782817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:26.785930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:26.787450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:26.788155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:26.788841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:27.028808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:27.042959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:27.048256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:27.049745 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48695a88-854a-48c5-8299-20605f7f371a tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1265 microversion: 2.25 time: 0.315937 Oct 05 17:39:27.052683 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1027/1969] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:26 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1265 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:27.083463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a844fa0-6892-4cdb-b5c0-402e40d96016 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-455097204"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:27.087237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3a844fa0-6892-4cdb-b5c0-402e40d96016 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:27.107152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a844fa0-6892-4cdb-b5c0-402e40d96016 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:27.108637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a844fa0-6892-4cdb-b5c0-402e40d96016 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:27.110689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a844fa0-6892-4cdb-b5c0-402e40d96016 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:27.113176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a844fa0-6892-4cdb-b5c0-402e40d96016 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:27.114520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a844fa0-6892-4cdb-b5c0-402e40d96016 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:27.117408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a844fa0-6892-4cdb-b5c0-402e40d96016 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:27.455162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-25277a85-77fd-4193-a1a1-092aaae440f9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:27.467626 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-25277a85-77fd-4193-a1a1-092aaae440f9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 1.045077 Oct 05 17:39:27.469781 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 943/1970] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:26 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:27.481800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0698ee2b-a7a5-4afb-9477-505cd410219c tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] Calling method '.version_select at 0x7f77795c9550>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:27.672445 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a844fa0-6892-4cdb-b5c0-402e40d96016 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "POST /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a/action" status: 202 len: 0 microversion: 2.1 time: 0.600120 Oct 05 17:39:27.674125 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1028/1971] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:39:27 2022] POST /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 17:39:27.687038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:27.687709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:27.701800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:27.706342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:27.706992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:27.707836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:27.708377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:27.708816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:27.818379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:27.819751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:27.820201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:27.824872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lazy-loading 'fault' on Instance uuid fb9c26e4-6a60-4b8f-8268-7ec8034ca709 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:39:27.899149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5177f088849043638c7f1f6c9196293a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0fc3993200f84751abc9ed6c79c764cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:27.914622 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aed49aab-da2e-48ef-8001-a1e6fdd7e75b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 200 len: 1330 microversion: 2.1 time: 0.238701 Oct 05 17:39:27.914851 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1029/1972] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:27 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 1330 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:27.931965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e3e37fe-e8e7-4b0a-a89a-a3dca0345975 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Calling method '.version_select at 0x7f777956e940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:28.139612 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e3e37fe-e8e7-4b0a-a89a-a3dca0345975 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee" status: 202 len: 0 microversion: 2.1 time: 0.223719 Oct 05 17:39:28.140199 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1030/1973] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:39:27 2022] DELETE /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:28.147084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-887e00dd-8be8-4cab-ad1e-f3f4dc10db07 req-650ae534-bf7a-409c-a20c-bc3c310584b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9c26e4-6a60-4b8f-8268-7ec8034ca709", "name": "network-vif-deleted", "tag": "e589215e-5a42-4222-bbff-7205d8e11675"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:28.188398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-887e00dd-8be8-4cab-ad1e-f3f4dc10db07 req-650ae534-bf7a-409c-a20c-bc3c310584b1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:28.191392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-887e00dd-8be8-4cab-ad1e-f3f4dc10db07 req-650ae534-bf7a-409c-a20c-bc3c310584b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:28.191858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-887e00dd-8be8-4cab-ad1e-f3f4dc10db07 req-650ae534-bf7a-409c-a20c-bc3c310584b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:28.228918 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-887e00dd-8be8-4cab-ad1e-f3f4dc10db07 req-650ae534-bf7a-409c-a20c-bc3c310584b1 service nova] Creating event network-vif-deleted:e589215e-5a42-4222-bbff-7205d8e11675 for instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 on n-h1-835595-3 Oct 05 17:39:28.235802 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-887e00dd-8be8-4cab-ad1e-f3f4dc10db07 req-650ae534-bf7a-409c-a20c-bc3c310584b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094265 Oct 05 17:39:28.238636 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1031/1974] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:28.250728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-aabe6f7d-10d5-476d-8386-8c2b59f17d3a req-bc3fb9b4-2c6d-417e-b188-5b3626ecd735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9c26e4-6a60-4b8f-8268-7ec8034ca709", "name": "network-vif-unplugged", "status": "completed", "tag": "e589215e-5a42-4222-bbff-7205d8e11675"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:28.270400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aabe6f7d-10d5-476d-8386-8c2b59f17d3a req-bc3fb9b4-2c6d-417e-b188-5b3626ecd735 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:28.270882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aabe6f7d-10d5-476d-8386-8c2b59f17d3a req-bc3fb9b4-2c6d-417e-b188-5b3626ecd735 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:28.271304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aabe6f7d-10d5-476d-8386-8c2b59f17d3a req-bc3fb9b4-2c6d-417e-b188-5b3626ecd735 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:28.312785 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-aabe6f7d-10d5-476d-8386-8c2b59f17d3a req-bc3fb9b4-2c6d-417e-b188-5b3626ecd735 service nova] Creating event network-vif-unplugged:e589215e-5a42-4222-bbff-7205d8e11675 for instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 on n-h1-835595-3 Oct 05 17:39:28.323112 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-aabe6f7d-10d5-476d-8386-8c2b59f17d3a req-bc3fb9b4-2c6d-417e-b188-5b3626ecd735 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082456 Oct 05 17:39:28.323739 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1032/1975] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:28.341736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d1fd16c4-9521-47f3-9e85-ccb67a0af574 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:28.342582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d1fd16c4-9521-47f3-9e85-ccb67a0af574 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:28.357754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1fd16c4-9521-47f3-9e85-ccb67a0af574 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:28.358252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1fd16c4-9521-47f3-9e85-ccb67a0af574 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:28.358706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1fd16c4-9521-47f3-9e85-ccb67a0af574 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:28.359418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1fd16c4-9521-47f3-9e85-ccb67a0af574 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:28.359889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1fd16c4-9521-47f3-9e85-ccb67a0af574 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:28.360293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1fd16c4-9521-47f3-9e85-ccb67a0af574 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:28.555495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d1fd16c4-9521-47f3-9e85-ccb67a0af574 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3d7ffb346645a4be9e09ac320031bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45130e1ffed4fb4a10f5cab79f839c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:28.568218 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d1fd16c4-9521-47f3-9e85-ccb67a0af574 tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 200 len: 1648 microversion: 2.1 time: 0.241681 Oct 05 17:39:28.583499 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1033/1976] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:28 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 1648 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:28.598187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-08e19359-bb03-4cc1-aa71-1b1558bae86e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77751d6dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:28.777294 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-08e19359-bb03-4cc1-aa71-1b1558bae86e tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.192549 Oct 05 17:39:28.793045 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1034/1977] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:28 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:28.811780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:28.819000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:28.843898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:28.849317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:28.850006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:28.855324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:28.859815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:28.860499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:29.091855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:29.101665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:29.103105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:29.104535 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0c1ae8bc-210f-4955-9023-651e98cbafb8 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1265 microversion: 2.25 time: 0.308779 Oct 05 17:39:29.118954 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1035/1978] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:28 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1265 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:29.135774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ce191ff-4659-4a76-81e9-36029e266a56 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Calling method '.version_select at 0x7f7779537040>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:29.259756 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ce191ff-4659-4a76-81e9-36029e266a56 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee" status: 200 len: 352 microversion: 2.1 time: 0.134976 Oct 05 17:39:29.260974 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1036/1979] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:39:29 2022] GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee => generated 352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:29.277198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8fcf03a8-83c6-411c-a84d-595038541bfd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:29.286566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8fcf03a8-83c6-411c-a84d-595038541bfd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:29.307339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fcf03a8-83c6-411c-a84d-595038541bfd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:29.308144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fcf03a8-83c6-411c-a84d-595038541bfd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:29.308755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fcf03a8-83c6-411c-a84d-595038541bfd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:29.309955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fcf03a8-83c6-411c-a84d-595038541bfd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:29.310632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fcf03a8-83c6-411c-a84d-595038541bfd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:29.312221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fcf03a8-83c6-411c-a84d-595038541bfd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:29.602186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8fcf03a8-83c6-411c-a84d-595038541bfd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:29.621563 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8fcf03a8-83c6-411c-a84d-595038541bfd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.357265 Oct 05 17:39:29.622472 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1037/1980] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:29 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:29.639330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:29.640532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:29.654832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:29.655590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:29.658110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:29.660304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:29.663421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:29.665532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:29.728107 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] HTTP exception thrown: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Request method failure captured: Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 HTTP/1.1 Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcCfhA40QUh6FnI6c2IU5z_vsxIz3GiQUnYnmav2Vlzr5p7l6y0GEmI9RtzBeoed3dnoMM9q3K4tVc14WSCNkrevoAoNIJjPgViisJ7aJCjNf9rom-l4BsBop-PVfzTUGuS2Bj63-q4OY6VN3OAZtzsn0G4zQezD-LqsVBNRc7k-s00 Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 0fc3993200f84751abc9ed6c79c764cc Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-442258921 Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0fc3993200f84751abc9ed6c79c764cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fc3993200f84751abc9ed6c79c764cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0fc3993200f84751abc9ed6c79c764cc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fc3993200f84751abc9ed6c79c764cc"}]}] Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-442258921 Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 0fc3993200f84751abc9ed6c79c764cc Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-442258921 Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachSCSIVolumeTestJSON-442258921-project Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 5177f088849043638c7f1f6c9196293a Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-442258921-project Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'fb9c26e4-6a60-4b8f-8268-7ec8034ca709'} Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:29.737107 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:29.742635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:29.742635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:29.742635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:29.742635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:39:29.742635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:39:29.742635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:29.742635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:29.744323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Returning 404 to user: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:39:29.745306 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2055c10-9f2a-4543-aa9d-43e2b0f6c33b tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 404 len: 111 microversion: 2.1 time: 0.121095 Oct 05 17:39:29.746206 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1038/1981] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:29 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:39:29.762951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:29.763574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] [instance: 5532aadd-9b7e-4272-a9c7-974410a0ad38] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:29.781900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:29.782585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:29.782862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:29.783625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:29.783925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:29.784342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:29.820466 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] HTTP exception thrown: Instance 5532aadd-9b7e-4272-a9c7-974410a0ad38 could not be found. Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Request method failure captured: Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 HTTP/1.1 Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcD-Ma_x6S3vPnEOu6wa48c6lP_HQGYs2njmihMuP5vOnEuJAP0du4_U937x4YRXMDIPT0GmlKRe-st_vMHuGbXkxEyVbmPSicCm8D_J1WwMFO5ad2IPfORbV0Z7oW8u4JNdlEkStY0SvQ3gif-Y6Tee4qwyBJezyFg4JbvTyHL7MqM Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: e45130e1ffed4fb4a10f5cab79f839c2 Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestManualDisk-371169108 Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e45130e1ffed4fb4a10f5cab79f839c2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e45130e1ffed4fb4a10f5cab79f839c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e45130e1ffed4fb4a10f5cab79f839c2", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e45130e1ffed4fb4a10f5cab79f839c2"}]}] Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestManualDisk-371169108 Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: e45130e1ffed4fb4a10f5cab79f839c2 Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestManualDisk-371169108 Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestManualDisk-371169108-project Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: ad3d7ffb346645a4be9e09ac320031bd Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestManualDisk-371169108-project Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 5532aadd-9b7e-4272-a9c7-974410a0ad38 could not be found. Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '5532aadd-9b7e-4272-a9c7-974410a0ad38'} Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5532aadd-9b7e-4272-a9c7-974410a0ad38 could not be found. Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5532aadd-9b7e-4272-a9c7-974410a0ad38 could not be found. Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:29.826578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5532aadd-9b7e-4272-a9c7-974410a0ad38 could not be found. Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Returning 404 to user: Instance 5532aadd-9b7e-4272-a9c7-974410a0ad38 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5dd023f6-3707-4eff-8609-b286a29f458a tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38" status: 404 len: 111 microversion: 2.1 time: 0.080246 Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1039/1982] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:29 2022] GET /compute/v2.1/servers/5532aadd-9b7e-4272-a9c7-974410a0ad38 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:39:29.839826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d6d27ec-4375-4066-b088-5d66b244bc1a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '.version_select at 0x7f77751d65e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:29.875555 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9d6d27ec-4375-4066-b088-5d66b244bc1a tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-904172646" status: 202 len: 0 microversion: 2.1 time: 0.044890 Oct 05 17:39:29.880091 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1040/1983] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 17:39:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-904172646 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:29.886076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ecf1bf09-5840-433a-bea9-293d26975549 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77793f9940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:29.980119 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ecf1bf09-5840-433a-bea9-293d26975549 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.098391 Oct 05 17:39:29.981094 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1041/1984] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:29 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:29.994899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e7fe351f-6f08-42e1-afb9-c9b57a6b70fe tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] Calling method '.version_select at 0x7f777956e280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:30.021521 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e7fe351f-6f08-42e1-afb9-c9b57a6b70fe tempest-ServersTestManualDisk-371169108 tempest-ServersTestManualDisk-371169108-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971092793" status: 202 len: 0 microversion: 2.1 time: 0.029966 Oct 05 17:39:30.028909 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1042/1985] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 17:39:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1971092793 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:30.146620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:30.147242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:30.157478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:30.157983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:30.158459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:30.159170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:30.159626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:30.160044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:30.273805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:30.391975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:30.419475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:30.436650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:30.445094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:30.455154 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-895ab37a-f4ac-4a84-bfa0-9135f080511d tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1265 microversion: 2.25 time: 0.313832 Oct 05 17:39:30.455859 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1043/1986] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:30 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:39:30.477483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5f604458-9c56-4d50-85e8-d99514aac5c8 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Calling method '.version_select at 0x7f777956ec10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:30.643807 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5f604458-9c56-4d50-85e8-d99514aac5c8 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee" status: 200 len: 352 microversion: 2.1 time: 0.180986 Oct 05 17:39:30.653080 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1044/1987] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:39:30 2022] GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee => generated 352 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:30.682619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8333d990-4fd8-463b-a04b-d4817ab0e4fd req-30efbd80-c455-48e1-b82f-3ffcd5372026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5532aadd-9b7e-4272-a9c7-974410a0ad38", "name": "network-vif-deleted", "tag": "9d178668-98f3-46ad-bb73-283d8c27f114"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:30.733845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8333d990-4fd8-463b-a04b-d4817ab0e4fd req-30efbd80-c455-48e1-b82f-3ffcd5372026 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:30.736052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8333d990-4fd8-463b-a04b-d4817ab0e4fd req-30efbd80-c455-48e1-b82f-3ffcd5372026 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:30.736845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8333d990-4fd8-463b-a04b-d4817ab0e4fd req-30efbd80-c455-48e1-b82f-3ffcd5372026 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:30.774367 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8333d990-4fd8-463b-a04b-d4817ab0e4fd req-30efbd80-c455-48e1-b82f-3ffcd5372026 service nova] Creating event network-vif-deleted:9d178668-98f3-46ad-bb73-283d8c27f114 for instance 5532aadd-9b7e-4272-a9c7-974410a0ad38 on n-h2-835595-3 Oct 05 17:39:30.792342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8333d990-4fd8-463b-a04b-d4817ab0e4fd req-30efbd80-c455-48e1-b82f-3ffcd5372026 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132321 Oct 05 17:39:30.794143 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1045/1988] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:30.804578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2ab5614-8bfa-4644-956b-b4b81728e3de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:30.806725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b2ab5614-8bfa-4644-956b-b4b81728e3de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:30.822110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ab5614-8bfa-4644-956b-b4b81728e3de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:30.824872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ab5614-8bfa-4644-956b-b4b81728e3de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:30.834939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ab5614-8bfa-4644-956b-b4b81728e3de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:30.835923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ab5614-8bfa-4644-956b-b4b81728e3de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:30.836605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ab5614-8bfa-4644-956b-b4b81728e3de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:30.837414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ab5614-8bfa-4644-956b-b4b81728e3de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:31.370534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b2ab5614-8bfa-4644-956b-b4b81728e3de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:31.394173 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2ab5614-8bfa-4644-956b-b4b81728e3de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.598458 Oct 05 17:39:31.404772 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1046/1989] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:30 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:31.440317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae313973-7266-4121-b723-071aad1ad87c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f7779560a60>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:31.564642 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae313973-7266-4121-b723-071aad1ad87c tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.157710 Oct 05 17:39:31.565584 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1047/1990] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:31 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:31.578959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:31.583285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:31.597970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:31.600411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:31.600886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:31.605782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:31.605782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:31.605782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:31.901373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:31.919558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:31.951975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:31.961015 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0698ee2b-a7a5-4afb-9477-505cd410219c tempest-FloatingIPDetailsTestJSON-69313434 tempest-FloatingIPDetailsTestJSON-69313434-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/e907533b-6559-4591-afa6-1ab53477b2bf" status: 202 len: 0 microversion: 2.1 time: 4.488107 Oct 05 17:39:31.966155 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 944/1991] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:39:27 2022] DELETE /compute/v2.1/os-floating-ips/e907533b-6559-4591-afa6-1ab53477b2bf => generated 0 bytes in 4495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:31.967538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:31.968965 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1e3d0cd0-7dbb-4686-8a17-5e1af6de30a7 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 200 len: 1265 microversion: 2.25 time: 0.400616 Oct 05 17:39:31.969596 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1048/1992] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:31 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:31.972704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1d055c3c-b81b-459c-9103-a3f70efd7179 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Calling method '.version_select at 0x7f77752cd160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:32.095821 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1d055c3c-b81b-459c-9103-a3f70efd7179 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee" status: 200 len: 352 microversion: 2.1 time: 0.128242 Oct 05 17:39:32.097024 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 945/1993] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:39:31 2022] GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:32.431822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-451b4b8b-ff22-4f3d-8890-1c9ad2e020a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:32.432444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-451b4b8b-ff22-4f3d-8890-1c9ad2e020a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:32.439423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451b4b8b-ff22-4f3d-8890-1c9ad2e020a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:32.439915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451b4b8b-ff22-4f3d-8890-1c9ad2e020a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:32.440350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451b4b8b-ff22-4f3d-8890-1c9ad2e020a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:32.455612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451b4b8b-ff22-4f3d-8890-1c9ad2e020a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:32.456057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451b4b8b-ff22-4f3d-8890-1c9ad2e020a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:32.456499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451b4b8b-ff22-4f3d-8890-1c9ad2e020a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:32.582555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-559c1352-70b6-4d51-b22f-dfe31ebc395a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795c9c10>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:33.220544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-451b4b8b-ff22-4f3d-8890-1c9ad2e020a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:33.231819 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-451b4b8b-ff22-4f3d-8890-1c9ad2e020a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.804778 Oct 05 17:39:33.237935 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1049/1994] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:32 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:33.251687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:33.252492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: 410bc024-ca08-46da-8f57-0a2b8d440307] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:33.268366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:33.297015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:33.297399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:33.297839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:33.300555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:33.301057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:33.303583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:33.341703 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] HTTP exception thrown: Instance 410bc024-ca08-46da-8f57-0a2b8d440307 could not be found. Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Request method failure captured: Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 HTTP/1.1 Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPb_SZlciAYQvui2Wk-fFFygBvZTR8V-ZVBYbfzlFjalDkWZied9BOlDdxec9O9HiTOkEi_b0n1trWVE0kP8XRgyolcFwAMcAvblNLoMKCwFkmyq-CZ8JorKNdt4XMsSy36qg1Mhw5_ZSpum0hUahOSA2ei2wh_qJpQpw7-PEEZWou9E Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.25 Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 51a14f79344f4986a6c54001c3d7590c Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/51a14f79344f4986a6c54001c3d7590c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/51a14f79344f4986a6c54001c3d7590c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_51a14f79344f4986a6c54001c3d7590c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/51a14f79344f4986a6c54001c3d7590c"}]}] Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 51a14f79344f4986a6c54001c3d7590c Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-LiveAutoBlockMigrationV225Test-1684665103-project Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 205777d0702b45d1b400045c3a2fd47b Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103-project Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 410bc024-ca08-46da-8f57-0a2b8d440307 could not be found. Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '410bc024-ca08-46da-8f57-0a2b8d440307'} Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 410bc024-ca08-46da-8f57-0a2b8d440307 could not be found. Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 410bc024-ca08-46da-8f57-0a2b8d440307 could not be found. Oct 05 17:39:33.345904 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.351437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:33.351437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.351437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:33.351437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:33.351437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:33.351437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:39:33.351437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:39:33.351437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 410bc024-ca08-46da-8f57-0a2b8d440307 could not be found. Oct 05 17:39:33.351437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.359196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Returning 404 to user: Instance 410bc024-ca08-46da-8f57-0a2b8d440307 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:39:33.360358 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b034852-922d-4fe7-ba92-77a2d85b7d20 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307" status: 404 len: 111 microversion: 2.25 time: 0.121134 Oct 05 17:39:33.361793 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1050/1995] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:33 2022] GET /compute/v2.1/servers/410bc024-ca08-46da-8f57-0a2b8d440307 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:39:33.383337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5e2c136-b1b3-45ae-8c2b-9315be59ee05 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Calling method '.version_select at 0x7f77795729d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:33.437770 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d5e2c136-b1b3-45ae-8c2b-9315be59ee05 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] HTTP exception thrown: Volume f1ee37af-cff5-4de7-90aa-06bdf2ab19ee could not be found. Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5e2c136-b1b3-45ae-8c2b-9315be59ee05 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Request method failure captured: Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee HTTP/1.1 Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcFIkKCJ5lh9oO_1vxFv_dLsgLV1dj8kNYULCli0sqF5zjmh-ZqVUIPhTImkSCHOpWfOPYK0SPXpbuqGPkYGnDrdZwBmfSM0v4mzTlQ_xVI_txHmHsmcqJj7hFXcnMDHW2RXaSV0wDYb-T13s-ydGdvCqt8CZ_iv0C7ARitvFmtpPeA Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 96d10203c4b544269c50f1dcf3b3b186 Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesGetTestJSON-1351147314 Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/96d10203c4b544269c50f1dcf3b3b186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96d10203c4b544269c50f1dcf3b3b186"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_96d10203c4b544269c50f1dcf3b3b186", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/96d10203c4b544269c50f1dcf3b3b186"}]}] Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesGetTestJSON-1351147314 Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 96d10203c4b544269c50f1dcf3b3b186 Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesGetTestJSON-1351147314 Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesGetTestJSON-1351147314-project Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 975f339614934d848580330f4aecc689 Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesGetTestJSON-1351147314-project Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: exception: Volume f1ee37af-cff5-4de7-90aa-06bdf2ab19ee could not be found. Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'f1ee37af-cff5-4de7-90aa-06bdf2ab19ee'} Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1ee37af-cff5-4de7-90aa-06bdf2ab19ee could not be found. (HTTP 404) (Request-ID: req-c1aba3d3-c7ab-46b9-b987-72bf31698131) Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 17:39:33.439613 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1ee37af-cff5-4de7-90aa-06bdf2ab19ee could not be found. Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1ee37af-cff5-4de7-90aa-06bdf2ab19ee could not be found. Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1ee37af-cff5-4de7-90aa-06bdf2ab19ee could not be found. Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5e2c136-b1b3-45ae-8c2b-9315be59ee05 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] Returning 404 to user: Volume f1ee37af-cff5-4de7-90aa-06bdf2ab19ee could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d5e2c136-b1b3-45ae-8c2b-9315be59ee05 tempest-VolumesGetTestJSON-1351147314 tempest-VolumesGetTestJSON-1351147314-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee" status: 404 len: 109 microversion: 2.1 time: 0.077746 Oct 05 17:39:33.445000 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1051/1996] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:39:33 2022] GET /compute/v2.1/os-volumes/f1ee37af-cff5-4de7-90aa-06bdf2ab19ee => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:39:34.211111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-dfa5538d-fe47-4828-b1f8-57f156bcc8aa req-da75d740-a102-4196-adfe-0e60e6ac5e78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67baad57-2eba-46d5-94df-c10ae7590a6a", "name": "network-vif-plugged", "status": "completed", "tag": "a6701176-0529-4a5b-9027-de7e2d50b2f4"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:34.239872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dfa5538d-fe47-4828-b1f8-57f156bcc8aa req-da75d740-a102-4196-adfe-0e60e6ac5e78 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:34.244293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dfa5538d-fe47-4828-b1f8-57f156bcc8aa req-da75d740-a102-4196-adfe-0e60e6ac5e78 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:34.245227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dfa5538d-fe47-4828-b1f8-57f156bcc8aa req-da75d740-a102-4196-adfe-0e60e6ac5e78 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:34.288678 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-dfa5538d-fe47-4828-b1f8-57f156bcc8aa req-da75d740-a102-4196-adfe-0e60e6ac5e78 service nova] Creating event network-vif-plugged:a6701176-0529-4a5b-9027-de7e2d50b2f4 for instance 67baad57-2eba-46d5-94df-c10ae7590a6a on n-h1-835595-3 Oct 05 17:39:34.303410 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-dfa5538d-fe47-4828-b1f8-57f156bcc8aa req-da75d740-a102-4196-adfe-0e60e6ac5e78 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094201 Oct 05 17:39:34.304351 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1052/1997] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:34.313838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-476bd1e2-cc9c-4380-924c-71fdb4596fea tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:34.316550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-476bd1e2-cc9c-4380-924c-71fdb4596fea tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:34.334497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476bd1e2-cc9c-4380-924c-71fdb4596fea tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:34.335225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476bd1e2-cc9c-4380-924c-71fdb4596fea tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:34.335831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476bd1e2-cc9c-4380-924c-71fdb4596fea tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:34.336718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476bd1e2-cc9c-4380-924c-71fdb4596fea tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:34.337341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476bd1e2-cc9c-4380-924c-71fdb4596fea tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:34.337927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476bd1e2-cc9c-4380-924c-71fdb4596fea tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:34.680002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-476bd1e2-cc9c-4380-924c-71fdb4596fea tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:34.688418 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-476bd1e2-cc9c-4380-924c-71fdb4596fea tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.382652 Oct 05 17:39:34.696316 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1053/1998] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:34 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:35.727330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3960d0e7-1840-46cc-9685-acaaafdc12b0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:35.728589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3960d0e7-1840-46cc-9685-acaaafdc12b0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:35.739573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3960d0e7-1840-46cc-9685-acaaafdc12b0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:35.745928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3960d0e7-1840-46cc-9685-acaaafdc12b0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:35.747082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3960d0e7-1840-46cc-9685-acaaafdc12b0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:35.749981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3960d0e7-1840-46cc-9685-acaaafdc12b0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:35.751978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3960d0e7-1840-46cc-9685-acaaafdc12b0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:35.752706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3960d0e7-1840-46cc-9685-acaaafdc12b0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:36.180533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3960d0e7-1840-46cc-9685-acaaafdc12b0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:36.192243 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3960d0e7-1840-46cc-9685-acaaafdc12b0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.468745 Oct 05 17:39:36.193567 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1054/1999] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:35 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:39:36.464620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:37.217039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d2ea177e-39ed-4b7c-b54a-f3754fc38620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:37.218513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d2ea177e-39ed-4b7c-b54a-f3754fc38620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:37.227624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2ea177e-39ed-4b7c-b54a-f3754fc38620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:37.228386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2ea177e-39ed-4b7c-b54a-f3754fc38620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:37.234078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2ea177e-39ed-4b7c-b54a-f3754fc38620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:37.234078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2ea177e-39ed-4b7c-b54a-f3754fc38620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:37.234078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2ea177e-39ed-4b7c-b54a-f3754fc38620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:37.234078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2ea177e-39ed-4b7c-b54a-f3754fc38620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:37.487267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=21 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:37.610560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d2ea177e-39ed-4b7c-b54a-f3754fc38620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:37.618829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d2ea177e-39ed-4b7c-b54a-f3754fc38620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.405697 Oct 05 17:39:37.630734 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1055/2000] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:37 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:38.645035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f811a7a-9521-4bee-bda5-c2ccb39ef172 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:38.646540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f811a7a-9521-4bee-bda5-c2ccb39ef172 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:38.675761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f811a7a-9521-4bee-bda5-c2ccb39ef172 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:38.678396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f811a7a-9521-4bee-bda5-c2ccb39ef172 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:38.679053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f811a7a-9521-4bee-bda5-c2ccb39ef172 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:38.679969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f811a7a-9521-4bee-bda5-c2ccb39ef172 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:38.683030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f811a7a-9521-4bee-bda5-c2ccb39ef172 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:38.683690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f811a7a-9521-4bee-bda5-c2ccb39ef172 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:39.033959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f811a7a-9521-4bee-bda5-c2ccb39ef172 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:39.053010 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f811a7a-9521-4bee-bda5-c2ccb39ef172 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.411643 Oct 05 17:39:39.055352 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1056/2001] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:38 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:39.651095 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-559c1352-70b6-4d51-b22f-dfe31ebc395a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 7.074072 Oct 05 17:39:39.651993 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 946/2002] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:32 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 7076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:40.081859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ca57302-9091-46fa-9747-f2acf4b8b806 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:40.083406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8ca57302-9091-46fa-9747-f2acf4b8b806 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:40.098057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca57302-9091-46fa-9747-f2acf4b8b806 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:40.098582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca57302-9091-46fa-9747-f2acf4b8b806 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:40.099020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca57302-9091-46fa-9747-f2acf4b8b806 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:40.099734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca57302-9091-46fa-9747-f2acf4b8b806 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:40.100196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca57302-9091-46fa-9747-f2acf4b8b806 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:40.100619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca57302-9091-46fa-9747-f2acf4b8b806 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:40.459550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8ca57302-9091-46fa-9747-f2acf4b8b806 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:40.473706 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8ca57302-9091-46fa-9747-f2acf4b8b806 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 0.393754 Oct 05 17:39:40.475908 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1057/2003] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:40 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:40.674915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48e392e0-7fbe-4a96-af3a-cf7011057100 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795e3e50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:41.271237 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48e392e0-7fbe-4a96-af3a-cf7011057100 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.608541 Oct 05 17:39:41.281376 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 947/2004] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:40 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:41.548242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f89f3764-a694-4940-b9da-4b0261624492 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:41.549582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f89f3764-a694-4940-b9da-4b0261624492 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:41.563946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f89f3764-a694-4940-b9da-4b0261624492 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:41.581349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f89f3764-a694-4940-b9da-4b0261624492 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:41.581879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f89f3764-a694-4940-b9da-4b0261624492 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:41.587626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f89f3764-a694-4940-b9da-4b0261624492 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:41.588555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f89f3764-a694-4940-b9da-4b0261624492 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:41.591577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f89f3764-a694-4940-b9da-4b0261624492 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:42.291181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-12718c8e-7181-45d9-a4fe-9be1f8c31fb7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f7779647e50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:42.548599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f89f3764-a694-4940-b9da-4b0261624492 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:42.561002 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f89f3764-a694-4940-b9da-4b0261624492 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1681 microversion: 2.1 time: 1.014839 Oct 05 17:39:42.561662 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1058/2005] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:41 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1681 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:42.842813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8a851c6a-4fea-4f4b-8d48-398fed0e7ade tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:42.843306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8a851c6a-4fea-4f4b-8d48-398fed0e7ade tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:42.876492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a851c6a-4fea-4f4b-8d48-398fed0e7ade tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:42.877034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a851c6a-4fea-4f4b-8d48-398fed0e7ade tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:42.877939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a851c6a-4fea-4f4b-8d48-398fed0e7ade tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:42.878215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a851c6a-4fea-4f4b-8d48-398fed0e7ade tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:42.878705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a851c6a-4fea-4f4b-8d48-398fed0e7ade tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:42.879130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a851c6a-4fea-4f4b-8d48-398fed0e7ade tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:43.000489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8a851c6a-4fea-4f4b-8d48-398fed0e7ade tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:39:43.248694 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8a851c6a-4fea-4f4b-8d48-398fed0e7ade tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 204 len: 0 microversion: 2.25 time: 0.412453 Oct 05 17:39:43.249400 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1059/2006] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:39:42 2022] DELETE /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 17:39:43.259002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:43.259707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:43.269829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:43.273218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:43.276240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:43.278065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:43.279962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:43.280842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:43.783302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:43.802802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:43.807413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:43.809140 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f53f27f-0345-45c7-86e3-b2f1d9e121c4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1731 microversion: 2.25 time: 0.554479 Oct 05 17:39:43.813940 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1060/2007] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:43 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1731 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:39:43.831026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-efa7833c-ba55-463a-b698-159a98a44388 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:43.845637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-efa7833c-ba55-463a-b698-159a98a44388 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:43.871419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa7833c-ba55-463a-b698-159a98a44388 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:43.875974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa7833c-ba55-463a-b698-159a98a44388 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:43.878636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa7833c-ba55-463a-b698-159a98a44388 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:43.880238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa7833c-ba55-463a-b698-159a98a44388 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:43.886667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa7833c-ba55-463a-b698-159a98a44388 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:43.887654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa7833c-ba55-463a-b698-159a98a44388 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:43.909526 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-12718c8e-7181-45d9-a4fe-9be1f8c31fb7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 1.625033 Oct 05 17:39:43.918560 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 948/2008] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:42 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:44.844461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:44.845162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:44.863605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:44.874541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:44.877176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:44.887208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:44.887854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:44.888402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:45.600285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-efa7833c-ba55-463a-b698-159a98a44388 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:45.613934 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-efa7833c-ba55-463a-b698-159a98a44388 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 1.790397 Oct 05 17:39:45.626800 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1061/2009] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:43 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:45.639311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13f843f4-57dd-4148-87ba-23f969a40921 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f7779433b80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:45.929145 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13f843f4-57dd-4148-87ba-23f969a40921 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.300347 Oct 05 17:39:45.930193 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1062/2010] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:45 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:45.964489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-37474e48-2593-4219-856b-1cb8e4d6220e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:45.966360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-37474e48-2593-4219-856b-1cb8e4d6220e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:45.995081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37474e48-2593-4219-856b-1cb8e4d6220e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:46.000291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37474e48-2593-4219-856b-1cb8e4d6220e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:46.000798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37474e48-2593-4219-856b-1cb8e4d6220e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:46.001573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37474e48-2593-4219-856b-1cb8e4d6220e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:46.002056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37474e48-2593-4219-856b-1cb8e4d6220e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:46.003154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37474e48-2593-4219-856b-1cb8e4d6220e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:46.367455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:46.377248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:46.378647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:46.395114 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-17917094-7466-47b3-a290-d4a1d8e7a114 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1663 microversion: 2.25 time: 1.539442 Oct 05 17:39:46.406700 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 949/2011] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:44 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1663 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:39:46.947431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-953ec6e7-f6ee-4226-9aeb-346229823c52 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f7779647ee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:47.042206 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-953ec6e7-f6ee-4226-9aeb-346229823c52 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.100317 Oct 05 17:39:47.042942 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 950/2012] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:46 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:47.065284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4b89cbe9-d113-482c-8a20-6b6820ae6159 req-b37b8191-7ed5-4b75-adf5-3d710a281abb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586258bf-c661-4819-804b-504089c77dc6", "name": "network-vif-unplugged", "status": "completed", "tag": "cfd34f5d-5af2-4330-b921-2091d3e274be"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:47.105346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4b89cbe9-d113-482c-8a20-6b6820ae6159 req-b37b8191-7ed5-4b75-adf5-3d710a281abb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:47.106201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4b89cbe9-d113-482c-8a20-6b6820ae6159 req-b37b8191-7ed5-4b75-adf5-3d710a281abb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:47.106336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4b89cbe9-d113-482c-8a20-6b6820ae6159 req-b37b8191-7ed5-4b75-adf5-3d710a281abb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:47.150740 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4b89cbe9-d113-482c-8a20-6b6820ae6159 req-b37b8191-7ed5-4b75-adf5-3d710a281abb service nova] Creating event network-vif-unplugged:cfd34f5d-5af2-4330-b921-2091d3e274be for instance 586258bf-c661-4819-804b-504089c77dc6 on n-h2-835595-3 Oct 05 17:39:47.167664 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4b89cbe9-d113-482c-8a20-6b6820ae6159 req-b37b8191-7ed5-4b75-adf5-3d710a281abb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.113137 Oct 05 17:39:47.173803 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 951/2013] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:47.425685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:47.426361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:47.439355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:47.439858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:47.440300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:47.441024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:47.456318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:47.456783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:48.092091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:48.119487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:48.121110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:48.146364 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-45810e54-a4f8-4424-b15c-b5ca4581dd9c tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 200 len: 1663 microversion: 2.25 time: 0.701097 Oct 05 17:39:48.154362 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 952/2014] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:47 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 1663 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:48.161337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7e4134ed-4cdc-4aef-80ef-b24e3f1d85b8 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795edee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:48.279102 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7e4134ed-4cdc-4aef-80ef-b24e3f1d85b8 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.123177 Oct 05 17:39:48.284504 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 953/2015] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:48 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:48.299396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-450ee413-be3a-45cd-b121-03a29a206f6d req-d04f3a88-47d4-434c-bef3-fd4b133f6e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a63958af-abf6-42db-be31-d666ae842191", "name": "network-vif-deleted", "tag": "341a9f89-e472-44f2-8da1-34fc17c91f7b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:48.312764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-450ee413-be3a-45cd-b121-03a29a206f6d req-d04f3a88-47d4-434c-bef3-fd4b133f6e62 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:48.313560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-450ee413-be3a-45cd-b121-03a29a206f6d req-d04f3a88-47d4-434c-bef3-fd4b133f6e62 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:48.314368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-450ee413-be3a-45cd-b121-03a29a206f6d req-d04f3a88-47d4-434c-bef3-fd4b133f6e62 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:48.328849 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-450ee413-be3a-45cd-b121-03a29a206f6d req-d04f3a88-47d4-434c-bef3-fd4b133f6e62 service nova] Creating event network-vif-deleted:341a9f89-e472-44f2-8da1-34fc17c91f7b for instance a63958af-abf6-42db-be31-d666ae842191 on n-h2-835595-3 Oct 05 17:39:48.335530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-450ee413-be3a-45cd-b121-03a29a206f6d req-d04f3a88-47d4-434c-bef3-fd4b133f6e62 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041026 Oct 05 17:39:48.336472 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 954/2016] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:39:48.601194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-37474e48-2593-4219-856b-1cb8e4d6220e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:48.618664 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-37474e48-2593-4219-856b-1cb8e4d6220e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 2.686675 Oct 05 17:39:48.626176 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1063/2017] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:45 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 2695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:49.176334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:49.177656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: a63958af-abf6-42db-be31-d666ae842191] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:49.203268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:49.205158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:49.208103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:49.214409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:49.223231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:49.224246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:49.300729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bee09819-2622-40a0-a453-95d6959ab6c7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f777941eca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:49.316128 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] HTTP exception thrown: Instance a63958af-abf6-42db-be31-d666ae842191 could not be found. Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Request method failure captured: Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 HTTP/1.1 Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_SZlciAYQvui2Wk-fFFygBvZTR8V-ZVBYbfzlFjalDkWZied9BOlDdxec9O9HiTOkEi_b0n1trWVE0kP8XRgyolcFwAMcAvblNLoMKCwFkmyq-CZ8JorKNdt4XMsSy36qg1Mhw5_ZSpum0hUahOSA2ei2wh_qJpQpw7-PEEZWou9E Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.25 Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 51a14f79344f4986a6c54001c3d7590c Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/51a14f79344f4986a6c54001c3d7590c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/51a14f79344f4986a6c54001c3d7590c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_51a14f79344f4986a6c54001c3d7590c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/51a14f79344f4986a6c54001c3d7590c"}]}] Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 51a14f79344f4986a6c54001c3d7590c Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-LiveAutoBlockMigrationV225Test-1684665103-project Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 205777d0702b45d1b400045c3a2fd47b Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103-project Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a63958af-abf6-42db-be31-d666ae842191 could not be found. Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a63958af-abf6-42db-be31-d666ae842191'} Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a63958af-abf6-42db-be31-d666ae842191 could not be found. Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a63958af-abf6-42db-be31-d666ae842191 could not be found. Oct 05 17:39:49.321184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:49.329006 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:49.329006 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:49.329006 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:49.329006 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:49.329006 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:49.329006 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:39:49.329006 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:39:49.329006 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a63958af-abf6-42db-be31-d666ae842191 could not be found. Oct 05 17:39:49.329006 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:49.338327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Returning 404 to user: Instance a63958af-abf6-42db-be31-d666ae842191 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:39:49.343351 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f552c224-3884-48b6-8b83-18a554e79e21 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191" status: 404 len: 111 microversion: 2.25 time: 0.173938 Oct 05 17:39:49.346707 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 955/2018] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:49 2022] GET /compute/v2.1/servers/a63958af-abf6-42db-be31-d666ae842191 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 05 17:39:49.370897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-321b85f6-da2c-4b5e-bbca-f3741dde0e64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '.version_select at 0x7f7779585af0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:49.440362 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-321b85f6-da2c-4b5e-bbca-f3741dde0e64 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-591109418" status: 204 len: 0 microversion: 2.25 time: 0.085515 Oct 05 17:39:49.453948 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 956/2019] 10.222.0.70 () {60 vars in 1259 bytes} [Wed Oct 5 17:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-591109418 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:39:50.749773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:50.751233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:50.766945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:50.770481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:50.771131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:50.772178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:50.774610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:50.775456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:50.821512 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] HTTP exception thrown: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Request method failure captured: Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 HTTP/1.1 Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcCfhA40QUh6FnI6c2IU5z_vsxIz3GiQUnYnmav2Vlzr5p7l6y0GEmI9RtzBeoed3dnoMM9q3K4tVc14WSCNkrevoAoNIJjPgViisJ7aJCjNf9rom-l4BsBop-PVfzTUGuS2Bj63-q4OY6VN3OAZtzsn0G4zQezD-LqsVBNRc7k-s00 Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 0fc3993200f84751abc9ed6c79c764cc Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-442258921 Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0fc3993200f84751abc9ed6c79c764cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fc3993200f84751abc9ed6c79c764cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0fc3993200f84751abc9ed6c79c764cc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fc3993200f84751abc9ed6c79c764cc"}]}] Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-442258921 Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 0fc3993200f84751abc9ed6c79c764cc Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-442258921 Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachSCSIVolumeTestJSON-442258921-project Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 5177f088849043638c7f1f6c9196293a Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-442258921-project Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'fb9c26e4-6a60-4b8f-8268-7ec8034ca709'} Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:39:50.824612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:50.829929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:50.832178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Returning 404 to user: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:39:50.833657 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c009fbfe-5bc1-4f82-a77a-e6e7159ddec0 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "DELETE /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 404 len: 111 microversion: 2.1 time: 0.094842 Oct 05 17:39:50.834904 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 957/2020] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:39:50 2022] DELETE /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:39:50.844874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:50.845783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] [instance: fb9c26e4-6a60-4b8f-8268-7ec8034ca709] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:50.853755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:50.854935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:50.855677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:50.856625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:50.857295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:50.858002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:50.881685 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] HTTP exception thrown: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Request method failure captured: Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 HTTP/1.1 Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcCfhA40QUh6FnI6c2IU5z_vsxIz3GiQUnYnmav2Vlzr5p7l6y0GEmI9RtzBeoed3dnoMM9q3K4tVc14WSCNkrevoAoNIJjPgViisJ7aJCjNf9rom-l4BsBop-PVfzTUGuS2Bj63-q4OY6VN3OAZtzsn0G4zQezD-LqsVBNRc7k-s00 Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 0fc3993200f84751abc9ed6c79c764cc Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-442258921 Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0fc3993200f84751abc9ed6c79c764cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fc3993200f84751abc9ed6c79c764cc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0fc3993200f84751abc9ed6c79c764cc", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0fc3993200f84751abc9ed6c79c764cc"}]}] Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-442258921 Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 0fc3993200f84751abc9ed6c79c764cc Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-442258921 Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachSCSIVolumeTestJSON-442258921-project Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 5177f088849043638c7f1f6c9196293a Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-442258921-project Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'fb9c26e4-6a60-4b8f-8268-7ec8034ca709'} Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:39:50.884352 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:50.891118 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:39:50.891118 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:39:50.891118 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:39:50.891118 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:39:50.891118 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:39:50.891118 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. Oct 05 17:39:50.891118 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:39:50.893247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] Returning 404 to user: Instance fb9c26e4-6a60-4b8f-8268-7ec8034ca709 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:39:50.894957 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b46093ca-c7d6-4293-9b67-3ae7a2dc4795 tempest-AttachSCSIVolumeTestJSON-442258921 tempest-AttachSCSIVolumeTestJSON-442258921-project] 10.222.0.70 "GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709" status: 404 len: 111 microversion: 2.1 time: 0.055538 Oct 05 17:39:50.896098 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 958/2021] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:50 2022] GET /compute/v2.1/servers/fb9c26e4-6a60-4b8f-8268-7ec8034ca709 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:39:52.879907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8f14e37a-e5ab-42f7-b192-069055ecd98e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:52.880681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8f14e37a-e5ab-42f7-b192-069055ecd98e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:52.881703 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bee09819-2622-40a0-a453-95d6959ab6c7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 3.584203 Oct 05 17:39:52.882322 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1064/2022] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:49 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 3587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:52.892017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f14e37a-e5ab-42f7-b192-069055ecd98e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:52.898373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f14e37a-e5ab-42f7-b192-069055ecd98e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:52.899182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f14e37a-e5ab-42f7-b192-069055ecd98e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:52.900185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f14e37a-e5ab-42f7-b192-069055ecd98e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:52.901019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f14e37a-e5ab-42f7-b192-069055ecd98e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:52.903532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f14e37a-e5ab-42f7-b192-069055ecd98e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:53.905048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d27ae26a-4aed-4850-a5ec-7a7536c7313a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f777941e9d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:53.996044 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d27ae26a-4aed-4850-a5ec-7a7536c7313a tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.102573 Oct 05 17:39:54.003564 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1065/2023] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:53 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:54.926361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f14e37a-e5ab-42f7-b192-069055ecd98e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:54.944678 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8f14e37a-e5ab-42f7-b192-069055ecd98e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 2.063459 Oct 05 17:39:54.945341 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 959/2024] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:52 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 2070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:39:54.972620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-96f2ba46-fe5a-49d4-b21e-012cc1f9e3e5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:54.973241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-96f2ba46-fe5a-49d4-b21e-012cc1f9e3e5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:54.989538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96f2ba46-fe5a-49d4-b21e-012cc1f9e3e5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:54.990186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96f2ba46-fe5a-49d4-b21e-012cc1f9e3e5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:54.990486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96f2ba46-fe5a-49d4-b21e-012cc1f9e3e5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:55.005053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96f2ba46-fe5a-49d4-b21e-012cc1f9e3e5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:55.005617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96f2ba46-fe5a-49d4-b21e-012cc1f9e3e5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:55.011210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-21c894a8-8064-4f77-9511-48cf3fe41094 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:55.012252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-21c894a8-8064-4f77-9511-48cf3fe41094 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:55.017502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96f2ba46-fe5a-49d4-b21e-012cc1f9e3e5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:55.038385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21c894a8-8064-4f77-9511-48cf3fe41094 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:55.038903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21c894a8-8064-4f77-9511-48cf3fe41094 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:55.044693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21c894a8-8064-4f77-9511-48cf3fe41094 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:55.045540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21c894a8-8064-4f77-9511-48cf3fe41094 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:55.046035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21c894a8-8064-4f77-9511-48cf3fe41094 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:55.046508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21c894a8-8064-4f77-9511-48cf3fe41094 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:55.141743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-21c894a8-8064-4f77-9511-48cf3fe41094 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:39:55.406213 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-21c894a8-8064-4f77-9511-48cf3fe41094 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 204 len: 0 microversion: 2.25 time: 0.397317 Oct 05 17:39:55.411230 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 960/2025] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:39:55 2022] DELETE /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:39:55.425508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9ded88a-1654-44a3-bbd2-e3220984a7ed tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795e3ee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:55.557818 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9ded88a-1654-44a3-bbd2-e3220984a7ed tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.143476 Oct 05 17:39:55.567396 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 961/2026] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:55 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:55.579172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:55.579959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:55.601289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:55.601892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:55.603906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:55.606446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:55.608180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:55.608955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:56.036727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-96f2ba46-fe5a-49d4-b21e-012cc1f9e3e5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:56.056800 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-96f2ba46-fe5a-49d4-b21e-012cc1f9e3e5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 1.090783 Oct 05 17:39:56.077151 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1066/2027] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:54 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:56.099437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-93fdee73-410a-48c7-a49e-b7468819d318 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:56.100076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-93fdee73-410a-48c7-a49e-b7468819d318 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:56.115333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93fdee73-410a-48c7-a49e-b7468819d318 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:56.115785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93fdee73-410a-48c7-a49e-b7468819d318 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:56.116397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93fdee73-410a-48c7-a49e-b7468819d318 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:56.116948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93fdee73-410a-48c7-a49e-b7468819d318 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:56.117400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93fdee73-410a-48c7-a49e-b7468819d318 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:56.117824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93fdee73-410a-48c7-a49e-b7468819d318 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:56.590636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:56.607351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:56.608763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:56.610049 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5048d75c-0f2f-4842-8091-6986261e0eb1 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1548 microversion: 2.25 time: 1.041498 Oct 05 17:39:56.611479 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 962/2028] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:55 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1548 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:56.623593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-36e9af3a-a415-4105-a3c5-96f242147bcb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795ed940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:56.693096 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-36e9af3a-a415-4105-a3c5-96f242147bcb tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.079937 Oct 05 17:39:56.701465 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 963/2029] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:56 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:56.880558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-93fdee73-410a-48c7-a49e-b7468819d318 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:56.889522 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-93fdee73-410a-48c7-a49e-b7468819d318 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.794021 Oct 05 17:39:56.890527 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1067/2030] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:56 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:39:56.918881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ac434272-760e-4a8e-9537-7c0d704d13aa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:39:56.921317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ac434272-760e-4a8e-9537-7c0d704d13aa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:56.945186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac434272-760e-4a8e-9537-7c0d704d13aa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:56.945993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac434272-760e-4a8e-9537-7c0d704d13aa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:56.946729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac434272-760e-4a8e-9537-7c0d704d13aa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:56.947748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac434272-760e-4a8e-9537-7c0d704d13aa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:56.948400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac434272-760e-4a8e-9537-7c0d704d13aa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:56.948982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac434272-760e-4a8e-9537-7c0d704d13aa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:57.135280 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ac434272-760e-4a8e-9537-7c0d704d13aa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.220939 Oct 05 17:39:57.136743 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 964/2031] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:39:56 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:39:57.144308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d20f2006-4419-4bcc-acbf-dbd3ace9375c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:57.145144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d20f2006-4419-4bcc-acbf-dbd3ace9375c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:57.159019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d20f2006-4419-4bcc-acbf-dbd3ace9375c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:57.159512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d20f2006-4419-4bcc-acbf-dbd3ace9375c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:57.159992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d20f2006-4419-4bcc-acbf-dbd3ace9375c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:57.160707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d20f2006-4419-4bcc-acbf-dbd3ace9375c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:57.161554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d20f2006-4419-4bcc-acbf-dbd3ace9375c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:57.161672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d20f2006-4419-4bcc-acbf-dbd3ace9375c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:57.588990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d20f2006-4419-4bcc-acbf-dbd3ace9375c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:57.597577 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d20f2006-4419-4bcc-acbf-dbd3ace9375c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1670 microversion: 2.1 time: 0.457108 Oct 05 17:39:57.598164 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1068/2032] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:57 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1670 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:57.638300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:57.639010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:57.661286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:57.661762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:57.662192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:57.662941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:57.663388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:57.667699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:57.708980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aa8d8e4f-6c58-4ae8-8ba4-a91ec064d987 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77794335e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:57.792852 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aa8d8e4f-6c58-4ae8-8ba4-a91ec064d987 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.087563 Oct 05 17:39:57.793661 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1069/2033] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:57 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:39:58.625705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1960654f-4ec5-47c1-bc19-8e586a5c5512 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:58.626648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1960654f-4ec5-47c1-bc19-8e586a5c5512 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:39:58.644474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1960654f-4ec5-47c1-bc19-8e586a5c5512 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:58.646693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1960654f-4ec5-47c1-bc19-8e586a5c5512 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:58.649079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1960654f-4ec5-47c1-bc19-8e586a5c5512 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:58.650308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1960654f-4ec5-47c1-bc19-8e586a5c5512 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:39:58.654502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1960654f-4ec5-47c1-bc19-8e586a5c5512 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:39:58.655516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1960654f-4ec5-47c1-bc19-8e586a5c5512 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:39:58.761384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:39:58.970967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:58.990086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:58.999802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:59.003872 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a96951d2-e4dc-4d72-b63b-abe850325fca tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1548 microversion: 2.25 time: 1.371282 Oct 05 17:39:59.004526 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 965/2034] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:39:57 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1548 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:39:59.015670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e6dc69c5-fb2f-41a6-a19f-5e9608e0cad9 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795ed3a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:39:59.130166 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e6dc69c5-fb2f-41a6-a19f-5e9608e0cad9 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.123796 Oct 05 17:39:59.135414 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 966/2035] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:39:59 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:39:59.154940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1960654f-4ec5-47c1-bc19-8e586a5c5512 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:39:59.165852 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1960654f-4ec5-47c1-bc19-8e586a5c5512 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1670 microversion: 2.1 time: 0.546464 Oct 05 17:39:59.171015 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1070/2036] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:39:58 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1670 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:00.037478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:00.038414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:00.068181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:00.069230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:00.069925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:00.072176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:00.073036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:00.076361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:00.146575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-048bb066-fe6b-4e06-8ed6-cf3881c16e5d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77793f95e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:00.271347 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-048bb066-fe6b-4e06-8ed6-cf3881c16e5d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.128945 Oct 05 17:40:00.279965 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1071/2037] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:00 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:00.289447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d4706b21-0c86-4755-9ba3-f423931b7211 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:00.290223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d4706b21-0c86-4755-9ba3-f423931b7211 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:00.298598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4706b21-0c86-4755-9ba3-f423931b7211 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:00.299376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4706b21-0c86-4755-9ba3-f423931b7211 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:00.299812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4706b21-0c86-4755-9ba3-f423931b7211 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:00.300621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4706b21-0c86-4755-9ba3-f423931b7211 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:00.301085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4706b21-0c86-4755-9ba3-f423931b7211 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:00.301512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4706b21-0c86-4755-9ba3-f423931b7211 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:00.550721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:00.565214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:00.567546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:00.582404 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ec9fa54b-b346-4e2a-9503-30e8838e8639 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 200 len: 1506 microversion: 2.25 time: 0.539473 Oct 05 17:40:00.605198 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 967/2038] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:40:00 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 1506 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:40:00.619704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-813425e8-ba34-41a2-99d5-51e26a1c55df req-3b2ef999-b758-4b86-84f8-9d0b4062cecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebc39da4-3415-41c0-9552-de49d599f894", "name": "network-vif-deleted", "tag": "4c8c6427-bd57-44ed-aa04-e2b51f49ce09"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:00.651753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d4706b21-0c86-4755-9ba3-f423931b7211 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:00.659681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-813425e8-ba34-41a2-99d5-51e26a1c55df req-3b2ef999-b758-4b86-84f8-9d0b4062cecd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:00.660180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-813425e8-ba34-41a2-99d5-51e26a1c55df req-3b2ef999-b758-4b86-84f8-9d0b4062cecd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:00.662100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-813425e8-ba34-41a2-99d5-51e26a1c55df req-3b2ef999-b758-4b86-84f8-9d0b4062cecd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:00.671207 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d4706b21-0c86-4755-9ba3-f423931b7211 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1670 microversion: 2.1 time: 0.392185 Oct 05 17:40:00.673542 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1072/2039] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:00 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1670 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:00.719609 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-813425e8-ba34-41a2-99d5-51e26a1c55df req-3b2ef999-b758-4b86-84f8-9d0b4062cecd service nova] Creating event network-vif-deleted:4c8c6427-bd57-44ed-aa04-e2b51f49ce09 for instance ebc39da4-3415-41c0-9552-de49d599f894 on n-h1-835595-3 Oct 05 17:40:00.727030 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-813425e8-ba34-41a2-99d5-51e26a1c55df req-3b2ef999-b758-4b86-84f8-9d0b4062cecd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118170 Oct 05 17:40:00.728299 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 968/2040] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:01.287258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9fe5256-8e5d-4a3b-bfaa-1259d094da50 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77793fcf70>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:01.379893 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9fe5256-8e5d-4a3b-bfaa-1259d094da50 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.095237 Oct 05 17:40:01.388280 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1073/2041] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:01 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:01.616010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:01.616873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: ebc39da4-3415-41c0-9552-de49d599f894] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:01.642994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:01.644419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:01.654226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:01.655926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:01.660973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:01.660973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:01.705219 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] HTTP exception thrown: Instance ebc39da4-3415-41c0-9552-de49d599f894 could not be found. Oct 05 17:40:01.706510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-be627a9d-c08c-48c8-8d36-7910a36fb136 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:01.707288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-be627a9d-c08c-48c8-8d36-7910a36fb136 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Request method failure captured: Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 HTTP/1.1 Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_SZlciAYQvui2Wk-fFFygBvZTR8V-ZVBYbfzlFjalDkWZied9BOlDdxec9O9HiTOkEi_b0n1trWVE0kP8XRgyolcFwAMcAvblNLoMKCwFkmyq-CZ8JorKNdt4XMsSy36qg1Mhw5_ZSpum0hUahOSA2ei2wh_qJpQpw7-PEEZWou9E Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.25 Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 51a14f79344f4986a6c54001c3d7590c Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/51a14f79344f4986a6c54001c3d7590c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/51a14f79344f4986a6c54001c3d7590c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_51a14f79344f4986a6c54001c3d7590c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/51a14f79344f4986a6c54001c3d7590c"}]}] Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 51a14f79344f4986a6c54001c3d7590c Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-LiveAutoBlockMigrationV225Test-1684665103-project Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 205777d0702b45d1b400045c3a2fd47b Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103-project Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance ebc39da4-3415-41c0-9552-de49d599f894 could not be found. Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'ebc39da4-3415-41c0-9552-de49d599f894'} Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebc39da4-3415-41c0-9552-de49d599f894 could not be found. Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebc39da4-3415-41c0-9552-de49d599f894 could not be found. Oct 05 17:40:01.710238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:40:01.716865 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:40:01.716865 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:40:01.716865 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:01.716865 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:40:01.716865 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:40:01.716865 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:40:01.716865 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:40:01.716865 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebc39da4-3415-41c0-9552-de49d599f894 could not be found. Oct 05 17:40:01.716865 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:40:01.719747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Returning 404 to user: Instance ebc39da4-3415-41c0-9552-de49d599f894 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:40:01.720045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be627a9d-c08c-48c8-8d36-7910a36fb136 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:01.722249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be627a9d-c08c-48c8-8d36-7910a36fb136 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:01.722736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be627a9d-c08c-48c8-8d36-7910a36fb136 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:01.723467 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e6150fd-1055-4193-94b3-1bd45ef3e858 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894" status: 404 len: 111 microversion: 2.25 time: 0.117070 Oct 05 17:40:01.723624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be627a9d-c08c-48c8-8d36-7910a36fb136 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:01.723956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be627a9d-c08c-48c8-8d36-7910a36fb136 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:01.724384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be627a9d-c08c-48c8-8d36-7910a36fb136 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:01.728668 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 969/2042] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:40:01 2022] GET /compute/v2.1/servers/ebc39da4-3415-41c0-9552-de49d599f894 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:40:01.763229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ad1cdc7d-4f6f-4d91-9dd9-769f71dc9585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:01.764268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ad1cdc7d-4f6f-4d91-9dd9-769f71dc9585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:01.806789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1cdc7d-4f6f-4d91-9dd9-769f71dc9585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:01.814378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1cdc7d-4f6f-4d91-9dd9-769f71dc9585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:01.815324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1cdc7d-4f6f-4d91-9dd9-769f71dc9585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:01.817103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1cdc7d-4f6f-4d91-9dd9-769f71dc9585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:01.818334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1cdc7d-4f6f-4d91-9dd9-769f71dc9585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:01.819212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad1cdc7d-4f6f-4d91-9dd9-769f71dc9585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:01.890418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ad1cdc7d-4f6f-4d91-9dd9-769f71dc9585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:40:02.122086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-be627a9d-c08c-48c8-8d36-7910a36fb136 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:02.142979 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-be627a9d-c08c-48c8-8d36-7910a36fb136 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.441628 Oct 05 17:40:02.151014 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1074/2043] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:01 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:02.169942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e82ba32-88af-4844-bec6-76f972fff484 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:02.172994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7e82ba32-88af-4844-bec6-76f972fff484 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:02.180387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e82ba32-88af-4844-bec6-76f972fff484 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:02.181294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e82ba32-88af-4844-bec6-76f972fff484 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:02.182005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e82ba32-88af-4844-bec6-76f972fff484 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:02.183207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e82ba32-88af-4844-bec6-76f972fff484 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:02.184441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e82ba32-88af-4844-bec6-76f972fff484 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:02.185152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e82ba32-88af-4844-bec6-76f972fff484 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:02.198147 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ad1cdc7d-4f6f-4d91-9dd9-769f71dc9585 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 204 len: 0 microversion: 2.25 time: 0.467189 Oct 05 17:40:02.202678 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 970/2044] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:40:01 2022] DELETE /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:40:02.214535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:02.215921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:02.226336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:02.228136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:02.232054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:02.233299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:02.234010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:02.235238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:02.287558 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7e82ba32-88af-4844-bec6-76f972fff484 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 200 len: 322 microversion: 2.1 time: 0.122175 Oct 05 17:40:02.293471 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1075/2045] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:40:02 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 322 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:40:02.304165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5361e830-e25b-4eaa-954a-01ffe9afcd68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:02.307419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5361e830-e25b-4eaa-954a-01ffe9afcd68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:02.327982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5361e830-e25b-4eaa-954a-01ffe9afcd68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:02.330444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5361e830-e25b-4eaa-954a-01ffe9afcd68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:02.330893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5361e830-e25b-4eaa-954a-01ffe9afcd68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:02.337113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5361e830-e25b-4eaa-954a-01ffe9afcd68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:02.337706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5361e830-e25b-4eaa-954a-01ffe9afcd68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:02.338816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5361e830-e25b-4eaa-954a-01ffe9afcd68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:02.610903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:02.616968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:02.649916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:02.654716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:02.657536 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-11be9b27-f3a0-407c-a8eb-68b684520a5b tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1562 microversion: 2.25 time: 0.449342 Oct 05 17:40:02.660481 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 971/2046] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:40:02 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1562 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:40:02.683910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-36475a7b-9eed-4a15-93d3-3de32d60df43 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795d93a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:02.818721 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-36475a7b-9eed-4a15-93d3-3de32d60df43 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.156784 Oct 05 17:40:02.820878 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 972/2047] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:02 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:02.964477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5361e830-e25b-4eaa-954a-01ffe9afcd68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:02.977559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5361e830-e25b-4eaa-954a-01ffe9afcd68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.674657 Oct 05 17:40:02.979977 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1076/2048] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:02 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:03.009774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3cfb09d8-10fe-4b93-972d-4049162d2192 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:03.010847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3cfb09d8-10fe-4b93-972d-4049162d2192 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:03.017925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cfb09d8-10fe-4b93-972d-4049162d2192 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:03.018832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cfb09d8-10fe-4b93-972d-4049162d2192 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:03.019522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cfb09d8-10fe-4b93-972d-4049162d2192 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:03.020628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cfb09d8-10fe-4b93-972d-4049162d2192 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:03.021304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cfb09d8-10fe-4b93-972d-4049162d2192 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:03.021951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cfb09d8-10fe-4b93-972d-4049162d2192 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:03.689150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:03.691126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:03.713022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:03.717083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:03.720417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:03.729200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:03.730931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:03.733021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:03.734791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:03.751006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3cfb09d8-10fe-4b93-972d-4049162d2192 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:03.786497 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3cfb09d8-10fe-4b93-972d-4049162d2192 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.778566 Oct 05 17:40:03.787180 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 973/2049] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:03 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:03.814678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-992c38b0-0593-4b89-9a0c-4e909c317ecb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:03.815346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-992c38b0-0593-4b89-9a0c-4e909c317ecb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:03.848404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992c38b0-0593-4b89-9a0c-4e909c317ecb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:03.848923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992c38b0-0593-4b89-9a0c-4e909c317ecb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:03.849522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992c38b0-0593-4b89-9a0c-4e909c317ecb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:03.850308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992c38b0-0593-4b89-9a0c-4e909c317ecb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:03.850769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992c38b0-0593-4b89-9a0c-4e909c317ecb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:03.851203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992c38b0-0593-4b89-9a0c-4e909c317ecb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:04.311347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-992c38b0-0593-4b89-9a0c-4e909c317ecb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:04.334674 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-992c38b0-0593-4b89-9a0c-4e909c317ecb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.523200 Oct 05 17:40:04.335303 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 974/2050] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:03 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:04.378003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dbbcd77c-8e09-4e85-94c9-085b89e67bf1 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795ed0d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:04.497392 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dbbcd77c-8e09-4e85-94c9-085b89e67bf1 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1426 microversion: 2.1 time: 0.136787 Oct 05 17:40:04.508911 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 975/2051] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:04 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1426 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:04.525335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-93c17487-0e1d-494e-b09c-7b49f3082475 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:04.528319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-93c17487-0e1d-494e-b09c-7b49f3082475 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:04.537821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93c17487-0e1d-494e-b09c-7b49f3082475 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:04.539194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93c17487-0e1d-494e-b09c-7b49f3082475 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:04.540295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93c17487-0e1d-494e-b09c-7b49f3082475 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:04.541467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93c17487-0e1d-494e-b09c-7b49f3082475 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:04.547220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93c17487-0e1d-494e-b09c-7b49f3082475 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:04.548699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93c17487-0e1d-494e-b09c-7b49f3082475 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:04.655262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:04.669936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:04.676752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '205777d0702b45d1b400045c3a2fd47b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51a14f79344f4986a6c54001c3d7590c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:04.680474 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-15b30691-887b-41df-b717-cc36d0cfc7f4 tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 200 len: 1562 microversion: 2.25 time: 0.994152 Oct 05 17:40:04.683519 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1077/2052] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:40:03 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 1562 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:40:04.694455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5fd06820-582c-443b-9c18-15dcd34ce25c req-b4324344-06a2-4ea6-884b-ec63ff1c5156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d655671e-b4fa-4bf6-85b2-5a2d556124a2", "name": "network-vif-deleted", "tag": "d566d38c-8389-4104-8984-f5d607c56fe6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:04.728592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5fd06820-582c-443b-9c18-15dcd34ce25c req-b4324344-06a2-4ea6-884b-ec63ff1c5156 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:04.731345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5fd06820-582c-443b-9c18-15dcd34ce25c req-b4324344-06a2-4ea6-884b-ec63ff1c5156 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:04.732796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5fd06820-582c-443b-9c18-15dcd34ce25c req-b4324344-06a2-4ea6-884b-ec63ff1c5156 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:04.768224 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5fd06820-582c-443b-9c18-15dcd34ce25c req-b4324344-06a2-4ea6-884b-ec63ff1c5156 service nova] Creating event network-vif-deleted:d566d38c-8389-4104-8984-f5d607c56fe6 for instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 on n-h1-835595-3 Oct 05 17:40:04.779596 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5fd06820-582c-443b-9c18-15dcd34ce25c req-b4324344-06a2-4ea6-884b-ec63ff1c5156 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094365 Oct 05 17:40:04.781092 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1078/2053] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:05.103454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-93c17487-0e1d-494e-b09c-7b49f3082475 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:05.120302 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-93c17487-0e1d-494e-b09c-7b49f3082475 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.607002 Oct 05 17:40:05.122851 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 976/2054] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:04 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:05.395430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-754929770", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "43b14ad7-066f-4366-a6d9-9f817db2441a"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:05.485987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] validate_networks() for [('43b14ad7-066f-4366-a6d9-9f817db2441a', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:40:05.515996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-103b859d-5c03-4a86-8668-6885bc8d5ec7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f777966af70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:05.605012 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-103b859d-5c03-4a86-8668-6885bc8d5ec7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1435 microversion: 2.1 time: 0.095185 Oct 05 17:40:05.605957 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 977/2055] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:05 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1435 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:05.635424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6e5c1d3-e48e-4fa4-849c-98f9c29e47d1 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77795e3ca0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:05.740214 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c6e5c1d3-e48e-4fa4-849c-98f9c29e47d1 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 200 len: 1435 microversion: 2.1 time: 0.122280 Oct 05 17:40:05.743455 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 978/2056] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:05 2022] GET /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 1435 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:05.752233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:05.756927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] [instance: d655671e-b4fa-4bf6-85b2-5a2d556124a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:05.778229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:05.781403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:05.782121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:05.783874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:05.785670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:05.787811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:05.827629 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] HTTP exception thrown: Instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 could not be found. Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Request method failure captured: Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 HTTP/1.1 Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPb_SZlciAYQvui2Wk-fFFygBvZTR8V-ZVBYbfzlFjalDkWZied9BOlDdxec9O9HiTOkEi_b0n1trWVE0kP8XRgyolcFwAMcAvblNLoMKCwFkmyq-CZ8JorKNdt4XMsSy36qg1Mhw5_ZSpum0hUahOSA2ei2wh_qJpQpw7-PEEZWou9E Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.25 Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 51a14f79344f4986a6c54001c3d7590c Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/51a14f79344f4986a6c54001c3d7590c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/51a14f79344f4986a6c54001c3d7590c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_51a14f79344f4986a6c54001c3d7590c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/51a14f79344f4986a6c54001c3d7590c"}]}] Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 51a14f79344f4986a6c54001c3d7590c Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103 Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-LiveAutoBlockMigrationV225Test-1684665103-project Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 205777d0702b45d1b400045c3a2fd47b Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1684665103-project Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 could not be found. Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'd655671e-b4fa-4bf6-85b2-5a2d556124a2'} Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 could not be found. Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 could not be found. Oct 05 17:40:05.831480 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 could not be found. Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] Returning 404 to user: Instance d655671e-b4fa-4bf6-85b2-5a2d556124a2 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f34f19b-fae4-4955-843a-a0d57703ac7f tempest-LiveAutoBlockMigrationV225Test-1684665103 tempest-LiveAutoBlockMigrationV225Test-1684665103-project] 10.222.0.70 "GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2" status: 404 len: 111 microversion: 2.25 time: 0.091136 Oct 05 17:40:05.837904 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 979/2057] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:40:05 2022] GET /compute/v2.1/servers/d655671e-b4fa-4bf6-85b2-5a2d556124a2 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:40:05.846096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a34f547-dd96-452e-aac7-37ccb0394183 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:05.846747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7a34f547-dd96-452e-aac7-37ccb0394183 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:05.862790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a34f547-dd96-452e-aac7-37ccb0394183 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:05.863292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a34f547-dd96-452e-aac7-37ccb0394183 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:05.863741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a34f547-dd96-452e-aac7-37ccb0394183 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:05.864571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a34f547-dd96-452e-aac7-37ccb0394183 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:05.865041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a34f547-dd96-452e-aac7-37ccb0394183 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:05.865490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a34f547-dd96-452e-aac7-37ccb0394183 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:06.423295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7a34f547-dd96-452e-aac7-37ccb0394183 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:06.468235 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a34f547-dd96-452e-aac7-37ccb0394183 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1467 microversion: 2.1 time: 0.628028 Oct 05 17:40:06.473511 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 980/2058] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:05 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1467 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:06.508271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f115c3fb-9550-4667-bf57-e741d44667b7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f7779651ee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:06.642999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:40:06.643563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:40:06.643944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:40:06.644391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:40:06.644851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:40:06.670656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:06.672338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:06.675898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:06.678010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:06.679754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:06.681002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:06.722641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:06.733723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for user 1c5f58a618c04b09815dea8f54504c7c and project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:06.751576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:40:06.754926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:40:06.821665 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e482cf0-1972-4553-af92-2336af6b7fc6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.430400 Oct 05 17:40:06.829309 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1079/2059] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:40:06.836175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-451e7fce-73f3-4a7a-8ef8-69746d7733c4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:06.837241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-451e7fce-73f3-4a7a-8ef8-69746d7733c4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:06.992668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-451e7fce-73f3-4a7a-8ef8-69746d7733c4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:07.002364 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-451e7fce-73f3-4a7a-8ef8-69746d7733c4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1214 microversion: 2.1 time: 0.171128 Oct 05 17:40:07.004288 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1080/2060] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:06 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1214 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:07.565561 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f115c3fb-9550-4667-bf57-e741d44667b7 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "DELETE /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789" status: 204 len: 0 microversion: 2.1 time: 1.063580 Oct 05 17:40:07.567046 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 981/2061] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:06 2022] DELETE /compute/v2.1/images/961091dd-c643-4e4a-9817-33f20b84f789 => generated 0 bytes in 1067 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:07.575047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb7c625d-6094-4645-bcc1-d59770d1f1fe tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '.version_select at 0x7f77747c5c10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:07.609572 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-eb7c625d-6094-4645-bcc1-d59770d1f1fe tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] HTTP exception thrown: Image not found. Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb7c625d-6094-4645-bcc1-d59770d1f1fe tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Request method failure captured: Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db HTTP/1.1 Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcENAI4jKJwkB4waua9TYl4nXzXBeZg5tFZG4auzJtY-9IRrGs26r_x4HYPdM2rlCE0TipQdzRsj_fumM1qZUOymeRadidtscElQidsWFtfy3KjX4Omm97cBthcETcj4rRery6_xCiN1LXYPEfxXPXxTDWls7zENpPOKfTp9Gncnn6M Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: e09b9e18087143a6863bd26d55ced3d7 Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerTestJSON-733592739 Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e09b9e18087143a6863bd26d55ced3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e09b9e18087143a6863bd26d55ced3d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e09b9e18087143a6863bd26d55ced3d7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e09b9e18087143a6863bd26d55ced3d7"}]}] Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerTestJSON-733592739 Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: e09b9e18087143a6863bd26d55ced3d7 Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-733592739 Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerTestJSON-733592739-project Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 3f47c095840642cfba9edb55fb8fc656 Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerTestJSON-733592739-project Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db'} Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db to delete Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db could not be found. Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:07.615693 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:07.618774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb7c625d-6094-4645-bcc1-d59770d1f1fe tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:40:07.619932 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb7c625d-6094-4645-bcc1-d59770d1f1fe tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "DELETE /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db" status: 404 len: 62 microversion: 2.1 time: 0.046567 Oct 05 17:40:07.622027 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1081/2062] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:07 2022] DELETE /compute/v2.1/images/5ef14a22-56da-4dbc-ab4e-e87c0ef4e8db => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:40:07.630428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da6538fa-6170-4b2e-8993-8f9a282734da tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:07.631218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da6538fa-6170-4b2e-8993-8f9a282734da tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:07.635806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:07.648076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6538fa-6170-4b2e-8993-8f9a282734da tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:07.648689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6538fa-6170-4b2e-8993-8f9a282734da tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:07.649443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6538fa-6170-4b2e-8993-8f9a282734da tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:07.655286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6538fa-6170-4b2e-8993-8f9a282734da tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:07.656032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6538fa-6170-4b2e-8993-8f9a282734da tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:07.656682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da6538fa-6170-4b2e-8993-8f9a282734da tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:07.718086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da6538fa-6170-4b2e-8993-8f9a282734da tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:40:07.823079 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da6538fa-6170-4b2e-8993-8f9a282734da tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "DELETE /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 204 len: 0 microversion: 2.1 time: 0.196255 Oct 05 17:40:07.824592 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 982/2063] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:40:07 2022] DELETE /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:07.834616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-769df874-45e8-4c46-8cef-2e608ce5a76d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:07.835267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-769df874-45e8-4c46-8cef-2e608ce5a76d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:07.856549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-769df874-45e8-4c46-8cef-2e608ce5a76d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:07.857261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-769df874-45e8-4c46-8cef-2e608ce5a76d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:07.857763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-769df874-45e8-4c46-8cef-2e608ce5a76d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:07.858547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-769df874-45e8-4c46-8cef-2e608ce5a76d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:07.858905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-769df874-45e8-4c46-8cef-2e608ce5a76d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:07.859470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-769df874-45e8-4c46-8cef-2e608ce5a76d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:08.028517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4fad73f-38f2-46c6-b9d3-1d6c01447348 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:08.029624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e4fad73f-38f2-46c6-b9d3-1d6c01447348 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:08.037173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4fad73f-38f2-46c6-b9d3-1d6c01447348 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:08.037883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4fad73f-38f2-46c6-b9d3-1d6c01447348 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:08.038488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4fad73f-38f2-46c6-b9d3-1d6c01447348 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:08.039771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4fad73f-38f2-46c6-b9d3-1d6c01447348 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:08.040358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4fad73f-38f2-46c6-b9d3-1d6c01447348 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:08.040922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4fad73f-38f2-46c6-b9d3-1d6c01447348 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:08.306458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e4fad73f-38f2-46c6-b9d3-1d6c01447348 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:08.319155 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e4fad73f-38f2-46c6-b9d3-1d6c01447348 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1266 microversion: 2.1 time: 0.294969 Oct 05 17:40:08.332028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-769df874-45e8-4c46-8cef-2e608ce5a76d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:08.336077 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 983/2064] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:08 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1266 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:08.340788 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-769df874-45e8-4c46-8cef-2e608ce5a76d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1473 microversion: 2.1 time: 0.511759 Oct 05 17:40:08.341356 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1082/2065] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:07 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1473 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:09.347508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ff253c9-dae7-429b-9657-cecb5f2d6183 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:09.350030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6ff253c9-dae7-429b-9657-cecb5f2d6183 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:09.375904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5541b4b8-cef6-444d-b164-febeaf7d1fb6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:09.376567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5541b4b8-cef6-444d-b164-febeaf7d1fb6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:09.377892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ff253c9-dae7-429b-9657-cecb5f2d6183 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:09.378781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ff253c9-dae7-429b-9657-cecb5f2d6183 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:09.379377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ff253c9-dae7-429b-9657-cecb5f2d6183 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:09.383310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ff253c9-dae7-429b-9657-cecb5f2d6183 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:09.384854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ff253c9-dae7-429b-9657-cecb5f2d6183 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:09.388114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ff253c9-dae7-429b-9657-cecb5f2d6183 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:09.390784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5541b4b8-cef6-444d-b164-febeaf7d1fb6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:09.391958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5541b4b8-cef6-444d-b164-febeaf7d1fb6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:09.394885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5541b4b8-cef6-444d-b164-febeaf7d1fb6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:09.395775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5541b4b8-cef6-444d-b164-febeaf7d1fb6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:09.397876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5541b4b8-cef6-444d-b164-febeaf7d1fb6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:09.398486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5541b4b8-cef6-444d-b164-febeaf7d1fb6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:09.907673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5541b4b8-cef6-444d-b164-febeaf7d1fb6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:09.924711 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5541b4b8-cef6-444d-b164-febeaf7d1fb6 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1473 microversion: 2.1 time: 0.552612 Oct 05 17:40:09.926202 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1083/2066] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:09 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1473 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:09.939639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-2a977dcd-4853-498e-8a70-2f69eb3074f2 req-6324e5ac-7228-4757-a9df-77fd9603906c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67baad57-2eba-46d5-94df-c10ae7590a6a", "name": "network-vif-unplugged", "status": "completed", "tag": "a6701176-0529-4a5b-9027-de7e2d50b2f4"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:09.968158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2a977dcd-4853-498e-8a70-2f69eb3074f2 req-6324e5ac-7228-4757-a9df-77fd9603906c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:09.968873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2a977dcd-4853-498e-8a70-2f69eb3074f2 req-6324e5ac-7228-4757-a9df-77fd9603906c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:09.969435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2a977dcd-4853-498e-8a70-2f69eb3074f2 req-6324e5ac-7228-4757-a9df-77fd9603906c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:09.994246 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-2a977dcd-4853-498e-8a70-2f69eb3074f2 req-6324e5ac-7228-4757-a9df-77fd9603906c service nova] Creating event network-vif-unplugged:a6701176-0529-4a5b-9027-de7e2d50b2f4 for instance 67baad57-2eba-46d5-94df-c10ae7590a6a on n-h1-835595-3 Oct 05 17:40:10.002373 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-2a977dcd-4853-498e-8a70-2f69eb3074f2 req-6324e5ac-7228-4757-a9df-77fd9603906c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074288 Oct 05 17:40:10.003650 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1084/2067] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:10.173942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6ff253c9-dae7-429b-9657-cecb5f2d6183 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:10.190054 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6ff253c9-dae7-429b-9657-cecb5f2d6183 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1272 microversion: 2.1 time: 0.849624 Oct 05 17:40:10.207714 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 984/2068] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:09 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1272 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:10.953389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ac97c0a-ee51-49c1-aed2-d411edb4f9af tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:10.954913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1ac97c0a-ee51-49c1-aed2-d411edb4f9af tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:10.964379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ac97c0a-ee51-49c1-aed2-d411edb4f9af tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:10.965504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ac97c0a-ee51-49c1-aed2-d411edb4f9af tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:10.966231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ac97c0a-ee51-49c1-aed2-d411edb4f9af tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:10.967184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ac97c0a-ee51-49c1-aed2-d411edb4f9af tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:10.967801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ac97c0a-ee51-49c1-aed2-d411edb4f9af tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:10.968365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ac97c0a-ee51-49c1-aed2-d411edb4f9af tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:11.215283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bf72de64-4dda-48a8-89f7-fa7b58d78284 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:11.215899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bf72de64-4dda-48a8-89f7-fa7b58d78284 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:11.233093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf72de64-4dda-48a8-89f7-fa7b58d78284 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:11.235355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf72de64-4dda-48a8-89f7-fa7b58d78284 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:11.237340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf72de64-4dda-48a8-89f7-fa7b58d78284 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:11.240039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf72de64-4dda-48a8-89f7-fa7b58d78284 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:11.240549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf72de64-4dda-48a8-89f7-fa7b58d78284 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:11.242129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf72de64-4dda-48a8-89f7-fa7b58d78284 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:11.502745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1ac97c0a-ee51-49c1-aed2-d411edb4f9af tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:11.537544 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1ac97c0a-ee51-49c1-aed2-d411edb4f9af tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1473 microversion: 2.1 time: 0.590331 Oct 05 17:40:11.544258 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1085/2069] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:10 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1473 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:11.712864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bf72de64-4dda-48a8-89f7-fa7b58d78284 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:11.721453 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bf72de64-4dda-48a8-89f7-fa7b58d78284 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1272 microversion: 2.1 time: 0.510223 Oct 05 17:40:11.725884 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 985/2070] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:11 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1272 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:12.560816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-209f21e3-567d-4030-9280-1bf9a628536d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:12.561442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-209f21e3-567d-4030-9280-1bf9a628536d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:12.578450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209f21e3-567d-4030-9280-1bf9a628536d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:12.578950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209f21e3-567d-4030-9280-1bf9a628536d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:12.579416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209f21e3-567d-4030-9280-1bf9a628536d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:12.591771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209f21e3-567d-4030-9280-1bf9a628536d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:12.592276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209f21e3-567d-4030-9280-1bf9a628536d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:12.592714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-209f21e3-567d-4030-9280-1bf9a628536d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:12.747208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-787d2716-68a9-439a-ba7e-7e511001758f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:12.747829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-787d2716-68a9-439a-ba7e-7e511001758f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:12.775521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d2716-68a9-439a-ba7e-7e511001758f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:12.776037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d2716-68a9-439a-ba7e-7e511001758f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:12.776641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d2716-68a9-439a-ba7e-7e511001758f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:12.777784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d2716-68a9-439a-ba7e-7e511001758f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:12.778437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d2716-68a9-439a-ba7e-7e511001758f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:12.779015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d2716-68a9-439a-ba7e-7e511001758f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:12.831967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-209f21e3-567d-4030-9280-1bf9a628536d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f47c095840642cfba9edb55fb8fc656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09b9e18087143a6863bd26d55ced3d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:12.848520 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-209f21e3-567d-4030-9280-1bf9a628536d tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 200 len: 1431 microversion: 2.1 time: 0.291867 Oct 05 17:40:12.855759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1086/2071] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:12 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 1431 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:12.880001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-0f3a0444-35b1-4739-8dc0-2b1af4d33528 req-d61216b3-9ae6-49d0-b37d-54194a86228c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67baad57-2eba-46d5-94df-c10ae7590a6a", "name": "network-vif-deleted", "tag": "a6701176-0529-4a5b-9027-de7e2d50b2f4"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:12.907151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0f3a0444-35b1-4739-8dc0-2b1af4d33528 req-d61216b3-9ae6-49d0-b37d-54194a86228c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:12.908151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0f3a0444-35b1-4739-8dc0-2b1af4d33528 req-d61216b3-9ae6-49d0-b37d-54194a86228c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:12.908738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0f3a0444-35b1-4739-8dc0-2b1af4d33528 req-d61216b3-9ae6-49d0-b37d-54194a86228c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:12.936980 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-0f3a0444-35b1-4739-8dc0-2b1af4d33528 req-d61216b3-9ae6-49d0-b37d-54194a86228c service nova] Creating event network-vif-deleted:a6701176-0529-4a5b-9027-de7e2d50b2f4 for instance 67baad57-2eba-46d5-94df-c10ae7590a6a on n-h1-835595-3 Oct 05 17:40:12.973647 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-0f3a0444-35b1-4739-8dc0-2b1af4d33528 req-d61216b3-9ae6-49d0-b37d-54194a86228c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097300 Oct 05 17:40:12.977087 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1087/2072] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:13.749115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-787d2716-68a9-439a-ba7e-7e511001758f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:13.763184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-787d2716-68a9-439a-ba7e-7e511001758f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1314 microversion: 2.1 time: 1.019807 Oct 05 17:40:13.770620 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 986/2073] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:12 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1314 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:13.882730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:13.884029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] [instance: 67baad57-2eba-46d5-94df-c10ae7590a6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:13.906756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:13.909170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:13.910046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:13.920846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:13.922933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:13.924295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:13.951610 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] HTTP exception thrown: Instance 67baad57-2eba-46d5-94df-c10ae7590a6a could not be found. Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Request method failure captured: Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a HTTP/1.1 Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcENAI4jKJwkB4waua9TYl4nXzXBeZg5tFZG4auzJtY-9IRrGs26r_x4HYPdM2rlCE0TipQdzRsj_fumM1qZUOymeRadidtscElQidsWFtfy3KjX4Omm97cBthcETcj4rRery6_xCiN1LXYPEfxXPXxTDWls7zENpPOKfTp9Gncnn6M Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: e09b9e18087143a6863bd26d55ced3d7 Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerTestJSON-733592739 Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e09b9e18087143a6863bd26d55ced3d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e09b9e18087143a6863bd26d55ced3d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e09b9e18087143a6863bd26d55ced3d7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e09b9e18087143a6863bd26d55ced3d7"}]}] Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerTestJSON-733592739 Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: e09b9e18087143a6863bd26d55ced3d7 Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-733592739 Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerTestJSON-733592739-project Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 3f47c095840642cfba9edb55fb8fc656 Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerTestJSON-733592739-project Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 67baad57-2eba-46d5-94df-c10ae7590a6a could not be found. Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '67baad57-2eba-46d5-94df-c10ae7590a6a'} Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67baad57-2eba-46d5-94df-c10ae7590a6a could not be found. Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67baad57-2eba-46d5-94df-c10ae7590a6a could not be found. Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:40:13.954272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:13.957299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:40:13.957299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:40:13.957299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:40:13.957299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:40:13.957299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:40:13.957299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67baad57-2eba-46d5-94df-c10ae7590a6a could not be found. Oct 05 17:40:13.957299 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:40:13.960680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] Returning 404 to user: Instance 67baad57-2eba-46d5-94df-c10ae7590a6a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:40:13.963043 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae0c8403-4591-4aaf-884f-f964edcd8f56 tempest-ImagesOneServerTestJSON-733592739 tempest-ImagesOneServerTestJSON-733592739-project] 10.222.0.70 "GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a" status: 404 len: 111 microversion: 2.1 time: 0.083169 Oct 05 17:40:13.964853 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1088/2074] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:13 2022] GET /compute/v2.1/servers/67baad57-2eba-46d5-94df-c10ae7590a6a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:40:14.785306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1afbaf02-6a63-450d-bbc6-ec93741ee465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:14.785918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1afbaf02-6a63-450d-bbc6-ec93741ee465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:14.795882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1afbaf02-6a63-450d-bbc6-ec93741ee465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:14.797618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1afbaf02-6a63-450d-bbc6-ec93741ee465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:14.799219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1afbaf02-6a63-450d-bbc6-ec93741ee465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:14.802705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1afbaf02-6a63-450d-bbc6-ec93741ee465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:14.802705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1afbaf02-6a63-450d-bbc6-ec93741ee465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:14.808839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1afbaf02-6a63-450d-bbc6-ec93741ee465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:15.441168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1afbaf02-6a63-450d-bbc6-ec93741ee465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:15.453434 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1afbaf02-6a63-450d-bbc6-ec93741ee465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1314 microversion: 2.1 time: 0.671837 Oct 05 17:40:15.468618 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 987/2075] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:14 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1314 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:16.480750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-60d0f1bc-1318-4448-9151-52c8aaf8f29a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:16.482095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-60d0f1bc-1318-4448-9151-52c8aaf8f29a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:16.506173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60d0f1bc-1318-4448-9151-52c8aaf8f29a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:16.509161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60d0f1bc-1318-4448-9151-52c8aaf8f29a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:16.512103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60d0f1bc-1318-4448-9151-52c8aaf8f29a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:16.515558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60d0f1bc-1318-4448-9151-52c8aaf8f29a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:16.517296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60d0f1bc-1318-4448-9151-52c8aaf8f29a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:16.517783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60d0f1bc-1318-4448-9151-52c8aaf8f29a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:16.711096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:16.998579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:17.538731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-60d0f1bc-1318-4448-9151-52c8aaf8f29a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:17.571469 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-60d0f1bc-1318-4448-9151-52c8aaf8f29a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1314 microversion: 2.1 time: 1.095243 Oct 05 17:40:17.575628 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1089/2076] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:16 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1314 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:17.711017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e10d4cea-0254-4737-9e3f-e2038c6d4d0b tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Action: 'create', calling method: .version_select at 0x7f77795430d0>, body: {"keypair": {"name": "tempest-keypair-331944282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNu2PEcopMXBsuzUeFW5ryWILKxeXkrrquHzGXhK3y10ZmKS/3qpfOfaUarsjUV82Rc8lOgzleDCHkwoRz/muocqRjlNG4sa90DzGQFYbLnHeu5g1++3BVJKA3QwEKQatQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:17.731490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e10d4cea-0254-4737-9e3f-e2038c6d4d0b tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:17.737192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e10d4cea-0254-4737-9e3f-e2038c6d4d0b tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for user b8f75f3f409b47778cb16b89dc494ad1 and project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:17.754709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-575750043", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "f858ae49-432b-47a7-98c9-045c9a50f77b"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:17.816615 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e10d4cea-0254-4737-9e3f-e2038c6d4d0b tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.520447 Oct 05 17:40:17.820141 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 988/2077] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:40:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:17.839488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] validate_networks() for [('f858ae49-432b-47a7-98c9-045c9a50f77b', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:40:17.842703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-717a7bb8-2464-4a27-8920-765f32dbf69d tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Calling method '.version_select at 0x7f77795624c0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:17.860437 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-717a7bb8-2464-4a27-8920-765f32dbf69d tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-331944282" status: 200 len: 497 microversion: 2.1 time: 0.034693 Oct 05 17:40:17.862330 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 989/2078] 10.222.0.70 () {58 vars in 1215 bytes} [Wed Oct 5 17:40:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-331944282 => generated 497 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:40:17.875101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e49b803b-80d9-4f0e-a771-b3d84f42af24 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Calling method '.version_select at 0x7f7779562af0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:17.922970 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e49b803b-80d9-4f0e-a771-b3d84f42af24 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-331944282" status: 202 len: 0 microversion: 2.1 time: 0.052202 Oct 05 17:40:17.933219 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 990/2079] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 17:40:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-331944282 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:40:17.960348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-09d829ee-2ab9-4909-bd39-6beef81c88dd tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Action: 'create', calling method: .version_select at 0x7f7779553e50>, body: {"keypair": {"name": "tempest-keypair-275739516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmIS0aIF6fGUSWx1CpzkeNeb8iyBVU+V6epaCFsURQqLXeiMC1HujEuWpSJiSTye7xe+vTzqT/V7UhBgmUvYzegApTxWxvxTQJ60bEQD8DMddTGm9m6DLJN3zh+APw/qA=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:17.985975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-09d829ee-2ab9-4909-bd39-6beef81c88dd tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:18.018827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-09d829ee-2ab9-4909-bd39-6beef81c88dd tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for user b8f75f3f409b47778cb16b89dc494ad1 and project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:18.086922 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-09d829ee-2ab9-4909-bd39-6beef81c88dd tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.151246 Oct 05 17:40:18.101354 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 991/2080] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:40:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:18.109926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41a33f59-4e39-453f-a413-a673d42136f9 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Calling method '.version_select at 0x7f77795e3ca0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:18.142064 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-41a33f59-4e39-453f-a413-a673d42136f9 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-275739516" status: 202 len: 0 microversion: 2.1 time: 0.037938 Oct 05 17:40:18.188751 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 992/2081] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 17:40:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-275739516 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:40:18.200560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-766b9542-33ec-4824-b09c-6d53c8685471 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Action: 'create', calling method: .version_select at 0x7f777966ac10>, body: {"keypair": {"name": "tempest-keypair-585771252", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:18.228873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-766b9542-33ec-4824-b09c-6d53c8685471 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:18.236464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-766b9542-33ec-4824-b09c-6d53c8685471 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for user b8f75f3f409b47778cb16b89dc494ad1 and project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:18.274118 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-766b9542-33ec-4824-b09c-6d53c8685471 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.083949 Oct 05 17:40:18.280091 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 993/2082] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:40:18 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:18.304194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2a38e9e2-4647-4176-959e-8c404d659baa tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Calling method '.version_select at 0x7f77795430d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:18.352718 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2a38e9e2-4647-4176-959e-8c404d659baa tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585771252" status: 202 len: 0 microversion: 2.1 time: 0.065659 Oct 05 17:40:18.363200 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 994/2083] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 17:40:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585771252 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:40:18.370235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51543582-620a-46bc-be54-7ff8905f3ba9 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Action: 'create', calling method: .version_select at 0x7f77795afb80>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1423442023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENsM6D/mMcCBLMPllF7tGOay9guDH0/revpKm0CRRBfsjzcysORj7UQX1PcEdBG00ghIGbLJOEf+Uizx4oNj+ZFbVPclj2FcalBv8HZlOyie9wrzPUKwC206ziF/xigdQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:18.392601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-51543582-620a-46bc-be54-7ff8905f3ba9 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:18.428567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-51543582-620a-46bc-be54-7ff8905f3ba9 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for user b8f75f3f409b47778cb16b89dc494ad1 and project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:18.489201 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51543582-620a-46bc-be54-7ff8905f3ba9 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.123926 Oct 05 17:40:18.489831 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 995/2084] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:40:18 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:18.509808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de9c9221-dfaa-4c62-b8b2-1cadb6e9c8fd tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Action: 'create', calling method: .version_select at 0x7f77795e3c10>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-733098623", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1rih0DXJg75zoL/Mvbt8E025GIesxiz2eLK4kpTIx2XQdntQDt53qBoKDfETdIcrQHBuVXtXB9CTCBb3NCk9ENMMZNRKn6dOyQpu2FMgNsVXTNANGkxbYaZA9N6Sse6A=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:18.556898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-de9c9221-dfaa-4c62-b8b2-1cadb6e9c8fd tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:18.572066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-de9c9221-dfaa-4c62-b8b2-1cadb6e9c8fd tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for user b8f75f3f409b47778cb16b89dc494ad1 and project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:18.612779 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de9c9221-dfaa-4c62-b8b2-1cadb6e9c8fd tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.112790 Oct 05 17:40:18.614052 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 996/2085] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:40:18 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:18.620754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ddf045bb-a9ac-4a74-bef5-1c165e87c898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:18.621919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ddf045bb-a9ac-4a74-bef5-1c165e87c898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:18.637096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddf045bb-a9ac-4a74-bef5-1c165e87c898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:18.637798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddf045bb-a9ac-4a74-bef5-1c165e87c898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:18.638478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddf045bb-a9ac-4a74-bef5-1c165e87c898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:18.639331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddf045bb-a9ac-4a74-bef5-1c165e87c898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:18.640090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddf045bb-a9ac-4a74-bef5-1c165e87c898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:18.640654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ddf045bb-a9ac-4a74-bef5-1c165e87c898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:19.276597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:40:19.277733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:40:19.278384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:40:19.278936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:40:19.279522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:40:19.289186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:19.289924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:19.290526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:19.291404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:19.291993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:19.292667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:19.312043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Getting quotas for project 47d5d4426b3d481b92b84c307cd00ead. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:19.317656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Getting quotas for user 6720411ae8fc46a5bcd7b8f6d95c24a8 and project 47d5d4426b3d481b92b84c307cd00ead. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:19.331993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:40:19.334676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:40:19.418445 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63db0655-037c-4116-a64e-5b32d2285ea8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.841018 Oct 05 17:40:19.419127 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1090/2086] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:40:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:40:19.424042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b386a794-3258-4d80-9ee6-49dc4e42c517 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Action: 'create', calling method: .version_select at 0x7f77794653a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-552173601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJCpiZBMoaLTZXEXpqGxZyibiaL4eToCZZZGevZeINLo/8xYl6PbNitZryE8CYwCHbspQf1tntUnoZdAVc6nF+M5eAJ/9eg4AuY8VAQXNn4fTH2fZpT3IlpYescZpSUeg=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:19.464908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-b386a794-3258-4d80-9ee6-49dc4e42c517 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:19.476065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-b386a794-3258-4d80-9ee6-49dc4e42c517 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Getting quotas for user b8f75f3f409b47778cb16b89dc494ad1 and project 87fc8cf69c0d402bb29af6cf23fc011c. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:19.519073 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b386a794-3258-4d80-9ee6-49dc4e42c517 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.098525 Oct 05 17:40:19.526042 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1091/2087] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:40:19 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:19.536039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b09145c-7066-4086-a73b-2cd38f1f0e66 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:19.536682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1b09145c-7066-4086-a73b-2cd38f1f0e66 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:19.677064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b09145c-7066-4086-a73b-2cd38f1f0e66 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:19.685427 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b09145c-7066-4086-a73b-2cd38f1f0e66 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1207 microversion: 2.1 time: 0.157849 Oct 05 17:40:19.689486 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1092/2088] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:19 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1207 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:19.700095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dee09a47-58d4-475d-8e81-d6c849a21fad tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Calling method '.version_select at 0x7f77747cf430>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:19.704343 n-d-835595-3 devstack@n-api.service[128844]: WARNING oslo_db.sqlalchemy.utils [None req-dee09a47-58d4-475d-8e81-d6c849a21fad tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 17:40:19.722241 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dee09a47-58d4-475d-8e81-d6c849a21fad tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.030284 Oct 05 17:40:19.723172 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1093/2089] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:40:19 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:19.738358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8634aeed-b242-4937-9ec6-247ac549b412 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Calling method '.version_select at 0x7f777942eee0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:19.799342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8634aeed-b242-4937-9ec6-247ac549b412 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-552173601" status: 202 len: 0 microversion: 2.1 time: 0.068901 Oct 05 17:40:19.800573 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1094/2090] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:40:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-552173601 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:40:19.809412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-16e181e3-bc16-489d-adf9-c88d4f6f6661 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Calling method '.version_select at 0x7f77747cb9d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:19.809568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ddf045bb-a9ac-4a74-bef5-1c165e87c898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:19.825621 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ddf045bb-a9ac-4a74-bef5-1c165e87c898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1314 microversion: 2.1 time: 1.206869 Oct 05 17:40:19.827165 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 997/2091] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:18 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1314 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:19.873790 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-16e181e3-bc16-489d-adf9-c88d4f6f6661 tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-733098623" status: 202 len: 0 microversion: 2.1 time: 0.068733 Oct 05 17:40:19.874659 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1095/2092] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:40:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-733098623 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:40:19.882627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d08a9fe-6c98-4892-8cc2-4615910e564a tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] Calling method '.version_select at 0x7f7779553820>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:19.944043 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d08a9fe-6c98-4892-8cc2-4615910e564a tempest-KeyPairsV2TestJSON-551103027 tempest-KeyPairsV2TestJSON-551103027-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1423442023" status: 202 len: 0 microversion: 2.1 time: 0.062788 Oct 05 17:40:19.944919 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 998/2093] 10.222.0.70 () {58 vars in 1278 bytes} [Wed Oct 5 17:40:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1423442023 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:40:20.340667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ce91b207-9a44-49e0-8dfa-a8c8fd78bb8f req-2b67f10a-fd09-47d3-81a9-d4cf9d31bc5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a73e084b-e4d1-4858-8a95-9f938ab0c177", "tag": "e1020a1c-b61e-4ea6-9d20-49f9f33a4b9f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:20.365357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ce91b207-9a44-49e0-8dfa-a8c8fd78bb8f req-2b67f10a-fd09-47d3-81a9-d4cf9d31bc5e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:20.367811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ce91b207-9a44-49e0-8dfa-a8c8fd78bb8f req-2b67f10a-fd09-47d3-81a9-d4cf9d31bc5e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:20.368928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ce91b207-9a44-49e0-8dfa-a8c8fd78bb8f req-2b67f10a-fd09-47d3-81a9-d4cf9d31bc5e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:20.403883 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ce91b207-9a44-49e0-8dfa-a8c8fd78bb8f req-2b67f10a-fd09-47d3-81a9-d4cf9d31bc5e service nova] Creating event network-changed:e1020a1c-b61e-4ea6-9d20-49f9f33a4b9f for instance a73e084b-e4d1-4858-8a95-9f938ab0c177 on n-h2-835595-3 Oct 05 17:40:20.419780 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ce91b207-9a44-49e0-8dfa-a8c8fd78bb8f req-2b67f10a-fd09-47d3-81a9-d4cf9d31bc5e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082667 Oct 05 17:40:20.430583 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1096/2094] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:20.714139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aece2a36-b9da-4853-b57b-70de29646dee tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:20.715993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aece2a36-b9da-4853-b57b-70de29646dee tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:20.742867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aece2a36-b9da-4853-b57b-70de29646dee tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:20.745652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aece2a36-b9da-4853-b57b-70de29646dee tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:20.746709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aece2a36-b9da-4853-b57b-70de29646dee tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:20.748097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aece2a36-b9da-4853-b57b-70de29646dee tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:20.754264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aece2a36-b9da-4853-b57b-70de29646dee tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:20.756036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aece2a36-b9da-4853-b57b-70de29646dee tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:20.854103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1629aa7b-fc22-4af5-8bc0-b7ce1d5363a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:20.855394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1629aa7b-fc22-4af5-8bc0-b7ce1d5363a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:20.880399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1629aa7b-fc22-4af5-8bc0-b7ce1d5363a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:20.881082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1629aa7b-fc22-4af5-8bc0-b7ce1d5363a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:20.884694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1629aa7b-fc22-4af5-8bc0-b7ce1d5363a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:20.886557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1629aa7b-fc22-4af5-8bc0-b7ce1d5363a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:20.887285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1629aa7b-fc22-4af5-8bc0-b7ce1d5363a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:20.887823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1629aa7b-fc22-4af5-8bc0-b7ce1d5363a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:21.291073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aece2a36-b9da-4853-b57b-70de29646dee tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:21.302925 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aece2a36-b9da-4853-b57b-70de29646dee tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1211 microversion: 2.1 time: 0.595382 Oct 05 17:40:21.309652 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 999/2095] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:20 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1211 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:21.688934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1629aa7b-fc22-4af5-8bc0-b7ce1d5363a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:21.733262 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1629aa7b-fc22-4af5-8bc0-b7ce1d5363a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1314 microversion: 2.1 time: 0.888885 Oct 05 17:40:21.743064 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1097/2096] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:20 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:22.333410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-be24c969-45c3-4297-9ee3-e4461c99bce6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:22.334046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-be24c969-45c3-4297-9ee3-e4461c99bce6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:22.350406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=5,nova_api:DELETE=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:22.375049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be24c969-45c3-4297-9ee3-e4461c99bce6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:22.375558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be24c969-45c3-4297-9ee3-e4461c99bce6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:22.375994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be24c969-45c3-4297-9ee3-e4461c99bce6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:22.376730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be24c969-45c3-4297-9ee3-e4461c99bce6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:22.377337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be24c969-45c3-4297-9ee3-e4461c99bce6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:22.392054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be24c969-45c3-4297-9ee3-e4461c99bce6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:22.768633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-293ee4dc-cfee-424d-9899-88b8dd66256f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:22.769464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-293ee4dc-cfee-424d-9899-88b8dd66256f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:22.786031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-293ee4dc-cfee-424d-9899-88b8dd66256f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:22.793678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-293ee4dc-cfee-424d-9899-88b8dd66256f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:22.794304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-293ee4dc-cfee-424d-9899-88b8dd66256f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:22.795485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-293ee4dc-cfee-424d-9899-88b8dd66256f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:22.799295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-293ee4dc-cfee-424d-9899-88b8dd66256f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:22.800021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-293ee4dc-cfee-424d-9899-88b8dd66256f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:23.261938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-293ee4dc-cfee-424d-9899-88b8dd66256f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:23.276492 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-293ee4dc-cfee-424d-9899-88b8dd66256f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1314 microversion: 2.1 time: 0.516498 Oct 05 17:40:23.280626 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1098/2097] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:22 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:23.493099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-be24c969-45c3-4297-9ee3-e4461c99bce6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:23.508052 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-be24c969-45c3-4297-9ee3-e4461c99bce6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1265 microversion: 2.1 time: 1.186261 Oct 05 17:40:23.524365 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1000/2098] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:22 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1265 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:24.305398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e000d7e3-7b5d-47e2-9d39-0db828b17ab3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:24.306013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e000d7e3-7b5d-47e2-9d39-0db828b17ab3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:24.334664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e000d7e3-7b5d-47e2-9d39-0db828b17ab3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:24.335341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e000d7e3-7b5d-47e2-9d39-0db828b17ab3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:24.341047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e000d7e3-7b5d-47e2-9d39-0db828b17ab3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:24.345191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e000d7e3-7b5d-47e2-9d39-0db828b17ab3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:24.348943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e000d7e3-7b5d-47e2-9d39-0db828b17ab3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:24.350990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e000d7e3-7b5d-47e2-9d39-0db828b17ab3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:24.536210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55f4d583-6830-4017-bcd3-7487f8178bd1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:24.537143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-55f4d583-6830-4017-bcd3-7487f8178bd1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:24.561056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55f4d583-6830-4017-bcd3-7487f8178bd1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:24.562735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55f4d583-6830-4017-bcd3-7487f8178bd1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:24.563807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55f4d583-6830-4017-bcd3-7487f8178bd1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:24.565969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55f4d583-6830-4017-bcd3-7487f8178bd1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:24.568372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55f4d583-6830-4017-bcd3-7487f8178bd1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:24.569911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55f4d583-6830-4017-bcd3-7487f8178bd1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:24.831224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-55f4d583-6830-4017-bcd3-7487f8178bd1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:24.842113 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-55f4d583-6830-4017-bcd3-7487f8178bd1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1265 microversion: 2.1 time: 0.310257 Oct 05 17:40:24.843686 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1001/2099] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:24 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:24.916795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e000d7e3-7b5d-47e2-9d39-0db828b17ab3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:24.932554 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e000d7e3-7b5d-47e2-9d39-0db828b17ab3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1314 microversion: 2.1 time: 0.632431 Oct 05 17:40:24.933235 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1099/2100] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:24 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:25.870210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-508bf177-018e-4c26-8b68-094d9c78938a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:25.872757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-508bf177-018e-4c26-8b68-094d9c78938a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:25.899736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-508bf177-018e-4c26-8b68-094d9c78938a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:25.900867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-508bf177-018e-4c26-8b68-094d9c78938a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:25.908473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-508bf177-018e-4c26-8b68-094d9c78938a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:25.915977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-508bf177-018e-4c26-8b68-094d9c78938a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:25.923928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-508bf177-018e-4c26-8b68-094d9c78938a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:25.925448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-508bf177-018e-4c26-8b68-094d9c78938a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:25.956383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5e9e634-407d-41b8-9ec9-547e5afea6ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:25.960895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d5e9e634-407d-41b8-9ec9-547e5afea6ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:25.993850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5e9e634-407d-41b8-9ec9-547e5afea6ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:25.994733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5e9e634-407d-41b8-9ec9-547e5afea6ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:26.002132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5e9e634-407d-41b8-9ec9-547e5afea6ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:26.003349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5e9e634-407d-41b8-9ec9-547e5afea6ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:26.007048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5e9e634-407d-41b8-9ec9-547e5afea6ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:26.010091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5e9e634-407d-41b8-9ec9-547e5afea6ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:26.023476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:26.382631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-508bf177-018e-4c26-8b68-094d9c78938a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:26.391403 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-508bf177-018e-4c26-8b68-094d9c78938a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1265 microversion: 2.1 time: 0.529768 Oct 05 17:40:26.391991 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1002/2101] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:25 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1265 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:26.407284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d5e9e634-407d-41b8-9ec9-547e5afea6ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:26.414302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:26.425341 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d5e9e634-407d-41b8-9ec9-547e5afea6ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1314 microversion: 2.1 time: 0.473876 Oct 05 17:40:26.447205 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1100/2102] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:25 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:27.421736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5864f9a0-9185-430a-9b20-0ed9a1de9ac3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:27.427384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5864f9a0-9185-430a-9b20-0ed9a1de9ac3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:27.450013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5864f9a0-9185-430a-9b20-0ed9a1de9ac3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:27.450560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5864f9a0-9185-430a-9b20-0ed9a1de9ac3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:27.451009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5864f9a0-9185-430a-9b20-0ed9a1de9ac3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:27.452993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5864f9a0-9185-430a-9b20-0ed9a1de9ac3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:27.453469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5864f9a0-9185-430a-9b20-0ed9a1de9ac3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:27.453902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5864f9a0-9185-430a-9b20-0ed9a1de9ac3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:27.565501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e40e0614-f608-4964-8d7c-58e12b20d904 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Action: 'create', calling method: .version_select at 0x7f77795d9ee0>, body: {"keypair": {"name": "tempest-keypair-988667356", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWP7feSNTjCghWtHxiap/Db1QCBVK5/Ss2FVgBAI1MmSFq26XWd05TO3zNNkfqqM5nMdtWWGAmY04EYNGEjMY204ivd9nTvj4cUDGq4tsexBmAiERkYj2R/Ad/tUn+/cQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:27.665925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e40e0614-f608-4964-8d7c-58e12b20d904 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:27.684361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e40e0614-f608-4964-8d7c-58e12b20d904 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for user 66af7cc07bcb4e42ae9c84788bffa436 and project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:27.748603 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e40e0614-f608-4964-8d7c-58e12b20d904 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 1.027318 Oct 05 17:40:27.756598 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1003/2103] 10.222.0.70 () {62 vars in 1199 bytes} [Wed Oct 5 17:40:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1030 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 05 17:40:27.772516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ff72ab37-944f-48bb-9899-02afb66d5e3a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:27.776286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ff72ab37-944f-48bb-9899-02afb66d5e3a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:27.801944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff72ab37-944f-48bb-9899-02afb66d5e3a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:27.804374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff72ab37-944f-48bb-9899-02afb66d5e3a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:27.805822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff72ab37-944f-48bb-9899-02afb66d5e3a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:27.808954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff72ab37-944f-48bb-9899-02afb66d5e3a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:27.812393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff72ab37-944f-48bb-9899-02afb66d5e3a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:27.813080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff72ab37-944f-48bb-9899-02afb66d5e3a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:27.911018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5864f9a0-9185-430a-9b20-0ed9a1de9ac3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:27.923024 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5864f9a0-9185-430a-9b20-0ed9a1de9ac3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.511677 Oct 05 17:40:27.924402 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1101/2104] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:27 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:27.943365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76ff87d0-b783-4b32-81a1-23f21ec9c584 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f7779537790>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:27.957456 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76ff87d0-b783-4b32-81a1-23f21ec9c584 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-988667356" status: 200 len: 512 microversion: 2.2 time: 0.031625 Oct 05 17:40:27.958738 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1102/2105] 10.222.0.70 () {60 vars in 1255 bytes} [Wed Oct 5 17:40:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-988667356 => generated 512 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:27.973462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8d02d347-bbe9-47f3-8fbc-0bfa2986657e tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f7774798550>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:28.012707 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8d02d347-bbe9-47f3-8fbc-0bfa2986657e tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-988667356" status: 204 len: 0 microversion: 2.2 time: 0.045997 Oct 05 17:40:28.015522 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1103/2106] 10.222.0.70 () {60 vars in 1258 bytes} [Wed Oct 5 17:40:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-988667356 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:40:28.032722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35afe76d-e9f2-4947-a5a0-2ec560bb832a tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Action: 'create', calling method: .version_select at 0x7f77747ccf70>, body: {"keypair": {"name": "tempest-keypair-1302753745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHo/Im2+ePIxfcrl8w11uPxEDCmOJmbUaqXFm1rSUgnPztgxso6UX8Pc2OnTfmbp/FLRGqtJz54eEYNA9MKKq2Fuoo1LUOAlbjVj9NZsrOcpy6rtykiehVr3jEH90RHrLA=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:28.057471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:28.143697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-35afe76d-e9f2-4947-a5a0-2ec560bb832a tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:28.162711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-35afe76d-e9f2-4947-a5a0-2ec560bb832a tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for user 66af7cc07bcb4e42ae9c84788bffa436 and project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:28.267101 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35afe76d-e9f2-4947-a5a0-2ec560bb832a tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.243531 Oct 05 17:40:28.267867 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1104/2107] 10.222.0.70 () {62 vars in 1199 bytes} [Wed Oct 5 17:40:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 245 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 05 17:40:28.278468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e80c342b-0a85-4fbc-8d18-bbf9d5a6096c tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f77747a74c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:28.334858 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e80c342b-0a85-4fbc-8d18-bbf9d5a6096c tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302753745" status: 204 len: 0 microversion: 2.2 time: 0.058102 Oct 05 17:40:28.335464 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1105/2108] 10.222.0.70 () {60 vars in 1261 bytes} [Wed Oct 5 17:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302753745 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:28.354612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-16bc4675-ada4-4c36-9d3c-f3b7a4f973b0 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Action: 'create', calling method: .version_select at 0x7f77747c0040>, body: {"keypair": {"name": "tempest-keypair-523920684", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:28.416991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-16bc4675-ada4-4c36-9d3c-f3b7a4f973b0 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:28.437981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-16bc4675-ada4-4c36-9d3c-f3b7a4f973b0 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for user 66af7cc07bcb4e42ae9c84788bffa436 and project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:28.533234 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-16bc4675-ada4-4c36-9d3c-f3b7a4f973b0 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.191907 Oct 05 17:40:28.534176 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1106/2109] 10.222.0.70 () {62 vars in 1199 bytes} [Wed Oct 5 17:40:28 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 193 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 05 17:40:28.549336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2fff22cc-ac1d-4a5e-b785-39f888ded590 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f77747c0280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:28.611049 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2fff22cc-ac1d-4a5e-b785-39f888ded590 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-523920684" status: 204 len: 0 microversion: 2.2 time: 0.068395 Oct 05 17:40:28.620261 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1107/2110] 10.222.0.70 () {60 vars in 1258 bytes} [Wed Oct 5 17:40:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-523920684 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:28.640392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ce19f8e-6275-4a44-8f07-a4b58b982e81 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Action: 'create', calling method: .version_select at 0x7f77747a7820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-667327344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEocN9vQ3ebW71vl3zwFN9IxB9ileRn2a1+/d4DBnZm3oizDGGX+bWUFcHq6PMCGJ7yXrt6CaWXEMJUeE5YxI9wDZEq9tOH4Fwn1zMLc2YQldA6T9reRN5jcMA+PZN08tQ=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:28.685336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-1ce19f8e-6275-4a44-8f07-a4b58b982e81 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:28.700088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-1ce19f8e-6275-4a44-8f07-a4b58b982e81 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for user 66af7cc07bcb4e42ae9c84788bffa436 and project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:28.785188 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1ce19f8e-6275-4a44-8f07-a4b58b982e81 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.157147 Oct 05 17:40:28.787582 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1108/2111] 10.222.0.70 () {62 vars in 1199 bytes} [Wed Oct 5 17:40:28 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 162 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 05 17:40:28.815554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40208c1a-070a-4f7d-bf8d-3a16c5062cae tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Action: 'create', calling method: .version_select at 0x7f777964baf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-650109241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAzFqtJIbCH4dDBdJvQaaN07ufY9vMiyTpaU8GdykCYx4WUT2APs51Dk+esMp+2Zf4uBniONb3BKCrfLoX1DswyiMar+4XrIZXn/3aD1Af3vGcFZ/InG5/u3Pd8V88+lYQ=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:28.867277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-40208c1a-070a-4f7d-bf8d-3a16c5062cae tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:28.889955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-40208c1a-070a-4f7d-bf8d-3a16c5062cae tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for user 66af7cc07bcb4e42ae9c84788bffa436 and project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:28.970040 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-40208c1a-070a-4f7d-bf8d-3a16c5062cae tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.164588 Oct 05 17:40:28.971238 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1109/2112] 10.222.0.70 () {62 vars in 1199 bytes} [Wed Oct 5 17:40:28 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 05 17:40:28.990555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cccd9201-a8ef-4cf3-a99d-0ec5686074ac tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:28.994743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cccd9201-a8ef-4cf3-a99d-0ec5686074ac tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:29.013864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccd9201-a8ef-4cf3-a99d-0ec5686074ac tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:29.015920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccd9201-a8ef-4cf3-a99d-0ec5686074ac tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:29.017079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccd9201-a8ef-4cf3-a99d-0ec5686074ac tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:29.018692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccd9201-a8ef-4cf3-a99d-0ec5686074ac tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:29.019171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccd9201-a8ef-4cf3-a99d-0ec5686074ac tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:29.019614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cccd9201-a8ef-4cf3-a99d-0ec5686074ac tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:29.303629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:29.348113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cccd9201-a8ef-4cf3-a99d-0ec5686074ac tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:29.354654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ff72ab37-944f-48bb-9899-02afb66d5e3a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:29.360819 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cccd9201-a8ef-4cf3-a99d-0ec5686074ac tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.387731 Oct 05 17:40:29.362999 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1110/2113] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:28 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:29.367949 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ff72ab37-944f-48bb-9899-02afb66d5e3a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1314 microversion: 2.1 time: 1.607717 Oct 05 17:40:29.368534 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1004/2114] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:27 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1314 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:29.385728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a376c426-4a9e-4f1f-a6a9-16ce711ed001 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Action: 'create', calling method: .version_select at 0x7f7779433160>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-618053337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDv1iV/mX65Pxg1qnv8erkAHr6eYzk3UpaIlt+B3Sbtl17TwcjId6XWufLZRt9tIEcztJqBPhUPf8TYQ7jVbc7ihzO2R/51DqMJ5EvPRiipyzyIKR+ZIOKMyyGIEr5cLw=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:29.388638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9223f67b-d0f9-49b0-bbe3-a974c7ae58fb tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Calling method '.version_select at 0x7f777966ae50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:29.412676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-a376c426-4a9e-4f1f-a6a9-16ce711ed001 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:29.421789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-a376c426-4a9e-4f1f-a6a9-16ce711ed001 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for user 66af7cc07bcb4e42ae9c84788bffa436 and project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:29.460238 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a376c426-4a9e-4f1f-a6a9-16ce711ed001 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.094420 Oct 05 17:40:29.462573 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1111/2115] 10.222.0.70 () {62 vars in 1199 bytes} [Wed Oct 5 17:40:29 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 05 17:40:29.474722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ff1bab7-ac71-4af1-aa3d-13bdf87aca62 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f77747c5ca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:29.477092 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9223f67b-d0f9-49b0-bbe3-a974c7ae58fb tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799" status: 200 len: 637 microversion: 2.1 time: 0.103581 Oct 05 17:40:29.478834 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1005/2116] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:29 2022] GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799 => generated 637 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:29.493026 n-d-835595-3 devstack@n-api.service[128844]: WARNING oslo_db.sqlalchemy.utils [None req-7ff1bab7-ac71-4af1-aa3d-13bdf87aca62 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 17:40:29.496575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bb9e8bd1-e66d-4623-936e-ecbde68db608 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Action: 'update_all', calling method: .version_select at 0x7f7779562f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:29.512818 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7ff1bab7-ac71-4af1-aa3d-13bdf87aca62 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.040262 Oct 05 17:40:29.516856 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1112/2117] 10.222.0.70 () {60 vars in 1177 bytes} [Wed Oct 5 17:40:29 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:29.533544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-77190f75-bb13-4953-bd40-46694f5e31ea tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f77747a74c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:29.587447 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-77190f75-bb13-4953-bd40-46694f5e31ea tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-618053337" status: 204 len: 0 microversion: 2.2 time: 0.061485 Oct 05 17:40:29.592457 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1113/2118] 10.222.0.70 () {60 vars in 1318 bytes} [Wed Oct 5 17:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-618053337 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:29.597710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e4194be-920c-4ec3-9608-8771acab2869 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f7774798f70>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:29.607328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-bb9e8bd1-e66d-4623-936e-ecbde68db608 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:29.623222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-bb9e8bd1-e66d-4623-936e-ecbde68db608 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for user d962e0f06258432194f4859459e6823a and project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:29.654028 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e4194be-920c-4ec3-9608-8771acab2869 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-650109241" status: 204 len: 0 microversion: 2.2 time: 0.060088 Oct 05 17:40:29.656759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1114/2119] 10.222.0.70 () {60 vars in 1318 bytes} [Wed Oct 5 17:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-650109241 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:29.695409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-01e5884d-c991-447b-8d51-04a64466de19 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f77747c5f70>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:29.753418 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-01e5884d-c991-447b-8d51-04a64466de19 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-667327344" status: 204 len: 0 microversion: 2.2 time: 0.089801 Oct 05 17:40:29.763259 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1115/2120] 10.222.0.70 () {60 vars in 1318 bytes} [Wed Oct 5 17:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-667327344 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:29.780768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-28e7dd14-27e5-40da-b6ad-214434fd00a8 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Action: 'create', calling method: .version_select at 0x7f77747cb670>, body: {"keypair": {"name": "tempest-keypair-1648316757", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWuLGXeGCTY3v8H9JIuxTi81OuAVA4oBt2IgXXKAfD1eaDZM8NVdixa9LCXCa1JYf3Q7qJq8LyTprOuDy+ftnH3NMSgdrW0h2yQqg7TQw9AYq0QBHhTazBOpen8u5fHBw=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:29.840469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-28e7dd14-27e5-40da-b6ad-214434fd00a8 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:29.848248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-28e7dd14-27e5-40da-b6ad-214434fd00a8 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for user 66af7cc07bcb4e42ae9c84788bffa436 and project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:29.887517 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-28e7dd14-27e5-40da-b6ad-214434fd00a8 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.120948 Oct 05 17:40:29.888515 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1116/2121] 10.222.0.70 () {62 vars in 1199 bytes} [Wed Oct 5 17:40:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 05 17:40:29.903543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a2c3413-3f75-42e5-ab45-53a638c41b74 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f7779569dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:29.932403 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a2c3413-3f75-42e5-ab45-53a638c41b74 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-1648316757" status: 200 len: 513 microversion: 2.2 time: 0.034594 Oct 05 17:40:29.941735 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1117/2122] 10.222.0.70 () {60 vars in 1258 bytes} [Wed Oct 5 17:40:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1648316757 => generated 513 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:29.950890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f652c558-8fdd-4746-aa0d-372c10885c94 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f7774798ee0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:29.957632 n-d-835595-3 devstack@n-api.service[128844]: WARNING oslo_db.sqlalchemy.utils [None req-f652c558-8fdd-4746-aa0d-372c10885c94 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 17:40:29.965832 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f652c558-8fdd-4746-aa0d-372c10885c94 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.021011 Oct 05 17:40:29.974380 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1118/2123] 10.222.0.70 () {60 vars in 1177 bytes} [Wed Oct 5 17:40:29 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:29.981778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac6d69e1-770f-40d7-b1b8-530fda3a0a82 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f77747a7160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:29.991456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:DELETE=5 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:30.026702 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac6d69e1-770f-40d7-b1b8-530fda3a0a82 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648316757" status: 204 len: 0 microversion: 2.2 time: 0.048872 Oct 05 17:40:30.034035 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1119/2124] 10.222.0.70 () {60 vars in 1261 bytes} [Wed Oct 5 17:40:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1648316757 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:30.039751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-565500a4-fa9b-44d3-a7d2-9ab423cc53e6 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Action: 'create', calling method: .version_select at 0x7f7779465e50>, body: {"keypair": {"name": "tempest-keypair-106552548", "type": "x509"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:30.064133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-565500a4-fa9b-44d3-a7d2-9ab423cc53e6 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:30.069921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-565500a4-fa9b-44d3-a7d2-9ab423cc53e6 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for user 66af7cc07bcb4e42ae9c84788bffa436 and project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:30.094658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.processutils [None req-565500a4-fa9b-44d3-a7d2-9ab423cc53e6 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpqmufmgye/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpqmufmgye/temp.key -subj /CN=66af7cc07bcb4e42ae9c84788bffa436 -extensions v3_req_client {{(pid=128844) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 05 17:40:30.340943 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bb9e8bd1-e66d-4623-936e-ecbde68db608 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 61 microversion: 2.1 time: 0.848705 Oct 05 17:40:30.342017 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1006/2125] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:40:29 2022] PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 61 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 17:40:30.347993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-8a1581ff-5c39-4f4c-aacd-c6ae1ad52792 req-cc7a18a8-67e3-458e-9e00-0d60d0a8102f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73e084b-e4d1-4858-8a95-9f938ab0c177", "name": "network-vif-plugged", "status": "completed", "tag": "e1020a1c-b61e-4ea6-9d20-49f9f33a4b9f"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:30.400027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8a1581ff-5c39-4f4c-aacd-c6ae1ad52792 req-cc7a18a8-67e3-458e-9e00-0d60d0a8102f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:30.404027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8a1581ff-5c39-4f4c-aacd-c6ae1ad52792 req-cc7a18a8-67e3-458e-9e00-0d60d0a8102f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:30.407013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8a1581ff-5c39-4f4c-aacd-c6ae1ad52792 req-cc7a18a8-67e3-458e-9e00-0d60d0a8102f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:30.454688 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-8a1581ff-5c39-4f4c-aacd-c6ae1ad52792 req-cc7a18a8-67e3-458e-9e00-0d60d0a8102f service nova] Creating event network-vif-plugged:e1020a1c-b61e-4ea6-9d20-49f9f33a4b9f for instance a73e084b-e4d1-4858-8a95-9f938ab0c177 on n-h2-835595-3 Oct 05 17:40:30.457537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.processutils [None req-565500a4-fa9b-44d3-a7d2-9ab423cc53e6 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpqmufmgye/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpqmufmgye/temp.key -subj /CN=66af7cc07bcb4e42ae9c84788bffa436 -extensions v3_req_client" returned: 0 in 0.363s {{(pid=128844) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 05 17:40:30.459133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.processutils [None req-565500a4-fa9b-44d3-a7d2-9ab423cc53e6 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpqmufmgye/temp.key -password pass: {{(pid=128844) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 05 17:40:30.466256 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-8a1581ff-5c39-4f4c-aacd-c6ae1ad52792 req-cc7a18a8-67e3-458e-9e00-0d60d0a8102f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121873 Oct 05 17:40:30.468822 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1007/2126] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:30.532286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e949478-e944-428f-8515-957dc31dc9ec tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Calling method '.version_select at 0x7f7779543160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:30.565915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.processutils [None req-565500a4-fa9b-44d3-a7d2-9ab423cc53e6 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpqmufmgye/temp.key -password pass:" returned: 0 in 0.106s {{(pid=128844) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 05 17:40:30.671352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-565500a4-fa9b-44d3-a7d2-9ab423cc53e6 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:30.698256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-565500a4-fa9b-44d3-a7d2-9ab423cc53e6 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Getting quotas for user 66af7cc07bcb4e42ae9c84788bffa436 and project 1b47e53a5469472d96ebcdd627fad83a. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:30.741161 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-565500a4-fa9b-44d3-a7d2-9ab423cc53e6 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.705256 Oct 05 17:40:30.742214 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1120/2127] 10.222.0.70 () {62 vars in 1198 bytes} [Wed Oct 5 17:40:30 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 707 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:30.768515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d987842e-804e-45d5-a238-a7cdaef72cbc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:30.769240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d987842e-804e-45d5-a238-a7cdaef72cbc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:30.794220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d987842e-804e-45d5-a238-a7cdaef72cbc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:30.795685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d987842e-804e-45d5-a238-a7cdaef72cbc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:30.815110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d987842e-804e-45d5-a238-a7cdaef72cbc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:30.815953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d987842e-804e-45d5-a238-a7cdaef72cbc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:30.816436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d987842e-804e-45d5-a238-a7cdaef72cbc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:30.824406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d987842e-804e-45d5-a238-a7cdaef72cbc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:31.095539 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6e949478-e944-428f-8515-957dc31dc9ec tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "DELETE /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.603377 Oct 05 17:40:31.096449 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1008/2128] 10.222.0.70 () {58 vars in 1296 bytes} [Wed Oct 5 17:40:30 2022] DELETE /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata/os_version => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:31.101706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b3bef8b-c583-4aae-bfc8-c392b41f52a6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:31.101849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d987842e-804e-45d5-a238-a7cdaef72cbc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:31.102861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0b3bef8b-c583-4aae-bfc8-c392b41f52a6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:31.117185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b3bef8b-c583-4aae-bfc8-c392b41f52a6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:31.122715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b3bef8b-c583-4aae-bfc8-c392b41f52a6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:31.123617 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d987842e-804e-45d5-a238-a7cdaef72cbc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.376652 Oct 05 17:40:31.125524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b3bef8b-c583-4aae-bfc8-c392b41f52a6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:31.126670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b3bef8b-c583-4aae-bfc8-c392b41f52a6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:31.126854 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1121/2129] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:30 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:31.130377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b3bef8b-c583-4aae-bfc8-c392b41f52a6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:31.131083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b3bef8b-c583-4aae-bfc8-c392b41f52a6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:31.133907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4ebb99ae-89a8-47e3-abca-f1eabc5b9ebb tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f77794653a0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:31.154014 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4ebb99ae-89a8-47e3-abca-f1eabc5b9ebb tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs/tempest-keypair-106552548" status: 200 len: 1533 microversion: 2.2 time: 0.025273 Oct 05 17:40:31.161358 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1122/2130] 10.222.0.70 () {60 vars in 1255 bytes} [Wed Oct 5 17:40:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-106552548 => generated 1533 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:31.166790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f1d5d5d-b9c3-4f38-8986-4abad5be6268 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Calling method '.version_select at 0x7f77794334c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:31.223914 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f1d5d5d-b9c3-4f38-8986-4abad5be6268 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 37 microversion: 2.1 time: 0.061346 Oct 05 17:40:31.225639 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1123/2131] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:40:31 2022] GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 37 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:31.232954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-58bb8dba-2cc7-4a05-9ad2-9a11ac584c11 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f77747ccee0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:31.238042 n-d-835595-3 devstack@n-api.service[128844]: WARNING oslo_db.sqlalchemy.utils [None req-58bb8dba-2cc7-4a05-9ad2-9a11ac584c11 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 17:40:31.245221 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-58bb8dba-2cc7-4a05-9ad2-9a11ac584c11 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.018449 Oct 05 17:40:31.251292 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1124/2132] 10.222.0.70 () {60 vars in 1177 bytes} [Wed Oct 5 17:40:31 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:31.266534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ecbc1bf-7a18-4010-bc81-609127493a3a tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Action: 'update_all', calling method: .version_select at 0x7f77747c5dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:31.345126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9ecbc1bf-7a18-4010-bc81-609127493a3a tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:31.359090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9ecbc1bf-7a18-4010-bc81-609127493a3a tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for user d962e0f06258432194f4859459e6823a and project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:31.866092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0b3bef8b-c583-4aae-bfc8-c392b41f52a6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:31.880519 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0b3bef8b-c583-4aae-bfc8-c392b41f52a6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1314 microversion: 2.1 time: 0.782761 Oct 05 17:40:31.885581 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1009/2133] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:31 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:31.903146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d6035848-f527-43b3-9766-c1c87ab15bf3 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] Calling method '.version_select at 0x7f77795e39d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:31.933399 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ecbc1bf-7a18-4010-bc81-609127493a3a tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 61 microversion: 2.1 time: 0.664867 Oct 05 17:40:31.943579 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1125/2134] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:40:31 2022] PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 61 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:31.955420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9917c18-d5db-4905-8966-7384a9f627f7 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Calling method '.version_select at 0x7f77747cd1f0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:31.957573 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d6035848-f527-43b3-9766-c1c87ab15bf3 tempest-KeyPairsV22TestJSON-1466746529 tempest-KeyPairsV22TestJSON-1466746529-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-106552548" status: 204 len: 0 microversion: 2.2 time: 0.070482 Oct 05 17:40:31.958413 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1010/2135] 10.222.0.70 () {60 vars in 1258 bytes} [Wed Oct 5 17:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-106552548 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:40:32.051282 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b9917c18-d5db-4905-8966-7384a9f627f7 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.105301 Oct 05 17:40:32.052590 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1126/2136] 10.222.0.70 () {58 vars in 1290 bytes} [Wed Oct 5 17:40:31 2022] GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata/os_distro => generated 33 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:32.064457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b99cfa0-a2ab-4c96-81c7-e10877d16233 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Action: 'update_all', calling method: .version_select at 0x7f7779554c10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:32.152062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c60e548-41f7-42c6-9224-4f8a9afb0254 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:32.153710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c60e548-41f7-42c6-9224-4f8a9afb0254 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:32.155685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-8b99cfa0-a2ab-4c96-81c7-e10877d16233 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:32.169754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c60e548-41f7-42c6-9224-4f8a9afb0254 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:32.170849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-8b99cfa0-a2ab-4c96-81c7-e10877d16233 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for user d962e0f06258432194f4859459e6823a and project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:32.175076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c60e548-41f7-42c6-9224-4f8a9afb0254 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:32.175545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c60e548-41f7-42c6-9224-4f8a9afb0254 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:32.176296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c60e548-41f7-42c6-9224-4f8a9afb0254 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:32.176757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c60e548-41f7-42c6-9224-4f8a9afb0254 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:32.177188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c60e548-41f7-42c6-9224-4f8a9afb0254 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:32.647274 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b99cfa0-a2ab-4c96-81c7-e10877d16233 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 61 microversion: 2.1 time: 0.586708 Oct 05 17:40:32.647274 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1011/2137] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:40:32 2022] PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 61 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:32.656674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a27fe17e-6576-41b5-ac92-3387c6f7b2de tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Calling method '.version_select at 0x7f77795e3160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:32.739051 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a27fe17e-6576-41b5-ac92-3387c6f7b2de tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 61 microversion: 2.1 time: 0.086470 Oct 05 17:40:32.740458 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1012/2138] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:40:32 2022] GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 61 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:32.762219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9c60e548-41f7-42c6-9224-4f8a9afb0254 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:32.765839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f0dbe6d-493a-4bb0-8d10-15ae392308c2 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Action: 'update_all', calling method: .version_select at 0x7f7779553280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:32.780507 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c60e548-41f7-42c6-9224-4f8a9afb0254 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.633761 Oct 05 17:40:32.788138 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1127/2139] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:32 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:32.887602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-0f0dbe6d-493a-4bb0-8d10-15ae392308c2 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:32.898376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-0f0dbe6d-493a-4bb0-8d10-15ae392308c2 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for user d962e0f06258432194f4859459e6823a and project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:32.917719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54f05022-1ed9-40bc-abd0-9ff746cbda6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:32.918372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54f05022-1ed9-40bc-abd0-9ff746cbda6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:32.939488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f05022-1ed9-40bc-abd0-9ff746cbda6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:32.940071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f05022-1ed9-40bc-abd0-9ff746cbda6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:32.945919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f05022-1ed9-40bc-abd0-9ff746cbda6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:32.951694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f05022-1ed9-40bc-abd0-9ff746cbda6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:32.952227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f05022-1ed9-40bc-abd0-9ff746cbda6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:32.952683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f05022-1ed9-40bc-abd0-9ff746cbda6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:33.189698 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f0dbe6d-493a-4bb0-8d10-15ae392308c2 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 61 microversion: 2.1 time: 0.432048 Oct 05 17:40:33.190785 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1013/2140] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:40:32 2022] PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 61 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:33.196582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-18816b79-286c-4ba2-903c-d283b12d2c75 req-23d18f25-dfe8-45b3-a7e2-7afbf1fb97d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e", "tag": "167ff7e5-e2af-40a1-bbd0-618ecfb3a035"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:33.218163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-18816b79-286c-4ba2-903c-d283b12d2c75 req-23d18f25-dfe8-45b3-a7e2-7afbf1fb97d3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:33.218695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-18816b79-286c-4ba2-903c-d283b12d2c75 req-23d18f25-dfe8-45b3-a7e2-7afbf1fb97d3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:33.219123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-18816b79-286c-4ba2-903c-d283b12d2c75 req-23d18f25-dfe8-45b3-a7e2-7afbf1fb97d3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:33.236266 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-18816b79-286c-4ba2-903c-d283b12d2c75 req-23d18f25-dfe8-45b3-a7e2-7afbf1fb97d3 service nova] Creating event network-changed:167ff7e5-e2af-40a1-bbd0-618ecfb3a035 for instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e on n-h1-835595-3 Oct 05 17:40:33.244417 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-18816b79-286c-4ba2-903c-d283b12d2c75 req-23d18f25-dfe8-45b3-a7e2-7afbf1fb97d3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052189 Oct 05 17:40:33.246150 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1014/2141] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:33.253276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fce3a1bc-f102-4b8c-81cc-a9d8b7debb3e tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Action: 'update_all', calling method: .version_select at 0x7f777956b8b0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:33.359354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-fce3a1bc-f102-4b8c-81cc-a9d8b7debb3e tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:33.384667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-fce3a1bc-f102-4b8c-81cc-a9d8b7debb3e tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for user d962e0f06258432194f4859459e6823a and project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:33.896769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54f05022-1ed9-40bc-abd0-9ff746cbda6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:33.913023 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54f05022-1ed9-40bc-abd0-9ff746cbda6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1501 microversion: 2.1 time: 0.999069 Oct 05 17:40:33.914002 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1128/2142] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:32 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1501 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:33.926691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-315d841d-50af-4052-9e4d-45235ccf26ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:33.927802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-315d841d-50af-4052-9e4d-45235ccf26ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:33.938012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-315d841d-50af-4052-9e4d-45235ccf26ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:33.949007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-315d841d-50af-4052-9e4d-45235ccf26ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:33.952353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-315d841d-50af-4052-9e4d-45235ccf26ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:33.953388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-315d841d-50af-4052-9e4d-45235ccf26ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:33.963885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-315d841d-50af-4052-9e4d-45235ccf26ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:33.964591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-315d841d-50af-4052-9e4d-45235ccf26ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:34.039876 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fce3a1bc-f102-4b8c-81cc-a9d8b7debb3e tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 64 microversion: 2.1 time: 0.791439 Oct 05 17:40:34.041053 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1015/2143] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:40:33 2022] PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 64 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:34.047905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1d5f23f4-289a-4b5b-8ee8-4b4960a766d3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:34.065176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d5f23f4-289a-4b5b-8ee8-4b4960a766d3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:34.065995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d5f23f4-289a-4b5b-8ee8-4b4960a766d3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:34.066676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d5f23f4-289a-4b5b-8ee8-4b4960a766d3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:34.158307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1d5f23f4-289a-4b5b-8ee8-4b4960a766d3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Going to try to stop instance {{(pid=128843) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 17:40:34.262985 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1d5f23f4-289a-4b5b-8ee8-4b4960a766d3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177/action" status: 202 len: 0 microversion: 2.1 time: 0.218849 Oct 05 17:40:34.263840 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1016/2144] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:40:34 2022] POST /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:40:34.284725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7631d07a-c6f8-4fb3-836c-f8bc77cb4a71 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Calling method '.version_select at 0x7f77795fb5e0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:34.321053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-315d841d-50af-4052-9e4d-45235ccf26ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:34.336532 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-315d841d-50af-4052-9e4d-45235ccf26ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.416414 Oct 05 17:40:34.345639 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7631d07a-c6f8-4fb3-836c-f8bc77cb4a71 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 64 microversion: 2.1 time: 0.080322 Oct 05 17:40:34.348831 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1129/2145] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:33 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:34.354400 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1017/2146] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:40:34 2022] GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 64 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:34.359889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-19f39ccc-e082-495a-afe5-76084e904bcf tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Action: 'update_all', calling method: .version_select at 0x7f77795543a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:34.366561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87bad131-ca8a-4b16-811c-1480eec80944 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:34.367627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-87bad131-ca8a-4b16-811c-1480eec80944 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:34.383908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bad131-ca8a-4b16-811c-1480eec80944 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:34.384644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bad131-ca8a-4b16-811c-1480eec80944 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:34.385377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bad131-ca8a-4b16-811c-1480eec80944 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:34.388994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bad131-ca8a-4b16-811c-1480eec80944 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:34.389681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bad131-ca8a-4b16-811c-1480eec80944 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:34.391386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87bad131-ca8a-4b16-811c-1480eec80944 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:34.452545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-19f39ccc-e082-495a-afe5-76084e904bcf tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:34.459166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-19f39ccc-e082-495a-afe5-76084e904bcf tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for user d962e0f06258432194f4859459e6823a and project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:35.051292 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-19f39ccc-e082-495a-afe5-76084e904bcf tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 61 microversion: 2.1 time: 0.695606 Oct 05 17:40:35.058477 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1018/2147] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:40:34 2022] PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 61 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:35.081141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c22534df-210d-4301-9a71-db1176f518c8 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Action: 'update', calling method: .version_select at 0x7f77795e3dc0>, body: {"meta": {"os_version": "alt"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:35.165091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c22534df-210d-4301-9a71-db1176f518c8 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:35.174353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c22534df-210d-4301-9a71-db1176f518c8 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for user d962e0f06258432194f4859459e6823a and project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:35.182479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-87bad131-ca8a-4b16-811c-1480eec80944 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:35.194835 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87bad131-ca8a-4b16-811c-1480eec80944 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.843025 Oct 05 17:40:35.196626 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1130/2148] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:34 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:35.361489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1bfc487f-09f6-43e1-b52b-2f7ea3fcb73e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:35.362953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1bfc487f-09f6-43e1-b52b-2f7ea3fcb73e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:35.377261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfc487f-09f6-43e1-b52b-2f7ea3fcb73e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:35.379892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfc487f-09f6-43e1-b52b-2f7ea3fcb73e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:35.385775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfc487f-09f6-43e1-b52b-2f7ea3fcb73e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:35.389695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfc487f-09f6-43e1-b52b-2f7ea3fcb73e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:35.390570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfc487f-09f6-43e1-b52b-2f7ea3fcb73e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:35.392828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfc487f-09f6-43e1-b52b-2f7ea3fcb73e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:35.857265 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c22534df-210d-4301-9a71-db1176f518c8 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.796840 Oct 05 17:40:35.858870 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1019/2149] 10.222.0.70 () {60 vars in 1313 bytes} [Wed Oct 5 17:40:35 2022] PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata/os_version => generated 31 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:35.870161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-282659ff-d97d-417a-b4ad-6dad39e4d0d8 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Calling method '.version_select at 0x7f777956b8b0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:35.978059 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-282659ff-d97d-417a-b4ad-6dad39e4d0d8 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 58 microversion: 2.1 time: 0.113227 Oct 05 17:40:35.979959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1bfc487f-09f6-43e1-b52b-2f7ea3fcb73e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:35.986586 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1020/2150] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:40:35 2022] GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 58 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 17:40:35.997058 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1bfc487f-09f6-43e1-b52b-2f7ea3fcb73e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.640145 Oct 05 17:40:35.997608 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1131/2151] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:35 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:36.025879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b0f4f5a-3b41-49c3-b462-61dc60314564 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Action: 'update_all', calling method: .version_select at 0x7f777956b430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:36.133216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3b0f4f5a-3b41-49c3-b462-61dc60314564 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:36.149077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3b0f4f5a-3b41-49c3-b462-61dc60314564 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for user d962e0f06258432194f4859459e6823a and project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:36.222959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76494b7b-dbf0-4ca5-a789-20f7fa102d7b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:36.223871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-76494b7b-dbf0-4ca5-a789-20f7fa102d7b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:36.246587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76494b7b-dbf0-4ca5-a789-20f7fa102d7b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:36.247095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76494b7b-dbf0-4ca5-a789-20f7fa102d7b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:36.247550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76494b7b-dbf0-4ca5-a789-20f7fa102d7b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:36.248253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76494b7b-dbf0-4ca5-a789-20f7fa102d7b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:36.248718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76494b7b-dbf0-4ca5-a789-20f7fa102d7b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:36.249146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76494b7b-dbf0-4ca5-a789-20f7fa102d7b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:36.730623 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b0f4f5a-3b41-49c3-b462-61dc60314564 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 61 microversion: 2.1 time: 0.735443 Oct 05 17:40:36.735361 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1021/2152] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:40:35 2022] PUT /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 61 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 17:40:36.749201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d480f293-f3a0-4044-83b5-3e8b693926e6 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Action: 'create', calling method: .version_select at 0x7f7779543d30>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:36.828351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-d480f293-f3a0-4044-83b5-3e8b693926e6 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:36.835129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-d480f293-f3a0-4044-83b5-3e8b693926e6 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Getting quotas for user d962e0f06258432194f4859459e6823a and project 25b17cb81a1243fa8c57b2adc3188762. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:37.098525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76494b7b-dbf0-4ca5-a789-20f7fa102d7b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:37.121743 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76494b7b-dbf0-4ca5-a789-20f7fa102d7b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.900612 Oct 05 17:40:37.137511 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1132/2153] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:36 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:37.138403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0cab7e19-114c-4d06-a954-03de12d70f7f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:37.138715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0cab7e19-114c-4d06-a954-03de12d70f7f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:37.160402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7e19-114c-4d06-a954-03de12d70f7f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:37.160903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7e19-114c-4d06-a954-03de12d70f7f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:37.161346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7e19-114c-4d06-a954-03de12d70f7f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:37.168404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7e19-114c-4d06-a954-03de12d70f7f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:37.168933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7e19-114c-4d06-a954-03de12d70f7f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:37.172561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7e19-114c-4d06-a954-03de12d70f7f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:37.462044 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d480f293-f3a0-4044-83b5-3e8b693926e6 tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "POST /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 85 microversion: 2.1 time: 0.724779 Oct 05 17:40:37.463044 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1022/2154] 10.222.0.70 () {60 vars in 1281 bytes} [Wed Oct 5 17:40:36 2022] POST /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 85 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:40:37.474328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6db3b2cd-122d-47a8-97c9-9a0431813a3e tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] Calling method '.version_select at 0x7f77795d9b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:37.545613 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6db3b2cd-122d-47a8-97c9-9a0431813a3e tempest-ImagesMetadataTestJSON-2131874018 tempest-ImagesMetadataTestJSON-2131874018-project] 10.222.0.70 "GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata" status: 200 len: 85 microversion: 2.1 time: 0.076059 Oct 05 17:40:37.547235 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1023/2155] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:40:37 2022] GET /compute/v2.1/images/075d9e8f-2dc3-4976-b0cc-e182dddbf799/metadata => generated 85 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 17:40:38.146829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ce23b93-73d3-41e3-89ad-1bd61bd4bcbd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:38.148923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7ce23b93-73d3-41e3-89ad-1bd61bd4bcbd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:38.166057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce23b93-73d3-41e3-89ad-1bd61bd4bcbd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:38.167059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce23b93-73d3-41e3-89ad-1bd61bd4bcbd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:38.169475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce23b93-73d3-41e3-89ad-1bd61bd4bcbd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:38.174854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce23b93-73d3-41e3-89ad-1bd61bd4bcbd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:38.175676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce23b93-73d3-41e3-89ad-1bd61bd4bcbd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:38.177674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce23b93-73d3-41e3-89ad-1bd61bd4bcbd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:38.555040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0cab7e19-114c-4d06-a954-03de12d70f7f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:38.593034 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0cab7e19-114c-4d06-a954-03de12d70f7f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 1.464035 Oct 05 17:40:38.593724 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1133/2156] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:37 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:38.744496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7ce23b93-73d3-41e3-89ad-1bd61bd4bcbd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:38.758240 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ce23b93-73d3-41e3-89ad-1bd61bd4bcbd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.616792 Oct 05 17:40:38.758876 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1024/2157] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:38 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:39.621228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e1fd52cd-b557-4120-84bf-b6bdd1b25784 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:39.622605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e1fd52cd-b557-4120-84bf-b6bdd1b25784 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:39.630923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1fd52cd-b557-4120-84bf-b6bdd1b25784 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:39.632378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1fd52cd-b557-4120-84bf-b6bdd1b25784 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:39.632978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1fd52cd-b557-4120-84bf-b6bdd1b25784 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:39.633861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1fd52cd-b557-4120-84bf-b6bdd1b25784 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:39.634574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1fd52cd-b557-4120-84bf-b6bdd1b25784 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:39.635132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1fd52cd-b557-4120-84bf-b6bdd1b25784 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:39.782575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-286737e2-003a-4f0b-bc16-8319692cc07c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:39.783877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-286737e2-003a-4f0b-bc16-8319692cc07c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:39.802434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-286737e2-003a-4f0b-bc16-8319692cc07c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:39.803189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-286737e2-003a-4f0b-bc16-8319692cc07c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:39.803771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-286737e2-003a-4f0b-bc16-8319692cc07c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:39.804639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-286737e2-003a-4f0b-bc16-8319692cc07c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:39.805371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-286737e2-003a-4f0b-bc16-8319692cc07c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:39.805923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-286737e2-003a-4f0b-bc16-8319692cc07c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:40.256041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-286737e2-003a-4f0b-bc16-8319692cc07c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:40.275313 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-286737e2-003a-4f0b-bc16-8319692cc07c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.497792 Oct 05 17:40:40.275933 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1025/2158] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:39 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:40.436167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e1fd52cd-b557-4120-84bf-b6bdd1b25784 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:40.450434 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e1fd52cd-b557-4120-84bf-b6bdd1b25784 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.834140 Oct 05 17:40:40.453527 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1134/2159] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:39 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:40.805045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1597373915", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "f3e9673e-31b1-48c7-9c8e-80ca5670c7ce"}, {"uuid": "4f2b7e93-7a4e-4e11-8846-56b2677bd34b"}, {"uuid": "f3e9673e-31b1-48c7-9c8e-80ca5670c7ce"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:40.822269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:40.998873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] validate_networks() for [('f3e9673e-31b1-48c7-9c8e-80ca5670c7ce', None, None, None, None, None), ('4f2b7e93-7a4e-4e11-8846-56b2677bd34b', None, None, None, None, None), ('f3e9673e-31b1-48c7-9c8e-80ca5670c7ce', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:40:41.302219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-00b95bae-afe3-4f0c-85c4-b6d57381e941 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:41.304206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-00b95bae-afe3-4f0c-85c4-b6d57381e941 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:41.330516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00b95bae-afe3-4f0c-85c4-b6d57381e941 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:41.331458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00b95bae-afe3-4f0c-85c4-b6d57381e941 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:41.333813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00b95bae-afe3-4f0c-85c4-b6d57381e941 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:41.336012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00b95bae-afe3-4f0c-85c4-b6d57381e941 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:41.338535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00b95bae-afe3-4f0c-85c4-b6d57381e941 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:41.339577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00b95bae-afe3-4f0c-85c4-b6d57381e941 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:41.382094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=48 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:41.825602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-00b95bae-afe3-4f0c-85c4-b6d57381e941 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:41.842183 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-00b95bae-afe3-4f0c-85c4-b6d57381e941 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.546309 Oct 05 17:40:41.842834 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1135/2160] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:41 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:41.859184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e2af1d7e-de99-433c-a2c2-f6d798f8d2eb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:41.860104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e2af1d7e-de99-433c-a2c2-f6d798f8d2eb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:41.882532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2af1d7e-de99-433c-a2c2-f6d798f8d2eb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:41.883036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2af1d7e-de99-433c-a2c2-f6d798f8d2eb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:41.883471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2af1d7e-de99-433c-a2c2-f6d798f8d2eb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:41.891608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2af1d7e-de99-433c-a2c2-f6d798f8d2eb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:41.892124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2af1d7e-de99-433c-a2c2-f6d798f8d2eb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:41.892564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2af1d7e-de99-433c-a2c2-f6d798f8d2eb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:42.205109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e2af1d7e-de99-433c-a2c2-f6d798f8d2eb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:42.226359 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e2af1d7e-de99-433c-a2c2-f6d798f8d2eb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.377399 Oct 05 17:40:42.229654 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1136/2161] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:41 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:42.871141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c863ba72-ee62-46e9-8e46-58373be1e2e2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:42.871783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c863ba72-ee62-46e9-8e46-58373be1e2e2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:42.915014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c863ba72-ee62-46e9-8e46-58373be1e2e2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:42.915896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c863ba72-ee62-46e9-8e46-58373be1e2e2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:42.917984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c863ba72-ee62-46e9-8e46-58373be1e2e2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:42.921379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c863ba72-ee62-46e9-8e46-58373be1e2e2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:42.924960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c863ba72-ee62-46e9-8e46-58373be1e2e2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:42.926216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c863ba72-ee62-46e9-8e46-58373be1e2e2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:43.958208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c863ba72-ee62-46e9-8e46-58373be1e2e2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:43.971202 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c863ba72-ee62-46e9-8e46-58373be1e2e2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 1.105773 Oct 05 17:40:43.972116 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1137/2162] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:42 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:43.991172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9df37ccf-8d79-4f9a-9e49-552911f8593f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:43.992191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9df37ccf-8d79-4f9a-9e49-552911f8593f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:44.012441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9df37ccf-8d79-4f9a-9e49-552911f8593f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:44.013038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9df37ccf-8d79-4f9a-9e49-552911f8593f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:44.013704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9df37ccf-8d79-4f9a-9e49-552911f8593f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:44.014777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9df37ccf-8d79-4f9a-9e49-552911f8593f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:44.015453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9df37ccf-8d79-4f9a-9e49-552911f8593f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:44.016091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9df37ccf-8d79-4f9a-9e49-552911f8593f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:44.588516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9df37ccf-8d79-4f9a-9e49-552911f8593f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:44.612609 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9df37ccf-8d79-4f9a-9e49-552911f8593f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.626607 Oct 05 17:40:44.633790 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1138/2163] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:43 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:44.853543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:40:44.853543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:40:44.854161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:40:44.854494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:40:44.855963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:40:44.877650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=57 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:44.896143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:44.898589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:44.899555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:44.911205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:44.917678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:44.920641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:44.995334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Getting quotas for project 8ac9093ae0534edb92b2e2b007c8926a. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:44.999063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-674a7152-3df3-4909-bff7-6f5aba6a4195 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:45.000518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-674a7152-3df3-4909-bff7-6f5aba6a4195 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:45.013847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Getting quotas for user 6aa6b735fc434e23b04a45979eeadafb and project 8ac9093ae0534edb92b2e2b007c8926a. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:45.034924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674a7152-3df3-4909-bff7-6f5aba6a4195 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:45.041843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674a7152-3df3-4909-bff7-6f5aba6a4195 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:45.045294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674a7152-3df3-4909-bff7-6f5aba6a4195 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:45.046376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674a7152-3df3-4909-bff7-6f5aba6a4195 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:45.049380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674a7152-3df3-4909-bff7-6f5aba6a4195 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:45.051838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674a7152-3df3-4909-bff7-6f5aba6a4195 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:45.054170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:40:45.059201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:40:45.276933 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [a7b70a10-373c-4631-a9c7-4b714321832a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 17:40:45.679828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-674a7152-3df3-4909-bff7-6f5aba6a4195 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:45.693870 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-674a7152-3df3-4909-bff7-6f5aba6a4195 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.701454 Oct 05 17:40:45.695246 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1139/2164] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:44 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:45.700917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a1c43ad0-fa17-4b49-8321-d8dc1466ebc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:45.701833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a1c43ad0-fa17-4b49-8321-d8dc1466ebc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:45.708742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1c43ad0-fa17-4b49-8321-d8dc1466ebc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:45.709717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1c43ad0-fa17-4b49-8321-d8dc1466ebc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:45.710451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1c43ad0-fa17-4b49-8321-d8dc1466ebc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:45.711322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1c43ad0-fa17-4b49-8321-d8dc1466ebc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:45.711918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1c43ad0-fa17-4b49-8321-d8dc1466ebc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:45.712468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1c43ad0-fa17-4b49-8321-d8dc1466ebc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:45.754094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:46.174297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a1c43ad0-fa17-4b49-8321-d8dc1466ebc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:46.202986 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a1c43ad0-fa17-4b49-8321-d8dc1466ebc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.506120 Oct 05 17:40:46.206124 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1140/2165] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:45 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:46.213819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b2fe6459-bcc5-4c5c-9879-a20d1fc5d5e7 req-8ec13073-4d86-4660-bbec-20f9dc6057e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e", "name": "network-vif-plugged", "status": "completed", "tag": "167ff7e5-e2af-40a1-bbd0-618ecfb3a035"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:46.248516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b2fe6459-bcc5-4c5c-9879-a20d1fc5d5e7 req-8ec13073-4d86-4660-bbec-20f9dc6057e8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:46.251050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b2fe6459-bcc5-4c5c-9879-a20d1fc5d5e7 req-8ec13073-4d86-4660-bbec-20f9dc6057e8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:46.252730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b2fe6459-bcc5-4c5c-9879-a20d1fc5d5e7 req-8ec13073-4d86-4660-bbec-20f9dc6057e8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:46.289296 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [a7b70a10-373c-4631-a9c7-4b714321832a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39014. Oct 05 17:40:46.296104 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-87b2c594-59bf-4316-b704-fda46d898b6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.497023 Oct 05 17:40:46.297496 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1026/2166] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:40:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 5499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:40:46.313504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5a480ef2-6337-42a4-b1b6-d83097bacfc6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:46.317832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5a480ef2-6337-42a4-b1b6-d83097bacfc6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:46.321790 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b2fe6459-bcc5-4c5c-9879-a20d1fc5d5e7 req-8ec13073-4d86-4660-bbec-20f9dc6057e8 service nova] Creating event network-vif-plugged:167ff7e5-e2af-40a1-bbd0-618ecfb3a035 for instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e on n-h1-835595-3 Oct 05 17:40:46.370672 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b2fe6459-bcc5-4c5c-9879-a20d1fc5d5e7 req-8ec13073-4d86-4660-bbec-20f9dc6057e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137766 Oct 05 17:40:46.389412 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1141/2167] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:46.726588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40499a36-0a6a-4725-8e5b-41a0992828c5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:46.727947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-40499a36-0a6a-4725-8e5b-41a0992828c5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:46.776201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40499a36-0a6a-4725-8e5b-41a0992828c5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:46.787381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40499a36-0a6a-4725-8e5b-41a0992828c5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:46.796878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40499a36-0a6a-4725-8e5b-41a0992828c5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:46.802867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40499a36-0a6a-4725-8e5b-41a0992828c5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:46.803403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40499a36-0a6a-4725-8e5b-41a0992828c5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:46.803938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40499a36-0a6a-4725-8e5b-41a0992828c5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:46.919033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5a480ef2-6337-42a4-b1b6-d83097bacfc6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:46.926702 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5a480ef2-6337-42a4-b1b6-d83097bacfc6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1213 microversion: 2.1 time: 0.621527 Oct 05 17:40:46.931526 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1027/2168] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:46 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1213 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:47.228520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-87a9e4e7-b542-45f6-9c99-e1e11552567b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:47.229417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-87a9e4e7-b542-45f6-9c99-e1e11552567b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:47.244705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87a9e4e7-b542-45f6-9c99-e1e11552567b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:47.246131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87a9e4e7-b542-45f6-9c99-e1e11552567b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:47.250134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87a9e4e7-b542-45f6-9c99-e1e11552567b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:47.252793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87a9e4e7-b542-45f6-9c99-e1e11552567b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:47.253967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87a9e4e7-b542-45f6-9c99-e1e11552567b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:47.256207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87a9e4e7-b542-45f6-9c99-e1e11552567b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:47.497722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40499a36-0a6a-4725-8e5b-41a0992828c5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:47.511326 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-40499a36-0a6a-4725-8e5b-41a0992828c5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.792553 Oct 05 17:40:47.512595 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1142/2169] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:46 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:47.964657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c57a17ad-4743-4cd9-baa8-988e027008c3 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:47.968499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c57a17ad-4743-4cd9-baa8-988e027008c3 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:47.985088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c57a17ad-4743-4cd9-baa8-988e027008c3 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:47.988996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c57a17ad-4743-4cd9-baa8-988e027008c3 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:47.989748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c57a17ad-4743-4cd9-baa8-988e027008c3 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:47.990958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c57a17ad-4743-4cd9-baa8-988e027008c3 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:47.991629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c57a17ad-4743-4cd9-baa8-988e027008c3 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:47.994424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c57a17ad-4743-4cd9-baa8-988e027008c3 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:48.163284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-87a9e4e7-b542-45f6-9c99-e1e11552567b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:48.184100 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-87a9e4e7-b542-45f6-9c99-e1e11552567b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1307 microversion: 2.1 time: 0.957124 Oct 05 17:40:48.187345 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1028/2170] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:47 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1307 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:48.205671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c57a17ad-4743-4cd9-baa8-988e027008c3 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:48.228760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c57a17ad-4743-4cd9-baa8-988e027008c3 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1209 microversion: 2.1 time: 0.270913 Oct 05 17:40:48.229473 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1143/2171] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:47 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1209 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:48.537348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-354d23d8-5732-4e0c-9655-3c85537a8f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:48.538217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-354d23d8-5732-4e0c-9655-3c85537a8f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:48.557415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-354d23d8-5732-4e0c-9655-3c85537a8f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:48.560778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-354d23d8-5732-4e0c-9655-3c85537a8f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:48.561434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-354d23d8-5732-4e0c-9655-3c85537a8f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:48.563183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-354d23d8-5732-4e0c-9655-3c85537a8f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:48.568816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-354d23d8-5732-4e0c-9655-3c85537a8f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:48.569558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-354d23d8-5732-4e0c-9655-3c85537a8f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:49.209834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-06fd268d-3c48-4f35-893c-e0de8cd98492 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:49.211938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-06fd268d-3c48-4f35-893c-e0de8cd98492 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:49.229111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06fd268d-3c48-4f35-893c-e0de8cd98492 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:49.229664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06fd268d-3c48-4f35-893c-e0de8cd98492 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:49.230108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06fd268d-3c48-4f35-893c-e0de8cd98492 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:49.230909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06fd268d-3c48-4f35-893c-e0de8cd98492 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:49.231362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06fd268d-3c48-4f35-893c-e0de8cd98492 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:49.231814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06fd268d-3c48-4f35-893c-e0de8cd98492 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:49.408996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-354d23d8-5732-4e0c-9655-3c85537a8f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:49.448963 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-354d23d8-5732-4e0c-9655-3c85537a8f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.895584 Oct 05 17:40:49.454082 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1029/2172] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:48 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:49.475101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76130645-a828-4cbc-871a-10714bb70090 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:49.475966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-76130645-a828-4cbc-871a-10714bb70090 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:49.490749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76130645-a828-4cbc-871a-10714bb70090 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:49.491240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76130645-a828-4cbc-871a-10714bb70090 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:49.491666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76130645-a828-4cbc-871a-10714bb70090 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:49.492369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76130645-a828-4cbc-871a-10714bb70090 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:49.492815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76130645-a828-4cbc-871a-10714bb70090 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:49.493232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76130645-a828-4cbc-871a-10714bb70090 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:49.611463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-76130645-a828-4cbc-871a-10714bb70090 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:49.627001 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76130645-a828-4cbc-871a-10714bb70090 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1271 microversion: 2.1 time: 0.169848 Oct 05 17:40:49.642862 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1030/2173] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:49 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:50.362783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-06fd268d-3c48-4f35-893c-e0de8cd98492 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:50.376446 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-06fd268d-3c48-4f35-893c-e0de8cd98492 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1488 microversion: 2.1 time: 1.169421 Oct 05 17:40:50.377561 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1144/2174] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:49 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1488 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:50.410848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cdcfaf16-35ce-47f7-ac92-846ec4e54099 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:50.412692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cdcfaf16-35ce-47f7-ac92-846ec4e54099 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:50.425761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf16-35ce-47f7-ac92-846ec4e54099 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:50.426865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf16-35ce-47f7-ac92-846ec4e54099 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:50.428493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf16-35ce-47f7-ac92-846ec4e54099 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:50.430469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf16-35ce-47f7-ac92-846ec4e54099 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:50.432672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf16-35ce-47f7-ac92-846ec4e54099 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:50.433360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdcfaf16-35ce-47f7-ac92-846ec4e54099 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:50.478381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a56f1d80-c1c7-43aa-ab35-61556cef906b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:50.479009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a56f1d80-c1c7-43aa-ab35-61556cef906b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:50.509833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a56f1d80-c1c7-43aa-ab35-61556cef906b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:50.510395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a56f1d80-c1c7-43aa-ab35-61556cef906b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:50.510884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a56f1d80-c1c7-43aa-ab35-61556cef906b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:50.526408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a56f1d80-c1c7-43aa-ab35-61556cef906b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:50.526918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a56f1d80-c1c7-43aa-ab35-61556cef906b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:50.527373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a56f1d80-c1c7-43aa-ab35-61556cef906b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:50.712646 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cdcfaf16-35ce-47f7-ac92-846ec4e54099 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e/action" status: 202 len: 0 microversion: 2.1 time: 0.312655 Oct 05 17:40:50.714417 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1031/2175] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:40:50 2022] POST /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:40:50.722310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fb4169ed-1186-46a5-87f9-1b64cc91b4f6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:50.723649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fb4169ed-1186-46a5-87f9-1b64cc91b4f6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:50.733131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb4169ed-1186-46a5-87f9-1b64cc91b4f6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:50.734099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb4169ed-1186-46a5-87f9-1b64cc91b4f6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:50.734889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb4169ed-1186-46a5-87f9-1b64cc91b4f6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:50.736035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb4169ed-1186-46a5-87f9-1b64cc91b4f6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:50.736749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb4169ed-1186-46a5-87f9-1b64cc91b4f6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:50.739040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb4169ed-1186-46a5-87f9-1b64cc91b4f6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:50.969578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fb4169ed-1186-46a5-87f9-1b64cc91b4f6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:50.985415 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fb4169ed-1186-46a5-87f9-1b64cc91b4f6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1271 microversion: 2.1 time: 0.269208 Oct 05 17:40:51.007218 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1032/2176] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:50 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1271 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:51.018127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7aefd841-8aa9-4858-bdd4-3d51c2759536 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:51.020649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7aefd841-8aa9-4858-bdd4-3d51c2759536 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:51.040058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aefd841-8aa9-4858-bdd4-3d51c2759536 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:51.040736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aefd841-8aa9-4858-bdd4-3d51c2759536 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:51.041327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aefd841-8aa9-4858-bdd4-3d51c2759536 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:51.042378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aefd841-8aa9-4858-bdd4-3d51c2759536 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:51.042978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aefd841-8aa9-4858-bdd4-3d51c2759536 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:51.043554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aefd841-8aa9-4858-bdd4-3d51c2759536 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:51.282902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a56f1d80-c1c7-43aa-ab35-61556cef906b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:51.298397 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a56f1d80-c1c7-43aa-ab35-61556cef906b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.824241 Oct 05 17:40:51.299099 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1145/2177] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:50 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:52.018996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ecb5524-69c9-41b1-bc89-39f5677a1b5c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:52.019701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ecb5524-69c9-41b1-bc89-39f5677a1b5c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:52.033889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ecb5524-69c9-41b1-bc89-39f5677a1b5c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:52.036557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ecb5524-69c9-41b1-bc89-39f5677a1b5c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:52.041380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ecb5524-69c9-41b1-bc89-39f5677a1b5c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:52.042457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ecb5524-69c9-41b1-bc89-39f5677a1b5c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:52.043086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ecb5524-69c9-41b1-bc89-39f5677a1b5c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:52.043666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ecb5524-69c9-41b1-bc89-39f5677a1b5c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:52.255213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7aefd841-8aa9-4858-bdd4-3d51c2759536 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:52.271799 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7aefd841-8aa9-4858-bdd4-3d51c2759536 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 200 len: 1473 microversion: 2.1 time: 1.263278 Oct 05 17:40:52.275307 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1033/2178] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:51 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 1473 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:52.302788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fe92cfe5-c418-470c-be7e-a4880363e4ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1798157817"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:52.308989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fe92cfe5-c418-470c-be7e-a4880363e4ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:52.340262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe92cfe5-c418-470c-be7e-a4880363e4ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:52.340989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe92cfe5-c418-470c-be7e-a4880363e4ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:52.341429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe92cfe5-c418-470c-be7e-a4880363e4ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:52.342139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe92cfe5-c418-470c-be7e-a4880363e4ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:52.345475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe92cfe5-c418-470c-be7e-a4880363e4ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:52.345475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe92cfe5-c418-470c-be7e-a4880363e4ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:52.863263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ecb5524-69c9-41b1-bc89-39f5677a1b5c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:52.879705 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ecb5524-69c9-41b1-bc89-39f5677a1b5c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1313 microversion: 2.1 time: 0.864663 Oct 05 17:40:52.895291 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1146/2179] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:52 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1313 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:52.913311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c075fc78-8433-449b-a231-1f67f6ec5d1e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:52.920930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c075fc78-8433-449b-a231-1f67f6ec5d1e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:52.943836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:52.946112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c075fc78-8433-449b-a231-1f67f6ec5d1e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:52.946549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c075fc78-8433-449b-a231-1f67f6ec5d1e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:52.947166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c075fc78-8433-449b-a231-1f67f6ec5d1e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:52.948122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c075fc78-8433-449b-a231-1f67f6ec5d1e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:52.948791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c075fc78-8433-449b-a231-1f67f6ec5d1e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:52.949411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c075fc78-8433-449b-a231-1f67f6ec5d1e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:52.974033 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fe92cfe5-c418-470c-be7e-a4880363e4ff tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e/action" status: 202 len: 0 microversion: 2.1 time: 0.675194 Oct 05 17:40:52.983840 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1034/2180] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:40:52 2022] POST /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 05 17:40:53.609826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-320441534", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "9110ba11-2b5a-4ff9-a7cb-a12763f98ebe"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:40:53.766956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] validate_networks() for [('9110ba11-2b5a-4ff9-a7cb-a12763f98ebe', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:40:54.883573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c075fc78-8433-449b-a231-1f67f6ec5d1e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:54.894856 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c075fc78-8433-449b-a231-1f67f6ec5d1e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 1.997833 Oct 05 17:40:54.895464 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1147/2181] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:52 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:54.906642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a411adb2-a08b-4c19-9103-ee0dd7adc9e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77747cc4c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:54.959145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:40:55.014086 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a411adb2-a08b-4c19-9103-ee0dd7adc9e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.114565 Oct 05 17:40:55.014696 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1148/2182] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:54 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:55.028938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d414105-9db4-4a5d-b81d-e297870eccf2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:55.036201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d414105-9db4-4a5d-b81d-e297870eccf2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:55.064873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d414105-9db4-4a5d-b81d-e297870eccf2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:55.065380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d414105-9db4-4a5d-b81d-e297870eccf2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:55.065819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d414105-9db4-4a5d-b81d-e297870eccf2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:55.066594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d414105-9db4-4a5d-b81d-e297870eccf2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:55.067056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d414105-9db4-4a5d-b81d-e297870eccf2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:55.067483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d414105-9db4-4a5d-b81d-e297870eccf2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:55.257759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:40:55.258171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:40:55.259443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:40:55.277712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:40:55.278635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:40:55.294140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:55.296079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:55.297412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:55.301225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:55.301908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:55.302537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:55.372163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Getting quotas for project 3db359a59df94c21a7d7a20e09c33ab6. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:40:55.386522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Getting quotas for user baf989c93eb94cf39ee90431703ec185 and project 3db359a59df94c21a7d7a20e09c33ab6. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:40:55.424728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Going to run 2 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:40:55.428487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: dd32bd25-0afe-45a0-867b-3c5fb0ee201b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:40:55.522861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=dd32bd25-0afe-45a0-867b-3c5fb0ee201b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:40:55.668775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3d414105-9db4-4a5d-b81d-e297870eccf2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:55.690954 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d414105-9db4-4a5d-b81d-e297870eccf2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1334 microversion: 2.1 time: 0.660110 Oct 05 17:40:55.695149 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1149/2183] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:55 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1334 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:55.731862 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c2147ece-743d-470a-8fcb-711a37df5556 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.746345 Oct 05 17:40:55.734190 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1035/2184] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:40:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:40:55.745298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8bcceb94-2650-406b-8d34-98158f2ab1dc tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:55.751066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8bcceb94-2650-406b-8d34-98158f2ab1dc tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:55.755862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8bcceb94-2650-406b-8d34-98158f2ab1dc tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Searching by: {'deleted': False, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:40:55.859148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bcceb94-2650-406b-8d34-98158f2ab1dc tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:55.859655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bcceb94-2650-406b-8d34-98158f2ab1dc tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:55.860105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bcceb94-2650-406b-8d34-98158f2ab1dc tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:55.866727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bcceb94-2650-406b-8d34-98158f2ab1dc tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:55.867261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bcceb94-2650-406b-8d34-98158f2ab1dc tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:55.874691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bcceb94-2650-406b-8d34-98158f2ab1dc tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:55.927291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aaf45d36-773b-4c03-a1ac-87acc69edb94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:55.928486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aaf45d36-773b-4c03-a1ac-87acc69edb94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:55.955531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaf45d36-773b-4c03-a1ac-87acc69edb94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:55.955859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaf45d36-773b-4c03-a1ac-87acc69edb94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:55.956290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaf45d36-773b-4c03-a1ac-87acc69edb94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:55.956997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaf45d36-773b-4c03-a1ac-87acc69edb94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:55.957445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaf45d36-773b-4c03-a1ac-87acc69edb94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:55.957864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaf45d36-773b-4c03-a1ac-87acc69edb94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:55.993466 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8bcceb94-2650-406b-8d34-98158f2ab1dc tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.252328 Oct 05 17:40:55.994646 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1150/2185] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:40:55 2022] GET /compute/v2.1/servers => generated 675 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:40:56.007785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e4b9379e-9ef4-4083-aa0f-a4dcb6e770f1 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:56.008421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e4b9379e-9ef4-4083-aa0f-a4dcb6e770f1 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:56.303467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e4b9379e-9ef4-4083-aa0f-a4dcb6e770f1 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:56.323313 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e4b9379e-9ef4-4083-aa0f-a4dcb6e770f1 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1219 microversion: 2.1 time: 0.319149 Oct 05 17:40:56.325966 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1151/2186] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:56 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1219 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:56.344416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fec92f9f-2794-4d31-b573-a2264301e20f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7779612ca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:56.492763 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fec92f9f-2794-4d31-b573-a2264301e20f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.163351 Oct 05 17:40:56.493271 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1152/2187] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:56 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:56.708371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aaf45d36-773b-4c03-a1ac-87acc69edb94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:56.726305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-701d9a0c-4cf1-44f7-9d46-46a3fe365fa5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:56.727197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-701d9a0c-4cf1-44f7-9d46-46a3fe365fa5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:56.731030 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aaf45d36-773b-4c03-a1ac-87acc69edb94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.794834 Oct 05 17:40:56.731700 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1036/2188] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:55 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:56.762082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-701d9a0c-4cf1-44f7-9d46-46a3fe365fa5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:56.765008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-701d9a0c-4cf1-44f7-9d46-46a3fe365fa5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:56.766153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-701d9a0c-4cf1-44f7-9d46-46a3fe365fa5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:56.767048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-701d9a0c-4cf1-44f7-9d46-46a3fe365fa5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:56.767624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-701d9a0c-4cf1-44f7-9d46-46a3fe365fa5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:56.768266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-701d9a0c-4cf1-44f7-9d46-46a3fe365fa5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:57.354208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-105ea53a-d019-41f4-932b-0dab920cca67 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:57.356227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-105ea53a-d019-41f4-932b-0dab920cca67 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:57.502153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-105ea53a-d019-41f4-932b-0dab920cca67 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:57.511477 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-105ea53a-d019-41f4-932b-0dab920cca67 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1219 microversion: 2.1 time: 0.161082 Oct 05 17:40:57.514963 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1037/2189] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:57 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1219 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:57.534914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-708c96ff-634f-4c8b-9903-cbda4bfb5657 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7779562820>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:57.635943 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-708c96ff-634f-4c8b-9903-cbda4bfb5657 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.104607 Oct 05 17:40:57.642913 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1038/2190] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:57 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:57.757581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-90e8436a-b967-469a-b757-0ff1fc13ae07 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:57.759094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-90e8436a-b967-469a-b757-0ff1fc13ae07 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:57.770778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90e8436a-b967-469a-b757-0ff1fc13ae07 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:57.771495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90e8436a-b967-469a-b757-0ff1fc13ae07 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:57.775515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90e8436a-b967-469a-b757-0ff1fc13ae07 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:57.778576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90e8436a-b967-469a-b757-0ff1fc13ae07 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:57.779235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90e8436a-b967-469a-b757-0ff1fc13ae07 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:57.780095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90e8436a-b967-469a-b757-0ff1fc13ae07 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:58.209416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-701d9a0c-4cf1-44f7-9d46-46a3fe365fa5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:58.220892 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-701d9a0c-4cf1-44f7-9d46-46a3fe365fa5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 1.502149 Oct 05 17:40:58.223442 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1153/2191] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:56 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:58.281583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-90e8436a-b967-469a-b757-0ff1fc13ae07 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:58.296339 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-90e8436a-b967-469a-b757-0ff1fc13ae07 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.543242 Oct 05 17:40:58.299663 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1039/2192] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:57 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:58.537162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ced7f2f1-622d-4448-94df-2b885910489e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:58.537778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ced7f2f1-622d-4448-94df-2b885910489e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:58.554356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced7f2f1-622d-4448-94df-2b885910489e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:58.555054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced7f2f1-622d-4448-94df-2b885910489e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:58.558585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced7f2f1-622d-4448-94df-2b885910489e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:58.559524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced7f2f1-622d-4448-94df-2b885910489e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:58.564342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced7f2f1-622d-4448-94df-2b885910489e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:58.566583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced7f2f1-622d-4448-94df-2b885910489e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:58.652162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-91fdd16e-772a-4797-9d84-43770461d929 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795aae50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:58.780464 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-91fdd16e-772a-4797-9d84-43770461d929 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.132116 Oct 05 17:40:58.792151 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1040/2193] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:58 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:40:58.869172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ced7f2f1-622d-4448-94df-2b885910489e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:58.880160 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ced7f2f1-622d-4448-94df-2b885910489e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1271 microversion: 2.1 time: 0.346654 Oct 05 17:40:58.914375 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1154/2194] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:58 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1271 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:59.249292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a95a532e-4231-4f77-9a8f-a1b7bda36de4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:59.250808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a95a532e-4231-4f77-9a8f-a1b7bda36de4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:59.282177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a95a532e-4231-4f77-9a8f-a1b7bda36de4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:59.282722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a95a532e-4231-4f77-9a8f-a1b7bda36de4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:59.283228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a95a532e-4231-4f77-9a8f-a1b7bda36de4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:59.283946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a95a532e-4231-4f77-9a8f-a1b7bda36de4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:59.294947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a95a532e-4231-4f77-9a8f-a1b7bda36de4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:59.295480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a95a532e-4231-4f77-9a8f-a1b7bda36de4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:59.329315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a11e18a-1a20-447e-a16c-f68802265629 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:59.329939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3a11e18a-1a20-447e-a16c-f68802265629 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:59.349268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a11e18a-1a20-447e-a16c-f68802265629 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:59.349787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a11e18a-1a20-447e-a16c-f68802265629 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:59.350226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a11e18a-1a20-447e-a16c-f68802265629 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:59.363506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a11e18a-1a20-447e-a16c-f68802265629 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:59.364066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a11e18a-1a20-447e-a16c-f68802265629 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:59.364532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a11e18a-1a20-447e-a16c-f68802265629 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:59.799731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3a11e18a-1a20-447e-a16c-f68802265629 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:40:59.820086 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a11e18a-1a20-447e-a16c-f68802265629 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1511 microversion: 2.1 time: 0.494638 Oct 05 17:40:59.824522 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1155/2195] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:59 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1511 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:59.847989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f8a7a14b-68e8-4dde-b52f-8e8967401d0e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7779612430>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:59.963618 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f8a7a14b-68e8-4dde-b52f-8e8967401d0e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.135026 Oct 05 17:40:59.964362 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1156/2196] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:40:59 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:40:59.970056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a8b2b167-3c6e-4e0f-9c19-88d7282b6848 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:40:59.970983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a8b2b167-3c6e-4e0f-9c19-88d7282b6848 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:40:59.983734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8b2b167-3c6e-4e0f-9c19-88d7282b6848 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:59.985112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8b2b167-3c6e-4e0f-9c19-88d7282b6848 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:59.985800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8b2b167-3c6e-4e0f-9c19-88d7282b6848 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:40:59.988682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8b2b167-3c6e-4e0f-9c19-88d7282b6848 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:40:59.989426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8b2b167-3c6e-4e0f-9c19-88d7282b6848 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:40:59.990060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8b2b167-3c6e-4e0f-9c19-88d7282b6848 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:00.141601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8b2b167-3c6e-4e0f-9c19-88d7282b6848 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:00.155206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a8b2b167-3c6e-4e0f-9c19-88d7282b6848 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1277 microversion: 2.1 time: 0.186714 Oct 05 17:41:00.183808 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1157/2197] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:59 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:00.820810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a95a532e-4231-4f77-9a8f-a1b7bda36de4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:00.835992 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a95a532e-4231-4f77-9a8f-a1b7bda36de4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 1.591366 Oct 05 17:41:00.848492 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1041/2198] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:40:59 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 1604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:00.858095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-55daafc0-daee-41ee-ac07-9783b565e7d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:00.858965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-55daafc0-daee-41ee-ac07-9783b565e7d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:00.863437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:00.884899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55daafc0-daee-41ee-ac07-9783b565e7d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:00.885405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55daafc0-daee-41ee-ac07-9783b565e7d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:00.898184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55daafc0-daee-41ee-ac07-9783b565e7d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:00.899022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55daafc0-daee-41ee-ac07-9783b565e7d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:00.899507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55daafc0-daee-41ee-ac07-9783b565e7d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:00.899934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55daafc0-daee-41ee-ac07-9783b565e7d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:00.980159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8a3da77-564b-4cc0-a384-d5a640164c02 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77794ccd30>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:01.084877 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8a3da77-564b-4cc0-a384-d5a640164c02 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.109205 Oct 05 17:41:01.085684 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1042/2199] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:00 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:01.461343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1012572201", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "10a4fcda-9f1d-4285-8912-24a7f4958aee"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:01.556079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-55daafc0-daee-41ee-ac07-9783b565e7d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:01.570568 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-55daafc0-daee-41ee-ac07-9783b565e7d6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1488 microversion: 2.1 time: 0.717335 Oct 05 17:41:01.577025 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1158/2200] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:00 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1488 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:01.600816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ffe4190-1da2-472e-ac51-786080f6609e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:01.605551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1ffe4190-1da2-472e-ac51-786080f6609e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:01.616517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] validate_networks() for [('10a4fcda-9f1d-4285-8912-24a7f4958aee', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:41:01.645244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ffe4190-1da2-472e-ac51-786080f6609e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:01.646897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ffe4190-1da2-472e-ac51-786080f6609e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:01.649766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ffe4190-1da2-472e-ac51-786080f6609e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:01.654520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ffe4190-1da2-472e-ac51-786080f6609e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:01.656697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ffe4190-1da2-472e-ac51-786080f6609e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:01.658250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ffe4190-1da2-472e-ac51-786080f6609e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:01.914522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1ffe4190-1da2-472e-ac51-786080f6609e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:01.953100 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1ffe4190-1da2-472e-ac51-786080f6609e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1277 microversion: 2.1 time: 0.367529 Oct 05 17:41:01.958861 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1159/2201] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:01 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1277 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:01.976770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-91f0237f-cbc7-4b7c-af73-f8ab3cd6dd22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:01.987910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-91f0237f-cbc7-4b7c-af73-f8ab3cd6dd22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:02.013644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f0237f-cbc7-4b7c-af73-f8ab3cd6dd22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:02.017463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f0237f-cbc7-4b7c-af73-f8ab3cd6dd22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:02.018793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f0237f-cbc7-4b7c-af73-f8ab3cd6dd22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:02.021646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f0237f-cbc7-4b7c-af73-f8ab3cd6dd22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:02.022892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f0237f-cbc7-4b7c-af73-f8ab3cd6dd22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:02.023958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91f0237f-cbc7-4b7c-af73-f8ab3cd6dd22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:02.128025 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-91f0237f-cbc7-4b7c-af73-f8ab3cd6dd22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 200 len: 137 microversion: 2.1 time: 0.167432 Oct 05 17:41:02.128874 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1160/2202] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:01 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 137 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:02.143538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a81b8a9c-fec6-4f38-814c-5954e81f30f7 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:02.150032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a81b8a9c-fec6-4f38-814c-5954e81f30f7 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:02.164636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81b8a9c-fec6-4f38-814c-5954e81f30f7 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:02.168210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81b8a9c-fec6-4f38-814c-5954e81f30f7 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:02.173155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81b8a9c-fec6-4f38-814c-5954e81f30f7 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:02.174499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81b8a9c-fec6-4f38-814c-5954e81f30f7 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:02.175639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81b8a9c-fec6-4f38-814c-5954e81f30f7 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:02.176795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81b8a9c-fec6-4f38-814c-5954e81f30f7 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:02.856787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a81b8a9c-fec6-4f38-814c-5954e81f30f7 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:02.866180 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a81b8a9c-fec6-4f38-814c-5954e81f30f7 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 0.735837 Oct 05 17:41:02.870432 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1161/2203] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:02 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:02.875455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b560a570-06e6-4a96-b61d-59b6bccf264e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795aba60>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:03.010374 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b560a570-06e6-4a96-b61d-59b6bccf264e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.138573 Oct 05 17:41:03.029407 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1162/2204] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:02 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:03.050725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b17c9c24-962c-462c-afe5-3f6f8eff8322 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:03.052277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b17c9c24-962c-462c-afe5-3f6f8eff8322 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:03.064599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17c9c24-962c-462c-afe5-3f6f8eff8322 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:03.066865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17c9c24-962c-462c-afe5-3f6f8eff8322 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:03.069496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17c9c24-962c-462c-afe5-3f6f8eff8322 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:03.073940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17c9c24-962c-462c-afe5-3f6f8eff8322 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:03.074676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17c9c24-962c-462c-afe5-3f6f8eff8322 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:03.075291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17c9c24-962c-462c-afe5-3f6f8eff8322 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:03.651319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b17c9c24-962c-462c-afe5-3f6f8eff8322 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:03.654980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:03.664000 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b17c9c24-962c-462c-afe5-3f6f8eff8322 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.623837 Oct 05 17:41:03.674615 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1163/2205] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:03 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:03.695304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-41f26fe8-850d-4ce3-97e5-2cee8715cfc4 req-f66447fc-8b42-4e51-bcf1-4eb3e1fd74c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e", "name": "network-vif-plugged", "status": "completed", "tag": "167ff7e5-e2af-40a1-bbd0-618ecfb3a035"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:03.720373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-41f26fe8-850d-4ce3-97e5-2cee8715cfc4 req-f66447fc-8b42-4e51-bcf1-4eb3e1fd74c8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:03.722635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-41f26fe8-850d-4ce3-97e5-2cee8715cfc4 req-f66447fc-8b42-4e51-bcf1-4eb3e1fd74c8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:03.724052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-41f26fe8-850d-4ce3-97e5-2cee8715cfc4 req-f66447fc-8b42-4e51-bcf1-4eb3e1fd74c8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:03.758666 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-41f26fe8-850d-4ce3-97e5-2cee8715cfc4 req-f66447fc-8b42-4e51-bcf1-4eb3e1fd74c8 service nova] Creating event network-vif-plugged:167ff7e5-e2af-40a1-bbd0-618ecfb3a035 for instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e on n-h1-835595-3 Oct 05 17:41:03.765131 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-41f26fe8-850d-4ce3-97e5-2cee8715cfc4 req-f66447fc-8b42-4e51-bcf1-4eb3e1fd74c8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088969 Oct 05 17:41:03.766156 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1164/2206] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:03.771848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7f1a44bf-b5dc-4ef5-8046-44b53030a209 req-81f05813-3ce3-4651-9782-d72690899063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0c9d6-efb6-4b55-9df3-23625b4c4efb", "tag": "c88e6c42-997b-4cfa-aa37-9b219419844b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:03.802443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7f1a44bf-b5dc-4ef5-8046-44b53030a209 req-81f05813-3ce3-4651-9782-d72690899063 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:03.803186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7f1a44bf-b5dc-4ef5-8046-44b53030a209 req-81f05813-3ce3-4651-9782-d72690899063 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:03.805632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7f1a44bf-b5dc-4ef5-8046-44b53030a209 req-81f05813-3ce3-4651-9782-d72690899063 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:03.846718 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7f1a44bf-b5dc-4ef5-8046-44b53030a209 req-81f05813-3ce3-4651-9782-d72690899063 service nova] Creating event network-changed:c88e6c42-997b-4cfa-aa37-9b219419844b for instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb on n-h2-835595-3 Oct 05 17:41:03.870900 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7f1a44bf-b5dc-4ef5-8046-44b53030a209 req-81f05813-3ce3-4651-9782-d72690899063 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093521 Oct 05 17:41:03.872755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1165/2207] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:03.888312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a01be41-d790-441b-b13a-9bb794e97ec5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:03.890435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9a01be41-d790-441b-b13a-9bb794e97ec5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:03.918343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a01be41-d790-441b-b13a-9bb794e97ec5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:03.918856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a01be41-d790-441b-b13a-9bb794e97ec5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:03.919302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a01be41-d790-441b-b13a-9bb794e97ec5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:03.923771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a01be41-d790-441b-b13a-9bb794e97ec5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:03.926489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a01be41-d790-441b-b13a-9bb794e97ec5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:03.930454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a01be41-d790-441b-b13a-9bb794e97ec5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:04.092200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9a01be41-d790-441b-b13a-9bb794e97ec5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:04.105486 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a01be41-d790-441b-b13a-9bb794e97ec5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1277 microversion: 2.1 time: 0.229904 Oct 05 17:41:04.108136 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1166/2208] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:03 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:04.122610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-df919647-9ce0-4ec0-9feb-26a932ea2c91 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:04.133774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-df919647-9ce0-4ec0-9feb-26a932ea2c91 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:04.147679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df919647-9ce0-4ec0-9feb-26a932ea2c91 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:04.148183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df919647-9ce0-4ec0-9feb-26a932ea2c91 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:04.148623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df919647-9ce0-4ec0-9feb-26a932ea2c91 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:04.149338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df919647-9ce0-4ec0-9feb-26a932ea2c91 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:04.154320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df919647-9ce0-4ec0-9feb-26a932ea2c91 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:04.154994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df919647-9ce0-4ec0-9feb-26a932ea2c91 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:05.338083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:05.595019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:41:05.595753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:41:05.596701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:41:05.597344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:41:05.597846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:41:05.610198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:05.612674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:05.613546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:05.615210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:05.615890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:05.617030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:05.644191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Getting quotas for project 6576c93c15754da4b845fd39842b7f51. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:41:05.650528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Getting quotas for user c55f9de1db564563b7ae19d50765351d and project 6576c93c15754da4b845fd39842b7f51. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:41:05.679055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:41:05.682170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:41:05.812022 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8316999-7a38-4c8d-a4f0-8d8f5dfab231 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.644404 Oct 05 17:41:05.813675 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1043/2209] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:41:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:41:05.833650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-adbd7438-3a2e-449f-9944-280f6748db86 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:05.834219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-adbd7438-3a2e-449f-9944-280f6748db86 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:05.845529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adbd7438-3a2e-449f-9944-280f6748db86 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:05.846036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adbd7438-3a2e-449f-9944-280f6748db86 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:05.846519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adbd7438-3a2e-449f-9944-280f6748db86 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:05.847238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adbd7438-3a2e-449f-9944-280f6748db86 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:05.847693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adbd7438-3a2e-449f-9944-280f6748db86 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:05.848115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adbd7438-3a2e-449f-9944-280f6748db86 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:05.900400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:06.075191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-df919647-9ce0-4ec0-9feb-26a932ea2c91 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:06.090986 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-df919647-9ce0-4ec0-9feb-26a932ea2c91 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 1.981611 Oct 05 17:41:06.091585 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1167/2210] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:04 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:06.133474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c78f4515-17c9-48a6-8454-7ab1d99bfa91 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77796124c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:06.217610 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c78f4515-17c9-48a6-8454-7ab1d99bfa91 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.101971 Oct 05 17:41:06.229473 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1168/2211] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:06 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:06.236436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f269427f-7554-490b-b10a-584b07f70d32 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:06.237926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f269427f-7554-490b-b10a-584b07f70d32 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:06.247450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f269427f-7554-490b-b10a-584b07f70d32 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:06.248442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f269427f-7554-490b-b10a-584b07f70d32 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:06.249927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f269427f-7554-490b-b10a-584b07f70d32 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:06.251658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f269427f-7554-490b-b10a-584b07f70d32 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:06.255289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f269427f-7554-490b-b10a-584b07f70d32 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:06.256002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f269427f-7554-490b-b10a-584b07f70d32 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:06.325810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:06.707435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f269427f-7554-490b-b10a-584b07f70d32 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:06.722236 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f269427f-7554-490b-b10a-584b07f70d32 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1319 microversion: 2.1 time: 0.489299 Oct 05 17:41:06.724126 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1169/2212] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:06 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1319 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:06.738966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-526cbeab-f28f-416a-93a0-4102c213cf34 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:06.740679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-526cbeab-f28f-416a-93a0-4102c213cf34 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:06.893836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-526cbeab-f28f-416a-93a0-4102c213cf34 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:06.918812 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-526cbeab-f28f-416a-93a0-4102c213cf34 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1216 microversion: 2.1 time: 0.193120 Oct 05 17:41:06.924380 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1170/2213] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:06 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1216 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:06.943176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2bfb1f24-8aa7-49d5-a4b2-44f8adaba9fc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:06.946659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2bfb1f24-8aa7-49d5-a4b2-44f8adaba9fc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:06.963226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2bfb1f24-8aa7-49d5-a4b2-44f8adaba9fc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:06.965082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2bfb1f24-8aa7-49d5-a4b2-44f8adaba9fc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:06.965764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2bfb1f24-8aa7-49d5-a4b2-44f8adaba9fc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:06.973093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2bfb1f24-8aa7-49d5-a4b2-44f8adaba9fc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:06.974633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2bfb1f24-8aa7-49d5-a4b2-44f8adaba9fc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:06.975297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2bfb1f24-8aa7-49d5-a4b2-44f8adaba9fc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:07.306998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-adbd7438-3a2e-449f-9944-280f6748db86 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:07.333947 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-adbd7438-3a2e-449f-9944-280f6748db86 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 1.504489 Oct 05 17:41:07.353554 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1044/2214] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:05 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:07.383051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-375156c5-0622-46c0-bf67-c70e5e3d3be8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777956b790>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:07.482863 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-375156c5-0622-46c0-bf67-c70e5e3d3be8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.123374 Oct 05 17:41:07.503416 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1045/2215] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:07 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:07.541325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2bfb1f24-8aa7-49d5-a4b2-44f8adaba9fc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:07.554088 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2bfb1f24-8aa7-49d5-a4b2-44f8adaba9fc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.625077 Oct 05 17:41:07.555274 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1171/2216] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:06 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:07.584043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed3ff152-017a-45cf-9454-c4e751f6e17c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:07.585091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed3ff152-017a-45cf-9454-c4e751f6e17c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:07.600275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed3ff152-017a-45cf-9454-c4e751f6e17c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:07.600988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed3ff152-017a-45cf-9454-c4e751f6e17c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:07.601580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed3ff152-017a-45cf-9454-c4e751f6e17c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:07.604606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed3ff152-017a-45cf-9454-c4e751f6e17c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:07.605334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed3ff152-017a-45cf-9454-c4e751f6e17c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:07.606176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed3ff152-017a-45cf-9454-c4e751f6e17c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:07.745927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e1831188-a84c-4312-9f44-49a162ca6a6f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:07.747029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e1831188-a84c-4312-9f44-49a162ca6a6f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:07.760955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1831188-a84c-4312-9f44-49a162ca6a6f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:07.761953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1831188-a84c-4312-9f44-49a162ca6a6f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:07.763111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1831188-a84c-4312-9f44-49a162ca6a6f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:07.764300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1831188-a84c-4312-9f44-49a162ca6a6f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:07.764977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1831188-a84c-4312-9f44-49a162ca6a6f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:07.768935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1831188-a84c-4312-9f44-49a162ca6a6f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:08.377270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e1831188-a84c-4312-9f44-49a162ca6a6f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:08.388649 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e1831188-a84c-4312-9f44-49a162ca6a6f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1319 microversion: 2.1 time: 0.646544 Oct 05 17:41:08.403794 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1172/2217] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:07 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1319 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:41:08.414518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48b8c9ab-79be-4a4e-b59a-e161ca40792b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:08.415414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-48b8c9ab-79be-4a4e-b59a-e161ca40792b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:08.424201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b8c9ab-79be-4a4e-b59a-e161ca40792b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:08.425017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b8c9ab-79be-4a4e-b59a-e161ca40792b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:08.425671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b8c9ab-79be-4a4e-b59a-e161ca40792b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:08.426675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b8c9ab-79be-4a4e-b59a-e161ca40792b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:08.427350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b8c9ab-79be-4a4e-b59a-e161ca40792b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:08.427990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48b8c9ab-79be-4a4e-b59a-e161ca40792b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:08.512486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-48b8c9ab-79be-4a4e-b59a-e161ca40792b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:08.521717 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48b8c9ab-79be-4a4e-b59a-e161ca40792b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1274 microversion: 2.1 time: 0.116153 Oct 05 17:41:08.522759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1173/2218] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:08 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:08.529314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-abe38d4d-9eda-408c-b889-9d0aad707f3f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:08.529942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-abe38d4d-9eda-408c-b889-9d0aad707f3f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:08.538054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abe38d4d-9eda-408c-b889-9d0aad707f3f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:08.538613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abe38d4d-9eda-408c-b889-9d0aad707f3f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:08.539152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abe38d4d-9eda-408c-b889-9d0aad707f3f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:08.539796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abe38d4d-9eda-408c-b889-9d0aad707f3f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:08.540274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abe38d4d-9eda-408c-b889-9d0aad707f3f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:08.540704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abe38d4d-9eda-408c-b889-9d0aad707f3f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:08.757358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ed3ff152-017a-45cf-9454-c4e751f6e17c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:08.781904 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed3ff152-017a-45cf-9454-c4e751f6e17c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 1.202580 Oct 05 17:41:08.784933 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1046/2219] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:07 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:08.794484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-74a7a9bb-f4e7-4227-9da7-6396cdd07011 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77794dae50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:08.872516 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-74a7a9bb-f4e7-4227-9da7-6396cdd07011 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.086341 Oct 05 17:41:08.880423 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1047/2220] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:08 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:08.883097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-abe38d4d-9eda-408c-b889-9d0aad707f3f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:08.929796 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-abe38d4d-9eda-408c-b889-9d0aad707f3f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 0.398896 Oct 05 17:41:08.929796 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1174/2221] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:08 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:09.107378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1430291119", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "43b14ad7-066f-4366-a6d9-9f817db2441a"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:09.204671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] validate_networks() for [('43b14ad7-066f-4366-a6d9-9f817db2441a', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:41:09.416472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-faa0e86e-69a2-48c5-a680-2b255f30426c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:09.417945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-faa0e86e-69a2-48c5-a680-2b255f30426c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:09.426322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faa0e86e-69a2-48c5-a680-2b255f30426c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:09.427067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faa0e86e-69a2-48c5-a680-2b255f30426c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:09.427823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faa0e86e-69a2-48c5-a680-2b255f30426c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:09.429626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faa0e86e-69a2-48c5-a680-2b255f30426c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:09.430648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faa0e86e-69a2-48c5-a680-2b255f30426c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:09.431528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faa0e86e-69a2-48c5-a680-2b255f30426c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:09.690359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-faa0e86e-69a2-48c5-a680-2b255f30426c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:09.703096 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-faa0e86e-69a2-48c5-a680-2b255f30426c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1319 microversion: 2.1 time: 0.290665 Oct 05 17:41:09.704827 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1175/2222] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:09 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:09.710716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8242d37a-e949-4de9-870c-00e5871ecca9 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:09.714109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8242d37a-e949-4de9-870c-00e5871ecca9 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:09.725753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8242d37a-e949-4de9-870c-00e5871ecca9 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:09.727021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8242d37a-e949-4de9-870c-00e5871ecca9 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:09.727680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8242d37a-e949-4de9-870c-00e5871ecca9 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:09.729012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8242d37a-e949-4de9-870c-00e5871ecca9 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:09.729928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8242d37a-e949-4de9-870c-00e5871ecca9 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:09.730950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8242d37a-e949-4de9-870c-00e5871ecca9 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:10.028434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8242d37a-e949-4de9-870c-00e5871ecca9 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:10.046386 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8242d37a-e949-4de9-870c-00e5871ecca9 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1274 microversion: 2.1 time: 0.340170 Oct 05 17:41:10.050216 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1176/2223] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:09 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1274 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:10.071541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d5a39b7-4c9a-44b3-b028-3d29c4fe9988 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7779612ca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:10.182881 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2d5a39b7-4c9a-44b3-b028-3d29c4fe9988 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.119583 Oct 05 17:41:10.186729 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1177/2224] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:10 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:10.203973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-67ea367d-5297-4ea6-b78f-260ef0daeea9 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:10.204447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-67ea367d-5297-4ea6-b78f-260ef0daeea9 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:10.217573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ea367d-5297-4ea6-b78f-260ef0daeea9 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:10.218255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ea367d-5297-4ea6-b78f-260ef0daeea9 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:10.218915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ea367d-5297-4ea6-b78f-260ef0daeea9 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:10.220396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ea367d-5297-4ea6-b78f-260ef0daeea9 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:10.221074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ea367d-5297-4ea6-b78f-260ef0daeea9 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:10.221625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67ea367d-5297-4ea6-b78f-260ef0daeea9 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:11.388710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-67ea367d-5297-4ea6-b78f-260ef0daeea9 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:11.404559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-67ea367d-5297-4ea6-b78f-260ef0daeea9 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 1.209518 Oct 05 17:41:11.406744 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1178/2225] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:10 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:11.415161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-11c39c20-378f-48e7-9e9b-b974d70a1b12 req-16bca41f-179b-4660-abca-e6832cabcb5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0c9d6-efb6-4b55-9df3-23625b4c4efb", "tag": "faf68f92-9784-4248-964c-935266565f08"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:11.442060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-11c39c20-378f-48e7-9e9b-b974d70a1b12 req-16bca41f-179b-4660-abca-e6832cabcb5a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:11.452998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-11c39c20-378f-48e7-9e9b-b974d70a1b12 req-16bca41f-179b-4660-abca-e6832cabcb5a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:11.454131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-11c39c20-378f-48e7-9e9b-b974d70a1b12 req-16bca41f-179b-4660-abca-e6832cabcb5a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:11.496230 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-11c39c20-378f-48e7-9e9b-b974d70a1b12 req-16bca41f-179b-4660-abca-e6832cabcb5a service nova] Creating event network-changed:faf68f92-9784-4248-964c-935266565f08 for instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb on n-h2-835595-3 Oct 05 17:41:11.508925 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-11c39c20-378f-48e7-9e9b-b974d70a1b12 req-16bca41f-179b-4660-abca-e6832cabcb5a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100574 Oct 05 17:41:11.520044 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1179/2226] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:11.528873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:41:11.529351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:41:11.530431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:41:11.530852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:41:11.531269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:41:11.535399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=12 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:11.540717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f81f1846-f96d-4f2a-85a6-05b6d55c6ff2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:11.545958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f81f1846-f96d-4f2a-85a6-05b6d55c6ff2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:11.564014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f81f1846-f96d-4f2a-85a6-05b6d55c6ff2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:11.564512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f81f1846-f96d-4f2a-85a6-05b6d55c6ff2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:11.566875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f81f1846-f96d-4f2a-85a6-05b6d55c6ff2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:11.567738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f81f1846-f96d-4f2a-85a6-05b6d55c6ff2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:11.568255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f81f1846-f96d-4f2a-85a6-05b6d55c6ff2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:11.572704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f81f1846-f96d-4f2a-85a6-05b6d55c6ff2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:11.574179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:11.574720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:11.575159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:11.575893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:11.576348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:11.576771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:11.634782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:41:11.644614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for user 1c5f58a618c04b09815dea8f54504c7c and project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:41:11.677697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:41:11.681842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:41:11.804509 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eecabdd0-0c62-408a-841b-e41a2d9c2e83 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.701642 Oct 05 17:41:11.811274 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1048/2227] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:41:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 2709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:41:11.818961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c3eaeb37-b885-4613-b932-a1a0c0d97cad tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:11.819828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3eaeb37-b885-4613-b932-a1a0c0d97cad tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:11.846982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3eaeb37-b885-4613-b932-a1a0c0d97cad tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:11.852007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3eaeb37-b885-4613-b932-a1a0c0d97cad tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:11.852663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3eaeb37-b885-4613-b932-a1a0c0d97cad tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:11.853578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3eaeb37-b885-4613-b932-a1a0c0d97cad tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:11.855964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3eaeb37-b885-4613-b932-a1a0c0d97cad tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:11.856557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3eaeb37-b885-4613-b932-a1a0c0d97cad tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:12.268719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f81f1846-f96d-4f2a-85a6-05b6d55c6ff2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:12.283819 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f81f1846-f96d-4f2a-85a6-05b6d55c6ff2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1319 microversion: 2.1 time: 0.761229 Oct 05 17:41:12.288052 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1180/2228] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:11 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1319 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:12.304967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d412c8a5-06ef-475c-9ea6-a8727b4edb1b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77747ccaf0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:12.416834 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d412c8a5-06ef-475c-9ea6-a8727b4edb1b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.118986 Oct 05 17:41:12.417442 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1181/2229] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:12 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:12.436468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f639ca94-bfc3-46a0-9b56-d7b42a07ac37 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:12.437427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f639ca94-bfc3-46a0-9b56-d7b42a07ac37 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:12.680511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c3eaeb37-b885-4613-b932-a1a0c0d97cad tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:12.690576 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c3eaeb37-b885-4613-b932-a1a0c0d97cad tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1274 microversion: 2.1 time: 0.877904 Oct 05 17:41:12.699290 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1049/2230] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:11 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1274 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:12.714546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f747405e-0b4d-4fc3-aa70-0c75eb008150 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:12.715413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f747405e-0b4d-4fc3-aa70-0c75eb008150 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:12.729771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f747405e-0b4d-4fc3-aa70-0c75eb008150 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:12.730289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f747405e-0b4d-4fc3-aa70-0c75eb008150 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:12.730740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f747405e-0b4d-4fc3-aa70-0c75eb008150 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:12.731466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f747405e-0b4d-4fc3-aa70-0c75eb008150 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:12.731910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f747405e-0b4d-4fc3-aa70-0c75eb008150 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:12.736945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f747405e-0b4d-4fc3-aa70-0c75eb008150 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:12.743710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f639ca94-bfc3-46a0-9b56-d7b42a07ac37 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:12.764130 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f639ca94-bfc3-46a0-9b56-d7b42a07ac37 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1215 microversion: 2.1 time: 0.344911 Oct 05 17:41:12.765163 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1182/2231] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:12 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1215 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:13.057324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f747405e-0b4d-4fc3-aa70-0c75eb008150 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:13.071683 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f747405e-0b4d-4fc3-aa70-0c75eb008150 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 0.371051 Oct 05 17:41:13.089104 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1050/2232] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:12 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:13.309383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-06c66faa-7286-44fd-b9f4-a77ba7c13657 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:13.310500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-06c66faa-7286-44fd-b9f4-a77ba7c13657 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:13.319738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c66faa-7286-44fd-b9f4-a77ba7c13657 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:13.324215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c66faa-7286-44fd-b9f4-a77ba7c13657 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:13.326724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c66faa-7286-44fd-b9f4-a77ba7c13657 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:13.331664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c66faa-7286-44fd-b9f4-a77ba7c13657 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:13.333994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c66faa-7286-44fd-b9f4-a77ba7c13657 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:13.334627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c66faa-7286-44fd-b9f4-a77ba7c13657 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:13.432832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-11688981-146f-48a8-8ea2-f3ba91340640 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777952c5e0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:13.532567 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-11688981-146f-48a8-8ea2-f3ba91340640 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.103538 Oct 05 17:41:13.540518 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1051/2233] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:13 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:41:13.724262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-937be9c4-74cd-4471-97f8-3903c825c748 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:13.725694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-937be9c4-74cd-4471-97f8-3903c825c748 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:13.733835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937be9c4-74cd-4471-97f8-3903c825c748 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:13.734749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937be9c4-74cd-4471-97f8-3903c825c748 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:13.735498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937be9c4-74cd-4471-97f8-3903c825c748 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:13.736423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937be9c4-74cd-4471-97f8-3903c825c748 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:13.737089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937be9c4-74cd-4471-97f8-3903c825c748 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:13.738039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937be9c4-74cd-4471-97f8-3903c825c748 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:14.006706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-937be9c4-74cd-4471-97f8-3903c825c748 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:14.015939 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-937be9c4-74cd-4471-97f8-3903c825c748 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1274 microversion: 2.1 time: 0.296391 Oct 05 17:41:14.031013 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1052/2234] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:13 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1274 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:41:14.042536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ac5a680e-dfa2-4544-a052-beb0180bd39f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:14.043169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ac5a680e-dfa2-4544-a052-beb0180bd39f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:14.068752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac5a680e-dfa2-4544-a052-beb0180bd39f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:14.069542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac5a680e-dfa2-4544-a052-beb0180bd39f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:14.070357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac5a680e-dfa2-4544-a052-beb0180bd39f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:14.072334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac5a680e-dfa2-4544-a052-beb0180bd39f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:14.073515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac5a680e-dfa2-4544-a052-beb0180bd39f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:14.074575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac5a680e-dfa2-4544-a052-beb0180bd39f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:14.459723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ac5a680e-dfa2-4544-a052-beb0180bd39f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:14.472616 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ac5a680e-dfa2-4544-a052-beb0180bd39f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1285 microversion: 2.1 time: 0.437284 Oct 05 17:41:14.487195 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1053/2235] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:14 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1285 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:14.501766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9f09504-551c-4934-811d-977254183f00 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:14.502450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a9f09504-551c-4934-811d-977254183f00 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:14.515720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9f09504-551c-4934-811d-977254183f00 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:14.516193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9f09504-551c-4934-811d-977254183f00 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:14.516627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9f09504-551c-4934-811d-977254183f00 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:14.518047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9f09504-551c-4934-811d-977254183f00 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:14.525469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9f09504-551c-4934-811d-977254183f00 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:14.526144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9f09504-551c-4934-811d-977254183f00 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:14.851636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-06c66faa-7286-44fd-b9f4-a77ba7c13657 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:14.867596 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-06c66faa-7286-44fd-b9f4-a77ba7c13657 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1319 microversion: 2.1 time: 1.557265 Oct 05 17:41:14.877771 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1183/2236] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:13 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1319 bytes in 1573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:14.883078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-015f7fdd-e08d-4bef-915a-6118b538ee7c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795cf3a0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:14.977557 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-015f7fdd-e08d-4bef-915a-6118b538ee7c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.097210 Oct 05 17:41:14.995035 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1184/2237] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:14 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:15.000927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9d007a1b-4e1d-451f-b6d8-2d1fc2c8e861 req-d5fc047c-69be-4c18-8b56-c17bf8e7e66c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b694959-7c45-47bc-9c5d-cff02aa8e3f3", "tag": "9472b148-e969-40cc-87f1-db6934949380"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:15.041614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9d007a1b-4e1d-451f-b6d8-2d1fc2c8e861 req-d5fc047c-69be-4c18-8b56-c17bf8e7e66c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:15.045099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9d007a1b-4e1d-451f-b6d8-2d1fc2c8e861 req-d5fc047c-69be-4c18-8b56-c17bf8e7e66c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:15.045668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9d007a1b-4e1d-451f-b6d8-2d1fc2c8e861 req-d5fc047c-69be-4c18-8b56-c17bf8e7e66c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:15.073580 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9d007a1b-4e1d-451f-b6d8-2d1fc2c8e861 req-d5fc047c-69be-4c18-8b56-c17bf8e7e66c service nova] Creating event network-changed:9472b148-e969-40cc-87f1-db6934949380 for instance 8b694959-7c45-47bc-9c5d-cff02aa8e3f3 on n-h2-835595-3 Oct 05 17:41:15.104245 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9d007a1b-4e1d-451f-b6d8-2d1fc2c8e861 req-d5fc047c-69be-4c18-8b56-c17bf8e7e66c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107662 Oct 05 17:41:15.107578 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1185/2238] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:15.115232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a27f6309-6a34-44a3-8bea-886ce48abc44 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:15.134135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a27f6309-6a34-44a3-8bea-886ce48abc44 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:15.154216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a27f6309-6a34-44a3-8bea-886ce48abc44 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:15.155006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a27f6309-6a34-44a3-8bea-886ce48abc44 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:15.165655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a27f6309-6a34-44a3-8bea-886ce48abc44 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:15.166919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a27f6309-6a34-44a3-8bea-886ce48abc44 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:15.167628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a27f6309-6a34-44a3-8bea-886ce48abc44 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:15.168273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a27f6309-6a34-44a3-8bea-886ce48abc44 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:16.008847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a9f09504-551c-4934-811d-977254183f00 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:16.022260 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a9f09504-551c-4934-811d-977254183f00 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 1.533364 Oct 05 17:41:16.023062 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1054/2239] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:14 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:16.050439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c1d2157-22a0-4db5-ab1f-c8ce06b90cf1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:16.051427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3c1d2157-22a0-4db5-ab1f-c8ce06b90cf1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:16.062888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c1d2157-22a0-4db5-ab1f-c8ce06b90cf1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:16.084425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c1d2157-22a0-4db5-ab1f-c8ce06b90cf1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:16.084885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c1d2157-22a0-4db5-ab1f-c8ce06b90cf1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:16.085665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c1d2157-22a0-4db5-ab1f-c8ce06b90cf1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:16.091286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c1d2157-22a0-4db5-ab1f-c8ce06b90cf1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:16.091930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c1d2157-22a0-4db5-ab1f-c8ce06b90cf1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:16.467748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3c1d2157-22a0-4db5-ab1f-c8ce06b90cf1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:16.482694 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c1d2157-22a0-4db5-ab1f-c8ce06b90cf1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1273 microversion: 2.1 time: 0.457044 Oct 05 17:41:16.489135 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1055/2240] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:16 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1273 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:16.494943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-60a9b5ce-3c6f-4872-b956-12cd356542be tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:16.497318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-60a9b5ce-3c6f-4872-b956-12cd356542be tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:16.513925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60a9b5ce-3c6f-4872-b956-12cd356542be tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:16.514681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60a9b5ce-3c6f-4872-b956-12cd356542be tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:16.515626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60a9b5ce-3c6f-4872-b956-12cd356542be tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:16.516492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60a9b5ce-3c6f-4872-b956-12cd356542be tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:16.517609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60a9b5ce-3c6f-4872-b956-12cd356542be tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:16.518205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60a9b5ce-3c6f-4872-b956-12cd356542be tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:17.226492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a27f6309-6a34-44a3-8bea-886ce48abc44 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:17.241696 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a27f6309-6a34-44a3-8bea-886ce48abc44 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1316 microversion: 2.1 time: 2.132518 Oct 05 17:41:17.264610 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1186/2241] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:15 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1316 bytes in 2156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:17.270996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-89a9145d-22e6-4cdd-9d6d-c06f2233b3a7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7779612ee0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:17.337447 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-89a9145d-22e6-4cdd-9d6d-c06f2233b3a7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.071281 Oct 05 17:41:17.338331 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1187/2242] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:17 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:17.348229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b08ef5b-f20e-4af3-b9b4-0cb66f822471 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:17.351727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b08ef5b-f20e-4af3-b9b4-0cb66f822471 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:17.361611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b08ef5b-f20e-4af3-b9b4-0cb66f822471 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:17.365319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b08ef5b-f20e-4af3-b9b4-0cb66f822471 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:17.366063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b08ef5b-f20e-4af3-b9b4-0cb66f822471 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:17.366958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b08ef5b-f20e-4af3-b9b4-0cb66f822471 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:17.367538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b08ef5b-f20e-4af3-b9b4-0cb66f822471 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:17.370953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b08ef5b-f20e-4af3-b9b4-0cb66f822471 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:17.733335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b08ef5b-f20e-4af3-b9b4-0cb66f822471 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:17.766750 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b08ef5b-f20e-4af3-b9b4-0cb66f822471 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 0.408890 Oct 05 17:41:17.784042 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1188/2243] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:17 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:17.796193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c48adfe4-2e5a-468d-8a61-37773bd958a0 req-ae75c049-1ae9-4f2f-bc51-42c213ba5b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd32bd25-0afe-45a0-867b-3c5fb0ee201b", "tag": "217aa248-5394-47b1-a3c3-b5df71e4c0e1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:17.816739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c48adfe4-2e5a-468d-8a61-37773bd958a0 req-ae75c049-1ae9-4f2f-bc51-42c213ba5b5c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:17.817531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c48adfe4-2e5a-468d-8a61-37773bd958a0 req-ae75c049-1ae9-4f2f-bc51-42c213ba5b5c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:17.818232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c48adfe4-2e5a-468d-8a61-37773bd958a0 req-ae75c049-1ae9-4f2f-bc51-42c213ba5b5c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:17.832064 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c48adfe4-2e5a-468d-8a61-37773bd958a0 req-ae75c049-1ae9-4f2f-bc51-42c213ba5b5c service nova] Creating event network-changed:217aa248-5394-47b1-a3c3-b5df71e4c0e1 for instance dd32bd25-0afe-45a0-867b-3c5fb0ee201b on n-h1-835595-3 Oct 05 17:41:17.863030 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c48adfe4-2e5a-468d-8a61-37773bd958a0 req-ae75c049-1ae9-4f2f-bc51-42c213ba5b5c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074204 Oct 05 17:41:17.871292 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1189/2244] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:17.879692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-89206f53-0fbe-4ef9-950b-695e17bd041d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:17.883469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-89206f53-0fbe-4ef9-950b-695e17bd041d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:17.937551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89206f53-0fbe-4ef9-950b-695e17bd041d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:17.939519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89206f53-0fbe-4ef9-950b-695e17bd041d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:17.943890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89206f53-0fbe-4ef9-950b-695e17bd041d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:17.947446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89206f53-0fbe-4ef9-950b-695e17bd041d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:17.980049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89206f53-0fbe-4ef9-950b-695e17bd041d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:17.984293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89206f53-0fbe-4ef9-950b-695e17bd041d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:18.518884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-60a9b5ce-3c6f-4872-b956-12cd356542be tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:18.532212 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-60a9b5ce-3c6f-4872-b956-12cd356542be tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1319 microversion: 2.1 time: 2.041584 Oct 05 17:41:18.533202 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1056/2245] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:16 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1319 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:18.538650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da896012-0fd5-463a-9c10-e65ecb42fe46 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:18.539503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da896012-0fd5-463a-9c10-e65ecb42fe46 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:18.546923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da896012-0fd5-463a-9c10-e65ecb42fe46 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:18.547676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da896012-0fd5-463a-9c10-e65ecb42fe46 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:18.548256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da896012-0fd5-463a-9c10-e65ecb42fe46 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:18.549075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da896012-0fd5-463a-9c10-e65ecb42fe46 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:18.549667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da896012-0fd5-463a-9c10-e65ecb42fe46 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:18.551484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da896012-0fd5-463a-9c10-e65ecb42fe46 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:18.726704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-89206f53-0fbe-4ef9-950b-695e17bd041d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:18.733214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:18.748471 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-89206f53-0fbe-4ef9-950b-695e17bd041d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1315 microversion: 2.1 time: 0.875298 Oct 05 17:41:18.749685 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1190/2246] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:17 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1315 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:18.755048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f6dc7be-e89a-4eef-a61d-b00d8c124ba4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777963eaf0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:18.824694 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f6dc7be-e89a-4eef-a61d-b00d8c124ba4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.073409 Oct 05 17:41:18.825292 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1191/2247] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:18 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:18.844797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a881506-39c1-49ad-8ff8-5bf4d1ed4148 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:18.846511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9a881506-39c1-49ad-8ff8-5bf4d1ed4148 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:18.864013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a881506-39c1-49ad-8ff8-5bf4d1ed4148 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:18.864534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a881506-39c1-49ad-8ff8-5bf4d1ed4148 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:18.864982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a881506-39c1-49ad-8ff8-5bf4d1ed4148 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:18.865708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a881506-39c1-49ad-8ff8-5bf4d1ed4148 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:18.868653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a881506-39c1-49ad-8ff8-5bf4d1ed4148 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:18.869104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a881506-39c1-49ad-8ff8-5bf4d1ed4148 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:19.188093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-da896012-0fd5-463a-9c10-e65ecb42fe46 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:19.203744 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da896012-0fd5-463a-9c10-e65ecb42fe46 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1316 microversion: 2.1 time: 0.667749 Oct 05 17:41:19.204370 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1057/2248] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:18 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1316 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:19.550142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9a881506-39c1-49ad-8ff8-5bf4d1ed4148 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:19.562904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d41bfa15-9929-4278-ba59-bddd7505a40c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:19.567074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d41bfa15-9929-4278-ba59-bddd7505a40c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:19.569567 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a881506-39c1-49ad-8ff8-5bf4d1ed4148 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 0.731274 Oct 05 17:41:19.575381 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1192/2249] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:18 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:19.595066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d41bfa15-9929-4278-ba59-bddd7505a40c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:19.596172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d41bfa15-9929-4278-ba59-bddd7505a40c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:19.597272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d41bfa15-9929-4278-ba59-bddd7505a40c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:19.598208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d41bfa15-9929-4278-ba59-bddd7505a40c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:19.598702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d41bfa15-9929-4278-ba59-bddd7505a40c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:19.603103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d41bfa15-9929-4278-ba59-bddd7505a40c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:19.776882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-933788c6-dde9-4934-9405-f83bb098c452 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:19.779417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-933788c6-dde9-4934-9405-f83bb098c452 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:19.788210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-933788c6-dde9-4934-9405-f83bb098c452 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:19.788944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-933788c6-dde9-4934-9405-f83bb098c452 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:19.789538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-933788c6-dde9-4934-9405-f83bb098c452 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:19.790492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-933788c6-dde9-4934-9405-f83bb098c452 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:19.791131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-933788c6-dde9-4934-9405-f83bb098c452 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:19.791838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-933788c6-dde9-4934-9405-f83bb098c452 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:20.424803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d41bfa15-9929-4278-ba59-bddd7505a40c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:20.436563 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d41bfa15-9929-4278-ba59-bddd7505a40c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1319 microversion: 2.1 time: 0.883343 Oct 05 17:41:20.439397 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1058/2250] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:19 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1319 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:20.454117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-425ed1af-4de4-4a1a-b2f5-3ce15e1031ca tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77794dae50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:20.521713 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-425ed1af-4de4-4a1a-b2f5-3ce15e1031ca tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.079693 Oct 05 17:41:20.522658 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1059/2251] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:20 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:20.534197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-506eda99-a4ae-4b0b-b302-6a10d164f40d tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:20.538091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-506eda99-a4ae-4b0b-b302-6a10d164f40d tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:20.553854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-506eda99-a4ae-4b0b-b302-6a10d164f40d tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:20.554418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-506eda99-a4ae-4b0b-b302-6a10d164f40d tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:20.554867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-506eda99-a4ae-4b0b-b302-6a10d164f40d tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:20.557696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-506eda99-a4ae-4b0b-b302-6a10d164f40d tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:20.559278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-506eda99-a4ae-4b0b-b302-6a10d164f40d tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:20.559721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-506eda99-a4ae-4b0b-b302-6a10d164f40d tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:21.434871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-933788c6-dde9-4934-9405-f83bb098c452 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:21.446817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-506eda99-a4ae-4b0b-b302-6a10d164f40d tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:21.473908 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-933788c6-dde9-4934-9405-f83bb098c452 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1315 microversion: 2.1 time: 1.701815 Oct 05 17:41:21.482014 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1193/2252] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:19 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1315 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:41:21.488914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-032432d1-1c1d-4f35-9225-b5979e527ada req-5c0e9875-0f92-4959-a84b-8f5f11c558a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51c0c9d6-efb6-4b55-9df3-23625b4c4efb", "tag": "da5d4bc0-859e-4373-9563-212b6d5bb0e6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:21.493998 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-506eda99-a4ae-4b0b-b302-6a10d164f40d tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1316 microversion: 2.1 time: 0.965507 Oct 05 17:41:21.496907 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1060/2253] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:20 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1316 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:21.520365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-032432d1-1c1d-4f35-9225-b5979e527ada req-5c0e9875-0f92-4959-a84b-8f5f11c558a3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:21.521165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-032432d1-1c1d-4f35-9225-b5979e527ada req-5c0e9875-0f92-4959-a84b-8f5f11c558a3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:21.522341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-032432d1-1c1d-4f35-9225-b5979e527ada req-5c0e9875-0f92-4959-a84b-8f5f11c558a3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:21.523878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-074c9206-e281-476d-b468-cba77b467ec5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:21.529477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-074c9206-e281-476d-b468-cba77b467ec5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:21.557051 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-032432d1-1c1d-4f35-9225-b5979e527ada req-5c0e9875-0f92-4959-a84b-8f5f11c558a3 service nova] Creating event network-changed:da5d4bc0-859e-4373-9563-212b6d5bb0e6 for instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb on n-h2-835595-3 Oct 05 17:41:21.558107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-074c9206-e281-476d-b468-cba77b467ec5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:21.560568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-074c9206-e281-476d-b468-cba77b467ec5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:21.562842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-074c9206-e281-476d-b468-cba77b467ec5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:21.571246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-074c9206-e281-476d-b468-cba77b467ec5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:21.572159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-074c9206-e281-476d-b468-cba77b467ec5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:21.572941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-074c9206-e281-476d-b468-cba77b467ec5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:21.573060 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-032432d1-1c1d-4f35-9225-b5979e527ada req-5c0e9875-0f92-4959-a84b-8f5f11c558a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089048 Oct 05 17:41:21.574057 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1194/2254] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:21.584128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ecbb95a8-2fa6-424a-8fef-0f0a96165fad tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:21.584858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ecbb95a8-2fa6-424a-8fef-0f0a96165fad tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:21.601625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecbb95a8-2fa6-424a-8fef-0f0a96165fad tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:21.602133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecbb95a8-2fa6-424a-8fef-0f0a96165fad tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:21.602601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecbb95a8-2fa6-424a-8fef-0f0a96165fad tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:21.603326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecbb95a8-2fa6-424a-8fef-0f0a96165fad tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:21.603788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecbb95a8-2fa6-424a-8fef-0f0a96165fad tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:21.604333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecbb95a8-2fa6-424a-8fef-0f0a96165fad tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:21.633954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:21.658601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:21.671102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=27 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:22.145147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ecbb95a8-2fa6-424a-8fef-0f0a96165fad tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:22.154987 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ecbb95a8-2fa6-424a-8fef-0f0a96165fad tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1319 microversion: 2.1 time: 0.579395 Oct 05 17:41:22.156968 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1195/2255] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:21 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1319 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:22.167643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4042915a-0cb7-4098-a5d3-b3a8901277e8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777964b0d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:22.273523 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4042915a-0cb7-4098-a5d3-b3a8901277e8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.115365 Oct 05 17:41:22.274186 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1196/2256] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:22 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:22.497236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4f58c9e4-29fb-49c2-bf84-c71f42960779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:22.498148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4f58c9e4-29fb-49c2-bf84-c71f42960779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:22.511627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f58c9e4-29fb-49c2-bf84-c71f42960779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:22.512137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f58c9e4-29fb-49c2-bf84-c71f42960779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:22.542414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f58c9e4-29fb-49c2-bf84-c71f42960779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:22.544934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f58c9e4-29fb-49c2-bf84-c71f42960779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:22.547531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f58c9e4-29fb-49c2-bf84-c71f42960779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:22.548269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f58c9e4-29fb-49c2-bf84-c71f42960779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:22.696187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-074c9206-e281-476d-b468-cba77b467ec5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:22.711341 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-074c9206-e281-476d-b468-cba77b467ec5 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 1.211931 Oct 05 17:41:22.712356 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1061/2257] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:21 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:22.717345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-50e61ecc-8bc4-42df-8f80-f271c80ccd9b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:22.727718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-50e61ecc-8bc4-42df-8f80-f271c80ccd9b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:22.743962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50e61ecc-8bc4-42df-8f80-f271c80ccd9b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:22.746670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50e61ecc-8bc4-42df-8f80-f271c80ccd9b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:22.747249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50e61ecc-8bc4-42df-8f80-f271c80ccd9b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:22.748072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50e61ecc-8bc4-42df-8f80-f271c80ccd9b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:22.750886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:22.753504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50e61ecc-8bc4-42df-8f80-f271c80ccd9b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:22.758799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50e61ecc-8bc4-42df-8f80-f271c80ccd9b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:23.526430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50e61ecc-8bc4-42df-8f80-f271c80ccd9b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:23.540554 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-50e61ecc-8bc4-42df-8f80-f271c80ccd9b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1316 microversion: 2.1 time: 0.825534 Oct 05 17:41:23.541788 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1062/2258] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:22 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1316 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:23.554219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-fa64756e-96d1-40bd-a093-d021aaf964c7 req-257b3e13-ba67-4be8-9fcd-61ca9e4d8a53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f76e942-86f4-44da-b82d-da4416157a4f", "tag": "baaf15c6-2eb1-4137-b82a-51a1a07f9c3f"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:23.582817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fa64756e-96d1-40bd-a093-d021aaf964c7 req-257b3e13-ba67-4be8-9fcd-61ca9e4d8a53 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:23.583613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fa64756e-96d1-40bd-a093-d021aaf964c7 req-257b3e13-ba67-4be8-9fcd-61ca9e4d8a53 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:23.585497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fa64756e-96d1-40bd-a093-d021aaf964c7 req-257b3e13-ba67-4be8-9fcd-61ca9e4d8a53 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:23.616156 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-fa64756e-96d1-40bd-a093-d021aaf964c7 req-257b3e13-ba67-4be8-9fcd-61ca9e4d8a53 service nova] Creating event network-changed:baaf15c6-2eb1-4137-b82a-51a1a07f9c3f for instance 9f76e942-86f4-44da-b82d-da4416157a4f on n-h2-835595-3 Oct 05 17:41:23.623335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f58c9e4-29fb-49c2-bf84-c71f42960779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:23.631767 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4f58c9e4-29fb-49c2-bf84-c71f42960779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1315 microversion: 2.1 time: 1.138551 Oct 05 17:41:23.643642 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1197/2259] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:22 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1315 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:23.652131 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-fa64756e-96d1-40bd-a093-d021aaf964c7 req-257b3e13-ba67-4be8-9fcd-61ca9e4d8a53 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107073 Oct 05 17:41:23.654485 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1063/2260] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:23.661131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25d2ff1d-dc72-4052-8c1a-8d328b6118d3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:23.662000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25d2ff1d-dc72-4052-8c1a-8d328b6118d3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:23.671182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-116093eb-3fd2-404d-90da-822f7c32c2b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795620d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:23.683092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d2ff1d-dc72-4052-8c1a-8d328b6118d3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:23.684184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d2ff1d-dc72-4052-8c1a-8d328b6118d3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:23.684777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d2ff1d-dc72-4052-8c1a-8d328b6118d3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:23.691282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d2ff1d-dc72-4052-8c1a-8d328b6118d3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:23.692177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d2ff1d-dc72-4052-8c1a-8d328b6118d3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:23.692770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d2ff1d-dc72-4052-8c1a-8d328b6118d3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:23.785460 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-116093eb-3fd2-404d-90da-822f7c32c2b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.129421 Oct 05 17:41:23.795030 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1064/2261] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:23 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:23.806773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1e6889b5-83a1-4b5d-8494-21f4fc737073 req-ba6fb472-8bca-4f6b-a3ff-0d1bea406069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b694959-7c45-47bc-9c5d-cff02aa8e3f3", "name": "network-vif-plugged", "status": "completed", "tag": "9472b148-e969-40cc-87f1-db6934949380"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:23.849909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1e6889b5-83a1-4b5d-8494-21f4fc737073 req-ba6fb472-8bca-4f6b-a3ff-0d1bea406069 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:23.855972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1e6889b5-83a1-4b5d-8494-21f4fc737073 req-ba6fb472-8bca-4f6b-a3ff-0d1bea406069 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:23.856572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1e6889b5-83a1-4b5d-8494-21f4fc737073 req-ba6fb472-8bca-4f6b-a3ff-0d1bea406069 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:23.880268 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1e6889b5-83a1-4b5d-8494-21f4fc737073 req-ba6fb472-8bca-4f6b-a3ff-0d1bea406069 service nova] Creating event network-vif-plugged:9472b148-e969-40cc-87f1-db6934949380 for instance 8b694959-7c45-47bc-9c5d-cff02aa8e3f3 on n-h2-835595-3 Oct 05 17:41:23.888123 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1e6889b5-83a1-4b5d-8494-21f4fc737073 req-ba6fb472-8bca-4f6b-a3ff-0d1bea406069 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093336 Oct 05 17:41:23.895365 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1065/2262] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:23.904749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-28ed2617-fa81-4e04-9387-5bf0fcd274ff tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:23.907907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-28ed2617-fa81-4e04-9387-5bf0fcd274ff tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:23.927141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28ed2617-fa81-4e04-9387-5bf0fcd274ff tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:23.927659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28ed2617-fa81-4e04-9387-5bf0fcd274ff tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:23.932026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28ed2617-fa81-4e04-9387-5bf0fcd274ff tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:23.933713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28ed2617-fa81-4e04-9387-5bf0fcd274ff tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:23.934626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28ed2617-fa81-4e04-9387-5bf0fcd274ff tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:23.942124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28ed2617-fa81-4e04-9387-5bf0fcd274ff tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:25.011474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-28ed2617-fa81-4e04-9387-5bf0fcd274ff tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:25.025322 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-28ed2617-fa81-4e04-9387-5bf0fcd274ff tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 1.128337 Oct 05 17:41:25.035885 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1066/2263] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:23 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:25.053262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-9580a2c7-6466-4332-b473-b61028026145 req-7fc7b57c-3007-482d-8782-e195e1f4c628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1268310-ba70-4b04-b154-c40254378586", "tag": "b277c367-ce3b-49d4-832e-804f1b7ed32d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:25.054139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25d2ff1d-dc72-4052-8c1a-8d328b6118d3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:25.065530 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25d2ff1d-dc72-4052-8c1a-8d328b6118d3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1319 microversion: 2.1 time: 1.420526 Oct 05 17:41:25.071168 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1198/2264] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:23 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1319 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:25.076922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ee11163b-0088-40b2-a3ca-a6df1673002e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:25.079703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ee11163b-0088-40b2-a3ca-a6df1673002e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:25.099207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee11163b-0088-40b2-a3ca-a6df1673002e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:25.100045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee11163b-0088-40b2-a3ca-a6df1673002e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:25.100676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee11163b-0088-40b2-a3ca-a6df1673002e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:25.103815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee11163b-0088-40b2-a3ca-a6df1673002e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:25.104537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee11163b-0088-40b2-a3ca-a6df1673002e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:25.105341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee11163b-0088-40b2-a3ca-a6df1673002e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:25.114231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9580a2c7-6466-4332-b473-b61028026145 req-7fc7b57c-3007-482d-8782-e195e1f4c628 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:25.115239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9580a2c7-6466-4332-b473-b61028026145 req-7fc7b57c-3007-482d-8782-e195e1f4c628 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:25.116322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9580a2c7-6466-4332-b473-b61028026145 req-7fc7b57c-3007-482d-8782-e195e1f4c628 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:25.132937 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9580a2c7-6466-4332-b473-b61028026145 req-7fc7b57c-3007-482d-8782-e195e1f4c628 service nova] Creating event network-changed:b277c367-ce3b-49d4-832e-804f1b7ed32d for instance e1268310-ba70-4b04-b154-c40254378586 on n-h1-835595-3 Oct 05 17:41:25.141294 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-9580a2c7-6466-4332-b473-b61028026145 req-7fc7b57c-3007-482d-8782-e195e1f4c628 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102805 Oct 05 17:41:25.142478 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1067/2265] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:25.175992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fdce4913-97fa-4c0c-bd77-26f8ae149813 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:25.178754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fdce4913-97fa-4c0c-bd77-26f8ae149813 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:25.199843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdce4913-97fa-4c0c-bd77-26f8ae149813 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:25.200610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdce4913-97fa-4c0c-bd77-26f8ae149813 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:25.202177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdce4913-97fa-4c0c-bd77-26f8ae149813 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:25.208449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdce4913-97fa-4c0c-bd77-26f8ae149813 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:25.209233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdce4913-97fa-4c0c-bd77-26f8ae149813 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:25.212622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdce4913-97fa-4c0c-bd77-26f8ae149813 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:25.763072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fdce4913-97fa-4c0c-bd77-26f8ae149813 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:25.780491 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fdce4913-97fa-4c0c-bd77-26f8ae149813 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1315 microversion: 2.1 time: 0.635687 Oct 05 17:41:25.784766 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1068/2266] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:25 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1315 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:25.801737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed02b561-5c15-4be3-947c-a99c76375fb5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77794c6c10>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:25.980976 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed02b561-5c15-4be3-947c-a99c76375fb5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.191480 Oct 05 17:41:25.982149 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1069/2267] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:25 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:26.020452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-41d01177-889f-4034-be3f-65926a65320f req-ceec8864-da91-4e34-bd3f-ca00244ed8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd32bd25-0afe-45a0-867b-3c5fb0ee201b", "name": "network-vif-plugged", "status": "completed", "tag": "217aa248-5394-47b1-a3c3-b5df71e4c0e1"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:26.042533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-41d01177-889f-4034-be3f-65926a65320f req-ceec8864-da91-4e34-bd3f-ca00244ed8cf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:26.043229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-41d01177-889f-4034-be3f-65926a65320f req-ceec8864-da91-4e34-bd3f-ca00244ed8cf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:26.043697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-41d01177-889f-4034-be3f-65926a65320f req-ceec8864-da91-4e34-bd3f-ca00244ed8cf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:26.062082 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-41d01177-889f-4034-be3f-65926a65320f req-ceec8864-da91-4e34-bd3f-ca00244ed8cf service nova] Creating event network-vif-plugged:217aa248-5394-47b1-a3c3-b5df71e4c0e1 for instance dd32bd25-0afe-45a0-867b-3c5fb0ee201b on n-h1-835595-3 Oct 05 17:41:26.067600 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-41d01177-889f-4034-be3f-65926a65320f req-ceec8864-da91-4e34-bd3f-ca00244ed8cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079587 Oct 05 17:41:26.069805 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1070/2268] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:26.119673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b7e582b6-d069-4235-8f45-dfccc5222711 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:26.119673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b7e582b6-d069-4235-8f45-dfccc5222711 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:26.119673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e582b6-d069-4235-8f45-dfccc5222711 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:26.119673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e582b6-d069-4235-8f45-dfccc5222711 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:26.119673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e582b6-d069-4235-8f45-dfccc5222711 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:26.119673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e582b6-d069-4235-8f45-dfccc5222711 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:26.119673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e582b6-d069-4235-8f45-dfccc5222711 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:26.119673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e582b6-d069-4235-8f45-dfccc5222711 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:26.313232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ee11163b-0088-40b2-a3ca-a6df1673002e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:26.324427 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ee11163b-0088-40b2-a3ca-a6df1673002e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1316 microversion: 2.1 time: 1.249747 Oct 05 17:41:26.326750 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1199/2269] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:25 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1316 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:26.340929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47cc1006-fe68-49dd-aca6-9b7800d26109 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:26.343375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-47cc1006-fe68-49dd-aca6-9b7800d26109 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:26.356661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47cc1006-fe68-49dd-aca6-9b7800d26109 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:26.360851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47cc1006-fe68-49dd-aca6-9b7800d26109 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:26.362241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47cc1006-fe68-49dd-aca6-9b7800d26109 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:26.368488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47cc1006-fe68-49dd-aca6-9b7800d26109 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:26.369242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47cc1006-fe68-49dd-aca6-9b7800d26109 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:26.370111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47cc1006-fe68-49dd-aca6-9b7800d26109 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:26.792708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7e582b6-d069-4235-8f45-dfccc5222711 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:26.804917 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b7e582b6-d069-4235-8f45-dfccc5222711 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 0.731195 Oct 05 17:41:26.807624 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1071/2270] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:26 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:26.822263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-114225f6-6472-4b8d-a3fa-30d83c39287c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:26.823220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-114225f6-6472-4b8d-a3fa-30d83c39287c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:26.846364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-114225f6-6472-4b8d-a3fa-30d83c39287c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:26.848112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-114225f6-6472-4b8d-a3fa-30d83c39287c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:26.849530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-114225f6-6472-4b8d-a3fa-30d83c39287c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:26.853249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-114225f6-6472-4b8d-a3fa-30d83c39287c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:26.855294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-114225f6-6472-4b8d-a3fa-30d83c39287c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:26.856269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-114225f6-6472-4b8d-a3fa-30d83c39287c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:27.060584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-47cc1006-fe68-49dd-aca6-9b7800d26109 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:27.074060 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-47cc1006-fe68-49dd-aca6-9b7800d26109 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 200 len: 1506 microversion: 2.1 time: 0.745268 Oct 05 17:41:27.075700 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1200/2271] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:26 2022] GET /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 1506 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:27.089818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7fa7f998-601b-448f-93a7-cb2a628c922f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795cf8b0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:27.125371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-114225f6-6472-4b8d-a3fa-30d83c39287c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:27.141842 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-114225f6-6472-4b8d-a3fa-30d83c39287c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1315 microversion: 2.1 time: 0.328011 Oct 05 17:41:27.145583 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1072/2272] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:26 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:27.159516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58e91c6c-d943-43f8-ad11-d35bd73ab7b8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:27.162741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-58e91c6c-d943-43f8-ad11-d35bd73ab7b8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: dd32bd25-0afe-45a0-867b-3c5fb0ee201b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:27.187344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e91c6c-d943-43f8-ad11-d35bd73ab7b8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:27.189128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e91c6c-d943-43f8-ad11-d35bd73ab7b8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:27.190534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e91c6c-d943-43f8-ad11-d35bd73ab7b8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:27.194101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e91c6c-d943-43f8-ad11-d35bd73ab7b8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:27.196242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e91c6c-d943-43f8-ad11-d35bd73ab7b8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:27.199055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e91c6c-d943-43f8-ad11-d35bd73ab7b8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:27.234879 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7fa7f998-601b-448f-93a7-cb2a628c922f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1412 microversion: 2.1 time: 0.157015 Oct 05 17:41:27.235499 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1201/2273] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:27 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1412 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:27.352248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a2e9b1d2-d134-430b-9c01-8f4fbfa70e1e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:27.352997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a2e9b1d2-d134-430b-9c01-8f4fbfa70e1e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:27.367689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2e9b1d2-d134-430b-9c01-8f4fbfa70e1e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:27.375892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2e9b1d2-d134-430b-9c01-8f4fbfa70e1e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:27.376374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2e9b1d2-d134-430b-9c01-8f4fbfa70e1e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:27.377134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2e9b1d2-d134-430b-9c01-8f4fbfa70e1e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:27.377602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2e9b1d2-d134-430b-9c01-8f4fbfa70e1e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:27.378033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2e9b1d2-d134-430b-9c01-8f4fbfa70e1e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:27.792517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58e91c6c-d943-43f8-ad11-d35bd73ab7b8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:27.806128 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-58e91c6c-d943-43f8-ad11-d35bd73ab7b8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/dd32bd25-0afe-45a0-867b-3c5fb0ee201b" status: 200 len: 1319 microversion: 2.1 time: 0.656873 Oct 05 17:41:27.810348 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1073/2274] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:27 2022] GET /compute/v2.1/servers/dd32bd25-0afe-45a0-867b-3c5fb0ee201b => generated 1319 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:27.834156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2afe9e6e-3fd1-4935-8381-3c72cdd59efe tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:27.835052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2afe9e6e-3fd1-4935-8381-3c72cdd59efe tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:27.844322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afe9e6e-3fd1-4935-8381-3c72cdd59efe tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:27.845262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afe9e6e-3fd1-4935-8381-3c72cdd59efe tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:27.845907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afe9e6e-3fd1-4935-8381-3c72cdd59efe tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:27.846932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afe9e6e-3fd1-4935-8381-3c72cdd59efe tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:27.847638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afe9e6e-3fd1-4935-8381-3c72cdd59efe tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:27.848227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afe9e6e-3fd1-4935-8381-3c72cdd59efe tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:28.166362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a2e9b1d2-d134-430b-9c01-8f4fbfa70e1e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:28.185361 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a2e9b1d2-d134-430b-9c01-8f4fbfa70e1e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1316 microversion: 2.1 time: 0.836540 Oct 05 17:41:28.187341 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1202/2275] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:27 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1316 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:28.212122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2afe9e6e-3fd1-4935-8381-3c72cdd59efe tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:28.213022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4472e886-5c2e-4b7e-8193-891b69ef26c1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:28.213690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4472e886-5c2e-4b7e-8193-891b69ef26c1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:28.222399 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2afe9e6e-3fd1-4935-8381-3c72cdd59efe tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 0.392079 Oct 05 17:41:28.230267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4472e886-5c2e-4b7e-8193-891b69ef26c1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:28.231254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4472e886-5c2e-4b7e-8193-891b69ef26c1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:28.232641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4472e886-5c2e-4b7e-8193-891b69ef26c1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:28.235200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4472e886-5c2e-4b7e-8193-891b69ef26c1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:28.238718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4472e886-5c2e-4b7e-8193-891b69ef26c1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:28.239319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4472e886-5c2e-4b7e-8193-891b69ef26c1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:28.240344 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1074/2276] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:27 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:28.258950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-082f013e-9073-4a50-951c-584e2e30f21f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77794989d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:28.317303 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-082f013e-9073-4a50-951c-584e2e30f21f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1421 microversion: 2.1 time: 0.067994 Oct 05 17:41:28.317303 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1075/2277] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:28 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1421 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:28.329926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e36eaf8a-69b9-4ead-828c-9a36c1935fcd tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7779498310>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:28.379780 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e36eaf8a-69b9-4ead-828c-9a36c1935fcd tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 200 len: 1421 microversion: 2.1 time: 0.053600 Oct 05 17:41:28.380733 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1076/2278] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:41:28 2022] GET /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 1421 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:41:28.395392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0323de9e-e01d-4b08-917b-467300d1632f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77794983a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:28.604170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4472e886-5c2e-4b7e-8193-891b69ef26c1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:28.616140 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4472e886-5c2e-4b7e-8193-891b69ef26c1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1315 microversion: 2.1 time: 0.415947 Oct 05 17:41:28.619006 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1203/2279] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:28 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:28.835065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2107e257-7bf4-480e-8b5c-437103474fab tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:28.835713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2107e257-7bf4-480e-8b5c-437103474fab tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: dd32bd25-0afe-45a0-867b-3c5fb0ee201b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:28.855315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2107e257-7bf4-480e-8b5c-437103474fab tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:28.855859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2107e257-7bf4-480e-8b5c-437103474fab tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:28.856313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2107e257-7bf4-480e-8b5c-437103474fab tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:28.860139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2107e257-7bf4-480e-8b5c-437103474fab tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:28.861794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2107e257-7bf4-480e-8b5c-437103474fab tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:28.863984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2107e257-7bf4-480e-8b5c-437103474fab tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:29.531636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2107e257-7bf4-480e-8b5c-437103474fab tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:29.547470 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2107e257-7bf4-480e-8b5c-437103474fab tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/dd32bd25-0afe-45a0-867b-3c5fb0ee201b" status: 200 len: 1507 microversion: 2.1 time: 0.716527 Oct 05 17:41:29.550986 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1204/2280] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:28 2022] GET /compute/v2.1/servers/dd32bd25-0afe-45a0-867b-3c5fb0ee201b => generated 1507 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:29.567289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-85ff8462-8bd8-49be-8d85-6ebafe793122 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:29.568498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-85ff8462-8bd8-49be-8d85-6ebafe793122 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:29.582619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85ff8462-8bd8-49be-8d85-6ebafe793122 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:29.583527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85ff8462-8bd8-49be-8d85-6ebafe793122 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:29.584127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85ff8462-8bd8-49be-8d85-6ebafe793122 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:29.585856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85ff8462-8bd8-49be-8d85-6ebafe793122 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:29.588807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85ff8462-8bd8-49be-8d85-6ebafe793122 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:29.589510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85ff8462-8bd8-49be-8d85-6ebafe793122 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:29.632066 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0323de9e-e01d-4b08-917b-467300d1632f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 204 len: 0 microversion: 2.1 time: 1.240694 Oct 05 17:41:29.632673 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1077/2281] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:28 2022] DELETE /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 0 bytes in 1243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:41:29.642664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b30db8f-fd3f-466f-8ab3-bb76c6cd24a0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Action: 'create', calling method: .version_select at 0x7f77794c6670>, body: {"keypair": {"name": "tempest-keypair-657021971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEGMKXo3SgGacmKWNAeDYarV6T9y/5YpleKdaGyhz1LA4Dfxd3i0VwqAo0g0gKXKDfFyHrLMbFg41fjHITBCuK7yZazr53hjZBlh7RvU9QvWFBvVnXqM2PGmgqaFDiXC9Q=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:29.675011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-7b30db8f-fd3f-466f-8ab3-bb76c6cd24a0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Getting quotas for project e3daa9043f854a7fb87e1ab2211690f8. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:41:29.682156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-7b30db8f-fd3f-466f-8ab3-bb76c6cd24a0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Getting quotas for user d3f3adea6b08459789a51e98b05cf50a and project e3daa9043f854a7fb87e1ab2211690f8. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:41:29.724151 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7b30db8f-fd3f-466f-8ab3-bb76c6cd24a0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.080745 Oct 05 17:41:29.725515 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1078/2282] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Oct 5 17:41:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 17:41:29.736062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a04a92d3-6766-464d-a95b-6b942e6240b2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:29.738123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a04a92d3-6766-464d-a95b-6b942e6240b2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:29.751461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a04a92d3-6766-464d-a95b-6b942e6240b2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:29.752250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a04a92d3-6766-464d-a95b-6b942e6240b2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:29.752916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a04a92d3-6766-464d-a95b-6b942e6240b2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:29.756249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a04a92d3-6766-464d-a95b-6b942e6240b2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:29.757037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a04a92d3-6766-464d-a95b-6b942e6240b2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:29.758878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a04a92d3-6766-464d-a95b-6b942e6240b2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:30.050982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-85ff8462-8bd8-49be-8d85-6ebafe793122 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:30.066301 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-85ff8462-8bd8-49be-8d85-6ebafe793122 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1316 microversion: 2.1 time: 0.512815 Oct 05 17:41:30.079034 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1205/2283] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:29 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:30.089009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4aa58f57-71df-4996-b727-ebd863eff7da tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:30.089787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4aa58f57-71df-4996-b727-ebd863eff7da tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: dd32bd25-0afe-45a0-867b-3c5fb0ee201b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:30.097257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aa58f57-71df-4996-b727-ebd863eff7da tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:30.097918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aa58f57-71df-4996-b727-ebd863eff7da tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:30.098502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aa58f57-71df-4996-b727-ebd863eff7da tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:30.099396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aa58f57-71df-4996-b727-ebd863eff7da tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:30.099910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aa58f57-71df-4996-b727-ebd863eff7da tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:30.100394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aa58f57-71df-4996-b727-ebd863eff7da tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:30.131290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4aa58f57-71df-4996-b727-ebd863eff7da tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: dd32bd25-0afe-45a0-867b-3c5fb0ee201b] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:41:30.155407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a04a92d3-6766-464d-a95b-6b942e6240b2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:30.164248 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a04a92d3-6766-464d-a95b-6b942e6240b2 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 0.437103 Oct 05 17:41:30.171670 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1079/2284] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:29 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:30.186630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ba36be0-bb4c-4e9d-be76-c98e3397a64a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:30.187408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6ba36be0-bb4c-4e9d-be76-c98e3397a64a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:30.193722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ba36be0-bb4c-4e9d-be76-c98e3397a64a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:30.200484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ba36be0-bb4c-4e9d-be76-c98e3397a64a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:30.201272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ba36be0-bb4c-4e9d-be76-c98e3397a64a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:30.202240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ba36be0-bb4c-4e9d-be76-c98e3397a64a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:30.202908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ba36be0-bb4c-4e9d-be76-c98e3397a64a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:30.207519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ba36be0-bb4c-4e9d-be76-c98e3397a64a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:30.259086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6ba36be0-bb4c-4e9d-be76-c98e3397a64a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:41:30.275863 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4aa58f57-71df-4996-b727-ebd863eff7da tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dd32bd25-0afe-45a0-867b-3c5fb0ee201b" status: 204 len: 0 microversion: 2.1 time: 0.193094 Oct 05 17:41:30.276636 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1206/2285] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:41:30 2022] DELETE /compute/v2.1/servers/dd32bd25-0afe-45a0-867b-3c5fb0ee201b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:41:30.289640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12ee19c1-57c7-4a1a-9455-5d500476fbf0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:30.291297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12ee19c1-57c7-4a1a-9455-5d500476fbf0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:30.304911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ee19c1-57c7-4a1a-9455-5d500476fbf0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:30.305986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ee19c1-57c7-4a1a-9455-5d500476fbf0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:30.307668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ee19c1-57c7-4a1a-9455-5d500476fbf0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:30.308538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ee19c1-57c7-4a1a-9455-5d500476fbf0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:30.309605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ee19c1-57c7-4a1a-9455-5d500476fbf0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:30.309976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ee19c1-57c7-4a1a-9455-5d500476fbf0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:30.425536 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6ba36be0-bb4c-4e9d-be76-c98e3397a64a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 204 len: 0 microversion: 2.1 time: 0.252229 Oct 05 17:41:30.426725 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1080/2286] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:41:30 2022] DELETE /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:41:30.462209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c78db33-4616-4d07-9f87-6b17e52ff324 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:30.462836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9c78db33-4616-4d07-9f87-6b17e52ff324 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:30.475843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c78db33-4616-4d07-9f87-6b17e52ff324 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:30.476338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c78db33-4616-4d07-9f87-6b17e52ff324 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:30.476774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c78db33-4616-4d07-9f87-6b17e52ff324 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:30.477487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c78db33-4616-4d07-9f87-6b17e52ff324 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:30.482102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c78db33-4616-4d07-9f87-6b17e52ff324 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:30.482676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c78db33-4616-4d07-9f87-6b17e52ff324 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:30.550056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9c78db33-4616-4d07-9f87-6b17e52ff324 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 8b694959-7c45-47bc-9c5d-cff02aa8e3f3] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:41:30.781961 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9c78db33-4616-4d07-9f87-6b17e52ff324 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3" status: 204 len: 0 microversion: 2.1 time: 0.351281 Oct 05 17:41:30.798175 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1081/2287] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:41:30 2022] DELETE /compute/v2.1/servers/8b694959-7c45-47bc-9c5d-cff02aa8e3f3 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:41:30.814993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-591061046", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "f858ae49-432b-47a7-98c9-045c9a50f77b"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:30.843030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-12ee19c1-57c7-4a1a-9455-5d500476fbf0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:30.856415 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12ee19c1-57c7-4a1a-9455-5d500476fbf0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1315 microversion: 2.1 time: 0.575125 Oct 05 17:41:30.872018 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1207/2288] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:30 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1315 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:30.921637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] validate_networks() for [('f858ae49-432b-47a7-98c9-045c9a50f77b', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:41:31.033145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-979933650", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "9110ba11-2b5a-4ff9-a7cb-a12763f98ebe"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:31.059547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:31.148136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] validate_networks() for [('9110ba11-2b5a-4ff9-a7cb-a12763f98ebe', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:41:32.478602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:41:32.479678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:41:32.480116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:41:32.480623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:41:32.481520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:41:32.508043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:32.513344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:32.514200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:32.516245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:32.516880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:32.518789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:32.570297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Getting quotas for project 47d5d4426b3d481b92b84c307cd00ead. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:41:32.575559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Getting quotas for user 6720411ae8fc46a5bcd7b8f6d95c24a8 and project 47d5d4426b3d481b92b84c307cd00ead. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:41:32.623153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:41:32.630578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:41:32.678264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:32.712180 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47a84ce2-6535-4ac0-ab63-697991ee2aeb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.912135 Oct 05 17:41:32.713519 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1082/2289] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:41:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:41:32.721108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a836aeda-9774-4b85-8a4b-a9fc68428bb7 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:32.729617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a836aeda-9774-4b85-8a4b-a9fc68428bb7 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:32.747681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a836aeda-9774-4b85-8a4b-a9fc68428bb7 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:32.748784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a836aeda-9774-4b85-8a4b-a9fc68428bb7 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:32.749346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a836aeda-9774-4b85-8a4b-a9fc68428bb7 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:32.749977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a836aeda-9774-4b85-8a4b-a9fc68428bb7 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:32.750431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a836aeda-9774-4b85-8a4b-a9fc68428bb7 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:32.750858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a836aeda-9774-4b85-8a4b-a9fc68428bb7 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:33.128463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:41:33.129912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:41:33.130648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:41:33.141127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:41:33.144621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:41:33.186924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:33.188426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:33.191496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:33.192793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:33.193774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:33.195017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:33.278214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Getting quotas for project 3db359a59df94c21a7d7a20e09c33ab6. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:41:33.284296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Getting quotas for user baf989c93eb94cf39ee90431703ec185 and project 3db359a59df94c21a7d7a20e09c33ab6. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:41:33.299741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Going to run 2 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:41:33.313907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 68fde73d-b536-4d20-888c-3966e7d4ed06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:41:33.411047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=68fde73d-b536-4d20-888c-3966e7d4ed06,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:41:33.518960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a836aeda-9774-4b85-8a4b-a9fc68428bb7 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:33.530329 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a836aeda-9774-4b85-8a4b-a9fc68428bb7 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1316 microversion: 2.1 time: 0.814996 Oct 05 17:41:33.530930 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1083/2290] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:32 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1316 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:33.550480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d04ec3c3-904c-4054-8b60-aa96c9412bf8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:33.551347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d04ec3c3-904c-4054-8b60-aa96c9412bf8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:33.565893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d04ec3c3-904c-4054-8b60-aa96c9412bf8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:33.568700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d04ec3c3-904c-4054-8b60-aa96c9412bf8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:33.569332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d04ec3c3-904c-4054-8b60-aa96c9412bf8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:33.570329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d04ec3c3-904c-4054-8b60-aa96c9412bf8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:33.576232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d04ec3c3-904c-4054-8b60-aa96c9412bf8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:33.576920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d04ec3c3-904c-4054-8b60-aa96c9412bf8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:33.586073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:33.637008 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3eff3d45-a780-4a67-9ee1-67a23e3e1ab6 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.598982 Oct 05 17:41:33.655231 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1208/2291] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:41:31 2022] POST /compute/v2.1/servers => generated 32 bytes in 2628 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 05 17:41:33.686193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7019833-03a5-473a-8893-d6ac18455fdc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:33.687187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b7019833-03a5-473a-8893-d6ac18455fdc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:33.713670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7019833-03a5-473a-8893-d6ac18455fdc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:33.717515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7019833-03a5-473a-8893-d6ac18455fdc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:33.725541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7019833-03a5-473a-8893-d6ac18455fdc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:33.728539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7019833-03a5-473a-8893-d6ac18455fdc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:33.730565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7019833-03a5-473a-8893-d6ac18455fdc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:33.733941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7019833-03a5-473a-8893-d6ac18455fdc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:34.729810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d04ec3c3-904c-4054-8b60-aa96c9412bf8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:34.740518 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d04ec3c3-904c-4054-8b60-aa96c9412bf8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 1.204072 Oct 05 17:41:34.745391 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1084/2292] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:33 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:34.757118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6d45f1dd-f071-4a12-9fbf-85d03cbf8c69 req-0986afb3-240e-48fa-b780-d817d2723986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1268310-ba70-4b04-b154-c40254378586", "name": "network-vif-plugged", "status": "completed", "tag": "b277c367-ce3b-49d4-832e-804f1b7ed32d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:34.784316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6d45f1dd-f071-4a12-9fbf-85d03cbf8c69 req-0986afb3-240e-48fa-b780-d817d2723986 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:34.788813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6d45f1dd-f071-4a12-9fbf-85d03cbf8c69 req-0986afb3-240e-48fa-b780-d817d2723986 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:34.789088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b7019833-03a5-473a-8893-d6ac18455fdc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:34.790181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6d45f1dd-f071-4a12-9fbf-85d03cbf8c69 req-0986afb3-240e-48fa-b780-d817d2723986 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:34.803332 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b7019833-03a5-473a-8893-d6ac18455fdc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1315 microversion: 2.1 time: 1.145365 Oct 05 17:41:34.807729 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1209/2293] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:33 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1315 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:34.819825 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6d45f1dd-f071-4a12-9fbf-85d03cbf8c69 req-0986afb3-240e-48fa-b780-d817d2723986 service nova] Creating event network-vif-plugged:b277c367-ce3b-49d4-832e-804f1b7ed32d for instance e1268310-ba70-4b04-b154-c40254378586 on n-h1-835595-3 Oct 05 17:41:34.835045 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6d45f1dd-f071-4a12-9fbf-85d03cbf8c69 req-0986afb3-240e-48fa-b780-d817d2723986 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087927 Oct 05 17:41:34.836795 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1085/2294] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:34.845368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a8f172c3-933f-4656-8e0e-212bfc3b54a4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:34.847940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a8f172c3-933f-4656-8e0e-212bfc3b54a4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:34.851427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:34.863609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:34.865349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Searching by: {'deleted': False, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:41:34.888651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8f172c3-933f-4656-8e0e-212bfc3b54a4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:34.889162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8f172c3-933f-4656-8e0e-212bfc3b54a4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:34.895656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8f172c3-933f-4656-8e0e-212bfc3b54a4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:34.896443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8f172c3-933f-4656-8e0e-212bfc3b54a4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:34.896927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8f172c3-933f-4656-8e0e-212bfc3b54a4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:34.897365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8f172c3-933f-4656-8e0e-212bfc3b54a4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:34.933650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:34.938354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:34.943256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:34.947572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:34.948612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:34.949262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:34.955025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:35.121848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:41:35.203135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8f172c3-933f-4656-8e0e-212bfc3b54a4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:35.221245 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a8f172c3-933f-4656-8e0e-212bfc3b54a4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1277 microversion: 2.1 time: 0.404687 Oct 05 17:41:35.221875 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1210/2295] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:34 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1277 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:35.235263 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1b8f9d60-4a8a-4041-bb04-06c45df39792 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.396288 Oct 05 17:41:35.238859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-da30441c-06f5-4265-93c7-12c90fa2f084 req-ebb21d3f-7c59-400c-ab5b-bee57f676558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b694959-7c45-47bc-9c5d-cff02aa8e3f3", "name": "network-vif-deleted", "tag": "9472b148-e969-40cc-87f1-db6934949380"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:35.239540 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1086/2296] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:41:34 2022] GET /compute/v2.1/servers => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:35.250038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d02f37d3-b134-4216-ba9f-dde80c36d208 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:35.254991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d02f37d3-b134-4216-ba9f-dde80c36d208 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:35.268999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02f37d3-b134-4216-ba9f-dde80c36d208 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:35.272334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02f37d3-b134-4216-ba9f-dde80c36d208 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:35.274254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02f37d3-b134-4216-ba9f-dde80c36d208 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:35.274612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-da30441c-06f5-4265-93c7-12c90fa2f084 req-ebb21d3f-7c59-400c-ab5b-bee57f676558 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:35.275552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02f37d3-b134-4216-ba9f-dde80c36d208 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:35.276456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-da30441c-06f5-4265-93c7-12c90fa2f084 req-ebb21d3f-7c59-400c-ab5b-bee57f676558 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:35.277125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02f37d3-b134-4216-ba9f-dde80c36d208 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:35.277973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-da30441c-06f5-4265-93c7-12c90fa2f084 req-ebb21d3f-7c59-400c-ab5b-bee57f676558 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:35.278724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02f37d3-b134-4216-ba9f-dde80c36d208 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:35.308080 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-da30441c-06f5-4265-93c7-12c90fa2f084 req-ebb21d3f-7c59-400c-ab5b-bee57f676558 service nova] Creating event network-vif-deleted:9472b148-e969-40cc-87f1-db6934949380 for instance 8b694959-7c45-47bc-9c5d-cff02aa8e3f3 on n-h2-835595-3 Oct 05 17:41:35.320335 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-da30441c-06f5-4265-93c7-12c90fa2f084 req-ebb21d3f-7c59-400c-ab5b-bee57f676558 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091968 Oct 05 17:41:35.323418 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1211/2297] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:35.333977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-861ca309-3562-4f02-a5e6-73c2a05dcaae tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:35.335432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-861ca309-3562-4f02-a5e6-73c2a05dcaae tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:35.349273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861ca309-3562-4f02-a5e6-73c2a05dcaae tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:35.350308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861ca309-3562-4f02-a5e6-73c2a05dcaae tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:35.351128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861ca309-3562-4f02-a5e6-73c2a05dcaae tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:35.352071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861ca309-3562-4f02-a5e6-73c2a05dcaae tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:35.354049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861ca309-3562-4f02-a5e6-73c2a05dcaae tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:35.354754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-861ca309-3562-4f02-a5e6-73c2a05dcaae tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:35.564514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-861ca309-3562-4f02-a5e6-73c2a05dcaae tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:35.578815 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-861ca309-3562-4f02-a5e6-73c2a05dcaae tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1221 microversion: 2.1 time: 0.253127 Oct 05 17:41:35.579988 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1212/2298] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:35 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1221 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:35.785992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cd9e76c6-aa3f-407a-ab70-71d429d43d08 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:35.787524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cd9e76c6-aa3f-407a-ab70-71d429d43d08 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:35.798795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9e76c6-aa3f-407a-ab70-71d429d43d08 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:35.799520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9e76c6-aa3f-407a-ab70-71d429d43d08 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:35.800575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9e76c6-aa3f-407a-ab70-71d429d43d08 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:35.813559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9e76c6-aa3f-407a-ab70-71d429d43d08 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:35.815547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9e76c6-aa3f-407a-ab70-71d429d43d08 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:35.816368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9e76c6-aa3f-407a-ab70-71d429d43d08 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:35.927356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d02f37d3-b134-4216-ba9f-dde80c36d208 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:35.937383 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d02f37d3-b134-4216-ba9f-dde80c36d208 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1316 microversion: 2.1 time: 0.696168 Oct 05 17:41:35.940906 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1087/2299] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:35 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1316 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:35.963392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5eb8adbe-b5b1-45cb-9233-73e59aded726 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:35.968310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5eb8adbe-b5b1-45cb-9233-73e59aded726 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:35.979684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5eb8adbe-b5b1-45cb-9233-73e59aded726 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:35.980456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5eb8adbe-b5b1-45cb-9233-73e59aded726 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:35.981508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5eb8adbe-b5b1-45cb-9233-73e59aded726 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:35.984141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5eb8adbe-b5b1-45cb-9233-73e59aded726 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:35.984911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5eb8adbe-b5b1-45cb-9233-73e59aded726 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:35.985483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5eb8adbe-b5b1-45cb-9233-73e59aded726 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:37.017451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5eb8adbe-b5b1-45cb-9233-73e59aded726 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:37.042078 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5eb8adbe-b5b1-45cb-9233-73e59aded726 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1315 microversion: 2.1 time: 1.098238 Oct 05 17:41:37.049833 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1088/2300] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:35 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1315 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:37.064078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-18441bb9-348f-4a36-96cc-e9d2af15664b req-d2e3f65d-87f9-46ab-abfa-96862d2d2011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e", "name": "network-vif-deleted", "tag": "167ff7e5-e2af-40a1-bbd0-618ecfb3a035"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:37.096090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-18441bb9-348f-4a36-96cc-e9d2af15664b req-d2e3f65d-87f9-46ab-abfa-96862d2d2011 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:37.100272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-18441bb9-348f-4a36-96cc-e9d2af15664b req-d2e3f65d-87f9-46ab-abfa-96862d2d2011 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:37.102599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-18441bb9-348f-4a36-96cc-e9d2af15664b req-d2e3f65d-87f9-46ab-abfa-96862d2d2011 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:37.141690 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-18441bb9-348f-4a36-96cc-e9d2af15664b req-d2e3f65d-87f9-46ab-abfa-96862d2d2011 service nova] Creating event network-vif-deleted:167ff7e5-e2af-40a1-bbd0-618ecfb3a035 for instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e on n-h1-835595-3 Oct 05 17:41:37.149853 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-18441bb9-348f-4a36-96cc-e9d2af15664b req-d2e3f65d-87f9-46ab-abfa-96862d2d2011 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098262 Oct 05 17:41:37.151961 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1089/2301] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:37.159753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ae3b20f4-73ed-4365-8609-028599732e9a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:37.162453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ae3b20f4-73ed-4365-8609-028599732e9a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:37.177474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae3b20f4-73ed-4365-8609-028599732e9a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:37.178625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae3b20f4-73ed-4365-8609-028599732e9a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:37.179356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae3b20f4-73ed-4365-8609-028599732e9a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:37.180469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae3b20f4-73ed-4365-8609-028599732e9a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:37.181166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae3b20f4-73ed-4365-8609-028599732e9a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:37.182155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae3b20f4-73ed-4365-8609-028599732e9a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:37.283450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae3b20f4-73ed-4365-8609-028599732e9a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:37.295712 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ae3b20f4-73ed-4365-8609-028599732e9a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1265 microversion: 2.1 time: 0.142040 Oct 05 17:41:37.296504 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1090/2302] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:37 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:37.324297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c09aa09-4704-49b4-95cf-b486b4826e03 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:37.331282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9c09aa09-4704-49b4-95cf-b486b4826e03 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:37.344711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c09aa09-4704-49b4-95cf-b486b4826e03 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:37.345227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c09aa09-4704-49b4-95cf-b486b4826e03 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:37.345662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c09aa09-4704-49b4-95cf-b486b4826e03 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:37.346401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c09aa09-4704-49b4-95cf-b486b4826e03 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:37.350683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c09aa09-4704-49b4-95cf-b486b4826e03 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:37.351135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c09aa09-4704-49b4-95cf-b486b4826e03 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:37.568711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cd9e76c6-aa3f-407a-ab70-71d429d43d08 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:37.573083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9c09aa09-4704-49b4-95cf-b486b4826e03 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:37.589741 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9c09aa09-4704-49b4-95cf-b486b4826e03 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1275 microversion: 2.1 time: 0.274201 Oct 05 17:41:37.596181 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cd9e76c6-aa3f-407a-ab70-71d429d43d08 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 1.830583 Oct 05 17:41:37.601028 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1213/2303] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:35 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:41:37.601475 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1091/2304] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:37 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1275 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:37.620148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8bb7ae4-40e5-47f3-b38d-a2cdbf23504f tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:37.621087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c8bb7ae4-40e5-47f3-b38d-a2cdbf23504f tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:37.621251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-512bb9ac-7b3c-440b-bf9a-0d8c16758301 req-4e1b08c7-e8af-448b-9d2c-4236b31b83b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e", "name": "network-vif-unplugged", "status": "completed", "tag": "167ff7e5-e2af-40a1-bbd0-618ecfb3a035"}, {"server_uuid": "9f76e942-86f4-44da-b82d-da4416157a4f", "name": "network-vif-plugged", "status": "completed", "tag": "baaf15c6-2eb1-4137-b82a-51a1a07f9c3f"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:37.631772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bb7ae4-40e5-47f3-b38d-a2cdbf23504f tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:37.632517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bb7ae4-40e5-47f3-b38d-a2cdbf23504f tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:37.639007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bb7ae4-40e5-47f3-b38d-a2cdbf23504f tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:37.640096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bb7ae4-40e5-47f3-b38d-a2cdbf23504f tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:37.641766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bb7ae4-40e5-47f3-b38d-a2cdbf23504f tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:37.642727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8bb7ae4-40e5-47f3-b38d-a2cdbf23504f tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:37.661832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-512bb9ac-7b3c-440b-bf9a-0d8c16758301 req-4e1b08c7-e8af-448b-9d2c-4236b31b83b4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:37.662364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-512bb9ac-7b3c-440b-bf9a-0d8c16758301 req-4e1b08c7-e8af-448b-9d2c-4236b31b83b4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:37.671323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-512bb9ac-7b3c-440b-bf9a-0d8c16758301 req-4e1b08c7-e8af-448b-9d2c-4236b31b83b4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:37.734993 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-512bb9ac-7b3c-440b-bf9a-0d8c16758301 req-4e1b08c7-e8af-448b-9d2c-4236b31b83b4 service nova] Creating event network-vif-unplugged:167ff7e5-e2af-40a1-bbd0-618ecfb3a035 for instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e on n-h1-835595-3 Oct 05 17:41:37.736189 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-512bb9ac-7b3c-440b-bf9a-0d8c16758301 req-4e1b08c7-e8af-448b-9d2c-4236b31b83b4 service nova] Creating event network-vif-plugged:baaf15c6-2eb1-4137-b82a-51a1a07f9c3f for instance 9f76e942-86f4-44da-b82d-da4416157a4f on n-h2-835595-3 Oct 05 17:41:37.791132 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-512bb9ac-7b3c-440b-bf9a-0d8c16758301 req-4e1b08c7-e8af-448b-9d2c-4236b31b83b4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.186705 Oct 05 17:41:37.792537 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1092/2305] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:38.078755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9e016bc1-fe61-4a61-95f4-9c8cd4856589 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:38.081168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9e016bc1-fe61-4a61-95f4-9c8cd4856589 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:38.093698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e016bc1-fe61-4a61-95f4-9c8cd4856589 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:38.094201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e016bc1-fe61-4a61-95f4-9c8cd4856589 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:38.097221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e016bc1-fe61-4a61-95f4-9c8cd4856589 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:38.101540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e016bc1-fe61-4a61-95f4-9c8cd4856589 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:38.102437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e016bc1-fe61-4a61-95f4-9c8cd4856589 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:38.102993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e016bc1-fe61-4a61-95f4-9c8cd4856589 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:38.756542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8bb7ae4-40e5-47f3-b38d-a2cdbf23504f tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:38.768206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c8bb7ae4-40e5-47f3-b38d-a2cdbf23504f tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1504 microversion: 2.1 time: 1.164049 Oct 05 17:41:38.769063 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1214/2306] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:37 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1504 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:38.784618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9e016bc1-fe61-4a61-95f4-9c8cd4856589 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:38.792871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35a008b8-6324-4530-9e62-4675e26a109f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:38.794408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-35a008b8-6324-4530-9e62-4675e26a109f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:38.801658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35a008b8-6324-4530-9e62-4675e26a109f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:38.802483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35a008b8-6324-4530-9e62-4675e26a109f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:38.803069 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9e016bc1-fe61-4a61-95f4-9c8cd4856589 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1315 microversion: 2.1 time: 0.730605 Oct 05 17:41:38.803251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35a008b8-6324-4530-9e62-4675e26a109f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:38.804666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35a008b8-6324-4530-9e62-4675e26a109f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:38.805306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35a008b8-6324-4530-9e62-4675e26a109f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:38.805973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35a008b8-6324-4530-9e62-4675e26a109f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:38.806246 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1093/2307] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:38 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1315 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:38.825313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-15231166", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "87161a89-0a4b-40c7-8eed-07fb0d8a5838"}, {"port": "d2f0b027-74d5-4d61-87a2-5e76a8d81918", "tag": "port-1"}, {"port": "87c952e0-16df-4553-88a0-a59666c95cf7", "tag": "port-2"}, {"uuid": "fb3eeb7e-d94b-44f4-93a5-75405af3becc", "tag": "net-1"}, {"uuid": "fb3eeb7e-d94b-44f4-93a5-75405af3becc"}, {"uuid": "675bbc4a-6d80-45d6-9416-88188655c443", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "675bbc4a-6d80-45d6-9416-88188655c443", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "925e1bb1-99b8-406f-9b6f-639fa29c07ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "cbd70cb4-1d41-423d-a7eb-97726b034c36", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "feee4cae-1099-45a1-ab6c-6b638e0aefba", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1168710589"}], "key_name": "tempest-keypair-657021971", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:39.187235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-35a008b8-6324-4530-9e62-4675e26a109f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:39.202040 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35a008b8-6324-4530-9e62-4675e26a109f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1307 microversion: 2.1 time: 0.417406 Oct 05 17:41:39.203248 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1215/2308] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:38 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1307 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:39.208512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-07ebf202-568c-4fce-9eaa-13f91c54587f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:39.209707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-07ebf202-568c-4fce-9eaa-13f91c54587f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:39.223379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ebf202-568c-4fce-9eaa-13f91c54587f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:39.225272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ebf202-568c-4fce-9eaa-13f91c54587f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:39.225881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ebf202-568c-4fce-9eaa-13f91c54587f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:39.226793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ebf202-568c-4fce-9eaa-13f91c54587f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:39.240993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ebf202-568c-4fce-9eaa-13f91c54587f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:39.243026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ebf202-568c-4fce-9eaa-13f91c54587f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:39.359844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] validate_networks() for [('87161a89-0a4b-40c7-8eed-07fb0d8a5838', None, None, None, None, None), (None, None, 'd2f0b027-74d5-4d61-87a2-5e76a8d81918', None, None, None), (None, None, '87c952e0-16df-4553-88a0-a59666c95cf7', None, None, None), ('fb3eeb7e-d94b-44f4-93a5-75405af3becc', None, None, None, None, None), ('fb3eeb7e-d94b-44f4-93a5-75405af3becc', None, None, None, None, None), ('675bbc4a-6d80-45d6-9416-88188655c443', '10.2.2.100', None, None, None, None), ('675bbc4a-6d80-45d6-9416-88188655c443', '10.2.2.200', None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:41:39.382463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-07ebf202-568c-4fce-9eaa-13f91c54587f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:39.396474 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-07ebf202-568c-4fce-9eaa-13f91c54587f tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1275 microversion: 2.1 time: 0.191950 Oct 05 17:41:39.398220 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1216/2309] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:39 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1275 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:39.405370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cde4d74c-9509-4d9c-bab9-eae613ee4d8b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:39.407714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cde4d74c-9509-4d9c-bab9-eae613ee4d8b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:39.415588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cde4d74c-9509-4d9c-bab9-eae613ee4d8b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:39.416433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cde4d74c-9509-4d9c-bab9-eae613ee4d8b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:39.417134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cde4d74c-9509-4d9c-bab9-eae613ee4d8b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:39.418140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cde4d74c-9509-4d9c-bab9-eae613ee4d8b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:39.418831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cde4d74c-9509-4d9c-bab9-eae613ee4d8b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:39.419785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cde4d74c-9509-4d9c-bab9-eae613ee4d8b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:39.794702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cde4d74c-9509-4d9c-bab9-eae613ee4d8b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:39.807024 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cde4d74c-9509-4d9c-bab9-eae613ee4d8b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1355 microversion: 2.1 time: 0.407133 Oct 05 17:41:39.814647 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1217/2310] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:39 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1355 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:39.820243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3792910d-93d3-477d-914b-fa53f86362c8 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:39.823188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3792910d-93d3-477d-914b-fa53f86362c8 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:39.838556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3792910d-93d3-477d-914b-fa53f86362c8 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:39.839067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3792910d-93d3-477d-914b-fa53f86362c8 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:39.840176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3792910d-93d3-477d-914b-fa53f86362c8 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:39.841021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3792910d-93d3-477d-914b-fa53f86362c8 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:39.841372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3792910d-93d3-477d-914b-fa53f86362c8 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:39.841810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3792910d-93d3-477d-914b-fa53f86362c8 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:39.899278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3792910d-93d3-477d-914b-fa53f86362c8 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:41:40.113446 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3792910d-93d3-477d-914b-fa53f86362c8 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 204 len: 0 microversion: 2.1 time: 0.296790 Oct 05 17:41:40.114959 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1218/2311] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:41:39 2022] DELETE /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:41:40.123554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c2621449-3960-4a34-947c-659383082f30 req-ee5d4dbd-bfd6-469b-84d2-d2148abaf5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd32bd25-0afe-45a0-867b-3c5fb0ee201b", "name": "network-vif-deleted", "tag": "217aa248-5394-47b1-a3c3-b5df71e4c0e1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:40.134103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c2621449-3960-4a34-947c-659383082f30 req-ee5d4dbd-bfd6-469b-84d2-d2148abaf5bd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:40.135189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c2621449-3960-4a34-947c-659383082f30 req-ee5d4dbd-bfd6-469b-84d2-d2148abaf5bd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:40.135844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c2621449-3960-4a34-947c-659383082f30 req-ee5d4dbd-bfd6-469b-84d2-d2148abaf5bd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:40.150010 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c2621449-3960-4a34-947c-659383082f30 req-ee5d4dbd-bfd6-469b-84d2-d2148abaf5bd service nova] Creating event network-vif-deleted:217aa248-5394-47b1-a3c3-b5df71e4c0e1 for instance dd32bd25-0afe-45a0-867b-3c5fb0ee201b on n-h1-835595-3 Oct 05 17:41:40.157220 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c2621449-3960-4a34-947c-659383082f30 req-ee5d4dbd-bfd6-469b-84d2-d2148abaf5bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037567 Oct 05 17:41:40.161204 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1219/2312] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:40.168405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0a9dfc08-05fa-4fa9-aa6f-f4d44ed7f6e6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:40.169380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0a9dfc08-05fa-4fa9-aa6f-f4d44ed7f6e6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:40.177681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a9dfc08-05fa-4fa9-aa6f-f4d44ed7f6e6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:40.178482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a9dfc08-05fa-4fa9-aa6f-f4d44ed7f6e6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:40.179604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a9dfc08-05fa-4fa9-aa6f-f4d44ed7f6e6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:40.180496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a9dfc08-05fa-4fa9-aa6f-f4d44ed7f6e6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:40.181101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a9dfc08-05fa-4fa9-aa6f-f4d44ed7f6e6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:40.182417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a9dfc08-05fa-4fa9-aa6f-f4d44ed7f6e6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:40.486732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0a9dfc08-05fa-4fa9-aa6f-f4d44ed7f6e6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:40.513277 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0a9dfc08-05fa-4fa9-aa6f-f4d44ed7f6e6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1503 microversion: 2.1 time: 0.350449 Oct 05 17:41:40.514701 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1220/2313] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:40 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1503 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:40.522813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-408ae3fb-f427-4aba-8083-409ad836b135 req-7ed2c0ff-3fdd-4cd5-b336-558e4efd74b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0c9d6-efb6-4b55-9df3-23625b4c4efb", "name": "network-vif-plugged", "status": "completed", "tag": "faf68f92-9784-4248-964c-935266565f08"}, {"server_uuid": "51c0c9d6-efb6-4b55-9df3-23625b4c4efb", "name": "network-vif-plugged", "status": "completed", "tag": "c88e6c42-997b-4cfa-aa37-9b219419844b"}, {"server_uuid": "51c0c9d6-efb6-4b55-9df3-23625b4c4efb", "name": "network-vif-plugged", "status": "completed", "tag": "da5d4bc0-859e-4373-9563-212b6d5bb0e6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:40.535957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-408ae3fb-f427-4aba-8083-409ad836b135 req-7ed2c0ff-3fdd-4cd5-b336-558e4efd74b9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:40.536916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-408ae3fb-f427-4aba-8083-409ad836b135 req-7ed2c0ff-3fdd-4cd5-b336-558e4efd74b9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:40.539202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-408ae3fb-f427-4aba-8083-409ad836b135 req-7ed2c0ff-3fdd-4cd5-b336-558e4efd74b9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:40.557670 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-408ae3fb-f427-4aba-8083-409ad836b135 req-7ed2c0ff-3fdd-4cd5-b336-558e4efd74b9 service nova] Creating event network-vif-plugged:faf68f92-9784-4248-964c-935266565f08 for instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb on n-h2-835595-3 Oct 05 17:41:40.558343 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-408ae3fb-f427-4aba-8083-409ad836b135 req-7ed2c0ff-3fdd-4cd5-b336-558e4efd74b9 service nova] Creating event network-vif-plugged:c88e6c42-997b-4cfa-aa37-9b219419844b for instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb on n-h2-835595-3 Oct 05 17:41:40.558930 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-408ae3fb-f427-4aba-8083-409ad836b135 req-7ed2c0ff-3fdd-4cd5-b336-558e4efd74b9 service nova] Creating event network-vif-plugged:da5d4bc0-859e-4373-9563-212b6d5bb0e6 for instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb on n-h2-835595-3 Oct 05 17:41:40.566714 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-408ae3fb-f427-4aba-8083-409ad836b135 req-7ed2c0ff-3fdd-4cd5-b336-558e4efd74b9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050407 Oct 05 17:41:40.568150 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1221/2314] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:40.576191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4753bb56-da1c-4466-af0a-c6c14bd7b399 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:40.577143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4753bb56-da1c-4466-af0a-c6c14bd7b399 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:40.619048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4753bb56-da1c-4466-af0a-c6c14bd7b399 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:40.619637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4753bb56-da1c-4466-af0a-c6c14bd7b399 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:40.620090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4753bb56-da1c-4466-af0a-c6c14bd7b399 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:40.627039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4753bb56-da1c-4466-af0a-c6c14bd7b399 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:40.630727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4753bb56-da1c-4466-af0a-c6c14bd7b399 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:40.631248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4753bb56-da1c-4466-af0a-c6c14bd7b399 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:41.150049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4753bb56-da1c-4466-af0a-c6c14bd7b399 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:41.165616 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4753bb56-da1c-4466-af0a-c6c14bd7b399 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1510 microversion: 2.1 time: 0.595662 Oct 05 17:41:41.166246 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1222/2315] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:40 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1510 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:41.181698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7b7289f-7009-4230-84cd-7f813dc05b9b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:41.183927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f7b7289f-7009-4230-84cd-7f813dc05b9b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:41.193766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b7289f-7009-4230-84cd-7f813dc05b9b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:41.194542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b7289f-7009-4230-84cd-7f813dc05b9b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:41.195132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b7289f-7009-4230-84cd-7f813dc05b9b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:41.196025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b7289f-7009-4230-84cd-7f813dc05b9b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:41.196649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b7289f-7009-4230-84cd-7f813dc05b9b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:41.197227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b7289f-7009-4230-84cd-7f813dc05b9b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:42.146342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f7b7289f-7009-4230-84cd-7f813dc05b9b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:42.157484 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f7b7289f-7009-4230-84cd-7f813dc05b9b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1307 microversion: 2.1 time: 0.979860 Oct 05 17:41:42.176147 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1223/2316] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:41 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1307 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:42.184050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a233011b-e39e-46b7-a67e-7bb1c656ea6b tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:42.186099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a233011b-e39e-46b7-a67e-7bb1c656ea6b tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:42.194480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a233011b-e39e-46b7-a67e-7bb1c656ea6b tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:42.195148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a233011b-e39e-46b7-a67e-7bb1c656ea6b tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:42.196415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a233011b-e39e-46b7-a67e-7bb1c656ea6b tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:42.197935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a233011b-e39e-46b7-a67e-7bb1c656ea6b tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:42.198669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a233011b-e39e-46b7-a67e-7bb1c656ea6b tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:42.199247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a233011b-e39e-46b7-a67e-7bb1c656ea6b tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:42.602308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:42.630266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a233011b-e39e-46b7-a67e-7bb1c656ea6b tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:42.664719 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a233011b-e39e-46b7-a67e-7bb1c656ea6b tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1317 microversion: 2.1 time: 0.486037 Oct 05 17:41:42.667134 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1224/2317] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:42 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1317 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:42.677379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ebacda8-4b85-421b-b19f-53b5d76916a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:42.689225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ebacda8-4b85-421b-b19f-53b5d76916a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:42.701569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ebacda8-4b85-421b-b19f-53b5d76916a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:42.703624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ebacda8-4b85-421b-b19f-53b5d76916a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:42.704437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ebacda8-4b85-421b-b19f-53b5d76916a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:42.705609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ebacda8-4b85-421b-b19f-53b5d76916a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:42.708200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ebacda8-4b85-421b-b19f-53b5d76916a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:42.708846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ebacda8-4b85-421b-b19f-53b5d76916a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:42.776992 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ebacda8-4b85-421b-b19f-53b5d76916a7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action" status: 200 len: 14 microversion: 2.1 time: 0.107492 Oct 05 17:41:42.778075 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1225/2318] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:42 2022] POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:41:42.799559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7d6f0b91-466f-4981-b3cc-e4842ba8340b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:42.802199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7d6f0b91-466f-4981-b3cc-e4842ba8340b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:42.816698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d6f0b91-466f-4981-b3cc-e4842ba8340b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:42.817611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d6f0b91-466f-4981-b3cc-e4842ba8340b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:42.818432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d6f0b91-466f-4981-b3cc-e4842ba8340b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:42.819605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d6f0b91-466f-4981-b3cc-e4842ba8340b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:42.821475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d6f0b91-466f-4981-b3cc-e4842ba8340b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:42.822180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d6f0b91-466f-4981-b3cc-e4842ba8340b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:43.145471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7d6f0b91-466f-4981-b3cc-e4842ba8340b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:43.157555 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7d6f0b91-466f-4981-b3cc-e4842ba8340b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1804 microversion: 2.1 time: 0.377891 Oct 05 17:41:43.159057 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1226/2319] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:42 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1804 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:43.168370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-304f6548-ab45-4ef4-8ca1-0c4f3fdbc0bb tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:43.169009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-304f6548-ab45-4ef4-8ca1-0c4f3fdbc0bb tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:43.185067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-304f6548-ab45-4ef4-8ca1-0c4f3fdbc0bb tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:43.185570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-304f6548-ab45-4ef4-8ca1-0c4f3fdbc0bb tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:43.186011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-304f6548-ab45-4ef4-8ca1-0c4f3fdbc0bb tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:43.187486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-304f6548-ab45-4ef4-8ca1-0c4f3fdbc0bb tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:43.188161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-304f6548-ab45-4ef4-8ca1-0c4f3fdbc0bb tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:43.190604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-304f6548-ab45-4ef4-8ca1-0c4f3fdbc0bb tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:43.223748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:43.230858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:43.294944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:43.503558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-304f6548-ab45-4ef4-8ca1-0c4f3fdbc0bb tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c55f9de1db564563b7ae19d50765351d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6576c93c15754da4b845fd39842b7f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:43.514561 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-304f6548-ab45-4ef4-8ca1-0c4f3fdbc0bb tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 200 len: 1510 microversion: 2.1 time: 0.354328 Oct 05 17:41:43.515338 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1227/2320] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:43 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 1510 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:43.520678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-90437e42-e8c2-4e5b-935b-9e04fb4baefc req-885dae13-b7bf-4024-bb00-77c6f33e38ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2c8db2-f243-4f95-8554-5f6456b4f18e", "tag": "c45bec95-980b-4f58-b5d6-bc729046e986"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:43.547885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-90437e42-e8c2-4e5b-935b-9e04fb4baefc req-885dae13-b7bf-4024-bb00-77c6f33e38ca service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:43.548270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-90437e42-e8c2-4e5b-935b-9e04fb4baefc req-885dae13-b7bf-4024-bb00-77c6f33e38ca service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:43.549089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-90437e42-e8c2-4e5b-935b-9e04fb4baefc req-885dae13-b7bf-4024-bb00-77c6f33e38ca service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:43.561065 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-90437e42-e8c2-4e5b-935b-9e04fb4baefc req-885dae13-b7bf-4024-bb00-77c6f33e38ca service nova] Creating event network-changed:c45bec95-980b-4f58-b5d6-bc729046e986 for instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e on n-h1-835595-3 Oct 05 17:41:43.566572 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-90437e42-e8c2-4e5b-935b-9e04fb4baefc req-885dae13-b7bf-4024-bb00-77c6f33e38ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049220 Oct 05 17:41:43.567956 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1228/2321] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:43.573645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a839ec3e-8d04-4422-ad13-3fa853de30aa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:43.574311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a839ec3e-8d04-4422-ad13-3fa853de30aa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:43.581234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a839ec3e-8d04-4422-ad13-3fa853de30aa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:43.581748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a839ec3e-8d04-4422-ad13-3fa853de30aa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:43.582187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a839ec3e-8d04-4422-ad13-3fa853de30aa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:43.582944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a839ec3e-8d04-4422-ad13-3fa853de30aa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:43.583395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a839ec3e-8d04-4422-ad13-3fa853de30aa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:43.583993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a839ec3e-8d04-4422-ad13-3fa853de30aa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:43.614604 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a839ec3e-8d04-4422-ad13-3fa853de30aa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb/ips" status: 200 len: 217 microversion: 2.1 time: 0.045174 Oct 05 17:41:43.615205 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1229/2322] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:41:43 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb/ips => generated 217 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:43.620243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-73279f0b-d949-4e21-96bf-23bb546303b7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:43.621089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-73279f0b-d949-4e21-96bf-23bb546303b7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:43.628165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73279f0b-d949-4e21-96bf-23bb546303b7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:43.628881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73279f0b-d949-4e21-96bf-23bb546303b7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:43.629539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73279f0b-d949-4e21-96bf-23bb546303b7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:43.630479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73279f0b-d949-4e21-96bf-23bb546303b7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:43.631279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73279f0b-d949-4e21-96bf-23bb546303b7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:43.631825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73279f0b-d949-4e21-96bf-23bb546303b7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:43.899624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-73279f0b-d949-4e21-96bf-23bb546303b7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:43.910570 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-73279f0b-d949-4e21-96bf-23bb546303b7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1307 microversion: 2.1 time: 0.293470 Oct 05 17:41:43.911096 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1230/2323] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:43 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1307 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:43.920808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a09925f9-a2e6-4072-9021-e0ba8d7e3c1e req-3706324f-66f9-42fc-8728-3fe383fadfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b3ebe68-038e-4369-8fc2-4edb36eab3fd", "tag": "b9c4193f-bd45-40b4-aaee-609b8fc0ebaf"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:43.954771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a09925f9-a2e6-4072-9021-e0ba8d7e3c1e req-3706324f-66f9-42fc-8728-3fe383fadfc7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:43.955529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a09925f9-a2e6-4072-9021-e0ba8d7e3c1e req-3706324f-66f9-42fc-8728-3fe383fadfc7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:43.956131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a09925f9-a2e6-4072-9021-e0ba8d7e3c1e req-3706324f-66f9-42fc-8728-3fe383fadfc7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:43.971380 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a09925f9-a2e6-4072-9021-e0ba8d7e3c1e req-3706324f-66f9-42fc-8728-3fe383fadfc7 service nova] Creating event network-changed:b9c4193f-bd45-40b4-aaee-609b8fc0ebaf for instance 5b3ebe68-038e-4369-8fc2-4edb36eab3fd on n-h2-835595-3 Oct 05 17:41:43.981696 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a09925f9-a2e6-4072-9021-e0ba8d7e3c1e req-3706324f-66f9-42fc-8728-3fe383fadfc7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069129 Oct 05 17:41:43.983425 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1231/2324] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:43.991635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87192286-8321-4b40-b473-ae3f3bef9652 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:43.992674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-87192286-8321-4b40-b473-ae3f3bef9652 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:44.000770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87192286-8321-4b40-b473-ae3f3bef9652 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:44.001737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87192286-8321-4b40-b473-ae3f3bef9652 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:44.003328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87192286-8321-4b40-b473-ae3f3bef9652 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:44.004233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87192286-8321-4b40-b473-ae3f3bef9652 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:44.004897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87192286-8321-4b40-b473-ae3f3bef9652 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:44.006038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87192286-8321-4b40-b473-ae3f3bef9652 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:44.040822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-87192286-8321-4b40-b473-ae3f3bef9652 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:41:44.139349 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87192286-8321-4b40-b473-ae3f3bef9652 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "DELETE /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 204 len: 0 microversion: 2.1 time: 0.153958 Oct 05 17:41:44.150765 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1232/2325] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:41:43 2022] DELETE /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:41:44.164460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec89f428-7e8b-4fdf-a2f9-d6904dc81041 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:44.165337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ec89f428-7e8b-4fdf-a2f9-d6904dc81041 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:44.181155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec89f428-7e8b-4fdf-a2f9-d6904dc81041 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:44.182090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec89f428-7e8b-4fdf-a2f9-d6904dc81041 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:44.184082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec89f428-7e8b-4fdf-a2f9-d6904dc81041 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:44.187116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec89f428-7e8b-4fdf-a2f9-d6904dc81041 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:44.189275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec89f428-7e8b-4fdf-a2f9-d6904dc81041 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:44.189943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec89f428-7e8b-4fdf-a2f9-d6904dc81041 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:44.487039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ec89f428-7e8b-4fdf-a2f9-d6904dc81041 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:44.501256 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ec89f428-7e8b-4fdf-a2f9-d6904dc81041 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1317 microversion: 2.1 time: 0.348652 Oct 05 17:41:44.514762 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1233/2326] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:44 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:44.543138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92c93a3b-0a81-4e7a-ac48-943eac8f23dc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:44.545466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92c93a3b-0a81-4e7a-ac48-943eac8f23dc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:44.555872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c93a3b-0a81-4e7a-ac48-943eac8f23dc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:44.556376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c93a3b-0a81-4e7a-ac48-943eac8f23dc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:44.557012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c93a3b-0a81-4e7a-ac48-943eac8f23dc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:44.557934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c93a3b-0a81-4e7a-ac48-943eac8f23dc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:44.558191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c93a3b-0a81-4e7a-ac48-943eac8f23dc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:44.558656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c93a3b-0a81-4e7a-ac48-943eac8f23dc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:45.056623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:45.580885 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92c93a3b-0a81-4e7a-ac48-943eac8f23dc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action" status: 200 len: 14 microversion: 2.1 time: 1.072659 Oct 05 17:41:45.582229 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1234/2327] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:44 2022] POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action => generated 14 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:41:45.606652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fc231b4e-2044-44ea-b4e8-9962cb40402a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:45.611005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fc231b4e-2044-44ea-b4e8-9962cb40402a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:45.631454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc231b4e-2044-44ea-b4e8-9962cb40402a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:45.632326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc231b4e-2044-44ea-b4e8-9962cb40402a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:45.632981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc231b4e-2044-44ea-b4e8-9962cb40402a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:45.633811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc231b4e-2044-44ea-b4e8-9962cb40402a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:45.635356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc231b4e-2044-44ea-b4e8-9962cb40402a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:45.636009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc231b4e-2044-44ea-b4e8-9962cb40402a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:46.027228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fc231b4e-2044-44ea-b4e8-9962cb40402a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:46.035862 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fc231b4e-2044-44ea-b4e8-9962cb40402a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1810 microversion: 2.1 time: 0.445946 Oct 05 17:41:46.036771 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1235/2328] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:45 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1810 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:46.041810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:46.042766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:46.050165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:46.051011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:46.051650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:46.052888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:46.053574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:46.054222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:46.072785 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] HTTP exception thrown: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Request method failure captured: Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 HTTP/1.1 Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGsvkH-Qns8HjljZGTMk33LrZ7mlA7SJx_eaBU5-2qeDkJJhviv_9jf6iCm4TxggrRgUzk6qwjgQr0oWwB0PejKCJqNmLr8P8lp5K0aVdRLwpeLAzI9G2oWBUpDLrESVGAJXIPhH1RQBGkOhwhBWkg1y-JuHoHnMyaSZM_uYhrSWLU Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6576c93c15754da4b845fd39842b7f51", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}] Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: c55f9de1db564563b7ae19d50765351d Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e1268310-ba70-4b04-b154-c40254378586'} Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:46.075125 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:46.080948 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:46.080948 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:46.080948 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:46.080948 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:41:46.080948 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:41:46.080948 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:46.080948 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:46.083515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Returning 404 to user: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:41:46.085049 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c21190b1-4a2a-49c6-ae84-23c8bafeb07e tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 404 len: 111 microversion: 2.1 time: 0.046852 Oct 05 17:41:46.086016 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1236/2329] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:46 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:41:46.091577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d4da95a-5356-4617-b381-83ebbdf4bd2b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:46.092501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d4da95a-5356-4617-b381-83ebbdf4bd2b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:46.099597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d4da95a-5356-4617-b381-83ebbdf4bd2b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:46.100370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d4da95a-5356-4617-b381-83ebbdf4bd2b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:46.101068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d4da95a-5356-4617-b381-83ebbdf4bd2b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:46.102002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d4da95a-5356-4617-b381-83ebbdf4bd2b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:46.102702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d4da95a-5356-4617-b381-83ebbdf4bd2b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:46.103333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d4da95a-5356-4617-b381-83ebbdf4bd2b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:46.402325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3d4da95a-5356-4617-b381-83ebbdf4bd2b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:46.412074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d4da95a-5356-4617-b381-83ebbdf4bd2b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1307 microversion: 2.1 time: 0.324482 Oct 05 17:41:46.412749 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1237/2330] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:46 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:46.437692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf9a775f-4a7e-4d15-bcf0-a3d95ef7d3c5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:46.438605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bf9a775f-4a7e-4d15-bcf0-a3d95ef7d3c5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:46.445895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf9a775f-4a7e-4d15-bcf0-a3d95ef7d3c5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:46.446546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf9a775f-4a7e-4d15-bcf0-a3d95ef7d3c5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:46.447001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf9a775f-4a7e-4d15-bcf0-a3d95ef7d3c5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:46.447715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf9a775f-4a7e-4d15-bcf0-a3d95ef7d3c5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:46.448336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf9a775f-4a7e-4d15-bcf0-a3d95ef7d3c5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:46.448763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf9a775f-4a7e-4d15-bcf0-a3d95ef7d3c5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:47.178177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bf9a775f-4a7e-4d15-bcf0-a3d95ef7d3c5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:47.207261 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf9a775f-4a7e-4d15-bcf0-a3d95ef7d3c5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1317 microversion: 2.1 time: 0.776117 Oct 05 17:41:47.209752 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1238/2331] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:46 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1317 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:47.219392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-649f03a7-468f-45b0-9ab9-9cf4646b4c70 req-9369e12a-f8a1-43a2-b1ab-ca4c377e9531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1268310-ba70-4b04-b154-c40254378586", "name": "network-vif-deleted", "tag": "b277c367-ce3b-49d4-832e-804f1b7ed32d"}, {"name": "network-changed", "server_uuid": "68fde73d-b536-4d20-888c-3966e7d4ed06", "tag": "ae705199-ad4f-4fae-9d62-e55f3f2bfeb3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:47.244001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-649f03a7-468f-45b0-9ab9-9cf4646b4c70 req-9369e12a-f8a1-43a2-b1ab-ca4c377e9531 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:47.245025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-649f03a7-468f-45b0-9ab9-9cf4646b4c70 req-9369e12a-f8a1-43a2-b1ab-ca4c377e9531 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:47.245647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-649f03a7-468f-45b0-9ab9-9cf4646b4c70 req-9369e12a-f8a1-43a2-b1ab-ca4c377e9531 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:47.271188 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-649f03a7-468f-45b0-9ab9-9cf4646b4c70 req-9369e12a-f8a1-43a2-b1ab-ca4c377e9531 service nova] Creating event network-vif-deleted:b277c367-ce3b-49d4-832e-804f1b7ed32d for instance e1268310-ba70-4b04-b154-c40254378586 on n-h1-835595-3 Oct 05 17:41:47.271986 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-649f03a7-468f-45b0-9ab9-9cf4646b4c70 req-9369e12a-f8a1-43a2-b1ab-ca4c377e9531 service nova] Creating event network-changed:ae705199-ad4f-4fae-9d62-e55f3f2bfeb3 for instance 68fde73d-b536-4d20-888c-3966e7d4ed06 on n-h1-835595-3 Oct 05 17:41:47.279163 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-649f03a7-468f-45b0-9ab9-9cf4646b4c70 req-9369e12a-f8a1-43a2-b1ab-ca4c377e9531 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.067754 Oct 05 17:41:47.280068 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1239/2332] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:47.286035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-344841357", "metadata": {"image_type": "test"}}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:47.289189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:47.296208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:47.297009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:47.297699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:47.298693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:47.299364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:47.299995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:47.319190 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] HTTP exception thrown: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Request method failure captured: Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586/action HTTP/1.1 Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 111 Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGsvkH-Qns8HjljZGTMk33LrZ7mlA7SJx_eaBU5-2qeDkJJhviv_9jf6iCm4TxggrRgUzk6qwjgQr0oWwB0PejKCJqNmLr8P8lp5K0aVdRLwpeLAzI9G2oWBUpDLrESVGAJXIPhH1RQBGkOhwhBWkg1y-JuHoHnMyaSZM_uYhrSWLU Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6576c93c15754da4b845fd39842b7f51", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}] Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: c55f9de1db564563b7ae19d50765351d Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-344841357", "metadata": {"image_type": "test"}}} Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e1268310-ba70-4b04-b154-c40254378586', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-344841357', 'metadata': {'image_type': 'test'}}}} Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 17:41:47.321350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:47.324813 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:47.327481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Returning 404 to user: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:41:47.328593 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d5ec1e75-5e26-4df9-afa8-788d636923b3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "POST /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586/action" status: 404 len: 111 microversion: 2.1 time: 0.047281 Oct 05 17:41:47.329722 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1240/2333] 10.222.0.70 () {60 vars in 1279 bytes} [Wed Oct 5 17:41:47 2022] POST /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586/action => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:41:47.552676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dc4c164f-ce0c-45ad-8895-729bcd570d89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:47.555393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dc4c164f-ce0c-45ad-8895-729bcd570d89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:47.562985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc4c164f-ce0c-45ad-8895-729bcd570d89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:47.563720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc4c164f-ce0c-45ad-8895-729bcd570d89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:47.564357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc4c164f-ce0c-45ad-8895-729bcd570d89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:47.565457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc4c164f-ce0c-45ad-8895-729bcd570d89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:47.566117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc4c164f-ce0c-45ad-8895-729bcd570d89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:47.566808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc4c164f-ce0c-45ad-8895-729bcd570d89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:47.615938 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dc4c164f-ce0c-45ad-8895-729bcd570d89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action" status: 200 len: 14 microversion: 2.1 time: 0.284387 Oct 05 17:41:47.636432 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1241/2334] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:47 2022] POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action => generated 14 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:41:47.644519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c37a2f86-9581-4437-85de-95fec6114938 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:47.646173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c37a2f86-9581-4437-85de-95fec6114938 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:47.650043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:41:47.651085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:41:47.651733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:41:47.652294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:41:47.652855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:41:47.656388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37a2f86-9581-4437-85de-95fec6114938 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:47.657321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37a2f86-9581-4437-85de-95fec6114938 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:47.657855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37a2f86-9581-4437-85de-95fec6114938 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:47.658688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37a2f86-9581-4437-85de-95fec6114938 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:47.659371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37a2f86-9581-4437-85de-95fec6114938 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:47.659989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37a2f86-9581-4437-85de-95fec6114938 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:47.668834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:47.678651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:47.679209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:47.680047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:47.680526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:47.680959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:47.720509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Getting quotas for project e3daa9043f854a7fb87e1ab2211690f8. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:41:47.726141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Getting quotas for user d3f3adea6b08459789a51e98b05cf50a and project e3daa9043f854a7fb87e1ab2211690f8. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:41:48.029405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:41:48.032379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='925e1bb1-99b8-406f-9b6f-639fa29c07ea',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='cbd70cb4-1d41-423d-a7eb-97726b034c36',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='feee4cae-1099-45a1-ab6c-6b638e0aefba',volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:41:48.195656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c37a2f86-9581-4437-85de-95fec6114938 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:48.236883 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c37a2f86-9581-4437-85de-95fec6114938 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1810 microversion: 2.1 time: 0.574819 Oct 05 17:41:48.258473 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1242/2335] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:47 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1810 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:48.290082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-203b71ca-56c4-47d9-92ac-a73d073af097 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1998282838", "metadata": {"image_type": "test"}}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:48.296435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-203b71ca-56c4-47d9-92ac-a73d073af097 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Failed to fetch instance by id tempest-invalid-1723225599 {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 17:41:48.298833 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-203b71ca-56c4-47d9-92ac-a73d073af097 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] HTTP exception thrown: Instance tempest-invalid-1723225599 could not be found. Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-203b71ca-56c4-47d9-92ac-a73d073af097 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Request method failure captured: Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/tempest-invalid-1723225599/action HTTP/1.1 Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 112 Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGsvkH-Qns8HjljZGTMk33LrZ7mlA7SJx_eaBU5-2qeDkJJhviv_9jf6iCm4TxggrRgUzk6qwjgQr0oWwB0PejKCJqNmLr8P8lp5K0aVdRLwpeLAzI9G2oWBUpDLrESVGAJXIPhH1RQBGkOhwhBWkg1y-JuHoHnMyaSZM_uYhrSWLU Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6576c93c15754da4b845fd39842b7f51", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}] Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: c55f9de1db564563b7ae19d50765351d Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1998282838", "metadata": {"image_type": "test"}}} Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance tempest-invalid-1723225599 could not be found. Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'tempest-invalid-1723225599', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1998282838', 'metadata': {'image_type': 'test'}}}} Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1723225599 could not be found. Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:41:48.304248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1723225599 could not be found. Oct 05 17:41:48.307851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:48.307851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:48.307851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:48.307851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:48.307851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:48.307851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:48.307851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:41:48.307851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:41:48.307851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1723225599 could not be found. Oct 05 17:41:48.307851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:48.314991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-203b71ca-56c4-47d9-92ac-a73d073af097 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Returning 404 to user: Instance tempest-invalid-1723225599 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:41:48.322100 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-203b71ca-56c4-47d9-92ac-a73d073af097 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "POST /compute/v2.1/servers/tempest-invalid-1723225599/action" status: 404 len: 101 microversion: 2.1 time: 0.058158 Oct 05 17:41:48.340189 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1243/2336] 10.222.0.70 () {60 vars in 1249 bytes} [Wed Oct 5 17:41:48 2022] POST /compute/v2.1/servers/tempest-invalid-1723225599/action => generated 101 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:41:48.355429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f0ee187c-16b7-4186-91ee-dca5c916c63a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:48.362837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f0ee187c-16b7-4186-91ee-dca5c916c63a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:48.366058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:48.389816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0ee187c-16b7-4186-91ee-dca5c916c63a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:48.390247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0ee187c-16b7-4186-91ee-dca5c916c63a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:48.390721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0ee187c-16b7-4186-91ee-dca5c916c63a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:48.391450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0ee187c-16b7-4186-91ee-dca5c916c63a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:48.391911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0ee187c-16b7-4186-91ee-dca5c916c63a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:48.392352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0ee187c-16b7-4186-91ee-dca5c916c63a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:48.660953 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1dd9fd26-a13e-40b7-bdb0-20142b6188b3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 9.852726 Oct 05 17:41:48.666131 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1094/2337] 10.222.0.70 () {62 vars in 1189 bytes} [Wed Oct 5 17:41:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 9859 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:41:48.675138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4136ac2a-385b-48eb-bb7a-a9ae8cf07e82 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:48.677066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4136ac2a-385b-48eb-bb7a-a9ae8cf07e82 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:48.685870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4136ac2a-385b-48eb-bb7a-a9ae8cf07e82 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:48.686697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4136ac2a-385b-48eb-bb7a-a9ae8cf07e82 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:48.687315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4136ac2a-385b-48eb-bb7a-a9ae8cf07e82 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:48.688761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4136ac2a-385b-48eb-bb7a-a9ae8cf07e82 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:48.689379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4136ac2a-385b-48eb-bb7a-a9ae8cf07e82 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:48.690018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4136ac2a-385b-48eb-bb7a-a9ae8cf07e82 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:49.074926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4136ac2a-385b-48eb-bb7a-a9ae8cf07e82 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:49.087638 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4136ac2a-385b-48eb-bb7a-a9ae8cf07e82 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1317 microversion: 2.1 time: 0.417385 Oct 05 17:41:49.093940 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1095/2338] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:48 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1317 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:49.110517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65e04167-345c-4d6c-82bb-7a5b45cbb33a tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1158507213"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:49.113882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-65e04167-345c-4d6c-82bb-7a5b45cbb33a tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 17:41:49.114613 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-65e04167-345c-4d6c-82bb-7a5b45cbb33a tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65e04167-345c-4d6c-82bb-7a5b45cbb33a tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Request method failure captured: Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 57 Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGsvkH-Qns8HjljZGTMk33LrZ7mlA7SJx_eaBU5-2qeDkJJhviv_9jf6iCm4TxggrRgUzk6qwjgQr0oWwB0PejKCJqNmLr8P8lp5K0aVdRLwpeLAzI9G2oWBUpDLrESVGAJXIPhH1RQBGkOhwhBWkg1y-JuHoHnMyaSZM_uYhrSWLU Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6576c93c15754da4b845fd39842b7f51", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}] Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: c55f9de1db564563b7ae19d50765351d Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: {"createImage": {"name": "tempest-test-snap-1158507213"}} Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1158507213'}}} Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 17:41:49.117521 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.122207 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:49.122207 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.122207 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.122207 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:49.122207 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:49.122207 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:41:49.122207 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:41:49.122207 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 17:41:49.122207 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.123754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65e04167-345c-4d6c-82bb-7a5b45cbb33a tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:41:49.127677 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-65e04167-345c-4d6c-82bb-7a5b45cbb33a tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.032313 Oct 05 17:41:49.132685 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1096/2339] 10.222.0.70 () {60 vars in 1275 bytes} [Wed Oct 5 17:41:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:41:49.142186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-73df43f9-18b2-4bde-86cc-b107905cd644 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:49.152192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-73df43f9-18b2-4bde-86cc-b107905cd644 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:49.168230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73df43f9-18b2-4bde-86cc-b107905cd644 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:49.169111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73df43f9-18b2-4bde-86cc-b107905cd644 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:49.169993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73df43f9-18b2-4bde-86cc-b107905cd644 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:49.171393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73df43f9-18b2-4bde-86cc-b107905cd644 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:49.172098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73df43f9-18b2-4bde-86cc-b107905cd644 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:49.172739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73df43f9-18b2-4bde-86cc-b107905cd644 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:49.193313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f0ee187c-16b7-4186-91ee-dca5c916c63a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:49.206988 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f0ee187c-16b7-4186-91ee-dca5c916c63a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1307 microversion: 2.1 time: 0.863475 Oct 05 17:41:49.210973 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1244/2340] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:48 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1307 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:49.221566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40440b2f-64d8-4395-b26f-e62cd1ca9504 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:49.223695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-40440b2f-64d8-4395-b26f-e62cd1ca9504 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:49.245021 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-73df43f9-18b2-4bde-86cc-b107905cd644 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action" status: 200 len: 14 microversion: 2.1 time: 0.110594 Oct 05 17:41:49.250883 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1097/2341] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:49 2022] POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:41:49.267497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2be84611-ab7a-4e34-a084-ecd7c39a60e3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-892615680"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:49.282786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2be84611-ab7a-4e34-a084-ecd7c39a60e3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 17:41:49.283998 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-2be84611-ab7a-4e34-a084-ecd7c39a60e3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2be84611-ab7a-4e34-a084-ecd7c39a60e3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Request method failure captured: Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 56 Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGsvkH-Qns8HjljZGTMk33LrZ7mlA7SJx_eaBU5-2qeDkJJhviv_9jf6iCm4TxggrRgUzk6qwjgQr0oWwB0PejKCJqNmLr8P8lp5K0aVdRLwpeLAzI9G2oWBUpDLrESVGAJXIPhH1RQBGkOhwhBWkg1y-JuHoHnMyaSZM_uYhrSWLU Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6576c93c15754da4b845fd39842b7f51", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}] Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: c55f9de1db564563b7ae19d50765351d Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: {"createImage": {"name": "tempest-test-snap-892615680"}} Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-892615680'}}} Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 17:41:49.285950 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.289511 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:49.289511 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.289511 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.289511 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:49.289511 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:49.289511 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:41:49.289511 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:41:49.289511 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 05 17:41:49.289511 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.292189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2be84611-ab7a-4e34-a084-ecd7c39a60e3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:41:49.295394 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2be84611-ab7a-4e34-a084-ecd7c39a60e3 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.041325 Oct 05 17:41:49.296587 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1098/2342] 10.222.0.70 () {60 vars in 1281 bytes} [Wed Oct 5 17:41:49 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:41:49.304054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-244b823d-98c4-416e-a078-23582c343baa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:49.305068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-244b823d-98c4-416e-a078-23582c343baa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:49.313897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-244b823d-98c4-416e-a078-23582c343baa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:49.314895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-244b823d-98c4-416e-a078-23582c343baa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:49.315700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-244b823d-98c4-416e-a078-23582c343baa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:49.316660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-244b823d-98c4-416e-a078-23582c343baa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:49.317329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-244b823d-98c4-416e-a078-23582c343baa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:49.317802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40440b2f-64d8-4395-b26f-e62cd1ca9504 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:49.318229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-244b823d-98c4-416e-a078-23582c343baa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:49.330410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40440b2f-64d8-4395-b26f-e62cd1ca9504 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:49.332060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40440b2f-64d8-4395-b26f-e62cd1ca9504 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:49.333702 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-40440b2f-64d8-4395-b26f-e62cd1ca9504 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1283 microversion: 2.32 time: 0.121522 Oct 05 17:41:49.334475 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1245/2343] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:41:49 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1283 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:41:49.358894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:49.360146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:49.384298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:49.389583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:49.390258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:49.391856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:49.392529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:49.393213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:49.419799 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] HTTP exception thrown: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Request method failure captured: Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 HTTP/1.1 Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGsvkH-Qns8HjljZGTMk33LrZ7mlA7SJx_eaBU5-2qeDkJJhviv_9jf6iCm4TxggrRgUzk6qwjgQr0oWwB0PejKCJqNmLr8P8lp5K0aVdRLwpeLAzI9G2oWBUpDLrESVGAJXIPhH1RQBGkOhwhBWkg1y-JuHoHnMyaSZM_uYhrSWLU Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6576c93c15754da4b845fd39842b7f51", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}] Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: c55f9de1db564563b7ae19d50765351d Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e1268310-ba70-4b04-b154-c40254378586'} Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:41:49.427350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:49.431433 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.433632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Returning 404 to user: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:41:49.434771 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d73ac3f5-0204-46b3-94ef-07ccafc9f86b tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 404 len: 111 microversion: 2.1 time: 0.095431 Oct 05 17:41:49.438786 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1246/2344] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:41:49 2022] DELETE /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:41:49.443850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:49.444573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] [instance: e1268310-ba70-4b04-b154-c40254378586] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:49.459602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:49.460183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:49.460806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:49.462858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:49.462858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:49.462858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:49.491651 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] HTTP exception thrown: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Request method failure captured: Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 HTTP/1.1 Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGsvkH-Qns8HjljZGTMk33LrZ7mlA7SJx_eaBU5-2qeDkJJhviv_9jf6iCm4TxggrRgUzk6qwjgQr0oWwB0PejKCJqNmLr8P8lp5K0aVdRLwpeLAzI9G2oWBUpDLrESVGAJXIPhH1RQBGkOhwhBWkg1y-JuHoHnMyaSZM_uYhrSWLU Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6576c93c15754da4b845fd39842b7f51", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6576c93c15754da4b845fd39842b7f51"}]}] Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 6576c93c15754da4b845fd39842b7f51 Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-75693777 Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: c55f9de1db564563b7ae19d50765351d Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesNegativeTestJSON-75693777-project Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e1268310-ba70-4b04-b154-c40254378586'} Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:49.500373 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.504802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:49.504802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:49.504802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:49.504802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:41:49.504802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:41:49.504802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. Oct 05 17:41:49.504802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:49.506402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] Returning 404 to user: Instance e1268310-ba70-4b04-b154-c40254378586 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:41:49.509905 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6f3af273-8584-44a1-9bd0-65e097eb8041 tempest-ImagesNegativeTestJSON-75693777 tempest-ImagesNegativeTestJSON-75693777-project] 10.222.0.70 "GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586" status: 404 len: 111 microversion: 2.1 time: 0.068063 Oct 05 17:41:49.514149 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1247/2345] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:49 2022] GET /compute/v2.1/servers/e1268310-ba70-4b04-b154-c40254378586 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:41:49.530565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b929ebb4-8c70-456e-9b6e-b34f928207d1 req-b0cd8a97-69fd-4867-9df1-75f16af4bc55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0c9d6-efb6-4b55-9df3-23625b4c4efb", "name": "network-vif-deleted", "tag": "c88e6c42-997b-4cfa-aa37-9b219419844b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:49.555505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b929ebb4-8c70-456e-9b6e-b34f928207d1 req-b0cd8a97-69fd-4867-9df1-75f16af4bc55 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:49.556236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b929ebb4-8c70-456e-9b6e-b34f928207d1 req-b0cd8a97-69fd-4867-9df1-75f16af4bc55 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:49.557290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b929ebb4-8c70-456e-9b6e-b34f928207d1 req-b0cd8a97-69fd-4867-9df1-75f16af4bc55 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:49.587747 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b929ebb4-8c70-456e-9b6e-b34f928207d1 req-b0cd8a97-69fd-4867-9df1-75f16af4bc55 service nova] Creating event network-vif-deleted:c88e6c42-997b-4cfa-aa37-9b219419844b for instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb on n-h2-835595-3 Oct 05 17:41:49.597593 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b929ebb4-8c70-456e-9b6e-b34f928207d1 req-b0cd8a97-69fd-4867-9df1-75f16af4bc55 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081917 Oct 05 17:41:49.604462 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1248/2346] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:50.122992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-11418e76-d473-4789-a51d-8aa13a9d5297 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:50.123713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-11418e76-d473-4789-a51d-8aa13a9d5297 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:50.139403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11418e76-d473-4789-a51d-8aa13a9d5297 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:50.142552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11418e76-d473-4789-a51d-8aa13a9d5297 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:50.143345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11418e76-d473-4789-a51d-8aa13a9d5297 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:50.144258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11418e76-d473-4789-a51d-8aa13a9d5297 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:50.146914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11418e76-d473-4789-a51d-8aa13a9d5297 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:50.147530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11418e76-d473-4789-a51d-8aa13a9d5297 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:50.228341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-244b823d-98c4-416e-a078-23582c343baa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:50.241898 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-244b823d-98c4-416e-a078-23582c343baa tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1789 microversion: 2.1 time: 0.943939 Oct 05 17:41:50.242742 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1099/2347] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:49 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1789 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:50.252134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0840784d-3da2-4284-a3cf-28efee35d01c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:50.254860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0840784d-3da2-4284-a3cf-28efee35d01c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:50.273349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0840784d-3da2-4284-a3cf-28efee35d01c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:50.274198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0840784d-3da2-4284-a3cf-28efee35d01c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:50.275282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0840784d-3da2-4284-a3cf-28efee35d01c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:50.276493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0840784d-3da2-4284-a3cf-28efee35d01c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:50.278371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0840784d-3da2-4284-a3cf-28efee35d01c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:50.281109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0840784d-3da2-4284-a3cf-28efee35d01c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:50.705569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11418e76-d473-4789-a51d-8aa13a9d5297 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:50.719100 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-11418e76-d473-4789-a51d-8aa13a9d5297 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1317 microversion: 2.1 time: 0.599904 Oct 05 17:41:50.720187 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1249/2348] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:50 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1317 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:41:50.738040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-37337ab8-063c-41c9-8c2f-9ff940d9b898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:50.742491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-37337ab8-063c-41c9-8c2f-9ff940d9b898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:50.775044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37337ab8-063c-41c9-8c2f-9ff940d9b898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:50.777245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37337ab8-063c-41c9-8c2f-9ff940d9b898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:50.780876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37337ab8-063c-41c9-8c2f-9ff940d9b898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:50.783208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37337ab8-063c-41c9-8c2f-9ff940d9b898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:50.783934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37337ab8-063c-41c9-8c2f-9ff940d9b898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:50.787514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37337ab8-063c-41c9-8c2f-9ff940d9b898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:50.830883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0840784d-3da2-4284-a3cf-28efee35d01c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:50.841800 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0840784d-3da2-4284-a3cf-28efee35d01c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1307 microversion: 2.1 time: 0.596558 Oct 05 17:41:50.846233 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1100/2349] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:50 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1307 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:50.857314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-00cf8351-75c7-4adc-817e-489d1517d1b4 req-470c0e99-509f-473b-a1a7-a99b1d18affb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2c8db2-f243-4f95-8554-5f6456b4f18e", "name": "network-vif-plugged", "status": "completed", "tag": "c45bec95-980b-4f58-b5d6-bc729046e986"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:50.880641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-00cf8351-75c7-4adc-817e-489d1517d1b4 req-470c0e99-509f-473b-a1a7-a99b1d18affb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:50.881720 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-37337ab8-063c-41c9-8c2f-9ff940d9b898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action" status: 200 len: 14 microversion: 2.1 time: 0.156112 Oct 05 17:41:50.882694 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1250/2350] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:50 2022] POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:41:50.882938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-00cf8351-75c7-4adc-817e-489d1517d1b4 req-470c0e99-509f-473b-a1a7-a99b1d18affb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:50.886661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-00cf8351-75c7-4adc-817e-489d1517d1b4 req-470c0e99-509f-473b-a1a7-a99b1d18affb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:50.896460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:50.899577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:50.920371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:50.925343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:50.925959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:50.927063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:50.927669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:50.928206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:50.931201 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-00cf8351-75c7-4adc-817e-489d1517d1b4 req-470c0e99-509f-473b-a1a7-a99b1d18affb service nova] Creating event network-vif-plugged:c45bec95-980b-4f58-b5d6-bc729046e986 for instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e on n-h1-835595-3 Oct 05 17:41:50.945042 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-00cf8351-75c7-4adc-817e-489d1517d1b4 req-470c0e99-509f-473b-a1a7-a99b1d18affb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096118 Oct 05 17:41:50.947759 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1101/2351] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:51.028147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:51.219587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:51.232251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:51.234180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:51.236579 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0db587a1-6cb1-4c69-a8c1-aba95bb62bc0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1573 microversion: 2.32 time: 0.352110 Oct 05 17:41:51.238012 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1251/2352] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:41:50 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1573 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:41:51.272084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72ab744c-a77e-4ed1-8dab-1f7b7f8f4266 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:51.273431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-72ab744c-a77e-4ed1-8dab-1f7b7f8f4266 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:51.281770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72ab744c-a77e-4ed1-8dab-1f7b7f8f4266 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:51.282495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72ab744c-a77e-4ed1-8dab-1f7b7f8f4266 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:51.283093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72ab744c-a77e-4ed1-8dab-1f7b7f8f4266 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:51.283955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72ab744c-a77e-4ed1-8dab-1f7b7f8f4266 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:51.284558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72ab744c-a77e-4ed1-8dab-1f7b7f8f4266 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:51.285134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72ab744c-a77e-4ed1-8dab-1f7b7f8f4266 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:51.749278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f64c2ba8-f8e7-452b-a450-62424a70a3fa tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:51.749971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f64c2ba8-f8e7-452b-a450-62424a70a3fa tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:51.791273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f64c2ba8-f8e7-452b-a450-62424a70a3fa tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:51.795429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f64c2ba8-f8e7-452b-a450-62424a70a3fa tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:51.796510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f64c2ba8-f8e7-452b-a450-62424a70a3fa tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:51.803549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f64c2ba8-f8e7-452b-a450-62424a70a3fa tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:51.808000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f64c2ba8-f8e7-452b-a450-62424a70a3fa tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:51.809537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f64c2ba8-f8e7-452b-a450-62424a70a3fa tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:52.328431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-72ab744c-a77e-4ed1-8dab-1f7b7f8f4266 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:52.360000 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-72ab744c-a77e-4ed1-8dab-1f7b7f8f4266 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1653 microversion: 2.1 time: 1.092213 Oct 05 17:41:52.389618 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1102/2353] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:51 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1653 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:52.399925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e486aed3-244f-4a98-90dc-4ed80495e88d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:52.406838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e486aed3-244f-4a98-90dc-4ed80495e88d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:52.415723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e486aed3-244f-4a98-90dc-4ed80495e88d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:52.416545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e486aed3-244f-4a98-90dc-4ed80495e88d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:52.417128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e486aed3-244f-4a98-90dc-4ed80495e88d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:52.418004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e486aed3-244f-4a98-90dc-4ed80495e88d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:52.418630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e486aed3-244f-4a98-90dc-4ed80495e88d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:52.419200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e486aed3-244f-4a98-90dc-4ed80495e88d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:52.770309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f64c2ba8-f8e7-452b-a450-62424a70a3fa tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:52.782188 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f64c2ba8-f8e7-452b-a450-62424a70a3fa tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1317 microversion: 2.1 time: 1.039789 Oct 05 17:41:52.783062 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1252/2354] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:51 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1317 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:41:52.788164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-365db8f9-ad40-4b2f-b422-25cf8271bd6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:52.791057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-365db8f9-ad40-4b2f-b422-25cf8271bd6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:52.803195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-365db8f9-ad40-4b2f-b422-25cf8271bd6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:52.804356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-365db8f9-ad40-4b2f-b422-25cf8271bd6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:52.804766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-365db8f9-ad40-4b2f-b422-25cf8271bd6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:52.805798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-365db8f9-ad40-4b2f-b422-25cf8271bd6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:52.806504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-365db8f9-ad40-4b2f-b422-25cf8271bd6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:52.807254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-365db8f9-ad40-4b2f-b422-25cf8271bd6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:52.904843 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-365db8f9-ad40-4b2f-b422-25cf8271bd6d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action" status: 200 len: 8202 microversion: 2.1 time: 0.120104 Oct 05 17:41:52.905746 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1253/2355] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:52 2022] POST /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f/action => generated 8202 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:52.917250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f9e43050-f554-42bd-aa66-c35057d959d9 req-1f5128a2-4eda-41f1-b7fc-a5527afa979c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0c9d6-efb6-4b55-9df3-23625b4c4efb", "name": "network-vif-deleted", "tag": "da5d4bc0-859e-4373-9563-212b6d5bb0e6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:52.941156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f9e43050-f554-42bd-aa66-c35057d959d9 req-1f5128a2-4eda-41f1-b7fc-a5527afa979c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:52.942177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f9e43050-f554-42bd-aa66-c35057d959d9 req-1f5128a2-4eda-41f1-b7fc-a5527afa979c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:52.943105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f9e43050-f554-42bd-aa66-c35057d959d9 req-1f5128a2-4eda-41f1-b7fc-a5527afa979c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:52.981164 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f9e43050-f554-42bd-aa66-c35057d959d9 req-1f5128a2-4eda-41f1-b7fc-a5527afa979c service nova] Creating event network-vif-deleted:da5d4bc0-859e-4373-9563-212b6d5bb0e6 for instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb on n-h2-835595-3 Oct 05 17:41:52.991841 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f9e43050-f554-42bd-aa66-c35057d959d9 req-1f5128a2-4eda-41f1-b7fc-a5527afa979c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084479 Oct 05 17:41:52.993339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1254/2356] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:52.999965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:53.001185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:53.010775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.011549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.012229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.013200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.013879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.014720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.135632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:53.146432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:53.147866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:53.149038 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8dbc9c49-0e81-4ba4-a7db-1ded908122e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1591 microversion: 2.32 time: 0.154058 Oct 05 17:41:53.153656 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1255/2357] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:41:52 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1591 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:41:53.163269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d2bd3ea9-28e7-4eb2-a53b-9757ab960352 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:53.168315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d2bd3ea9-28e7-4eb2-a53b-9757ab960352 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:53.183587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2bd3ea9-28e7-4eb2-a53b-9757ab960352 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.184347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2bd3ea9-28e7-4eb2-a53b-9757ab960352 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.184585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e486aed3-244f-4a98-90dc-4ed80495e88d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:53.185118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2bd3ea9-28e7-4eb2-a53b-9757ab960352 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.185987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2bd3ea9-28e7-4eb2-a53b-9757ab960352 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.196938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2bd3ea9-28e7-4eb2-a53b-9757ab960352 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.197587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2bd3ea9-28e7-4eb2-a53b-9757ab960352 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.208903 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e486aed3-244f-4a98-90dc-4ed80495e88d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1307 microversion: 2.1 time: 0.817855 Oct 05 17:41:53.230040 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1103/2358] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:52 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1307 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:53.392542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:53.398935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:53.413183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.418501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.419247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.420217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.420867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.421617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.423500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d2bd3ea9-28e7-4eb2-a53b-9757ab960352 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:53.434870 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d2bd3ea9-28e7-4eb2-a53b-9757ab960352 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.279055 Oct 05 17:41:53.435784 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1256/2359] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:53 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:53.447657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4a0ec5e2-8de8-4c0e-bfb9-9209bbb52340 req-5e79d789-70ad-486f-a0fc-3fdc820fefdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fde73d-b536-4d20-888c-3966e7d4ed06", "name": "network-vif-plugged", "status": "completed", "tag": "ae705199-ad4f-4fae-9d62-e55f3f2bfeb3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:53.489639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.490237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4a0ec5e2-8de8-4c0e-bfb9-9209bbb52340 req-5e79d789-70ad-486f-a0fc-3fdc820fefdc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.490700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.490947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4a0ec5e2-8de8-4c0e-bfb9-9209bbb52340 req-5e79d789-70ad-486f-a0fc-3fdc820fefdc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.491385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4a0ec5e2-8de8-4c0e-bfb9-9209bbb52340 req-5e79d789-70ad-486f-a0fc-3fdc820fefdc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.491922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.492564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lazy-loading 'fault' on Instance uuid 51c0c9d6-efb6-4b55-9df3-23625b4c4efb {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:41:53.512778 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4a0ec5e2-8de8-4c0e-bfb9-9209bbb52340 req-5e79d789-70ad-486f-a0fc-3fdc820fefdc service nova] Creating event network-vif-plugged:ae705199-ad4f-4fae-9d62-e55f3f2bfeb3 for instance 68fde73d-b536-4d20-888c-3966e7d4ed06 on n-h1-835595-3 Oct 05 17:41:53.521281 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4a0ec5e2-8de8-4c0e-bfb9-9209bbb52340 req-5e79d789-70ad-486f-a0fc-3fdc820fefdc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082153 Oct 05 17:41:53.522815 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1257/2360] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:53.529706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0a871401-c1f4-46d0-84fa-288da5b6a120 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:53.544036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0a871401-c1f4-46d0-84fa-288da5b6a120 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:53.557653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a871401-c1f4-46d0-84fa-288da5b6a120 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.558628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a871401-c1f4-46d0-84fa-288da5b6a120 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.561207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a871401-c1f4-46d0-84fa-288da5b6a120 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.562217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a871401-c1f4-46d0-84fa-288da5b6a120 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.563250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a871401-c1f4-46d0-84fa-288da5b6a120 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.563704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a871401-c1f4-46d0-84fa-288da5b6a120 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.621937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:53.629661 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-71eb32a4-a431-4d1d-b25e-4be26f6867b4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 200 len: 1303 microversion: 2.1 time: 0.243082 Oct 05 17:41:53.646305 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1104/2361] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:53 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 1303 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:41:53.806866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d17723e-d8aa-4a8f-8108-4e4fd1c4dfdb tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:53.807639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6d17723e-d8aa-4a8f-8108-4e4fd1c4dfdb tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:53.818238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d17723e-d8aa-4a8f-8108-4e4fd1c4dfdb tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.818766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d17723e-d8aa-4a8f-8108-4e4fd1c4dfdb tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.819195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d17723e-d8aa-4a8f-8108-4e4fd1c4dfdb tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.825747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d17723e-d8aa-4a8f-8108-4e4fd1c4dfdb tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:53.826968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d17723e-d8aa-4a8f-8108-4e4fd1c4dfdb tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:53.827556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d17723e-d8aa-4a8f-8108-4e4fd1c4dfdb tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:53.969147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0a871401-c1f4-46d0-84fa-288da5b6a120 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:53.985188 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0a871401-c1f4-46d0-84fa-288da5b6a120 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.460919 Oct 05 17:41:53.989001 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1258/2362] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:53 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:54.028989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b13bbbc7-a4e2-4656-8a18-0710a96f7635 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:54.030842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b13bbbc7-a4e2-4656-8a18-0710a96f7635 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:54.044572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b13bbbc7-a4e2-4656-8a18-0710a96f7635 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:54.045651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b13bbbc7-a4e2-4656-8a18-0710a96f7635 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:54.046393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b13bbbc7-a4e2-4656-8a18-0710a96f7635 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:54.047387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b13bbbc7-a4e2-4656-8a18-0710a96f7635 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:54.048706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b13bbbc7-a4e2-4656-8a18-0710a96f7635 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:54.049291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b13bbbc7-a4e2-4656-8a18-0710a96f7635 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:54.206183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d17723e-d8aa-4a8f-8108-4e4fd1c4dfdb tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:54.210569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:54.219104 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6d17723e-d8aa-4a8f-8108-4e4fd1c4dfdb tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1317 microversion: 2.1 time: 0.417660 Oct 05 17:41:54.239625 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1105/2363] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:53 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:54.246730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:54.247830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:54.255676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:54.256538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:54.257192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:54.258127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:54.258815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:54.259530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:54.503275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b13bbbc7-a4e2-4656-8a18-0710a96f7635 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:54.516068 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b13bbbc7-a4e2-4656-8a18-0710a96f7635 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.501884 Oct 05 17:41:54.526156 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1259/2364] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:54 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:54.531599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2b414291-3318-462b-8320-d7e2b6292956 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:54.532281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2b414291-3318-462b-8320-d7e2b6292956 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:54.555467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b414291-3318-462b-8320-d7e2b6292956 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:54.555980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b414291-3318-462b-8320-d7e2b6292956 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:54.556424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b414291-3318-462b-8320-d7e2b6292956 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:54.557204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b414291-3318-462b-8320-d7e2b6292956 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:54.557663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b414291-3318-462b-8320-d7e2b6292956 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:54.558090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b414291-3318-462b-8320-d7e2b6292956 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:54.568620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:54.586817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:54.588500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:54.591598 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-428df244-13d7-4f9a-8f96-0d8c77eb2377 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1591 microversion: 2.32 time: 0.350378 Oct 05 17:41:54.595257 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1106/2365] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:41:54 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1591 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:41:54.625580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d0d4bff-d20d-4b42-8010-0c18abdcc062 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:54.626544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0d0d4bff-d20d-4b42-8010-0c18abdcc062 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:54.636320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d0d4bff-d20d-4b42-8010-0c18abdcc062 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:54.637202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d0d4bff-d20d-4b42-8010-0c18abdcc062 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:54.637889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d0d4bff-d20d-4b42-8010-0c18abdcc062 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:54.638880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d0d4bff-d20d-4b42-8010-0c18abdcc062 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:54.639847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d0d4bff-d20d-4b42-8010-0c18abdcc062 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:54.640573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d0d4bff-d20d-4b42-8010-0c18abdcc062 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:55.061672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2b414291-3318-462b-8320-d7e2b6292956 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:55.072716 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2b414291-3318-462b-8320-d7e2b6292956 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1487 microversion: 2.1 time: 0.545117 Oct 05 17:41:55.073323 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1260/2366] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:54 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1487 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:55.086526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:55.086526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:55.110131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:55.118103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:55.120089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:55.120919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:55.123992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:55.124463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:55.157060 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] HTTP exception thrown: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Request method failure captured: Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb HTTP/1.1 Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGRonZ_xC29CZD9lh4kGv13W1PkfQDaNJ2ZjpKfhQAQO4a1E3XGSKRe32NwtQSHxQmtEScDFE3ruI7xc5qPvlx3m5c78DiRYoY_6bYtFTRpOWnaslYRf6HRm14i_0CmvvhZeHYzw4obaZvTbjcP6bMOlsHAGp5_G-wlLt1so9mxE_o Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8ac9093ae0534edb92b2e2b007c8926a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}] Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestMultiNic-65439040 Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestMultiNic-65439040-project Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6aa6b735fc434e23b04a45979eeadafb Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestMultiNic-65439040-project Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '51c0c9d6-efb6-4b55-9df3-23625b4c4efb'} Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:55.158832 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:55.169247 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:55.169247 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:55.169247 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:55.169247 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:41:55.169247 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:41:55.169247 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:41:55.169247 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:55.169247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Returning 404 to user: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:41:55.169247 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9aa7774b-4136-438e-a158-1623b313c46f tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 404 len: 111 microversion: 2.1 time: 0.085996 Oct 05 17:41:55.170664 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1261/2367] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:55 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:41:55.175814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-de3b26ad-98fb-4295-9c5d-cfb88ba1881b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:55.180651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d0d4bff-d20d-4b42-8010-0c18abdcc062 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:55.189956 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0d0d4bff-d20d-4b42-8010-0c18abdcc062 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.579864 Oct 05 17:41:55.204936 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1107/2368] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:54 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:55.205261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de3b26ad-98fb-4295-9c5d-cfb88ba1881b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:55.205261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de3b26ad-98fb-4295-9c5d-cfb88ba1881b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:55.205261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de3b26ad-98fb-4295-9c5d-cfb88ba1881b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:55.344106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3a74fe4a-5b37-40a4-911d-fa7d86d63f3a req-bc72eaee-33c1-4f27-8ac1-823821393206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51c0c9d6-efb6-4b55-9df3-23625b4c4efb", "name": "network-vif-deleted", "tag": "faf68f92-9784-4248-964c-935266565f08"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:55.363548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3a74fe4a-5b37-40a4-911d-fa7d86d63f3a req-bc72eaee-33c1-4f27-8ac1-823821393206 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:55.364545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3a74fe4a-5b37-40a4-911d-fa7d86d63f3a req-bc72eaee-33c1-4f27-8ac1-823821393206 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:55.365186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3a74fe4a-5b37-40a4-911d-fa7d86d63f3a req-bc72eaee-33c1-4f27-8ac1-823821393206 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:55.368437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-de3b26ad-98fb-4295-9c5d-cfb88ba1881b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Going to try to stop instance {{(pid=128844) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 17:41:55.380937 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3a74fe4a-5b37-40a4-911d-fa7d86d63f3a req-bc72eaee-33c1-4f27-8ac1-823821393206 service nova] Creating event network-vif-deleted:faf68f92-9784-4248-964c-935266565f08 for instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb on n-h2-835595-3 Oct 05 17:41:55.419871 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3a74fe4a-5b37-40a4-911d-fa7d86d63f3a req-bc72eaee-33c1-4f27-8ac1-823821393206 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217480 Oct 05 17:41:55.422433 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1108/2369] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:55.438952 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-de3b26ad-98fb-4295-9c5d-cfb88ba1881b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e/action" status: 202 len: 0 microversion: 2.1 time: 0.266528 Oct 05 17:41:55.440048 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1262/2370] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:55 2022] POST /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:41:55.452187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f6250f58-2064-468d-b9c5-52a73bdb28b5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:55.453152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f6250f58-2064-468d-b9c5-52a73bdb28b5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:55.462597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6250f58-2064-468d-b9c5-52a73bdb28b5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:55.463578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6250f58-2064-468d-b9c5-52a73bdb28b5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:55.464723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6250f58-2064-468d-b9c5-52a73bdb28b5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:55.465879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1417d91b-b53e-42e5-9fa8-5b1af52c02ac tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:55.466009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6250f58-2064-468d-b9c5-52a73bdb28b5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:55.466821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6250f58-2064-468d-b9c5-52a73bdb28b5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:55.467572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6250f58-2064-468d-b9c5-52a73bdb28b5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:55.468086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1417d91b-b53e-42e5-9fa8-5b1af52c02ac tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:55.494646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1417d91b-b53e-42e5-9fa8-5b1af52c02ac tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:55.498229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1417d91b-b53e-42e5-9fa8-5b1af52c02ac tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:55.498877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1417d91b-b53e-42e5-9fa8-5b1af52c02ac tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:55.500373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1417d91b-b53e-42e5-9fa8-5b1af52c02ac tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:55.502258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1417d91b-b53e-42e5-9fa8-5b1af52c02ac tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:55.502964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1417d91b-b53e-42e5-9fa8-5b1af52c02ac tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:55.645969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1417d91b-b53e-42e5-9fa8-5b1af52c02ac tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Locking {{(pid=128843) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 05 17:41:56.089200 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1417d91b-b53e-42e5-9fa8-5b1af52c02ac tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.664173 Oct 05 17:41:56.093018 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1109/2371] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:55 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:41:56.098217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76f79e91-265e-4242-be90-04743a184d68 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:56.098960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-76f79e91-265e-4242-be90-04743a184d68 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:56.118006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76f79e91-265e-4242-be90-04743a184d68 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:56.118797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76f79e91-265e-4242-be90-04743a184d68 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:56.119522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76f79e91-265e-4242-be90-04743a184d68 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:56.131363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76f79e91-265e-4242-be90-04743a184d68 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:56.131854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76f79e91-265e-4242-be90-04743a184d68 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:56.132293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76f79e91-265e-4242-be90-04743a184d68 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:56.199497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f6250f58-2064-468d-b9c5-52a73bdb28b5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:56.215641 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f6250f58-2064-468d-b9c5-52a73bdb28b5 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1317 microversion: 2.1 time: 0.769588 Oct 05 17:41:56.217460 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1263/2372] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:55 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1317 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:56.229075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f6db2c04-ebca-4dc4-904e-c372665fb8eb req-d0df67e5-e943-4d17-9cda-3707b199b4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3ebe68-038e-4369-8fc2-4edb36eab3fd", "name": "network-vif-plugged", "status": "completed", "tag": "b9c4193f-bd45-40b4-aaee-609b8fc0ebaf"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:56.254516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f6db2c04-ebca-4dc4-904e-c372665fb8eb req-d0df67e5-e943-4d17-9cda-3707b199b4d8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:56.255341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f6db2c04-ebca-4dc4-904e-c372665fb8eb req-d0df67e5-e943-4d17-9cda-3707b199b4d8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:56.256294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f6db2c04-ebca-4dc4-904e-c372665fb8eb req-d0df67e5-e943-4d17-9cda-3707b199b4d8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:56.278987 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f6db2c04-ebca-4dc4-904e-c372665fb8eb req-d0df67e5-e943-4d17-9cda-3707b199b4d8 service nova] Creating event network-vif-plugged:b9c4193f-bd45-40b4-aaee-609b8fc0ebaf for instance 5b3ebe68-038e-4369-8fc2-4edb36eab3fd on n-h2-835595-3 Oct 05 17:41:56.289280 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f6db2c04-ebca-4dc4-904e-c372665fb8eb req-d0df67e5-e943-4d17-9cda-3707b199b4d8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070415 Oct 05 17:41:56.292222 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1264/2373] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:41:56.309526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:56.311741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:56.328192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:56.328626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:56.329074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:56.330098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:56.330243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:56.337703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:56.577093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-76f79e91-265e-4242-be90-04743a184d68 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:56.587658 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76f79e91-265e-4242-be90-04743a184d68 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 0.496101 Oct 05 17:41:56.588269 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1110/2374] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:56 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:56.614556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c7923e2e-e0ba-4ea7-917d-4784d27886f0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:56.623740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c7923e2e-e0ba-4ea7-917d-4784d27886f0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:56.634762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7923e2e-e0ba-4ea7-917d-4784d27886f0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:56.635352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7923e2e-e0ba-4ea7-917d-4784d27886f0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:56.635799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7923e2e-e0ba-4ea7-917d-4784d27886f0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:56.636520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7923e2e-e0ba-4ea7-917d-4784d27886f0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:56.636980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7923e2e-e0ba-4ea7-917d-4784d27886f0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:56.637409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7923e2e-e0ba-4ea7-917d-4784d27886f0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:56.892748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:56.914868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:56.916401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:56.917629 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d5d28ab9-8dc4-49e3-a026-61fc61046436 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1659 microversion: 2.32 time: 0.621265 Oct 05 17:41:56.932280 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1265/2375] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:41:56 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1659 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:41:57.180741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7923e2e-e0ba-4ea7-917d-4784d27886f0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:57.191936 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c7923e2e-e0ba-4ea7-917d-4784d27886f0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.586667 Oct 05 17:41:57.216249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ec5d650-7e3c-4c2a-9c3d-e3d09fe9aabe tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:57.222546 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1111/2376] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:56 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:57.225174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ec5d650-7e3c-4c2a-9c3d-e3d09fe9aabe tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:57.225952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ec5d650-7e3c-4c2a-9c3d-e3d09fe9aabe tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:57.226668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ec5d650-7e3c-4c2a-9c3d-e3d09fe9aabe tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:57.241887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b6ca59ee-75b6-447e-9eec-f22a934ff42c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:57.242817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b6ca59ee-75b6-447e-9eec-f22a934ff42c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:57.255224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6ca59ee-75b6-447e-9eec-f22a934ff42c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:57.257785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6ca59ee-75b6-447e-9eec-f22a934ff42c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:57.259669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6ca59ee-75b6-447e-9eec-f22a934ff42c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:57.260771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6ca59ee-75b6-447e-9eec-f22a934ff42c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:57.262722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6ca59ee-75b6-447e-9eec-f22a934ff42c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:57.263669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6ca59ee-75b6-447e-9eec-f22a934ff42c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:57.287343 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-2ec5d650-7e3c-4c2a-9c3d-e3d09fe9aabe tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] HTTP exception thrown: Instance 586258bf-c661-4819-804b-504089c77dc6 is locked Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ec5d650-7e3c-4c2a-9c3d-e3d09fe9aabe tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Request method failure captured: Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action HTTP/1.1 Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 15 Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcCvFl89ip348NgYmwRfZVFC69tIUsNnayzGFoWfaaS5WJz4H_LFyyNRNAoVHHF9Wfeh9GoU_EwuvkTy8VtZir92iFF1CSn6ibH-bezU0QjM6z6boOtDmg22QRK98g5juENhUY8ur87Hcv6cKi_H4k4qVVkCC9KKvvdQauWSleksFok Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d8ec67d827143b3a09b519cb4af417e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}] Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-385249587 Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 1c5f58a618c04b09815dea8f54504c7c Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: {"os-stop": {}} Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 586258bf-c661-4819-804b-504089c77dc6 is locked Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '586258bf-c661-4819-804b-504089c77dc6', 'body': {'os-stop': {}}} Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 586258bf-c661-4819-804b-504089c77dc6 is locked Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 586258bf-c661-4819-804b-504089c77dc6 is locked Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586258bf-c661-4819-804b-504089c77dc6 is locked Oct 05 17:41:57.290871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:41:57.296232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ec5d650-7e3c-4c2a-9c3d-e3d09fe9aabe tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Returning 409 to user: Instance 586258bf-c661-4819-804b-504089c77dc6 is locked {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:41:57.297562 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ec5d650-7e3c-4c2a-9c3d-e3d09fe9aabe tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 409 len: 107 microversion: 2.1 time: 0.085862 Oct 05 17:41:57.299892 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1266/2377] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:57 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 107 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:41:57.309374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-227e6b46-11d8-4655-b993-886a534cad05 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:57.320254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-227e6b46-11d8-4655-b993-886a534cad05 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:57.339657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-227e6b46-11d8-4655-b993-886a534cad05 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:57.340509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-227e6b46-11d8-4655-b993-886a534cad05 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:57.341190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-227e6b46-11d8-4655-b993-886a534cad05 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:57.343079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-227e6b46-11d8-4655-b993-886a534cad05 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:57.343780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-227e6b46-11d8-4655-b993-886a534cad05 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:57.344415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-227e6b46-11d8-4655-b993-886a534cad05 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:57.504267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-227e6b46-11d8-4655-b993-886a534cad05 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Unlocking {{(pid=128844) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 05 17:41:57.593032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:57.600512 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-227e6b46-11d8-4655-b993-886a534cad05 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.297933 Oct 05 17:41:57.602344 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1267/2378] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:57 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:41:57.620227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81c7cf14-4730-4f59-8b8c-108aab81b19e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:41:57.641221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81c7cf14-4730-4f59-8b8c-108aab81b19e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:57.641754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81c7cf14-4730-4f59-8b8c-108aab81b19e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:57.642962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81c7cf14-4730-4f59-8b8c-108aab81b19e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:57.675101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-81c7cf14-4730-4f59-8b8c-108aab81b19e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Going to try to stop instance {{(pid=128844) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 17:41:57.703227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:57.738951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:57.810479 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81c7cf14-4730-4f59-8b8c-108aab81b19e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.197394 Oct 05 17:41:57.814715 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1268/2379] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:41:57 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:41:57.836950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-be28acdd-fe37-462f-b71b-4a379ace486e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:57.839360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-be28acdd-fe37-462f-b71b-4a379ace486e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:57.858391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be28acdd-fe37-462f-b71b-4a379ace486e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:57.860216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be28acdd-fe37-462f-b71b-4a379ace486e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:57.860434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be28acdd-fe37-462f-b71b-4a379ace486e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:57.861523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be28acdd-fe37-462f-b71b-4a379ace486e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:57.861994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be28acdd-fe37-462f-b71b-4a379ace486e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:57.862458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be28acdd-fe37-462f-b71b-4a379ace486e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:58.296748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b6ca59ee-75b6-447e-9eec-f22a934ff42c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:58.315033 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b6ca59ee-75b6-447e-9eec-f22a934ff42c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1317 microversion: 2.1 time: 1.078459 Oct 05 17:41:58.334934 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1112/2380] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:57 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1317 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:41:58.356837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d6f06a1e-5c70-4901-a9a3-d3e2e38fb05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:58.358924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d6f06a1e-5c70-4901-a9a3-d3e2e38fb05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:58.379464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6f06a1e-5c70-4901-a9a3-d3e2e38fb05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:58.379973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6f06a1e-5c70-4901-a9a3-d3e2e38fb05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:58.380416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6f06a1e-5c70-4901-a9a3-d3e2e38fb05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:58.387756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6f06a1e-5c70-4901-a9a3-d3e2e38fb05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:58.388550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6f06a1e-5c70-4901-a9a3-d3e2e38fb05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:58.389249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6f06a1e-5c70-4901-a9a3-d3e2e38fb05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:58.875292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d6f06a1e-5c70-4901-a9a3-d3e2e38fb05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:58.894475 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d6f06a1e-5c70-4901-a9a3-d3e2e38fb05f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.557973 Oct 05 17:41:58.895074 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1113/2381] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:58 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:58.929912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:58.938898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:58.945572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:58.946623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:58.947880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:58.949796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:58.951846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:58.959438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:59.227373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-be28acdd-fe37-462f-b71b-4a379ace486e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:59.243080 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-be28acdd-fe37-462f-b71b-4a379ace486e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 1.426749 Oct 05 17:41:59.261284 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1269/2382] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:57 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:59.272463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:59.290108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:59.292559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:59.295230 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cbe59190-9bef-45ef-8173-bfa854cb1bb1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1706 microversion: 2.32 time: 0.398754 Oct 05 17:41:59.296496 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1114/2383] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:41:58 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1706 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:41:59.347315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4018c523-c8c7-45f5-97ef-75c2f2d028ee tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:59.348367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4018c523-c8c7-45f5-97ef-75c2f2d028ee tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:59.353993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:41:59.360330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4018c523-c8c7-45f5-97ef-75c2f2d028ee tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:59.361396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4018c523-c8c7-45f5-97ef-75c2f2d028ee tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:59.364870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4018c523-c8c7-45f5-97ef-75c2f2d028ee tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:59.366469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4018c523-c8c7-45f5-97ef-75c2f2d028ee tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:59.367273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4018c523-c8c7-45f5-97ef-75c2f2d028ee tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:59.368006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4018c523-c8c7-45f5-97ef-75c2f2d028ee tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:59.860833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4018c523-c8c7-45f5-97ef-75c2f2d028ee tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:41:59.872631 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4018c523-c8c7-45f5-97ef-75c2f2d028ee tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1505 microversion: 2.1 time: 0.530601 Oct 05 17:41:59.876159 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1270/2384] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:59 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1505 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:41:59.907289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b5930dac-73d9-4e2a-80ac-bb35b4a00f34 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:59.907825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b5930dac-73d9-4e2a-80ac-bb35b4a00f34 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 68fde73d-b536-4d20-888c-3966e7d4ed06] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:59.920366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dd32715d-80ec-4de5-bf8a-822e295eda9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:41:59.921496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dd32715d-80ec-4de5-bf8a-822e295eda9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:41:59.928584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5930dac-73d9-4e2a-80ac-bb35b4a00f34 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:59.930498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5930dac-73d9-4e2a-80ac-bb35b4a00f34 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:59.932514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd32715d-80ec-4de5-bf8a-822e295eda9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:59.933314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5930dac-73d9-4e2a-80ac-bb35b4a00f34 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:59.934062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5930dac-73d9-4e2a-80ac-bb35b4a00f34 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:59.934561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5930dac-73d9-4e2a-80ac-bb35b4a00f34 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:59.935024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd32715d-80ec-4de5-bf8a-822e295eda9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:59.935603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5930dac-73d9-4e2a-80ac-bb35b4a00f34 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:59.936195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd32715d-80ec-4de5-bf8a-822e295eda9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:41:59.937760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd32715d-80ec-4de5-bf8a-822e295eda9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:41:59.941497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd32715d-80ec-4de5-bf8a-822e295eda9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:41:59.942088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd32715d-80ec-4de5-bf8a-822e295eda9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:00.358842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b5930dac-73d9-4e2a-80ac-bb35b4a00f34 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:00.377839 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b5930dac-73d9-4e2a-80ac-bb35b4a00f34 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06" status: 200 len: 1504 microversion: 2.1 time: 0.474108 Oct 05 17:42:00.380130 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1115/2385] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:59 2022] GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06 => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:00.389845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b6a7b4e-0698-4f2c-85ec-158d79892bad tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:00.393072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b6a7b4e-0698-4f2c-85ec-158d79892bad tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:00.408090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b4e-0698-4f2c-85ec-158d79892bad tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:00.411129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b4e-0698-4f2c-85ec-158d79892bad tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:00.412747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b4e-0698-4f2c-85ec-158d79892bad tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:00.414453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b4e-0698-4f2c-85ec-158d79892bad tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:00.416514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b4e-0698-4f2c-85ec-158d79892bad tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:00.418411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6a7b4e-0698-4f2c-85ec-158d79892bad tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:00.685852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8b6a7b4e-0698-4f2c-85ec-158d79892bad tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:00.700004 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b6a7b4e-0698-4f2c-85ec-158d79892bad tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 0.317991 Oct 05 17:42:00.706378 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1116/2386] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:00 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:00.723300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:00.724294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:00.737483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:00.739423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:00.741564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:00.742593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:00.745039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:00.746872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:00.883530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd32715d-80ec-4de5-bf8a-822e295eda9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:00.904224 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dd32715d-80ec-4de5-bf8a-822e295eda9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.979220 Oct 05 17:42:00.925991 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1271/2387] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:41:59 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:00.942403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-44f945d6-3efc-40c9-89c3-206ab46ac1b2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:00.943419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-44f945d6-3efc-40c9-89c3-206ab46ac1b2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 68fde73d-b536-4d20-888c-3966e7d4ed06] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:00.963167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44f945d6-3efc-40c9-89c3-206ab46ac1b2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:00.964455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44f945d6-3efc-40c9-89c3-206ab46ac1b2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:00.965783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44f945d6-3efc-40c9-89c3-206ab46ac1b2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:00.967070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44f945d6-3efc-40c9-89c3-206ab46ac1b2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:00.971299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44f945d6-3efc-40c9-89c3-206ab46ac1b2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:00.973283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44f945d6-3efc-40c9-89c3-206ab46ac1b2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:01.055559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-44f945d6-3efc-40c9-89c3-206ab46ac1b2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 68fde73d-b536-4d20-888c-3966e7d4ed06] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:42:01.188512 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-44f945d6-3efc-40c9-89c3-206ab46ac1b2 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "DELETE /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06" status: 204 len: 0 microversion: 2.1 time: 0.268091 Oct 05 17:42:01.189704 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1272/2388] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:42:00 2022] DELETE /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:42:01.206639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-559ee8d4-402f-48f7-918e-26a3d3cc5161 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:01.207556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-559ee8d4-402f-48f7-918e-26a3d3cc5161 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:01.222055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-559ee8d4-402f-48f7-918e-26a3d3cc5161 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:01.224002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-559ee8d4-402f-48f7-918e-26a3d3cc5161 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:01.225571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-559ee8d4-402f-48f7-918e-26a3d3cc5161 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:01.226636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-559ee8d4-402f-48f7-918e-26a3d3cc5161 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:01.228715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-559ee8d4-402f-48f7-918e-26a3d3cc5161 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:01.229341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-559ee8d4-402f-48f7-918e-26a3d3cc5161 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:01.282563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-559ee8d4-402f-48f7-918e-26a3d3cc5161 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:42:01.393958 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-559ee8d4-402f-48f7-918e-26a3d3cc5161 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 204 len: 0 microversion: 2.1 time: 0.198666 Oct 05 17:42:01.396643 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1273/2389] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:42:01 2022] DELETE /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:42:01.413282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-918bff61-ffab-46b2-9fd7-703e7e652fa8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:01.415057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-918bff61-ffab-46b2-9fd7-703e7e652fa8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 68fde73d-b536-4d20-888c-3966e7d4ed06] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:01.428977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-918bff61-ffab-46b2-9fd7-703e7e652fa8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:01.433662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-918bff61-ffab-46b2-9fd7-703e7e652fa8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:01.434712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-918bff61-ffab-46b2-9fd7-703e7e652fa8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:01.435829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-918bff61-ffab-46b2-9fd7-703e7e652fa8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:01.437327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-918bff61-ffab-46b2-9fd7-703e7e652fa8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:01.437988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-918bff61-ffab-46b2-9fd7-703e7e652fa8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:01.614673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:01.624603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:01.636581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:01.638219 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-74b25789-35f9-42e3-a368-78cec0a59b8e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1706 microversion: 2.32 time: 0.929874 Oct 05 17:42:01.639024 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1117/2390] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:00 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1706 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:01.732441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f4b1d48e-c5d4-4bb7-96b6-55a9d1d1cff2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:01.733354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f4b1d48e-c5d4-4bb7-96b6-55a9d1d1cff2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:01.743850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b1d48e-c5d4-4bb7-96b6-55a9d1d1cff2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:01.744702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b1d48e-c5d4-4bb7-96b6-55a9d1d1cff2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:01.745372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b1d48e-c5d4-4bb7-96b6-55a9d1d1cff2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:01.746339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b1d48e-c5d4-4bb7-96b6-55a9d1d1cff2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:01.747046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b1d48e-c5d4-4bb7-96b6-55a9d1d1cff2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:01.747700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b1d48e-c5d4-4bb7-96b6-55a9d1d1cff2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:02.253432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-918bff61-ffab-46b2-9fd7-703e7e652fa8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:02.270474 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-918bff61-ffab-46b2-9fd7-703e7e652fa8 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06" status: 200 len: 1510 microversion: 2.1 time: 0.869955 Oct 05 17:42:02.290337 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1274/2391] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:01 2022] GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06 => generated 1510 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:02.312525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42603abb-0063-480f-bf0a-4631fa948c14 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:02.314704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-42603abb-0063-480f-bf0a-4631fa948c14 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:02.324334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42603abb-0063-480f-bf0a-4631fa948c14 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:02.325554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42603abb-0063-480f-bf0a-4631fa948c14 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:02.326005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42603abb-0063-480f-bf0a-4631fa948c14 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:02.326755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42603abb-0063-480f-bf0a-4631fa948c14 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:02.329993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42603abb-0063-480f-bf0a-4631fa948c14 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:02.330965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42603abb-0063-480f-bf0a-4631fa948c14 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:02.460742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f4b1d48e-c5d4-4bb7-96b6-55a9d1d1cff2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:02.475085 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f4b1d48e-c5d4-4bb7-96b6-55a9d1d1cff2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 0.746463 Oct 05 17:42:02.475740 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1118/2392] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:01 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:02.666638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:02.668784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:02.676831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:02.677923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:02.678608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:02.679610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:02.680506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:02.681165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:03.052861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:03.066272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:03.068534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:03.071346 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-89037c26-4f06-4403-a1cf-8a5123be8dd5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1753 microversion: 2.32 time: 0.410084 Oct 05 17:42:03.072311 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1119/2393] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:02 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1753 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:03.108070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-42603abb-0063-480f-bf0a-4631fa948c14 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:03.129042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-42603abb-0063-480f-bf0a-4631fa948c14 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.837348 Oct 05 17:42:03.129660 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1275/2394] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:02 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:03.296422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5da386e7-fc07-4a51-8b54-5ce5b3b444b3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:03.297478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5da386e7-fc07-4a51-8b54-5ce5b3b444b3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 68fde73d-b536-4d20-888c-3966e7d4ed06] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:03.303099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=86 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:03.305428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5da386e7-fc07-4a51-8b54-5ce5b3b444b3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:03.306315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5da386e7-fc07-4a51-8b54-5ce5b3b444b3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:03.307483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5da386e7-fc07-4a51-8b54-5ce5b3b444b3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:03.308847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5da386e7-fc07-4a51-8b54-5ce5b3b444b3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:03.309725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5da386e7-fc07-4a51-8b54-5ce5b3b444b3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:03.310485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5da386e7-fc07-4a51-8b54-5ce5b3b444b3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:03.499746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1d8d2918-c538-4c13-aefd-a6e79d52b380 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:03.501874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1d8d2918-c538-4c13-aefd-a6e79d52b380 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:03.511155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d8d2918-c538-4c13-aefd-a6e79d52b380 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:03.512014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d8d2918-c538-4c13-aefd-a6e79d52b380 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:03.512685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d8d2918-c538-4c13-aefd-a6e79d52b380 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:03.513716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d8d2918-c538-4c13-aefd-a6e79d52b380 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:03.514181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d8d2918-c538-4c13-aefd-a6e79d52b380 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:03.514677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d8d2918-c538-4c13-aefd-a6e79d52b380 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:03.777816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5da386e7-fc07-4a51-8b54-5ce5b3b444b3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:03.781184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:03.801040 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5da386e7-fc07-4a51-8b54-5ce5b3b444b3 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06" status: 200 len: 1510 microversion: 2.1 time: 0.506592 Oct 05 17:42:03.802879 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1120/2395] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:03 2022] GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06 => generated 1510 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:04.105709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:04.106866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:04.131957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:04.137527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:04.138123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:04.147571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:04.148109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:04.148565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:04.526002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d8d2918-c538-4c13-aefd-a6e79d52b380 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:04.543732 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1d8d2918-c538-4c13-aefd-a6e79d52b380 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 1.047081 Oct 05 17:42:04.545726 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1276/2396] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:03 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:04.570007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-08947bd0-3023-498e-883f-530cab174ad1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:04.572249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-08947bd0-3023-498e-883f-530cab174ad1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:04.627463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08947bd0-3023-498e-883f-530cab174ad1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:04.633854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08947bd0-3023-498e-883f-530cab174ad1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:04.637999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08947bd0-3023-498e-883f-530cab174ad1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:04.638843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08947bd0-3023-498e-883f-530cab174ad1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:04.642884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08947bd0-3023-498e-883f-530cab174ad1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:04.643070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08947bd0-3023-498e-883f-530cab174ad1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:04.802107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:04.817519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:04.834423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:04.835949 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-980737cc-6d1a-49f1-aa33-76b376b9070c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1800 microversion: 2.32 time: 0.738973 Oct 05 17:42:04.839559 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1121/2397] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:04 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1800 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:04.844883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b2c51fc4-a5f3-4eb2-8405-0fe011b341ba req-287f036b-3963-42f7-ba5e-44c51772e421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68fde73d-b536-4d20-888c-3966e7d4ed06", "name": "network-vif-deleted", "tag": "ae705199-ad4f-4fae-9d62-e55f3f2bfeb3"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:04.876791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b2c51fc4-a5f3-4eb2-8405-0fe011b341ba req-287f036b-3963-42f7-ba5e-44c51772e421 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:04.877394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b2c51fc4-a5f3-4eb2-8405-0fe011b341ba req-287f036b-3963-42f7-ba5e-44c51772e421 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:04.878986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b2c51fc4-a5f3-4eb2-8405-0fe011b341ba req-287f036b-3963-42f7-ba5e-44c51772e421 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:04.910177 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b2c51fc4-a5f3-4eb2-8405-0fe011b341ba req-287f036b-3963-42f7-ba5e-44c51772e421 service nova] Creating event network-vif-deleted:ae705199-ad4f-4fae-9d62-e55f3f2bfeb3 for instance 68fde73d-b536-4d20-888c-3966e7d4ed06 on n-h1-835595-3 Oct 05 17:42:04.918993 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b2c51fc4-a5f3-4eb2-8405-0fe011b341ba req-287f036b-3963-42f7-ba5e-44c51772e421 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077631 Oct 05 17:42:04.922241 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1122/2398] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:04.927808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:04.950858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 68fde73d-b536-4d20-888c-3966e7d4ed06] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:04.980898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:04.982652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:04.985296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:04.989248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:04.990003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:04.993315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:05.079709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:05.080332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:05.081007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:05.082536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lazy-loading 'fault' on Instance uuid 68fde73d-b536-4d20-888c-3966e7d4ed06 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:42:05.204790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:05.219618 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ecc6ff30-4506-49e5-ab11-1ea5efd13640 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06" status: 200 len: 1307 microversion: 2.1 time: 0.291012 Oct 05 17:42:05.222608 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1123/2399] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:04 2022] GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06 => generated 1307 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:05.586188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-02361673-174e-45a9-afec-4644026b4192 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:05.589745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-02361673-174e-45a9-afec-4644026b4192 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:05.604874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02361673-174e-45a9-afec-4644026b4192 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:05.605775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02361673-174e-45a9-afec-4644026b4192 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:05.608636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02361673-174e-45a9-afec-4644026b4192 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:05.612590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02361673-174e-45a9-afec-4644026b4192 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:05.615973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02361673-174e-45a9-afec-4644026b4192 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:05.617550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02361673-174e-45a9-afec-4644026b4192 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:05.770613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-08947bd0-3023-498e-883f-530cab174ad1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:05.784148 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-08947bd0-3023-498e-883f-530cab174ad1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 1.234886 Oct 05 17:42:05.798303 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1277/2400] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:04 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:05.872996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:05.876479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:05.900066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:05.904531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:05.905444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:05.907145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:05.908034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:05.909293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:05.977054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-02361673-174e-45a9-afec-4644026b4192 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:05.994711 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-02361673-174e-45a9-afec-4644026b4192 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 0.420563 Oct 05 17:42:05.996021 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1124/2401] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:05 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:06.246594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:06.247281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 68fde73d-b536-4d20-888c-3966e7d4ed06] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:06.274216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:06.284444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:06.285721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:06.292680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:06.298661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:06.299192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:06.355775 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] HTTP exception thrown: Instance 68fde73d-b536-4d20-888c-3966e7d4ed06 could not be found. Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Request method failure captured: Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06 HTTP/1.1 Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGkG0NEKMIXDs3JwzkYVvYc9LFnvI5am2fODNN1U8qvzKmcJrAXj_FPSJgODWSB99PMxeIrrmIW5kd1jmWwmP4QmmTh22R1B-3j6ecv6BuFmey3pkBcEOB1C_fmOhaH4LExzjuS6e98lE1D0F35fo3bPFh0rwJXVOI8JOnNeR_7elw Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 3db359a59df94c21a7d7a20e09c33ab6 Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-MultipleCreateTestJSON-1522866671 Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3db359a59df94c21a7d7a20e09c33ab6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3db359a59df94c21a7d7a20e09c33ab6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3db359a59df94c21a7d7a20e09c33ab6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3db359a59df94c21a7d7a20e09c33ab6"}]}] Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-MultipleCreateTestJSON-1522866671 Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 3db359a59df94c21a7d7a20e09c33ab6 Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1522866671 Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-MultipleCreateTestJSON-1522866671-project Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: baf989c93eb94cf39ee90431703ec185 Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-MultipleCreateTestJSON-1522866671-project Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 68fde73d-b536-4d20-888c-3966e7d4ed06 could not be found. Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '68fde73d-b536-4d20-888c-3966e7d4ed06'} Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68fde73d-b536-4d20-888c-3966e7d4ed06 could not be found. Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68fde73d-b536-4d20-888c-3966e7d4ed06 could not be found. Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:06.359290 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:06.364156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:06.364156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:06.364156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:06.364156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:42:06.364156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:42:06.364156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68fde73d-b536-4d20-888c-3966e7d4ed06 could not be found. Oct 05 17:42:06.364156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:06.366915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Returning 404 to user: Instance 68fde73d-b536-4d20-888c-3966e7d4ed06 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:42:06.368699 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8f4587e-7780-49b6-ab18-5f1b4b75087c tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06" status: 404 len: 111 microversion: 2.1 time: 0.127404 Oct 05 17:42:06.372697 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1125/2402] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:06 2022] GET /compute/v2.1/servers/68fde73d-b536-4d20-888c-3966e7d4ed06 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:42:06.385420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:06.387093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:06.400329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:06.404737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:06.405469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:06.406461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:06.408113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:06.408745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:06.462407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:06.463773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:06.464366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:06.464967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lazy-loading 'fault' on Instance uuid 5b3ebe68-038e-4369-8fc2-4edb36eab3fd {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:42:06.560048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf989c93eb94cf39ee90431703ec185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3db359a59df94c21a7d7a20e09c33ab6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:06.571054 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e325194d-a967-46dd-84ab-c12f86a41a81 tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 200 len: 1307 microversion: 2.1 time: 0.190370 Oct 05 17:42:06.572897 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1126/2403] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:06 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 1307 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:06.659800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:06.677385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:06.679528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:06.681057 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-934e2ac2-07a1-49af-bccc-d95536fcbebe tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1800 microversion: 2.32 time: 0.815899 Oct 05 17:42:06.691116 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1278/2404] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:05 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1800 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:06.809192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ece2f43-b7e6-4510-a85a-763675f31e22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:06.809813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6ece2f43-b7e6-4510-a85a-763675f31e22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:06.822645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ece2f43-b7e6-4510-a85a-763675f31e22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:06.823558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ece2f43-b7e6-4510-a85a-763675f31e22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:06.824272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ece2f43-b7e6-4510-a85a-763675f31e22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:06.825020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ece2f43-b7e6-4510-a85a-763675f31e22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:06.833101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ece2f43-b7e6-4510-a85a-763675f31e22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:06.833718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ece2f43-b7e6-4510-a85a-763675f31e22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:07.008276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-aaf249cd-685e-4403-ab71-bfd0a3b37904 req-6a9053a5-6b6c-496d-965a-8fa80cecaaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b3ebe68-038e-4369-8fc2-4edb36eab3fd", "name": "network-vif-deleted", "tag": "b9c4193f-bd45-40b4-aaee-609b8fc0ebaf"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:07.029970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aaf249cd-685e-4403-ab71-bfd0a3b37904 req-6a9053a5-6b6c-496d-965a-8fa80cecaaab service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:07.030528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aaf249cd-685e-4403-ab71-bfd0a3b37904 req-6a9053a5-6b6c-496d-965a-8fa80cecaaab service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:07.030940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aaf249cd-685e-4403-ab71-bfd0a3b37904 req-6a9053a5-6b6c-496d-965a-8fa80cecaaab service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:07.073397 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-aaf249cd-685e-4403-ab71-bfd0a3b37904 req-6a9053a5-6b6c-496d-965a-8fa80cecaaab service nova] Creating event network-vif-deleted:b9c4193f-bd45-40b4-aaee-609b8fc0ebaf for instance 5b3ebe68-038e-4369-8fc2-4edb36eab3fd on n-h2-835595-3 Oct 05 17:42:07.078731 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-aaf249cd-685e-4403-ab71-bfd0a3b37904 req-6a9053a5-6b6c-496d-965a-8fa80cecaaab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074608 Oct 05 17:42:07.079816 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1279/2405] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:42:07.093067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-91975193-6f26-47a5-89a9-860b025971ec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:07.093789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-91975193-6f26-47a5-89a9-860b025971ec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:07.113283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91975193-6f26-47a5-89a9-860b025971ec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:07.113782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91975193-6f26-47a5-89a9-860b025971ec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:07.114228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91975193-6f26-47a5-89a9-860b025971ec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:07.114991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91975193-6f26-47a5-89a9-860b025971ec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:07.115456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91975193-6f26-47a5-89a9-860b025971ec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:07.115892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91975193-6f26-47a5-89a9-860b025971ec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:07.501041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6ece2f43-b7e6-4510-a85a-763675f31e22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:07.510560 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6ece2f43-b7e6-4510-a85a-763675f31e22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.705068 Oct 05 17:42:07.511397 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1127/2406] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:06 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:07.598249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:07.600652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] [instance: 5b3ebe68-038e-4369-8fc2-4edb36eab3fd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:07.621592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:07.623773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:07.624533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:07.627793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:07.630093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:07.631363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:07.665022 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] HTTP exception thrown: Instance 5b3ebe68-038e-4369-8fc2-4edb36eab3fd could not be found. Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Request method failure captured: Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd HTTP/1.1 Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGkG0NEKMIXDs3JwzkYVvYc9LFnvI5am2fODNN1U8qvzKmcJrAXj_FPSJgODWSB99PMxeIrrmIW5kd1jmWwmP4QmmTh22R1B-3j6ecv6BuFmey3pkBcEOB1C_fmOhaH4LExzjuS6e98lE1D0F35fo3bPFh0rwJXVOI8JOnNeR_7elw Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 3db359a59df94c21a7d7a20e09c33ab6 Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-MultipleCreateTestJSON-1522866671 Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3db359a59df94c21a7d7a20e09c33ab6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3db359a59df94c21a7d7a20e09c33ab6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3db359a59df94c21a7d7a20e09c33ab6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3db359a59df94c21a7d7a20e09c33ab6"}]}] Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-MultipleCreateTestJSON-1522866671 Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 3db359a59df94c21a7d7a20e09c33ab6 Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1522866671 Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-MultipleCreateTestJSON-1522866671-project Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: baf989c93eb94cf39ee90431703ec185 Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-MultipleCreateTestJSON-1522866671-project Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 5b3ebe68-038e-4369-8fc2-4edb36eab3fd could not be found. Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '5b3ebe68-038e-4369-8fc2-4edb36eab3fd'} Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b3ebe68-038e-4369-8fc2-4edb36eab3fd could not be found. Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b3ebe68-038e-4369-8fc2-4edb36eab3fd could not be found. Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:07.669442 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:07.677174 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:07.677174 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:07.677174 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:07.677174 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:42:07.677174 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:42:07.677174 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b3ebe68-038e-4369-8fc2-4edb36eab3fd could not be found. Oct 05 17:42:07.677174 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:07.679676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] Returning 404 to user: Instance 5b3ebe68-038e-4369-8fc2-4edb36eab3fd could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:42:07.680851 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a743db12-96de-4736-bfc8-f8cc03ff2b1e tempest-MultipleCreateTestJSON-1522866671 tempest-MultipleCreateTestJSON-1522866671-project] 10.222.0.70 "GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd" status: 404 len: 111 microversion: 2.1 time: 0.088896 Oct 05 17:42:07.682136 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1128/2407] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:07 2022] GET /compute/v2.1/servers/5b3ebe68-038e-4369-8fc2-4edb36eab3fd => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:42:07.717281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:07.718155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:07.727474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:07.734634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:07.735099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:07.735868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:07.740017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:07.740696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:08.367356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-91975193-6f26-47a5-89a9-860b025971ec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:08.370772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:08.380325 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-91975193-6f26-47a5-89a9-860b025971ec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 1.299158 Oct 05 17:42:08.389984 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1280/2408] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:07 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:08.405077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1702836166", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "0d0e55fe-0222-419d-a8cc-d2c66764157f"}, {"uuid": "6d50c4c8-23aa-4535-9899-ea8e323b2a23"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:08.534741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] validate_networks() for [('0d0e55fe-0222-419d-a8cc-d2c66764157f', None, None, None, None, None), ('6d50c4c8-23aa-4535-9899-ea8e323b2a23', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:42:08.570201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:08.586447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:08.591053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:08.592532 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a4b1028-6d73-496b-8c4c-5b5c6918a5c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1800 microversion: 2.32 time: 0.879329 Oct 05 17:42:08.595477 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1129/2409] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:07 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1800 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:42:08.611666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aaaa267c-15bc-4bda-b97f-8861cec55de8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:08.612289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aaaa267c-15bc-4bda-b97f-8861cec55de8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:08.628348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaaa267c-15bc-4bda-b97f-8861cec55de8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:08.628863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaaa267c-15bc-4bda-b97f-8861cec55de8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:08.629306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaaa267c-15bc-4bda-b97f-8861cec55de8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:08.630025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaaa267c-15bc-4bda-b97f-8861cec55de8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:08.635024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaaa267c-15bc-4bda-b97f-8861cec55de8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:08.648968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aaaa267c-15bc-4bda-b97f-8861cec55de8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:09.091715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aaaa267c-15bc-4bda-b97f-8861cec55de8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:09.102386 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aaaa267c-15bc-4bda-b97f-8861cec55de8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.505783 Oct 05 17:42:09.102979 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1130/2410] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:08 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:09.416071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-512008fa-6155-4d4a-855d-15bd7fbe5b3f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:09.416713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-512008fa-6155-4d4a-855d-15bd7fbe5b3f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:09.425633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-512008fa-6155-4d4a-855d-15bd7fbe5b3f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:09.426724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-512008fa-6155-4d4a-855d-15bd7fbe5b3f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:09.427348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-512008fa-6155-4d4a-855d-15bd7fbe5b3f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:09.428785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-512008fa-6155-4d4a-855d-15bd7fbe5b3f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:09.429540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-512008fa-6155-4d4a-855d-15bd7fbe5b3f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:09.430138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-512008fa-6155-4d4a-855d-15bd7fbe5b3f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:10.062952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-512008fa-6155-4d4a-855d-15bd7fbe5b3f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:10.074630 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-512008fa-6155-4d4a-855d-15bd7fbe5b3f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 0.662442 Oct 05 17:42:10.075697 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1131/2411] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:09 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:42:10.081056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:10.082614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:10.105825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:10.107160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:10.110382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:10.111214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:10.111762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:10.112314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:10.768597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:10.791037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:10.792915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:10.795249 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2dd26c25-3305-4cb1-9d7d-8b96e770de03 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1800 microversion: 2.32 time: 0.718365 Oct 05 17:42:10.796564 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1132/2412] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:10 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1800 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:10.802376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-919bd976-ad24-47d2-953a-669aa0bf7b4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:10.807827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-919bd976-ad24-47d2-953a-669aa0bf7b4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:10.830814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-919bd976-ad24-47d2-953a-669aa0bf7b4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:10.832276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-919bd976-ad24-47d2-953a-669aa0bf7b4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:10.839431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-919bd976-ad24-47d2-953a-669aa0bf7b4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:10.840285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-919bd976-ad24-47d2-953a-669aa0bf7b4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:10.840768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-919bd976-ad24-47d2-953a-669aa0bf7b4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:10.841203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-919bd976-ad24-47d2-953a-669aa0bf7b4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:11.901885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:42:11.903075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:42:11.903715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:42:11.904293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:42:11.904964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:42:11.936179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:11.936680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:11.945941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:11.952073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:11.952822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:11.954901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:12.028951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Getting quotas for project 8ac9093ae0534edb92b2e2b007c8926a. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:42:12.042810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Getting quotas for user 6aa6b735fc434e23b04a45979eeadafb and project 8ac9093ae0534edb92b2e2b007c8926a. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:42:12.081883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:42:12.090220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:42:12.123168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-919bd976-ad24-47d2-953a-669aa0bf7b4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:12.155798 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-919bd976-ad24-47d2-953a-669aa0bf7b4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 1.348010 Oct 05 17:42:12.157446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:12.171782 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1133/2413] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:10 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:12.193505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4449ae1f-405a-45e7-8e26-c82c2dc301a0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:12.197088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4449ae1f-405a-45e7-8e26-c82c2dc301a0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:12.246615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4449ae1f-405a-45e7-8e26-c82c2dc301a0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:12.250952 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1484f517-07cb-4882-a6a5-c938761d0288 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.858629 Oct 05 17:42:12.251848 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1281/2414] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:42:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:42:12.252555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4449ae1f-405a-45e7-8e26-c82c2dc301a0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:12.253026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4449ae1f-405a-45e7-8e26-c82c2dc301a0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:12.255951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4449ae1f-405a-45e7-8e26-c82c2dc301a0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:12.256439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4449ae1f-405a-45e7-8e26-c82c2dc301a0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:12.256878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4449ae1f-405a-45e7-8e26-c82c2dc301a0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:12.275777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:12.276410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:12.313384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:12.314107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:12.317822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:12.318998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:12.322774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:12.323468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:13.113340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:13.123620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:13.125281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:13.127139 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ea2d4cf8-342d-4e7f-ae33-1fffbb6d25f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1847 microversion: 2.32 time: 0.872941 Oct 05 17:42:13.138476 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1282/2415] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:12 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1847 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:13.138476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-078b3afd-3d3c-47d7-8e35-3357adbc758c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:13.138476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-078b3afd-3d3c-47d7-8e35-3357adbc758c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:13.327871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4449ae1f-405a-45e7-8e26-c82c2dc301a0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:13.338251 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4449ae1f-405a-45e7-8e26-c82c2dc301a0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 1.159863 Oct 05 17:42:13.340177 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1134/2416] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:12 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:13.359867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0acc3904-bf90-4301-8acb-3b4c09313f6a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:13.373437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-078b3afd-3d3c-47d7-8e35-3357adbc758c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:13.396727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0acc3904-bf90-4301-8acb-3b4c09313f6a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:13.399404 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-078b3afd-3d3c-47d7-8e35-3357adbc758c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1213 microversion: 2.1 time: 0.270026 Oct 05 17:42:13.414858 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1283/2417] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:13 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1213 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:13.477704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0acc3904-bf90-4301-8acb-3b4c09313f6a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:13.479758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0acc3904-bf90-4301-8acb-3b4c09313f6a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:13.481107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0acc3904-bf90-4301-8acb-3b4c09313f6a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:13.482056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0acc3904-bf90-4301-8acb-3b4c09313f6a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:13.482751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0acc3904-bf90-4301-8acb-3b4c09313f6a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:13.483356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0acc3904-bf90-4301-8acb-3b4c09313f6a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:14.154165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:14.154817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:14.177920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:14.178712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:14.179569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:14.179924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:14.187205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:14.187631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:14.424419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0acc3904-bf90-4301-8acb-3b4c09313f6a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:14.438553 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0acc3904-bf90-4301-8acb-3b4c09313f6a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1655 microversion: 2.1 time: 1.097206 Oct 05 17:42:14.439477 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1135/2418] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:13 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1655 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:14.445958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48a10b46-8746-4233-9151-01ee460cc756 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:14.453419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48a10b46-8746-4233-9151-01ee460cc756 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:14.487145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48a10b46-8746-4233-9151-01ee460cc756 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:14.488732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48a10b46-8746-4233-9151-01ee460cc756 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:14.493652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48a10b46-8746-4233-9151-01ee460cc756 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:14.504690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48a10b46-8746-4233-9151-01ee460cc756 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:14.505565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48a10b46-8746-4233-9151-01ee460cc756 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:14.509921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48a10b46-8746-4233-9151-01ee460cc756 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:14.804525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:14.825181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:14.826654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:14.827865 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-469a1b30-fba7-430b-bf67-dc37c27b8c63 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1847 microversion: 2.32 time: 0.678802 Oct 05 17:42:14.828454 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1284/2419] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:14 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1847 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:14.866479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-52b98883-1494-4764-8ec0-8c09fc355042 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:14.871498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-52b98883-1494-4764-8ec0-8c09fc355042 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:14.889195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52b98883-1494-4764-8ec0-8c09fc355042 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:14.889753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52b98883-1494-4764-8ec0-8c09fc355042 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:14.890744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52b98883-1494-4764-8ec0-8c09fc355042 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:14.891656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52b98883-1494-4764-8ec0-8c09fc355042 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:14.892582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52b98883-1494-4764-8ec0-8c09fc355042 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:14.893038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52b98883-1494-4764-8ec0-8c09fc355042 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:15.092650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-52b98883-1494-4764-8ec0-8c09fc355042 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:15.107249 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-52b98883-1494-4764-8ec0-8c09fc355042 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1271 microversion: 2.1 time: 0.255261 Oct 05 17:42:15.108407 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1285/2420] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:14 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:15.119761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9edfd7ed-3158-4f1f-9f21-9a4a9b996dfa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:15.139973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9edfd7ed-3158-4f1f-9f21-9a4a9b996dfa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:15.140800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9edfd7ed-3158-4f1f-9f21-9a4a9b996dfa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:15.143227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9edfd7ed-3158-4f1f-9f21-9a4a9b996dfa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:15.198306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9edfd7ed-3158-4f1f-9f21-9a4a9b996dfa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Going to try to start instance {{(pid=128844) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 17:42:15.286522 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9edfd7ed-3158-4f1f-9f21-9a4a9b996dfa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.173177 Oct 05 17:42:15.287487 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1286/2421] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:42:15 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:42:15.597081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48a10b46-8746-4233-9151-01ee460cc756 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:15.623169 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48a10b46-8746-4233-9151-01ee460cc756 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 1.182427 Oct 05 17:42:15.625613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-0a1f4ce1-bec8-4934-984e-b93c64bbbaf3 req-cf730494-53a7-4b0f-95f8-e6c2574aa7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "tag": "4d785381-e8e2-468c-b43f-da00a289173d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:15.638403 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1136/2422] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:14 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:15.640804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0a1f4ce1-bec8-4934-984e-b93c64bbbaf3 req-cf730494-53a7-4b0f-95f8-e6c2574aa7d3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:15.641577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0a1f4ce1-bec8-4934-984e-b93c64bbbaf3 req-cf730494-53a7-4b0f-95f8-e6c2574aa7d3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:15.642579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0a1f4ce1-bec8-4934-984e-b93c64bbbaf3 req-cf730494-53a7-4b0f-95f8-e6c2574aa7d3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:15.643360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c0828f5-74a0-43a5-b354-e8ba0f8edffa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:15.659066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0c0828f5-74a0-43a5-b354-e8ba0f8edffa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:15.660861 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-0a1f4ce1-bec8-4934-984e-b93c64bbbaf3 req-cf730494-53a7-4b0f-95f8-e6c2574aa7d3 service nova] Creating event network-changed:4d785381-e8e2-468c-b43f-da00a289173d for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:42:15.665410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c0828f5-74a0-43a5-b354-e8ba0f8edffa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:15.665951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c0828f5-74a0-43a5-b354-e8ba0f8edffa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:15.666418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c0828f5-74a0-43a5-b354-e8ba0f8edffa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:15.667848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-0a1f4ce1-bec8-4934-984e-b93c64bbbaf3 req-cf730494-53a7-4b0f-95f8-e6c2574aa7d3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.378670 Oct 05 17:42:15.668241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c0828f5-74a0-43a5-b354-e8ba0f8edffa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:15.668869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c0828f5-74a0-43a5-b354-e8ba0f8edffa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:15.669177 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1287/2423] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:15.669699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c0828f5-74a0-43a5-b354-e8ba0f8edffa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:15.863670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:15.864482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:15.890123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:15.890842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:15.891218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:15.892139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:15.892427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:15.892859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:16.458353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:16.475164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:16.480523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:16.482602 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1f12531e-4a2a-4063-8021-f6865b745f0b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1868 microversion: 2.32 time: 0.629080 Oct 05 17:42:16.498307 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1288/2424] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:15 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1868 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:16.505591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3da0c76-01ab-4542-8adc-c1641489708e tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:16.507899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c3da0c76-01ab-4542-8adc-c1641489708e tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:16.524211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3da0c76-01ab-4542-8adc-c1641489708e tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:16.529017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3da0c76-01ab-4542-8adc-c1641489708e tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:16.529182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3da0c76-01ab-4542-8adc-c1641489708e tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:16.530252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3da0c76-01ab-4542-8adc-c1641489708e tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:16.532018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3da0c76-01ab-4542-8adc-c1641489708e tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:16.539146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3da0c76-01ab-4542-8adc-c1641489708e tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:16.634577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c3da0c76-01ab-4542-8adc-c1641489708e tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:16.644390 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3da0c76-01ab-4542-8adc-c1641489708e tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1271 microversion: 2.1 time: 0.156123 Oct 05 17:42:16.646570 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1289/2425] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:16 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:16.663995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-575cb176-fc6b-4030-9025-bbd484edd133 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:16.664732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-575cb176-fc6b-4030-9025-bbd484edd133 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:16.683730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575cb176-fc6b-4030-9025-bbd484edd133 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:16.684310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575cb176-fc6b-4030-9025-bbd484edd133 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:16.684847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575cb176-fc6b-4030-9025-bbd484edd133 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:16.685747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575cb176-fc6b-4030-9025-bbd484edd133 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:16.686343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575cb176-fc6b-4030-9025-bbd484edd133 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:16.686872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-575cb176-fc6b-4030-9025-bbd484edd133 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:17.630421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-575cb176-fc6b-4030-9025-bbd484edd133 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:17.640789 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-575cb176-fc6b-4030-9025-bbd484edd133 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 0.981181 Oct 05 17:42:17.643704 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1290/2426] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:16 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:17.662209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:17.663112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:17.669477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:17.669995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:17.670465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:17.671170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:17.671630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:17.672058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:17.990858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0c0828f5-74a0-43a5-b354-e8ba0f8edffa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:18.001186 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c0828f5-74a0-43a5-b354-e8ba0f8edffa tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1664 microversion: 2.1 time: 2.361447 Oct 05 17:42:18.010243 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1137/2427] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:15 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1664 bytes in 2371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:18.034244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b2757c2-b6be-40eb-8fc4-680159144603 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:18.035920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b2757c2-b6be-40eb-8fc4-680159144603 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:18.042485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b2757c2-b6be-40eb-8fc4-680159144603 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:18.043282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b2757c2-b6be-40eb-8fc4-680159144603 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:18.043935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b2757c2-b6be-40eb-8fc4-680159144603 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:18.044894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b2757c2-b6be-40eb-8fc4-680159144603 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:18.045567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b2757c2-b6be-40eb-8fc4-680159144603 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:18.046363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b2757c2-b6be-40eb-8fc4-680159144603 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:18.140541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:18.158917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:18.160362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:18.161564 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b36d8c0a-8997-4587-b557-522e0211d3be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1856 microversion: 2.32 time: 0.516743 Oct 05 17:42:18.162542 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1291/2428] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:17 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1856 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:18.167485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c6749eb8-da6f-433a-b911-6cd4ee864c92 req-2167426a-a989-47fb-a6cd-8f0e7919bfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "tag": "d2f0b027-74d5-4d61-87a2-5e76a8d81918"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:18.178084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c6749eb8-da6f-433a-b911-6cd4ee864c92 req-2167426a-a989-47fb-a6cd-8f0e7919bfa4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:18.178820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c6749eb8-da6f-433a-b911-6cd4ee864c92 req-2167426a-a989-47fb-a6cd-8f0e7919bfa4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:18.179252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c6749eb8-da6f-433a-b911-6cd4ee864c92 req-2167426a-a989-47fb-a6cd-8f0e7919bfa4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:18.201903 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c6749eb8-da6f-433a-b911-6cd4ee864c92 req-2167426a-a989-47fb-a6cd-8f0e7919bfa4 service nova] Creating event network-changed:d2f0b027-74d5-4d61-87a2-5e76a8d81918 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:42:18.214789 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c6749eb8-da6f-433a-b911-6cd4ee864c92 req-2167426a-a989-47fb-a6cd-8f0e7919bfa4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050618 Oct 05 17:42:18.216011 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1292/2429] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:18.282399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3b2757c2-b6be-40eb-8fc4-680159144603 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:18.293372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:18.297470 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b2757c2-b6be-40eb-8fc4-680159144603 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1271 microversion: 2.1 time: 0.268415 Oct 05 17:42:18.301055 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1138/2430] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:18 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1271 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:18.665931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d08e17a9-8adf-448a-97f3-43f9a16de6a3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:18.667128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d08e17a9-8adf-448a-97f3-43f9a16de6a3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:18.675830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d08e17a9-8adf-448a-97f3-43f9a16de6a3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:18.676786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d08e17a9-8adf-448a-97f3-43f9a16de6a3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:18.677380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d08e17a9-8adf-448a-97f3-43f9a16de6a3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:18.678242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d08e17a9-8adf-448a-97f3-43f9a16de6a3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:18.678887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d08e17a9-8adf-448a-97f3-43f9a16de6a3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:18.679456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d08e17a9-8adf-448a-97f3-43f9a16de6a3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:19.033590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9ead83e-5112-4180-93f1-59b64ea55160 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:19.035600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c9ead83e-5112-4180-93f1-59b64ea55160 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:19.044198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9ead83e-5112-4180-93f1-59b64ea55160 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:19.045113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9ead83e-5112-4180-93f1-59b64ea55160 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:19.045776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9ead83e-5112-4180-93f1-59b64ea55160 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:19.046772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9ead83e-5112-4180-93f1-59b64ea55160 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:19.047483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9ead83e-5112-4180-93f1-59b64ea55160 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:19.048132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9ead83e-5112-4180-93f1-59b64ea55160 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:19.084408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d08e17a9-8adf-448a-97f3-43f9a16de6a3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:19.097666 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d08e17a9-8adf-448a-97f3-43f9a16de6a3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 0.436248 Oct 05 17:42:19.102247 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1293/2431] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:18 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:19.193211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:19.193959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:19.205503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:19.209662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:19.210235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:19.215990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:19.223012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:19.224018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:19.658507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:19.673554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:19.680282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:19.681905 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78dbd558-2cab-4f01-8e2c-2a08d8663252 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.493657 Oct 05 17:42:19.685292 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1294/2432] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:19 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:19.700065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-feb0a894-c56f-4be8-ae74-d09a7861044c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:19.705835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-feb0a894-c56f-4be8-ae74-d09a7861044c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:19.724274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feb0a894-c56f-4be8-ae74-d09a7861044c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:19.724773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feb0a894-c56f-4be8-ae74-d09a7861044c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:19.725206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feb0a894-c56f-4be8-ae74-d09a7861044c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:19.726124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feb0a894-c56f-4be8-ae74-d09a7861044c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:19.726615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feb0a894-c56f-4be8-ae74-d09a7861044c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:19.727031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feb0a894-c56f-4be8-ae74-d09a7861044c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:19.835855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-feb0a894-c56f-4be8-ae74-d09a7861044c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:19.856873 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-feb0a894-c56f-4be8-ae74-d09a7861044c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1271 microversion: 2.1 time: 0.169915 Oct 05 17:42:19.858077 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1295/2433] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:19 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:20.102632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c9ead83e-5112-4180-93f1-59b64ea55160 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:20.127085 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c9ead83e-5112-4180-93f1-59b64ea55160 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1664 microversion: 2.1 time: 1.097708 Oct 05 17:42:20.127532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c546af1-b443-4b19-9273-50b416cebf18 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:20.128125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3c546af1-b443-4b19-9273-50b416cebf18 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:20.137378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c546af1-b443-4b19-9273-50b416cebf18 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:20.139323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c546af1-b443-4b19-9273-50b416cebf18 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:20.140112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c546af1-b443-4b19-9273-50b416cebf18 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:20.140982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c546af1-b443-4b19-9273-50b416cebf18 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:20.147852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c546af1-b443-4b19-9273-50b416cebf18 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:20.148574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c546af1-b443-4b19-9273-50b416cebf18 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:20.152962 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1139/2434] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:19 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1664 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:42:20.339451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6401a0e8-3e48-480d-8dec-ff26f27c31f9 req-0d892dcb-a699-4c23-b141-531419f530fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "tag": "87c952e0-16df-4553-88a0-a59666c95cf7"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:20.378099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6401a0e8-3e48-480d-8dec-ff26f27c31f9 req-0d892dcb-a699-4c23-b141-531419f530fb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:20.379696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6401a0e8-3e48-480d-8dec-ff26f27c31f9 req-0d892dcb-a699-4c23-b141-531419f530fb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:20.380487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6401a0e8-3e48-480d-8dec-ff26f27c31f9 req-0d892dcb-a699-4c23-b141-531419f530fb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:20.448718 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6401a0e8-3e48-480d-8dec-ff26f27c31f9 req-0d892dcb-a699-4c23-b141-531419f530fb service nova] Creating event network-changed:87c952e0-16df-4553-88a0-a59666c95cf7 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:42:20.465188 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6401a0e8-3e48-480d-8dec-ff26f27c31f9 req-0d892dcb-a699-4c23-b141-531419f530fb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131347 Oct 05 17:42:20.469511 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1140/2435] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:20.719356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:20.720148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:20.736216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:20.736952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:20.746696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:20.748697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:20.751414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:20.752074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:21.344450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3c546af1-b443-4b19-9273-50b416cebf18 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:21.353697 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c546af1-b443-4b19-9273-50b416cebf18 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1497 microversion: 2.1 time: 1.232353 Oct 05 17:42:21.357636 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1296/2436] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:20 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1497 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:21.369503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb4e154b-05c7-4632-ba78-a57858d8d81d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:21.373818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb4e154b-05c7-4632-ba78-a57858d8d81d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:21.386886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4e154b-05c7-4632-ba78-a57858d8d81d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:21.387545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4e154b-05c7-4632-ba78-a57858d8d81d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:21.388095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4e154b-05c7-4632-ba78-a57858d8d81d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:21.390164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4e154b-05c7-4632-ba78-a57858d8d81d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:21.392474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4e154b-05c7-4632-ba78-a57858d8d81d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:21.398029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb4e154b-05c7-4632-ba78-a57858d8d81d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:22.009140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:22.017302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:22.044259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:22.048204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:22.052709 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dc80a1a4-cb78-4e93-8b2b-13e481492dc8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 1.339013 Oct 05 17:42:22.071100 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1141/2437] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:20 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:42:22.084870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dfd32924-f0fb-4347-8e19-77b4de80df6f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:22.087737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dfd32924-f0fb-4347-8e19-77b4de80df6f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:22.107453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dfd32924-f0fb-4347-8e19-77b4de80df6f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:22.108030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dfd32924-f0fb-4347-8e19-77b4de80df6f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:22.109234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dfd32924-f0fb-4347-8e19-77b4de80df6f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:22.111831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dfd32924-f0fb-4347-8e19-77b4de80df6f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:22.113173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dfd32924-f0fb-4347-8e19-77b4de80df6f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:22.113714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dfd32924-f0fb-4347-8e19-77b4de80df6f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:22.380541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fb4e154b-05c7-4632-ba78-a57858d8d81d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:22.398535 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb4e154b-05c7-4632-ba78-a57858d8d81d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1313 microversion: 2.1 time: 1.038974 Oct 05 17:42:22.399508 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1297/2438] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:21 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1313 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:22.422392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fc3f6b71-1085-416b-88f8-fe414c90696d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:22.423246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fc3f6b71-1085-416b-88f8-fe414c90696d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:22.439436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3f6b71-1085-416b-88f8-fe414c90696d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:22.442177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3f6b71-1085-416b-88f8-fe414c90696d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:22.443329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3f6b71-1085-416b-88f8-fe414c90696d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:22.445503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3f6b71-1085-416b-88f8-fe414c90696d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:22.446207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3f6b71-1085-416b-88f8-fe414c90696d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:22.447371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3f6b71-1085-416b-88f8-fe414c90696d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:22.892754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fc3f6b71-1085-416b-88f8-fe414c90696d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:22.927097 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fc3f6b71-1085-416b-88f8-fe414c90696d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 200 len: 1474 microversion: 2.1 time: 0.492307 Oct 05 17:42:22.927097 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1298/2439] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:22 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 1474 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:22.937996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1ce0308-da62-4058-bc0c-185cdb089e6a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-631516249"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:22.940839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f1ce0308-da62-4058-bc0c-185cdb089e6a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:22.948893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1ce0308-da62-4058-bc0c-185cdb089e6a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:22.951907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1ce0308-da62-4058-bc0c-185cdb089e6a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:22.953005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1ce0308-da62-4058-bc0c-185cdb089e6a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:22.953984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1ce0308-da62-4058-bc0c-185cdb089e6a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:22.955939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1ce0308-da62-4058-bc0c-185cdb089e6a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:22.958882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1ce0308-da62-4058-bc0c-185cdb089e6a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:22.988539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:23.127300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dfd32924-f0fb-4347-8e19-77b4de80df6f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:23.143300 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dfd32924-f0fb-4347-8e19-77b4de80df6f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 1.070659 Oct 05 17:42:23.145209 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1142/2440] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:22 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:23.157449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:23.159713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:23.216266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:23.217232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:23.217911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:23.223272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:23.239596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:23.241567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:23.348015 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f1ce0308-da62-4058-bc0c-185cdb089e6a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e/action" status: 202 len: 0 microversion: 2.1 time: 0.413894 Oct 05 17:42:23.356109 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1299/2441] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:42:22 2022] POST /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 17:42:23.364809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1d05870d-8524-4700-9fc1-9d4a23e7430a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:23.365556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1d05870d-8524-4700-9fc1-9d4a23e7430a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:23.377727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d05870d-8524-4700-9fc1-9d4a23e7430a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:23.378663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d05870d-8524-4700-9fc1-9d4a23e7430a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:23.379262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d05870d-8524-4700-9fc1-9d4a23e7430a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:23.380757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d05870d-8524-4700-9fc1-9d4a23e7430a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:23.383067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d05870d-8524-4700-9fc1-9d4a23e7430a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:23.384017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d05870d-8524-4700-9fc1-9d4a23e7430a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:23.385778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:24.049249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:24.081387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:24.082998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:24.084457 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-df100132-4aa5-406d-9988-b6b79a0a66e3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.935912 Oct 05 17:42:24.086112 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1143/2442] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:23 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:24.095059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-861cf407-b097-4b3f-8d63-bedaac0684cc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795d9430>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:24.193332 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-861cf407-b097-4b3f-8d63-bedaac0684cc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.105671 Oct 05 17:42:24.207252 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1144/2443] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:24 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:24.212492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8bdd7c02-7738-4853-a222-cbabb5b9dd58 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:24.213314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8bdd7c02-7738-4853-a222-cbabb5b9dd58 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:24.232595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bdd7c02-7738-4853-a222-cbabb5b9dd58 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:24.234032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bdd7c02-7738-4853-a222-cbabb5b9dd58 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:24.235226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bdd7c02-7738-4853-a222-cbabb5b9dd58 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:24.235913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bdd7c02-7738-4853-a222-cbabb5b9dd58 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:24.236898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bdd7c02-7738-4853-a222-cbabb5b9dd58 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:24.237556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bdd7c02-7738-4853-a222-cbabb5b9dd58 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:24.377090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d05870d-8524-4700-9fc1-9d4a23e7430a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:24.391416 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1d05870d-8524-4700-9fc1-9d4a23e7430a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 1.033191 Oct 05 17:42:24.403575 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1300/2444] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:23 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:24.412010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7b42f506-8a13-499b-8b54-c76c10d2ed09 req-ce9a2e01-5339-432b-9ef8-97fef25d87d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "tag": "d9b12b5b-6e9d-4c88-9bcd-822551970a31"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:24.432917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7b42f506-8a13-499b-8b54-c76c10d2ed09 req-ce9a2e01-5339-432b-9ef8-97fef25d87d7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:24.433428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7b42f506-8a13-499b-8b54-c76c10d2ed09 req-ce9a2e01-5339-432b-9ef8-97fef25d87d7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:24.434374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7b42f506-8a13-499b-8b54-c76c10d2ed09 req-ce9a2e01-5339-432b-9ef8-97fef25d87d7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:24.451727 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7b42f506-8a13-499b-8b54-c76c10d2ed09 req-ce9a2e01-5339-432b-9ef8-97fef25d87d7 service nova] Creating event network-changed:d9b12b5b-6e9d-4c88-9bcd-822551970a31 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:42:24.456980 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7b42f506-8a13-499b-8b54-c76c10d2ed09 req-ce9a2e01-5339-432b-9ef8-97fef25d87d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063001 Oct 05 17:42:24.458235 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1301/2445] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:24.476215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-622f20b9-36df-4ef6-9e99-8b442c400b73 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:24.486222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-622f20b9-36df-4ef6-9e99-8b442c400b73 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:24.494915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f20b9-36df-4ef6-9e99-8b442c400b73 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:24.495614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f20b9-36df-4ef6-9e99-8b442c400b73 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:24.496211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f20b9-36df-4ef6-9e99-8b442c400b73 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:24.497768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f20b9-36df-4ef6-9e99-8b442c400b73 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:24.498632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f20b9-36df-4ef6-9e99-8b442c400b73 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:24.499597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f20b9-36df-4ef6-9e99-8b442c400b73 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:24.573923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-622f20b9-36df-4ef6-9e99-8b442c400b73 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Unlocking {{(pid=128844) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 05 17:42:24.680729 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-622f20b9-36df-4ef6-9e99-8b442c400b73 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.209534 Oct 05 17:42:24.681786 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1302/2446] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:42:24 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:42:24.700981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a733fbc-75c4-40d5-8035-242f830bda76 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:24.702654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4a733fbc-75c4-40d5-8035-242f830bda76 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:24.717184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a733fbc-75c4-40d5-8035-242f830bda76 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:24.719510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a733fbc-75c4-40d5-8035-242f830bda76 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:24.721496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a733fbc-75c4-40d5-8035-242f830bda76 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:24.722351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a733fbc-75c4-40d5-8035-242f830bda76 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:24.723727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a733fbc-75c4-40d5-8035-242f830bda76 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:24.724699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a733fbc-75c4-40d5-8035-242f830bda76 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:25.149966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4a733fbc-75c4-40d5-8035-242f830bda76 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:25.174259 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4a733fbc-75c4-40d5-8035-242f830bda76 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.475664 Oct 05 17:42:25.175261 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1303/2447] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:24 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:25.180496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:25.183035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:25.199134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:25.207008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:25.207786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:25.208873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:25.209645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:25.210248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:25.531877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8bdd7c02-7738-4853-a222-cbabb5b9dd58 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:25.564411 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8bdd7c02-7738-4853-a222-cbabb5b9dd58 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 1.352283 Oct 05 17:42:25.565903 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1145/2448] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:24 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:25.579997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-39bb531e-fa31-40d6-bcf6-b4abb1386fb8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:25.582604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-39bb531e-fa31-40d6-bcf6-b4abb1386fb8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:25.606924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bb531e-fa31-40d6-bcf6-b4abb1386fb8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:25.609046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bb531e-fa31-40d6-bcf6-b4abb1386fb8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:25.609906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bb531e-fa31-40d6-bcf6-b4abb1386fb8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:25.614249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bb531e-fa31-40d6-bcf6-b4abb1386fb8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:25.616504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bb531e-fa31-40d6-bcf6-b4abb1386fb8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:25.619216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bb531e-fa31-40d6-bcf6-b4abb1386fb8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:26.240925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:26.273655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:26.277962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:26.283825 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7aa27e34-ea58-4779-aa20-1dd378cf0c9a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 1.105283 Oct 05 17:42:26.285672 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1304/2449] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:25 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:26.304478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27067459-f51a-4564-ae0e-78158d89d2d9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7774d06790>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:26.352426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-39bb531e-fa31-40d6-bcf6-b4abb1386fb8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:26.371239 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-39bb531e-fa31-40d6-bcf6-b4abb1386fb8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.800158 Oct 05 17:42:26.372370 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1146/2450] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:25 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:26.405846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9cdc806e-b1b7-492d-bdf7-a2684076c2bd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:26.409207 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27067459-f51a-4564-ae0e-78158d89d2d9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.121451 Oct 05 17:42:26.409807 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1305/2451] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:26 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:26.415117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9cdc806e-b1b7-492d-bdf7-a2684076c2bd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:26.426142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc806e-b1b7-492d-bdf7-a2684076c2bd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:26.436050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc806e-b1b7-492d-bdf7-a2684076c2bd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:26.436510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc806e-b1b7-492d-bdf7-a2684076c2bd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:26.437272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc806e-b1b7-492d-bdf7-a2684076c2bd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:26.437736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc806e-b1b7-492d-bdf7-a2684076c2bd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:26.438181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cdc806e-b1b7-492d-bdf7-a2684076c2bd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:26.637026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1714747204", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "5692d339-819d-4921-a90e-ae4420454834"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:26.750474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] validate_networks() for [('5692d339-819d-4921-a90e-ae4420454834', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:42:27.264632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9cdc806e-b1b7-492d-bdf7-a2684076c2bd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:27.278000 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9cdc806e-b1b7-492d-bdf7-a2684076c2bd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.884313 Oct 05 17:42:27.283064 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1147/2452] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:26 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:42:27.293072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-40b5a2f8-b2f4-4736-8a95-5e3eeee8880d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:27.293927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-40b5a2f8-b2f4-4736-8a95-5e3eeee8880d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:27.313018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40b5a2f8-b2f4-4736-8a95-5e3eeee8880d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:27.313556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40b5a2f8-b2f4-4736-8a95-5e3eeee8880d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:27.314001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40b5a2f8-b2f4-4736-8a95-5e3eeee8880d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:27.314763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40b5a2f8-b2f4-4736-8a95-5e3eeee8880d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:27.315224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40b5a2f8-b2f4-4736-8a95-5e3eeee8880d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:27.315702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40b5a2f8-b2f4-4736-8a95-5e3eeee8880d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:28.698503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-40b5a2f8-b2f4-4736-8a95-5e3eeee8880d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:28.714014 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-40b5a2f8-b2f4-4736-8a95-5e3eeee8880d tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 1.429506 Oct 05 17:42:28.715248 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1148/2453] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:27 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:28.723871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd81c75b-6eaf-4dcb-b13c-0541fdf719c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:28.730310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd81c75b-6eaf-4dcb-b13c-0541fdf719c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:28.745798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd81c75b-6eaf-4dcb-b13c-0541fdf719c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:28.749767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd81c75b-6eaf-4dcb-b13c-0541fdf719c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:28.750454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd81c75b-6eaf-4dcb-b13c-0541fdf719c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:28.751396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd81c75b-6eaf-4dcb-b13c-0541fdf719c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:28.752168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd81c75b-6eaf-4dcb-b13c-0541fdf719c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:28.755345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd81c75b-6eaf-4dcb-b13c-0541fdf719c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:28.977123 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fd81c75b-6eaf-4dcb-b13c-0541fdf719c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.254922 Oct 05 17:42:28.981228 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1149/2454] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:42:28 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:42:28.997416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:29.001452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:29.001948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:42:29.002960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:42:29.003640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:42:29.004205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:42:29.004773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:42:29.019974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:29.022484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:29.023763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:29.024732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:29.028006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:29.028693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:29.029342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:29.031272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:29.031871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:29.032736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:29.038202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:29.038870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:29.072316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Getting quotas for project 611cddc6ef94407dba177aea44f5268d. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:42:29.089660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Getting quotas for user fe8df861068f404e90034c993f9e0e45 and project 611cddc6ef94407dba177aea44f5268d. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:42:29.110170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:42:29.124647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:42:29.214034 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-288e7bdf-8a4a-4dcd-86d3-97949bbd4443 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.793313 Oct 05 17:42:29.216713 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1306/2455] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:42:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:42:29.225613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-37e303b5-92fe-48b0-9f93-6ea60b08126a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775341a60>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:29.314772 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-37e303b5-92fe-48b0-9f93-6ea60b08126a tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.095549 Oct 05 17:42:29.317131 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1307/2456] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:29 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:29.331558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8786b539-4d80-4e78-ae12-fa82226c5bfc req-71a17355-f313-4475-a65a-2d7c1939faad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "tag": "dd8de17b-2b96-4926-ad70-b1417782ae0f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:29.369997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8786b539-4d80-4e78-ae12-fa82226c5bfc req-71a17355-f313-4475-a65a-2d7c1939faad service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:29.371937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8786b539-4d80-4e78-ae12-fa82226c5bfc req-71a17355-f313-4475-a65a-2d7c1939faad service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:29.373713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8786b539-4d80-4e78-ae12-fa82226c5bfc req-71a17355-f313-4475-a65a-2d7c1939faad service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:29.414598 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8786b539-4d80-4e78-ae12-fa82226c5bfc req-71a17355-f313-4475-a65a-2d7c1939faad service nova] Creating event network-changed:dd8de17b-2b96-4926-ad70-b1417782ae0f for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:42:29.436572 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8786b539-4d80-4e78-ae12-fa82226c5bfc req-71a17355-f313-4475-a65a-2d7c1939faad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110452 Oct 05 17:42:29.437539 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1308/2457] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:29.444575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c46f8a5-9a76-4fb5-a6b5-a2406263fbd2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:29.456181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c46f8a5-9a76-4fb5-a6b5-a2406263fbd2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:29.475665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c46f8a5-9a76-4fb5-a6b5-a2406263fbd2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:29.476169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c46f8a5-9a76-4fb5-a6b5-a2406263fbd2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:29.478155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c46f8a5-9a76-4fb5-a6b5-a2406263fbd2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:29.479891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c46f8a5-9a76-4fb5-a6b5-a2406263fbd2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:29.480376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c46f8a5-9a76-4fb5-a6b5-a2406263fbd2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:29.480819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c46f8a5-9a76-4fb5-a6b5-a2406263fbd2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:30.003901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9c46f8a5-9a76-4fb5-a6b5-a2406263fbd2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:30.014195 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c46f8a5-9a76-4fb5-a6b5-a2406263fbd2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1653 microversion: 2.1 time: 0.575245 Oct 05 17:42:30.022849 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1309/2458] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:29 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1653 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:30.044144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b48dca2-6d9e-4ac9-ab64-87032566472a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:30.048553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b48dca2-6d9e-4ac9-ab64-87032566472a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:30.392005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b48dca2-6d9e-4ac9-ab64-87032566472a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:30.401804 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b48dca2-6d9e-4ac9-ab64-87032566472a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1225 microversion: 2.1 time: 0.377622 Oct 05 17:42:30.406798 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1310/2459] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:30 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1225 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:30.709426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6e92c2d-a3af-47a1-9cbb-50d8789d8682 tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-354264968", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:30.716071 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c6e92c2d-a3af-47a1-9cbb-50d8789d8682 tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] HTTP exception thrown: min_count must be <= max_count Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6e92c2d-a3af-47a1-9cbb-50d8789d8682 tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Request method failure captured: Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 183 Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcIFkFRrV7bkHqPZZ1nbgzTNUAMddpEZWdKKEQk2cd2WrYwQpH7gb6iCUHEzOIXNryZID1irEfxjgtBotjeYQ0L4KtQrXJxgx9BLlwDxoOaP5E9xiue_dpA63yrQ37UZHOQmABocXOk-yZKIOeWitKkUF1UPABEFi87RBNWvLzzWntE Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 3067cb50f4994d4cb810d66d113a5254 Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3067cb50f4994d4cb810d66d113a5254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3067cb50f4994d4cb810d66d113a5254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3067cb50f4994d4cb810d66d113a5254", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3067cb50f4994d4cb810d66d113a5254"}]}] Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 3067cb50f4994d4cb810d66d113a5254 Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-MultipleCreateNegativeTestJSON-2038518157-project Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fdf054c6777e4237a8f9fd7029147b6f Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2038518157-project Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-354264968", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: exception: min_count must be <= max_count Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-354264968', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 05 17:42:30.721310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:30.727518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6e92c2d-a3af-47a1-9cbb-50d8789d8682 tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Returning 400 to user: min_count must be <= max_count {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:42:30.729814 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c6e92c2d-a3af-47a1-9cbb-50d8789d8682 tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.320199 Oct 05 17:42:30.757334 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1311/2460] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:42:30 2022] POST /compute/v2.1/servers => generated 74 bytes in 340 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:42:30.768580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9539a885-4220-41db-bcb2-505eb1a3ba57 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:30.770684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9539a885-4220-41db-bcb2-505eb1a3ba57 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:30.795365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9539a885-4220-41db-bcb2-505eb1a3ba57 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:30.797890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9539a885-4220-41db-bcb2-505eb1a3ba57 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:30.798574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9539a885-4220-41db-bcb2-505eb1a3ba57 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:30.801208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9539a885-4220-41db-bcb2-505eb1a3ba57 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:30.804545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9539a885-4220-41db-bcb2-505eb1a3ba57 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:30.806468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9539a885-4220-41db-bcb2-505eb1a3ba57 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:30.909129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:30.920446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:30.935549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:30.936816 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c7cc7fd2-1dd7-49a7-89b8-d0db7a156034 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 1.954254 Oct 05 17:42:30.945931 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1150/2461] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:28 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:30.964692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c64d941f-bf6f-49a0-a4e7-5ba6659e869d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:30.970436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c64d941f-bf6f-49a0-a4e7-5ba6659e869d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:31.012099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c64d941f-bf6f-49a0-a4e7-5ba6659e869d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:31.012617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c64d941f-bf6f-49a0-a4e7-5ba6659e869d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:31.020154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c64d941f-bf6f-49a0-a4e7-5ba6659e869d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:31.031794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c64d941f-bf6f-49a0-a4e7-5ba6659e869d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:31.032255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c64d941f-bf6f-49a0-a4e7-5ba6659e869d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:31.033550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c64d941f-bf6f-49a0-a4e7-5ba6659e869d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:31.187156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9539a885-4220-41db-bcb2-505eb1a3ba57 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:31.200482 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9539a885-4220-41db-bcb2-505eb1a3ba57 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.443717 Oct 05 17:42:31.212687 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1312/2462] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:30 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:31.250509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-115bfd2b-3939-4f2f-8aef-456384cbeeb6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775437e50>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:31.287000 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c64d941f-bf6f-49a0-a4e7-5ba6659e869d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.339651 Oct 05 17:42:31.293350 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1151/2463] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:42:30 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:42:31.337916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4bf5b4b9-7f53-4b1f-83c1-259023608dff tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1376232495", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "max_count": 0}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4bf5b4b9-7f53-4b1f-83c1-259023608dff tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Request method failure captured: Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 168 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcIFkFRrV7bkHqPZZ1nbgzTNUAMddpEZWdKKEQk2cd2WrYwQpH7gb6iCUHEzOIXNryZID1irEfxjgtBotjeYQ0L4KtQrXJxgx9BLlwDxoOaP5E9xiue_dpA63yrQ37UZHOQmABocXOk-yZKIOeWitKkUF1UPABEFi87RBNWvLzzWntE Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 3067cb50f4994d4cb810d66d113a5254 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3067cb50f4994d4cb810d66d113a5254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3067cb50f4994d4cb810d66d113a5254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3067cb50f4994d4cb810d66d113a5254", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3067cb50f4994d4cb810d66d113a5254"}]}] Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 3067cb50f4994d4cb810d66d113a5254 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-MultipleCreateNegativeTestJSON-2038518157-project Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: fdf054c6777e4237a8f9fd7029147b6f Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2038518157-project Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1376232495", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "max_count": 0}} Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1376232495', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'max_count': 0}}} Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 0 Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:42:31.358336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 05 17:42:31.364421 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:42:31.368504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4bf5b4b9-7f53-4b1f-83c1-259023608dff tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:42:31.371435 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4bf5b4b9-7f53-4b1f-83c1-259023608dff tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.075016 Oct 05 17:42:31.376631 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1152/2464] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:42:31 2022] POST /compute/v2.1/servers => generated 130 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:42:31.395913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-33a83cf9-76cb-4f7a-b4b9-94fa1d57a7c9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:31.402121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-33a83cf9-76cb-4f7a-b4b9-94fa1d57a7c9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:31.425640 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-115bfd2b-3939-4f2f-8aef-456384cbeeb6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.211365 Oct 05 17:42:31.442268 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1313/2465] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:31 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:31.448380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a83cf9-76cb-4f7a-b4b9-94fa1d57a7c9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:31.452854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a83cf9-76cb-4f7a-b4b9-94fa1d57a7c9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:31.453640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a83cf9-76cb-4f7a-b4b9-94fa1d57a7c9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:31.454718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a83cf9-76cb-4f7a-b4b9-94fa1d57a7c9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:31.455475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a83cf9-76cb-4f7a-b4b9-94fa1d57a7c9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:31.456156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab6df680-6408-4c5e-82e9-337b25f9af01 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:31.456932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a83cf9-76cb-4f7a-b4b9-94fa1d57a7c9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:31.457440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ab6df680-6408-4c5e-82e9-337b25f9af01 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:31.483227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab6df680-6408-4c5e-82e9-337b25f9af01 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:31.488891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab6df680-6408-4c5e-82e9-337b25f9af01 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:31.489360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab6df680-6408-4c5e-82e9-337b25f9af01 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:31.490119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab6df680-6408-4c5e-82e9-337b25f9af01 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:31.490628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab6df680-6408-4c5e-82e9-337b25f9af01 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:31.491063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab6df680-6408-4c5e-82e9-337b25f9af01 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:32.032201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab6df680-6408-4c5e-82e9-337b25f9af01 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:32.045197 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab6df680-6408-4c5e-82e9-337b25f9af01 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1277 microversion: 2.1 time: 0.601011 Oct 05 17:42:32.047881 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1314/2466] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:31 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1277 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:32.236278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-99aceb26-6ac7-40d3-9f5c-cc1e87ce3166 req-f76eead1-c52b-42c7-b820-325465f34f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2c8db2-f243-4f95-8554-5f6456b4f18e", "name": "network-vif-plugged", "status": "completed", "tag": "c45bec95-980b-4f58-b5d6-bc729046e986"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:32.292716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-99aceb26-6ac7-40d3-9f5c-cc1e87ce3166 req-f76eead1-c52b-42c7-b820-325465f34f2c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:32.293530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-99aceb26-6ac7-40d3-9f5c-cc1e87ce3166 req-f76eead1-c52b-42c7-b820-325465f34f2c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:32.294490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-99aceb26-6ac7-40d3-9f5c-cc1e87ce3166 req-f76eead1-c52b-42c7-b820-325465f34f2c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:32.328867 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-99aceb26-6ac7-40d3-9f5c-cc1e87ce3166 req-f76eead1-c52b-42c7-b820-325465f34f2c service nova] Creating event network-vif-plugged:c45bec95-980b-4f58-b5d6-bc729046e986 for instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e on n-h1-835595-3 Oct 05 17:42:32.345878 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-99aceb26-6ac7-40d3-9f5c-cc1e87ce3166 req-f76eead1-c52b-42c7-b820-325465f34f2c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296426 Oct 05 17:42:32.349368 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1315/2467] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:32.356474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-830dd485-526b-4641-bba3-5dfde927dc0c tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1000761040", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "max_count": 2.5}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:32.357699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-33a83cf9-76cb-4f7a-b4b9-94fa1d57a7c9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:32.366424 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-33a83cf9-76cb-4f7a-b4b9-94fa1d57a7c9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1660 microversion: 2.1 time: 0.985755 Oct 05 17:42:32.373779 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1153/2468] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:31 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1660 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-830dd485-526b-4641-bba3-5dfde927dc0c tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Request method failure captured: Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 170 Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcIFkFRrV7bkHqPZZ1nbgzTNUAMddpEZWdKKEQk2cd2WrYwQpH7gb6iCUHEzOIXNryZID1irEfxjgtBotjeYQ0L4KtQrXJxgx9BLlwDxoOaP5E9xiue_dpA63yrQ37UZHOQmABocXOk-yZKIOeWitKkUF1UPABEFi87RBNWvLzzWntE Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 3067cb50f4994d4cb810d66d113a5254 Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3067cb50f4994d4cb810d66d113a5254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3067cb50f4994d4cb810d66d113a5254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3067cb50f4994d4cb810d66d113a5254", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3067cb50f4994d4cb810d66d113a5254"}]}] Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 3067cb50f4994d4cb810d66d113a5254 Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-MultipleCreateNegativeTestJSON-2038518157-project Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fdf054c6777e4237a8f9fd7029147b6f Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2038518157-project Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1000761040", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "max_count": 2.5}} Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1000761040', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'max_count': 2.5}}} Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 2.5 Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:42:32.377017 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 17:42:32.384047 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:32.391048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-830dd485-526b-4641-bba3-5dfde927dc0c tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:42:32.392237 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-830dd485-526b-4641-bba3-5dfde927dc0c tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.041461 Oct 05 17:42:32.393383 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1316/2469] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:42:32 2022] POST /compute/v2.1/servers => generated 139 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:42:32.408034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-734a0db7-4877-4ba0-8091-d98a44b348c1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:32.416510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-734a0db7-4877-4ba0-8091-d98a44b348c1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:32.421348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:32.422873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:32.435610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-734a0db7-4877-4ba0-8091-d98a44b348c1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:32.437544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:32.438324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-734a0db7-4877-4ba0-8091-d98a44b348c1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:32.440002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-734a0db7-4877-4ba0-8091-d98a44b348c1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:32.442357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:32.443808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:32.444129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-734a0db7-4877-4ba0-8091-d98a44b348c1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:32.444823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-734a0db7-4877-4ba0-8091-d98a44b348c1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:32.445801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:32.446538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-734a0db7-4877-4ba0-8091-d98a44b348c1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:32.449599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:32.450218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:33.547747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-734a0db7-4877-4ba0-8091-d98a44b348c1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:33.563196 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-734a0db7-4877-4ba0-8091-d98a44b348c1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 1.168499 Oct 05 17:42:33.564561 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1317/2470] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:32 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:33.582520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d41df5f-7e73-423b-bf97-2ad94d01b111 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777964b3a0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:33.659856 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2d41df5f-7e73-423b-bf97-2ad94d01b111 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.094045 Oct 05 17:42:33.660435 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1318/2471] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:33 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:33.672034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ddf5993-f606-449b-8321-85f0b47a2a40 tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-165537342", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 0}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ddf5993-f606-449b-8321-85f0b47a2a40 tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Request method failure captured: Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 167 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcIFkFRrV7bkHqPZZ1nbgzTNUAMddpEZWdKKEQk2cd2WrYwQpH7gb6iCUHEzOIXNryZID1irEfxjgtBotjeYQ0L4KtQrXJxgx9BLlwDxoOaP5E9xiue_dpA63yrQ37UZHOQmABocXOk-yZKIOeWitKkUF1UPABEFi87RBNWvLzzWntE Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 3067cb50f4994d4cb810d66d113a5254 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3067cb50f4994d4cb810d66d113a5254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3067cb50f4994d4cb810d66d113a5254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3067cb50f4994d4cb810d66d113a5254", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3067cb50f4994d4cb810d66d113a5254"}]}] Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 3067cb50f4994d4cb810d66d113a5254 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-MultipleCreateNegativeTestJSON-2038518157-project Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fdf054c6777e4237a8f9fd7029147b6f Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2038518157-project Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-165537342", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 0}} Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-165537342', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'min_count': 0}}} Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 0 Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:42:33.676097 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ddf5993-f606-449b-8321-85f0b47a2a40 tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7ddf5993-f606-449b-8321-85f0b47a2a40 tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016118 Oct 05 17:42:33.679911 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1319/2472] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:42:33 2022] POST /compute/v2.1/servers => generated 130 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:42:33.690565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:33.696401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-88ae1dab-19ca-4450-9565-14b8e9f81320 req-b83b1e3e-71a5-4462-87bc-eec840d9c75c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80ed110-8f6b-4126-a565-bb874a0de577", "tag": "4c75e5be-d490-4be8-bdbf-b88f7b406cb7"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:33.707352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:33.717271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:33.719012 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e2a9aada-4c43-4815-bd52-b427e9282dbc tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 1.335152 Oct 05 17:42:33.719810 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1154/2473] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:32 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:33.720711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88ae1dab-19ca-4450-9565-14b8e9f81320 req-b83b1e3e-71a5-4462-87bc-eec840d9c75c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:33.721197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88ae1dab-19ca-4450-9565-14b8e9f81320 req-b83b1e3e-71a5-4462-87bc-eec840d9c75c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:33.721626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88ae1dab-19ca-4450-9565-14b8e9f81320 req-b83b1e3e-71a5-4462-87bc-eec840d9c75c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:33.735137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ed956011-f3c1-45d6-bed6-d3edbead40ac req-72a0c58e-218b-4131-94dd-466f10cf917d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "tag": "58505811-eb6b-4527-9362-13751f69bc6e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:33.740684 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-88ae1dab-19ca-4450-9565-14b8e9f81320 req-b83b1e3e-71a5-4462-87bc-eec840d9c75c service nova] Creating event network-changed:4c75e5be-d490-4be8-bdbf-b88f7b406cb7 for instance b80ed110-8f6b-4126-a565-bb874a0de577 on n-h1-835595-3 Oct 05 17:42:33.741746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=70 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:33.747186 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-88ae1dab-19ca-4450-9565-14b8e9f81320 req-b83b1e3e-71a5-4462-87bc-eec840d9c75c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055472 Oct 05 17:42:33.747801 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1320/2474] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:33.760966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-186f2a6c-f5d6-4c4f-9cbf-4afc664b6b03 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:33.767262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-186f2a6c-f5d6-4c4f-9cbf-4afc664b6b03 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:33.770150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ed956011-f3c1-45d6-bed6-d3edbead40ac req-72a0c58e-218b-4131-94dd-466f10cf917d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:33.776221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186f2a6c-f5d6-4c4f-9cbf-4afc664b6b03 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:33.776717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186f2a6c-f5d6-4c4f-9cbf-4afc664b6b03 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:33.777150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186f2a6c-f5d6-4c4f-9cbf-4afc664b6b03 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:33.777851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186f2a6c-f5d6-4c4f-9cbf-4afc664b6b03 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:33.780369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ed956011-f3c1-45d6-bed6-d3edbead40ac req-72a0c58e-218b-4131-94dd-466f10cf917d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:33.780844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ed956011-f3c1-45d6-bed6-d3edbead40ac req-72a0c58e-218b-4131-94dd-466f10cf917d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:33.782903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186f2a6c-f5d6-4c4f-9cbf-4afc664b6b03 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:33.783331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-186f2a6c-f5d6-4c4f-9cbf-4afc664b6b03 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:33.811343 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ed956011-f3c1-45d6-bed6-d3edbead40ac req-72a0c58e-218b-4131-94dd-466f10cf917d service nova] Creating event network-changed:58505811-eb6b-4527-9362-13751f69bc6e for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:42:33.828770 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ed956011-f3c1-45d6-bed6-d3edbead40ac req-72a0c58e-218b-4131-94dd-466f10cf917d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107364 Oct 05 17:42:33.832849 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1155/2475] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:33.845589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0272514a-cdcd-489b-ba3b-2ccabb9937a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:33.848896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0272514a-cdcd-489b-ba3b-2ccabb9937a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:33.869350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0272514a-cdcd-489b-ba3b-2ccabb9937a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:33.871604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0272514a-cdcd-489b-ba3b-2ccabb9937a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:33.873300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0272514a-cdcd-489b-ba3b-2ccabb9937a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:33.874549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0272514a-cdcd-489b-ba3b-2ccabb9937a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:33.876666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0272514a-cdcd-489b-ba3b-2ccabb9937a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:33.877346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0272514a-cdcd-489b-ba3b-2ccabb9937a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:34.033866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-186f2a6c-f5d6-4c4f-9cbf-4afc664b6b03 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:34.049718 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-186f2a6c-f5d6-4c4f-9cbf-4afc664b6b03 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1283 microversion: 2.1 time: 0.295875 Oct 05 17:42:34.050682 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1321/2476] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:33 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1283 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:34.061270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48869ec9-de03-4ce5-8050-5fe20a10b67a tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1116243005", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 2.5}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48869ec9-de03-4ce5-8050-5fe20a10b67a tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Request method failure captured: Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 170 Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcIFkFRrV7bkHqPZZ1nbgzTNUAMddpEZWdKKEQk2cd2WrYwQpH7gb6iCUHEzOIXNryZID1irEfxjgtBotjeYQ0L4KtQrXJxgx9BLlwDxoOaP5E9xiue_dpA63yrQ37UZHOQmABocXOk-yZKIOeWitKkUF1UPABEFi87RBNWvLzzWntE Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 3067cb50f4994d4cb810d66d113a5254 Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/3067cb50f4994d4cb810d66d113a5254"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3067cb50f4994d4cb810d66d113a5254"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_3067cb50f4994d4cb810d66d113a5254", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/3067cb50f4994d4cb810d66d113a5254"}]}] Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 3067cb50f4994d4cb810d66d113a5254 Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-2038518157 Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-MultipleCreateNegativeTestJSON-2038518157-project Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fdf054c6777e4237a8f9fd7029147b6f Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-2038518157-project Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1116243005", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 2.5}} Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1116243005', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'min_count': 2.5}}} Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 2.5 Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:42:34.068239 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48869ec9-de03-4ce5-8050-5fe20a10b67a tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48869ec9-de03-4ce5-8050-5fe20a10b67a tempest-MultipleCreateNegativeTestJSON-2038518157 tempest-MultipleCreateNegativeTestJSON-2038518157-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018579 Oct 05 17:42:34.072292 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1322/2477] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:42:34 2022] POST /compute/v2.1/servers => generated 139 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:42:34.592326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54982ddd-141f-4ad7-b044-4bfd9f80d236 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:34.592999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54982ddd-141f-4ad7-b044-4bfd9f80d236 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:34.610061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54982ddd-141f-4ad7-b044-4bfd9f80d236 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:34.610575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54982ddd-141f-4ad7-b044-4bfd9f80d236 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:34.611185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54982ddd-141f-4ad7-b044-4bfd9f80d236 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:34.612046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54982ddd-141f-4ad7-b044-4bfd9f80d236 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:34.612654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54982ddd-141f-4ad7-b044-4bfd9f80d236 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:34.613523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54982ddd-141f-4ad7-b044-4bfd9f80d236 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:35.080503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0272514a-cdcd-489b-ba3b-2ccabb9937a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:35.082899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:35.092756 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0272514a-cdcd-489b-ba3b-2ccabb9937a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 1.253278 Oct 05 17:42:35.093335 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1156/2478] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:33 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:35.118459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e6b09d8-6e76-4360-8f62-6feab3c1983f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795d9670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:35.199847 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6e6b09d8-6e76-4360-8f62-6feab3c1983f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.099714 Oct 05 17:42:35.202827 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1157/2479] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:35 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:35.210460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:35.226513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:35.279013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:35.279542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:35.280133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:35.280750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:35.281213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:35.281636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:35.911703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54982ddd-141f-4ad7-b044-4bfd9f80d236 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:35.928353 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54982ddd-141f-4ad7-b044-4bfd9f80d236 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 1.341237 Oct 05 17:42:35.930909 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1323/2480] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:34 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:42:35.948980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-10b9bd29-aabb-427e-98a1-8567695aefed tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:35.949960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-10b9bd29-aabb-427e-98a1-8567695aefed tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:35.973518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10b9bd29-aabb-427e-98a1-8567695aefed tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:35.974073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10b9bd29-aabb-427e-98a1-8567695aefed tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:35.974612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10b9bd29-aabb-427e-98a1-8567695aefed tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:35.975561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10b9bd29-aabb-427e-98a1-8567695aefed tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:35.976204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10b9bd29-aabb-427e-98a1-8567695aefed tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:35.976817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10b9bd29-aabb-427e-98a1-8567695aefed tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:36.005907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:36.187276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-10b9bd29-aabb-427e-98a1-8567695aefed tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:36.196307 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-10b9bd29-aabb-427e-98a1-8567695aefed tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1283 microversion: 2.1 time: 0.262572 Oct 05 17:42:36.203379 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1324/2481] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:35 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1283 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:36.207300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:36.215528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3808c592-529f-41ec-acea-95fa8b697e89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:36.216502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3808c592-529f-41ec-acea-95fa8b697e89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:36.229369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3808c592-529f-41ec-acea-95fa8b697e89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:36.229681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:36.237016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3808c592-529f-41ec-acea-95fa8b697e89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:36.237480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3808c592-529f-41ec-acea-95fa8b697e89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:36.238574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3808c592-529f-41ec-acea-95fa8b697e89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:36.238705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:36.239598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3808c592-529f-41ec-acea-95fa8b697e89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:36.239967 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-57507cdc-f470-4d68-b113-d8ac9265b251 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 1.035895 Oct 05 17:42:36.240334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3808c592-529f-41ec-acea-95fa8b697e89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:36.247128 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1158/2482] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:35 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:36.274052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-762816df-986c-4cde-8f2a-cd2f10cb7688 req-dcb95f86-e65f-4162-a6fa-fcf4276dec73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "tag": "8bab3a7f-8718-4960-8440-c090413703a8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:36.285201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-762816df-986c-4cde-8f2a-cd2f10cb7688 req-dcb95f86-e65f-4162-a6fa-fcf4276dec73 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:36.285979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-762816df-986c-4cde-8f2a-cd2f10cb7688 req-dcb95f86-e65f-4162-a6fa-fcf4276dec73 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:36.286699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-762816df-986c-4cde-8f2a-cd2f10cb7688 req-dcb95f86-e65f-4162-a6fa-fcf4276dec73 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:36.300783 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-762816df-986c-4cde-8f2a-cd2f10cb7688 req-dcb95f86-e65f-4162-a6fa-fcf4276dec73 service nova] Creating event network-changed:8bab3a7f-8718-4960-8440-c090413703a8 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:42:36.307070 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-762816df-986c-4cde-8f2a-cd2f10cb7688 req-dcb95f86-e65f-4162-a6fa-fcf4276dec73 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042526 Oct 05 17:42:36.307933 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1159/2483] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:36.315209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4e33a076-f0e8-4abe-b8ee-327ca9b48190 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795af700>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:36.433780 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4e33a076-f0e8-4abe-b8ee-327ca9b48190 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.124341 Oct 05 17:42:36.435031 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1160/2484] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:36 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:36.651950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3808c592-529f-41ec-acea-95fa8b697e89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:36.660956 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3808c592-529f-41ec-acea-95fa8b697e89 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.456095 Oct 05 17:42:36.661555 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1325/2485] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:36 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:36.692221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c62eb9f-31de-4db9-b2a2-c4f452528c2b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:36.692963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c62eb9f-31de-4db9-b2a2-c4f452528c2b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:36.708748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c62eb9f-31de-4db9-b2a2-c4f452528c2b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:36.709604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c62eb9f-31de-4db9-b2a2-c4f452528c2b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:36.711020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c62eb9f-31de-4db9-b2a2-c4f452528c2b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:36.711937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c62eb9f-31de-4db9-b2a2-c4f452528c2b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:36.712438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c62eb9f-31de-4db9-b2a2-c4f452528c2b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:36.713503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c62eb9f-31de-4db9-b2a2-c4f452528c2b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:36.983798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99a75bf1-ea1d-4df1-9eec-028bbe2bde9a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:36.984563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99a75bf1-ea1d-4df1-9eec-028bbe2bde9a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:36.997110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a75bf1-ea1d-4df1-9eec-028bbe2bde9a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:36.997931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a75bf1-ea1d-4df1-9eec-028bbe2bde9a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:37.006836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a75bf1-ea1d-4df1-9eec-028bbe2bde9a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:37.008050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a75bf1-ea1d-4df1-9eec-028bbe2bde9a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:37.012372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a75bf1-ea1d-4df1-9eec-028bbe2bde9a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:37.013126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a75bf1-ea1d-4df1-9eec-028bbe2bde9a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:37.330387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99a75bf1-ea1d-4df1-9eec-028bbe2bde9a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:37.345271 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99a75bf1-ea1d-4df1-9eec-028bbe2bde9a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.390853 Oct 05 17:42:37.345947 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1326/2486] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:36 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:37.354777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-33e9bff1-3f13-4157-b0b1-89b087e6cb20 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:37.355385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-33e9bff1-3f13-4157-b0b1-89b087e6cb20 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:37.375821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33e9bff1-3f13-4157-b0b1-89b087e6cb20 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:37.376775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33e9bff1-3f13-4157-b0b1-89b087e6cb20 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:37.377513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33e9bff1-3f13-4157-b0b1-89b087e6cb20 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:37.378563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33e9bff1-3f13-4157-b0b1-89b087e6cb20 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:37.379420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33e9bff1-3f13-4157-b0b1-89b087e6cb20 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:37.380672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33e9bff1-3f13-4157-b0b1-89b087e6cb20 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:37.915689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-33e9bff1-3f13-4157-b0b1-89b087e6cb20 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:37.927861 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-33e9bff1-3f13-4157-b0b1-89b087e6cb20 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.578921 Oct 05 17:42:37.950310 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1327/2487] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:37 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:37.950310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:37.950310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:37.983455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:37.987081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:37.987765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:37.989518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:37.992082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:37.993946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:38.116944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6c62eb9f-31de-4db9-b2a2-c4f452528c2b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:38.130357 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c62eb9f-31de-4db9-b2a2-c4f452528c2b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 1.443725 Oct 05 17:42:38.134851 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1161/2488] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:36 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:38.145478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4463632d-f083-41a8-95aa-b6d2b8262fa3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795e3dc0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:38.237658 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4463632d-f083-41a8-95aa-b6d2b8262fa3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.101616 Oct 05 17:42:38.238566 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1162/2489] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:38 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:38.253838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d2b57e1f-8df0-4760-999a-bd288adf6d5d req-1105a0e0-d67b-44de-b2e2-1b22df17e122 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b80ed110-8f6b-4126-a565-bb874a0de577", "tag": "de32f0ab-7e10-4e24-8cd1-81209d7dc484"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:38.282677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d2b57e1f-8df0-4760-999a-bd288adf6d5d req-1105a0e0-d67b-44de-b2e2-1b22df17e122 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:38.283195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d2b57e1f-8df0-4760-999a-bd288adf6d5d req-1105a0e0-d67b-44de-b2e2-1b22df17e122 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:38.283713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d2b57e1f-8df0-4760-999a-bd288adf6d5d req-1105a0e0-d67b-44de-b2e2-1b22df17e122 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:38.343272 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d2b57e1f-8df0-4760-999a-bd288adf6d5d req-1105a0e0-d67b-44de-b2e2-1b22df17e122 service nova] Creating event network-changed:de32f0ab-7e10-4e24-8cd1-81209d7dc484 for instance b80ed110-8f6b-4126-a565-bb874a0de577 on n-h1-835595-3 Oct 05 17:42:38.352728 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d2b57e1f-8df0-4760-999a-bd288adf6d5d req-1105a0e0-d67b-44de-b2e2-1b22df17e122 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110244 Oct 05 17:42:38.354447 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1163/2490] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:38.370804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d0ce4eae-3f11-4f9b-8362-78a6b4996c27 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:38.372426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d0ce4eae-3f11-4f9b-8362-78a6b4996c27 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:38.382422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0ce4eae-3f11-4f9b-8362-78a6b4996c27 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:38.383230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0ce4eae-3f11-4f9b-8362-78a6b4996c27 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:38.383873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0ce4eae-3f11-4f9b-8362-78a6b4996c27 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:38.384929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0ce4eae-3f11-4f9b-8362-78a6b4996c27 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:38.385713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0ce4eae-3f11-4f9b-8362-78a6b4996c27 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:38.386347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0ce4eae-3f11-4f9b-8362-78a6b4996c27 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:38.549411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:38.566789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:38.568751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:38.570210 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99631cfb-fe98-4475-b551-b1a2e0281a98 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.626970 Oct 05 17:42:38.572089 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1328/2491] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:37 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:38.581075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ee029306-5f36-4eae-a03c-04690387d602 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:38.581921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ee029306-5f36-4eae-a03c-04690387d602 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:38.592191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:38.593998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee029306-5f36-4eae-a03c-04690387d602 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:38.594726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee029306-5f36-4eae-a03c-04690387d602 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:38.603604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee029306-5f36-4eae-a03c-04690387d602 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:38.607439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee029306-5f36-4eae-a03c-04690387d602 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:38.608158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee029306-5f36-4eae-a03c-04690387d602 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:38.609524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee029306-5f36-4eae-a03c-04690387d602 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:38.995904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ee029306-5f36-4eae-a03c-04690387d602 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:39.006367 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ee029306-5f36-4eae-a03c-04690387d602 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.432977 Oct 05 17:42:39.023238 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1329/2492] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:38 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:39.031776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49eb6d4e-95ac-4da6-affc-746ca7a2172a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:39.032491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-49eb6d4e-95ac-4da6-affc-746ca7a2172a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:39.057248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:39.062541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb6d4e-95ac-4da6-affc-746ca7a2172a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:39.070736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb6d4e-95ac-4da6-affc-746ca7a2172a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:39.071374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb6d4e-95ac-4da6-affc-746ca7a2172a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:39.072975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb6d4e-95ac-4da6-affc-746ca7a2172a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:39.073536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb6d4e-95ac-4da6-affc-746ca7a2172a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:39.074047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb6d4e-95ac-4da6-affc-746ca7a2172a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:39.420710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-49eb6d4e-95ac-4da6-affc-746ca7a2172a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:39.429829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49eb6d4e-95ac-4da6-affc-746ca7a2172a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.405264 Oct 05 17:42:39.430456 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1330/2493] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:39 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:39.454949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1011267b-addd-458d-8a86-13006296def0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7774ee2c10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:39.582359 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1011267b-addd-458d-8a86-13006296def0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.150261 Oct 05 17:42:39.588724 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1331/2494] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:39 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:39.603213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:39.603935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:39.614548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:39.615171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:39.615706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:39.616519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:39.617075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:39.617606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:40.161075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:40.176262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:40.182267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:40.186750 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-af2d30bd-b46c-4115-bb67-ef08cd3cf60b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.587798 Oct 05 17:42:40.195774 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1332/2495] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:39 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:40.214939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5fe8492b-e267-49fa-b47b-3276fa0fb70a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:40.215830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5fe8492b-e267-49fa-b47b-3276fa0fb70a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:40.246321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe8492b-e267-49fa-b47b-3276fa0fb70a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:40.247093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe8492b-e267-49fa-b47b-3276fa0fb70a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:40.250095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe8492b-e267-49fa-b47b-3276fa0fb70a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:40.253137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe8492b-e267-49fa-b47b-3276fa0fb70a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:40.254197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe8492b-e267-49fa-b47b-3276fa0fb70a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:40.254807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe8492b-e267-49fa-b47b-3276fa0fb70a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:40.403206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:40.650226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5fe8492b-e267-49fa-b47b-3276fa0fb70a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:40.662545 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5fe8492b-e267-49fa-b47b-3276fa0fb70a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.463910 Oct 05 17:42:40.668255 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1333/2496] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:40 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:40.673362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1f883f97-99d5-4ba4-b1d2-a32aac4bd27e tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:40.676195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1f883f97-99d5-4ba4-b1d2-a32aac4bd27e tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:40.688159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f883f97-99d5-4ba4-b1d2-a32aac4bd27e tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:40.690861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f883f97-99d5-4ba4-b1d2-a32aac4bd27e tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:40.691479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f883f97-99d5-4ba4-b1d2-a32aac4bd27e tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:40.692389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f883f97-99d5-4ba4-b1d2-a32aac4bd27e tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:40.694803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f883f97-99d5-4ba4-b1d2-a32aac4bd27e tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:40.696681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f883f97-99d5-4ba4-b1d2-a32aac4bd27e tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:40.831655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d0ce4eae-3f11-4f9b-8362-78a6b4996c27 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:40.844642 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d0ce4eae-3f11-4f9b-8362-78a6b4996c27 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 2.486681 Oct 05 17:42:40.849522 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1164/2497] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:38 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:40.862488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c435c8da-661f-4b02-97c8-479117d4bbec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795aa3a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:40.956884 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c435c8da-661f-4b02-97c8-479117d4bbec tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.104671 Oct 05 17:42:40.969013 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1165/2498] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:40 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:41.239380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-535537151", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "0ccfc34d-2c65-4344-9114-4b96b3845d6a"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:41.254764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1f883f97-99d5-4ba4-b1d2-a32aac4bd27e tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:41.271270 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1f883f97-99d5-4ba4-b1d2-a32aac4bd27e tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.599795 Oct 05 17:42:41.284671 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1334/2499] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:40 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:41.297965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-15d91ca4-a4e9-48a4-bbfc-8e4e7410f600 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:41.307321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15d91ca4-a4e9-48a4-bbfc-8e4e7410f600 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:41.324904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d91ca4-a4e9-48a4-bbfc-8e4e7410f600 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:41.330199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d91ca4-a4e9-48a4-bbfc-8e4e7410f600 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:41.343000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d91ca4-a4e9-48a4-bbfc-8e4e7410f600 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:41.344127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d91ca4-a4e9-48a4-bbfc-8e4e7410f600 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:41.344802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d91ca4-a4e9-48a4-bbfc-8e4e7410f600 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:41.353880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d91ca4-a4e9-48a4-bbfc-8e4e7410f600 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:41.355635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] validate_networks() for [('0ccfc34d-2c65-4344-9114-4b96b3845d6a', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:42:41.618168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-15d91ca4-a4e9-48a4-bbfc-8e4e7410f600 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:41.630156 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-15d91ca4-a4e9-48a4-bbfc-8e4e7410f600 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.344251 Oct 05 17:42:41.634245 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1335/2500] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:41 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:41.643758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:41.647577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:41.663450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:41.664137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:41.664675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:41.665520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:41.668943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:41.669934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:42.062534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:42.076611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:42.079416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:42.083748 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-451082d1-8cf1-4ea4-a41b-5e22b263ca18 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.448012 Oct 05 17:42:42.094962 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1336/2501] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:41 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:42.124157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-de850985-361a-4696-9509-5aeb32818b51 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:42.124794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-de850985-361a-4696-9509-5aeb32818b51 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:42.135208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de850985-361a-4696-9509-5aeb32818b51 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:42.135709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de850985-361a-4696-9509-5aeb32818b51 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:42.136149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de850985-361a-4696-9509-5aeb32818b51 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:42.139056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de850985-361a-4696-9509-5aeb32818b51 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:42.139526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de850985-361a-4696-9509-5aeb32818b51 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:42.139959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de850985-361a-4696-9509-5aeb32818b51 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:42.402651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-de850985-361a-4696-9509-5aeb32818b51 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:42.412834 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-de850985-361a-4696-9509-5aeb32818b51 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.316573 Oct 05 17:42:42.417196 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1337/2502] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:42 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:42.425671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70498965-675b-451c-a1c5-974115251699 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:42.433577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-70498965-675b-451c-a1c5-974115251699 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:42.445481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70498965-675b-451c-a1c5-974115251699 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:42.448007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70498965-675b-451c-a1c5-974115251699 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:42.448630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70498965-675b-451c-a1c5-974115251699 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:42.451136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70498965-675b-451c-a1c5-974115251699 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:42.451788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70498965-675b-451c-a1c5-974115251699 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:42.454021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70498965-675b-451c-a1c5-974115251699 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:42.780260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-70498965-675b-451c-a1c5-974115251699 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:42.790729 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-70498965-675b-451c-a1c5-974115251699 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.368887 Oct 05 17:42:42.791888 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1338/2503] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:42 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:42.797779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82a4dfab-6ea2-4a0c-9734-c3c13a792a7b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775394820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:42.851212 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-82a4dfab-6ea2-4a0c-9734-c3c13a792a7b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.057560 Oct 05 17:42:42.859399 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1339/2504] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:42 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:42.867422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-093db729-e5de-4120-b9ac-2ea75c6fc16b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:42.868248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-093db729-e5de-4120-b9ac-2ea75c6fc16b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:42.875543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-093db729-e5de-4120-b9ac-2ea75c6fc16b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:42.876260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-093db729-e5de-4120-b9ac-2ea75c6fc16b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:42.876873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-093db729-e5de-4120-b9ac-2ea75c6fc16b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:42.877731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-093db729-e5de-4120-b9ac-2ea75c6fc16b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:42.878360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-093db729-e5de-4120-b9ac-2ea75c6fc16b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:42.878957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-093db729-e5de-4120-b9ac-2ea75c6fc16b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:43.204795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-093db729-e5de-4120-b9ac-2ea75c6fc16b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:43.215180 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-093db729-e5de-4120-b9ac-2ea75c6fc16b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.354335 Oct 05 17:42:43.226320 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1340/2505] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:42 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:43.227836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:43.228472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:43.247892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:43.250248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:43.250764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:43.251994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:43.252435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:43.252861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:43.699660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:43.715292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:43.718166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:43.726162 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-23c7427a-89e3-43ae-ac45-b6dd802e216f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.506311 Oct 05 17:42:43.748687 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1341/2506] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:43 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:43.822488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-408c166a-72b0-4333-8068-58abe2e18e7c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:43.823404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-408c166a-72b0-4333-8068-58abe2e18e7c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:43.830518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-408c166a-72b0-4333-8068-58abe2e18e7c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:43.831305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-408c166a-72b0-4333-8068-58abe2e18e7c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:43.831957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-408c166a-72b0-4333-8068-58abe2e18e7c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:43.833130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-408c166a-72b0-4333-8068-58abe2e18e7c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:43.833795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-408c166a-72b0-4333-8068-58abe2e18e7c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:43.834472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-408c166a-72b0-4333-8068-58abe2e18e7c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:44.187026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-408c166a-72b0-4333-8068-58abe2e18e7c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:44.197042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-408c166a-72b0-4333-8068-58abe2e18e7c tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.379034 Oct 05 17:42:44.203012 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1342/2507] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:43 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:44.208370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2a754f4-b7dd-4562-8d2c-c5eea3aa6e00 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77752e2550>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:44.314020 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2a754f4-b7dd-4562-8d2c-c5eea3aa6e00 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.109521 Oct 05 17:42:44.315103 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1343/2508] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:44 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:44.327614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4921324b-76d6-4dcc-855e-91b0d11567b6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:44.328370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4921324b-76d6-4dcc-855e-91b0d11567b6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:44.359376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4921324b-76d6-4dcc-855e-91b0d11567b6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:44.360560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4921324b-76d6-4dcc-855e-91b0d11567b6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:44.361253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4921324b-76d6-4dcc-855e-91b0d11567b6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:44.362389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4921324b-76d6-4dcc-855e-91b0d11567b6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:44.363404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4921324b-76d6-4dcc-855e-91b0d11567b6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:44.364313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4921324b-76d6-4dcc-855e-91b0d11567b6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:44.380470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:44.856948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4921324b-76d6-4dcc-855e-91b0d11567b6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:44.876263 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4921324b-76d6-4dcc-855e-91b0d11567b6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.556226 Oct 05 17:42:44.879667 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1344/2509] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:44 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:44.919284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:44.919902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:44.949592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:44.955008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:44.956292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:44.959096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:44.962577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:44.965632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:45.643836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:45.653624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:45.655102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:45.656297 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-26703df2-8766-49fa-916f-6bec67d0c17d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.775449 Oct 05 17:42:45.656871 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1345/2510] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:44 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:45.661357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e38e653c-235e-4961-9496-9b603e497feb tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:45.661970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e38e653c-235e-4961-9496-9b603e497feb tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:45.687462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38e653c-235e-4961-9496-9b603e497feb tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:45.687965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38e653c-235e-4961-9496-9b603e497feb tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:45.688412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38e653c-235e-4961-9496-9b603e497feb tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:45.689134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38e653c-235e-4961-9496-9b603e497feb tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:45.689598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38e653c-235e-4961-9496-9b603e497feb tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:45.690029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38e653c-235e-4961-9496-9b603e497feb tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:46.009142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e38e653c-235e-4961-9496-9b603e497feb tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:46.020676 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e38e653c-235e-4961-9496-9b603e497feb tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.360558 Oct 05 17:42:46.039442 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1346/2511] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:45 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:46.054387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dac1653c-1e48-45c4-a2f9-92ce31ec1610 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777528ef70>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:46.110908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:42:46.116732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:42:46.119060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:42:46.119973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:42:46.121150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:42:46.137421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:46.138189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:46.144234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:46.146492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:46.147317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:46.147937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:46.174456 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dac1653c-1e48-45c4-a2f9-92ce31ec1610 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.132743 Oct 05 17:42:46.176561 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1347/2512] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:46 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:46.184302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Getting quotas for project f401d1367a73495598bb8a6b882e8618. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:42:46.189163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7863316-17a2-47ea-b9c0-88b3e4441a1a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:46.190133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b7863316-17a2-47ea-b9c0-88b3e4441a1a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:46.196849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Getting quotas for user 695a37f439e94d2e860e51df835827e4 and project f401d1367a73495598bb8a6b882e8618. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:42:46.207989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7863316-17a2-47ea-b9c0-88b3e4441a1a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:46.208508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7863316-17a2-47ea-b9c0-88b3e4441a1a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:46.211461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7863316-17a2-47ea-b9c0-88b3e4441a1a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:46.212486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7863316-17a2-47ea-b9c0-88b3e4441a1a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:46.215058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7863316-17a2-47ea-b9c0-88b3e4441a1a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:46.217697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7863316-17a2-47ea-b9c0-88b3e4441a1a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:46.230582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:42:46.234905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:42:46.412540 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47ee2008-1ea1-46b7-8748-99788bb3d2dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.437668 Oct 05 17:42:46.417996 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1166/2513] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:42:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 5448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:42:46.423262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6e8f93db-bf27-4800-9648-8c4479a61c48 req-24c0ddd1-1c0a-4248-8b22-f887fdaa7ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05e13165-324b-4dbf-b095-9d7629b0f570", "tag": "8e71d756-2bfa-46ef-b903-90032171c8ce"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:46.497440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6e8f93db-bf27-4800-9648-8c4479a61c48 req-24c0ddd1-1c0a-4248-8b22-f887fdaa7ed4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:46.503098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6e8f93db-bf27-4800-9648-8c4479a61c48 req-24c0ddd1-1c0a-4248-8b22-f887fdaa7ed4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:46.505558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6e8f93db-bf27-4800-9648-8c4479a61c48 req-24c0ddd1-1c0a-4248-8b22-f887fdaa7ed4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:46.549738 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6e8f93db-bf27-4800-9648-8c4479a61c48 req-24c0ddd1-1c0a-4248-8b22-f887fdaa7ed4 service nova] Creating event network-changed:8e71d756-2bfa-46ef-b903-90032171c8ce for instance 05e13165-324b-4dbf-b095-9d7629b0f570 on n-h2-835595-3 Oct 05 17:42:46.560407 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6e8f93db-bf27-4800-9648-8c4479a61c48 req-24c0ddd1-1c0a-4248-8b22-f887fdaa7ed4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140867 Oct 05 17:42:46.561805 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1167/2514] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:46.585859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f5150169-7f08-425b-af39-a70c8729c4bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:46.586604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f5150169-7f08-425b-af39-a70c8729c4bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:46.729121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b7863316-17a2-47ea-b9c0-88b3e4441a1a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:46.739171 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b7863316-17a2-47ea-b9c0-88b3e4441a1a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.561505 Oct 05 17:42:46.739788 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1348/2515] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:46 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:46.775248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:46.775860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:46.796053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:46.796564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:46.797011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:46.797738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:46.798268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:46.799112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:46.978477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f5150169-7f08-425b-af39-a70c8729c4bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:46.989404 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f5150169-7f08-425b-af39-a70c8729c4bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1210 microversion: 2.1 time: 0.425267 Oct 05 17:42:46.993270 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1168/2516] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:46 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1210 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:47.060043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f4d15c0-00a1-4959-8b90-f0f4649f11c8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:47.060776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0f4d15c0-00a1-4959-8b90-f0f4649f11c8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:47.080216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f4d15c0-00a1-4959-8b90-f0f4649f11c8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:47.080729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f4d15c0-00a1-4959-8b90-f0f4649f11c8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:47.082219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f4d15c0-00a1-4959-8b90-f0f4649f11c8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:47.084792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f4d15c0-00a1-4959-8b90-f0f4649f11c8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:47.086757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f4d15c0-00a1-4959-8b90-f0f4649f11c8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:47.088638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f4d15c0-00a1-4959-8b90-f0f4649f11c8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:47.279867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:47.294108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:47.305380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:47.311808 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-16748a07-d3e0-4c1d-a2e7-d35fee0ec155 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.547213 Oct 05 17:42:47.317069 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1349/2517] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:46 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:47.338204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ab0e2dc-7b31-4da7-9187-25fbe240927d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77753ae4c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:47.417572 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7ab0e2dc-7b31-4da7-9187-25fbe240927d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.098983 Oct 05 17:42:47.418995 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1350/2518] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:47 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:47.766083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8a255987-b0d3-4a4c-bd52-f9e1ca866c31 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:47.767190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8a255987-b0d3-4a4c-bd52-f9e1ca866c31 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:47.779769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a255987-b0d3-4a4c-bd52-f9e1ca866c31 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:47.781518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a255987-b0d3-4a4c-bd52-f9e1ca866c31 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:47.782211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a255987-b0d3-4a4c-bd52-f9e1ca866c31 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:47.784305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a255987-b0d3-4a4c-bd52-f9e1ca866c31 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:47.789075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a255987-b0d3-4a4c-bd52-f9e1ca866c31 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:47.789895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a255987-b0d3-4a4c-bd52-f9e1ca866c31 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:48.103330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8a255987-b0d3-4a4c-bd52-f9e1ca866c31 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:48.112438 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8a255987-b0d3-4a4c-bd52-f9e1ca866c31 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.351678 Oct 05 17:42:48.121667 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1351/2519] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:47 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:48.142122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8264733d-4c5d-4064-a9ed-79ca7469a78d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:48.142762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8264733d-4c5d-4064-a9ed-79ca7469a78d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:48.155642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8264733d-4c5d-4064-a9ed-79ca7469a78d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:48.156149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8264733d-4c5d-4064-a9ed-79ca7469a78d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:48.156594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8264733d-4c5d-4064-a9ed-79ca7469a78d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:48.157506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8264733d-4c5d-4064-a9ed-79ca7469a78d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:48.157753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8264733d-4c5d-4064-a9ed-79ca7469a78d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:48.168192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8264733d-4c5d-4064-a9ed-79ca7469a78d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:48.264170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8264733d-4c5d-4064-a9ed-79ca7469a78d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:48.272819 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8264733d-4c5d-4064-a9ed-79ca7469a78d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1262 microversion: 2.1 time: 0.148765 Oct 05 17:42:48.275622 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1352/2520] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:48 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:48.358582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:48.359819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:48.397834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:48.399847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:48.401959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:48.402804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:48.404656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:48.408956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:48.658748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0f4d15c0-00a1-4959-8b90-f0f4649f11c8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:48.671571 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f4d15c0-00a1-4959-8b90-f0f4649f11c8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 1.618559 Oct 05 17:42:48.676253 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1169/2521] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:47 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:48.691507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-39b998c3-df9b-4c0d-9377-a16a8348df84 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77794da820>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:48.789589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-39b998c3-df9b-4c0d-9377-a16a8348df84 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.111751 Oct 05 17:42:48.790980 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1170/2522] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:48 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:49.154607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b1e5c85-650c-4cc4-9907-3a09fb37cba4 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:49.155225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b1e5c85-650c-4cc4-9907-3a09fb37cba4 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:49.171428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1e5c85-650c-4cc4-9907-3a09fb37cba4 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:49.176341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1e5c85-650c-4cc4-9907-3a09fb37cba4 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:49.177554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1e5c85-650c-4cc4-9907-3a09fb37cba4 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:49.178529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1e5c85-650c-4cc4-9907-3a09fb37cba4 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:49.179323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1e5c85-650c-4cc4-9907-3a09fb37cba4 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:49.183796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1e5c85-650c-4cc4-9907-3a09fb37cba4 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:49.598180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3b1e5c85-650c-4cc4-9907-3a09fb37cba4 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:49.608136 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b1e5c85-650c-4cc4-9907-3a09fb37cba4 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.457847 Oct 05 17:42:49.626185 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1171/2523] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:49 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:49.634799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a07fe55f-f9f5-41ab-a609-a2a795897eba tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:49.635684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a07fe55f-f9f5-41ab-a609-a2a795897eba tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:49.645648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a07fe55f-f9f5-41ab-a609-a2a795897eba tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:49.646176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:49.646935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a07fe55f-f9f5-41ab-a609-a2a795897eba tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:49.648126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a07fe55f-f9f5-41ab-a609-a2a795897eba tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:49.649043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a07fe55f-f9f5-41ab-a609-a2a795897eba tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:49.650050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a07fe55f-f9f5-41ab-a609-a2a795897eba tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:49.650892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a07fe55f-f9f5-41ab-a609-a2a795897eba tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:49.671577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:49.673077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:49.682814 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cb5c09cd-8aae-4aa8-b43e-4a0ab8be741f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 1.341748 Oct 05 17:42:49.684066 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1353/2524] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:48 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:49.701414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a40106e6-9aa8-4140-a0e7-4428a447cfdc tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:49.702075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a40106e6-9aa8-4140-a0e7-4428a447cfdc tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:49.719479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40106e6-9aa8-4140-a0e7-4428a447cfdc tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:49.721956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40106e6-9aa8-4140-a0e7-4428a447cfdc tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:49.722520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40106e6-9aa8-4140-a0e7-4428a447cfdc tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:49.723283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40106e6-9aa8-4140-a0e7-4428a447cfdc tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:49.723755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40106e6-9aa8-4140-a0e7-4428a447cfdc tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:49.724185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a40106e6-9aa8-4140-a0e7-4428a447cfdc tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:49.912207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a07fe55f-f9f5-41ab-a609-a2a795897eba tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:49.935394 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a07fe55f-f9f5-41ab-a609-a2a795897eba tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1268 microversion: 2.1 time: 0.307494 Oct 05 17:42:49.936658 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1172/2525] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:49 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1268 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:49.976722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6700920f-19a0-4eee-ac2a-e847c1e2fe5c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77760fbca0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:50.063836 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6700920f-19a0-4eee-ac2a-e847c1e2fe5c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.124542 Oct 05 17:42:50.077939 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1173/2526] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:49 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:50.279007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a40106e6-9aa8-4140-a0e7-4428a447cfdc tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:50.288324 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a40106e6-9aa8-4140-a0e7-4428a447cfdc tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.595055 Oct 05 17:42:50.312776 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1354/2527] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:49 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:50.636584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-03808052-8e84-415d-b26c-7c20b30f3baf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:50.637219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-03808052-8e84-415d-b26c-7c20b30f3baf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:50.658731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03808052-8e84-415d-b26c-7c20b30f3baf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:50.659695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03808052-8e84-415d-b26c-7c20b30f3baf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:50.662703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03808052-8e84-415d-b26c-7c20b30f3baf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:50.669039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03808052-8e84-415d-b26c-7c20b30f3baf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:50.669787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03808052-8e84-415d-b26c-7c20b30f3baf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:50.674434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03808052-8e84-415d-b26c-7c20b30f3baf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:50.713620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:50.714944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:50.731993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:50.732462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:50.735778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:50.737779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:50.743722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:50.744171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:51.369005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:51.389858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:51.395942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:51.398989 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9f682052-c346-4593-90c4-c04a9544abbd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.693467 Oct 05 17:42:51.401335 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1355/2528] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:50 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:51.418328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9cb7c66c-d740-48ff-9d5d-dbb92fc137d6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:51.419124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9cb7c66c-d740-48ff-9d5d-dbb92fc137d6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:51.436187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cb7c66c-d740-48ff-9d5d-dbb92fc137d6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:51.436687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cb7c66c-d740-48ff-9d5d-dbb92fc137d6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:51.438524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cb7c66c-d740-48ff-9d5d-dbb92fc137d6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:51.440757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cb7c66c-d740-48ff-9d5d-dbb92fc137d6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:51.443075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cb7c66c-d740-48ff-9d5d-dbb92fc137d6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:51.443549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cb7c66c-d740-48ff-9d5d-dbb92fc137d6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:51.490652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-03808052-8e84-415d-b26c-7c20b30f3baf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:51.508554 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-03808052-8e84-415d-b26c-7c20b30f3baf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.869275 Oct 05 17:42:51.510799 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1174/2529] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:50 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:51.533571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e24dcf4d-e2c0-444a-9b4d-debd3b7c62e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777941fe50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:51.624887 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e24dcf4d-e2c0-444a-9b4d-debd3b7c62e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.112530 Oct 05 17:42:51.626210 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1175/2530] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:51 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:51.641429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d6b1014d-6fed-4649-af78-6d60c6fb1655 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:51.645067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d6b1014d-6fed-4649-af78-6d60c6fb1655 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:51.666220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6b1014d-6fed-4649-af78-6d60c6fb1655 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:51.667024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6b1014d-6fed-4649-af78-6d60c6fb1655 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:51.667537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6b1014d-6fed-4649-af78-6d60c6fb1655 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:51.668301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6b1014d-6fed-4649-af78-6d60c6fb1655 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:51.669937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6b1014d-6fed-4649-af78-6d60c6fb1655 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:51.670486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6b1014d-6fed-4649-af78-6d60c6fb1655 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:51.788997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9cb7c66c-d740-48ff-9d5d-dbb92fc137d6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:51.801351 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9cb7c66c-d740-48ff-9d5d-dbb92fc137d6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1268 microversion: 2.1 time: 0.396638 Oct 05 17:42:51.815997 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1356/2531] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:51 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1268 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:52.431484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:52.432828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:52.453751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d6b1014d-6fed-4649-af78-6d60c6fb1655 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:52.468970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:52.470460 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d6b1014d-6fed-4649-af78-6d60c6fb1655 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.843021 Oct 05 17:42:52.471069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:52.471798 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1176/2532] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:51 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:52.493100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:52.494715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:52.497148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:52.497800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:52.540439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2f8e103b-85a5-43cc-a29e-818dc0156638 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:52.541759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2f8e103b-85a5-43cc-a29e-818dc0156638 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:52.554003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f8e103b-85a5-43cc-a29e-818dc0156638 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:52.554796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f8e103b-85a5-43cc-a29e-818dc0156638 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:52.555404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f8e103b-85a5-43cc-a29e-818dc0156638 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:52.556406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f8e103b-85a5-43cc-a29e-818dc0156638 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:52.557220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f8e103b-85a5-43cc-a29e-818dc0156638 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:52.557809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f8e103b-85a5-43cc-a29e-818dc0156638 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:52.884708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:52.902408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:52.905981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:52.909532 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e9a0c8d-dfda-4f58-aac6-bbee4cb2e2d2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.483422 Oct 05 17:42:52.910043 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1357/2533] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:52 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:52.924651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4f4053d-fd38-41ea-a2fd-256a97470c58 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777528e940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:52.991636 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b4f4053d-fd38-41ea-a2fd-256a97470c58 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.077007 Oct 05 17:42:52.992244 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1358/2534] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:52 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:53.009319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-795c3ab6-06ad-400e-91ea-835046d47e1d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:53.010145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-795c3ab6-06ad-400e-91ea-835046d47e1d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:53.027156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-795c3ab6-06ad-400e-91ea-835046d47e1d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:53.033849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-795c3ab6-06ad-400e-91ea-835046d47e1d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:53.034754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-795c3ab6-06ad-400e-91ea-835046d47e1d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:53.035933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-795c3ab6-06ad-400e-91ea-835046d47e1d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:53.036560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-795c3ab6-06ad-400e-91ea-835046d47e1d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:53.037163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-795c3ab6-06ad-400e-91ea-835046d47e1d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:53.233200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-795c3ab6-06ad-400e-91ea-835046d47e1d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:53.245196 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-795c3ab6-06ad-400e-91ea-835046d47e1d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1268 microversion: 2.1 time: 0.239323 Oct 05 17:42:53.247645 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1359/2535] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:52 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1268 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:53.499956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02e24f53-5949-4e14-a32c-c48311afe96a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:53.500875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02e24f53-5949-4e14-a32c-c48311afe96a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:53.516984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02e24f53-5949-4e14-a32c-c48311afe96a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:53.518029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02e24f53-5949-4e14-a32c-c48311afe96a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:53.518579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02e24f53-5949-4e14-a32c-c48311afe96a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:53.519861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02e24f53-5949-4e14-a32c-c48311afe96a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:53.519861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02e24f53-5949-4e14-a32c-c48311afe96a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:53.520236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02e24f53-5949-4e14-a32c-c48311afe96a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:53.541134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2f8e103b-85a5-43cc-a29e-818dc0156638 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:53.556287 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2f8e103b-85a5-43cc-a29e-818dc0156638 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 1.019742 Oct 05 17:42:53.559449 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1177/2536] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:52 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:42:53.866898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-02e24f53-5949-4e14-a32c-c48311afe96a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:53.877886 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02e24f53-5949-4e14-a32c-c48311afe96a tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.382423 Oct 05 17:42:53.884635 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1360/2537] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:53 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:53.937622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:53.938638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:53.947790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:53.953558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:53.954605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:53.955622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:53.957223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:53.959024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:54.007668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cad1c651-f895-4c3a-a7a4-bbcd81c6f4b8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77751378b0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:54.097838 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cad1c651-f895-4c3a-a7a4-bbcd81c6f4b8 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1411 microversion: 2.1 time: 0.094440 Oct 05 17:42:54.104347 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1361/2538] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:54 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1411 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:54.274489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a299a7de-093e-4985-a5f6-e9d9d334a6ca tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:54.275373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a299a7de-093e-4985-a5f6-e9d9d334a6ca tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:54.286133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a299a7de-093e-4985-a5f6-e9d9d334a6ca tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:54.287019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a299a7de-093e-4985-a5f6-e9d9d334a6ca tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:54.287676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a299a7de-093e-4985-a5f6-e9d9d334a6ca tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:54.288711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a299a7de-093e-4985-a5f6-e9d9d334a6ca tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:54.290046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a299a7de-093e-4985-a5f6-e9d9d334a6ca tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:54.290829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a299a7de-093e-4985-a5f6-e9d9d334a6ca tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:54.418117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a299a7de-093e-4985-a5f6-e9d9d334a6ca tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:54.426167 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a299a7de-093e-4985-a5f6-e9d9d334a6ca tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1268 microversion: 2.1 time: 0.157256 Oct 05 17:42:54.427031 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1362/2539] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:54 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:54.581463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-41f7706c-e11a-40bf-8fc4-0f72c21f7c56 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:54.582496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-41f7706c-e11a-40bf-8fc4-0f72c21f7c56 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:54.592184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41f7706c-e11a-40bf-8fc4-0f72c21f7c56 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:54.592984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41f7706c-e11a-40bf-8fc4-0f72c21f7c56 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:54.593589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41f7706c-e11a-40bf-8fc4-0f72c21f7c56 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:54.594600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41f7706c-e11a-40bf-8fc4-0f72c21f7c56 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:54.595218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41f7706c-e11a-40bf-8fc4-0f72c21f7c56 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:54.595835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41f7706c-e11a-40bf-8fc4-0f72c21f7c56 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:54.739396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:54.752562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:54.753993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:54.762455 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f9ac79b9-b337-4cf9-be09-1510d3a15d1a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.828869 Oct 05 17:42:54.763282 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1178/2540] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:53 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:54.908207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-921c973f-5e00-471d-94d7-2a84a44aad79 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:54.909101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-921c973f-5e00-471d-94d7-2a84a44aad79 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:54.925017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921c973f-5e00-471d-94d7-2a84a44aad79 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:54.926041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921c973f-5e00-471d-94d7-2a84a44aad79 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:54.926720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921c973f-5e00-471d-94d7-2a84a44aad79 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:54.927624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921c973f-5e00-471d-94d7-2a84a44aad79 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:54.928234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921c973f-5e00-471d-94d7-2a84a44aad79 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:54.929256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921c973f-5e00-471d-94d7-2a84a44aad79 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:55.033886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-41f7706c-e11a-40bf-8fc4-0f72c21f7c56 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:55.043020 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-41f7706c-e11a-40bf-8fc4-0f72c21f7c56 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.465531 Oct 05 17:42:55.047755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1363/2541] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:54 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:55.117922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9299c1bd-caeb-4d2e-b85c-90bb01a51845 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775001550>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:55.211667 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9299c1bd-caeb-4d2e-b85c-90bb01a51845 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1420 microversion: 2.1 time: 0.100306 Oct 05 17:42:55.219344 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1364/2542] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:55 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:42:55.234683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6e24b34d-63bc-4217-9b47-85c3d577abd9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777535e550>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:55.306344 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6e24b34d-63bc-4217-9b47-85c3d577abd9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 200 len: 1420 microversion: 2.1 time: 0.075539 Oct 05 17:42:55.307747 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1365/2543] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:42:55 2022] GET /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:55.322980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-abd3f600-8343-4ff6-a0c2-de5efa977670 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77752e2550>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:55.377149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-921c973f-5e00-471d-94d7-2a84a44aad79 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:55.391907 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-921c973f-5e00-471d-94d7-2a84a44aad79 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.487666 Oct 05 17:42:55.397401 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1179/2544] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:54 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:55.450891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d9249213-d370-4dbe-905a-abb693b5046c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:55.451555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d9249213-d370-4dbe-905a-abb693b5046c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:55.479112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9249213-d370-4dbe-905a-abb693b5046c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:55.479624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9249213-d370-4dbe-905a-abb693b5046c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:55.480068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9249213-d370-4dbe-905a-abb693b5046c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:55.480843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9249213-d370-4dbe-905a-abb693b5046c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:55.481358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9249213-d370-4dbe-905a-abb693b5046c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:55.485858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9249213-d370-4dbe-905a-abb693b5046c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:56.119315 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-abd3f600-8343-4ff6-a0c2-de5efa977670 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 204 len: 0 microversion: 2.1 time: 0.801444 Oct 05 17:42:56.120107 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1366/2545] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:55 2022] DELETE /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 0 bytes in 803 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:42:56.128098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:56.129085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:56.136119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:56.137075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:56.137938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:56.139127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:56.139878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:56.140530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:56.161216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:56.195042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9249213-d370-4dbe-905a-abb693b5046c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:56.207475 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d9249213-d370-4dbe-905a-abb693b5046c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1310 microversion: 2.1 time: 0.761496 Oct 05 17:42:56.210245 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1180/2546] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:55 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1310 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:42:56.216675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f7fb7bab-50f6-450f-8244-97236c6c14e0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:56.217602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f7fb7bab-50f6-450f-8244-97236c6c14e0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:56.225862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7fb7bab-50f6-450f-8244-97236c6c14e0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:56.227866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7fb7bab-50f6-450f-8244-97236c6c14e0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:56.228583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7fb7bab-50f6-450f-8244-97236c6c14e0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:56.230006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7fb7bab-50f6-450f-8244-97236c6c14e0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:56.231334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7fb7bab-50f6-450f-8244-97236c6c14e0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:56.232077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7fb7bab-50f6-450f-8244-97236c6c14e0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:56.547820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:56.553282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:56.572027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:56.575875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:56.582327 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6a74b819-1f4a-4374-9268-cf81b0a36b50 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.460877 Oct 05 17:42:56.583530 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1367/2547] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:56 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:56.599536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-83d49e53-bf8f-4f9b-8054-3f815325e2dc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:56.600387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-83d49e53-bf8f-4f9b-8054-3f815325e2dc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:56.620269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83d49e53-bf8f-4f9b-8054-3f815325e2dc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:56.621020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83d49e53-bf8f-4f9b-8054-3f815325e2dc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:56.621646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83d49e53-bf8f-4f9b-8054-3f815325e2dc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:56.622593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83d49e53-bf8f-4f9b-8054-3f815325e2dc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:56.623218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83d49e53-bf8f-4f9b-8054-3f815325e2dc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:56.624580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83d49e53-bf8f-4f9b-8054-3f815325e2dc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:56.676158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-83d49e53-bf8f-4f9b-8054-3f815325e2dc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:42:56.741619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f7fb7bab-50f6-450f-8244-97236c6c14e0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:56.754800 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f7fb7bab-50f6-450f-8244-97236c6c14e0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.542199 Oct 05 17:42:56.757028 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1181/2548] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:56 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:56.772183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-fef83a6f-854f-43ef-9d66-e3c11d0b325d req-45a57e76-3da7-49e4-b202-beb90330a4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80ed110-8f6b-4126-a565-bb874a0de577", "name": "network-vif-plugged", "status": "completed", "tag": "de32f0ab-7e10-4e24-8cd1-81209d7dc484"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:56.789825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fef83a6f-854f-43ef-9d66-e3c11d0b325d req-45a57e76-3da7-49e4-b202-beb90330a4e9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:56.791093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fef83a6f-854f-43ef-9d66-e3c11d0b325d req-45a57e76-3da7-49e4-b202-beb90330a4e9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:56.791744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fef83a6f-854f-43ef-9d66-e3c11d0b325d req-45a57e76-3da7-49e4-b202-beb90330a4e9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:56.807587 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-fef83a6f-854f-43ef-9d66-e3c11d0b325d req-45a57e76-3da7-49e4-b202-beb90330a4e9 service nova] Creating event network-vif-plugged:de32f0ab-7e10-4e24-8cd1-81209d7dc484 for instance b80ed110-8f6b-4126-a565-bb874a0de577 on n-h1-835595-3 Oct 05 17:42:56.813880 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-fef83a6f-854f-43ef-9d66-e3c11d0b325d req-45a57e76-3da7-49e4-b202-beb90330a4e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055306 Oct 05 17:42:56.815250 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1182/2549] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:56.823955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69851e82-6e56-4ad4-adf2-8c5d9fc0fd31 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:56.825072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-69851e82-6e56-4ad4-adf2-8c5d9fc0fd31 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:56.831050 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-83d49e53-bf8f-4f9b-8054-3f815325e2dc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 204 len: 0 microversion: 2.1 time: 0.241081 Oct 05 17:42:56.833158 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1368/2550] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:42:56 2022] DELETE /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:42:56.838466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69851e82-6e56-4ad4-adf2-8c5d9fc0fd31 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:56.839679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69851e82-6e56-4ad4-adf2-8c5d9fc0fd31 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:56.840330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69851e82-6e56-4ad4-adf2-8c5d9fc0fd31 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:56.841241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69851e82-6e56-4ad4-adf2-8c5d9fc0fd31 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:56.841846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69851e82-6e56-4ad4-adf2-8c5d9fc0fd31 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:56.843075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69851e82-6e56-4ad4-adf2-8c5d9fc0fd31 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:56.987239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:56.992917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1371011944", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "f858ae49-432b-47a7-98c9-045c9a50f77b"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:57.079377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] validate_networks() for [('f858ae49-432b-47a7-98c9-045c9a50f77b', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:42:57.312868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-69851e82-6e56-4ad4-adf2-8c5d9fc0fd31 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:57.322359 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69851e82-6e56-4ad4-adf2-8c5d9fc0fd31 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.505495 Oct 05 17:42:57.338269 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1183/2551] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:56 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:57.343816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ec9a4d09-af5d-4781-b278-75ddf4348bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:57.347104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ec9a4d09-af5d-4781-b278-75ddf4348bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:57.355525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9a4d09-af5d-4781-b278-75ddf4348bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:57.356479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9a4d09-af5d-4781-b278-75ddf4348bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:57.357124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9a4d09-af5d-4781-b278-75ddf4348bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:57.358063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9a4d09-af5d-4781-b278-75ddf4348bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:57.358901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9a4d09-af5d-4781-b278-75ddf4348bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:57.359536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec9a4d09-af5d-4781-b278-75ddf4348bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:57.415781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:42:57.521406 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ec9a4d09-af5d-4781-b278-75ddf4348bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.181244 Oct 05 17:42:57.525415 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1184/2552] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:42:57 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:42:57.532978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-98d45800-f124-4653-a767-88340aa109c6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:57.533990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-98d45800-f124-4653-a767-88340aa109c6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:57.544366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98d45800-f124-4653-a767-88340aa109c6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:57.546164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98d45800-f124-4653-a767-88340aa109c6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:57.546717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98d45800-f124-4653-a767-88340aa109c6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:57.549313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98d45800-f124-4653-a767-88340aa109c6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:57.549972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98d45800-f124-4653-a767-88340aa109c6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:57.552364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98d45800-f124-4653-a767-88340aa109c6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:57.919392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-98d45800-f124-4653-a767-88340aa109c6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:57.931524 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-98d45800-f124-4653-a767-88340aa109c6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1310 microversion: 2.1 time: 0.404256 Oct 05 17:42:57.942075 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1185/2553] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:57 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1310 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:57.961192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-713cb674-af24-44f9-9d7b-269fc9e89465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:57.962635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-713cb674-af24-44f9-9d7b-269fc9e89465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:57.984479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-713cb674-af24-44f9-9d7b-269fc9e89465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:57.984991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-713cb674-af24-44f9-9d7b-269fc9e89465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:57.985434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-713cb674-af24-44f9-9d7b-269fc9e89465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:57.986161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-713cb674-af24-44f9-9d7b-269fc9e89465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:57.986629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-713cb674-af24-44f9-9d7b-269fc9e89465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:57.987057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-713cb674-af24-44f9-9d7b-269fc9e89465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:58.169160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:42:58.170510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:42:58.171260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:42:58.171884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:42:58.173355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:42:58.186231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:58.187156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:58.187813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:58.188896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:58.189794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:58.190529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:58.218009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Getting quotas for project 47d5d4426b3d481b92b84c307cd00ead. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:42:58.224229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Getting quotas for user 6720411ae8fc46a5bcd7b8f6d95c24a8 and project 47d5d4426b3d481b92b84c307cd00ead. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:42:58.239380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:42:58.243547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:42:58.356671 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a7cd2e8a-659d-470b-885d-3f913d9ff9e0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.368416 Oct 05 17:42:58.363987 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1369/2554] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:42:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:42:58.370269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:58.372984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:58.393301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:58.394332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:58.396610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:58.398756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:58.401797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:58.402523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:58.483216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-713cb674-af24-44f9-9d7b-269fc9e89465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:58.508191 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-713cb674-af24-44f9-9d7b-269fc9e89465 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1670 microversion: 2.1 time: 0.564601 Oct 05 17:42:58.509303 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1186/2555] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:57 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1670 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:58.533925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ae1d059a-32c7-41dd-896b-4bf9b4b9cb5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:58.535422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ae1d059a-32c7-41dd-896b-4bf9b4b9cb5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:58.547779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae1d059a-32c7-41dd-896b-4bf9b4b9cb5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:58.548913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae1d059a-32c7-41dd-896b-4bf9b4b9cb5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:58.549550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae1d059a-32c7-41dd-896b-4bf9b4b9cb5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:58.550367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae1d059a-32c7-41dd-896b-4bf9b4b9cb5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:58.550835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae1d059a-32c7-41dd-896b-4bf9b4b9cb5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:58.551265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae1d059a-32c7-41dd-896b-4bf9b4b9cb5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:58.725865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:58.736779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:58.738796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:58.740279 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5f2dca17-d874-4ad8-8111-b26b98abc0f7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.382008 Oct 05 17:42:58.754797 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1370/2556] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:42:58 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:42:58.880860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1809333821", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "9e81d037-2595-4df7-b74b-9e884f6121d2"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:58.961622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] validate_networks() for [('9e81d037-2595-4df7-b74b-9e884f6121d2', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:42:59.199760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ae1d059a-32c7-41dd-896b-4bf9b4b9cb5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:42:59.212116 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ae1d059a-32c7-41dd-896b-4bf9b4b9cb5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.682485 Oct 05 17:42:59.214568 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1187/2557] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:58 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:42:59.222033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-42405e61-b8e8-47a9-b851-d196e91d99e8 req-0cb40598-2dff-4701-98f4-df24dc2c1615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8bc911-1ed0-4477-95a8-9b63aeb837aa", "tag": "2adbf98a-5ee3-4501-8cde-8d0b03b4a187"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:42:59.256703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-42405e61-b8e8-47a9-b851-d196e91d99e8 req-0cb40598-2dff-4701-98f4-df24dc2c1615 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:59.257712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-42405e61-b8e8-47a9-b851-d196e91d99e8 req-0cb40598-2dff-4701-98f4-df24dc2c1615 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:59.259335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-42405e61-b8e8-47a9-b851-d196e91d99e8 req-0cb40598-2dff-4701-98f4-df24dc2c1615 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:59.293673 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-42405e61-b8e8-47a9-b851-d196e91d99e8 req-0cb40598-2dff-4701-98f4-df24dc2c1615 service nova] Creating event network-changed:2adbf98a-5ee3-4501-8cde-8d0b03b4a187 for instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa on n-h1-835595-3 Oct 05 17:42:59.314363 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-42405e61-b8e8-47a9-b851-d196e91d99e8 req-0cb40598-2dff-4701-98f4-df24dc2c1615 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097291 Oct 05 17:42:59.316496 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1188/2558] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:42:59.326311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-868eb081-9b8b-4ed4-a8aa-323446abaeef tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:42:59.328324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-868eb081-9b8b-4ed4-a8aa-323446abaeef tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:42:59.341077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-868eb081-9b8b-4ed4-a8aa-323446abaeef tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:59.341582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-868eb081-9b8b-4ed4-a8aa-323446abaeef tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:59.342027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-868eb081-9b8b-4ed4-a8aa-323446abaeef tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:59.342785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-868eb081-9b8b-4ed4-a8aa-323446abaeef tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:59.343421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-868eb081-9b8b-4ed4-a8aa-323446abaeef tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:59.344008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-868eb081-9b8b-4ed4-a8aa-323446abaeef tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:59.967202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:42:59.968267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:42:59.968898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:42:59.969498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:42:59.970114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:42:59.988600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:59.989281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:59.989922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:42:59.990894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:42:59.991361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:42:59.991791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:00.035158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Getting quotas for project a553b48a66bf4ff7829bd4c26368dac4. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:43:00.046332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Getting quotas for user 929729edafef461692e4e44adeea5bc1 and project a553b48a66bf4ff7829bd4c26368dac4. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:43:00.086325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:43:00.095481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:43:00.179045 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d9badaa-f663-43c8-ad7e-c85cb46ee461 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.422702 Oct 05 17:43:00.179713 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1371/2559] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:42:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:43:00.192457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc7f51b2-45f3-40ad-9b4d-afc53ba55176 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:00.193124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc7f51b2-45f3-40ad-9b4d-afc53ba55176 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:00.196119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:00.204919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc7f51b2-45f3-40ad-9b4d-afc53ba55176 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:00.205673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc7f51b2-45f3-40ad-9b4d-afc53ba55176 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:00.206266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc7f51b2-45f3-40ad-9b4d-afc53ba55176 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:00.207361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc7f51b2-45f3-40ad-9b4d-afc53ba55176 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:00.208059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc7f51b2-45f3-40ad-9b4d-afc53ba55176 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:00.208880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc7f51b2-45f3-40ad-9b4d-afc53ba55176 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:00.264633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-868eb081-9b8b-4ed4-a8aa-323446abaeef tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:00.273966 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-868eb081-9b8b-4ed4-a8aa-323446abaeef tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.955953 Oct 05 17:43:00.275321 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1189/2560] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:42:59 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:00.281425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a9e46915-093e-4134-824d-acc21dd58f77 req-7ad4c3c7-460b-4b65-a8f3-36a84254b596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80ed110-8f6b-4126-a565-bb874a0de577", "name": "network-vif-plugged", "status": "completed", "tag": "4c75e5be-d490-4be8-bdbf-b88f7b406cb7"}, {"server_uuid": "1f2c8db2-f243-4f95-8554-5f6456b4f18e", "name": "network-vif-unplugged", "status": "completed", "tag": "c45bec95-980b-4f58-b5d6-bc729046e986"}, {"server_uuid": "05e13165-324b-4dbf-b095-9d7629b0f570", "name": "network-vif-plugged", "status": "completed", "tag": "8e71d756-2bfa-46ef-b903-90032171c8ce"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:00.294334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a9e46915-093e-4134-824d-acc21dd58f77 req-7ad4c3c7-460b-4b65-a8f3-36a84254b596 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:00.295167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a9e46915-093e-4134-824d-acc21dd58f77 req-7ad4c3c7-460b-4b65-a8f3-36a84254b596 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:00.296224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a9e46915-093e-4134-824d-acc21dd58f77 req-7ad4c3c7-460b-4b65-a8f3-36a84254b596 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:00.316292 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a9e46915-093e-4134-824d-acc21dd58f77 req-7ad4c3c7-460b-4b65-a8f3-36a84254b596 service nova] Creating event network-vif-plugged:4c75e5be-d490-4be8-bdbf-b88f7b406cb7 for instance b80ed110-8f6b-4126-a565-bb874a0de577 on n-h1-835595-3 Oct 05 17:43:00.317051 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a9e46915-093e-4134-824d-acc21dd58f77 req-7ad4c3c7-460b-4b65-a8f3-36a84254b596 service nova] Creating event network-vif-unplugged:c45bec95-980b-4f58-b5d6-bc729046e986 for instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e on n-h1-835595-3 Oct 05 17:43:00.317748 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a9e46915-093e-4134-824d-acc21dd58f77 req-7ad4c3c7-460b-4b65-a8f3-36a84254b596 service nova] Creating event network-vif-plugged:8e71d756-2bfa-46ef-b903-90032171c8ce for instance 05e13165-324b-4dbf-b095-9d7629b0f570 on n-h2-835595-3 Oct 05 17:43:00.329520 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a9e46915-093e-4134-824d-acc21dd58f77 req-7ad4c3c7-460b-4b65-a8f3-36a84254b596 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.052716 Oct 05 17:43:00.331006 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1190/2561] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:00.339645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e573d086-6b58-4616-bb06-66a678ae0e9f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:00.340812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e573d086-6b58-4616-bb06-66a678ae0e9f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:00.347994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e573d086-6b58-4616-bb06-66a678ae0e9f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:00.348820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e573d086-6b58-4616-bb06-66a678ae0e9f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:00.349435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e573d086-6b58-4616-bb06-66a678ae0e9f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:00.351195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e573d086-6b58-4616-bb06-66a678ae0e9f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:00.351884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e573d086-6b58-4616-bb06-66a678ae0e9f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:00.352536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e573d086-6b58-4616-bb06-66a678ae0e9f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:00.421935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc7f51b2-45f3-40ad-9b4d-afc53ba55176 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:00.441072 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc7f51b2-45f3-40ad-9b4d-afc53ba55176 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1260 microversion: 2.1 time: 0.257460 Oct 05 17:43:00.443093 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1372/2562] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:00 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1260 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:00.451824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b6358aaa-2d72-44b5-a1d6-903cf4ea4898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:00.457209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b6358aaa-2d72-44b5-a1d6-903cf4ea4898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:00.479173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6358aaa-2d72-44b5-a1d6-903cf4ea4898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:00.479460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6358aaa-2d72-44b5-a1d6-903cf4ea4898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:00.479898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6358aaa-2d72-44b5-a1d6-903cf4ea4898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:00.480612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6358aaa-2d72-44b5-a1d6-903cf4ea4898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:00.481064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6358aaa-2d72-44b5-a1d6-903cf4ea4898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:00.481486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6358aaa-2d72-44b5-a1d6-903cf4ea4898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:00.809313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e573d086-6b58-4616-bb06-66a678ae0e9f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:00.820039 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e573d086-6b58-4616-bb06-66a678ae0e9f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1310 microversion: 2.1 time: 0.486873 Oct 05 17:43:00.821730 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1191/2563] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:00 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1310 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:00.850068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:00.852340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:00.866784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:00.868572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:00.869028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:00.869756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:00.870221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:00.870449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b6358aaa-2d72-44b5-a1d6-903cf4ea4898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:00.875175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:00.880491 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b6358aaa-2d72-44b5-a1d6-903cf4ea4898 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.432991 Oct 05 17:43:00.887959 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1373/2564] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:00 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:00.893152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-becddb95-57e6-4b94-9207-fb61cbad3edb tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:00.911341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-becddb95-57e6-4b94-9207-fb61cbad3edb tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:01.010107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-becddb95-57e6-4b94-9207-fb61cbad3edb tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:01.018526 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-becddb95-57e6-4b94-9207-fb61cbad3edb tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1216 microversion: 2.1 time: 0.129128 Oct 05 17:43:01.019916 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1374/2565] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:00 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1216 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:01.024851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ccfc6a7-3e63-4861-87d8-eb9cc6c60426 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:01.025640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8ccfc6a7-3e63-4861-87d8-eb9cc6c60426 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:01.033786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ccfc6a7-3e63-4861-87d8-eb9cc6c60426 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:01.034166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ccfc6a7-3e63-4861-87d8-eb9cc6c60426 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:01.034839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ccfc6a7-3e63-4861-87d8-eb9cc6c60426 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:01.035487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ccfc6a7-3e63-4861-87d8-eb9cc6c60426 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:01.036000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ccfc6a7-3e63-4861-87d8-eb9cc6c60426 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:01.036493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ccfc6a7-3e63-4861-87d8-eb9cc6c60426 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:01.230475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8ccfc6a7-3e63-4861-87d8-eb9cc6c60426 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:01.244475 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8ccfc6a7-3e63-4861-87d8-eb9cc6c60426 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.223203 Oct 05 17:43:01.259302 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1375/2566] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:01 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:01.297783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a53c1a84-05ec-4af1-98a8-02272c56b631 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:01.298960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a53c1a84-05ec-4af1-98a8-02272c56b631 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:01.325859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a53c1a84-05ec-4af1-98a8-02272c56b631 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:01.327905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a53c1a84-05ec-4af1-98a8-02272c56b631 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:01.329846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a53c1a84-05ec-4af1-98a8-02272c56b631 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:01.332006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a53c1a84-05ec-4af1-98a8-02272c56b631 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:01.333227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a53c1a84-05ec-4af1-98a8-02272c56b631 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:01.334528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a53c1a84-05ec-4af1-98a8-02272c56b631 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:01.384894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:01.415604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:01.420165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:01.425034 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-abb6d9ed-ac09-42d0-a40e-8f673ccc7175 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.585443 Oct 05 17:43:01.425669 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1192/2567] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:00 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:01.462360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-31e1412c-923b-4d96-804e-cecdc644e69a req-aafead7d-004d-40e8-a5f3-1b751a178348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2c8db2-f243-4f95-8554-5f6456b4f18e", "name": "network-vif-deleted", "tag": "c45bec95-980b-4f58-b5d6-bc729046e986"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:01.506660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-31e1412c-923b-4d96-804e-cecdc644e69a req-aafead7d-004d-40e8-a5f3-1b751a178348 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:01.508294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-31e1412c-923b-4d96-804e-cecdc644e69a req-aafead7d-004d-40e8-a5f3-1b751a178348 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:01.509121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-31e1412c-923b-4d96-804e-cecdc644e69a req-aafead7d-004d-40e8-a5f3-1b751a178348 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:01.556139 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-31e1412c-923b-4d96-804e-cecdc644e69a req-aafead7d-004d-40e8-a5f3-1b751a178348 service nova] Creating event network-vif-deleted:c45bec95-980b-4f58-b5d6-bc729046e986 for instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e on n-h1-835595-3 Oct 05 17:43:01.570061 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-31e1412c-923b-4d96-804e-cecdc644e69a req-aafead7d-004d-40e8-a5f3-1b751a178348 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116660 Oct 05 17:43:01.571097 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1193/2568] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:01.580684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2afee36b-6755-4a5d-8e83-114adb8d0b4b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:01.585060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2afee36b-6755-4a5d-8e83-114adb8d0b4b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:01.598848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afee36b-6755-4a5d-8e83-114adb8d0b4b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:01.599354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afee36b-6755-4a5d-8e83-114adb8d0b4b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:01.599864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afee36b-6755-4a5d-8e83-114adb8d0b4b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:01.600582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afee36b-6755-4a5d-8e83-114adb8d0b4b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:01.601085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afee36b-6755-4a5d-8e83-114adb8d0b4b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:01.601605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afee36b-6755-4a5d-8e83-114adb8d0b4b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:01.733004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a53c1a84-05ec-4af1-98a8-02272c56b631 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:01.746943 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a53c1a84-05ec-4af1-98a8-02272c56b631 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.453311 Oct 05 17:43:01.748509 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1376/2569] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:01 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:01.749465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2afee36b-6755-4a5d-8e83-114adb8d0b4b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:01.761266 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2afee36b-6755-4a5d-8e83-114adb8d0b4b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1278 microversion: 2.1 time: 0.185637 Oct 05 17:43:01.764219 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1194/2570] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:01 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1278 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:01.847884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d028a0d0-9ff1-4403-a0dc-6a2cb6fa247b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:01.848584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d028a0d0-9ff1-4403-a0dc-6a2cb6fa247b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:01.858698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d028a0d0-9ff1-4403-a0dc-6a2cb6fa247b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:01.859657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d028a0d0-9ff1-4403-a0dc-6a2cb6fa247b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:01.860254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d028a0d0-9ff1-4403-a0dc-6a2cb6fa247b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:01.862056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d028a0d0-9ff1-4403-a0dc-6a2cb6fa247b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:01.863398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d028a0d0-9ff1-4403-a0dc-6a2cb6fa247b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:01.864052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d028a0d0-9ff1-4403-a0dc-6a2cb6fa247b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:02.041265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a047c46e-b20f-4af8-92aa-37e7e830f5f6 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:02.041888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a047c46e-b20f-4af8-92aa-37e7e830f5f6 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:02.053384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a047c46e-b20f-4af8-92aa-37e7e830f5f6 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:02.053892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a047c46e-b20f-4af8-92aa-37e7e830f5f6 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:02.054355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a047c46e-b20f-4af8-92aa-37e7e830f5f6 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:02.058760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a047c46e-b20f-4af8-92aa-37e7e830f5f6 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:02.059359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a047c46e-b20f-4af8-92aa-37e7e830f5f6 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:02.059822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a047c46e-b20f-4af8-92aa-37e7e830f5f6 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:02.168889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a047c46e-b20f-4af8-92aa-37e7e830f5f6 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:02.181781 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a047c46e-b20f-4af8-92aa-37e7e830f5f6 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1212 microversion: 2.1 time: 0.144426 Oct 05 17:43:02.198444 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1195/2571] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:02 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1212 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:02.271438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9bbd3be-a688-4315-afac-4a0ca6491273 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:02.272107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f9bbd3be-a688-4315-afac-4a0ca6491273 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:02.291152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bbd3be-a688-4315-afac-4a0ca6491273 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:02.291674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bbd3be-a688-4315-afac-4a0ca6491273 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:02.294518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bbd3be-a688-4315-afac-4a0ca6491273 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:02.295296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bbd3be-a688-4315-afac-4a0ca6491273 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:02.295778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bbd3be-a688-4315-afac-4a0ca6491273 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:02.301386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bbd3be-a688-4315-afac-4a0ca6491273 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:02.639522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f9bbd3be-a688-4315-afac-4a0ca6491273 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:02.651910 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f9bbd3be-a688-4315-afac-4a0ca6491273 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1325 microversion: 2.1 time: 0.385488 Oct 05 17:43:02.653323 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1196/2572] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:02 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1325 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:02.665693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:02.666389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:02.682048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:02.682686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:02.685197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:02.687062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:02.688273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:02.688894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:02.958639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d028a0d0-9ff1-4403-a0dc-6a2cb6fa247b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:02.977935 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d028a0d0-9ff1-4403-a0dc-6a2cb6fa247b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1310 microversion: 2.1 time: 1.135377 Oct 05 17:43:02.979801 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1377/2573] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:01 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1310 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:03.011794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a344ac91-ad69-4eaf-9ed2-a66b7dc86364 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:03.012426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a344ac91-ad69-4eaf-9ed2-a66b7dc86364 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:03.029593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a344ac91-ad69-4eaf-9ed2-a66b7dc86364 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:03.030384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a344ac91-ad69-4eaf-9ed2-a66b7dc86364 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:03.032620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a344ac91-ad69-4eaf-9ed2-a66b7dc86364 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:03.033362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a344ac91-ad69-4eaf-9ed2-a66b7dc86364 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:03.033826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a344ac91-ad69-4eaf-9ed2-a66b7dc86364 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:03.034259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a344ac91-ad69-4eaf-9ed2-a66b7dc86364 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:03.321602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:03.332858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:03.339910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:03.346773 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d40acffa-931c-4869-90c1-035bd7dcc1eb tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.690783 Oct 05 17:43:03.347712 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1197/2574] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:02 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:03.359165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9011efc5-9476-43a8-8f53-612242023ce5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:03.360124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9011efc5-9476-43a8-8f53-612242023ce5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:03.379101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9011efc5-9476-43a8-8f53-612242023ce5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:03.379963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9011efc5-9476-43a8-8f53-612242023ce5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:03.380632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9011efc5-9476-43a8-8f53-612242023ce5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:03.381594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9011efc5-9476-43a8-8f53-612242023ce5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:03.382263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9011efc5-9476-43a8-8f53-612242023ce5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:03.382926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9011efc5-9476-43a8-8f53-612242023ce5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:03.389794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a344ac91-ad69-4eaf-9ed2-a66b7dc86364 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:03.410905 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a344ac91-ad69-4eaf-9ed2-a66b7dc86364 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1334 microversion: 2.1 time: 0.427817 Oct 05 17:43:03.411531 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1378/2575] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:02 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1334 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:03.432719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7c3b9c91-17f9-4ed9-9315-9bc837acb67d tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:03.433355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7c3b9c91-17f9-4ed9-9315-9bc837acb67d tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:03.453921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c3b9c91-17f9-4ed9-9315-9bc837acb67d tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:03.454515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c3b9c91-17f9-4ed9-9315-9bc837acb67d tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:03.455066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c3b9c91-17f9-4ed9-9315-9bc837acb67d tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:03.456483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c3b9c91-17f9-4ed9-9315-9bc837acb67d tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:03.456968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c3b9c91-17f9-4ed9-9315-9bc837acb67d tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:03.457406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c3b9c91-17f9-4ed9-9315-9bc837acb67d tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:03.499286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9011efc5-9476-43a8-8f53-612242023ce5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:03.514758 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9011efc5-9476-43a8-8f53-612242023ce5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1266 microversion: 2.1 time: 0.165596 Oct 05 17:43:03.515363 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1198/2576] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:03 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:03.681565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da9cf6fa-5c7c-4d7d-bf90-1895403e68af tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:03.683004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da9cf6fa-5c7c-4d7d-bf90-1895403e68af tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:03.690479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da9cf6fa-5c7c-4d7d-bf90-1895403e68af tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:03.694831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da9cf6fa-5c7c-4d7d-bf90-1895403e68af tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:03.695472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da9cf6fa-5c7c-4d7d-bf90-1895403e68af tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:03.698227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da9cf6fa-5c7c-4d7d-bf90-1895403e68af tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:03.698912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da9cf6fa-5c7c-4d7d-bf90-1895403e68af tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:03.701668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da9cf6fa-5c7c-4d7d-bf90-1895403e68af tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:03.706201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7c3b9c91-17f9-4ed9-9315-9bc837acb67d tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:03.720465 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7c3b9c91-17f9-4ed9-9315-9bc837acb67d tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1274 microversion: 2.1 time: 0.296324 Oct 05 17:43:03.734920 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1379/2577] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:03 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1274 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:04.008661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-62e5bdcc-adb0-4dcd-91f1-4b4169f61ebf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:04.009526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-62e5bdcc-adb0-4dcd-91f1-4b4169f61ebf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:04.016038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62e5bdcc-adb0-4dcd-91f1-4b4169f61ebf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.016733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62e5bdcc-adb0-4dcd-91f1-4b4169f61ebf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.017327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62e5bdcc-adb0-4dcd-91f1-4b4169f61ebf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.018208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62e5bdcc-adb0-4dcd-91f1-4b4169f61ebf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.019203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62e5bdcc-adb0-4dcd-91f1-4b4169f61ebf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.019802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62e5bdcc-adb0-4dcd-91f1-4b4169f61ebf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.177378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-da9cf6fa-5c7c-4d7d-bf90-1895403e68af tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:04.195725 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da9cf6fa-5c7c-4d7d-bf90-1895403e68af tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1522 microversion: 2.1 time: 0.518331 Oct 05 17:43:04.198593 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1199/2578] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:03 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:04.223354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a7a49bc4-75fc-4bb7-9cdb-cec9e36781ef tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:04.224229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a7a49bc4-75fc-4bb7-9cdb-cec9e36781ef tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:04.227492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:04.236191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a49bc4-75fc-4bb7-9cdb-cec9e36781ef tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.242776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a49bc4-75fc-4bb7-9cdb-cec9e36781ef tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.243648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a49bc4-75fc-4bb7-9cdb-cec9e36781ef tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.244640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a49bc4-75fc-4bb7-9cdb-cec9e36781ef tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.245325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a49bc4-75fc-4bb7-9cdb-cec9e36781ef tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.245997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a49bc4-75fc-4bb7-9cdb-cec9e36781ef tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.352706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-62e5bdcc-adb0-4dcd-91f1-4b4169f61ebf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:04.362158 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-62e5bdcc-adb0-4dcd-91f1-4b4169f61ebf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1310 microversion: 2.1 time: 0.358148 Oct 05 17:43:04.364800 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1380/2579] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:04 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1310 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:04.380188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:04.396468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:04.415153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.422918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.423691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.424360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.425114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.427159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.669480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:04.679566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:04.681040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:04.682222 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9c5d4d5-b577-448f-81c0-458b4075695b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.308802 Oct 05 17:43:04.684453 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1381/2580] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:04 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:04.690398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d4f80234-cc12-449a-bb70-2d6e72d4ebc4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:04.691213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d4f80234-cc12-449a-bb70-2d6e72d4ebc4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:04.698990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4f80234-cc12-449a-bb70-2d6e72d4ebc4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.699682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4f80234-cc12-449a-bb70-2d6e72d4ebc4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.700292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4f80234-cc12-449a-bb70-2d6e72d4ebc4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.701145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4f80234-cc12-449a-bb70-2d6e72d4ebc4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.701748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4f80234-cc12-449a-bb70-2d6e72d4ebc4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.702710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4f80234-cc12-449a-bb70-2d6e72d4ebc4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.752776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a7a49bc4-75fc-4bb7-9cdb-cec9e36781ef tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:04.769714 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a7a49bc4-75fc-4bb7-9cdb-cec9e36781ef tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1522 microversion: 2.1 time: 0.550094 Oct 05 17:43:04.770726 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1200/2581] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:04 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:04.775777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d8c85cde-9549-4029-a50d-76e1a728c6e4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:04.776392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d8c85cde-9549-4029-a50d-76e1a728c6e4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:04.801160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c85cde-9549-4029-a50d-76e1a728c6e4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.802077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c85cde-9549-4029-a50d-76e1a728c6e4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.802735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c85cde-9549-4029-a50d-76e1a728c6e4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.803694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c85cde-9549-4029-a50d-76e1a728c6e4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.804229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c85cde-9549-4029-a50d-76e1a728c6e4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.805384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c85cde-9549-4029-a50d-76e1a728c6e4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.888769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d4f80234-cc12-449a-bb70-2d6e72d4ebc4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:04.898138 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d4f80234-cc12-449a-bb70-2d6e72d4ebc4 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1669 microversion: 2.1 time: 0.212396 Oct 05 17:43:04.901580 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1382/2582] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:04 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1669 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:04.907025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ead01190-bcf1-48d9-a0d7-ec536240d607 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:04.919769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ead01190-bcf1-48d9-a0d7-ec536240d607 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:04.933407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead01190-bcf1-48d9-a0d7-ec536240d607 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.934341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead01190-bcf1-48d9-a0d7-ec536240d607 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.934703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead01190-bcf1-48d9-a0d7-ec536240d607 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:04.941257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead01190-bcf1-48d9-a0d7-ec536240d607 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:04.941757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead01190-bcf1-48d9-a0d7-ec536240d607 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:04.942182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead01190-bcf1-48d9-a0d7-ec536240d607 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.031351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ead01190-bcf1-48d9-a0d7-ec536240d607 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:05.042540 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ead01190-bcf1-48d9-a0d7-ec536240d607 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1274 microversion: 2.1 time: 0.139027 Oct 05 17:43:05.043504 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1383/2583] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:04 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:05.049813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9e585904-c9c5-4a28-9307-a556e8fdfdad tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1113989098", "metadata": {"": ""}}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9e585904-c9c5-4a28-9307-a556e8fdfdad tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action HTTP/1.1 Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 107 Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1113989098", "metadata": {"": ""}}} Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '05e13165-324b-4dbf-b095-9d7629b0f570', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1113989098', 'metadata': {'': ''}}}} Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'': ''} Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:43:05.056045 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9e585904-c9c5-4a28-9307-a556e8fdfdad tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9e585904-c9c5-4a28-9307-a556e8fdfdad tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action" status: 400 len: 170 microversion: 2.1 time: 0.014402 Oct 05 17:43:05.060053 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1384/2584] 10.222.0.70 () {60 vars in 1279 bytes} [Wed Oct 5 17:43:05 2022] POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action => generated 170 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:43:05.065515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-af7cfc53-7ef8-48e0-ba05-60b230055ba6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:05.066073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-af7cfc53-7ef8-48e0-ba05-60b230055ba6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:05.073960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af7cfc53-7ef8-48e0-ba05-60b230055ba6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.074568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af7cfc53-7ef8-48e0-ba05-60b230055ba6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.075066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af7cfc53-7ef8-48e0-ba05-60b230055ba6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.075862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af7cfc53-7ef8-48e0-ba05-60b230055ba6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.076379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af7cfc53-7ef8-48e0-ba05-60b230055ba6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.076869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af7cfc53-7ef8-48e0-ba05-60b230055ba6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.102139 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-af7cfc53-7ef8-48e0-ba05-60b230055ba6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577/ips" status: 200 len: 179 microversion: 2.1 time: 0.041131 Oct 05 17:43:05.102928 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1385/2585] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:43:05 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577/ips => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:05.107660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5900b0db-b788-4dd0-b207-6a6f23833f37 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:05.108286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5900b0db-b788-4dd0-b207-6a6f23833f37 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:05.119146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5900b0db-b788-4dd0-b207-6a6f23833f37 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.119646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5900b0db-b788-4dd0-b207-6a6f23833f37 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.120232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5900b0db-b788-4dd0-b207-6a6f23833f37 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.120954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5900b0db-b788-4dd0-b207-6a6f23833f37 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.121399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5900b0db-b788-4dd0-b207-6a6f23833f37 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.121819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5900b0db-b788-4dd0-b207-6a6f23833f37 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.143891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:05.290788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5900b0db-b788-4dd0-b207-6a6f23833f37 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:05.299626 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5900b0db-b788-4dd0-b207-6a6f23833f37 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1522 microversion: 2.1 time: 0.195519 Oct 05 17:43:05.310452 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1386/2586] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:05 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:05.310452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ae2586a-fbbf-49f7-b59f-4c9b498bface tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:05.310452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ae2586a-fbbf-49f7-b59f-4c9b498bface tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:05.312545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ae2586a-fbbf-49f7-b59f-4c9b498bface tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.313028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ae2586a-fbbf-49f7-b59f-4c9b498bface tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.313464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ae2586a-fbbf-49f7-b59f-4c9b498bface tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.314171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ae2586a-fbbf-49f7-b59f-4c9b498bface tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.314658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ae2586a-fbbf-49f7-b59f-4c9b498bface tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.315079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ae2586a-fbbf-49f7-b59f-4c9b498bface tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.349809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ae2586a-fbbf-49f7-b59f-4c9b498bface tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:43:05.473206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ae2586a-fbbf-49f7-b59f-4c9b498bface tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 204 len: 0 microversion: 2.1 time: 0.170769 Oct 05 17:43:05.474550 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1387/2587] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:43:05 2022] DELETE /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:43:05.482733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d52192b2-3e0d-4062-beed-5f958afbb1d9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:05.483853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d52192b2-3e0d-4062-beed-5f958afbb1d9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:05.495129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d52192b2-3e0d-4062-beed-5f958afbb1d9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.496200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d52192b2-3e0d-4062-beed-5f958afbb1d9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.496868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d52192b2-3e0d-4062-beed-5f958afbb1d9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.497887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d52192b2-3e0d-4062-beed-5f958afbb1d9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.499102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d52192b2-3e0d-4062-beed-5f958afbb1d9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.499705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d52192b2-3e0d-4062-beed-5f958afbb1d9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.660378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d52192b2-3e0d-4062-beed-5f958afbb1d9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:05.672263 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d52192b2-3e0d-4062-beed-5f958afbb1d9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1522 microversion: 2.1 time: 0.195077 Oct 05 17:43:05.685543 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1388/2588] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:05 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:05.696730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d7238f50-99f6-4c5f-a164-27a2ca47cfb9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:05.700981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d8c85cde-9549-4029-a50d-76e1a728c6e4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:05.704732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d7238f50-99f6-4c5f-a164-27a2ca47cfb9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:05.709886 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d8c85cde-9549-4029-a50d-76e1a728c6e4 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1308 microversion: 2.1 time: 0.937843 Oct 05 17:43:05.714210 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1201/2589] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:04 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1308 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:05.722995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7238f50-99f6-4c5f-a164-27a2ca47cfb9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.723545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7238f50-99f6-4c5f-a164-27a2ca47cfb9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.724675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7238f50-99f6-4c5f-a164-27a2ca47cfb9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.724880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-341a84ec-b049-4022-9623-39cc1d0a9270 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:05.726700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7238f50-99f6-4c5f-a164-27a2ca47cfb9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.727099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-341a84ec-b049-4022-9623-39cc1d0a9270 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:05.728597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7238f50-99f6-4c5f-a164-27a2ca47cfb9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.730040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7238f50-99f6-4c5f-a164-27a2ca47cfb9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.739623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-341a84ec-b049-4022-9623-39cc1d0a9270 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.740780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-341a84ec-b049-4022-9623-39cc1d0a9270 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.741335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-341a84ec-b049-4022-9623-39cc1d0a9270 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.742138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-341a84ec-b049-4022-9623-39cc1d0a9270 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.742782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-341a84ec-b049-4022-9623-39cc1d0a9270 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.743378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-341a84ec-b049-4022-9623-39cc1d0a9270 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.769805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:05.887950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d7238f50-99f6-4c5f-a164-27a2ca47cfb9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:05.896091 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d7238f50-99f6-4c5f-a164-27a2ca47cfb9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1310 microversion: 2.1 time: 0.209374 Oct 05 17:43:05.896714 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1389/2590] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:05 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1310 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:05.902110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac6185af-c358-43f4-ab48-b656d2ffcdcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1915197200", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac6185af-c358-43f4-ab48-b656d2ffcdcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action HTTP/1.1 Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 619 Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1915197200", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '05e13165-324b-4dbf-b095-9d7629b0f570', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1915197200', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:43:05.913432 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:43:05.916543 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:05.920435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac6185af-c358-43f4-ab48-b656d2ffcdcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:05.920435 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac6185af-c358-43f4-ab48-b656d2ffcdcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action" status: 400 len: 938 microversion: 2.1 time: 0.017250 Oct 05 17:43:05.920435 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1390/2591] 10.222.0.70 () {60 vars in 1279 bytes} [Wed Oct 5 17:43:05 2022] POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action => generated 938 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:43:05.924001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:05.924804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:05.934815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.935311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.935755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:05.936462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:05.936924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:05.937356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.133428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:06.143716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:06.145178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:06.146407 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7db1d96b-51b8-451d-aa8b-154b8a8113e9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.226344 Oct 05 17:43:06.147104 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1391/2592] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:05 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:06.152544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-40285b69-8238-48cc-a85d-1e97495fd2bd req-041567a8-3a05-431e-8c12-bbadb2b6948f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8bc911-1ed0-4477-95a8-9b63aeb837aa", "name": "network-vif-plugged", "status": "completed", "tag": "2adbf98a-5ee3-4501-8cde-8d0b03b4a187"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:06.158616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-341a84ec-b049-4022-9623-39cc1d0a9270 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:06.164898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-40285b69-8238-48cc-a85d-1e97495fd2bd req-041567a8-3a05-431e-8c12-bbadb2b6948f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.165893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-40285b69-8238-48cc-a85d-1e97495fd2bd req-041567a8-3a05-431e-8c12-bbadb2b6948f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.166743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-40285b69-8238-48cc-a85d-1e97495fd2bd req-041567a8-3a05-431e-8c12-bbadb2b6948f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.180964 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-40285b69-8238-48cc-a85d-1e97495fd2bd req-041567a8-3a05-431e-8c12-bbadb2b6948f service nova] Creating event network-vif-plugged:2adbf98a-5ee3-4501-8cde-8d0b03b4a187 for instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa on n-h1-835595-3 Oct 05 17:43:06.183741 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-341a84ec-b049-4022-9623-39cc1d0a9270 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1675 microversion: 2.1 time: 0.468237 Oct 05 17:43:06.184349 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1202/2593] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:05 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1675 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:06.199253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-302d1ae7-15fc-42fe-ad52-9edf85661ff8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:06.205595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-302d1ae7-15fc-42fe-ad52-9edf85661ff8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:06.207802 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-40285b69-8238-48cc-a85d-1e97495fd2bd req-041567a8-3a05-431e-8c12-bbadb2b6948f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059175 Oct 05 17:43:06.208485 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1392/2594] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:06.215685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3f52d606-2495-4118-a003-d4fe04929b32 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:06.216464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3f52d606-2495-4118-a003-d4fe04929b32 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:06.218495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302d1ae7-15fc-42fe-ad52-9edf85661ff8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.219093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302d1ae7-15fc-42fe-ad52-9edf85661ff8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.219869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302d1ae7-15fc-42fe-ad52-9edf85661ff8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.220766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302d1ae7-15fc-42fe-ad52-9edf85661ff8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.221381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302d1ae7-15fc-42fe-ad52-9edf85661ff8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.221968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-302d1ae7-15fc-42fe-ad52-9edf85661ff8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.225740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f52d606-2495-4118-a003-d4fe04929b32 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.226242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f52d606-2495-4118-a003-d4fe04929b32 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.227512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f52d606-2495-4118-a003-d4fe04929b32 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.228381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f52d606-2495-4118-a003-d4fe04929b32 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.229259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f52d606-2495-4118-a003-d4fe04929b32 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.229884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f52d606-2495-4118-a003-d4fe04929b32 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.392664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3f52d606-2495-4118-a003-d4fe04929b32 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:06.401222 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3f52d606-2495-4118-a003-d4fe04929b32 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1316 microversion: 2.1 time: 0.190760 Oct 05 17:43:06.402416 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1393/2595] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:06 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:06.668890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-302d1ae7-15fc-42fe-ad52-9edf85661ff8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:06.677624 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-302d1ae7-15fc-42fe-ad52-9edf85661ff8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1522 microversion: 2.1 time: 0.487838 Oct 05 17:43:06.678543 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1203/2596] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:06 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:06.702000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e55ed0d-e478-478d-83f1-8acb87a223f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:06.703775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e55ed0d-e478-478d-83f1-8acb87a223f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:06.711019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e55ed0d-e478-478d-83f1-8acb87a223f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.711509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e55ed0d-e478-478d-83f1-8acb87a223f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.711936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e55ed0d-e478-478d-83f1-8acb87a223f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.712631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e55ed0d-e478-478d-83f1-8acb87a223f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.713088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e55ed0d-e478-478d-83f1-8acb87a223f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.713655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e55ed0d-e478-478d-83f1-8acb87a223f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.737676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fe8055f6-395d-41df-9b26-c8fe589c91b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:06.739364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fe8055f6-395d-41df-9b26-c8fe589c91b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:06.745998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe8055f6-395d-41df-9b26-c8fe589c91b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.746937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe8055f6-395d-41df-9b26-c8fe589c91b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.747384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe8055f6-395d-41df-9b26-c8fe589c91b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.748318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe8055f6-395d-41df-9b26-c8fe589c91b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.748764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe8055f6-395d-41df-9b26-c8fe589c91b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.749406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe8055f6-395d-41df-9b26-c8fe589c91b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.852022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e55ed0d-e478-478d-83f1-8acb87a223f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:06.869490 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e55ed0d-e478-478d-83f1-8acb87a223f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1522 microversion: 2.1 time: 0.171255 Oct 05 17:43:06.870015 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1394/2597] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:06 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:06.896331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7f656849-6f59-4ca0-81a7-7eec1aba4ac7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7f656849-6f59-4ca0-81a7-7eec1aba4ac7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action HTTP/1.1 Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 285 Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '05e13165-324b-4dbf-b095-9d7629b0f570', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:06.902241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 17:43:06.905540 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:06.909068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7f656849-6f59-4ca0-81a7-7eec1aba4ac7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:06.910348 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7f656849-6f59-4ca0-81a7-7eec1aba4ac7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action" status: 400 len: 619 microversion: 2.1 time: 0.020141 Oct 05 17:43:06.910896 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1395/2598] 10.222.0.70 () {60 vars in 1279 bytes} [Wed Oct 5 17:43:06 2022] POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action => generated 619 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:43:06.920447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-62415401-3252-4f9e-aa5b-78d6a3ede228 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:06.921057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-62415401-3252-4f9e-aa5b-78d6a3ede228 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:06.931647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62415401-3252-4f9e-aa5b-78d6a3ede228 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.932473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62415401-3252-4f9e-aa5b-78d6a3ede228 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.933100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62415401-3252-4f9e-aa5b-78d6a3ede228 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:06.934453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62415401-3252-4f9e-aa5b-78d6a3ede228 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:06.934911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62415401-3252-4f9e-aa5b-78d6a3ede228 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:06.935527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62415401-3252-4f9e-aa5b-78d6a3ede228 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.165612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-62415401-3252-4f9e-aa5b-78d6a3ede228 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:07.175889 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-62415401-3252-4f9e-aa5b-78d6a3ede228 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1310 microversion: 2.1 time: 0.260470 Oct 05 17:43:07.190697 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1396/2599] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:06 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1310 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:07.197522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-41a3dcb5-664e-412c-a375-7723cc0e6385 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:07.198484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-41a3dcb5-664e-412c-a375-7723cc0e6385 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:07.204830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41a3dcb5-664e-412c-a375-7723cc0e6385 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.205602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41a3dcb5-664e-412c-a375-7723cc0e6385 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.206260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41a3dcb5-664e-412c-a375-7723cc0e6385 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.207180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41a3dcb5-664e-412c-a375-7723cc0e6385 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.207824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41a3dcb5-664e-412c-a375-7723cc0e6385 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.208469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41a3dcb5-664e-412c-a375-7723cc0e6385 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.218882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe8055f6-395d-41df-9b26-c8fe589c91b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:07.237501 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fe8055f6-395d-41df-9b26-c8fe589c91b5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1308 microversion: 2.1 time: 0.502979 Oct 05 17:43:07.239892 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1204/2600] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:06 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1308 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:07.246906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:07.247527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:07.264311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.269058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.269596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.270495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.271038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.279209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.476363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-41a3dcb5-664e-412c-a375-7723cc0e6385 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:07.492603 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-41a3dcb5-664e-412c-a375-7723cc0e6385 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1522 microversion: 2.1 time: 0.300315 Oct 05 17:43:07.493989 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1397/2601] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:07 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1522 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:07.502342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7fcf6a7c-25b0-4dfe-96a3-357113309f6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:07.503388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7fcf6a7c-25b0-4dfe-96a3-357113309f6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:07.518495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fcf6a7c-25b0-4dfe-96a3-357113309f6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.519007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fcf6a7c-25b0-4dfe-96a3-357113309f6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.519453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fcf6a7c-25b0-4dfe-96a3-357113309f6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.520313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fcf6a7c-25b0-4dfe-96a3-357113309f6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.521041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fcf6a7c-25b0-4dfe-96a3-357113309f6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.521784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fcf6a7c-25b0-4dfe-96a3-357113309f6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.795910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:07.799605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7fcf6a7c-25b0-4dfe-96a3-357113309f6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:07.808579 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7fcf6a7c-25b0-4dfe-96a3-357113309f6b tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1675 microversion: 2.1 time: 0.312569 Oct 05 17:43:07.809453 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1398/2602] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:07 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1675 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:07.812525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:07.813976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:07.814535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30df9b3f-bf46-4109-b01a-d72bca5ed064 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:07.815192 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c9d360f0-77a1-41d6-8535-f89a2283b93d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.573892 Oct 05 17:43:07.815448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-30df9b3f-bf46-4109-b01a-d72bca5ed064 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:07.822897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30df9b3f-bf46-4109-b01a-d72bca5ed064 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.823634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30df9b3f-bf46-4109-b01a-d72bca5ed064 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.824234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30df9b3f-bf46-4109-b01a-d72bca5ed064 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.826450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30df9b3f-bf46-4109-b01a-d72bca5ed064 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.826450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30df9b3f-bf46-4109-b01a-d72bca5ed064 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.826450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30df9b3f-bf46-4109-b01a-d72bca5ed064 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.833528 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1205/2603] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:07 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:07.839542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4d1ba1d2-de3b-4568-a03d-c477f3ed031e req-8202efd8-a299-4e68-a08e-1e1bfcdc0e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c03997c-01af-46a1-9887-9b72e2a2815b", "tag": "10e3d67e-7cde-4cc7-9263-0e9b5687690c"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:07.853163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4d1ba1d2-de3b-4568-a03d-c477f3ed031e req-8202efd8-a299-4e68-a08e-1e1bfcdc0e1d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.853831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4d1ba1d2-de3b-4568-a03d-c477f3ed031e req-8202efd8-a299-4e68-a08e-1e1bfcdc0e1d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.854459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4d1ba1d2-de3b-4568-a03d-c477f3ed031e req-8202efd8-a299-4e68-a08e-1e1bfcdc0e1d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.884671 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4d1ba1d2-de3b-4568-a03d-c477f3ed031e req-8202efd8-a299-4e68-a08e-1e1bfcdc0e1d service nova] Creating event network-changed:10e3d67e-7cde-4cc7-9263-0e9b5687690c for instance 9c03997c-01af-46a1-9887-9b72e2a2815b on n-h1-835595-3 Oct 05 17:43:07.890889 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4d1ba1d2-de3b-4568-a03d-c477f3ed031e req-8202efd8-a299-4e68-a08e-1e1bfcdc0e1d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057977 Oct 05 17:43:07.892016 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1206/2604] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:07.897897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c4bcb60-af63-4888-ac53-f00c0dd4024c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:07.899001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9c4bcb60-af63-4888-ac53-f00c0dd4024c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:07.912905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4bcb60-af63-4888-ac53-f00c0dd4024c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.913630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4bcb60-af63-4888-ac53-f00c0dd4024c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.914354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4bcb60-af63-4888-ac53-f00c0dd4024c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:07.918955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4bcb60-af63-4888-ac53-f00c0dd4024c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:07.919909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4bcb60-af63-4888-ac53-f00c0dd4024c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:07.920563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4bcb60-af63-4888-ac53-f00c0dd4024c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:08.114376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-30df9b3f-bf46-4109-b01a-d72bca5ed064 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:08.123320 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-30df9b3f-bf46-4109-b01a-d72bca5ed064 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1316 microversion: 2.1 time: 0.312669 Oct 05 17:43:08.124584 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1399/2605] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:07 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1316 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:08.202203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8fb41e6-03a3-4014-834d-2c680b6840fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:08.202873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c8fb41e6-03a3-4014-834d-2c680b6840fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:08.208933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8fb41e6-03a3-4014-834d-2c680b6840fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:08.209414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8fb41e6-03a3-4014-834d-2c680b6840fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:08.209844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8fb41e6-03a3-4014-834d-2c680b6840fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:08.210560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8fb41e6-03a3-4014-834d-2c680b6840fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:08.211011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8fb41e6-03a3-4014-834d-2c680b6840fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:08.211431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8fb41e6-03a3-4014-834d-2c680b6840fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:08.379124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8fb41e6-03a3-4014-834d-2c680b6840fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:08.391500 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c8fb41e6-03a3-4014-834d-2c680b6840fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1492 microversion: 2.1 time: 0.192974 Oct 05 17:43:08.392156 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1400/2606] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:08 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1492 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:08.401898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-846c1eb5-c45d-4e1d-b5ca-b02bfd054d59 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:08.403221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-846c1eb5-c45d-4e1d-b5ca-b02bfd054d59 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:08.405493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9c4bcb60-af63-4888-ac53-f00c0dd4024c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:08.412729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-846c1eb5-c45d-4e1d-b5ca-b02bfd054d59 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:08.413571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-846c1eb5-c45d-4e1d-b5ca-b02bfd054d59 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:08.413994 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9c4bcb60-af63-4888-ac53-f00c0dd4024c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1522 microversion: 2.1 time: 0.520602 Oct 05 17:43:08.414114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-846c1eb5-c45d-4e1d-b5ca-b02bfd054d59 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:08.414960 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1207/2607] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:07 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:08.415101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-846c1eb5-c45d-4e1d-b5ca-b02bfd054d59 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:08.415782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-846c1eb5-c45d-4e1d-b5ca-b02bfd054d59 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:08.416293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-846c1eb5-c45d-4e1d-b5ca-b02bfd054d59 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:08.485166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da975846-04d7-481c-bcc5-04eebfbfb965 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:08.486101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da975846-04d7-481c-bcc5-04eebfbfb965 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:08.492688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da975846-04d7-481c-bcc5-04eebfbfb965 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:08.493650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da975846-04d7-481c-bcc5-04eebfbfb965 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:08.494374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da975846-04d7-481c-bcc5-04eebfbfb965 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:08.495352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da975846-04d7-481c-bcc5-04eebfbfb965 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:08.499798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da975846-04d7-481c-bcc5-04eebfbfb965 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:08.500532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da975846-04d7-481c-bcc5-04eebfbfb965 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:08.621635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-846c1eb5-c45d-4e1d-b5ca-b02bfd054d59 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:08.633684 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-846c1eb5-c45d-4e1d-b5ca-b02bfd054d59 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1308 microversion: 2.1 time: 0.239841 Oct 05 17:43:08.634781 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1401/2608] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:08 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:08.640878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e88a4bdf-082f-4466-b0e2-418ee7233c14 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-904251097"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:08.643942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e88a4bdf-082f-4466-b0e2-418ee7233c14 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:08.654100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e88a4bdf-082f-4466-b0e2-418ee7233c14 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:08.655200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e88a4bdf-082f-4466-b0e2-418ee7233c14 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:08.657334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e88a4bdf-082f-4466-b0e2-418ee7233c14 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:08.659897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e88a4bdf-082f-4466-b0e2-418ee7233c14 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:08.660609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e88a4bdf-082f-4466-b0e2-418ee7233c14 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:08.661300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e88a4bdf-082f-4466-b0e2-418ee7233c14 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:08.922136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:08.946396 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e88a4bdf-082f-4466-b0e2-418ee7233c14 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action" status: 202 len: 0 microversion: 2.1 time: 0.309639 Oct 05 17:43:08.947846 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1402/2609] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:43:08 2022] POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 17:43:08.955295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27f1f401-70f2-4322-ae91-1e874c6a2dd8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:08.956304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-27f1f401-70f2-4322-ae91-1e874c6a2dd8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:08.964326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f1f401-70f2-4322-ae91-1e874c6a2dd8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:08.964931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f1f401-70f2-4322-ae91-1e874c6a2dd8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:08.965479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f1f401-70f2-4322-ae91-1e874c6a2dd8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:08.966214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f1f401-70f2-4322-ae91-1e874c6a2dd8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:08.966960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f1f401-70f2-4322-ae91-1e874c6a2dd8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:08.967657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27f1f401-70f2-4322-ae91-1e874c6a2dd8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:09.154564 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da975846-04d7-481c-bcc5-04eebfbfb965 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1643 microversion: 2.1 time: 0.735104 Oct 05 17:43:09.156623 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1208/2610] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:08 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1643 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:09.191526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:09.199378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:09.208086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:09.212297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:09.212864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:09.213652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:09.214141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:09.214608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:09.679077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-27f1f401-70f2-4322-ae91-1e874c6a2dd8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:09.690342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27f1f401-70f2-4322-ae91-1e874c6a2dd8 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1654 microversion: 2.1 time: 0.740962 Oct 05 17:43:09.707528 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1403/2611] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:08 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1654 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:09.712918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-209319297"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:09.715385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:09.721900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:09.722309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:09.722803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:09.723692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:09.723973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:09.724399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:09.756815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:09.763202 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Cannot 'createImage' instance 05e13165-324b-4dbf-b095-9d7629b0f570 while it is in task_state image_snapshot Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action HTTP/1.1 Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 84 Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-209319297"}} Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot 'createImage' instance 05e13165-324b-4dbf-b095-9d7629b0f570 while it is in task_state image_snapshot Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '05e13165-324b-4dbf-b095-9d7629b0f570', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-209319297'}}} Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 17:43:09.765319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 05e13165-324b-4dbf-b095-9d7629b0f570 while it is in task_state image_snapshot Oct 05 17:43:09.769799 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:09.769799 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:09.769799 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:09.769799 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:09.769799 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:09.769799 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:09.769799 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:43:09.769799 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:43:09.769799 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 05e13165-324b-4dbf-b095-9d7629b0f570 while it is in task_state image_snapshot Oct 05 17:43:09.769799 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:09.771609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 409 to user: Cannot 'createImage' instance 05e13165-324b-4dbf-b095-9d7629b0f570 while it is in task_state image_snapshot {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:09.772684 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae0becd4-d93f-41b4-a61e-c4dd02d2261b tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action" status: 409 len: 159 microversion: 2.1 time: 0.063847 Oct 05 17:43:09.773735 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1404/2612] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:43:09 2022] POST /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570/action => generated 159 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:43:09.776938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:09.779082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e7aedc00-f9ec-4208-b2b4-fa14473459ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:09.779217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:09.779996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e7aedc00-f9ec-4208-b2b4-fa14473459ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:09.781758 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-277f3798-a440-418d-b4d7-c20552120dd3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.622718 Oct 05 17:43:09.786787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7aedc00-f9ec-4208-b2b4-fa14473459ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:09.787488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7aedc00-f9ec-4208-b2b4-fa14473459ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:09.789814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7aedc00-f9ec-4208-b2b4-fa14473459ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:09.791908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7aedc00-f9ec-4208-b2b4-fa14473459ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:09.792389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7aedc00-f9ec-4208-b2b4-fa14473459ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:09.792652 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1209/2613] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:09 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:09.794845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7aedc00-f9ec-4208-b2b4-fa14473459ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:09.798857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ceeb8777-da17-4084-bff3-c19ae9cefefb tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:09.799770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ceeb8777-da17-4084-bff3-c19ae9cefefb tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:09.806665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceeb8777-da17-4084-bff3-c19ae9cefefb tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:09.807175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceeb8777-da17-4084-bff3-c19ae9cefefb tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:09.807614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceeb8777-da17-4084-bff3-c19ae9cefefb tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:09.808330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceeb8777-da17-4084-bff3-c19ae9cefefb tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:09.808938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceeb8777-da17-4084-bff3-c19ae9cefefb tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:09.811738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceeb8777-da17-4084-bff3-c19ae9cefefb tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.016189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:10.138751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e7aedc00-f9ec-4208-b2b4-fa14473459ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:10.151686 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e7aedc00-f9ec-4208-b2b4-fa14473459ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1316 microversion: 2.1 time: 0.376536 Oct 05 17:43:10.152885 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1405/2614] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:09 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:10.158865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3695f66b-10db-43c1-9c6e-83a03f0da1b6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:10.159687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3695f66b-10db-43c1-9c6e-83a03f0da1b6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:10.169119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3695f66b-10db-43c1-9c6e-83a03f0da1b6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.169934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3695f66b-10db-43c1-9c6e-83a03f0da1b6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.170628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3695f66b-10db-43c1-9c6e-83a03f0da1b6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.171815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3695f66b-10db-43c1-9c6e-83a03f0da1b6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.172438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3695f66b-10db-43c1-9c6e-83a03f0da1b6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.173027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3695f66b-10db-43c1-9c6e-83a03f0da1b6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.382163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3695f66b-10db-43c1-9c6e-83a03f0da1b6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:10.391113 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3695f66b-10db-43c1-9c6e-83a03f0da1b6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1308 microversion: 2.1 time: 0.236923 Oct 05 17:43:10.391959 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1406/2615] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:10 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1308 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:10.397668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36ce9c8e-fce2-45c9-b2cb-b0ae2524e6a2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '.version_select at 0x7f77751d11f0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:10.566094 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-36ce9c8e-fce2-45c9-b2cb-b0ae2524e6a2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "DELETE /compute/v2.1/images/28e2fe85-644b-46e2-b7fb-4d2f4a74fe73" status: 204 len: 0 microversion: 2.1 time: 0.172500 Oct 05 17:43:10.567157 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1407/2616] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:10 2022] DELETE /compute/v2.1/images/28e2fe85-644b-46e2-b7fb-4d2f4a74fe73 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:43:10.575803 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ceeb8777-da17-4084-bff3-c19ae9cefefb tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1643 microversion: 2.1 time: 0.781807 Oct 05 17:43:10.586224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8a853753-9801-46c6-a313-1994546434ad req-66ebb532-85b6-4f8c-b2b7-c0d594548beb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80ed110-8f6b-4126-a565-bb874a0de577", "name": "network-vif-deleted", "tag": "de32f0ab-7e10-4e24-8cd1-81209d7dc484"}, {"name": "network-changed", "server_uuid": "ca66e5a2-7805-4dbd-a3c3-83647f245241", "tag": "3a8784ad-c292-4925-b944-7d8959a69721"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:10.593328 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1210/2617] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:09 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1643 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:10.604958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa793833-1fb1-475b-9dc7-be1fc0a08240 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:10.606065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa793833-1fb1-475b-9dc7-be1fc0a08240 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:10.610063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8a853753-9801-46c6-a313-1994546434ad req-66ebb532-85b6-4f8c-b2b7-c0d594548beb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.610633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8a853753-9801-46c6-a313-1994546434ad req-66ebb532-85b6-4f8c-b2b7-c0d594548beb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.615150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa793833-1fb1-475b-9dc7-be1fc0a08240 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.615933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa793833-1fb1-475b-9dc7-be1fc0a08240 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.616561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa793833-1fb1-475b-9dc7-be1fc0a08240 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.617644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8a853753-9801-46c6-a313-1994546434ad req-66ebb532-85b6-4f8c-b2b7-c0d594548beb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.618209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa793833-1fb1-475b-9dc7-be1fc0a08240 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.618878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa793833-1fb1-475b-9dc7-be1fc0a08240 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.619468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa793833-1fb1-475b-9dc7-be1fc0a08240 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.641076 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8a853753-9801-46c6-a313-1994546434ad req-66ebb532-85b6-4f8c-b2b7-c0d594548beb service nova] Creating event network-vif-deleted:de32f0ab-7e10-4e24-8cd1-81209d7dc484 for instance b80ed110-8f6b-4126-a565-bb874a0de577 on n-h1-835595-3 Oct 05 17:43:10.643657 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8a853753-9801-46c6-a313-1994546434ad req-66ebb532-85b6-4f8c-b2b7-c0d594548beb service nova] Creating event network-changed:3a8784ad-c292-4925-b944-7d8959a69721 for instance ca66e5a2-7805-4dbd-a3c3-83647f245241 on n-h2-835595-3 Oct 05 17:43:10.653257 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8a853753-9801-46c6-a313-1994546434ad req-66ebb532-85b6-4f8c-b2b7-c0d594548beb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084718 Oct 05 17:43:10.654714 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1408/2618] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:10.663431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-50c1eb40-307b-46f0-b12d-5401b645387f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:10.668713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50c1eb40-307b-46f0-b12d-5401b645387f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.670191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50c1eb40-307b-46f0-b12d-5401b645387f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.670917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50c1eb40-307b-46f0-b12d-5401b645387f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.671938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50c1eb40-307b-46f0-b12d-5401b645387f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.673358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50c1eb40-307b-46f0-b12d-5401b645387f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.674206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50c1eb40-307b-46f0-b12d-5401b645387f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.714184 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-50c1eb40-307b-46f0-b12d-5401b645387f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.057883 Oct 05 17:43:10.715593 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1409/2619] 10.222.0.70 () {58 vars in 1176 bytes} [Wed Oct 5 17:43:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:10.722907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:10.723959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:10.731469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.733477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.733477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.733860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.735426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.736075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.780536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.781556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.782166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.782731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lazy-loading 'fault' on Instance uuid b80ed110-8f6b-4126-a565-bb874a0de577 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:43:10.856816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aa6b735fc434e23b04a45979eeadafb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ac9093ae0534edb92b2e2b007c8926a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:10.865768 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-23c476c7-0db7-4406-a011-664428b838d6 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 200 len: 1303 microversion: 2.1 time: 0.148697 Oct 05 17:43:10.866897 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1410/2620] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:10 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 1303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:10.872029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-835595-3", "block_migration": true, "disk_over_commit": false}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:10.874909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:10.881407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.882187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.882909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.883705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:10.884234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:10.884743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:10.928808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lazy-loading 'flavor' on Instance uuid 2c8bc911-1ed0-4477-95a8-9b63aeb837aa {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:43:10.949768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Going to try to live migrate instance to n-h2-835595-3 {{(pid=128844) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 17:43:11.005923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa793833-1fb1-475b-9dc7-be1fc0a08240 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:11.016713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=14 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:11.020517 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa793833-1fb1-475b-9dc7-be1fc0a08240 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1540 microversion: 2.1 time: 0.425571 Oct 05 17:43:11.021759 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1211/2621] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:10 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1540 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:11.028177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:11.030106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:11.038699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:11.039203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:11.039629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:11.041274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:11.041969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:11.042436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:11.479773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:11.499758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:11.502468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:11.504754 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-761b7f41-bcee-4d88-8f6e-8f002dbd1ace tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.481813 Oct 05 17:43:11.513874 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1212/2622] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:11 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:11.519139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f35c10b2-f8a0-463c-8ad0-c216a9bcd81f tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:11.519899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f35c10b2-f8a0-463c-8ad0-c216a9bcd81f tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:11.527071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f35c10b2-f8a0-463c-8ad0-c216a9bcd81f tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:11.527842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f35c10b2-f8a0-463c-8ad0-c216a9bcd81f tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:11.528328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f35c10b2-f8a0-463c-8ad0-c216a9bcd81f tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:11.529240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f35c10b2-f8a0-463c-8ad0-c216a9bcd81f tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:11.529877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f35c10b2-f8a0-463c-8ad0-c216a9bcd81f tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:11.530533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f35c10b2-f8a0-463c-8ad0-c216a9bcd81f tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:11.749953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f35c10b2-f8a0-463c-8ad0-c216a9bcd81f tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:11.758521 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f35c10b2-f8a0-463c-8ad0-c216a9bcd81f tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1316 microversion: 2.1 time: 0.243095 Oct 05 17:43:11.759551 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1213/2623] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:11 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:11.765270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cbfc37c3-702c-4900-865f-b8c8a942f292 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:11.765999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cbfc37c3-702c-4900-865f-b8c8a942f292 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:11.775111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbfc37c3-702c-4900-865f-b8c8a942f292 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:11.776015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbfc37c3-702c-4900-865f-b8c8a942f292 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:11.776613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbfc37c3-702c-4900-865f-b8c8a942f292 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:11.777515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbfc37c3-702c-4900-865f-b8c8a942f292 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:11.778084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbfc37c3-702c-4900-865f-b8c8a942f292 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:11.778536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbfc37c3-702c-4900-865f-b8c8a942f292 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:11.946352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cbfc37c3-702c-4900-865f-b8c8a942f292 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:11.955366 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cbfc37c3-702c-4900-865f-b8c8a942f292 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1308 microversion: 2.1 time: 0.194475 Oct 05 17:43:11.956233 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1214/2624] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:11 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1308 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:11.976324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:11.977083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:11.988771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:11.989757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:11.990691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:11.991775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:11.992638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:11.993367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:12.011824 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] HTTP exception thrown: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Request method failure captured: Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 HTTP/1.1 Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGRonZ_xC29CZD9lh4kGv13W1PkfQDaNJ2ZjpKfhQAQO4a1E3XGSKRe32NwtQSHxQmtEScDFE3ruI7xc5qPvlx3m5c78DiRYoY_6bYtFTRpOWnaslYRf6HRm14i_0CmvvhZeHYzw4obaZvTbjcP6bMOlsHAGp5_G-wlLt1so9mxE_o Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8ac9093ae0534edb92b2e2b007c8926a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}] Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestMultiNic-65439040-project Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6aa6b735fc434e23b04a45979eeadafb Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestMultiNic-65439040-project Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'b80ed110-8f6b-4126-a565-bb874a0de577'} Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:12.018068 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:12.023070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:12.023070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:12.023070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:12.023070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:43:12.023070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:43:12.023070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:12.023070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:12.023921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Returning 404 to user: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:12.024914 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2d88ce20-383e-42bf-8395-f3adbc4a3864 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 404 len: 111 microversion: 2.1 time: 0.060463 Oct 05 17:43:12.025756 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1215/2625] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:11 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:43:12.048165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b65d9da5-03c9-475e-853b-778c6b8bbe6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:12.048806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b65d9da5-03c9-475e-853b-778c6b8bbe6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:12.054763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b65d9da5-03c9-475e-853b-778c6b8bbe6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:12.055250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b65d9da5-03c9-475e-853b-778c6b8bbe6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:12.055726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b65d9da5-03c9-475e-853b-778c6b8bbe6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:12.056810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b65d9da5-03c9-475e-853b-778c6b8bbe6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:12.057269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b65d9da5-03c9-475e-853b-778c6b8bbe6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:12.057688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b65d9da5-03c9-475e-853b-778c6b8bbe6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:12.289975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b65d9da5-03c9-475e-853b-778c6b8bbe6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:12.298515 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b65d9da5-03c9-475e-853b-778c6b8bbe6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1540 microversion: 2.1 time: 0.254186 Oct 05 17:43:12.322784 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1216/2626] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:12 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1540 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:12.536577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:12.537263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:12.543973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:12.544538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:12.545395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:12.546147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:12.546866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:12.547363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:13.381917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:13.395602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:13.397201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:13.398881 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f880a406-2596-4913-b36c-41e906a79fac tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.867275 Oct 05 17:43:13.414900 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1217/2627] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:12 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:43:13.426416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-63d8d3ca-2ec8-48ce-b682-3e2bfc1b67cf req-184a17e3-78b6-41f2-8a78-e38d997a7f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b80ed110-8f6b-4126-a565-bb874a0de577", "name": "network-vif-deleted", "tag": "4c75e5be-d490-4be8-bdbf-b88f7b406cb7"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:13.436465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-63d8d3ca-2ec8-48ce-b682-3e2bfc1b67cf req-184a17e3-78b6-41f2-8a78-e38d997a7f8a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:13.436960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-63d8d3ca-2ec8-48ce-b682-3e2bfc1b67cf req-184a17e3-78b6-41f2-8a78-e38d997a7f8a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:13.437398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-63d8d3ca-2ec8-48ce-b682-3e2bfc1b67cf req-184a17e3-78b6-41f2-8a78-e38d997a7f8a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:13.451811 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-63d8d3ca-2ec8-48ce-b682-3e2bfc1b67cf req-184a17e3-78b6-41f2-8a78-e38d997a7f8a service nova] Creating event network-vif-deleted:4c75e5be-d490-4be8-bdbf-b88f7b406cb7 for instance b80ed110-8f6b-4126-a565-bb874a0de577 on n-h1-835595-3 Oct 05 17:43:13.458066 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-63d8d3ca-2ec8-48ce-b682-3e2bfc1b67cf req-184a17e3-78b6-41f2-8a78-e38d997a7f8a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041832 Oct 05 17:43:13.458717 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1218/2628] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:13.463998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9462e93-8dcb-4e30-b857-2ecedf117da7 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:13.464699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c9462e93-8dcb-4e30-b857-2ecedf117da7 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:13.470892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9462e93-8dcb-4e30-b857-2ecedf117da7 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:13.471373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9462e93-8dcb-4e30-b857-2ecedf117da7 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:13.472012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9462e93-8dcb-4e30-b857-2ecedf117da7 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:13.472948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9462e93-8dcb-4e30-b857-2ecedf117da7 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:13.473404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9462e93-8dcb-4e30-b857-2ecedf117da7 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:13.473828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9462e93-8dcb-4e30-b857-2ecedf117da7 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:14.050400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c9462e93-8dcb-4e30-b857-2ecedf117da7 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:14.058959 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c9462e93-8dcb-4e30-b857-2ecedf117da7 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1316 microversion: 2.1 time: 0.598874 Oct 05 17:43:14.059774 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1219/2629] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:13 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1316 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:14.071489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d64fab5-8ef1-4097-bf8b-14e5d85ca694 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:14.072431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0d64fab5-8ef1-4097-bf8b-14e5d85ca694 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:14.080558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d64fab5-8ef1-4097-bf8b-14e5d85ca694 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:14.081392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d64fab5-8ef1-4097-bf8b-14e5d85ca694 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:14.081832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d64fab5-8ef1-4097-bf8b-14e5d85ca694 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:14.082595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d64fab5-8ef1-4097-bf8b-14e5d85ca694 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:14.083054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d64fab5-8ef1-4097-bf8b-14e5d85ca694 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:14.083480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d64fab5-8ef1-4097-bf8b-14e5d85ca694 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:14.441516 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ca7f590-af4e-4ef8-a168-bb830d89235c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa/action" status: 202 len: 0 microversion: 2.1 time: 3.573319 Oct 05 17:43:14.444936 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1411/2630] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:43:10 2022] POST /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa/action => generated 0 bytes in 3577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:43:14.464362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43d65e2f-75a2-4bc5-b69e-db18a3d3c269 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:14.466003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-43d65e2f-75a2-4bc5-b69e-db18a3d3c269 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:14.489477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d65e2f-75a2-4bc5-b69e-db18a3d3c269 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:14.490245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d65e2f-75a2-4bc5-b69e-db18a3d3c269 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:14.490730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d65e2f-75a2-4bc5-b69e-db18a3d3c269 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:14.491457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d65e2f-75a2-4bc5-b69e-db18a3d3c269 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:14.492492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d65e2f-75a2-4bc5-b69e-db18a3d3c269 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:14.493149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d65e2f-75a2-4bc5-b69e-db18a3d3c269 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:14.518935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d64fab5-8ef1-4097-bf8b-14e5d85ca694 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:14.541482 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0d64fab5-8ef1-4097-bf8b-14e5d85ca694 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1308 microversion: 2.1 time: 0.478918 Oct 05 17:43:14.543121 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1220/2631] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:14 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1308 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:14.555916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-aa972887-9afd-44b3-adff-db531dc188ae req-8f0f2715-04eb-4329-ba51-a7c81e7a9065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c03997c-01af-46a1-9887-9b72e2a2815b", "name": "network-vif-plugged", "status": "completed", "tag": "10e3d67e-7cde-4cc7-9263-0e9b5687690c"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:14.585040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-aa972887-9afd-44b3-adff-db531dc188ae req-8f0f2715-04eb-4329-ba51-a7c81e7a9065 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:14.586344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-aa972887-9afd-44b3-adff-db531dc188ae req-8f0f2715-04eb-4329-ba51-a7c81e7a9065 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:14.587182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-aa972887-9afd-44b3-adff-db531dc188ae req-8f0f2715-04eb-4329-ba51-a7c81e7a9065 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:14.593690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:14.612574 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-aa972887-9afd-44b3-adff-db531dc188ae req-8f0f2715-04eb-4329-ba51-a7c81e7a9065 service nova] Creating event network-vif-plugged:10e3d67e-7cde-4cc7-9263-0e9b5687690c for instance 9c03997c-01af-46a1-9887-9b72e2a2815b on n-h1-835595-3 Oct 05 17:43:14.641895 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-aa972887-9afd-44b3-adff-db531dc188ae req-8f0f2715-04eb-4329-ba51-a7c81e7a9065 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095690 Oct 05 17:43:14.644917 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1221/2632] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:14.668777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:14.672817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:14.692658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:14.696881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:14.696881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:14.696881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:14.696881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:14.697733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:14.851165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-43d65e2f-75a2-4bc5-b69e-db18a3d3c269 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:14.865541 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-43d65e2f-75a2-4bc5-b69e-db18a3d3c269 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1522 microversion: 2.1 time: 0.407814 Oct 05 17:43:14.877080 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1412/2633] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:14 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:14.882894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2018787f-97a9-4631-99ee-f35b71e69691 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:14.884198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2018787f-97a9-4631-99ee-f35b71e69691 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:14.892788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2018787f-97a9-4631-99ee-f35b71e69691 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:14.893556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2018787f-97a9-4631-99ee-f35b71e69691 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:14.894859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2018787f-97a9-4631-99ee-f35b71e69691 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:14.895835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2018787f-97a9-4631-99ee-f35b71e69691 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:14.896506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2018787f-97a9-4631-99ee-f35b71e69691 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:14.897289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2018787f-97a9-4631-99ee-f35b71e69691 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:15.085225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:15.095397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:15.097100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:15.098671 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4524f3f0-01c0-4a8c-ac2f-7206306d898f tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.451295 Oct 05 17:43:15.099530 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1222/2634] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:14 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:15.129176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-49ba25f8-2bd8-4aa6-92cf-176e2f34050c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:15.129908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-49ba25f8-2bd8-4aa6-92cf-176e2f34050c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:15.144505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49ba25f8-2bd8-4aa6-92cf-176e2f34050c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:15.146995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49ba25f8-2bd8-4aa6-92cf-176e2f34050c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:15.149877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49ba25f8-2bd8-4aa6-92cf-176e2f34050c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:15.150694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49ba25f8-2bd8-4aa6-92cf-176e2f34050c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:15.151186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49ba25f8-2bd8-4aa6-92cf-176e2f34050c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:15.151622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49ba25f8-2bd8-4aa6-92cf-176e2f34050c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:15.190668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-49ba25f8-2bd8-4aa6-92cf-176e2f34050c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:43:15.284284 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-49ba25f8-2bd8-4aa6-92cf-176e2f34050c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 204 len: 0 microversion: 2.1 time: 0.177643 Oct 05 17:43:15.285909 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1223/2635] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:43:15 2022] DELETE /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:43:15.291840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2018787f-97a9-4631-99ee-f35b71e69691 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:15.295583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-336d06f4-95b9-46db-839e-077ee276a279 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:15.298156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-336d06f4-95b9-46db-839e-077ee276a279 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:15.305088 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2018787f-97a9-4631-99ee-f35b71e69691 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.425123 Oct 05 17:43:15.306143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-336d06f4-95b9-46db-839e-077ee276a279 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:15.306867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-336d06f4-95b9-46db-839e-077ee276a279 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:15.307438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-336d06f4-95b9-46db-839e-077ee276a279 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:15.307887 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1413/2636] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:14 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:15.308452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-336d06f4-95b9-46db-839e-077ee276a279 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:15.309042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-336d06f4-95b9-46db-839e-077ee276a279 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:15.309619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-336d06f4-95b9-46db-839e-077ee276a279 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:15.327240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35573b5a-b233-4faf-9016-8a23d6ab1c6d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:15.330080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-35573b5a-b233-4faf-9016-8a23d6ab1c6d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:15.343737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35573b5a-b233-4faf-9016-8a23d6ab1c6d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:15.344341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35573b5a-b233-4faf-9016-8a23d6ab1c6d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:15.344855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35573b5a-b233-4faf-9016-8a23d6ab1c6d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:15.349044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35573b5a-b233-4faf-9016-8a23d6ab1c6d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:15.349621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35573b5a-b233-4faf-9016-8a23d6ab1c6d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:15.350134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35573b5a-b233-4faf-9016-8a23d6ab1c6d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:15.492839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-336d06f4-95b9-46db-839e-077ee276a279 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:15.501120 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-336d06f4-95b9-46db-839e-077ee276a279 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1316 microversion: 2.1 time: 0.212722 Oct 05 17:43:15.501317 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1224/2637] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:15 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1316 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:15.569075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cfb1a4e3-5df5-4ca2-a7a8-abea6b785be7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:15.569780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cfb1a4e3-5df5-4ca2-a7a8-abea6b785be7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:15.578168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfb1a4e3-5df5-4ca2-a7a8-abea6b785be7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:15.578750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfb1a4e3-5df5-4ca2-a7a8-abea6b785be7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:15.579257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfb1a4e3-5df5-4ca2-a7a8-abea6b785be7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:15.580540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfb1a4e3-5df5-4ca2-a7a8-abea6b785be7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:15.580540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfb1a4e3-5df5-4ca2-a7a8-abea6b785be7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:15.581048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfb1a4e3-5df5-4ca2-a7a8-abea6b785be7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:15.644067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-35573b5a-b233-4faf-9016-8a23d6ab1c6d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:15.653026 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35573b5a-b233-4faf-9016-8a23d6ab1c6d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1528 microversion: 2.1 time: 0.343901 Oct 05 17:43:15.666884 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1414/2638] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:15 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1528 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:15.755400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cfb1a4e3-5df5-4ca2-a7a8-abea6b785be7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:15.764916 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cfb1a4e3-5df5-4ca2-a7a8-abea6b785be7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1308 microversion: 2.1 time: 0.199711 Oct 05 17:43:15.766018 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1225/2639] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:15 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:43:16.125428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:16.127149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:16.138489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.139361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.140027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.140736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.141348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.149577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.329926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2329af1c-1672-4c1e-8f3e-64a21042edaf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:16.330924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2329af1c-1672-4c1e-8f3e-64a21042edaf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:16.337599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2329af1c-1672-4c1e-8f3e-64a21042edaf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.338503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2329af1c-1672-4c1e-8f3e-64a21042edaf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.339103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2329af1c-1672-4c1e-8f3e-64a21042edaf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.339801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2329af1c-1672-4c1e-8f3e-64a21042edaf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.340406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2329af1c-1672-4c1e-8f3e-64a21042edaf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.340983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2329af1c-1672-4c1e-8f3e-64a21042edaf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.457976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:16.475002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:16.485076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:16.487002 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4f3948b5-d478-49ef-a70a-ce59baf433cd tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.365648 Oct 05 17:43:16.494723 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1415/2640] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:16 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:16.527805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cf1c2921-0b6d-4688-8c1a-24517ed4d5e8 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:16.528080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cf1c2921-0b6d-4688-8c1a-24517ed4d5e8 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:16.536561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1c2921-0b6d-4688-8c1a-24517ed4d5e8 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.537708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1c2921-0b6d-4688-8c1a-24517ed4d5e8 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.538364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1c2921-0b6d-4688-8c1a-24517ed4d5e8 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.539527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1c2921-0b6d-4688-8c1a-24517ed4d5e8 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.540335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1c2921-0b6d-4688-8c1a-24517ed4d5e8 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.542021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1c2921-0b6d-4688-8c1a-24517ed4d5e8 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.618323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2329af1c-1672-4c1e-8f3e-64a21042edaf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:16.631572 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2329af1c-1672-4c1e-8f3e-64a21042edaf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.305440 Oct 05 17:43:16.633083 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1226/2641] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:16 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:16.643938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:16.645409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:16.660486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.661754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.662494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.665982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.666558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.668279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.687865 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] HTTP exception thrown: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Request method failure captured: Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 HTTP/1.1 Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGRonZ_xC29CZD9lh4kGv13W1PkfQDaNJ2ZjpKfhQAQO4a1E3XGSKRe32NwtQSHxQmtEScDFE3ruI7xc5qPvlx3m5c78DiRYoY_6bYtFTRpOWnaslYRf6HRm14i_0CmvvhZeHYzw4obaZvTbjcP6bMOlsHAGp5_G-wlLt1so9mxE_o Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8ac9093ae0534edb92b2e2b007c8926a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}] Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestMultiNic-65439040-project Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6aa6b735fc434e23b04a45979eeadafb Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestMultiNic-65439040-project Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'b80ed110-8f6b-4126-a565-bb874a0de577'} Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:43:16.690205 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:16.694711 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:16.696831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Returning 404 to user: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:16.697877 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-72f19696-cf55-47cc-8120-84a5d9bbf5ae tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 404 len: 111 microversion: 2.1 time: 0.062502 Oct 05 17:43:16.698956 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1227/2642] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:43:16 2022] DELETE /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:43:16.704438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dcecb6c9-6216-463f-8934-7757badc38f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:16.705294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dcecb6c9-6216-463f-8934-7757badc38f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:16.717362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dcecb6c9-6216-463f-8934-7757badc38f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.718306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dcecb6c9-6216-463f-8934-7757badc38f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.718921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dcecb6c9-6216-463f-8934-7757badc38f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.719842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dcecb6c9-6216-463f-8934-7757badc38f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.721088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dcecb6c9-6216-463f-8934-7757badc38f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.722170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dcecb6c9-6216-463f-8934-7757badc38f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.797036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cf1c2921-0b6d-4688-8c1a-24517ed4d5e8 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:16.805717 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cf1c2921-0b6d-4688-8c1a-24517ed4d5e8 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1316 microversion: 2.1 time: 0.285835 Oct 05 17:43:16.817517 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1416/2643] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:16 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:43:16.829780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:16.830712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: b80ed110-8f6b-4126-a565-bb874a0de577] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:16.839066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.839495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.840114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.840817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.841436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.842590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.858499 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] HTTP exception thrown: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Request method failure captured: Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 HTTP/1.1 Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGRonZ_xC29CZD9lh4kGv13W1PkfQDaNJ2ZjpKfhQAQO4a1E3XGSKRe32NwtQSHxQmtEScDFE3ruI7xc5qPvlx3m5c78DiRYoY_6bYtFTRpOWnaslYRf6HRm14i_0CmvvhZeHYzw4obaZvTbjcP6bMOlsHAGp5_G-wlLt1so9mxE_o Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8ac9093ae0534edb92b2e2b007c8926a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}] Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestMultiNic-65439040-project Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6aa6b735fc434e23b04a45979eeadafb Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestMultiNic-65439040-project Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'b80ed110-8f6b-4126-a565-bb874a0de577'} Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:16.860525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:16.864647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:16.864647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:16.864647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:16.864647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:43:16.864647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:43:16.864647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. Oct 05 17:43:16.864647 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:16.866495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Returning 404 to user: Instance b80ed110-8f6b-4126-a565-bb874a0de577 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:16.867778 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88bcd70a-3714-4ae2-9f60-d56d0c4873a1 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577" status: 404 len: 111 microversion: 2.1 time: 0.048840 Oct 05 17:43:16.868779 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1417/2644] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:16 2022] GET /compute/v2.1/servers/b80ed110-8f6b-4126-a565-bb874a0de577 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:43:16.874708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-fd2326ba-85ab-4255-a79a-0d39bca24118 req-e0a0e58a-1214-4e9b-8607-7ebff9e62cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e13165-324b-4dbf-b095-9d7629b0f570", "name": "network-vif-plugged", "status": "completed", "tag": "8e71d756-2bfa-46ef-b903-90032171c8ce"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:16.885188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fd2326ba-85ab-4255-a79a-0d39bca24118 req-e0a0e58a-1214-4e9b-8607-7ebff9e62cdc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.885763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fd2326ba-85ab-4255-a79a-0d39bca24118 req-e0a0e58a-1214-4e9b-8607-7ebff9e62cdc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.886313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fd2326ba-85ab-4255-a79a-0d39bca24118 req-e0a0e58a-1214-4e9b-8607-7ebff9e62cdc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.899353 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-fd2326ba-85ab-4255-a79a-0d39bca24118 req-e0a0e58a-1214-4e9b-8607-7ebff9e62cdc service nova] Creating event network-vif-plugged:8e71d756-2bfa-46ef-b903-90032171c8ce for instance 05e13165-324b-4dbf-b095-9d7629b0f570 on n-h2-835595-3 Oct 05 17:43:16.904934 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-fd2326ba-85ab-4255-a79a-0d39bca24118 req-e0a0e58a-1214-4e9b-8607-7ebff9e62cdc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034703 Oct 05 17:43:16.906238 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1418/2645] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:16.914440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-46a42c6e-2bb2-4789-8376-daa5999fe018 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:16.915395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-46a42c6e-2bb2-4789-8376-daa5999fe018 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:16.917418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:16.923571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a42c6e-2bb2-4789-8376-daa5999fe018 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.924431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a42c6e-2bb2-4789-8376-daa5999fe018 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.925010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a42c6e-2bb2-4789-8376-daa5999fe018 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:16.926486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a42c6e-2bb2-4789-8376-daa5999fe018 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:16.927203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a42c6e-2bb2-4789-8376-daa5999fe018 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:16.928175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a42c6e-2bb2-4789-8376-daa5999fe018 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:17.076310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dcecb6c9-6216-463f-8934-7757badc38f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:17.093854 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dcecb6c9-6216-463f-8934-7757badc38f7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1528 microversion: 2.1 time: 0.392338 Oct 05 17:43:17.094166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46a42c6e-2bb2-4789-8376-daa5999fe018 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:17.099034 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1228/2646] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:16 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1528 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:17.107107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:17.110788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:17.116161 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-46a42c6e-2bb2-4789-8376-daa5999fe018 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1488 microversion: 2.1 time: 0.205227 Oct 05 17:43:17.118460 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1419/2647] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:16 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1488 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:17.139709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:17.140276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:17.140724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:17.141460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:17.141921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:17.142372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:17.144498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-73cae21a-bc01-4bf7-bac7-04a9b6fa123d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:17.150510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-73cae21a-bc01-4bf7-bac7-04a9b6fa123d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:17.163971 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] HTTP exception thrown: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Request method failure captured: Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb HTTP/1.1 Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGRonZ_xC29CZD9lh4kGv13W1PkfQDaNJ2ZjpKfhQAQO4a1E3XGSKRe32NwtQSHxQmtEScDFE3ruI7xc5qPvlx3m5c78DiRYoY_6bYtFTRpOWnaslYRf6HRm14i_0CmvvhZeHYzw4obaZvTbjcP6bMOlsHAGp5_G-wlLt1so9mxE_o Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8ac9093ae0534edb92b2e2b007c8926a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}] Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestMultiNic-65439040-project Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6aa6b735fc434e23b04a45979eeadafb Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestMultiNic-65439040-project Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '51c0c9d6-efb6-4b55-9df3-23625b4c4efb'} Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:43:17.166609 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:43:17.170254 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:17.170944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73cae21a-bc01-4bf7-bac7-04a9b6fa123d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:17.170944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73cae21a-bc01-4bf7-bac7-04a9b6fa123d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:17.170944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73cae21a-bc01-4bf7-bac7-04a9b6fa123d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:17.172675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73cae21a-bc01-4bf7-bac7-04a9b6fa123d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:17.172977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Returning 404 to user: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:17.173160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73cae21a-bc01-4bf7-bac7-04a9b6fa123d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:17.173600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73cae21a-bc01-4bf7-bac7-04a9b6fa123d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:17.174470 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f05ff19c-14aa-4ac9-9b97-ebd3d8b12627 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "DELETE /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 404 len: 111 microversion: 2.1 time: 0.074049 Oct 05 17:43:17.175599 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1229/2648] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:43:17 2022] DELETE /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:43:17.184280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:17.185517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] [instance: 51c0c9d6-efb6-4b55-9df3-23625b4c4efb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:17.193436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:17.194704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:17.195709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:17.197330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:17.198815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:17.199485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:17.220511 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] HTTP exception thrown: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Request method failure captured: Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb HTTP/1.1 Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGRonZ_xC29CZD9lh4kGv13W1PkfQDaNJ2ZjpKfhQAQO4a1E3XGSKRe32NwtQSHxQmtEScDFE3ruI7xc5qPvlx3m5c78DiRYoY_6bYtFTRpOWnaslYRf6HRm14i_0CmvvhZeHYzw4obaZvTbjcP6bMOlsHAGp5_G-wlLt1so9mxE_o Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8ac9093ae0534edb92b2e2b007c8926a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8ac9093ae0534edb92b2e2b007c8926a"}]}] Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8ac9093ae0534edb92b2e2b007c8926a Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestMultiNic-65439040 Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestMultiNic-65439040-project Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6aa6b735fc434e23b04a45979eeadafb Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestMultiNic-65439040-project Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '51c0c9d6-efb6-4b55-9df3-23625b4c4efb'} Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:17.222426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:17.226370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:17.226370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:17.226370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:17.226370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:43:17.226370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:43:17.226370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. Oct 05 17:43:17.226370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:17.229181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] Returning 404 to user: Instance 51c0c9d6-efb6-4b55-9df3-23625b4c4efb could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:17.229743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-73cae21a-bc01-4bf7-bac7-04a9b6fa123d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lazy-loading 'flavor' on Instance uuid 9c03997c-01af-46a1-9887-9b72e2a2815b {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:43:17.232717 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8ea5eac0-3701-4a7d-ae62-afb296dc9432 tempest-ServersTestMultiNic-65439040 tempest-ServersTestMultiNic-65439040-project] 10.222.0.70 "GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb" status: 404 len: 111 microversion: 2.1 time: 0.051925 Oct 05 17:43:17.234477 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1230/2649] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:17 2022] GET /compute/v2.1/servers/51c0c9d6-efb6-4b55-9df3-23625b4c4efb => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:43:17.252979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:17.378431 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-73cae21a-bc01-4bf7-bac7-04a9b6fa123d tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b/action" status: 202 len: 0 microversion: 2.1 time: 0.241011 Oct 05 17:43:17.379829 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1420/2650] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:43:17 2022] POST /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:43:17.399795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-44fcf833-96ab-4b0e-bf35-7bcadc936439 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:17.403233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-44fcf833-96ab-4b0e-bf35-7bcadc936439 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:17.424425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44fcf833-96ab-4b0e-bf35-7bcadc936439 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:17.425725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44fcf833-96ab-4b0e-bf35-7bcadc936439 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:17.426869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44fcf833-96ab-4b0e-bf35-7bcadc936439 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:17.427879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44fcf833-96ab-4b0e-bf35-7bcadc936439 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:17.429261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44fcf833-96ab-4b0e-bf35-7bcadc936439 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:17.430250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44fcf833-96ab-4b0e-bf35-7bcadc936439 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:17.514339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:17.515062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:17.523377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:17.523757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:17.524215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:17.524938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:17.526078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:17.526546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:18.080335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-44fcf833-96ab-4b0e-bf35-7bcadc936439 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:18.088433 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-44fcf833-96ab-4b0e-bf35-7bcadc936439 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1496 microversion: 2.1 time: 0.704064 Oct 05 17:43:18.093433 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1231/2651] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:17 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1496 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:18.102943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-07dd0962-8861-4ee7-b232-d6c8b1f9a118 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:18.106164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-07dd0962-8861-4ee7-b232-d6c8b1f9a118 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:18.130863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07dd0962-8861-4ee7-b232-d6c8b1f9a118 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:18.131426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07dd0962-8861-4ee7-b232-d6c8b1f9a118 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:18.131930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07dd0962-8861-4ee7-b232-d6c8b1f9a118 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:18.133012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07dd0962-8861-4ee7-b232-d6c8b1f9a118 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:18.134774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07dd0962-8861-4ee7-b232-d6c8b1f9a118 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:18.135267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07dd0962-8861-4ee7-b232-d6c8b1f9a118 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:18.183521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:18.195119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:18.197008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:18.198672 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ef71a2a-a33c-4449-87e7-b31b7e8538a4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.688949 Oct 05 17:43:18.199952 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1421/2652] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:17 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:43:18.205241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4fce8315-9237-464e-a1f2-2ee2bf9f0557 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:18.206166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4fce8315-9237-464e-a1f2-2ee2bf9f0557 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:18.213212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fce8315-9237-464e-a1f2-2ee2bf9f0557 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:18.214226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fce8315-9237-464e-a1f2-2ee2bf9f0557 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:18.215168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fce8315-9237-464e-a1f2-2ee2bf9f0557 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:18.216183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fce8315-9237-464e-a1f2-2ee2bf9f0557 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:18.217275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fce8315-9237-464e-a1f2-2ee2bf9f0557 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:18.217925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fce8315-9237-464e-a1f2-2ee2bf9f0557 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:18.533540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-07dd0962-8861-4ee7-b232-d6c8b1f9a118 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:18.553969 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-07dd0962-8861-4ee7-b232-d6c8b1f9a118 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.459000 Oct 05 17:43:18.555906 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1232/2653] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:18 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:18.562211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d7341ad0-822f-4b95-b7a8-43723ee7181c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:18.563316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d7341ad0-822f-4b95-b7a8-43723ee7181c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:18.571924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7341ad0-822f-4b95-b7a8-43723ee7181c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:18.572701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7341ad0-822f-4b95-b7a8-43723ee7181c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:18.573405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7341ad0-822f-4b95-b7a8-43723ee7181c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:18.574985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7341ad0-822f-4b95-b7a8-43723ee7181c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:18.575800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7341ad0-822f-4b95-b7a8-43723ee7181c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:18.577358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7341ad0-822f-4b95-b7a8-43723ee7181c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:18.623996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4fce8315-9237-464e-a1f2-2ee2bf9f0557 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:18.638047 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4fce8315-9237-464e-a1f2-2ee2bf9f0557 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1316 microversion: 2.1 time: 0.436626 Oct 05 17:43:18.639522 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1422/2654] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:18 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:18.690109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b85d229e-8a9e-40b3-a896-4dd870cc732f req-126df35e-8068-44f1-9827-be8fd875a00c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8bc911-1ed0-4477-95a8-9b63aeb837aa", "name": "network-vif-unplugged", "status": "completed", "tag": "2adbf98a-5ee3-4501-8cde-8d0b03b4a187"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:18.709288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b85d229e-8a9e-40b3-a896-4dd870cc732f req-126df35e-8068-44f1-9827-be8fd875a00c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:18.709781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b85d229e-8a9e-40b3-a896-4dd870cc732f req-126df35e-8068-44f1-9827-be8fd875a00c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:18.710217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b85d229e-8a9e-40b3-a896-4dd870cc732f req-126df35e-8068-44f1-9827-be8fd875a00c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:18.738769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d7341ad0-822f-4b95-b7a8-43723ee7181c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:18.740388 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b85d229e-8a9e-40b3-a896-4dd870cc732f req-126df35e-8068-44f1-9827-be8fd875a00c service nova] Creating event network-vif-unplugged:2adbf98a-5ee3-4501-8cde-8d0b03b4a187 for instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa on n-h1-835595-3 Oct 05 17:43:18.754039 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d7341ad0-822f-4b95-b7a8-43723ee7181c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1486 microversion: 2.1 time: 0.196090 Oct 05 17:43:18.755017 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1233/2655] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:18 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1486 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:18.755863 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b85d229e-8a9e-40b3-a896-4dd870cc732f req-126df35e-8068-44f1-9827-be8fd875a00c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069386 Oct 05 17:43:18.756398 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1423/2656] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:43:18.946566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7b70e835-798a-472d-9849-99eae916f464 req-8e9f7921-131e-4bcc-ab66-72035200eeee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca66e5a2-7805-4dbd-a3c3-83647f245241", "name": "network-vif-plugged", "status": "completed", "tag": "3a8784ad-c292-4925-b944-7d8959a69721"}, {"server_uuid": "05e13165-324b-4dbf-b095-9d7629b0f570", "name": "network-vif-unplugged", "status": "completed", "tag": "8e71d756-2bfa-46ef-b903-90032171c8ce"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:18.962016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7b70e835-798a-472d-9849-99eae916f464 req-8e9f7921-131e-4bcc-ab66-72035200eeee service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:18.963199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7b70e835-798a-472d-9849-99eae916f464 req-8e9f7921-131e-4bcc-ab66-72035200eeee service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:18.964133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7b70e835-798a-472d-9849-99eae916f464 req-8e9f7921-131e-4bcc-ab66-72035200eeee service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:18.993576 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7b70e835-798a-472d-9849-99eae916f464 req-8e9f7921-131e-4bcc-ab66-72035200eeee service nova] Creating event network-vif-plugged:3a8784ad-c292-4925-b944-7d8959a69721 for instance ca66e5a2-7805-4dbd-a3c3-83647f245241 on n-h2-835595-3 Oct 05 17:43:18.996295 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7b70e835-798a-472d-9849-99eae916f464 req-8e9f7921-131e-4bcc-ab66-72035200eeee service nova] Creating event network-vif-unplugged:8e71d756-2bfa-46ef-b903-90032171c8ce for instance 05e13165-324b-4dbf-b095-9d7629b0f570 on n-h2-835595-3 Oct 05 17:43:19.019770 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7b70e835-798a-472d-9849-99eae916f464 req-8e9f7921-131e-4bcc-ab66-72035200eeee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.084270 Oct 05 17:43:19.020936 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1234/2657] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:19.120528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fac12a89-2a51-45e3-8247-594def033b0b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:19.121651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fac12a89-2a51-45e3-8247-594def033b0b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:19.133381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fac12a89-2a51-45e3-8247-594def033b0b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.135600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fac12a89-2a51-45e3-8247-594def033b0b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.136173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fac12a89-2a51-45e3-8247-594def033b0b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.141053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fac12a89-2a51-45e3-8247-594def033b0b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.142197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fac12a89-2a51-45e3-8247-594def033b0b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.143118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fac12a89-2a51-45e3-8247-594def033b0b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.322808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:19.324157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:19.341740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.342518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.343062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.344043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.344713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.345452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.452421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fac12a89-2a51-45e3-8247-594def033b0b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:19.461074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fac12a89-2a51-45e3-8247-594def033b0b tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 200 len: 1479 microversion: 2.1 time: 0.345726 Oct 05 17:43:19.466258 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1424/2658] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:19 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 1479 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:19.489137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-28fd85b0-d34d-4ed4-bbaa-249ab3999b4e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1778707399"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:19.492591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-28fd85b0-d34d-4ed4-bbaa-249ab3999b4e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:19.500686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28fd85b0-d34d-4ed4-bbaa-249ab3999b4e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.501456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28fd85b0-d34d-4ed4-bbaa-249ab3999b4e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.502111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28fd85b0-d34d-4ed4-bbaa-249ab3999b4e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.503033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28fd85b0-d34d-4ed4-bbaa-249ab3999b4e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.503915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28fd85b0-d34d-4ed4-bbaa-249ab3999b4e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.504817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28fd85b0-d34d-4ed4-bbaa-249ab3999b4e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.648649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:19.663074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:19.665100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:19.666606 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-239d82e5-361d-46ff-ba35-34a92c2ed2a7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.355053 Oct 05 17:43:19.667708 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1235/2659] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:19 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:19.672686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d344b690-331b-49d7-b850-3a94064a2f80 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:19.674011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d344b690-331b-49d7-b850-3a94064a2f80 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:19.680522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d344b690-331b-49d7-b850-3a94064a2f80 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.681346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d344b690-331b-49d7-b850-3a94064a2f80 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.681993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d344b690-331b-49d7-b850-3a94064a2f80 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.682989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d344b690-331b-49d7-b850-3a94064a2f80 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.684312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d344b690-331b-49d7-b850-3a94064a2f80 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.684947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d344b690-331b-49d7-b850-3a94064a2f80 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.805965 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-28fd85b0-d34d-4ed4-bbaa-249ab3999b4e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b/action" status: 202 len: 0 microversion: 2.1 time: 0.321514 Oct 05 17:43:19.806926 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1425/2660] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:43:19 2022] POST /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 17:43:19.819541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-32bc4ede-c675-49ff-b50a-92a5296ebad1 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:19.820543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-32bc4ede-c675-49ff-b50a-92a5296ebad1 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:19.829901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32bc4ede-c675-49ff-b50a-92a5296ebad1 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.830699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32bc4ede-c675-49ff-b50a-92a5296ebad1 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.831343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32bc4ede-c675-49ff-b50a-92a5296ebad1 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.832377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32bc4ede-c675-49ff-b50a-92a5296ebad1 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.833066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32bc4ede-c675-49ff-b50a-92a5296ebad1 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.833683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32bc4ede-c675-49ff-b50a-92a5296ebad1 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.859901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d344b690-331b-49d7-b850-3a94064a2f80 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:19.871962 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d344b690-331b-49d7-b850-3a94064a2f80 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.202788 Oct 05 17:43:19.872578 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1236/2661] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:19 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:19.879557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:19.880198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:19.899435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.900235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.900670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.901450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.901841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.902261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.944106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:19.944741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:19.945394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:19.945971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lazy-loading 'fault' on Instance uuid 05e13165-324b-4dbf-b095-9d7629b0f570 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:43:20.003044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:20.014145 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fc9c9580-fddf-41d0-aa2f-db3838406cc2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 200 len: 1315 microversion: 2.1 time: 0.137595 Oct 05 17:43:20.014875 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1237/2662] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:19 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 1315 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:20.019967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6a13eb3-9aef-4386-9fb7-92606ca267fe tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775888160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:20.072089 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c6a13eb3-9aef-4386-9fb7-92606ca267fe tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.055776 Oct 05 17:43:20.073246 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1238/2663] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:20 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:20.198489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-32bc4ede-c675-49ff-b50a-92a5296ebad1 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:20.210909 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-32bc4ede-c675-49ff-b50a-92a5296ebad1 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1316 microversion: 2.1 time: 0.392357 Oct 05 17:43:20.211577 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1426/2664] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:19 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1316 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:20.696664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:20.697240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:20.711990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:20.712862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:20.714242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:20.716301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:20.716992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:20.718090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:20.799762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-15c000a1-cbbe-4e94-b565-6f6b6aae6ae9 req-d3178796-9099-476e-a8dd-1cf10859aa40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05e13165-324b-4dbf-b095-9d7629b0f570", "name": "network-vif-deleted", "tag": "8e71d756-2bfa-46ef-b903-90032171c8ce"}, {"name": "network-changed", "server_uuid": "2c8bc911-1ed0-4477-95a8-9b63aeb837aa", "tag": "2adbf98a-5ee3-4501-8cde-8d0b03b4a187"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:20.810260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:20.813226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-15c000a1-cbbe-4e94-b565-6f6b6aae6ae9 req-d3178796-9099-476e-a8dd-1cf10859aa40 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:20.814056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-15c000a1-cbbe-4e94-b565-6f6b6aae6ae9 req-d3178796-9099-476e-a8dd-1cf10859aa40 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:20.814501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-15c000a1-cbbe-4e94-b565-6f6b6aae6ae9 req-d3178796-9099-476e-a8dd-1cf10859aa40 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:20.830793 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-15c000a1-cbbe-4e94-b565-6f6b6aae6ae9 req-d3178796-9099-476e-a8dd-1cf10859aa40 service nova] Creating event network-vif-deleted:8e71d756-2bfa-46ef-b903-90032171c8ce for instance 05e13165-324b-4dbf-b095-9d7629b0f570 on n-h2-835595-3 Oct 05 17:43:20.831638 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-15c000a1-cbbe-4e94-b565-6f6b6aae6ae9 req-d3178796-9099-476e-a8dd-1cf10859aa40 service nova] Creating event network-changed:2adbf98a-5ee3-4501-8cde-8d0b03b4a187 for instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa on n-h1-835595-3 Oct 05 17:43:20.840819 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-15c000a1-cbbe-4e94-b565-6f6b6aae6ae9 req-d3178796-9099-476e-a8dd-1cf10859aa40 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044851 Oct 05 17:43:20.841844 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1427/2665] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:43:20.901571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0b09369b-8da1-48dd-a3cf-f5e3689022b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:20.902535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0b09369b-8da1-48dd-a3cf-f5e3689022b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:20.912120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b09369b-8da1-48dd-a3cf-f5e3689022b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:20.912982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b09369b-8da1-48dd-a3cf-f5e3689022b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:20.913582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b09369b-8da1-48dd-a3cf-f5e3689022b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:20.914516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b09369b-8da1-48dd-a3cf-f5e3689022b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:20.915192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b09369b-8da1-48dd-a3cf-f5e3689022b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:20.916035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b09369b-8da1-48dd-a3cf-f5e3689022b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.119888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0b09369b-8da1-48dd-a3cf-f5e3689022b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:21.132848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0b09369b-8da1-48dd-a3cf-f5e3689022b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.236600 Oct 05 17:43:21.135351 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1428/2666] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:20 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:21.173767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:21.188712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:21.201772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:21.203758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:21.204756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:21.211519 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aecb0784-ab94-4719-81e5-6803b450c3ec tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.519964 Oct 05 17:43:21.237159 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1239/2667] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:20 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:43:21.239143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:21.239651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:21.240097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.240822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:21.241288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:21.241721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.245461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b96b621-77c9-47a8-9b15-a5eceb6e6145 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777584be50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:21.287914 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 HTTP/1.1 Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '05e13165-324b-4dbf-b095-9d7629b0f570'} Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:21.289630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 404 to user: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-19c878e5-20a6-488d-b50d-166484e14cd8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 404 len: 111 microversion: 2.1 time: 0.121916 Oct 05 17:43:21.293483 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1429/2668] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:21 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:43:21.296497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb12fc17-57c5-43e4-ab35-da61c483c245 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:21.299007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb12fc17-57c5-43e4-ab35-da61c483c245 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:21.303596 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 17:43:21.303780 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 17:43:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 (ip 10.222.0.70) !!! Oct 05 17:43:21.322715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb12fc17-57c5-43e4-ab35-da61c483c245 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:21.323216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb12fc17-57c5-43e4-ab35-da61c483c245 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:21.323658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb12fc17-57c5-43e4-ab35-da61c483c245 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.324375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb12fc17-57c5-43e4-ab35-da61c483c245 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:21.327023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb12fc17-57c5-43e4-ab35-da61c483c245 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:21.327481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb12fc17-57c5-43e4-ab35-da61c483c245 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.340332 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b96b621-77c9-47a8-9b15-a5eceb6e6145 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.101314 Oct 05 17:43:21.341112 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1240/2669] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:21 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:21.346163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4a510f9-3aef-443d-86c1-6c638fdfda3c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Action: 'create', calling method: .version_select at 0x7f77759a6dc0>, body: {"keypair": {"name": "tempest-keypair-840756743", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbz4o/bx9HBKSpccgqfP0LMUvdHRifzP+5bRWJi6figxjZGA+FW89EI/n45dz8omvn867/nhwKD5QGQx9F5+8GlsptCl5BWO+F64GybQmOeuMRSIFkhN260nO3oj5QZiw=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:21.365895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e4a510f9-3aef-443d-86c1-6c638fdfda3c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Getting quotas for project 611cddc6ef94407dba177aea44f5268d. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:43:21.373149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e4a510f9-3aef-443d-86c1-6c638fdfda3c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Getting quotas for user fe8df861068f404e90034c993f9e0e45 and project 611cddc6ef94407dba177aea44f5268d. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:43:21.404018 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e4a510f9-3aef-443d-86c1-6c638fdfda3c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061514 Oct 05 17:43:21.413406 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1241/2670] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:43:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:21.544539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fb12fc17-57c5-43e4-ab35-da61c483c245 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:21.551867 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb12fc17-57c5-43e4-ab35-da61c483c245 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1504 microversion: 2.1 time: 0.259080 Oct 05 17:43:21.552459 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1430/2671] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:21 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:21.579433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00a1e208-5673-4ceb-9d98-fb66d0c032a2 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:21.580635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00a1e208-5673-4ceb-9d98-fb66d0c032a2 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:21.593958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00a1e208-5673-4ceb-9d98-fb66d0c032a2 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:21.596285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00a1e208-5673-4ceb-9d98-fb66d0c032a2 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:21.596409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00a1e208-5673-4ceb-9d98-fb66d0c032a2 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.597142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00a1e208-5673-4ceb-9d98-fb66d0c032a2 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:21.597643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00a1e208-5673-4ceb-9d98-fb66d0c032a2 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:21.598079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00a1e208-5673-4ceb-9d98-fb66d0c032a2 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.633540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:21.778591 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00a1e208-5673-4ceb-9d98-fb66d0c032a2 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.204151 Oct 05 17:43:21.780316 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1242/2672] 10.222.0.70 () {58 vars in 1296 bytes} [Wed Oct 5 17:43:21 2022] DELETE /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241/os-server-password => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:43:21.791417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-452464f5-798d-4d65-a610-9dbd2502e898 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:21.792768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-452464f5-798d-4d65-a610-9dbd2502e898 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:21.804147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-452464f5-798d-4d65-a610-9dbd2502e898 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:21.804790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-452464f5-798d-4d65-a610-9dbd2502e898 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:21.808201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-452464f5-798d-4d65-a610-9dbd2502e898 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.809262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-452464f5-798d-4d65-a610-9dbd2502e898 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:21.810581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-452464f5-798d-4d65-a610-9dbd2502e898 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:21.811101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-452464f5-798d-4d65-a610-9dbd2502e898 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.866163 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-452464f5-798d-4d65-a610-9dbd2502e898 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.079468 Oct 05 17:43:21.867299 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1431/2673] 10.222.0.70 () {58 vars in 1293 bytes} [Wed Oct 5 17:43:21 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241/os-server-password => generated 16 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:43:21.888592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1c336c5a-f63b-42ac-9921-f0df8006f3c5 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:21.889716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1c336c5a-f63b-42ac-9921-f0df8006f3c5 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:21.898088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:21.902509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c336c5a-f63b-42ac-9921-f0df8006f3c5 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:21.904091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c336c5a-f63b-42ac-9921-f0df8006f3c5 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:21.904759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c336c5a-f63b-42ac-9921-f0df8006f3c5 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.906163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c336c5a-f63b-42ac-9921-f0df8006f3c5 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:21.906969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c336c5a-f63b-42ac-9921-f0df8006f3c5 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:21.907732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c336c5a-f63b-42ac-9921-f0df8006f3c5 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:21.960917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1c336c5a-f63b-42ac-9921-f0df8006f3c5 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:43:22.090868 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1c336c5a-f63b-42ac-9921-f0df8006f3c5 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 204 len: 0 microversion: 2.1 time: 0.215916 Oct 05 17:43:22.092004 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1243/2674] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:43:21 2022] DELETE /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:43:22.101512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1bcebb65-2535-4493-a577-7f65ce3424f0 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:22.102674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1bcebb65-2535-4493-a577-7f65ce3424f0 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:22.110079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcebb65-2535-4493-a577-7f65ce3424f0 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:22.110906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcebb65-2535-4493-a577-7f65ce3424f0 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:22.111114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcebb65-2535-4493-a577-7f65ce3424f0 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:22.112229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcebb65-2535-4493-a577-7f65ce3424f0 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:22.114065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcebb65-2535-4493-a577-7f65ce3424f0 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:22.114758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcebb65-2535-4493-a577-7f65ce3424f0 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:22.163347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-31f7a84c-2596-4730-b5a4-37ea5e09f65d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:22.164819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-31f7a84c-2596-4730-b5a4-37ea5e09f65d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:22.173103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31f7a84c-2596-4730-b5a4-37ea5e09f65d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:22.173837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31f7a84c-2596-4730-b5a4-37ea5e09f65d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:22.175079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31f7a84c-2596-4730-b5a4-37ea5e09f65d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:22.175984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31f7a84c-2596-4730-b5a4-37ea5e09f65d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:22.176639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31f7a84c-2596-4730-b5a4-37ea5e09f65d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:22.177266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31f7a84c-2596-4730-b5a4-37ea5e09f65d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:22.504853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1bcebb65-2535-4493-a577-7f65ce3424f0 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:22.515358 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1bcebb65-2535-4493-a577-7f65ce3424f0 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1510 microversion: 2.1 time: 0.418882 Oct 05 17:43:22.532008 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1432/2675] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:22 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1510 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:22.532008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:22.532008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:22.532247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:22.533431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:22.533431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:22.536175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:22.536175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:22.536175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:22.708553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-31f7a84c-2596-4730-b5a4-37ea5e09f65d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:22.719477 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-31f7a84c-2596-4730-b5a4-37ea5e09f65d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.561927 Oct 05 17:43:22.720846 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1244/2676] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:22 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:43:22.727925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d6db452-cf95-42f6-a355-7a2e689e0989 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795c93a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:22.807122 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4d6db452-cf95-42f6-a355-7a2e689e0989 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.084953 Oct 05 17:43:22.808929 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1245/2677] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:22 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:22.895059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:22.911001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:22.917522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:22.919067 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d73c002d-5c26-491c-9610-25d7d6a977be tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.399153 Oct 05 17:43:22.919594 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1433/2678] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:22 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:23.538802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eba61cfe-1957-40bb-bbb1-4181628bd241 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:23.539426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eba61cfe-1957-40bb-bbb1-4181628bd241 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:23.560623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eba61cfe-1957-40bb-bbb1-4181628bd241 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:23.561128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eba61cfe-1957-40bb-bbb1-4181628bd241 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:23.561562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eba61cfe-1957-40bb-bbb1-4181628bd241 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:23.562527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eba61cfe-1957-40bb-bbb1-4181628bd241 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:23.566149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eba61cfe-1957-40bb-bbb1-4181628bd241 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:23.566841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eba61cfe-1957-40bb-bbb1-4181628bd241 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:23.747874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9bd13398-3b18-4503-ab24-d2e8de5b6c7b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:23.749724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9bd13398-3b18-4503-ab24-d2e8de5b6c7b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:23.764678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bd13398-3b18-4503-ab24-d2e8de5b6c7b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:23.765427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bd13398-3b18-4503-ab24-d2e8de5b6c7b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:23.768890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bd13398-3b18-4503-ab24-d2e8de5b6c7b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:23.770607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bd13398-3b18-4503-ab24-d2e8de5b6c7b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:23.771291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bd13398-3b18-4503-ab24-d2e8de5b6c7b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:23.771916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bd13398-3b18-4503-ab24-d2e8de5b6c7b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:24.095415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9bd13398-3b18-4503-ab24-d2e8de5b6c7b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:24.108251 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9bd13398-3b18-4503-ab24-d2e8de5b6c7b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.363816 Oct 05 17:43:24.111835 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1434/2679] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:23 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:43:24.127110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a7c3936-543e-4a77-83e0-54582eb97cc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77793f9b80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:24.229049 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1a7c3936-543e-4a77-83e0-54582eb97cc0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.115268 Oct 05 17:43:24.229885 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1435/2680] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:24 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:24.246590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e423b06a-3e1f-4264-9a64-3b8e0d6ec010 req-8cd18279-0669-4599-8b6e-81e743819c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c03997c-01af-46a1-9887-9b72e2a2815b", "name": "network-vif-plugged", "status": "completed", "tag": "10e3d67e-7cde-4cc7-9263-0e9b5687690c"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:24.338565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e423b06a-3e1f-4264-9a64-3b8e0d6ec010 req-8cd18279-0669-4599-8b6e-81e743819c27 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:24.339422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e423b06a-3e1f-4264-9a64-3b8e0d6ec010 req-8cd18279-0669-4599-8b6e-81e743819c27 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:24.340073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e423b06a-3e1f-4264-9a64-3b8e0d6ec010 req-8cd18279-0669-4599-8b6e-81e743819c27 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:24.396097 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e423b06a-3e1f-4264-9a64-3b8e0d6ec010 req-8cd18279-0669-4599-8b6e-81e743819c27 service nova] Creating event network-vif-plugged:10e3d67e-7cde-4cc7-9263-0e9b5687690c for instance 9c03997c-01af-46a1-9887-9b72e2a2815b on n-h1-835595-3 Oct 05 17:43:24.410234 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e423b06a-3e1f-4264-9a64-3b8e0d6ec010 req-8cd18279-0669-4599-8b6e-81e743819c27 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176863 Oct 05 17:43:24.411823 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1436/2681] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:24.419882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:24.421044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:24.432427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:24.433076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:24.433712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:24.434769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:24.438951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:24.440365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:24.720938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:24.728095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eba61cfe-1957-40bb-bbb1-4181628bd241 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:24.730887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:24.732608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:24.734037 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc0bbb94-4f31-4bfa-a97c-69c33bfc5483 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.319942 Oct 05 17:43:24.749573 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eba61cfe-1957-40bb-bbb1-4181628bd241 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1510 microversion: 2.1 time: 1.210256 Oct 05 17:43:24.749573 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1246/2682] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:23 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1510 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:24.750328 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1437/2683] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:24 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:24.761594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-100349126", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:24.860124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] validate_networks() for [('5692d339-819d-4921-a90e-ae4420454834', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:43:25.139031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c7e90ce-df90-4e0d-984f-6cb78de3522d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:25.139655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6c7e90ce-df90-4e0d-984f-6cb78de3522d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:25.154577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c7e90ce-df90-4e0d-984f-6cb78de3522d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:25.155346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c7e90ce-df90-4e0d-984f-6cb78de3522d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:25.156106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c7e90ce-df90-4e0d-984f-6cb78de3522d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:25.157011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c7e90ce-df90-4e0d-984f-6cb78de3522d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:25.157635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c7e90ce-df90-4e0d-984f-6cb78de3522d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:25.158215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c7e90ce-df90-4e0d-984f-6cb78de3522d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:25.221120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:25.419003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6c7e90ce-df90-4e0d-984f-6cb78de3522d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:25.428946 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6c7e90ce-df90-4e0d-984f-6cb78de3522d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.293186 Oct 05 17:43:25.440407 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1438/2684] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:25 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:25.458511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84c69dea-7d10-4cd9-a5f0-2974a151f04c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7774dfbb80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:25.525425 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84c69dea-7d10-4cd9-a5f0-2974a151f04c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.079217 Oct 05 17:43:25.526688 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1439/2685] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:25 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:25.762558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:25.763199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:25.773377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:25.773883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:25.774566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:25.775278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:25.775738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:25.776165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:26.497536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:43:26.501718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:43:26.503034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:43:26.503681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:43:26.504315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:43:26.557092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:26.557928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:26.558654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:26.559843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:26.562208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:26.564488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:26.662029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:26.678771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:26.680289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:26.681001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Getting quotas for project 611cddc6ef94407dba177aea44f5268d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:43:26.681535 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54a18d77-7b74-4662-81c4-000de1d3c3c4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.924395 Oct 05 17:43:26.682108 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1440/2686] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:25 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:43:26.704943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Getting quotas for user fe8df861068f404e90034c993f9e0e45 and project 611cddc6ef94407dba177aea44f5268d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:43:26.738649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:26.740102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:26.758509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:43:26.762470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:43:26.773284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:26.773914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:26.774506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:26.775514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:26.776215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:26.776652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:26.942504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:26.955960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:26.963326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:26.964501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lazy-loading 'fault' on Instance uuid ca66e5a2-7805-4dbd-a3c3-83647f245241 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:43:26.984315 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e84ee505-a45a-4581-a84e-68d6ecb244cb tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.236008 Oct 05 17:43:26.990922 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1247/2687] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:43:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:43:27.012924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c8cf61c-4515-4d85-87f3-eaeed7827ff3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:27.013982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c8cf61c-4515-4d85-87f3-eaeed7827ff3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:27.030399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8cf61c-4515-4d85-87f3-eaeed7827ff3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:27.031204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8cf61c-4515-4d85-87f3-eaeed7827ff3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:27.032450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8cf61c-4515-4d85-87f3-eaeed7827ff3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:27.033334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8cf61c-4515-4d85-87f3-eaeed7827ff3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:27.034671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8cf61c-4515-4d85-87f3-eaeed7827ff3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:27.035280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8cf61c-4515-4d85-87f3-eaeed7827ff3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:27.201428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929729edafef461692e4e44adeea5bc1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a553b48a66bf4ff7829bd4c26368dac4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:27.215196 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-839f3b68-abc3-4cb9-afbd-8de228e39019 tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 200 len: 1306 microversion: 2.1 time: 0.501531 Oct 05 17:43:27.219135 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1441/2688] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:26 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 1306 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:27.230626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-48d8d225-89a9-4f7a-90cd-fc50678740b8 req-300f0e0e-2ac4-40c8-9117-5c7d8a79b2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-plugged", "status": "completed", "tag": "87c952e0-16df-4553-88a0-a59666c95cf7"}, {"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-plugged", "status": "completed", "tag": "4d785381-e8e2-468c-b43f-da00a289173d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:27.261377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-48d8d225-89a9-4f7a-90cd-fc50678740b8 req-300f0e0e-2ac4-40c8-9117-5c7d8a79b2ee service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:27.262914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-48d8d225-89a9-4f7a-90cd-fc50678740b8 req-300f0e0e-2ac4-40c8-9117-5c7d8a79b2ee service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:27.263633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-48d8d225-89a9-4f7a-90cd-fc50678740b8 req-300f0e0e-2ac4-40c8-9117-5c7d8a79b2ee service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:27.314876 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-48d8d225-89a9-4f7a-90cd-fc50678740b8 req-300f0e0e-2ac4-40c8-9117-5c7d8a79b2ee service nova] Creating event network-vif-plugged:87c952e0-16df-4553-88a0-a59666c95cf7 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:43:27.317386 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-48d8d225-89a9-4f7a-90cd-fc50678740b8 req-300f0e0e-2ac4-40c8-9117-5c7d8a79b2ee service nova] Creating event network-vif-plugged:4d785381-e8e2-468c-b43f-da00a289173d for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:43:27.344049 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-48d8d225-89a9-4f7a-90cd-fc50678740b8 req-300f0e0e-2ac4-40c8-9117-5c7d8a79b2ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.116093 Oct 05 17:43:27.345780 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1442/2689] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:27.361425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-32d67f26-ce12-49c8-95eb-1f03d27bbff7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77747cf3a0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:27.462481 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-32d67f26-ce12-49c8-95eb-1f03d27bbff7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.113885 Oct 05 17:43:27.463872 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1443/2690] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:27 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:27.470170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f21e4c88-3c52-46ab-8f89-84d926a4155c req-2b8b8a7e-1caf-478e-b06b-27d44673e9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca66e5a2-7805-4dbd-a3c3-83647f245241", "name": "network-vif-deleted", "tag": "3a8784ad-c292-4925-b944-7d8959a69721"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:27.474693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6c8cf61c-4515-4d85-87f3-eaeed7827ff3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:27.493814 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c8cf61c-4515-4d85-87f3-eaeed7827ff3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.497382 Oct 05 17:43:27.496433 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1248/2691] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:26 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:27.509565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d76a3968-7fe8-4766-b644-c96635a34134 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:27.510201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d76a3968-7fe8-4766-b644-c96635a34134 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:27.516444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f21e4c88-3c52-46ab-8f89-84d926a4155c req-2b8b8a7e-1caf-478e-b06b-27d44673e9a4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:27.517756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f21e4c88-3c52-46ab-8f89-84d926a4155c req-2b8b8a7e-1caf-478e-b06b-27d44673e9a4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:27.519687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f21e4c88-3c52-46ab-8f89-84d926a4155c req-2b8b8a7e-1caf-478e-b06b-27d44673e9a4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:27.579248 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f21e4c88-3c52-46ab-8f89-84d926a4155c req-2b8b8a7e-1caf-478e-b06b-27d44673e9a4 service nova] Creating event network-vif-deleted:3a8784ad-c292-4925-b944-7d8959a69721 for instance ca66e5a2-7805-4dbd-a3c3-83647f245241 on n-h2-835595-3 Oct 05 17:43:27.595331 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f21e4c88-3c52-46ab-8f89-84d926a4155c req-2b8b8a7e-1caf-478e-b06b-27d44673e9a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128412 Oct 05 17:43:27.596565 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1444/2692] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:27.656683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d76a3968-7fe8-4766-b644-c96635a34134 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:27.666182 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d76a3968-7fe8-4766-b644-c96635a34134 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1224 microversion: 2.1 time: 0.167805 Oct 05 17:43:27.686508 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1249/2693] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:27 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1224 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:27.717106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:27.717923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:27.736438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:27.744121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:27.744670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:27.746731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:27.749609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:27.750209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:28.246317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:28.246948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] [instance: ca66e5a2-7805-4dbd-a3c3-83647f245241] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:28.261487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:28.261986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:28.274969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:28.282390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:28.287220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:28.287695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:28.292168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:28.309892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:28.323684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:28.328340 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c687903e-5f71-43be-857f-95fa4603e487 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.620903 Oct 05 17:43:28.329535 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1445/2694] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:27 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:28.396382 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] HTTP exception thrown: Instance ca66e5a2-7805-4dbd-a3c3-83647f245241 could not be found. Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Request method failure captured: Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 HTTP/1.1 Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcIhuR9qRAvmfp2BQUwh2e25JMEwCAgScy8rujTYgaxHO96JHs6LINVNsDpBkNvrRL4PZmTc1CMv270P4S00HZzkdPIMWmIEUTQ6wKGcJikwCQrUECB1T1Xk45G8XvxU9RYF7UImK_dhBrElXp1zj4yrjXBzRRePovbkH-rxgQAmGHs Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: a553b48a66bf4ff7829bd4c26368dac4 Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerPasswordTestJSON-2132098655 Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a553b48a66bf4ff7829bd4c26368dac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a553b48a66bf4ff7829bd4c26368dac4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a553b48a66bf4ff7829bd4c26368dac4", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a553b48a66bf4ff7829bd4c26368dac4"}]}] Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerPasswordTestJSON-2132098655 Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: a553b48a66bf4ff7829bd4c26368dac4 Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2132098655 Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerPasswordTestJSON-2132098655-project Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 929729edafef461692e4e44adeea5bc1 Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerPasswordTestJSON-2132098655-project Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance ca66e5a2-7805-4dbd-a3c3-83647f245241 could not be found. Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'ca66e5a2-7805-4dbd-a3c3-83647f245241'} Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca66e5a2-7805-4dbd-a3c3-83647f245241 could not be found. Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca66e5a2-7805-4dbd-a3c3-83647f245241 could not be found. Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:28.404062 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:28.408870 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:28.408870 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:28.408870 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:28.408870 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:43:28.408870 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:43:28.408870 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca66e5a2-7805-4dbd-a3c3-83647f245241 could not be found. Oct 05 17:43:28.408870 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:43:28.428374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] Returning 404 to user: Instance ca66e5a2-7805-4dbd-a3c3-83647f245241 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:28.429505 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d6593d8d-5068-4ce2-ba20-642a20e004ec tempest-ServerPasswordTestJSON-2132098655 tempest-ServerPasswordTestJSON-2132098655-project] 10.222.0.70 "GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241" status: 404 len: 111 microversion: 2.1 time: 0.187718 Oct 05 17:43:28.436535 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1250/2695] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:28 2022] GET /compute/v2.1/servers/ca66e5a2-7805-4dbd-a3c3-83647f245241 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:43:28.479918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7c7bfd83-d849-42a2-980a-4b8034d08182 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7779465790>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:28.531895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e9b0d2d4-f0e6-4b0e-a49e-fc6aee25eec2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:28.532666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e9b0d2d4-f0e6-4b0e-a49e-fc6aee25eec2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:28.562184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9b0d2d4-f0e6-4b0e-a49e-fc6aee25eec2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:28.566175 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7c7bfd83-d849-42a2-980a-4b8034d08182 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.090367 Oct 05 17:43:28.567295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9b0d2d4-f0e6-4b0e-a49e-fc6aee25eec2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:28.575251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9b0d2d4-f0e6-4b0e-a49e-fc6aee25eec2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:28.584914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9b0d2d4-f0e6-4b0e-a49e-fc6aee25eec2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:28.585417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9b0d2d4-f0e6-4b0e-a49e-fc6aee25eec2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:28.585863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9b0d2d4-f0e6-4b0e-a49e-fc6aee25eec2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:28.586877 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1446/2696] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:28 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:28.695009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a1cc1172-5e03-45d2-9234-e9aac95600d8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:28.696058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a1cc1172-5e03-45d2-9234-e9aac95600d8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:28.718253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1cc1172-5e03-45d2-9234-e9aac95600d8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:28.721565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1cc1172-5e03-45d2-9234-e9aac95600d8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:28.722753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1cc1172-5e03-45d2-9234-e9aac95600d8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:28.723815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1cc1172-5e03-45d2-9234-e9aac95600d8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:28.724556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1cc1172-5e03-45d2-9234-e9aac95600d8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:28.725246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1cc1172-5e03-45d2-9234-e9aac95600d8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:28.893970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a1cc1172-5e03-45d2-9234-e9aac95600d8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:28.924961 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a1cc1172-5e03-45d2-9234-e9aac95600d8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1276 microversion: 2.1 time: 0.233948 Oct 05 17:43:28.929201 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1447/2697] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:28 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1276 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:29.043549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e9b0d2d4-f0e6-4b0e-a49e-fc6aee25eec2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:29.058594 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e9b0d2d4-f0e6-4b0e-a49e-fc6aee25eec2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.532798 Oct 05 17:43:29.083391 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1251/2698] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:28 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:29.362780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:29.364007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:29.371149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4e7cc64c-117a-4b35-8a1e-dd01fd59828e req-e540fc5e-d2f9-45aa-89f5-e9a8bfe44556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-plugged", "status": "completed", "tag": "d9b12b5b-6e9d-4c88-9bcd-822551970a31"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:29.387294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:29.390938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:29.391163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4e7cc64c-117a-4b35-8a1e-dd01fd59828e req-e540fc5e-d2f9-45aa-89f5-e9a8bfe44556 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:29.391757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:29.392646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:29.393328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4e7cc64c-117a-4b35-8a1e-dd01fd59828e req-e540fc5e-d2f9-45aa-89f5-e9a8bfe44556 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:29.393778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:29.395198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:29.396188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4e7cc64c-117a-4b35-8a1e-dd01fd59828e req-e540fc5e-d2f9-45aa-89f5-e9a8bfe44556 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:29.418360 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4e7cc64c-117a-4b35-8a1e-dd01fd59828e req-e540fc5e-d2f9-45aa-89f5-e9a8bfe44556 service nova] Creating event network-vif-plugged:d9b12b5b-6e9d-4c88-9bcd-822551970a31 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:43:29.444116 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4e7cc64c-117a-4b35-8a1e-dd01fd59828e req-e540fc5e-d2f9-45aa-89f5-e9a8bfe44556 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078070 Oct 05 17:43:29.445331 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1252/2699] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:43:29.592747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3429c813-30ba-4e68-971b-776be51ed386 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77795c9f70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:29.708831 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3429c813-30ba-4e68-971b-776be51ed386 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.120692 Oct 05 17:43:29.722635 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1253/2700] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:29 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:29.953475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1c3f399d-055a-4603-a97e-57a40c13593d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:29.954367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1c3f399d-055a-4603-a97e-57a40c13593d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:29.967019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3f399d-055a-4603-a97e-57a40c13593d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:29.967524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3f399d-055a-4603-a97e-57a40c13593d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:29.967965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3f399d-055a-4603-a97e-57a40c13593d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:29.968681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3f399d-055a-4603-a97e-57a40c13593d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:29.974147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3f399d-055a-4603-a97e-57a40c13593d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:29.974715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3f399d-055a-4603-a97e-57a40c13593d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:30.213370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:30.227371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:30.229404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:30.231252 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b4adb6b7-0132-47e3-9a46-a1427d329d99 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.876778 Oct 05 17:43:30.232072 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1448/2701] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:29 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:30.239017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e12793cb-f021-4c0b-9d98-86cc36b2517c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:30.240032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e12793cb-f021-4c0b-9d98-86cc36b2517c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:30.248041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e12793cb-f021-4c0b-9d98-86cc36b2517c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:30.248922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e12793cb-f021-4c0b-9d98-86cc36b2517c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:30.249642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e12793cb-f021-4c0b-9d98-86cc36b2517c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:30.250606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e12793cb-f021-4c0b-9d98-86cc36b2517c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:30.251436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e12793cb-f021-4c0b-9d98-86cc36b2517c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:30.252074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e12793cb-f021-4c0b-9d98-86cc36b2517c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:30.491925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e12793cb-f021-4c0b-9d98-86cc36b2517c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:30.506178 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e12793cb-f021-4c0b-9d98-86cc36b2517c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1502 microversion: 2.1 time: 0.272219 Oct 05 17:43:30.507245 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1449/2702] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:30 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1502 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:30.576267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1c3f399d-055a-4603-a97e-57a40c13593d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:30.586355 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1c3f399d-055a-4603-a97e-57a40c13593d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1282 microversion: 2.1 time: 0.638714 Oct 05 17:43:30.587032 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1254/2703] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:29 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1282 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:43:30.734112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5766a2db-699c-4ca8-a943-7f63b4197815 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77794659d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:30.806430 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5766a2db-699c-4ca8-a943-7f63b4197815 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.080688 Oct 05 17:43:30.807392 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1450/2704] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:30 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:31.263358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:31.264212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:31.280722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:31.281384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:31.281934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:31.283104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:31.283672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:31.284203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:31.536626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0b8b4445-04d9-48b1-96ec-ade823908869 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:31.537864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0b8b4445-04d9-48b1-96ec-ade823908869 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:31.550796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8b4445-04d9-48b1-96ec-ade823908869 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:31.561841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8b4445-04d9-48b1-96ec-ade823908869 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:31.562429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8b4445-04d9-48b1-96ec-ade823908869 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:31.563254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8b4445-04d9-48b1-96ec-ade823908869 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:31.563790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8b4445-04d9-48b1-96ec-ade823908869 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:31.564314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8b4445-04d9-48b1-96ec-ade823908869 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:32.284720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:32.302273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:32.304160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:32.305649 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f32cf61-858e-47b0-9b7b-9cedf81fcb22 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 1.046673 Oct 05 17:43:32.327799 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1255/2705] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:31 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:32.334859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-dc58c1aa-a47a-460b-923d-035b5237561f req-8d22f88f-bbff-44fc-8bdd-6e3198c49b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-plugged", "status": "completed", "tag": "d2f0b027-74d5-4d61-87a2-5e76a8d81918"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:32.346085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-dc58c1aa-a47a-460b-923d-035b5237561f req-8d22f88f-bbff-44fc-8bdd-6e3198c49b5f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:32.353829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-dc58c1aa-a47a-460b-923d-035b5237561f req-8d22f88f-bbff-44fc-8bdd-6e3198c49b5f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:32.361935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-dc58c1aa-a47a-460b-923d-035b5237561f req-8d22f88f-bbff-44fc-8bdd-6e3198c49b5f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:32.412153 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-dc58c1aa-a47a-460b-923d-035b5237561f req-8d22f88f-bbff-44fc-8bdd-6e3198c49b5f service nova] Creating event network-vif-plugged:d2f0b027-74d5-4d61-87a2-5e76a8d81918 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:43:32.428624 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-dc58c1aa-a47a-460b-923d-035b5237561f req-8d22f88f-bbff-44fc-8bdd-6e3198c49b5f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097416 Oct 05 17:43:32.430697 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1256/2706] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:32.444306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b4b41441-7d95-4171-8936-deae29800c6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:32.447713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b4b41441-7d95-4171-8936-deae29800c6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:32.461709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4b41441-7d95-4171-8936-deae29800c6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:32.470661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4b41441-7d95-4171-8936-deae29800c6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:32.471371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4b41441-7d95-4171-8936-deae29800c6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:32.473719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4b41441-7d95-4171-8936-deae29800c6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:32.474644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4b41441-7d95-4171-8936-deae29800c6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:32.475273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4b41441-7d95-4171-8936-deae29800c6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:32.667394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b4b41441-7d95-4171-8936-deae29800c6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:32.683045 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b4b41441-7d95-4171-8936-deae29800c6f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1282 microversion: 2.1 time: 0.250919 Oct 05 17:43:32.689176 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1257/2707] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:32 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1282 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:32.708090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-81cca87c-6da3-403e-a0e2-4702efeae21f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775ae8af0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:32.759179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0b8b4445-04d9-48b1-96ec-ade823908869 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:32.768697 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0b8b4445-04d9-48b1-96ec-ade823908869 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1492 microversion: 2.1 time: 1.237196 Oct 05 17:43:32.781652 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1451/2708] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:31 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1492 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:32.808305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ee78795-504e-4ea2-8d7d-896cf3bf5d8b tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '.version_select at 0x7f77793fc5e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:32.808466 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-81cca87c-6da3-403e-a0e2-4702efeae21f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.114763 Oct 05 17:43:32.810425 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1258/2709] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:32 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:32.827644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ee78795-504e-4ea2-8d7d-896cf3bf5d8b tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:32.828133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ee78795-504e-4ea2-8d7d-896cf3bf5d8b tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:32.828581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ee78795-504e-4ea2-8d7d-896cf3bf5d8b tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:32.848340 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ee78795-504e-4ea2-8d7d-896cf3bf5d8b tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.053230 Oct 05 17:43:32.854403 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1452/2710] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:43:32 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:32.864981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-91a22a4f-1003-43e2-a1d6-24c58289ccbf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:32.865741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-91a22a4f-1003-43e2-a1d6-24c58289ccbf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:32.877566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91a22a4f-1003-43e2-a1d6-24c58289ccbf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:32.878364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91a22a4f-1003-43e2-a1d6-24c58289ccbf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:32.879026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91a22a4f-1003-43e2-a1d6-24c58289ccbf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:32.880001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91a22a4f-1003-43e2-a1d6-24c58289ccbf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:32.880665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91a22a4f-1003-43e2-a1d6-24c58289ccbf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:32.881296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91a22a4f-1003-43e2-a1d6-24c58289ccbf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:33.335696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:33.336786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:33.358776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:33.359325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:33.359788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:33.360611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:33.361338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:33.361779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:34.165817 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-91a22a4f-1003-43e2-a1d6-24c58289ccbf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1643 microversion: 2.1 time: 1.305408 Oct 05 17:43:34.186159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:34.200305 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1259/2711] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:32 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1643 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:34.221246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:34.223371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:34.224966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-440d6a15-5f24-41b6-b8ad-2195305d3eaa tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:34.225676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-440d6a15-5f24-41b6-b8ad-2195305d3eaa tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:34.231179 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dd537478-60d3-4aa5-8528-491d6ed252ff tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.900199 Oct 05 17:43:34.239800 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1453/2712] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:33 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:34.248247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-440d6a15-5f24-41b6-b8ad-2195305d3eaa tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:34.248765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-440d6a15-5f24-41b6-b8ad-2195305d3eaa tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:34.249201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-440d6a15-5f24-41b6-b8ad-2195305d3eaa tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:34.249921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-440d6a15-5f24-41b6-b8ad-2195305d3eaa tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:34.250428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-440d6a15-5f24-41b6-b8ad-2195305d3eaa tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:34.250853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-440d6a15-5f24-41b6-b8ad-2195305d3eaa tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:34.267126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2e8f276c-8cd1-4ab3-a22f-78044a4fb5ef tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777478f700>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:34.395894 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2e8f276c-8cd1-4ab3-a22f-78044a4fb5ef tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.154674 Oct 05 17:43:34.398678 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1454/2713] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:34 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:34.732026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-440d6a15-5f24-41b6-b8ad-2195305d3eaa tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:34.755953 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-440d6a15-5f24-41b6-b8ad-2195305d3eaa tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1324 microversion: 2.1 time: 0.546833 Oct 05 17:43:34.761768 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1260/2714] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:34 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1324 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:34.789993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1185041625", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "0ccfc34d-2c65-4344-9114-4b96b3845d6a"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:34.843398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-768149202", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "779a91f2-3a75-445d-9118-95906babe826"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:34.913934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] validate_networks() for [('0ccfc34d-2c65-4344-9114-4b96b3845d6a', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:43:35.032882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] validate_networks() for [('779a91f2-3a75-445d-9118-95906babe826', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:43:36.626693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:36.924932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:43:36.926020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:43:36.928215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:43:36.928882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:43:36.929584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:43:36.980510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:36.981623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:36.982371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:36.983391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:36.984138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:36.985305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:37.033142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Getting quotas for project 7956891e6f6e4d34a6180bf39302dba9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:43:37.050891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Getting quotas for user 3cd8c8eb0eac4ad3b8364e5fe54bc340 and project 7956891e6f6e4d34a6180bf39302dba9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:43:37.071529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:43:37.080478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:43:37.182821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d370877-8826-4919-825e-1d5b1b5597ff tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.753225 Oct 05 17:43:37.184462 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1455/2715] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 17:43:37.232877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-cd84be01-8236-44a9-aefd-8e1b88bbe1fb req-e48b3fb9-f765-46a1-970f-455a49ecb926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-plugged", "status": "completed", "tag": "dd8de17b-2b96-4926-ad70-b1417782ae0f"}, {"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-plugged", "status": "completed", "tag": "58505811-eb6b-4527-9362-13751f69bc6e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:37.274666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:43:37.275100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:43:37.275581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:43:37.275991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:43:37.277395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cd84be01-8236-44a9-aefd-8e1b88bbe1fb req-e48b3fb9-f765-46a1-970f-455a49ecb926 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:37.277569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:43:37.280400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cd84be01-8236-44a9-aefd-8e1b88bbe1fb req-e48b3fb9-f765-46a1-970f-455a49ecb926 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:37.281121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cd84be01-8236-44a9-aefd-8e1b88bbe1fb req-e48b3fb9-f765-46a1-970f-455a49ecb926 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:37.300713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:37.301402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:37.302584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:37.304747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:37.307500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:37.308157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:37.323977 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-cd84be01-8236-44a9-aefd-8e1b88bbe1fb req-e48b3fb9-f765-46a1-970f-455a49ecb926 service nova] Creating event network-vif-plugged:dd8de17b-2b96-4926-ad70-b1417782ae0f for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:43:37.324780 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-cd84be01-8236-44a9-aefd-8e1b88bbe1fb req-e48b3fb9-f765-46a1-970f-455a49ecb926 service nova] Creating event network-vif-plugged:58505811-eb6b-4527-9362-13751f69bc6e for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:43:37.338868 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-cd84be01-8236-44a9-aefd-8e1b88bbe1fb req-e48b3fb9-f765-46a1-970f-455a49ecb926 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.152896 Oct 05 17:43:37.339987 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1456/2716] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:37.345878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Getting quotas for project f401d1367a73495598bb8a6b882e8618. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:43:37.351529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Getting quotas for user 695a37f439e94d2e860e51df835827e4 and project f401d1367a73495598bb8a6b882e8618. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:43:37.353493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:37.354827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:37.365931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:43:37.368056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:37.369028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:37.369720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:37.370694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:37.371389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:37.372311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:37.380319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:43:37.494669 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d61c1afa-2290-42fc-a2f6-73c69f9ca6b4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.730009 Oct 05 17:43:37.495754 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1261/2717] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:43:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:43:37.501661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e915f394-803b-4fc1-98d8-c73ab3f48083 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77758139d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:37.590152 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e915f394-803b-4fc1-98d8-c73ab3f48083 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.082780 Oct 05 17:43:37.598273 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1262/2718] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:37 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:37.614841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-03d2b397-6775-4c8c-bc9e-c0b3b1d19705 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:37.616525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-03d2b397-6775-4c8c-bc9e-c0b3b1d19705 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:37.649589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03d2b397-6775-4c8c-bc9e-c0b3b1d19705 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:37.652186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03d2b397-6775-4c8c-bc9e-c0b3b1d19705 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:37.652808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03d2b397-6775-4c8c-bc9e-c0b3b1d19705 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:37.654330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03d2b397-6775-4c8c-bc9e-c0b3b1d19705 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:37.658759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03d2b397-6775-4c8c-bc9e-c0b3b1d19705 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:37.660664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03d2b397-6775-4c8c-bc9e-c0b3b1d19705 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:38.041411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:38.057889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:38.066945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:38.074263 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d78303d-f8c1-44cd-b6e2-1ad360cdeb0d tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.728915 Oct 05 17:43:38.077538 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1457/2719] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:37 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:38.109843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-412381758", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "779a91f2-3a75-445d-9118-95906babe826"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:38.311511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] validate_networks() for [('779a91f2-3a75-445d-9118-95906babe826', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:43:38.820664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-03d2b397-6775-4c8c-bc9e-c0b3b1d19705 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:38.841758 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-03d2b397-6775-4c8c-bc9e-c0b3b1d19705 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1324 microversion: 2.1 time: 1.240281 Oct 05 17:43:38.843345 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1263/2720] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:37 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1324 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:38.866903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f37dd128-a174-4de0-972b-5f951a301de1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:38.867709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f37dd128-a174-4de0-972b-5f951a301de1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:38.887333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37dd128-a174-4de0-972b-5f951a301de1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:38.888016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37dd128-a174-4de0-972b-5f951a301de1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:38.888493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37dd128-a174-4de0-972b-5f951a301de1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:38.889440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37dd128-a174-4de0-972b-5f951a301de1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:38.890854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37dd128-a174-4de0-972b-5f951a301de1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:38.893608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37dd128-a174-4de0-972b-5f951a301de1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:38.897551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:39.092861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f37dd128-a174-4de0-972b-5f951a301de1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:39.105278 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f37dd128-a174-4de0-972b-5f951a301de1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1207 microversion: 2.1 time: 0.251219 Oct 05 17:43:39.128770 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1264/2721] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:38 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1207 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:39.128770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-dad38401-4975-4675-8a3a-92a77d80097b req-293b152c-ddea-45ff-9d09-e3cffc5c7529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "528b4233-a9d9-4f97-94d8-c4b52c793f09", "tag": "7acf7b85-5877-44df-9da8-c253b70ac5ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:39.145588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-dad38401-4975-4675-8a3a-92a77d80097b req-293b152c-ddea-45ff-9d09-e3cffc5c7529 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:39.146291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-dad38401-4975-4675-8a3a-92a77d80097b req-293b152c-ddea-45ff-9d09-e3cffc5c7529 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:39.146849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-dad38401-4975-4675-8a3a-92a77d80097b req-293b152c-ddea-45ff-9d09-e3cffc5c7529 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:39.160978 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-dad38401-4975-4675-8a3a-92a77d80097b req-293b152c-ddea-45ff-9d09-e3cffc5c7529 service nova] Creating event network-changed:7acf7b85-5877-44df-9da8-c253b70ac5ef for instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 on n-h2-835595-3 Oct 05 17:43:39.176695 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-dad38401-4975-4675-8a3a-92a77d80097b req-293b152c-ddea-45ff-9d09-e3cffc5c7529 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060876 Oct 05 17:43:39.183232 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1265/2722] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:39.189353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-047a34eb-d851-4d9a-acdb-c43fa5b92764 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775b51a60>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:39.283236 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-047a34eb-d851-4d9a-acdb-c43fa5b92764 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.098190 Oct 05 17:43:39.283827 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1266/2723] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:39 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:39.296381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:39.299005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:39.327535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:39.328031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:39.328542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:39.333275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:39.333766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:39.334203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:39.465243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:43:39.466351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:43:39.467043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:43:39.467650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:43:39.468263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:43:39.480657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:39.481429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:39.482743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:39.484467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:39.485103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:39.485768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:39.564503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Getting quotas for project 7956891e6f6e4d34a6180bf39302dba9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:43:39.597924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Getting quotas for user 3cd8c8eb0eac4ad3b8364e5fe54bc340 and project 7956891e6f6e4d34a6180bf39302dba9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:43:39.666036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:43:39.676309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:43:40.029834 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-069d7f77-742f-49a3-aeb0-d53c32d0706c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.939960 Oct 05 17:43:40.030975 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1458/2724] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:43:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:43:40.047426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-38423f25-bf56-4ff0-8505-deadee4db04c req-1ae5360a-9b24-4979-a1d2-98fa0ee4f033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-plugged", "status": "completed", "tag": "8bab3a7f-8718-4960-8440-c090413703a8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:40.095524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-38423f25-bf56-4ff0-8505-deadee4db04c req-1ae5360a-9b24-4979-a1d2-98fa0ee4f033 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:40.100307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-38423f25-bf56-4ff0-8505-deadee4db04c req-1ae5360a-9b24-4979-a1d2-98fa0ee4f033 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:40.104691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-38423f25-bf56-4ff0-8505-deadee4db04c req-1ae5360a-9b24-4979-a1d2-98fa0ee4f033 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:40.164385 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-38423f25-bf56-4ff0-8505-deadee4db04c req-1ae5360a-9b24-4979-a1d2-98fa0ee4f033 service nova] Creating event network-vif-plugged:8bab3a7f-8718-4960-8440-c090413703a8 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:43:40.191611 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-38423f25-bf56-4ff0-8505-deadee4db04c req-1ae5360a-9b24-4979-a1d2-98fa0ee4f033 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156000 Oct 05 17:43:40.194018 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1459/2725] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:40.229922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7b23c37e-36b9-4395-8403-4e6d2d6b7905 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:40.229922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7b23c37e-36b9-4395-8403-4e6d2d6b7905 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:40.271863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b23c37e-36b9-4395-8403-4e6d2d6b7905 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:40.276771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b23c37e-36b9-4395-8403-4e6d2d6b7905 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:40.280578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b23c37e-36b9-4395-8403-4e6d2d6b7905 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:40.281598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b23c37e-36b9-4395-8403-4e6d2d6b7905 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:40.286852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b23c37e-36b9-4395-8403-4e6d2d6b7905 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:40.290384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b23c37e-36b9-4395-8403-4e6d2d6b7905 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:40.594121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7b23c37e-36b9-4395-8403-4e6d2d6b7905 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:40.607165 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7b23c37e-36b9-4395-8403-4e6d2d6b7905 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1324 microversion: 2.1 time: 0.401631 Oct 05 17:43:40.609684 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1460/2726] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:40 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1324 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:40.617714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b0f1c757-a618-44e1-8b66-60b137fc3303 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:40.624176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b0f1c757-a618-44e1-8b66-60b137fc3303 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:40.626695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:40.641035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f1c757-a618-44e1-8b66-60b137fc3303 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:40.642152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f1c757-a618-44e1-8b66-60b137fc3303 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:40.645005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f1c757-a618-44e1-8b66-60b137fc3303 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:40.647075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f1c757-a618-44e1-8b66-60b137fc3303 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:40.649758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f1c757-a618-44e1-8b66-60b137fc3303 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:40.652227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0f1c757-a618-44e1-8b66-60b137fc3303 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:40.875227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b0f1c757-a618-44e1-8b66-60b137fc3303 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:40.885426 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b0f1c757-a618-44e1-8b66-60b137fc3303 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1271 microversion: 2.1 time: 0.274444 Oct 05 17:43:40.910892 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1461/2727] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:40 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1271 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:40.935766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1311818921", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "451", "networks": [{"uuid": "779a91f2-3a75-445d-9118-95906babe826"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:41.037083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] validate_networks() for [('779a91f2-3a75-445d-9118-95906babe826', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:43:41.241896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:41.258558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:41.264290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:41.270590 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8a458265-059c-4e5c-b642-cee1b0d2215a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 1.985692 Oct 05 17:43:41.290304 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1267/2728] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:39 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 1993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:41.290304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b9329d2-35bc-4c39-82b3-2a4a68c16739 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775b96ee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:41.404385 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b9329d2-35bc-4c39-82b3-2a4a68c16739 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.124132 Oct 05 17:43:41.404979 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1268/2729] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:41 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:41.636726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ffa5303-c28b-46c4-8ada-b8c8e1245ca9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:41.637354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8ffa5303-c28b-46c4-8ada-b8c8e1245ca9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:41.650039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffa5303-c28b-46c4-8ada-b8c8e1245ca9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:41.650574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffa5303-c28b-46c4-8ada-b8c8e1245ca9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:41.651031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffa5303-c28b-46c4-8ada-b8c8e1245ca9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:41.651862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffa5303-c28b-46c4-8ada-b8c8e1245ca9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:41.652184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffa5303-c28b-46c4-8ada-b8c8e1245ca9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:41.665155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffa5303-c28b-46c4-8ada-b8c8e1245ca9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:42.471949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:43:42.472900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:43:42.473521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:43:42.474086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:43:42.474692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:43:42.493951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:42.494865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:42.497080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:42.503243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:42.504396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:42.505004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:42.558925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Getting quotas for project 7956891e6f6e4d34a6180bf39302dba9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:43:42.569978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Getting quotas for user 3cd8c8eb0eac4ad3b8364e5fe54bc340 and project 7956891e6f6e4d34a6180bf39302dba9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:43:42.608125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:43:42.624324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:43:42.730004 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6857feac-1de3-4a91-a7e9-26850336567a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.817633 Oct 05 17:43:42.734035 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1462/2730] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:43:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:43:42.745774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-34e23c8a-8dab-46e2-a7db-326c38f84d8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:42.748316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-34e23c8a-8dab-46e2-a7db-326c38f84d8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:42.757198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34e23c8a-8dab-46e2-a7db-326c38f84d8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:42.757934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34e23c8a-8dab-46e2-a7db-326c38f84d8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:42.758714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34e23c8a-8dab-46e2-a7db-326c38f84d8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:42.759658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34e23c8a-8dab-46e2-a7db-326c38f84d8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:42.760325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34e23c8a-8dab-46e2-a7db-326c38f84d8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:42.760964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34e23c8a-8dab-46e2-a7db-326c38f84d8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:42.907850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-34e23c8a-8dab-46e2-a7db-326c38f84d8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:42.922320 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-34e23c8a-8dab-46e2-a7db-326c38f84d8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1269 microversion: 2.1 time: 0.179291 Oct 05 17:43:42.922867 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1463/2731] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:42 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1269 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:42.939719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:42.940340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:42.976087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:42.976577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:42.977108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:42.977876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:42.978389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:42.978761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:43.205143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8ffa5303-c28b-46c4-8ada-b8c8e1245ca9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:43.228308 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8ffa5303-c28b-46c4-8ada-b8c8e1245ca9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1324 microversion: 2.1 time: 1.589641 Oct 05 17:43:43.230979 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1269/2732] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:41 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1324 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:43.252912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-baf96715-bd56-412e-9bca-7296e5fb8020 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775c48f70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:43.319815 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-baf96715-bd56-412e-9bca-7296e5fb8020 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.084717 Oct 05 17:43:43.324158 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1270/2733] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:43 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:43.335805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-21b1c7a4-5b20-41d2-929b-b3d9600b7a87 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:43.340262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-21b1c7a4-5b20-41d2-929b-b3d9600b7a87 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:43.703577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:43.735369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:43.739030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:43.742667 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21121393-5a3c-417c-8cc8-5b0c8bf7a840 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1877 microversion: 2.32 time: 0.813788 Oct 05 17:43:43.758872 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1464/2734] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:42 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1877 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:43.816495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-21b1c7a4-5b20-41d2-929b-b3d9600b7a87 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:43.829184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-21b1c7a4-5b20-41d2-929b-b3d9600b7a87 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1221 microversion: 2.1 time: 0.503647 Oct 05 17:43:43.830605 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1271/2735] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:43 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1221 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:43.946333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c400fff6-8e90-45f2-843b-5ebc3019411b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:43.946931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c400fff6-8e90-45f2-843b-5ebc3019411b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:43.962877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c400fff6-8e90-45f2-843b-5ebc3019411b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:43.963363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c400fff6-8e90-45f2-843b-5ebc3019411b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:43.963800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c400fff6-8e90-45f2-843b-5ebc3019411b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:43.977868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c400fff6-8e90-45f2-843b-5ebc3019411b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:43.996931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c400fff6-8e90-45f2-843b-5ebc3019411b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:43.997406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c400fff6-8e90-45f2-843b-5ebc3019411b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:44.002087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:44.254037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-18b53acd-e663-4967-bd55-8619bd2d6c36 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:44.255374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-18b53acd-e663-4967-bd55-8619bd2d6c36 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:44.268651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18b53acd-e663-4967-bd55-8619bd2d6c36 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:44.271060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18b53acd-e663-4967-bd55-8619bd2d6c36 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:44.271747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18b53acd-e663-4967-bd55-8619bd2d6c36 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:44.272687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18b53acd-e663-4967-bd55-8619bd2d6c36 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:44.273418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18b53acd-e663-4967-bd55-8619bd2d6c36 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:44.274161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18b53acd-e663-4967-bd55-8619bd2d6c36 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:44.285601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c400fff6-8e90-45f2-843b-5ebc3019411b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:44.295046 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c400fff6-8e90-45f2-843b-5ebc3019411b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1269 microversion: 2.1 time: 0.353272 Oct 05 17:43:44.306356 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1465/2736] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:43 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1269 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:44.339245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fe7002f3-a0b7-4fd1-884c-f03496022497 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775219280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:44.410772 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fe7002f3-a0b7-4fd1-884c-f03496022497 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.075431 Oct 05 17:43:44.411879 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1466/2737] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:44 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:44.772486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:44.773945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:44.802567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:44.803363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:44.805163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:44.809790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:44.811660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:44.812705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:45.328192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-18b53acd-e663-4967-bd55-8619bd2d6c36 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:45.404715 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-18b53acd-e663-4967-bd55-8619bd2d6c36 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1324 microversion: 2.1 time: 1.153164 Oct 05 17:43:45.407837 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1272/2738] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:44 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1324 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:43:45.432526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-646b9e24-c61c-4466-bd81-08837dc804cd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:45.433913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-646b9e24-c61c-4466-bd81-08837dc804cd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:45.443611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-646b9e24-c61c-4466-bd81-08837dc804cd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:45.450152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-646b9e24-c61c-4466-bd81-08837dc804cd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:45.451640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-646b9e24-c61c-4466-bd81-08837dc804cd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:45.452618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-646b9e24-c61c-4466-bd81-08837dc804cd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:45.452749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:45.453954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-646b9e24-c61c-4466-bd81-08837dc804cd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:45.454620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-646b9e24-c61c-4466-bd81-08837dc804cd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:45.480186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:45.488064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:45.490580 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ada14135-143f-4a46-9285-32bfea9f5224 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 2829 microversion: 2.32 time: 0.722574 Oct 05 17:43:45.491189 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1467/2739] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:43:44 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 2829 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:45.505858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-215dc98c-4d4e-4296-9d48-210b7b15ae42 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:45.506718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-215dc98c-4d4e-4296-9d48-210b7b15ae42 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:45.531299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-215dc98c-4d4e-4296-9d48-210b7b15ae42 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:45.534592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-215dc98c-4d4e-4296-9d48-210b7b15ae42 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:45.535418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-215dc98c-4d4e-4296-9d48-210b7b15ae42 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:45.538498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-215dc98c-4d4e-4296-9d48-210b7b15ae42 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:45.543368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-215dc98c-4d4e-4296-9d48-210b7b15ae42 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:45.544900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-215dc98c-4d4e-4296-9d48-210b7b15ae42 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:45.729122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-215dc98c-4d4e-4296-9d48-210b7b15ae42 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:45.745964 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-215dc98c-4d4e-4296-9d48-210b7b15ae42 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1269 microversion: 2.1 time: 0.246568 Oct 05 17:43:45.747362 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1468/2740] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:45 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1269 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:45.752630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d469cfc-54e1-4b95-9398-f54f1898dea0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777478f790>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:45.854680 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2d469cfc-54e1-4b95-9398-f54f1898dea0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.105437 Oct 05 17:43:45.855716 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1469/2741] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:45 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:45.866345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e81c1663-c0c1-4289-85a0-af4931590bf3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:45.866969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e81c1663-c0c1-4289-85a0-af4931590bf3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:45.879764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e81c1663-c0c1-4289-85a0-af4931590bf3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:45.884636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e81c1663-c0c1-4289-85a0-af4931590bf3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:45.885336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e81c1663-c0c1-4289-85a0-af4931590bf3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:45.886323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e81c1663-c0c1-4289-85a0-af4931590bf3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:45.887072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e81c1663-c0c1-4289-85a0-af4931590bf3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:45.887740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e81c1663-c0c1-4289-85a0-af4931590bf3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:46.213153 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e81c1663-c0c1-4289-85a0-af4931590bf3 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.356159 Oct 05 17:43:46.213835 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1470/2742] 10.222.0.70 () {60 vars in 1316 bytes} [Wed Oct 5 17:43:45 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce/os-interface => generated 1830 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:43:46.429786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bd9c5b4c-88d4-43ae-8939-98c4f7ab9187 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:46.430755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bd9c5b4c-88d4-43ae-8939-98c4f7ab9187 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:46.440083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd9c5b4c-88d4-43ae-8939-98c4f7ab9187 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:46.443497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd9c5b4c-88d4-43ae-8939-98c4f7ab9187 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:46.443957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd9c5b4c-88d4-43ae-8939-98c4f7ab9187 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:46.444696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd9c5b4c-88d4-43ae-8939-98c4f7ab9187 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:46.450415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd9c5b4c-88d4-43ae-8939-98c4f7ab9187 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:46.451668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd9c5b4c-88d4-43ae-8939-98c4f7ab9187 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:46.901382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-646b9e24-c61c-4466-bd81-08837dc804cd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:46.912056 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-646b9e24-c61c-4466-bd81-08837dc804cd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1273 microversion: 2.1 time: 1.499966 Oct 05 17:43:46.923086 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1273/2743] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:45 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1273 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:46.933840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4377eb69-5052-4d12-9977-7b377822c4f1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:46.938855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4377eb69-5052-4d12-9977-7b377822c4f1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:46.957403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4377eb69-5052-4d12-9977-7b377822c4f1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:46.958116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4377eb69-5052-4d12-9977-7b377822c4f1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:46.960451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4377eb69-5052-4d12-9977-7b377822c4f1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:46.966820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4377eb69-5052-4d12-9977-7b377822c4f1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:46.967589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4377eb69-5052-4d12-9977-7b377822c4f1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:46.968108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4377eb69-5052-4d12-9977-7b377822c4f1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:47.336341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:47.464145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4377eb69-5052-4d12-9977-7b377822c4f1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:47.478133 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4377eb69-5052-4d12-9977-7b377822c4f1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1269 microversion: 2.1 time: 0.555696 Oct 05 17:43:47.481524 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1274/2744] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:46 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1269 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:47.503549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6fc7498-a0fe-46e9-bcc5-d6b4411caad6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775438c10>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:47.579103 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c6fc7498-a0fe-46e9-bcc5-d6b4411caad6 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1438 microversion: 2.1 time: 0.093940 Oct 05 17:43:47.580464 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1275/2745] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:47 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1438 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:47.590374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-113551cf-3755-4fc9-b26a-e86f5780f11a req-6d3ca1d4-b4c7-4c96-b39b-775b172bc360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528b4233-a9d9-4f97-94d8-c4b52c793f09", "name": "network-vif-plugged", "status": "completed", "tag": "7acf7b85-5877-44df-9da8-c253b70ac5ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:47.614073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-113551cf-3755-4fc9-b26a-e86f5780f11a req-6d3ca1d4-b4c7-4c96-b39b-775b172bc360 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:47.614829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-113551cf-3755-4fc9-b26a-e86f5780f11a req-6d3ca1d4-b4c7-4c96-b39b-775b172bc360 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:47.615558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-113551cf-3755-4fc9-b26a-e86f5780f11a req-6d3ca1d4-b4c7-4c96-b39b-775b172bc360 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:47.645114 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-113551cf-3755-4fc9-b26a-e86f5780f11a req-6d3ca1d4-b4c7-4c96-b39b-775b172bc360 service nova] Creating event network-vif-plugged:7acf7b85-5877-44df-9da8-c253b70ac5ef for instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 on n-h2-835595-3 Oct 05 17:43:47.665712 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-113551cf-3755-4fc9-b26a-e86f5780f11a req-6d3ca1d4-b4c7-4c96-b39b-775b172bc360 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083786 Oct 05 17:43:47.667457 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1276/2746] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:47.940601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bd9c5b4c-88d4-43ae-8939-98c4f7ab9187 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:47.951824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc9c6791-ad39-4a25-b51b-e9eb5c74ba68 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:47.952864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cc9c6791-ad39-4a25-b51b-e9eb5c74ba68 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:47.970871 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bd9c5b4c-88d4-43ae-8939-98c4f7ab9187 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1324 microversion: 2.1 time: 1.537086 Oct 05 17:43:47.971911 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1471/2747] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:46 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1324 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:47.994622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc9c6791-ad39-4a25-b51b-e9eb5c74ba68 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:47.995571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc9c6791-ad39-4a25-b51b-e9eb5c74ba68 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:48.022827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc9c6791-ad39-4a25-b51b-e9eb5c74ba68 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:48.023815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc9c6791-ad39-4a25-b51b-e9eb5c74ba68 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:48.024313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc9c6791-ad39-4a25-b51b-e9eb5c74ba68 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:48.024757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc9c6791-ad39-4a25-b51b-e9eb5c74ba68 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:48.508464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24bad0bc-999a-424a-a7e9-247a2175a650 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:48.509082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-24bad0bc-999a-424a-a7e9-247a2175a650 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:48.527431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24bad0bc-999a-424a-a7e9-247a2175a650 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:48.529736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24bad0bc-999a-424a-a7e9-247a2175a650 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:48.530294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24bad0bc-999a-424a-a7e9-247a2175a650 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:48.532723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24bad0bc-999a-424a-a7e9-247a2175a650 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:48.534477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24bad0bc-999a-424a-a7e9-247a2175a650 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:48.536142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24bad0bc-999a-424a-a7e9-247a2175a650 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:49.176356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cc9c6791-ad39-4a25-b51b-e9eb5c74ba68 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:49.190627 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cc9c6791-ad39-4a25-b51b-e9eb5c74ba68 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1321 microversion: 2.1 time: 1.244858 Oct 05 17:43:49.192014 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1277/2748] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:47 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1321 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:49.198429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b38efe2a-f24e-4a85-8d2c-2595be96f9f0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775aa7b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:49.267672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-24bad0bc-999a-424a-a7e9-247a2175a650 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:49.275907 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b38efe2a-f24e-4a85-8d2c-2595be96f9f0 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1447 microversion: 2.1 time: 0.082514 Oct 05 17:43:49.276671 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1278/2749] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:49 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1447 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:49.277259 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-24bad0bc-999a-424a-a7e9-247a2175a650 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.772720 Oct 05 17:43:49.290313 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1472/2750] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:48 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:43:49.294992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d73ec8bb-5c77-4250-b2a5-f0f2061b4e98 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77793f9160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:49.298899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e4af22e-8181-470b-9fa3-cac635181b5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:49.299560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e4af22e-8181-470b-9fa3-cac635181b5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:49.321396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e4af22e-8181-470b-9fa3-cac635181b5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:49.321891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e4af22e-8181-470b-9fa3-cac635181b5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:49.322352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e4af22e-8181-470b-9fa3-cac635181b5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:49.323075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e4af22e-8181-470b-9fa3-cac635181b5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:49.323530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e4af22e-8181-470b-9fa3-cac635181b5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:49.323954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e4af22e-8181-470b-9fa3-cac635181b5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:49.356299 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d73ec8bb-5c77-4250-b2a5-f0f2061b4e98 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 200 len: 1447 microversion: 2.1 time: 0.069569 Oct 05 17:43:49.361512 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1473/2751] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:49 2022] GET /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 1447 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:49.388302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cb230271-1fc8-4e34-ab06-cd88a531b3da tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777478fd30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:50.215391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2e4af22e-8181-470b-9fa3-cac635181b5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:50.229568 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e4af22e-8181-470b-9fa3-cac635181b5c tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1324 microversion: 2.1 time: 0.943111 Oct 05 17:43:50.232717 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1279/2752] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:49 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1324 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:50.239627 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cb230271-1fc8-4e34-ab06-cd88a531b3da tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 204 len: 0 microversion: 2.1 time: 0.861928 Oct 05 17:43:50.240352 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1474/2753] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:49 2022] DELETE /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:43:50.256549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae4df47e-bfc8-4b80-bca7-7480065a246c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:50.259076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae4df47e-bfc8-4b80-bca7-7480065a246c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:50.278637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51084c09-c219-4c11-98c1-d397e44e9f9b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:50.281214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51084c09-c219-4c11-98c1-d397e44e9f9b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:50.285578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae4df47e-bfc8-4b80-bca7-7480065a246c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:50.289151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae4df47e-bfc8-4b80-bca7-7480065a246c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:50.294459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae4df47e-bfc8-4b80-bca7-7480065a246c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:50.295499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae4df47e-bfc8-4b80-bca7-7480065a246c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:50.300636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae4df47e-bfc8-4b80-bca7-7480065a246c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:50.302976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae4df47e-bfc8-4b80-bca7-7480065a246c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:50.306419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51084c09-c219-4c11-98c1-d397e44e9f9b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:50.310910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51084c09-c219-4c11-98c1-d397e44e9f9b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:50.311844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51084c09-c219-4c11-98c1-d397e44e9f9b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:50.312892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51084c09-c219-4c11-98c1-d397e44e9f9b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:50.315936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51084c09-c219-4c11-98c1-d397e44e9f9b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:50.316619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51084c09-c219-4c11-98c1-d397e44e9f9b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:50.363429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae4df47e-bfc8-4b80-bca7-7480065a246c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:43:50.457760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae4df47e-bfc8-4b80-bca7-7480065a246c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 204 len: 0 microversion: 2.1 time: 0.206277 Oct 05 17:43:50.459321 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1475/2754] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:43:50 2022] DELETE /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:43:50.486585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bcbcadaa-541f-4216-b86a-9b299205ac8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:50.488330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bcbcadaa-541f-4216-b86a-9b299205ac8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:50.496558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcbcadaa-541f-4216-b86a-9b299205ac8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:50.497262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcbcadaa-541f-4216-b86a-9b299205ac8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:50.497858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcbcadaa-541f-4216-b86a-9b299205ac8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:50.498871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcbcadaa-541f-4216-b86a-9b299205ac8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:50.499484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcbcadaa-541f-4216-b86a-9b299205ac8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:50.500180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bcbcadaa-541f-4216-b86a-9b299205ac8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:50.961263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bcbcadaa-541f-4216-b86a-9b299205ac8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:50.977496 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bcbcadaa-541f-4216-b86a-9b299205ac8c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.514285 Oct 05 17:43:50.978592 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1476/2755] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:50 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:50.983861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-973683819", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "f858ae49-432b-47a7-98c9-045c9a50f77b"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:51.048055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] validate_networks() for [('f858ae49-432b-47a7-98c9-045c9a50f77b', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:43:51.362994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-51084c09-c219-4c11-98c1-d397e44e9f9b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:51.384135 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51084c09-c219-4c11-98c1-d397e44e9f9b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1321 microversion: 2.1 time: 1.142164 Oct 05 17:43:51.398545 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1280/2756] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:50 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1321 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:51.405563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c407cb06-24cf-4a90-8e25-fac5a0c7c381 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:51.406331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c407cb06-24cf-4a90-8e25-fac5a0c7c381 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:51.412984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c407cb06-24cf-4a90-8e25-fac5a0c7c381 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:51.413471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c407cb06-24cf-4a90-8e25-fac5a0c7c381 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:51.413897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c407cb06-24cf-4a90-8e25-fac5a0c7c381 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:51.414868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c407cb06-24cf-4a90-8e25-fac5a0c7c381 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:51.415472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c407cb06-24cf-4a90-8e25-fac5a0c7c381 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:51.416043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c407cb06-24cf-4a90-8e25-fac5a0c7c381 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:51.855830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c407cb06-24cf-4a90-8e25-fac5a0c7c381 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:51.865658 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c407cb06-24cf-4a90-8e25-fac5a0c7c381 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1522 microversion: 2.1 time: 0.465781 Oct 05 17:43:51.867031 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1281/2757] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:51 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:51.872680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-84d192fa-f1ef-42f6-8e02-d0c5f7aa8b94 req-9b9e2af3-a99a-4e84-b2d6-47f88e040396 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "tag": "4d785381-e8e2-468c-b43f-da00a289173d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:51.884323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-84d192fa-f1ef-42f6-8e02-d0c5f7aa8b94 req-9b9e2af3-a99a-4e84-b2d6-47f88e040396 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:51.885109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-84d192fa-f1ef-42f6-8e02-d0c5f7aa8b94 req-9b9e2af3-a99a-4e84-b2d6-47f88e040396 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:51.885719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-84d192fa-f1ef-42f6-8e02-d0c5f7aa8b94 req-9b9e2af3-a99a-4e84-b2d6-47f88e040396 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:51.921363 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-84d192fa-f1ef-42f6-8e02-d0c5f7aa8b94 req-9b9e2af3-a99a-4e84-b2d6-47f88e040396 service nova] Creating event network-changed:4d785381-e8e2-468c-b43f-da00a289173d for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:43:51.928902 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-84d192fa-f1ef-42f6-8e02-d0c5f7aa8b94 req-9b9e2af3-a99a-4e84-b2d6-47f88e040396 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060342 Oct 05 17:43:51.936579 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1282/2758] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:51.956500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c05ae62c-548d-406e-81f3-0b1cb78137a9 req-f61d1e26-dc67-4567-897c-114a5d2731b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56bc233a-cffb-408b-a620-c3f7f909230d", "tag": "d82a9349-89ca-4494-921c-b29ca5e98f6a"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:51.961867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:51.969501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c05ae62c-548d-406e-81f3-0b1cb78137a9 req-f61d1e26-dc67-4567-897c-114a5d2731b8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:51.969982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c05ae62c-548d-406e-81f3-0b1cb78137a9 req-f61d1e26-dc67-4567-897c-114a5d2731b8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:51.970444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c05ae62c-548d-406e-81f3-0b1cb78137a9 req-f61d1e26-dc67-4567-897c-114a5d2731b8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:51.989121 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c05ae62c-548d-406e-81f3-0b1cb78137a9 req-f61d1e26-dc67-4567-897c-114a5d2731b8 service nova] Creating event network-changed:d82a9349-89ca-4494-921c-b29ca5e98f6a for instance 56bc233a-cffb-408b-a620-c3f7f909230d on n-h1-835595-3 Oct 05 17:43:51.994589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c05ae62c-548d-406e-81f3-0b1cb78137a9 req-f61d1e26-dc67-4567-897c-114a5d2731b8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056323 Oct 05 17:43:51.995897 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1283/2759] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:52.002042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-50b3fb8a-37fa-42cc-ad9d-73a8d2cc1ac0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:52.003258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-50b3fb8a-37fa-42cc-ad9d-73a8d2cc1ac0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:52.011561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50b3fb8a-37fa-42cc-ad9d-73a8d2cc1ac0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:52.012279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50b3fb8a-37fa-42cc-ad9d-73a8d2cc1ac0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:52.013264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50b3fb8a-37fa-42cc-ad9d-73a8d2cc1ac0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:52.014245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50b3fb8a-37fa-42cc-ad9d-73a8d2cc1ac0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:52.014999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50b3fb8a-37fa-42cc-ad9d-73a8d2cc1ac0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:52.016803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50b3fb8a-37fa-42cc-ad9d-73a8d2cc1ac0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:52.524375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:52.588575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=18 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:52.604228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50b3fb8a-37fa-42cc-ad9d-73a8d2cc1ac0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:52.612825 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-50b3fb8a-37fa-42cc-ad9d-73a8d2cc1ac0 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1522 microversion: 2.1 time: 0.615215 Oct 05 17:43:52.613457 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1284/2760] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:51 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1522 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:52.637594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd902872-61ac-43be-ba04-0ee80b0fe984 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:52.638557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd902872-61ac-43be-ba04-0ee80b0fe984 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:52.645420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd902872-61ac-43be-ba04-0ee80b0fe984 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:52.646132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd902872-61ac-43be-ba04-0ee80b0fe984 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:52.646748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd902872-61ac-43be-ba04-0ee80b0fe984 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:52.647602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd902872-61ac-43be-ba04-0ee80b0fe984 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:52.648358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd902872-61ac-43be-ba04-0ee80b0fe984 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:52.648964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd902872-61ac-43be-ba04-0ee80b0fe984 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:52.891578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:43:52.892397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:43:52.892973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:43:52.893592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:43:52.894557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:43:52.911054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:52.911664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:52.912191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:52.913221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:52.913822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:52.914356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:52.936618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Getting quotas for project 47d5d4426b3d481b92b84c307cd00ead. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:43:52.944353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Getting quotas for user 6720411ae8fc46a5bcd7b8f6d95c24a8 and project 47d5d4426b3d481b92b84c307cd00ead. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:43:52.960651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:43:52.963955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:43:53.035868 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dd84f271-35fd-45b1-9c7b-6653f2ef8102 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.055566 Oct 05 17:43:53.036916 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1477/2761] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:43:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:43:53.054381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f0bdfb9-90d5-439f-8e8a-a5668683a01d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:53.057258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f0bdfb9-90d5-439f-8e8a-a5668683a01d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:53.068099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0bdfb9-90d5-439f-8e8a-a5668683a01d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:53.069239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0bdfb9-90d5-439f-8e8a-a5668683a01d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:53.072306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0bdfb9-90d5-439f-8e8a-a5668683a01d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:53.073471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0bdfb9-90d5-439f-8e8a-a5668683a01d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:53.074872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0bdfb9-90d5-439f-8e8a-a5668683a01d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:53.075525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0bdfb9-90d5-439f-8e8a-a5668683a01d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:53.389714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fd902872-61ac-43be-ba04-0ee80b0fe984 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:53.399046 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fd902872-61ac-43be-ba04-0ee80b0fe984 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.770248 Oct 05 17:43:53.399642 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1285/2762] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:52 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:53.415481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-efb82ae5-736d-48fc-ab12-c38b57db4968 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2042391644"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:53.418511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-efb82ae5-736d-48fc-ab12-c38b57db4968 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:53.429516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efb82ae5-736d-48fc-ab12-c38b57db4968 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:53.430248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efb82ae5-736d-48fc-ab12-c38b57db4968 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:53.430908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efb82ae5-736d-48fc-ab12-c38b57db4968 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:53.431788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efb82ae5-736d-48fc-ab12-c38b57db4968 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:53.432405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efb82ae5-736d-48fc-ab12-c38b57db4968 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:53.432991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efb82ae5-736d-48fc-ab12-c38b57db4968 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:53.705736 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-efb82ae5-736d-48fc-ab12-c38b57db4968 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "POST /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09/action" status: 202 len: 0 microversion: 2.1 time: 0.302006 Oct 05 17:43:53.715614 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1286/2763] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:43:53 2022] POST /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 17:43:53.725952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-86de763d-97a8-4a48-bc83-34747ff142a9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:53.727098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-86de763d-97a8-4a48-bc83-34747ff142a9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:53.768144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86de763d-97a8-4a48-bc83-34747ff142a9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:53.773108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86de763d-97a8-4a48-bc83-34747ff142a9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:53.773956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86de763d-97a8-4a48-bc83-34747ff142a9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:53.775365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86de763d-97a8-4a48-bc83-34747ff142a9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:53.776053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86de763d-97a8-4a48-bc83-34747ff142a9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:53.776705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86de763d-97a8-4a48-bc83-34747ff142a9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:53.821870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=20 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:54.052021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f0bdfb9-90d5-439f-8e8a-a5668683a01d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:54.072314 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f0bdfb9-90d5-439f-8e8a-a5668683a01d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1321 microversion: 2.1 time: 1.031268 Oct 05 17:43:54.077780 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1478/2764] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:53 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1321 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:54.084789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-05d73132-7bf9-464c-84ff-6652552b6326 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '.version_select at 0x7f7774786dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:54.388780 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-05d73132-7bf9-464c-84ff-6652552b6326 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "DELETE /compute/v2.1/images/4075fcdd-ac6b-4626-81cb-013ca7fb48d6" status: 204 len: 0 microversion: 2.1 time: 0.308774 Oct 05 17:43:54.389922 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1479/2765] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:54 2022] DELETE /compute/v2.1/images/4075fcdd-ac6b-4626-81cb-013ca7fb48d6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:43:54.398870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-bd8bc2cd-91f2-4b54-9d39-097b71b4823d req-a98267b0-4ec5-44f4-add2-bf439afa9ac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca78094-2274-411b-ba3f-0c6e4e369ca3", "tag": "e28797c1-601b-479a-b80e-f459dc9b3d0c"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:54.419948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bd8bc2cd-91f2-4b54-9d39-097b71b4823d req-a98267b0-4ec5-44f4-add2-bf439afa9ac3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:54.422848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bd8bc2cd-91f2-4b54-9d39-097b71b4823d req-a98267b0-4ec5-44f4-add2-bf439afa9ac3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:54.423820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bd8bc2cd-91f2-4b54-9d39-097b71b4823d req-a98267b0-4ec5-44f4-add2-bf439afa9ac3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:54.439688 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-bd8bc2cd-91f2-4b54-9d39-097b71b4823d req-a98267b0-4ec5-44f4-add2-bf439afa9ac3 service nova] Creating event network-changed:e28797c1-601b-479a-b80e-f459dc9b3d0c for instance cca78094-2274-411b-ba3f-0c6e4e369ca3 on n-h2-835595-3 Oct 05 17:43:54.447143 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-bd8bc2cd-91f2-4b54-9d39-097b71b4823d req-a98267b0-4ec5-44f4-add2-bf439afa9ac3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055623 Oct 05 17:43:54.450087 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1480/2766] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:54.455984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-54287f07-b8ff-466e-a75d-ab52e38afb92 req-9fd2a674-b6c2-4859-ac2b-2501c334dc33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724e1789-37d2-4d11-8d47-0e5f5ef8b38e", "tag": "91e2b936-b6a8-40cb-949e-282fc986a77b"}, {"name": "network-changed", "server_uuid": "beaf97b4-53da-43bc-afe6-15350b810193", "tag": "1a9259fb-7b43-42bb-9bbd-11fc82600a80"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:54.468254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-54287f07-b8ff-466e-a75d-ab52e38afb92 req-9fd2a674-b6c2-4859-ac2b-2501c334dc33 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:54.469085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-54287f07-b8ff-466e-a75d-ab52e38afb92 req-9fd2a674-b6c2-4859-ac2b-2501c334dc33 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:54.469960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-54287f07-b8ff-466e-a75d-ab52e38afb92 req-9fd2a674-b6c2-4859-ac2b-2501c334dc33 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:54.484013 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-54287f07-b8ff-466e-a75d-ab52e38afb92 req-9fd2a674-b6c2-4859-ac2b-2501c334dc33 service nova] Creating event network-changed:91e2b936-b6a8-40cb-949e-282fc986a77b for instance 724e1789-37d2-4d11-8d47-0e5f5ef8b38e on n-h1-835595-3 Oct 05 17:43:54.484774 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-54287f07-b8ff-466e-a75d-ab52e38afb92 req-9fd2a674-b6c2-4859-ac2b-2501c334dc33 service nova] Creating event network-changed:1a9259fb-7b43-42bb-9bbd-11fc82600a80 for instance beaf97b4-53da-43bc-afe6-15350b810193 on n-h1-835595-3 Oct 05 17:43:54.496358 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-54287f07-b8ff-466e-a75d-ab52e38afb92 req-9fd2a674-b6c2-4859-ac2b-2501c334dc33 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044598 Oct 05 17:43:54.497307 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1481/2767] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:54.502606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8267501c-3816-4fac-af61-4ad3cc001358 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '.version_select at 0x7f7779510e50>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:54.527488 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-8267501c-3816-4fac-af61-4ad3cc001358 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Image not found. Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8267501c-3816-4fac-af61-4ad3cc001358 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/images/4075fcdd-ac6b-4626-81cb-013ca7fb48d6 HTTP/1.1 Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4075fcdd-ac6b-4626-81cb-013ca7fb48d6'} Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 4075fcdd-ac6b-4626-81cb-013ca7fb48d6 Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 17:43:54.530434 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4075fcdd-ac6b-4626-81cb-013ca7fb48d6 could not be found. Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:43:54.535031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8267501c-3816-4fac-af61-4ad3cc001358 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:43:54.538747 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8267501c-3816-4fac-af61-4ad3cc001358 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/images/4075fcdd-ac6b-4626-81cb-013ca7fb48d6" status: 404 len: 62 microversion: 2.1 time: 0.036260 Oct 05 17:43:54.548317 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1482/2768] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:43:54 2022] GET /compute/v2.1/images/4075fcdd-ac6b-4626-81cb-013ca7fb48d6 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:43:54.564996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-34c26ec5-c058-4802-82ab-d4c3857d4e74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:54.564996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-34c26ec5-c058-4802-82ab-d4c3857d4e74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:54.575313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86de763d-97a8-4a48-bc83-34747ff142a9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:54.579170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34c26ec5-c058-4802-82ab-d4c3857d4e74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:54.579899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34c26ec5-c058-4802-82ab-d4c3857d4e74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:54.580410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34c26ec5-c058-4802-82ab-d4c3857d4e74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:54.581240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34c26ec5-c058-4802-82ab-d4c3857d4e74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:54.581769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34c26ec5-c058-4802-82ab-d4c3857d4e74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:54.582263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34c26ec5-c058-4802-82ab-d4c3857d4e74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:54.590304 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-86de763d-97a8-4a48-bc83-34747ff142a9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1211 microversion: 2.1 time: 0.872691 Oct 05 17:43:54.594808 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1287/2769] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:53 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1211 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:54.608365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b9aad71-21d5-417a-ab68-e05c6c8e197a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:54.613021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b9aad71-21d5-417a-ab68-e05c6c8e197a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:54.620021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b9aad71-21d5-417a-ab68-e05c6c8e197a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:54.620748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b9aad71-21d5-417a-ab68-e05c6c8e197a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:54.621349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b9aad71-21d5-417a-ab68-e05c6c8e197a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:54.622223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b9aad71-21d5-417a-ab68-e05c6c8e197a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:54.622848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b9aad71-21d5-417a-ab68-e05c6c8e197a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:54.623426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b9aad71-21d5-417a-ab68-e05c6c8e197a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:54.628064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:55.160682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b9aad71-21d5-417a-ab68-e05c6c8e197a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:55.174132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-34c26ec5-c058-4802-82ab-d4c3857d4e74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:55.177301 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b9aad71-21d5-417a-ab68-e05c6c8e197a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1534 microversion: 2.1 time: 0.571707 Oct 05 17:43:55.177930 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1288/2770] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:54 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1534 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:55.184784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-84b90d59-ee35-48ce-b008-1d4228414100 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:55.185398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-84b90d59-ee35-48ce-b008-1d4228414100 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:55.189186 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-34c26ec5-c058-4802-82ab-d4c3857d4e74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.639578 Oct 05 17:43:55.190410 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1483/2771] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:54 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:55.192373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b90d59-ee35-48ce-b008-1d4228414100 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:55.192855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b90d59-ee35-48ce-b008-1d4228414100 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:55.193315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b90d59-ee35-48ce-b008-1d4228414100 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:55.194014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b90d59-ee35-48ce-b008-1d4228414100 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:55.194555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b90d59-ee35-48ce-b008-1d4228414100 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:55.195149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b90d59-ee35-48ce-b008-1d4228414100 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:55.451460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-84b90d59-ee35-48ce-b008-1d4228414100 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:55.460078 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-84b90d59-ee35-48ce-b008-1d4228414100 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1321 microversion: 2.1 time: 0.281075 Oct 05 17:43:55.460925 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1289/2772] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:55 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:55.618058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-51166456-b309-4d07-a3d4-cccfbd7465e1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:55.618757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-51166456-b309-4d07-a3d4-cccfbd7465e1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:55.626236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51166456-b309-4d07-a3d4-cccfbd7465e1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:55.627036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51166456-b309-4d07-a3d4-cccfbd7465e1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:55.627634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51166456-b309-4d07-a3d4-cccfbd7465e1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:55.628504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51166456-b309-4d07-a3d4-cccfbd7465e1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:55.629121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51166456-b309-4d07-a3d4-cccfbd7465e1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:55.629710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51166456-b309-4d07-a3d4-cccfbd7465e1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:55.730040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-51166456-b309-4d07-a3d4-cccfbd7465e1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:55.740417 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-51166456-b309-4d07-a3d4-cccfbd7465e1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1265 microversion: 2.1 time: 0.126571 Oct 05 17:43:55.741731 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1484/2773] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:55 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1265 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:56.205841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-04dd1dda-0092-431d-b3db-288aafcccea6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:56.214928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8fb3e96b-c290-4a77-a630-c8399b50e094 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:56.216152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8fb3e96b-c290-4a77-a630-c8399b50e094 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:56.218538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-04dd1dda-0092-431d-b3db-288aafcccea6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:56.231583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04dd1dda-0092-431d-b3db-288aafcccea6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:56.233281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb3e96b-c290-4a77-a630-c8399b50e094 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:56.234802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb3e96b-c290-4a77-a630-c8399b50e094 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:56.240723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04dd1dda-0092-431d-b3db-288aafcccea6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:56.241579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb3e96b-c290-4a77-a630-c8399b50e094 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:56.242432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04dd1dda-0092-431d-b3db-288aafcccea6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:56.243430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb3e96b-c290-4a77-a630-c8399b50e094 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:56.244938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb3e96b-c290-4a77-a630-c8399b50e094 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:56.245378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04dd1dda-0092-431d-b3db-288aafcccea6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:56.246113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04dd1dda-0092-431d-b3db-288aafcccea6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:56.246827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb3e96b-c290-4a77-a630-c8399b50e094 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:56.247494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04dd1dda-0092-431d-b3db-288aafcccea6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:56.454372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-04dd1dda-0092-431d-b3db-288aafcccea6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:56.464667 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-04dd1dda-0092-431d-b3db-288aafcccea6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1540 microversion: 2.1 time: 0.266306 Oct 05 17:43:56.465792 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1290/2774] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:56 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1540 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:56.492738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64918efe-64f0-4925-8a85-8221d0ff6a86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:56.493393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-64918efe-64f0-4925-8a85-8221d0ff6a86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:56.503311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64918efe-64f0-4925-8a85-8221d0ff6a86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:56.503817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64918efe-64f0-4925-8a85-8221d0ff6a86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:56.504257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64918efe-64f0-4925-8a85-8221d0ff6a86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:56.504978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64918efe-64f0-4925-8a85-8221d0ff6a86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:56.505449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64918efe-64f0-4925-8a85-8221d0ff6a86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:56.505919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64918efe-64f0-4925-8a85-8221d0ff6a86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:56.733700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8fb3e96b-c290-4a77-a630-c8399b50e094 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:56.751894 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8fb3e96b-c290-4a77-a630-c8399b50e094 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.542782 Oct 05 17:43:56.762361 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1485/2775] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:56 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:43:56.763423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-be8accc1-219c-408f-b697-8b4340cb3e73 req-21e63917-d3a1-429d-8681-3840e30cf23f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c03997c-01af-46a1-9887-9b72e2a2815b", "name": "network-vif-deleted", "tag": "10e3d67e-7cde-4cc7-9263-0e9b5687690c"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:56.776759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-be8accc1-219c-408f-b697-8b4340cb3e73 req-21e63917-d3a1-429d-8681-3840e30cf23f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:56.777504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-be8accc1-219c-408f-b697-8b4340cb3e73 req-21e63917-d3a1-429d-8681-3840e30cf23f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:56.778039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-be8accc1-219c-408f-b697-8b4340cb3e73 req-21e63917-d3a1-429d-8681-3840e30cf23f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:56.796601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-be8accc1-219c-408f-b697-8b4340cb3e73 req-21e63917-d3a1-429d-8681-3840e30cf23f service nova] Creating event network-vif-deleted:10e3d67e-7cde-4cc7-9263-0e9b5687690c for instance 9c03997c-01af-46a1-9887-9b72e2a2815b on n-h1-835595-3 Oct 05 17:43:56.803118 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-be8accc1-219c-408f-b697-8b4340cb3e73 req-21e63917-d3a1-429d-8681-3840e30cf23f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048513 Oct 05 17:43:56.804282 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1486/2776] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:56.813538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2b7b42f7-5599-469b-b5f8-55f1e89a034e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:56.814773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2b7b42f7-5599-469b-b5f8-55f1e89a034e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:56.836015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-64918efe-64f0-4925-8a85-8221d0ff6a86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:56.858897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7b42f7-5599-469b-b5f8-55f1e89a034e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:56.859421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7b42f7-5599-469b-b5f8-55f1e89a034e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:56.859870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7b42f7-5599-469b-b5f8-55f1e89a034e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:56.860575 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-64918efe-64f0-4925-8a85-8221d0ff6a86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1321 microversion: 2.1 time: 0.374889 Oct 05 17:43:56.864899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7b42f7-5599-469b-b5f8-55f1e89a034e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:56.865555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7b42f7-5599-469b-b5f8-55f1e89a034e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:56.866685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7b42f7-5599-469b-b5f8-55f1e89a034e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:56.912086 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1291/2777] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:56 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1321 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:57.042186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2b7b42f7-5599-469b-b5f8-55f1e89a034e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:57.060141 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2b7b42f7-5599-469b-b5f8-55f1e89a034e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1265 microversion: 2.1 time: 0.253740 Oct 05 17:43:57.061480 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1487/2778] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:56 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:57.492464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-94d16ce7-0f32-43aa-bb6d-fb151b80cc19 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:57.493724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-94d16ce7-0f32-43aa-bb6d-fb151b80cc19 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:57.504501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94d16ce7-0f32-43aa-bb6d-fb151b80cc19 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:57.506023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94d16ce7-0f32-43aa-bb6d-fb151b80cc19 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:57.506769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94d16ce7-0f32-43aa-bb6d-fb151b80cc19 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:57.507952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94d16ce7-0f32-43aa-bb6d-fb151b80cc19 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:57.508842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94d16ce7-0f32-43aa-bb6d-fb151b80cc19 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:57.509578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94d16ce7-0f32-43aa-bb6d-fb151b80cc19 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:57.781104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bbbc3a91-b166-4543-93c4-9cafa321518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:57.782489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bbbc3a91-b166-4543-93c4-9cafa321518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:57.796418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbbc3a91-b166-4543-93c4-9cafa321518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:57.797538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbbc3a91-b166-4543-93c4-9cafa321518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:57.798914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbbc3a91-b166-4543-93c4-9cafa321518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:57.800025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbbc3a91-b166-4543-93c4-9cafa321518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:57.800692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbbc3a91-b166-4543-93c4-9cafa321518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:57.801477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbbc3a91-b166-4543-93c4-9cafa321518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:58.252353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bbbc3a91-b166-4543-93c4-9cafa321518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:58.274086 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bbbc3a91-b166-4543-93c4-9cafa321518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.498080 Oct 05 17:43:58.276684 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1488/2779] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:57 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:43:58.283286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e006c6e-28d1-404f-8799-487b9bc16e86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:58.284145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5e006c6e-28d1-404f-8799-487b9bc16e86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:58.294512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e006c6e-28d1-404f-8799-487b9bc16e86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:58.319330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-94d16ce7-0f32-43aa-bb6d-fb151b80cc19 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:58.322553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e006c6e-28d1-404f-8799-487b9bc16e86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:58.323331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e006c6e-28d1-404f-8799-487b9bc16e86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:58.324529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e006c6e-28d1-404f-8799-487b9bc16e86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:58.325209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e006c6e-28d1-404f-8799-487b9bc16e86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:58.326775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e006c6e-28d1-404f-8799-487b9bc16e86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:58.334490 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-94d16ce7-0f32-43aa-bb6d-fb151b80cc19 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1522 microversion: 2.1 time: 0.847547 Oct 05 17:43:58.347926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:43:58.356285 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1292/2780] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:57 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1522 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:43:58.361518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-66cf6d57-50a1-40d8-a55a-578319248350 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:58.372786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-66cf6d57-50a1-40d8-a55a-578319248350 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:58.379658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66cf6d57-50a1-40d8-a55a-578319248350 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:58.380360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66cf6d57-50a1-40d8-a55a-578319248350 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:58.380960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66cf6d57-50a1-40d8-a55a-578319248350 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:58.381843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66cf6d57-50a1-40d8-a55a-578319248350 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:58.386234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66cf6d57-50a1-40d8-a55a-578319248350 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:58.386944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66cf6d57-50a1-40d8-a55a-578319248350 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:58.931811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5e006c6e-28d1-404f-8799-487b9bc16e86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:58.954572 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e006c6e-28d1-404f-8799-487b9bc16e86 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1321 microversion: 2.1 time: 0.667903 Oct 05 17:43:58.955866 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1489/2781] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:58 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1321 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:58.961150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e75b7e99-21fd-4edb-a976-42909a7d9a68 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:58.962816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e75b7e99-21fd-4edb-a976-42909a7d9a68 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:58.970738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e75b7e99-21fd-4edb-a976-42909a7d9a68 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:58.971363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e75b7e99-21fd-4edb-a976-42909a7d9a68 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:58.972476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e75b7e99-21fd-4edb-a976-42909a7d9a68 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:58.973970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e75b7e99-21fd-4edb-a976-42909a7d9a68 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:58.975013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e75b7e99-21fd-4edb-a976-42909a7d9a68 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:58.976285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e75b7e99-21fd-4edb-a976-42909a7d9a68 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:59.017539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e75b7e99-21fd-4edb-a976-42909a7d9a68 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:43:59.141799 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e75b7e99-21fd-4edb-a976-42909a7d9a68 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "DELETE /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 204 len: 0 microversion: 2.1 time: 0.184302 Oct 05 17:43:59.146575 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1490/2782] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:43:58 2022] DELETE /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:43:59.156631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13beb27e-7ddd-43b7-9971-6abe6676850d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:59.158013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13beb27e-7ddd-43b7-9971-6abe6676850d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:59.169733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13beb27e-7ddd-43b7-9971-6abe6676850d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:59.170710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13beb27e-7ddd-43b7-9971-6abe6676850d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:59.171581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13beb27e-7ddd-43b7-9971-6abe6676850d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:59.172586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13beb27e-7ddd-43b7-9971-6abe6676850d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:59.173265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13beb27e-7ddd-43b7-9971-6abe6676850d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:59.173935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13beb27e-7ddd-43b7-9971-6abe6676850d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:59.284434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66cf6d57-50a1-40d8-a55a-578319248350 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:59.295696 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-66cf6d57-50a1-40d8-a55a-578319248350 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1307 microversion: 2.1 time: 0.937242 Oct 05 17:43:59.310305 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1293/2783] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:58 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1307 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:59.314822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6d71bc84-a2ed-4601-9e7b-5b21bee55fd6 req-3c5c870c-b1cd-4948-a66e-999a48c06671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528b4233-a9d9-4f97-94d8-c4b52c793f09", "name": "network-vif-plugged", "status": "completed", "tag": "7acf7b85-5877-44df-9da8-c253b70ac5ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:43:59.332671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6d71bc84-a2ed-4601-9e7b-5b21bee55fd6 req-3c5c870c-b1cd-4948-a66e-999a48c06671 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:59.333161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6d71bc84-a2ed-4601-9e7b-5b21bee55fd6 req-3c5c870c-b1cd-4948-a66e-999a48c06671 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:59.333668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6d71bc84-a2ed-4601-9e7b-5b21bee55fd6 req-3c5c870c-b1cd-4948-a66e-999a48c06671 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:59.356791 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6d71bc84-a2ed-4601-9e7b-5b21bee55fd6 req-3c5c870c-b1cd-4948-a66e-999a48c06671 service nova] Creating event network-vif-plugged:7acf7b85-5877-44df-9da8-c253b70ac5ef for instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 on n-h2-835595-3 Oct 05 17:43:59.366709 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6d71bc84-a2ed-4601-9e7b-5b21bee55fd6 req-3c5c870c-b1cd-4948-a66e-999a48c06671 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066724 Oct 05 17:43:59.367945 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1294/2784] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:43:59.373772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4da5d455-b8a2-450e-afb1-a9a5d04fda9d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:59.374706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4da5d455-b8a2-450e-afb1-a9a5d04fda9d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:43:59.381815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da5d455-b8a2-450e-afb1-a9a5d04fda9d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:59.383097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da5d455-b8a2-450e-afb1-a9a5d04fda9d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:59.383683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da5d455-b8a2-450e-afb1-a9a5d04fda9d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:59.384542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da5d455-b8a2-450e-afb1-a9a5d04fda9d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:43:59.385631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da5d455-b8a2-450e-afb1-a9a5d04fda9d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:43:59.386207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da5d455-b8a2-450e-afb1-a9a5d04fda9d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:43:59.602105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-13beb27e-7ddd-43b7-9971-6abe6676850d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:43:59.616194 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13beb27e-7ddd-43b7-9971-6abe6676850d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1528 microversion: 2.1 time: 0.463996 Oct 05 17:43:59.617063 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1491/2785] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:59 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1528 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:43:59.985928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-682e61e8-c3e8-49ca-b34d-dde9531b66cc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:43:59.987334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-682e61e8-c3e8-49ca-b34d-dde9531b66cc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:00.026178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-682e61e8-c3e8-49ca-b34d-dde9531b66cc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:00.031285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-682e61e8-c3e8-49ca-b34d-dde9531b66cc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:00.031912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-682e61e8-c3e8-49ca-b34d-dde9531b66cc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:00.037278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-682e61e8-c3e8-49ca-b34d-dde9531b66cc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:00.037798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-682e61e8-c3e8-49ca-b34d-dde9531b66cc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:00.038248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-682e61e8-c3e8-49ca-b34d-dde9531b66cc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:00.233897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4da5d455-b8a2-450e-afb1-a9a5d04fda9d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:00.242630 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4da5d455-b8a2-450e-afb1-a9a5d04fda9d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.873171 Oct 05 17:44:00.246704 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1295/2786] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:59 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:00.258523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ec45fcdc-ce26-442b-8d32-22e276190367 req-56be58e2-6557-4b8d-8cad-76fa230bdbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea892f71-7a5d-4c84-a174-e011125220a4", "tag": "7dea4b91-2303-49a6-bd1a-09f08a5efef6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:00.277756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ec45fcdc-ce26-442b-8d32-22e276190367 req-56be58e2-6557-4b8d-8cad-76fa230bdbc9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:00.278547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ec45fcdc-ce26-442b-8d32-22e276190367 req-56be58e2-6557-4b8d-8cad-76fa230bdbc9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:00.282830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ec45fcdc-ce26-442b-8d32-22e276190367 req-56be58e2-6557-4b8d-8cad-76fa230bdbc9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:00.296210 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ec45fcdc-ce26-442b-8d32-22e276190367 req-56be58e2-6557-4b8d-8cad-76fa230bdbc9 service nova] Creating event network-changed:7dea4b91-2303-49a6-bd1a-09f08a5efef6 for instance ea892f71-7a5d-4c84-a174-e011125220a4 on n-h1-835595-3 Oct 05 17:44:00.302048 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ec45fcdc-ce26-442b-8d32-22e276190367 req-56be58e2-6557-4b8d-8cad-76fa230bdbc9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053683 Oct 05 17:44:00.303198 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1296/2787] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:00.326250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a7aab83-4745-4117-894c-f6cbbd1f4fc2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:00.327785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0a7aab83-4745-4117-894c-f6cbbd1f4fc2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:00.336887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a7aab83-4745-4117-894c-f6cbbd1f4fc2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:00.337663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a7aab83-4745-4117-894c-f6cbbd1f4fc2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:00.338241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a7aab83-4745-4117-894c-f6cbbd1f4fc2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:00.339591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a7aab83-4745-4117-894c-f6cbbd1f4fc2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:00.340316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a7aab83-4745-4117-894c-f6cbbd1f4fc2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:00.340997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a7aab83-4745-4117-894c-f6cbbd1f4fc2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:00.617823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0a7aab83-4745-4117-894c-f6cbbd1f4fc2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:00.633089 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0a7aab83-4745-4117-894c-f6cbbd1f4fc2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1307 microversion: 2.1 time: 0.312787 Oct 05 17:44:00.635308 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1297/2788] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:00 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1307 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:00.644507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1ab28f33-6422-4b12-b455-b967a4a18e34 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:00.645313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1ab28f33-6422-4b12-b455-b967a4a18e34 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:00.652149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab28f33-6422-4b12-b455-b967a4a18e34 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:00.653019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab28f33-6422-4b12-b455-b967a4a18e34 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:00.653627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab28f33-6422-4b12-b455-b967a4a18e34 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:00.654523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab28f33-6422-4b12-b455-b967a4a18e34 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:00.655943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab28f33-6422-4b12-b455-b967a4a18e34 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:00.656533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab28f33-6422-4b12-b455-b967a4a18e34 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:00.755710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-682e61e8-c3e8-49ca-b34d-dde9531b66cc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:00.770226 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-682e61e8-c3e8-49ca-b34d-dde9531b66cc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1321 microversion: 2.1 time: 0.793515 Oct 05 17:44:00.774964 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1492/2789] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:43:59 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1321 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:00.891174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1ab28f33-6422-4b12-b455-b967a4a18e34 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:00.903513 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1ab28f33-6422-4b12-b455-b967a4a18e34 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1528 microversion: 2.1 time: 0.263122 Oct 05 17:44:00.920733 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1298/2790] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:00 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1528 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:01.272465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90b8bdeb-d6dd-4b13-8661-80e0f1e67bbf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:01.274028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90b8bdeb-d6dd-4b13-8661-80e0f1e67bbf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:01.281582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90b8bdeb-d6dd-4b13-8661-80e0f1e67bbf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:01.282329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90b8bdeb-d6dd-4b13-8661-80e0f1e67bbf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:01.283266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90b8bdeb-d6dd-4b13-8661-80e0f1e67bbf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:01.284214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90b8bdeb-d6dd-4b13-8661-80e0f1e67bbf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:01.284901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90b8bdeb-d6dd-4b13-8661-80e0f1e67bbf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:01.285534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90b8bdeb-d6dd-4b13-8661-80e0f1e67bbf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:01.412119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-09a84940-2913-405d-af06-6d9ceee97222 req-e7806f27-3c7f-4887-8985-0fa4157c6e23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528b4233-a9d9-4f97-94d8-c4b52c793f09", "name": "network-vif-unplugged", "status": "completed", "tag": "7acf7b85-5877-44df-9da8-c253b70ac5ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:01.430054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-09a84940-2913-405d-af06-6d9ceee97222 req-e7806f27-3c7f-4887-8985-0fa4157c6e23 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:01.430581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-09a84940-2913-405d-af06-6d9ceee97222 req-e7806f27-3c7f-4887-8985-0fa4157c6e23 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:01.431016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-09a84940-2913-405d-af06-6d9ceee97222 req-e7806f27-3c7f-4887-8985-0fa4157c6e23 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:01.443613 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-09a84940-2913-405d-af06-6d9ceee97222 req-e7806f27-3c7f-4887-8985-0fa4157c6e23 service nova] Creating event network-vif-unplugged:7acf7b85-5877-44df-9da8-c253b70ac5ef for instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 on n-h2-835595-3 Oct 05 17:44:01.451848 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-09a84940-2913-405d-af06-6d9ceee97222 req-e7806f27-3c7f-4887-8985-0fa4157c6e23 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049254 Oct 05 17:44:01.452785 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1299/2791] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:01.664721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-56abd388-5a06-4341-927b-a1a925245630 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:01.667495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-56abd388-5a06-4341-927b-a1a925245630 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:01.705422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56abd388-5a06-4341-927b-a1a925245630 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:01.707271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56abd388-5a06-4341-927b-a1a925245630 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:01.709666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56abd388-5a06-4341-927b-a1a925245630 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:01.710695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56abd388-5a06-4341-927b-a1a925245630 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:01.714254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56abd388-5a06-4341-927b-a1a925245630 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:01.717918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56abd388-5a06-4341-927b-a1a925245630 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:01.796393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90b8bdeb-d6dd-4b13-8661-80e0f1e67bbf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:01.831804 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90b8bdeb-d6dd-4b13-8661-80e0f1e67bbf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.563784 Oct 05 17:44:01.842375 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1493/2792] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:01 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:01.855457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e9701906-9dd8-4669-896f-aea04173da80 req-3e71b5c7-ad4e-4fb2-8ffb-81cdf07952b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "528b4233-a9d9-4f97-94d8-c4b52c793f09", "name": "network-vif-deleted", "tag": "7acf7b85-5877-44df-9da8-c253b70ac5ef"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:01.889018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e9701906-9dd8-4669-896f-aea04173da80 req-3e71b5c7-ad4e-4fb2-8ffb-81cdf07952b4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:01.889534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e9701906-9dd8-4669-896f-aea04173da80 req-3e71b5c7-ad4e-4fb2-8ffb-81cdf07952b4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:01.889980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e9701906-9dd8-4669-896f-aea04173da80 req-3e71b5c7-ad4e-4fb2-8ffb-81cdf07952b4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:01.924453 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e9701906-9dd8-4669-896f-aea04173da80 req-3e71b5c7-ad4e-4fb2-8ffb-81cdf07952b4 service nova] Creating event network-vif-deleted:7acf7b85-5877-44df-9da8-c253b70ac5ef for instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 on n-h2-835595-3 Oct 05 17:44:01.938063 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e9701906-9dd8-4669-896f-aea04173da80 req-3e71b5c7-ad4e-4fb2-8ffb-81cdf07952b4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093991 Oct 05 17:44:01.941478 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1494/2793] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:01.957684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1777f772-7076-4af2-9ae1-7d538804d97b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:01.960383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1777f772-7076-4af2-9ae1-7d538804d97b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:01.978746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1777f772-7076-4af2-9ae1-7d538804d97b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:01.980064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1777f772-7076-4af2-9ae1-7d538804d97b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:01.982247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1777f772-7076-4af2-9ae1-7d538804d97b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:01.983358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1777f772-7076-4af2-9ae1-7d538804d97b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:01.985663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1777f772-7076-4af2-9ae1-7d538804d97b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:01.986291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1777f772-7076-4af2-9ae1-7d538804d97b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:02.052241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-56abd388-5a06-4341-927b-a1a925245630 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:02.073589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-56abd388-5a06-4341-927b-a1a925245630 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1307 microversion: 2.1 time: 0.414173 Oct 05 17:44:02.077797 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1300/2794] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:01 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1307 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:02.087377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:02.088350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:02.095419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:02.096224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:02.096873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:02.098046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:02.098762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:02.100076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:02.146477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:02.147203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:02.148016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:02.148715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lazy-loading 'fault' on Instance uuid 528b4233-a9d9-4f97-94d8-c4b52c793f09 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:44:02.254370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:02.266609 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3f0ffa4e-97b5-482e-aadf-294c1c06916f tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 200 len: 1314 microversion: 2.1 time: 0.184098 Oct 05 17:44:02.269583 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1301/2795] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:02 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:02.769301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1777f772-7076-4af2-9ae1-7d538804d97b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:02.783289 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1777f772-7076-4af2-9ae1-7d538804d97b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1321 microversion: 2.1 time: 0.840472 Oct 05 17:44:02.785263 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1495/2796] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:01 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1321 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:02.857182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0cf64ba7-c632-4941-9366-c9fb962ebf58 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:02.859784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0cf64ba7-c632-4941-9366-c9fb962ebf58 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:02.887934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cf64ba7-c632-4941-9366-c9fb962ebf58 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:02.889150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cf64ba7-c632-4941-9366-c9fb962ebf58 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:02.890144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cf64ba7-c632-4941-9366-c9fb962ebf58 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:02.891313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cf64ba7-c632-4941-9366-c9fb962ebf58 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:02.891889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cf64ba7-c632-4941-9366-c9fb962ebf58 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:02.892963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cf64ba7-c632-4941-9366-c9fb962ebf58 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:03.094448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:03.096383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:03.121714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-df002230-9eac-429e-8a93-24bad2d67461 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:03.124020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-df002230-9eac-429e-8a93-24bad2d67461 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:03.137704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df002230-9eac-429e-8a93-24bad2d67461 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:03.140333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df002230-9eac-429e-8a93-24bad2d67461 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:03.141483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df002230-9eac-429e-8a93-24bad2d67461 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:03.143325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df002230-9eac-429e-8a93-24bad2d67461 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:03.144495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df002230-9eac-429e-8a93-24bad2d67461 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:03.146140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df002230-9eac-429e-8a93-24bad2d67461 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:03.497990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-df002230-9eac-429e-8a93-24bad2d67461 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:03.514854 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-df002230-9eac-429e-8a93-24bad2d67461 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1307 microversion: 2.1 time: 0.422072 Oct 05 17:44:03.516655 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1496/2797] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:03 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1307 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:03.532557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0cf64ba7-c632-4941-9366-c9fb962ebf58 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:03.535356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:03.536283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:03.538521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:03.552032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:03.552581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:03.553030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:03.553907 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0cf64ba7-c632-4941-9366-c9fb962ebf58 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.697802 Oct 05 17:44:03.562944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:03.563448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:03.563891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:03.573112 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1302/2798] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:02 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:03.586866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-515542e8-b501-4f53-8848-46f73f2bd2d6 req-7a4c5f52-9c8d-47ad-89da-33a7cc444f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca78094-2274-411b-ba3f-0c6e4e369ca3", "name": "network-vif-plugged", "status": "completed", "tag": "e28797c1-601b-479a-b80e-f459dc9b3d0c"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:03.599037 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 HTTP/1.1 Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '528b4233-a9d9-4f97-94d8-c4b52c793f09'} Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:03.600757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:03.605655 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:03.605655 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:03.605655 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:03.605655 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:03.605655 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:03.605655 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:03.605655 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:03.605655 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:03.605655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 404 to user: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:03.605655 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-388be1b2-4a8f-403f-9792-f8b2141f9e74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 404 len: 111 microversion: 2.1 time: 0.084505 Oct 05 17:44:03.616611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-515542e8-b501-4f53-8848-46f73f2bd2d6 req-7a4c5f52-9c8d-47ad-89da-33a7cc444f71 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:03.626496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-515542e8-b501-4f53-8848-46f73f2bd2d6 req-7a4c5f52-9c8d-47ad-89da-33a7cc444f71 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:03.626496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-515542e8-b501-4f53-8848-46f73f2bd2d6 req-7a4c5f52-9c8d-47ad-89da-33a7cc444f71 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:03.633185 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1497/2799] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:03 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:03.639688 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-515542e8-b501-4f53-8848-46f73f2bd2d6 req-7a4c5f52-9c8d-47ad-89da-33a7cc444f71 service nova] Creating event network-vif-plugged:e28797c1-601b-479a-b80e-f459dc9b3d0c for instance cca78094-2274-411b-ba3f-0c6e4e369ca3 on n-h2-835595-3 Oct 05 17:44:03.664548 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-515542e8-b501-4f53-8848-46f73f2bd2d6 req-7a4c5f52-9c8d-47ad-89da-33a7cc444f71 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084870 Oct 05 17:44:03.667028 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1303/2800] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:03.811398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1bcdb690-0ec6-4edd-93f5-0d6a6f55e351 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:03.813265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1bcdb690-0ec6-4edd-93f5-0d6a6f55e351 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:03.827496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcdb690-0ec6-4edd-93f5-0d6a6f55e351 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:03.831593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcdb690-0ec6-4edd-93f5-0d6a6f55e351 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:03.832222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcdb690-0ec6-4edd-93f5-0d6a6f55e351 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:03.833240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcdb690-0ec6-4edd-93f5-0d6a6f55e351 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:03.837870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcdb690-0ec6-4edd-93f5-0d6a6f55e351 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:03.838704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bcdb690-0ec6-4edd-93f5-0d6a6f55e351 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:03.858151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-572720846", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:03.981950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] validate_networks() for [('5692d339-819d-4921-a90e-ae4420454834', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:44:04.319222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1bcdb690-0ec6-4edd-93f5-0d6a6f55e351 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:04.335083 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1bcdb690-0ec6-4edd-93f5-0d6a6f55e351 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1321 microversion: 2.1 time: 0.527497 Oct 05 17:44:04.335683 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1498/2801] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:03 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:04.356774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5939f29f-aa1f-408d-b205-7b0b47b93ac4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:04.360232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5939f29f-aa1f-408d-b205-7b0b47b93ac4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:04.370160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5939f29f-aa1f-408d-b205-7b0b47b93ac4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:04.371242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5939f29f-aa1f-408d-b205-7b0b47b93ac4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:04.373899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5939f29f-aa1f-408d-b205-7b0b47b93ac4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:04.373899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5939f29f-aa1f-408d-b205-7b0b47b93ac4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:04.375409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5939f29f-aa1f-408d-b205-7b0b47b93ac4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:04.377192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5939f29f-aa1f-408d-b205-7b0b47b93ac4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:04.593365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5939f29f-aa1f-408d-b205-7b0b47b93ac4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:04.601797 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5939f29f-aa1f-408d-b205-7b0b47b93ac4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.264753 Oct 05 17:44:04.602669 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1499/2802] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:04 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:04.607530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cbe88f09-179c-4432-952d-06ebaee6ede2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:04.608520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cbe88f09-179c-4432-952d-06ebaee6ede2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:04.616517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbe88f09-179c-4432-952d-06ebaee6ede2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:04.617437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbe88f09-179c-4432-952d-06ebaee6ede2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:04.618178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbe88f09-179c-4432-952d-06ebaee6ede2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:04.619125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbe88f09-179c-4432-952d-06ebaee6ede2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:04.619733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbe88f09-179c-4432-952d-06ebaee6ede2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:04.620308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbe88f09-179c-4432-952d-06ebaee6ede2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:04.796915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cbe88f09-179c-4432-952d-06ebaee6ede2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:04.805996 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cbe88f09-179c-4432-952d-06ebaee6ede2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1307 microversion: 2.1 time: 0.202137 Oct 05 17:44:04.807528 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1500/2803] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:04 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1307 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:04.813640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-01b0ed10-d1c7-495d-a126-cd97488a4fe1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:04.814380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-01b0ed10-d1c7-495d-a126-cd97488a4fe1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:04.822325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01b0ed10-d1c7-495d-a126-cd97488a4fe1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:04.823020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01b0ed10-d1c7-495d-a126-cd97488a4fe1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:04.823625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01b0ed10-d1c7-495d-a126-cd97488a4fe1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:04.824492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01b0ed10-d1c7-495d-a126-cd97488a4fe1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:04.825135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01b0ed10-d1c7-495d-a126-cd97488a4fe1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:04.825555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01b0ed10-d1c7-495d-a126-cd97488a4fe1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:04.979605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-01b0ed10-d1c7-495d-a126-cd97488a4fe1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:04.988456 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-01b0ed10-d1c7-495d-a126-cd97488a4fe1 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.179527 Oct 05 17:44:05.002542 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1501/2804] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:04 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:05.002542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3e24cfb3-8f04-4078-a9af-f3b0baa444d0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:05.002542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3e24cfb3-8f04-4078-a9af-f3b0baa444d0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:05.002854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e24cfb3-8f04-4078-a9af-f3b0baa444d0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.003127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e24cfb3-8f04-4078-a9af-f3b0baa444d0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.004119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e24cfb3-8f04-4078-a9af-f3b0baa444d0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.005226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e24cfb3-8f04-4078-a9af-f3b0baa444d0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.005834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e24cfb3-8f04-4078-a9af-f3b0baa444d0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.006434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e24cfb3-8f04-4078-a9af-f3b0baa444d0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.181998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3e24cfb3-8f04-4078-a9af-f3b0baa444d0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:05.191381 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3e24cfb3-8f04-4078-a9af-f3b0baa444d0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.199722 Oct 05 17:44:05.208404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1502/2805] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:04 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:05.215320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-baea8d7a-5b4b-4756-bf47-2721985fa4c6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:05.215710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-baea8d7a-5b4b-4756-bf47-2721985fa4c6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:05.226005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baea8d7a-5b4b-4756-bf47-2721985fa4c6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.226705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baea8d7a-5b4b-4756-bf47-2721985fa4c6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.230814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baea8d7a-5b4b-4756-bf47-2721985fa4c6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.232776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baea8d7a-5b4b-4756-bf47-2721985fa4c6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.232776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baea8d7a-5b4b-4756-bf47-2721985fa4c6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.233162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baea8d7a-5b4b-4756-bf47-2721985fa4c6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.263226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:44:05.263952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:44:05.264679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:44:05.265329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:44:05.265753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:44:05.288488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.289018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.292018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.294033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.296025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.299412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.381621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Getting quotas for project 611cddc6ef94407dba177aea44f5268d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:44:05.398693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Getting quotas for user fe8df861068f404e90034c993f9e0e45 and project 611cddc6ef94407dba177aea44f5268d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:44:05.422085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:44:05.424744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:44:05.511572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-baea8d7a-5b4b-4756-bf47-2721985fa4c6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:05.518459 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8185886-9523-4d81-b670-e966c7e9e9a6 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.662489 Oct 05 17:44:05.522079 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-baea8d7a-5b4b-4756-bf47-2721985fa4c6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.312046 Oct 05 17:44:05.522889 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1304/2806] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:44:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 1672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 17:44:05.533131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd543ea8-0ec3-4218-9dd1-0ff5d2f3df9d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:05.533948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd543ea8-0ec3-4218-9dd1-0ff5d2f3df9d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:05.534991 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1503/2807] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:05 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:05.548063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f2d1d6b-fd94-4d1e-9a31-a4c431054079 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:05.548529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6f2d1d6b-fd94-4d1e-9a31-a4c431054079 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:05.556576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd543ea8-0ec3-4218-9dd1-0ff5d2f3df9d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.557093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd543ea8-0ec3-4218-9dd1-0ff5d2f3df9d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.558741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd543ea8-0ec3-4218-9dd1-0ff5d2f3df9d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.561995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd543ea8-0ec3-4218-9dd1-0ff5d2f3df9d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.562806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd543ea8-0ec3-4218-9dd1-0ff5d2f3df9d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.563698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd543ea8-0ec3-4218-9dd1-0ff5d2f3df9d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.666920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6f2d1d6b-fd94-4d1e-9a31-a4c431054079 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:05.679644 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6f2d1d6b-fd94-4d1e-9a31-a4c431054079 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1224 microversion: 2.1 time: 0.141269 Oct 05 17:44:05.681417 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1504/2808] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:05 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:05.686301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-09647b9b-d67d-4077-899d-ddc01e1100bf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:05.686927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-09647b9b-d67d-4077-899d-ddc01e1100bf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:05.708655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09647b9b-d67d-4077-899d-ddc01e1100bf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.709164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09647b9b-d67d-4077-899d-ddc01e1100bf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.714910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09647b9b-d67d-4077-899d-ddc01e1100bf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.720941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09647b9b-d67d-4077-899d-ddc01e1100bf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.722409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09647b9b-d67d-4077-899d-ddc01e1100bf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.724305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-09647b9b-d67d-4077-899d-ddc01e1100bf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.897343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-09647b9b-d67d-4077-899d-ddc01e1100bf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:05.919717 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-09647b9b-d67d-4077-899d-ddc01e1100bf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.237130 Oct 05 17:44:05.934647 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1505/2809] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:05 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:05.935999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56ae6d77-0459-4d37-a312-93ee4ad8c155 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:05.936836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56ae6d77-0459-4d37-a312-93ee4ad8c155 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:05.947748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56ae6d77-0459-4d37-a312-93ee4ad8c155 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.949952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56ae6d77-0459-4d37-a312-93ee4ad8c155 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.950629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56ae6d77-0459-4d37-a312-93ee4ad8c155 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.952550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56ae6d77-0459-4d37-a312-93ee4ad8c155 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:05.953186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56ae6d77-0459-4d37-a312-93ee4ad8c155 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:05.953820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56ae6d77-0459-4d37-a312-93ee4ad8c155 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:05.977202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:06.230576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-56ae6d77-0459-4d37-a312-93ee4ad8c155 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:06.252072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fd543ea8-0ec3-4218-9dd1-0ff5d2f3df9d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:06.253042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56ae6d77-0459-4d37-a312-93ee4ad8c155 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1307 microversion: 2.1 time: 0.322002 Oct 05 17:44:06.268619 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1506/2810] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:05 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1307 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:06.269118 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fd543ea8-0ec3-4218-9dd1-0ff5d2f3df9d tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1321 microversion: 2.1 time: 0.737716 Oct 05 17:44:06.269118 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1305/2811] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:05 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1321 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:06.274100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-076efed5-216f-4834-8bed-7f4f0315fd3f req-40b17733-35d1-4b48-8a64-3f484d418b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56bc233a-cffb-408b-a620-c3f7f909230d", "name": "network-vif-plugged", "status": "completed", "tag": "d82a9349-89ca-4494-921c-b29ca5e98f6a"}, {"server_uuid": "724e1789-37d2-4d11-8d47-0e5f5ef8b38e", "name": "network-vif-plugged", "status": "completed", "tag": "91e2b936-b6a8-40cb-949e-282fc986a77b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:06.277796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c989ef20-840c-42d0-9de0-fa7fb0a48a4f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:06.279204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c989ef20-840c-42d0-9de0-fa7fb0a48a4f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:06.296770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c989ef20-840c-42d0-9de0-fa7fb0a48a4f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:06.297657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c989ef20-840c-42d0-9de0-fa7fb0a48a4f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:06.300913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c989ef20-840c-42d0-9de0-fa7fb0a48a4f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:06.302255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c989ef20-840c-42d0-9de0-fa7fb0a48a4f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:06.304150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-076efed5-216f-4834-8bed-7f4f0315fd3f req-40b17733-35d1-4b48-8a64-3f484d418b0d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:06.304691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-076efed5-216f-4834-8bed-7f4f0315fd3f req-40b17733-35d1-4b48-8a64-3f484d418b0d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:06.305043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c989ef20-840c-42d0-9de0-fa7fb0a48a4f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:06.305160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-076efed5-216f-4834-8bed-7f4f0315fd3f req-40b17733-35d1-4b48-8a64-3f484d418b0d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:06.305596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c989ef20-840c-42d0-9de0-fa7fb0a48a4f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:06.344329 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-076efed5-216f-4834-8bed-7f4f0315fd3f req-40b17733-35d1-4b48-8a64-3f484d418b0d service nova] Creating event network-vif-plugged:d82a9349-89ca-4494-921c-b29ca5e98f6a for instance 56bc233a-cffb-408b-a620-c3f7f909230d on n-h1-835595-3 Oct 05 17:44:06.344847 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-076efed5-216f-4834-8bed-7f4f0315fd3f req-40b17733-35d1-4b48-8a64-3f484d418b0d service nova] Creating event network-vif-plugged:91e2b936-b6a8-40cb-949e-282fc986a77b for instance 724e1789-37d2-4d11-8d47-0e5f5ef8b38e on n-h1-835595-3 Oct 05 17:44:06.356279 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-076efed5-216f-4834-8bed-7f4f0315fd3f req-40b17733-35d1-4b48-8a64-3f484d418b0d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098661 Oct 05 17:44:06.357692 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1507/2812] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:06.369564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1055858616", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "43b14ad7-066f-4366-a6d9-9f817db2441a"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:06.478774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] validate_networks() for [('43b14ad7-066f-4366-a6d9-9f817db2441a', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:44:06.957637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c989ef20-840c-42d0-9de0-fa7fb0a48a4f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:06.968553 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c989ef20-840c-42d0-9de0-fa7fb0a48a4f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.698997 Oct 05 17:44:06.979434 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1306/2813] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:06 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:06.981443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-edbaa3cc-ebcd-4ef1-a0f2-cf6b32552689 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:06.985240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-edbaa3cc-ebcd-4ef1-a0f2-cf6b32552689 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:06.998114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbaa3cc-ebcd-4ef1-a0f2-cf6b32552689 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:06.999801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbaa3cc-ebcd-4ef1-a0f2-cf6b32552689 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:07.001009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbaa3cc-ebcd-4ef1-a0f2-cf6b32552689 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:07.011438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbaa3cc-ebcd-4ef1-a0f2-cf6b32552689 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:07.011938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbaa3cc-ebcd-4ef1-a0f2-cf6b32552689 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:07.012382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbaa3cc-ebcd-4ef1-a0f2-cf6b32552689 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:07.135506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-edbaa3cc-ebcd-4ef1-a0f2-cf6b32552689 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:07.141175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:07.155906 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-edbaa3cc-ebcd-4ef1-a0f2-cf6b32552689 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1276 microversion: 2.1 time: 0.185637 Oct 05 17:44:07.161486 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1307/2814] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:06 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:07.283778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53710ea0-a69c-48df-b2aa-f81ef830b916 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:07.290787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-53710ea0-a69c-48df-b2aa-f81ef830b916 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:07.300144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53710ea0-a69c-48df-b2aa-f81ef830b916 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:07.301070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53710ea0-a69c-48df-b2aa-f81ef830b916 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:07.301738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53710ea0-a69c-48df-b2aa-f81ef830b916 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:07.302583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53710ea0-a69c-48df-b2aa-f81ef830b916 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:07.303471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53710ea0-a69c-48df-b2aa-f81ef830b916 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:07.304382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53710ea0-a69c-48df-b2aa-f81ef830b916 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:07.522412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:44:07.522962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:44:07.523462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:44:07.524118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:44:07.524577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:44:07.541348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:07.541847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:07.542309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:07.543042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:07.543503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:07.543939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:07.593358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:44:07.609658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for user 1c5f58a618c04b09815dea8f54504c7c and project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:44:07.634071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:44:07.636646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:44:07.704011 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a031b0cd-1fed-432a-9a71-9340ab15b241 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.343842 Oct 05 17:44:07.711274 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1508/2815] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:44:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1354 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:44:07.718466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8a4448a9-575c-46db-b0ca-1a56b0815040 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:07.727442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8a4448a9-575c-46db-b0ca-1a56b0815040 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:07.738226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a4448a9-575c-46db-b0ca-1a56b0815040 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:07.741199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a4448a9-575c-46db-b0ca-1a56b0815040 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:07.741811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a4448a9-575c-46db-b0ca-1a56b0815040 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:07.742902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a4448a9-575c-46db-b0ca-1a56b0815040 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:07.745601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a4448a9-575c-46db-b0ca-1a56b0815040 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:07.746220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a4448a9-575c-46db-b0ca-1a56b0815040 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:07.949213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-53710ea0-a69c-48df-b2aa-f81ef830b916 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:07.960608 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53710ea0-a69c-48df-b2aa-f81ef830b916 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1307 microversion: 2.1 time: 0.682239 Oct 05 17:44:07.971426 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1308/2816] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:07 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1307 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:07.995472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f91e5fa-08ca-4b7a-9fb0-be8f2c2c3fe5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:07.996740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5f91e5fa-08ca-4b7a-9fb0-be8f2c2c3fe5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:08.317468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5f91e5fa-08ca-4b7a-9fb0-be8f2c2c3fe5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:08.326320 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5f91e5fa-08ca-4b7a-9fb0-be8f2c2c3fe5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1215 microversion: 2.1 time: 0.353494 Oct 05 17:44:08.326941 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1309/2817] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:07 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1215 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:08.337582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8a4448a9-575c-46db-b0ca-1a56b0815040 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:08.357131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0810ffd4-1e5d-44d4-b20e-43964f956bc8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:08.357748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0810ffd4-1e5d-44d4-b20e-43964f956bc8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:08.357854 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8a4448a9-575c-46db-b0ca-1a56b0815040 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1513 microversion: 2.1 time: 0.645038 Oct 05 17:44:08.358547 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1509/2818] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:07 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1513 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:08.386844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b3c87df-03ed-4460-bbc7-3821e5cb10ac tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:08.387806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1b3c87df-03ed-4460-bbc7-3821e5cb10ac tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:08.402984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0810ffd4-1e5d-44d4-b20e-43964f956bc8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:08.403706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0810ffd4-1e5d-44d4-b20e-43964f956bc8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:08.405607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0810ffd4-1e5d-44d4-b20e-43964f956bc8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:08.406709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b3c87df-03ed-4460-bbc7-3821e5cb10ac tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:08.407663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0810ffd4-1e5d-44d4-b20e-43964f956bc8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:08.408304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0810ffd4-1e5d-44d4-b20e-43964f956bc8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:08.411209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b3c87df-03ed-4460-bbc7-3821e5cb10ac tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:08.412104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0810ffd4-1e5d-44d4-b20e-43964f956bc8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:08.412586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b3c87df-03ed-4460-bbc7-3821e5cb10ac tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:08.413390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b3c87df-03ed-4460-bbc7-3821e5cb10ac tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:08.414672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b3c87df-03ed-4460-bbc7-3821e5cb10ac tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:08.416682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b3c87df-03ed-4460-bbc7-3821e5cb10ac tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:08.720083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b3c87df-03ed-4460-bbc7-3821e5cb10ac tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:08.735296 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b3c87df-03ed-4460-bbc7-3821e5cb10ac tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1282 microversion: 2.1 time: 0.371236 Oct 05 17:44:08.736506 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1510/2819] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:08 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1282 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:08.746237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8754f0ab-5b67-4f08-8558-c7e1e47ad8e9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:08.753145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8754f0ab-5b67-4f08-8558-c7e1e47ad8e9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:08.768788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8754f0ab-5b67-4f08-8558-c7e1e47ad8e9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:08.780115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8754f0ab-5b67-4f08-8558-c7e1e47ad8e9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:08.780560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8754f0ab-5b67-4f08-8558-c7e1e47ad8e9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:08.781717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8754f0ab-5b67-4f08-8558-c7e1e47ad8e9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:08.782155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8754f0ab-5b67-4f08-8558-c7e1e47ad8e9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:08.782669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8754f0ab-5b67-4f08-8558-c7e1e47ad8e9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:08.996726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0810ffd4-1e5d-44d4-b20e-43964f956bc8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:09.016501 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0810ffd4-1e5d-44d4-b20e-43964f956bc8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.688207 Oct 05 17:44:09.017541 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1310/2820] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:08 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:09.024960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-53adf6ff-19bc-412c-b03a-2f7a19e1cbe4 req-aa1d302b-fdb1-46f7-8968-c1b90fdcc581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beaf97b4-53da-43bc-afe6-15350b810193", "name": "network-vif-plugged", "status": "completed", "tag": "1a9259fb-7b43-42bb-9bbd-11fc82600a80"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:09.056364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-53adf6ff-19bc-412c-b03a-2f7a19e1cbe4 req-aa1d302b-fdb1-46f7-8968-c1b90fdcc581 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:09.060897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-53adf6ff-19bc-412c-b03a-2f7a19e1cbe4 req-aa1d302b-fdb1-46f7-8968-c1b90fdcc581 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:09.061931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-53adf6ff-19bc-412c-b03a-2f7a19e1cbe4 req-aa1d302b-fdb1-46f7-8968-c1b90fdcc581 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:09.086441 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-53adf6ff-19bc-412c-b03a-2f7a19e1cbe4 req-aa1d302b-fdb1-46f7-8968-c1b90fdcc581 service nova] Creating event network-vif-plugged:1a9259fb-7b43-42bb-9bbd-11fc82600a80 for instance beaf97b4-53da-43bc-afe6-15350b810193 on n-h1-835595-3 Oct 05 17:44:09.100654 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-53adf6ff-19bc-412c-b03a-2f7a19e1cbe4 req-aa1d302b-fdb1-46f7-8968-c1b90fdcc581 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078542 Oct 05 17:44:09.102385 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1311/2821] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:09.116126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c88e948a-49d8-4b0a-8577-0f60b5efbc53 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:09.124723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c88e948a-49d8-4b0a-8577-0f60b5efbc53 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:09.145254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c88e948a-49d8-4b0a-8577-0f60b5efbc53 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:09.149307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c88e948a-49d8-4b0a-8577-0f60b5efbc53 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:09.149978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c88e948a-49d8-4b0a-8577-0f60b5efbc53 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:09.150929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c88e948a-49d8-4b0a-8577-0f60b5efbc53 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:09.151615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c88e948a-49d8-4b0a-8577-0f60b5efbc53 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:09.155014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c88e948a-49d8-4b0a-8577-0f60b5efbc53 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:09.534463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c88e948a-49d8-4b0a-8577-0f60b5efbc53 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:09.543191 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c88e948a-49d8-4b0a-8577-0f60b5efbc53 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1307 microversion: 2.1 time: 0.438070 Oct 05 17:44:09.544053 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1312/2822] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:09 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1307 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:09.549045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c3332084-f5e8-4b78-9cb0-8f964fc6fc33 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:09.549633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3332084-f5e8-4b78-9cb0-8f964fc6fc33 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:09.557851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3332084-f5e8-4b78-9cb0-8f964fc6fc33 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:09.565229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8754f0ab-5b67-4f08-8558-c7e1e47ad8e9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:09.569282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3332084-f5e8-4b78-9cb0-8f964fc6fc33 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:09.569734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3332084-f5e8-4b78-9cb0-8f964fc6fc33 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:09.570512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3332084-f5e8-4b78-9cb0-8f964fc6fc33 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:09.570975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3332084-f5e8-4b78-9cb0-8f964fc6fc33 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:09.582712 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8754f0ab-5b67-4f08-8558-c7e1e47ad8e9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1511 microversion: 2.1 time: 0.844683 Oct 05 17:44:09.583302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3332084-f5e8-4b78-9cb0-8f964fc6fc33 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:09.584103 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1511/2823] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:08 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1511 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:09.612874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0ddf274-023e-4a34-9a5c-c02995fa365c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:09.613502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0ddf274-023e-4a34-9a5c-c02995fa365c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:09.628264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0ddf274-023e-4a34-9a5c-c02995fa365c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:09.630152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0ddf274-023e-4a34-9a5c-c02995fa365c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:09.631100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0ddf274-023e-4a34-9a5c-c02995fa365c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:09.632468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0ddf274-023e-4a34-9a5c-c02995fa365c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:09.634688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0ddf274-023e-4a34-9a5c-c02995fa365c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:09.636194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0ddf274-023e-4a34-9a5c-c02995fa365c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:09.718642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c3332084-f5e8-4b78-9cb0-8f964fc6fc33 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:09.729653 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c3332084-f5e8-4b78-9cb0-8f964fc6fc33 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1267 microversion: 2.1 time: 0.184123 Oct 05 17:44:09.740125 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1313/2824] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:09 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:09.759443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f55e679-8130-4885-9b59-598a046bcacf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:09.760057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3f55e679-8130-4885-9b59-598a046bcacf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:09.766583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f55e679-8130-4885-9b59-598a046bcacf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:09.767088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f55e679-8130-4885-9b59-598a046bcacf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:09.767601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f55e679-8130-4885-9b59-598a046bcacf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:09.768287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f55e679-8130-4885-9b59-598a046bcacf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:09.768790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f55e679-8130-4885-9b59-598a046bcacf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:09.769409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f55e679-8130-4885-9b59-598a046bcacf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:09.861607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3f55e679-8130-4885-9b59-598a046bcacf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:09.871471 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3f55e679-8130-4885-9b59-598a046bcacf tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1282 microversion: 2.1 time: 0.116536 Oct 05 17:44:09.872278 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1314/2825] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:09 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:10.041605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e345293-6342-42e0-ae7a-cf08c731f0b6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:10.042705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6e345293-6342-42e0-ae7a-cf08c731f0b6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:10.059554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e345293-6342-42e0-ae7a-cf08c731f0b6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:10.061995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e345293-6342-42e0-ae7a-cf08c731f0b6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:10.062766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e345293-6342-42e0-ae7a-cf08c731f0b6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:10.064463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e345293-6342-42e0-ae7a-cf08c731f0b6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:10.065477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e345293-6342-42e0-ae7a-cf08c731f0b6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:10.069586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e345293-6342-42e0-ae7a-cf08c731f0b6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:10.315869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0ddf274-023e-4a34-9a5c-c02995fa365c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:10.328568 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0ddf274-023e-4a34-9a5c-c02995fa365c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e" status: 200 len: 1512 microversion: 2.1 time: 0.719870 Oct 05 17:44:10.347037 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1512/2826] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:09 2022] GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e => generated 1512 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:10.356049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:10.363179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:10.364712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:10.378840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:10.380239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:10.380911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:10.381908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:10.382857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:10.383474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:10.528143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:10.617218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:10.624975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:10.625706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:10.626431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:10.681779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6e345293-6342-42e0-ae7a-cf08c731f0b6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:10.697323 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6e345293-6342-42e0-ae7a-cf08c731f0b6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1311 microversion: 2.1 time: 0.659325 Oct 05 17:44:10.714872 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1315/2827] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:10 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1311 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:10.720935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b0a686ba-d791-4088-81a2-fb96154ab855 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:10.721824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b0a686ba-d791-4088-81a2-fb96154ab855 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:10.728981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0a686ba-d791-4088-81a2-fb96154ab855 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:10.729940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0a686ba-d791-4088-81a2-fb96154ab855 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:10.730673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0a686ba-d791-4088-81a2-fb96154ab855 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:10.731732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0a686ba-d791-4088-81a2-fb96154ab855 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:10.732341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0a686ba-d791-4088-81a2-fb96154ab855 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:10.732912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0a686ba-d791-4088-81a2-fb96154ab855 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:11.047493 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fbdd8128-dd30-4d01-ae59-9b19cf58d802 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.696028 Oct 05 17:44:11.048743 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1513/2828] 10.222.0.70 () {58 vars in 1167 bytes} [Wed Oct 5 17:44:10 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:11.056263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a5e5e2d-2036-407f-831a-8ffcf5e575b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:11.057846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3a5e5e2d-2036-407f-831a-8ffcf5e575b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:11.076861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5e5e2d-2036-407f-831a-8ffcf5e575b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:11.077581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5e5e2d-2036-407f-831a-8ffcf5e575b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:11.078188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5e5e2d-2036-407f-831a-8ffcf5e575b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:11.079196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5e5e2d-2036-407f-831a-8ffcf5e575b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:11.079911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5e5e2d-2036-407f-831a-8ffcf5e575b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:11.080582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5e5e2d-2036-407f-831a-8ffcf5e575b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:11.199480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3a5e5e2d-2036-407f-831a-8ffcf5e575b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:11.223634 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a5e5e2d-2036-407f-831a-8ffcf5e575b7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1273 microversion: 2.1 time: 0.173322 Oct 05 17:44:11.226693 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1514/2829] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:11 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:11.233792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2678568-6105-49d3-9965-c52cf67e7b63 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:11.234785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b2678568-6105-49d3-9965-c52cf67e7b63 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:11.251362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2678568-6105-49d3-9965-c52cf67e7b63 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:11.254498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2678568-6105-49d3-9965-c52cf67e7b63 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:11.258935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2678568-6105-49d3-9965-c52cf67e7b63 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:11.259724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2678568-6105-49d3-9965-c52cf67e7b63 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:11.260400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2678568-6105-49d3-9965-c52cf67e7b63 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:11.260913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2678568-6105-49d3-9965-c52cf67e7b63 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:11.276772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b0a686ba-d791-4088-81a2-fb96154ab855 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:11.290119 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b0a686ba-d791-4088-81a2-fb96154ab855 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1307 microversion: 2.1 time: 0.573977 Oct 05 17:44:11.297835 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1316/2830] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:10 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1307 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:11.323161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:11.334320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:11.335189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-768149202', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:11.358421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:11.359024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:11.359540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:11.360349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:11.361436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:11.361938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:11.556808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b2678568-6105-49d3-9965-c52cf67e7b63 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:11.571942 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2678568-6105-49d3-9965-c52cf67e7b63 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1324 microversion: 2.1 time: 0.343683 Oct 05 17:44:11.589073 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1515/2831] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:11 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1324 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:11.593476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:11.595804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-72d0a9a2-9e68-43fb-8a17-b0dcc394a49e req-be90b3dc-ae62-4874-a0bd-b07631d027c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea892f71-7a5d-4c84-a174-e011125220a4", "name": "network-vif-plugged", "status": "completed", "tag": "7dea4b91-2303-49a6-bd1a-09f08a5efef6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:11.610392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-72d0a9a2-9e68-43fb-8a17-b0dcc394a49e req-be90b3dc-ae62-4874-a0bd-b07631d027c7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:11.611234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-72d0a9a2-9e68-43fb-8a17-b0dcc394a49e req-be90b3dc-ae62-4874-a0bd-b07631d027c7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:11.614842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-72d0a9a2-9e68-43fb-8a17-b0dcc394a49e req-be90b3dc-ae62-4874-a0bd-b07631d027c7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:11.639502 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-72d0a9a2-9e68-43fb-8a17-b0dcc394a49e req-be90b3dc-ae62-4874-a0bd-b07631d027c7 service nova] Creating event network-vif-plugged:7dea4b91-2303-49a6-bd1a-09f08a5efef6 for instance ea892f71-7a5d-4c84-a174-e011125220a4 on n-h1-835595-3 Oct 05 17:44:11.652251 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-72d0a9a2-9e68-43fb-8a17-b0dcc394a49e req-be90b3dc-ae62-4874-a0bd-b07631d027c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061752 Oct 05 17:44:11.653176 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1516/2832] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:11.730674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6ad0b377-07b1-4a8a-90dc-365f3874a345 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:11.732740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6ad0b377-07b1-4a8a-90dc-365f3874a345 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:11.744445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ad0b377-07b1-4a8a-90dc-365f3874a345 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:11.747887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ad0b377-07b1-4a8a-90dc-365f3874a345 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:11.748512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ad0b377-07b1-4a8a-90dc-365f3874a345 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:11.752538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ad0b377-07b1-4a8a-90dc-365f3874a345 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:11.753471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ad0b377-07b1-4a8a-90dc-365f3874a345 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:11.754309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ad0b377-07b1-4a8a-90dc-365f3874a345 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:11.767963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:11.776761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:11.777680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:11.778518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:12.041142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6ad0b377-07b1-4a8a-90dc-365f3874a345 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:12.054105 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6ad0b377-07b1-4a8a-90dc-365f3874a345 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1493 microversion: 2.1 time: 0.330297 Oct 05 17:44:12.055345 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1517/2833] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:11 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1493 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:12.078036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-03bbb702-33a6-4368-8a34-f7b2f3c9e68d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:12.079039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-03bbb702-33a6-4368-8a34-f7b2f3c9e68d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:12.085683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03bbb702-33a6-4368-8a34-f7b2f3c9e68d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:12.086523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03bbb702-33a6-4368-8a34-f7b2f3c9e68d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:12.087174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03bbb702-33a6-4368-8a34-f7b2f3c9e68d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:12.088091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03bbb702-33a6-4368-8a34-f7b2f3c9e68d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:12.088760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03bbb702-33a6-4368-8a34-f7b2f3c9e68d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:12.089336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03bbb702-33a6-4368-8a34-f7b2f3c9e68d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:12.441813 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-03bbb702-33a6-4368-8a34-f7b2f3c9e68d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1644 microversion: 2.1 time: 0.366515 Oct 05 17:44:12.459933 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1518/2834] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:12 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1644 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:12.472339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a11922c9-396a-4d08-b062-f0a409436e12 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:12.473320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a11922c9-396a-4d08-b062-f0a409436e12 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:12.482744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a11922c9-396a-4d08-b062-f0a409436e12 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:12.483510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a11922c9-396a-4d08-b062-f0a409436e12 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:12.484146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a11922c9-396a-4d08-b062-f0a409436e12 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:12.486533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a11922c9-396a-4d08-b062-f0a409436e12 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:12.488654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a11922c9-396a-4d08-b062-f0a409436e12 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:12.490687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a11922c9-396a-4d08-b062-f0a409436e12 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:12.518516 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da49e5ec-5ac6-4490-98ab-4f0a1887b109 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-768149202" status: 200 len: 1514 microversion: 2.1 time: 1.209105 Oct 05 17:44:12.519371 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1317/2835] 10.222.0.70 () {58 vars in 1261 bytes} [Wed Oct 5 17:44:11 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-768149202 => generated 1514 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:12.524625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-01fab91f-9ced-4482-b2f3-82dd86250c26 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:12.525487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-01fab91f-9ced-4482-b2f3-82dd86250c26 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:12.538646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01fab91f-9ced-4482-b2f3-82dd86250c26 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:12.539776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01fab91f-9ced-4482-b2f3-82dd86250c26 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:12.543189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01fab91f-9ced-4482-b2f3-82dd86250c26 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:12.544193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01fab91f-9ced-4482-b2f3-82dd86250c26 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:12.544870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01fab91f-9ced-4482-b2f3-82dd86250c26 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:12.549785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01fab91f-9ced-4482-b2f3-82dd86250c26 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:12.704561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a11922c9-396a-4d08-b062-f0a409436e12 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:12.713393 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a11922c9-396a-4d08-b062-f0a409436e12 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1273 microversion: 2.1 time: 0.249207 Oct 05 17:44:12.714571 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1519/2836] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:12 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1273 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:12.719257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a7c73bf0-6301-4d41-97c3-8cdd2d27c8bf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:12.720720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a7c73bf0-6301-4d41-97c3-8cdd2d27c8bf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:12.728249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c73bf0-6301-4d41-97c3-8cdd2d27c8bf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:12.730542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c73bf0-6301-4d41-97c3-8cdd2d27c8bf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:12.731261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c73bf0-6301-4d41-97c3-8cdd2d27c8bf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:12.732513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c73bf0-6301-4d41-97c3-8cdd2d27c8bf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:12.735114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c73bf0-6301-4d41-97c3-8cdd2d27c8bf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:12.735718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c73bf0-6301-4d41-97c3-8cdd2d27c8bf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:12.901946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-01fab91f-9ced-4482-b2f3-82dd86250c26 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:12.926503 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-01fab91f-9ced-4482-b2f3-82dd86250c26 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1307 microversion: 2.1 time: 0.402708 Oct 05 17:44:12.942008 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1318/2837] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:12 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1307 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:12.944544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:12.965507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:12.967588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:12.984034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:12.984304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:12.984901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:12.986088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:12.987196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:12.987795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:13.178059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:13.332132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:13.342856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:13.343367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:13.343955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:13.599630 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a7c73bf0-6301-4d41-97c3-8cdd2d27c8bf tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1644 microversion: 2.1 time: 0.882270 Oct 05 17:44:13.602523 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1520/2838] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:12 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1644 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:13.609782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3be3e71-11f5-4378-9bf8-3735f4252ca8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:13.611152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b3be3e71-11f5-4378-9bf8-3735f4252ca8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:13.628464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3be3e71-11f5-4378-9bf8-3735f4252ca8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:13.629594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3be3e71-11f5-4378-9bf8-3735f4252ca8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:13.631195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3be3e71-11f5-4378-9bf8-3735f4252ca8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:13.632380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3be3e71-11f5-4378-9bf8-3735f4252ca8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:13.634015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3be3e71-11f5-4378-9bf8-3735f4252ca8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:13.634755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3be3e71-11f5-4378-9bf8-3735f4252ca8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:13.719932 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-50c2dac2-ed5c-47e6-bd1d-154fa1dfe46a tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.784982 Oct 05 17:44:13.721468 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1319/2839] 10.222.0.70 () {58 vars in 1173 bytes} [Wed Oct 5 17:44:12 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:13.728609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7d4e04dc-e0b3-4d1c-b895-bd4e2bd4e460 req-5c8aaf0a-c410-45f7-b5df-afdaed0dbcaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca1a4b8-636b-4137-a397-910fb7d8f449", "tag": "508b694b-0b99-4f03-a3ab-9a6db4aebbbe"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:13.751880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:13.758817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7d4e04dc-e0b3-4d1c-b895-bd4e2bd4e460 req-5c8aaf0a-c410-45f7-b5df-afdaed0dbcaf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:13.760722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7d4e04dc-e0b3-4d1c-b895-bd4e2bd4e460 req-5c8aaf0a-c410-45f7-b5df-afdaed0dbcaf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:13.761389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7d4e04dc-e0b3-4d1c-b895-bd4e2bd4e460 req-5c8aaf0a-c410-45f7-b5df-afdaed0dbcaf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:13.791303 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7d4e04dc-e0b3-4d1c-b895-bd4e2bd4e460 req-5c8aaf0a-c410-45f7-b5df-afdaed0dbcaf service nova] Creating event network-changed:508b694b-0b99-4f03-a3ab-9a6db4aebbbe for instance dca1a4b8-636b-4137-a397-910fb7d8f449 on n-h2-835595-3 Oct 05 17:44:13.798102 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7d4e04dc-e0b3-4d1c-b895-bd4e2bd4e460 req-5c8aaf0a-c410-45f7-b5df-afdaed0dbcaf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074754 Oct 05 17:44:13.799321 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1320/2840] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:13.804846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-56881001-d294-409b-8e28-84ac14b2caa0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:13.808901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56881001-d294-409b-8e28-84ac14b2caa0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:13.809593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56881001-d294-409b-8e28-84ac14b2caa0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:13.814260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56881001-d294-409b-8e28-84ac14b2caa0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:13.815890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56881001-d294-409b-8e28-84ac14b2caa0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:13.816543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56881001-d294-409b-8e28-84ac14b2caa0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:13.817134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-56881001-d294-409b-8e28-84ac14b2caa0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:13.849598 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-56881001-d294-409b-8e28-84ac14b2caa0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.048690 Oct 05 17:44:13.850824 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1321/2841] 10.222.0.70 () {58 vars in 1176 bytes} [Wed Oct 5 17:44:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:13.855707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e122851d-2487-47e3-84e7-99a21df6ccbf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:13.856655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e122851d-2487-47e3-84e7-99a21df6ccbf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:13.863544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e122851d-2487-47e3-84e7-99a21df6ccbf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:13.865034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e122851d-2487-47e3-84e7-99a21df6ccbf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:13.865617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e122851d-2487-47e3-84e7-99a21df6ccbf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:13.866513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e122851d-2487-47e3-84e7-99a21df6ccbf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:13.867198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e122851d-2487-47e3-84e7-99a21df6ccbf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:13.867774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e122851d-2487-47e3-84e7-99a21df6ccbf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:13.998165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3be3e71-11f5-4378-9bf8-3735f4252ca8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:14.010693 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3be3e71-11f5-4378-9bf8-3735f4252ca8 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1324 microversion: 2.1 time: 0.405663 Oct 05 17:44:14.019858 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1521/2842] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:13 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1324 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:14.034426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:14.041006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:14.042362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.servers [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Removing options 'limit' from query {{(pid=128844) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 05 17:44:14.043532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:14.050773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.051576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.053414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.055069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.055810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.056480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.100039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:14.109538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.114851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.115605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.250747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e122851d-2487-47e3-84e7-99a21df6ccbf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:14.298433 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e122851d-2487-47e3-84e7-99a21df6ccbf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1315 microversion: 2.1 time: 0.441520 Oct 05 17:44:14.300551 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1322/2843] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:13 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:14.311141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4826e1d-9cc9-4d95-947d-264f4d6b2f4c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:14.312230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4826e1d-9cc9-4d95-947d-264f4d6b2f4c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:14.321441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4826e1d-9cc9-4d95-947d-264f4d6b2f4c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.324884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4826e1d-9cc9-4d95-947d-264f4d6b2f4c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.325848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4826e1d-9cc9-4d95-947d-264f4d6b2f4c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.327165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4826e1d-9cc9-4d95-947d-264f4d6b2f4c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.328303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4826e1d-9cc9-4d95-947d-264f4d6b2f4c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.328941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4826e1d-9cc9-4d95-947d-264f4d6b2f4c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.439895 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e28d7ada-70e5-4b54-a6d8-53147a8718b3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.418426 Oct 05 17:44:14.440930 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1522/2844] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 17:44:14 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:14.447784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7c408c72-9eda-462f-a918-7da8d58cc58f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:14.448557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7c408c72-9eda-462f-a918-7da8d58cc58f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:14.458969 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4826e1d-9cc9-4d95-947d-264f4d6b2f4c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193/action" status: 202 len: 0 microversion: 2.1 time: 0.144972 Oct 05 17:44:14.464069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c408c72-9eda-462f-a918-7da8d58cc58f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.465929 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1323/2845] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:44:14 2022] POST /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:44:14.468357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c408c72-9eda-462f-a918-7da8d58cc58f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.470764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c408c72-9eda-462f-a918-7da8d58cc58f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.472737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c408c72-9eda-462f-a918-7da8d58cc58f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.476924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c408c72-9eda-462f-a918-7da8d58cc58f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.477611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c408c72-9eda-462f-a918-7da8d58cc58f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.485593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:14.496097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:14.496877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:14.504284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.505156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.505403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.506205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.507100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.507235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.650077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:14.682718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:14.752028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa10027b-969a-48cb-b3ef-5dc5e705319c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.283649 Oct 05 17:44:14.753446 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1324/2846] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:44:14 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:14.760904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1d15f4bb-878c-4e4d-bd3e-04f29a36a024 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:14.762004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1d15f4bb-878c-4e4d-bd3e-04f29a36a024 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:14.770664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d15f4bb-878c-4e4d-bd3e-04f29a36a024 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.771445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d15f4bb-878c-4e4d-bd3e-04f29a36a024 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.773441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d15f4bb-878c-4e4d-bd3e-04f29a36a024 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.774409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d15f4bb-878c-4e4d-bd3e-04f29a36a024 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:14.775157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d15f4bb-878c-4e4d-bd3e-04f29a36a024 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:14.775854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d15f4bb-878c-4e4d-bd3e-04f29a36a024 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:14.962720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7c408c72-9eda-462f-a918-7da8d58cc58f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:14.971279 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7c408c72-9eda-462f-a918-7da8d58cc58f tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1488 microversion: 2.1 time: 0.528981 Oct 05 17:44:14.971878 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1523/2847] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:14 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1488 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:14.984330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:14.998904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:15.001611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.servers [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Removing options 'limit' from query {{(pid=128844) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 05 17:44:15.006522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:15.012632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.017766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.018234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.019173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.019638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.020065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.078616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:15.082536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:15.128095 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b82e52c4-aa64-4c6a-8321-4c5264a405b4 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.147439 Oct 05 17:44:15.130851 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1524/2848] 10.222.0.70 () {58 vars in 1150 bytes} [Wed Oct 5 17:44:14 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:15.138810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ce7818e-0b08-4065-9cb8-a1a5b5bc0900 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-304843873"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:15.143325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8ce7818e-0b08-4065-9cb8-a1a5b5bc0900 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:15.154644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ce7818e-0b08-4065-9cb8-a1a5b5bc0900 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.155559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ce7818e-0b08-4065-9cb8-a1a5b5bc0900 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.156487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ce7818e-0b08-4065-9cb8-a1a5b5bc0900 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.159280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ce7818e-0b08-4065-9cb8-a1a5b5bc0900 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.160119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ce7818e-0b08-4065-9cb8-a1a5b5bc0900 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.160737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ce7818e-0b08-4065-9cb8-a1a5b5bc0900 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.244721 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1d15f4bb-878c-4e4d-bd3e-04f29a36a024 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1629 microversion: 2.1 time: 0.489915 Oct 05 17:44:15.257124 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1325/2849] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:14 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1629 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:15.272083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ea97f14-54e6-4b7c-bee9-a153bb74bf74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:15.272698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ea97f14-54e6-4b7c-bee9-a153bb74bf74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:15.292180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ea97f14-54e6-4b7c-bee9-a153bb74bf74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.292681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ea97f14-54e6-4b7c-bee9-a153bb74bf74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.293107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ea97f14-54e6-4b7c-bee9-a153bb74bf74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.293809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ea97f14-54e6-4b7c-bee9-a153bb74bf74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.297788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ea97f14-54e6-4b7c-bee9-a153bb74bf74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.299726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ea97f14-54e6-4b7c-bee9-a153bb74bf74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.426506 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8ce7818e-0b08-4065-9cb8-a1a5b5bc0900 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "POST /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4/action" status: 202 len: 0 microversion: 2.1 time: 0.294131 Oct 05 17:44:15.438612 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1525/2850] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:44:15 2022] POST /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 17:44:15.455046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:15.462829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:15.463990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:15.470617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.471429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.472020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.472890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.473584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.474161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.512042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:15.551332 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-adb12b85-cf06-4f40-ace7-60878aa8d289 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.102222 Oct 05 17:44:15.556036 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1526/2851] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:44:15 2022] GET /compute/v2.1/servers => generated 1010 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:15.561527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-835595-3", "block_migration": true, "disk_over_commit": false}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:15.566183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:15.575055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.575940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.576606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.577662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.578380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.579205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.616100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lazy-loading 'flavor' on Instance uuid beaf97b4-53da-43bc-afe6-15350b810193 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:44:15.638158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Going to try to live migrate instance to n-h2-835595-3 {{(pid=128844) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 17:44:15.765035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3ea97f14-54e6-4b7c-bee9-a153bb74bf74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:15.780669 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ea97f14-54e6-4b7c-bee9-a153bb74bf74 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1324 microversion: 2.1 time: 0.522345 Oct 05 17:44:15.790013 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1326/2852] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:15 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1324 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:15.797822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4a739053-b92f-4b7f-9254-75bbdd6f6a4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:15.802236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4a739053-b92f-4b7f-9254-75bbdd6f6a4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:15.813018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a739053-b92f-4b7f-9254-75bbdd6f6a4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.818443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a739053-b92f-4b7f-9254-75bbdd6f6a4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.819061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a739053-b92f-4b7f-9254-75bbdd6f6a4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:15.820048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a739053-b92f-4b7f-9254-75bbdd6f6a4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:15.821485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a739053-b92f-4b7f-9254-75bbdd6f6a4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:15.822125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a739053-b92f-4b7f-9254-75bbdd6f6a4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:16.647519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4a739053-b92f-4b7f-9254-75bbdd6f6a4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:16.669740 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4a739053-b92f-4b7f-9254-75bbdd6f6a4c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1315 microversion: 2.1 time: 0.878044 Oct 05 17:44:16.675051 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1327/2853] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:15 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:16.686395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e20289cc-06f9-4ed3-8879-9aae0b664ce9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77754245e0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:16.765761 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e20289cc-06f9-4ed3-8879-9aae0b664ce9 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0" status: 200 len: 1411 microversion: 2.1 time: 0.087845 Oct 05 17:44:16.774187 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1328/2854] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:44:16 2022] GET /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0 => generated 1411 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:16.800444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:16.806138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:16.822976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:16.892558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:16.903737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:16.906606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:16.909475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:16.911655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:16.912274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:17.142704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:17.251470 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-60e3a0e0-968b-4361-9608-dd5b9c7313bd tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.475786 Oct 05 17:44:17.252639 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1329/2855] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:44:16 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:17.258443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7cc56d2f-24e1-4cc8-9cfa-bda43f3afe76 req-0e9faa2a-7c46-44a2-ba26-2c4f2d518350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8782e20f-31a5-4548-bed9-1f77db983f32", "tag": "faf0a0a8-ddc5-4f43-85a2-794e8fa87d2b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:17.269265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7cc56d2f-24e1-4cc8-9cfa-bda43f3afe76 req-0e9faa2a-7c46-44a2-ba26-2c4f2d518350 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:17.270042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7cc56d2f-24e1-4cc8-9cfa-bda43f3afe76 req-0e9faa2a-7c46-44a2-ba26-2c4f2d518350 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:17.270796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7cc56d2f-24e1-4cc8-9cfa-bda43f3afe76 req-0e9faa2a-7c46-44a2-ba26-2c4f2d518350 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:17.283623 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7cc56d2f-24e1-4cc8-9cfa-bda43f3afe76 req-0e9faa2a-7c46-44a2-ba26-2c4f2d518350 service nova] Creating event network-changed:faf0a0a8-ddc5-4f43-85a2-794e8fa87d2b for instance 8782e20f-31a5-4548-bed9-1f77db983f32 on n-h1-835595-3 Oct 05 17:44:17.296036 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7cc56d2f-24e1-4cc8-9cfa-bda43f3afe76 req-0e9faa2a-7c46-44a2-ba26-2c4f2d518350 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041831 Oct 05 17:44:17.303221 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1330/2856] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:17.320493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-281f3f6d-349a-4854-a784-d3284dd632a2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f777535d5e0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:17.384958 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-281f3f6d-349a-4854-a784-d3284dd632a2 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0" status: 200 len: 1411 microversion: 2.1 time: 0.079960 Oct 05 17:44:17.385688 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1331/2857] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:44:17 2022] GET /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0 => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:17.405343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ab66c04-9d6c-4751-bfed-8256e5d4dc08 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:17.406372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ab66c04-9d6c-4751-bfed-8256e5d4dc08 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:17.424445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ab66c04-9d6c-4751-bfed-8256e5d4dc08 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:17.424766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ab66c04-9d6c-4751-bfed-8256e5d4dc08 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:17.425209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ab66c04-9d6c-4751-bfed-8256e5d4dc08 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:17.426265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ab66c04-9d6c-4751-bfed-8256e5d4dc08 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:17.426800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ab66c04-9d6c-4751-bfed-8256e5d4dc08 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:17.427734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ab66c04-9d6c-4751-bfed-8256e5d4dc08 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:17.779155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3ab66c04-9d6c-4751-bfed-8256e5d4dc08 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:17.788631 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ab66c04-9d6c-4751-bfed-8256e5d4dc08 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1324 microversion: 2.1 time: 0.399259 Oct 05 17:44:17.789489 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1332/2858] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:17 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1324 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:17.963806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1095325023", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "86bbfffd-e30f-4ea1-a11f-f144938f9e73"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:18.036283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] validate_networks() for [('86bbfffd-e30f-4ea1-a11f-f144938f9e73', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:44:18.889663 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-830f5dde-078c-4756-b8b9-cb09a1b055ee tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193/action" status: 202 len: 0 microversion: 2.1 time: 3.332152 Oct 05 17:44:18.894630 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1527/2859] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:44:15 2022] POST /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193/action => generated 0 bytes in 3338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:44:18.902150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:18.920305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:18.921287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.servers [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Removing options 'limit' from query {{(pid=128844) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 05 17:44:18.923356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:18.937519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:18.940044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:18.940801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:18.941944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:18.944105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:18.945293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:19.013020 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-facef606-651d-4374-9ba3-74a615d5ec98 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.116439 Oct 05 17:44:19.014773 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1528/2860] 10.222.0.70 () {58 vars in 1140 bytes} [Wed Oct 5 17:44:18 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:19.026669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ba19efbf-2b3a-4906-9b5a-8fd36f327dcf tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7774669670>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:19.312561 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ba19efbf-2b3a-4906-9b5a-8fd36f327dcf tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0" status: 204 len: 0 microversion: 2.1 time: 0.295491 Oct 05 17:44:19.316467 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1529/2861] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:19 2022] DELETE /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:44:19.322675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f72ab637-1995-4012-9678-56c0c398b44a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:19.323316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f72ab637-1995-4012-9678-56c0c398b44a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:19.323801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:44:19.324257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:44:19.324839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:44:19.325254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:44:19.325656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:44:19.341322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72ab637-1995-4012-9678-56c0c398b44a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:19.344327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72ab637-1995-4012-9678-56c0c398b44a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:19.345032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72ab637-1995-4012-9678-56c0c398b44a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:19.348636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72ab637-1995-4012-9678-56c0c398b44a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:19.349350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72ab637-1995-4012-9678-56c0c398b44a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:19.351634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72ab637-1995-4012-9678-56c0c398b44a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:19.356249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:19.357006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:19.357794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:19.358803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:19.360148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:19.360791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:19.385584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Getting quotas for project 4393c803b178449689c9696c8301eff3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:44:19.397759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Getting quotas for user 1c8193b43c1f429d82cd97cbf7fedc04 and project 4393c803b178449689c9696c8301eff3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:44:19.419546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:44:19.421841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:44:19.540299 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2a1e0dff-2adf-482f-9e29-908d8caaf2ea tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.749729 Oct 05 17:44:19.541017 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1333/2862] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:44:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:44:19.553615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8efe02e9-90ed-4100-b9a4-b6b45d3d34e5 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:19.554243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8efe02e9-90ed-4100-b9a4-b6b45d3d34e5 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:19.574607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8efe02e9-90ed-4100-b9a4-b6b45d3d34e5 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:19.575076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8efe02e9-90ed-4100-b9a4-b6b45d3d34e5 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:19.577724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8efe02e9-90ed-4100-b9a4-b6b45d3d34e5 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:19.580048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8efe02e9-90ed-4100-b9a4-b6b45d3d34e5 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:19.581067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8efe02e9-90ed-4100-b9a4-b6b45d3d34e5 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:19.595979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8efe02e9-90ed-4100-b9a4-b6b45d3d34e5 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:19.811156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f72ab637-1995-4012-9678-56c0c398b44a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:19.863523 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f72ab637-1995-4012-9678-56c0c398b44a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1315 microversion: 2.1 time: 0.544605 Oct 05 17:44:19.876157 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1530/2863] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:19 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1315 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:19.892377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-61da7d62-9604-44b9-a8c3-69683cf6c16c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:19.892940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-61da7d62-9604-44b9-a8c3-69683cf6c16c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:19.928764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61da7d62-9604-44b9-a8c3-69683cf6c16c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:19.932182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61da7d62-9604-44b9-a8c3-69683cf6c16c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:19.933478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61da7d62-9604-44b9-a8c3-69683cf6c16c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:19.934242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61da7d62-9604-44b9-a8c3-69683cf6c16c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:19.938639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61da7d62-9604-44b9-a8c3-69683cf6c16c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:19.939279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61da7d62-9604-44b9-a8c3-69683cf6c16c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:20.171314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8efe02e9-90ed-4100-b9a4-b6b45d3d34e5 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:20.199852 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8efe02e9-90ed-4100-b9a4-b6b45d3d34e5 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1324 microversion: 2.1 time: 0.650062 Oct 05 17:44:20.202565 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1334/2864] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:19 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1324 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:20.210471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:20.233908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:20.234728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-768149202', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:20.265961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:20.270454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:20.271057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:20.276713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:20.279848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:20.280381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:20.287641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-61da7d62-9604-44b9-a8c3-69683cf6c16c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:20.311216 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-61da7d62-9604-44b9-a8c3-69683cf6c16c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1503 microversion: 2.1 time: 0.433760 Oct 05 17:44:20.327334 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1531/2865] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:19 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1503 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:20.332854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78b7cc13-159c-4cfc-8fc3-d749ece4a3c1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77746bbf70>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:20.372672 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-78b7cc13-159c-4cfc-8fc3-d749ece4a3c1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Image not found. Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78b7cc13-159c-4cfc-8fc3-d749ece4a3c1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0 HTTP/1.1 Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '975f4875-53f8-4032-9d68-d22d26e4f4a0'} Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 975f4875-53f8-4032-9d68-d22d26e4f4a0 Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 17:44:20.375352 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 975f4875-53f8-4032-9d68-d22d26e4f4a0 could not be found. Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:44:20.379772 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:20.385580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78b7cc13-159c-4cfc-8fc3-d749ece4a3c1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:20.386752 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78b7cc13-159c-4cfc-8fc3-d749ece4a3c1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0" status: 404 len: 62 microversion: 2.1 time: 0.058050 Oct 05 17:44:20.391799 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1532/2866] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:44:20 2022] GET /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:44:20.397858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-32a1741b-4040-401f-8c6a-d6282edfda8e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:20.398945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-32a1741b-4040-401f-8c6a-d6282edfda8e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:20.519877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-32a1741b-4040-401f-8c6a-d6282edfda8e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:20.528812 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-32a1741b-4040-401f-8c6a-d6282edfda8e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1228 microversion: 2.1 time: 0.135247 Oct 05 17:44:20.558150 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1533/2867] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:20 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1228 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:20.564285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13fa8f15-a86f-4d28-bd16-f8f4b3b312d3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:20.565059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13fa8f15-a86f-4d28-bd16-f8f4b3b312d3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:20.578046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13fa8f15-a86f-4d28-bd16-f8f4b3b312d3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:20.579483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13fa8f15-a86f-4d28-bd16-f8f4b3b312d3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:20.582751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13fa8f15-a86f-4d28-bd16-f8f4b3b312d3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:20.583871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13fa8f15-a86f-4d28-bd16-f8f4b3b312d3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:20.584639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13fa8f15-a86f-4d28-bd16-f8f4b3b312d3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:20.585523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13fa8f15-a86f-4d28-bd16-f8f4b3b312d3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:20.709705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:20.920755 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48c7d960-58c5-4214-9453-73b02aeec91c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-768149202" status: 200 len: 345 microversion: 2.1 time: 0.716860 Oct 05 17:44:20.938831 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1335/2868] 10.222.0.70 () {58 vars in 1240 bytes} [Wed Oct 5 17:44:20 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-768149202 => generated 345 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:20.967246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-13fa8f15-a86f-4d28-bd16-f8f4b3b312d3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:20.967246 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13fa8f15-a86f-4d28-bd16-f8f4b3b312d3 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1501 microversion: 2.1 time: 0.405484 Oct 05 17:44:20.969391 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1534/2869] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:20 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1501 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:20.973646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b700f034-9482-41ca-81f9-2cbfde5d2132 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:20.994303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b700f034-9482-41ca-81f9-2cbfde5d2132 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:20.994303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b700f034-9482-41ca-81f9-2cbfde5d2132 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:20.994303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b700f034-9482-41ca-81f9-2cbfde5d2132 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:20.999202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2fc0fee8-fe8b-4c99-aa33-17e305acfe8e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:21.003332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2fc0fee8-fe8b-4c99-aa33-17e305acfe8e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:21.012206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc0fee8-fe8b-4c99-aa33-17e305acfe8e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:21.013080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc0fee8-fe8b-4c99-aa33-17e305acfe8e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:21.013773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc0fee8-fe8b-4c99-aa33-17e305acfe8e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:21.015763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc0fee8-fe8b-4c99-aa33-17e305acfe8e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:21.016826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc0fee8-fe8b-4c99-aa33-17e305acfe8e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:21.017854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc0fee8-fe8b-4c99-aa33-17e305acfe8e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:21.046870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b700f034-9482-41ca-81f9-2cbfde5d2132 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Going to try to stop instance {{(pid=128844) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 17:44:21.140756 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b700f034-9482-41ca-81f9-2cbfde5d2132 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "POST /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d/action" status: 202 len: 0 microversion: 2.1 time: 0.170453 Oct 05 17:44:21.142705 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1535/2870] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:44:20 2022] POST /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d/action => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:44:21.173734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-72176a6a-8643-4cbe-8e9a-e0d058fb42ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:21.174982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-72176a6a-8643-4cbe-8e9a-e0d058fb42ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:21.185549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:21.187629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72176a6a-8643-4cbe-8e9a-e0d058fb42ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:21.188561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72176a6a-8643-4cbe-8e9a-e0d058fb42ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:21.189155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72176a6a-8643-4cbe-8e9a-e0d058fb42ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:21.190075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72176a6a-8643-4cbe-8e9a-e0d058fb42ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:21.190745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72176a6a-8643-4cbe-8e9a-e0d058fb42ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:21.191669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72176a6a-8643-4cbe-8e9a-e0d058fb42ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:21.416083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-72176a6a-8643-4cbe-8e9a-e0d058fb42ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:21.434120 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-72176a6a-8643-4cbe-8e9a-e0d058fb42ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.283820 Oct 05 17:44:21.435010 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1536/2871] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:21 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:21.447441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d99157d3-2cc6-4eed-b1a7-8ee7700a4d05 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:21.448249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d99157d3-2cc6-4eed-b1a7-8ee7700a4d05 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:21.466544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d99157d3-2cc6-4eed-b1a7-8ee7700a4d05 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:21.467280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d99157d3-2cc6-4eed-b1a7-8ee7700a4d05 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:21.470610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d99157d3-2cc6-4eed-b1a7-8ee7700a4d05 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:21.470610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d99157d3-2cc6-4eed-b1a7-8ee7700a4d05 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:21.470610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d99157d3-2cc6-4eed-b1a7-8ee7700a4d05 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:21.470610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d99157d3-2cc6-4eed-b1a7-8ee7700a4d05 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:21.705490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2fc0fee8-fe8b-4c99-aa33-17e305acfe8e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:21.716320 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2fc0fee8-fe8b-4c99-aa33-17e305acfe8e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1315 microversion: 2.1 time: 0.740750 Oct 05 17:44:21.732592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d99157d3-2cc6-4eed-b1a7-8ee7700a4d05 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:21.737472 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1336/2872] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:20 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1315 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:21.741549 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d99157d3-2cc6-4eed-b1a7-8ee7700a4d05 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1324 microversion: 2.1 time: 0.303142 Oct 05 17:44:21.743099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a8da16c7-8bbc-4b4f-8eac-290020ffd509 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:21.744165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a8da16c7-8bbc-4b4f-8eac-290020ffd509 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:21.747976 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1537/2873] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:21 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:21.751527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8da16c7-8bbc-4b4f-8eac-290020ffd509 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:21.752186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8da16c7-8bbc-4b4f-8eac-290020ffd509 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:21.752914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8da16c7-8bbc-4b4f-8eac-290020ffd509 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:21.753766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8da16c7-8bbc-4b4f-8eac-290020ffd509 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:21.754412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8da16c7-8bbc-4b4f-8eac-290020ffd509 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:21.755101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8da16c7-8bbc-4b4f-8eac-290020ffd509 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:21.770672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d4dce5f6-c1db-475c-814b-6e74a751ec67 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:21.771618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d4dce5f6-c1db-475c-814b-6e74a751ec67 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:21.792210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dce5f6-c1db-475c-814b-6e74a751ec67 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:21.794316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dce5f6-c1db-475c-814b-6e74a751ec67 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:21.794987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dce5f6-c1db-475c-814b-6e74a751ec67 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:21.796765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dce5f6-c1db-475c-814b-6e74a751ec67 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:21.799413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dce5f6-c1db-475c-814b-6e74a751ec67 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:21.800585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4dce5f6-c1db-475c-814b-6e74a751ec67 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:21.923423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d4dce5f6-c1db-475c-814b-6e74a751ec67 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:21.936356 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d4dce5f6-c1db-475c-814b-6e74a751ec67 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1280 microversion: 2.1 time: 0.187235 Oct 05 17:44:21.937813 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1538/2874] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:21 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:21.994754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cd367eb8-2aaa-4b95-a029-d88351a43d57 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:21.997252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cd367eb8-2aaa-4b95-a029-d88351a43d57 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:22.015650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd367eb8-2aaa-4b95-a029-d88351a43d57 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:22.016603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd367eb8-2aaa-4b95-a029-d88351a43d57 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:22.017383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd367eb8-2aaa-4b95-a029-d88351a43d57 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:22.019296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd367eb8-2aaa-4b95-a029-d88351a43d57 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:22.023007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd367eb8-2aaa-4b95-a029-d88351a43d57 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:22.024911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd367eb8-2aaa-4b95-a029-d88351a43d57 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:22.360800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cd367eb8-2aaa-4b95-a029-d88351a43d57 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:22.364877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:22.369838 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cd367eb8-2aaa-4b95-a029-d88351a43d57 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1488 microversion: 2.1 time: 0.381792 Oct 05 17:44:22.374830 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1539/2875] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:21 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1488 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:22.392973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-674c6cb5-7e29-4e25-906f-f509f6a30108 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:22.393480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-674c6cb5-7e29-4e25-906f-f509f6a30108 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:22.402415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674c6cb5-7e29-4e25-906f-f509f6a30108 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:22.402951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674c6cb5-7e29-4e25-906f-f509f6a30108 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:22.403399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674c6cb5-7e29-4e25-906f-f509f6a30108 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:22.404110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674c6cb5-7e29-4e25-906f-f509f6a30108 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:22.404724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674c6cb5-7e29-4e25-906f-f509f6a30108 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:22.405157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-674c6cb5-7e29-4e25-906f-f509f6a30108 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:22.448098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-674c6cb5-7e29-4e25-906f-f509f6a30108 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:44:22.594445 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-674c6cb5-7e29-4e25-906f-f509f6a30108 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 204 len: 0 microversion: 2.1 time: 0.205539 Oct 05 17:44:22.609833 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1540/2876] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:22 2022] DELETE /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:44:22.624370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ed638deb-a608-4f6c-8b96-aa30edcdda0c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:22.625411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ed638deb-a608-4f6c-8b96-aa30edcdda0c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:22.632528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed638deb-a608-4f6c-8b96-aa30edcdda0c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:22.633423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed638deb-a608-4f6c-8b96-aa30edcdda0c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:22.634057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed638deb-a608-4f6c-8b96-aa30edcdda0c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:22.635063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed638deb-a608-4f6c-8b96-aa30edcdda0c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:22.635666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed638deb-a608-4f6c-8b96-aa30edcdda0c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:22.636317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed638deb-a608-4f6c-8b96-aa30edcdda0c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:22.929389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a8da16c7-8bbc-4b4f-8eac-290020ffd509 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:22.942148 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a8da16c7-8bbc-4b4f-8eac-290020ffd509 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1503 microversion: 2.1 time: 1.203497 Oct 05 17:44:22.942796 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1337/2877] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:21 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1503 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:22.950910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea969407-3496-44cd-86d8-fe3dcf3ca8fc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7774d6e8b0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:22.990424 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-ea969407-3496-44cd-86d8-fe3dcf3ca8fc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Image not found. Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea969407-3496-44cd-86d8-fe3dcf3ca8fc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0 HTTP/1.1 Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: exception: Image not found. Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '975f4875-53f8-4032-9d68-d22d26e4f4a0'} Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 975f4875-53f8-4032-9d68-d22d26e4f4a0 to delete Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 975f4875-53f8-4032-9d68-d22d26e4f4a0 could not be found. Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:22.992518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:22.997427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea969407-3496-44cd-86d8-fe3dcf3ca8fc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Image not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:22.999048 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ea969407-3496-44cd-86d8-fe3dcf3ca8fc tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0" status: 404 len: 62 microversion: 2.1 time: 0.053132 Oct 05 17:44:22.999639 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1338/2878] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:22 2022] DELETE /compute/v2.1/images/975f4875-53f8-4032-9d68-d22d26e4f4a0 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:44:23.009681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-401ac92a-c240-485b-be27-04882291ad6d req-df675a2d-10c5-4ef4-8c08-dd166e6991b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8782e20f-31a5-4548-bed9-1f77db983f32", "name": "network-vif-plugged", "status": "completed", "tag": "faf0a0a8-ddc5-4f43-85a2-794e8fa87d2b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:23.029379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-401ac92a-c240-485b-be27-04882291ad6d req-df675a2d-10c5-4ef4-8c08-dd166e6991b3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.029974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-401ac92a-c240-485b-be27-04882291ad6d req-df675a2d-10c5-4ef4-8c08-dd166e6991b3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.030695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-401ac92a-c240-485b-be27-04882291ad6d req-df675a2d-10c5-4ef4-8c08-dd166e6991b3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.045607 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-401ac92a-c240-485b-be27-04882291ad6d req-df675a2d-10c5-4ef4-8c08-dd166e6991b3 service nova] Creating event network-vif-plugged:faf0a0a8-ddc5-4f43-85a2-794e8fa87d2b for instance 8782e20f-31a5-4548-bed9-1f77db983f32 on n-h1-835595-3 Oct 05 17:44:23.051281 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-401ac92a-c240-485b-be27-04882291ad6d req-df675a2d-10c5-4ef4-8c08-dd166e6991b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050405 Oct 05 17:44:23.052543 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1339/2879] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:23.060045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2e6f0ad-01d9-4b04-aa13-2085c9dadb4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:23.061006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2e6f0ad-01d9-4b04-aa13-2085c9dadb4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:23.068672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2e6f0ad-01d9-4b04-aa13-2085c9dadb4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.069478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2e6f0ad-01d9-4b04-aa13-2085c9dadb4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.070184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2e6f0ad-01d9-4b04-aa13-2085c9dadb4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.071213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2e6f0ad-01d9-4b04-aa13-2085c9dadb4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.071895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2e6f0ad-01d9-4b04-aa13-2085c9dadb4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.072514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2e6f0ad-01d9-4b04-aa13-2085c9dadb4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.319842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2e6f0ad-01d9-4b04-aa13-2085c9dadb4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:23.327927 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c2e6f0ad-01d9-4b04-aa13-2085c9dadb4e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1315 microversion: 2.1 time: 0.273996 Oct 05 17:44:23.328643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ed638deb-a608-4f6c-8b96-aa30edcdda0c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:23.329736 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1340/2880] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:23 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:23.334537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ec933d1f-86cd-4635-a8cb-211f2d92c8ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:23.335562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ec933d1f-86cd-4635-a8cb-211f2d92c8ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:23.351542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec933d1f-86cd-4635-a8cb-211f2d92c8ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.352355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec933d1f-86cd-4635-a8cb-211f2d92c8ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.352796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec933d1f-86cd-4635-a8cb-211f2d92c8ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.353508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec933d1f-86cd-4635-a8cb-211f2d92c8ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.353961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec933d1f-86cd-4635-a8cb-211f2d92c8ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.354430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec933d1f-86cd-4635-a8cb-211f2d92c8ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.354745 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ed638deb-a608-4f6c-8b96-aa30edcdda0c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.743173 Oct 05 17:44:23.366305 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1541/2881] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:22 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:23.366305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-07bf4117-6463-4a7b-8c2a-a516e7551d25 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:23.366305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-07bf4117-6463-4a7b-8c2a-a516e7551d25 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:23.367780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07bf4117-6463-4a7b-8c2a-a516e7551d25 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.368512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07bf4117-6463-4a7b-8c2a-a516e7551d25 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.369187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07bf4117-6463-4a7b-8c2a-a516e7551d25 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.370100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07bf4117-6463-4a7b-8c2a-a516e7551d25 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.371042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07bf4117-6463-4a7b-8c2a-a516e7551d25 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.371676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07bf4117-6463-4a7b-8c2a-a516e7551d25 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.504227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-07bf4117-6463-4a7b-8c2a-a516e7551d25 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:23.521088 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-07bf4117-6463-4a7b-8c2a-a516e7551d25 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1286 microversion: 2.1 time: 0.164237 Oct 05 17:44:23.524541 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1542/2882] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:23 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:23.533016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:23.535567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:23.546265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.547929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.548758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.549745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.550266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.551260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.583315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ec933d1f-86cd-4635-a8cb-211f2d92c8ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:23.585398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:44:23.591951 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ec933d1f-86cd-4635-a8cb-211f2d92c8ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1324 microversion: 2.1 time: 0.260998 Oct 05 17:44:23.592533 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1341/2883] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:23 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1324 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:23.602839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7eb9a515-822c-4890-81ef-89e7b55ba912 req-36c69721-21c8-4c1e-844e-23a21e780124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beaf97b4-53da-43bc-afe6-15350b810193", "name": "network-vif-unplugged", "status": "completed", "tag": "1a9259fb-7b43-42bb-9bbd-11fc82600a80"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:23.630456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7eb9a515-822c-4890-81ef-89e7b55ba912 req-36c69721-21c8-4c1e-844e-23a21e780124 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.631212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7eb9a515-822c-4890-81ef-89e7b55ba912 req-36c69721-21c8-4c1e-844e-23a21e780124 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.631640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7eb9a515-822c-4890-81ef-89e7b55ba912 req-36c69721-21c8-4c1e-844e-23a21e780124 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.645798 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7eb9a515-822c-4890-81ef-89e7b55ba912 req-36c69721-21c8-4c1e-844e-23a21e780124 service nova] Creating event network-vif-unplugged:1a9259fb-7b43-42bb-9bbd-11fc82600a80 for instance beaf97b4-53da-43bc-afe6-15350b810193 on n-h1-835595-3 Oct 05 17:44:23.653734 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7eb9a515-822c-4890-81ef-89e7b55ba912 req-36c69721-21c8-4c1e-844e-23a21e780124 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055578 Oct 05 17:44:23.656434 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1342/2884] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:23.679816 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.api [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Instance is already in deleting state, ignoring this request Oct 05 17:44:23.681022 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6587456c-bc76-450e-9613-497495b49945 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 204 len: 0 microversion: 2.1 time: 0.154901 Oct 05 17:44:23.682132 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1543/2885] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:23 2022] DELETE /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:44:23.694037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d40b3e35-4d12-4ce5-8320-5b854c81311e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:23.694968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d40b3e35-4d12-4ce5-8320-5b854c81311e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:23.706413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40b3e35-4d12-4ce5-8320-5b854c81311e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.707234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40b3e35-4d12-4ce5-8320-5b854c81311e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.707948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40b3e35-4d12-4ce5-8320-5b854c81311e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.708845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40b3e35-4d12-4ce5-8320-5b854c81311e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.709481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40b3e35-4d12-4ce5-8320-5b854c81311e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.710113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d40b3e35-4d12-4ce5-8320-5b854c81311e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.970230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-325a51ec-d520-4738-9d1e-a27d360520e4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:23.970977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-325a51ec-d520-4738-9d1e-a27d360520e4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:23.987508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325a51ec-d520-4738-9d1e-a27d360520e4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.988492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325a51ec-d520-4738-9d1e-a27d360520e4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:23.996256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325a51ec-d520-4738-9d1e-a27d360520e4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:23.998168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325a51ec-d520-4738-9d1e-a27d360520e4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:23.999538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325a51ec-d520-4738-9d1e-a27d360520e4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:24.001540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325a51ec-d520-4738-9d1e-a27d360520e4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:24.023651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d40b3e35-4d12-4ce5-8320-5b854c81311e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:24.039173 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d40b3e35-4d12-4ce5-8320-5b854c81311e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1494 microversion: 2.1 time: 0.351440 Oct 05 17:44:24.040193 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1343/2886] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:23 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1494 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:24.314029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-325a51ec-d520-4738-9d1e-a27d360520e4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:24.325948 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-325a51ec-d520-4738-9d1e-a27d360520e4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1503 microversion: 2.1 time: 0.358347 Oct 05 17:44:24.331487 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1544/2887] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:23 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1503 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:24.355164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc74dd9a-ef7d-4c69-b820-1817e183039e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:24.356086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cc74dd9a-ef7d-4c69-b820-1817e183039e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:24.365164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc74dd9a-ef7d-4c69-b820-1817e183039e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:24.366205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc74dd9a-ef7d-4c69-b820-1817e183039e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:24.367092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc74dd9a-ef7d-4c69-b820-1817e183039e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:24.368165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc74dd9a-ef7d-4c69-b820-1817e183039e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:24.368832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc74dd9a-ef7d-4c69-b820-1817e183039e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:24.370017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc74dd9a-ef7d-4c69-b820-1817e183039e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:24.379982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d3eb5b4-3c88-40dc-9294-a1d3049118ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:24.380619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d3eb5b4-3c88-40dc-9294-a1d3049118ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:24.392937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d3eb5b4-3c88-40dc-9294-a1d3049118ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:24.393375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d3eb5b4-3c88-40dc-9294-a1d3049118ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:24.393812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d3eb5b4-3c88-40dc-9294-a1d3049118ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:24.396983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d3eb5b4-3c88-40dc-9294-a1d3049118ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:24.397462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d3eb5b4-3c88-40dc-9294-a1d3049118ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:24.397892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d3eb5b4-3c88-40dc-9294-a1d3049118ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:24.574186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cc74dd9a-ef7d-4c69-b820-1817e183039e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:24.584565 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cc74dd9a-ef7d-4c69-b820-1817e183039e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1315 microversion: 2.1 time: 0.234927 Oct 05 17:44:24.585640 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1344/2888] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:24 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:24.591230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-709050f6-78f7-432d-8c1c-e1fa19778ac9 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:24.592617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-709050f6-78f7-432d-8c1c-e1fa19778ac9 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:24.598926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709050f6-78f7-432d-8c1c-e1fa19778ac9 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:24.599611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709050f6-78f7-432d-8c1c-e1fa19778ac9 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:24.600314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709050f6-78f7-432d-8c1c-e1fa19778ac9 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:24.600921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709050f6-78f7-432d-8c1c-e1fa19778ac9 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:24.601363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709050f6-78f7-432d-8c1c-e1fa19778ac9 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:24.602010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709050f6-78f7-432d-8c1c-e1fa19778ac9 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:24.685711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3d3eb5b4-3c88-40dc-9294-a1d3049118ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:24.694773 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d3eb5b4-3c88-40dc-9294-a1d3049118ba tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.318777 Oct 05 17:44:24.710672 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1545/2889] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:24 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:24.714503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cddca123-5300-4721-b8e4-9a22ac0581d7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:24.715160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cddca123-5300-4721-b8e4-9a22ac0581d7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:24.721795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cddca123-5300-4721-b8e4-9a22ac0581d7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:24.722381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cddca123-5300-4721-b8e4-9a22ac0581d7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:24.722730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cddca123-5300-4721-b8e4-9a22ac0581d7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:24.724207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cddca123-5300-4721-b8e4-9a22ac0581d7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:24.724688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cddca123-5300-4721-b8e4-9a22ac0581d7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:24.725205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cddca123-5300-4721-b8e4-9a22ac0581d7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:24.881306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-709050f6-78f7-432d-8c1c-e1fa19778ac9 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:24.890889 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-709050f6-78f7-432d-8c1c-e1fa19778ac9 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1328 microversion: 2.1 time: 0.303235 Oct 05 17:44:24.891561 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1345/2890] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:24 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1328 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:25.065116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0dccbb14-42d8-4f16-ba99-f59fcf8db0e5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:25.065744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0dccbb14-42d8-4f16-ba99-f59fcf8db0e5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:25.072338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dccbb14-42d8-4f16-ba99-f59fcf8db0e5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:25.072854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dccbb14-42d8-4f16-ba99-f59fcf8db0e5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:25.073285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dccbb14-42d8-4f16-ba99-f59fcf8db0e5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:25.074788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dccbb14-42d8-4f16-ba99-f59fcf8db0e5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:25.075713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dccbb14-42d8-4f16-ba99-f59fcf8db0e5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:25.076146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dccbb14-42d8-4f16-ba99-f59fcf8db0e5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:25.091642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cddca123-5300-4721-b8e4-9a22ac0581d7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:25.096439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:25.106069 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cddca123-5300-4721-b8e4-9a22ac0581d7 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1324 microversion: 2.1 time: 0.408858 Oct 05 17:44:25.114961 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1546/2891] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:24 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1324 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:25.127011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5476c228-06d7-4372-a4ca-de59b3465d99 req-fe715d52-a462-4ea6-a162-e0ccf4df5aeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca1a4b8-636b-4137-a397-910fb7d8f449", "name": "network-vif-plugged", "status": "completed", "tag": "508b694b-0b99-4f03-a3ab-9a6db4aebbbe"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:25.141174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5476c228-06d7-4372-a4ca-de59b3465d99 req-fe715d52-a462-4ea6-a162-e0ccf4df5aeb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:25.141972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5476c228-06d7-4372-a4ca-de59b3465d99 req-fe715d52-a462-4ea6-a162-e0ccf4df5aeb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:25.142421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5476c228-06d7-4372-a4ca-de59b3465d99 req-fe715d52-a462-4ea6-a162-e0ccf4df5aeb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:25.157444 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5476c228-06d7-4372-a4ca-de59b3465d99 req-fe715d52-a462-4ea6-a162-e0ccf4df5aeb service nova] Creating event network-vif-plugged:508b694b-0b99-4f03-a3ab-9a6db4aebbbe for instance dca1a4b8-636b-4137-a397-910fb7d8f449 on n-h2-835595-3 Oct 05 17:44:25.162517 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5476c228-06d7-4372-a4ca-de59b3465d99 req-fe715d52-a462-4ea6-a162-e0ccf4df5aeb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045964 Oct 05 17:44:25.163707 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1547/2892] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:25.351079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f4c34b2-5824-4e57-bdd7-9cf1b6895786 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:25.353364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2f4c34b2-5824-4e57-bdd7-9cf1b6895786 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:25.362909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f4c34b2-5824-4e57-bdd7-9cf1b6895786 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:25.363745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f4c34b2-5824-4e57-bdd7-9cf1b6895786 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:25.365901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f4c34b2-5824-4e57-bdd7-9cf1b6895786 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:25.368338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f4c34b2-5824-4e57-bdd7-9cf1b6895786 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:25.369434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f4c34b2-5824-4e57-bdd7-9cf1b6895786 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:25.370118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f4c34b2-5824-4e57-bdd7-9cf1b6895786 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:25.372853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0dccbb14-42d8-4f16-ba99-f59fcf8db0e5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:25.387301 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0dccbb14-42d8-4f16-ba99-f59fcf8db0e5 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1494 microversion: 2.1 time: 0.326051 Oct 05 17:44:25.388823 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1346/2893] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:25 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1494 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:25.557850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-823e057f-275f-4cd1-88a5-a6c7ce234e77 req-ea7ec9ef-af3e-46b4-a785-906f9f3998f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef", "tag": "fb997ddb-6c4a-40a4-be79-949940675ee9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:25.569131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-823e057f-275f-4cd1-88a5-a6c7ce234e77 req-ea7ec9ef-af3e-46b4-a785-906f9f3998f5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:25.570786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-823e057f-275f-4cd1-88a5-a6c7ce234e77 req-ea7ec9ef-af3e-46b4-a785-906f9f3998f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:25.571525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-823e057f-275f-4cd1-88a5-a6c7ce234e77 req-ea7ec9ef-af3e-46b4-a785-906f9f3998f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:25.588446 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-823e057f-275f-4cd1-88a5-a6c7ce234e77 req-ea7ec9ef-af3e-46b4-a785-906f9f3998f5 service nova] Creating event network-changed:fb997ddb-6c4a-40a4-be79-949940675ee9 for instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef on n-h2-835595-3 Oct 05 17:44:25.616239 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-823e057f-275f-4cd1-88a5-a6c7ce234e77 req-ea7ec9ef-af3e-46b4-a785-906f9f3998f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063412 Oct 05 17:44:25.621571 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1347/2894] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:44:25.646107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-39c5e3aa-fc30-41e8-a950-6a22990da519 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:25.646107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-39c5e3aa-fc30-41e8-a950-6a22990da519 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:25.662781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39c5e3aa-fc30-41e8-a950-6a22990da519 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:25.663638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39c5e3aa-fc30-41e8-a950-6a22990da519 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:25.664342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39c5e3aa-fc30-41e8-a950-6a22990da519 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:25.668444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39c5e3aa-fc30-41e8-a950-6a22990da519 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:25.669512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39c5e3aa-fc30-41e8-a950-6a22990da519 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:25.670198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39c5e3aa-fc30-41e8-a950-6a22990da519 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:25.754211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f4c34b2-5824-4e57-bdd7-9cf1b6895786 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:25.771057 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f4c34b2-5824-4e57-bdd7-9cf1b6895786 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1503 microversion: 2.1 time: 0.426548 Oct 05 17:44:25.772102 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1548/2895] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:25 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1503 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:25.777598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e1f95c09-6181-4dad-9be6-a89229cdeadf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:25.788856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e1f95c09-6181-4dad-9be6-a89229cdeadf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:25.795370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1f95c09-6181-4dad-9be6-a89229cdeadf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:25.795874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1f95c09-6181-4dad-9be6-a89229cdeadf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:25.796313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1f95c09-6181-4dad-9be6-a89229cdeadf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:25.797023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1f95c09-6181-4dad-9be6-a89229cdeadf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:25.797651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1f95c09-6181-4dad-9be6-a89229cdeadf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:25.798266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1f95c09-6181-4dad-9be6-a89229cdeadf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:26.067211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-39c5e3aa-fc30-41e8-a950-6a22990da519 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:26.093532 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-39c5e3aa-fc30-41e8-a950-6a22990da519 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1315 microversion: 2.1 time: 0.468167 Oct 05 17:44:26.111974 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1348/2896] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:25 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:26.148517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-720d4e5d-0f19-4e64-a05b-624432b34949 req-6a107cdd-9c03-4655-baf0-81194a8f54db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beaf97b4-53da-43bc-afe6-15350b810193", "tag": "1a9259fb-7b43-42bb-9bbd-11fc82600a80"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:26.158691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-720d4e5d-0f19-4e64-a05b-624432b34949 req-6a107cdd-9c03-4655-baf0-81194a8f54db service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:26.159466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-720d4e5d-0f19-4e64-a05b-624432b34949 req-6a107cdd-9c03-4655-baf0-81194a8f54db service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:26.160057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-720d4e5d-0f19-4e64-a05b-624432b34949 req-6a107cdd-9c03-4655-baf0-81194a8f54db service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:26.174758 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-720d4e5d-0f19-4e64-a05b-624432b34949 req-6a107cdd-9c03-4655-baf0-81194a8f54db service nova] Creating event network-changed:1a9259fb-7b43-42bb-9bbd-11fc82600a80 for instance beaf97b4-53da-43bc-afe6-15350b810193 on n-h1-835595-3 Oct 05 17:44:26.180469 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-720d4e5d-0f19-4e64-a05b-624432b34949 req-6a107cdd-9c03-4655-baf0-81194a8f54db service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043564 Oct 05 17:44:26.181515 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1349/2897] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:26.189039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-71b370a6-26e9-4451-98d1-68ffdb5c9841 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:26.189743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-71b370a6-26e9-4451-98d1-68ffdb5c9841 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:26.193920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e1f95c09-6181-4dad-9be6-a89229cdeadf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:26.196842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71b370a6-26e9-4451-98d1-68ffdb5c9841 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:26.197510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71b370a6-26e9-4451-98d1-68ffdb5c9841 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:26.198109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71b370a6-26e9-4451-98d1-68ffdb5c9841 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:26.198889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71b370a6-26e9-4451-98d1-68ffdb5c9841 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:26.199558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71b370a6-26e9-4451-98d1-68ffdb5c9841 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:26.199954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71b370a6-26e9-4451-98d1-68ffdb5c9841 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:26.206259 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e1f95c09-6181-4dad-9be6-a89229cdeadf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.432892 Oct 05 17:44:26.221953 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1549/2898] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:25 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:26.221953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e6833363-1080-4419-ab62-501f18192fb2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:26.221953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e6833363-1080-4419-ab62-501f18192fb2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:26.237553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6833363-1080-4419-ab62-501f18192fb2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:26.238066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6833363-1080-4419-ab62-501f18192fb2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:26.238583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6833363-1080-4419-ab62-501f18192fb2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:26.239634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6833363-1080-4419-ab62-501f18192fb2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:26.240086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6833363-1080-4419-ab62-501f18192fb2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:26.240505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6833363-1080-4419-ab62-501f18192fb2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:26.503241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-71b370a6-26e9-4451-98d1-68ffdb5c9841 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:26.516376 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-71b370a6-26e9-4451-98d1-68ffdb5c9841 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1328 microversion: 2.1 time: 0.332381 Oct 05 17:44:26.518547 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1350/2899] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:26 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1328 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:26.527516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:26.528583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:26.536290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:26.536793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:26.537231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:26.537949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:26.538450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:26.538977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:26.598618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:26.599234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:26.599685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:26.600217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lazy-loading 'fault' on Instance uuid ea892f71-7a5d-4c84-a174-e011125220a4 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:44:26.685642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6720411ae8fc46a5bcd7b8f6d95c24a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d5d4426b3d481b92b84c307cd00ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:26.694656 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-06a63537-9829-4ccf-a3ab-e17f99aa8bcb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 200 len: 1385 microversion: 2.1 time: 0.174514 Oct 05 17:44:26.710738 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1351/2900] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:26 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 1385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:26.804874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-148f2180-d3be-4c40-bf56-b1218920bd32 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:26.809544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-148f2180-d3be-4c40-bf56-b1218920bd32 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:26.837479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-148f2180-d3be-4c40-bf56-b1218920bd32 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:26.838961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-148f2180-d3be-4c40-bf56-b1218920bd32 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:26.839717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-148f2180-d3be-4c40-bf56-b1218920bd32 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:26.842236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-148f2180-d3be-4c40-bf56-b1218920bd32 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:26.843774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-148f2180-d3be-4c40-bf56-b1218920bd32 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:26.844224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-148f2180-d3be-4c40-bf56-b1218920bd32 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:27.162015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-148f2180-d3be-4c40-bf56-b1218920bd32 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:27.171685 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-148f2180-d3be-4c40-bf56-b1218920bd32 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1503 microversion: 2.1 time: 0.381057 Oct 05 17:44:27.184671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e6833363-1080-4419-ab62-501f18192fb2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:27.186160 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1352/2901] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:26 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:27.192866 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e6833363-1080-4419-ab62-501f18192fb2 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1324 microversion: 2.1 time: 0.984377 Oct 05 17:44:27.193467 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1550/2902] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:26 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1324 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:27.198867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51798611-501c-4cad-adca-c4da5e0bb779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:27.199695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51798611-501c-4cad-adca-c4da5e0bb779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:27.207429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51798611-501c-4cad-adca-c4da5e0bb779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:27.208147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51798611-501c-4cad-adca-c4da5e0bb779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:27.208745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51798611-501c-4cad-adca-c4da5e0bb779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:27.209897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51798611-501c-4cad-adca-c4da5e0bb779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:27.210585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51798611-501c-4cad-adca-c4da5e0bb779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:27.211232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51798611-501c-4cad-adca-c4da5e0bb779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:27.232996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-834224a2-9aa5-4f0e-8e87-fd406da28c37 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:27.233647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-834224a2-9aa5-4f0e-8e87-fd406da28c37 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:27.240279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-834224a2-9aa5-4f0e-8e87-fd406da28c37 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:27.240986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-834224a2-9aa5-4f0e-8e87-fd406da28c37 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:27.241608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-834224a2-9aa5-4f0e-8e87-fd406da28c37 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:27.242560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-834224a2-9aa5-4f0e-8e87-fd406da28c37 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:27.243186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-834224a2-9aa5-4f0e-8e87-fd406da28c37 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:27.243765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-834224a2-9aa5-4f0e-8e87-fd406da28c37 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:27.481291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-51798611-501c-4cad-adca-c4da5e0bb779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:27.508889 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51798611-501c-4cad-adca-c4da5e0bb779 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1503 microversion: 2.1 time: 0.318581 Oct 05 17:44:27.511156 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1353/2903] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:27 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1503 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:27.547320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5dd85d95-3124-4807-abfc-cf55f1020d80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:27.547947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5dd85d95-3124-4807-abfc-cf55f1020d80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:27.556896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dd85d95-3124-4807-abfc-cf55f1020d80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:27.557753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dd85d95-3124-4807-abfc-cf55f1020d80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:27.559062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dd85d95-3124-4807-abfc-cf55f1020d80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:27.560024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dd85d95-3124-4807-abfc-cf55f1020d80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:27.560696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dd85d95-3124-4807-abfc-cf55f1020d80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:27.561306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dd85d95-3124-4807-abfc-cf55f1020d80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:27.631922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-834224a2-9aa5-4f0e-8e87-fd406da28c37 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:27.649971 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-834224a2-9aa5-4f0e-8e87-fd406da28c37 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.423275 Oct 05 17:44:27.650713 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1551/2904] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:27 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:27.665631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fc36f106-2b40-4285-884e-0cd2c1009d31 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:27.666903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fc36f106-2b40-4285-884e-0cd2c1009d31 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:27.684287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc36f106-2b40-4285-884e-0cd2c1009d31 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:27.685052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc36f106-2b40-4285-884e-0cd2c1009d31 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:27.685701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc36f106-2b40-4285-884e-0cd2c1009d31 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:27.686616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc36f106-2b40-4285-884e-0cd2c1009d31 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:27.687221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc36f106-2b40-4285-884e-0cd2c1009d31 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:27.692309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc36f106-2b40-4285-884e-0cd2c1009d31 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:27.850563 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.network.security_group_api [None req-5dd85d95-3124-4807-abfc-cf55f1020d80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Removing security group 872c8743-9c3f-4873-b6f7-8cf6522f7bc5 from port faf0a0a8-ddc5-4f43-85a2-794e8fa87d2b Oct 05 17:44:28.035848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fc36f106-2b40-4285-884e-0cd2c1009d31 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:28.045636 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fc36f106-2b40-4285-884e-0cd2c1009d31 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1328 microversion: 2.1 time: 0.389294 Oct 05 17:44:28.047713 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1552/2905] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:27 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1328 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:28.057434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e33a6d1f-59e7-4fb0-9a90-b8b06c0023fd req-2d45cfeb-24fe-4210-93e1-c812d3d38819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea892f71-7a5d-4c84-a174-e011125220a4", "name": "network-vif-deleted", "tag": "7dea4b91-2303-49a6-bd1a-09f08a5efef6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:28.084879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e33a6d1f-59e7-4fb0-9a90-b8b06c0023fd req-2d45cfeb-24fe-4210-93e1-c812d3d38819 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.085670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e33a6d1f-59e7-4fb0-9a90-b8b06c0023fd req-2d45cfeb-24fe-4210-93e1-c812d3d38819 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.087047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e33a6d1f-59e7-4fb0-9a90-b8b06c0023fd req-2d45cfeb-24fe-4210-93e1-c812d3d38819 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.111735 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e33a6d1f-59e7-4fb0-9a90-b8b06c0023fd req-2d45cfeb-24fe-4210-93e1-c812d3d38819 service nova] Creating event network-vif-deleted:7dea4b91-2303-49a6-bd1a-09f08a5efef6 for instance ea892f71-7a5d-4c84-a174-e011125220a4 on n-h1-835595-3 Oct 05 17:44:28.121331 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e33a6d1f-59e7-4fb0-9a90-b8b06c0023fd req-2d45cfeb-24fe-4210-93e1-c812d3d38819 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072004 Oct 05 17:44:28.122782 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1553/2906] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:28.131417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:28.132342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: ea892f71-7a5d-4c84-a174-e011125220a4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:28.140674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.141387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.141989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.143166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.143801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.144392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.160879 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Instance ea892f71-7a5d-4c84-a174-e011125220a4 could not be found. Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 HTTP/1.1 Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance ea892f71-7a5d-4c84-a174-e011125220a4 could not be found. Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'ea892f71-7a5d-4c84-a174-e011125220a4'} Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea892f71-7a5d-4c84-a174-e011125220a4 could not be found. Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea892f71-7a5d-4c84-a174-e011125220a4 could not be found. Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.163081 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:28.168120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:28.168120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:28.168120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:28.168120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:28.168120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea892f71-7a5d-4c84-a174-e011125220a4 could not be found. Oct 05 17:44:28.168120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.170342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Instance ea892f71-7a5d-4c84-a174-e011125220a4 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:28.171374 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-573018f7-1c0c-45b6-861e-3f71805ee0e7 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4" status: 404 len: 111 microversion: 2.1 time: 0.047203 Oct 05 17:44:28.171999 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1554/2907] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:28 2022] GET /compute/v2.1/servers/ea892f71-7a5d-4c84-a174-e011125220a4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:28.184733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c403fe4-0db3-4e63-92bc-b631d5add34c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7774649dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:28.224596 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5c403fe4-0db3-4e63-92bc-b631d5add34c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Image not found. Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c403fe4-0db3-4e63-92bc-b631d5add34c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 HTTP/1.1 Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '7ffc1323-1464-4f88-8a41-822ffbe160a2'} Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7ffc1323-1464-4f88-8a41-822ffbe160a2 to delete Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7ffc1323-1464-4f88-8a41-822ffbe160a2 could not be found. Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.226777 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c403fe4-0db3-4e63-92bc-b631d5add34c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:28.233070 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c403fe4-0db3-4e63-92bc-b631d5add34c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2" status: 404 len: 62 microversion: 2.1 time: 0.048704 Oct 05 17:44:28.235420 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1555/2908] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:28 2022] DELETE /compute/v2.1/images/7ffc1323-1464-4f88-8a41-822ffbe160a2 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:44:28.241116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-57735b78-170b-4f77-9c5a-7649d4539e5b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:28.242105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-57735b78-170b-4f77-9c5a-7649d4539e5b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:28.252186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57735b78-170b-4f77-9c5a-7649d4539e5b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.252774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57735b78-170b-4f77-9c5a-7649d4539e5b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.253306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57735b78-170b-4f77-9c5a-7649d4539e5b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.254089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57735b78-170b-4f77-9c5a-7649d4539e5b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.254676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57735b78-170b-4f77-9c5a-7649d4539e5b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.255344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57735b78-170b-4f77-9c5a-7649d4539e5b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.285424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:28.524942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-57735b78-170b-4f77-9c5a-7649d4539e5b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:28.537457 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-57735b78-170b-4f77-9c5a-7649d4539e5b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1503 microversion: 2.1 time: 0.296294 Oct 05 17:44:28.547260 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1556/2909] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:28 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1503 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:28.554413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f924ec24-7921-40e8-9d59-efb3a31601b9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:28.555497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f924ec24-7921-40e8-9d59-efb3a31601b9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:28.566755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f924ec24-7921-40e8-9d59-efb3a31601b9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.567249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f924ec24-7921-40e8-9d59-efb3a31601b9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.567720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f924ec24-7921-40e8-9d59-efb3a31601b9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.568421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f924ec24-7921-40e8-9d59-efb3a31601b9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.568867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f924ec24-7921-40e8-9d59-efb3a31601b9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.569428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f924ec24-7921-40e8-9d59-efb3a31601b9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.631377 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5dd85d95-3124-4807-abfc-cf55f1020d80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32/action" status: 202 len: 0 microversion: 2.1 time: 1.092262 Oct 05 17:44:28.633951 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1354/2910] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:44:27 2022] POST /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32/action => generated 0 bytes in 1096 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:44:28.640998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:28.642518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:28.651963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.652940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.654120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.655400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.656117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.656736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.694413 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b HTTP/1.1 Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '9c03997c-01af-46a1-9887-9b72e2a2815b'} Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:28.698132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. Oct 05 17:44:28.702246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.702246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:28.702246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.702246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:28.702246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:28.702246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:28.702246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:28.702246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:28.702246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. Oct 05 17:44:28.702246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:28.705682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:28.708394 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e0cf3924-a07d-498f-966b-0232f239be21 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 404 len: 111 microversion: 2.1 time: 0.072888 Oct 05 17:44:28.709572 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1355/2911] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:28 2022] DELETE /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:28.717188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1df8497a-32b9-4f03-ae2b-72bf2d1b33b4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:28.718044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1df8497a-32b9-4f03-ae2b-72bf2d1b33b4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:28.728997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1df8497a-32b9-4f03-ae2b-72bf2d1b33b4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.729863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1df8497a-32b9-4f03-ae2b-72bf2d1b33b4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.731214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1df8497a-32b9-4f03-ae2b-72bf2d1b33b4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.732160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1df8497a-32b9-4f03-ae2b-72bf2d1b33b4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.732783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1df8497a-32b9-4f03-ae2b-72bf2d1b33b4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.733463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1df8497a-32b9-4f03-ae2b-72bf2d1b33b4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.849655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f924ec24-7921-40e8-9d59-efb3a31601b9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:28.870924 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f924ec24-7921-40e8-9d59-efb3a31601b9 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1521 microversion: 2.1 time: 0.321415 Oct 05 17:44:28.872402 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1557/2912] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:28 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:28.880475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-fba6f9d7-d3e8-4fbd-9251-f11ca149583a req-1a1ee903-8e88-49b5-853e-986a5725299c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8782e20f-31a5-4548-bed9-1f77db983f32", "tag": "faf0a0a8-ddc5-4f43-85a2-794e8fa87d2b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:28.901664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fba6f9d7-d3e8-4fbd-9251-f11ca149583a req-1a1ee903-8e88-49b5-853e-986a5725299c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.902770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fba6f9d7-d3e8-4fbd-9251-f11ca149583a req-1a1ee903-8e88-49b5-853e-986a5725299c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.903831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fba6f9d7-d3e8-4fbd-9251-f11ca149583a req-1a1ee903-8e88-49b5-853e-986a5725299c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.923354 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-fba6f9d7-d3e8-4fbd-9251-f11ca149583a req-1a1ee903-8e88-49b5-853e-986a5725299c service nova] Creating event network-changed:faf0a0a8-ddc5-4f43-85a2-794e8fa87d2b for instance 8782e20f-31a5-4548-bed9-1f77db983f32 on n-h1-835595-3 Oct 05 17:44:28.933056 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-fba6f9d7-d3e8-4fbd-9251-f11ca149583a req-1a1ee903-8e88-49b5-853e-986a5725299c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058258 Oct 05 17:44:28.933996 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1558/2913] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:28.940825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8dbf119a-cb90-48c6-bbb3-4cd8f7185b57 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:28.941803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8dbf119a-cb90-48c6-bbb3-4cd8f7185b57 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:28.949590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbf119a-cb90-48c6-bbb3-4cd8f7185b57 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.950489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbf119a-cb90-48c6-bbb3-4cd8f7185b57 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.951089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbf119a-cb90-48c6-bbb3-4cd8f7185b57 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.952262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbf119a-cb90-48c6-bbb3-4cd8f7185b57 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:28.953661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbf119a-cb90-48c6-bbb3-4cd8f7185b57 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:28.954273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8dbf119a-cb90-48c6-bbb3-4cd8f7185b57 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:28.981330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=12 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:29.192573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8dbf119a-cb90-48c6-bbb3-4cd8f7185b57 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:29.204436 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8dbf119a-cb90-48c6-bbb3-4cd8f7185b57 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.268665 Oct 05 17:44:29.205583 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1559/2914] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:28 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:29.212369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:29.213172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 9c03997c-01af-46a1-9887-9b72e2a2815b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:29.220387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.221097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.222310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.223605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.224108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.224538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.243357 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b HTTP/1.1 Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '9c03997c-01af-46a1-9887-9b72e2a2815b'} Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.245023 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:29.251083 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:29.251083 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:29.251083 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:29.251083 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:29.251083 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. Oct 05 17:44:29.251083 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.251083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Instance 9c03997c-01af-46a1-9887-9b72e2a2815b could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:29.251083 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90bb288a-f465-4685-953d-b272446bbf7e tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b" status: 404 len: 111 microversion: 2.1 time: 0.039775 Oct 05 17:44:29.251083 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1560/2915] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:29 2022] GET /compute/v2.1/servers/9c03997c-01af-46a1-9887-9b72e2a2815b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:29.253544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7f7828d4-79bf-41a9-9aa8-c2caa9892a06 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:29.254146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7f7828d4-79bf-41a9-9aa8-c2caa9892a06 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:29.261809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f7828d4-79bf-41a9-9aa8-c2caa9892a06 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.263026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f7828d4-79bf-41a9-9aa8-c2caa9892a06 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.263559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f7828d4-79bf-41a9-9aa8-c2caa9892a06 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.264325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f7828d4-79bf-41a9-9aa8-c2caa9892a06 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.268066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f7828d4-79bf-41a9-9aa8-c2caa9892a06 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.268512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f7828d4-79bf-41a9-9aa8-c2caa9892a06 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.303249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7f7828d4-79bf-41a9-9aa8-c2caa9892a06 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:44:29.313898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1df8497a-32b9-4f03-ae2b-72bf2d1b33b4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:29.322336 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1df8497a-32b9-4f03-ae2b-72bf2d1b33b4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1461 microversion: 2.1 time: 0.611316 Oct 05 17:44:29.335636 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1356/2916] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:28 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1461 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:29.344763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-87c3e322-bdeb-483a-af47-099895d80217 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:29.345713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-87c3e322-bdeb-483a-af47-099895d80217 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:29.352399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87c3e322-bdeb-483a-af47-099895d80217 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.352895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87c3e322-bdeb-483a-af47-099895d80217 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.353589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87c3e322-bdeb-483a-af47-099895d80217 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.354418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87c3e322-bdeb-483a-af47-099895d80217 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.354984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87c3e322-bdeb-483a-af47-099895d80217 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.355452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-87c3e322-bdeb-483a-af47-099895d80217 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.423132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=18 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:29.439167 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7f7828d4-79bf-41a9-9aa8-c2caa9892a06 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 204 len: 0 microversion: 2.1 time: 0.189996 Oct 05 17:44:29.439967 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1561/2917] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:29 2022] DELETE /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:44:29.446782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3e15aaa-5b40-4d2e-ba3c-8727cf05bbf1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f77754294c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:29.483331 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c3e15aaa-5b40-4d2e-ba3c-8727cf05bbf1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Image not found. Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3e15aaa-5b40-4d2e-ba3c-8727cf05bbf1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a HTTP/1.1 Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '98273b1b-78b7-4b94-8383-4b3c57f8615a'} Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 98273b1b-78b7-4b94-8383-4b3c57f8615a to delete Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 98273b1b-78b7-4b94-8383-4b3c57f8615a could not be found. Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.485528 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3e15aaa-5b40-4d2e-ba3c-8727cf05bbf1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3e15aaa-5b40-4d2e-ba3c-8727cf05bbf1 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a" status: 404 len: 62 microversion: 2.1 time: 0.045574 Oct 05 17:44:29.492438 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1562/2918] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:29 2022] DELETE /compute/v2.1/images/98273b1b-78b7-4b94-8383-4b3c57f8615a => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:44:29.495858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13f49018-8d1e-4d53-b558-06e09e5dadd5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:29.495858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13f49018-8d1e-4d53-b558-06e09e5dadd5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:29.503419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f49018-8d1e-4d53-b558-06e09e5dadd5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.504005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f49018-8d1e-4d53-b558-06e09e5dadd5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.504452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f49018-8d1e-4d53-b558-06e09e5dadd5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.505369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f49018-8d1e-4d53-b558-06e09e5dadd5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.505678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f49018-8d1e-4d53-b558-06e09e5dadd5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.506105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f49018-8d1e-4d53-b558-06e09e5dadd5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.659843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-13f49018-8d1e-4d53-b558-06e09e5dadd5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:29.674944 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13f49018-8d1e-4d53-b558-06e09e5dadd5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.186146 Oct 05 17:44:29.675632 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1563/2919] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:29 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:29.700178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c632434-7ead-4d85-8489-15fc39a30be1 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:29.701129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c632434-7ead-4d85-8489-15fc39a30be1 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:29.707508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c632434-7ead-4d85-8489-15fc39a30be1 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.708096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c632434-7ead-4d85-8489-15fc39a30be1 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.708837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c632434-7ead-4d85-8489-15fc39a30be1 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.709703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c632434-7ead-4d85-8489-15fc39a30be1 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.710173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c632434-7ead-4d85-8489-15fc39a30be1 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.710924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c632434-7ead-4d85-8489-15fc39a30be1 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.733596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-87c3e322-bdeb-483a-af47-099895d80217 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:29.755949 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-87c3e322-bdeb-483a-af47-099895d80217 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1328 microversion: 2.1 time: 0.418999 Oct 05 17:44:29.756712 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1357/2920] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:29 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1328 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:29.761606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:29.762235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:29.776891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.777394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.777834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.778632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.779087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.779517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.795184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e HTTP/1.1 Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '1f2c8db2-f243-4f95-8554-5f6456b4f18e'} Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:29.797024 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-73a6744b-1355-42af-8e33-70635160b818 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 404 len: 111 microversion: 2.1 time: 0.040577 Oct 05 17:44:29.802518 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1358/2921] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:29 2022] DELETE /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:29.803867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-66516c76-ee9e-4ef4-ba7d-b9a0fd417522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:29.804620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-66516c76-ee9e-4ef4-ba7d-b9a0fd417522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:29.811916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66516c76-ee9e-4ef4-ba7d-b9a0fd417522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.812262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66516c76-ee9e-4ef4-ba7d-b9a0fd417522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.812696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66516c76-ee9e-4ef4-ba7d-b9a0fd417522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.813455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66516c76-ee9e-4ef4-ba7d-b9a0fd417522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.813916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66516c76-ee9e-4ef4-ba7d-b9a0fd417522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.814373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66516c76-ee9e-4ef4-ba7d-b9a0fd417522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.874313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9c632434-7ead-4d85-8489-15fc39a30be1 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:29.882727 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c632434-7ead-4d85-8489-15fc39a30be1 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1527 microversion: 2.1 time: 0.196032 Oct 05 17:44:29.883294 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1564/2922] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:29 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1527 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:29.892441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb018ec6-2b7f-43ee-a6f7-0c00cbf7ddd7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:29.893523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb018ec6-2b7f-43ee-a6f7-0c00cbf7ddd7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:29.900296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb018ec6-2b7f-43ee-a6f7-0c00cbf7ddd7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.901330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb018ec6-2b7f-43ee-a6f7-0c00cbf7ddd7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.901936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb018ec6-2b7f-43ee-a6f7-0c00cbf7ddd7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:29.902917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb018ec6-2b7f-43ee-a6f7-0c00cbf7ddd7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:29.903518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb018ec6-2b7f-43ee-a6f7-0c00cbf7ddd7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:29.904088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb018ec6-2b7f-43ee-a6f7-0c00cbf7ddd7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.094018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66516c76-ee9e-4ef4-ba7d-b9a0fd417522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:30.104447 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-66516c76-ee9e-4ef4-ba7d-b9a0fd417522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1503 microversion: 2.1 time: 0.304229 Oct 05 17:44:30.105566 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1359/2923] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:29 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1503 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:30.111206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:30.112124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: 1f2c8db2-f243-4f95-8554-5f6456b4f18e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:30.120815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.121582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.121895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.122781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.123412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.123984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.138538 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e HTTP/1.1 Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '1f2c8db2-f243-4f95-8554-5f6456b4f18e'} Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.140318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.145616 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:30.145616 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:30.145616 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:30.145616 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:30.145616 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. Oct 05 17:44:30.145616 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.147349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Instance 1f2c8db2-f243-4f95-8554-5f6456b4f18e could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:30.148477 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-70438f2d-54ae-44cc-878e-36d5e3498321 tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e" status: 404 len: 111 microversion: 2.1 time: 0.041600 Oct 05 17:44:30.149296 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1360/2924] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:30 2022] GET /compute/v2.1/servers/1f2c8db2-f243-4f95-8554-5f6456b4f18e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:30.159146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9894607-85f5-4780-aa5f-2470e2ca95cb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '.version_select at 0x7f7775649700>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:30.160795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fb018ec6-2b7f-43ee-a6f7-0c00cbf7ddd7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:30.174266 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb018ec6-2b7f-43ee-a6f7-0c00cbf7ddd7 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.289914 Oct 05 17:44:30.174966 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1565/2925] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:29 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:30.184041 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c9894607-85f5-4780-aa5f-2470e2ca95cb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Image not found. Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9894607-85f5-4780-aa5f-2470e2ca95cb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe HTTP/1.1 Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: exception: Image not found. Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'ae72de82-c963-47c7-a243-18fe3de1cffe'} Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ae72de82-c963-47c7-a243-18fe3de1cffe to delete Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae72de82-c963-47c7-a243-18fe3de1cffe could not be found. Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.185826 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9894607-85f5-4780-aa5f-2470e2ca95cb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Image not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:30.190127 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c9894607-85f5-4780-aa5f-2470e2ca95cb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe" status: 404 len: 62 microversion: 2.1 time: 0.032685 Oct 05 17:44:30.192046 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1361/2926] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:30 2022] DELETE /compute/v2.1/images/ae72de82-c963-47c7-a243-18fe3de1cffe => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:44:30.199319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-73c1c004-57f4-456a-8cb7-5ab3baee4033 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:30.199699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:30.200169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-73c1c004-57f4-456a-8cb7-5ab3baee4033 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:30.200993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:30.207454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.208217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.208715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.209428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.209764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73c1c004-57f4-456a-8cb7-5ab3baee4033 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.209940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.210429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73c1c004-57f4-456a-8cb7-5ab3baee4033 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.210852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.210992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73c1c004-57f4-456a-8cb7-5ab3baee4033 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.211839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73c1c004-57f4-456a-8cb7-5ab3baee4033 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.212563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73c1c004-57f4-456a-8cb7-5ab3baee4033 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.213062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73c1c004-57f4-456a-8cb7-5ab3baee4033 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.227679 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e HTTP/1.1 Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e'} Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:30.229493 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. Oct 05 17:44:30.234160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.234160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:30.234160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.234160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.234160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:30.234160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:30.234160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:30.234160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:30.234160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. Oct 05 17:44:30.234160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.235882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:30.236834 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-70ac853e-d719-48ee-828a-22254ffabd8c tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 404 len: 111 microversion: 2.1 time: 0.041197 Oct 05 17:44:30.237629 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1566/2927] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:30 2022] DELETE /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:30.243047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b82a444-89a7-482b-931b-68a92e3e1763 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:30.243685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b82a444-89a7-482b-931b-68a92e3e1763 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:30.250217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b82a444-89a7-482b-931b-68a92e3e1763 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.250745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b82a444-89a7-482b-931b-68a92e3e1763 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.251231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b82a444-89a7-482b-931b-68a92e3e1763 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.252192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b82a444-89a7-482b-931b-68a92e3e1763 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.252681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b82a444-89a7-482b-931b-68a92e3e1763 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.253209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b82a444-89a7-482b-931b-68a92e3e1763 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.456080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=16 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:30.467479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-73c1c004-57f4-456a-8cb7-5ab3baee4033 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:30.475939 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-73c1c004-57f4-456a-8cb7-5ab3baee4033 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.280355 Oct 05 17:44:30.476690 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1362/2928] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:30 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:30.481495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:30.482353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] [instance: a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:30.488758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.490606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.492127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.493112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.493905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.494574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.513738 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] HTTP exception thrown: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Request method failure captured: Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e HTTP/1.1 Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcGBl6UuHxrRzR4QqbVApF4E6jbQmlyNtalanwI8U4WDW6utH9ZP1MasnmOmPtaZCeDJXKLNJEA9yaL20lnqVrtsKGZJtB-POPL614j1YuiCvGuyLX_VkeaNZ4TKJ6dUeWtTNjtG0FzI-rHPVHppas5JlLLELxybUPgyHeHQ-uh5yQs Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_47d5d4426b3d481b92b84c307cd00ead", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/47d5d4426b3d481b92b84c307cd00ead"}]}] Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 47d5d4426b3d481b92b84c307cd00ead Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesTestJSON-648939396 Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6720411ae8fc46a5bcd7b8f6d95c24a8 Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesTestJSON-648939396-project Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e'} Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.514753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:30.521725 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:30.521725 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:30.521725 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:30.521725 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:30.521725 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. Oct 05 17:44:30.521725 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:30.521725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] Returning 404 to user: Instance a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:30.521725 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4d9ce892-fef2-40ff-8f11-5cba265ffdbb tempest-ImagesTestJSON-648939396 tempest-ImagesTestJSON-648939396-project] 10.222.0.70 "GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e" status: 404 len: 111 microversion: 2.1 time: 0.038309 Oct 05 17:44:30.522522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b82a444-89a7-482b-931b-68a92e3e1763 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:30.522636 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1363/2929] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:30 2022] GET /compute/v2.1/servers/a52ed0d6-b66b-46ba-96f4-d383bbb5aa5e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:30.528075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e536f218-26d1-4a9e-9204-429c0b812f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:30.528766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e536f218-26d1-4a9e-9204-429c0b812f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:30.530113 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b82a444-89a7-482b-931b-68a92e3e1763 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.289794 Oct 05 17:44:30.530882 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1567/2930] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:30 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:30.550764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:30.553385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e536f218-26d1-4a9e-9204-429c0b812f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.554011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e536f218-26d1-4a9e-9204-429c0b812f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.554769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e536f218-26d1-4a9e-9204-429c0b812f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.555710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e536f218-26d1-4a9e-9204-429c0b812f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.556565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e536f218-26d1-4a9e-9204-429c0b812f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.557175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e536f218-26d1-4a9e-9204-429c0b812f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.734540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e536f218-26d1-4a9e-9204-429c0b812f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:30.744315 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e536f218-26d1-4a9e-9204-429c0b812f88 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.221762 Oct 05 17:44:30.744889 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1364/2931] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:30 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:30.781333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4239ca8a-f1e5-4fca-96d9-953a3ec42d61 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:30.782986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4239ca8a-f1e5-4fca-96d9-953a3ec42d61 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:30.788943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=14 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:30.790900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4239ca8a-f1e5-4fca-96d9-953a3ec42d61 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.791620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4239ca8a-f1e5-4fca-96d9-953a3ec42d61 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.792233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4239ca8a-f1e5-4fca-96d9-953a3ec42d61 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.793121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4239ca8a-f1e5-4fca-96d9-953a3ec42d61 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:30.793829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4239ca8a-f1e5-4fca-96d9-953a3ec42d61 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:30.794617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4239ca8a-f1e5-4fca-96d9-953a3ec42d61 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:30.824960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-274402736", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "43b14ad7-066f-4366-a6d9-9f817db2441a"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:30.889674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] validate_networks() for [('43b14ad7-066f-4366-a6d9-9f817db2441a', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:44:31.590778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4239ca8a-f1e5-4fca-96d9-953a3ec42d61 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:31.597129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:44:31.597559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:44:31.598040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:44:31.598675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:44:31.599344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:44:31.607083 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4239ca8a-f1e5-4fca-96d9-953a3ec42d61 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1328 microversion: 2.1 time: 0.829909 Oct 05 17:44:31.607909 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1568/2932] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:30 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1328 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:31.613473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-abc1d27b-973a-4d59-98bd-e15948b5d4fc tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:31.614435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-abc1d27b-973a-4d59-98bd-e15948b5d4fc tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:31.616872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:31.617312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:31.617758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:31.618513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:31.619136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:31.620006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:31.639696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:44:31.643257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abc1d27b-973a-4d59-98bd-e15948b5d4fc tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:31.644579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abc1d27b-973a-4d59-98bd-e15948b5d4fc tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:31.644868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Getting quotas for user 1c5f58a618c04b09815dea8f54504c7c and project 4d8ec67d827143b3a09b519cb4af417e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:44:31.645232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abc1d27b-973a-4d59-98bd-e15948b5d4fc tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:31.648227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abc1d27b-973a-4d59-98bd-e15948b5d4fc tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:31.648866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abc1d27b-973a-4d59-98bd-e15948b5d4fc tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:31.649301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abc1d27b-973a-4d59-98bd-e15948b5d4fc tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:31.659382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:44:31.662234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:44:31.720959 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b1524ce5-8d2a-458e-aca0-15719db8d359 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900369 Oct 05 17:44:31.722514 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1365/2933] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:44:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 17:44:31.728055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-498adffb-3d13-4703-9c29-89d5710694fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:31.729928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-498adffb-3d13-4703-9c29-89d5710694fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:31.737997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498adffb-3d13-4703-9c29-89d5710694fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:31.738687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498adffb-3d13-4703-9c29-89d5710694fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:31.739303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498adffb-3d13-4703-9c29-89d5710694fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:31.740140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498adffb-3d13-4703-9c29-89d5710694fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:31.740606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498adffb-3d13-4703-9c29-89d5710694fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:31.741240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498adffb-3d13-4703-9c29-89d5710694fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:32.027310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-498adffb-3d13-4703-9c29-89d5710694fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:32.047211 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-498adffb-3d13-4703-9c29-89d5710694fb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1503 microversion: 2.1 time: 0.322123 Oct 05 17:44:32.050426 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1366/2934] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:31 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1503 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:32.060566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-359f9145-cf09-4917-aa7a-0590f1a504ac tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:32.066592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-359f9145-cf09-4917-aa7a-0590f1a504ac tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:32.084332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-359f9145-cf09-4917-aa7a-0590f1a504ac tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:32.084898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-359f9145-cf09-4917-aa7a-0590f1a504ac tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:32.087913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-359f9145-cf09-4917-aa7a-0590f1a504ac tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:32.088595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-359f9145-cf09-4917-aa7a-0590f1a504ac tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:32.092585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-359f9145-cf09-4917-aa7a-0590f1a504ac tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:32.093299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-359f9145-cf09-4917-aa7a-0590f1a504ac tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:32.250469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-abc1d27b-973a-4d59-98bd-e15948b5d4fc tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe8df861068f404e90034c993f9e0e45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '611cddc6ef94407dba177aea44f5268d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:32.263142 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-abc1d27b-973a-4d59-98bd-e15948b5d4fc tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 200 len: 1527 microversion: 2.1 time: 0.653943 Oct 05 17:44:32.264345 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1569/2935] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:31 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 1527 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:32.268728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-18aeda64-3e10-462a-a61e-39bb6dfa83cf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:32.269364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-18aeda64-3e10-462a-a61e-39bb6dfa83cf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:32.407130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-18aeda64-3e10-462a-a61e-39bb6dfa83cf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:32.414516 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-18aeda64-3e10-462a-a61e-39bb6dfa83cf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1214 microversion: 2.1 time: 0.149323 Oct 05 17:44:32.435139 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1570/2936] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:32 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1214 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:32.440511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6f4d9724-de9a-4020-9a72-4f1de2e7c711 req-b36d946f-0f73-4b23-a74a-e52cc861b264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca1a4b8-636b-4137-a397-910fb7d8f449", "name": "network-vif-deleted", "tag": "508b694b-0b99-4f03-a3ab-9a6db4aebbbe"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:32.466636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6f4d9724-de9a-4020-9a72-4f1de2e7c711 req-b36d946f-0f73-4b23-a74a-e52cc861b264 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:32.467108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6f4d9724-de9a-4020-9a72-4f1de2e7c711 req-b36d946f-0f73-4b23-a74a-e52cc861b264 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:32.467556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6f4d9724-de9a-4020-9a72-4f1de2e7c711 req-b36d946f-0f73-4b23-a74a-e52cc861b264 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:32.483553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-359f9145-cf09-4917-aa7a-0590f1a504ac tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:32.496211 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-359f9145-cf09-4917-aa7a-0590f1a504ac tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.443068 Oct 05 17:44:32.497514 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6f4d9724-de9a-4020-9a72-4f1de2e7c711 req-b36d946f-0f73-4b23-a74a-e52cc861b264 service nova] Creating event network-vif-deleted:508b694b-0b99-4f03-a3ab-9a6db4aebbbe for instance dca1a4b8-636b-4137-a397-910fb7d8f449 on n-h2-835595-3 Oct 05 17:44:32.512186 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6f4d9724-de9a-4020-9a72-4f1de2e7c711 req-b36d946f-0f73-4b23-a74a-e52cc861b264 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075375 Oct 05 17:44:32.513120 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1571/2937] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:32.520495 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1367/2938] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:32 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:32.634451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6aa8c73d-0d2c-4a20-b380-553b591fee44 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:32.635832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6aa8c73d-0d2c-4a20-b380-553b591fee44 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:32.654651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa8c73d-0d2c-4a20-b380-553b591fee44 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:32.655369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa8c73d-0d2c-4a20-b380-553b591fee44 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:32.655978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa8c73d-0d2c-4a20-b380-553b591fee44 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:32.656961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa8c73d-0d2c-4a20-b380-553b591fee44 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:32.657597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa8c73d-0d2c-4a20-b380-553b591fee44 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:32.658186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa8c73d-0d2c-4a20-b380-553b591fee44 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:32.972840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6aa8c73d-0d2c-4a20-b380-553b591fee44 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:32.984734 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6aa8c73d-0d2c-4a20-b380-553b591fee44 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1328 microversion: 2.1 time: 0.354204 Oct 05 17:44:32.986640 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1572/2939] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:32 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1328 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:33.075934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00e13cdc-8a25-4aa4-9330-a9da565b0c62 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:33.076543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00e13cdc-8a25-4aa4-9330-a9da565b0c62 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:33.086747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e13cdc-8a25-4aa4-9330-a9da565b0c62 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.087242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e13cdc-8a25-4aa4-9330-a9da565b0c62 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.087686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e13cdc-8a25-4aa4-9330-a9da565b0c62 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.089273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e13cdc-8a25-4aa4-9330-a9da565b0c62 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.089903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e13cdc-8a25-4aa4-9330-a9da565b0c62 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.090873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e13cdc-8a25-4aa4-9330-a9da565b0c62 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.296191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:33.301086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: dca1a4b8-636b-4137-a397-910fb7d8f449] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:33.318074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.322023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.323597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.324977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.327201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.328898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.350404 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Instance dca1a4b8-636b-4137-a397-910fb7d8f449 could not be found. Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 HTTP/1.1 Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance dca1a4b8-636b-4137-a397-910fb7d8f449 could not be found. Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'dca1a4b8-636b-4137-a397-910fb7d8f449'} Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca1a4b8-636b-4137-a397-910fb7d8f449 could not be found. Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca1a4b8-636b-4137-a397-910fb7d8f449 could not be found. Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.352651 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:33.356605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.356605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.356605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:33.356605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:33.356605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:33.356605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:33.356605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca1a4b8-636b-4137-a397-910fb7d8f449 could not be found. Oct 05 17:44:33.356605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.359424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 404 to user: Instance dca1a4b8-636b-4137-a397-910fb7d8f449 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:33.360532 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27225086-9b64-43ef-bb24-0a36d594e074 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449" status: 404 len: 111 microversion: 2.1 time: 0.075194 Oct 05 17:44:33.361317 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1573/2940] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:33 2022] GET /compute/v2.1/servers/dca1a4b8-636b-4137-a397-910fb7d8f449 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:44:33.373941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c135276-d9a5-4cdf-be59-d3fad418682a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '.version_select at 0x7f777464da60>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:33.380693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-00e13cdc-8a25-4aa4-9330-a9da565b0c62 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:33.383317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:33.409460 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5c135276-d9a5-4cdf-be59-d3fad418682a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Image not found. Oct 05 17:44:33.410074 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00e13cdc-8a25-4aa4-9330-a9da565b0c62 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1503 microversion: 2.1 time: 0.339169 Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c135276-d9a5-4cdf-be59-d3fad418682a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/images/4075fcdd-ac6b-4626-81cb-013ca7fb48d6 HTTP/1.1 Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4075fcdd-ac6b-4626-81cb-013ca7fb48d6'} Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4075fcdd-ac6b-4626-81cb-013ca7fb48d6 to delete Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4075fcdd-ac6b-4626-81cb-013ca7fb48d6 could not be found. Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:33.412268 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c135276-d9a5-4cdf-be59-d3fad418682a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c135276-d9a5-4cdf-be59-d3fad418682a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "DELETE /compute/v2.1/images/4075fcdd-ac6b-4626-81cb-013ca7fb48d6" status: 404 len: 62 microversion: 2.1 time: 0.048206 Oct 05 17:44:33.416380 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1574/2941] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:33 2022] DELETE /compute/v2.1/images/4075fcdd-ac6b-4626-81cb-013ca7fb48d6 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:44:33.423995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:33.425721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:33.433628 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1368/2942] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:33 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:33.445689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.449524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.450272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.451457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.452347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.453138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.463925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f5c3308-aae6-4ccc-8bd6-ce0b915733ce tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:33.468554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9f5c3308-aae6-4ccc-8bd6-ce0b915733ce tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:33.469968 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 HTTP/1.1 Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '528b4233-a9d9-4f97-94d8-c4b52c793f09'} Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:33.472304 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:33.477119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.479824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f5c3308-aae6-4ccc-8bd6-ce0b915733ce tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.480415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 404 to user: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:33.481572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f5c3308-aae6-4ccc-8bd6-ce0b915733ce tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.481774 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3de9b92d-e258-495e-862a-945db373df70 tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "DELETE /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 404 len: 111 microversion: 2.1 time: 0.061789 Oct 05 17:44:33.482016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f5c3308-aae6-4ccc-8bd6-ce0b915733ce tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.482810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f5c3308-aae6-4ccc-8bd6-ce0b915733ce tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.485998 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1575/2943] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:33 2022] DELETE /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:44:33.492824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:33.494542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 528b4233-a9d9-4f97-94d8-c4b52c793f09] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:33.500852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f5c3308-aae6-4ccc-8bd6-ce0b915733ce tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.501920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.502511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.503148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.503969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.504630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.505281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.508784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f5c3308-aae6-4ccc-8bd6-ce0b915733ce tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.537103 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 HTTP/1.1 Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '528b4233-a9d9-4f97-94d8-c4b52c793f09'} Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.538809 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 404 to user: Instance 528b4233-a9d9-4f97-94d8-c4b52c793f09 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c4e47afb-b5b8-44e5-8024-b07320ecedcd tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09" status: 404 len: 111 microversion: 2.1 time: 0.052998 Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1576/2944] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:33 2022] GET /compute/v2.1/servers/528b4233-a9d9-4f97-94d8-c4b52c793f09 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:33.547557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88e1e6e3-ffe9-49c3-9bca-203d96d94ebe tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:33.549098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88e1e6e3-ffe9-49c3-9bca-203d96d94ebe tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:33.564438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88e1e6e3-ffe9-49c3-9bca-203d96d94ebe tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.564975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88e1e6e3-ffe9-49c3-9bca-203d96d94ebe tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.565415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88e1e6e3-ffe9-49c3-9bca-203d96d94ebe tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.566135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88e1e6e3-ffe9-49c3-9bca-203d96d94ebe tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:33.568191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88e1e6e3-ffe9-49c3-9bca-203d96d94ebe tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:33.568640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88e1e6e3-ffe9-49c3-9bca-203d96d94ebe tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:33.620767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f5c3308-aae6-4ccc-8bd6-ce0b915733ce tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:33.631021 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9f5c3308-aae6-4ccc-8bd6-ce0b915733ce tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1266 microversion: 2.1 time: 0.178498 Oct 05 17:44:33.633505 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1369/2945] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:33 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:33.651288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4e46587-bcdf-4373-b5c2-5c253ab6824d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '.version_select at 0x7f77749f49d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:33.697826 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e4e46587-bcdf-4373-b5c2-5c253ab6824d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-840756743" status: 202 len: 0 microversion: 2.1 time: 0.062098 Oct 05 17:44:33.700819 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1370/2946] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 17:44:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-840756743 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:44:34.013628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6092abec-d342-4c49-a9d0-81ba4af24155 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:34.014517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6092abec-d342-4c49-a9d0-81ba4af24155 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:34.021279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6092abec-d342-4c49-a9d0-81ba4af24155 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:34.021948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6092abec-d342-4c49-a9d0-81ba4af24155 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:34.022661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6092abec-d342-4c49-a9d0-81ba4af24155 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:34.023678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6092abec-d342-4c49-a9d0-81ba4af24155 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:34.024364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6092abec-d342-4c49-a9d0-81ba4af24155 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:34.025217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6092abec-d342-4c49-a9d0-81ba4af24155 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:34.171927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88e1e6e3-ffe9-49c3-9bca-203d96d94ebe tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:34.182465 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88e1e6e3-ffe9-49c3-9bca-203d96d94ebe tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.639799 Oct 05 17:44:34.198344 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1577/2947] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:33 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:34.287071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6092abec-d342-4c49-a9d0-81ba4af24155 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:34.313687 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6092abec-d342-4c49-a9d0-81ba4af24155 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1328 microversion: 2.1 time: 0.304061 Oct 05 17:44:34.319063 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1371/2948] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:34 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1328 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:34.444070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-acbcf037-0738-4756-b0ec-47d6109c6fb7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:34.445351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-acbcf037-0738-4756-b0ec-47d6109c6fb7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:34.454818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acbcf037-0738-4756-b0ec-47d6109c6fb7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:34.456093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acbcf037-0738-4756-b0ec-47d6109c6fb7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:34.456748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acbcf037-0738-4756-b0ec-47d6109c6fb7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:34.458265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acbcf037-0738-4756-b0ec-47d6109c6fb7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:34.458981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acbcf037-0738-4756-b0ec-47d6109c6fb7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:34.459617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acbcf037-0738-4756-b0ec-47d6109c6fb7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:34.663023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e23f34a5-9056-4816-9893-d3d8e8d0488f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:34.665534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e23f34a5-9056-4816-9893-d3d8e8d0488f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:34.682666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e23f34a5-9056-4816-9893-d3d8e8d0488f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:34.683429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e23f34a5-9056-4816-9893-d3d8e8d0488f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:34.684139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e23f34a5-9056-4816-9893-d3d8e8d0488f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:34.685038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e23f34a5-9056-4816-9893-d3d8e8d0488f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:34.696238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e23f34a5-9056-4816-9893-d3d8e8d0488f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:34.701219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e23f34a5-9056-4816-9893-d3d8e8d0488f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:34.824072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e23f34a5-9056-4816-9893-d3d8e8d0488f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:34.836385 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e23f34a5-9056-4816-9893-d3d8e8d0488f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1272 microversion: 2.1 time: 0.182063 Oct 05 17:44:34.852495 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1372/2949] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:34 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:35.126628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-acbcf037-0738-4756-b0ec-47d6109c6fb7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:35.156782 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-acbcf037-0738-4756-b0ec-47d6109c6fb7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1478 microversion: 2.1 time: 0.718432 Oct 05 17:44:35.157385 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1578/2950] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:34 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1478 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:35.179449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8aa3db08-77a3-4c5e-90cc-93b1c264af9f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '.version_select at 0x7f7774d6ea60>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:35.186081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aa3db08-77a3-4c5e-90cc-93b1c264af9f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:35.187802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aa3db08-77a3-4c5e-90cc-93b1c264af9f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:35.189139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aa3db08-77a3-4c5e-90cc-93b1c264af9f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:35.206846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c481ba83-065f-471b-a037-34102161ed2e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:35.207687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c481ba83-065f-471b-a037-34102161ed2e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:35.213378 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8aa3db08-77a3-4c5e-90cc-93b1c264af9f tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.035831 Oct 05 17:44:35.215532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c481ba83-065f-471b-a037-34102161ed2e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:35.219073 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1373/2951] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:44:35 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:35.219893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c481ba83-065f-471b-a037-34102161ed2e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:35.222050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c481ba83-065f-471b-a037-34102161ed2e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:35.223027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c481ba83-065f-471b-a037-34102161ed2e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:35.226086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c481ba83-065f-471b-a037-34102161ed2e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:35.227126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c481ba83-065f-471b-a037-34102161ed2e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:35.233435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c457923-45e4-4a1d-8c34-51bbf98f349d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:35.235141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0c457923-45e4-4a1d-8c34-51bbf98f349d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:35.247949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:35.249164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c457923-45e4-4a1d-8c34-51bbf98f349d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:35.249921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c457923-45e4-4a1d-8c34-51bbf98f349d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:35.250744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c457923-45e4-4a1d-8c34-51bbf98f349d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:35.251799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c457923-45e4-4a1d-8c34-51bbf98f349d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:35.253092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c457923-45e4-4a1d-8c34-51bbf98f349d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:35.253918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c457923-45e4-4a1d-8c34-51bbf98f349d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:35.655037 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c457923-45e4-4a1d-8c34-51bbf98f349d tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1629 microversion: 2.1 time: 0.426577 Oct 05 17:44:35.670308 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1374/2952] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:35 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1629 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:35.678522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-86a3f8f9-0881-4565-9c4a-bc55b79deffa tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:35.678522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-86a3f8f9-0881-4565-9c4a-bc55b79deffa tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:35.699094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a3f8f9-0881-4565-9c4a-bc55b79deffa tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:35.699442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a3f8f9-0881-4565-9c4a-bc55b79deffa tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:35.699772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a3f8f9-0881-4565-9c4a-bc55b79deffa tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:35.706164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a3f8f9-0881-4565-9c4a-bc55b79deffa tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:35.708237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a3f8f9-0881-4565-9c4a-bc55b79deffa tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:35.708905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a3f8f9-0881-4565-9c4a-bc55b79deffa tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:35.802985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c481ba83-065f-471b-a037-34102161ed2e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:35.814837 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c481ba83-065f-471b-a037-34102161ed2e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.610118 Oct 05 17:44:35.832268 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1579/2953] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:35 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:35.842574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1604ecbd-4683-468d-9936-cd748ed801ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '.version_select at 0x7f777478fee0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:35.885318 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-1604ecbd-4683-468d-9936-cd748ed801ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Image not found. Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1604ecbd-4683-468d-9936-cd748ed801ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/images/28e2fe85-644b-46e2-b7fb-4d2f4a74fe73 HTTP/1.1 Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: exception: Image not found. Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '28e2fe85-644b-46e2-b7fb-4d2f4a74fe73'} Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 28e2fe85-644b-46e2-b7fb-4d2f4a74fe73 to delete Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28e2fe85-644b-46e2-b7fb-4d2f4a74fe73 could not be found. Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:35.890745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:44:35.894973 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:35.899442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1604ecbd-4683-468d-9936-cd748ed801ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 404 to user: Image not found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:35.901245 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1604ecbd-4683-468d-9936-cd748ed801ce tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "DELETE /compute/v2.1/images/28e2fe85-644b-46e2-b7fb-4d2f4a74fe73" status: 404 len: 62 microversion: 2.1 time: 0.064717 Oct 05 17:44:35.902721 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1580/2954] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:35 2022] DELETE /compute/v2.1/images/28e2fe85-644b-46e2-b7fb-4d2f4a74fe73 => generated 62 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:44:35.908879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8315c655-6036-4efc-8092-144f48b6dfd7 req-18219f7f-3f69-4948-9fa5-381a3431c709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef", "name": "network-vif-plugged", "status": "completed", "tag": "fb997ddb-6c4a-40a4-be79-949940675ee9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:35.923341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8315c655-6036-4efc-8092-144f48b6dfd7 req-18219f7f-3f69-4948-9fa5-381a3431c709 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:35.924214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8315c655-6036-4efc-8092-144f48b6dfd7 req-18219f7f-3f69-4948-9fa5-381a3431c709 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:35.924947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8315c655-6036-4efc-8092-144f48b6dfd7 req-18219f7f-3f69-4948-9fa5-381a3431c709 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:35.943548 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8315c655-6036-4efc-8092-144f48b6dfd7 req-18219f7f-3f69-4948-9fa5-381a3431c709 service nova] Creating event network-vif-plugged:fb997ddb-6c4a-40a4-be79-949940675ee9 for instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef on n-h2-835595-3 Oct 05 17:44:35.949324 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8315c655-6036-4efc-8092-144f48b6dfd7 req-18219f7f-3f69-4948-9fa5-381a3431c709 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044847 Oct 05 17:44:35.950540 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1581/2955] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:35.968625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d3e9ad56-2b5f-4e9b-bf96-b0fbcfef8957 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Action: 'create', calling method: .version_select at 0x7f77747cfd30>, body: {"keypair": {"name": "tempest-keypair-1882207205", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7u8ihdAvqmtU/rKs4FufzSNegfXpgWdgGkXDmQIZqi7+plGQ2b4JB41l6T9AtEpDWF24uAc43v2/hLFE9OF3CRyGhqnKHKria/31ASNJL/6zlIs0JUV3HX0pjgXms+jw=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:35.988581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:35.998188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-d3e9ad56-2b5f-4e9b-bf96-b0fbcfef8957 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Getting quotas for project f401d1367a73495598bb8a6b882e8618. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:44:36.006793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-d3e9ad56-2b5f-4e9b-bf96-b0fbcfef8957 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Getting quotas for user 695a37f439e94d2e860e51df835827e4 and project f401d1367a73495598bb8a6b882e8618. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:44:36.054338 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d3e9ad56-2b5f-4e9b-bf96-b0fbcfef8957 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.091632 Oct 05 17:44:36.056853 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1582/2956] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:44:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:36.073221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-939e4c4f-69ce-4904-8503-ab2a94350ad3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:36.075243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-939e4c4f-69ce-4904-8503-ab2a94350ad3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:36.095852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939e4c4f-69ce-4904-8503-ab2a94350ad3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:36.096363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939e4c4f-69ce-4904-8503-ab2a94350ad3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:36.101732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939e4c4f-69ce-4904-8503-ab2a94350ad3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:36.102884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939e4c4f-69ce-4904-8503-ab2a94350ad3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:36.103539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939e4c4f-69ce-4904-8503-ab2a94350ad3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:36.104311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939e4c4f-69ce-4904-8503-ab2a94350ad3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:36.127938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86a3f8f9-0881-4565-9c4a-bc55b79deffa tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:36.144929 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-86a3f8f9-0881-4565-9c4a-bc55b79deffa tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1328 microversion: 2.1 time: 0.478275 Oct 05 17:44:36.146188 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1375/2957] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:35 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1328 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:36.156660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:36.160822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:36.174575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:36.175173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:36.176009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:36.176955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:36.178110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:36.179805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:36.207184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 HTTP/1.1 Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '05e13165-324b-4dbf-b095-9d7629b0f570'} Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:36.224333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 404 to user: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-902a2416-c98b-4bec-b96c-65e54921319a tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "DELETE /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 404 len: 111 microversion: 2.1 time: 0.079112 Oct 05 17:44:36.229230 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1376/2958] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:36 2022] DELETE /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:36.235104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:36.235718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] [instance: 05e13165-324b-4dbf-b095-9d7629b0f570] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:36.242392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:36.242913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:36.243366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:36.244072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:36.244535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:36.244970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:36.261362 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] HTTP exception thrown: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Request method failure captured: Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 HTTP/1.1 Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcICYGryNZF67pGkEpD_GM97U4ICSNsUzgYqtW7k7auiZhIcx5jrYTVHoRFBtE3Xx8rgGdGPrhoaUOzKrQxnHyViShUoXALJ_9mPM83GMpEBeoLaK4nlSLTYn_ZpDobN5SZV7PEormEqoYzKFa23lh_MY_L7l4i5FVdaZE2ux7QXrW8 Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_611cddc6ef94407dba177aea44f5268d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/611cddc6ef94407dba177aea44f5268d"}]}] Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 611cddc6ef94407dba177aea44f5268d Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-672564038 Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: fe8df861068f404e90034c993f9e0e45 Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-672564038-project Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '05e13165-324b-4dbf-b095-9d7629b0f570'} Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:36.263152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] Returning 404 to user: Instance 05e13165-324b-4dbf-b095-9d7629b0f570 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-93a7eb58-eccd-429f-aad4-2ed10550648d tempest-ImagesOneServerNegativeTestJSON-672564038 tempest-ImagesOneServerNegativeTestJSON-672564038-project] 10.222.0.70 "GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570" status: 404 len: 111 microversion: 2.1 time: 0.033233 Oct 05 17:44:36.268874 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1377/2959] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:36 2022] GET /compute/v2.1/servers/05e13165-324b-4dbf-b095-9d7629b0f570 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:44:36.753013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-939e4c4f-69ce-4904-8503-ab2a94350ad3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:36.763763 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-939e4c4f-69ce-4904-8503-ab2a94350ad3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1314 microversion: 2.1 time: 0.705638 Oct 05 17:44:36.764545 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1583/2960] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:36 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1314 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:36.850356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bc7c1c23-25b3-407e-9542-3d360e58224e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:36.851701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bc7c1c23-25b3-407e-9542-3d360e58224e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:36.866697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc7c1c23-25b3-407e-9542-3d360e58224e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:36.868337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc7c1c23-25b3-407e-9542-3d360e58224e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:36.870093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc7c1c23-25b3-407e-9542-3d360e58224e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:36.870980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc7c1c23-25b3-407e-9542-3d360e58224e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:36.872092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc7c1c23-25b3-407e-9542-3d360e58224e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:36.872715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc7c1c23-25b3-407e-9542-3d360e58224e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:37.170615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e58d0122-fbf6-42ad-8e93-d5c06339832b tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:37.171513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e58d0122-fbf6-42ad-8e93-d5c06339832b tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:37.181452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e58d0122-fbf6-42ad-8e93-d5c06339832b tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:37.182390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e58d0122-fbf6-42ad-8e93-d5c06339832b tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:37.183078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e58d0122-fbf6-42ad-8e93-d5c06339832b tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:37.185578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e58d0122-fbf6-42ad-8e93-d5c06339832b tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:37.186502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e58d0122-fbf6-42ad-8e93-d5c06339832b tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:37.187161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e58d0122-fbf6-42ad-8e93-d5c06339832b tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:37.269812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bc7c1c23-25b3-407e-9542-3d360e58224e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:37.289618 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bc7c1c23-25b3-407e-9542-3d360e58224e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.450155 Oct 05 17:44:37.305561 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1378/2961] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:36 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:37.799886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c99323b-9331-4ce6-95c1-0de8320ec3a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:37.800513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0c99323b-9331-4ce6-95c1-0de8320ec3a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:37.809557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c99323b-9331-4ce6-95c1-0de8320ec3a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:37.810051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c99323b-9331-4ce6-95c1-0de8320ec3a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:37.810517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c99323b-9331-4ce6-95c1-0de8320ec3a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:37.811220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c99323b-9331-4ce6-95c1-0de8320ec3a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:37.811668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c99323b-9331-4ce6-95c1-0de8320ec3a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:37.812084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c99323b-9331-4ce6-95c1-0de8320ec3a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:37.876471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e58d0122-fbf6-42ad-8e93-d5c06339832b tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:37.888881 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e58d0122-fbf6-42ad-8e93-d5c06339832b tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1328 microversion: 2.1 time: 0.723434 Oct 05 17:44:37.889736 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1584/2962] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:37 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1328 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:38.170217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0c99323b-9331-4ce6-95c1-0de8320ec3a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:38.178223 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c99323b-9331-4ce6-95c1-0de8320ec3a8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1314 microversion: 2.1 time: 0.382214 Oct 05 17:44:38.178846 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1379/2963] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:37 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:38.315026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-db4bd50e-b91c-41b3-892c-e1e747854224 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:38.316475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-db4bd50e-b91c-41b3-892c-e1e747854224 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:38.324809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1ca944af-fb29-4068-a95b-a925d31287a6 req-811e73a0-980c-439b-86ee-578bb7e97bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d64aabce-b60d-42c0-881b-43aa1880709b", "tag": "ca151148-f4dd-4fec-afc0-c8cb86c25709"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:38.325738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4bd50e-b91c-41b3-892c-e1e747854224 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:38.326992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4bd50e-b91c-41b3-892c-e1e747854224 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:38.327564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4bd50e-b91c-41b3-892c-e1e747854224 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:38.329947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4bd50e-b91c-41b3-892c-e1e747854224 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:38.330710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4bd50e-b91c-41b3-892c-e1e747854224 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:38.332274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4bd50e-b91c-41b3-892c-e1e747854224 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:38.352572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1ca944af-fb29-4068-a95b-a925d31287a6 req-811e73a0-980c-439b-86ee-578bb7e97bcc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:38.353060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1ca944af-fb29-4068-a95b-a925d31287a6 req-811e73a0-980c-439b-86ee-578bb7e97bcc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:38.353495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1ca944af-fb29-4068-a95b-a925d31287a6 req-811e73a0-980c-439b-86ee-578bb7e97bcc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:38.365292 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1ca944af-fb29-4068-a95b-a925d31287a6 req-811e73a0-980c-439b-86ee-578bb7e97bcc service nova] Creating event network-changed:ca151148-f4dd-4fec-afc0-c8cb86c25709 for instance d64aabce-b60d-42c0-881b-43aa1880709b on n-h1-835595-3 Oct 05 17:44:38.371054 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1ca944af-fb29-4068-a95b-a925d31287a6 req-811e73a0-980c-439b-86ee-578bb7e97bcc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050388 Oct 05 17:44:38.372098 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1380/2964] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:44:38.702927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-db4bd50e-b91c-41b3-892c-e1e747854224 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:38.721032 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-db4bd50e-b91c-41b3-892c-e1e747854224 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.408201 Oct 05 17:44:38.722576 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1585/2965] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:38 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:38.935688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-413de4b4-4472-49ad-bb03-bf2930d853d7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:38.938136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-413de4b4-4472-49ad-bb03-bf2930d853d7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:38.954143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-413de4b4-4472-49ad-bb03-bf2930d853d7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:38.955992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-413de4b4-4472-49ad-bb03-bf2930d853d7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:38.956912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-413de4b4-4472-49ad-bb03-bf2930d853d7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:38.958854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-413de4b4-4472-49ad-bb03-bf2930d853d7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:38.959281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-413de4b4-4472-49ad-bb03-bf2930d853d7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:38.961792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-413de4b4-4472-49ad-bb03-bf2930d853d7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:39.209173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-355e8b5d-7b3c-4e39-8251-a979f1be003a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:39.212828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-355e8b5d-7b3c-4e39-8251-a979f1be003a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:39.236814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-355e8b5d-7b3c-4e39-8251-a979f1be003a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:39.238025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-355e8b5d-7b3c-4e39-8251-a979f1be003a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:39.239388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-355e8b5d-7b3c-4e39-8251-a979f1be003a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:39.240382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-355e8b5d-7b3c-4e39-8251-a979f1be003a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:39.240952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-355e8b5d-7b3c-4e39-8251-a979f1be003a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:39.243565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-355e8b5d-7b3c-4e39-8251-a979f1be003a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:39.294583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-413de4b4-4472-49ad-bb03-bf2930d853d7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:39.305439 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-413de4b4-4472-49ad-bb03-bf2930d853d7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1529 microversion: 2.1 time: 0.391549 Oct 05 17:44:39.322767 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1381/2966] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:38 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1529 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:39.342560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a225401f-1830-4dcd-bd11-304b5437230d tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:39.343868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a225401f-1830-4dcd-bd11-304b5437230d tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:39.352466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a225401f-1830-4dcd-bd11-304b5437230d tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:39.367242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a225401f-1830-4dcd-bd11-304b5437230d tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:39.368056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a225401f-1830-4dcd-bd11-304b5437230d tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:39.369030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a225401f-1830-4dcd-bd11-304b5437230d tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:39.369695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a225401f-1830-4dcd-bd11-304b5437230d tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:39.370382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a225401f-1830-4dcd-bd11-304b5437230d tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:39.675476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a225401f-1830-4dcd-bd11-304b5437230d tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:39.684250 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a225401f-1830-4dcd-bd11-304b5437230d tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1529 microversion: 2.1 time: 0.352906 Oct 05 17:44:39.684820 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1382/2967] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:39 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1529 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:39.985225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-355e8b5d-7b3c-4e39-8251-a979f1be003a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:40.002685 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-355e8b5d-7b3c-4e39-8251-a979f1be003a tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1314 microversion: 2.1 time: 0.802166 Oct 05 17:44:40.017097 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1586/2968] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:39 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:40.026218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:40.026886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:40.027492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3654b911-cc67-4d5f-a5e6-f983fdef9b49 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:40.028160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3654b911-cc67-4d5f-a5e6-f983fdef9b49 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:40.036696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.037515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.037685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3654b911-cc67-4d5f-a5e6-f983fdef9b49 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.038358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.039067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3654b911-cc67-4d5f-a5e6-f983fdef9b49 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.039527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.040376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3654b911-cc67-4d5f-a5e6-f983fdef9b49 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.041069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.041192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3654b911-cc67-4d5f-a5e6-f983fdef9b49 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.041946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3654b911-cc67-4d5f-a5e6-f983fdef9b49 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.043009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3654b911-cc67-4d5f-a5e6-f983fdef9b49 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.043266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.083358 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] HTTP exception thrown: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Request method failure captured: Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef HTTP/1.1 Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcJwGg8sav6XDtuDCULtvBScYGmmg-ysFig7Fzw0VKjXb0pLBaS0lbzM4duGFIpB5lbqDKVdJZwCu6w3-q1CBoKKykYhm-_gGMDhvnjxLAFIsxNjYFKng6X2QJDTQls7MH4r4We14_GmHkg6kkHH3wetaMF-P13k4Ta2JMhgtb4Lp6o Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 86960d363c9e44238bda46bb8c2e3ddb Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-153096739 Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/86960d363c9e44238bda46bb8c2e3ddb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/86960d363c9e44238bda46bb8c2e3ddb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_86960d363c9e44238bda46bb8c2e3ddb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/86960d363c9e44238bda46bb8c2e3ddb"}]}] Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-153096739 Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 86960d363c9e44238bda46bb8c2e3ddb Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-153096739 Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestMultiTenantJSON-153096739-project Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 200a5c5df7fc4b3aba1706771c49987a Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-153096739-project Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef'} Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:40.088169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:40.092330 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:40.094836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Returning 404 to user: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:40.095789 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2c41e4d3-aeb4-48b0-87f7-0c506f10590a tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] 10.222.0.70 "DELETE /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 404 len: 111 microversion: 2.1 time: 0.393248 Oct 05 17:44:40.096567 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1383/2969] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:39 2022] DELETE /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 111 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:44:40.107759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6841eb87-ba88-4b6d-beb5-d688f8bcba87 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:40.108491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6841eb87-ba88-4b6d-beb5-d688f8bcba87 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:40.117032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6841eb87-ba88-4b6d-beb5-d688f8bcba87 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.117667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6841eb87-ba88-4b6d-beb5-d688f8bcba87 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.118207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6841eb87-ba88-4b6d-beb5-d688f8bcba87 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.119080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6841eb87-ba88-4b6d-beb5-d688f8bcba87 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.119635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6841eb87-ba88-4b6d-beb5-d688f8bcba87 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.120156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6841eb87-ba88-4b6d-beb5-d688f8bcba87 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.407182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3654b911-cc67-4d5f-a5e6-f983fdef9b49 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:40.422080 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3654b911-cc67-4d5f-a5e6-f983fdef9b49 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1521 microversion: 2.1 time: 0.403527 Oct 05 17:44:40.423137 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1587/2970] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:40 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1521 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:40.435121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6841eb87-ba88-4b6d-beb5-d688f8bcba87 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:40.440230 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6841eb87-ba88-4b6d-beb5-d688f8bcba87 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1529 microversion: 2.1 time: 0.336609 Oct 05 17:44:40.441837 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1384/2971] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:40 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1529 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:40.467825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Action: 'update', calling method: >, body: {"server": {"name": "eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef_new"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:40.471182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:40.478690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.479452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.480141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.481042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.481811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.482824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.498071 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] HTTP exception thrown: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Request method failure captured: Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef HTTP/1.1 Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 64 Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcJwGg8sav6XDtuDCULtvBScYGmmg-ysFig7Fzw0VKjXb0pLBaS0lbzM4duGFIpB5lbqDKVdJZwCu6w3-q1CBoKKykYhm-_gGMDhvnjxLAFIsxNjYFKng6X2QJDTQls7MH4r4We14_GmHkg6kkHH3wetaMF-P13k4Ta2JMhgtb4Lp6o Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 86960d363c9e44238bda46bb8c2e3ddb Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-153096739 Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/86960d363c9e44238bda46bb8c2e3ddb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/86960d363c9e44238bda46bb8c2e3ddb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_86960d363c9e44238bda46bb8c2e3ddb", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/86960d363c9e44238bda46bb8c2e3ddb"}]}] Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-153096739 Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 86960d363c9e44238bda46bb8c2e3ddb Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-153096739 Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestMultiTenantJSON-153096739-project Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 200a5c5df7fc4b3aba1706771c49987a Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-153096739-project Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef_new"}} Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef', 'body': {'server': {'name': 'eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef_new'}}} Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:44:40.500193 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:44:40.504507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] Returning 404 to user: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:40.507232 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c79c82b-14ee-4ab5-8da3-e2137841a117 tempest-ServersNegativeTestMultiTenantJSON-153096739 tempest-ServersNegativeTestMultiTenantJSON-153096739-project] 10.222.0.70 "PUT /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 404 len: 111 microversion: 2.1 time: 0.042799 Oct 05 17:44:40.512924 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1588/2972] 10.222.0.70 () {60 vars in 1256 bytes} [Wed Oct 5 17:44:40 2022] PUT /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:40.520869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c28514c8-d599-4671-a00f-c6cb0d32faaf tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:40.521773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c28514c8-d599-4671-a00f-c6cb0d32faaf tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:40.529238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c28514c8-d599-4671-a00f-c6cb0d32faaf tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.530014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c28514c8-d599-4671-a00f-c6cb0d32faaf tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.530871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c28514c8-d599-4671-a00f-c6cb0d32faaf tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.531813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c28514c8-d599-4671-a00f-c6cb0d32faaf tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.532366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c28514c8-d599-4671-a00f-c6cb0d32faaf tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.533029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c28514c8-d599-4671-a00f-c6cb0d32faaf tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.579483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c28514c8-d599-4671-a00f-c6cb0d32faaf tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:44:40.621940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-261789044", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "0ccfc34d-2c65-4344-9114-4b96b3845d6a"}], "security_groups": [{"name": "tempest-securitygroup--766325950"}], "key_name": "tempest-keypair-1882207205", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:40.718095 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c28514c8-d599-4671-a00f-c6cb0d32faaf tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "DELETE /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 204 len: 0 microversion: 2.1 time: 0.203401 Oct 05 17:44:40.718714 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1385/2973] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:40 2022] DELETE /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:44:40.728993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-39769847-4793-4eb4-bbb7-01bf34a6902a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:40.729932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-39769847-4793-4eb4-bbb7-01bf34a6902a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:40.736811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39769847-4793-4eb4-bbb7-01bf34a6902a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.737519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39769847-4793-4eb4-bbb7-01bf34a6902a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.738148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39769847-4793-4eb4-bbb7-01bf34a6902a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:40.740092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39769847-4793-4eb4-bbb7-01bf34a6902a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:40.741142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39769847-4793-4eb4-bbb7-01bf34a6902a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:40.743394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39769847-4793-4eb4-bbb7-01bf34a6902a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:41.069678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-39769847-4793-4eb4-bbb7-01bf34a6902a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:41.079171 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-39769847-4793-4eb4-bbb7-01bf34a6902a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1535 microversion: 2.1 time: 0.355329 Oct 05 17:44:41.096127 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1386/2974] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:40 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1535 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:41.103165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23c84871-a227-41ac-9df5-7f7a58f57838 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:41.104043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23c84871-a227-41ac-9df5-7f7a58f57838 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:41.112165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23c84871-a227-41ac-9df5-7f7a58f57838 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:41.112848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23c84871-a227-41ac-9df5-7f7a58f57838 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:41.113463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23c84871-a227-41ac-9df5-7f7a58f57838 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:41.114780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23c84871-a227-41ac-9df5-7f7a58f57838 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:41.115394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23c84871-a227-41ac-9df5-7f7a58f57838 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:41.116205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23c84871-a227-41ac-9df5-7f7a58f57838 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:41.157497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] validate_networks() for [('0ccfc34d-2c65-4344-9114-4b96b3845d6a', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:44:41.344289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23c84871-a227-41ac-9df5-7f7a58f57838 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:41.361618 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23c84871-a227-41ac-9df5-7f7a58f57838 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1314 microversion: 2.1 time: 0.264102 Oct 05 17:44:41.362627 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1387/2975] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:41 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:41.559484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c03b2165-1bf3-4235-b038-19ffb74e3c74 tempest-ListImageFiltersNegativeTestJSON-895798484 tempest-ListImageFiltersNegativeTestJSON-895798484-project] Calling method '.version_select at 0x7f77749edf70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:41.589126 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c03b2165-1bf3-4235-b038-19ffb74e3c74 tempest-ListImageFiltersNegativeTestJSON-895798484 tempest-ListImageFiltersNegativeTestJSON-895798484-project] HTTP exception thrown: Image not found. Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c03b2165-1bf3-4235-b038-19ffb74e3c74 tempest-ListImageFiltersNegativeTestJSON-895798484 tempest-ListImageFiltersNegativeTestJSON-895798484-project] Request method failure captured: Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/images/9595b4e6-fa32-49d0-8eb2-168c4388f16c HTTP/1.1 Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcKJQlhMmiqLfAQ62qSju1YnrDqbduy_LUIX0NBuLYvA80KiYTH4gmmbBj2RKbNmNyBruREvuoOCCO24Lw6h6uh7Hm5SeOiTFG0tJcKgVsWpzgwnVqK4r_hoW6zgSYoellJLIRJyy2FLtaDzF_9nwWjMwlz-vy_50ZxYqNgRqrsYEM4 Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: e24f3dd6076b483a94680232657bfec0 Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-895798484 Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e24f3dd6076b483a94680232657bfec0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e24f3dd6076b483a94680232657bfec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e24f3dd6076b483a94680232657bfec0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e24f3dd6076b483a94680232657bfec0"}]}] Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-895798484 Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: e24f3dd6076b483a94680232657bfec0 Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-895798484 Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ListImageFiltersNegativeTestJSON-895798484-project Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 414b7d79e22041d3bd1d3d4d652c191e Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-895798484-project Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: exception: Image not found. Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '9595b4e6-fa32-49d0-8eb2-168c4388f16c'} Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9595b4e6-fa32-49d0-8eb2-168c4388f16c Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 05 17:44:41.593846 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9595b4e6-fa32-49d0-8eb2-168c4388f16c could not be found. Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:41.597941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c03b2165-1bf3-4235-b038-19ffb74e3c74 tempest-ListImageFiltersNegativeTestJSON-895798484 tempest-ListImageFiltersNegativeTestJSON-895798484-project] Returning 404 to user: Image not found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:41.607768 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c03b2165-1bf3-4235-b038-19ffb74e3c74 tempest-ListImageFiltersNegativeTestJSON-895798484 tempest-ListImageFiltersNegativeTestJSON-895798484-project] 10.222.0.70 "GET /compute/v2.1/images/9595b4e6-fa32-49d0-8eb2-168c4388f16c" status: 404 len: 62 microversion: 2.1 time: 0.177164 Oct 05 17:44:41.607768 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1388/2976] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:44:41 2022] GET /compute/v2.1/images/9595b4e6-fa32-49d0-8eb2-168c4388f16c => generated 62 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 17:44:41.619236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-94705161-b67e-463c-85f1-7035d85c9c32 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:41.619912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-94705161-b67e-463c-85f1-7035d85c9c32 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:41.628071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94705161-b67e-463c-85f1-7035d85c9c32 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:41.628608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94705161-b67e-463c-85f1-7035d85c9c32 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:41.629312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94705161-b67e-463c-85f1-7035d85c9c32 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:41.631511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94705161-b67e-463c-85f1-7035d85c9c32 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:41.632782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94705161-b67e-463c-85f1-7035d85c9c32 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:41.634451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94705161-b67e-463c-85f1-7035d85c9c32 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:41.635154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:41.641891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:41.656750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:41.811355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-94705161-b67e-463c-85f1-7035d85c9c32 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:41.820290 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-94705161-b67e-463c-85f1-7035d85c9c32 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1498 microversion: 2.1 time: 0.218503 Oct 05 17:44:41.822355 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1389/2977] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:41 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1498 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:41.843414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:41.859796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:41.860644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:41.866699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:41.867197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:41.867627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:41.868598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:41.869212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:41.869780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:41.899569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:41.968287 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-efd7284a-9a2d-4446-804a-d455c67cd3a7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.128699 Oct 05 17:44:41.974626 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1390/2978] 10.222.0.70 () {58 vars in 1154 bytes} [Wed Oct 5 17:44:41 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:41.981191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-286671f8-3419-4bca-b9df-ea7abfe95634 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:42.002562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-286671f8-3419-4bca-b9df-ea7abfe95634 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:42.003380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-286671f8-3419-4bca-b9df-ea7abfe95634 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:42.005095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-286671f8-3419-4bca-b9df-ea7abfe95634 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:42.048068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-286671f8-3419-4bca-b9df-ea7abfe95634 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Going to try to start instance {{(pid=128843) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 17:44:42.123283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:44:42.124409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:44:42.125233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:44:42.125873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:44:42.126921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:44:42.138619 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-286671f8-3419-4bca-b9df-ea7abfe95634 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "POST /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d/action" status: 202 len: 0 microversion: 2.1 time: 0.161048 Oct 05 17:44:42.142484 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1391/2979] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:44:41 2022] POST /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:44:42.155993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:42.158101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:42.159241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:42.160312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:42.170352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:42.171305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:42.189346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d6490fde-3178-455a-a2dc-4e437af10ea7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:42.190748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d6490fde-3178-455a-a2dc-4e437af10ea7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:42.201842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6490fde-3178-455a-a2dc-4e437af10ea7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:42.202598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6490fde-3178-455a-a2dc-4e437af10ea7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:42.203251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6490fde-3178-455a-a2dc-4e437af10ea7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:42.204809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6490fde-3178-455a-a2dc-4e437af10ea7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:42.205501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6490fde-3178-455a-a2dc-4e437af10ea7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:42.206310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6490fde-3178-455a-a2dc-4e437af10ea7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:42.220216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Getting quotas for project f401d1367a73495598bb8a6b882e8618. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:44:42.234315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Getting quotas for user 695a37f439e94d2e860e51df835827e4 and project f401d1367a73495598bb8a6b882e8618. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:44:42.266105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:44:42.271761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:44:42.334527 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cc5cc986-a0a2-4340-950b-f16dc94c2d2a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.716636 Oct 05 17:44:42.341656 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1589/2980] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:44:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:44:42.347918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-763acafd-7006-460e-8d78-923fced65feb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:42.348827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-763acafd-7006-460e-8d78-923fced65feb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:42.355535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-763acafd-7006-460e-8d78-923fced65feb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:42.356309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-763acafd-7006-460e-8d78-923fced65feb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:42.356904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-763acafd-7006-460e-8d78-923fced65feb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:42.358825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-763acafd-7006-460e-8d78-923fced65feb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:42.359449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-763acafd-7006-460e-8d78-923fced65feb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:42.360086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-763acafd-7006-460e-8d78-923fced65feb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:42.564142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d6490fde-3178-455a-a2dc-4e437af10ea7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:42.577307 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d6490fde-3178-455a-a2dc-4e437af10ea7 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1535 microversion: 2.1 time: 0.392794 Oct 05 17:44:42.579886 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1392/2981] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:42 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1535 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:42.595358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-57a47434-dce1-4e11-8758-6c9c6342a5af tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:42.598512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-57a47434-dce1-4e11-8758-6c9c6342a5af tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:42.708676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-57a47434-dce1-4e11-8758-6c9c6342a5af tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:42.716862 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-57a47434-dce1-4e11-8758-6c9c6342a5af tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1234 microversion: 2.1 time: 0.135838 Oct 05 17:44:42.719087 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1393/2982] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:42 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1234 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:42.748148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0e4901a4-0b06-41e7-a08e-aeac3051787c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:42.748883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0e4901a4-0b06-41e7-a08e-aeac3051787c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:42.768977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e4901a4-0b06-41e7-a08e-aeac3051787c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:42.769545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e4901a4-0b06-41e7-a08e-aeac3051787c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:42.770029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e4901a4-0b06-41e7-a08e-aeac3051787c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:42.770752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e4901a4-0b06-41e7-a08e-aeac3051787c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:42.771221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e4901a4-0b06-41e7-a08e-aeac3051787c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:42.771696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e4901a4-0b06-41e7-a08e-aeac3051787c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:42.854354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-763acafd-7006-460e-8d78-923fced65feb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:42.870563 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-763acafd-7006-460e-8d78-923fced65feb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1507 microversion: 2.1 time: 0.525256 Oct 05 17:44:42.872010 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1590/2983] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:42 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1507 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:43.244483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0e4901a4-0b06-41e7-a08e-aeac3051787c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:43.263074 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0e4901a4-0b06-41e7-a08e-aeac3051787c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1314 microversion: 2.1 time: 0.532246 Oct 05 17:44:43.263668 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1394/2984] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:42 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:43.610008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aa88a8be-7288-4cb3-b1e2-61cb830f25d6 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:43.611996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aa88a8be-7288-4cb3-b1e2-61cb830f25d6 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:43.622040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa88a8be-7288-4cb3-b1e2-61cb830f25d6 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:43.624185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa88a8be-7288-4cb3-b1e2-61cb830f25d6 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:43.625058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa88a8be-7288-4cb3-b1e2-61cb830f25d6 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:43.627947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa88a8be-7288-4cb3-b1e2-61cb830f25d6 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:43.629525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa88a8be-7288-4cb3-b1e2-61cb830f25d6 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:43.631219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa88a8be-7288-4cb3-b1e2-61cb830f25d6 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:43.747825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-925d6bb6-b1e7-49ff-a320-fa2cc2380a5c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:43.748440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-925d6bb6-b1e7-49ff-a320-fa2cc2380a5c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:43.755835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-925d6bb6-b1e7-49ff-a320-fa2cc2380a5c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:43.756291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-925d6bb6-b1e7-49ff-a320-fa2cc2380a5c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:43.757126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-925d6bb6-b1e7-49ff-a320-fa2cc2380a5c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:43.758002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-925d6bb6-b1e7-49ff-a320-fa2cc2380a5c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:43.758770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-925d6bb6-b1e7-49ff-a320-fa2cc2380a5c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:43.759185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-925d6bb6-b1e7-49ff-a320-fa2cc2380a5c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:43.851208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-925d6bb6-b1e7-49ff-a320-fa2cc2380a5c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:43.859443 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-925d6bb6-b1e7-49ff-a320-fa2cc2380a5c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1286 microversion: 2.1 time: 0.115777 Oct 05 17:44:43.860284 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1395/2985] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:43 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1286 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:43.868702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:43.869644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:43.876433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:43.877269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:43.877925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:43.878997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:43.879674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:43.880302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:44.103566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aa88a8be-7288-4cb3-b1e2-61cb830f25d6 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:44.112919 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aa88a8be-7288-4cb3-b1e2-61cb830f25d6 tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1535 microversion: 2.1 time: 0.510710 Oct 05 17:44:44.113560 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1591/2986] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:43 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1535 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:44.137820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49edfd36-6dd3-485c-b0f9-2561d51217d1 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:44.138482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-49edfd36-6dd3-485c-b0f9-2561d51217d1 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:44.149914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49edfd36-6dd3-485c-b0f9-2561d51217d1 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:44.152330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49edfd36-6dd3-485c-b0f9-2561d51217d1 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:44.152741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49edfd36-6dd3-485c-b0f9-2561d51217d1 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:44.153640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49edfd36-6dd3-485c-b0f9-2561d51217d1 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:44.154354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49edfd36-6dd3-485c-b0f9-2561d51217d1 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:44.154752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49edfd36-6dd3-485c-b0f9-2561d51217d1 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:44.304374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:44.314551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:44.322308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:44.325693 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5e97bc2b-47d4-495c-8b31-63ce173e2dd0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 2947 microversion: 2.32 time: 0.460874 Oct 05 17:44:44.326300 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1396/2987] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:44:43 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 2947 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:44:44.334572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb09fbd3-7d85-4a1a-8eeb-071c50eab9e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:44.335779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eb09fbd3-7d85-4a1a-8eeb-071c50eab9e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:44.354412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb09fbd3-7d85-4a1a-8eeb-071c50eab9e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:44.355154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb09fbd3-7d85-4a1a-8eeb-071c50eab9e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:44.360391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb09fbd3-7d85-4a1a-8eeb-071c50eab9e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:44.364280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb09fbd3-7d85-4a1a-8eeb-071c50eab9e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:44.375082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb09fbd3-7d85-4a1a-8eeb-071c50eab9e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:44.375850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb09fbd3-7d85-4a1a-8eeb-071c50eab9e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:44.631963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-49edfd36-6dd3-485c-b0f9-2561d51217d1 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:44.641059 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49edfd36-6dd3-485c-b0f9-2561d51217d1 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1507 microversion: 2.1 time: 0.526148 Oct 05 17:44:44.641653 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1592/2988] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:44 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1507 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:44.677360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ab5d558-69ed-438e-bec1-fc9d982a163b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:44.677883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ab5d558-69ed-438e-bec1-fc9d982a163b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:44.704711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab5d558-69ed-438e-bec1-fc9d982a163b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:44.705211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab5d558-69ed-438e-bec1-fc9d982a163b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:44.705748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab5d558-69ed-438e-bec1-fc9d982a163b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:44.706399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab5d558-69ed-438e-bec1-fc9d982a163b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:44.706861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab5d558-69ed-438e-bec1-fc9d982a163b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:44.707306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab5d558-69ed-438e-bec1-fc9d982a163b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:44.709873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb09fbd3-7d85-4a1a-8eeb-071c50eab9e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:44.723262 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb09fbd3-7d85-4a1a-8eeb-071c50eab9e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1314 microversion: 2.1 time: 0.391772 Oct 05 17:44:44.747101 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1397/2989] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:44 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:44.887152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-393c3976-081a-4558-8772-950012ffefd5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:44.888979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-393c3976-081a-4558-8772-950012ffefd5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:44.916807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393c3976-081a-4558-8772-950012ffefd5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:44.921736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393c3976-081a-4558-8772-950012ffefd5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:44.942801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393c3976-081a-4558-8772-950012ffefd5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:44.942801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393c3976-081a-4558-8772-950012ffefd5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:44.942801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393c3976-081a-4558-8772-950012ffefd5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:44.942801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393c3976-081a-4558-8772-950012ffefd5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.104715 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ab5d558-69ed-438e-bec1-fc9d982a163b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.461445 Oct 05 17:44:45.110817 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1593/2990] 10.222.0.70 () {60 vars in 1316 bytes} [Wed Oct 5 17:44:44 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce/os-interface => generated 1830 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:44:45.119833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e5d5371b-6a87-495b-9dc4-abc9ea71dbf2 req-6d7ce8d7-6491-4526-ad2c-64eebdf82194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64aabce-b60d-42c0-881b-43aa1880709b", "name": "network-vif-plugged", "status": "completed", "tag": "ca151148-f4dd-4fec-afc0-c8cb86c25709"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:45.141804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e5d5371b-6a87-495b-9dc4-abc9ea71dbf2 req-6d7ce8d7-6491-4526-ad2c-64eebdf82194 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.148415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e5d5371b-6a87-495b-9dc4-abc9ea71dbf2 req-6d7ce8d7-6491-4526-ad2c-64eebdf82194 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.150914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e5d5371b-6a87-495b-9dc4-abc9ea71dbf2 req-6d7ce8d7-6491-4526-ad2c-64eebdf82194 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.165065 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e5d5371b-6a87-495b-9dc4-abc9ea71dbf2 req-6d7ce8d7-6491-4526-ad2c-64eebdf82194 service nova] Creating event network-vif-plugged:ca151148-f4dd-4fec-afc0-c8cb86c25709 for instance d64aabce-b60d-42c0-881b-43aa1880709b on n-h1-835595-3 Oct 05 17:44:45.180484 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e5d5371b-6a87-495b-9dc4-abc9ea71dbf2 req-6d7ce8d7-6491-4526-ad2c-64eebdf82194 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068258 Oct 05 17:44:45.181100 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1594/2991] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:45.188670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3db90ca7-8e3c-41f2-8f36-99cb3db707d7 req-9ab50d58-3717-498e-b50d-056a99e3131a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef", "name": "network-vif-deleted", "tag": "fb997ddb-6c4a-40a4-be79-949940675ee9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:45.201937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-393c3976-081a-4558-8772-950012ffefd5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:45.213173 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-393c3976-081a-4558-8772-950012ffefd5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1292 microversion: 2.1 time: 0.331820 Oct 05 17:44:45.215760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3db90ca7-8e3c-41f2-8f36-99cb3db707d7 req-9ab50d58-3717-498e-b50d-056a99e3131a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.216440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3db90ca7-8e3c-41f2-8f36-99cb3db707d7 req-9ab50d58-3717-498e-b50d-056a99e3131a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.216912 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1398/2992] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:44 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1292 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:45.217328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3db90ca7-8e3c-41f2-8f36-99cb3db707d7 req-9ab50d58-3717-498e-b50d-056a99e3131a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.226156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:45.230382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:45.241588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.242915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.246577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.247597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.248281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.248942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.290327 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3db90ca7-8e3c-41f2-8f36-99cb3db707d7 req-9ab50d58-3717-498e-b50d-056a99e3131a service nova] Creating event network-vif-deleted:fb997ddb-6c4a-40a4-be79-949940675ee9 for instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef on n-h2-835595-3 Oct 05 17:44:45.299408 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3db90ca7-8e3c-41f2-8f36-99cb3db707d7 req-9ab50d58-3717-498e-b50d-056a99e3131a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114627 Oct 05 17:44:45.301720 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1595/2993] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:45.342769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.349734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.351558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.355399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lazy-loading 'fault' on Instance uuid eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:44:45.437891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:45.446988 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-50f644ae-125d-46f1-9104-848789500d7a tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1318 microversion: 2.1 time: 0.228731 Oct 05 17:44:45.454193 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1399/2994] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:45 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:45.670634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f10b2ec1-93b8-4fbb-a386-7602a768b80e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:45.672191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f10b2ec1-93b8-4fbb-a386-7602a768b80e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:45.679546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10b2ec1-93b8-4fbb-a386-7602a768b80e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.680615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10b2ec1-93b8-4fbb-a386-7602a768b80e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.681816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10b2ec1-93b8-4fbb-a386-7602a768b80e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.682749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10b2ec1-93b8-4fbb-a386-7602a768b80e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.683449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10b2ec1-93b8-4fbb-a386-7602a768b80e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.684115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f10b2ec1-93b8-4fbb-a386-7602a768b80e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.759003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0b01a20-d933-4f9f-b267-dba0b148d8f6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:45.759633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e0b01a20-d933-4f9f-b267-dba0b148d8f6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:45.767078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0b01a20-d933-4f9f-b267-dba0b148d8f6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.767964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0b01a20-d933-4f9f-b267-dba0b148d8f6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.768687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0b01a20-d933-4f9f-b267-dba0b148d8f6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.769597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0b01a20-d933-4f9f-b267-dba0b148d8f6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.770852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0b01a20-d933-4f9f-b267-dba0b148d8f6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.771435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0b01a20-d933-4f9f-b267-dba0b148d8f6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.913688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f10b2ec1-93b8-4fbb-a386-7602a768b80e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:45.933640 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f10b2ec1-93b8-4fbb-a386-7602a768b80e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1511 microversion: 2.1 time: 0.266824 Oct 05 17:44:45.934257 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1596/2995] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:45 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:45.964846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:45.970225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:45.971480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.servers [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Removing options 'limit' from query {{(pid=128844) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 05 17:44:45.972371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:45.973682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.974269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.975184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.976288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:45.976936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:45.977523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:45.979284 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a87d3761-106e-4121-b509-f5a179f9d3fa tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.019683 Oct 05 17:44:45.980170 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1597/2996] 10.222.0.70 () {58 vars in 1140 bytes} [Wed Oct 5 17:44:45 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 17:44:45.993525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24a0cfce-2d98-4e38-82a6-a481ce38aeb3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:45.994342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-24a0cfce-2d98-4e38-82a6-a481ce38aeb3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:46.001420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a0cfce-2d98-4e38-82a6-a481ce38aeb3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.002197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a0cfce-2d98-4e38-82a6-a481ce38aeb3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.002758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a0cfce-2d98-4e38-82a6-a481ce38aeb3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.003648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a0cfce-2d98-4e38-82a6-a481ce38aeb3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.004427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a0cfce-2d98-4e38-82a6-a481ce38aeb3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.005269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a0cfce-2d98-4e38-82a6-a481ce38aeb3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.165313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e0b01a20-d933-4f9f-b267-dba0b148d8f6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:46.176868 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e0b01a20-d933-4f9f-b267-dba0b148d8f6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1314 microversion: 2.1 time: 0.428773 Oct 05 17:44:46.178095 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1400/2997] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:45 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:46.248305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53084b42-d58a-4bad-a650-0713da21a3cf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:46.249785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-53084b42-d58a-4bad-a650-0713da21a3cf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:46.278307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-24a0cfce-2d98-4e38-82a6-a481ce38aeb3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:46.281996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53084b42-d58a-4bad-a650-0713da21a3cf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.282917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53084b42-d58a-4bad-a650-0713da21a3cf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.283644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53084b42-d58a-4bad-a650-0713da21a3cf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.286022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53084b42-d58a-4bad-a650-0713da21a3cf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.286773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53084b42-d58a-4bad-a650-0713da21a3cf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.287352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53084b42-d58a-4bad-a650-0713da21a3cf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.293932 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-24a0cfce-2d98-4e38-82a6-a481ce38aeb3 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1511 microversion: 2.1 time: 0.304682 Oct 05 17:44:46.295353 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1598/2998] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:45 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1511 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:46.326788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aa5c8fc9-a70b-4b61-a2ae-1bbd1955e582 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:46.327584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aa5c8fc9-a70b-4b61-a2ae-1bbd1955e582 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:46.339568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa5c8fc9-a70b-4b61-a2ae-1bbd1955e582 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.340356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa5c8fc9-a70b-4b61-a2ae-1bbd1955e582 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.344279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa5c8fc9-a70b-4b61-a2ae-1bbd1955e582 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.346112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa5c8fc9-a70b-4b61-a2ae-1bbd1955e582 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.346775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa5c8fc9-a70b-4b61-a2ae-1bbd1955e582 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.349001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa5c8fc9-a70b-4b61-a2ae-1bbd1955e582 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.543008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-53084b42-d58a-4bad-a650-0713da21a3cf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:46.552938 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53084b42-d58a-4bad-a650-0713da21a3cf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1292 microversion: 2.1 time: 0.311587 Oct 05 17:44:46.556607 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1401/2999] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:46 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1292 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:46.565746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:46.566485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:46.572903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.573472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.574032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.574832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.575309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.575820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.620151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:46.625700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.626436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.627241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.628025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lazy-loading 'fault' on Instance uuid eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:44:46.652648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aa5c8fc9-a70b-4b61-a2ae-1bbd1955e582 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:46.661511 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aa5c8fc9-a70b-4b61-a2ae-1bbd1955e582 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e" status: 200 len: 1512 microversion: 2.1 time: 0.342926 Oct 05 17:44:46.679127 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1599/3000] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:46 2022] GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e => generated 1512 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:46.688305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a03fa41-14c6-4a89-b4cc-140658ac7da9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:46.689209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9a03fa41-14c6-4a89-b4cc-140658ac7da9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:46.697955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a03fa41-14c6-4a89-b4cc-140658ac7da9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.698898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a03fa41-14c6-4a89-b4cc-140658ac7da9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.699501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a03fa41-14c6-4a89-b4cc-140658ac7da9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.700457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a03fa41-14c6-4a89-b4cc-140658ac7da9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:46.701108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a03fa41-14c6-4a89-b4cc-140658ac7da9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:46.701739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a03fa41-14c6-4a89-b4cc-140658ac7da9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:46.775685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c8193b43c1f429d82cd97cbf7fedc04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4393c803b178449689c9696c8301eff3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:46.783894 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa344153-4f78-4bd4-8c03-13a7d16fd92c tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 200 len: 1318 microversion: 2.1 time: 0.225913 Oct 05 17:44:46.798872 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1402/3001] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:46 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:46.858546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9a03fa41-14c6-4a89-b4cc-140658ac7da9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:46.867331 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a03fa41-14c6-4a89-b4cc-140658ac7da9 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1513 microversion: 2.1 time: 0.186451 Oct 05 17:44:46.867992 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1600/3002] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:46 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:46.892940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:46.904384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:46.905619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:47.201441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6eacd278-05ca-4545-82cb-cea97d192c94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:47.202139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6eacd278-05ca-4545-82cb-cea97d192c94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:47.216094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6eacd278-05ca-4545-82cb-cea97d192c94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:47.217984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6eacd278-05ca-4545-82cb-cea97d192c94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:47.219415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6eacd278-05ca-4545-82cb-cea97d192c94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:47.221123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6eacd278-05ca-4545-82cb-cea97d192c94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:47.222257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6eacd278-05ca-4545-82cb-cea97d192c94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:47.224295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6eacd278-05ca-4545-82cb-cea97d192c94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:47.265308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:47.265902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:47.266226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:47.267678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:47.268567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:47.269005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:47.497890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:47.566045 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fb3bf626-8dfa-4aa6-a136-1716988536bf tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.678998 Oct 05 17:44:47.568137 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1403/3003] 10.222.0.70 () {58 vars in 1154 bytes} [Wed Oct 5 17:44:46 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:47.579965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d4498157-593d-497b-81b7-c781e6f40178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:47.582146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d4498157-593d-497b-81b7-c781e6f40178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:47.601708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4498157-593d-497b-81b7-c781e6f40178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:47.603755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4498157-593d-497b-81b7-c781e6f40178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:47.604802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4498157-593d-497b-81b7-c781e6f40178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:47.608687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4498157-593d-497b-81b7-c781e6f40178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:47.612746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4498157-593d-497b-81b7-c781e6f40178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:47.613577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4498157-593d-497b-81b7-c781e6f40178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:47.658192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:47.700618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6eacd278-05ca-4545-82cb-cea97d192c94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:47.713040 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6eacd278-05ca-4545-82cb-cea97d192c94 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1501 microversion: 2.1 time: 0.515682 Oct 05 17:44:47.714853 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1601/3004] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:47 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1501 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:47.736271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bd51f27c-06f1-4e63-aa42-449bff462699 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:47.737260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bd51f27c-06f1-4e63-aa42-449bff462699 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:47.745456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd51f27c-06f1-4e63-aa42-449bff462699 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:47.746340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd51f27c-06f1-4e63-aa42-449bff462699 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:47.746969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd51f27c-06f1-4e63-aa42-449bff462699 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:47.749109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd51f27c-06f1-4e63-aa42-449bff462699 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:47.749840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd51f27c-06f1-4e63-aa42-449bff462699 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:47.750539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd51f27c-06f1-4e63-aa42-449bff462699 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:47.790508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:48.075109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bd51f27c-06f1-4e63-aa42-449bff462699 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:48.093998 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bd51f27c-06f1-4e63-aa42-449bff462699 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1511 microversion: 2.1 time: 0.377686 Oct 05 17:44:48.100966 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1602/3005] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:47 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1511 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:48.125581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f895cdfc-6e8f-483b-a9a2-6fc6622d9b84 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:48.128767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f895cdfc-6e8f-483b-a9a2-6fc6622d9b84 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:48.152707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f895cdfc-6e8f-483b-a9a2-6fc6622d9b84 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:48.153720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f895cdfc-6e8f-483b-a9a2-6fc6622d9b84 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:48.158567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f895cdfc-6e8f-483b-a9a2-6fc6622d9b84 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:48.166342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f895cdfc-6e8f-483b-a9a2-6fc6622d9b84 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:48.169367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f895cdfc-6e8f-483b-a9a2-6fc6622d9b84 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:48.170336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f895cdfc-6e8f-483b-a9a2-6fc6622d9b84 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:48.189971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d4498157-593d-497b-81b7-c781e6f40178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:48.203127 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d4498157-593d-497b-81b7-c781e6f40178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1359 microversion: 2.1 time: 0.627478 Oct 05 17:44:48.203881 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1404/3006] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:47 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1359 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:48.208649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:48.209285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] [instance: eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:48.230819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:48.231317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:48.231753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:48.232636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:48.233122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:48.237754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:48.274462 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] HTTP exception thrown: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Request method failure captured: Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef HTTP/1.1 Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcJi1-HHeUUbPOvBS4jsVVUs9Xk-NKQUQu6G0dY2Cn0HD_C2tt6nJcIJKBWv0JK1mvA5eweKNrsOX-LTHS3Qe1tg-6sS6d60ClD_8cM5iJxi-CiVMXI6G77hPFsRbA7pxua98R889grzsgP8XbS7YPonzrCaIBGA7zK_gHJeliBwV1E Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4393c803b178449689c9696c8301eff3 Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2143369435 Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4393c803b178449689c9696c8301eff3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4393c803b178449689c9696c8301eff3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4393c803b178449689c9696c8301eff3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4393c803b178449689c9696c8301eff3"}]}] Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2143369435 Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4393c803b178449689c9696c8301eff3 Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2143369435 Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2143369435-project Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 1c8193b43c1f429d82cd97cbf7fedc04 Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2143369435-project Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef'} Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:48.277187 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:48.281467 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:48.281467 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:48.281467 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:48.281467 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:48.281467 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:48.281467 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:48.281467 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:48.281467 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. Oct 05 17:44:48.281467 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:48.283280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] Returning 404 to user: Instance eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:48.284369 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5ea5d13a-89bc-4823-ba72-f7f412c95d1e tempest-ServersNegativeTestMultiTenantJSON-2143369435 tempest-ServersNegativeTestMultiTenantJSON-2143369435-project] 10.222.0.70 "GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef" status: 404 len: 111 microversion: 2.1 time: 0.079487 Oct 05 17:44:48.285501 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1405/3007] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:48 2022] GET /compute/v2.1/servers/eb9f85d9-ca28-482e-9f7f-cea3f75fe8ef => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:48.292347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b6316be-7a12-4fbc-87f9-5c9edce87849 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:48.293259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b6316be-7a12-4fbc-87f9-5c9edce87849 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:48.303942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6316be-7a12-4fbc-87f9-5c9edce87849 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:48.310389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6316be-7a12-4fbc-87f9-5c9edce87849 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:48.311142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6316be-7a12-4fbc-87f9-5c9edce87849 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:48.312082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6316be-7a12-4fbc-87f9-5c9edce87849 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:48.312731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6316be-7a12-4fbc-87f9-5c9edce87849 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:48.313382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b6316be-7a12-4fbc-87f9-5c9edce87849 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:48.397506 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f895cdfc-6e8f-483b-a9a2-6fc6622d9b84 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b/action" status: 202 len: 0 microversion: 2.1 time: 0.294429 Oct 05 17:44:48.398463 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1603/3008] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:44:48 2022] POST /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:44:48.408238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-007c3c67-e6a4-4e89-b5e5-aa1c17d99bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:48.409699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-007c3c67-e6a4-4e89-b5e5-aa1c17d99bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:48.424853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-007c3c67-e6a4-4e89-b5e5-aa1c17d99bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:48.425464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-007c3c67-e6a4-4e89-b5e5-aa1c17d99bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:48.425974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-007c3c67-e6a4-4e89-b5e5-aa1c17d99bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:48.428296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-007c3c67-e6a4-4e89-b5e5-aa1c17d99bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:48.428886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-007c3c67-e6a4-4e89-b5e5-aa1c17d99bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:48.433244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-007c3c67-e6a4-4e89-b5e5-aa1c17d99bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:48.611490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b6316be-7a12-4fbc-87f9-5c9edce87849 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:48.620600 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b6316be-7a12-4fbc-87f9-5c9edce87849 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e" status: 200 len: 1512 microversion: 2.1 time: 0.333727 Oct 05 17:44:48.635309 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1406/3009] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:48 2022] GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e => generated 1512 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:48.649278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f1587785-c9a6-409a-9803-7f96aac61b48 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:48.652901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1587785-c9a6-409a-9803-7f96aac61b48 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:48.664368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1587785-c9a6-409a-9803-7f96aac61b48 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:48.672050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1587785-c9a6-409a-9803-7f96aac61b48 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:48.672802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1587785-c9a6-409a-9803-7f96aac61b48 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:48.673716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1587785-c9a6-409a-9803-7f96aac61b48 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:48.674356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1587785-c9a6-409a-9803-7f96aac61b48 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:48.674940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1587785-c9a6-409a-9803-7f96aac61b48 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:49.077087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1587785-c9a6-409a-9803-7f96aac61b48 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:49.089249 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f1587785-c9a6-409a-9803-7f96aac61b48 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1513 microversion: 2.1 time: 0.443748 Oct 05 17:44:49.103010 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1407/3010] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:48 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1513 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:49.112079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:49.117984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:49.121062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:49.127703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:49.128251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:49.128766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:49.129742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:49.130323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:49.131418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:49.176289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:49.657204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-007c3c67-e6a4-4e89-b5e5-aa1c17d99bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:49.665399 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-007c3c67-e6a4-4e89-b5e5-aa1c17d99bdb tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1506 microversion: 2.1 time: 1.262526 Oct 05 17:44:49.672873 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1604/3011] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:48 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1506 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:49.677969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c04c4112-095b-4af1-9395-9c91d61aaa9c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:49.680535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c04c4112-095b-4af1-9395-9c91d61aaa9c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:49.697448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:49.703838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c04c4112-095b-4af1-9395-9c91d61aaa9c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:49.704362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c04c4112-095b-4af1-9395-9c91d61aaa9c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:49.704785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c04c4112-095b-4af1-9395-9c91d61aaa9c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:49.705482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c04c4112-095b-4af1-9395-9c91d61aaa9c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:49.706578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c04c4112-095b-4af1-9395-9c91d61aaa9c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:49.707024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c04c4112-095b-4af1-9395-9c91d61aaa9c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:49.714797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:49.715303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:49.715750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:49.982187 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a95bc31-e89a-4d78-add8-bfbcf048243b tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.874025 Oct 05 17:44:49.983137 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1408/3012] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:44:49 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:49.998672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-85f66ebc-0c08-4d56-8743-eadeb1b784ec req-14ef328f-c0c8-4634-bad9-142936e34732 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861d19af-3969-47e3-9887-e20a02de197f", "tag": "c398e3dd-834e-4b62-9832-e96be5cc76ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:50.051277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-85f66ebc-0c08-4d56-8743-eadeb1b784ec req-14ef328f-c0c8-4634-bad9-142936e34732 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.051777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-85f66ebc-0c08-4d56-8743-eadeb1b784ec req-14ef328f-c0c8-4634-bad9-142936e34732 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.052213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-85f66ebc-0c08-4d56-8743-eadeb1b784ec req-14ef328f-c0c8-4634-bad9-142936e34732 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:50.112639 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-85f66ebc-0c08-4d56-8743-eadeb1b784ec req-14ef328f-c0c8-4634-bad9-142936e34732 service nova] Creating event network-changed:c398e3dd-834e-4b62-9832-e96be5cc76ef for instance 861d19af-3969-47e3-9887-e20a02de197f on n-h1-835595-3 Oct 05 17:44:50.138017 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-85f66ebc-0c08-4d56-8743-eadeb1b784ec req-14ef328f-c0c8-4634-bad9-142936e34732 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153316 Oct 05 17:44:50.142657 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1409/3013] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:50.161662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:50.173635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:50.174734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:50.293437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.294401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.294401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:50.295081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.295530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.296107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:50.336761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:50.380882 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-88d0cbee-3561-4db2-b77e-c16fee2afa9c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.236483 Oct 05 17:44:50.381557 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1410/3014] 10.222.0.70 () {58 vars in 1150 bytes} [Wed Oct 5 17:44:50 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:50.403477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:50.416919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:50.419141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:50.425765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.426852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.426852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:50.427707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.428376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.429291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:50.488662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c04c4112-095b-4af1-9395-9c91d61aaa9c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:50.497320 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c04c4112-095b-4af1-9395-9c91d61aaa9c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1359 microversion: 2.1 time: 0.823084 Oct 05 17:44:50.503031 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1605/3015] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:49 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1359 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:50.610583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:50.675764 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4b613608-7007-41f4-8379-70f09ae17722 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.280362 Oct 05 17:44:50.676525 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1411/3016] 10.222.0.70 () {58 vars in 1212 bytes} [Wed Oct 5 17:44:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:50.690460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:50.704363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:50.705171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:50.708245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d9a22a91-5da7-48c6-bb63-b6d2a52ebaf9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:50.710307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d9a22a91-5da7-48c6-bb63-b6d2a52ebaf9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:50.721859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.724849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.725311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:50.726139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.727916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-5da7-48c6-bb63-b6d2a52ebaf9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.728412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-5da7-48c6-bb63-b6d2a52ebaf9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.728852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-5da7-48c6-bb63-b6d2a52ebaf9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:50.729555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-5da7-48c6-bb63-b6d2a52ebaf9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.730010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-5da7-48c6-bb63-b6d2a52ebaf9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.730765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.731197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:50.734727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9a22a91-5da7-48c6-bb63-b6d2a52ebaf9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:50.895591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:50.944594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9a22a91-5da7-48c6-bb63-b6d2a52ebaf9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:50.954573 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d9a22a91-5da7-48c6-bb63-b6d2a52ebaf9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1486 microversion: 2.1 time: 0.254307 Oct 05 17:44:50.955346 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1412/3017] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:50 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1486 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:50.973555 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-006468e0-17d7-4461-a4c1-fcbdc425bbf6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.288173 Oct 05 17:44:50.974460 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1606/3018] 10.222.0.70 () {58 vars in 1196 bytes} [Wed Oct 5 17:44:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:50.982590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a8bea73-13d2-48e1-94da-79d8d986b0cd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:50.983665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7a8bea73-13d2-48e1-94da-79d8d986b0cd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:50.990672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:50.993655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a8bea73-13d2-48e1-94da-79d8d986b0cd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.995378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a8bea73-13d2-48e1-94da-79d8d986b0cd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.995904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a8bea73-13d2-48e1-94da-79d8d986b0cd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:50.996700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a8bea73-13d2-48e1-94da-79d8d986b0cd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:50.997230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a8bea73-13d2-48e1-94da-79d8d986b0cd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:50.997721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a8bea73-13d2-48e1-94da-79d8d986b0cd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:51.001039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:51.002179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'name': '-768149202', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:51.017888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:51.018429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:51.018869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:51.019801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:51.020999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:51.021601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:51.030608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-7a8bea73-13d2-48e1-94da-79d8d986b0cd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lazy-loading 'flavor' on Instance uuid d64aabce-b60d-42c0-881b-43aa1880709b {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:44:51.180531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:51.320960 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7146c318-ea7f-4bde-a207-8758db41ef6c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?name=-768149202" status: 200 len: 345 microversion: 2.1 time: 0.337901 Oct 05 17:44:51.331930 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1607/3019] 10.222.0.70 () {58 vars in 1156 bytes} [Wed Oct 5 17:44:50 2022] GET /compute/v2.1/servers?name=-768149202 => generated 345 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:44:51.341917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:51.351289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:51.351968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:51.359703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:51.360209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:51.360803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:51.361615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:51.362200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:51.363390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:51.443584 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a8bea73-13d2-48e1-94da-79d8d986b0cd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b/action" status: 202 len: 0 microversion: 2.1 time: 0.466267 Oct 05 17:44:51.463992 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1413/3020] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:44:50 2022] POST /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:44:51.487041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-802c351b-41d6-4022-80a8-93424aad212e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:51.488081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-802c351b-41d6-4022-80a8-93424aad212e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:51.508420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-802c351b-41d6-4022-80a8-93424aad212e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:51.508914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-802c351b-41d6-4022-80a8-93424aad212e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:51.511942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-802c351b-41d6-4022-80a8-93424aad212e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:51.512677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-802c351b-41d6-4022-80a8-93424aad212e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:51.513127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-802c351b-41d6-4022-80a8-93424aad212e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:51.513543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-802c351b-41d6-4022-80a8-93424aad212e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:51.552871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:51.661517 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-74cee753-34c5-40f7-aeae-ebda3b338c03 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.327857 Oct 05 17:44:51.663177 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1608/3021] 10.222.0.70 () {58 vars in 1154 bytes} [Wed Oct 5 17:44:51 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:51.668884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8d512e5-a207-4867-9de1-f30f722950bc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:51.669595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c8d512e5-a207-4867-9de1-f30f722950bc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:51.676484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d512e5-a207-4867-9de1-f30f722950bc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:51.677259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d512e5-a207-4867-9de1-f30f722950bc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:51.678053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d512e5-a207-4867-9de1-f30f722950bc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:51.679092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d512e5-a207-4867-9de1-f30f722950bc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:51.679620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d512e5-a207-4867-9de1-f30f722950bc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:51.680135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d512e5-a207-4867-9de1-f30f722950bc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:51.990617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-802c351b-41d6-4022-80a8-93424aad212e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:52.001967 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-802c351b-41d6-4022-80a8-93424aad212e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1492 microversion: 2.1 time: 0.534129 Oct 05 17:44:52.003145 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1414/3022] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:51 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1492 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:52.019221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:52.037372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:52.038262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-76814920', 'deleted': False, 'project_id': '7956891e6f6e4d34a6180bf39302dba9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:44:52.048664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:52.049435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:52.050106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:52.051630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:52.052380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:52.053103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:52.221655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:44:52.253080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=12 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:52.331746 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-230c0017-45d4-4bab-a2db-994563540846 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-76814920" status: 200 len: 345 microversion: 2.1 time: 0.326547 Oct 05 17:44:52.346819 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1415/3023] 10.222.0.70 () {58 vars in 1226 bytes} [Wed Oct 5 17:44:52 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-76814920 => generated 345 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:52.352993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8d512e5-a207-4867-9de1-f30f722950bc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:52.353989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b19fac33-7b66-43bc-910d-e52c176deaa5 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77753f04c0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:52.361122 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c8d512e5-a207-4867-9de1-f30f722950bc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1359 microversion: 2.1 time: 0.696751 Oct 05 17:44:52.364315 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1609/3024] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:51 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1359 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:52.392890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-55d763e2-ff31-4e1b-a378-9ad11985d7b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:52.393694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-55d763e2-ff31-4e1b-a378-9ad11985d7b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:52.405810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d763e2-ff31-4e1b-a378-9ad11985d7b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:52.411551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d763e2-ff31-4e1b-a378-9ad11985d7b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:52.412332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d763e2-ff31-4e1b-a378-9ad11985d7b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:52.413595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d763e2-ff31-4e1b-a378-9ad11985d7b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:52.414347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d763e2-ff31-4e1b-a378-9ad11985d7b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:52.414959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d763e2-ff31-4e1b-a378-9ad11985d7b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:52.452639 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b19fac33-7b66-43bc-910d-e52c176deaa5 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/ad3703ff-2a56-4b47-b034-74ffc130e4d6" status: 200 len: 661 microversion: 2.1 time: 0.104545 Oct 05 17:44:52.458013 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1416/3025] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:44:52 2022] GET /compute/v2.1/images/ad3703ff-2a56-4b47-b034-74ffc130e4d6 => generated 661 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:52.458981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-55d763e2-ff31-4e1b-a378-9ad11985d7b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:44:52.471368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-593db1aa-db96-4dd0-b2b5-ff5a40bf5881 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774d6e670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:52.541487 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-593db1aa-db96-4dd0-b2b5-ff5a40bf5881 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/ad3703ff-2a56-4b47-b034-74ffc130e4d6" status: 200 len: 661 microversion: 2.1 time: 0.074234 Oct 05 17:44:52.545866 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1417/3026] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:44:52 2022] GET /compute/v2.1/images/ad3703ff-2a56-4b47-b034-74ffc130e4d6 => generated 661 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:44:52.600530 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-55d763e2-ff31-4e1b-a378-9ad11985d7b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 204 len: 0 microversion: 2.1 time: 0.211522 Oct 05 17:44:52.601462 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1610/3027] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:52 2022] DELETE /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:44:52.619484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d23d9ba-f8be-4828-9332-1edd97f831b6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:52.622623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4d23d9ba-f8be-4828-9332-1edd97f831b6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:52.636868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d23d9ba-f8be-4828-9332-1edd97f831b6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:52.637963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d23d9ba-f8be-4828-9332-1edd97f831b6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:52.638619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d23d9ba-f8be-4828-9332-1edd97f831b6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:52.639573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d23d9ba-f8be-4828-9332-1edd97f831b6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:52.640190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d23d9ba-f8be-4828-9332-1edd97f831b6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:52.640775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d23d9ba-f8be-4828-9332-1edd97f831b6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:52.909441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4d23d9ba-f8be-4828-9332-1edd97f831b6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:52.919074 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4d23d9ba-f8be-4828-9332-1edd97f831b6 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1519 microversion: 2.1 time: 0.312480 Oct 05 17:44:52.942721 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1418/3028] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:52 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1519 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:53.039740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-18b2b11a-5389-4246-8d8d-620cd0b10daf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:53.041600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-18b2b11a-5389-4246-8d8d-620cd0b10daf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:53.050771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18b2b11a-5389-4246-8d8d-620cd0b10daf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:53.051528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18b2b11a-5389-4246-8d8d-620cd0b10daf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:53.052312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18b2b11a-5389-4246-8d8d-620cd0b10daf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:53.053423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18b2b11a-5389-4246-8d8d-620cd0b10daf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:53.055016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18b2b11a-5389-4246-8d8d-620cd0b10daf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:53.056268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-18b2b11a-5389-4246-8d8d-620cd0b10daf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:53.395070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-418ba8f5-3a87-4f4a-9b6b-64d23f015b66 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:53.396479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-418ba8f5-3a87-4f4a-9b6b-64d23f015b66 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:53.403786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-418ba8f5-3a87-4f4a-9b6b-64d23f015b66 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:53.404271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-418ba8f5-3a87-4f4a-9b6b-64d23f015b66 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:53.404901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-418ba8f5-3a87-4f4a-9b6b-64d23f015b66 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:53.405782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-418ba8f5-3a87-4f4a-9b6b-64d23f015b66 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:53.406420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-418ba8f5-3a87-4f4a-9b6b-64d23f015b66 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:53.407000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-418ba8f5-3a87-4f4a-9b6b-64d23f015b66 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:53.536496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-18b2b11a-5389-4246-8d8d-620cd0b10daf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:53.546800 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-18b2b11a-5389-4246-8d8d-620cd0b10daf tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1513 microversion: 2.1 time: 0.520494 Oct 05 17:44:53.561614 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1611/3029] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:53 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1513 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:53.565901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-418ba8f5-3a87-4f4a-9b6b-64d23f015b66 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:53.576094 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-418ba8f5-3a87-4f4a-9b6b-64d23f015b66 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1359 microversion: 2.1 time: 0.185038 Oct 05 17:44:53.576715 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1419/3030] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:53 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:53.948728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1b01f12-8ae1-44ad-980b-a06af9228a45 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:53.950058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f1b01f12-8ae1-44ad-980b-a06af9228a45 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:53.958114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b01f12-8ae1-44ad-980b-a06af9228a45 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:53.958658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b01f12-8ae1-44ad-980b-a06af9228a45 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:53.959097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b01f12-8ae1-44ad-980b-a06af9228a45 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:53.959820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b01f12-8ae1-44ad-980b-a06af9228a45 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:53.960312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b01f12-8ae1-44ad-980b-a06af9228a45 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:53.960922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b01f12-8ae1-44ad-980b-a06af9228a45 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:54.064656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5808e5f6-64ee-487d-8c1f-de52a1a04d3e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774a45b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:54.114623 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5808e5f6-64ee-487d-8c1f-de52a1a04d3e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/f2a314da-4b93-4568-a67c-80c5b55dae51" status: 200 len: 662 microversion: 2.1 time: 0.053559 Oct 05 17:44:54.115208 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1420/3031] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:44:54 2022] GET /compute/v2.1/images/f2a314da-4b93-4568-a67c-80c5b55dae51 => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:54.131750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f6b4f58f-d163-4b73-8b7c-690ec1fb9df8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77753e7940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:54.182150 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f6b4f58f-d163-4b73-8b7c-690ec1fb9df8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/f2a314da-4b93-4568-a67c-80c5b55dae51" status: 200 len: 662 microversion: 2.1 time: 0.056616 Oct 05 17:44:54.183027 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1421/3032] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:44:54 2022] GET /compute/v2.1/images/f2a314da-4b93-4568-a67c-80c5b55dae51 => generated 662 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:44:54.575194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-927956ad-eb73-4951-8df4-2b47e446c620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:54.576700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-927956ad-eb73-4951-8df4-2b47e446c620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:54.601277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-927956ad-eb73-4951-8df4-2b47e446c620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:54.601809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-927956ad-eb73-4951-8df4-2b47e446c620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:54.604986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-927956ad-eb73-4951-8df4-2b47e446c620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:54.605957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-927956ad-eb73-4951-8df4-2b47e446c620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:54.611403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f1b01f12-8ae1-44ad-980b-a06af9228a45 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:54.623006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-927956ad-eb73-4951-8df4-2b47e446c620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:54.624893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-927956ad-eb73-4951-8df4-2b47e446c620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:54.629502 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f1b01f12-8ae1-44ad-980b-a06af9228a45 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1519 microversion: 2.1 time: 0.686168 Oct 05 17:44:54.630151 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1612/3033] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:53 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1519 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:54.655547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bda83a7e-0741-437b-b91c-4766fd3ba3de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:54.656171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bda83a7e-0741-437b-b91c-4766fd3ba3de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:54.669064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bda83a7e-0741-437b-b91c-4766fd3ba3de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:54.670851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bda83a7e-0741-437b-b91c-4766fd3ba3de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:54.672582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bda83a7e-0741-437b-b91c-4766fd3ba3de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:54.673525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bda83a7e-0741-437b-b91c-4766fd3ba3de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:54.675009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bda83a7e-0741-437b-b91c-4766fd3ba3de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:54.678028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bda83a7e-0741-437b-b91c-4766fd3ba3de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:54.898729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-927956ad-eb73-4951-8df4-2b47e446c620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:54.901117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:54.915984 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-927956ad-eb73-4951-8df4-2b47e446c620 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.347203 Oct 05 17:44:54.930310 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1422/3034] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:54 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:55.075619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6b9619bb-487e-4f93-abd0-5b09a97ce4dc req-5e8893f3-4a34-40e5-9cc7-6140711cf8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861d19af-3969-47e3-9887-e20a02de197f", "name": "network-vif-plugged", "status": "completed", "tag": "c398e3dd-834e-4b62-9832-e96be5cc76ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:55.090532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6b9619bb-487e-4f93-abd0-5b09a97ce4dc req-5e8893f3-4a34-40e5-9cc7-6140711cf8b1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:55.101755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6b9619bb-487e-4f93-abd0-5b09a97ce4dc req-5e8893f3-4a34-40e5-9cc7-6140711cf8b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:55.105590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6b9619bb-487e-4f93-abd0-5b09a97ce4dc req-5e8893f3-4a34-40e5-9cc7-6140711cf8b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:55.125979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bda83a7e-0741-437b-b91c-4766fd3ba3de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:55.134788 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6b9619bb-487e-4f93-abd0-5b09a97ce4dc req-5e8893f3-4a34-40e5-9cc7-6140711cf8b1 service nova] Creating event network-vif-plugged:c398e3dd-834e-4b62-9832-e96be5cc76ef for instance 861d19af-3969-47e3-9887-e20a02de197f on n-h1-835595-3 Oct 05 17:44:55.137375 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bda83a7e-0741-437b-b91c-4766fd3ba3de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1359 microversion: 2.1 time: 0.501131 Oct 05 17:44:55.147617 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1613/3035] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:54 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1359 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:55.148808 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6b9619bb-487e-4f93-abd0-5b09a97ce4dc req-5e8893f3-4a34-40e5-9cc7-6140711cf8b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077089 Oct 05 17:44:55.149450 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1423/3036] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:44:55.653764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f63d3baf-917d-4ab5-8716-14f283d2afeb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:55.655167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f63d3baf-917d-4ab5-8716-14f283d2afeb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:55.667680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-02a6796f-cfd7-4872-a320-c26f261ef45b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77756daa60>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:55.671100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63d3baf-917d-4ab5-8716-14f283d2afeb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:55.671852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63d3baf-917d-4ab5-8716-14f283d2afeb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:55.672507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63d3baf-917d-4ab5-8716-14f283d2afeb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:55.674126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63d3baf-917d-4ab5-8716-14f283d2afeb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:55.676335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63d3baf-917d-4ab5-8716-14f283d2afeb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:55.677371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63d3baf-917d-4ab5-8716-14f283d2afeb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:55.781111 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-02a6796f-cfd7-4872-a320-c26f261ef45b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a102d2cf-e475-4358-b00f-288b389a21e9" status: 200 len: 662 microversion: 2.1 time: 0.115626 Oct 05 17:44:55.782408 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1424/3037] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:44:55 2022] GET /compute/v2.1/images/a102d2cf-e475-4358-b00f-288b389a21e9 => generated 662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:44:55.800788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-313a596a-a97b-458b-b2d6-1253a0779b5d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777489c3a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:55.891202 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-313a596a-a97b-458b-b2d6-1253a0779b5d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a102d2cf-e475-4358-b00f-288b389a21e9" status: 200 len: 662 microversion: 2.1 time: 0.099168 Oct 05 17:44:55.894996 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1425/3038] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:44:55 2022] GET /compute/v2.1/images/a102d2cf-e475-4358-b00f-288b389a21e9 => generated 662 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:55.944522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c3d3e2d3-26ba-48d0-8e86-4b59d4b5f9b9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:55.946394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3d3e2d3-26ba-48d0-8e86-4b59d4b5f9b9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:55.954876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2d3-26ba-48d0-8e86-4b59d4b5f9b9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:55.955702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2d3-26ba-48d0-8e86-4b59d4b5f9b9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:55.956301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2d3-26ba-48d0-8e86-4b59d4b5f9b9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:55.958390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2d3-26ba-48d0-8e86-4b59d4b5f9b9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:55.959080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2d3-26ba-48d0-8e86-4b59d4b5f9b9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:55.959753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d3e2d3-26ba-48d0-8e86-4b59d4b5f9b9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:56.152126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f63d3baf-917d-4ab5-8716-14f283d2afeb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:56.165560 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f63d3baf-917d-4ab5-8716-14f283d2afeb tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 200 len: 1519 microversion: 2.1 time: 0.515469 Oct 05 17:44:56.166450 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1614/3039] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:55 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 1519 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:56.196875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-323085821", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:56.334935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:44:57.243647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:44:57.244749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:44:57.245386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:44:57.245968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:44:57.246564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:44:57.263085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:57.265700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:57.266343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:57.267283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:57.270502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:57.271356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:57.324223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Getting quotas for project 66a9e15f741c4d2ba29c84de6548b609. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:44:57.326918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:57.330336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Getting quotas for user 9fc5abcfae46458abd33c1cf827f6be4 and project 66a9e15f741c4d2ba29c84de6548b609. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:44:57.359901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:44:57.370097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:44:57.462059 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c1559c8c-b061-493c-8a63-3c2b0bf163b0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.294338 Oct 05 17:44:57.463049 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1615/3040] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:44:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:44:57.492181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d47f472d-ef0f-45ab-99c1-7c4449b2518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:57.493933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d47f472d-ef0f-45ab-99c1-7c4449b2518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:57.510456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47f472d-ef0f-45ab-99c1-7c4449b2518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:57.511703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47f472d-ef0f-45ab-99c1-7c4449b2518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:57.512393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47f472d-ef0f-45ab-99c1-7c4449b2518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:57.513572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47f472d-ef0f-45ab-99c1-7c4449b2518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:57.514309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47f472d-ef0f-45ab-99c1-7c4449b2518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:57.514976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47f472d-ef0f-45ab-99c1-7c4449b2518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:57.520633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:44:57.668025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c3d3e2d3-26ba-48d0-8e86-4b59d4b5f9b9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:57.682312 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c3d3e2d3-26ba-48d0-8e86-4b59d4b5f9b9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 1.745576 Oct 05 17:44:57.685152 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1426/3041] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:55 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:44:57.710979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ef259823-3e63-479f-ae5e-3d4a67fd0068 req-e307f2c5-7535-42f0-8451-2816404b9e08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca78094-2274-411b-ba3f-0c6e4e369ca3", "name": "network-vif-deleted", "tag": "e28797c1-601b-479a-b80e-f459dc9b3d0c"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:57.728538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ef259823-3e63-479f-ae5e-3d4a67fd0068 req-e307f2c5-7535-42f0-8451-2816404b9e08 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:57.729717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ef259823-3e63-479f-ae5e-3d4a67fd0068 req-e307f2c5-7535-42f0-8451-2816404b9e08 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:57.730438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ef259823-3e63-479f-ae5e-3d4a67fd0068 req-e307f2c5-7535-42f0-8451-2816404b9e08 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:57.746400 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ef259823-3e63-479f-ae5e-3d4a67fd0068 req-e307f2c5-7535-42f0-8451-2816404b9e08 service nova] Creating event network-vif-deleted:e28797c1-601b-479a-b80e-f459dc9b3d0c for instance cca78094-2274-411b-ba3f-0c6e4e369ca3 on n-h2-835595-3 Oct 05 17:44:57.755011 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ef259823-3e63-479f-ae5e-3d4a67fd0068 req-e307f2c5-7535-42f0-8451-2816404b9e08 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068316 Oct 05 17:44:57.756844 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1427/3042] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:57.764095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:57.765676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: cca78094-2274-411b-ba3f-0c6e4e369ca3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:57.777935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:57.778755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:57.779825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:57.780820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:57.781958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:57.782830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:57.799248 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] HTTP exception thrown: Instance cca78094-2274-411b-ba3f-0c6e4e369ca3 could not be found. Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Request method failure captured: Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 HTTP/1.1 Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcJF02QF-k4gtZiB2DEqksmc_G5CdydRwl4YbZ-8u_nNiSXlo_AzTLH0Pg_Ab2Vjz1v-ona8LW2-YcmfSxBvYksOtvxzYYO2NeJXA-A4DckOw4shCUxykhiRQjlayHrGgsk2cksFJjZ3tRL1VudwRnyvgYXpqmfEl85TT0KG5EQTiBg Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7956891e6f6e4d34a6180bf39302dba9 Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ListServerFiltersTestJSON-67927586 Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7956891e6f6e4d34a6180bf39302dba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7956891e6f6e4d34a6180bf39302dba9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7956891e6f6e4d34a6180bf39302dba9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7956891e6f6e4d34a6180bf39302dba9"}]}] Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ListServerFiltersTestJSON-67927586 Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7956891e6f6e4d34a6180bf39302dba9 Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-67927586 Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ListServerFiltersTestJSON-67927586-project Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 3cd8c8eb0eac4ad3b8364e5fe54bc340 Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ListServerFiltersTestJSON-67927586-project Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance cca78094-2274-411b-ba3f-0c6e4e369ca3 could not be found. Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'cca78094-2274-411b-ba3f-0c6e4e369ca3'} Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca78094-2274-411b-ba3f-0c6e4e369ca3 could not be found. Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca78094-2274-411b-ba3f-0c6e4e369ca3 could not be found. Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:44:57.802102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:57.806231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:44:57.806231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:44:57.806231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:44:57.806231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:44:57.806231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:44:57.806231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca78094-2274-411b-ba3f-0c6e4e369ca3 could not be found. Oct 05 17:44:57.806231 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:44:57.809949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Returning 404 to user: Instance cca78094-2274-411b-ba3f-0c6e4e369ca3 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:44:57.811106 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6127de0c-c3fc-4e2d-bdb5-e9ebcbef7d8e tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3" status: 404 len: 111 microversion: 2.1 time: 0.052320 Oct 05 17:44:57.812284 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1428/3043] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:57 2022] GET /compute/v2.1/servers/cca78094-2274-411b-ba3f-0c6e4e369ca3 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:44:57.817453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-472638583", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:44:57.912001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:44:58.165626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d47f472d-ef0f-45ab-99c1-7c4449b2518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:58.174518 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d47f472d-ef0f-45ab-99c1-7c4449b2518a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1542 microversion: 2.1 time: 0.699577 Oct 05 17:44:58.179167 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1616/3044] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:57 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1542 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:44:58.198778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36181680-14ce-4729-b956-d4aa7beaf263 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:58.199594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-36181680-14ce-4729-b956-d4aa7beaf263 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:58.215479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36181680-14ce-4729-b956-d4aa7beaf263 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:58.218998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36181680-14ce-4729-b956-d4aa7beaf263 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:58.221932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36181680-14ce-4729-b956-d4aa7beaf263 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:58.222914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36181680-14ce-4729-b956-d4aa7beaf263 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:58.223545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36181680-14ce-4729-b956-d4aa7beaf263 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:58.226270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36181680-14ce-4729-b956-d4aa7beaf263 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:58.276238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-36181680-14ce-4729-b956-d4aa7beaf263 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:44:58.459878 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-36181680-14ce-4729-b956-d4aa7beaf263 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "DELETE /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e" status: 204 len: 0 microversion: 2.1 time: 0.276784 Oct 05 17:44:58.461208 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1617/3045] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:44:58 2022] DELETE /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:44:58.471932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9286284a-b818-4dd0-a0de-053c9d2bc4fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:58.474920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9286284a-b818-4dd0-a0de-053c9d2bc4fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:58.496850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9286284a-b818-4dd0-a0de-053c9d2bc4fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:58.497674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9286284a-b818-4dd0-a0de-053c9d2bc4fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:58.498273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9286284a-b818-4dd0-a0de-053c9d2bc4fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:58.499221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9286284a-b818-4dd0-a0de-053c9d2bc4fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:58.501073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9286284a-b818-4dd0-a0de-053c9d2bc4fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:58.501660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9286284a-b818-4dd0-a0de-053c9d2bc4fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:58.772072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:44:58.772576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:44:58.773236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:44:58.773658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:44:58.774077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:44:58.798686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:58.799252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:58.799701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:58.800494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:58.800955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:58.802605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:58.845702 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9286284a-b818-4dd0-a0de-053c9d2bc4fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.382856 Oct 05 17:44:58.846327 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1618/3046] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:44:58 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-interface => generated 285 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:44:58.851203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99d2856d-d91a-4300-9601-252c7488a80c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:58.852021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99d2856d-d91a-4300-9601-252c7488a80c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:58.864720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99d2856d-d91a-4300-9601-252c7488a80c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:58.864720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99d2856d-d91a-4300-9601-252c7488a80c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:58.865044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99d2856d-d91a-4300-9601-252c7488a80c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:58.865758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99d2856d-d91a-4300-9601-252c7488a80c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:58.866215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99d2856d-d91a-4300-9601-252c7488a80c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:58.866737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99d2856d-d91a-4300-9601-252c7488a80c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:58.920606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Getting quotas for project 66a9e15f741c4d2ba29c84de6548b609. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:44:58.945588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Getting quotas for user 9fc5abcfae46458abd33c1cf827f6be4 and project 66a9e15f741c4d2ba29c84de6548b609. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:44:58.986136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:44:58.991913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:44:59.156660 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5dc5cc0c-ea4a-4c0e-acff-a4fc88c1d6bf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341577 Oct 05 17:44:59.159126 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1429/3047] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:44:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:44:59.172349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8c850651-6dd4-4237-aa29-120d4f968436 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:44:59.172975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8c850651-6dd4-4237-aa29-120d4f968436 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:44:59.195885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c850651-6dd4-4237-aa29-120d4f968436 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:59.198412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c850651-6dd4-4237-aa29-120d4f968436 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:59.200593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c850651-6dd4-4237-aa29-120d4f968436 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:59.201424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c850651-6dd4-4237-aa29-120d4f968436 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:44:59.201905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c850651-6dd4-4237-aa29-120d4f968436 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:44:59.202359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c850651-6dd4-4237-aa29-120d4f968436 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:44:59.973341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99d2856d-d91a-4300-9601-252c7488a80c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:44:59.982127 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99d2856d-d91a-4300-9601-252c7488a80c tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e" status: 200 len: 1518 microversion: 2.1 time: 1.134544 Oct 05 17:45:00.001475 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1619/3048] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:58 2022] GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e => generated 1518 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:00.014513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bca90bfb-8356-4420-b960-b368acb38585 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:00.015303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bca90bfb-8356-4420-b960-b368acb38585 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:00.033700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c850651-6dd4-4237-aa29-120d4f968436 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:00.049427 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8c850651-6dd4-4237-aa29-120d4f968436 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.887053 Oct 05 17:45:00.050150 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1430/3049] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:44:59 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:00.163773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bca90bfb-8356-4420-b960-b368acb38585 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:00.173330 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bca90bfb-8356-4420-b960-b368acb38585 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1217 microversion: 2.1 time: 0.170628 Oct 05 17:45:00.173928 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1620/3050] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:00 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:01.011481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-70a791cf-066a-4da8-bf64-bc89b5b550f7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:01.012183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-70a791cf-066a-4da8-bf64-bc89b5b550f7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:01.028791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70a791cf-066a-4da8-bf64-bc89b5b550f7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:01.032942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70a791cf-066a-4da8-bf64-bc89b5b550f7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:01.033392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70a791cf-066a-4da8-bf64-bc89b5b550f7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:01.037626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70a791cf-066a-4da8-bf64-bc89b5b550f7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:01.039516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70a791cf-066a-4da8-bf64-bc89b5b550f7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:01.040324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70a791cf-066a-4da8-bf64-bc89b5b550f7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:01.073783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f72b02b3-f482-4195-b753-a48eed88d248 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:01.076091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f72b02b3-f482-4195-b753-a48eed88d248 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:01.098811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72b02b3-f482-4195-b753-a48eed88d248 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:01.099327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72b02b3-f482-4195-b753-a48eed88d248 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:01.103229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72b02b3-f482-4195-b753-a48eed88d248 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:01.103417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72b02b3-f482-4195-b753-a48eed88d248 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:01.103738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72b02b3-f482-4195-b753-a48eed88d248 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:01.104175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f72b02b3-f482-4195-b753-a48eed88d248 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:01.928475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-70a791cf-066a-4da8-bf64-bc89b5b550f7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:01.941010 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-70a791cf-066a-4da8-bf64-bc89b5b550f7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e" status: 200 len: 1518 microversion: 2.1 time: 0.932747 Oct 05 17:45:01.942117 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1431/3051] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:01 2022] GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e => generated 1518 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:01.954403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ee4278ab-fa8e-4a56-bb19-11db5f5ad23d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:01.955113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ee4278ab-fa8e-4a56-bb19-11db5f5ad23d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:01.966593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee4278ab-fa8e-4a56-bb19-11db5f5ad23d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:01.969800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee4278ab-fa8e-4a56-bb19-11db5f5ad23d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:01.970250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee4278ab-fa8e-4a56-bb19-11db5f5ad23d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:01.978982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee4278ab-fa8e-4a56-bb19-11db5f5ad23d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:01.979660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee4278ab-fa8e-4a56-bb19-11db5f5ad23d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:01.980174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee4278ab-fa8e-4a56-bb19-11db5f5ad23d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:02.593315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f72b02b3-f482-4195-b753-a48eed88d248 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:02.603466 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f72b02b3-f482-4195-b753-a48eed88d248 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 1.534261 Oct 05 17:45:02.604075 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1621/3052] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:01 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:02.615061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-68e78733-2f2f-40ff-9344-a6c2ffced229 req-a433ff32-9a0d-4643-8437-7d648a7caa20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64aabce-b60d-42c0-881b-43aa1880709b", "name": "network-vif-plugged", "status": "completed", "tag": "ca151148-f4dd-4fec-afc0-c8cb86c25709"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:02.651171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-68e78733-2f2f-40ff-9344-a6c2ffced229 req-a433ff32-9a0d-4643-8437-7d648a7caa20 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:02.651706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-68e78733-2f2f-40ff-9344-a6c2ffced229 req-a433ff32-9a0d-4643-8437-7d648a7caa20 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:02.652422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-68e78733-2f2f-40ff-9344-a6c2ffced229 req-a433ff32-9a0d-4643-8437-7d648a7caa20 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:02.686702 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-68e78733-2f2f-40ff-9344-a6c2ffced229 req-a433ff32-9a0d-4643-8437-7d648a7caa20 service nova] Creating event network-vif-plugged:ca151148-f4dd-4fec-afc0-c8cb86c25709 for instance d64aabce-b60d-42c0-881b-43aa1880709b on n-h1-835595-3 Oct 05 17:45:02.701874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ee4278ab-fa8e-4a56-bb19-11db5f5ad23d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:02.708453 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-68e78733-2f2f-40ff-9344-a6c2ffced229 req-a433ff32-9a0d-4643-8437-7d648a7caa20 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103104 Oct 05 17:45:02.714348 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ee4278ab-fa8e-4a56-bb19-11db5f5ad23d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1287 microversion: 2.1 time: 0.770795 Oct 05 17:45:02.714559 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1622/3053] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:02.719504 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1432/3054] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:01 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1287 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:02.977074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc98cea3-6c9a-452d-8fd4-1eb806c39ed5 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:02.979104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc98cea3-6c9a-452d-8fd4-1eb806c39ed5 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:02.993367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc98cea3-6c9a-452d-8fd4-1eb806c39ed5 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:02.993872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc98cea3-6c9a-452d-8fd4-1eb806c39ed5 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:02.994621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc98cea3-6c9a-452d-8fd4-1eb806c39ed5 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:02.996766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc98cea3-6c9a-452d-8fd4-1eb806c39ed5 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:02.997448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc98cea3-6c9a-452d-8fd4-1eb806c39ed5 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:02.998073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc98cea3-6c9a-452d-8fd4-1eb806c39ed5 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:03.556713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c12c3cb8-c846-4f5b-8e72-10c594ac704f req-5e92d7c2-1a7a-4f7c-aedd-f55baf07ac00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861d19af-3969-47e3-9887-e20a02de197f", "tag": "c398e3dd-834e-4b62-9832-e96be5cc76ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:03.577467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c12c3cb8-c846-4f5b-8e72-10c594ac704f req-5e92d7c2-1a7a-4f7c-aedd-f55baf07ac00 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:03.578582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c12c3cb8-c846-4f5b-8e72-10c594ac704f req-5e92d7c2-1a7a-4f7c-aedd-f55baf07ac00 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:03.579295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c12c3cb8-c846-4f5b-8e72-10c594ac704f req-5e92d7c2-1a7a-4f7c-aedd-f55baf07ac00 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:03.583958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc98cea3-6c9a-452d-8fd4-1eb806c39ed5 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:03.596092 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc98cea3-6c9a-452d-8fd4-1eb806c39ed5 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e" status: 200 len: 1518 microversion: 2.1 time: 0.630410 Oct 05 17:45:03.611506 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c12c3cb8-c846-4f5b-8e72-10c594ac704f req-5e92d7c2-1a7a-4f7c-aedd-f55baf07ac00 service nova] Creating event network-changed:c398e3dd-834e-4b62-9832-e96be5cc76ef for instance 861d19af-3969-47e3-9887-e20a02de197f on n-h1-835595-3 Oct 05 17:45:03.616553 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1623/3055] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:02 2022] GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e => generated 1518 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:03.620825 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c12c3cb8-c846-4f5b-8e72-10c594ac704f req-5e92d7c2-1a7a-4f7c-aedd-f55baf07ac00 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069239 Oct 05 17:45:03.624532 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1433/3056] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:45:03.643007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-289628c5-821e-4ec6-b630-ceedc6bf20b1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:03.643673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-289628c5-821e-4ec6-b630-ceedc6bf20b1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:03.657635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289628c5-821e-4ec6-b630-ceedc6bf20b1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:03.658144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289628c5-821e-4ec6-b630-ceedc6bf20b1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:03.663411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289628c5-821e-4ec6-b630-ceedc6bf20b1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:03.664784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289628c5-821e-4ec6-b630-ceedc6bf20b1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:03.665474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289628c5-821e-4ec6-b630-ceedc6bf20b1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:03.667259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289628c5-821e-4ec6-b630-ceedc6bf20b1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:03.698053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-fb8e5557-a6b2-4498-9846-8b8353fac98a req-94aba178-a4ec-4fb9-af47-7db40ad6c9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724e1789-37d2-4d11-8d47-0e5f5ef8b38e", "name": "network-vif-deleted", "tag": "91e2b936-b6a8-40cb-949e-282fc986a77b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:03.728879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fb8e5557-a6b2-4498-9846-8b8353fac98a req-94aba178-a4ec-4fb9-af47-7db40ad6c9f7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:03.729549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fb8e5557-a6b2-4498-9846-8b8353fac98a req-94aba178-a4ec-4fb9-af47-7db40ad6c9f7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:03.729791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fb8e5557-a6b2-4498-9846-8b8353fac98a req-94aba178-a4ec-4fb9-af47-7db40ad6c9f7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:03.760836 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-fb8e5557-a6b2-4498-9846-8b8353fac98a req-94aba178-a4ec-4fb9-af47-7db40ad6c9f7 service nova] Creating event network-vif-deleted:91e2b936-b6a8-40cb-949e-282fc986a77b for instance 724e1789-37d2-4d11-8d47-0e5f5ef8b38e on n-h1-835595-3 Oct 05 17:45:03.780467 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-fb8e5557-a6b2-4498-9846-8b8353fac98a req-94aba178-a4ec-4fb9-af47-7db40ad6c9f7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089893 Oct 05 17:45:03.784080 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1434/3057] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:45:03.796252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3332a520-587f-4b1f-b531-303b2e40457e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:03.801077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3332a520-587f-4b1f-b531-303b2e40457e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:03.816094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3332a520-587f-4b1f-b531-303b2e40457e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:03.819191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3332a520-587f-4b1f-b531-303b2e40457e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:03.819785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3332a520-587f-4b1f-b531-303b2e40457e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:03.820539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3332a520-587f-4b1f-b531-303b2e40457e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:03.821001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3332a520-587f-4b1f-b531-303b2e40457e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:03.821434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3332a520-587f-4b1f-b531-303b2e40457e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:04.140781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3332a520-587f-4b1f-b531-303b2e40457e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:04.152764 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3332a520-587f-4b1f-b531-303b2e40457e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1275 microversion: 2.1 time: 0.366949 Oct 05 17:45:04.160082 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1435/3058] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:03 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1275 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:04.412835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-289628c5-821e-4ec6-b630-ceedc6bf20b1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:04.424353 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-289628c5-821e-4ec6-b630-ceedc6bf20b1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.791554 Oct 05 17:45:04.425000 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1624/3059] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:03 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:04.624944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:04.625896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:04.642099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:04.648688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:04.649315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:04.651671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:04.652960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:04.658372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:04.801561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:04.802301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:04.802778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:04.803340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lazy-loading 'fault' on Instance uuid 724e1789-37d2-4d11-8d47-0e5f5ef8b38e {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:45:04.996198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:05.006933 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-baf35131-a982-476c-8d65-2da8d4e74ccc tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e" status: 200 len: 1310 microversion: 2.1 time: 0.386359 Oct 05 17:45:05.010009 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1436/3060] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:04 2022] GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e => generated 1310 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:05.187777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4cfb96b-5826-4434-964a-4f582b76e35a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:05.188397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b4cfb96b-5826-4434-964a-4f582b76e35a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:05.204238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4cfb96b-5826-4434-964a-4f582b76e35a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:05.206134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4cfb96b-5826-4434-964a-4f582b76e35a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:05.206616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4cfb96b-5826-4434-964a-4f582b76e35a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:05.210001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4cfb96b-5826-4434-964a-4f582b76e35a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:05.210538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4cfb96b-5826-4434-964a-4f582b76e35a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:05.213552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4cfb96b-5826-4434-964a-4f582b76e35a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:05.447369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8abd2532-8fe5-45ae-b98e-87630f689a46 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:05.448282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8abd2532-8fe5-45ae-b98e-87630f689a46 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:05.456914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8abd2532-8fe5-45ae-b98e-87630f689a46 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:05.456914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8abd2532-8fe5-45ae-b98e-87630f689a46 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:05.463387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8abd2532-8fe5-45ae-b98e-87630f689a46 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:05.464416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8abd2532-8fe5-45ae-b98e-87630f689a46 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:05.465088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8abd2532-8fe5-45ae-b98e-87630f689a46 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:05.465640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8abd2532-8fe5-45ae-b98e-87630f689a46 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:05.700623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4cfb96b-5826-4434-964a-4f582b76e35a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:05.711808 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b4cfb96b-5826-4434-964a-4f582b76e35a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 0.527514 Oct 05 17:45:05.715217 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1625/3061] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:05 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:06.036536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:06.037187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 724e1789-37d2-4d11-8d47-0e5f5ef8b38e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:06.046480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:06.046988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:06.047436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:06.060956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:06.061506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:06.061940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:06.117848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] HTTP exception thrown: Instance 724e1789-37d2-4d11-8d47-0e5f5ef8b38e could not be found. Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Request method failure captured: Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e HTTP/1.1 Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcJF02QF-k4gtZiB2DEqksmc_G5CdydRwl4YbZ-8u_nNiSXlo_AzTLH0Pg_Ab2Vjz1v-ona8LW2-YcmfSxBvYksOtvxzYYO2NeJXA-A4DckOw4shCUxykhiRQjlayHrGgsk2cksFJjZ3tRL1VudwRnyvgYXpqmfEl85TT0KG5EQTiBg Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7956891e6f6e4d34a6180bf39302dba9 Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ListServerFiltersTestJSON-67927586 Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7956891e6f6e4d34a6180bf39302dba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7956891e6f6e4d34a6180bf39302dba9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7956891e6f6e4d34a6180bf39302dba9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7956891e6f6e4d34a6180bf39302dba9"}]}] Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ListServerFiltersTestJSON-67927586 Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7956891e6f6e4d34a6180bf39302dba9 Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-67927586 Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ListServerFiltersTestJSON-67927586-project Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 3cd8c8eb0eac4ad3b8364e5fe54bc340 Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ListServerFiltersTestJSON-67927586-project Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 724e1789-37d2-4d11-8d47-0e5f5ef8b38e could not be found. Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '724e1789-37d2-4d11-8d47-0e5f5ef8b38e'} Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724e1789-37d2-4d11-8d47-0e5f5ef8b38e could not be found. Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724e1789-37d2-4d11-8d47-0e5f5ef8b38e could not be found. Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:45:06.124905 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:45:06.130022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:45:06.130022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:45:06.130022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:45:06.130022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:45:06.130022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:45:06.130022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724e1789-37d2-4d11-8d47-0e5f5ef8b38e could not be found. Oct 05 17:45:06.130022 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:45:06.135058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Returning 404 to user: Instance 724e1789-37d2-4d11-8d47-0e5f5ef8b38e could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:45:06.136321 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-64be17a5-41b8-4b52-9ac1-a35a3cbabfa2 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e" status: 404 len: 111 microversion: 2.1 time: 0.104915 Oct 05 17:45:06.138139 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1626/3062] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:06 2022] GET /compute/v2.1/servers/724e1789-37d2-4d11-8d47-0e5f5ef8b38e => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:45:06.151081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f54907e3-9081-402e-8051-991950b3d968 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:06.152115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f54907e3-9081-402e-8051-991950b3d968 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:06.165471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f54907e3-9081-402e-8051-991950b3d968 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:06.168359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f54907e3-9081-402e-8051-991950b3d968 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:06.169031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f54907e3-9081-402e-8051-991950b3d968 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:06.169950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f54907e3-9081-402e-8051-991950b3d968 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:06.170838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f54907e3-9081-402e-8051-991950b3d968 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:06.174058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f54907e3-9081-402e-8051-991950b3d968 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:06.186791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8abd2532-8fe5-45ae-b98e-87630f689a46 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:06.200133 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8abd2532-8fe5-45ae-b98e-87630f689a46 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.755231 Oct 05 17:45:06.215511 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1437/3063] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:05 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:06.228739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f54907e3-9081-402e-8051-991950b3d968 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:45:06.382433 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f54907e3-9081-402e-8051-991950b3d968 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "DELETE /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 204 len: 0 microversion: 2.1 time: 0.239507 Oct 05 17:45:06.383460 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1627/3064] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:45:06 2022] DELETE /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:45:06.425540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d9283155-096a-49b1-80ed-df1a15035798 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:06.427624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d9283155-096a-49b1-80ed-df1a15035798 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:06.455641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9283155-096a-49b1-80ed-df1a15035798 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:06.462067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9283155-096a-49b1-80ed-df1a15035798 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:06.464084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9283155-096a-49b1-80ed-df1a15035798 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:06.472672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9283155-096a-49b1-80ed-df1a15035798 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:06.473936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9283155-096a-49b1-80ed-df1a15035798 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:06.474655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9283155-096a-49b1-80ed-df1a15035798 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:06.670488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-293246340", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "941b871a-4b4c-4da8-8d9e-bb2ee1c9a341"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:06.812109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] validate_networks() for [('941b871a-4b4c-4da8-8d9e-bb2ee1c9a341', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:45:07.303638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=10 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:08.713951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d9283155-096a-49b1-80ed-df1a15035798 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:08.724045 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d9283155-096a-49b1-80ed-df1a15035798 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1517 microversion: 2.1 time: 2.329528 Oct 05 17:45:08.728727 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1628/3065] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:06 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1517 bytes in 2335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:08.756656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a09de4f-c36e-4b76-bf16-31e5d3f5ee59 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:08.757875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4a09de4f-c36e-4b76-bf16-31e5d3f5ee59 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:08.774507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a09de4f-c36e-4b76-bf16-31e5d3f5ee59 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:08.775012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a09de4f-c36e-4b76-bf16-31e5d3f5ee59 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:08.788465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a09de4f-c36e-4b76-bf16-31e5d3f5ee59 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:08.789580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a09de4f-c36e-4b76-bf16-31e5d3f5ee59 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:08.792622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a09de4f-c36e-4b76-bf16-31e5d3f5ee59 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:08.792976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a09de4f-c36e-4b76-bf16-31e5d3f5ee59 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:08.860991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=14 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:08.969417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:09.485623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:45:09.486495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:45:09.487279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:45:09.487857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:45:09.488435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:45:09.530418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:09.531245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:09.531858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:09.532792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:09.533444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:09.534495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:09.606031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Getting quotas for project 322009e2b6f2443c9c3e8f0a43bd7567. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:09.616318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Getting quotas for user 8878ab6c93164071bb4602782e3d5e5c and project 322009e2b6f2443c9c3e8f0a43bd7567. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:09.666899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:45:09.672415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:45:09.813976 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2ff12baa-a68f-4882-a49e-928a52ec044e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.428150 Oct 05 17:45:09.815442 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1438/3066] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:45:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 3431 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:45:09.821443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de32a1b6-9379-460e-a5bb-0b24ae5dc0b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:09.822673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-de32a1b6-9379-460e-a5bb-0b24ae5dc0b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:09.831471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de32a1b6-9379-460e-a5bb-0b24ae5dc0b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:09.832461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de32a1b6-9379-460e-a5bb-0b24ae5dc0b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:09.833276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de32a1b6-9379-460e-a5bb-0b24ae5dc0b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:09.834485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de32a1b6-9379-460e-a5bb-0b24ae5dc0b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:09.835208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de32a1b6-9379-460e-a5bb-0b24ae5dc0b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:09.835856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de32a1b6-9379-460e-a5bb-0b24ae5dc0b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:10.092032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4a09de4f-c36e-4b76-bf16-31e5d3f5ee59 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:10.108751 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4a09de4f-c36e-4b76-bf16-31e5d3f5ee59 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 1.371455 Oct 05 17:45:10.109409 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1629/3067] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:08 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:10.135568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c2dec069-1f21-40c6-9a29-ebc079306d97 req-b1316ac9-7b41-4f82-8ee3-affbd6937b05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "989ec240-1506-4643-b1e7-0a849f54db3d", "tag": "ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:10.187387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:10.194314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c2dec069-1f21-40c6-9a29-ebc079306d97 req-b1316ac9-7b41-4f82-8ee3-affbd6937b05 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:10.195571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c2dec069-1f21-40c6-9a29-ebc079306d97 req-b1316ac9-7b41-4f82-8ee3-affbd6937b05 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:10.195939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c2dec069-1f21-40c6-9a29-ebc079306d97 req-b1316ac9-7b41-4f82-8ee3-affbd6937b05 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:10.237601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c2dec069-1f21-40c6-9a29-ebc079306d97 req-b1316ac9-7b41-4f82-8ee3-affbd6937b05 service nova] Creating event network-changed:ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8 for instance 989ec240-1506-4643-b1e7-0a849f54db3d on n-h2-835595-3 Oct 05 17:45:10.254049 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c2dec069-1f21-40c6-9a29-ebc079306d97 req-b1316ac9-7b41-4f82-8ee3-affbd6937b05 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143326 Oct 05 17:45:10.267672 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1630/3068] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:10.277535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ff1cfb59-1d6e-4cd1-92a3-b8f9178d8d92 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:10.287480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ff1cfb59-1d6e-4cd1-92a3-b8f9178d8d92 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:10.307930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff1cfb59-1d6e-4cd1-92a3-b8f9178d8d92 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:10.308441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff1cfb59-1d6e-4cd1-92a3-b8f9178d8d92 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:10.308887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff1cfb59-1d6e-4cd1-92a3-b8f9178d8d92 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:10.318494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff1cfb59-1d6e-4cd1-92a3-b8f9178d8d92 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:10.319548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff1cfb59-1d6e-4cd1-92a3-b8f9178d8d92 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:10.321060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff1cfb59-1d6e-4cd1-92a3-b8f9178d8d92 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:10.997487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-de32a1b6-9379-460e-a5bb-0b24ae5dc0b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:11.015667 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de32a1b6-9379-460e-a5bb-0b24ae5dc0b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 1.198817 Oct 05 17:45:11.016381 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1439/3069] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:09 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:11.022409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-042f9188-8306-4ff0-ae2f-3edfb767102e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:11.033183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-042f9188-8306-4ff0-ae2f-3edfb767102e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:11.060262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-042f9188-8306-4ff0-ae2f-3edfb767102e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:11.060770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-042f9188-8306-4ff0-ae2f-3edfb767102e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:11.061190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-042f9188-8306-4ff0-ae2f-3edfb767102e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:11.061902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-042f9188-8306-4ff0-ae2f-3edfb767102e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:11.062387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-042f9188-8306-4ff0-ae2f-3edfb767102e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:11.062804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-042f9188-8306-4ff0-ae2f-3edfb767102e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:11.310408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-042f9188-8306-4ff0-ae2f-3edfb767102e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:11.321844 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-042f9188-8306-4ff0-ae2f-3edfb767102e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1221 microversion: 2.1 time: 0.303989 Oct 05 17:45:11.322716 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1440/3070] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:11 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1221 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:11.349402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4fea53a2-682d-43e0-a0d4-5eda41bc0625 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:11.350029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4fea53a2-682d-43e0-a0d4-5eda41bc0625 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:11.371389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fea53a2-682d-43e0-a0d4-5eda41bc0625 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:11.371859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fea53a2-682d-43e0-a0d4-5eda41bc0625 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:11.379181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fea53a2-682d-43e0-a0d4-5eda41bc0625 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:11.380182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fea53a2-682d-43e0-a0d4-5eda41bc0625 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:11.380844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fea53a2-682d-43e0-a0d4-5eda41bc0625 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:11.381433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fea53a2-682d-43e0-a0d4-5eda41bc0625 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:11.900650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ff1cfb59-1d6e-4cd1-92a3-b8f9178d8d92 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd8c8eb0eac4ad3b8364e5fe54bc340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7956891e6f6e4d34a6180bf39302dba9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:11.916249 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ff1cfb59-1d6e-4cd1-92a3-b8f9178d8d92 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 200 len: 1517 microversion: 2.1 time: 1.642284 Oct 05 17:45:11.919891 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1631/3071] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:10 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 1517 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:11.950503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-58ac7b50-aab7-4481-a2ec-7a1fce10ec82 req-ef5bd0e7-d9fe-41ed-be27-571b5319fff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56bc233a-cffb-408b-a620-c3f7f909230d", "name": "network-vif-deleted", "tag": "d82a9349-89ca-4494-921c-b29ca5e98f6a"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:11.959798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4fea53a2-682d-43e0-a0d4-5eda41bc0625 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:11.984736 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4fea53a2-682d-43e0-a0d4-5eda41bc0625 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 0.638004 Oct 05 17:45:11.985475 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1441/3072] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:11 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:11.995079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-58ac7b50-aab7-4481-a2ec-7a1fce10ec82 req-ef5bd0e7-d9fe-41ed-be27-571b5319fff8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:11.998835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-58ac7b50-aab7-4481-a2ec-7a1fce10ec82 req-ef5bd0e7-d9fe-41ed-be27-571b5319fff8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:11.999321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-58ac7b50-aab7-4481-a2ec-7a1fce10ec82 req-ef5bd0e7-d9fe-41ed-be27-571b5319fff8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:12.027922 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-58ac7b50-aab7-4481-a2ec-7a1fce10ec82 req-ef5bd0e7-d9fe-41ed-be27-571b5319fff8 service nova] Creating event network-vif-deleted:d82a9349-89ca-4494-921c-b29ca5e98f6a for instance 56bc233a-cffb-408b-a620-c3f7f909230d on n-h1-835595-3 Oct 05 17:45:12.034496 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-58ac7b50-aab7-4481-a2ec-7a1fce10ec82 req-ef5bd0e7-d9fe-41ed-be27-571b5319fff8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104455 Oct 05 17:45:12.035817 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1632/3073] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:12.051258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f65458b7-7a00-4f54-a05c-fb2908bdc2d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:12.052857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f65458b7-7a00-4f54-a05c-fb2908bdc2d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:12.063390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f65458b7-7a00-4f54-a05c-fb2908bdc2d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:12.065346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f65458b7-7a00-4f54-a05c-fb2908bdc2d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:12.067618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f65458b7-7a00-4f54-a05c-fb2908bdc2d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:12.068813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f65458b7-7a00-4f54-a05c-fb2908bdc2d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:12.069603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f65458b7-7a00-4f54-a05c-fb2908bdc2d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:12.070338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f65458b7-7a00-4f54-a05c-fb2908bdc2d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:12.345353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90d9dcc4-2012-43de-bcea-c7282d6119bf tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:12.346079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90d9dcc4-2012-43de-bcea-c7282d6119bf tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:12.353224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f65458b7-7a00-4f54-a05c-fb2908bdc2d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:12.362997 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f65458b7-7a00-4f54-a05c-fb2908bdc2d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.323117 Oct 05 17:45:12.368809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90d9dcc4-2012-43de-bcea-c7282d6119bf tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:12.380504 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1442/3074] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:12 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:12.386684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90d9dcc4-2012-43de-bcea-c7282d6119bf tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:12.387268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90d9dcc4-2012-43de-bcea-c7282d6119bf tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:12.388045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90d9dcc4-2012-43de-bcea-c7282d6119bf tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:12.388519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90d9dcc4-2012-43de-bcea-c7282d6119bf tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:12.395306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90d9dcc4-2012-43de-bcea-c7282d6119bf tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:12.432261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:12.447981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-25170f48-c3a9-4b17-aa8e-ba1b1f8ee144 req-9f22cd15-86a5-48f0-968d-4bbf9658f1f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3caa633-ebf4-4260-9dc5-bcc736013af2", "tag": "30f075ed-d317-4f30-9da2-0931dec00b11"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:12.471423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-25170f48-c3a9-4b17-aa8e-ba1b1f8ee144 req-9f22cd15-86a5-48f0-968d-4bbf9658f1f2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:12.472110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-25170f48-c3a9-4b17-aa8e-ba1b1f8ee144 req-9f22cd15-86a5-48f0-968d-4bbf9658f1f2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:12.472704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-25170f48-c3a9-4b17-aa8e-ba1b1f8ee144 req-9f22cd15-86a5-48f0-968d-4bbf9658f1f2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:12.488816 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-25170f48-c3a9-4b17-aa8e-ba1b1f8ee144 req-9f22cd15-86a5-48f0-968d-4bbf9658f1f2 service nova] Creating event network-changed:30f075ed-d317-4f30-9da2-0931dec00b11 for instance d3caa633-ebf4-4260-9dc5-bcc736013af2 on n-h1-835595-3 Oct 05 17:45:12.508110 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-25170f48-c3a9-4b17-aa8e-ba1b1f8ee144 req-9f22cd15-86a5-48f0-968d-4bbf9658f1f2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067517 Oct 05 17:45:12.509374 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1443/3075] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:45:12.823375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90d9dcc4-2012-43de-bcea-c7282d6119bf tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:12.861509 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90d9dcc4-2012-43de-bcea-c7282d6119bf tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1269 microversion: 2.1 time: 0.518835 Oct 05 17:45:12.865058 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1633/3076] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:12 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1269 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:12.945265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:12.946349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] [instance: 56bc233a-cffb-408b-a620-c3f7f909230d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:12.951141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:12.969338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:12.979099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:12.982360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:12.984902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:12.988375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:12.991701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:13.016666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-507afc59-4780-4ffa-b6c6-9a838f5a73a4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:13.018365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-507afc59-4780-4ffa-b6c6-9a838f5a73a4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:13.036034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-507afc59-4780-4ffa-b6c6-9a838f5a73a4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:13.036970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-507afc59-4780-4ffa-b6c6-9a838f5a73a4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:13.038888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-507afc59-4780-4ffa-b6c6-9a838f5a73a4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:13.039854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-507afc59-4780-4ffa-b6c6-9a838f5a73a4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:13.041746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-507afc59-4780-4ffa-b6c6-9a838f5a73a4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:13.043020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-507afc59-4780-4ffa-b6c6-9a838f5a73a4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:13.046833 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] HTTP exception thrown: Instance 56bc233a-cffb-408b-a620-c3f7f909230d could not be found. Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Request method failure captured: Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d HTTP/1.1 Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcJF02QF-k4gtZiB2DEqksmc_G5CdydRwl4YbZ-8u_nNiSXlo_AzTLH0Pg_Ab2Vjz1v-ona8LW2-YcmfSxBvYksOtvxzYYO2NeJXA-A4DckOw4shCUxykhiRQjlayHrGgsk2cksFJjZ3tRL1VudwRnyvgYXpqmfEl85TT0KG5EQTiBg Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7956891e6f6e4d34a6180bf39302dba9 Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ListServerFiltersTestJSON-67927586 Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7956891e6f6e4d34a6180bf39302dba9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7956891e6f6e4d34a6180bf39302dba9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7956891e6f6e4d34a6180bf39302dba9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7956891e6f6e4d34a6180bf39302dba9"}]}] Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ListServerFiltersTestJSON-67927586 Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7956891e6f6e4d34a6180bf39302dba9 Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-67927586 Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ListServerFiltersTestJSON-67927586-project Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 3cd8c8eb0eac4ad3b8364e5fe54bc340 Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ListServerFiltersTestJSON-67927586-project Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 56bc233a-cffb-408b-a620-c3f7f909230d could not be found. Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '56bc233a-cffb-408b-a620-c3f7f909230d'} Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56bc233a-cffb-408b-a620-c3f7f909230d could not be found. Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56bc233a-cffb-408b-a620-c3f7f909230d could not be found. Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:45:13.048798 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:45:13.053402 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:45:13.053402 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:45:13.053402 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:45:13.053402 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:45:13.053402 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:45:13.053402 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56bc233a-cffb-408b-a620-c3f7f909230d could not be found. Oct 05 17:45:13.053402 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:45:13.055160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] Returning 404 to user: Instance 56bc233a-cffb-408b-a620-c3f7f909230d could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:45:13.056223 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-72c2801f-1ded-42e7-8a12-f23e4d6f12b7 tempest-ListServerFiltersTestJSON-67927586 tempest-ListServerFiltersTestJSON-67927586-project] 10.222.0.70 "GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d" status: 404 len: 111 microversion: 2.1 time: 0.116786 Oct 05 17:45:13.067420 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1444/3077] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:12 2022] GET /compute/v2.1/servers/56bc233a-cffb-408b-a620-c3f7f909230d => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:45:13.400626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ba6e4306-0e94-494c-92b8-b720ed287fc8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:13.404343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ba6e4306-0e94-494c-92b8-b720ed287fc8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:13.418498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba6e4306-0e94-494c-92b8-b720ed287fc8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:13.419270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba6e4306-0e94-494c-92b8-b720ed287fc8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:13.420840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba6e4306-0e94-494c-92b8-b720ed287fc8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:13.422233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba6e4306-0e94-494c-92b8-b720ed287fc8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:13.423866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba6e4306-0e94-494c-92b8-b720ed287fc8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:13.424602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba6e4306-0e94-494c-92b8-b720ed287fc8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:13.744555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-507afc59-4780-4ffa-b6c6-9a838f5a73a4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:13.770793 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-507afc59-4780-4ffa-b6c6-9a838f5a73a4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 0.761255 Oct 05 17:45:13.783029 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1634/3078] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:13 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:13.890340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e9e6d914-3e82-422e-9476-2d06aaaf2ba9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:13.890978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e9e6d914-3e82-422e-9476-2d06aaaf2ba9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:13.906855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9e6d914-3e82-422e-9476-2d06aaaf2ba9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:13.907277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9e6d914-3e82-422e-9476-2d06aaaf2ba9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:13.907737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9e6d914-3e82-422e-9476-2d06aaaf2ba9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:13.908567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9e6d914-3e82-422e-9476-2d06aaaf2ba9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:13.909212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9e6d914-3e82-422e-9476-2d06aaaf2ba9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:13.914989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9e6d914-3e82-422e-9476-2d06aaaf2ba9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:14.059802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e9e6d914-3e82-422e-9476-2d06aaaf2ba9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:14.076387 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e9e6d914-3e82-422e-9476-2d06aaaf2ba9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1275 microversion: 2.1 time: 0.191003 Oct 05 17:45:14.079455 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1635/3079] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:13 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:14.180563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ba6e4306-0e94-494c-92b8-b720ed287fc8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:14.194750 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ba6e4306-0e94-494c-92b8-b720ed287fc8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.801406 Oct 05 17:45:14.196397 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1445/3080] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:13 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:14.817506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2403526a-4ac8-474d-a1f8-884ac45a3f93 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:14.820237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2403526a-4ac8-474d-a1f8-884ac45a3f93 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:14.839266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2403526a-4ac8-474d-a1f8-884ac45a3f93 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:14.845580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2403526a-4ac8-474d-a1f8-884ac45a3f93 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:14.855015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2403526a-4ac8-474d-a1f8-884ac45a3f93 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:14.860337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2403526a-4ac8-474d-a1f8-884ac45a3f93 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:14.861177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2403526a-4ac8-474d-a1f8-884ac45a3f93 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:14.861806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2403526a-4ac8-474d-a1f8-884ac45a3f93 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:15.105255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5a2ee23c-7b47-41cf-bea3-0fd4959c17e4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:15.106197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5a2ee23c-7b47-41cf-bea3-0fd4959c17e4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:15.118095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a2ee23c-7b47-41cf-bea3-0fd4959c17e4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:15.118855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a2ee23c-7b47-41cf-bea3-0fd4959c17e4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:15.122602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a2ee23c-7b47-41cf-bea3-0fd4959c17e4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:15.123641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a2ee23c-7b47-41cf-bea3-0fd4959c17e4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:15.124324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a2ee23c-7b47-41cf-bea3-0fd4959c17e4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:15.127740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a2ee23c-7b47-41cf-bea3-0fd4959c17e4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:15.155235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2403526a-4ac8-474d-a1f8-884ac45a3f93 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:15.165638 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2403526a-4ac8-474d-a1f8-884ac45a3f93 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 0.373571 Oct 05 17:45:15.185554 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1636/3081] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:14 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:15.223486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5a36889-7713-4476-8980-2b632288caa9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:15.224215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b5a36889-7713-4476-8980-2b632288caa9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:15.233847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5a36889-7713-4476-8980-2b632288caa9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:15.234482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5a36889-7713-4476-8980-2b632288caa9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:15.242346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5a36889-7713-4476-8980-2b632288caa9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:15.243420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5a36889-7713-4476-8980-2b632288caa9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:15.244085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5a36889-7713-4476-8980-2b632288caa9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:15.244584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5a36889-7713-4476-8980-2b632288caa9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:15.647692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b5a36889-7713-4476-8980-2b632288caa9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:15.656643 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b5a36889-7713-4476-8980-2b632288caa9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.437134 Oct 05 17:45:15.657236 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1637/3082] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:15 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:15.710308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5a2ee23c-7b47-41cf-bea3-0fd4959c17e4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:15.721733 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5a2ee23c-7b47-41cf-bea3-0fd4959c17e4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1275 microversion: 2.1 time: 0.620309 Oct 05 17:45:15.722665 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1446/3083] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:15 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1275 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:16.193997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40d6dfba-ddfa-4862-ab2c-6dccc8b9ca43 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:16.194908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-40d6dfba-ddfa-4862-ab2c-6dccc8b9ca43 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:16.209178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d6dfba-ddfa-4862-ab2c-6dccc8b9ca43 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:16.209689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d6dfba-ddfa-4862-ab2c-6dccc8b9ca43 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:16.210192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d6dfba-ddfa-4862-ab2c-6dccc8b9ca43 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:16.214947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d6dfba-ddfa-4862-ab2c-6dccc8b9ca43 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:16.218458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d6dfba-ddfa-4862-ab2c-6dccc8b9ca43 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:16.219162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d6dfba-ddfa-4862-ab2c-6dccc8b9ca43 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:16.685891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e5650e7d-8aae-4746-8374-37bcf61d38b8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:16.686764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e5650e7d-8aae-4746-8374-37bcf61d38b8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:16.714241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5650e7d-8aae-4746-8374-37bcf61d38b8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:16.717523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5650e7d-8aae-4746-8374-37bcf61d38b8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:16.718113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5650e7d-8aae-4746-8374-37bcf61d38b8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:16.725079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5650e7d-8aae-4746-8374-37bcf61d38b8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:16.725835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5650e7d-8aae-4746-8374-37bcf61d38b8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:16.726415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5650e7d-8aae-4746-8374-37bcf61d38b8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:16.755742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:17.136176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40d6dfba-ddfa-4862-ab2c-6dccc8b9ca43 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:17.144959 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-40d6dfba-ddfa-4862-ab2c-6dccc8b9ca43 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 0.955733 Oct 05 17:45:17.145903 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1638/3084] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:16 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:17.151083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-432fbcdf-bbbc-42a8-af86-9c64141ad4b1 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:17.151959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-432fbcdf-bbbc-42a8-af86-9c64141ad4b1 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:17.170845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-432fbcdf-bbbc-42a8-af86-9c64141ad4b1 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:17.171704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-432fbcdf-bbbc-42a8-af86-9c64141ad4b1 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:17.172434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-432fbcdf-bbbc-42a8-af86-9c64141ad4b1 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:17.174297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-432fbcdf-bbbc-42a8-af86-9c64141ad4b1 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:17.174943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-432fbcdf-bbbc-42a8-af86-9c64141ad4b1 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:17.175907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-432fbcdf-bbbc-42a8-af86-9c64141ad4b1 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:17.290116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e5650e7d-8aae-4746-8374-37bcf61d38b8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:17.309721 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e5650e7d-8aae-4746-8374-37bcf61d38b8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.626324 Oct 05 17:45:17.312378 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1447/3085] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:16 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:17.950508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-432fbcdf-bbbc-42a8-af86-9c64141ad4b1 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:17.966026 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-432fbcdf-bbbc-42a8-af86-9c64141ad4b1 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1317 microversion: 2.1 time: 0.815401 Oct 05 17:45:17.971133 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1639/3086] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:17 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1317 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:18.169329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-938ed9b0-aac6-4d14-bca1-ca82b23d4ede tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:18.169948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-938ed9b0-aac6-4d14-bca1-ca82b23d4ede tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:18.186056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-938ed9b0-aac6-4d14-bca1-ca82b23d4ede tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:18.186824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-938ed9b0-aac6-4d14-bca1-ca82b23d4ede tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:18.187504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-938ed9b0-aac6-4d14-bca1-ca82b23d4ede tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:18.189088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-938ed9b0-aac6-4d14-bca1-ca82b23d4ede tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:18.189785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-938ed9b0-aac6-4d14-bca1-ca82b23d4ede tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:18.190609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-938ed9b0-aac6-4d14-bca1-ca82b23d4ede tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:18.332876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-06c8f9da-ea96-4227-8630-e00103356275 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:18.333492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-06c8f9da-ea96-4227-8630-e00103356275 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:18.356331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c8f9da-ea96-4227-8630-e00103356275 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:18.356966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c8f9da-ea96-4227-8630-e00103356275 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:18.357426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c8f9da-ea96-4227-8630-e00103356275 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:18.358198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c8f9da-ea96-4227-8630-e00103356275 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:18.359777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c8f9da-ea96-4227-8630-e00103356275 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:18.365033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06c8f9da-ea96-4227-8630-e00103356275 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:18.808718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-06c8f9da-ea96-4227-8630-e00103356275 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:18.822348 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-06c8f9da-ea96-4227-8630-e00103356275 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.493116 Oct 05 17:45:18.834797 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1640/3087] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:18 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:18.989108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-62494aa5-15f7-4cad-8bd1-40978915eb7c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:18.990158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-62494aa5-15f7-4cad-8bd1-40978915eb7c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:18.997203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62494aa5-15f7-4cad-8bd1-40978915eb7c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:19.002968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62494aa5-15f7-4cad-8bd1-40978915eb7c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:19.003689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62494aa5-15f7-4cad-8bd1-40978915eb7c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:19.004609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62494aa5-15f7-4cad-8bd1-40978915eb7c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:19.006264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62494aa5-15f7-4cad-8bd1-40978915eb7c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:19.009205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62494aa5-15f7-4cad-8bd1-40978915eb7c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:19.094620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-938ed9b0-aac6-4d14-bca1-ca82b23d4ede tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:19.103987 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-938ed9b0-aac6-4d14-bca1-ca82b23d4ede tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 0.938504 Oct 05 17:45:19.108456 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1448/3088] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:18 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:19.151991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-67501d62-9401-4b49-92ce-5e02770cf0ba req-5386bc45-d409-435b-bbe5-4f341d4bc9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989ec240-1506-4643-b1e7-0a849f54db3d", "name": "network-vif-plugged", "status": "completed", "tag": "ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:19.183905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-67501d62-9401-4b49-92ce-5e02770cf0ba req-5386bc45-d409-435b-bbe5-4f341d4bc9be service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:19.185756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-67501d62-9401-4b49-92ce-5e02770cf0ba req-5386bc45-d409-435b-bbe5-4f341d4bc9be service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:19.186910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-67501d62-9401-4b49-92ce-5e02770cf0ba req-5386bc45-d409-435b-bbe5-4f341d4bc9be service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:19.251289 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-67501d62-9401-4b49-92ce-5e02770cf0ba req-5386bc45-d409-435b-bbe5-4f341d4bc9be service nova] Creating event network-vif-plugged:ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8 for instance 989ec240-1506-4643-b1e7-0a849f54db3d on n-h2-835595-3 Oct 05 17:45:19.267659 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-67501d62-9401-4b49-92ce-5e02770cf0ba req-5386bc45-d409-435b-bbe5-4f341d4bc9be service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114462 Oct 05 17:45:19.269946 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1449/3089] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:45:19.294534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f81a1077-6d3a-4ed8-b1cb-15474c28cfb7 req-432516f2-f61b-4f7e-b103-a1eeff30e829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3fc4e4d-9f2d-4df2-bf41-9fd764de0382", "tag": "ba6a5ab9-d39f-4718-9a48-4bc6c5c16d68"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:19.314459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f81a1077-6d3a-4ed8-b1cb-15474c28cfb7 req-432516f2-f61b-4f7e-b103-a1eeff30e829 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:19.314942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f81a1077-6d3a-4ed8-b1cb-15474c28cfb7 req-432516f2-f61b-4f7e-b103-a1eeff30e829 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:19.316038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f81a1077-6d3a-4ed8-b1cb-15474c28cfb7 req-432516f2-f61b-4f7e-b103-a1eeff30e829 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:19.341625 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f81a1077-6d3a-4ed8-b1cb-15474c28cfb7 req-432516f2-f61b-4f7e-b103-a1eeff30e829 service nova] Creating event network-changed:ba6a5ab9-d39f-4718-9a48-4bc6c5c16d68 for instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 on n-h2-835595-3 Oct 05 17:45:19.356691 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f81a1077-6d3a-4ed8-b1cb-15474c28cfb7 req-432516f2-f61b-4f7e-b103-a1eeff30e829 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065912 Oct 05 17:45:19.358794 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1450/3090] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:45:19.424210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-62494aa5-15f7-4cad-8bd1-40978915eb7c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:19.440144 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-62494aa5-15f7-4cad-8bd1-40978915eb7c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1317 microversion: 2.1 time: 0.454795 Oct 05 17:45:19.451893 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1641/3091] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:18 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:19.571764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:19.634805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:19.846668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-224ab57a-eac4-4ff1-ae93-1e7644a1ed9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:19.847567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-224ab57a-eac4-4ff1-ae93-1e7644a1ed9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:19.854459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224ab57a-eac4-4ff1-ae93-1e7644a1ed9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:19.855166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224ab57a-eac4-4ff1-ae93-1e7644a1ed9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:19.855612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224ab57a-eac4-4ff1-ae93-1e7644a1ed9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:19.856332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224ab57a-eac4-4ff1-ae93-1e7644a1ed9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:19.856916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224ab57a-eac4-4ff1-ae93-1e7644a1ed9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:19.857344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-224ab57a-eac4-4ff1-ae93-1e7644a1ed9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:19.874602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-868306195", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": "none"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:19.983222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:45:19.983929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:45:19.984646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:45:19.985226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:45:19.985643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:45:19.995632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:19.996118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:19.996729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:19.997982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:19.998628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:19.999441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:20.018760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Getting quotas for project 5c678dd1e05b4d148d8ae63076a8ed28. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:20.025198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Getting quotas for user 142e1db84c1f4fa5a75ca9fb2489f230 and project 5c678dd1e05b4d148d8ae63076a8ed28. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:20.038568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:45:20.041569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:45:20.089707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-224ab57a-eac4-4ff1-ae93-1e7644a1ed9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:20.103778 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-224ab57a-eac4-4ff1-ae93-1e7644a1ed9d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.260862 Oct 05 17:45:20.104614 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1642/3092] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:19 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:20.108610 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8787c46c-61cb-4ab1-bf2d-78955cb9f0dc tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.678378 Oct 05 17:45:20.115802 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1451/3093] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:45:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 05 17:45:20.123107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4933c0f7-6732-4350-9c4a-ac5863ac6f67 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:20.123962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4933c0f7-6732-4350-9c4a-ac5863ac6f67 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:20.135373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7918c272-2122-4fe8-8eed-a8ae0bbf9bc4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:20.136002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7918c272-2122-4fe8-8eed-a8ae0bbf9bc4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:20.165060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7918c272-2122-4fe8-8eed-a8ae0bbf9bc4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:20.165558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7918c272-2122-4fe8-8eed-a8ae0bbf9bc4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:20.165993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7918c272-2122-4fe8-8eed-a8ae0bbf9bc4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:20.171181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7918c272-2122-4fe8-8eed-a8ae0bbf9bc4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:20.171685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7918c272-2122-4fe8-8eed-a8ae0bbf9bc4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:20.172298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7918c272-2122-4fe8-8eed-a8ae0bbf9bc4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:20.265477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4933c0f7-6732-4350-9c4a-ac5863ac6f67 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:20.277394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4933c0f7-6732-4350-9c4a-ac5863ac6f67 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:20.279358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4933c0f7-6732-4350-9c4a-ac5863ac6f67 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:20.280784 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4933c0f7-6732-4350-9c4a-ac5863ac6f67 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 200 len: 1280 microversion: 2.47 time: 0.163579 Oct 05 17:45:20.283070 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1643/3094] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:20 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 1280 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:45:20.474043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-039dc6c4-d4ff-4863-a5db-762ce5b432b9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:20.474937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-039dc6c4-d4ff-4863-a5db-762ce5b432b9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:20.482327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-039dc6c4-d4ff-4863-a5db-762ce5b432b9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:20.483047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-039dc6c4-d4ff-4863-a5db-762ce5b432b9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:20.483668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-039dc6c4-d4ff-4863-a5db-762ce5b432b9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:20.485135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-039dc6c4-d4ff-4863-a5db-762ce5b432b9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:20.486370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-039dc6c4-d4ff-4863-a5db-762ce5b432b9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:20.486998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-039dc6c4-d4ff-4863-a5db-762ce5b432b9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:20.591057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7918c272-2122-4fe8-8eed-a8ae0bbf9bc4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:20.600727 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7918c272-2122-4fe8-8eed-a8ae0bbf9bc4 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 0.471824 Oct 05 17:45:20.602136 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1452/3095] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:20 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:20.825158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-039dc6c4-d4ff-4863-a5db-762ce5b432b9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:20.842316 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-039dc6c4-d4ff-4863-a5db-762ce5b432b9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1317 microversion: 2.1 time: 0.372750 Oct 05 17:45:20.858856 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1644/3096] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:20 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:21.130661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85f71253-8027-4829-9eba-c9ad809cb4be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:21.131819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-85f71253-8027-4829-9eba-c9ad809cb4be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:21.146344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85f71253-8027-4829-9eba-c9ad809cb4be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:21.148137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85f71253-8027-4829-9eba-c9ad809cb4be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:21.149009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85f71253-8027-4829-9eba-c9ad809cb4be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:21.149963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85f71253-8027-4829-9eba-c9ad809cb4be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:21.150825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85f71253-8027-4829-9eba-c9ad809cb4be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:21.151457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85f71253-8027-4829-9eba-c9ad809cb4be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:21.309228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:21.311097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:21.319436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:21.320207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:21.320644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:21.321501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:21.322067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:21.322785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:21.432163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:21.446017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:21.447529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:21.448892 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9e3622ea-ed10-4999-9829-ad8cea2634d3 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 200 len: 1332 microversion: 2.47 time: 0.144643 Oct 05 17:45:21.462170 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1645/3097] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:21 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 1332 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:45:21.480689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4a3e8604-be3e-4513-ac7c-9186e6a17289 req-a1e5bf04-c62c-44e3-9860-3ac888b433ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3caa633-ebf4-4260-9dc5-bcc736013af2", "name": "network-vif-plugged", "status": "completed", "tag": "30f075ed-d317-4f30-9da2-0931dec00b11"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:21.497287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4a3e8604-be3e-4513-ac7c-9186e6a17289 req-a1e5bf04-c62c-44e3-9860-3ac888b433ca service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:21.497774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4a3e8604-be3e-4513-ac7c-9186e6a17289 req-a1e5bf04-c62c-44e3-9860-3ac888b433ca service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:21.498209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4a3e8604-be3e-4513-ac7c-9186e6a17289 req-a1e5bf04-c62c-44e3-9860-3ac888b433ca service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:21.516297 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4a3e8604-be3e-4513-ac7c-9186e6a17289 req-a1e5bf04-c62c-44e3-9860-3ac888b433ca service nova] Creating event network-vif-plugged:30f075ed-d317-4f30-9da2-0931dec00b11 for instance d3caa633-ebf4-4260-9dc5-bcc736013af2 on n-h1-835595-3 Oct 05 17:45:21.527011 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4a3e8604-be3e-4513-ac7c-9186e6a17289 req-a1e5bf04-c62c-44e3-9860-3ac888b433ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053778 Oct 05 17:45:21.528118 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1646/3098] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:21.590981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85f71253-8027-4829-9eba-c9ad809cb4be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:21.600286 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85f71253-8027-4829-9eba-c9ad809cb4be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1505 microversion: 2.1 time: 0.474705 Oct 05 17:45:21.607210 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1453/3099] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:21 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:21.626757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2c68c453-bed3-4326-844f-26b5ace00ceb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:21.627444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2c68c453-bed3-4326-844f-26b5ace00ceb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:21.633898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c68c453-bed3-4326-844f-26b5ace00ceb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:21.634498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c68c453-bed3-4326-844f-26b5ace00ceb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:21.634991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c68c453-bed3-4326-844f-26b5ace00ceb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:21.636036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c68c453-bed3-4326-844f-26b5ace00ceb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:21.636681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c68c453-bed3-4326-844f-26b5ace00ceb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:21.637365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c68c453-bed3-4326-844f-26b5ace00ceb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:21.810085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2c68c453-bed3-4326-844f-26b5ace00ceb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:21.819553 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2c68c453-bed3-4326-844f-26b5ace00ceb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 0.197113 Oct 05 17:45:21.820141 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1647/3100] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:21 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:21.866900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f2090bd3-b4f3-4cf1-aa42-7e924b7da689 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:21.867766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f2090bd3-b4f3-4cf1-aa42-7e924b7da689 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:21.878394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2090bd3-b4f3-4cf1-aa42-7e924b7da689 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:21.878843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2090bd3-b4f3-4cf1-aa42-7e924b7da689 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:21.879387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2090bd3-b4f3-4cf1-aa42-7e924b7da689 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:21.882396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2090bd3-b4f3-4cf1-aa42-7e924b7da689 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:21.883348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2090bd3-b4f3-4cf1-aa42-7e924b7da689 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:21.883733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2090bd3-b4f3-4cf1-aa42-7e924b7da689 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:22.151248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f2090bd3-b4f3-4cf1-aa42-7e924b7da689 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:22.159598 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f2090bd3-b4f3-4cf1-aa42-7e924b7da689 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1317 microversion: 2.1 time: 0.297081 Oct 05 17:45:22.160193 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1454/3101] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:21 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:22.478960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:22.479555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:22.485799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:22.486829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:22.486829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:22.487434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:22.488000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:22.488476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:22.558094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:22.567350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:22.568798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:22.570042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-194579b6-132b-4699-bc23-472e00a801ef tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 200 len: 1332 microversion: 2.47 time: 0.095353 Oct 05 17:45:22.570644 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1648/3102] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:22 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 1332 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:45:22.625975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4c9a7afb-9d8f-44a4-8f61-d5be2791739f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:22.626771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4c9a7afb-9d8f-44a4-8f61-d5be2791739f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:22.633726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c9a7afb-9d8f-44a4-8f61-d5be2791739f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:22.634455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c9a7afb-9d8f-44a4-8f61-d5be2791739f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:22.634981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c9a7afb-9d8f-44a4-8f61-d5be2791739f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:22.635764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c9a7afb-9d8f-44a4-8f61-d5be2791739f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:22.636221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c9a7afb-9d8f-44a4-8f61-d5be2791739f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:22.636648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c9a7afb-9d8f-44a4-8f61-d5be2791739f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:22.847280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35857736-15ca-41ea-9c23-300ef4cf7251 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:22.848230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-35857736-15ca-41ea-9c23-300ef4cf7251 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:22.857390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35857736-15ca-41ea-9c23-300ef4cf7251 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:22.857866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35857736-15ca-41ea-9c23-300ef4cf7251 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:22.858299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35857736-15ca-41ea-9c23-300ef4cf7251 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:22.859183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35857736-15ca-41ea-9c23-300ef4cf7251 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:22.859788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35857736-15ca-41ea-9c23-300ef4cf7251 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:22.860439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35857736-15ca-41ea-9c23-300ef4cf7251 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:23.060471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c9a7afb-9d8f-44a4-8f61-d5be2791739f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:23.070058 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4c9a7afb-9d8f-44a4-8f61-d5be2791739f tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1505 microversion: 2.1 time: 0.449925 Oct 05 17:45:23.074025 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1455/3103] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:22 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1505 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:23.090514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-35857736-15ca-41ea-9c23-300ef4cf7251 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:23.099690 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35857736-15ca-41ea-9c23-300ef4cf7251 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 0.260706 Oct 05 17:45:23.100685 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1649/3104] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:22 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:23.183084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-86f85cf5-3a69-4323-a3df-110606841fc5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:23.183946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-86f85cf5-3a69-4323-a3df-110606841fc5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:23.191897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86f85cf5-3a69-4323-a3df-110606841fc5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:23.192604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86f85cf5-3a69-4323-a3df-110606841fc5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:23.193246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86f85cf5-3a69-4323-a3df-110606841fc5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:23.194378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86f85cf5-3a69-4323-a3df-110606841fc5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:23.194844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86f85cf5-3a69-4323-a3df-110606841fc5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:23.195581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86f85cf5-3a69-4323-a3df-110606841fc5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:23.547867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86f85cf5-3a69-4323-a3df-110606841fc5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:23.556312 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-86f85cf5-3a69-4323-a3df-110606841fc5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1317 microversion: 2.1 time: 0.376985 Oct 05 17:45:23.557251 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1456/3105] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:23 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1317 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:23.582178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8e2c1c04-f050-4d92-bb43-b87b293d8b12 req-efbdda10-2b9b-4650-8365-d7c3b49268e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64aabce-b60d-42c0-881b-43aa1880709b", "name": "network-vif-unplugged", "status": "completed", "tag": "ca151148-f4dd-4fec-afc0-c8cb86c25709"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:23.597242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:23.601114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:23.615556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:23.617262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:23.619242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:23.619812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8e2c1c04-f050-4d92-bb43-b87b293d8b12 req-efbdda10-2b9b-4650-8365-d7c3b49268e0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:23.621886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8e2c1c04-f050-4d92-bb43-b87b293d8b12 req-efbdda10-2b9b-4650-8365-d7c3b49268e0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:23.622391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:23.623025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:23.623874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8e2c1c04-f050-4d92-bb43-b87b293d8b12 req-efbdda10-2b9b-4650-8365-d7c3b49268e0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:23.625373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:23.650807 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8e2c1c04-f050-4d92-bb43-b87b293d8b12 req-efbdda10-2b9b-4650-8365-d7c3b49268e0 service nova] Creating event network-vif-unplugged:ca151148-f4dd-4fec-afc0-c8cb86c25709 for instance d64aabce-b60d-42c0-881b-43aa1880709b on n-h1-835595-3 Oct 05 17:45:23.664055 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8e2c1c04-f050-4d92-bb43-b87b293d8b12 req-efbdda10-2b9b-4650-8365-d7c3b49268e0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090026 Oct 05 17:45:23.668254 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1650/3106] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:23.750380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:23.771886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:23.773521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:23.774792 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-63890e75-8fb7-4cef-80ad-a5203474b535 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 200 len: 1332 microversion: 2.47 time: 0.182710 Oct 05 17:45:23.775896 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1457/3107] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:23 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 1332 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:45:24.097742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-38c57c05-e4a9-4856-a1d8-f4ce9feba078 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:24.098837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-38c57c05-e4a9-4856-a1d8-f4ce9feba078 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:24.110272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-38c57c05-e4a9-4856-a1d8-f4ce9feba078 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.111038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-38c57c05-e4a9-4856-a1d8-f4ce9feba078 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.111723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-38c57c05-e4a9-4856-a1d8-f4ce9feba078 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.112664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-38c57c05-e4a9-4856-a1d8-f4ce9feba078 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.113692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-38c57c05-e4a9-4856-a1d8-f4ce9feba078 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.114798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-38c57c05-e4a9-4856-a1d8-f4ce9feba078 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.122754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-280135db-9e24-4855-aa91-c892282f14c8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:24.123369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-280135db-9e24-4855-aa91-c892282f14c8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:24.131729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-280135db-9e24-4855-aa91-c892282f14c8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.136169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-280135db-9e24-4855-aa91-c892282f14c8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.136848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-280135db-9e24-4855-aa91-c892282f14c8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.138864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-280135db-9e24-4855-aa91-c892282f14c8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.140638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-280135db-9e24-4855-aa91-c892282f14c8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.141531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-280135db-9e24-4855-aa91-c892282f14c8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.430418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-38c57c05-e4a9-4856-a1d8-f4ce9feba078 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:24.439507 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-38c57c05-e4a9-4856-a1d8-f4ce9feba078 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 200 len: 1508 microversion: 2.1 time: 0.348332 Oct 05 17:45:24.442463 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1651/3108] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:24 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:24.463284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78c98ae5-0b05-4f08-903c-a02677574d68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:24.464158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-78c98ae5-0b05-4f08-903c-a02677574d68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:24.470562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78c98ae5-0b05-4f08-903c-a02677574d68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.471373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78c98ae5-0b05-4f08-903c-a02677574d68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.471972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78c98ae5-0b05-4f08-903c-a02677574d68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.472846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78c98ae5-0b05-4f08-903c-a02677574d68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.473486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78c98ae5-0b05-4f08-903c-a02677574d68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.474070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78c98ae5-0b05-4f08-903c-a02677574d68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.497901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:24.613607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-280135db-9e24-4855-aa91-c892282f14c8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:24.641050 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-280135db-9e24-4855-aa91-c892282f14c8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1317 microversion: 2.1 time: 0.520475 Oct 05 17:45:24.646030 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1458/3109] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:24 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:24.659596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d7e7421-4d15-452b-8626-3dea5283d019 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:24.660565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9d7e7421-4d15-452b-8626-3dea5283d019 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:24.667248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d7e7421-4d15-452b-8626-3dea5283d019 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.668904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d7e7421-4d15-452b-8626-3dea5283d019 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.669521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d7e7421-4d15-452b-8626-3dea5283d019 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.670935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d7e7421-4d15-452b-8626-3dea5283d019 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.672576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d7e7421-4d15-452b-8626-3dea5283d019 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.675900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d7e7421-4d15-452b-8626-3dea5283d019 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.760353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78c98ae5-0b05-4f08-903c-a02677574d68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:24.770783 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78c98ae5-0b05-4f08-903c-a02677574d68 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.311394 Oct 05 17:45:24.772962 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1652/3110] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:24 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:24.802439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:24.803644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:24.809593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:24.811367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.812250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.812877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.813968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.814621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.815209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.932299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:24.946936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:24.949846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:24.962548 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25e8cd4e-1af2-43bf-9326-c2aaf2a85246 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 200 len: 1338 microversion: 2.47 time: 0.164198 Oct 05 17:45:24.975830 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1653/3111] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:24 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 1338 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:45:24.976187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9d7e7421-4d15-452b-8626-3dea5283d019 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:24.983374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-797266d8-4cc3-4b59-92a3-44ed5b9ce7dd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:24.984220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-797266d8-4cc3-4b59-92a3-44ed5b9ce7dd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:24.992850 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d7e7421-4d15-452b-8626-3dea5283d019 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1317 microversion: 2.1 time: 0.345306 Oct 05 17:45:24.993700 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1459/3112] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:24 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1317 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:24.997388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797266d8-4cc3-4b59-92a3-44ed5b9ce7dd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:24.998118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797266d8-4cc3-4b59-92a3-44ed5b9ce7dd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:24.998585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797266d8-4cc3-4b59-92a3-44ed5b9ce7dd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:24.999607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797266d8-4cc3-4b59-92a3-44ed5b9ce7dd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:25.000230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797266d8-4cc3-4b59-92a3-44ed5b9ce7dd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:25.000811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797266d8-4cc3-4b59-92a3-44ed5b9ce7dd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:25.580348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-797266d8-4cc3-4b59-92a3-44ed5b9ce7dd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:25.613564 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-797266d8-4cc3-4b59-92a3-44ed5b9ce7dd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.642555 Oct 05 17:45:25.616755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1654/3113] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:24 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:25.652136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a8db2665-9ad7-4740-84d6-9239097ff4e0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:25.653560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a8db2665-9ad7-4740-84d6-9239097ff4e0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:25.673290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ebfbb23-96f4-4253-8441-697477e59095 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:25.674123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3ebfbb23-96f4-4253-8441-697477e59095 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:25.675012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8db2665-9ad7-4740-84d6-9239097ff4e0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:25.675518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8db2665-9ad7-4740-84d6-9239097ff4e0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:25.675959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8db2665-9ad7-4740-84d6-9239097ff4e0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:25.676687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8db2665-9ad7-4740-84d6-9239097ff4e0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:25.677148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8db2665-9ad7-4740-84d6-9239097ff4e0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:25.677576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8db2665-9ad7-4740-84d6-9239097ff4e0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:25.689536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ebfbb23-96f4-4253-8441-697477e59095 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:25.692066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ebfbb23-96f4-4253-8441-697477e59095 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:25.693399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ebfbb23-96f4-4253-8441-697477e59095 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:25.695525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ebfbb23-96f4-4253-8441-697477e59095 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:25.698512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ebfbb23-96f4-4253-8441-697477e59095 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:25.701272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ebfbb23-96f4-4253-8441-697477e59095 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.029431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3ebfbb23-96f4-4253-8441-697477e59095 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:26.038044 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ebfbb23-96f4-4253-8441-697477e59095 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1465 microversion: 2.1 time: 0.372888 Oct 05 17:45:26.038681 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1655/3114] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:25 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1465 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:26.043685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:26.044482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:26.051840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.052640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.053280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.054454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.055364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.056718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a8db2665-9ad7-4740-84d6-9239097ff4e0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:26.058889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.071465 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a8db2665-9ad7-4740-84d6-9239097ff4e0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.430307 Oct 05 17:45:26.073128 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1460/3115] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:25 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:26.090988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a332c026-f55b-4565-a14b-febbc739a75d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:26.092031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a332c026-f55b-4565-a14b-febbc739a75d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:26.099462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a332c026-f55b-4565-a14b-febbc739a75d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.100341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a332c026-f55b-4565-a14b-febbc739a75d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.101127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a332c026-f55b-4565-a14b-febbc739a75d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.102656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a332c026-f55b-4565-a14b-febbc739a75d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.103527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a332c026-f55b-4565-a14b-febbc739a75d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.104052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a332c026-f55b-4565-a14b-febbc739a75d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.201213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:26.211495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:26.212982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:26.214129 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab219f8e-8a0c-4ad8-a708-a25113efd2bd tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 200 len: 1338 microversion: 2.47 time: 0.174261 Oct 05 17:45:26.230559 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1656/3116] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:26 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 1338 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:45:26.230559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e3ea45d5-359c-440e-ba87-30b31ddbbe1b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:26.230559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e3ea45d5-359c-440e-ba87-30b31ddbbe1b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:26.230559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3ea45d5-359c-440e-ba87-30b31ddbbe1b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.230559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3ea45d5-359c-440e-ba87-30b31ddbbe1b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.230559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3ea45d5-359c-440e-ba87-30b31ddbbe1b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.231165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3ea45d5-359c-440e-ba87-30b31ddbbe1b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.231630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3ea45d5-359c-440e-ba87-30b31ddbbe1b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.232056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3ea45d5-359c-440e-ba87-30b31ddbbe1b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.399955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e3ea45d5-359c-440e-ba87-30b31ddbbe1b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:26.408960 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e3ea45d5-359c-440e-ba87-30b31ddbbe1b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d" status: 200 len: 1467 microversion: 2.1 time: 0.193075 Oct 05 17:45:26.409801 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1657/3117] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:26 2022] GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d => generated 1467 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:26.432979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a332c026-f55b-4565-a14b-febbc739a75d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:26.438292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-20667818-b38a-422d-a5f3-87698b0921a9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:26.442469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-20667818-b38a-422d-a5f3-87698b0921a9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:26.454471 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a332c026-f55b-4565-a14b-febbc739a75d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1317 microversion: 2.1 time: 0.367533 Oct 05 17:45:26.458670 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1461/3118] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:26 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1317 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:26.460859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20667818-b38a-422d-a5f3-87698b0921a9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.461853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20667818-b38a-422d-a5f3-87698b0921a9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.464785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20667818-b38a-422d-a5f3-87698b0921a9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.467781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20667818-b38a-422d-a5f3-87698b0921a9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.468939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20667818-b38a-422d-a5f3-87698b0921a9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.469382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20667818-b38a-422d-a5f3-87698b0921a9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.477231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-57980ecb-1f9b-4204-9593-6909daee03fc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1334741505"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:26.484677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-57980ecb-1f9b-4204-9593-6909daee03fc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:26.499918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57980ecb-1f9b-4204-9593-6909daee03fc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.506767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57980ecb-1f9b-4204-9593-6909daee03fc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.507559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57980ecb-1f9b-4204-9593-6909daee03fc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.509821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57980ecb-1f9b-4204-9593-6909daee03fc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.510475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57980ecb-1f9b-4204-9593-6909daee03fc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.511085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57980ecb-1f9b-4204-9593-6909daee03fc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.767053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-20667818-b38a-422d-a5f3-87698b0921a9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:26.783776 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-20667818-b38a-422d-a5f3-87698b0921a9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.372262 Oct 05 17:45:26.792778 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1658/3119] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:26 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:26.819799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5e9578b-b4c2-48e9-9f20-054a0ba8f9ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:26.836509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5e9578b-b4c2-48e9-9f20-054a0ba8f9ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:26.837300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5e9578b-b4c2-48e9-9f20-054a0ba8f9ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:26.837961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5e9578b-b4c2-48e9-9f20-054a0ba8f9ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:26.880509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5e9578b-b4c2-48e9-9f20-054a0ba8f9ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Going to try to stop instance {{(pid=128844) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 17:45:26.957627 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-57980ecb-1f9b-4204-9593-6909daee03fc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "POST /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d/action" status: 202 len: 0 microversion: 2.1 time: 0.497599 Oct 05 17:45:26.960821 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1462/3120] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:45:26 2022] POST /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 17:45:26.973227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f267d09-ab34-4026-9c5d-2db7f01ef7b3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775bb8f70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:27.028213 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5e9578b-b4c2-48e9-9f20-054a0ba8f9ff tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.217364 Oct 05 17:45:27.031774 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1659/3121] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:45:26 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:45:27.037432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4256ca3b-ef09-4dcf-9abe-651415702bde tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:27.038214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4256ca3b-ef09-4dcf-9abe-651415702bde tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:27.050794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4256ca3b-ef09-4dcf-9abe-651415702bde tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.051308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4256ca3b-ef09-4dcf-9abe-651415702bde tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.051858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4256ca3b-ef09-4dcf-9abe-651415702bde tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.052473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4256ca3b-ef09-4dcf-9abe-651415702bde tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.052931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4256ca3b-ef09-4dcf-9abe-651415702bde tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.053378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4256ca3b-ef09-4dcf-9abe-651415702bde tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.085632 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f267d09-ab34-4026-9c5d-2db7f01ef7b3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.116690 Oct 05 17:45:27.087207 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1463/3122] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:26 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:27.242528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:27.242981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:27.253434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.253929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.254383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.255125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.255957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.255957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.281959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4256ca3b-ef09-4dcf-9abe-651415702bde tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:27.291661 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4256ca3b-ef09-4dcf-9abe-651415702bde tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.258400 Oct 05 17:45:27.292979 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1660/3123] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:27 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:27.394556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:27.403582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:27.405380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:27.406603 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f397d6d1-ef0c-42c4-9f13-2f8e60e82001 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 200 len: 1359 microversion: 2.47 time: 0.169382 Oct 05 17:45:27.407446 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1464/3124] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:27 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:45:27.433630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3bbe22fd-4143-4350-ac7d-1e8fa4d2499f tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1019606532"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:27.436231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3bbe22fd-4143-4350-ac7d-1e8fa4d2499f tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:27.442805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3bbe22fd-4143-4350-ac7d-1e8fa4d2499f tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.443295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3bbe22fd-4143-4350-ac7d-1e8fa4d2499f tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.443939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3bbe22fd-4143-4350-ac7d-1e8fa4d2499f tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.444606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3bbe22fd-4143-4350-ac7d-1e8fa4d2499f tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.445537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3bbe22fd-4143-4350-ac7d-1e8fa4d2499f tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.445537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3bbe22fd-4143-4350-ac7d-1e8fa4d2499f tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.486246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f07f027b-3b44-41df-9052-8fd313919f2a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:27.487105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f07f027b-3b44-41df-9052-8fd313919f2a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:27.499075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f07f027b-3b44-41df-9052-8fd313919f2a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.502179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f07f027b-3b44-41df-9052-8fd313919f2a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.502852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f07f027b-3b44-41df-9052-8fd313919f2a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.503846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f07f027b-3b44-41df-9052-8fd313919f2a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.504464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f07f027b-3b44-41df-9052-8fd313919f2a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.505619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f07f027b-3b44-41df-9052-8fd313919f2a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.545275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:27.676458 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3bbe22fd-4143-4350-ac7d-1e8fa4d2499f tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "POST /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5/action" status: 202 len: 52 microversion: 2.47 time: 0.246696 Oct 05 17:45:27.677370 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1661/3125] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:45:27 2022] POST /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5/action => generated 52 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 05 17:45:27.690789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-751168b3-840d-496e-ab56-125b9f24522b tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:27.691637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-751168b3-840d-496e-ab56-125b9f24522b tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:27.702122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-751168b3-840d-496e-ab56-125b9f24522b tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.702650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-751168b3-840d-496e-ab56-125b9f24522b tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.703146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-751168b3-840d-496e-ab56-125b9f24522b tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.703925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-751168b3-840d-496e-ab56-125b9f24522b tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.704791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-751168b3-840d-496e-ab56-125b9f24522b tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.705504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-751168b3-840d-496e-ab56-125b9f24522b tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.742228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-751168b3-840d-496e-ab56-125b9f24522b tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:45:27.872216 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-751168b3-840d-496e-ab56-125b9f24522b tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 204 len: 0 microversion: 2.47 time: 0.186548 Oct 05 17:45:27.876915 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1662/3126] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:45:27 2022] DELETE /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:45:27.884058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:27.885098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:27.894592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.895393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.896018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.897079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.897900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.898721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.911962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f07f027b-3b44-41df-9052-8fd313919f2a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:27.925197 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f07f027b-3b44-41df-9052-8fd313919f2a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1317 microversion: 2.1 time: 0.443798 Oct 05 17:45:27.950770 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1465/3127] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:27 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:27.965239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6364115d-1284-41f0-bd92-2d2ac3b54e38 req-e47eb951-32d4-4a8f-8cb3-bad423d737a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3fc4e4d-9f2d-4df2-bf41-9fd764de0382", "name": "network-vif-plugged", "status": "completed", "tag": "ba6a5ab9-d39f-4718-9a48-4bc6c5c16d68"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:27.981119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6364115d-1284-41f0-bd92-2d2ac3b54e38 req-e47eb951-32d4-4a8f-8cb3-bad423d737a5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:27.981613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6364115d-1284-41f0-bd92-2d2ac3b54e38 req-e47eb951-32d4-4a8f-8cb3-bad423d737a5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:27.982039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6364115d-1284-41f0-bd92-2d2ac3b54e38 req-e47eb951-32d4-4a8f-8cb3-bad423d737a5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:27.998916 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6364115d-1284-41f0-bd92-2d2ac3b54e38 req-e47eb951-32d4-4a8f-8cb3-bad423d737a5 service nova] Creating event network-vif-plugged:ba6a5ab9-d39f-4718-9a48-4bc6c5c16d68 for instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 on n-h2-835595-3 Oct 05 17:45:28.006432 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6364115d-1284-41f0-bd92-2d2ac3b54e38 req-e47eb951-32d4-4a8f-8cb3-bad423d737a5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044840 Oct 05 17:45:28.007551 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1466/3128] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:45:28.073208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:28.093930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:28.104695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb45a143-19ec-4770-aad0-410d09ce0870 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777598b040>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:28.114616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:28.116073 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-599f4020-9419-4de0-b14f-90e0f9a00d92 tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 200 len: 1365 microversion: 2.47 time: 0.237551 Oct 05 17:45:28.126444 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1663/3129] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:27 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 1365 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:45:28.187626 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb45a143-19ec-4770-aad0-410d09ce0870 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.088913 Oct 05 17:45:28.188545 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1467/3130] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:28 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:28.316702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bbc0cf33-3f4f-4089-9182-f7a7ad249ccc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:28.317325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bbc0cf33-3f4f-4089-9182-f7a7ad249ccc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:28.323638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbc0cf33-3f4f-4089-9182-f7a7ad249ccc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:28.324146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbc0cf33-3f4f-4089-9182-f7a7ad249ccc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:28.324593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbc0cf33-3f4f-4089-9182-f7a7ad249ccc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:28.325304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbc0cf33-3f4f-4089-9182-f7a7ad249ccc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:28.325786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbc0cf33-3f4f-4089-9182-f7a7ad249ccc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:28.326186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbc0cf33-3f4f-4089-9182-f7a7ad249ccc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:28.606842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bbc0cf33-3f4f-4089-9182-f7a7ad249ccc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:28.615081 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bbc0cf33-3f4f-4089-9182-f7a7ad249ccc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.301880 Oct 05 17:45:28.616014 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1664/3131] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:28 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:28.951717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d87a7fa6-4dd8-4790-8466-a02030fc7e6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:28.952390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d87a7fa6-4dd8-4790-8466-a02030fc7e6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:28.966722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d87a7fa6-4dd8-4790-8466-a02030fc7e6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:28.967368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d87a7fa6-4dd8-4790-8466-a02030fc7e6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:28.968273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d87a7fa6-4dd8-4790-8466-a02030fc7e6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:28.974525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d87a7fa6-4dd8-4790-8466-a02030fc7e6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:28.975448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d87a7fa6-4dd8-4790-8466-a02030fc7e6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:28.975989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d87a7fa6-4dd8-4790-8466-a02030fc7e6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:29.148330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:29.149069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:29.167960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:29.168464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:29.168905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:29.169614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:29.170150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:29.170527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:29.175980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:29.213269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d87a7fa6-4dd8-4790-8466-a02030fc7e6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:29.222615 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d87a7fa6-4dd8-4790-8466-a02030fc7e6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1317 microversion: 2.1 time: 0.275672 Oct 05 17:45:29.223707 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1468/3132] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:28 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:29.229417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-17aa2750-87f5-4904-8545-25c186c2572e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77759b9ee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:29.292374 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-17aa2750-87f5-4904-8545-25c186c2572e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.067325 Oct 05 17:45:29.293691 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1469/3133] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:29 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:29.315528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:29.332501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:29.335909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:29.338347 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a12310b5-f2e4-44f5-a8e1-dae8403d157c tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 200 len: 1365 microversion: 2.47 time: 0.195706 Oct 05 17:45:29.340318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1665/3134] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:29 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:45:29.666159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ff5b744-3751-4999-9273-704322a6b6df tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:29.667340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ff5b744-3751-4999-9273-704322a6b6df tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:29.677921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ff5b744-3751-4999-9273-704322a6b6df tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:29.682391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ff5b744-3751-4999-9273-704322a6b6df tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:29.685881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ff5b744-3751-4999-9273-704322a6b6df tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:29.691718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ff5b744-3751-4999-9273-704322a6b6df tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:29.693102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ff5b744-3751-4999-9273-704322a6b6df tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:29.694158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ff5b744-3751-4999-9273-704322a6b6df tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:29.947316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3ff5b744-3751-4999-9273-704322a6b6df tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:29.960439 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ff5b744-3751-4999-9273-704322a6b6df tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.309209 Oct 05 17:45:29.962317 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1470/3135] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:29 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:30.226056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a6ffefb6-9f1e-4b17-8750-0fccc9c50e34 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'create', calling method: .version_select at 0x7f77747329d0>, body: {"keypair": {"name": "tempest-keypair-1520047779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4zwBSFypNQgmTxr6e/9hR16si1pLmFUQDhmd48G5xnM4IGck9mFFS2SeGMU3JA5DGNBZuO3AB/2pyPkLIwDa2QPEkY2r6BQx5qrnsCMA61RGr0JO0JZ9kbLJfk+2dyiQ=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:30.249485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb074146-bd1a-48ad-81a4-a24a5fc3dd79 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:30.252614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eb074146-bd1a-48ad-81a4-a24a5fc3dd79 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:30.271938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:30.275825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:30.277858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:30.284416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb074146-bd1a-48ad-81a4-a24a5fc3dd79 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:30.284954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb074146-bd1a-48ad-81a4-a24a5fc3dd79 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:30.285394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb074146-bd1a-48ad-81a4-a24a5fc3dd79 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:30.286563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb074146-bd1a-48ad-81a4-a24a5fc3dd79 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:30.288531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb074146-bd1a-48ad-81a4-a24a5fc3dd79 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:30.293022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-a6ffefb6-9f1e-4b17-8750-0fccc9c50e34 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Getting quotas for project ee4220fd6f904e36ada64a2b5f3bf524. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:30.298427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb074146-bd1a-48ad-81a4-a24a5fc3dd79 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:30.300554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-a6ffefb6-9f1e-4b17-8750-0fccc9c50e34 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Getting quotas for user 418f5619d2f543d98e874a0c48e81d52 and project ee4220fd6f904e36ada64a2b5f3bf524. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:30.332620 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a6ffefb6-9f1e-4b17-8750-0fccc9c50e34 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.300220 Oct 05 17:45:30.333598 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1666/3136] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:45:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:45:30.339558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a295793b-a2fa-440d-9a4b-d60e132e1707 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775194550>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:30.404206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a295793b-a2fa-440d-9a4b-d60e132e1707 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.069200 Oct 05 17:45:30.413751 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1667/3137] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:30 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:30.431820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:30.435321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:30.452724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:30.453632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:30.454830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:30.461257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:30.462271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:30.463155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:30.654309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:30.669216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:30.674030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '142e1db84c1f4fa5a75ca9fb2489f230', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c678dd1e05b4d148d8ae63076a8ed28', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:30.675329 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7ee4ea9a-74ed-4c9c-8877-fcd632b47cea tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 200 len: 1365 microversion: 2.47 time: 0.260493 Oct 05 17:45:30.694373 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1668/3138] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:30 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:45:30.728408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb074146-bd1a-48ad-81a4-a24a5fc3dd79 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:30.742272 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb074146-bd1a-48ad-81a4-a24a5fc3dd79 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1508 microversion: 2.1 time: 0.499440 Oct 05 17:45:30.742927 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1471/3139] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:30 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1508 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:30.781344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec0fe811-fc41-4cdb-b012-a89791940a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:30.784042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ec0fe811-fc41-4cdb-b012-a89791940a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:30.816769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec0fe811-fc41-4cdb-b012-a89791940a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:30.818631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec0fe811-fc41-4cdb-b012-a89791940a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:30.819162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec0fe811-fc41-4cdb-b012-a89791940a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:30.820037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec0fe811-fc41-4cdb-b012-a89791940a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:30.820521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec0fe811-fc41-4cdb-b012-a89791940a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:30.820954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec0fe811-fc41-4cdb-b012-a89791940a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:30.987089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48e71cac-37c2-423b-875d-45003b369d15 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:30.988009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48e71cac-37c2-423b-875d-45003b369d15 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:30.998772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e71cac-37c2-423b-875d-45003b369d15 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:31.003478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e71cac-37c2-423b-875d-45003b369d15 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:31.004283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e71cac-37c2-423b-875d-45003b369d15 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:31.005290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e71cac-37c2-423b-875d-45003b369d15 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:31.005965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e71cac-37c2-423b-875d-45003b369d15 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:31.007084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e71cac-37c2-423b-875d-45003b369d15 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:31.357008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ec0fe811-fc41-4cdb-b012-a89791940a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:31.373936 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ec0fe811-fc41-4cdb-b012-a89791940a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1508 microversion: 2.1 time: 0.610108 Oct 05 17:45:31.380578 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1669/3140] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:30 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1508 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:31.403485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48e71cac-37c2-423b-875d-45003b369d15 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:31.406246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:31.412200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:31.426011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:31.426903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:31.427562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:31.428831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:31.429604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:31.430498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:31.436181 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48e71cac-37c2-423b-875d-45003b369d15 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.430285 Oct 05 17:45:31.437072 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1472/3141] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:30 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:31.467836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0bac2e6e-809c-4ae6-9f65-fc3a51d26927 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774a54160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:31.569979 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0bac2e6e-809c-4ae6-9f65-fc3a51d26927 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.130369 Oct 05 17:45:31.570968 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1473/3142] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:31 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:31.713962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:45:31.718847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:31.719745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:45:31.720697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] [instance: 7ba55118-a9aa-416b-aa3b-5b403e118af5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:31.723476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:45:31.725673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:45:31.729480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:45:31.738994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:31.742360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:31.748272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:31.754495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:31.756584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:31.761939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:31.833665 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] HTTP exception thrown: Instance 7ba55118-a9aa-416b-aa3b-5b403e118af5 could not be found. Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Request method failure captured: Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 HTTP/1.1 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcKvlFX5FMetkbP3q6wEVfuXsWs1fqz5E66tdZRcTgBwEThwpvSM-ia-CaHArL5A6-OXjS6u03-tVPbQhPrRa305uihHs18Rai4c68zZ0yrt_Ftc3zDZZtSvq3CUGNmHMo3MQ3tPqA0Cubcge0qi_2978xgmruKibGoLskjc602SoKU Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.47 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 5c678dd1e05b4d148d8ae63076a8ed28 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersAaction247Test-1006638610 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5c678dd1e05b4d148d8ae63076a8ed28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c678dd1e05b4d148d8ae63076a8ed28"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5c678dd1e05b4d148d8ae63076a8ed28", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5c678dd1e05b4d148d8ae63076a8ed28"}]}] Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersAaction247Test-1006638610 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 5c678dd1e05b4d148d8ae63076a8ed28 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersAaction247Test-1006638610 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersAaction247Test-1006638610-project Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 142e1db84c1f4fa5a75ca9fb2489f230 Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersAaction247Test-1006638610-project Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 7ba55118-a9aa-416b-aa3b-5b403e118af5 could not be found. Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '7ba55118-a9aa-416b-aa3b-5b403e118af5'} Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ba55118-a9aa-416b-aa3b-5b403e118af5 could not be found. Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ba55118-a9aa-416b-aa3b-5b403e118af5 could not be found. Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:45:31.839434 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:45:31.844389 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:45:31.844389 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:45:31.844389 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:45:31.844389 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:45:31.844389 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:45:31.844389 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:45:31.844389 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ba55118-a9aa-416b-aa3b-5b403e118af5 could not be found. Oct 05 17:45:31.844389 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:45:31.848030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] Returning 404 to user: Instance 7ba55118-a9aa-416b-aa3b-5b403e118af5 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:45:31.852758 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-45b34f26-1be7-4452-8a59-ec16b2c023da tempest-ServersAaction247Test-1006638610 tempest-ServersAaction247Test-1006638610-project] 10.222.0.70 "GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5" status: 404 len: 111 microversion: 2.47 time: 0.142503 Oct 05 17:45:31.854386 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1474/3143] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:45:31 2022] GET /compute/v2.1/servers/7ba55118-a9aa-416b-aa3b-5b403e118af5 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:45:31.942216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:31.966150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:31.970427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:31.971782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:31.977518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:31.978241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:31.979394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:32.093445 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a23aab3d-abc0-42d9-9a92-8e4915ee0922 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "POST /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382/action" status: 202 len: 1110 microversion: 2.1 time: 0.693479 Oct 05 17:45:32.117891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a802f5e8-a270-45e5-94f1-78e40efb2974 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:32.118562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a802f5e8-a270-45e5-94f1-78e40efb2974 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:32.125374 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1670/3144] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:45:31 2022] POST /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382/action => generated 1110 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 05 17:45:32.142999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a802f5e8-a270-45e5-94f1-78e40efb2974 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:32.143447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a802f5e8-a270-45e5-94f1-78e40efb2974 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:32.143881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a802f5e8-a270-45e5-94f1-78e40efb2974 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:32.150939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a802f5e8-a270-45e5-94f1-78e40efb2974 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:32.151583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a802f5e8-a270-45e5-94f1-78e40efb2974 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:32.152040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a802f5e8-a270-45e5-94f1-78e40efb2974 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:32.468156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6bf6ed4c-c552-4610-9c54-3ac2bd3f748c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:32.469074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6bf6ed4c-c552-4610-9c54-3ac2bd3f748c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:32.483490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6bf6ed4c-c552-4610-9c54-3ac2bd3f748c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:32.486239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6bf6ed4c-c552-4610-9c54-3ac2bd3f748c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:32.487039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6bf6ed4c-c552-4610-9c54-3ac2bd3f748c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:32.490762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6bf6ed4c-c552-4610-9c54-3ac2bd3f748c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:32.492041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6bf6ed4c-c552-4610-9c54-3ac2bd3f748c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:32.493815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6bf6ed4c-c552-4610-9c54-3ac2bd3f748c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:32.885209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6bf6ed4c-c552-4610-9c54-3ac2bd3f748c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:32.894353 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6bf6ed4c-c552-4610-9c54-3ac2bd3f748c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.432615 Oct 05 17:45:32.898030 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1671/3145] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:32 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:32.912177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb39d4df-ce53-466d-b12f-5aab2bdb42ff tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777596d820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:32.927567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a802f5e8-a270-45e5-94f1-78e40efb2974 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:32.940011 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a802f5e8-a270-45e5-94f1-78e40efb2974 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.827454 Oct 05 17:45:32.940598 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1475/3146] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:32 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:33.016998 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb39d4df-ce53-466d-b12f-5aab2bdb42ff tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.117482 Oct 05 17:45:33.017926 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1672/3147] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:32 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:33.635662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-efcf411d-b720-42f0-8f06-0f225b686fda req-f3b7178b-30e1-4a81-a9d0-1c3455bc6f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989ec240-1506-4643-b1e7-0a849f54db3d", "name": "network-vif-plugged", "status": "completed", "tag": "ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:33.655450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-efcf411d-b720-42f0-8f06-0f225b686fda req-f3b7178b-30e1-4a81-a9d0-1c3455bc6f48 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:33.656382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-efcf411d-b720-42f0-8f06-0f225b686fda req-f3b7178b-30e1-4a81-a9d0-1c3455bc6f48 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:33.657040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-efcf411d-b720-42f0-8f06-0f225b686fda req-f3b7178b-30e1-4a81-a9d0-1c3455bc6f48 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:33.671248 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-efcf411d-b720-42f0-8f06-0f225b686fda req-f3b7178b-30e1-4a81-a9d0-1c3455bc6f48 service nova] Creating event network-vif-plugged:ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8 for instance 989ec240-1506-4643-b1e7-0a849f54db3d on n-h2-835595-3 Oct 05 17:45:33.677438 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-efcf411d-b720-42f0-8f06-0f225b686fda req-f3b7178b-30e1-4a81-a9d0-1c3455bc6f48 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051708 Oct 05 17:45:33.678465 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1476/3148] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:33.924308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0435e59e-3dd7-40c1-9abb-630f68075837 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:33.924927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0435e59e-3dd7-40c1-9abb-630f68075837 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:33.967922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0435e59e-3dd7-40c1-9abb-630f68075837 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:33.971902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0435e59e-3dd7-40c1-9abb-630f68075837 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:33.972360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ecc65f5-131e-48fc-bd18-67ce6588ae8d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:33.973561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0435e59e-3dd7-40c1-9abb-630f68075837 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:33.975884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ecc65f5-131e-48fc-bd18-67ce6588ae8d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:33.977043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0435e59e-3dd7-40c1-9abb-630f68075837 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:33.977678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0435e59e-3dd7-40c1-9abb-630f68075837 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:33.984395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0435e59e-3dd7-40c1-9abb-630f68075837 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:34.008984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ecc65f5-131e-48fc-bd18-67ce6588ae8d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:34.009492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ecc65f5-131e-48fc-bd18-67ce6588ae8d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:34.022936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ecc65f5-131e-48fc-bd18-67ce6588ae8d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:34.038116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ecc65f5-131e-48fc-bd18-67ce6588ae8d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:34.047796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ecc65f5-131e-48fc-bd18-67ce6588ae8d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:34.048225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ecc65f5-131e-48fc-bd18-67ce6588ae8d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:34.387940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0435e59e-3dd7-40c1-9abb-630f68075837 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:34.398886 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0435e59e-3dd7-40c1-9abb-630f68075837 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.478564 Oct 05 17:45:34.401893 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1673/3149] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:33 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:34.418065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2fdde428-79f8-43f3-861c-70b72c4e453d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775194700>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:34.484538 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2fdde428-79f8-43f3-861c-70b72c4e453d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.081340 Oct 05 17:45:34.493342 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1674/3150] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:34 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:34.507864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1833518302", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ce965b4-92ba-4ac6-b3d5-60c0776d2f1e"}], "security_groups": [{"name": "tempest-securitygroup--1858146217"}], "key_name": "tempest-keypair-1520047779", "user_data": "}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:34.674239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3ecc65f5-131e-48fc-bd18-67ce6588ae8d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:34.687493 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ecc65f5-131e-48fc-bd18-67ce6588ae8d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.727214 Oct 05 17:45:34.692538 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1477/3151] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:33 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:34.727081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] validate_networks() for [('1ce965b4-92ba-4ac6-b3d5-60c0776d2f1e', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:45:35.425252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-493bc0c1-a17f-45d9-ab5c-836acdc967ba tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:35.426791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-493bc0c1-a17f-45d9-ab5c-836acdc967ba tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:35.464009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493bc0c1-a17f-45d9-ab5c-836acdc967ba tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:35.468378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493bc0c1-a17f-45d9-ab5c-836acdc967ba tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:35.470345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493bc0c1-a17f-45d9-ab5c-836acdc967ba tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:35.473261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493bc0c1-a17f-45d9-ab5c-836acdc967ba tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:35.474018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493bc0c1-a17f-45d9-ab5c-836acdc967ba tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:35.474719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493bc0c1-a17f-45d9-ab5c-836acdc967ba tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:35.781357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-493bc0c1-a17f-45d9-ab5c-836acdc967ba tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:35.794877 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-493bc0c1-a17f-45d9-ab5c-836acdc967ba tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.373362 Oct 05 17:45:35.822080 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1478/3152] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:35 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:35.832065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6fc7479f-8bf3-4186-8ba9-37ef554fe999 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775b96280>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:35.887187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:45:35.887724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:45:35.888073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:45:35.888488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:45:35.888901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:45:35.903747 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6fc7479f-8bf3-4186-8ba9-37ef554fe999 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.079527 Oct 05 17:45:35.903990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:35.904340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:35.904808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:35.905496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:35.905948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:35.906403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:35.907135 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1479/3153] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:35 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:35.920915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76839aef-f5e3-4fdc-948c-cd6832276d63 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:35.924630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-76839aef-f5e3-4fdc-948c-cd6832276d63 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:35.942128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Getting quotas for project ee4220fd6f904e36ada64a2b5f3bf524. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:35.948463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Getting quotas for user 418f5619d2f543d98e874a0c48e81d52 and project ee4220fd6f904e36ada64a2b5f3bf524. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:35.954334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76839aef-f5e3-4fdc-948c-cd6832276d63 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:35.955709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76839aef-f5e3-4fdc-948c-cd6832276d63 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:35.957355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76839aef-f5e3-4fdc-948c-cd6832276d63 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:35.958635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76839aef-f5e3-4fdc-948c-cd6832276d63 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:35.959670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76839aef-f5e3-4fdc-948c-cd6832276d63 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:35.960437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76839aef-f5e3-4fdc-948c-cd6832276d63 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:35.969375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:45:35.971757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:45:36.059379 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-714767ad-d065-4c0a-b1e8-37d86902ec06 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.559007 Oct 05 17:45:36.063641 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1675/3154] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:45:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:45:36.075985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e955032-c345-4cd2-b055-d40d286c4302 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:36.079463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e955032-c345-4cd2-b055-d40d286c4302 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:36.170741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4e955032-c345-4cd2-b055-d40d286c4302 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:36.177783 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e955032-c345-4cd2-b055-d40d286c4302 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1238 microversion: 2.1 time: 0.106874 Oct 05 17:45:36.187515 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1676/3155] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:36 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1238 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:36.446852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-76839aef-f5e3-4fdc-948c-cd6832276d63 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:36.460526 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76839aef-f5e3-4fdc-948c-cd6832276d63 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.549097 Oct 05 17:45:36.461348 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1480/3156] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:35 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:36.824826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fda985a0-26fb-414d-a9ff-4d0e1c220ffd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:36.826041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fda985a0-26fb-414d-a9ff-4d0e1c220ffd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:36.841811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fda985a0-26fb-414d-a9ff-4d0e1c220ffd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:36.843498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fda985a0-26fb-414d-a9ff-4d0e1c220ffd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:36.845317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fda985a0-26fb-414d-a9ff-4d0e1c220ffd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:36.846734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fda985a0-26fb-414d-a9ff-4d0e1c220ffd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:36.849135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fda985a0-26fb-414d-a9ff-4d0e1c220ffd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:36.849805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fda985a0-26fb-414d-a9ff-4d0e1c220ffd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:36.922687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53b66d6c-cf58-42b0-8d34-9ae7c1cbc055 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77759b9a60>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:37.025417 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53b66d6c-cf58-42b0-8d34-9ae7c1cbc055 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.107486 Oct 05 17:45:37.029434 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1481/3157] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:36 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:37.211962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dc630da7-f3ac-496b-9f99-39cbf36bec74 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:37.212985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dc630da7-f3ac-496b-9f99-39cbf36bec74 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:37.223217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc630da7-f3ac-496b-9f99-39cbf36bec74 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:37.226304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc630da7-f3ac-496b-9f99-39cbf36bec74 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:37.231187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc630da7-f3ac-496b-9f99-39cbf36bec74 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:37.232296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc630da7-f3ac-496b-9f99-39cbf36bec74 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:37.233006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc630da7-f3ac-496b-9f99-39cbf36bec74 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:37.233646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc630da7-f3ac-496b-9f99-39cbf36bec74 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:37.388453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fda985a0-26fb-414d-a9ff-4d0e1c220ffd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:37.418185 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fda985a0-26fb-414d-a9ff-4d0e1c220ffd tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1678 microversion: 2.1 time: 0.593613 Oct 05 17:45:37.432513 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1677/3158] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:36 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1678 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:37.466032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bb7c5a94-daa9-457a-b2f2-4aa5ba9ee87e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:37.473620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bb7c5a94-daa9-457a-b2f2-4aa5ba9ee87e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:37.498928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb7c5a94-daa9-457a-b2f2-4aa5ba9ee87e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:37.502111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb7c5a94-daa9-457a-b2f2-4aa5ba9ee87e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:37.503042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb7c5a94-daa9-457a-b2f2-4aa5ba9ee87e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:37.504014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb7c5a94-daa9-457a-b2f2-4aa5ba9ee87e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:37.506257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb7c5a94-daa9-457a-b2f2-4aa5ba9ee87e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:37.507973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb7c5a94-daa9-457a-b2f2-4aa5ba9ee87e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:37.598219 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dc630da7-f3ac-496b-9f99-39cbf36bec74 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1812 microversion: 2.1 time: 0.391394 Oct 05 17:45:37.625562 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1482/3159] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:37 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1812 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:37.651259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-df3c0ba0-b190-4816-9feb-ce0765ad113d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:37.652197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-df3c0ba0-b190-4816-9feb-ce0765ad113d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:37.659406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3c0ba0-b190-4816-9feb-ce0765ad113d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:37.660147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3c0ba0-b190-4816-9feb-ce0765ad113d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:37.660731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3c0ba0-b190-4816-9feb-ce0765ad113d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:37.661622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3c0ba0-b190-4816-9feb-ce0765ad113d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:37.662311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3c0ba0-b190-4816-9feb-ce0765ad113d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:37.663978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df3c0ba0-b190-4816-9feb-ce0765ad113d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:37.731451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bb7c5a94-daa9-457a-b2f2-4aa5ba9ee87e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:37.741433 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bb7c5a94-daa9-457a-b2f2-4aa5ba9ee87e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1290 microversion: 2.1 time: 0.307692 Oct 05 17:45:37.742433 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1678/3160] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:37 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1290 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:37.746987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e998ecb1-03f9-4840-846d-8423ea3d8906 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:37.751412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e998ecb1-03f9-4840-846d-8423ea3d8906 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:37.752170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e998ecb1-03f9-4840-846d-8423ea3d8906 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:37.752835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e998ecb1-03f9-4840-846d-8423ea3d8906 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:37.753790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e998ecb1-03f9-4840-846d-8423ea3d8906 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:37.754522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e998ecb1-03f9-4840-846d-8423ea3d8906 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:37.755181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e998ecb1-03f9-4840-846d-8423ea3d8906 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:37.783098 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e998ecb1-03f9-4840-846d-8423ea3d8906 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039380 Oct 05 17:45:37.784816 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1679/3161] 10.222.0.70 () {58 vars in 1176 bytes} [Wed Oct 5 17:45:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:38.044698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1891abb3-75b8-4dc3-b402-9e20c11d5e94 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774d45c10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:38.180356 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1891abb3-75b8-4dc3-b402-9e20c11d5e94 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.140140 Oct 05 17:45:38.183137 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1680/3162] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:38 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:38.430685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df3c0ba0-b190-4816-9feb-ce0765ad113d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:38.441675 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-df3c0ba0-b190-4816-9feb-ce0765ad113d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.814480 Oct 05 17:45:38.442267 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1483/3163] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:37 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:38.464757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bbe504f7-2d74-4a87-b6d1-1b8530ea11b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:38.465859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bbe504f7-2d74-4a87-b6d1-1b8530ea11b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:38.481058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe504f7-2d74-4a87-b6d1-1b8530ea11b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:38.487468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe504f7-2d74-4a87-b6d1-1b8530ea11b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:38.488707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe504f7-2d74-4a87-b6d1-1b8530ea11b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:38.491719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe504f7-2d74-4a87-b6d1-1b8530ea11b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:38.495541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe504f7-2d74-4a87-b6d1-1b8530ea11b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:38.496028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe504f7-2d74-4a87-b6d1-1b8530ea11b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:38.769261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7e825498-66fa-481b-828b-585c476acbbc tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:38.770093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7e825498-66fa-481b-828b-585c476acbbc tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:38.780247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e825498-66fa-481b-828b-585c476acbbc tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:38.780893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e825498-66fa-481b-828b-585c476acbbc tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:38.783290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e825498-66fa-481b-828b-585c476acbbc tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:38.784171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e825498-66fa-481b-828b-585c476acbbc tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:38.785752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e825498-66fa-481b-828b-585c476acbbc tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:38.787193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e825498-66fa-481b-828b-585c476acbbc tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:38.992536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7e825498-66fa-481b-828b-585c476acbbc tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:39.003994 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7e825498-66fa-481b-828b-585c476acbbc tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1296 microversion: 2.1 time: 0.238611 Oct 05 17:45:39.006754 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1484/3164] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:38 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1296 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:39.147926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bbe504f7-2d74-4a87-b6d1-1b8530ea11b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:39.156957 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bbe504f7-2d74-4a87-b6d1-1b8530ea11b5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1655 microversion: 2.1 time: 0.716150 Oct 05 17:45:39.170815 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1681/3165] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:38 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1655 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:39.189749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-31f18ecf-4c59-4e91-8da1-4ab56f389a22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:39.204151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6ff19895-dd5f-4988-9c34-d5aed4c8e1c5 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7779510040>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:39.210492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31f18ecf-4c59-4e91-8da1-4ab56f389a22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:39.211362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31f18ecf-4c59-4e91-8da1-4ab56f389a22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:39.213436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31f18ecf-4c59-4e91-8da1-4ab56f389a22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:39.296935 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6ff19895-dd5f-4988-9c34-d5aed4c8e1c5 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.103800 Oct 05 17:45:39.299054 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1682/3166] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:39 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:39.308334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-31f18ecf-4c59-4e91-8da1-4ab56f389a22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Going to try to start instance {{(pid=128843) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 17:45:39.514613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a9ecb1b-8190-4abd-9bc5-68ffe64b0e26 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:39.522049 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-31f18ecf-4c59-4e91-8da1-4ab56f389a22 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.338823 Oct 05 17:45:39.528423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1a9ecb1b-8190-4abd-9bc5-68ffe64b0e26 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:39.528668 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1485/3167] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:45:39 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:45:39.543513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-efdbbfcd-824b-4c7d-9060-72fc06b8b678 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:39.545358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-efdbbfcd-824b-4c7d-9060-72fc06b8b678 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:39.547546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9ecb1b-8190-4abd-9bc5-68ffe64b0e26 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:39.548293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9ecb1b-8190-4abd-9bc5-68ffe64b0e26 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:39.549955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9ecb1b-8190-4abd-9bc5-68ffe64b0e26 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:39.552162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9ecb1b-8190-4abd-9bc5-68ffe64b0e26 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:39.553729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9ecb1b-8190-4abd-9bc5-68ffe64b0e26 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:39.555797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a9ecb1b-8190-4abd-9bc5-68ffe64b0e26 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:39.563728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efdbbfcd-824b-4c7d-9060-72fc06b8b678 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:39.565361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efdbbfcd-824b-4c7d-9060-72fc06b8b678 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:39.567355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efdbbfcd-824b-4c7d-9060-72fc06b8b678 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:39.573867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efdbbfcd-824b-4c7d-9060-72fc06b8b678 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:39.575590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efdbbfcd-824b-4c7d-9060-72fc06b8b678 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:39.578030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efdbbfcd-824b-4c7d-9060-72fc06b8b678 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:40.496400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1a9ecb1b-8190-4abd-9bc5-68ffe64b0e26 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:40.525343 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1a9ecb1b-8190-4abd-9bc5-68ffe64b0e26 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 1.039301 Oct 05 17:45:40.528054 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1683/3168] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:39 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:40.539257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82af6111-7663-4150-9aa9-d705dcb27893 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:40.543404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-82af6111-7663-4150-9aa9-d705dcb27893 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:40.576260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82af6111-7663-4150-9aa9-d705dcb27893 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:40.578918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82af6111-7663-4150-9aa9-d705dcb27893 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:40.580517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82af6111-7663-4150-9aa9-d705dcb27893 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:40.586407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82af6111-7663-4150-9aa9-d705dcb27893 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:40.587206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82af6111-7663-4150-9aa9-d705dcb27893 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:40.588571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82af6111-7663-4150-9aa9-d705dcb27893 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:40.891859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-82af6111-7663-4150-9aa9-d705dcb27893 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:40.961516 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-82af6111-7663-4150-9aa9-d705dcb27893 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1296 microversion: 2.1 time: 0.432087 Oct 05 17:45:40.968813 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1684/3169] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:40 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1296 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:40.976650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e0f4a215-58eb-400b-aa85-15b8e77ced50 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775219430>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:41.089299 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e0f4a215-58eb-400b-aa85-15b8e77ced50 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.119168 Oct 05 17:45:41.095530 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1685/3170] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:40 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:41.102240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b5489a7-dbcf-4c9f-9f2a-5063ccdaf14c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e020243c-29e0-4831-90f3-e44e31119541", "device": "/dev/xvdb"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:41.112369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-efdbbfcd-824b-4c7d-9060-72fc06b8b678 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:41.113893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5b5489a7-dbcf-4c9f-9f2a-5063ccdaf14c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:41.123476 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-efdbbfcd-824b-4c7d-9060-72fc06b8b678 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1664 microversion: 2.1 time: 1.593343 Oct 05 17:45:41.124078 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1486/3171] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:39 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1664 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:41.128508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b5489a7-dbcf-4c9f-9f2a-5063ccdaf14c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:41.131896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b5489a7-dbcf-4c9f-9f2a-5063ccdaf14c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:41.134626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b5489a7-dbcf-4c9f-9f2a-5063ccdaf14c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:41.139909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b5489a7-dbcf-4c9f-9f2a-5063ccdaf14c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:41.140560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b5489a7-dbcf-4c9f-9f2a-5063ccdaf14c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:41.141138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b5489a7-dbcf-4c9f-9f2a-5063ccdaf14c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:41.554308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-61a08266-7aac-415e-af66-58301bea670a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:41.555180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-61a08266-7aac-415e-af66-58301bea670a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:41.580137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a08266-7aac-415e-af66-58301bea670a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:41.580881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a08266-7aac-415e-af66-58301bea670a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:41.581095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a08266-7aac-415e-af66-58301bea670a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:41.591360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a08266-7aac-415e-af66-58301bea670a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:41.592133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a08266-7aac-415e-af66-58301bea670a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:41.592562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a08266-7aac-415e-af66-58301bea670a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:41.680100 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b5489a7-dbcf-4c9f-9f2a-5063ccdaf14c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "POST /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.577027 Oct 05 17:45:41.692202 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1686/3172] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 17:45:41 2022] POST /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 194 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:42.006574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1669e984-5dc6-47bc-88e6-223fce3e7a27 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:42.007489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1669e984-5dc6-47bc-88e6-223fce3e7a27 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:42.033403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1669e984-5dc6-47bc-88e6-223fce3e7a27 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:42.038393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1669e984-5dc6-47bc-88e6-223fce3e7a27 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:42.038866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1669e984-5dc6-47bc-88e6-223fce3e7a27 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:42.039623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1669e984-5dc6-47bc-88e6-223fce3e7a27 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:42.047796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1669e984-5dc6-47bc-88e6-223fce3e7a27 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:42.048259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1669e984-5dc6-47bc-88e6-223fce3e7a27 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:42.861515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-61a08266-7aac-415e-af66-58301bea670a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:42.894012 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-61a08266-7aac-415e-af66-58301bea670a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 1.348367 Oct 05 17:45:42.896987 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1487/3173] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:41 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:42.918267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97d27ea8-8d60-4fee-8c95-fd6e8e40bd89 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77759a6040>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:42.960087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1669e984-5dc6-47bc-88e6-223fce3e7a27 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:42.964641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:42.991156 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1669e984-5dc6-47bc-88e6-223fce3e7a27 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1364 microversion: 2.1 time: 1.000601 Oct 05 17:45:43.004793 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1687/3174] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:41 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1364 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:43.006127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4ee64686-9fd6-49ef-b006-3c844927cab8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:43.006893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4ee64686-9fd6-49ef-b006-3c844927cab8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:43.030479 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-97d27ea8-8d60-4fee-8c95-fd6e8e40bd89 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.119005 Oct 05 17:45:43.034525 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1488/3175] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:42 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:43.042263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ee64686-9fd6-49ef-b006-3c844927cab8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:43.043046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ee64686-9fd6-49ef-b006-3c844927cab8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:43.043886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ee64686-9fd6-49ef-b006-3c844927cab8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:43.044829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ee64686-9fd6-49ef-b006-3c844927cab8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:43.045467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ee64686-9fd6-49ef-b006-3c844927cab8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:43.046340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ee64686-9fd6-49ef-b006-3c844927cab8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:43.924802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-16989c23-73dd-484e-98de-753ec3d0cd01 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:43.926524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-16989c23-73dd-484e-98de-753ec3d0cd01 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:43.945323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:43.953945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16989c23-73dd-484e-98de-753ec3d0cd01 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:43.955108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16989c23-73dd-484e-98de-753ec3d0cd01 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:43.955806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16989c23-73dd-484e-98de-753ec3d0cd01 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:43.957974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16989c23-73dd-484e-98de-753ec3d0cd01 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:43.958749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16989c23-73dd-484e-98de-753ec3d0cd01 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:43.960024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16989c23-73dd-484e-98de-753ec3d0cd01 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:43.979204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:44.424320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-16989c23-73dd-484e-98de-753ec3d0cd01 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:44.438540 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-16989c23-73dd-484e-98de-753ec3d0cd01 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.515540 Oct 05 17:45:44.439628 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1489/3176] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:43 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:44.474715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2b6405f-c882-40c9-a8f7-463b6dd21db2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:44.475817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2b6405f-c882-40c9-a8f7-463b6dd21db2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:44.491108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2b6405f-c882-40c9-a8f7-463b6dd21db2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:44.494812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2b6405f-c882-40c9-a8f7-463b6dd21db2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:44.496332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2b6405f-c882-40c9-a8f7-463b6dd21db2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:44.497981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2b6405f-c882-40c9-a8f7-463b6dd21db2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:44.504128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2b6405f-c882-40c9-a8f7-463b6dd21db2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:44.506542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2b6405f-c882-40c9-a8f7-463b6dd21db2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:44.893151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4ee64686-9fd6-49ef-b006-3c844927cab8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:44.907414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2b6405f-c882-40c9-a8f7-463b6dd21db2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:44.919756 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c2b6405f-c882-40c9-a8f7-463b6dd21db2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1364 microversion: 2.1 time: 0.478155 Oct 05 17:45:44.921653 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1490/3177] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:44 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1364 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:44.928782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9a027d05-fba0-451c-9e29-0d291887cd2f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775b51e50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:44.962194 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4ee64686-9fd6-49ef-b006-3c844927cab8 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1664 microversion: 2.1 time: 1.967746 Oct 05 17:45:44.963126 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1688/3178] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:42 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1664 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:45.039194 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9a027d05-fba0-451c-9e29-0d291887cd2f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.114992 Oct 05 17:45:45.050081 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1491/3179] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:44 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:45.467525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c62b7972-dfd3-4457-9fd0-d6cff857e595 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:45.468130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c62b7972-dfd3-4457-9fd0-d6cff857e595 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:45.479222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:45.481298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c62b7972-dfd3-4457-9fd0-d6cff857e595 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:45.481801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c62b7972-dfd3-4457-9fd0-d6cff857e595 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:45.494383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c62b7972-dfd3-4457-9fd0-d6cff857e595 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:45.496413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c62b7972-dfd3-4457-9fd0-d6cff857e595 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:45.497323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c62b7972-dfd3-4457-9fd0-d6cff857e595 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:45.499196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c62b7972-dfd3-4457-9fd0-d6cff857e595 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:45.949535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2c06e481-a949-4d5e-82d9-61fde0221a45 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:45.950163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2c06e481-a949-4d5e-82d9-61fde0221a45 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:45.971014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c06e481-a949-4d5e-82d9-61fde0221a45 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:45.971509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c06e481-a949-4d5e-82d9-61fde0221a45 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:45.972062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c06e481-a949-4d5e-82d9-61fde0221a45 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:45.972649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c06e481-a949-4d5e-82d9-61fde0221a45 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:45.973099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c06e481-a949-4d5e-82d9-61fde0221a45 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:45.973522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c06e481-a949-4d5e-82d9-61fde0221a45 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:46.057607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c62b7972-dfd3-4457-9fd0-d6cff857e595 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:46.079869 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c62b7972-dfd3-4457-9fd0-d6cff857e595 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.617273 Oct 05 17:45:46.080495 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1689/3180] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:45 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:46.085538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88520969-f771-4018-b21f-9c37990633e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:46.093920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88520969-f771-4018-b21f-9c37990633e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:46.117538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88520969-f771-4018-b21f-9c37990633e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:46.118054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88520969-f771-4018-b21f-9c37990633e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:46.118539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88520969-f771-4018-b21f-9c37990633e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:46.119280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88520969-f771-4018-b21f-9c37990633e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:46.119749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88520969-f771-4018-b21f-9c37990633e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:46.120179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88520969-f771-4018-b21f-9c37990633e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:46.184304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=12 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:46.479269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2c06e481-a949-4d5e-82d9-61fde0221a45 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:46.496144 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2c06e481-a949-4d5e-82d9-61fde0221a45 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1364 microversion: 2.1 time: 0.550903 Oct 05 17:45:46.497011 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1492/3181] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:45 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1364 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:46.518231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-afa613f0-cca9-4679-9583-63e04a25261f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775b96160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:46.598900 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-afa613f0-cca9-4679-9583-63e04a25261f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.086970 Oct 05 17:45:46.599955 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1493/3182] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:46 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:47.064451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-dced57e3-8230-4482-b4d4-353a9c2eba4d req-9f178ed6-0c26-4c1f-89aa-e5c1d23b84d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad2a87d-6f65-4d38-add2-2b119a8a2210", "tag": "d524c925-1190-4025-83bf-7ff68a7cdb80"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:47.080413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88520969-f771-4018-b21f-9c37990633e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:47.086416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-dced57e3-8230-4482-b4d4-353a9c2eba4d req-9f178ed6-0c26-4c1f-89aa-e5c1d23b84d9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:47.087253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-dced57e3-8230-4482-b4d4-353a9c2eba4d req-9f178ed6-0c26-4c1f-89aa-e5c1d23b84d9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:47.087884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-dced57e3-8230-4482-b4d4-353a9c2eba4d req-9f178ed6-0c26-4c1f-89aa-e5c1d23b84d9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:47.093225 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88520969-f771-4018-b21f-9c37990633e4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 1.011040 Oct 05 17:45:47.110676 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-dced57e3-8230-4482-b4d4-353a9c2eba4d req-9f178ed6-0c26-4c1f-89aa-e5c1d23b84d9 service nova] Creating event network-changed:d524c925-1190-4025-83bf-7ff68a7cdb80 for instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 on n-h1-835595-3 Oct 05 17:45:47.115622 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1690/3183] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:46 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:47.123633 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-dced57e3-8230-4482-b4d4-353a9c2eba4d req-9f178ed6-0c26-4c1f-89aa-e5c1d23b84d9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062665 Oct 05 17:45:47.127455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-398987b2-8acf-4940-9d82-a8c22072a0bd tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:47.128084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-398987b2-8acf-4940-9d82-a8c22072a0bd tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:47.128515 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1494/3184] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:45:47.134140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a72d7c5-2a26-473c-8afc-9898f5a01dc0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:47.143748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a72d7c5-2a26-473c-8afc-9898f5a01dc0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:47.144722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-398987b2-8acf-4940-9d82-a8c22072a0bd tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:47.145235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-398987b2-8acf-4940-9d82-a8c22072a0bd tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:47.145683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-398987b2-8acf-4940-9d82-a8c22072a0bd tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:47.146430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-398987b2-8acf-4940-9d82-a8c22072a0bd tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:47.146978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-398987b2-8acf-4940-9d82-a8c22072a0bd tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:47.147415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-398987b2-8acf-4940-9d82-a8c22072a0bd tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:47.153946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a72d7c5-2a26-473c-8afc-9898f5a01dc0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:47.158050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a72d7c5-2a26-473c-8afc-9898f5a01dc0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:47.158688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a72d7c5-2a26-473c-8afc-9898f5a01dc0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:47.159600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a72d7c5-2a26-473c-8afc-9898f5a01dc0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:47.160211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a72d7c5-2a26-473c-8afc-9898f5a01dc0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:47.160807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a72d7c5-2a26-473c-8afc-9898f5a01dc0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:47.749375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a72d7c5-2a26-473c-8afc-9898f5a01dc0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:47.774487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:47.774888 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a72d7c5-2a26-473c-8afc-9898f5a01dc0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.635674 Oct 05 17:45:47.774888 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1495/3185] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:47 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:47.781140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0da33297-4028-4382-8ae3-aed4502fffbb tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:47.781769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0da33297-4028-4382-8ae3-aed4502fffbb tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:47.797919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0da33297-4028-4382-8ae3-aed4502fffbb tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:47.801371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0da33297-4028-4382-8ae3-aed4502fffbb tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:47.801881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0da33297-4028-4382-8ae3-aed4502fffbb tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:47.803212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0da33297-4028-4382-8ae3-aed4502fffbb tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:47.803692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0da33297-4028-4382-8ae3-aed4502fffbb tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:47.805930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0da33297-4028-4382-8ae3-aed4502fffbb tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:48.283464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-398987b2-8acf-4940-9d82-a8c22072a0bd tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:48.294992 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-398987b2-8acf-4940-9d82-a8c22072a0bd tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 1.171385 Oct 05 17:45:48.295595 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1691/3186] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:47 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:48.318328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b6ec2e89-f877-48a9-94df-9eba6605d046 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775243af0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:48.410657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0da33297-4028-4382-8ae3-aed4502fffbb tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:48.419803 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b6ec2e89-f877-48a9-94df-9eba6605d046 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.122386 Oct 05 17:45:48.429560 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0da33297-4028-4382-8ae3-aed4502fffbb tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1364 microversion: 2.1 time: 0.657460 Oct 05 17:45:48.430194 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1692/3187] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:48 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:48.439502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac47b323-4a3a-4a1d-8637-dba1f2332df5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:48.440591 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1496/3188] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:47 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1364 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:48.449240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac47b323-4a3a-4a1d-8637-dba1f2332df5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:48.462024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac47b323-4a3a-4a1d-8637-dba1f2332df5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:48.462024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac47b323-4a3a-4a1d-8637-dba1f2332df5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:48.462479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac47b323-4a3a-4a1d-8637-dba1f2332df5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:48.463412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac47b323-4a3a-4a1d-8637-dba1f2332df5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:48.464024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac47b323-4a3a-4a1d-8637-dba1f2332df5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:48.464624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac47b323-4a3a-4a1d-8637-dba1f2332df5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:48.916371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ac47b323-4a3a-4a1d-8637-dba1f2332df5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:48.935992 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac47b323-4a3a-4a1d-8637-dba1f2332df5 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.504398 Oct 05 17:45:48.946940 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1693/3189] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:48 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:48.959344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d326804d-c3f4-4a83-b0ca-27d5a4872ea1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:48.959970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d326804d-c3f4-4a83-b0ca-27d5a4872ea1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:48.969707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d326804d-c3f4-4a83-b0ca-27d5a4872ea1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:48.970196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d326804d-c3f4-4a83-b0ca-27d5a4872ea1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:48.970661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d326804d-c3f4-4a83-b0ca-27d5a4872ea1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:48.971373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d326804d-c3f4-4a83-b0ca-27d5a4872ea1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:48.971829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d326804d-c3f4-4a83-b0ca-27d5a4872ea1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:48.972245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d326804d-c3f4-4a83-b0ca-27d5a4872ea1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:49.205749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d326804d-c3f4-4a83-b0ca-27d5a4872ea1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:49.214448 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d326804d-c3f4-4a83-b0ca-27d5a4872ea1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.258895 Oct 05 17:45:49.215800 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1497/3190] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:48 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:49.241568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6dc95c98-4e37-4af3-a090-a3ac5117b430 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:49.242519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6dc95c98-4e37-4af3-a090-a3ac5117b430 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:49.257297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6dc95c98-4e37-4af3-a090-a3ac5117b430 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:49.258102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6dc95c98-4e37-4af3-a090-a3ac5117b430 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:49.258741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6dc95c98-4e37-4af3-a090-a3ac5117b430 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:49.259671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6dc95c98-4e37-4af3-a090-a3ac5117b430 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:49.260296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6dc95c98-4e37-4af3-a090-a3ac5117b430 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:49.260886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6dc95c98-4e37-4af3-a090-a3ac5117b430 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:49.316879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6765fc96-ed58-45ae-8584-3884cf1255ef tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:49.317789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6765fc96-ed58-45ae-8584-3884cf1255ef tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:49.325807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6765fc96-ed58-45ae-8584-3884cf1255ef tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:49.326603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6765fc96-ed58-45ae-8584-3884cf1255ef tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:49.327204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6765fc96-ed58-45ae-8584-3884cf1255ef tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:49.328193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6765fc96-ed58-45ae-8584-3884cf1255ef tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:49.328809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6765fc96-ed58-45ae-8584-3884cf1255ef tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:49.329393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6765fc96-ed58-45ae-8584-3884cf1255ef tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:49.600970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6765fc96-ed58-45ae-8584-3884cf1255ef tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:49.609345 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6765fc96-ed58-45ae-8584-3884cf1255ef tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.296223 Oct 05 17:45:49.610782 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1498/3191] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:49 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:49.616334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e1f8cfb-6080-44d3-8397-29bfebbb9931 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777966b160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:49.705764 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e1f8cfb-6080-44d3-8397-29bfebbb9931 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.093466 Oct 05 17:45:49.706726 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1499/3192] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:49 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:49.725794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58e8f807-8bc1-4c57-bb73-9d51bca675e5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:49.729573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-58e8f807-8bc1-4c57-bb73-9d51bca675e5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:49.751418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e8f807-8bc1-4c57-bb73-9d51bca675e5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:49.751919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e8f807-8bc1-4c57-bb73-9d51bca675e5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:49.752372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e8f807-8bc1-4c57-bb73-9d51bca675e5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:49.756355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e8f807-8bc1-4c57-bb73-9d51bca675e5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:49.756962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e8f807-8bc1-4c57-bb73-9d51bca675e5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:49.757419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58e8f807-8bc1-4c57-bb73-9d51bca675e5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:50.222241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58e8f807-8bc1-4c57-bb73-9d51bca675e5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:50.234874 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-58e8f807-8bc1-4c57-bb73-9d51bca675e5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1364 microversion: 2.1 time: 0.524291 Oct 05 17:45:50.237339 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1500/3193] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:49 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1364 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:50.306271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6dc95c98-4e37-4af3-a090-a3ac5117b430 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:50.317922 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6dc95c98-4e37-4af3-a090-a3ac5117b430 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 1.080709 Oct 05 17:45:50.322927 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1694/3194] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:49 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:50.356771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-acc820da-ff02-4551-9dca-ad05df9af3d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:50.357439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-acc820da-ff02-4551-9dca-ad05df9af3d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:50.376985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acc820da-ff02-4551-9dca-ad05df9af3d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:50.379154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acc820da-ff02-4551-9dca-ad05df9af3d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:50.380171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acc820da-ff02-4551-9dca-ad05df9af3d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:50.382778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acc820da-ff02-4551-9dca-ad05df9af3d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:50.385044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acc820da-ff02-4551-9dca-ad05df9af3d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:50.387474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acc820da-ff02-4551-9dca-ad05df9af3d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:50.453546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-acc820da-ff02-4551-9dca-ad05df9af3d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lazy-loading 'flavor' on Instance uuid 586258bf-c661-4819-804b-504089c77dc6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:45:50.620670 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-acc820da-ff02-4551-9dca-ad05df9af3d9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.272903 Oct 05 17:45:50.625991 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1501/3195] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:45:50 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:45:50.630654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e43c37a4-e834-4337-b21d-4c658315437c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:50.632195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e43c37a4-e834-4337-b21d-4c658315437c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:50.644861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3bfa4648-4ad2-4ded-b26c-630a9a59ea5c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:50.649249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3bfa4648-4ad2-4ded-b26c-630a9a59ea5c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:50.650774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e43c37a4-e834-4337-b21d-4c658315437c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:50.655238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e43c37a4-e834-4337-b21d-4c658315437c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:50.660480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e43c37a4-e834-4337-b21d-4c658315437c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:50.661674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e43c37a4-e834-4337-b21d-4c658315437c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:50.666570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e43c37a4-e834-4337-b21d-4c658315437c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:50.669636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e43c37a4-e834-4337-b21d-4c658315437c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:50.679660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bfa4648-4ad2-4ded-b26c-630a9a59ea5c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:50.680168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bfa4648-4ad2-4ded-b26c-630a9a59ea5c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:50.680610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bfa4648-4ad2-4ded-b26c-630a9a59ea5c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:50.681556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bfa4648-4ad2-4ded-b26c-630a9a59ea5c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:50.682051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bfa4648-4ad2-4ded-b26c-630a9a59ea5c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:50.686553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bfa4648-4ad2-4ded-b26c-630a9a59ea5c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:51.076113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e43c37a4-e834-4337-b21d-4c658315437c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:51.090435 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e43c37a4-e834-4337-b21d-4c658315437c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1676 microversion: 2.1 time: 0.464098 Oct 05 17:45:51.114084 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1695/3196] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:50 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1676 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:51.119619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-09e58d21-37a5-4ce1-b6ff-7bc4b661a6f8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775194310>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:51.164299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3bfa4648-4ad2-4ded-b26c-630a9a59ea5c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:51.197228 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-09e58d21-37a5-4ce1-b6ff-7bc4b661a6f8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.081292 Oct 05 17:45:51.204339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1696/3197] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:51 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:51.213171 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3bfa4648-4ad2-4ded-b26c-630a9a59ea5c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.574263 Oct 05 17:45:51.226314 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1502/3198] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:50 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:51.263317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4f8f8f1f-20e8-4a70-b1ed-78bd8173f49d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:51.263954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4f8f8f1f-20e8-4a70-b1ed-78bd8173f49d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:51.273579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8f8f1f-20e8-4a70-b1ed-78bd8173f49d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:51.274088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8f8f1f-20e8-4a70-b1ed-78bd8173f49d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:51.274958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8f8f1f-20e8-4a70-b1ed-78bd8173f49d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:51.278077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8f8f1f-20e8-4a70-b1ed-78bd8173f49d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:51.278077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8f8f1f-20e8-4a70-b1ed-78bd8173f49d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:51.278355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f8f8f1f-20e8-4a70-b1ed-78bd8173f49d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:51.694468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f8f8f1f-20e8-4a70-b1ed-78bd8173f49d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:51.706163 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4f8f8f1f-20e8-4a70-b1ed-78bd8173f49d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1364 microversion: 2.1 time: 0.447252 Oct 05 17:45:51.707990 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1697/3199] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:51 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1364 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:52.122334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e60c65f9-44d0-428d-b9f7-b4e4f22458de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:52.122974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e60c65f9-44d0-428d-b9f7-b4e4f22458de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:52.135595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e60c65f9-44d0-428d-b9f7-b4e4f22458de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:52.137088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e60c65f9-44d0-428d-b9f7-b4e4f22458de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:52.138446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e60c65f9-44d0-428d-b9f7-b4e4f22458de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:52.141107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e60c65f9-44d0-428d-b9f7-b4e4f22458de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:52.141787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e60c65f9-44d0-428d-b9f7-b4e4f22458de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:52.143489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e60c65f9-44d0-428d-b9f7-b4e4f22458de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:52.212989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8bf2526f-d8be-4d2d-a13b-6a1555c2a139 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774e02280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:52.280326 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8bf2526f-d8be-4d2d-a13b-6a1555c2a139 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.071216 Oct 05 17:45:52.281565 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1698/3200] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:52 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:52.287296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bce3fe20-8299-413f-9f67-174c470994a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:52.288279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bce3fe20-8299-413f-9f67-174c470994a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:52.296267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bce3fe20-8299-413f-9f67-174c470994a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:52.297124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bce3fe20-8299-413f-9f67-174c470994a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:52.297805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bce3fe20-8299-413f-9f67-174c470994a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:52.298932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bce3fe20-8299-413f-9f67-174c470994a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:52.299672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bce3fe20-8299-413f-9f67-174c470994a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:52.300370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bce3fe20-8299-413f-9f67-174c470994a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:52.593595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e60c65f9-44d0-428d-b9f7-b4e4f22458de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:52.609527 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e60c65f9-44d0-428d-b9f7-b4e4f22458de tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1659 microversion: 2.1 time: 0.492019 Oct 05 17:45:52.611557 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1503/3201] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:52 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1659 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:52.635691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d407d5c5-7726-4de2-946e-f4ac93404076 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:52.636345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d407d5c5-7726-4de2-946e-f4ac93404076 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:52.649250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d407d5c5-7726-4de2-946e-f4ac93404076 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:52.649845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d407d5c5-7726-4de2-946e-f4ac93404076 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:52.650314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d407d5c5-7726-4de2-946e-f4ac93404076 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:52.655200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d407d5c5-7726-4de2-946e-f4ac93404076 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:52.655688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d407d5c5-7726-4de2-946e-f4ac93404076 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:52.656126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d407d5c5-7726-4de2-946e-f4ac93404076 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:52.779196 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d407d5c5-7726-4de2-946e-f4ac93404076 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action" status: 202 len: 0 microversion: 2.1 time: 0.147884 Oct 05 17:45:52.781448 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1504/3202] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:45:52 2022] POST /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:45:52.790421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-57102171-eb6d-4800-b6a4-5a2786144866 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:52.791984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-57102171-eb6d-4800-b6a4-5a2786144866 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:52.801435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57102171-eb6d-4800-b6a4-5a2786144866 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:52.802348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57102171-eb6d-4800-b6a4-5a2786144866 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:52.803122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57102171-eb6d-4800-b6a4-5a2786144866 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:52.803984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57102171-eb6d-4800-b6a4-5a2786144866 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:52.804686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57102171-eb6d-4800-b6a4-5a2786144866 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:52.805529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57102171-eb6d-4800-b6a4-5a2786144866 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:52.852463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bce3fe20-8299-413f-9f67-174c470994a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:52.875233 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bce3fe20-8299-413f-9f67-174c470994a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.592254 Oct 05 17:45:52.876444 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1699/3203] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:52 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:52.882965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a320561d-56ed-4d01-8922-692f80298c03 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:52.883847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a320561d-56ed-4d01-8922-692f80298c03 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:52.892986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a320561d-56ed-4d01-8922-692f80298c03 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:52.893765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a320561d-56ed-4d01-8922-692f80298c03 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:52.894670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a320561d-56ed-4d01-8922-692f80298c03 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:52.895603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a320561d-56ed-4d01-8922-692f80298c03 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:52.896343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a320561d-56ed-4d01-8922-692f80298c03 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:52.897671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a320561d-56ed-4d01-8922-692f80298c03 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:53.047352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-57102171-eb6d-4800-b6a4-5a2786144866 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:53.066028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-57102171-eb6d-4800-b6a4-5a2786144866 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1364 microversion: 2.1 time: 0.282483 Oct 05 17:45:53.068517 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1505/3204] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:52 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:53.300464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-24efaac7-4cf4-4ca3-988f-8d0461547760 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775c5d040>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:53.395467 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-24efaac7-4cf4-4ca3-988f-8d0461547760 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.102750 Oct 05 17:45:53.397890 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1506/3205] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:53 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:53.490827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a320561d-56ed-4d01-8922-692f80298c03 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:53.505685 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a320561d-56ed-4d01-8922-692f80298c03 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1665 microversion: 2.1 time: 0.627985 Oct 05 17:45:53.511146 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1700/3206] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:52 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1665 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:53.905004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-502f84ac-629d-4c6d-a12a-7be6313e7487 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:53.905683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-502f84ac-629d-4c6d-a12a-7be6313e7487 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:53.916502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-502f84ac-629d-4c6d-a12a-7be6313e7487 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:53.923399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-502f84ac-629d-4c6d-a12a-7be6313e7487 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:53.926489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-502f84ac-629d-4c6d-a12a-7be6313e7487 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:53.933561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-502f84ac-629d-4c6d-a12a-7be6313e7487 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:53.934106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-502f84ac-629d-4c6d-a12a-7be6313e7487 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:53.937541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-502f84ac-629d-4c6d-a12a-7be6313e7487 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:54.095790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae208dde-8f7f-41be-8db0-7e73401d73f3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:54.097000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae208dde-8f7f-41be-8db0-7e73401d73f3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:54.116879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae208dde-8f7f-41be-8db0-7e73401d73f3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:54.117596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae208dde-8f7f-41be-8db0-7e73401d73f3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:54.118206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae208dde-8f7f-41be-8db0-7e73401d73f3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:54.119646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae208dde-8f7f-41be-8db0-7e73401d73f3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:54.120301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae208dde-8f7f-41be-8db0-7e73401d73f3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:54.120892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae208dde-8f7f-41be-8db0-7e73401d73f3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:54.510174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-502f84ac-629d-4c6d-a12a-7be6313e7487 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:54.512924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:54.523843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ae208dde-8f7f-41be-8db0-7e73401d73f3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:54.527798 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-502f84ac-629d-4c6d-a12a-7be6313e7487 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.628741 Oct 05 17:45:54.528563 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1507/3207] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:53 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:54.535099 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae208dde-8f7f-41be-8db0-7e73401d73f3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1364 microversion: 2.1 time: 0.443017 Oct 05 17:45:54.545856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8ee3cae-f68a-4637-a904-9bd74aacb6ce tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775cb6c10>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:54.547968 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1701/3208] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:54 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1364 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:54.617257 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8ee3cae-f68a-4637-a904-9bd74aacb6ce tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.086528 Oct 05 17:45:54.617989 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1508/3209] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:54 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:54.626743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9048f802-a5b0-43cd-8bcc-5ef9b70bb3b3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:54.627686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9048f802-a5b0-43cd-8bcc-5ef9b70bb3b3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:54.635902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9048f802-a5b0-43cd-8bcc-5ef9b70bb3b3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:54.636645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9048f802-a5b0-43cd-8bcc-5ef9b70bb3b3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:54.637301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9048f802-a5b0-43cd-8bcc-5ef9b70bb3b3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:54.638217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9048f802-a5b0-43cd-8bcc-5ef9b70bb3b3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:54.638933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9048f802-a5b0-43cd-8bcc-5ef9b70bb3b3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:54.639549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9048f802-a5b0-43cd-8bcc-5ef9b70bb3b3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:54.810904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-895fa244-a358-4605-a79c-b4dd5bf9d32c tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Action: 'create', calling method: .version_select at 0x7f77752814c0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1696046239", "policies": ["affinity"]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:54.854517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-895fa244-a358-4605-a79c-b4dd5bf9d32c tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:54.869723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-895fa244-a358-4605-a79c-b4dd5bf9d32c tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:54.953420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9048f802-a5b0-43cd-8bcc-5ef9b70bb3b3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:54.968241 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9048f802-a5b0-43cd-8bcc-5ef9b70bb3b3 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1665 microversion: 2.1 time: 0.348160 Oct 05 17:45:54.982905 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1509/3210] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:54 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1665 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:54.992612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-895fa244-a358-4605-a79c-b4dd5bf9d32c tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:55.005625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-895fa244-a358-4605-a79c-b4dd5bf9d32c tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:55.035323 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-895fa244-a358-4605-a79c-b4dd5bf9d32c tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.485942 Oct 05 17:45:55.038727 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1702/3211] 10.222.0.70 () {60 vars in 1174 bytes} [Wed Oct 5 17:45:54 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:55.051981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e3ebb95e-9c81-434c-a064-e3d639ac7636 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Action: 'create', calling method: .version_select at 0x7f77755e4700>, body: {"server_group": {"name": "tempest-server-group-1078598132", "policies": ["affinity"]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:55.102270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e3ebb95e-9c81-434c-a064-e3d639ac7636 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:55.118244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e3ebb95e-9c81-434c-a064-e3d639ac7636 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:55.230091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e3ebb95e-9c81-434c-a064-e3d639ac7636 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:55.236961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e3ebb95e-9c81-434c-a064-e3d639ac7636 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:55.262733 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e3ebb95e-9c81-434c-a064-e3d639ac7636 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.216775 Oct 05 17:45:55.271925 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1510/3212] 10.222.0.70 () {60 vars in 1173 bytes} [Wed Oct 5 17:45:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:55.277743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-50aee85c-87e1-44ba-974f-89f130291843 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Action: 'create', calling method: .version_select at 0x7f77751d1820>, body: {"server_group": {"name": "tempest-server-group-1078598132", "policies": ["affinity"]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:55.300148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-50aee85c-87e1-44ba-974f-89f130291843 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:55.308149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-50aee85c-87e1-44ba-974f-89f130291843 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:55.378304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-50aee85c-87e1-44ba-974f-89f130291843 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:55.384474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-50aee85c-87e1-44ba-974f-89f130291843 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:55.403076 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-50aee85c-87e1-44ba-974f-89f130291843 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.129100 Oct 05 17:45:55.403901 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1703/3213] 10.222.0.70 () {60 vars in 1173 bytes} [Wed Oct 5 17:45:55 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:55.414809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f239581-1e1c-43b7-b78c-74a3a8e13f92 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:55.486907 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3f239581-1e1c-43b7-b78c-74a3a8e13f92 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/119b07b8-9c20-4326-ab20-ec88c72ee03f" status: 204 len: 0 microversion: 2.1 time: 0.075577 Oct 05 17:45:55.488199 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1511/3214] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:45:55 2022] DELETE /compute/v2.1/os-server-groups/119b07b8-9c20-4326-ab20-ec88c72ee03f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:45:55.497766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f6da171-48ac-4c39-b49c-ef81dce4fdd9 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:55.530049 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f6da171-48ac-4c39-b49c-ef81dce4fdd9 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.037381 Oct 05 17:45:55.538984 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1704/3215] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:45:55 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:55.543375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bf9bcc48-a084-487c-83ce-df4bbdfd28ec tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:55.557412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-750b4759-0ee3-41bd-8768-6f51bef87a31 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:55.562705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-750b4759-0ee3-41bd-8768-6f51bef87a31 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:55.578815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-750b4759-0ee3-41bd-8768-6f51bef87a31 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:55.583566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-750b4759-0ee3-41bd-8768-6f51bef87a31 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:55.584342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-750b4759-0ee3-41bd-8768-6f51bef87a31 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:55.585613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-750b4759-0ee3-41bd-8768-6f51bef87a31 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:55.586334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-750b4759-0ee3-41bd-8768-6f51bef87a31 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:55.586999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-750b4759-0ee3-41bd-8768-6f51bef87a31 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:55.634763 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bf9bcc48-a084-487c-83ce-df4bbdfd28ec tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/b9fc6b5b-f474-4174-84da-e88470298bc3" status: 204 len: 0 microversion: 2.1 time: 0.091717 Oct 05 17:45:55.638389 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1512/3216] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:45:55 2022] DELETE /compute/v2.1/os-server-groups/b9fc6b5b-f474-4174-84da-e88470298bc3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:45:55.645738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d59018f5-ed21-4756-b0f3-a3cc4b2954d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:55.647927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d59018f5-ed21-4756-b0f3-a3cc4b2954d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:55.688970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d59018f5-ed21-4756-b0f3-a3cc4b2954d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:55.689532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d59018f5-ed21-4756-b0f3-a3cc4b2954d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:55.695699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d59018f5-ed21-4756-b0f3-a3cc4b2954d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:55.698914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d59018f5-ed21-4756-b0f3-a3cc4b2954d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:55.703657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d59018f5-ed21-4756-b0f3-a3cc4b2954d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:55.704136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d59018f5-ed21-4756-b0f3-a3cc4b2954d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:56.255136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d59018f5-ed21-4756-b0f3-a3cc4b2954d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:56.269107 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d59018f5-ed21-4756-b0f3-a3cc4b2954d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1364 microversion: 2.1 time: 0.629421 Oct 05 17:45:56.279418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-750b4759-0ee3-41bd-8768-6f51bef87a31 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:56.283019 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1513/3217] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:55 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1364 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:56.289365 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-750b4759-0ee3-41bd-8768-6f51bef87a31 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.737225 Oct 05 17:45:56.296748 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1705/3218] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:55 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:56.302130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25c1a586-a769-4ce2-8724-dc78a804af7d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:56.311127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-01f926f9-06ce-46c0-afd7-c266efc89c0f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777584bee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:56.329607 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25c1a586-a769-4ce2-8724-dc78a804af7d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.031479 Oct 05 17:45:56.344820 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1706/3219] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:45:56 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:56.352299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d8e1162f-0952-4558-905d-6a31f729c792 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:56.357740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d8e1162f-0952-4558-905d-6a31f729c792 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:56.376443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8e1162f-0952-4558-905d-6a31f729c792 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:56.377312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8e1162f-0952-4558-905d-6a31f729c792 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:56.377948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8e1162f-0952-4558-905d-6a31f729c792 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:56.378888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8e1162f-0952-4558-905d-6a31f729c792 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:56.379506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8e1162f-0952-4558-905d-6a31f729c792 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:56.382090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8e1162f-0952-4558-905d-6a31f729c792 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:56.424297 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-01f926f9-06ce-46c0-afd7-c266efc89c0f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.138662 Oct 05 17:45:56.424901 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1514/3220] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:56 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:56.433909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-592378fc-c2ae-4a50-99aa-7f76df08e64e req-c3f2de37-b290-41a7-8742-c267d2fa4616 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad2a87d-6f65-4d38-add2-2b119a8a2210", "name": "network-vif-plugged", "status": "completed", "tag": "d524c925-1190-4025-83bf-7ff68a7cdb80"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:56.477495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-592378fc-c2ae-4a50-99aa-7f76df08e64e req-c3f2de37-b290-41a7-8742-c267d2fa4616 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:56.477982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-592378fc-c2ae-4a50-99aa-7f76df08e64e req-c3f2de37-b290-41a7-8742-c267d2fa4616 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:56.487432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-592378fc-c2ae-4a50-99aa-7f76df08e64e req-c3f2de37-b290-41a7-8742-c267d2fa4616 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:56.508622 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-592378fc-c2ae-4a50-99aa-7f76df08e64e req-c3f2de37-b290-41a7-8742-c267d2fa4616 service nova] Creating event network-vif-plugged:d524c925-1190-4025-83bf-7ff68a7cdb80 for instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 on n-h1-835595-3 Oct 05 17:45:56.516093 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-592378fc-c2ae-4a50-99aa-7f76df08e64e req-c3f2de37-b290-41a7-8742-c267d2fa4616 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089941 Oct 05 17:45:56.520850 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1515/3221] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:56.526244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6190bea6-0156-487c-8301-bfb857867587 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Action: 'create', calling method: .version_select at 0x7f7775b96c10>, body: {"server_group": {"name": "tempest-server-group-932137510", "policies": ["affinity"]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:56.555190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6190bea6-0156-487c-8301-bfb857867587 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:56.562260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6190bea6-0156-487c-8301-bfb857867587 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:56.648529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6190bea6-0156-487c-8301-bfb857867587 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:56.659407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:56.662846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6190bea6-0156-487c-8301-bfb857867587 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:56.712526 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6190bea6-0156-487c-8301-bfb857867587 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.190097 Oct 05 17:45:56.713342 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1516/3222] 10.222.0.70 () {60 vars in 1173 bytes} [Wed Oct 5 17:45:56 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:56.729147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e32817d7-13ef-4f5b-b32b-ec38d460d43f tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:56.811886 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e32817d7-13ef-4f5b-b32b-ec38d460d43f tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/6db96340-1f0d-4612-ba69-7b49d05b0555" status: 204 len: 0 microversion: 2.1 time: 0.091223 Oct 05 17:45:56.821722 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1517/3223] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:45:56 2022] DELETE /compute/v2.1/os-server-groups/6db96340-1f0d-4612-ba69-7b49d05b0555 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:45:56.840607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64d7818c-f842-4acd-b19a-5df8aa42dcb5 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:56.897368 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-64d7818c-f842-4acd-b19a-5df8aa42dcb5 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.072964 Oct 05 17:45:56.898184 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1518/3224] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:45:56 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:56.930743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-122f53a5-d2fa-46ff-a041-6525fd81c2c7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Action: 'create', calling method: .version_select at 0x7f7775b96d30>, body: {"server_group": {"name": "tempest-server-group-798257121", "policies": ["anti-affinity"]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:56.954731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-122f53a5-d2fa-46ff-a041-6525fd81c2c7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:56.968554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-122f53a5-d2fa-46ff-a041-6525fd81c2c7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:57.015021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d8e1162f-0952-4558-905d-6a31f729c792 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:57.025649 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d8e1162f-0952-4558-905d-6a31f729c792 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.678244 Oct 05 17:45:57.029081 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1707/3225] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:56 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:57.061600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ae3711a-6bff-4a75-a516-40aae66cfab6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:57.062542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8ae3711a-6bff-4a75-a516-40aae66cfab6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:57.073344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae3711a-6bff-4a75-a516-40aae66cfab6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:57.075360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae3711a-6bff-4a75-a516-40aae66cfab6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:57.076070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae3711a-6bff-4a75-a516-40aae66cfab6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:57.077024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae3711a-6bff-4a75-a516-40aae66cfab6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:57.077682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae3711a-6bff-4a75-a516-40aae66cfab6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:57.078412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae3711a-6bff-4a75-a516-40aae66cfab6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:57.118960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-122f53a5-d2fa-46ff-a041-6525fd81c2c7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:57.127226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-122f53a5-d2fa-46ff-a041-6525fd81c2c7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:57.172048 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-122f53a5-d2fa-46ff-a041-6525fd81c2c7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.244973 Oct 05 17:45:57.178874 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1519/3226] 10.222.0.70 () {60 vars in 1173 bytes} [Wed Oct 5 17:45:56 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:57.194898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-db5422bd-df42-4428-be50-8adc372d05a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:57.250250 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-db5422bd-df42-4428-be50-8adc372d05a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/3b318604-9d4e-4c49-ad4f-c836a14249c5" status: 204 len: 0 microversion: 2.1 time: 0.070154 Oct 05 17:45:57.251274 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1520/3227] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:45:57 2022] DELETE /compute/v2.1/os-server-groups/3b318604-9d4e-4c49-ad4f-c836a14249c5 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:45:57.264130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b41c0599-55f4-4441-add2-fd46b9e5f3fd tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:57.287543 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b41c0599-55f4-4441-add2-fd46b9e5f3fd tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.030905 Oct 05 17:45:57.288794 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1521/3228] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:45:57 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:45:57.309550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-39bc96a8-9837-418a-9a05-bba694b4567a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:57.311052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-39bc96a8-9837-418a-9a05-bba694b4567a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:57.318717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bc96a8-9837-418a-9a05-bba694b4567a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:57.319474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bc96a8-9837-418a-9a05-bba694b4567a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:57.320070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bc96a8-9837-418a-9a05-bba694b4567a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:57.321463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bc96a8-9837-418a-9a05-bba694b4567a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:57.322092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bc96a8-9837-418a-9a05-bba694b4567a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:57.322912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39bc96a8-9837-418a-9a05-bba694b4567a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:57.405609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8ae3711a-6bff-4a75-a516-40aae66cfab6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:57.417020 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8ae3711a-6bff-4a75-a516-40aae66cfab6 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1668 microversion: 2.1 time: 0.367079 Oct 05 17:45:57.418558 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1708/3229] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:57 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1668 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:57.423347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aa9b3558-ddc0-48da-8e16-27d0f4459978 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:57.424258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aa9b3558-ddc0-48da-8e16-27d0f4459978 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:57.446667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa9b3558-ddc0-48da-8e16-27d0f4459978 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:57.448852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa9b3558-ddc0-48da-8e16-27d0f4459978 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:57.452786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa9b3558-ddc0-48da-8e16-27d0f4459978 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:57.453658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa9b3558-ddc0-48da-8e16-27d0f4459978 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:57.454204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa9b3558-ddc0-48da-8e16-27d0f4459978 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:57.456236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa9b3558-ddc0-48da-8e16-27d0f4459978 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:57.634176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-39bc96a8-9837-418a-9a05-bba694b4567a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:57.642612 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-39bc96a8-9837-418a-9a05-bba694b4567a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1364 microversion: 2.1 time: 0.337558 Oct 05 17:45:57.643206 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1522/3230] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:57 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:45:57.664284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1916316438", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "8b9cd3b5-85da-401e-960e-ba47360b997e"}]}, "os:scheduler_hints": {"group": "d72e30e3-9961-482d-8a59-73154ccfd7aa"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:45:57.714392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aa9b3558-ddc0-48da-8e16-27d0f4459978 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:57.725205 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aa9b3558-ddc0-48da-8e16-27d0f4459978 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.305275 Oct 05 17:45:57.725792 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1709/3231] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:57 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:57.730631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81ce0ad6-ac83-4715-bef3-06a4b67f87f8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774d45e50>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:57.784795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] validate_networks() for [('8b9cd3b5-85da-401e-960e-ba47360b997e', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:45:57.789923 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81ce0ad6-ac83-4715-bef3-06a4b67f87f8 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1453 microversion: 2.1 time: 0.062778 Oct 05 17:45:57.790589 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1710/3232] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:57 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:57.797210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:57.797811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:57.813192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:57.814018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:57.814717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:57.816705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:57.817349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:57.817952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:57.867433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:45:57.887622 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.api [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Working on deleting snapshot ceaaf48f-64ed-457a-85db-b051cd1d26dd from shelved instance... Oct 05 17:45:58.799745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:45:58.801234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:45:58.801881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:45:58.802478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:45:58.806372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:45:58.858928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:58.859645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:58.860569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:58.863429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:58.868234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:58.868839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:58.909652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:58.931015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:58.959426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:45:58.962218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:45:59.024598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128843) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 05 17:45:59.049263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_group_members'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:59.055504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_group_members'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:59.157581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for project abcafeba091a430c988536309174a3a9. Resources: {'server_group_members'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:45:59.170202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Getting quotas for user 388509aad0a34e96988e5ec7068070ea and project abcafeba091a430c988536309174a3a9. Resources: {'server_group_members'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:45:59.234230 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e05013e3-0f35-4393-86ad-c7423b4d5613 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589879 Oct 05 17:45:59.235287 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1523/3233] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:45:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:45:59.246103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9360f9e-405b-4b7b-8652-2761a090472c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:59.246103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b9360f9e-405b-4b7b-8652-2761a090472c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:59.246633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:59.254451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9360f9e-405b-4b7b-8652-2761a090472c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:59.255620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9360f9e-405b-4b7b-8652-2761a090472c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:59.257059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9360f9e-405b-4b7b-8652-2761a090472c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:59.259034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9360f9e-405b-4b7b-8652-2761a090472c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:59.259550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9360f9e-405b-4b7b-8652-2761a090472c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:59.262313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9360f9e-405b-4b7b-8652-2761a090472c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:59.463245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:45:59.497989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Doing local delete in cell 7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) {{(pid=128844) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 05 17:45:59.500937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:59.501659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:59.502793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:59.507135 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.api [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 05 17:45:59.515387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] deallocate_for_instance() {{(pid=128844) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 05 17:45:59.574939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9360f9e-405b-4b7b-8652-2761a090472c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:59.587166 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9360f9e-405b-4b7b-8652-2761a090472c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1550 microversion: 2.1 time: 0.349746 Oct 05 17:45:59.589040 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1524/3234] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:59 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1550 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:59.595214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dc347915-342f-4606-8a39-3b67ab123e20 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:59.595831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dc347915-342f-4606-8a39-3b67ab123e20 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:45:59.609455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc347915-342f-4606-8a39-3b67ab123e20 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:59.609962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc347915-342f-4606-8a39-3b67ab123e20 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:59.610459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc347915-342f-4606-8a39-3b67ab123e20 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:59.611173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc347915-342f-4606-8a39-3b67ab123e20 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:45:59.612172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc347915-342f-4606-8a39-3b67ab123e20 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:45:59.612673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc347915-342f-4606-8a39-3b67ab123e20 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:45:59.797084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dc347915-342f-4606-8a39-3b67ab123e20 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:45:59.807597 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dc347915-342f-4606-8a39-3b67ab123e20 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.215952 Oct 05 17:45:59.809144 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1525/3235] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:59 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:59.817253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c25b0f2b-7607-4497-87b9-7b5c88c5d152 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7779585e50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:59.899407 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c25b0f2b-7607-4497-87b9-7b5c88c5d152 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1462 microversion: 2.1 time: 0.087008 Oct 05 17:45:59.900306 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1526/3236] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:45:59 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:45:59.905742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2be953a5-2bc3-48fa-9b95-e5076fea46f1 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:45:59.907070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2be953a5-2bc3-48fa-9b95-e5076fea46f1 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:00.016560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2be953a5-2bc3-48fa-9b95-e5076fea46f1 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:00.028733 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2be953a5-2bc3-48fa-9b95-e5076fea46f1 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1213 microversion: 2.1 time: 0.127238 Oct 05 17:46:00.029322 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1527/3237] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:45:59 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1213 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:00.039857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3fde6bfa-7f33-498a-bff8-24f0ce3ff0e0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:00.043023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3fde6bfa-7f33-498a-bff8-24f0ce3ff0e0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:00.053214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fde6bfa-7f33-498a-bff8-24f0ce3ff0e0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:00.059245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fde6bfa-7f33-498a-bff8-24f0ce3ff0e0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:00.059950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fde6bfa-7f33-498a-bff8-24f0ce3ff0e0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:00.061715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fde6bfa-7f33-498a-bff8-24f0ce3ff0e0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:00.065452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fde6bfa-7f33-498a-bff8-24f0ce3ff0e0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:00.066091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fde6bfa-7f33-498a-bff8-24f0ce3ff0e0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:00.266823 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3fde6bfa-7f33-498a-bff8-24f0ce3ff0e0 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1858 microversion: 2.1 time: 0.235340 Oct 05 17:46:00.288031 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1528/3238] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:00 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1858 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:00.297156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a1223415-6a7c-41fc-861a-e6d4e2ed671b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:00.302022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a1223415-6a7c-41fc-861a-e6d4e2ed671b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:00.316946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1223415-6a7c-41fc-861a-e6d4e2ed671b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:00.317710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1223415-6a7c-41fc-861a-e6d4e2ed671b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:00.318364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1223415-6a7c-41fc-861a-e6d4e2ed671b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:00.321788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1223415-6a7c-41fc-861a-e6d4e2ed671b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:00.322502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1223415-6a7c-41fc-861a-e6d4e2ed671b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:00.323130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1223415-6a7c-41fc-861a-e6d4e2ed671b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:00.420568 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a1223415-6a7c-41fc-861a-e6d4e2ed671b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131020 Oct 05 17:46:00.421355 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1529/3239] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:46:00 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:00.426895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c7d6e16f-8a25-4c28-ae5a-47d38681bbc5 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775b96820>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:00.489938 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c7d6e16f-8a25-4c28-ae5a-47d38681bbc5 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 200 len: 1462 microversion: 2.1 time: 0.067299 Oct 05 17:46:00.490716 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1530/3240] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:00 2022] GET /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 1462 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:00.495703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-835595-3", "block_migration": true, "disk_over_commit": false}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:00.498693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:00.506405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:00.506593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:00.507068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:00.507894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:00.508530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:00.509853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:00.547863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lazy-loading 'flavor' on Instance uuid 861d19af-3969-47e3-9887-e20a02de197f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:46:00.561805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Going to try to live migrate instance to n-h2-835595-3 {{(pid=128843) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 17:46:00.762434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Updating instance_info_cache with network_info: [] {{(pid=128844) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:46:01.359687 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e815322b-af7e-4c99-8be0-23f37c24254c tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 204 len: 0 microversion: 2.1 time: 3.568024 Oct 05 17:46:01.363616 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1711/3241] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:45:57 2022] DELETE /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 0 bytes in 3570 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:46:01.368887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13ee3753-ebdd-4e4a-8e4d-65cc925deaab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:01.369547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13ee3753-ebdd-4e4a-8e4d-65cc925deaab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:01.375863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ee3753-ebdd-4e4a-8e4d-65cc925deaab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:01.376607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ee3753-ebdd-4e4a-8e4d-65cc925deaab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:01.377044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ee3753-ebdd-4e4a-8e4d-65cc925deaab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:01.377927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ee3753-ebdd-4e4a-8e4d-65cc925deaab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:01.378427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ee3753-ebdd-4e4a-8e4d-65cc925deaab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:01.379130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ee3753-ebdd-4e4a-8e4d-65cc925deaab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:01.759169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-13ee3753-ebdd-4e4a-8e4d-65cc925deaab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:01.768940 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13ee3753-ebdd-4e4a-8e4d-65cc925deaab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d" status: 200 len: 1467 microversion: 2.1 time: 0.405345 Oct 05 17:46:01.770472 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1712/3242] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:01 2022] GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d => generated 1467 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:01.775342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a55017e2-fcbe-497a-bc52-50a4da81b872 req-5b52ce5f-0c09-4e92-a201-9fd0f202585d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d64aabce-b60d-42c0-881b-43aa1880709b", "name": "network-vif-deleted", "tag": "ca151148-f4dd-4fec-afc0-c8cb86c25709"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:01.785310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a55017e2-fcbe-497a-bc52-50a4da81b872 req-5b52ce5f-0c09-4e92-a201-9fd0f202585d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:01.786076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a55017e2-fcbe-497a-bc52-50a4da81b872 req-5b52ce5f-0c09-4e92-a201-9fd0f202585d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:01.786744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a55017e2-fcbe-497a-bc52-50a4da81b872 req-5b52ce5f-0c09-4e92-a201-9fd0f202585d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:01.798667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.server_external_events [req-a55017e2-fcbe-497a-bc52-50a4da81b872 req-5b52ce5f-0c09-4e92-a201-9fd0f202585d service nova] Unable to find a host for instance d64aabce-b60d-42c0-881b-43aa1880709b. Dropping event network-vif-deleted {{(pid=128844) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 17:46:01.799657 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a55017e2-fcbe-497a-bc52-50a4da81b872 req-5b52ce5f-0c09-4e92-a201-9fd0f202585d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.028106 Oct 05 17:46:01.800495 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1713/3243] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 17:46:01.805509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-924532cc-9d29-4106-8d01-a41d0304e0d5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:01.806450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-924532cc-9d29-4106-8d01-a41d0304e0d5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:01.808622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:01.815137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-924532cc-9d29-4106-8d01-a41d0304e0d5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:01.815630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-924532cc-9d29-4106-8d01-a41d0304e0d5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:01.816098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-924532cc-9d29-4106-8d01-a41d0304e0d5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:01.817035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-924532cc-9d29-4106-8d01-a41d0304e0d5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:01.817662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-924532cc-9d29-4106-8d01-a41d0304e0d5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:01.818254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-924532cc-9d29-4106-8d01-a41d0304e0d5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.201763 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5679eab0-cb97-4603-9fee-6b0221ce004e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/action" status: 202 len: 0 microversion: 2.1 time: 1.709480 Oct 05 17:46:02.206630 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1531/3244] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:46:00 2022] POST /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/action => generated 0 bytes in 1712 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:46:02.210698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4167d2db-2b47-4374-bfc5-72e5d617bb76 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:02.211491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4167d2db-2b47-4374-bfc5-72e5d617bb76 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:02.220621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4167d2db-2b47-4374-bfc5-72e5d617bb76 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.221156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4167d2db-2b47-4374-bfc5-72e5d617bb76 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.221596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4167d2db-2b47-4374-bfc5-72e5d617bb76 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.222451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4167d2db-2b47-4374-bfc5-72e5d617bb76 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.224521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4167d2db-2b47-4374-bfc5-72e5d617bb76 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.225123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4167d2db-2b47-4374-bfc5-72e5d617bb76 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.307402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4167d2db-2b47-4374-bfc5-72e5d617bb76 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:02.315451 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4167d2db-2b47-4374-bfc5-72e5d617bb76 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1271 microversion: 2.1 time: 0.110967 Oct 05 17:46:02.316286 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1532/3245] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:02 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:02.321142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:02.321763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: d64aabce-b60d-42c0-881b-43aa1880709b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:02.327678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.328378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.328978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.329822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.330453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.331026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.346024 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] HTTP exception thrown: Instance d64aabce-b60d-42c0-881b-43aa1880709b could not be found. Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Request method failure captured: Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b HTTP/1.1 Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcCvFl89ip348NgYmwRfZVFC69tIUsNnayzGFoWfaaS5WJz4H_LFyyNRNAoVHHF9Wfeh9GoU_EwuvkTy8VtZir92iFF1CSn6ibH-bezU0QjM6z6boOtDmg22QRK98g5juENhUY8ur87Hcv6cKi_H4k4qVVkCC9KKvvdQauWSleksFok Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d8ec67d827143b3a09b519cb4af417e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}] Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 1c5f58a618c04b09815dea8f54504c7c Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance d64aabce-b60d-42c0-881b-43aa1880709b could not be found. Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'd64aabce-b60d-42c0-881b-43aa1880709b'} Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d64aabce-b60d-42c0-881b-43aa1880709b could not be found. Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d64aabce-b60d-42c0-881b-43aa1880709b could not be found. Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:02.347690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:02.352888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:02.352888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:02.352888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:02.352888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:02.352888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:02.352888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d64aabce-b60d-42c0-881b-43aa1880709b could not be found. Oct 05 17:46:02.352888 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:02.354094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Returning 404 to user: Instance d64aabce-b60d-42c0-881b-43aa1880709b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:02.355161 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8209cb2b-c271-44b6-83d6-b022426cdfd1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b" status: 404 len: 111 microversion: 2.1 time: 0.037773 Oct 05 17:46:02.355744 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1533/3246] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:02 2022] GET /compute/v2.1/servers/d64aabce-b60d-42c0-881b-43aa1880709b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:46:02.361192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed595f24-698a-4807-997b-5af400483fd3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-314956683"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:02.364087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed595f24-698a-4807-997b-5af400483fd3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:02.371157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed595f24-698a-4807-997b-5af400483fd3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.371639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed595f24-698a-4807-997b-5af400483fd3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.372266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed595f24-698a-4807-997b-5af400483fd3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.372963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed595f24-698a-4807-997b-5af400483fd3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.373409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed595f24-698a-4807-997b-5af400483fd3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.373824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed595f24-698a-4807-997b-5af400483fd3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.547775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-924532cc-9d29-4106-8d01-a41d0304e0d5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:02.559383 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-924532cc-9d29-4106-8d01-a41d0304e0d5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.756335 Oct 05 17:46:02.561739 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1714/3247] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:01 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:02.569558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2092f2d8-71ea-4ee0-86e9-c3df8b34856c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:02.571715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2092f2d8-71ea-4ee0-86e9-c3df8b34856c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:02.579576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2092f2d8-71ea-4ee0-86e9-c3df8b34856c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.582541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2092f2d8-71ea-4ee0-86e9-c3df8b34856c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.583231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2092f2d8-71ea-4ee0-86e9-c3df8b34856c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.584095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2092f2d8-71ea-4ee0-86e9-c3df8b34856c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.584586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2092f2d8-71ea-4ee0-86e9-c3df8b34856c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.585014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2092f2d8-71ea-4ee0-86e9-c3df8b34856c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.593440 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed595f24-698a-4807-997b-5af400483fd3 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "POST /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2/action" status: 202 len: 0 microversion: 2.1 time: 0.235893 Oct 05 17:46:02.594094 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1534/3248] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:46:02 2022] POST /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 17:46:02.605267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-95fc4c42-80d4-4d69-9b47-c6e23b773c0d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:02.605792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-95fc4c42-80d4-4d69-9b47-c6e23b773c0d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:02.625617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95fc4c42-80d4-4d69-9b47-c6e23b773c0d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.626121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95fc4c42-80d4-4d69-9b47-c6e23b773c0d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.626591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95fc4c42-80d4-4d69-9b47-c6e23b773c0d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.627305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95fc4c42-80d4-4d69-9b47-c6e23b773c0d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.627760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95fc4c42-80d4-4d69-9b47-c6e23b773c0d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.628257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95fc4c42-80d4-4d69-9b47-c6e23b773c0d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.684268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-95fc4c42-80d4-4d69-9b47-c6e23b773c0d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:46:02.763090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:02.854212 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-95fc4c42-80d4-4d69-9b47-c6e23b773c0d tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 204 len: 0 microversion: 2.1 time: 0.252647 Oct 05 17:46:02.855503 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1535/3249] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:46:02 2022] DELETE /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:46:02.868492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-493c0791-f65d-4eac-b4bf-ec14b9453c58 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77795d9ee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:02.947797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2092f2d8-71ea-4ee0-86e9-c3df8b34856c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:02.954216 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-493c0791-f65d-4eac-b4bf-ec14b9453c58 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.097296 Oct 05 17:46:02.962420 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1536/3250] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:02 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:02.962420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3436c912-fbc0-4a11-abea-533a8cc4a219 req-c5109825-b3ab-40f7-a1bb-31c589e89bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989ec240-1506-4643-b1e7-0a849f54db3d", "name": "network-vif-unplugged", "status": "completed", "tag": "ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:02.966633 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2092f2d8-71ea-4ee0-86e9-c3df8b34856c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.402568 Oct 05 17:46:02.967739 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1715/3251] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:02 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:02.973175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d607d3d0-4994-4b7d-86e4-f37309bdf704 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:02.974149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d607d3d0-4994-4b7d-86e4-f37309bdf704 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:02.980373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d607d3d0-4994-4b7d-86e4-f37309bdf704 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.981374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d607d3d0-4994-4b7d-86e4-f37309bdf704 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.982155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d607d3d0-4994-4b7d-86e4-f37309bdf704 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.983852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d607d3d0-4994-4b7d-86e4-f37309bdf704 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.984726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d607d3d0-4994-4b7d-86e4-f37309bdf704 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.985309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d607d3d0-4994-4b7d-86e4-f37309bdf704 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:02.986498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3436c912-fbc0-4a11-abea-533a8cc4a219 req-c5109825-b3ab-40f7-a1bb-31c589e89bfd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:02.986992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3436c912-fbc0-4a11-abea-533a8cc4a219 req-c5109825-b3ab-40f7-a1bb-31c589e89bfd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:02.987417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3436c912-fbc0-4a11-abea-533a8cc4a219 req-c5109825-b3ab-40f7-a1bb-31c589e89bfd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:03.000683 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3436c912-fbc0-4a11-abea-533a8cc4a219 req-c5109825-b3ab-40f7-a1bb-31c589e89bfd service nova] Creating event network-vif-unplugged:ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8 for instance 989ec240-1506-4643-b1e7-0a849f54db3d on n-h2-835595-3 Oct 05 17:46:03.006133 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3436c912-fbc0-4a11-abea-533a8cc4a219 req-c5109825-b3ab-40f7-a1bb-31c589e89bfd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049134 Oct 05 17:46:03.006775 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1537/3252] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:03.253563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d607d3d0-4994-4b7d-86e4-f37309bdf704 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:03.263177 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d607d3d0-4994-4b7d-86e4-f37309bdf704 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1467 microversion: 2.1 time: 0.294130 Oct 05 17:46:03.263811 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1716/3253] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:02 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1467 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:03.340863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d29eeb46-3bc7-460e-abc1-67e9eca8ff4d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:03.341671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d29eeb46-3bc7-460e-abc1-67e9eca8ff4d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:03.349020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d29eeb46-3bc7-460e-abc1-67e9eca8ff4d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:03.349620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d29eeb46-3bc7-460e-abc1-67e9eca8ff4d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:03.350136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d29eeb46-3bc7-460e-abc1-67e9eca8ff4d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:03.351189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d29eeb46-3bc7-460e-abc1-67e9eca8ff4d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:03.351679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d29eeb46-3bc7-460e-abc1-67e9eca8ff4d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:03.352304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d29eeb46-3bc7-460e-abc1-67e9eca8ff4d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:03.428260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d29eeb46-3bc7-460e-abc1-67e9eca8ff4d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:03.438525 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d29eeb46-3bc7-460e-abc1-67e9eca8ff4d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1271 microversion: 2.1 time: 0.102833 Oct 05 17:46:03.439398 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1538/3254] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:03 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1271 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:03.586154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-553c4fdd-23f7-4a32-a327-1d30dcdaae0c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:03.586850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-553c4fdd-23f7-4a32-a327-1d30dcdaae0c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:03.607058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553c4fdd-23f7-4a32-a327-1d30dcdaae0c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:03.607772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553c4fdd-23f7-4a32-a327-1d30dcdaae0c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:03.613872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553c4fdd-23f7-4a32-a327-1d30dcdaae0c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:03.616031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553c4fdd-23f7-4a32-a327-1d30dcdaae0c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:03.617005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553c4fdd-23f7-4a32-a327-1d30dcdaae0c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:03.617506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553c4fdd-23f7-4a32-a327-1d30dcdaae0c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:03.799715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-553c4fdd-23f7-4a32-a327-1d30dcdaae0c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:03.809575 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-553c4fdd-23f7-4a32-a327-1d30dcdaae0c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1515 microversion: 2.1 time: 0.229048 Oct 05 17:46:03.823011 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1717/3255] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:03 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1515 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:03.825477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-96f72a8b-7829-4dea-ab4c-740a900180bd req-db649733-1bb5-475b-90e2-97dfe73eb10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ad2a87d-6f65-4d38-add2-2b119a8a2210", "tag": "d524c925-1190-4025-83bf-7ff68a7cdb80"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:03.838331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-96f72a8b-7829-4dea-ab4c-740a900180bd req-db649733-1bb5-475b-90e2-97dfe73eb10b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:03.839272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-96f72a8b-7829-4dea-ab4c-740a900180bd req-db649733-1bb5-475b-90e2-97dfe73eb10b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:03.840670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-96f72a8b-7829-4dea-ab4c-740a900180bd req-db649733-1bb5-475b-90e2-97dfe73eb10b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:03.877757 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-96f72a8b-7829-4dea-ab4c-740a900180bd req-db649733-1bb5-475b-90e2-97dfe73eb10b service nova] Creating event network-changed:d524c925-1190-4025-83bf-7ff68a7cdb80 for instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 on n-h1-835595-3 Oct 05 17:46:03.885266 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-96f72a8b-7829-4dea-ab4c-740a900180bd req-db649733-1bb5-475b-90e2-97dfe73eb10b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063522 Oct 05 17:46:03.886105 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1539/3256] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:46:03.970616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3289815d-1227-45c2-b463-58c9a606c7ab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77752a1b80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:03.995944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b7e9fbbe-28e2-4a66-ba99-85e033c12d48 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:03.997036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b7e9fbbe-28e2-4a66-ba99-85e033c12d48 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:04.005376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e9fbbe-28e2-4a66-ba99-85e033c12d48 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:04.006581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e9fbbe-28e2-4a66-ba99-85e033c12d48 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:04.007139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e9fbbe-28e2-4a66-ba99-85e033c12d48 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:04.007900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e9fbbe-28e2-4a66-ba99-85e033c12d48 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:04.008576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e9fbbe-28e2-4a66-ba99-85e033c12d48 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:04.009275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e9fbbe-28e2-4a66-ba99-85e033c12d48 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:04.016328 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3289815d-1227-45c2-b463-58c9a606c7ab tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.049592 Oct 05 17:46:04.017472 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1718/3257] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:03 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:04.277242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7e9fbbe-28e2-4a66-ba99-85e033c12d48 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:04.288240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e620850-6626-4a32-90b8-c9b440fc2156 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:04.290071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e620850-6626-4a32-90b8-c9b440fc2156 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:04.300329 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b7e9fbbe-28e2-4a66-ba99-85e033c12d48 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.309648 Oct 05 17:46:04.319681 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1540/3258] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:03 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:04.320374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e620850-6626-4a32-90b8-c9b440fc2156 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:04.321105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e620850-6626-4a32-90b8-c9b440fc2156 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:04.321790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e620850-6626-4a32-90b8-c9b440fc2156 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:04.322735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e620850-6626-4a32-90b8-c9b440fc2156 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:04.323427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e620850-6626-4a32-90b8-c9b440fc2156 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:04.323978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e620850-6626-4a32-90b8-c9b440fc2156 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:04.454552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e620850-6626-4a32-90b8-c9b440fc2156 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:04.463339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ebf8a58-a8a6-4c4e-b10b-34e1f661afe7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:04.464023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7ebf8a58-a8a6-4c4e-b10b-34e1f661afe7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:04.465026 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e620850-6626-4a32-90b8-c9b440fc2156 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1467 microversion: 2.1 time: 0.181795 Oct 05 17:46:04.478594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf8a58-a8a6-4c4e-b10b-34e1f661afe7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:04.478594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf8a58-a8a6-4c4e-b10b-34e1f661afe7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:04.478594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf8a58-a8a6-4c4e-b10b-34e1f661afe7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:04.479911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf8a58-a8a6-4c4e-b10b-34e1f661afe7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:04.480058 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1719/3259] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:04 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1467 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:04.480695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf8a58-a8a6-4c4e-b10b-34e1f661afe7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:04.481289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf8a58-a8a6-4c4e-b10b-34e1f661afe7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:04.834385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-08b91ca7-9f1f-45b9-bc4c-d6fc5e7a0e46 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:04.835089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-08b91ca7-9f1f-45b9-bc4c-d6fc5e7a0e46 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:04.850529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08b91ca7-9f1f-45b9-bc4c-d6fc5e7a0e46 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:04.851397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08b91ca7-9f1f-45b9-bc4c-d6fc5e7a0e46 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:04.856369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08b91ca7-9f1f-45b9-bc4c-d6fc5e7a0e46 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:04.857207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08b91ca7-9f1f-45b9-bc4c-d6fc5e7a0e46 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:04.857650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08b91ca7-9f1f-45b9-bc4c-d6fc5e7a0e46 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:04.858091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08b91ca7-9f1f-45b9-bc4c-d6fc5e7a0e46 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:05.100773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-08b91ca7-9f1f-45b9-bc4c-d6fc5e7a0e46 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:05.137932 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-08b91ca7-9f1f-45b9-bc4c-d6fc5e7a0e46 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1521 microversion: 2.1 time: 0.306834 Oct 05 17:46:05.139912 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1720/3260] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:04 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:05.153440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-311811da-0adf-4518-9810-a12565584320 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77751161f0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:05.157505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7ebf8a58-a8a6-4c4e-b10b-34e1f661afe7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:05.168843 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ebf8a58-a8a6-4c4e-b10b-34e1f661afe7 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1313 microversion: 2.1 time: 0.709121 Oct 05 17:46:05.171251 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1541/3261] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:04 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1313 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:05.238879 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-311811da-0adf-4518-9810-a12565584320 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.096827 Oct 05 17:46:05.240223 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1721/3262] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:05 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:05.325143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-df645a5b-9606-41ed-94a4-f791b04fa249 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:05.326032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-df645a5b-9606-41ed-94a4-f791b04fa249 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:05.332396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df645a5b-9606-41ed-94a4-f791b04fa249 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:05.333320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df645a5b-9606-41ed-94a4-f791b04fa249 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:05.333921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df645a5b-9606-41ed-94a4-f791b04fa249 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:05.335324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df645a5b-9606-41ed-94a4-f791b04fa249 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:05.335947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df645a5b-9606-41ed-94a4-f791b04fa249 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:05.336537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df645a5b-9606-41ed-94a4-f791b04fa249 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:05.486030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=16 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:05.491730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1aeda2a6-fedc-45dc-9a7b-a8a99a9df742 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:05.492482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1aeda2a6-fedc-45dc-9a7b-a8a99a9df742 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:05.503093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1aeda2a6-fedc-45dc-9a7b-a8a99a9df742 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:05.503883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1aeda2a6-fedc-45dc-9a7b-a8a99a9df742 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:05.504553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1aeda2a6-fedc-45dc-9a7b-a8a99a9df742 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:05.505512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1aeda2a6-fedc-45dc-9a7b-a8a99a9df742 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:05.506299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1aeda2a6-fedc-45dc-9a7b-a8a99a9df742 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:05.506930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1aeda2a6-fedc-45dc-9a7b-a8a99a9df742 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:05.612211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1aeda2a6-fedc-45dc-9a7b-a8a99a9df742 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:05.621376 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1aeda2a6-fedc-45dc-9a7b-a8a99a9df742 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1467 microversion: 2.1 time: 0.136087 Oct 05 17:46:05.623324 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1722/3263] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:05 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1467 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:05.907294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7805d57b-da8a-4e76-957d-50885cce9918 req-39c7ca3d-71c5-41be-83bf-08a4abb2cf30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18cf41c6-26f8-4a3a-abe7-d3b7b814962f", "tag": "1e9ef320-7fa5-49fe-862f-353931f9ccb3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:05.956364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7805d57b-da8a-4e76-957d-50885cce9918 req-39c7ca3d-71c5-41be-83bf-08a4abb2cf30 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:05.957101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7805d57b-da8a-4e76-957d-50885cce9918 req-39c7ca3d-71c5-41be-83bf-08a4abb2cf30 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:05.957875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7805d57b-da8a-4e76-957d-50885cce9918 req-39c7ca3d-71c5-41be-83bf-08a4abb2cf30 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:05.972525 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7805d57b-da8a-4e76-957d-50885cce9918 req-39c7ca3d-71c5-41be-83bf-08a4abb2cf30 service nova] Creating event network-changed:1e9ef320-7fa5-49fe-862f-353931f9ccb3 for instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f on n-h1-835595-3 Oct 05 17:46:05.978622 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7805d57b-da8a-4e76-957d-50885cce9918 req-39c7ca3d-71c5-41be-83bf-08a4abb2cf30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077858 Oct 05 17:46:05.980111 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1723/3264] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:06.075575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3decc499-860b-4fe0-a370-7ffe1ed044d5 req-ea28753b-23b9-4b44-bc5f-8690a883e74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8782e20f-31a5-4548-bed9-1f77db983f32", "name": "network-vif-deleted", "tag": "faf0a0a8-ddc5-4f43-85a2-794e8fa87d2b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:06.087500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3decc499-860b-4fe0-a370-7ffe1ed044d5 req-ea28753b-23b9-4b44-bc5f-8690a883e74e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:06.088140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3decc499-860b-4fe0-a370-7ffe1ed044d5 req-ea28753b-23b9-4b44-bc5f-8690a883e74e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:06.088829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3decc499-860b-4fe0-a370-7ffe1ed044d5 req-ea28753b-23b9-4b44-bc5f-8690a883e74e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:06.102629 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3decc499-860b-4fe0-a370-7ffe1ed044d5 req-ea28753b-23b9-4b44-bc5f-8690a883e74e service nova] Creating event network-vif-deleted:faf0a0a8-ddc5-4f43-85a2-794e8fa87d2b for instance 8782e20f-31a5-4548-bed9-1f77db983f32 on n-h1-835595-3 Oct 05 17:46:06.107927 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3decc499-860b-4fe0-a370-7ffe1ed044d5 req-ea28753b-23b9-4b44-bc5f-8690a883e74e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042410 Oct 05 17:46:06.108477 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1724/3265] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:06.158921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df645a5b-9606-41ed-94a4-f791b04fa249 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:06.172209 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-df645a5b-9606-41ed-94a4-f791b04fa249 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.850940 Oct 05 17:46:06.173181 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1542/3266] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:05 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:06.179056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-593e8c22-7322-44c0-85d7-d02d3e205190 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:06.179922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-593e8c22-7322-44c0-85d7-d02d3e205190 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:06.188211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593e8c22-7322-44c0-85d7-d02d3e205190 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:06.188719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593e8c22-7322-44c0-85d7-d02d3e205190 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:06.189576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593e8c22-7322-44c0-85d7-d02d3e205190 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:06.190502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593e8c22-7322-44c0-85d7-d02d3e205190 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:06.191111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593e8c22-7322-44c0-85d7-d02d3e205190 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:06.191877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593e8c22-7322-44c0-85d7-d02d3e205190 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:06.195345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-abe0e99a-0d94-481a-98b9-ebb1cbb39541 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:06.196131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-abe0e99a-0d94-481a-98b9-ebb1cbb39541 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:06.203619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abe0e99a-0d94-481a-98b9-ebb1cbb39541 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:06.204142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abe0e99a-0d94-481a-98b9-ebb1cbb39541 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:06.204578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abe0e99a-0d94-481a-98b9-ebb1cbb39541 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:06.205532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abe0e99a-0d94-481a-98b9-ebb1cbb39541 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:06.206224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abe0e99a-0d94-481a-98b9-ebb1cbb39541 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:06.218903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abe0e99a-0d94-481a-98b9-ebb1cbb39541 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:06.373218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-593e8c22-7322-44c0-85d7-d02d3e205190 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:06.382030 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-593e8c22-7322-44c0-85d7-d02d3e205190 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1521 microversion: 2.1 time: 0.217620 Oct 05 17:46:06.383811 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1725/3267] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:06 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:06.389052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-900f7da4-670b-4eb2-aba5-5ebdbe5871ff tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77752a1c10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:06.455122 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-900f7da4-670b-4eb2-aba5-5ebdbe5871ff tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.069980 Oct 05 17:46:06.455902 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1726/3268] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:06 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:06.545301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-abe0e99a-0d94-481a-98b9-ebb1cbb39541 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:06.554989 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-abe0e99a-0d94-481a-98b9-ebb1cbb39541 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1313 microversion: 2.1 time: 0.365554 Oct 05 17:46:06.556194 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1543/3269] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:06 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1313 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:06.645226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a0ec136c-64dc-4788-b2ce-e0a3709418cc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:06.647189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a0ec136c-64dc-4788-b2ce-e0a3709418cc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:06.655003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ec136c-64dc-4788-b2ce-e0a3709418cc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:06.655859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ec136c-64dc-4788-b2ce-e0a3709418cc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:06.656704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ec136c-64dc-4788-b2ce-e0a3709418cc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:06.657772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ec136c-64dc-4788-b2ce-e0a3709418cc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:06.658514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ec136c-64dc-4788-b2ce-e0a3709418cc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:06.659283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0ec136c-64dc-4788-b2ce-e0a3709418cc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:06.740717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a0ec136c-64dc-4788-b2ce-e0a3709418cc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:06.745187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:UPDATE=16,nova_cell1:SELECT=80,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:06.752385 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a0ec136c-64dc-4788-b2ce-e0a3709418cc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 200 len: 1467 microversion: 2.1 time: 0.111096 Oct 05 17:46:06.753164 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1727/3270] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:06 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 1467 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:07.197709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d3957d91-d082-479e-aacc-21b95d163e50 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:07.198343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d3957d91-d082-479e-aacc-21b95d163e50 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:07.209251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3957d91-d082-479e-aacc-21b95d163e50 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:07.213070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3957d91-d082-479e-aacc-21b95d163e50 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:07.213531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3957d91-d082-479e-aacc-21b95d163e50 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:07.214312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3957d91-d082-479e-aacc-21b95d163e50 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:07.214761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3957d91-d082-479e-aacc-21b95d163e50 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:07.215185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3957d91-d082-479e-aacc-21b95d163e50 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:07.409467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f18e6682-a757-439d-9be0-e3a138ed935e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:07.410094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f18e6682-a757-439d-9be0-e3a138ed935e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:07.439364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f18e6682-a757-439d-9be0-e3a138ed935e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:07.439876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f18e6682-a757-439d-9be0-e3a138ed935e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:07.440329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f18e6682-a757-439d-9be0-e3a138ed935e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:07.441058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f18e6682-a757-439d-9be0-e3a138ed935e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:07.441748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f18e6682-a757-439d-9be0-e3a138ed935e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:07.442405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f18e6682-a757-439d-9be0-e3a138ed935e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:07.636053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f18e6682-a757-439d-9be0-e3a138ed935e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:07.646790 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f18e6682-a757-439d-9be0-e3a138ed935e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1521 microversion: 2.1 time: 0.241529 Oct 05 17:46:07.647966 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1728/3271] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:07 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:07.654268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7c604196-8a38-4424-8008-d30788f7c6eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777532e5e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:07.717211 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7c604196-8a38-4424-8008-d30788f7c6eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.067968 Oct 05 17:46:07.718014 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1729/3272] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:07 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:07.723141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27a560b7-600b-43f1-9087-6d0226a73382 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:07.724097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-27a560b7-600b-43f1-9087-6d0226a73382 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:07.731259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27a560b7-600b-43f1-9087-6d0226a73382 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:07.732061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27a560b7-600b-43f1-9087-6d0226a73382 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:07.732713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27a560b7-600b-43f1-9087-6d0226a73382 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:07.733708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27a560b7-600b-43f1-9087-6d0226a73382 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:07.734406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27a560b7-600b-43f1-9087-6d0226a73382 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:07.735064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27a560b7-600b-43f1-9087-6d0226a73382 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:07.839598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d3957d91-d082-479e-aacc-21b95d163e50 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:07.853698 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d3957d91-d082-479e-aacc-21b95d163e50 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.656370 Oct 05 17:46:07.866371 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1544/3273] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:07 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:07.887152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:07.889728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 8782e20f-31a5-4548-bed9-1f77db983f32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:07.919833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:07.921587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:07.922212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:07.925116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:07.925773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:07.928569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:07.975044 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] HTTP exception thrown: Instance 8782e20f-31a5-4548-bed9-1f77db983f32 could not be found. Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Request method failure captured: Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 HTTP/1.1 Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcCvFl89ip348NgYmwRfZVFC69tIUsNnayzGFoWfaaS5WJz4H_LFyyNRNAoVHHF9Wfeh9GoU_EwuvkTy8VtZir92iFF1CSn6ibH-bezU0QjM6z6boOtDmg22QRK98g5juENhUY8ur87Hcv6cKi_H4k4qVVkCC9KKvvdQauWSleksFok Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d8ec67d827143b3a09b519cb4af417e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}] Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 1c5f58a618c04b09815dea8f54504c7c Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 8782e20f-31a5-4548-bed9-1f77db983f32 could not be found. Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '8782e20f-31a5-4548-bed9-1f77db983f32'} Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8782e20f-31a5-4548-bed9-1f77db983f32 could not be found. Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8782e20f-31a5-4548-bed9-1f77db983f32 could not be found. Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:07.979106 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:07.985460 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:07.985460 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:07.985460 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:07.985460 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:07.985460 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:07.985460 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8782e20f-31a5-4548-bed9-1f77db983f32 could not be found. Oct 05 17:46:07.985460 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:07.985460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Returning 404 to user: Instance 8782e20f-31a5-4548-bed9-1f77db983f32 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:07.985460 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9f84b95d-9bc2-4be8-a034-b3a649f9b3c0 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32" status: 404 len: 111 microversion: 2.1 time: 0.112700 Oct 05 17:46:07.989392 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1545/3274] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:07 2022] GET /compute/v2.1/servers/8782e20f-31a5-4548-bed9-1f77db983f32 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:46:07.997291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b9986b5-f308-472f-bbb1-9a6f5ab15af2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:08.004452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5b9986b5-f308-472f-bbb1-9a6f5ab15af2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:08.016620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b9986b5-f308-472f-bbb1-9a6f5ab15af2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:08.022509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b9986b5-f308-472f-bbb1-9a6f5ab15af2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:08.023328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b9986b5-f308-472f-bbb1-9a6f5ab15af2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:08.024432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b9986b5-f308-472f-bbb1-9a6f5ab15af2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:08.025056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b9986b5-f308-472f-bbb1-9a6f5ab15af2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:08.025648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b9986b5-f308-472f-bbb1-9a6f5ab15af2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:08.046689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-27a560b7-600b-43f1-9087-6d0226a73382 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:08.059399 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27a560b7-600b-43f1-9087-6d0226a73382 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1313 microversion: 2.1 time: 0.340005 Oct 05 17:46:08.060199 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1730/3275] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:07 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:08.089180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5b9986b5-f308-472f-bbb1-9a6f5ab15af2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:46:08.241777 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b9986b5-f308-472f-bbb1-9a6f5ab15af2 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 204 len: 0 microversion: 2.1 time: 0.250596 Oct 05 17:46:08.242750 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1546/3276] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:46:07 2022] DELETE /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:46:08.251007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23b44f71-e938-4415-b3ce-1925a66131e9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:08.251799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-23b44f71-e938-4415-b3ce-1925a66131e9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:08.263457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b44f71-e938-4415-b3ce-1925a66131e9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:08.264122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b44f71-e938-4415-b3ce-1925a66131e9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:08.264672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b44f71-e938-4415-b3ce-1925a66131e9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:08.266763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b44f71-e938-4415-b3ce-1925a66131e9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:08.269275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b44f71-e938-4415-b3ce-1925a66131e9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:08.276730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23b44f71-e938-4415-b3ce-1925a66131e9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:08.478558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23b44f71-e938-4415-b3ce-1925a66131e9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:08.491239 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-23b44f71-e938-4415-b3ce-1925a66131e9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1509 microversion: 2.1 time: 0.244220 Oct 05 17:46:08.506704 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1731/3277] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:08 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1509 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:08.672088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-40aab0c4-eb20-422f-8a74-ca810eaae4e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:08.679067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-40aab0c4-eb20-422f-8a74-ca810eaae4e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:08.732884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40aab0c4-eb20-422f-8a74-ca810eaae4e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:08.733130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-684d9fd5-600c-442e-bcb0-3773e4fb748a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775243430>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:08.737630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40aab0c4-eb20-422f-8a74-ca810eaae4e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:08.742055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40aab0c4-eb20-422f-8a74-ca810eaae4e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:08.747959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40aab0c4-eb20-422f-8a74-ca810eaae4e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:08.755018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40aab0c4-eb20-422f-8a74-ca810eaae4e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:08.755764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40aab0c4-eb20-422f-8a74-ca810eaae4e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:08.794684 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-684d9fd5-600c-442e-bcb0-3773e4fb748a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.065397 Oct 05 17:46:08.795954 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1732/3278] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:08 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:08.884276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-001b5566-919c-44f5-bea0-91575e3aab45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:08.884897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-001b5566-919c-44f5-bea0-91575e3aab45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:08.892156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:08.893756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001b5566-919c-44f5-bea0-91575e3aab45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:08.901676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001b5566-919c-44f5-bea0-91575e3aab45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:08.902228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001b5566-919c-44f5-bea0-91575e3aab45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:08.906364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001b5566-919c-44f5-bea0-91575e3aab45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:08.906364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001b5566-919c-44f5-bea0-91575e3aab45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:08.906364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001b5566-919c-44f5-bea0-91575e3aab45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:09.167486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-001b5566-919c-44f5-bea0-91575e3aab45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:09.184033 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-001b5566-919c-44f5-bea0-91575e3aab45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.303451 Oct 05 17:46:09.194889 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1733/3279] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:08 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:09.194889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8d3b137e-dc57-4d23-8b67-9b8550003fe8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:09.195202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8d3b137e-dc57-4d23-8b67-9b8550003fe8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:09.201474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d3b137e-dc57-4d23-8b67-9b8550003fe8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:09.202190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d3b137e-dc57-4d23-8b67-9b8550003fe8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:09.202829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d3b137e-dc57-4d23-8b67-9b8550003fe8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:09.203693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d3b137e-dc57-4d23-8b67-9b8550003fe8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:09.204303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d3b137e-dc57-4d23-8b67-9b8550003fe8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:09.204887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d3b137e-dc57-4d23-8b67-9b8550003fe8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:09.208443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-40aab0c4-eb20-422f-8a74-ca810eaae4e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:09.226082 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-40aab0c4-eb20-422f-8a74-ca810eaae4e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1521 microversion: 2.1 time: 0.557930 Oct 05 17:46:09.227560 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1547/3280] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:08 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:09.517247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-408c6fbe-4981-469d-a9de-1a99b92a2b70 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:09.517882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-408c6fbe-4981-469d-a9de-1a99b92a2b70 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:09.520567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8d3b137e-dc57-4d23-8b67-9b8550003fe8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:09.529824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-408c6fbe-4981-469d-a9de-1a99b92a2b70 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:09.530601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8d3b137e-dc57-4d23-8b67-9b8550003fe8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1313 microversion: 2.1 time: 0.343796 Oct 05 17:46:09.531216 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1734/3281] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:09 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:09.531570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-408c6fbe-4981-469d-a9de-1a99b92a2b70 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:09.532237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-408c6fbe-4981-469d-a9de-1a99b92a2b70 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:09.533174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-408c6fbe-4981-469d-a9de-1a99b92a2b70 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:09.533861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-408c6fbe-4981-469d-a9de-1a99b92a2b70 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:09.534549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-408c6fbe-4981-469d-a9de-1a99b92a2b70 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:09.811131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7fd4343b-ee6e-4cf1-8b74-222040d9f286 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777596dca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:09.931109 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7fd4343b-ee6e-4cf1-8b74-222040d9f286 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.123969 Oct 05 17:46:09.939161 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1735/3282] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:09 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:10.028539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=40 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:10.211578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d2d7578-6291-4815-8b98-13e59061f801 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:10.212499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d2d7578-6291-4815-8b98-13e59061f801 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:10.231972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d2d7578-6291-4815-8b98-13e59061f801 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:10.232761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d2d7578-6291-4815-8b98-13e59061f801 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:10.233385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d2d7578-6291-4815-8b98-13e59061f801 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:10.234796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d2d7578-6291-4815-8b98-13e59061f801 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:10.235435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d2d7578-6291-4815-8b98-13e59061f801 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:10.236050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d2d7578-6291-4815-8b98-13e59061f801 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:10.390593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-408c6fbe-4981-469d-a9de-1a99b92a2b70 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:10.398959 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-408c6fbe-4981-469d-a9de-1a99b92a2b70 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1509 microversion: 2.1 time: 0.886757 Oct 05 17:46:10.409150 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1548/3283] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:09 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1509 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:10.428783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-21558b7b-f596-400a-95ef-8ed536514241 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:10.430332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-21558b7b-f596-400a-95ef-8ed536514241 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:10.442656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21558b7b-f596-400a-95ef-8ed536514241 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:10.443900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21558b7b-f596-400a-95ef-8ed536514241 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:10.445394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21558b7b-f596-400a-95ef-8ed536514241 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:10.446404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21558b7b-f596-400a-95ef-8ed536514241 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:10.447091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21558b7b-f596-400a-95ef-8ed536514241 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:10.454174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21558b7b-f596-400a-95ef-8ed536514241 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:10.793950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-21558b7b-f596-400a-95ef-8ed536514241 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:10.819416 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-21558b7b-f596-400a-95ef-8ed536514241 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1521 microversion: 2.1 time: 0.408986 Oct 05 17:46:10.825164 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1549/3284] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:10 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:10.848223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d8951b68-852c-43b5-a13e-cbd87951d884 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:10.848867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d8951b68-852c-43b5-a13e-cbd87951d884 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:10.868002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8951b68-852c-43b5-a13e-cbd87951d884 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:10.870704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8951b68-852c-43b5-a13e-cbd87951d884 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:10.871228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8951b68-852c-43b5-a13e-cbd87951d884 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:10.873676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8951b68-852c-43b5-a13e-cbd87951d884 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:10.874698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8951b68-852c-43b5-a13e-cbd87951d884 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:10.874698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8951b68-852c-43b5-a13e-cbd87951d884 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:11.158185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d8951b68-852c-43b5-a13e-cbd87951d884 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:11.181760 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d8951b68-852c-43b5-a13e-cbd87951d884 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1313 microversion: 2.1 time: 0.350657 Oct 05 17:46:11.185195 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1550/3285] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:10 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1313 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:11.198247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a43cef89-43d9-4993-9944-cd7227945afb req-18aa2796-efa2-4a79-a607-7ab2dfd6dcaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f76e942-86f4-44da-b82d-da4416157a4f", "name": "network-vif-deleted", "tag": "baaf15c6-2eb1-4137-b82a-51a1a07f9c3f"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:11.208139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d2d7578-6291-4815-8b98-13e59061f801 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:11.233376 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d2d7578-6291-4815-8b98-13e59061f801 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 1.025784 Oct 05 17:46:11.238819 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1736/3286] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:10 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:11.250367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c01c9997-9fb5-43ea-82be-5ab00069842e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77752a1dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:11.254798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a43cef89-43d9-4993-9944-cd7227945afb req-18aa2796-efa2-4a79-a607-7ab2dfd6dcaf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:11.261693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a43cef89-43d9-4993-9944-cd7227945afb req-18aa2796-efa2-4a79-a607-7ab2dfd6dcaf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:11.262532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a43cef89-43d9-4993-9944-cd7227945afb req-18aa2796-efa2-4a79-a607-7ab2dfd6dcaf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:11.305189 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a43cef89-43d9-4993-9944-cd7227945afb req-18aa2796-efa2-4a79-a607-7ab2dfd6dcaf service nova] Creating event network-vif-deleted:baaf15c6-2eb1-4137-b82a-51a1a07f9c3f for instance 9f76e942-86f4-44da-b82d-da4416157a4f on n-h2-835595-3 Oct 05 17:46:11.322187 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a43cef89-43d9-4993-9944-cd7227945afb req-18aa2796-efa2-4a79-a607-7ab2dfd6dcaf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125712 Oct 05 17:46:11.325653 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1551/3287] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:11.346187 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c01c9997-9fb5-43ea-82be-5ab00069842e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.104219 Oct 05 17:46:11.354320 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1737/3288] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:11 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:11.423913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:11.425144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:11.446090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:11.448290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:11.448997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:11.451246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:11.453473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:11.456614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:11.532835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:11.533652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:11.534437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:11.535126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lazy-loading 'fault' on Instance uuid 9f76e942-86f4-44da-b82d-da4416157a4f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:46:11.588359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:11.596933 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f19476d-61e1-489e-9d39-4162e4751f13 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 200 len: 1305 microversion: 2.1 time: 0.177386 Oct 05 17:46:11.599333 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1552/3289] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:11 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 1305 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:11.850003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9466899f-018b-44d9-bd24-7673ff24e41f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:11.851033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9466899f-018b-44d9-bd24-7673ff24e41f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:11.868650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9466899f-018b-44d9-bd24-7673ff24e41f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:11.878656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9466899f-018b-44d9-bd24-7673ff24e41f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:11.883300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9466899f-018b-44d9-bd24-7673ff24e41f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:11.886837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9466899f-018b-44d9-bd24-7673ff24e41f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:11.890358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9466899f-018b-44d9-bd24-7673ff24e41f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:11.893206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9466899f-018b-44d9-bd24-7673ff24e41f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:12.191577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9466899f-018b-44d9-bd24-7673ff24e41f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:12.208009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97aed88a-1944-46b8-ad9d-813f5dce1207 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:12.208769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-97aed88a-1944-46b8-ad9d-813f5dce1207 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:12.220644 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9466899f-018b-44d9-bd24-7673ff24e41f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1521 microversion: 2.1 time: 0.357354 Oct 05 17:46:12.222356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97aed88a-1944-46b8-ad9d-813f5dce1207 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:12.224985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97aed88a-1944-46b8-ad9d-813f5dce1207 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:12.225646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97aed88a-1944-46b8-ad9d-813f5dce1207 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:12.226595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97aed88a-1944-46b8-ad9d-813f5dce1207 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:12.230878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97aed88a-1944-46b8-ad9d-813f5dce1207 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:12.231595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97aed88a-1944-46b8-ad9d-813f5dce1207 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:12.238421 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1738/3290] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:11 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:12.251122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a27e0004-5f42-4664-be96-8a21d933c1b2 req-ab7552e6-47db-404c-8f77-9426e188e64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18cf41c6-26f8-4a3a-abe7-d3b7b814962f", "name": "network-vif-plugged", "status": "completed", "tag": "1e9ef320-7fa5-49fe-862f-353931f9ccb3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:12.272533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a27e0004-5f42-4664-be96-8a21d933c1b2 req-ab7552e6-47db-404c-8f77-9426e188e64f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:12.273315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a27e0004-5f42-4664-be96-8a21d933c1b2 req-ab7552e6-47db-404c-8f77-9426e188e64f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:12.273907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a27e0004-5f42-4664-be96-8a21d933c1b2 req-ab7552e6-47db-404c-8f77-9426e188e64f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:12.305197 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a27e0004-5f42-4664-be96-8a21d933c1b2 req-ab7552e6-47db-404c-8f77-9426e188e64f service nova] Creating event network-vif-plugged:1e9ef320-7fa5-49fe-862f-353931f9ccb3 for instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f on n-h1-835595-3 Oct 05 17:46:12.311919 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a27e0004-5f42-4664-be96-8a21d933c1b2 req-ab7552e6-47db-404c-8f77-9426e188e64f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071923 Oct 05 17:46:12.313274 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1739/3291] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:12.330964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7b3efdd9-21f6-4399-a57a-0cb45bf9127d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:12.331932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7b3efdd9-21f6-4399-a57a-0cb45bf9127d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:12.341620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b3efdd9-21f6-4399-a57a-0cb45bf9127d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:12.355134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b3efdd9-21f6-4399-a57a-0cb45bf9127d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:12.355846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b3efdd9-21f6-4399-a57a-0cb45bf9127d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:12.356899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b3efdd9-21f6-4399-a57a-0cb45bf9127d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:12.357556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b3efdd9-21f6-4399-a57a-0cb45bf9127d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:12.358173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b3efdd9-21f6-4399-a57a-0cb45bf9127d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:12.714825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-97aed88a-1944-46b8-ad9d-813f5dce1207 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:12.736234 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-97aed88a-1944-46b8-ad9d-813f5dce1207 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1313 microversion: 2.1 time: 0.524217 Oct 05 17:46:12.738459 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1553/3292] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:12 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1313 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:12.744574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-81d0e64c-1254-4214-b933-f023cdf29ecc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775cb6af0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:12.806413 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-81d0e64c-1254-4214-b933-f023cdf29ecc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.066191 Oct 05 17:46:12.815649 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1554/3293] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:12 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:12.821219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:12.822035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 9f76e942-86f4-44da-b82d-da4416157a4f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:12.830559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:12.831318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:12.834324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:12.835698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:12.836712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:12.837317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:12.859510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:12.861394 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] HTTP exception thrown: Instance 9f76e942-86f4-44da-b82d-da4416157a4f could not be found. Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Request method failure captured: Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f HTTP/1.1 Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcCvFl89ip348NgYmwRfZVFC69tIUsNnayzGFoWfaaS5WJz4H_LFyyNRNAoVHHF9Wfeh9GoU_EwuvkTy8VtZir92iFF1CSn6ibH-bezU0QjM6z6boOtDmg22QRK98g5juENhUY8ur87Hcv6cKi_H4k4qVVkCC9KKvvdQauWSleksFok Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d8ec67d827143b3a09b519cb4af417e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}] Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 1c5f58a618c04b09815dea8f54504c7c Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 9f76e942-86f4-44da-b82d-da4416157a4f could not be found. Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '9f76e942-86f4-44da-b82d-da4416157a4f'} Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f76e942-86f4-44da-b82d-da4416157a4f could not be found. Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f76e942-86f4-44da-b82d-da4416157a4f could not be found. Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:12.864018 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:12.868956 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:12.868956 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:12.868956 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:12.868956 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:12.868956 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:12.868956 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f76e942-86f4-44da-b82d-da4416157a4f could not be found. Oct 05 17:46:12.868956 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:12.868956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Returning 404 to user: Instance 9f76e942-86f4-44da-b82d-da4416157a4f could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:12.872628 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8c48d03-ab51-4913-bd99-68022d179236 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f" status: 404 len: 111 microversion: 2.1 time: 0.053919 Oct 05 17:46:12.872628 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1555/3294] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:12 2022] GET /compute/v2.1/servers/9f76e942-86f4-44da-b82d-da4416157a4f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:46:12.883375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4b4d90e0-0eab-40f0-917c-5792904baa23 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:12.883863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b4d90e0-0eab-40f0-917c-5792904baa23 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:12.922127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b4d90e0-0eab-40f0-917c-5792904baa23 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:12.922652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b4d90e0-0eab-40f0-917c-5792904baa23 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:12.929290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b4d90e0-0eab-40f0-917c-5792904baa23 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:12.930494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b4d90e0-0eab-40f0-917c-5792904baa23 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:12.932883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b4d90e0-0eab-40f0-917c-5792904baa23 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:12.935044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b4d90e0-0eab-40f0-917c-5792904baa23 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:13.000335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b4d90e0-0eab-40f0-917c-5792904baa23 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:46:13.190221 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4b4d90e0-0eab-40f0-917c-5792904baa23 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 204 len: 0 microversion: 2.1 time: 0.308983 Oct 05 17:46:13.193186 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1556/3295] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:46:12 2022] DELETE /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:46:13.211631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7b3efdd9-21f6-4399-a57a-0cb45bf9127d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:13.214347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a93b13d-6653-405d-9066-91cfaa49235b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:13.218807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a93b13d-6653-405d-9066-91cfaa49235b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:13.223730 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7b3efdd9-21f6-4399-a57a-0cb45bf9127d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.908906 Oct 05 17:46:13.230250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a93b13d-6653-405d-9066-91cfaa49235b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:13.230823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a93b13d-6653-405d-9066-91cfaa49235b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:13.231266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a93b13d-6653-405d-9066-91cfaa49235b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:13.232287 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1740/3296] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:12 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:13.232525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a93b13d-6653-405d-9066-91cfaa49235b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:13.233157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a93b13d-6653-405d-9066-91cfaa49235b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:13.233581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a93b13d-6653-405d-9066-91cfaa49235b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:13.246661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1737663d-1783-43ce-bb9b-b7518d72458f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:13.256469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1737663d-1783-43ce-bb9b-b7518d72458f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:13.275143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1737663d-1783-43ce-bb9b-b7518d72458f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:13.287504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1737663d-1783-43ce-bb9b-b7518d72458f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:13.290735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1737663d-1783-43ce-bb9b-b7518d72458f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:13.293175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1737663d-1783-43ce-bb9b-b7518d72458f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:13.296134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1737663d-1783-43ce-bb9b-b7518d72458f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:13.297556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1737663d-1783-43ce-bb9b-b7518d72458f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:13.523314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6a93b13d-6653-405d-9066-91cfaa49235b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:13.541069 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a93b13d-6653-405d-9066-91cfaa49235b tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1494 microversion: 2.1 time: 0.340372 Oct 05 17:46:13.557959 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1557/3297] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:13 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1494 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:13.750149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1737663d-1783-43ce-bb9b-b7518d72458f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:13.761699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cddf398d-4d72-4d83-8978-e07ee0cea172 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:13.762506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cddf398d-4d72-4d83-8978-e07ee0cea172 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:13.772129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cddf398d-4d72-4d83-8978-e07ee0cea172 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:13.772631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cddf398d-4d72-4d83-8978-e07ee0cea172 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:13.773062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cddf398d-4d72-4d83-8978-e07ee0cea172 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:13.773772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cddf398d-4d72-4d83-8978-e07ee0cea172 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:13.774223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cddf398d-4d72-4d83-8978-e07ee0cea172 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:13.774671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cddf398d-4d72-4d83-8978-e07ee0cea172 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:13.781054 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1737663d-1783-43ce-bb9b-b7518d72458f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1521 microversion: 2.1 time: 0.537836 Oct 05 17:46:13.783568 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1741/3298] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:13 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:13.824901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-615050e0-e582-419b-9a5c-378d33f9be6b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775252670>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:13.899505 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-615050e0-e582-419b-9a5c-378d33f9be6b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.080585 Oct 05 17:46:13.900615 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1742/3299] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:13 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:14.266454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cddf398d-4d72-4d83-8978-e07ee0cea172 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:14.268019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-98074d9c-9151-41d4-8a52-6fcc59806720 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:14.269123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-98074d9c-9151-41d4-8a52-6fcc59806720 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:14.274745 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cddf398d-4d72-4d83-8978-e07ee0cea172 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1313 microversion: 2.1 time: 0.516936 Oct 05 17:46:14.280321 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1558/3300] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:13 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:14.289393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98074d9c-9151-41d4-8a52-6fcc59806720 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:14.291169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98074d9c-9151-41d4-8a52-6fcc59806720 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:14.292707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98074d9c-9151-41d4-8a52-6fcc59806720 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:14.295090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98074d9c-9151-41d4-8a52-6fcc59806720 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:14.296010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98074d9c-9151-41d4-8a52-6fcc59806720 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:14.297988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98074d9c-9151-41d4-8a52-6fcc59806720 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:14.354944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-8a48347d-f3d9-4bd6-bc7b-8680bd403af2 req-c167fb30-74f3-45ea-b677-e6e5f1ae5ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3caa633-ebf4-4260-9dc5-bcc736013af2", "name": "network-vif-plugged", "status": "completed", "tag": "30f075ed-d317-4f30-9da2-0931dec00b11"}, {"server_uuid": "a3fc4e4d-9f2d-4df2-bf41-9fd764de0382", "name": "network-vif-plugged", "status": "completed", "tag": "ba6a5ab9-d39f-4718-9a48-4bc6c5c16d68"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:14.373884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8a48347d-f3d9-4bd6-bc7b-8680bd403af2 req-c167fb30-74f3-45ea-b677-e6e5f1ae5ce4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:14.374787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8a48347d-f3d9-4bd6-bc7b-8680bd403af2 req-c167fb30-74f3-45ea-b677-e6e5f1ae5ce4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:14.375230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8a48347d-f3d9-4bd6-bc7b-8680bd403af2 req-c167fb30-74f3-45ea-b677-e6e5f1ae5ce4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:14.403836 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-8a48347d-f3d9-4bd6-bc7b-8680bd403af2 req-c167fb30-74f3-45ea-b677-e6e5f1ae5ce4 service nova] Creating event network-vif-plugged:30f075ed-d317-4f30-9da2-0931dec00b11 for instance d3caa633-ebf4-4260-9dc5-bcc736013af2 on n-h1-835595-3 Oct 05 17:46:14.404343 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-8a48347d-f3d9-4bd6-bc7b-8680bd403af2 req-c167fb30-74f3-45ea-b677-e6e5f1ae5ce4 service nova] Creating event network-vif-plugged:ba6a5ab9-d39f-4718-9a48-4bc6c5c16d68 for instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 on n-h2-835595-3 Oct 05 17:46:14.427593 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-8a48347d-f3d9-4bd6-bc7b-8680bd403af2 req-c167fb30-74f3-45ea-b677-e6e5f1ae5ce4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076793 Oct 05 17:46:14.429598 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1559/3301] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:46:14.565486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-82ec4bf4-047f-480a-aef4-5e7978ad6b90 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:14.566540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-82ec4bf4-047f-480a-aef4-5e7978ad6b90 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:14.576771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82ec4bf4-047f-480a-aef4-5e7978ad6b90 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:14.577399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82ec4bf4-047f-480a-aef4-5e7978ad6b90 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:14.577932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82ec4bf4-047f-480a-aef4-5e7978ad6b90 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:14.578819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82ec4bf4-047f-480a-aef4-5e7978ad6b90 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:14.579377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82ec4bf4-047f-480a-aef4-5e7978ad6b90 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:14.579917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82ec4bf4-047f-480a-aef4-5e7978ad6b90 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:14.649087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-98074d9c-9151-41d4-8a52-6fcc59806720 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:14.668079 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-98074d9c-9151-41d4-8a52-6fcc59806720 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.411575 Oct 05 17:46:14.668937 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1743/3302] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:14 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:14.673770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-26294a52-aecd-4aee-a76c-07ce69815b6c req-fde92a56-cf32-453c-a5b4-2908f9e7c0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73e084b-e4d1-4858-8a95-9f938ab0c177", "name": "network-vif-deleted", "tag": "e1020a1c-b61e-4ea6-9d20-49f9f33a4b9f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:14.691635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-82ec4bf4-047f-480a-aef4-5e7978ad6b90 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:14.708197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-26294a52-aecd-4aee-a76c-07ce69815b6c req-fde92a56-cf32-453c-a5b4-2908f9e7c0ac service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:14.709138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-26294a52-aecd-4aee-a76c-07ce69815b6c req-fde92a56-cf32-453c-a5b4-2908f9e7c0ac service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:14.709797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-26294a52-aecd-4aee-a76c-07ce69815b6c req-fde92a56-cf32-453c-a5b4-2908f9e7c0ac service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:14.716857 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-82ec4bf4-047f-480a-aef4-5e7978ad6b90 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1452 microversion: 2.1 time: 0.154291 Oct 05 17:46:14.718490 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1560/3303] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:14 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:14.728608 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-26294a52-aecd-4aee-a76c-07ce69815b6c req-fde92a56-cf32-453c-a5b4-2908f9e7c0ac service nova] Creating event network-vif-deleted:e1020a1c-b61e-4ea6-9d20-49f9f33a4b9f for instance a73e084b-e4d1-4858-8a95-9f938ab0c177 on n-h2-835595-3 Oct 05 17:46:14.748180 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-26294a52-aecd-4aee-a76c-07ce69815b6c req-fde92a56-cf32-453c-a5b4-2908f9e7c0ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077726 Oct 05 17:46:14.749363 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1744/3304] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:14.805465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-df1bdcd3-83a6-4acc-8683-f45aa63b9755 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:14.806841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-df1bdcd3-83a6-4acc-8683-f45aa63b9755 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:14.820312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df1bdcd3-83a6-4acc-8683-f45aa63b9755 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:14.821344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df1bdcd3-83a6-4acc-8683-f45aa63b9755 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:14.822107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df1bdcd3-83a6-4acc-8683-f45aa63b9755 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:14.823173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df1bdcd3-83a6-4acc-8683-f45aa63b9755 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:14.823980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df1bdcd3-83a6-4acc-8683-f45aa63b9755 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:14.824625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df1bdcd3-83a6-4acc-8683-f45aa63b9755 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:14.938693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0838797a-d103-4cf9-9b3c-56468e4fb515 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77752199d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:15.006153 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0838797a-d103-4cf9-9b3c-56468e4fb515 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.093653 Oct 05 17:46:15.013982 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1745/3305] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:14 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:15.158166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df1bdcd3-83a6-4acc-8683-f45aa63b9755 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:15.175109 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-df1bdcd3-83a6-4acc-8683-f45aa63b9755 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1521 microversion: 2.1 time: 0.371829 Oct 05 17:46:15.189126 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1561/3306] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:14 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:15.302963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6d4769a4-3c4b-42ef-8953-0fc5ff1f9458 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:15.303778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6d4769a4-3c4b-42ef-8953-0fc5ff1f9458 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:15.315068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d4769a4-3c4b-42ef-8953-0fc5ff1f9458 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:15.319035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d4769a4-3c4b-42ef-8953-0fc5ff1f9458 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:15.320084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d4769a4-3c4b-42ef-8953-0fc5ff1f9458 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:15.320931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d4769a4-3c4b-42ef-8953-0fc5ff1f9458 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:15.321460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d4769a4-3c4b-42ef-8953-0fc5ff1f9458 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:15.321946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d4769a4-3c4b-42ef-8953-0fc5ff1f9458 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:15.542710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6d4769a4-3c4b-42ef-8953-0fc5ff1f9458 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:15.553751 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6d4769a4-3c4b-42ef-8953-0fc5ff1f9458 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1497 microversion: 2.1 time: 0.254892 Oct 05 17:46:15.571460 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1746/3307] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:15 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1497 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:15.577898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-506b1584-8514-4007-8127-fbe38b9353c5 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:15.602404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.compute.server_groups [None req-506b1584-8514-4007-8127-fbe38b9353c5 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Querying cell 7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) for 1 instances {{(pid=128843) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 05 17:46:15.603339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-506b1584-8514-4007-8127-fbe38b9353c5 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:15.604015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-506b1584-8514-4007-8127-fbe38b9353c5 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:15.604664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-506b1584-8514-4007-8127-fbe38b9353c5 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:15.636859 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-506b1584-8514-4007-8127-fbe38b9353c5 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/d72e30e3-9961-482d-8a59-73154ccfd7aa" status: 200 len: 222 microversion: 2.1 time: 0.062679 Oct 05 17:46:15.637765 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1562/3308] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:46:15 2022] GET /compute/v2.1/os-server-groups/d72e30e3-9961-482d-8a59-73154ccfd7aa => generated 222 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:15.652986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3211a9a7-266e-43c1-acda-f7a5b06e452d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:15.653644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3211a9a7-266e-43c1-acda-f7a5b06e452d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:15.672201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3211a9a7-266e-43c1-acda-f7a5b06e452d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:15.674789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3211a9a7-266e-43c1-acda-f7a5b06e452d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:15.675251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3211a9a7-266e-43c1-acda-f7a5b06e452d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:15.675987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3211a9a7-266e-43c1-acda-f7a5b06e452d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:15.676489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3211a9a7-266e-43c1-acda-f7a5b06e452d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:15.676879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3211a9a7-266e-43c1-acda-f7a5b06e452d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:15.695630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd6f40bf-fb53-424d-a618-93ece0ec1456 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:15.695630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd6f40bf-fb53-424d-a618-93ece0ec1456 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:15.709886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd6f40bf-fb53-424d-a618-93ece0ec1456 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:15.711165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd6f40bf-fb53-424d-a618-93ece0ec1456 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:15.711165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd6f40bf-fb53-424d-a618-93ece0ec1456 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:15.711573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd6f40bf-fb53-424d-a618-93ece0ec1456 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:15.716404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd6f40bf-fb53-424d-a618-93ece0ec1456 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:15.719166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd6f40bf-fb53-424d-a618-93ece0ec1456 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:15.781924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3211a9a7-266e-43c1-acda-f7a5b06e452d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:46:15.990473 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3211a9a7-266e-43c1-acda-f7a5b06e452d tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 204 len: 0 microversion: 2.1 time: 0.334558 Oct 05 17:46:15.994101 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1747/3309] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:46:15 2022] DELETE /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:46:16.001322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:16.004879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:16.018331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fd6f40bf-fb53-424d-a618-93ece0ec1456 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:16.026152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:16.026664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:16.027598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:16.028663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:16.029313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:16.029937 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fd6f40bf-fb53-424d-a618-93ece0ec1456 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.340701 Oct 05 17:46:16.030217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:16.052931 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1563/3310] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:15 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:16.058137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-852781c4-4829-4899-ba8f-176b2b6de2a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:16.058788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-852781c4-4829-4899-ba8f-176b2b6de2a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:16.077981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-852781c4-4829-4899-ba8f-176b2b6de2a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:16.078503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-852781c4-4829-4899-ba8f-176b2b6de2a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:16.078948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-852781c4-4829-4899-ba8f-176b2b6de2a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:16.079657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-852781c4-4829-4899-ba8f-176b2b6de2a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:16.080112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-852781c4-4829-4899-ba8f-176b2b6de2a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:16.080742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-852781c4-4829-4899-ba8f-176b2b6de2a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:16.090407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:16.091291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:16.091964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:16.092634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lazy-loading 'fault' on Instance uuid a73e084b-e4d1-4858-8a95-9f938ab0c177 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:46:16.148847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:16.158968 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2b1ffb45-9d04-4322-89b9-b8c6094181d4 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 200 len: 1304 microversion: 2.1 time: 0.166609 Oct 05 17:46:16.171263 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1748/3311] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:15 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 1304 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:16.183013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b47f304d-271b-45bc-8800-f4c500866a67 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77753b28b0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:16.239324 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b47f304d-271b-45bc-8800-f4c500866a67 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.066330 Oct 05 17:46:16.241286 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1749/3312] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:16 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:16.257862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c0a6b05d-0db4-4ba1-b06d-43255d05278d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:16.258763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c0a6b05d-0db4-4ba1-b06d-43255d05278d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:16.273254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a6b05d-0db4-4ba1-b06d-43255d05278d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:16.274030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a6b05d-0db4-4ba1-b06d-43255d05278d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:16.274601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a6b05d-0db4-4ba1-b06d-43255d05278d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:16.277575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a6b05d-0db4-4ba1-b06d-43255d05278d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:16.279016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a6b05d-0db4-4ba1-b06d-43255d05278d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:16.284792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0a6b05d-0db4-4ba1-b06d-43255d05278d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:16.325762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-852781c4-4829-4899-ba8f-176b2b6de2a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:16.336315 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-852781c4-4829-4899-ba8f-176b2b6de2a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1503 microversion: 2.1 time: 0.280203 Oct 05 17:46:16.336937 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1564/3313] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:16 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:16.537215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c0a6b05d-0db4-4ba1-b06d-43255d05278d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:16.540882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:16.557938 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c0a6b05d-0db4-4ba1-b06d-43255d05278d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1521 microversion: 2.1 time: 0.315320 Oct 05 17:46:16.558730 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1750/3314] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:16 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:17.055056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a02597e8-e7fb-415a-b5c8-d5ff66cd7554 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:17.055056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a02597e8-e7fb-415a-b5c8-d5ff66cd7554 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:17.059450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:17.063336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a02597e8-e7fb-415a-b5c8-d5ff66cd7554 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.063818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a02597e8-e7fb-415a-b5c8-d5ff66cd7554 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.064253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a02597e8-e7fb-415a-b5c8-d5ff66cd7554 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.064960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a02597e8-e7fb-415a-b5c8-d5ff66cd7554 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.065415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a02597e8-e7fb-415a-b5c8-d5ff66cd7554 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.065844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a02597e8-e7fb-415a-b5c8-d5ff66cd7554 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.187402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:17.191402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: a73e084b-e4d1-4858-8a95-9f938ab0c177] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:17.212852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.213690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.214356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.215265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.216037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.216621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.235371 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] HTTP exception thrown: Instance a73e084b-e4d1-4858-8a95-9f938ab0c177 could not be found. Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Request method failure captured: Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 HTTP/1.1 Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcCvFl89ip348NgYmwRfZVFC69tIUsNnayzGFoWfaaS5WJz4H_LFyyNRNAoVHHF9Wfeh9GoU_EwuvkTy8VtZir92iFF1CSn6ibH-bezU0QjM6z6boOtDmg22QRK98g5juENhUY8ur87Hcv6cKi_H4k4qVVkCC9KKvvdQauWSleksFok Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d8ec67d827143b3a09b519cb4af417e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}] Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 1c5f58a618c04b09815dea8f54504c7c Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance a73e084b-e4d1-4858-8a95-9f938ab0c177 could not be found. Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'a73e084b-e4d1-4858-8a95-9f938ab0c177'} Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a73e084b-e4d1-4858-8a95-9f938ab0c177 could not be found. Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a73e084b-e4d1-4858-8a95-9f938ab0c177 could not be found. Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:17.242581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:17.247619 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:17.247619 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:17.247619 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:17.247619 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:17.247619 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:17.247619 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a73e084b-e4d1-4858-8a95-9f938ab0c177 could not be found. Oct 05 17:46:17.247619 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:17.249830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Returning 404 to user: Instance a73e084b-e4d1-4858-8a95-9f938ab0c177 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:17.250860 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb28e5a2-8798-4c23-9288-a6ba04c808bc tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177" status: 404 len: 111 microversion: 2.1 time: 0.069103 Oct 05 17:46:17.255350 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1751/3315] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:17 2022] GET /compute/v2.1/servers/a73e084b-e4d1-4858-8a95-9f938ab0c177 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:46:17.261007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f87dda6-caa8-4b21-839e-a14cc52ede2f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77753b2430>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:17.302384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a02597e8-e7fb-415a-b5c8-d5ff66cd7554 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:17.312164 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a02597e8-e7fb-415a-b5c8-d5ff66cd7554 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.262582 Oct 05 17:46:17.314807 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f87dda6-caa8-4b21-839e-a14cc52ede2f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.057797 Oct 05 17:46:17.315565 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1752/3316] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:17 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:17.318469 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1565/3317] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:17 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:17.338264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f403ed4-807c-4b69-9729-82b04cc5a66e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:17.339425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8f403ed4-807c-4b69-9729-82b04cc5a66e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:17.350028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f403ed4-807c-4b69-9729-82b04cc5a66e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.350981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f403ed4-807c-4b69-9729-82b04cc5a66e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.351583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f403ed4-807c-4b69-9729-82b04cc5a66e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.352689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f403ed4-807c-4b69-9729-82b04cc5a66e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.353308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f403ed4-807c-4b69-9729-82b04cc5a66e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.353893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f403ed4-807c-4b69-9729-82b04cc5a66e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.363334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cbcfb9ca-de31-485a-b3c2-404e8d7cc0b8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:17.364243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cbcfb9ca-de31-485a-b3c2-404e8d7cc0b8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:17.372751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbcfb9ca-de31-485a-b3c2-404e8d7cc0b8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.375505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbcfb9ca-de31-485a-b3c2-404e8d7cc0b8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.376051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbcfb9ca-de31-485a-b3c2-404e8d7cc0b8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.379757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbcfb9ca-de31-485a-b3c2-404e8d7cc0b8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.380374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbcfb9ca-de31-485a-b3c2-404e8d7cc0b8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.380997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbcfb9ca-de31-485a-b3c2-404e8d7cc0b8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.389319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8f403ed4-807c-4b69-9729-82b04cc5a66e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:46:17.530772 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f403ed4-807c-4b69-9729-82b04cc5a66e tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "DELETE /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 204 len: 0 microversion: 2.1 time: 0.213726 Oct 05 17:46:17.536755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1753/3318] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:46:17 2022] DELETE /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:46:17.542544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-33ff1e8c-366f-40a1-90c5-cee3b26bc2e1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:17.550711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-33ff1e8c-366f-40a1-90c5-cee3b26bc2e1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:17.561742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33ff1e8c-366f-40a1-90c5-cee3b26bc2e1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.564325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33ff1e8c-366f-40a1-90c5-cee3b26bc2e1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.576693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33ff1e8c-366f-40a1-90c5-cee3b26bc2e1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.577860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33ff1e8c-366f-40a1-90c5-cee3b26bc2e1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.578530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33ff1e8c-366f-40a1-90c5-cee3b26bc2e1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.579118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33ff1e8c-366f-40a1-90c5-cee3b26bc2e1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.671000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cbcfb9ca-de31-485a-b3c2-404e8d7cc0b8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:17.687165 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cbcfb9ca-de31-485a-b3c2-404e8d7cc0b8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1503 microversion: 2.1 time: 0.325802 Oct 05 17:46:17.688124 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1566/3319] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:17 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:17.697810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8c20bfda-b019-4eff-980a-eae95e3097e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:17.698608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8c20bfda-b019-4eff-980a-eae95e3097e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:17.715769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c20bfda-b019-4eff-980a-eae95e3097e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.716481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c20bfda-b019-4eff-980a-eae95e3097e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.717020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c20bfda-b019-4eff-980a-eae95e3097e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.717834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c20bfda-b019-4eff-980a-eae95e3097e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:17.718441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c20bfda-b019-4eff-980a-eae95e3097e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:17.722538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c20bfda-b019-4eff-980a-eae95e3097e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:17.838010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-33ff1e8c-366f-40a1-90c5-cee3b26bc2e1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:17.848436 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-33ff1e8c-366f-40a1-90c5-cee3b26bc2e1 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1674 microversion: 2.1 time: 0.310056 Oct 05 17:46:17.851791 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1754/3320] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:17 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1674 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:18.069210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c20bfda-b019-4eff-980a-eae95e3097e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:18.108777 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8c20bfda-b019-4eff-980a-eae95e3097e6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1506 microversion: 2.1 time: 0.417021 Oct 05 17:46:18.123118 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1567/3321] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:17 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1506 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:18.136067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-80b3944c-7665-4aa6-b3dd-0a9e6e3f990b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:18.136692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-80b3944c-7665-4aa6-b3dd-0a9e6e3f990b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:18.143044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80b3944c-7665-4aa6-b3dd-0a9e6e3f990b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.143542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80b3944c-7665-4aa6-b3dd-0a9e6e3f990b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.143982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80b3944c-7665-4aa6-b3dd-0a9e6e3f990b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.144688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80b3944c-7665-4aa6-b3dd-0a9e6e3f990b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.145148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80b3944c-7665-4aa6-b3dd-0a9e6e3f990b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.145638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-80b3944c-7665-4aa6-b3dd-0a9e6e3f990b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.336623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7f13e3e0-ab9e-480f-8fb5-2267761850b6 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777966bf70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:18.421921 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7f13e3e0-ab9e-480f-8fb5-2267761850b6 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.094579 Oct 05 17:46:18.422548 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1568/3322] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:18 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:18.431916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e5371b85-6f8f-4a7c-8c6e-731d9188107e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:18.432541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e5371b85-6f8f-4a7c-8c6e-731d9188107e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:18.451430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5371b85-6f8f-4a7c-8c6e-731d9188107e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.451938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5371b85-6f8f-4a7c-8c6e-731d9188107e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.452389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5371b85-6f8f-4a7c-8c6e-731d9188107e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.453203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5371b85-6f8f-4a7c-8c6e-731d9188107e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.453660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5371b85-6f8f-4a7c-8c6e-731d9188107e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.454190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5371b85-6f8f-4a7c-8c6e-731d9188107e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.550319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-80b3944c-7665-4aa6-b3dd-0a9e6e3f990b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:18.562206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-80b3944c-7665-4aa6-b3dd-0a9e6e3f990b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 200 len: 1506 microversion: 2.1 time: 0.429937 Oct 05 17:46:18.583318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1755/3323] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:18 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:18.593694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f76430ae-8efe-4f38-8c58-89a3fd07ee34 req-2203e0a7-02da-4877-8a42-5f51045d478e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18cf41c6-26f8-4a3a-abe7-d3b7b814962f", "name": "network-vif-deleted", "tag": "1e9ef320-7fa5-49fe-862f-353931f9ccb3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:18.638113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f76430ae-8efe-4f38-8c58-89a3fd07ee34 req-2203e0a7-02da-4877-8a42-5f51045d478e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.639662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f76430ae-8efe-4f38-8c58-89a3fd07ee34 req-2203e0a7-02da-4877-8a42-5f51045d478e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.640127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f76430ae-8efe-4f38-8c58-89a3fd07ee34 req-2203e0a7-02da-4877-8a42-5f51045d478e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.673313 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f76430ae-8efe-4f38-8c58-89a3fd07ee34 req-2203e0a7-02da-4877-8a42-5f51045d478e service nova] Creating event network-vif-deleted:1e9ef320-7fa5-49fe-862f-353931f9ccb3 for instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f on n-h1-835595-3 Oct 05 17:46:18.678920 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f76430ae-8efe-4f38-8c58-89a3fd07ee34 req-2203e0a7-02da-4877-8a42-5f51045d478e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094084 Oct 05 17:46:18.682737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e5371b85-6f8f-4a7c-8c6e-731d9188107e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:18.687871 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1756/3324] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:18.694643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b87395da-dae0-40d7-9d46-f282a17e891f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:18.697851 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e5371b85-6f8f-4a7c-8c6e-731d9188107e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.274189 Oct 05 17:46:18.706180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b87395da-dae0-40d7-9d46-f282a17e891f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:18.710437 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1569/3325] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:18 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:18.721817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b87395da-dae0-40d7-9d46-f282a17e891f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.729372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:18.729647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b87395da-dae0-40d7-9d46-f282a17e891f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.730013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:18.730547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b87395da-dae0-40d7-9d46-f282a17e891f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.731568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b87395da-dae0-40d7-9d46-f282a17e891f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.732207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b87395da-dae0-40d7-9d46-f282a17e891f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.732815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b87395da-dae0-40d7-9d46-f282a17e891f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.752339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.752850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.753313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.767421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.767938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.768387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.772505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b87395da-dae0-40d7-9d46-f282a17e891f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:46:18.852498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.853002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.853453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.863205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lazy-loading 'fault' on Instance uuid 18cf41c6-26f8-4a3a-abe7-d3b7b814962f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:46:18.932283 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b87395da-dae0-40d7-9d46-f282a17e891f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 204 len: 0 microversion: 2.1 time: 0.242525 Oct 05 17:46:18.933126 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1757/3326] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:46:18 2022] DELETE /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:46:18.940747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ff68322-2dbe-4fb1-b3cd-116091931a26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:18.941860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ff68322-2dbe-4fb1-b3cd-116091931a26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:18.965558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff68322-2dbe-4fb1-b3cd-116091931a26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.966078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff68322-2dbe-4fb1-b3cd-116091931a26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.968719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff68322-2dbe-4fb1-b3cd-116091931a26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:18.969972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff68322-2dbe-4fb1-b3cd-116091931a26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:18.971554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff68322-2dbe-4fb1-b3cd-116091931a26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:18.972034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff68322-2dbe-4fb1-b3cd-116091931a26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:19.017784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388509aad0a34e96988e5ec7068070ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcafeba091a430c988536309174a3a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:19.031520 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2caa7f18-0dbc-4af5-a5fb-cd2ce749c411 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 200 len: 1303 microversion: 2.1 time: 0.319233 Oct 05 17:46:19.032132 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1570/3327] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:18 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 1303 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:19.230515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-873192182", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "941b871a-4b4c-4da8-8d9e-bb2ee1c9a341"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:19.335396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] validate_networks() for [('941b871a-4b4c-4da8-8d9e-bb2ee1c9a341', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:46:19.840597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0ff68322-2dbe-4fb1-b3cd-116091931a26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:19.851253 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ff68322-2dbe-4fb1-b3cd-116091931a26 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1674 microversion: 2.1 time: 0.916486 Oct 05 17:46:19.852924 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1758/3328] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:18 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1674 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:19.858666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-95a8eb69-59ce-4870-b962-77439ff34b0f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7776b7c9d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:19.962001 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-95a8eb69-59ce-4870-b962-77439ff34b0f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.107701 Oct 05 17:46:19.962784 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1759/3329] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:19 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:19.981138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e63cd7ef-75a0-4d28-9258-b68d7e018f72 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:19.982169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e63cd7ef-75a0-4d28-9258-b68d7e018f72 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:19.988855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e63cd7ef-75a0-4d28-9258-b68d7e018f72 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:19.991303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e63cd7ef-75a0-4d28-9258-b68d7e018f72 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:19.993714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e63cd7ef-75a0-4d28-9258-b68d7e018f72 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:19.994507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e63cd7ef-75a0-4d28-9258-b68d7e018f72 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:19.994986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e63cd7ef-75a0-4d28-9258-b68d7e018f72 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:19.995407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e63cd7ef-75a0-4d28-9258-b68d7e018f72 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.156973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:46:20.158233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:46:20.158968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:46:20.160099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:46:20.160750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:46:20.176598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.178167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.179291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.180815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.181492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.182152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.213270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Getting quotas for project 322009e2b6f2443c9c3e8f0a43bd7567. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:46:20.218720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Getting quotas for user 8878ab6c93164071bb4602782e3d5e5c and project 322009e2b6f2443c9c3e8f0a43bd7567. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:46:20.236862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e63cd7ef-75a0-4d28-9258-b68d7e018f72 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:20.249406 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e63cd7ef-75a0-4d28-9258-b68d7e018f72 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.285470 Oct 05 17:46:20.263649 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1760/3330] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:19 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:20.263916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:46:20.263916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:46:20.267738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.268731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:20.284953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.285726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.286388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.287363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.287828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.288423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.319427 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] HTTP exception thrown: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Request method failure captured: Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f HTTP/1.1 Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcLSTsRGZRP4c3PwLoDuehzUT01vK1guG2gqcLPegzEINWeQwRdX2lHhYRKOBPXXHzYMDuSGtz2OH6HPETj5i5MtXrnUvfbdrMrg921_kxYnXJ8j322QEraO4rrryAlNUDUzbF6bxTISclbpd_-cs4ex6qrXsZpKY76tBk-joh4p64M Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/abcafeba091a430c988536309174a3a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_abcafeba091a430c988536309174a3a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}] Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 388509aad0a34e96988e5ec7068070ea Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '18cf41c6-26f8-4a3a-abe7-d3b7b814962f'} Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.322248 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.327319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.327319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.327319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.327319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:20.327319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:20.327319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.327319 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.329179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Returning 404 to user: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:20.330312 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b5d6c4fb-671b-4aee-9df9-5fa26dfd7f27 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 404 len: 111 microversion: 2.1 time: 0.074047 Oct 05 17:46:20.346763 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1761/3331] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:20 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:46:20.352395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bb05906b-71b9-4e10-bb6e-b9c05084bf71 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.366784 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2a5bc5e2-9a84-45a1-a202-13ee6cf8b8ab tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.140286 Oct 05 17:46:20.377206 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1571/3332] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:46:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:46:20.385501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.server_groups [None req-bb05906b-71b9-4e10-bb6e-b9c05084bf71 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Querying cell 7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) for 1 instances {{(pid=128844) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 05 17:46:20.386215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb05906b-71b9-4e10-bb6e-b9c05084bf71 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.386717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb05906b-71b9-4e10-bb6e-b9c05084bf71 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.387149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb05906b-71b9-4e10-bb6e-b9c05084bf71 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.404512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-869b3486-8936-41f7-a74e-f85591dc4204 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.405187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-869b3486-8936-41f7-a74e-f85591dc4204 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:20.438047 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bb05906b-71b9-4e10-bb6e-b9c05084bf71 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.089528 Oct 05 17:46:20.446947 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1762/3333] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:46:20 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:20.454682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4ef5e78b-9ef6-41de-b0a9-afa78bab85c4 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.569300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.server_groups [None req-4ef5e78b-9ef6-41de-b0a9-afa78bab85c4 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Querying cell 7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) for 1 instances {{(pid=128844) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 05 17:46:20.569300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ef5e78b-9ef6-41de-b0a9-afa78bab85c4 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.569300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ef5e78b-9ef6-41de-b0a9-afa78bab85c4 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.569300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ef5e78b-9ef6-41de-b0a9-afa78bab85c4 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.569300 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4ef5e78b-9ef6-41de-b0a9-afa78bab85c4 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/d72e30e3-9961-482d-8a59-73154ccfd7aa" status: 200 len: 184 microversion: 2.1 time: 0.042998 Oct 05 17:46:20.569300 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1763/3334] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:46:20 2022] GET /compute/v2.1/os-server-groups/d72e30e3-9961-482d-8a59-73154ccfd7aa => generated 184 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:20.569924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-869b3486-8936-41f7-a74e-f85591dc4204 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:20.569924 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-869b3486-8936-41f7-a74e-f85591dc4204 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1217 microversion: 2.1 time: 0.145962 Oct 05 17:46:20.569924 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1572/3335] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:20 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:20.587829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.587829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:20.587829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:20.587829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.587829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.587829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.587829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.587829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.587829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.625017 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] HTTP exception thrown: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Request method failure captured: Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f HTTP/1.1 Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcLSTsRGZRP4c3PwLoDuehzUT01vK1guG2gqcLPegzEINWeQwRdX2lHhYRKOBPXXHzYMDuSGtz2OH6HPETj5i5MtXrnUvfbdrMrg921_kxYnXJ8j322QEraO4rrryAlNUDUzbF6bxTISclbpd_-cs4ex6qrXsZpKY76tBk-joh4p64M Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/abcafeba091a430c988536309174a3a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_abcafeba091a430c988536309174a3a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}] Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 388509aad0a34e96988e5ec7068070ea Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '18cf41c6-26f8-4a3a-abe7-d3b7b814962f'} Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:46:20.628595 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Returning 404 to user: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:20.634091 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-43670d39-44af-42cf-ab81-a78c286a869b tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 404 len: 111 microversion: 2.1 time: 0.058117 Oct 05 17:46:20.636274 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1764/3336] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:46:20 2022] DELETE /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:46:20.640169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.640968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] [instance: 18cf41c6-26f8-4a3a-abe7-d3b7b814962f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:20.647639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.648146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.648645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.649347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.649802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.650229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.683565 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] HTTP exception thrown: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Request method failure captured: Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f HTTP/1.1 Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcLSTsRGZRP4c3PwLoDuehzUT01vK1guG2gqcLPegzEINWeQwRdX2lHhYRKOBPXXHzYMDuSGtz2OH6HPETj5i5MtXrnUvfbdrMrg921_kxYnXJ8j322QEraO4rrryAlNUDUzbF6bxTISclbpd_-cs4ex6qrXsZpKY76tBk-joh4p64M Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/abcafeba091a430c988536309174a3a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_abcafeba091a430c988536309174a3a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}] Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 388509aad0a34e96988e5ec7068070ea Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '18cf41c6-26f8-4a3a-abe7-d3b7b814962f'} Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.688882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.696947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.696947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.696947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.696947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:20.696947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:20.696947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. Oct 05 17:46:20.696947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.696947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Returning 404 to user: Instance 18cf41c6-26f8-4a3a-abe7-d3b7b814962f could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:20.696947 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-95cf10b1-5bc5-430d-a2cd-a363217f5798 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f" status: 404 len: 111 microversion: 2.1 time: 0.054394 Oct 05 17:46:20.696947 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1573/3337] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:20 2022] GET /compute/v2.1/servers/18cf41c6-26f8-4a3a-abe7-d3b7b814962f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:46:20.705755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12eb8f4b-2e1f-4080-8551-381a5ffb37f2 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.735511 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-12eb8f4b-2e1f-4080-8551-381a5ffb37f2 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] HTTP exception thrown: Instance group 3b318604-9d4e-4c49-ad4f-c836a14249c5 could not be found. Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12eb8f4b-2e1f-4080-8551-381a5ffb37f2 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Request method failure captured: Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-server-groups/3b318604-9d4e-4c49-ad4f-c836a14249c5 HTTP/1.1 Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcLSTsRGZRP4c3PwLoDuehzUT01vK1guG2gqcLPegzEINWeQwRdX2lHhYRKOBPXXHzYMDuSGtz2OH6HPETj5i5MtXrnUvfbdrMrg921_kxYnXJ8j322QEraO4rrryAlNUDUzbF6bxTISclbpd_-cs4ex6qrXsZpKY76tBk-joh4p64M Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/abcafeba091a430c988536309174a3a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_abcafeba091a430c988536309174a3a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}] Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 388509aad0a34e96988e5ec7068070ea Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance group 3b318604-9d4e-4c49-ad4f-c836a14249c5 could not be found. Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '3b318604-9d4e-4c49-ad4f-c836a14249c5'} Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 3b318604-9d4e-4c49-ad4f-c836a14249c5 could not be found. Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 3b318604-9d4e-4c49-ad4f-c836a14249c5 could not be found. Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.757713 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.762001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.762001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.762001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:20.762001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:20.762001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 3b318604-9d4e-4c49-ad4f-c836a14249c5 could not be found. Oct 05 17:46:20.762001 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.764646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12eb8f4b-2e1f-4080-8551-381a5ffb37f2 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Returning 404 to user: Instance group 3b318604-9d4e-4c49-ad4f-c836a14249c5 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:20.766227 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12eb8f4b-2e1f-4080-8551-381a5ffb37f2 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/3b318604-9d4e-4c49-ad4f-c836a14249c5" status: 404 len: 117 microversion: 2.1 time: 0.066170 Oct 05 17:46:20.770371 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1765/3338] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:46:20 2022] DELETE /compute/v2.1/os-server-groups/3b318604-9d4e-4c49-ad4f-c836a14249c5 => generated 117 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:46:20.775951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9d5701b-cff5-4a81-93bd-104f89c41828 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.784672 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-b9d5701b-cff5-4a81-93bd-104f89c41828 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] HTTP exception thrown: Instance group 6db96340-1f0d-4612-ba69-7b49d05b0555 could not be found. Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9d5701b-cff5-4a81-93bd-104f89c41828 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Request method failure captured: Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-server-groups/6db96340-1f0d-4612-ba69-7b49d05b0555 HTTP/1.1 Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcLSTsRGZRP4c3PwLoDuehzUT01vK1guG2gqcLPegzEINWeQwRdX2lHhYRKOBPXXHzYMDuSGtz2OH6HPETj5i5MtXrnUvfbdrMrg921_kxYnXJ8j322QEraO4rrryAlNUDUzbF6bxTISclbpd_-cs4ex6qrXsZpKY76tBk-joh4p64M Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/abcafeba091a430c988536309174a3a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_abcafeba091a430c988536309174a3a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}] Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 388509aad0a34e96988e5ec7068070ea Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance group 6db96340-1f0d-4612-ba69-7b49d05b0555 could not be found. Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '6db96340-1f0d-4612-ba69-7b49d05b0555'} Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6db96340-1f0d-4612-ba69-7b49d05b0555 could not be found. Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6db96340-1f0d-4612-ba69-7b49d05b0555 could not be found. Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.787587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.795343 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.795343 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.795343 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:20.795343 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:20.795343 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6db96340-1f0d-4612-ba69-7b49d05b0555 could not be found. Oct 05 17:46:20.795343 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.795343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9d5701b-cff5-4a81-93bd-104f89c41828 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Returning 404 to user: Instance group 6db96340-1f0d-4612-ba69-7b49d05b0555 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:20.795343 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9d5701b-cff5-4a81-93bd-104f89c41828 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/6db96340-1f0d-4612-ba69-7b49d05b0555" status: 404 len: 117 microversion: 2.1 time: 0.017063 Oct 05 17:46:20.795343 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1574/3339] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:46:20 2022] DELETE /compute/v2.1/os-server-groups/6db96340-1f0d-4612-ba69-7b49d05b0555 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:46:20.802405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-34c052b2-b97a-44ba-8c03-c02b4fddeaf8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.818829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-34c052b2-b97a-44ba-8c03-c02b4fddeaf8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] HTTP exception thrown: Instance group b9fc6b5b-f474-4174-84da-e88470298bc3 could not be found. Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-34c052b2-b97a-44ba-8c03-c02b4fddeaf8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Request method failure captured: Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-server-groups/b9fc6b5b-f474-4174-84da-e88470298bc3 HTTP/1.1 Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcLSTsRGZRP4c3PwLoDuehzUT01vK1guG2gqcLPegzEINWeQwRdX2lHhYRKOBPXXHzYMDuSGtz2OH6HPETj5i5MtXrnUvfbdrMrg921_kxYnXJ8j322QEraO4rrryAlNUDUzbF6bxTISclbpd_-cs4ex6qrXsZpKY76tBk-joh4p64M Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/abcafeba091a430c988536309174a3a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_abcafeba091a430c988536309174a3a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}] Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 388509aad0a34e96988e5ec7068070ea Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance group b9fc6b5b-f474-4174-84da-e88470298bc3 could not be found. Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'b9fc6b5b-f474-4174-84da-e88470298bc3'} Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b9fc6b5b-f474-4174-84da-e88470298bc3 could not be found. Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b9fc6b5b-f474-4174-84da-e88470298bc3 could not be found. Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.820656 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.826038 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.826038 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.826038 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:20.826038 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:20.826038 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b9fc6b5b-f474-4174-84da-e88470298bc3 could not be found. Oct 05 17:46:20.826038 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.826038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-34c052b2-b97a-44ba-8c03-c02b4fddeaf8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Returning 404 to user: Instance group b9fc6b5b-f474-4174-84da-e88470298bc3 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:20.826038 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-34c052b2-b97a-44ba-8c03-c02b4fddeaf8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/b9fc6b5b-f474-4174-84da-e88470298bc3" status: 404 len: 117 microversion: 2.1 time: 0.026574 Oct 05 17:46:20.826038 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1766/3340] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:46:20 2022] DELETE /compute/v2.1/os-server-groups/b9fc6b5b-f474-4174-84da-e88470298bc3 => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:46:20.832731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53d06dae-bd36-4f69-9c53-b67ef082e8c8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.844654 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-53d06dae-bd36-4f69-9c53-b67ef082e8c8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] HTTP exception thrown: Instance group 119b07b8-9c20-4326-ab20-ec88c72ee03f could not be found. Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53d06dae-bd36-4f69-9c53-b67ef082e8c8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Request method failure captured: Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-server-groups/119b07b8-9c20-4326-ab20-ec88c72ee03f HTTP/1.1 Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcLSTsRGZRP4c3PwLoDuehzUT01vK1guG2gqcLPegzEINWeQwRdX2lHhYRKOBPXXHzYMDuSGtz2OH6HPETj5i5MtXrnUvfbdrMrg921_kxYnXJ8j322QEraO4rrryAlNUDUzbF6bxTISclbpd_-cs4ex6qrXsZpKY76tBk-joh4p64M Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/abcafeba091a430c988536309174a3a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_abcafeba091a430c988536309174a3a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/abcafeba091a430c988536309174a3a9"}]}] Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: abcafeba091a430c988536309174a3a9 Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerGroupTestJSON-448990871 Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 388509aad0a34e96988e5ec7068070ea Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerGroupTestJSON-448990871-project Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance group 119b07b8-9c20-4326-ab20-ec88c72ee03f could not be found. Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '119b07b8-9c20-4326-ab20-ec88c72ee03f'} Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 119b07b8-9c20-4326-ab20-ec88c72ee03f could not be found. Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 119b07b8-9c20-4326-ab20-ec88c72ee03f could not be found. Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.852972 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:20.857396 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:20.857396 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:20.857396 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:20.857396 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:20.857396 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 119b07b8-9c20-4326-ab20-ec88c72ee03f could not be found. Oct 05 17:46:20.857396 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:46:20.857396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53d06dae-bd36-4f69-9c53-b67ef082e8c8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Returning 404 to user: Instance group 119b07b8-9c20-4326-ab20-ec88c72ee03f could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:20.857396 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53d06dae-bd36-4f69-9c53-b67ef082e8c8 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/119b07b8-9c20-4326-ab20-ec88c72ee03f" status: 404 len: 117 microversion: 2.1 time: 0.028347 Oct 05 17:46:20.857396 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1575/3341] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:46:20 2022] DELETE /compute/v2.1/os-server-groups/119b07b8-9c20-4326-ab20-ec88c72ee03f => generated 117 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:46:20.864512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f04bb99d-c421-42bb-8891-2c63330084a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.882545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5868e18c-e03c-4739-af89-c670b3144f81 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:20.883162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5868e18c-e03c-4739-af89-c670b3144f81 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:20.889405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5868e18c-e03c-4739-af89-c670b3144f81 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.889889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5868e18c-e03c-4739-af89-c670b3144f81 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.890344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5868e18c-e03c-4739-af89-c670b3144f81 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.891052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5868e18c-e03c-4739-af89-c670b3144f81 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:20.891504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5868e18c-e03c-4739-af89-c670b3144f81 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:20.891929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5868e18c-e03c-4739-af89-c670b3144f81 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:20.921198 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f04bb99d-c421-42bb-8891-2c63330084a6 tempest-ServerGroupTestJSON-448990871 tempest-ServerGroupTestJSON-448990871-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/d72e30e3-9961-482d-8a59-73154ccfd7aa" status: 204 len: 0 microversion: 2.1 time: 0.060244 Oct 05 17:46:20.931053 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1767/3342] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:46:20 2022] DELETE /compute/v2.1/os-server-groups/d72e30e3-9961-482d-8a59-73154ccfd7aa => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:46:20.978095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e0203a6c-9676-48ba-8fe4-d289ec52b20d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7779621940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:21.049348 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e0203a6c-9676-48ba-8fe4-d289ec52b20d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.076043 Oct 05 17:46:21.050387 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1768/3343] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:20 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:21.280635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3297560-06f1-44b0-a948-36f5f9baf0e2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:21.281917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b3297560-06f1-44b0-a948-36f5f9baf0e2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:21.309719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3297560-06f1-44b0-a948-36f5f9baf0e2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:21.314204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3297560-06f1-44b0-a948-36f5f9baf0e2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:21.317803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3297560-06f1-44b0-a948-36f5f9baf0e2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:21.338525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3297560-06f1-44b0-a948-36f5f9baf0e2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:21.342498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3297560-06f1-44b0-a948-36f5f9baf0e2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:21.343885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3297560-06f1-44b0-a948-36f5f9baf0e2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:21.856069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3297560-06f1-44b0-a948-36f5f9baf0e2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:21.872033 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3297560-06f1-44b0-a948-36f5f9baf0e2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.596165 Oct 05 17:46:21.874024 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1769/3344] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:21 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:21.892599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f718ee2-9e7e-401b-8296-75a515090eea tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:21.893659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8f718ee2-9e7e-401b-8296-75a515090eea tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:21.906724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f718ee2-9e7e-401b-8296-75a515090eea tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:21.909185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f718ee2-9e7e-401b-8296-75a515090eea tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:21.909872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f718ee2-9e7e-401b-8296-75a515090eea tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:21.916039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f718ee2-9e7e-401b-8296-75a515090eea tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:21.916784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f718ee2-9e7e-401b-8296-75a515090eea tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:21.917696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f718ee2-9e7e-401b-8296-75a515090eea tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:22.043951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8f718ee2-9e7e-401b-8296-75a515090eea tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:22.053771 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f718ee2-9e7e-401b-8296-75a515090eea tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1269 microversion: 2.1 time: 0.178337 Oct 05 17:46:22.075431 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1770/3345] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:21 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1269 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:22.105675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99ba5fd8-fa31-4580-be1d-5401205d89f6 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77795a5d30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:22.109692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5868e18c-e03c-4739-af89-c670b3144f81 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:22.112561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:22.123869 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5868e18c-e03c-4739-af89-c670b3144f81 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1674 microversion: 2.1 time: 1.246421 Oct 05 17:46:22.125791 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1576/3346] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:20 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1674 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:22.200188 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99ba5fd8-fa31-4580-be1d-5401205d89f6 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.122993 Oct 05 17:46:22.201200 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1771/3347] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:22 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:22.901141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-81f82daf-bcf7-4810-aede-b0fdb99aede8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:22.905602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-81f82daf-bcf7-4810-aede-b0fdb99aede8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:22.929492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81f82daf-bcf7-4810-aede-b0fdb99aede8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:22.930452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81f82daf-bcf7-4810-aede-b0fdb99aede8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:22.933487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81f82daf-bcf7-4810-aede-b0fdb99aede8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:22.934548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81f82daf-bcf7-4810-aede-b0fdb99aede8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:22.935919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81f82daf-bcf7-4810-aede-b0fdb99aede8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:22.936834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81f82daf-bcf7-4810-aede-b0fdb99aede8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:23.053065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-09b169e3-3b1d-4128-9b2e-6f5a98c7e01f req-a7e4ab2a-c71b-4764-a365-3ac06ce3bb53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3fc4e4d-9f2d-4df2-bf41-9fd764de0382", "name": "network-vif-deleted", "tag": "ba6a5ab9-d39f-4718-9a48-4bc6c5c16d68"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:23.097601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-09b169e3-3b1d-4128-9b2e-6f5a98c7e01f req-a7e4ab2a-c71b-4764-a365-3ac06ce3bb53 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:23.098108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-09b169e3-3b1d-4128-9b2e-6f5a98c7e01f req-a7e4ab2a-c71b-4764-a365-3ac06ce3bb53 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:23.098684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-09b169e3-3b1d-4128-9b2e-6f5a98c7e01f req-a7e4ab2a-c71b-4764-a365-3ac06ce3bb53 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:23.154515 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-09b169e3-3b1d-4128-9b2e-6f5a98c7e01f req-a7e4ab2a-c71b-4764-a365-3ac06ce3bb53 service nova] Creating event network-vif-deleted:ba6a5ab9-d39f-4718-9a48-4bc6c5c16d68 for instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 on n-h2-835595-3 Oct 05 17:46:23.167183 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-09b169e3-3b1d-4128-9b2e-6f5a98c7e01f req-a7e4ab2a-c71b-4764-a365-3ac06ce3bb53 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119118 Oct 05 17:46:23.174511 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1772/3348] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:23.180407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f679c13-e914-4e66-9e57-6429b7dff2a6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:23.184105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2f679c13-e914-4e66-9e57-6429b7dff2a6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:23.200971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f679c13-e914-4e66-9e57-6429b7dff2a6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:23.201830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f679c13-e914-4e66-9e57-6429b7dff2a6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:23.202512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f679c13-e914-4e66-9e57-6429b7dff2a6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:23.203442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f679c13-e914-4e66-9e57-6429b7dff2a6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:23.204107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f679c13-e914-4e66-9e57-6429b7dff2a6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:23.204738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f679c13-e914-4e66-9e57-6429b7dff2a6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:23.601975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f679c13-e914-4e66-9e57-6429b7dff2a6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:23.617121 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f679c13-e914-4e66-9e57-6429b7dff2a6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1275 microversion: 2.1 time: 0.440980 Oct 05 17:46:23.632713 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1773/3349] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:23 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1275 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:23.643706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ca59e888-63f0-441c-8b8d-ab90e7a8cac9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:23.644953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ca59e888-63f0-441c-8b8d-ab90e7a8cac9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:23.659388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca59e888-63f0-441c-8b8d-ab90e7a8cac9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:23.660434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca59e888-63f0-441c-8b8d-ab90e7a8cac9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:23.661117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca59e888-63f0-441c-8b8d-ab90e7a8cac9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:23.666267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca59e888-63f0-441c-8b8d-ab90e7a8cac9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:23.667135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca59e888-63f0-441c-8b8d-ab90e7a8cac9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:23.667812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca59e888-63f0-441c-8b8d-ab90e7a8cac9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:23.788601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ca59e888-63f0-441c-8b8d-ab90e7a8cac9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:23.802703 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ca59e888-63f0-441c-8b8d-ab90e7a8cac9 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1607 microversion: 2.1 time: 0.168033 Oct 05 17:46:23.808808 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1774/3350] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:23 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1607 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:23.814791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88d9df60-6f31-4a0a-90eb-760a483b8592 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77752e25e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:23.888568 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88d9df60-6f31-4a0a-90eb-760a483b8592 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.077989 Oct 05 17:46:23.892215 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1775/3351] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:23 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:23.987136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-81f82daf-bcf7-4810-aede-b0fdb99aede8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:24.003433 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-81f82daf-bcf7-4810-aede-b0fdb99aede8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 1.110525 Oct 05 17:46:24.006090 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1577/3352] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:22 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:24.412367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-505af43f-f957-41e6-b320-862d51090d4f req-162c501b-faf6-4831-ac4f-7a10feb0b325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586258bf-c661-4819-804b-504089c77dc6", "name": "network-vif-deleted", "tag": "cfd34f5d-5af2-4330-b921-2091d3e274be"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:24.460003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-505af43f-f957-41e6-b320-862d51090d4f req-162c501b-faf6-4831-ac4f-7a10feb0b325 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:24.461056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-505af43f-f957-41e6-b320-862d51090d4f req-162c501b-faf6-4831-ac4f-7a10feb0b325 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:24.461490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-505af43f-f957-41e6-b320-862d51090d4f req-162c501b-faf6-4831-ac4f-7a10feb0b325 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:24.497766 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-505af43f-f957-41e6-b320-862d51090d4f req-162c501b-faf6-4831-ac4f-7a10feb0b325 service nova] Creating event network-vif-deleted:cfd34f5d-5af2-4330-b921-2091d3e274be for instance 586258bf-c661-4819-804b-504089c77dc6 on n-h2-835595-3 Oct 05 17:46:24.513343 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-505af43f-f957-41e6-b320-862d51090d4f req-162c501b-faf6-4831-ac4f-7a10feb0b325 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104930 Oct 05 17:46:24.522017 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1776/3353] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:24.647249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8d8a8c76-4d30-4231-9a96-2ffe1a835f8c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:24.648004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8d8a8c76-4d30-4231-9a96-2ffe1a835f8c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:24.663677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d8a8c76-4d30-4231-9a96-2ffe1a835f8c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:24.664351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d8a8c76-4d30-4231-9a96-2ffe1a835f8c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:24.665031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d8a8c76-4d30-4231-9a96-2ffe1a835f8c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:24.665990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d8a8c76-4d30-4231-9a96-2ffe1a835f8c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:24.667315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d8a8c76-4d30-4231-9a96-2ffe1a835f8c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:24.667973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d8a8c76-4d30-4231-9a96-2ffe1a835f8c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:24.828022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:24.828635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:24.844632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:24.845133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:24.845572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:24.846310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:24.846769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:24.847197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:24.919521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:24.951681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:24.952177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:24.952612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:24.953067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lazy-loading 'fault' on Instance uuid 586258bf-c661-4819-804b-504089c77dc6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:46:25.050718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c5f58a618c04b09815dea8f54504c7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8ec67d827143b3a09b519cb4af417e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:25.055137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d8a8c76-4d30-4231-9a96-2ffe1a835f8c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:25.064707 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8d8a8c76-4d30-4231-9a96-2ffe1a835f8c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1275 microversion: 2.1 time: 0.423542 Oct 05 17:46:25.075076 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1578/3354] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:24 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1275 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:25.078820 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0001a691-3068-408d-b93c-01e879bf4f80 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 200 len: 1328 microversion: 2.1 time: 0.255027 Oct 05 17:46:25.084032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da1bb8a5-2ecc-488e-bf53-88a6c5d87708 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777963fee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:25.087325 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1777/3355] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:24 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 1328 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:25.092000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cbd0117a-cd19-4955-a33d-9edc0772d53b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:25.092609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cbd0117a-cd19-4955-a33d-9edc0772d53b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:25.130950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbd0117a-cd19-4955-a33d-9edc0772d53b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:25.131484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbd0117a-cd19-4955-a33d-9edc0772d53b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:25.131933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbd0117a-cd19-4955-a33d-9edc0772d53b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:25.136017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbd0117a-cd19-4955-a33d-9edc0772d53b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:25.139156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbd0117a-cd19-4955-a33d-9edc0772d53b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:25.141478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbd0117a-cd19-4955-a33d-9edc0772d53b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:25.165336 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da1bb8a5-2ecc-488e-bf53-88a6c5d87708 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.085128 Oct 05 17:46:25.166655 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1579/3356] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:25 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:25.308191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-04968481-d1fd-41b1-93fe-dfad1edef03a req-4518d9d5-c539-4129-8d9a-566fc7451dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861d19af-3969-47e3-9887-e20a02de197f", "name": "network-vif-unplugged", "status": "completed", "tag": "c398e3dd-834e-4b62-9832-e96be5cc76ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:25.329954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-04968481-d1fd-41b1-93fe-dfad1edef03a req-4518d9d5-c539-4129-8d9a-566fc7451dde service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:25.335617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-04968481-d1fd-41b1-93fe-dfad1edef03a req-4518d9d5-c539-4129-8d9a-566fc7451dde service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:25.338177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-04968481-d1fd-41b1-93fe-dfad1edef03a req-4518d9d5-c539-4129-8d9a-566fc7451dde service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:25.376126 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-04968481-d1fd-41b1-93fe-dfad1edef03a req-4518d9d5-c539-4129-8d9a-566fc7451dde service nova] Creating event network-vif-unplugged:c398e3dd-834e-4b62-9832-e96be5cc76ef for instance 861d19af-3969-47e3-9887-e20a02de197f on n-h1-835595-3 Oct 05 17:46:25.384869 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-04968481-d1fd-41b1-93fe-dfad1edef03a req-4518d9d5-c539-4129-8d9a-566fc7451dde service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088809 Oct 05 17:46:25.389667 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1580/3357] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 05 17:46:25.664351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cbd0117a-cd19-4955-a33d-9edc0772d53b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:25.681845 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cbd0117a-cd19-4955-a33d-9edc0772d53b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.592823 Oct 05 17:46:25.683028 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1778/3358] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:25 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:26.089033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1bf6735-185e-4864-a954-62f80b4434a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:26.090532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c1bf6735-185e-4864-a954-62f80b4434a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:26.108973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:26.109583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] [instance: 586258bf-c661-4819-804b-504089c77dc6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:26.109971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1bf6735-185e-4864-a954-62f80b4434a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:26.110775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1bf6735-185e-4864-a954-62f80b4434a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:26.111893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1bf6735-185e-4864-a954-62f80b4434a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:26.113553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1bf6735-185e-4864-a954-62f80b4434a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:26.114358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1bf6735-185e-4864-a954-62f80b4434a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:26.115770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1bf6735-185e-4864-a954-62f80b4434a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:26.116484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:26.125060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:26.128249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:26.131261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:26.131939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:26.133715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:26.178813 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] HTTP exception thrown: Instance 586258bf-c661-4819-804b-504089c77dc6 could not be found. Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Request method failure captured: Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 HTTP/1.1 Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcCvFl89ip348NgYmwRfZVFC69tIUsNnayzGFoWfaaS5WJz4H_LFyyNRNAoVHHF9Wfeh9GoU_EwuvkTy8VtZir92iFF1CSn6ibH-bezU0QjM6z6boOtDmg22QRK98g5juENhUY8ur87Hcv6cKi_H4k4qVVkCC9KKvvdQauWSleksFok Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d8ec67d827143b3a09b519cb4af417e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d8ec67d827143b3a09b519cb4af417e"}]}] Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 4d8ec67d827143b3a09b519cb4af417e Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-385249587 Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 1c5f58a618c04b09815dea8f54504c7c Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-385249587-project Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 586258bf-c661-4819-804b-504089c77dc6 could not be found. Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '586258bf-c661-4819-804b-504089c77dc6'} Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586258bf-c661-4819-804b-504089c77dc6 could not be found. Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586258bf-c661-4819-804b-504089c77dc6 could not be found. Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:46:26.182818 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:26.189029 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:46:26.189029 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:46:26.189029 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:46:26.189029 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:46:26.189029 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:46:26.189029 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586258bf-c661-4819-804b-504089c77dc6 could not be found. Oct 05 17:46:26.189029 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:46:26.201078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Returning 404 to user: Instance 586258bf-c661-4819-804b-504089c77dc6 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:46:26.203192 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-40d1c851-a3d9-49f9-9309-7014627c5960 tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6" status: 404 len: 111 microversion: 2.1 time: 0.098092 Oct 05 17:46:26.212973 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1779/3359] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:26 2022] GET /compute/v2.1/servers/586258bf-c661-4819-804b-504089c77dc6 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:46:26.217984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48c04f26-70a7-40e9-97f3-036676c44f73 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77751271f0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:26.290734 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48c04f26-70a7-40e9-97f3-036676c44f73 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.076562 Oct 05 17:46:26.291650 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1780/3360] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:26 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:26.303121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-52cc8ac4-1f30-4c6c-b574-60f4b2a611be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] Calling method '.version_select at 0x7f77795a5310>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:26.374170 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-52cc8ac4-1f30-4c6c-b574-60f4b2a611be tempest-ServerActionsTestJSON-385249587 tempest-ServerActionsTestJSON-385249587-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989299184" status: 202 len: 0 microversion: 2.1 time: 0.078945 Oct 05 17:46:26.375672 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1781/3361] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 17:46:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989299184 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:46:26.743891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-071e3161-dec5-4cd1-895c-058322e91c45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:26.745425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-071e3161-dec5-4cd1-895c-058322e91c45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:26.774072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-071e3161-dec5-4cd1-895c-058322e91c45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:26.774546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-071e3161-dec5-4cd1-895c-058322e91c45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:26.774985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-071e3161-dec5-4cd1-895c-058322e91c45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:26.780020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-071e3161-dec5-4cd1-895c-058322e91c45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:26.780710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-071e3161-dec5-4cd1-895c-058322e91c45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:26.781443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-071e3161-dec5-4cd1-895c-058322e91c45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:26.906846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c1bf6735-185e-4864-a954-62f80b4434a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:26.917240 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c1bf6735-185e-4864-a954-62f80b4434a2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1317 microversion: 2.1 time: 0.832302 Oct 05 17:46:26.923277 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1581/3362] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:26 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1317 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:27.307345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-263f9c86-2e35-40af-8702-d26488fd4329 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777566d8b0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:27.406698 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-263f9c86-2e35-40af-8702-d26488fd4329 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.103507 Oct 05 17:46:27.407888 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1582/3363] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:27 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:27.655092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-35d1fffb-99c0-4ec9-90cb-723305a98641 req-dd44213f-4ab9-4288-91aa-7f400c0a900a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "861d19af-3969-47e3-9887-e20a02de197f", "tag": "c398e3dd-834e-4b62-9832-e96be5cc76ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:27.672721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-35d1fffb-99c0-4ec9-90cb-723305a98641 req-dd44213f-4ab9-4288-91aa-7f400c0a900a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:27.673207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-35d1fffb-99c0-4ec9-90cb-723305a98641 req-dd44213f-4ab9-4288-91aa-7f400c0a900a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:27.673643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-35d1fffb-99c0-4ec9-90cb-723305a98641 req-dd44213f-4ab9-4288-91aa-7f400c0a900a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:27.699185 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-35d1fffb-99c0-4ec9-90cb-723305a98641 req-dd44213f-4ab9-4288-91aa-7f400c0a900a service nova] Creating event network-changed:c398e3dd-834e-4b62-9832-e96be5cc76ef for instance 861d19af-3969-47e3-9887-e20a02de197f on n-h1-835595-3 Oct 05 17:46:27.711594 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-35d1fffb-99c0-4ec9-90cb-723305a98641 req-dd44213f-4ab9-4288-91aa-7f400c0a900a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059412 Oct 05 17:46:27.714478 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1583/3364] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:27.936284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-071e3161-dec5-4cd1-895c-058322e91c45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:27.954975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b30bca57-480e-45c6-ba6f-7d7b4c81279c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:27.955984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b30bca57-480e-45c6-ba6f-7d7b4c81279c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:27.971042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-071e3161-dec5-4cd1-895c-058322e91c45 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 1.268543 Oct 05 17:46:27.972104 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1782/3365] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:26 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:27.987460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b30bca57-480e-45c6-ba6f-7d7b4c81279c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:27.987460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b30bca57-480e-45c6-ba6f-7d7b4c81279c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:27.987460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b30bca57-480e-45c6-ba6f-7d7b4c81279c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:27.987460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b30bca57-480e-45c6-ba6f-7d7b4c81279c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:27.987460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b30bca57-480e-45c6-ba6f-7d7b4c81279c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:27.987460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b30bca57-480e-45c6-ba6f-7d7b4c81279c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:28.423602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b6432864-0dd7-4fcd-b0e5-a6db8cd7ed2a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775127310>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:28.478412 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b6432864-0dd7-4fcd-b0e5-a6db8cd7ed2a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1452 microversion: 2.1 time: 0.059583 Oct 05 17:46:28.479268 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1783/3366] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:28 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1452 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:28.852088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b30bca57-480e-45c6-ba6f-7d7b4c81279c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:28.873729 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b30bca57-480e-45c6-ba6f-7d7b4c81279c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1317 microversion: 2.1 time: 0.916586 Oct 05 17:46:28.886336 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1584/3367] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:27 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1317 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:29.000677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8a87f0bd-24cc-4937-9092-7bbbb1432ead tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:29.001287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8a87f0bd-24cc-4937-9092-7bbbb1432ead tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:29.009593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a87f0bd-24cc-4937-9092-7bbbb1432ead tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:29.010337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a87f0bd-24cc-4937-9092-7bbbb1432ead tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:29.010937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a87f0bd-24cc-4937-9092-7bbbb1432ead tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:29.011810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a87f0bd-24cc-4937-9092-7bbbb1432ead tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:29.012426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a87f0bd-24cc-4937-9092-7bbbb1432ead tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:29.013032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a87f0bd-24cc-4937-9092-7bbbb1432ead tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:29.244095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8a87f0bd-24cc-4937-9092-7bbbb1432ead tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:29.257846 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8a87f0bd-24cc-4937-9092-7bbbb1432ead tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.261852 Oct 05 17:46:29.259719 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1784/3368] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:28 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:29.494892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-88086972-0471-4161-8e09-a97c37aced8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77795621f0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:29.596199 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-88086972-0471-4161-8e09-a97c37aced8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1461 microversion: 2.1 time: 0.105232 Oct 05 17:46:29.597918 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1585/3369] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:29 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1461 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:29.612586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-edb94782-0034-4875-88d6-797bc46bdc20 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774d06f70>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:29.706062 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-edb94782-0034-4875-88d6-797bc46bdc20 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 200 len: 1461 microversion: 2.1 time: 0.099050 Oct 05 17:46:29.707632 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1785/3370] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:29 2022] GET /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 1461 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:29.724930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-905751bc-b939-4f57-b90f-0da10d1c8a6a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:29.726267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-905751bc-b939-4f57-b90f-0da10d1c8a6a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:29.739294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-905751bc-b939-4f57-b90f-0da10d1c8a6a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:29.741078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-905751bc-b939-4f57-b90f-0da10d1c8a6a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:29.741733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-905751bc-b939-4f57-b90f-0da10d1c8a6a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:29.742806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-905751bc-b939-4f57-b90f-0da10d1c8a6a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:29.743488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-905751bc-b939-4f57-b90f-0da10d1c8a6a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:29.744131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-905751bc-b939-4f57-b90f-0da10d1c8a6a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:29.785548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-bbd539fe-6238-4e3f-88ad-8523cd69e2a7 req-c230ed4c-8a2c-4c93-8a43-1d4d4535359c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd", "tag": "b9627811-9013-44a9-b7ff-0e44f3f9d2c9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:29.810141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bbd539fe-6238-4e3f-88ad-8523cd69e2a7 req-c230ed4c-8a2c-4c93-8a43-1d4d4535359c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:29.810933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bbd539fe-6238-4e3f-88ad-8523cd69e2a7 req-c230ed4c-8a2c-4c93-8a43-1d4d4535359c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:29.811659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bbd539fe-6238-4e3f-88ad-8523cd69e2a7 req-c230ed4c-8a2c-4c93-8a43-1d4d4535359c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:29.824994 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-bbd539fe-6238-4e3f-88ad-8523cd69e2a7 req-c230ed4c-8a2c-4c93-8a43-1d4d4535359c service nova] Creating event network-changed:b9627811-9013-44a9-b7ff-0e44f3f9d2c9 for instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd on n-h1-835595-3 Oct 05 17:46:29.832449 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-bbd539fe-6238-4e3f-88ad-8523cd69e2a7 req-c230ed4c-8a2c-4c93-8a43-1d4d4535359c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051599 Oct 05 17:46:29.834366 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1786/3371] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:29.901795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a7c06d51-6632-4584-82e9-6f84032d2b3a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:29.902947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a7c06d51-6632-4584-82e9-6f84032d2b3a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:29.931086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c06d51-6632-4584-82e9-6f84032d2b3a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:29.931676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c06d51-6632-4584-82e9-6f84032d2b3a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:29.932175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c06d51-6632-4584-82e9-6f84032d2b3a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:29.932956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c06d51-6632-4584-82e9-6f84032d2b3a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:29.933477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c06d51-6632-4584-82e9-6f84032d2b3a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:29.933970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7c06d51-6632-4584-82e9-6f84032d2b3a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:30.118785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-905751bc-b939-4f57-b90f-0da10d1c8a6a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:30.137778 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-905751bc-b939-4f57-b90f-0da10d1c8a6a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1465 microversion: 2.1 time: 0.418777 Oct 05 17:46:30.139003 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1586/3372] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:29 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1465 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:30.169531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d67cf19f-a23d-4344-a906-191d6f8b105f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-149834380"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:30.182380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d67cf19f-a23d-4344-a906-191d6f8b105f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:30.189186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d67cf19f-a23d-4344-a906-191d6f8b105f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:30.190662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d67cf19f-a23d-4344-a906-191d6f8b105f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:30.191544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d67cf19f-a23d-4344-a906-191d6f8b105f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:30.192507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d67cf19f-a23d-4344-a906-191d6f8b105f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:30.193779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d67cf19f-a23d-4344-a906-191d6f8b105f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:30.195466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d67cf19f-a23d-4344-a906-191d6f8b105f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:30.196740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:30.533635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:30.569283 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d67cf19f-a23d-4344-a906-191d6f8b105f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "POST /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d/action" status: 202 len: 0 microversion: 2.1 time: 0.407032 Oct 05 17:46:30.575837 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1587/3373] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:46:30 2022] POST /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 17:46:30.608351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5358ebf3-ecc5-4073-b939-3823d55bce73 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:30.609463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5358ebf3-ecc5-4073-b939-3823d55bce73 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:30.630092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5358ebf3-ecc5-4073-b939-3823d55bce73 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:30.630940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5358ebf3-ecc5-4073-b939-3823d55bce73 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:30.631540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5358ebf3-ecc5-4073-b939-3823d55bce73 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:30.632439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5358ebf3-ecc5-4073-b939-3823d55bce73 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:30.634962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5358ebf3-ecc5-4073-b939-3823d55bce73 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:30.636249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5358ebf3-ecc5-4073-b939-3823d55bce73 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:30.873322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5358ebf3-ecc5-4073-b939-3823d55bce73 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:30.884425 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5358ebf3-ecc5-4073-b939-3823d55bce73 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.306101 Oct 05 17:46:30.886004 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1588/3374] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:30 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:30.891347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e741e030-9a42-4678-90ee-6bfe4ed59c01 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77794ccca0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:30.967785 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e741e030-9a42-4678-90ee-6bfe4ed59c01 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.080447 Oct 05 17:46:30.968860 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1589/3375] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:30 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:31.028720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7c06d51-6632-4584-82e9-6f84032d2b3a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:31.038812 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a7c06d51-6632-4584-82e9-6f84032d2b3a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1317 microversion: 2.1 time: 1.141210 Oct 05 17:46:31.039719 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1787/3376] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:29 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1317 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:31.803226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-073aa56f-9f54-4cd9-9224-88a9c19550cc req-ba598245-42d3-473b-a3da-b025dd7278f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3caa633-ebf4-4260-9dc5-bcc736013af2", "name": "network-vif-unplugged", "status": "completed", "tag": "30f075ed-d317-4f30-9da2-0931dec00b11"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:31.822602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-073aa56f-9f54-4cd9-9224-88a9c19550cc req-ba598245-42d3-473b-a3da-b025dd7278f1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:31.830168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-073aa56f-9f54-4cd9-9224-88a9c19550cc req-ba598245-42d3-473b-a3da-b025dd7278f1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:31.830887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-073aa56f-9f54-4cd9-9224-88a9c19550cc req-ba598245-42d3-473b-a3da-b025dd7278f1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:31.867954 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-073aa56f-9f54-4cd9-9224-88a9c19550cc req-ba598245-42d3-473b-a3da-b025dd7278f1 service nova] Creating event network-vif-unplugged:30f075ed-d317-4f30-9da2-0931dec00b11 for instance d3caa633-ebf4-4260-9dc5-bcc736013af2 on n-h1-835595-3 Oct 05 17:46:31.878026 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-073aa56f-9f54-4cd9-9224-88a9c19550cc req-ba598245-42d3-473b-a3da-b025dd7278f1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077211 Oct 05 17:46:31.879458 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1590/3377] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:31.913842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a3ce65ee-dd71-45b2-8b46-a8a3b1e7b158 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:31.915805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a3ce65ee-dd71-45b2-8b46-a8a3b1e7b158 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:31.929178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce65ee-dd71-45b2-8b46-a8a3b1e7b158 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:31.930114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce65ee-dd71-45b2-8b46-a8a3b1e7b158 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:31.930793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce65ee-dd71-45b2-8b46-a8a3b1e7b158 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:31.932192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce65ee-dd71-45b2-8b46-a8a3b1e7b158 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:31.933263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce65ee-dd71-45b2-8b46-a8a3b1e7b158 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:31.935165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce65ee-dd71-45b2-8b46-a8a3b1e7b158 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:31.985297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-50a875c7-98b8-4c1d-bf7b-10c9edcee237 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777966b3a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:32.051966 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-50a875c7-98b8-4c1d-bf7b-10c9edcee237 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.071402 Oct 05 17:46:32.060345 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1591/3378] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:31 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:32.065362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6875d2c8-b592-46e7-baad-b1cf6c9ffd74 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:32.066097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6875d2c8-b592-46e7-baad-b1cf6c9ffd74 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:32.073728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6875d2c8-b592-46e7-baad-b1cf6c9ffd74 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:32.074537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6875d2c8-b592-46e7-baad-b1cf6c9ffd74 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:32.075154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6875d2c8-b592-46e7-baad-b1cf6c9ffd74 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:32.076032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6875d2c8-b592-46e7-baad-b1cf6c9ffd74 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:32.076648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6875d2c8-b592-46e7-baad-b1cf6c9ffd74 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:32.077250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6875d2c8-b592-46e7-baad-b1cf6c9ffd74 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:32.620727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6875d2c8-b592-46e7-baad-b1cf6c9ffd74 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:32.631765 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6875d2c8-b592-46e7-baad-b1cf6c9ffd74 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1317 microversion: 2.1 time: 0.570228 Oct 05 17:46:32.633328 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1592/3379] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:32 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1317 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:32.762807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a3ce65ee-dd71-45b2-8b46-a8a3b1e7b158 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:32.772374 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a3ce65ee-dd71-45b2-8b46-a8a3b1e7b158 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.863734 Oct 05 17:46:32.773010 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1788/3380] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:31 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:33.069577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-381f0e79-e979-431f-a49f-98fbafadea7b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777956b940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:33.167688 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-381f0e79-e979-431f-a49f-98fbafadea7b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.103448 Oct 05 17:46:33.171735 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1593/3381] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:33 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:33.673794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d11424d0-f2e6-49e4-90b5-e68702139766 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:33.674918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d11424d0-f2e6-49e4-90b5-e68702139766 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:33.701499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d11424d0-f2e6-49e4-90b5-e68702139766 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:33.702350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d11424d0-f2e6-49e4-90b5-e68702139766 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:33.703206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d11424d0-f2e6-49e4-90b5-e68702139766 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:33.705571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d11424d0-f2e6-49e4-90b5-e68702139766 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:33.706418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d11424d0-f2e6-49e4-90b5-e68702139766 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:33.709951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d11424d0-f2e6-49e4-90b5-e68702139766 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:33.796507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a508d47-6106-49aa-84cc-f655bdcb7afb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:33.797114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7a508d47-6106-49aa-84cc-f655bdcb7afb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:33.808607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a508d47-6106-49aa-84cc-f655bdcb7afb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:33.809106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a508d47-6106-49aa-84cc-f655bdcb7afb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:33.814536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a508d47-6106-49aa-84cc-f655bdcb7afb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:33.815326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a508d47-6106-49aa-84cc-f655bdcb7afb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:33.815816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a508d47-6106-49aa-84cc-f655bdcb7afb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:33.820034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a508d47-6106-49aa-84cc-f655bdcb7afb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:34.118084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d11424d0-f2e6-49e4-90b5-e68702139766 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:34.136575 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d11424d0-f2e6-49e4-90b5-e68702139766 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1317 microversion: 2.1 time: 0.484070 Oct 05 17:46:34.138054 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1789/3382] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:33 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1317 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:34.193459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21ae1f3f-be40-4904-ab80-df8532edfe7b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774f00670>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:34.250008 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21ae1f3f-be40-4904-ab80-df8532edfe7b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.066885 Oct 05 17:46:34.259367 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1790/3383] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:34 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:34.282937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7a508d47-6106-49aa-84cc-f655bdcb7afb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:34.314800 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a508d47-6106-49aa-84cc-f655bdcb7afb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.521899 Oct 05 17:46:34.332783 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1594/3384] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:33 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:35.161459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e53ff60-fdff-4de3-af3a-5c6ccde5f355 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:35.162122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e53ff60-fdff-4de3-af3a-5c6ccde5f355 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:35.180311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e53ff60-fdff-4de3-af3a-5c6ccde5f355 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:35.181315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e53ff60-fdff-4de3-af3a-5c6ccde5f355 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:35.182022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e53ff60-fdff-4de3-af3a-5c6ccde5f355 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:35.183497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e53ff60-fdff-4de3-af3a-5c6ccde5f355 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:35.184226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e53ff60-fdff-4de3-af3a-5c6ccde5f355 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:35.184676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e53ff60-fdff-4de3-af3a-5c6ccde5f355 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:35.267459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a51b8250-774e-420a-9cef-466fed6978da tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775d93f70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:35.388180 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a51b8250-774e-420a-9cef-466fed6978da tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.124329 Oct 05 17:46:35.389366 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1595/3385] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:35 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:35.401551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8a8da5b3-93b7-472d-ab36-7d2f5016b60d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:35.402194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8a8da5b3-93b7-472d-ab36-7d2f5016b60d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:35.436247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8da5b3-93b7-472d-ab36-7d2f5016b60d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:35.436745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8da5b3-93b7-472d-ab36-7d2f5016b60d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:35.437187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8da5b3-93b7-472d-ab36-7d2f5016b60d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:35.437910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8da5b3-93b7-472d-ab36-7d2f5016b60d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:35.447391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8da5b3-93b7-472d-ab36-7d2f5016b60d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:35.448004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a8da5b3-93b7-472d-ab36-7d2f5016b60d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:35.797062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e53ff60-fdff-4de3-af3a-5c6ccde5f355 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:35.808503 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e53ff60-fdff-4de3-af3a-5c6ccde5f355 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1317 microversion: 2.1 time: 0.652038 Oct 05 17:46:35.809100 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1791/3386] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:35 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:35.930215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4092e034-c34d-4cbd-ad15-56c662e6d9a9 req-bb7e8f5b-f5ba-4ec6-b7f1-f348575abe44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd", "name": "network-vif-plugged", "status": "completed", "tag": "b9627811-9013-44a9-b7ff-0e44f3f9d2c9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:35.954373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4092e034-c34d-4cbd-ad15-56c662e6d9a9 req-bb7e8f5b-f5ba-4ec6-b7f1-f348575abe44 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:35.954864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4092e034-c34d-4cbd-ad15-56c662e6d9a9 req-bb7e8f5b-f5ba-4ec6-b7f1-f348575abe44 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:35.955296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4092e034-c34d-4cbd-ad15-56c662e6d9a9 req-bb7e8f5b-f5ba-4ec6-b7f1-f348575abe44 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:35.985530 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4092e034-c34d-4cbd-ad15-56c662e6d9a9 req-bb7e8f5b-f5ba-4ec6-b7f1-f348575abe44 service nova] Creating event network-vif-plugged:b9627811-9013-44a9-b7ff-0e44f3f9d2c9 for instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd on n-h1-835595-3 Oct 05 17:46:36.004053 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4092e034-c34d-4cbd-ad15-56c662e6d9a9 req-bb7e8f5b-f5ba-4ec6-b7f1-f348575abe44 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077659 Oct 05 17:46:36.004983 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1792/3387] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:46:36.060195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8a8da5b3-93b7-472d-ab36-7d2f5016b60d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:36.073987 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8a8da5b3-93b7-472d-ab36-7d2f5016b60d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.682615 Oct 05 17:46:36.075566 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1596/3388] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:35 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:36.403604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6bca4863-0523-4c39-9afa-e43d4ff32b28 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77796213a0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:36.504580 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6bca4863-0523-4c39-9afa-e43d4ff32b28 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.105166 Oct 05 17:46:36.518602 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1793/3389] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:36 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:36.835395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51fda876-126e-4ff4-8dc4-174f0f1cd03d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:36.836925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51fda876-126e-4ff4-8dc4-174f0f1cd03d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:36.853138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51fda876-126e-4ff4-8dc4-174f0f1cd03d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:36.854556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51fda876-126e-4ff4-8dc4-174f0f1cd03d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:36.856885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51fda876-126e-4ff4-8dc4-174f0f1cd03d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:36.858030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51fda876-126e-4ff4-8dc4-174f0f1cd03d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:36.860311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51fda876-126e-4ff4-8dc4-174f0f1cd03d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:36.863975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51fda876-126e-4ff4-8dc4-174f0f1cd03d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:37.097299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-931ee90b-da5f-4de3-9570-ff26a279e1d7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:37.098040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-931ee90b-da5f-4de3-9570-ff26a279e1d7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:37.117451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-931ee90b-da5f-4de3-9570-ff26a279e1d7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:37.118257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-931ee90b-da5f-4de3-9570-ff26a279e1d7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:37.118901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-931ee90b-da5f-4de3-9570-ff26a279e1d7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:37.119829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-931ee90b-da5f-4de3-9570-ff26a279e1d7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:37.123106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-931ee90b-da5f-4de3-9570-ff26a279e1d7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:37.123778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-931ee90b-da5f-4de3-9570-ff26a279e1d7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:37.411704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-51fda876-126e-4ff4-8dc4-174f0f1cd03d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:37.423000 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51fda876-126e-4ff4-8dc4-174f0f1cd03d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1317 microversion: 2.1 time: 0.590262 Oct 05 17:46:37.439829 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1597/3390] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:36 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:37.453775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-931ee90b-da5f-4de3-9570-ff26a279e1d7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:37.464196 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-931ee90b-da5f-4de3-9570-ff26a279e1d7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1717 microversion: 2.1 time: 0.370843 Oct 05 17:46:37.483671 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1794/3391] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:37 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1717 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:37.530846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69b36d5a-914e-4300-abd3-491cb167adb1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7779562af0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:37.673932 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69b36d5a-914e-4300-abd3-491cb167adb1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.149555 Oct 05 17:46:37.687028 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1598/3392] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:37 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:38.026409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-19bd974c-1c73-45b0-8eab-90f588351827 req-b760aca4-3514-42f6-a242-e06d0d6941de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989ec240-1506-4643-b1e7-0a849f54db3d", "name": "network-vif-plugged", "status": "completed", "tag": "ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:38.052188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-19bd974c-1c73-45b0-8eab-90f588351827 req-b760aca4-3514-42f6-a242-e06d0d6941de service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:38.052710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-19bd974c-1c73-45b0-8eab-90f588351827 req-b760aca4-3514-42f6-a242-e06d0d6941de service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:38.053152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-19bd974c-1c73-45b0-8eab-90f588351827 req-b760aca4-3514-42f6-a242-e06d0d6941de service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:38.097032 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-19bd974c-1c73-45b0-8eab-90f588351827 req-b760aca4-3514-42f6-a242-e06d0d6941de service nova] Creating event network-vif-plugged:ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8 for instance 989ec240-1506-4643-b1e7-0a849f54db3d on n-h2-835595-3 Oct 05 17:46:38.112566 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-19bd974c-1c73-45b0-8eab-90f588351827 req-b760aca4-3514-42f6-a242-e06d0d6941de service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090900 Oct 05 17:46:38.115482 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1795/3393] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:38.452738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a7bba29f-e43f-4a87-b74d-089a0629dd68 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:38.455034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a7bba29f-e43f-4a87-b74d-089a0629dd68 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:38.471412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7bba29f-e43f-4a87-b74d-089a0629dd68 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:38.472975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7bba29f-e43f-4a87-b74d-089a0629dd68 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:38.475465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7bba29f-e43f-4a87-b74d-089a0629dd68 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:38.478382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7bba29f-e43f-4a87-b74d-089a0629dd68 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:38.479384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7bba29f-e43f-4a87-b74d-089a0629dd68 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:38.481449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7bba29f-e43f-4a87-b74d-089a0629dd68 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:38.515100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b184b7a1-48ec-495d-8b64-889385c93522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:38.516639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b184b7a1-48ec-495d-8b64-889385c93522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:38.536446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b184b7a1-48ec-495d-8b64-889385c93522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:38.539080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b184b7a1-48ec-495d-8b64-889385c93522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:38.540902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b184b7a1-48ec-495d-8b64-889385c93522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:38.542787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b184b7a1-48ec-495d-8b64-889385c93522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:38.544364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b184b7a1-48ec-495d-8b64-889385c93522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:38.545741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b184b7a1-48ec-495d-8b64-889385c93522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:38.811548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b184b7a1-48ec-495d-8b64-889385c93522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:38.830946 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b184b7a1-48ec-495d-8b64-889385c93522 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1707 microversion: 2.1 time: 0.321322 Oct 05 17:46:38.837524 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1796/3394] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:38 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1707 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:38.851332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3a23fdf-b4ff-4504-8291-9e859bccdac2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774653ee0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:38.965400 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3a23fdf-b4ff-4504-8291-9e859bccdac2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.125568 Oct 05 17:46:38.966333 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1797/3395] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:38 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:38.980960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf38c996-42c0-4b6a-ba0f-a1fa58813255 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '.version_select at 0x7f77753e8b80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:38.984775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf38c996-42c0-4b6a-ba0f-a1fa58813255 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:38.985512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf38c996-42c0-4b6a-ba0f-a1fa58813255 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:38.986142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf38c996-42c0-4b6a-ba0f-a1fa58813255 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:39.002760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf38c996-42c0-4b6a-ba0f-a1fa58813255 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.034777 Oct 05 17:46:39.005042 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1798/3396] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:46:38 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:39.031293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4cc182e4-c049-4ecf-b32b-ce202951ab6e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:39.032165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4cc182e4-c049-4ecf-b32b-ce202951ab6e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:39.049109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cc182e4-c049-4ecf-b32b-ce202951ab6e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:39.050781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cc182e4-c049-4ecf-b32b-ce202951ab6e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:39.055183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cc182e4-c049-4ecf-b32b-ce202951ab6e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:39.057531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cc182e4-c049-4ecf-b32b-ce202951ab6e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:39.058832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cc182e4-c049-4ecf-b32b-ce202951ab6e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:39.060007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cc182e4-c049-4ecf-b32b-ce202951ab6e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:39.344964 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4cc182e4-c049-4ecf-b32b-ce202951ab6e tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1858 microversion: 2.1 time: 0.324660 Oct 05 17:46:39.345140 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1799/3397] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:39 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1858 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:39.372591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13d75f77-158e-4e76-82b8-5f99f9f6f888 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:39.373283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13d75f77-158e-4e76-82b8-5f99f9f6f888 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:39.393454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13d75f77-158e-4e76-82b8-5f99f9f6f888 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:39.393970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13d75f77-158e-4e76-82b8-5f99f9f6f888 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:39.399711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13d75f77-158e-4e76-82b8-5f99f9f6f888 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:39.408384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13d75f77-158e-4e76-82b8-5f99f9f6f888 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:39.409508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13d75f77-158e-4e76-82b8-5f99f9f6f888 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:39.410350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13d75f77-158e-4e76-82b8-5f99f9f6f888 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:39.745046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a7bba29f-e43f-4a87-b74d-089a0629dd68 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:39.756860 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a7bba29f-e43f-4a87-b74d-089a0629dd68 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1508 microversion: 2.1 time: 1.311954 Oct 05 17:46:39.760041 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1599/3398] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:38 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1508 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:39.791374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1ba91769-50ec-45b1-be5a-0bd75a7415e9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:39.792614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1ba91769-50ec-45b1-be5a-0bd75a7415e9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:39.806563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ba91769-50ec-45b1-be5a-0bd75a7415e9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:39.807042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ba91769-50ec-45b1-be5a-0bd75a7415e9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:39.807497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ba91769-50ec-45b1-be5a-0bd75a7415e9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:39.808192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ba91769-50ec-45b1-be5a-0bd75a7415e9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:39.808646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ba91769-50ec-45b1-be5a-0bd75a7415e9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:39.811639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ba91769-50ec-45b1-be5a-0bd75a7415e9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:40.085484 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13d75f77-158e-4e76-82b8-5f99f9f6f888 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1858 microversion: 2.1 time: 0.716750 Oct 05 17:46:40.088123 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1800/3399] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:39 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1858 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:40.112186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2cacdf32-fd56-48f7-9197-e7a9d1104a89 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:40.112544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2cacdf32-fd56-48f7-9197-e7a9d1104a89 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:40.136557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cacdf32-fd56-48f7-9197-e7a9d1104a89 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:40.137071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cacdf32-fd56-48f7-9197-e7a9d1104a89 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:40.137525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cacdf32-fd56-48f7-9197-e7a9d1104a89 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:40.141967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cacdf32-fd56-48f7-9197-e7a9d1104a89 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:40.142984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cacdf32-fd56-48f7-9197-e7a9d1104a89 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:40.146135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cacdf32-fd56-48f7-9197-e7a9d1104a89 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:40.218029 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2cacdf32-fd56-48f7-9197-e7a9d1104a89 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/ips" status: 200 len: 146 microversion: 2.1 time: 0.127350 Oct 05 17:46:40.219961 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1801/3400] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:46:40 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/ips => generated 146 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:40.230896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81b60533-9377-47f4-a98a-04d0d2ff0fdb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774d06160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:40.306583 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81b60533-9377-47f4-a98a-04d0d2ff0fdb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.084860 Oct 05 17:46:40.308032 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1802/3401] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:40 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:40.637563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1975261895", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": "none"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:40.670960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1ba91769-50ec-45b1-be5a-0bd75a7415e9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:40.684936 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1ba91769-50ec-45b1-be5a-0bd75a7415e9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1508 microversion: 2.1 time: 0.897245 Oct 05 17:46:40.698382 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1600/3402] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:39 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1508 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:40.701245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-30f58392-3f96-4790-a966-21a06a9098a8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:40.704251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30f58392-3f96-4790-a966-21a06a9098a8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:40.722236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30f58392-3f96-4790-a966-21a06a9098a8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:40.723121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30f58392-3f96-4790-a966-21a06a9098a8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:40.725044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30f58392-3f96-4790-a966-21a06a9098a8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:40.729092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30f58392-3f96-4790-a966-21a06a9098a8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:40.730073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30f58392-3f96-4790-a966-21a06a9098a8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:40.732737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30f58392-3f96-4790-a966-21a06a9098a8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:40.765219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:46:40.765796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:46:40.766708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:46:40.767232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:46:40.767775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:46:40.793468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:40.796798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:40.798202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:40.799353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:40.801617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:40.803065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:40.868514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Getting quotas for project 4dc07cfdb43646c0977702870e3669f3. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:46:40.890360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Getting quotas for user 86e92b168e88454d903867eb176df5f8 and project 4dc07cfdb43646c0977702870e3669f3. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:46:40.891697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-30f58392-3f96-4790-a966-21a06a9098a8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lazy-loading 'services' on Instance uuid 861d19af-3969-47e3-9887-e20a02de197f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:46:40.896905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:40.934868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:46:40.937665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:46:41.014003 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-124fef1c-afb8-4e2c-a57d-412a78a99c88 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.703314 Oct 05 17:46:41.019046 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1803/3403] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:46:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:46:41.029593 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-30f58392-3f96-4790-a966-21a06a9098a8 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments/e020243c-29e0-4831-90f3-e44e31119541" status: 202 len: 0 microversion: 2.1 time: 0.339422 Oct 05 17:46:41.030606 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1601/3404] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 17:46:40 2022] DELETE /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments/e020243c-29e0-4831-90f3-e44e31119541 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:46:41.034167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1765b007-fa38-4251-9561-bc5ab5a01347 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:41.036787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1765b007-fa38-4251-9561-bc5ab5a01347 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:41.048001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-22e60406-3e9d-4eb1-bae7-e202e795c614 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:41.055884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-22e60406-3e9d-4eb1-bae7-e202e795c614 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:41.059033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1765b007-fa38-4251-9561-bc5ab5a01347 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:41.059537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1765b007-fa38-4251-9561-bc5ab5a01347 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:41.059974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1765b007-fa38-4251-9561-bc5ab5a01347 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:41.060702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1765b007-fa38-4251-9561-bc5ab5a01347 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:41.061170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1765b007-fa38-4251-9561-bc5ab5a01347 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:41.061617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1765b007-fa38-4251-9561-bc5ab5a01347 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:41.270072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-22e60406-3e9d-4eb1-bae7-e202e795c614 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:41.279736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-22e60406-3e9d-4eb1-bae7-e202e795c614 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:41.281173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-22e60406-3e9d-4eb1-bae7-e202e795c614 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:41.282428 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-22e60406-3e9d-4eb1-bae7-e202e795c614 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1278 microversion: 2.57 time: 0.249963 Oct 05 17:46:41.286438 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1602/3405] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:41 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1278 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:46:41.289453 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1765b007-fa38-4251-9561-bc5ab5a01347 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "PUT /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1080 microversion: 2.1 time: 0.268893 Oct 05 17:46:41.290091 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1804/3406] 10.222.0.70 () {60 vars in 1256 bytes} [Wed Oct 5 17:46:41 2022] PUT /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1080 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:41.307590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4593613d-9a7f-4f94-9a07-acfe7486f83c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:41.310531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4593613d-9a7f-4f94-9a07-acfe7486f83c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:41.323441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-85ec2375-2eee-493e-a424-d15dc84f3c7a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77754371f0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:41.333122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4593613d-9a7f-4f94-9a07-acfe7486f83c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:41.334893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4593613d-9a7f-4f94-9a07-acfe7486f83c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:41.336714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4593613d-9a7f-4f94-9a07-acfe7486f83c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:41.339515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4593613d-9a7f-4f94-9a07-acfe7486f83c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:41.340650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4593613d-9a7f-4f94-9a07-acfe7486f83c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:41.341323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4593613d-9a7f-4f94-9a07-acfe7486f83c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:41.417497 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4593613d-9a7f-4f94-9a07-acfe7486f83c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.129371 Oct 05 17:46:41.429014 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1603/3407] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:41 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:41.440041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-808e816c-8efb-44e3-806d-1c3cc5fc2c6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:41.441829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-808e816c-8efb-44e3-806d-1c3cc5fc2c6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:41.451206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-85ec2375-2eee-493e-a424-d15dc84f3c7a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.131833 Oct 05 17:46:41.453913 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1805/3408] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:41 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:41.466834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-808e816c-8efb-44e3-806d-1c3cc5fc2c6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:41.469656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-808e816c-8efb-44e3-806d-1c3cc5fc2c6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:41.473769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-808e816c-8efb-44e3-806d-1c3cc5fc2c6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:41.481469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-808e816c-8efb-44e3-806d-1c3cc5fc2c6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:41.483673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-808e816c-8efb-44e3-806d-1c3cc5fc2c6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:41.485351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-808e816c-8efb-44e3-806d-1c3cc5fc2c6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:42.039725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-808e816c-8efb-44e3-806d-1c3cc5fc2c6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:42.055437 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-808e816c-8efb-44e3-806d-1c3cc5fc2c6d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1506 microversion: 2.1 time: 0.621177 Oct 05 17:46:42.056891 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1604/3409] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:41 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1506 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:42.082966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7da0465-c4c7-4b79-ad42-5782ef0e6c93 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:42.083721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b7da0465-c4c7-4b79-ad42-5782ef0e6c93 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:42.108716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7da0465-c4c7-4b79-ad42-5782ef0e6c93 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:42.109377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7da0465-c4c7-4b79-ad42-5782ef0e6c93 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:42.112176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7da0465-c4c7-4b79-ad42-5782ef0e6c93 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:42.118246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7da0465-c4c7-4b79-ad42-5782ef0e6c93 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:42.120211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7da0465-c4c7-4b79-ad42-5782ef0e6c93 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:42.122614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7da0465-c4c7-4b79-ad42-5782ef0e6c93 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:42.196522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:42.331372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:42.332603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:42.345313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:42.346235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:42.346966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:42.347976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:42.353337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:42.354269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:42.659873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:42.672284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:42.676782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:42.681840 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a0c59559-f8c0-4270-97a4-d99ed27cbcb0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1282 microversion: 2.57 time: 0.358742 Oct 05 17:46:42.684733 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1605/3410] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:42 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1282 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:46:42.695389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-419bc433-27e0-4e5a-b83b-6f1e1a4154b9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:42.703623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-419bc433-27e0-4e5a-b83b-6f1e1a4154b9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:42.717497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419bc433-27e0-4e5a-b83b-6f1e1a4154b9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:42.733552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419bc433-27e0-4e5a-b83b-6f1e1a4154b9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:42.737415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419bc433-27e0-4e5a-b83b-6f1e1a4154b9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:42.739714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419bc433-27e0-4e5a-b83b-6f1e1a4154b9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:42.742125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419bc433-27e0-4e5a-b83b-6f1e1a4154b9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:42.747795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419bc433-27e0-4e5a-b83b-6f1e1a4154b9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:42.890088 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-419bc433-27e0-4e5a-b83b-6f1e1a4154b9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.204092 Oct 05 17:46:42.890932 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1606/3411] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:42 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:42.899868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2341276a-da71-47ac-87d6-952682556846 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775a0fdc0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:43.035482 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2341276a-da71-47ac-87d6-952682556846 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.139696 Oct 05 17:46:43.036791 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1607/3412] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:42 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:43.370216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b7da0465-c4c7-4b79-ad42-5782ef0e6c93 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:43.383902 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b7da0465-c4c7-4b79-ad42-5782ef0e6c93 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1506 microversion: 2.1 time: 1.307392 Oct 05 17:46:43.384534 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1806/3413] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:42 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1506 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:43.427252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:43.433679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:43.459287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:43.461160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:43.465172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:43.465935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:43.471325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:43.472801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:43.669708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:46:43.674657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:46:43.675240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:46:43.675665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:46:43.679580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:46:43.713573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:43.714206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:43.731745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:43.735361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:43.736299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:43.740281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:43.746001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:43.746815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:43.943038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:43.983823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:43.985588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:43.989550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:43.993167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:43.993793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:43.998363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:44.138763 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-656d4b44-faba-4532-a4e8-1592489ed27f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "POST /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd/action" status: 202 len: 1112 microversion: 2.1 time: 0.730886 Oct 05 17:46:44.142814 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1608/3414] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:46:43 2022] POST /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd/action => generated 1112 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 05 17:46:44.157836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-93f360b6-44ca-4695-8c8c-847a65f41693 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:44.167176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:44.173737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-93f360b6-44ca-4695-8c8c-847a65f41693 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:44.192264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:44.200490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:44.211869 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e95954dd-1cfa-4f49-84c2-c275c479e2a2 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1330 microversion: 2.57 time: 0.502298 Oct 05 17:46:44.216382 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1807/3415] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:43 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1330 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:46:44.219122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93f360b6-44ca-4695-8c8c-847a65f41693 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:44.223982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26053c10-5094-4857-a032-d5c8dcef8ed5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d8dc943-9823-4d32-9a21-888cd058b50d"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:44.228732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93f360b6-44ca-4695-8c8c-847a65f41693 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:44.231738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93f360b6-44ca-4695-8c8c-847a65f41693 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:44.234543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-26053c10-5094-4857-a032-d5c8dcef8ed5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:44.237013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93f360b6-44ca-4695-8c8c-847a65f41693 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:44.242764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93f360b6-44ca-4695-8c8c-847a65f41693 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:44.243308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93f360b6-44ca-4695-8c8c-847a65f41693 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:44.256237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26053c10-5094-4857-a032-d5c8dcef8ed5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:44.257127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26053c10-5094-4857-a032-d5c8dcef8ed5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:44.258610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26053c10-5094-4857-a032-d5c8dcef8ed5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:44.259593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26053c10-5094-4857-a032-d5c8dcef8ed5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:44.260301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26053c10-5094-4857-a032-d5c8dcef8ed5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:44.260841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26053c10-5094-4857-a032-d5c8dcef8ed5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:44.346364 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-93f360b6-44ca-4695-8c8c-847a65f41693 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202265 Oct 05 17:46:44.350143 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1609/3416] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:44 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:44.355774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ae95f039-975c-4e9b-8940-f0519b2d37d9 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7779562670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:44.497204 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ae95f039-975c-4e9b-8940-f0519b2d37d9 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.145659 Oct 05 17:46:44.499040 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1610/3417] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:44 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:44.512012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1bae21a9-6a2e-4b82-9f96-22214933f968 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:44.517639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1bae21a9-6a2e-4b82-9f96-22214933f968 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:44.550549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bae21a9-6a2e-4b82-9f96-22214933f968 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:44.553329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bae21a9-6a2e-4b82-9f96-22214933f968 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:44.556461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bae21a9-6a2e-4b82-9f96-22214933f968 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:44.559769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bae21a9-6a2e-4b82-9f96-22214933f968 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:44.563134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bae21a9-6a2e-4b82-9f96-22214933f968 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:44.566649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bae21a9-6a2e-4b82-9f96-22214933f968 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:44.971821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1bae21a9-6a2e-4b82-9f96-22214933f968 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:44.980246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1bae21a9-6a2e-4b82-9f96-22214933f968 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.479981 Oct 05 17:46:44.986481 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1611/3418] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:44 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:45.242572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:45.243472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:45.259738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:45.262005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:45.264381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:45.269330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:45.270089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:45.271746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:45.419931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:45.433703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:45.437225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:45.439012 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9099cbf8-28e6-46bf-9178-4a1eb7eec247 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1336 microversion: 2.57 time: 0.201418 Oct 05 17:46:45.442209 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1612/3419] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:45 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1336 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:46:45.452230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4b13dd79-9df2-473e-a8cf-d8b90d1fdae0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:45.464244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b13dd79-9df2-473e-a8cf-d8b90d1fdae0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:45.488265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b13dd79-9df2-473e-a8cf-d8b90d1fdae0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:45.489078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b13dd79-9df2-473e-a8cf-d8b90d1fdae0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:45.489526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b13dd79-9df2-473e-a8cf-d8b90d1fdae0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:45.491724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b13dd79-9df2-473e-a8cf-d8b90d1fdae0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:45.491724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b13dd79-9df2-473e-a8cf-d8b90d1fdae0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:45.491724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b13dd79-9df2-473e-a8cf-d8b90d1fdae0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:45.559546 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4b13dd79-9df2-473e-a8cf-d8b90d1fdae0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115700 Oct 05 17:46:45.564089 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1613/3420] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:45 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:45.582796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b908c92-1bef-4743-af36-e44444543b55 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777952caf0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:45.694692 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b908c92-1bef-4743-af36-e44444543b55 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.129139 Oct 05 17:46:45.695559 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1614/3421] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:45 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:45.795061 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-26053c10-5094-4857-a032-d5c8dcef8ed5 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.576860 Oct 05 17:46:45.802436 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1808/3422] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 17:46:44 2022] POST /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/os-volume_attachments => generated 194 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:46.016986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-127ba237-b759-4c0b-92aa-a670ea944531 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:46.017617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-127ba237-b759-4c0b-92aa-a670ea944531 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:46.037367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:46.048195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-127ba237-b759-4c0b-92aa-a670ea944531 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:46.049062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-127ba237-b759-4c0b-92aa-a670ea944531 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:46.057048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-127ba237-b759-4c0b-92aa-a670ea944531 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:46.058217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-127ba237-b759-4c0b-92aa-a670ea944531 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:46.058916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-127ba237-b759-4c0b-92aa-a670ea944531 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:46.060711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-127ba237-b759-4c0b-92aa-a670ea944531 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:46.476847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:46.477854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:46.520114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:46.522762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:46.524317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:46.527154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-127ba237-b759-4c0b-92aa-a670ea944531 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:46.534027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:46.537389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:46.537861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:46.539188 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-127ba237-b759-4c0b-92aa-a670ea944531 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.531077 Oct 05 17:46:46.540337 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1615/3423] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:46 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:46.574811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7242f0e9-a623-4486-9f44-75b659edc491 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:46.579405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7242f0e9-a623-4486-9f44-75b659edc491 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:46.610107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7242f0e9-a623-4486-9f44-75b659edc491 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:46.610519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7242f0e9-a623-4486-9f44-75b659edc491 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:46.610961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7242f0e9-a623-4486-9f44-75b659edc491 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:46.616877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7242f0e9-a623-4486-9f44-75b659edc491 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:46.618955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7242f0e9-a623-4486-9f44-75b659edc491 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:46.627017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7242f0e9-a623-4486-9f44-75b659edc491 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:46.726112 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7242f0e9-a623-4486-9f44-75b659edc491 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152802 Oct 05 17:46:46.727632 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1616/3424] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:46 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:46.743563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-397a9e7a-4dfc-418d-a2af-7732c7216fe2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7779562670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:46.785615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:46.799710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:46.806759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:46.809903 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ffe83d7-e573-4829-8170-5b49ac631010 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1336 microversion: 2.57 time: 0.340397 Oct 05 17:46:46.810884 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1809/3425] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:46 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1336 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:46:46.842211 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-397a9e7a-4dfc-418d-a2af-7732c7216fe2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.112629 Oct 05 17:46:46.843036 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1617/3426] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:46 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:47.567811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf65624b-61e6-4f10-8061-6a56b4ff4308 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:47.568778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bf65624b-61e6-4f10-8061-6a56b4ff4308 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:47.586416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf65624b-61e6-4f10-8061-6a56b4ff4308 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:47.587602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf65624b-61e6-4f10-8061-6a56b4ff4308 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:47.589481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf65624b-61e6-4f10-8061-6a56b4ff4308 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:47.592064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf65624b-61e6-4f10-8061-6a56b4ff4308 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:47.592810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf65624b-61e6-4f10-8061-6a56b4ff4308 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:47.593463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf65624b-61e6-4f10-8061-6a56b4ff4308 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:47.739932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a374a4b7-5ac7-4032-a82e-24a24f80a57d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:47.742838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a374a4b7-5ac7-4032-a82e-24a24f80a57d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:47.757158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a374a4b7-5ac7-4032-a82e-24a24f80a57d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:47.769551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a374a4b7-5ac7-4032-a82e-24a24f80a57d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:47.770164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a374a4b7-5ac7-4032-a82e-24a24f80a57d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:47.771153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a374a4b7-5ac7-4032-a82e-24a24f80a57d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:47.771734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a374a4b7-5ac7-4032-a82e-24a24f80a57d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:47.772263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a374a4b7-5ac7-4032-a82e-24a24f80a57d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:47.876222 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a374a4b7-5ac7-4032-a82e-24a24f80a57d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140530 Oct 05 17:46:47.884214 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1618/3427] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:47 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:47.902667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:47.903640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:47.926761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:47.937622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:47.949057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:47.953457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:47.953957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:47.954437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:48.151385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bf65624b-61e6-4f10-8061-6a56b4ff4308 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:48.162359 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf65624b-61e6-4f10-8061-6a56b4ff4308 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.599011 Oct 05 17:46:48.181318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1810/3428] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:47 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:48.195304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43817707-d2f2-422c-9d0e-a43d2d1ac953 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777960a160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:48.243615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:48.257888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:48.262770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:48.264665 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e518a3fd-bef4-4a3a-aaeb-30ea7f29d454 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1357 microversion: 2.57 time: 0.383204 Oct 05 17:46:48.267912 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1619/3429] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:47 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1357 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:46:48.273341 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-43817707-d2f2-422c-9d0e-a43d2d1ac953 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.090565 Oct 05 17:46:48.273960 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1811/3430] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:48 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:48.295601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:48.298424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:48.312439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:48.313249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:48.315194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:48.316775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:48.319014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:48.320833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:48.471675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:46:48.472088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:46:48.476625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:46:48.479728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:46:48.480338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:46:48.498486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:48.624434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:48.637652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:48.639673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:48.643100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:48.644194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:48.648098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:48.648706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:48.723520 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a859cf99-f4a0-4545-8b48-a594642ec4b5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "POST /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b/action" status: 202 len: 1138 microversion: 2.57 time: 0.432670 Oct 05 17:46:48.728282 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1620/3431] 10.222.0.70 () {62 vars in 1320 bytes} [Wed Oct 5 17:46:48 2022] POST /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b/action => generated 1138 bytes in 438 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 05 17:46:48.748296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:48.749220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:48.770395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:48.770930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:48.771460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:48.772065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:48.772522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:48.772945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:48.894910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab194d4a-9aea-41d1-847b-ad540576ef6a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:48.899271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ab194d4a-9aea-41d1-847b-ad540576ef6a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:48.937632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab194d4a-9aea-41d1-847b-ad540576ef6a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:48.945206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab194d4a-9aea-41d1-847b-ad540576ef6a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:48.949895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab194d4a-9aea-41d1-847b-ad540576ef6a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:48.951850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:48.954577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab194d4a-9aea-41d1-847b-ad540576ef6a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:48.957849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab194d4a-9aea-41d1-847b-ad540576ef6a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:48.959268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab194d4a-9aea-41d1-847b-ad540576ef6a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:49.030640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:49.030640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:49.030640 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-46986e63-f76d-4253-97d2-8bdc3fa253b0 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.273274 Oct 05 17:46:49.030640 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1812/3432] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:48 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:46:49.064537 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ab194d4a-9aea-41d1-847b-ad540576ef6a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176248 Oct 05 17:46:49.074252 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1621/3433] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:48 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:49.189647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d582d5e7-f3ba-418d-972c-955c120f81ae tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:49.190271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d582d5e7-f3ba-418d-972c-955c120f81ae tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:49.211406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d582d5e7-f3ba-418d-972c-955c120f81ae tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:49.217302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d582d5e7-f3ba-418d-972c-955c120f81ae tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:49.222166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d582d5e7-f3ba-418d-972c-955c120f81ae tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:49.229500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d582d5e7-f3ba-418d-972c-955c120f81ae tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:49.230376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d582d5e7-f3ba-418d-972c-955c120f81ae tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:49.231026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d582d5e7-f3ba-418d-972c-955c120f81ae tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:49.289196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-01c43589-409a-4454-9804-18ff5e36917f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77795623a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:49.360438 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-01c43589-409a-4454-9804-18ff5e36917f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.075521 Oct 05 17:46:49.374474 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1622/3434] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:49 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:49.595547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d582d5e7-f3ba-418d-972c-955c120f81ae tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:49.610846 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d582d5e7-f3ba-418d-972c-955c120f81ae tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.424982 Oct 05 17:46:49.628733 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1813/3435] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:49 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:50.049196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:50.049665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:50.058636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:50.059078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:50.063299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:50.081374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-71b271c3-00b7-4f1e-8ec7-eccb851f0f7d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:50.083303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:50.083807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-71b271c3-00b7-4f1e-8ec7-eccb851f0f7d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:50.084345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:50.085815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:50.099578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71b271c3-00b7-4f1e-8ec7-eccb851f0f7d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:50.100075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71b271c3-00b7-4f1e-8ec7-eccb851f0f7d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:50.100518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71b271c3-00b7-4f1e-8ec7-eccb851f0f7d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:50.101234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71b271c3-00b7-4f1e-8ec7-eccb851f0f7d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:50.101702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71b271c3-00b7-4f1e-8ec7-eccb851f0f7d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:50.102134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71b271c3-00b7-4f1e-8ec7-eccb851f0f7d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:50.200752 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-71b271c3-00b7-4f1e-8ec7-eccb851f0f7d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123457 Oct 05 17:46:50.202728 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1814/3436] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:50 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:50.362722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:50.380912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-98c442c4-8693-4928-bf38-5103a6ee3bf0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7779612790>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:50.413268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:50.415539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:50.417955 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5bd1e71d-e857-4402-b8e7-48c552c2ca42 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.373686 Oct 05 17:46:50.439781 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1623/3437] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:50 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:46:50.482426 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-98c442c4-8693-4928-bf38-5103a6ee3bf0 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.105594 Oct 05 17:46:50.494082 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1815/3438] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:50 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:46:50.635391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b99416e0-7229-4a2b-ae3c-edefcf56503c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:50.640665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b99416e0-7229-4a2b-ae3c-edefcf56503c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:50.669869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b99416e0-7229-4a2b-ae3c-edefcf56503c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:50.671038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b99416e0-7229-4a2b-ae3c-edefcf56503c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:50.679974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b99416e0-7229-4a2b-ae3c-edefcf56503c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:50.681216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b99416e0-7229-4a2b-ae3c-edefcf56503c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:50.688700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b99416e0-7229-4a2b-ae3c-edefcf56503c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:50.692107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b99416e0-7229-4a2b-ae3c-edefcf56503c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:51.212879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:51.215017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:51.221312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ec09ca3-7df8-4b99-bdb6-72a939efae01 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:51.236178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3ec09ca3-7df8-4b99-bdb6-72a939efae01 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:51.238761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=4,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:51.270311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ec09ca3-7df8-4b99-bdb6-72a939efae01 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:51.274740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:51.283295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ec09ca3-7df8-4b99-bdb6-72a939efae01 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:51.283952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ec09ca3-7df8-4b99-bdb6-72a939efae01 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:51.285727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ec09ca3-7df8-4b99-bdb6-72a939efae01 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:51.286384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ec09ca3-7df8-4b99-bdb6-72a939efae01 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:51.286891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ec09ca3-7df8-4b99-bdb6-72a939efae01 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:51.386103 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ec09ca3-7df8-4b99-bdb6-72a939efae01 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.174925 Oct 05 17:46:51.389288 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1816/3439] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:51 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:51.455389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:51.456390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:51.463680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:51.464664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:51.465275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:51.467350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:51.471369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:51.472130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:51.589217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:51.599916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:51.601721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:51.604191 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f0229b9d-875a-4c9a-835c-1e53dcdec65e tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.155675 Oct 05 17:46:51.604964 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1817/3440] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:51 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:46:51.621884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c99b81f-ef93-4625-be17-1c801cc29103 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7779572040>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:51.703669 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c99b81f-ef93-4625-be17-1c801cc29103 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.097140 Oct 05 17:46:51.713154 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1818/3441] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:51 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:52.103181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5936bfe6-7f6b-4294-9b3b-b146fd4574c1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:52.103181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5936bfe6-7f6b-4294-9b3b-b146fd4574c1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:52.108230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5936bfe6-7f6b-4294-9b3b-b146fd4574c1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:52.111781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5936bfe6-7f6b-4294-9b3b-b146fd4574c1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:52.112336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5936bfe6-7f6b-4294-9b3b-b146fd4574c1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:52.113110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5936bfe6-7f6b-4294-9b3b-b146fd4574c1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:52.113582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5936bfe6-7f6b-4294-9b3b-b146fd4574c1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:52.114011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5936bfe6-7f6b-4294-9b3b-b146fd4574c1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:52.176161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5936bfe6-7f6b-4294-9b3b-b146fd4574c1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:46:52.449737 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5936bfe6-7f6b-4294-9b3b-b146fd4574c1 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 204 len: 0 microversion: 2.32 time: 0.734703 Oct 05 17:46:52.458697 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1819/3442] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:46:51 2022] DELETE /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 0 bytes in 744 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:46:52.468739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-792629ab-901a-42fd-be95-438ebcfa93e9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:52.494355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-792629ab-901a-42fd-be95-438ebcfa93e9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:52.535926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-792629ab-901a-42fd-be95-438ebcfa93e9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:52.538518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-792629ab-901a-42fd-be95-438ebcfa93e9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:52.545693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-792629ab-901a-42fd-be95-438ebcfa93e9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:52.546392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-792629ab-901a-42fd-be95-438ebcfa93e9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:52.547505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-792629ab-901a-42fd-be95-438ebcfa93e9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:52.549128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-792629ab-901a-42fd-be95-438ebcfa93e9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:52.587370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b99416e0-7229-4a2b-ae3c-edefcf56503c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:52.607733 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b99416e0-7229-4a2b-ae3c-edefcf56503c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 1.976837 Oct 05 17:46:52.616453 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1624/3443] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:50 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 1986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:52.651889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:52.652514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:52.674325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:52.674826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:52.675266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:52.675984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:52.676437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:52.676859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:52.704658 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-792629ab-901a-42fd-be95-438ebcfa93e9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.236826 Oct 05 17:46:52.712134 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1820/3444] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:52 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:52.734914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:52.735563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:52.763812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:52.766908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:52.767634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:52.774833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:52.775658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:52.776512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:52.977024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:52.986469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:52.991923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:52.995396 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2eee33f1-c4ef-4248-840c-2bcbba1f7daf tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.281262 Oct 05 17:46:53.013797 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1821/3445] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:52 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:46:53.023209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-71866f0e-204a-460e-be59-a6c9e91b10fa tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774d12820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:53.084653 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-71866f0e-204a-460e-be59-a6c9e91b10fa tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.069001 Oct 05 17:46:53.085907 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1822/3446] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:53 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:53.211843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:53.222820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:53.226085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:53.227692 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8c611841-6b41-47e7-a8bd-9369a6e33a11 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 2953 microversion: 2.32 time: 0.596192 Oct 05 17:46:53.228558 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1625/3447] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:52 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 2953 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:46:53.645694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-542973a4-2d2f-4d09-853f-94836d596177 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:53.646313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-542973a4-2d2f-4d09-853f-94836d596177 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:53.670934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-542973a4-2d2f-4d09-853f-94836d596177 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:53.672553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-542973a4-2d2f-4d09-853f-94836d596177 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:53.672998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-542973a4-2d2f-4d09-853f-94836d596177 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:53.673737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-542973a4-2d2f-4d09-853f-94836d596177 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:53.674198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-542973a4-2d2f-4d09-853f-94836d596177 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:53.674670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-542973a4-2d2f-4d09-853f-94836d596177 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:53.720284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f723587a-4bbe-4e22-ac52-44a4c5e95d75 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:53.722747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f723587a-4bbe-4e22-ac52-44a4c5e95d75 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:53.730128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f723587a-4bbe-4e22-ac52-44a4c5e95d75 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:53.734933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f723587a-4bbe-4e22-ac52-44a4c5e95d75 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:53.735384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f723587a-4bbe-4e22-ac52-44a4c5e95d75 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:53.736136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f723587a-4bbe-4e22-ac52-44a4c5e95d75 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:53.736595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f723587a-4bbe-4e22-ac52-44a4c5e95d75 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:53.737029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f723587a-4bbe-4e22-ac52-44a4c5e95d75 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:53.798412 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f723587a-4bbe-4e22-ac52-44a4c5e95d75 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082059 Oct 05 17:46:53.799010 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1626/3448] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:53 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:46:54.020274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-542973a4-2d2f-4d09-853f-94836d596177 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:54.029039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:54.029931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:54.037106 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-542973a4-2d2f-4d09-853f-94836d596177 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.396454 Oct 05 17:46:54.040093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:54.041056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:54.041668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:54.047134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:54.047777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:54.048363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:54.057982 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1823/3449] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:53 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:54.101966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-717de476-4970-45fd-bffb-8f496b736d2b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7779612a60>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:54.170247 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-717de476-4970-45fd-bffb-8f496b736d2b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.073578 Oct 05 17:46:54.171756 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1824/3450] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:54 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:54.259389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:54.260195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:54.275904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:54.276505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:54.276968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:54.277708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:54.280490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:54.280948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:54.282557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:54.295171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:54.296700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:54.301768 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b78461f-cc3b-42ec-b9b9-80a76f19bcc5 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.276567 Oct 05 17:46:54.304772 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1627/3451] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:54 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:46:54.338186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:46:54.747943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-598416787", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:46:54.801920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:54.821928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:54.824290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:54.828267 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c7d3a6ab-b2e6-4ccf-b5ff-43edf21312ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 2953 microversion: 2.32 time: 0.574908 Oct 05 17:46:54.832712 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1825/3452] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:54 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 2953 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:46:54.847785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-95a18a46-ee1f-44ef-b169-ca14064cea53 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:54.854036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-95a18a46-ee1f-44ef-b169-ca14064cea53 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:54.870218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95a18a46-ee1f-44ef-b169-ca14064cea53 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:54.873436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95a18a46-ee1f-44ef-b169-ca14064cea53 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:54.874459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95a18a46-ee1f-44ef-b169-ca14064cea53 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:54.877277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95a18a46-ee1f-44ef-b169-ca14064cea53 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:54.880453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95a18a46-ee1f-44ef-b169-ca14064cea53 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:54.881663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95a18a46-ee1f-44ef-b169-ca14064cea53 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:54.885451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] validate_networks() for [('a318cf17-4970-4411-8821-7ec2ee9e9e79', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:46:55.003120 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-95a18a46-ee1f-44ef-b169-ca14064cea53 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.168686 Oct 05 17:46:55.010623 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1826/3453] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:46:54 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f/os-volume_attachments => generated 25 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:46:55.066401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4f2a683-affd-4261-975f-165dae80cf90 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:55.067270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b4f2a683-affd-4261-975f-165dae80cf90 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:55.076809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f2a683-affd-4261-975f-165dae80cf90 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:55.078552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f2a683-affd-4261-975f-165dae80cf90 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:55.079712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f2a683-affd-4261-975f-165dae80cf90 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:55.098323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f2a683-affd-4261-975f-165dae80cf90 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:55.098323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f2a683-affd-4261-975f-165dae80cf90 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:55.098323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f2a683-affd-4261-975f-165dae80cf90 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:55.435816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4f2a683-affd-4261-975f-165dae80cf90 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:55.445761 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b4f2a683-affd-4261-975f-165dae80cf90 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.384890 Oct 05 17:46:55.467850 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1827/3454] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:55 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:55.482161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bdbad297-5e70-4103-b92e-5ee831363d39 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775127310>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:55.574314 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bdbad297-5e70-4103-b92e-5ee831363d39 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1452 microversion: 2.1 time: 0.103610 Oct 05 17:46:55.574314 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1828/3455] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:55 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:55.578974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:55.579671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:55.595227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:55.595823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:55.596880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:55.597674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:55.597811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:55.598218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:55.843002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:55.857755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:55.866424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:55.869439 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3910e260-e765-4ce0-bc86-4ccf1e9a0392 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.294944 Oct 05 17:46:55.872475 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1829/3456] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:55 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:46:55.891542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:55.892546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:55.904167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:55.906762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:55.907704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:55.908670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:55.909618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:55.911266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:56.488425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:46:56.488922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:46:56.489667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:46:56.490813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:46:56.491378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:46:56.508532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:56.509469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:56.510681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:56.512041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:56.513934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:56.514600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:56.564037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Getting quotas for project caf452f31a594c888e1703356c637a91. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:46:56.576263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Getting quotas for user 50b3fb554dd64e41bea1109e697b0799 and project caf452f31a594c888e1703356c637a91. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:46:56.608196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:46:56.614934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:46:56.739209 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-277e7ee6-d789-4558-aabf-ea9b5e9e7b4c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.102417 Oct 05 17:46:56.739971 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1628/3457] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:46:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:46:56.744981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cafa58ff-a30f-42db-a02d-0f1b17dde14c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:56.745596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cafa58ff-a30f-42db-a02d-0f1b17dde14c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:56.788560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafa58ff-a30f-42db-a02d-0f1b17dde14c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:56.807789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafa58ff-a30f-42db-a02d-0f1b17dde14c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:56.808599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafa58ff-a30f-42db-a02d-0f1b17dde14c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:56.815307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafa58ff-a30f-42db-a02d-0f1b17dde14c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:56.816064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafa58ff-a30f-42db-a02d-0f1b17dde14c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:56.816710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafa58ff-a30f-42db-a02d-0f1b17dde14c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:56.889458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:56.909998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:56.922660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:56.936319 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-749b0856-5515-4912-806d-43c3738d7bd9 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 2953 microversion: 2.32 time: 1.061718 Oct 05 17:46:56.942987 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1830/3458] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:55 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 2953 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:46:56.968524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-67149ece-3304-4edb-8dfd-1cb5600e075b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7775127310>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:57.562656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cafa58ff-a30f-42db-a02d-0f1b17dde14c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:57.577208 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cafa58ff-a30f-42db-a02d-0f1b17dde14c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.835786 Oct 05 17:46:57.582515 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1629/3459] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:56 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:57.595771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7aa161b3-1778-4381-921f-d0a5d802c98d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:57.596847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7aa161b3-1778-4381-921f-d0a5d802c98d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:57.920379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7aa161b3-1778-4381-921f-d0a5d802c98d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:57.971062 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7aa161b3-1778-4381-921f-d0a5d802c98d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1221 microversion: 2.1 time: 0.381885 Oct 05 17:46:57.971978 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1630/3460] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:46:57 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1221 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:46:57.995745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:58.000963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:58.013991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:58.020161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:58.021389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:58.022394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:58.023041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:58.023812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:58.402516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:58.413365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:58.430547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:46:58.431805 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e517a65b-d592-417c-9bd7-82e220be5dbd tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.456389 Oct 05 17:46:58.441509 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1631/3461] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:57 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:46:58.458031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:46:58.461709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:46:58.484416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:58.491089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:58.492394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:46:58.494135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:46:58.496835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:46:58.497817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:00.063237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:00.099477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:00.112606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:00.120437 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-660c2172-c45b-4c30-9227-737a1fadf665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 2932 microversion: 2.32 time: 1.677366 Oct 05 17:47:00.125243 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1632/3462] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:46:58 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 2932 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:00.159118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1552275574", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:04.096773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] validate_networks() for [('a318cf17-4970-4411-8821-7ec2ee9e9e79', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:47:04.102829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-67149ece-3304-4edb-8dfd-1cb5600e075b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1461 microversion: 2.1 time: 7.158260 Oct 05 17:47:04.107707 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1831/3463] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:46:56 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1461 bytes in 7164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:04.123175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-442b08fc-dc2e-41d0-adb5-38b682648024 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:04.136640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-442b08fc-dc2e-41d0-adb5-38b682648024 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:04.161356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-442b08fc-dc2e-41d0-adb5-38b682648024 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:04.164959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-442b08fc-dc2e-41d0-adb5-38b682648024 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:04.165704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-442b08fc-dc2e-41d0-adb5-38b682648024 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:04.168513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-442b08fc-dc2e-41d0-adb5-38b682648024 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:04.171410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-442b08fc-dc2e-41d0-adb5-38b682648024 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:04.173096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-442b08fc-dc2e-41d0-adb5-38b682648024 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:04.467453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-442b08fc-dc2e-41d0-adb5-38b682648024 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:04.477165 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-442b08fc-dc2e-41d0-adb5-38b682648024 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.367899 Oct 05 17:47:04.478898 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1832/3464] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:04 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:04.483862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:04.484619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:04.491500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:04.492368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:04.493490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:04.494555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:04.495240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:04.495895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:04.647085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:04.674565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:04.677206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:04.679518 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-977dafb3-aa20-485c-9f78-2670baab16fe tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.198632 Oct 05 17:47:04.680982 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1833/3465] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:04 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:04.687153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-68af157e-657a-4d0e-ba95-dec0ef7e1081 req-0b64c50b-9f0a-495c-9862-8358e016d5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-unplugged", "status": "completed", "tag": "58505811-eb6b-4527-9362-13751f69bc6e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:04.700659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-68af157e-657a-4d0e-ba95-dec0ef7e1081 req-0b64c50b-9f0a-495c-9862-8358e016d5d3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:04.701554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-68af157e-657a-4d0e-ba95-dec0ef7e1081 req-0b64c50b-9f0a-495c-9862-8358e016d5d3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:04.702192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-68af157e-657a-4d0e-ba95-dec0ef7e1081 req-0b64c50b-9f0a-495c-9862-8358e016d5d3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:04.717439 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-68af157e-657a-4d0e-ba95-dec0ef7e1081 req-0b64c50b-9f0a-495c-9862-8358e016d5d3 service nova] Creating event network-vif-unplugged:58505811-eb6b-4527-9362-13751f69bc6e for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:47:04.727751 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-68af157e-657a-4d0e-ba95-dec0ef7e1081 req-0b64c50b-9f0a-495c-9862-8358e016d5d3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045207 Oct 05 17:47:04.728789 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1834/3466] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:04.736087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:04.737326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:04.745660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:04.746935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:04.747602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:04.748797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:04.749730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:04.750398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:05.108276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:47:05.109556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:47:05.111515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:47:05.112820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:47:05.113741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:47:05.133937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:05.135318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:05.136078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:05.136934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:05.137770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:05.138318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:05.160450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:05.161385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Getting quotas for project caf452f31a594c888e1703356c637a91. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:05.167585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Getting quotas for user 50b3fb554dd64e41bea1109e697b0799 and project caf452f31a594c888e1703356c637a91. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:05.175014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:05.176517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:05.177908 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a7426eb2-c25e-41da-98ef-e595f4f1192a tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 2723 microversion: 2.32 time: 0.447688 Oct 05 17:47:05.181875 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1835/3467] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:04 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 2723 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:05.187638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-aceaee4f-ab62-40e6-bf4c-729925aa0e8b req-403079e6-0274-41a3-8103-f1450a11525e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-deleted", "tag": "dd8de17b-2b96-4926-ad70-b1417782ae0f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:05.199551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:47:05.203731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:47:05.217919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aceaee4f-ab62-40e6-bf4c-729925aa0e8b req-403079e6-0274-41a3-8103-f1450a11525e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:05.219126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aceaee4f-ab62-40e6-bf4c-729925aa0e8b req-403079e6-0274-41a3-8103-f1450a11525e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:05.220394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aceaee4f-ab62-40e6-bf4c-729925aa0e8b req-403079e6-0274-41a3-8103-f1450a11525e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:05.248939 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-aceaee4f-ab62-40e6-bf4c-729925aa0e8b req-403079e6-0274-41a3-8103-f1450a11525e service nova] Creating event network-vif-deleted:dd8de17b-2b96-4926-ad70-b1417782ae0f for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:47:05.254421 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-aceaee4f-ab62-40e6-bf4c-729925aa0e8b req-403079e6-0274-41a3-8103-f1450a11525e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070762 Oct 05 17:47:05.259821 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1836/3468] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:05.265576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a621a741-3718-45c2-a109-2386b77e3e33 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77747cc8b0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:05.320863 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-92551d83-53f7-4886-8a47-68091030530a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.189459 Oct 05 17:47:05.321846 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1633/3469] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:47:00 2022] POST /compute/v2.1/servers => generated 383 bytes in 5194 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:47:05.334582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a841a19b-44c5-4a40-8aca-4ea4e7b8e9e9 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:05.335737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a841a19b-44c5-4a40-8aca-4ea4e7b8e9e9 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:05.380485 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a621a741-3718-45c2-a109-2386b77e3e33 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 200 len: 1461 microversion: 2.1 time: 0.118989 Oct 05 17:47:05.381061 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1837/3470] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:47:05 2022] GET /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 1461 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:05.411979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b52b3c2-08a8-4840-b555-0ae89e985d92 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:05.412915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1b52b3c2-08a8-4840-b555-0ae89e985d92 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:05.420769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b52b3c2-08a8-4840-b555-0ae89e985d92 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:05.425461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b52b3c2-08a8-4840-b555-0ae89e985d92 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:05.426161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b52b3c2-08a8-4840-b555-0ae89e985d92 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:05.427189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b52b3c2-08a8-4840-b555-0ae89e985d92 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:05.427881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b52b3c2-08a8-4840-b555-0ae89e985d92 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:05.428504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b52b3c2-08a8-4840-b555-0ae89e985d92 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:05.456806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a841a19b-44c5-4a40-8aca-4ea4e7b8e9e9 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:05.468932 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a841a19b-44c5-4a40-8aca-4ea4e7b8e9e9 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1222 microversion: 2.1 time: 0.138138 Oct 05 17:47:05.491611 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1634/3471] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:05 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1222 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:05.622612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7380be77-87ca-4675-8a0e-676ce75d66b8 req-01a4b8eb-1ed3-44e8-8f65-00b6ed798127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d037b8c8-e287-459a-a4b4-ac53b463337d", "tag": "2a95d002-7741-4d80-9a3d-939f6d945694"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:05.644634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7380be77-87ca-4675-8a0e-676ce75d66b8 req-01a4b8eb-1ed3-44e8-8f65-00b6ed798127 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:05.645423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7380be77-87ca-4675-8a0e-676ce75d66b8 req-01a4b8eb-1ed3-44e8-8f65-00b6ed798127 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:05.646416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7380be77-87ca-4675-8a0e-676ce75d66b8 req-01a4b8eb-1ed3-44e8-8f65-00b6ed798127 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:05.674488 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7380be77-87ca-4675-8a0e-676ce75d66b8 req-01a4b8eb-1ed3-44e8-8f65-00b6ed798127 service nova] Creating event network-changed:2a95d002-7741-4d80-9a3d-939f6d945694 for instance d037b8c8-e287-459a-a4b4-ac53b463337d on n-h2-835595-3 Oct 05 17:47:05.682168 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7380be77-87ca-4675-8a0e-676ce75d66b8 req-01a4b8eb-1ed3-44e8-8f65-00b6ed798127 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188484 Oct 05 17:47:05.685245 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1635/3472] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:05.695056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9e3e51bc-9d1e-40d2-9d59-19c1b93af5c4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:05.697630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9e3e51bc-9d1e-40d2-9d59-19c1b93af5c4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:05.706662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3e51bc-9d1e-40d2-9d59-19c1b93af5c4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:05.707581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3e51bc-9d1e-40d2-9d59-19c1b93af5c4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:05.708542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3e51bc-9d1e-40d2-9d59-19c1b93af5c4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:05.709927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3e51bc-9d1e-40d2-9d59-19c1b93af5c4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:05.713904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3e51bc-9d1e-40d2-9d59-19c1b93af5c4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:05.714630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3e51bc-9d1e-40d2-9d59-19c1b93af5c4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:05.905308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b52b3c2-08a8-4840-b555-0ae89e985d92 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:05.932267 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b52b3c2-08a8-4840-b555-0ae89e985d92 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d" status: 200 len: 1467 microversion: 2.1 time: 0.526773 Oct 05 17:47:05.933083 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1838/3473] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:05 2022] GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d => generated 1467 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:05.946086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:05.947092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:05.958041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:05.958708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:05.959231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:05.960413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:05.961349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:05.962481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:06.049862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9e3e51bc-9d1e-40d2-9d59-19c1b93af5c4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:06.064193 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9e3e51bc-9d1e-40d2-9d59-19c1b93af5c4 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.376268 Oct 05 17:47:06.065179 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1636/3474] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:05 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:06.094669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b3e432f-e6f8-41c9-be72-345dc4973f36 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77749ed9d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:06.161489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:06.181076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:06.185677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:06.188939 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f4395dca-5d24-4ced-a996-59200cf8787d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.250329 Oct 05 17:47:06.190674 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1839/3475] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:05 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:06.217776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:06.218819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:06.236238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:06.237743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:06.239489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:06.242081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:06.244016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:06.247060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:06.360308 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b3e432f-e6f8-41c9-be72-345dc4973f36 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images?changes-since=2022-10-05T17%3A44%3A54Z" status: 200 len: 2375 microversion: 2.1 time: 0.288052 Oct 05 17:47:06.361917 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1637/3476] 10.222.0.70 () {58 vars in 1199 bytes} [Wed Oct 5 17:47:06 2022] GET /compute/v2.1/images?changes-since=2022-10-05T17%3A44%3A54Z => generated 2375 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:06.383927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6ba404c-7bbb-49b7-a4ed-df171fdf128a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77795fb040>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:06.512760 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c6ba404c-7bbb-49b7-a4ed-df171fdf128a tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-546491448" status: 200 len: 484 microversion: 2.1 time: 0.138193 Oct 05 17:47:06.513604 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1638/3477] 10.222.0.70 () {58 vars in 1229 bytes} [Wed Oct 5 17:47:06 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-546491448 => generated 484 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:06.514310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:06.520382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80aa9625-fedc-4ee9-8567-98fcf96e7fca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:06.521271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-80aa9625-fedc-4ee9-8567-98fcf96e7fca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:06.533082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80aa9625-fedc-4ee9-8567-98fcf96e7fca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:06.533875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:06.534499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80aa9625-fedc-4ee9-8567-98fcf96e7fca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:06.535171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80aa9625-fedc-4ee9-8567-98fcf96e7fca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:06.538323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80aa9625-fedc-4ee9-8567-98fcf96e7fca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:06.539160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80aa9625-fedc-4ee9-8567-98fcf96e7fca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:06.539778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80aa9625-fedc-4ee9-8567-98fcf96e7fca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:06.539912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:06.541486 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd8e8b3a-f1dc-4a65-b929-5a2814bc15f0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 2542 microversion: 2.32 time: 0.328043 Oct 05 17:47:06.542525 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1840/3478] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:06 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 2542 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:06.553674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec47a7c3-eb6e-4994-b520-9329b9b61100 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774d12dc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:06.672465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-80aa9625-fedc-4ee9-8567-98fcf96e7fca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:06.693637 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-80aa9625-fedc-4ee9-8567-98fcf96e7fca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1218 microversion: 2.1 time: 0.178132 Oct 05 17:47:06.696243 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1639/3479] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:06 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:06.727816 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ec47a7c3-eb6e-4994-b520-9329b9b61100 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images?server=989ec240-1506-4643-b1e7-0a849f54db3d" status: 200 len: 957 microversion: 2.1 time: 0.181297 Oct 05 17:47:06.728855 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1841/3480] 10.222.0.70 () {58 vars in 1209 bytes} [Wed Oct 5 17:47:06 2022] GET /compute/v2.1/images?server=989ec240-1506-4643-b1e7-0a849f54db3d => generated 957 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:06.742676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e61954e5-85f1-48cf-a015-3fad955fdbbf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777966ae50>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:06.774426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-16e0e5a6-5347-4157-9cdf-2a1e374e227f req-a9c5a826-00df-4e3e-b743-9409fa78cb1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-unplugged", "status": "completed", "tag": "d9b12b5b-6e9d-4c88-9bcd-822551970a31"}, {"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-unplugged", "status": "completed", "tag": "4d785381-e8e2-468c-b43f-da00a289173d"}, {"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-unplugged", "status": "completed", "tag": "dd8de17b-2b96-4926-ad70-b1417782ae0f"}, {"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-unplugged", "status": "completed", "tag": "8bab3a7f-8718-4960-8440-c090413703a8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:06.812030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-16e0e5a6-5347-4157-9cdf-2a1e374e227f req-a9c5a826-00df-4e3e-b743-9409fa78cb1e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:06.823222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-16e0e5a6-5347-4157-9cdf-2a1e374e227f req-a9c5a826-00df-4e3e-b743-9409fa78cb1e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:06.823703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-16e0e5a6-5347-4157-9cdf-2a1e374e227f req-a9c5a826-00df-4e3e-b743-9409fa78cb1e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:06.848762 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e61954e5-85f1-48cf-a015-3fad955fdbbf tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2Fd3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 484 microversion: 2.1 time: 0.111371 Oct 05 17:47:06.849425 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1640/3481] 10.222.0.70 () {58 vars in 1317 bytes} [Wed Oct 5 17:47:06 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2Fd3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 484 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:06.864050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7592e53b-08f0-44a7-bf5b-f045288b2507 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77795d7550>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:06.868258 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-16e0e5a6-5347-4157-9cdf-2a1e374e227f req-a9c5a826-00df-4e3e-b743-9409fa78cb1e service nova] Creating event network-vif-unplugged:d9b12b5b-6e9d-4c88-9bcd-822551970a31 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:47:06.868848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-16e0e5a6-5347-4157-9cdf-2a1e374e227f req-a9c5a826-00df-4e3e-b743-9409fa78cb1e service nova] Creating event network-vif-unplugged:4d785381-e8e2-468c-b43f-da00a289173d for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:47:06.869472 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-16e0e5a6-5347-4157-9cdf-2a1e374e227f req-a9c5a826-00df-4e3e-b743-9409fa78cb1e service nova] Creating event network-vif-unplugged:dd8de17b-2b96-4926-ad70-b1417782ae0f for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:47:06.870083 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-16e0e5a6-5347-4157-9cdf-2a1e374e227f req-a9c5a826-00df-4e3e-b743-9409fa78cb1e service nova] Creating event network-vif-unplugged:8bab3a7f-8718-4960-8440-c090413703a8 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:47:06.896652 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-16e0e5a6-5347-4157-9cdf-2a1e374e227f req-a9c5a826-00df-4e3e-b743-9409fa78cb1e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.132154 Oct 05 17:47:06.913881 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1842/3482] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:47:06.970056 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7592e53b-08f0-44a7-bf5b-f045288b2507 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2Fd3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 484 microversion: 2.1 time: 0.112066 Oct 05 17:47:06.979187 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1641/3483] 10.222.0.70 () {58 vars in 1303 bytes} [Wed Oct 5 17:47:06 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2Fd3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 484 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:06.985994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b64128b8-c0bb-48b9-b74d-726ef0a5926b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777964bb80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:07.088165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80900838-702e-4fd1-a96e-7a8537d9f24c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:07.089061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-80900838-702e-4fd1-a96e-7a8537d9f24c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:07.101069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80900838-702e-4fd1-a96e-7a8537d9f24c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:07.101589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80900838-702e-4fd1-a96e-7a8537d9f24c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:07.102066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80900838-702e-4fd1-a96e-7a8537d9f24c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:07.102867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80900838-702e-4fd1-a96e-7a8537d9f24c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:07.103545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80900838-702e-4fd1-a96e-7a8537d9f24c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:07.104145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80900838-702e-4fd1-a96e-7a8537d9f24c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:07.163977 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b64128b8-c0bb-48b9-b74d-726ef0a5926b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.183084 Oct 05 17:47:07.165984 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1843/3484] 10.222.0.70 () {58 vars in 1149 bytes} [Wed Oct 5 17:47:06 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:07.186973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-400466a6-67a4-4734-80bf-8cc52a4af91d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77753e8b80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:07.285908 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-400466a6-67a4-4734-80bf-8cc52a4af91d tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.106875 Oct 05 17:47:07.287415 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1844/3485] 10.222.0.70 () {58 vars in 1149 bytes} [Wed Oct 5 17:47:07 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:07.297411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:07.298732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:07.308756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:07.309740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:07.310628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:07.311701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:07.312499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:07.313325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:07.399289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-80900838-702e-4fd1-a96e-7a8537d9f24c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:07.420659 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-80900838-702e-4fd1-a96e-7a8537d9f24c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.336293 Oct 05 17:47:07.437861 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1642/3486] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:07 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:07.437861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb0ba783-4dd1-440e-a468-1475c3dd4138 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77795d7790>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:07.447484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:07.481489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:07.490570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:07.493997 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-767dd3e5-dcd6-46f4-9055-c2bb3b9add84 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.204722 Oct 05 17:47:07.494905 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1845/3487] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:07 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:07.505533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-88b16b2f-f07d-4f26-bb66-44ddda8d5cba req-79bc759b-300e-4061-ba8e-2f5d934a5d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-deleted", "tag": "8bab3a7f-8718-4960-8440-c090413703a8"}, {"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-deleted", "tag": "d9b12b5b-6e9d-4c88-9bcd-822551970a31"}, {"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-deleted", "tag": "58505811-eb6b-4527-9362-13751f69bc6e"}, {"server_uuid": "5362ba2a-b905-484f-a7cf-d0c8757475ce", "name": "network-vif-deleted", "tag": "4d785381-e8e2-468c-b43f-da00a289173d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:07.546789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88b16b2f-f07d-4f26-bb66-44ddda8d5cba req-79bc759b-300e-4061-ba8e-2f5d934a5d4c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:07.547178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88b16b2f-f07d-4f26-bb66-44ddda8d5cba req-79bc759b-300e-4061-ba8e-2f5d934a5d4c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:07.547613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88b16b2f-f07d-4f26-bb66-44ddda8d5cba req-79bc759b-300e-4061-ba8e-2f5d934a5d4c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:07.573496 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-88b16b2f-f07d-4f26-bb66-44ddda8d5cba req-79bc759b-300e-4061-ba8e-2f5d934a5d4c service nova] Creating event network-vif-deleted:8bab3a7f-8718-4960-8440-c090413703a8 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:47:07.574034 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-88b16b2f-f07d-4f26-bb66-44ddda8d5cba req-79bc759b-300e-4061-ba8e-2f5d934a5d4c service nova] Creating event network-vif-deleted:d9b12b5b-6e9d-4c88-9bcd-822551970a31 for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:47:07.575566 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-88b16b2f-f07d-4f26-bb66-44ddda8d5cba req-79bc759b-300e-4061-ba8e-2f5d934a5d4c service nova] Creating event network-vif-deleted:58505811-eb6b-4527-9362-13751f69bc6e for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:47:07.576984 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-88b16b2f-f07d-4f26-bb66-44ddda8d5cba req-79bc759b-300e-4061-ba8e-2f5d934a5d4c service nova] Creating event network-vif-deleted:4d785381-e8e2-468c-b43f-da00a289173d for instance 5362ba2a-b905-484f-a7cf-d0c8757475ce on n-h2-835595-3 Oct 05 17:47:07.588915 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-88b16b2f-f07d-4f26-bb66-44ddda8d5cba req-79bc759b-300e-4061-ba8e-2f5d934a5d4c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.092443 Oct 05 17:47:07.590356 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1846/3488] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:07.606445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:07.607154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:07.617294 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb0ba783-4dd1-440e-a468-1475c3dd4138 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.193342 Oct 05 17:47:07.617294 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1643/3489] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:47:07 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:07.637210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:07.637770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:07.638218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:07.638987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:07.639461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:07.639890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:07.645124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d28895a5-5c66-4906-aa8b-66e31bf0c487 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77795fb8b0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:07.832795 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d28895a5-5c66-4906-aa8b-66e31bf0c487 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/detail?changes-since=2022-10-05T17%3A44%3A50Z" status: 200 len: 6327 microversion: 2.1 time: 0.205490 Oct 05 17:47:07.834062 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1644/3490] 10.222.0.70 () {58 vars in 1220 bytes} [Wed Oct 5 17:47:07 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-05T17%3A44%3A50Z => generated 6327 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:07.849158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-456c7ea3-0c2c-44e5-9eb3-80ef5b18a809 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:07.850271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-456c7ea3-0c2c-44e5-9eb3-80ef5b18a809 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:07.867148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:07.869139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-456c7ea3-0c2c-44e5-9eb3-80ef5b18a809 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:07.869921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-456c7ea3-0c2c-44e5-9eb3-80ef5b18a809 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:07.872409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-456c7ea3-0c2c-44e5-9eb3-80ef5b18a809 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:07.873685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-456c7ea3-0c2c-44e5-9eb3-80ef5b18a809 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:07.876079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-456c7ea3-0c2c-44e5-9eb3-80ef5b18a809 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:07.876841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-456c7ea3-0c2c-44e5-9eb3-80ef5b18a809 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:07.879753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:07.890360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:07.898072 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f7522f3d-09a9-4b81-b502-d229d3f4b1c2 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.298081 Oct 05 17:47:07.899370 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1847/3491] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:07 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:07.905730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-89ae167e-78f0-456b-8b00-f30189ec35dc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774d12820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:07.984044 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-89ae167e-78f0-456b-8b00-f30189ec35dc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-546491448" status: 200 len: 664 microversion: 2.1 time: 0.082644 Oct 05 17:47:07.990646 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1848/3492] 10.222.0.70 () {58 vars in 1250 bytes} [Wed Oct 5 17:47:07 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-546491448 => generated 664 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:08.018704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aa6d8851-1129-4ea9-9405-26f5c324353e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77747ccc10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:08.046467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-456c7ea3-0c2c-44e5-9eb3-80ef5b18a809 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:08.061036 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-456c7ea3-0c2c-44e5-9eb3-80ef5b18a809 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1280 microversion: 2.1 time: 0.225507 Oct 05 17:47:08.064115 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1645/3493] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:07 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1280 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:08.143838 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aa6d8851-1129-4ea9-9405-26f5c324353e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2Fd3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1464 microversion: 2.1 time: 0.140532 Oct 05 17:47:08.154552 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1849/3494] 10.222.0.70 () {58 vars in 1338 bytes} [Wed Oct 5 17:47:07 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fv2.1%2Fservers%2Fd3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1464 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:08.166261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ff8879d7-0425-403b-b778-7b851b09578f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77795afaf0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:08.260224 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ff8879d7-0425-403b-b778-7b851b09578f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2Fd3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1464 microversion: 2.1 time: 0.100244 Oct 05 17:47:08.261220 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1646/3495] 10.222.0.70 () {58 vars in 1324 bytes} [Wed Oct 5 17:47:08 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.70%2Fcompute%2Fservers%2Fd3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1464 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:08.283611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-caf2ca4e-3a8a-47cc-8e1e-94d75a14e8fa tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77796211f0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:08.453362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8b4bcd6-e4f2-468b-a74f-e9c428f56bf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:08.455140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8b4bcd6-e4f2-468b-a74f-e9c428f56bf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:08.471965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b4bcd6-e4f2-468b-a74f-e9c428f56bf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:08.473145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b4bcd6-e4f2-468b-a74f-e9c428f56bf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:08.474992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b4bcd6-e4f2-468b-a74f-e9c428f56bf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:08.478659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b4bcd6-e4f2-468b-a74f-e9c428f56bf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:08.480459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b4bcd6-e4f2-468b-a74f-e9c428f56bf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:08.483433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b4bcd6-e4f2-468b-a74f-e9c428f56bf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:08.489982 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-caf2ca4e-3a8a-47cc-8e1e-94d75a14e8fa tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.209354 Oct 05 17:47:08.493657 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1850/3496] 10.222.0.70 () {58 vars in 1170 bytes} [Wed Oct 5 17:47:08 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:08.514513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-08a4d534-419a-42c4-bd9d-3646cd27e647 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77747cc310>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:08.633838 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-08a4d534-419a-42c4-bd9d-3646cd27e647 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.123858 Oct 05 17:47:08.635197 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1851/3497] 10.222.0.70 () {58 vars in 1170 bytes} [Wed Oct 5 17:47:08 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:08.646113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:08.647065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:08.655627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:08.656233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:08.656780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:08.657817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:08.658407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:08.658988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:08.803786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:08.815536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:08.820884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:08.832839 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-26077dcd-91ea-4585-a356-cd3e0ab4e7ae tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.189604 Oct 05 17:47:08.833992 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1852/3498] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:08 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:08.843820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8a71e4de-87fb-4137-afc1-119aacd798d7 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774d12040>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:08.967045 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8a71e4de-87fb-4137-afc1-119aacd798d7 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/0510c978-5936-46d4-9cc7-8d23f52ed26e" status: 200 len: 784 microversion: 2.1 time: 0.131684 Oct 05 17:47:08.981896 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1853/3499] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:47:08 2022] GET /compute/v2.1/images/0510c978-5936-46d4-9cc7-8d23f52ed26e => generated 784 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:08.995300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:08.996272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:09.019626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:09.020899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:09.026988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:09.028563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:09.030157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:09.031367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:09.222229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:09.249881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:09.259015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:09.260343 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6de79de0-257c-4080-be8c-77966ca6ff47 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.276463 Oct 05 17:47:09.264077 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1854/3500] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:08 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:09.279300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d05422ab-37b9-4cb2-9992-ab8d1cb0e498 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77747ccd30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:09.373243 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d05422ab-37b9-4cb2-9992-ab8d1cb0e498 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.107037 Oct 05 17:47:09.375001 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1855/3501] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:47:09 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:09.396736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-83bd9404-a031-45b9-87d0-cbb1cb52f9d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:09.397921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-83bd9404-a031-45b9-87d0-cbb1cb52f9d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:09.421646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83bd9404-a031-45b9-87d0-cbb1cb52f9d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:09.427973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83bd9404-a031-45b9-87d0-cbb1cb52f9d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:09.429582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83bd9404-a031-45b9-87d0-cbb1cb52f9d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:09.430900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83bd9404-a031-45b9-87d0-cbb1cb52f9d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:09.431724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b8b4bcd6-e4f2-468b-a74f-e9c428f56bf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:09.432060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83bd9404-a031-45b9-87d0-cbb1cb52f9d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:09.432924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83bd9404-a031-45b9-87d0-cbb1cb52f9d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:09.435856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:09.447298 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8b4bcd6-e4f2-468b-a74f-e9c428f56bf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 1.001272 Oct 05 17:47:09.473035 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1647/3502] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:08 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:09.518989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e0cf627c-a6b2-48ff-9863-d83c8ddeb006 req-21cd00c1-ee0e-4cb5-a754-32369c7a6bb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989ec240-1506-4643-b1e7-0a849f54db3d", "name": "network-vif-unplugged", "status": "completed", "tag": "ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:09.525801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:09.557201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e0cf627c-a6b2-48ff-9863-d83c8ddeb006 req-21cd00c1-ee0e-4cb5-a754-32369c7a6bb2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:09.557675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e0cf627c-a6b2-48ff-9863-d83c8ddeb006 req-21cd00c1-ee0e-4cb5-a754-32369c7a6bb2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:09.560851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e0cf627c-a6b2-48ff-9863-d83c8ddeb006 req-21cd00c1-ee0e-4cb5-a754-32369c7a6bb2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:09.585920 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e0cf627c-a6b2-48ff-9863-d83c8ddeb006 req-21cd00c1-ee0e-4cb5-a754-32369c7a6bb2 service nova] Creating event network-vif-unplugged:ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8 for instance 989ec240-1506-4643-b1e7-0a849f54db3d on n-h2-835595-3 Oct 05 17:47:09.604165 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e0cf627c-a6b2-48ff-9863-d83c8ddeb006 req-21cd00c1-ee0e-4cb5-a754-32369c7a6bb2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121401 Oct 05 17:47:09.605476 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1648/3503] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:09.617313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48f8db98-ed62-4154-8a52-c6b47420e525 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77794e9430>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:10.128187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-83bd9404-a031-45b9-87d0-cbb1cb52f9d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:10.141537 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-83bd9404-a031-45b9-87d0-cbb1cb52f9d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1322 microversion: 2.1 time: 0.750594 Oct 05 17:47:10.142491 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1856/3504] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:09 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1322 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:10.158776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:10.159706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:10.173196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:10.174896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:10.175343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:10.176107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:10.178720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:10.179180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:10.271363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:10.281327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:10.287893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:10.289614 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99e7e807-373e-452a-8e5e-aa9c9092e8c6 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.142914 Oct 05 17:47:10.303760 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1857/3505] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:10 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:10.316024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e8656b02-92c9-4bbf-b2fe-9e4fd28dc102 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:10.324171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8656b02-92c9-4bbf-b2fe-9e4fd28dc102 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:10.325720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8656b02-92c9-4bbf-b2fe-9e4fd28dc102 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:10.326425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8656b02-92c9-4bbf-b2fe-9e4fd28dc102 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:10.363171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e8656b02-92c9-4bbf-b2fe-9e4fd28dc102 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Going to try to stop instance {{(pid=128844) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 17:47:10.442710 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e8656b02-92c9-4bbf-b2fe-9e4fd28dc102 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/action" status: 202 len: 0 microversion: 2.1 time: 0.132761 Oct 05 17:47:10.450084 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1858/3506] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:47:10 2022] POST /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:47:10.458395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:10.459315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:10.480099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:10.480596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:10.481054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:10.482094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:10.482668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:10.482986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:10.652485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:10.667983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:10.670824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:10.672587 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5194e568-a20b-48ed-bc49-475b297f0665 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.220683 Oct 05 17:47:10.675987 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1859/3507] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:10 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:10.688730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25d4b4a1-847d-4067-932b-37a9d43a713a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:10.691965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25d4b4a1-847d-4067-932b-37a9d43a713a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:10.705473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d4b4a1-847d-4067-932b-37a9d43a713a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:10.708499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d4b4a1-847d-4067-932b-37a9d43a713a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:10.709152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d4b4a1-847d-4067-932b-37a9d43a713a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:10.710094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d4b4a1-847d-4067-932b-37a9d43a713a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:10.711517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d4b4a1-847d-4067-932b-37a9d43a713a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:10.712591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25d4b4a1-847d-4067-932b-37a9d43a713a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:10.751309 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48f8db98-ed62-4154-8a52-c6b47420e525 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "DELETE /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2" status: 204 len: 0 microversion: 2.1 time: 1.144528 Oct 05 17:47:10.752282 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1649/3508] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:09 2022] DELETE /compute/v2.1/images/800abf39-ebd8-4e4f-8b1f-1b3a27c493d2 => generated 0 bytes in 1146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:10.757443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97ff2747-1911-4732-93fe-f032f082cf5a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:10.759918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-97ff2747-1911-4732-93fe-f032f082cf5a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:10.774326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97ff2747-1911-4732-93fe-f032f082cf5a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:10.775016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97ff2747-1911-4732-93fe-f032f082cf5a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:10.775515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97ff2747-1911-4732-93fe-f032f082cf5a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:10.776403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97ff2747-1911-4732-93fe-f032f082cf5a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:10.776861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97ff2747-1911-4732-93fe-f032f082cf5a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:10.777331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97ff2747-1911-4732-93fe-f032f082cf5a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:10.917037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25d4b4a1-847d-4067-932b-37a9d43a713a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:10.936375 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25d4b4a1-847d-4067-932b-37a9d43a713a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.257869 Oct 05 17:47:10.937834 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1860/3509] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:10 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:10.957075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a57b0a64-f82f-4213-9705-53c9490b3236 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7779621940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:11.225615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-97ff2747-1911-4732-93fe-f032f082cf5a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:11.249919 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-97ff2747-1911-4732-93fe-f032f082cf5a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.494018 Oct 05 17:47:11.251921 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1650/3510] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:10 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:11.287985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2859a89a-1f48-4c08-bb7c-0c8aee26b0f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:11.288845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2859a89a-1f48-4c08-bb7c-0c8aee26b0f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:11.332192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2859a89a-1f48-4c08-bb7c-0c8aee26b0f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:11.332985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2859a89a-1f48-4c08-bb7c-0c8aee26b0f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:11.334244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2859a89a-1f48-4c08-bb7c-0c8aee26b0f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:11.338125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2859a89a-1f48-4c08-bb7c-0c8aee26b0f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:11.340295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2859a89a-1f48-4c08-bb7c-0c8aee26b0f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:11.341315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2859a89a-1f48-4c08-bb7c-0c8aee26b0f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:11.764035 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a57b0a64-f82f-4213-9705-53c9490b3236 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "DELETE /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292" status: 204 len: 0 microversion: 2.1 time: 0.824484 Oct 05 17:47:11.765359 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1861/3511] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:10 2022] DELETE /compute/v2.1/images/a5d0c33e-e759-4a8e-ad66-9ad1f9e4d292 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:11.774088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:11.775502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:11.790389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:11.793002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:11.793546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:11.795451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:11.797674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:11.798530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:11.905013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:11.916434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:11.919094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:11.920794 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ce16670-2fdf-48f6-9819-a44ea2f4ff51 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.154433 Oct 05 17:47:11.921921 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1862/3512] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:11 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:11.941232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-2b8629cd-f900-4a35-a68a-d36d81cf2b7e req-9629d0e1-31b3-4014-aab4-3d136cbb00e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb5b7961-3ec3-477d-a023-3c8ea6931d2d", "tag": "fbfa1a3c-3784-4cab-a410-88a06e481889"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:11.946030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2859a89a-1f48-4c08-bb7c-0c8aee26b0f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:11.956645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2b8629cd-f900-4a35-a68a-d36d81cf2b7e req-9629d0e1-31b3-4014-aab4-3d136cbb00e7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:11.957781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2b8629cd-f900-4a35-a68a-d36d81cf2b7e req-9629d0e1-31b3-4014-aab4-3d136cbb00e7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:11.958474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2b8629cd-f900-4a35-a68a-d36d81cf2b7e req-9629d0e1-31b3-4014-aab4-3d136cbb00e7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:11.958739 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2859a89a-1f48-4c08-bb7c-0c8aee26b0f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1322 microversion: 2.1 time: 0.705113 Oct 05 17:47:11.967845 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1651/3513] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:11 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1322 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:11.968317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:11.968631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:11.976020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:11.976756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:11.977347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:11.978100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:11.978638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:11.979105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:12.006265 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-2b8629cd-f900-4a35-a68a-d36d81cf2b7e req-9629d0e1-31b3-4014-aab4-3d136cbb00e7 service nova] Creating event network-changed:fbfa1a3c-3784-4cab-a410-88a06e481889 for instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d on n-h1-835595-3 Oct 05 17:47:12.017010 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-2b8629cd-f900-4a35-a68a-d36d81cf2b7e req-9629d0e1-31b3-4014-aab4-3d136cbb00e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091480 Oct 05 17:47:12.017651 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1863/3514] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:12.034659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f500cc0c-18e6-4bfd-adaa-74c9c3876c24 req-3b6369ae-189e-41cf-85cc-30a0f8254c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d037b8c8-e287-459a-a4b4-ac53b463337d", "name": "network-vif-plugged", "status": "completed", "tag": "2a95d002-7741-4d80-9a3d-939f6d945694"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:12.046229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f500cc0c-18e6-4bfd-adaa-74c9c3876c24 req-3b6369ae-189e-41cf-85cc-30a0f8254c3e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:12.046700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f500cc0c-18e6-4bfd-adaa-74c9c3876c24 req-3b6369ae-189e-41cf-85cc-30a0f8254c3e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:12.047133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f500cc0c-18e6-4bfd-adaa-74c9c3876c24 req-3b6369ae-189e-41cf-85cc-30a0f8254c3e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:12.060130 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f500cc0c-18e6-4bfd-adaa-74c9c3876c24 req-3b6369ae-189e-41cf-85cc-30a0f8254c3e service nova] Creating event network-vif-plugged:2a95d002-7741-4d80-9a3d-939f6d945694 for instance d037b8c8-e287-459a-a4b4-ac53b463337d on n-h2-835595-3 Oct 05 17:47:12.071600 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f500cc0c-18e6-4bfd-adaa-74c9c3876c24 req-3b6369ae-189e-41cf-85cc-30a0f8254c3e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048756 Oct 05 17:47:12.073493 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1864/3515] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:12.080413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4c799a18-c3a1-49cf-8de4-83c9fa384aff tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777963e160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:12.125020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:12.141071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:12.146034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:12.148386 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8cd58570-8c4e-4e11-bce4-27b83623e2ed tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.185189 Oct 05 17:47:12.149259 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1652/3516] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:11 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:12.155223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c2b9eed-89d8-432c-a784-905fbb601bb6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:12.156272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0c2b9eed-89d8-432c-a784-905fbb601bb6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:12.165164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c2b9eed-89d8-432c-a784-905fbb601bb6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:12.166170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c2b9eed-89d8-432c-a784-905fbb601bb6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:12.167120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c2b9eed-89d8-432c-a784-905fbb601bb6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:12.169012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c2b9eed-89d8-432c-a784-905fbb601bb6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:12.170020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c2b9eed-89d8-432c-a784-905fbb601bb6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:12.170922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c2b9eed-89d8-432c-a784-905fbb601bb6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:12.769631 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4c799a18-c3a1-49cf-8de4-83c9fa384aff tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "DELETE /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2" status: 204 len: 0 microversion: 2.1 time: 0.693870 Oct 05 17:47:12.772698 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1865/3517] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:12 2022] DELETE /compute/v2.1/images/0cd6a609-30e2-4520-a9dd-4b970b7efdf2 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:12.779024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c16ec109-8460-441c-8133-211d88667c27 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:12.780145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c16ec109-8460-441c-8133-211d88667c27 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:12.789871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c16ec109-8460-441c-8133-211d88667c27 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:12.790655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c16ec109-8460-441c-8133-211d88667c27 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:12.791437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c16ec109-8460-441c-8133-211d88667c27 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:12.792149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c16ec109-8460-441c-8133-211d88667c27 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:12.792753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c16ec109-8460-441c-8133-211d88667c27 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:12.793350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c16ec109-8460-441c-8133-211d88667c27 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:12.987056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0c2b9eed-89d8-432c-a784-905fbb601bb6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:12.998657 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c2b9eed-89d8-432c-a784-905fbb601bb6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.847956 Oct 05 17:47:13.001600 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1653/3518] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:12 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:13.007969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1929ad47-01e3-426b-8f59-d59ebbc30f8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:13.008812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1929ad47-01e3-426b-8f59-d59ebbc30f8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:13.016099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1929ad47-01e3-426b-8f59-d59ebbc30f8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:13.016900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1929ad47-01e3-426b-8f59-d59ebbc30f8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:13.017555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1929ad47-01e3-426b-8f59-d59ebbc30f8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:13.018697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1929ad47-01e3-426b-8f59-d59ebbc30f8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:13.019331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1929ad47-01e3-426b-8f59-d59ebbc30f8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:13.019923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1929ad47-01e3-426b-8f59-d59ebbc30f8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:13.073781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1929ad47-01e3-426b-8f59-d59ebbc30f8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:47:13.077639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c16ec109-8460-441c-8133-211d88667c27 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:13.090977 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c16ec109-8460-441c-8133-211d88667c27 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.312335 Oct 05 17:47:13.092409 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1866/3519] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:12 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:13.097912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:13.098552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:13.120128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:13.120710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:13.121589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:13.122319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:13.122775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:13.123202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:13.187134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:13.191307 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1929ad47-01e3-426b-8f59-d59ebbc30f8c tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 204 len: 0 microversion: 2.1 time: 0.187884 Oct 05 17:47:13.192180 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1654/3520] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:47:13 2022] DELETE /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:13.197778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8b1b8d5-4d8d-47ce-8a8e-c93117104806 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:13.198898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8b1b8d5-4d8d-47ce-8a8e-c93117104806 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:13.205708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8b1b8d5-4d8d-47ce-8a8e-c93117104806 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:13.206359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8b1b8d5-4d8d-47ce-8a8e-c93117104806 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:13.207086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8b1b8d5-4d8d-47ce-8a8e-c93117104806 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:13.207904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8b1b8d5-4d8d-47ce-8a8e-c93117104806 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:13.208867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8b1b8d5-4d8d-47ce-8a8e-c93117104806 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:13.209574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8b1b8d5-4d8d-47ce-8a8e-c93117104806 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:13.215586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:13.226443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:13.227974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:13.229187 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bb40f8ab-7667-4781-b128-9c6faa482e9a tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.135422 Oct 05 17:47:13.229770 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1867/3521] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:13 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:13.245173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:13.251862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:13.268559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:13.269419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:13.270060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:13.271088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:13.271762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:13.272721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:13.379990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:13.392836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:13.394616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:13.397669 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b311f831-f2e4-4783-a85f-6f806ca9d87b tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.158234 Oct 05 17:47:13.398838 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1868/3522] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:13 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:13.409296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-970658f0-9cfd-49fc-9f5d-58ff3f1b057e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:13.410163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-970658f0-9cfd-49fc-9f5d-58ff3f1b057e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:13.416913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-970658f0-9cfd-49fc-9f5d-58ff3f1b057e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:13.417487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-970658f0-9cfd-49fc-9f5d-58ff3f1b057e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:13.418155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-970658f0-9cfd-49fc-9f5d-58ff3f1b057e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:13.419053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-970658f0-9cfd-49fc-9f5d-58ff3f1b057e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:13.422603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c8b1b8d5-4d8d-47ce-8a8e-c93117104806 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:13.427693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-970658f0-9cfd-49fc-9f5d-58ff3f1b057e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:13.428165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-970658f0-9cfd-49fc-9f5d-58ff3f1b057e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:13.434190 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8b1b8d5-4d8d-47ce-8a8e-c93117104806 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1322 microversion: 2.1 time: 0.240357 Oct 05 17:47:13.434971 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1655/3523] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:13 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:13.681108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-970658f0-9cfd-49fc-9f5d-58ff3f1b057e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:13.693075 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-970658f0-9cfd-49fc-9f5d-58ff3f1b057e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1471 microversion: 2.1 time: 0.292809 Oct 05 17:47:13.710816 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1869/3524] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:13 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1471 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:14.026230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cbbde5cd-0313-4a45-8227-623fc076395a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:14.027736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cbbde5cd-0313-4a45-8227-623fc076395a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:14.035012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbbde5cd-0313-4a45-8227-623fc076395a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.035776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbbde5cd-0313-4a45-8227-623fc076395a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.036415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbbde5cd-0313-4a45-8227-623fc076395a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.037379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbbde5cd-0313-4a45-8227-623fc076395a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.037999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbbde5cd-0313-4a45-8227-623fc076395a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.038622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbbde5cd-0313-4a45-8227-623fc076395a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.120820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9f700f3-652f-4263-b15a-d5a8a8295c7f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:14.122323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9f700f3-652f-4263-b15a-d5a8a8295c7f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:14.132993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f700f3-652f-4263-b15a-d5a8a8295c7f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.133523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f700f3-652f-4263-b15a-d5a8a8295c7f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.133981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f700f3-652f-4263-b15a-d5a8a8295c7f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.134761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f700f3-652f-4263-b15a-d5a8a8295c7f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.135248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f700f3-652f-4263-b15a-d5a8a8295c7f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.135678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f700f3-652f-4263-b15a-d5a8a8295c7f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.224509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cbbde5cd-0313-4a45-8227-623fc076395a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:14.237523 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cbbde5cd-0313-4a45-8227-623fc076395a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.215057 Oct 05 17:47:14.239054 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1656/3525] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:14 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:14.263200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:14.264104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:14.274954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.275860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.276583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.277709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.278414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.280300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.354201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9f700f3-652f-4263-b15a-d5a8a8295c7f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:14.368737 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9f700f3-652f-4263-b15a-d5a8a8295c7f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.249280 Oct 05 17:47:14.382389 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1870/3526] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:14 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:14.395427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:14.404691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:14.406146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:14.408057 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-09169c61-96b3-4dd7-9169-aecd8bdb0204 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.150185 Oct 05 17:47:14.409353 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1657/3527] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:14 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:14.428083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:14.428730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:14.437628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.437926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.439234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.439963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.440430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.440861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.460844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1150ad40-c3e2-4f79-9f5f-fb38e9f3d4f3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:14.461834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1150ad40-c3e2-4f79-9f5f-fb38e9f3d4f3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:14.468998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1150ad40-c3e2-4f79-9f5f-fb38e9f3d4f3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.469856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1150ad40-c3e2-4f79-9f5f-fb38e9f3d4f3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.470554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1150ad40-c3e2-4f79-9f5f-fb38e9f3d4f3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.471502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1150ad40-c3e2-4f79-9f5f-fb38e9f3d4f3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.472185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1150ad40-c3e2-4f79-9f5f-fb38e9f3d4f3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.472859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1150ad40-c3e2-4f79-9f5f-fb38e9f3d4f3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.596263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:14.609561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:14.611593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:14.613407 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2c8be410-1806-46c1-a6df-78c1c8bb357c tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.190041 Oct 05 17:47:14.614779 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1871/3528] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:14 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:14.710834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1150ad40-c3e2-4f79-9f5f-fb38e9f3d4f3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:14.721623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-961a195b-e2f9-4631-839d-e1a43848ee79 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:14.723168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-961a195b-e2f9-4631-839d-e1a43848ee79 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:14.731986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961a195b-e2f9-4631-839d-e1a43848ee79 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.732594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961a195b-e2f9-4631-839d-e1a43848ee79 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.733048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961a195b-e2f9-4631-839d-e1a43848ee79 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.733794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961a195b-e2f9-4631-839d-e1a43848ee79 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:14.734258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961a195b-e2f9-4631-839d-e1a43848ee79 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:14.734709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961a195b-e2f9-4631-839d-e1a43848ee79 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:14.747755 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1150ad40-c3e2-4f79-9f5f-fb38e9f3d4f3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1322 microversion: 2.1 time: 0.290350 Oct 05 17:47:14.750876 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1658/3529] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:14 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:14.965286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-961a195b-e2f9-4631-839d-e1a43848ee79 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:14.973890 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-961a195b-e2f9-4631-839d-e1a43848ee79 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1471 microversion: 2.1 time: 0.257087 Oct 05 17:47:14.975319 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1872/3530] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:14 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:15.264046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-62917cff-639a-4efd-8113-208fa241c12d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:15.265861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-62917cff-639a-4efd-8113-208fa241c12d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:15.273089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:15.275828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62917cff-639a-4efd-8113-208fa241c12d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:15.276432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62917cff-639a-4efd-8113-208fa241c12d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:15.276958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62917cff-639a-4efd-8113-208fa241c12d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:15.277764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62917cff-639a-4efd-8113-208fa241c12d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:15.278339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62917cff-639a-4efd-8113-208fa241c12d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:15.278913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62917cff-639a-4efd-8113-208fa241c12d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:15.397404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5881741e-66dc-4a1b-8e48-dfd876d55761 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:15.398023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5881741e-66dc-4a1b-8e48-dfd876d55761 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:15.410054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5881741e-66dc-4a1b-8e48-dfd876d55761 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:15.410592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5881741e-66dc-4a1b-8e48-dfd876d55761 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:15.411042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5881741e-66dc-4a1b-8e48-dfd876d55761 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:15.414806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5881741e-66dc-4a1b-8e48-dfd876d55761 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:15.415620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5881741e-66dc-4a1b-8e48-dfd876d55761 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:15.416072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5881741e-66dc-4a1b-8e48-dfd876d55761 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:15.468585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=16 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:15.530432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-62917cff-639a-4efd-8113-208fa241c12d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:15.549430 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-62917cff-639a-4efd-8113-208fa241c12d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.289714 Oct 05 17:47:15.562570 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1659/3531] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:15 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:15.576267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:15.576913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:15.595592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:15.596256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:15.602915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:15.603763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:15.604248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:15.604683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:15.727887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:15.738317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:15.738997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5881741e-66dc-4a1b-8e48-dfd876d55761 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:15.739871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:15.741916 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c5fbf393-3b08-4fed-bc44-94a9eb70b44d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.181003 Oct 05 17:47:15.742791 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1660/3532] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:15 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:15.754514 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5881741e-66dc-4a1b-8e48-dfd876d55761 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1517 microversion: 2.1 time: 0.359483 Oct 05 17:47:15.766142 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1873/3533] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:15 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1517 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:15.771767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:15.772419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:15.773973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d39ab790-cfb4-4124-b6f9-a31a69301fa8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:15.780216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:15.780714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:15.781155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:15.782076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:15.782215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d39ab790-cfb4-4124-b6f9-a31a69301fa8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:15.782861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:15.783490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:15.796131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d39ab790-cfb4-4124-b6f9-a31a69301fa8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:15.796131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d39ab790-cfb4-4124-b6f9-a31a69301fa8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:15.803913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d39ab790-cfb4-4124-b6f9-a31a69301fa8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:15.804880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d39ab790-cfb4-4124-b6f9-a31a69301fa8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:15.805369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d39ab790-cfb4-4124-b6f9-a31a69301fa8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:15.805801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d39ab790-cfb4-4124-b6f9-a31a69301fa8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:15.884421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:15.897189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:15.897535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:15.898912 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-80162a53-a859-417d-9286-44b765a2348e tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.142472 Oct 05 17:47:15.899915 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1661/3534] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:15 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:15.999646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab5b1a9e-030e-48dc-a0c7-670a6245b79f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:16.000314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ab5b1a9e-030e-48dc-a0c7-670a6245b79f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:16.009976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab5b1a9e-030e-48dc-a0c7-670a6245b79f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:16.010512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab5b1a9e-030e-48dc-a0c7-670a6245b79f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:16.013606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab5b1a9e-030e-48dc-a0c7-670a6245b79f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:16.016894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab5b1a9e-030e-48dc-a0c7-670a6245b79f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:16.017396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab5b1a9e-030e-48dc-a0c7-670a6245b79f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:16.017848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab5b1a9e-030e-48dc-a0c7-670a6245b79f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:16.071904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d39ab790-cfb4-4124-b6f9-a31a69301fa8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:16.083630 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d39ab790-cfb4-4124-b6f9-a31a69301fa8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1322 microversion: 2.1 time: 0.313626 Oct 05 17:47:16.084234 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1874/3535] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:15 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:16.239995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ab5b1a9e-030e-48dc-a0c7-670a6245b79f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:16.249959 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ab5b1a9e-030e-48dc-a0c7-670a6245b79f tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1471 microversion: 2.1 time: 0.256307 Oct 05 17:47:16.266158 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1662/3536] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:15 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1471 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:16.600925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e3363936-006b-41f3-8151-a3ffca6f87c3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:16.601546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e3363936-006b-41f3-8151-a3ffca6f87c3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:16.611714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3363936-006b-41f3-8151-a3ffca6f87c3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:16.612212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3363936-006b-41f3-8151-a3ffca6f87c3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:16.612645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3363936-006b-41f3-8151-a3ffca6f87c3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:16.621628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3363936-006b-41f3-8151-a3ffca6f87c3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:16.623099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3363936-006b-41f3-8151-a3ffca6f87c3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:16.625097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3363936-006b-41f3-8151-a3ffca6f87c3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:16.675903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:16.776040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:16.776656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:16.797288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:16.799359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:16.802303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:16.805435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:16.808028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:16.811718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:16.913888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e3363936-006b-41f3-8151-a3ffca6f87c3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:16.935176 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e3363936-006b-41f3-8151-a3ffca6f87c3 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.338107 Oct 05 17:47:16.940962 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1875/3537] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:16 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:16.954042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6f10814-915f-49f9-93b7-a5bbe519e93e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:16.954964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c6f10814-915f-49f9-93b7-a5bbe519e93e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:16.974721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f10814-915f-49f9-93b7-a5bbe519e93e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:16.975553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f10814-915f-49f9-93b7-a5bbe519e93e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:16.976169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f10814-915f-49f9-93b7-a5bbe519e93e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:16.977077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f10814-915f-49f9-93b7-a5bbe519e93e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:16.978559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f10814-915f-49f9-93b7-a5bbe519e93e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:16.979361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f10814-915f-49f9-93b7-a5bbe519e93e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:17.055629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:17.065509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:17.088947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:17.091148 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c27efaea-f4b1-41c4-8389-0589a77e82bc tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.318314 Oct 05 17:47:17.107909 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1663/3538] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:16 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:17.114439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:17.115146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:17.122318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:17.122826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:17.123263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:17.123971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:17.124429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:17.124855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:17.152709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:17.265040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:17.275671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:17.277126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:17.278360 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-160c1fdd-4e71-4318-9002-7e75a53b0d48 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.170424 Oct 05 17:47:17.278937 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1664/3539] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:17 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:17.294722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cb01d572-f69d-49e4-8379-105581a1755b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:17.295281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cb01d572-f69d-49e4-8379-105581a1755b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:17.310741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb01d572-f69d-49e4-8379-105581a1755b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:17.311145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb01d572-f69d-49e4-8379-105581a1755b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:17.311666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb01d572-f69d-49e4-8379-105581a1755b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:17.312387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb01d572-f69d-49e4-8379-105581a1755b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:17.312852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb01d572-f69d-49e4-8379-105581a1755b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:17.313278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb01d572-f69d-49e4-8379-105581a1755b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:17.317027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c6f10814-915f-49f9-93b7-a5bbe519e93e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:17.326049 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c6f10814-915f-49f9-93b7-a5bbe519e93e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1523 microversion: 2.1 time: 0.383684 Oct 05 17:47:17.330460 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1876/3540] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:16 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:17.339333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-013cf88f-7219-4026-9926-95983145be21 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:17.342315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-013cf88f-7219-4026-9926-95983145be21 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:17.349150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-013cf88f-7219-4026-9926-95983145be21 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:17.349926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-013cf88f-7219-4026-9926-95983145be21 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:17.350531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-013cf88f-7219-4026-9926-95983145be21 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:17.351350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-013cf88f-7219-4026-9926-95983145be21 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:17.351942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-013cf88f-7219-4026-9926-95983145be21 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:17.352624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-013cf88f-7219-4026-9926-95983145be21 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:17.556237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cb01d572-f69d-49e4-8379-105581a1755b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:17.571728 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cb01d572-f69d-49e4-8379-105581a1755b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1322 microversion: 2.1 time: 0.280812 Oct 05 17:47:17.573120 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1665/3541] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:17 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:17.854462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-711325c8-2020-49a6-8457-9a046cd2182c req-6e74dec6-f97b-48dd-aa32-9fce3ee5082c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3caa633-ebf4-4260-9dc5-bcc736013af2", "name": "network-vif-deleted", "tag": "30f075ed-d317-4f30-9da2-0931dec00b11"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:17.868036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-711325c8-2020-49a6-8457-9a046cd2182c req-6e74dec6-f97b-48dd-aa32-9fce3ee5082c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:17.868522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-711325c8-2020-49a6-8457-9a046cd2182c req-6e74dec6-f97b-48dd-aa32-9fce3ee5082c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:17.868956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-711325c8-2020-49a6-8457-9a046cd2182c req-6e74dec6-f97b-48dd-aa32-9fce3ee5082c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:17.881320 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-711325c8-2020-49a6-8457-9a046cd2182c req-6e74dec6-f97b-48dd-aa32-9fce3ee5082c service nova] Creating event network-vif-deleted:30f075ed-d317-4f30-9da2-0931dec00b11 for instance d3caa633-ebf4-4260-9dc5-bcc736013af2 on n-h1-835595-3 Oct 05 17:47:17.887615 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-711325c8-2020-49a6-8457-9a046cd2182c req-6e74dec6-f97b-48dd-aa32-9fce3ee5082c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036719 Oct 05 17:47:17.891623 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1666/3542] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:47:17.947407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-013cf88f-7219-4026-9926-95983145be21 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:17.988405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a0ffa864-5da8-4263-b040-1587f9328329 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:17.989270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a0ffa864-5da8-4263-b040-1587f9328329 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:17.990953 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-013cf88f-7219-4026-9926-95983145be21 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 200 len: 1471 microversion: 2.1 time: 0.631861 Oct 05 17:47:17.998848 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1877/3543] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:17 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 1471 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:18.021730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ffa864-5da8-4263-b040-1587f9328329 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.022682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ffa864-5da8-4263-b040-1587f9328329 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.024477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ffa864-5da8-4263-b040-1587f9328329 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:18.025611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ffa864-5da8-4263-b040-1587f9328329 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.028803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ffa864-5da8-4263-b040-1587f9328329 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.030601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ffa864-5da8-4263-b040-1587f9328329 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:18.129745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:18.131958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:18.178485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.183738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.185444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:18.188649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.189601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.199187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:18.374133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:18.387916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:18.392063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:18.406350 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e1e31b7c-a611-4deb-882b-6399a19cc074 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.291060 Oct 05 17:47:18.407471 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1878/3544] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:18 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:47:18.416805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-63e608f8-c57a-4705-b771-0eacd6085e3a req-9c7a0b4a-e55f-4baf-b693-519b03c3d736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5b7961-3ec3-477d-a023-3c8ea6931d2d", "name": "network-vif-plugged", "status": "completed", "tag": "fbfa1a3c-3784-4cab-a410-88a06e481889"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:18.438499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-63e608f8-c57a-4705-b771-0eacd6085e3a req-9c7a0b4a-e55f-4baf-b693-519b03c3d736 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.439521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-63e608f8-c57a-4705-b771-0eacd6085e3a req-9c7a0b4a-e55f-4baf-b693-519b03c3d736 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.440191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-63e608f8-c57a-4705-b771-0eacd6085e3a req-9c7a0b4a-e55f-4baf-b693-519b03c3d736 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:18.470023 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-63e608f8-c57a-4705-b771-0eacd6085e3a req-9c7a0b4a-e55f-4baf-b693-519b03c3d736 service nova] Creating event network-vif-plugged:fbfa1a3c-3784-4cab-a410-88a06e481889 for instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d on n-h1-835595-3 Oct 05 17:47:18.483074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-63e608f8-c57a-4705-b771-0eacd6085e3a req-9c7a0b4a-e55f-4baf-b693-519b03c3d736 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072460 Oct 05 17:47:18.499437 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1879/3545] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:18.526700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:18.526700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:18.526700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:18.537912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.538446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.547458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:18.548581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.549309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.549958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:18.681522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:18.700603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:18.702109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:18.704783 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eefeb915-f304-4ce0-aab2-b9876cce1218 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.211334 Oct 05 17:47:18.705717 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1880/3546] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:18 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:18.716174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-17b0ca0d-7d71-4e25-abc4-4e150d2e9772 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:18.717882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-17b0ca0d-7d71-4e25-abc4-4e150d2e9772 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:18.735664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b0ca0d-7d71-4e25-abc4-4e150d2e9772 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.736493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b0ca0d-7d71-4e25-abc4-4e150d2e9772 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.737603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b0ca0d-7d71-4e25-abc4-4e150d2e9772 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:18.738603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b0ca0d-7d71-4e25-abc4-4e150d2e9772 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.739603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b0ca0d-7d71-4e25-abc4-4e150d2e9772 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.740565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b0ca0d-7d71-4e25-abc4-4e150d2e9772 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:18.745468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0ffa864-5da8-4263-b040-1587f9328329 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:18.758816 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a0ffa864-5da8-4263-b040-1587f9328329 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.793629 Oct 05 17:47:18.777547 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1667/3547] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:17 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:18.788270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f968dee1-ca45-4000-aa81-f82fd2cb1ec5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:18.791271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f968dee1-ca45-4000-aa81-f82fd2cb1ec5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:18.807646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f968dee1-ca45-4000-aa81-f82fd2cb1ec5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.813367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f968dee1-ca45-4000-aa81-f82fd2cb1ec5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.814923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f968dee1-ca45-4000-aa81-f82fd2cb1ec5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:18.818365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f968dee1-ca45-4000-aa81-f82fd2cb1ec5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:18.819146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f968dee1-ca45-4000-aa81-f82fd2cb1ec5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:18.820455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f968dee1-ca45-4000-aa81-f82fd2cb1ec5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.120223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-17b0ca0d-7d71-4e25-abc4-4e150d2e9772 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:19.143539 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-17b0ca0d-7d71-4e25-abc4-4e150d2e9772 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1523 microversion: 2.1 time: 0.436440 Oct 05 17:47:19.145755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1881/3548] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:18 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1523 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:19.159725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:19.163070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: d3caa633-ebf4-4260-9dc5-bcc736013af2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:19.172268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.173009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.173907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.174970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.175697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.176302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.193645 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] HTTP exception thrown: Instance d3caa633-ebf4-4260-9dc5-bcc736013af2 could not be found. Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Request method failure captured: Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 HTTP/1.1 Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcKR_1et0FEBpvuu0JfKJDF05tVrRnOYpWEN73m5361L59Py0Pwwoc8bq4dPZUlj2ool4-X7o4pf8KiMHHMOOhljEabSj8Nhzn3fF3DbHF1D7HCPVImZisIYXVDnW32LVXNcKE2jgcFKuGOPVNMQUcYFQinBhCvm7JvHB9wUt5xnYhI Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 66a9e15f741c4d2ba29c84de6548b609 Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ListImageFiltersTestJSON-149902055 Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/66a9e15f741c4d2ba29c84de6548b609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66a9e15f741c4d2ba29c84de6548b609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_66a9e15f741c4d2ba29c84de6548b609", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66a9e15f741c4d2ba29c84de6548b609"}]}] Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ListImageFiltersTestJSON-149902055 Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 66a9e15f741c4d2ba29c84de6548b609 Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-149902055 Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ListImageFiltersTestJSON-149902055-project Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9fc5abcfae46458abd33c1cf827f6be4 Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ListImageFiltersTestJSON-149902055-project Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance d3caa633-ebf4-4260-9dc5-bcc736013af2 could not be found. Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'd3caa633-ebf4-4260-9dc5-bcc736013af2'} Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3caa633-ebf4-4260-9dc5-bcc736013af2 could not be found. Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3caa633-ebf4-4260-9dc5-bcc736013af2 could not be found. Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:19.195750 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:19.201506 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:19.201506 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:19.201506 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:19.201506 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:19.201506 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:19.201506 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3caa633-ebf4-4260-9dc5-bcc736013af2 could not be found. Oct 05 17:47:19.201506 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:19.202927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Returning 404 to user: Instance d3caa633-ebf4-4260-9dc5-bcc736013af2 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:19.204539 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-113a3dba-e98f-4f40-ab9f-34ead558738e tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2" status: 404 len: 111 microversion: 2.1 time: 0.057582 Oct 05 17:47:19.210763 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1882/3549] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:19 2022] GET /compute/v2.1/servers/d3caa633-ebf4-4260-9dc5-bcc736013af2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:47:19.216679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f9fa792c-11a8-4341-b1dc-60eec304f7eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:19.217423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f9fa792c-11a8-4341-b1dc-60eec304f7eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:19.231507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9fa792c-11a8-4341-b1dc-60eec304f7eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.232434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9fa792c-11a8-4341-b1dc-60eec304f7eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.233153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9fa792c-11a8-4341-b1dc-60eec304f7eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.234062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9fa792c-11a8-4341-b1dc-60eec304f7eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.235605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9fa792c-11a8-4341-b1dc-60eec304f7eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.238725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9fa792c-11a8-4341-b1dc-60eec304f7eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.241434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f968dee1-ca45-4000-aa81-f82fd2cb1ec5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:19.250173 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f968dee1-ca45-4000-aa81-f82fd2cb1ec5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1322 microversion: 2.1 time: 0.471500 Oct 05 17:47:19.251067 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1668/3550] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:18 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1322 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:19.276705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f9fa792c-11a8-4341-b1dc-60eec304f7eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:47:19.373193 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f9fa792c-11a8-4341-b1dc-60eec304f7eb tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "DELETE /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d" status: 204 len: 0 microversion: 2.1 time: 0.159385 Oct 05 17:47:19.373871 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1883/3551] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:47:19 2022] DELETE /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:19.382667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-68c2e919-00ea-4581-bf53-249811bd5cd1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:19.383687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-68c2e919-00ea-4581-bf53-249811bd5cd1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:19.390008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68c2e919-00ea-4581-bf53-249811bd5cd1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.390595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68c2e919-00ea-4581-bf53-249811bd5cd1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.391084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68c2e919-00ea-4581-bf53-249811bd5cd1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.391837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68c2e919-00ea-4581-bf53-249811bd5cd1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.392346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68c2e919-00ea-4581-bf53-249811bd5cd1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.393150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68c2e919-00ea-4581-bf53-249811bd5cd1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.440522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:19.442835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:19.455063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.456534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.457127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.457990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.459175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.463264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.560698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-68c2e919-00ea-4581-bf53-249811bd5cd1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:19.570214 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-68c2e919-00ea-4581-bf53-249811bd5cd1 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d" status: 200 len: 1473 microversion: 2.1 time: 0.192386 Oct 05 17:47:19.572679 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1669/3552] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:19 2022] GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d => generated 1473 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:19.583686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:19.592883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:19.594623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:19.596097 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c37e249c-1a11-4568-9449-af6b51017d6c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.164811 Oct 05 17:47:19.597375 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1884/3553] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:19 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:19.732976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:19.733593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:19.742607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.743104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.743820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.744745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.745197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.745820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.785336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d834737e-55ca-43db-a71f-900745713c5c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:19.786787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d834737e-55ca-43db-a71f-900745713c5c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:19.796948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d834737e-55ca-43db-a71f-900745713c5c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.798046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d834737e-55ca-43db-a71f-900745713c5c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.798935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d834737e-55ca-43db-a71f-900745713c5c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.800150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d834737e-55ca-43db-a71f-900745713c5c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:19.800871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d834737e-55ca-43db-a71f-900745713c5c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:19.802391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d834737e-55ca-43db-a71f-900745713c5c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:19.862001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:19.882493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:19.884134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:19.888864 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6ee1d964-1317-41b8-bae3-b3fd05336596 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.159860 Oct 05 17:47:19.890907 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1670/3554] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:19 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:47:20.043355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d834737e-55ca-43db-a71f-900745713c5c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:20.053620 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d834737e-55ca-43db-a71f-900745713c5c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.274418 Oct 05 17:47:20.055338 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1885/3555] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:19 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:20.170613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e809427-b4c6-4233-b035-31c266bb76b3 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:20.171611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6e809427-b4c6-4233-b035-31c266bb76b3 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:20.182261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e809427-b4c6-4233-b035-31c266bb76b3 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.185450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e809427-b4c6-4233-b035-31c266bb76b3 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.185899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e809427-b4c6-4233-b035-31c266bb76b3 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:20.186664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e809427-b4c6-4233-b035-31c266bb76b3 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.187120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e809427-b4c6-4233-b035-31c266bb76b3 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.192142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e809427-b4c6-4233-b035-31c266bb76b3 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:20.273309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-be684424-c09c-47d2-af87-d47c8ceadcd3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:20.273969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-be684424-c09c-47d2-af87-d47c8ceadcd3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:20.283656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be684424-c09c-47d2-af87-d47c8ceadcd3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.284148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be684424-c09c-47d2-af87-d47c8ceadcd3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.284579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be684424-c09c-47d2-af87-d47c8ceadcd3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:20.285283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be684424-c09c-47d2-af87-d47c8ceadcd3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.285730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be684424-c09c-47d2-af87-d47c8ceadcd3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.290184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be684424-c09c-47d2-af87-d47c8ceadcd3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:20.454311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6e809427-b4c6-4233-b035-31c266bb76b3 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:20.465160 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6e809427-b4c6-4233-b035-31c266bb76b3 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1523 microversion: 2.1 time: 0.300408 Oct 05 17:47:20.466523 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1671/3556] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:20 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:20.532678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-9786e6de-7d14-4a56-be54-99a1eaf59003 req-98370bd9-9c2d-4a13-971f-57d2e1c03f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd", "name": "network-vif-unplugged", "status": "completed", "tag": "b9627811-9013-44a9-b7ff-0e44f3f9d2c9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:20.538251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-be684424-c09c-47d2-af87-d47c8ceadcd3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:20.555986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9786e6de-7d14-4a56-be54-99a1eaf59003 req-98370bd9-9c2d-4a13-971f-57d2e1c03f45 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.557236 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-be684424-c09c-47d2-af87-d47c8ceadcd3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1322 microversion: 2.1 time: 0.287910 Oct 05 17:47:20.557845 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1886/3557] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:20 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:20.561632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9786e6de-7d14-4a56-be54-99a1eaf59003 req-98370bd9-9c2d-4a13-971f-57d2e1c03f45 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.562387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9786e6de-7d14-4a56-be54-99a1eaf59003 req-98370bd9-9c2d-4a13-971f-57d2e1c03f45 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:20.587917 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9786e6de-7d14-4a56-be54-99a1eaf59003 req-98370bd9-9c2d-4a13-971f-57d2e1c03f45 service nova] Creating event network-vif-unplugged:b9627811-9013-44a9-b7ff-0e44f3f9d2c9 for instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd on n-h1-835595-3 Oct 05 17:47:20.595885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9eace816-d911-490f-aad5-4eba68c31dc2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:20.596504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9eace816-d911-490f-aad5-4eba68c31dc2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:20.602857 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-9786e6de-7d14-4a56-be54-99a1eaf59003 req-98370bd9-9c2d-4a13-971f-57d2e1c03f45 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073391 Oct 05 17:47:20.604761 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1672/3558] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:47:20.605109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eace816-d911-490f-aad5-4eba68c31dc2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.605608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eace816-d911-490f-aad5-4eba68c31dc2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.607734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eace816-d911-490f-aad5-4eba68c31dc2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:20.608466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eace816-d911-490f-aad5-4eba68c31dc2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.608928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eace816-d911-490f-aad5-4eba68c31dc2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.609353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eace816-d911-490f-aad5-4eba68c31dc2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:20.624854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:20.625972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:20.641663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.642381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.643581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:20.646013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.646828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.648947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:20.791857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:20.806555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:20.809608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:20.813424 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-30afcce1-424d-41af-a109-8daf481acab3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1366 microversion: 2.57 time: 0.193613 Oct 05 17:47:20.815954 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1673/3559] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:20 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:47:20.888682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9eace816-d911-490f-aad5-4eba68c31dc2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:20.900493 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9eace816-d911-490f-aad5-4eba68c31dc2 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d" status: 200 len: 1473 microversion: 2.1 time: 0.308778 Oct 05 17:47:20.923043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:20.923881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:20.928825 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1887/3560] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:20 2022] GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d => generated 1473 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:20.931526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.932385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.933349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:20.934762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:20.935408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:20.935998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:21.015038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:21.025396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:21.026874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:21.028102 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-25e6ba42-763d-44d4-9554-eee50103a8c0 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.112196 Oct 05 17:47:21.028914 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1674/3561] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:20 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:21.081274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-241658f5-28b1-4129-98cb-dce911f5e01e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:21.082151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-241658f5-28b1-4129-98cb-dce911f5e01e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:21.092992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-241658f5-28b1-4129-98cb-dce911f5e01e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:21.094153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-241658f5-28b1-4129-98cb-dce911f5e01e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:21.095459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-241658f5-28b1-4129-98cb-dce911f5e01e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:21.097345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-241658f5-28b1-4129-98cb-dce911f5e01e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:21.100253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-241658f5-28b1-4129-98cb-dce911f5e01e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:21.100813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-241658f5-28b1-4129-98cb-dce911f5e01e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:21.401095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-241658f5-28b1-4129-98cb-dce911f5e01e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:21.410428 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-241658f5-28b1-4129-98cb-dce911f5e01e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.335688 Oct 05 17:47:21.423146 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1888/3562] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:21 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:21.493414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b2a5958b-a1f8-4c07-bea6-901d1e071a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:21.495000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b2a5958b-a1f8-4c07-bea6-901d1e071a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:21.504200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a5958b-a1f8-4c07-bea6-901d1e071a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:21.505372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a5958b-a1f8-4c07-bea6-901d1e071a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:21.506080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a5958b-a1f8-4c07-bea6-901d1e071a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:21.507067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a5958b-a1f8-4c07-bea6-901d1e071a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:21.508460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a5958b-a1f8-4c07-bea6-901d1e071a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:21.509167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2a5958b-a1f8-4c07-bea6-901d1e071a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:21.584728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8d7a57a1-5390-43ae-be26-da4f82126e8a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:21.585731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8d7a57a1-5390-43ae-be26-da4f82126e8a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:21.600519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d7a57a1-5390-43ae-be26-da4f82126e8a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:21.601439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d7a57a1-5390-43ae-be26-da4f82126e8a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:21.603380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d7a57a1-5390-43ae-be26-da4f82126e8a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:21.607304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d7a57a1-5390-43ae-be26-da4f82126e8a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:21.608081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d7a57a1-5390-43ae-be26-da4f82126e8a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:21.608749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d7a57a1-5390-43ae-be26-da4f82126e8a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:21.750715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2a5958b-a1f8-4c07-bea6-901d1e071a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:21.762332 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b2a5958b-a1f8-4c07-bea6-901d1e071a59 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1523 microversion: 2.1 time: 0.275307 Oct 05 17:47:21.763580 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1675/3563] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:21 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:21.843384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:21.844840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:21.855052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:21.860011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:21.860689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:21.861628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:21.863526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:21.864664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.002963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:22.019740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:22.021730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:22.022669 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f619b86a-ec41-4777-95a3-96656379306c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1372 microversion: 2.57 time: 0.185466 Oct 05 17:47:22.028311 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1676/3564] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:21 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1372 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:47:22.039468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3fffe5af-4a23-4132-83e8-9f567e4a6bdc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:22.042051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3fffe5af-4a23-4132-83e8-9f567e4a6bdc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:22.078925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fffe5af-4a23-4132-83e8-9f567e4a6bdc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.083754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fffe5af-4a23-4132-83e8-9f567e4a6bdc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.090250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fffe5af-4a23-4132-83e8-9f567e4a6bdc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.092127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fffe5af-4a23-4132-83e8-9f567e4a6bdc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.093846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fffe5af-4a23-4132-83e8-9f567e4a6bdc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.094303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fffe5af-4a23-4132-83e8-9f567e4a6bdc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.209615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8d7a57a1-5390-43ae-be26-da4f82126e8a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:22.220780 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8d7a57a1-5390-43ae-be26-da4f82126e8a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1516 microversion: 2.1 time: 0.640265 Oct 05 17:47:22.228003 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1889/3565] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:21 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1516 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:22.250684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:22.251330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:22.266983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.272717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3fffe5af-4a23-4132-83e8-9f567e4a6bdc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc5abcfae46458abd33c1cf827f6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66a9e15f741c4d2ba29c84de6548b609', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:22.278754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.279702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.281185 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3fffe5af-4a23-4132-83e8-9f567e4a6bdc tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d" status: 200 len: 1431 microversion: 2.1 time: 0.251492 Oct 05 17:47:22.281790 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1677/3566] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:22 2022] GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d => generated 1431 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:22.287062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.290207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.290927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.440957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:22.455442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:22.457426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:22.459159 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0cc89d3c-14a7-4e36-8076-09000c296eb4 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.229662 Oct 05 17:47:22.462244 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1890/3567] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:22 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:22.484599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0293d55d-6b55-4ecc-9708-ab407b14c049 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:22.490059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0293d55d-6b55-4ecc-9708-ab407b14c049 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:22.497787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0293d55d-6b55-4ecc-9708-ab407b14c049 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.498557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0293d55d-6b55-4ecc-9708-ab407b14c049 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.499453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0293d55d-6b55-4ecc-9708-ab407b14c049 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.500404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0293d55d-6b55-4ecc-9708-ab407b14c049 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.500867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0293d55d-6b55-4ecc-9708-ab407b14c049 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.501726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0293d55d-6b55-4ecc-9708-ab407b14c049 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.522567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-88399ab5-d142-4494-8dd8-43102d22d75c req-e9471bf6-1c5c-4309-8458-46f20b6e8b57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "989ec240-1506-4643-b1e7-0a849f54db3d", "name": "network-vif-deleted", "tag": "ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:22.535882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-88399ab5-d142-4494-8dd8-43102d22d75c req-e9471bf6-1c5c-4309-8458-46f20b6e8b57 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.537213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-88399ab5-d142-4494-8dd8-43102d22d75c req-e9471bf6-1c5c-4309-8458-46f20b6e8b57 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.537855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-88399ab5-d142-4494-8dd8-43102d22d75c req-e9471bf6-1c5c-4309-8458-46f20b6e8b57 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.556843 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-88399ab5-d142-4494-8dd8-43102d22d75c req-e9471bf6-1c5c-4309-8458-46f20b6e8b57 service nova] Creating event network-vif-deleted:ea9303d6-5db0-4b62-ab34-0a5ff78ef3c8 for instance 989ec240-1506-4643-b1e7-0a849f54db3d on n-h2-835595-3 Oct 05 17:47:22.568277 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-88399ab5-d142-4494-8dd8-43102d22d75c req-e9471bf6-1c5c-4309-8458-46f20b6e8b57 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.284391 Oct 05 17:47:22.569054 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1678/3568] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:22.578209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-0293d55d-6b55-4ecc-9708-ab407b14c049 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lazy-loading 'flavor' on Instance uuid bb5b7961-3ec3-477d-a023-3c8ea6931d2d {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:47:22.584384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43e49162-41f9-4d0b-aba6-fdfb7e313e95 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:22.584635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:22.585122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-43e49162-41f9-4d0b-aba6-fdfb7e313e95 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:22.592923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43e49162-41f9-4d0b-aba6-fdfb7e313e95 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.606976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43e49162-41f9-4d0b-aba6-fdfb7e313e95 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.609054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43e49162-41f9-4d0b-aba6-fdfb7e313e95 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.612527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43e49162-41f9-4d0b-aba6-fdfb7e313e95 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.613488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43e49162-41f9-4d0b-aba6-fdfb7e313e95 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.615819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43e49162-41f9-4d0b-aba6-fdfb7e313e95 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.729888 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0293d55d-6b55-4ecc-9708-ab407b14c049 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d/action" status: 200 len: 32 microversion: 2.1 time: 0.265390 Oct 05 17:47:22.731559 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1891/3569] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:47:22 2022] POST /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d/action => generated 32 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:47:22.749018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac624a61-4fc9-4ebb-8324-d39a0871cfae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:22.751092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac624a61-4fc9-4ebb-8324-d39a0871cfae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:22.760962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac624a61-4fc9-4ebb-8324-d39a0871cfae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.762057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac624a61-4fc9-4ebb-8324-d39a0871cfae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.762891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac624a61-4fc9-4ebb-8324-d39a0871cfae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.765095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac624a61-4fc9-4ebb-8324-d39a0871cfae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.766073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac624a61-4fc9-4ebb-8324-d39a0871cfae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.767231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac624a61-4fc9-4ebb-8324-d39a0871cfae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.872323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-43e49162-41f9-4d0b-aba6-fdfb7e313e95 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:22.882220 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-43e49162-41f9-4d0b-aba6-fdfb7e313e95 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.311951 Oct 05 17:47:22.884445 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1679/3570] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:22 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:22.889645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e652e957-3284-47ef-b538-fcc71616d611 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:22.890556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e652e957-3284-47ef-b538-fcc71616d611 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:22.897226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e652e957-3284-47ef-b538-fcc71616d611 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.898037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e652e957-3284-47ef-b538-fcc71616d611 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.898789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e652e957-3284-47ef-b538-fcc71616d611 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:22.899711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e652e957-3284-47ef-b538-fcc71616d611 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:22.903315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e652e957-3284-47ef-b538-fcc71616d611 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:22.904011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e652e957-3284-47ef-b538-fcc71616d611 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:23.040439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ac624a61-4fc9-4ebb-8324-d39a0871cfae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:23.051777 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac624a61-4fc9-4ebb-8324-d39a0871cfae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.308425 Oct 05 17:47:23.052739 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1892/3571] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:22 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:23.059108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:23.060033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:23.068897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:23.069941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:23.071099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:23.072385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:23.074066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:23.074922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:23.205036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:23.267557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:23.286849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:23.300821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c341268b-3775-4f3c-91af-6014b8f418a8 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1372 microversion: 2.57 time: 0.241978 Oct 05 17:47:23.302106 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1893/3572] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:23 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:23.308815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:23.309723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] [instance: 989ec240-1506-4643-b1e7-0a849f54db3d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:23.318560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:23.319453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:23.320994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:23.322075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:23.322823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:23.323488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:23.391810 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] HTTP exception thrown: Instance 989ec240-1506-4643-b1e7-0a849f54db3d could not be found. Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Request method failure captured: Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d HTTP/1.1 Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcKR_1et0FEBpvuu0JfKJDF05tVrRnOYpWEN73m5361L59Py0Pwwoc8bq4dPZUlj2ool4-X7o4pf8KiMHHMOOhljEabSj8Nhzn3fF3DbHF1D7HCPVImZisIYXVDnW32LVXNcKE2jgcFKuGOPVNMQUcYFQinBhCvm7JvHB9wUt5xnYhI Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 66a9e15f741c4d2ba29c84de6548b609 Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ListImageFiltersTestJSON-149902055 Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/66a9e15f741c4d2ba29c84de6548b609"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66a9e15f741c4d2ba29c84de6548b609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_66a9e15f741c4d2ba29c84de6548b609", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/66a9e15f741c4d2ba29c84de6548b609"}]}] Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ListImageFiltersTestJSON-149902055 Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 66a9e15f741c4d2ba29c84de6548b609 Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-149902055 Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ListImageFiltersTestJSON-149902055-project Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9fc5abcfae46458abd33c1cf827f6be4 Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ListImageFiltersTestJSON-149902055-project Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 989ec240-1506-4643-b1e7-0a849f54db3d could not be found. Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '989ec240-1506-4643-b1e7-0a849f54db3d'} Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 989ec240-1506-4643-b1e7-0a849f54db3d could not be found. Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 989ec240-1506-4643-b1e7-0a849f54db3d could not be found. Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:23.393588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:23.399694 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:23.399694 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:23.399694 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:23.399694 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:23.399694 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:23.399694 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 989ec240-1506-4643-b1e7-0a849f54db3d could not be found. Oct 05 17:47:23.399694 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:23.399694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Returning 404 to user: Instance 989ec240-1506-4643-b1e7-0a849f54db3d could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:23.399694 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e165ba44-4c4e-4fd4-90a0-51c13ba8491b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d" status: 404 len: 111 microversion: 2.1 time: 0.091115 Oct 05 17:47:23.399694 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1894/3573] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:23 2022] GET /compute/v2.1/servers/989ec240-1506-4643-b1e7-0a849f54db3d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:47:23.404844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e9662c99-7909-466c-b3b6-74cb9c38c953 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f777963e430>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:23.513316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e652e957-3284-47ef-b538-fcc71616d611 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:23.533331 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e652e957-3284-47ef-b538-fcc71616d611 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1523 microversion: 2.1 time: 0.646060 Oct 05 17:47:23.538054 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1680/3574] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:22 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1523 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:23.544557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:23.545777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:23.555257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:23.556490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:23.559658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:23.561397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:23.562174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:23.562737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:23.687078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:23.702096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:23.707652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:23.711298 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ea51a302-8d7b-469e-8f24-a8199a181795 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.171725 Oct 05 17:47:23.717819 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1681/3575] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:23 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:23.909166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5382addb-bc89-499c-8737-882dfb596227 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:23.909959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5382addb-bc89-499c-8737-882dfb596227 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:23.925014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5382addb-bc89-499c-8737-882dfb596227 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:23.925985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5382addb-bc89-499c-8737-882dfb596227 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:23.929149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5382addb-bc89-499c-8737-882dfb596227 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:23.931417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5382addb-bc89-499c-8737-882dfb596227 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:23.936990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5382addb-bc89-499c-8737-882dfb596227 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:23.937653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5382addb-bc89-499c-8737-882dfb596227 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:24.361897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5382addb-bc89-499c-8737-882dfb596227 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:24.392110 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5382addb-bc89-499c-8737-882dfb596227 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.486762 Oct 05 17:47:24.403802 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1682/3576] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:23 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:24.416705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-93fb686a-d34c-4cbc-9e85-42aedbc62279 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:24.418621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-93fb686a-d34c-4cbc-9e85-42aedbc62279 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:24.428502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93fb686a-d34c-4cbc-9e85-42aedbc62279 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:24.429198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93fb686a-d34c-4cbc-9e85-42aedbc62279 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:24.429800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93fb686a-d34c-4cbc-9e85-42aedbc62279 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:24.431021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93fb686a-d34c-4cbc-9e85-42aedbc62279 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:24.431651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93fb686a-d34c-4cbc-9e85-42aedbc62279 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:24.432365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93fb686a-d34c-4cbc-9e85-42aedbc62279 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:24.437322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:24.473076 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e9662c99-7909-466c-b3b6-74cb9c38c953 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "DELETE /compute/v2.1/images/a102d2cf-e475-4358-b00f-288b389a21e9" status: 204 len: 0 microversion: 2.1 time: 1.072419 Oct 05 17:47:24.473742 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1895/3577] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:23 2022] DELETE /compute/v2.1/images/a102d2cf-e475-4358-b00f-288b389a21e9 => generated 0 bytes in 1074 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:24.482646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5fc8b7d3-062c-4853-9feb-5890564e3d5b req-0a1eba01-fe28-47d3-a0c6-40f3b54fb695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd", "name": "network-vif-plugged", "status": "completed", "tag": "b9627811-9013-44a9-b7ff-0e44f3f9d2c9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:24.499256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5fc8b7d3-062c-4853-9feb-5890564e3d5b req-0a1eba01-fe28-47d3-a0c6-40f3b54fb695 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:24.500219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5fc8b7d3-062c-4853-9feb-5890564e3d5b req-0a1eba01-fe28-47d3-a0c6-40f3b54fb695 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:24.500886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5fc8b7d3-062c-4853-9feb-5890564e3d5b req-0a1eba01-fe28-47d3-a0c6-40f3b54fb695 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:24.517121 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5fc8b7d3-062c-4853-9feb-5890564e3d5b req-0a1eba01-fe28-47d3-a0c6-40f3b54fb695 service nova] Creating event network-vif-plugged:b9627811-9013-44a9-b7ff-0e44f3f9d2c9 for instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd on n-h1-835595-3 Oct 05 17:47:24.525426 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5fc8b7d3-062c-4853-9feb-5890564e3d5b req-0a1eba01-fe28-47d3-a0c6-40f3b54fb695 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049963 Oct 05 17:47:24.526672 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1896/3578] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:24.550787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:24.552826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:24.564271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:24.565562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:24.566210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:24.567252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:24.568020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:24.568704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:24.668914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-93fb686a-d34c-4cbc-9e85-42aedbc62279 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:24.686144 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-93fb686a-d34c-4cbc-9e85-42aedbc62279 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.280569 Oct 05 17:47:24.702514 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1683/3579] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:24 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:24.707617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d3a3d4b5-92b4-464b-90d4-f071464b396b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f77795fb280>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:24.713197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:24.723570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:24.729202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:24.731227 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fcd59456-508a-45d7-aeef-6a1b88e3196d tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1357 microversion: 2.57 time: 0.202483 Oct 05 17:47:24.733355 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1897/3580] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:24 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:24.739413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2313d9d6-1e04-40df-8cc4-8ba0bd84d252 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:24.752625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2313d9d6-1e04-40df-8cc4-8ba0bd84d252 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:24.763969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2313d9d6-1e04-40df-8cc4-8ba0bd84d252 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:24.764555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2313d9d6-1e04-40df-8cc4-8ba0bd84d252 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:24.765061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2313d9d6-1e04-40df-8cc4-8ba0bd84d252 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:24.765848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2313d9d6-1e04-40df-8cc4-8ba0bd84d252 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:24.766961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2313d9d6-1e04-40df-8cc4-8ba0bd84d252 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:24.767470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2313d9d6-1e04-40df-8cc4-8ba0bd84d252 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:24.981192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2313d9d6-1e04-40df-8cc4-8ba0bd84d252 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:24.990249 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2313d9d6-1e04-40df-8cc4-8ba0bd84d252 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1523 microversion: 2.1 time: 0.255625 Oct 05 17:47:24.991247 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1898/3581] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:24 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:24.996411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:24.997029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:25.004127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:25.004622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:25.005211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:25.005993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:25.006488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:25.006918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:25.098589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:25.127703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:25.129676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:25.131201 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9128e72d-a02d-4d85-a17c-02e4ef81d888 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.138996 Oct 05 17:47:25.132227 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1899/3582] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:24 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:25.137390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-55691fed-8f09-4b26-92a7-8bbd96e90972 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:25.137919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-55691fed-8f09-4b26-92a7-8bbd96e90972 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:25.144667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55691fed-8f09-4b26-92a7-8bbd96e90972 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:25.145158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55691fed-8f09-4b26-92a7-8bbd96e90972 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:25.145668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55691fed-8f09-4b26-92a7-8bbd96e90972 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:25.146420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55691fed-8f09-4b26-92a7-8bbd96e90972 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:25.146884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55691fed-8f09-4b26-92a7-8bbd96e90972 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:25.147310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55691fed-8f09-4b26-92a7-8bbd96e90972 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:25.152705 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d3a3d4b5-92b4-464b-90d4-f071464b396b tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "DELETE /compute/v2.1/images/f2a314da-4b93-4568-a67c-80c5b55dae51" status: 204 len: 0 microversion: 2.1 time: 0.448839 Oct 05 17:47:25.154533 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1684/3583] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:24 2022] DELETE /compute/v2.1/images/f2a314da-4b93-4568-a67c-80c5b55dae51 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:25.162247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-edb8abbf-6eba-4249-83c8-1583a2a15893 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] Calling method '.version_select at 0x7f7774d591f0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:25.194248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-55691fed-8f09-4b26-92a7-8bbd96e90972 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:47:25.301262 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-55691fed-8f09-4b26-92a7-8bbd96e90972 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 204 len: 0 microversion: 2.57 time: 0.167144 Oct 05 17:47:25.306793 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1900/3584] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:47:25 2022] DELETE /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:47:25.315419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:25.316328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:25.323642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:25.324138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:25.324580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:25.325450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:25.325915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:25.326387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:25.467962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:25.481373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:25.483503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:25.485206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76803b4c-7b6b-4f45-8413-5d1f698fca55 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1363 microversion: 2.57 time: 0.176612 Oct 05 17:47:25.486456 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1901/3585] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:25 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:25.494246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9fe9a1e6-d3fd-4c2d-a2c4-f0e5609a2f07 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:25.494894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9fe9a1e6-d3fd-4c2d-a2c4-f0e5609a2f07 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:25.501360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fe9a1e6-d3fd-4c2d-a2c4-f0e5609a2f07 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:25.501851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fe9a1e6-d3fd-4c2d-a2c4-f0e5609a2f07 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:25.502312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fe9a1e6-d3fd-4c2d-a2c4-f0e5609a2f07 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:25.503013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fe9a1e6-d3fd-4c2d-a2c4-f0e5609a2f07 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:25.503469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fe9a1e6-d3fd-4c2d-a2c4-f0e5609a2f07 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:25.504178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fe9a1e6-d3fd-4c2d-a2c4-f0e5609a2f07 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:25.707170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9fe9a1e6-d3fd-4c2d-a2c4-f0e5609a2f07 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:25.720150 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9fe9a1e6-d3fd-4c2d-a2c4-f0e5609a2f07 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1725 microversion: 2.1 time: 0.232601 Oct 05 17:47:25.727351 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1902/3586] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:25 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1725 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:25.738577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac3a1b3c-8e18-4663-84aa-ceafd5f025c8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:25.739562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac3a1b3c-8e18-4663-84aa-ceafd5f025c8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:25.748168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b3c-8e18-4663-84aa-ceafd5f025c8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:25.748168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b3c-8e18-4663-84aa-ceafd5f025c8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:25.748168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b3c-8e18-4663-84aa-ceafd5f025c8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:25.748514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b3c-8e18-4663-84aa-ceafd5f025c8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:25.748892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b3c-8e18-4663-84aa-ceafd5f025c8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:25.749280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac3a1b3c-8e18-4663-84aa-ceafd5f025c8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:25.751957 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-edb8abbf-6eba-4249-83c8-1583a2a15893 tempest-ListImageFiltersTestJSON-149902055 tempest-ListImageFiltersTestJSON-149902055-project] 10.222.0.70 "DELETE /compute/v2.1/images/ad3703ff-2a56-4b47-b034-74ffc130e4d6" status: 204 len: 0 microversion: 2.1 time: 0.593436 Oct 05 17:47:25.752983 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1685/3587] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:25 2022] DELETE /compute/v2.1/images/ad3703ff-2a56-4b47-b034-74ffc130e4d6 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:26.009647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ac3a1b3c-8e18-4663-84aa-ceafd5f025c8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:26.019247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1672ae21-d13b-4fb5-a865-053a35624ae7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:26.020278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1672ae21-d13b-4fb5-a865-053a35624ae7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:26.035247 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac3a1b3c-8e18-4663-84aa-ceafd5f025c8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.303564 Oct 05 17:47:26.054570 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1903/3588] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:25 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:26.055279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1672ae21-d13b-4fb5-a865-053a35624ae7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:26.057028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1672ae21-d13b-4fb5-a865-053a35624ae7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:26.057683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1672ae21-d13b-4fb5-a865-053a35624ae7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:26.058870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1672ae21-d13b-4fb5-a865-053a35624ae7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:26.059601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1672ae21-d13b-4fb5-a865-053a35624ae7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:26.060189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1672ae21-d13b-4fb5-a865-053a35624ae7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:26.158806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:26.159942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:26.170445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:26.177751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:26.178483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:26.179392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:26.180197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:26.180807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:26.340921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1672ae21-d13b-4fb5-a865-053a35624ae7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:26.347229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:26.350321 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1672ae21-d13b-4fb5-a865-053a35624ae7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1523 microversion: 2.1 time: 0.335294 Oct 05 17:47:26.350912 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1686/3589] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:26 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1523 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:26.360512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:26.363461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:26.364814 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9cdbf865-f5a4-4653-a2ec-a9c9f6dbe9b5 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.211665 Oct 05 17:47:26.366088 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1904/3590] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:26 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:47:26.514376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:26.516451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:26.527111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:26.527910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:26.528602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:26.529560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:26.530450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:26.531745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:26.620574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:26.629989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:26.631930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:26.633368 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e482d66c-6134-46ca-a6e8-296ef195d04c tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1363 microversion: 2.57 time: 0.124231 Oct 05 17:47:26.634630 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1687/3591] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:26 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1363 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:26.745332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f9800c1b-fa03-428e-89c4-7c69196c905b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:26.746619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f9800c1b-fa03-428e-89c4-7c69196c905b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:26.757352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9800c1b-fa03-428e-89c4-7c69196c905b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:26.758943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9800c1b-fa03-428e-89c4-7c69196c905b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:26.759479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9800c1b-fa03-428e-89c4-7c69196c905b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:26.760713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9800c1b-fa03-428e-89c4-7c69196c905b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:26.761342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9800c1b-fa03-428e-89c4-7c69196c905b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:26.761827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9800c1b-fa03-428e-89c4-7c69196c905b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:26.867200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-517627695", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "0ccfc34d-2c65-4344-9114-4b96b3845d6a"}], "block_device_mapping_v2": [{"uuid": "e02b8b4e-08af-4613-b085-60be3b8275cb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:26.977423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] validate_networks() for [('0ccfc34d-2c65-4344-9114-4b96b3845d6a', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:47:27.032349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f9800c1b-fa03-428e-89c4-7c69196c905b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:27.042746 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f9800c1b-fa03-428e-89c4-7c69196c905b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1702 microversion: 2.1 time: 0.301175 Oct 05 17:47:27.045219 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1905/3592] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:26 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1702 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:27.058427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-33fb6746-038b-4205-be0f-4cb8b00664a6 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:27.059427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-33fb6746-038b-4205-be0f-4cb8b00664a6 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:27.066029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33fb6746-038b-4205-be0f-4cb8b00664a6 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.067004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33fb6746-038b-4205-be0f-4cb8b00664a6 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.068081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33fb6746-038b-4205-be0f-4cb8b00664a6 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.069082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33fb6746-038b-4205-be0f-4cb8b00664a6 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.069770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33fb6746-038b-4205-be0f-4cb8b00664a6 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.070451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33fb6746-038b-4205-be0f-4cb8b00664a6 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.275605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-33fb6746-038b-4205-be0f-4cb8b00664a6 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:27.286344 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-33fb6746-038b-4205-be0f-4cb8b00664a6 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.231690 Oct 05 17:47:27.286973 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1906/3593] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:27 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:27.292754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ae24ba9-e2ca-4343-8401-c762fa4cb24e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:27.321163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ae24ba9-e2ca-4343-8401-c762fa4cb24e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.323766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ae24ba9-e2ca-4343-8401-c762fa4cb24e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.325305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ae24ba9-e2ca-4343-8401-c762fa4cb24e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.336045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:27.382553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ae24ba9-e2ca-4343-8401-c762fa4cb24e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Going to try to start instance {{(pid=128844) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 17:47:27.443036 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ae24ba9-e2ca-4343-8401-c762fa4cb24e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/action" status: 202 len: 0 microversion: 2.1 time: 0.154312 Oct 05 17:47:27.444048 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1907/3594] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:47:27 2022] POST /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:47:27.451304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fc83f004-77f7-4e2e-a0d6-fa332432669b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:27.452899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fc83f004-77f7-4e2e-a0d6-fa332432669b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:27.461517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc83f004-77f7-4e2e-a0d6-fa332432669b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.463026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc83f004-77f7-4e2e-a0d6-fa332432669b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.463501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc83f004-77f7-4e2e-a0d6-fa332432669b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.464466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc83f004-77f7-4e2e-a0d6-fa332432669b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.465188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc83f004-77f7-4e2e-a0d6-fa332432669b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.465628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc83f004-77f7-4e2e-a0d6-fa332432669b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.714787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fc83f004-77f7-4e2e-a0d6-fa332432669b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:27.733248 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fc83f004-77f7-4e2e-a0d6-fa332432669b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1508 microversion: 2.1 time: 0.287497 Oct 05 17:47:27.733866 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1908/3595] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:27 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:27.742680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:27.746961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:27.753348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.753846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.754314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.755090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.755961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.756396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.855102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:47:27.855721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:47:27.857046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:47:27.857554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:47:27.858047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:47:27.863793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:27.876566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.878407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.879130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.883190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.884023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.884726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.886580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:27.893090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:27.894754 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c31aa6c6-c84a-44fe-8ef1-eda1ede9a243 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1602 microversion: 2.32 time: 0.159728 Oct 05 17:47:27.908281 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1909/3596] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:27 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1602 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:27.908281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a25c781-61f3-4a69-b7ef-c74ef4ec3959 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:27.908281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4a25c781-61f3-4a69-b7ef-c74ef4ec3959 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:27.920540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a25c781-61f3-4a69-b7ef-c74ef4ec3959 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.923365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a25c781-61f3-4a69-b7ef-c74ef4ec3959 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.925684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a25c781-61f3-4a69-b7ef-c74ef4ec3959 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.927873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a25c781-61f3-4a69-b7ef-c74ef4ec3959 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:27.929973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a25c781-61f3-4a69-b7ef-c74ef4ec3959 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:27.930749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a25c781-61f3-4a69-b7ef-c74ef4ec3959 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:27.966237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Getting quotas for project f401d1367a73495598bb8a6b882e8618. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:27.983931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Getting quotas for user 695a37f439e94d2e860e51df835827e4 and project f401d1367a73495598bb8a6b882e8618. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:28.117621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:47:28.120182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e02b8b4e-08af-4613-b085-60be3b8275cb',volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:47:28.245382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4a25c781-61f3-4a69-b7ef-c74ef4ec3959 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:28.257542 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4a25c781-61f3-4a69-b7ef-c74ef4ec3959 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1711 microversion: 2.1 time: 0.360898 Oct 05 17:47:28.273269 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1910/3597] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:27 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1711 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:28.273269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:28.273269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:28.281338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:28.281950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:28.282627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:28.283409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:28.283958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:28.284675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:28.354230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:28.354230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:28.355012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:28.355680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lazy-loading 'fault' on Instance uuid a22f055b-27aa-47f4-9373-fc447f25c06b {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:47:28.408236 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53c9a59a-c3e7-4419-8b6e-d2c174b7bb24 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.547026 Oct 05 17:47:28.409853 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1688/3598] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:47:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:47:28.433517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:28.443027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:28.444715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86e92b168e88454d903867eb176df5f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4dc07cfdb43646c0977702870e3669f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:28.446216 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b954bfd3-6350-4486-b21f-c4fefbcc3e05 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 200 len: 1368 microversion: 2.57 time: 0.186298 Oct 05 17:47:28.447213 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1911/3599] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:28 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:28.448345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e788725-f1c6-4999-9f90-620c12053b81 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:28.453060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2ba14a8-6eca-4586-b1d5-002df1dbece3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:28.453680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c2ba14a8-6eca-4586-b1d5-002df1dbece3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:28.454769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e788725-f1c6-4999-9f90-620c12053b81 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:28.475490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e788725-f1c6-4999-9f90-620c12053b81 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:28.475614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ba14a8-6eca-4586-b1d5-002df1dbece3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:28.475738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e788725-f1c6-4999-9f90-620c12053b81 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:28.475839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ba14a8-6eca-4586-b1d5-002df1dbece3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:28.476172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e788725-f1c6-4999-9f90-620c12053b81 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:28.476312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ba14a8-6eca-4586-b1d5-002df1dbece3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:28.476914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ba14a8-6eca-4586-b1d5-002df1dbece3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:28.477062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e788725-f1c6-4999-9f90-620c12053b81 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:28.477369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e788725-f1c6-4999-9f90-620c12053b81 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:28.477486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ba14a8-6eca-4586-b1d5-002df1dbece3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:28.477811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e788725-f1c6-4999-9f90-620c12053b81 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:28.477930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ba14a8-6eca-4586-b1d5-002df1dbece3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:28.651972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c2ba14a8-6eca-4586-b1d5-002df1dbece3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:28.660383 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2ba14a8-6eca-4586-b1d5-002df1dbece3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.211549 Oct 05 17:47:28.675079 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1912/3600] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:28 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:28.725914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2e788725-f1c6-4999-9f90-620c12053b81 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:28.735977 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e788725-f1c6-4999-9f90-620c12053b81 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 200 len: 1508 microversion: 2.1 time: 0.324986 Oct 05 17:47:28.738122 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1689/3601] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:28 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 1508 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:28.744490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-66c44cfb-b2cf-42d2-9e7f-1125d6b6ada3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:28.747031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-66c44cfb-b2cf-42d2-9e7f-1125d6b6ada3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:28.896648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66c44cfb-b2cf-42d2-9e7f-1125d6b6ada3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:28.914270 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-66c44cfb-b2cf-42d2-9e7f-1125d6b6ada3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1052 microversion: 2.1 time: 0.173755 Oct 05 17:47:28.914970 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1690/3602] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:28 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1052 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:28.922610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b82acd6f-b15c-473c-a051-82f01664d635 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:28.923119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b82acd6f-b15c-473c-a051-82f01664d635 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:28.939471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b82acd6f-b15c-473c-a051-82f01664d635 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:28.941550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b82acd6f-b15c-473c-a051-82f01664d635 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:28.942974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b82acd6f-b15c-473c-a051-82f01664d635 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:28.944731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b82acd6f-b15c-473c-a051-82f01664d635 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:28.945215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b82acd6f-b15c-473c-a051-82f01664d635 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:28.945785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b82acd6f-b15c-473c-a051-82f01664d635 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:28.976248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7241d0f1-4347-4c49-a3c9-16b66a2fc6c1 tempest-ListImagesTestJSON-2100335976 tempest-ListImagesTestJSON-2100335976-project] Calling method '.version_select at 0x7f77747cf940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:28.981303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b82acd6f-b15c-473c-a051-82f01664d635 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:47:29.035951 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7241d0f1-4347-4c49-a3c9-16b66a2fc6c1 tempest-ListImagesTestJSON-2100335976 tempest-ListImagesTestJSON-2100335976-project] 10.222.0.70 "GET /compute/v2.1/images/0510c978-5936-46d4-9cc7-8d23f52ed26e" status: 200 len: 784 microversion: 2.1 time: 0.359384 Oct 05 17:47:29.036516 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1913/3603] 10.222.0.70 () {58 vars in 1233 bytes} [Wed Oct 5 17:47:28 2022] GET /compute/v2.1/images/0510c978-5936-46d4-9cc7-8d23f52ed26e => generated 784 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:29.047374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:29.050597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:29.061507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:29.062441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:29.063156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:29.064083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:29.064986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:29.065598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:29.101830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:29.102785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:29.103473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:29.104187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lazy-loading 'fault' on Instance uuid 5362ba2a-b905-484f-a7cf-d0c8757475ce {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:47:29.112771 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b82acd6f-b15c-473c-a051-82f01664d635 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 204 len: 0 microversion: 2.1 time: 0.196068 Oct 05 17:47:29.114640 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1691/3604] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:47:28 2022] DELETE /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:29.124855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c7b26851-1c10-48a3-9afe-c9babb5d073f tempest-ListImagesTestJSON-2100335976 tempest-ListImagesTestJSON-2100335976-project] Calling method '.version_select at 0x7f777966a3a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:29.173127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:29.182825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:29.184278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd3f3adea6b08459789a51e98b05cf50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3daa9043f854a7fb87e1ab2211690f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:29.189024 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e4630d39-ddae-4fc6-9a73-4f0d31931ad7 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 200 len: 1369 microversion: 2.32 time: 0.145792 Oct 05 17:47:29.191165 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1914/3605] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:29 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 1369 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:47:29.255742 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c7b26851-1c10-48a3-9afe-c9babb5d073f tempest-ListImagesTestJSON-2100335976 tempest-ListImagesTestJSON-2100335976-project] 10.222.0.70 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.138778 Oct 05 17:47:29.256961 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1692/3606] 10.222.0.70 () {58 vars in 1122 bytes} [Wed Oct 5 17:47:29 2022] GET /compute/v2.1/images => generated 445 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:29.269584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49680f5f-5b3d-4500-8908-ac3bb93f52f2 tempest-ListImagesTestJSON-2100335976 tempest-ListImagesTestJSON-2100335976-project] Calling method '.version_select at 0x7f7779569160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:29.284952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85175cc7-7d25-42ee-940c-34b6b310f267 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:29.285750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-85175cc7-7d25-42ee-940c-34b6b310f267 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:29.294830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85175cc7-7d25-42ee-940c-34b6b310f267 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:29.295391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85175cc7-7d25-42ee-940c-34b6b310f267 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:29.296240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85175cc7-7d25-42ee-940c-34b6b310f267 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:29.297137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85175cc7-7d25-42ee-940c-34b6b310f267 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:29.298471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85175cc7-7d25-42ee-940c-34b6b310f267 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:29.299497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85175cc7-7d25-42ee-940c-34b6b310f267 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:29.329397 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49680f5f-5b3d-4500-8908-ac3bb93f52f2 tempest-ListImagesTestJSON-2100335976 tempest-ListImagesTestJSON-2100335976-project] 10.222.0.70 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.063632 Oct 05 17:47:29.330491 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1915/3607] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:47:29 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:29.343728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1212328774", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "941b871a-4b4c-4da8-8d9e-bb2ee1c9a341"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:29.419307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] validate_networks() for [('941b871a-4b4c-4da8-8d9e-bb2ee1c9a341', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:47:29.488276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85175cc7-7d25-42ee-940c-34b6b310f267 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:29.497976 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85175cc7-7d25-42ee-940c-34b6b310f267 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1711 microversion: 2.1 time: 0.220738 Oct 05 17:47:29.500148 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1693/3608] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:29 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1711 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:29.519366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:29.522612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] [instance: a22f055b-27aa-47f4-9373-fc447f25c06b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:29.540027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:29.540504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:29.543178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:29.543959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:29.545478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:29.545999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:29.573422 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] HTTP exception thrown: Instance a22f055b-27aa-47f4-9373-fc447f25c06b could not be found. Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Request method failure captured: Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b HTTP/1.1 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcL_StrOyujvb2VwtzvB6wl0mNv2aHAoWkW2Su82Le04Lm7kVVZIFbUJsctYVHwvoG4gT0Yy71FjahRLJ48J_1O1VE9O3EUjmteOpDdM6eTMfR_T01eX2RXOUGkS8UoEtGWw4tavNx4Lq6lb4noigGENZoh3Drevu9HCpqrGlyH0bAQ Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.57 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4dc07cfdb43646c0977702870e3669f3 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerShowV257Test-1261151874 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4dc07cfdb43646c0977702870e3669f3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4dc07cfdb43646c0977702870e3669f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4dc07cfdb43646c0977702870e3669f3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4dc07cfdb43646c0977702870e3669f3"}]}] Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerShowV257Test-1261151874 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4dc07cfdb43646c0977702870e3669f3 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerShowV257Test-1261151874 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerShowV257Test-1261151874-project Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 86e92b168e88454d903867eb176df5f8 Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerShowV257Test-1261151874-project Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a22f055b-27aa-47f4-9373-fc447f25c06b could not be found. Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a22f055b-27aa-47f4-9373-fc447f25c06b'} Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a22f055b-27aa-47f4-9373-fc447f25c06b could not be found. Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a22f055b-27aa-47f4-9373-fc447f25c06b could not be found. Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:29.575197 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:29.579878 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:29.579878 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:29.579878 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:29.579878 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:29.579878 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:29.579878 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a22f055b-27aa-47f4-9373-fc447f25c06b could not be found. Oct 05 17:47:29.579878 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:29.579878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] Returning 404 to user: Instance a22f055b-27aa-47f4-9373-fc447f25c06b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:29.579878 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-615689bb-5966-4a90-a759-4955c00e7af3 tempest-ServerShowV257Test-1261151874 tempest-ServerShowV257Test-1261151874-project] 10.222.0.70 "GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b" status: 404 len: 111 microversion: 2.57 time: 0.075257 Oct 05 17:47:29.579878 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1694/3609] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:29 2022] GET /compute/v2.1/servers/a22f055b-27aa-47f4-9373-fc447f25c06b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:47:29.694649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9b432d1a-4bae-46b4-9d9b-b74b0216f01f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:29.697019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9b432d1a-4bae-46b4-9d9b-b74b0216f01f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:29.713718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b432d1a-4bae-46b4-9d9b-b74b0216f01f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:29.714985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b432d1a-4bae-46b4-9d9b-b74b0216f01f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:29.715697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b432d1a-4bae-46b4-9d9b-b74b0216f01f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:29.724983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b432d1a-4bae-46b4-9d9b-b74b0216f01f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:29.725795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b432d1a-4bae-46b4-9d9b-b74b0216f01f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:29.726644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b432d1a-4bae-46b4-9d9b-b74b0216f01f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:29.969582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9b432d1a-4bae-46b4-9d9b-b74b0216f01f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:29.982812 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9b432d1a-4bae-46b4-9d9b-b74b0216f01f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.297414 Oct 05 17:47:29.992384 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1695/3610] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:29 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:30.003543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52cfbc95-a9d2-499b-9aad-7a24ed3abe74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:30.005257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-52cfbc95-a9d2-499b-9aad-7a24ed3abe74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:30.009345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:30.017647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52cfbc95-a9d2-499b-9aad-7a24ed3abe74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:30.018712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52cfbc95-a9d2-499b-9aad-7a24ed3abe74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:30.019334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52cfbc95-a9d2-499b-9aad-7a24ed3abe74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:30.020656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52cfbc95-a9d2-499b-9aad-7a24ed3abe74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:30.021279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52cfbc95-a9d2-499b-9aad-7a24ed3abe74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:30.022346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52cfbc95-a9d2-499b-9aad-7a24ed3abe74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:30.034498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:47:30.035554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:47:30.037287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:47:30.037989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:47:30.038586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:47:30.058710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:30.060115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:30.060938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:30.061869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:30.062533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:30.063352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:30.084909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Getting quotas for project 322009e2b6f2443c9c3e8f0a43bd7567. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:30.090904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Getting quotas for user 8878ab6c93164071bb4602782e3d5e5c and project 322009e2b6f2443c9c3e8f0a43bd7567. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:30.106378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:47:30.109598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:47:30.136746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-52cfbc95-a9d2-499b-9aad-7a24ed3abe74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:30.148099 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-52cfbc95-a9d2-499b-9aad-7a24ed3abe74 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1150 microversion: 2.1 time: 0.154367 Oct 05 17:47:30.149013 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1696/3611] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:29 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1150 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:30.182893 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8129c328-7b14-415e-957c-d92f7a2833dc tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.850945 Oct 05 17:47:30.184013 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1916/3612] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:47:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:47:30.199314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cd5e6644-06b2-48a9-9b77-be0c8bdb08ac tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:30.199940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cd5e6644-06b2-48a9-9b77-be0c8bdb08ac tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:30.221471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:30.222238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:30.233184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:30.233675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:30.234104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:30.234850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:30.236403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:30.237013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:30.257785 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] HTTP exception thrown: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Request method failure captured: Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce HTTP/1.1 Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcFvZ20c3Km-TzNCLlsFir23z6Dpd3CTyiPQY6AN2GMIBv3a0vV8kfwGtm7YStevz5655IgGr-YOaGNjH7PmEq-mOX3Qqadx3KWOdeIUkrYgJoY44BX4zITPYww_IgmbN3-pFzfTxFe9UyfpL9C27j3MW-7SbJU9tvBfBjitDTdY-_Q Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.32 Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: e3daa9043f854a7fb87e1ab2211690f8 Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TaggedBootDevicesTest-574456844 Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e3daa9043f854a7fb87e1ab2211690f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e3daa9043f854a7fb87e1ab2211690f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e3daa9043f854a7fb87e1ab2211690f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e3daa9043f854a7fb87e1ab2211690f8"}]}] Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TaggedBootDevicesTest-574456844 Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: e3daa9043f854a7fb87e1ab2211690f8 Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TaggedBootDevicesTest-574456844 Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TaggedBootDevicesTest-574456844-project Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: d3f3adea6b08459789a51e98b05cf50a Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TaggedBootDevicesTest-574456844-project Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '5362ba2a-b905-484f-a7cf-d0c8757475ce'} Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:30.260371 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:30.265872 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:30.265872 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:30.265872 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:30.265872 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:30.265872 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:30.265872 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:30.265872 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:30.267875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Returning 404 to user: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:30.268912 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-499135bf-7628-4c12-afd3-3d9a7d7747d8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 404 len: 111 microversion: 2.32 time: 0.051760 Oct 05 17:47:30.270031 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1917/3613] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:30 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:47:30.282392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78519017-a28e-4873-9e42-34f154691065 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '.version_select at 0x7f7775127160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:30.296457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:30.320493 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78519017-a28e-4873-9e42-34f154691065 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657021971" status: 204 len: 0 microversion: 2.32 time: 0.046109 Oct 05 17:47:30.321712 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1918/3614] 10.222.0.70 () {60 vars in 1259 bytes} [Wed Oct 5 17:47:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657021971 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:47:30.499925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cd5e6644-06b2-48a9-9b77-be0c8bdb08ac tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:30.508810 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cd5e6644-06b2-48a9-9b77-be0c8bdb08ac tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1218 microversion: 2.1 time: 0.317131 Oct 05 17:47:30.511438 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1697/3615] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:30 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1218 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:30.528533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0b6e5606-982e-4822-ae4f-728eecce3774 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:30.529657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0b6e5606-982e-4822-ae4f-728eecce3774 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:30.546986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b6e5606-982e-4822-ae4f-728eecce3774 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:30.547929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b6e5606-982e-4822-ae4f-728eecce3774 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:30.548630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b6e5606-982e-4822-ae4f-728eecce3774 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:30.564260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b6e5606-982e-4822-ae4f-728eecce3774 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:30.568524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b6e5606-982e-4822-ae4f-728eecce3774 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:30.569318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b6e5606-982e-4822-ae4f-728eecce3774 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:31.006758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9cedd43f-3bf2-4399-8f86-58cb927d3044 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:31.007367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9cedd43f-3bf2-4399-8f86-58cb927d3044 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:31.019334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cedd43f-3bf2-4399-8f86-58cb927d3044 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:31.022920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cedd43f-3bf2-4399-8f86-58cb927d3044 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:31.023573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cedd43f-3bf2-4399-8f86-58cb927d3044 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:31.024483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cedd43f-3bf2-4399-8f86-58cb927d3044 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:31.035114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cedd43f-3bf2-4399-8f86-58cb927d3044 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:31.038975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cedd43f-3bf2-4399-8f86-58cb927d3044 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:31.377243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0b6e5606-982e-4822-ae4f-728eecce3774 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:31.391048 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0b6e5606-982e-4822-ae4f-728eecce3774 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1715 microversion: 2.1 time: 0.867072 Oct 05 17:47:31.393413 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1919/3616] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:30 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1715 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:31.406984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-248cdf6b-ca96-4c69-8375-334af3db895f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:31.409981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-248cdf6b-ca96-4c69-8375-334af3db895f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:31.427966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-248cdf6b-ca96-4c69-8375-334af3db895f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:31.429395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-248cdf6b-ca96-4c69-8375-334af3db895f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:31.431740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-248cdf6b-ca96-4c69-8375-334af3db895f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:31.434109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-248cdf6b-ca96-4c69-8375-334af3db895f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:31.437283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-248cdf6b-ca96-4c69-8375-334af3db895f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:31.438034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-248cdf6b-ca96-4c69-8375-334af3db895f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:31.615983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-248cdf6b-ca96-4c69-8375-334af3db895f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:31.633366 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-248cdf6b-ca96-4c69-8375-334af3db895f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1168 microversion: 2.1 time: 0.237664 Oct 05 17:47:31.633966 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1920/3617] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:31 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1168 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:31.652403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9018048a-eff4-42f4-8987-b23118662075 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:31.655526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9018048a-eff4-42f4-8987-b23118662075 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:31.681935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9018048a-eff4-42f4-8987-b23118662075 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:31.683826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9018048a-eff4-42f4-8987-b23118662075 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:31.684429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9018048a-eff4-42f4-8987-b23118662075 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:31.686236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9018048a-eff4-42f4-8987-b23118662075 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:31.687837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9018048a-eff4-42f4-8987-b23118662075 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:31.689280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9018048a-eff4-42f4-8987-b23118662075 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:31.926120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9cedd43f-3bf2-4399-8f86-58cb927d3044 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:31.941192 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9cedd43f-3bf2-4399-8f86-58cb927d3044 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.938257 Oct 05 17:47:31.964078 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1698/3618] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:31 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:32.065194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9018048a-eff4-42f4-8987-b23118662075 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:32.078219 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9018048a-eff4-42f4-8987-b23118662075 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1270 microversion: 2.1 time: 0.441272 Oct 05 17:47:32.078993 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1921/3619] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:31 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1270 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:32.660284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29d45a67-80e2-4b34-912f-66e8d7e26bcb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:32.662048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29d45a67-80e2-4b34-912f-66e8d7e26bcb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:32.676357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d45a67-80e2-4b34-912f-66e8d7e26bcb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:32.681233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d45a67-80e2-4b34-912f-66e8d7e26bcb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:32.687045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d45a67-80e2-4b34-912f-66e8d7e26bcb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:32.688267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d45a67-80e2-4b34-912f-66e8d7e26bcb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:32.690499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d45a67-80e2-4b34-912f-66e8d7e26bcb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:32.692399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29d45a67-80e2-4b34-912f-66e8d7e26bcb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:32.973016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c7758040-5701-4ad1-a444-2309544479b1 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:32.974622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c7758040-5701-4ad1-a444-2309544479b1 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:32.990703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7758040-5701-4ad1-a444-2309544479b1 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:32.992625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7758040-5701-4ad1-a444-2309544479b1 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:32.993453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7758040-5701-4ad1-a444-2309544479b1 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:32.995743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7758040-5701-4ad1-a444-2309544479b1 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:32.996540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7758040-5701-4ad1-a444-2309544479b1 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:32.998001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7758040-5701-4ad1-a444-2309544479b1 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:33.531830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c7758040-5701-4ad1-a444-2309544479b1 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:33.541942 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c7758040-5701-4ad1-a444-2309544479b1 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.574023 Oct 05 17:47:33.542916 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1922/3620] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:32 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:33.573348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b2165f0-8b16-4ad1-b53f-721b3b04960c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:33.575101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1b2165f0-8b16-4ad1-b53f-721b3b04960c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:33.589983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b2165f0-8b16-4ad1-b53f-721b3b04960c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:33.590770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b2165f0-8b16-4ad1-b53f-721b3b04960c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:33.594456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b2165f0-8b16-4ad1-b53f-721b3b04960c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:33.596312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b2165f0-8b16-4ad1-b53f-721b3b04960c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:33.596914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b2165f0-8b16-4ad1-b53f-721b3b04960c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:33.597454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b2165f0-8b16-4ad1-b53f-721b3b04960c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:33.776994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b2165f0-8b16-4ad1-b53f-721b3b04960c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:33.789463 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b2165f0-8b16-4ad1-b53f-721b3b04960c tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1276 microversion: 2.1 time: 0.230966 Oct 05 17:47:33.790067 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1923/3621] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:33 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1276 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:33.813561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d906782f-c179-4157-8c4d-7a62caaa7144 req-28283f9e-84e4-4282-9a35-a4336d3ea327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd", "name": "network-vif-deleted", "tag": "b9627811-9013-44a9-b7ff-0e44f3f9d2c9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:33.840817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d906782f-c179-4157-8c4d-7a62caaa7144 req-28283f9e-84e4-4282-9a35-a4336d3ea327 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:33.841567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d906782f-c179-4157-8c4d-7a62caaa7144 req-28283f9e-84e4-4282-9a35-a4336d3ea327 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:33.843996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29d45a67-80e2-4b34-912f-66e8d7e26bcb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:33.844927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d906782f-c179-4157-8c4d-7a62caaa7144 req-28283f9e-84e4-4282-9a35-a4336d3ea327 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:33.855767 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29d45a67-80e2-4b34-912f-66e8d7e26bcb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1210 microversion: 2.1 time: 1.199709 Oct 05 17:47:33.856360 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1699/3622] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:32 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1210 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:33.881916 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d906782f-c179-4157-8c4d-7a62caaa7144 req-28283f9e-84e4-4282-9a35-a4336d3ea327 service nova] Creating event network-vif-deleted:b9627811-9013-44a9-b7ff-0e44f3f9d2c9 for instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd on n-h1-835595-3 Oct 05 17:47:33.908515 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d906782f-c179-4157-8c4d-7a62caaa7144 req-28283f9e-84e4-4282-9a35-a4336d3ea327 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107082 Oct 05 17:47:33.913707 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1924/3623] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:34.263691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab4c6420-2b30-4a8e-b144-1f7d2b9eae20 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Action: 'create', calling method: .version_select at 0x7f77747c53a0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5x0pF+zRokvg1neuvVduCvCDJ1bHpEcMTqttSIxoneU2NJxipo2PGTc6/13IMZRcCooLO1NB4yNPHwQ5JVLGwf/8qA5E49dCjWTD8yfEKrQpJZqTFWdWLO7b/TaDzMLQ=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:34.264365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-553540fc-78f1-4ced-8503-d46bf665c354 tempest-QuotasTestJSON-1522460627 tempest-QuotasTestJSON-1522460627-project] Calling method '.version_select at 0x7f7774672b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab4c6420-2b30-4a8e-b144-1f7d2b9eae20 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Request method failure captured: Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 257 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcM1aRMHTzieFXGB51xE8n8RzHHwuK8olGlFhihPxiFxAyQmJJFTQ7X_sSqmAUz5UwgRWHILedhx7LZUXDQDTwflBXa07PAuHllHg7065pwJIdTBOnV8idLaCE9YqST5Y5fzDU18Amew-9PXBQNEefWvlSsgv0XzYOJXYoo2elCXX6A Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe5d687ab67a4f788790bd12da56a503", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}] Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5x0pF+zRokvg1neuvVduCvCDJ1bHpEcMTqttSIxoneU2NJxipo2PGTc6/13IMZRcCooLO1NB4yNPHwQ5JVLGwf/8qA5E49dCjWTD8yfEKrQpJZqTFWdWLO7b/TaDzMLQ=="}} Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5x0pF+zRokvg1neuvVduCvCDJ1bHpEcMTqttSIxoneU2NJxipo2PGTc6/13IMZRcCooLO1NB4yNPHwQ5JVLGwf/8qA5E49dCjWTD8yfEKrQpJZqTFWdWLO7b/TaDzMLQ=='}}} Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 05 17:47:34.270343 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 05 17:47:34.276090 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.285749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab4c6420-2b30-4a8e-b144-1f7d2b9eae20 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:34.285749 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab4c6420-2b30-4a8e-b144-1f7d2b9eae20 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.278947 Oct 05 17:47:34.285749 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1925/3624] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:47:33 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:47:34.313875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-531e972d-bc69-4754-be2f-8a8e98faf675 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Action: 'create', calling method: .version_select at 0x7f77747cf820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1517653337", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:34.340238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-531e972d-bc69-4754-be2f-8a8e98faf675 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Getting quotas for project fe5d687ab67a4f788790bd12da56a503. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:34.351284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-531e972d-bc69-4754-be2f-8a8e98faf675 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Getting quotas for user 005d8c90c3374ac8b98897cc32fd5d55 and project fe5d687ab67a4f788790bd12da56a503. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:34.387141 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-531e972d-bc69-4754-be2f-8a8e98faf675 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:34.393651 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-553540fc-78f1-4ced-8503-d46bf665c354 tempest-QuotasTestJSON-1522460627 tempest-QuotasTestJSON-1522460627-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/62ed03a5557f49e4b17f4a38ba481e85/defaults" status: 200 len: 371 microversion: 2.1 time: 0.459661 Oct 05 17:47:34.401046 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1700/3625] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:47:33 2022] GET /compute/v2.1/os-quota-sets/62ed03a5557f49e4b17f4a38ba481e85/defaults => generated 371 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:34.401046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4851bb86-fcae-467a-9e60-7fa08715a95e req-a45bac8a-bd3b-4be5-bd10-caecc67e4b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637528bb-a7bd-49c4-baf5-f63095788532", "tag": "b0f1bad7-bd89-4f62-bd96-6e8439a2671b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-531e972d-bc69-4754-be2f-8a8e98faf675 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Request method failure captured: Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 2167 Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcM1aRMHTzieFXGB51xE8n8RzHHwuK8olGlFhihPxiFxAyQmJJFTQ7X_sSqmAUz5UwgRWHILedhx7LZUXDQDTwflBXa07PAuHllHg7065pwJIdTBOnV8idLaCE9YqST5Y5fzDU18Amew-9PXBQNEefWvlSsgv0XzYOJXYoo2elCXX6A Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe5d687ab67a4f788790bd12da56a503", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}] Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1517653337", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:47:34.407666 n-d-835595-3 devstack@n-api.service[128844]: exception: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1517653337', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:34.410660 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:34.414009 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.418932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-531e972d-bc69-4754-be2f-8a8e98faf675 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:34.418932 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-531e972d-bc69-4754-be2f-8a8e98faf675 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.129867 Oct 05 17:47:34.419421 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1926/3626] 10.222.0.70 () {60 vars in 1160 bytes} [Wed Oct 5 17:47:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 133 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:47:34.426169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2cef6df6-15e3-455b-8f31-bd4b93f9c094 tempest-QuotasTestJSON-1522460627 tempest-QuotasTestJSON-1522460627-project] Calling method '.version_select at 0x7f77747ccb80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:34.440562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4851bb86-fcae-467a-9e60-7fa08715a95e req-a45bac8a-bd3b-4be5-bd10-caecc67e4b35 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:34.441272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4851bb86-fcae-467a-9e60-7fa08715a95e req-a45bac8a-bd3b-4be5-bd10-caecc67e4b35 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:34.443170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4851bb86-fcae-467a-9e60-7fa08715a95e req-a45bac8a-bd3b-4be5-bd10-caecc67e4b35 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:34.477344 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4851bb86-fcae-467a-9e60-7fa08715a95e req-a45bac8a-bd3b-4be5-bd10-caecc67e4b35 service nova] Creating event network-changed:b0f1bad7-bd89-4f62-bd96-6e8439a2671b for instance 637528bb-a7bd-49c4-baf5-f63095788532 on n-h2-835595-3 Oct 05 17:47:34.490168 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4851bb86-fcae-467a-9e60-7fa08715a95e req-a45bac8a-bd3b-4be5-bd10-caecc67e4b35 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093503 Oct 05 17:47:34.491714 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1701/3627] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:34.508215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ac362bb-55f0-4e7c-9e2c-d781503cbaf2 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Action: 'create', calling method: .version_select at 0x7f77749a2160>, body: {"keypair": {"name": "tempest-keypair-1272587486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyjeEqle61XJ/HHN6eAbmJJ6ofrcl2OxDNGNu2+mSDEPoozc2RCC53Jh2LdbKNoslfdAzhqGJpEg7IS8uOkzZocJ5MwNgLaICXg8Q9IKfQjkhwbKL/RgqwmTjYmTCXYsw=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:34.532821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-8ac362bb-55f0-4e7c-9e2c-d781503cbaf2 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Getting quotas for project fe5d687ab67a4f788790bd12da56a503. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:34.539225 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2cef6df6-15e3-455b-8f31-bd4b93f9c094 tempest-QuotasTestJSON-1522460627 tempest-QuotasTestJSON-1522460627-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/62ed03a5557f49e4b17f4a38ba481e85" status: 200 len: 371 microversion: 2.1 time: 0.118548 Oct 05 17:47:34.540622 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1927/3628] 10.222.0.70 () {58 vars in 1242 bytes} [Wed Oct 5 17:47:34 2022] GET /compute/v2.1/os-quota-sets/62ed03a5557f49e4b17f4a38ba481e85 => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:34.541434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-8ac362bb-55f0-4e7c-9e2c-d781503cbaf2 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Getting quotas for user 005d8c90c3374ac8b98897cc32fd5d55 and project fe5d687ab67a4f788790bd12da56a503. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:34.555405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1653c505-dbb6-438f-8161-c61d9c77a30d tempest-QuotasTestJSON-1522460627 tempest-QuotasTestJSON-1522460627-project] Calling method '.version_select at 0x7f77743fd5e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:34.601548 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8ac362bb-55f0-4e7c-9e2c-d781503cbaf2 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107675 Oct 05 17:47:34.603005 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1702/3629] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:47:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:34.608885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-363baf37-93ba-449e-944a-2482b4f121ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:34.611456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-363baf37-93ba-449e-944a-2482b4f121ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:34.627915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363baf37-93ba-449e-944a-2482b4f121ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:34.629329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363baf37-93ba-449e-944a-2482b4f121ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:34.629329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363baf37-93ba-449e-944a-2482b4f121ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:34.631400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363baf37-93ba-449e-944a-2482b4f121ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:34.631811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363baf37-93ba-449e-944a-2482b4f121ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:34.632255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-363baf37-93ba-449e-944a-2482b4f121ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:34.655214 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1653c505-dbb6-438f-8161-c61d9c77a30d tempest-QuotasTestJSON-1522460627 tempest-QuotasTestJSON-1522460627-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/62ed03a5557f49e4b17f4a38ba481e85/defaults" status: 200 len: 371 microversion: 2.1 time: 0.103623 Oct 05 17:47:34.655831 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1928/3630] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:47:34 2022] GET /compute/v2.1/os-quota-sets/62ed03a5557f49e4b17f4a38ba481e85/defaults => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:47:34.675392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0a331db7-918a-4f1a-8ed6-4e51b489f5a0 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Action: 'create', calling method: .version_select at 0x7f7779612670>, body: {"keypair": {"name": "tempest-keypair-1272587486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqIX+gdphp41QsUPYHPtZoHOv5FfcyxZB5AXY2PKRVac7CNWUmVvXatxOSQJKZ0flHsa2WLybcGSQ8jENF8rQOPLmNR16V0nQwwy2nT9J4u9hI5u3HKG3ZxPVRkuAXUCA=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:34.723819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a331db7-918a-4f1a-8ed6-4e51b489f5a0 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Getting quotas for project fe5d687ab67a4f788790bd12da56a503. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:34.734524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a331db7-918a-4f1a-8ed6-4e51b489f5a0 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Getting quotas for user 005d8c90c3374ac8b98897cc32fd5d55 and project fe5d687ab67a4f788790bd12da56a503. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:34.803025 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-0a331db7-918a-4f1a-8ed6-4e51b489f5a0 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] HTTP exception thrown: Key pair 'tempest-keypair-1272587486' already exists. Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0a331db7-918a-4f1a-8ed6-4e51b489f5a0 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Request method failure captured: Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 273 Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcM1aRMHTzieFXGB51xE8n8RzHHwuK8olGlFhihPxiFxAyQmJJFTQ7X_sSqmAUz5UwgRWHILedhx7LZUXDQDTwflBXa07PAuHllHg7065pwJIdTBOnV8idLaCE9YqST5Y5fzDU18Amew-9PXBQNEefWvlSsgv0XzYOJXYoo2elCXX6A Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe5d687ab67a4f788790bd12da56a503", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}] Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: {"keypair": {"name": "tempest-keypair-1272587486", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqIX+gdphp41QsUPYHPtZoHOv5FfcyxZB5AXY2PKRVac7CNWUmVvXatxOSQJKZ0flHsa2WLybcGSQ8jENF8rQOPLmNR16V0nQwwy2nT9J4u9hI5u3HKG3ZxPVRkuAXUCA=="}} Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: exception: Key pair 'tempest-keypair-1272587486' already exists. Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1272587486', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqIX+gdphp41QsUPYHPtZoHOv5FfcyxZB5AXY2PKRVac7CNWUmVvXatxOSQJKZ0flHsa2WLybcGSQ8jENF8rQOPLmNR16V0nQwwy2nT9J4u9hI5u3HKG3ZxPVRkuAXUCA=='}}} Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result.read() Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '005d8c90c3374ac8b98897cc32fd5d55-tempest-keypair-1272587486' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 05 17:47:34.818408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi session.flush() Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result.read() Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 05 17:47:34.823288 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '005d8c90c3374ac8b98897cc32fd5d55-tempest-keypair-1272587486' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 5, 17, 47, 34, 789015), 'updated_at': None, 'name': 'tempest-keypair-1272587486', 'user_id': '005d8c90c3374ac8b98897cc32fd5d55', 'fingerprint': '22:27:0c:00:60:8a:56:bf:4f:ca:1b:85:fd:a6:8e:bc', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqIX+gdphp41QsUPYHPtZoHOv5FfcyxZB5AXY2PKRVac7CNWUmVvXatxOSQJKZ0flHsa2WLybcGSQ8jENF8rQOPLmNR16V0nQwwy2nT9J4u9hI5u3HKG3ZxPVRkuAXUCA==', 'type': 'ssh'}] Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi keypair.create() Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._create() Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1272587486' already exists. Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 05 17:47:34.828721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1272587486' already exists. Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1272587486' already exists. Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:34.838842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0a331db7-918a-4f1a-8ed6-4e51b489f5a0 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Returning 409 to user: Key pair 'tempest-keypair-1272587486' already exists. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:34.843089 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0a331db7-918a-4f1a-8ed6-4e51b489f5a0 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.183558 Oct 05 17:47:34.843909 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1929/3631] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:47:34 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:47:34.860040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f4bfcca2-8f2a-49d9-b341-6e063ef147b9 tempest-QuotasTestJSON-1522460627 tempest-QuotasTestJSON-1522460627-project] Calling method '.version_select at 0x7f77795abee0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:34.994733 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f4bfcca2-8f2a-49d9-b341-6e063ef147b9 tempest-QuotasTestJSON-1522460627 tempest-QuotasTestJSON-1522460627-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/62ed03a5557f49e4b17f4a38ba481e85" status: 200 len: 371 microversion: 2.1 time: 0.148103 Oct 05 17:47:35.001962 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1930/3632] 10.222.0.70 () {58 vars in 1242 bytes} [Wed Oct 5 17:47:34 2022] GET /compute/v2.1/os-quota-sets/62ed03a5557f49e4b17f4a38ba481e85 => generated 371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:35.006890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64d3c974-9834-4564-ad23-331d7af3d3c2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:35.007640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-64d3c974-9834-4564-ad23-331d7af3d3c2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:35.029132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d3c974-9834-4564-ad23-331d7af3d3c2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:35.029882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d3c974-9834-4564-ad23-331d7af3d3c2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:35.030425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d3c974-9834-4564-ad23-331d7af3d3c2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:35.031774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d3c974-9834-4564-ad23-331d7af3d3c2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:35.032445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d3c974-9834-4564-ad23-331d7af3d3c2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:35.033795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d3c974-9834-4564-ad23-331d7af3d3c2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:35.179880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-64d3c974-9834-4564-ad23-331d7af3d3c2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:35.186272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-363baf37-93ba-449e-944a-2482b4f121ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:35.207711 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-363baf37-93ba-449e-944a-2482b4f121ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.603097 Oct 05 17:47:35.208330 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1703/3633] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:34 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:35.213112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9868084-79b2-4485-b621-067823ece905 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Calling method '.version_select at 0x7f77794c6f70>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:35.241266 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-64d3c974-9834-4564-ad23-331d7af3d3c2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1276 microversion: 2.1 time: 0.243847 Oct 05 17:47:35.243962 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1931/3634] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:34 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:35.265584 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c9868084-79b2-4485-b621-067823ece905 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272587486" status: 202 len: 0 microversion: 2.1 time: 0.055955 Oct 05 17:47:35.281086 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1704/3635] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 17:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1272587486 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:47:35.306223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-787d561a-64e5-4ead-8211-4dc442535b90 tempest-QuotasTestJSON-1522460627 tempest-QuotasTestJSON-1522460627-project] Calling method '.version_select at 0x7f77749a2670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:35.343760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5f1957f-e900-4f69-bd88-b9083cfd70ed tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:35.358334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5f1957f-e900-4f69-bd88-b9083cfd70ed tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:35.441415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5f1957f-e900-4f69-bd88-b9083cfd70ed tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:35.442199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5f1957f-e900-4f69-bd88-b9083cfd70ed tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:35.442909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5f1957f-e900-4f69-bd88-b9083cfd70ed tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:35.443829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5f1957f-e900-4f69-bd88-b9083cfd70ed tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:35.447157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5f1957f-e900-4f69-bd88-b9083cfd70ed tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:35.451058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5f1957f-e900-4f69-bd88-b9083cfd70ed tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:35.509630 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-787d561a-64e5-4ead-8211-4dc442535b90 tempest-QuotasTestJSON-1522460627 tempest-QuotasTestJSON-1522460627-project] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/62ed03a5557f49e4b17f4a38ba481e85?user_id=9e88502f7d2c471a92339e01d9fbee22" status: 200 len: 371 microversion: 2.1 time: 0.213762 Oct 05 17:47:35.511163 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1705/3636] 10.222.0.70 () {58 vars in 1323 bytes} [Wed Oct 5 17:47:35 2022] GET /compute/v2.1/os-quota-sets/62ed03a5557f49e4b17f4a38ba481e85?user_id=9e88502f7d2c471a92339e01d9fbee22 => generated 371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:35.517772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2431e18-b2b0-494d-9545-c4ea9dffa2f4 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Action: 'create', calling method: .version_select at 0x7f77749a6f70>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFawck8n1borFWzQd6g0wIGELV/SxFIvQjGTII29LYOx2WoxE4ona5cXneH7/xlEhHdFotvQhGckyRyo0mBm885bLfKG6u34ToOtX9TGCMd/KUut1qE/ijbxmjnVwVVwFQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2431e18-b2b0-494d-9545-c4ea9dffa2f4 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Request method failure captured: Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 247 Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcM1aRMHTzieFXGB51xE8n8RzHHwuK8olGlFhihPxiFxAyQmJJFTQ7X_sSqmAUz5UwgRWHILedhx7LZUXDQDTwflBXa07PAuHllHg7065pwJIdTBOnV8idLaCE9YqST5Y5fzDU18Amew-9PXBQNEefWvlSsgv0XzYOJXYoo2elCXX6A Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe5d687ab67a4f788790bd12da56a503", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}] Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFawck8n1borFWzQd6g0wIGELV/SxFIvQjGTII29LYOx2WoxE4ona5cXneH7/xlEhHdFotvQhGckyRyo0mBm885bLfKG6u34ToOtX9TGCMd/KUut1qE/ijbxmjnVwVVwFQ=="}} Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFawck8n1borFWzQd6g0wIGELV/SxFIvQjGTII29LYOx2WoxE4ona5cXneH7/xlEhHdFotvQhGckyRyo0mBm885bLfKG6u34ToOtX9TGCMd/KUut1qE/ijbxmjnVwVVwFQ=='}}} Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi '' Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:47:35.523967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 05 17:47:35.532162 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.535757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2431e18-b2b0-494d-9545-c4ea9dffa2f4 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:35.536986 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d2431e18-b2b0-494d-9545-c4ea9dffa2f4 tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.023485 Oct 05 17:47:35.537911 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1706/3637] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:47:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:47:35.550792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97b6d660-3d6c-4479-8151-aadf5b88fd5c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Action: 'create', calling method: .version_select at 0x7f7774d59700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2000300658", "public_key": " "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:35.573324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-97b6d660-3d6c-4479-8151-aadf5b88fd5c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Getting quotas for project fe5d687ab67a4f788790bd12da56a503. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:35.584420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-97b6d660-3d6c-4479-8151-aadf5b88fd5c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Getting quotas for user 005d8c90c3374ac8b98897cc32fd5d55 and project fe5d687ab67a4f788790bd12da56a503. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:35.640961 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-97b6d660-3d6c-4479-8151-aadf5b88fd5c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97b6d660-3d6c-4479-8151-aadf5b88fd5c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Request method failure captured: Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 95 Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcM1aRMHTzieFXGB51xE8n8RzHHwuK8olGlFhihPxiFxAyQmJJFTQ7X_sSqmAUz5UwgRWHILedhx7LZUXDQDTwflBXa07PAuHllHg7065pwJIdTBOnV8idLaCE9YqST5Y5fzDU18Amew-9PXBQNEefWvlSsgv0XzYOJXYoo2elCXX6A Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe5d687ab67a4f788790bd12da56a503", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}] Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2000300658", "public_key": " "}} Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: exception: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2000300658', 'public_key': ' '}}} Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.645884 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.651753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97b6d660-3d6c-4479-8151-aadf5b88fd5c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:35.661706 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-97b6d660-3d6c-4479-8151-aadf5b88fd5c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.106750 Oct 05 17:47:35.661706 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1707/3638] 10.222.0.70 () {60 vars in 1158 bytes} [Wed Oct 5 17:47:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:47:35.669981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25233e8d-23c7-46aa-95d5-2d23a6f3443d tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Action: 'create', calling method: .version_select at 0x7f77795af310>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJ7S/xzOEwBeufJG7RSRS7VoUhI6Y6coNVf0Rou7Njo0YUjYpDmm6b3s+XWfYwXriEca/NX0qUsBdf4KaGi9EIzbnbBNhZDzT8+cBWIfcdrRm8pdUqB+F8LF2W/0Il6Ig=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25233e8d-23c7-46aa-95d5-2d23a6f3443d tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Request method failure captured: Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 507 Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcM1aRMHTzieFXGB51xE8n8RzHHwuK8olGlFhihPxiFxAyQmJJFTQ7X_sSqmAUz5UwgRWHILedhx7LZUXDQDTwflBXa07PAuHllHg7065pwJIdTBOnV8idLaCE9YqST5Y5fzDU18Amew-9PXBQNEefWvlSsgv0XzYOJXYoo2elCXX6A Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe5d687ab67a4f788790bd12da56a503", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}] Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJ7S/xzOEwBeufJG7RSRS7VoUhI6Y6coNVf0Rou7Njo0YUjYpDmm6b3s+XWfYwXriEca/NX0qUsBdf4KaGi9EIzbnbBNhZDzT8+cBWIfcdrRm8pdUqB+F8LF2W/0Il6Ig=="}} Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJ7S/xzOEwBeufJG7RSRS7VoUhI6Y6coNVf0Rou7Njo0YUjYpDmm6b3s+XWfYwXriEca/NX0qUsBdf4KaGi9EIzbnbBNhZDzT8+cBWIfcdrRm8pdUqB+F8LF2W/0Il6Ig=='}}} Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 05 17:47:35.681060 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25233e8d-23c7-46aa-95d5-2d23a6f3443d tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:35.685382 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-25233e8d-23c7-46aa-95d5-2d23a6f3443d tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.021461 Oct 05 17:47:35.688134 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1708/3639] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:47:35 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:47:35.702376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e8a9db6-46b4-4305-bf75-985add6c3a7f tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Action: 'create', calling method: .version_select at 0x7f777566d940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1102982728", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:35.724028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6e8a9db6-46b4-4305-bf75-985add6c3a7f tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Getting quotas for project fe5d687ab67a4f788790bd12da56a503. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:35.729243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6e8a9db6-46b4-4305-bf75-985add6c3a7f tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Getting quotas for user 005d8c90c3374ac8b98897cc32fd5d55 and project fe5d687ab67a4f788790bd12da56a503. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:35.752020 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-6e8a9db6-46b4-4305-bf75-985add6c3a7f tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e8a9db6-46b4-4305-bf75-985add6c3a7f tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Request method failure captured: Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 118 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcM1aRMHTzieFXGB51xE8n8RzHHwuK8olGlFhihPxiFxAyQmJJFTQ7X_sSqmAUz5UwgRWHILedhx7LZUXDQDTwflBXa07PAuHllHg7065pwJIdTBOnV8idLaCE9YqST5Y5fzDU18Amew-9PXBQNEefWvlSsgv0XzYOJXYoo2elCXX6A Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe5d687ab67a4f788790bd12da56a503", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}] Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1102982728", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: exception: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1102982728', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 05 17:47:35.755134 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e8a9db6-46b4-4305-bf75-985add6c3a7f tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6e8a9db6-46b4-4305-bf75-985add6c3a7f tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.067316 Oct 05 17:47:35.766181 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1709/3640] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:47:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:47:35.775714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-409f0017-e4e6-43cb-9944-c064dbb80d9c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Calling method '.version_select at 0x7f777468b9d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:35.794525 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-409f0017-e4e6-43cb-9944-c064dbb80d9c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-102209621 not found for user 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-409f0017-e4e6-43cb-9944-c064dbb80d9c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Request method failure captured: Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-102209621 HTTP/1.1 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcM1aRMHTzieFXGB51xE8n8RzHHwuK8olGlFhihPxiFxAyQmJJFTQ7X_sSqmAUz5UwgRWHILedhx7LZUXDQDTwflBXa07PAuHllHg7065pwJIdTBOnV8idLaCE9YqST5Y5fzDU18Amew-9PXBQNEefWvlSsgv0XzYOJXYoo2elCXX6A Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fe5d687ab67a4f788790bd12da56a503", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fe5d687ab67a4f788790bd12da56a503"}]}] Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fe5d687ab67a4f788790bd12da56a503 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1624029285 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1624029285-project Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: exception: Keypair tempest-keypair-non-existent-102209621 not found for user 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'tempest-keypair-non-existent-102209621'} Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise self.value Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-102209621 not found for user 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.797250 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-102209621 not found for user 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-102209621 not found for user 005d8c90c3374ac8b98897cc32fd5d55 Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-409f0017-e4e6-43cb-9944-c064dbb80d9c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] Returning 404 to user: Keypair tempest-keypair-non-existent-102209621 not found for user 005d8c90c3374ac8b98897cc32fd5d55 {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:35.803522 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-409f0017-e4e6-43cb-9944-c064dbb80d9c tempest-KeyPairsNegativeTestJSON-1624029285 tempest-KeyPairsNegativeTestJSON-1624029285-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-102209621" status: 404 len: 144 microversion: 2.1 time: 0.033501 Oct 05 17:47:35.809595 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1710/3641] 10.222.0.70 () {58 vars in 1257 bytes} [Wed Oct 5 17:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-102209621 => generated 144 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:47:35.983490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5f1957f-e900-4f69-bd88-b9083cfd70ed tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:35.997526 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5f1957f-e900-4f69-bd88-b9083cfd70ed tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1210 microversion: 2.1 time: 0.747919 Oct 05 17:47:36.018588 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1932/3642] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:35 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1210 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:36.235289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1d8fe2e9-550b-42a0-b881-b3a3068c05c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:36.236635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1d8fe2e9-550b-42a0-b881-b3a3068c05c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:36.249896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d8fe2e9-550b-42a0-b881-b3a3068c05c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:36.252793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d8fe2e9-550b-42a0-b881-b3a3068c05c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:36.253499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d8fe2e9-550b-42a0-b881-b3a3068c05c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:36.254628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d8fe2e9-550b-42a0-b881-b3a3068c05c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:36.258252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d8fe2e9-550b-42a0-b881-b3a3068c05c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:36.270739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d8fe2e9-550b-42a0-b881-b3a3068c05c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:36.277384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1e5036ea-dbd3-40e9-bff9-df10526c0c14 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:36.278115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1e5036ea-dbd3-40e9-bff9-df10526c0c14 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:36.305729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e5036ea-dbd3-40e9-bff9-df10526c0c14 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:36.306251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e5036ea-dbd3-40e9-bff9-df10526c0c14 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:36.306733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e5036ea-dbd3-40e9-bff9-df10526c0c14 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:36.307490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e5036ea-dbd3-40e9-bff9-df10526c0c14 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:36.315781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e5036ea-dbd3-40e9-bff9-df10526c0c14 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:36.316254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e5036ea-dbd3-40e9-bff9-df10526c0c14 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:36.321129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:37.055123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1d8fe2e9-550b-42a0-b881-b3a3068c05c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:37.073462 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1d8fe2e9-550b-42a0-b881-b3a3068c05c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.842931 Oct 05 17:47:37.074351 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1711/3643] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:36 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:37.079244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8c55ac0f-d495-4432-9db2-18f2281eec20 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:37.080047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8c55ac0f-d495-4432-9db2-18f2281eec20 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:37.101489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c55ac0f-d495-4432-9db2-18f2281eec20 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:37.102967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c55ac0f-d495-4432-9db2-18f2281eec20 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:37.103949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c55ac0f-d495-4432-9db2-18f2281eec20 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:37.104904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c55ac0f-d495-4432-9db2-18f2281eec20 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:37.105590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c55ac0f-d495-4432-9db2-18f2281eec20 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:37.106327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c55ac0f-d495-4432-9db2-18f2281eec20 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:37.209764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1e5036ea-dbd3-40e9-bff9-df10526c0c14 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:37.227710 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1e5036ea-dbd3-40e9-bff9-df10526c0c14 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1318 microversion: 2.1 time: 0.961518 Oct 05 17:47:37.228331 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1933/3644] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:36 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1318 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:37.847404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c55ac0f-d495-4432-9db2-18f2281eec20 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:37.859197 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8c55ac0f-d495-4432-9db2-18f2281eec20 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1210 microversion: 2.1 time: 0.783558 Oct 05 17:47:37.877589 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1712/3645] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:37 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1210 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:38.100567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a03c409c-2afc-476b-a4c9-38ef66f038ac tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:38.101216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a03c409c-2afc-476b-a4c9-38ef66f038ac tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:38.115126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a03c409c-2afc-476b-a4c9-38ef66f038ac tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:38.116665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a03c409c-2afc-476b-a4c9-38ef66f038ac tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:38.117320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a03c409c-2afc-476b-a4c9-38ef66f038ac tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:38.120000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a03c409c-2afc-476b-a4c9-38ef66f038ac tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:38.121067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a03c409c-2afc-476b-a4c9-38ef66f038ac tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:38.124015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a03c409c-2afc-476b-a4c9-38ef66f038ac tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:38.252801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-38b0be4c-177a-45d3-928e-a2937cc0ee2e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:38.255644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-38b0be4c-177a-45d3-928e-a2937cc0ee2e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:38.263660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:38.269488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38b0be4c-177a-45d3-928e-a2937cc0ee2e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:38.271664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38b0be4c-177a-45d3-928e-a2937cc0ee2e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:38.273158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38b0be4c-177a-45d3-928e-a2937cc0ee2e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:38.274593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38b0be4c-177a-45d3-928e-a2937cc0ee2e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:38.276360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38b0be4c-177a-45d3-928e-a2937cc0ee2e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:38.277063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38b0be4c-177a-45d3-928e-a2937cc0ee2e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:38.624540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a03c409c-2afc-476b-a4c9-38ef66f038ac tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:38.634207 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a03c409c-2afc-476b-a4c9-38ef66f038ac tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.538136 Oct 05 17:47:38.635423 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1934/3646] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:38 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:38.828485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-38b0be4c-177a-45d3-928e-a2937cc0ee2e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:38.850733 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-38b0be4c-177a-45d3-928e-a2937cc0ee2e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1318 microversion: 2.1 time: 0.597346 Oct 05 17:47:38.852802 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1713/3647] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:38 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1318 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:38.890368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2af7694-7291-4459-a24f-ae8417096591 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:38.891400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f2af7694-7291-4459-a24f-ae8417096591 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:38.904104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2af7694-7291-4459-a24f-ae8417096591 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:38.904632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2af7694-7291-4459-a24f-ae8417096591 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:38.905063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2af7694-7291-4459-a24f-ae8417096591 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:38.905769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2af7694-7291-4459-a24f-ae8417096591 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:38.920218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-049908d6-524a-4bf4-8260-5179b16a63e6 req-ceec7a07-de4d-405e-b60f-48d5da7cb02f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41294a97-3daa-42bc-988c-4c67fbcaf5f2", "tag": "678dd377-cdce-4a9c-90fa-1fdc74249a40"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:38.930159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2af7694-7291-4459-a24f-ae8417096591 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:38.937709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2af7694-7291-4459-a24f-ae8417096591 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:38.960486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-049908d6-524a-4bf4-8260-5179b16a63e6 req-ceec7a07-de4d-405e-b60f-48d5da7cb02f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:38.961417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-049908d6-524a-4bf4-8260-5179b16a63e6 req-ceec7a07-de4d-405e-b60f-48d5da7cb02f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:38.968128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-049908d6-524a-4bf4-8260-5179b16a63e6 req-ceec7a07-de4d-405e-b60f-48d5da7cb02f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:38.989056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:39.045625 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-049908d6-524a-4bf4-8260-5179b16a63e6 req-ceec7a07-de4d-405e-b60f-48d5da7cb02f service nova] Creating event network-changed:678dd377-cdce-4a9c-90fa-1fdc74249a40 for instance 41294a97-3daa-42bc-988c-4c67fbcaf5f2 on n-h1-835595-3 Oct 05 17:47:39.066308 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-049908d6-524a-4bf4-8260-5179b16a63e6 req-ceec7a07-de4d-405e-b60f-48d5da7cb02f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150948 Oct 05 17:47:39.069086 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1714/3648] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:47:39.439302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f2af7694-7291-4459-a24f-ae8417096591 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:39.457651 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f2af7694-7291-4459-a24f-ae8417096591 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1210 microversion: 2.1 time: 0.574053 Oct 05 17:47:39.462489 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1935/3649] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:38 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1210 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:39.686884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0e86c7fa-6aa0-4995-b2f8-fc8067e87600 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:39.687629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0e86c7fa-6aa0-4995-b2f8-fc8067e87600 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:39.728014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e86c7fa-6aa0-4995-b2f8-fc8067e87600 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:39.731728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e86c7fa-6aa0-4995-b2f8-fc8067e87600 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:39.735012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e86c7fa-6aa0-4995-b2f8-fc8067e87600 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:39.747932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e86c7fa-6aa0-4995-b2f8-fc8067e87600 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:39.748685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e86c7fa-6aa0-4995-b2f8-fc8067e87600 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:39.749196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e86c7fa-6aa0-4995-b2f8-fc8067e87600 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:39.877441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f368fab1-ba5e-42ab-905d-f3ab595e67a5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:39.878060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f368fab1-ba5e-42ab-905d-f3ab595e67a5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:39.895753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f368fab1-ba5e-42ab-905d-f3ab595e67a5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:39.899733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f368fab1-ba5e-42ab-905d-f3ab595e67a5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:39.901431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f368fab1-ba5e-42ab-905d-f3ab595e67a5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:39.908767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f368fab1-ba5e-42ab-905d-f3ab595e67a5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:39.909806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f368fab1-ba5e-42ab-905d-f3ab595e67a5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:39.910484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f368fab1-ba5e-42ab-905d-f3ab595e67a5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:40.075190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:40.267903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f368fab1-ba5e-42ab-905d-f3ab595e67a5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:40.278610 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f368fab1-ba5e-42ab-905d-f3ab595e67a5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1318 microversion: 2.1 time: 0.405805 Oct 05 17:47:40.290113 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1936/3650] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:39 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:40.311884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:40.314889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:40.328396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:40.330952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:40.331461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:40.332197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:40.332764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:40.337388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:40.368410 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] HTTP exception thrown: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Request method failure captured: Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce HTTP/1.1 Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcFvZ20c3Km-TzNCLlsFir23z6Dpd3CTyiPQY6AN2GMIBv3a0vV8kfwGtm7YStevz5655IgGr-YOaGNjH7PmEq-mOX3Qqadx3KWOdeIUkrYgJoY44BX4zITPYww_IgmbN3-pFzfTxFe9UyfpL9C27j3MW-7SbJU9tvBfBjitDTdY-_Q Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.32 Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: e3daa9043f854a7fb87e1ab2211690f8 Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TaggedBootDevicesTest-574456844 Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e3daa9043f854a7fb87e1ab2211690f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e3daa9043f854a7fb87e1ab2211690f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e3daa9043f854a7fb87e1ab2211690f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e3daa9043f854a7fb87e1ab2211690f8"}]}] Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TaggedBootDevicesTest-574456844 Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: e3daa9043f854a7fb87e1ab2211690f8 Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TaggedBootDevicesTest-574456844 Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TaggedBootDevicesTest-574456844-project Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: d3f3adea6b08459789a51e98b05cf50a Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TaggedBootDevicesTest-574456844-project Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '5362ba2a-b905-484f-a7cf-d0c8757475ce'} Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:40.371265 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:40.376309 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:40.380458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Returning 404 to user: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:40.381524 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1ccbb185-f557-43c3-97c4-4fb442be27a8 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 404 len: 111 microversion: 2.32 time: 0.090115 Oct 05 17:47:40.382313 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1937/3651] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:47:40 2022] DELETE /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:47:40.395524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:40.401370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] [instance: 5362ba2a-b905-484f-a7cf-d0c8757475ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:40.413254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:40.422359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:40.422359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:40.422359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:40.422359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:40.422359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:40.464850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0e86c7fa-6aa0-4995-b2f8-fc8067e87600 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:40.483982 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0e86c7fa-6aa0-4995-b2f8-fc8067e87600 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.822060 Oct 05 17:47:40.484366 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] HTTP exception thrown: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:40.485013 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1715/3652] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:39 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Request method failure captured: Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce HTTP/1.1 Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcFvZ20c3Km-TzNCLlsFir23z6Dpd3CTyiPQY6AN2GMIBv3a0vV8kfwGtm7YStevz5655IgGr-YOaGNjH7PmEq-mOX3Qqadx3KWOdeIUkrYgJoY44BX4zITPYww_IgmbN3-pFzfTxFe9UyfpL9C27j3MW-7SbJU9tvBfBjitDTdY-_Q Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.32 Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: e3daa9043f854a7fb87e1ab2211690f8 Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TaggedBootDevicesTest-574456844 Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e3daa9043f854a7fb87e1ab2211690f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e3daa9043f854a7fb87e1ab2211690f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e3daa9043f854a7fb87e1ab2211690f8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e3daa9043f854a7fb87e1ab2211690f8"}]}] Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TaggedBootDevicesTest-574456844 Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: e3daa9043f854a7fb87e1ab2211690f8 Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TaggedBootDevicesTest-574456844 Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TaggedBootDevicesTest-574456844-project Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: d3f3adea6b08459789a51e98b05cf50a Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TaggedBootDevicesTest-574456844-project Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '5362ba2a-b905-484f-a7cf-d0c8757475ce'} Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:40.487980 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:40.493787 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:40.493787 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:40.493787 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:40.493787 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:40.493787 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:40.493787 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. Oct 05 17:47:40.493787 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:40.494925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4e2bc3d0-4cf1-4ba2-acd0-f1ed1f4b16fa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:40.496695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4e2bc3d0-4cf1-4ba2-acd0-f1ed1f4b16fa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:40.497043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] Returning 404 to user: Instance 5362ba2a-b905-484f-a7cf-d0c8757475ce could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:40.498030 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3f3dbd47-f410-4dd4-9b4c-75228193a027 tempest-TaggedBootDevicesTest-574456844 tempest-TaggedBootDevicesTest-574456844-project] 10.222.0.70 "GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce" status: 404 len: 111 microversion: 2.32 time: 0.111461 Oct 05 17:47:40.502927 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1938/3653] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:47:40 2022] GET /compute/v2.1/servers/5362ba2a-b905-484f-a7cf-d0c8757475ce => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:47:40.546008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e2bc3d0-4cf1-4ba2-acd0-f1ed1f4b16fa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:40.549057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e2bc3d0-4cf1-4ba2-acd0-f1ed1f4b16fa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:40.549945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e2bc3d0-4cf1-4ba2-acd0-f1ed1f4b16fa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:40.552427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e2bc3d0-4cf1-4ba2-acd0-f1ed1f4b16fa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:40.555044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e2bc3d0-4cf1-4ba2-acd0-f1ed1f4b16fa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:40.555744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e2bc3d0-4cf1-4ba2-acd0-f1ed1f4b16fa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:40.866109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4e2bc3d0-4cf1-4ba2-acd0-f1ed1f4b16fa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:40.883774 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4e2bc3d0-4cf1-4ba2-acd0-f1ed1f4b16fa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1210 microversion: 2.1 time: 0.397574 Oct 05 17:47:40.886120 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1716/3654] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:40 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1210 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:41.314763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-382ef6cf-b9ca-46d2-a980-aef9128d712f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:41.315683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-382ef6cf-b9ca-46d2-a980-aef9128d712f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:41.341846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-382ef6cf-b9ca-46d2-a980-aef9128d712f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:41.345554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-382ef6cf-b9ca-46d2-a980-aef9128d712f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:41.347500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-382ef6cf-b9ca-46d2-a980-aef9128d712f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:41.348682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-382ef6cf-b9ca-46d2-a980-aef9128d712f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:41.351089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-382ef6cf-b9ca-46d2-a980-aef9128d712f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:41.351738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-382ef6cf-b9ca-46d2-a980-aef9128d712f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:41.523361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f161f4cc-fabc-43c2-a41c-78da8a607dca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:41.524774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f161f4cc-fabc-43c2-a41c-78da8a607dca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:41.536199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f161f4cc-fabc-43c2-a41c-78da8a607dca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:41.536882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f161f4cc-fabc-43c2-a41c-78da8a607dca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:41.539220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f161f4cc-fabc-43c2-a41c-78da8a607dca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:41.543084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f161f4cc-fabc-43c2-a41c-78da8a607dca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:41.543739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f161f4cc-fabc-43c2-a41c-78da8a607dca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:41.546178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f161f4cc-fabc-43c2-a41c-78da8a607dca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:41.677530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-382ef6cf-b9ca-46d2-a980-aef9128d712f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:41.702986 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-382ef6cf-b9ca-46d2-a980-aef9128d712f tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1318 microversion: 2.1 time: 0.393672 Oct 05 17:47:41.703646 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1939/3655] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:41 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:41.908674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f0f8fa24-f4bf-40f3-9594-8f743d66189f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:41.909829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f0f8fa24-f4bf-40f3-9594-8f743d66189f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:41.917075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f8fa24-f4bf-40f3-9594-8f743d66189f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:41.917815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f8fa24-f4bf-40f3-9594-8f743d66189f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:41.918494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f8fa24-f4bf-40f3-9594-8f743d66189f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:41.919690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f8fa24-f4bf-40f3-9594-8f743d66189f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:41.920356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f8fa24-f4bf-40f3-9594-8f743d66189f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:41.921014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f8fa24-f4bf-40f3-9594-8f743d66189f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:42.236281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f161f4cc-fabc-43c2-a41c-78da8a607dca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:42.263965 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f161f4cc-fabc-43c2-a41c-78da8a607dca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.750013 Oct 05 17:47:42.269237 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1717/3656] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:41 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:42.343726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f0f8fa24-f4bf-40f3-9594-8f743d66189f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:42.356494 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f0f8fa24-f4bf-40f3-9594-8f743d66189f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1198 microversion: 2.1 time: 0.448438 Oct 05 17:47:42.357697 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1940/3657] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:41 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1198 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:42.735830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-21a8d2d7-89c0-4238-a02d-227e30839d8e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:42.736643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-21a8d2d7-89c0-4238-a02d-227e30839d8e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:42.753474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21a8d2d7-89c0-4238-a02d-227e30839d8e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:42.753988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21a8d2d7-89c0-4238-a02d-227e30839d8e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:42.754870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21a8d2d7-89c0-4238-a02d-227e30839d8e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:42.757252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21a8d2d7-89c0-4238-a02d-227e30839d8e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:42.757799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21a8d2d7-89c0-4238-a02d-227e30839d8e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:42.758384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21a8d2d7-89c0-4238-a02d-227e30839d8e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:43.130355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-21a8d2d7-89c0-4238-a02d-227e30839d8e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:43.155966 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-21a8d2d7-89c0-4238-a02d-227e30839d8e tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1318 microversion: 2.1 time: 0.428448 Oct 05 17:47:43.159981 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1718/3658] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:42 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:43.292366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2d4d726-055f-4694-9f9a-695b646ab254 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:43.293190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f2d4d726-055f-4694-9f9a-695b646ab254 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:43.300680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2d4d726-055f-4694-9f9a-695b646ab254 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:43.301488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2d4d726-055f-4694-9f9a-695b646ab254 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:43.302103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2d4d726-055f-4694-9f9a-695b646ab254 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:43.303038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2d4d726-055f-4694-9f9a-695b646ab254 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:43.303694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2d4d726-055f-4694-9f9a-695b646ab254 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:43.304289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2d4d726-055f-4694-9f9a-695b646ab254 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:43.384810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b5634548-430f-4988-8696-4bcddc891edf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:43.386020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b5634548-430f-4988-8696-4bcddc891edf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:43.395610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5634548-430f-4988-8696-4bcddc891edf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:43.396113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5634548-430f-4988-8696-4bcddc891edf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:43.396557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5634548-430f-4988-8696-4bcddc891edf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:43.397294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5634548-430f-4988-8696-4bcddc891edf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:43.404527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5634548-430f-4988-8696-4bcddc891edf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:43.404833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5634548-430f-4988-8696-4bcddc891edf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:43.674198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f2d4d726-055f-4694-9f9a-695b646ab254 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:43.691305 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f2d4d726-055f-4694-9f9a-695b646ab254 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.397808 Oct 05 17:47:43.695157 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1941/3659] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:43 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:43.706238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b5634548-430f-4988-8696-4bcddc891edf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:43.726051 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b5634548-430f-4988-8696-4bcddc891edf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1198 microversion: 2.1 time: 0.345439 Oct 05 17:47:43.741610 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1719/3660] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:43 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1198 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:44.196113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e4a3e86-9ada-4e73-b099-4838cec646b5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:44.196744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e4a3e86-9ada-4e73-b099-4838cec646b5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:44.218440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4a3e86-9ada-4e73-b099-4838cec646b5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:44.219190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4a3e86-9ada-4e73-b099-4838cec646b5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:44.219933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4a3e86-9ada-4e73-b099-4838cec646b5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:44.223148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4a3e86-9ada-4e73-b099-4838cec646b5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:44.224254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4a3e86-9ada-4e73-b099-4838cec646b5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:44.224930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4a3e86-9ada-4e73-b099-4838cec646b5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:44.684531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e4a3e86-9ada-4e73-b099-4838cec646b5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:44.697559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e4a3e86-9ada-4e73-b099-4838cec646b5 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1318 microversion: 2.1 time: 0.517011 Oct 05 17:47:44.702773 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1942/3661] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:44 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1318 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:44.723628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ffe28e85-b4d9-4824-bc1b-203aebc6af41 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:44.723628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ffe28e85-b4d9-4824-bc1b-203aebc6af41 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:44.749755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe28e85-b4d9-4824-bc1b-203aebc6af41 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:44.751160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe28e85-b4d9-4824-bc1b-203aebc6af41 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:44.751536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe28e85-b4d9-4824-bc1b-203aebc6af41 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:44.752281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe28e85-b4d9-4824-bc1b-203aebc6af41 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:44.752743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe28e85-b4d9-4824-bc1b-203aebc6af41 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:44.753174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffe28e85-b4d9-4824-bc1b-203aebc6af41 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:44.754501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84e86bdd-f405-4865-b16c-4824a845e3df tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:44.755315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-84e86bdd-f405-4865-b16c-4824a845e3df tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:44.764087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84e86bdd-f405-4865-b16c-4824a845e3df tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:44.767351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84e86bdd-f405-4865-b16c-4824a845e3df tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:44.768026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84e86bdd-f405-4865-b16c-4824a845e3df tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:44.768985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84e86bdd-f405-4865-b16c-4824a845e3df tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:44.769448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84e86bdd-f405-4865-b16c-4824a845e3df tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:44.771385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84e86bdd-f405-4865-b16c-4824a845e3df tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:44.979662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=18 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:45.169692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ffe28e85-b4d9-4824-bc1b-203aebc6af41 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:45.187001 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ffe28e85-b4d9-4824-bc1b-203aebc6af41 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.470952 Oct 05 17:47:45.187655 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1720/3662] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:44 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:45.586520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1324f7e6-dc57-4ea6-aaa1-4d7021562343 req-4b548967-27f1-42ab-bb35-553208bf79ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41294a97-3daa-42bc-988c-4c67fbcaf5f2", "name": "network-vif-plugged", "status": "completed", "tag": "678dd377-cdce-4a9c-90fa-1fdc74249a40"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:45.621500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1324f7e6-dc57-4ea6-aaa1-4d7021562343 req-4b548967-27f1-42ab-bb35-553208bf79ac service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:45.622005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1324f7e6-dc57-4ea6-aaa1-4d7021562343 req-4b548967-27f1-42ab-bb35-553208bf79ac service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:45.622476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1324f7e6-dc57-4ea6-aaa1-4d7021562343 req-4b548967-27f1-42ab-bb35-553208bf79ac service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:45.657184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1324f7e6-dc57-4ea6-aaa1-4d7021562343 req-4b548967-27f1-42ab-bb35-553208bf79ac service nova] Creating event network-vif-plugged:678dd377-cdce-4a9c-90fa-1fdc74249a40 for instance 41294a97-3daa-42bc-988c-4c67fbcaf5f2 on n-h1-835595-3 Oct 05 17:47:45.663232 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1324f7e6-dc57-4ea6-aaa1-4d7021562343 req-4b548967-27f1-42ab-bb35-553208bf79ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.474350 Oct 05 17:47:45.664047 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1721/3663] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:45.740888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-32840657-a811-4234-b807-3d4a0f186d99 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:45.741612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-32840657-a811-4234-b807-3d4a0f186d99 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:45.743751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=26 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:45.782493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32840657-a811-4234-b807-3d4a0f186d99 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:45.783154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32840657-a811-4234-b807-3d4a0f186d99 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:45.785177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32840657-a811-4234-b807-3d4a0f186d99 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:45.786214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32840657-a811-4234-b807-3d4a0f186d99 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:45.790786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32840657-a811-4234-b807-3d4a0f186d99 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:45.791562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-32840657-a811-4234-b807-3d4a0f186d99 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:46.089547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-84e86bdd-f405-4865-b16c-4824a845e3df tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:46.100054 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84e86bdd-f405-4865-b16c-4824a845e3df tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1198 microversion: 2.1 time: 1.351616 Oct 05 17:47:46.131352 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1943/3664] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:44 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1198 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:46.159021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-32840657-a811-4234-b807-3d4a0f186d99 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:46.171193 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-32840657-a811-4234-b807-3d4a0f186d99 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1318 microversion: 2.1 time: 0.449722 Oct 05 17:47:46.175318 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1722/3665] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:45 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:46.214227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-75b64ce8-cfcc-4a03-937b-9ed7121cb005 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:46.214884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-75b64ce8-cfcc-4a03-937b-9ed7121cb005 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:46.231970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75b64ce8-cfcc-4a03-937b-9ed7121cb005 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:46.232484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75b64ce8-cfcc-4a03-937b-9ed7121cb005 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:46.232932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75b64ce8-cfcc-4a03-937b-9ed7121cb005 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:46.233645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75b64ce8-cfcc-4a03-937b-9ed7121cb005 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:46.234106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75b64ce8-cfcc-4a03-937b-9ed7121cb005 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:46.241838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75b64ce8-cfcc-4a03-937b-9ed7121cb005 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:46.722532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-75b64ce8-cfcc-4a03-937b-9ed7121cb005 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:46.747592 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-75b64ce8-cfcc-4a03-937b-9ed7121cb005 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.535430 Oct 05 17:47:46.751140 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1944/3666] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:46 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:47.126932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-498d904d-0e06-48ed-97f6-a4522b0e03f2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:47.128225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-498d904d-0e06-48ed-97f6-a4522b0e03f2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:47.142787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498d904d-0e06-48ed-97f6-a4522b0e03f2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:47.151419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498d904d-0e06-48ed-97f6-a4522b0e03f2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:47.171628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498d904d-0e06-48ed-97f6-a4522b0e03f2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:47.175850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498d904d-0e06-48ed-97f6-a4522b0e03f2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:47.176751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498d904d-0e06-48ed-97f6-a4522b0e03f2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:47.177424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-498d904d-0e06-48ed-97f6-a4522b0e03f2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:47.202745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8491b02b-51ec-4b7c-89c7-28bf8b05b92d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:47.204688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8491b02b-51ec-4b7c-89c7-28bf8b05b92d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:47.221522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8491b02b-51ec-4b7c-89c7-28bf8b05b92d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:47.223493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8491b02b-51ec-4b7c-89c7-28bf8b05b92d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:47.233189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8491b02b-51ec-4b7c-89c7-28bf8b05b92d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:47.234103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8491b02b-51ec-4b7c-89c7-28bf8b05b92d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:47.234808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8491b02b-51ec-4b7c-89c7-28bf8b05b92d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:47.235165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8491b02b-51ec-4b7c-89c7-28bf8b05b92d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:47.548332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-498d904d-0e06-48ed-97f6-a4522b0e03f2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:47.559810 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-498d904d-0e06-48ed-97f6-a4522b0e03f2 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1198 microversion: 2.1 time: 0.437863 Oct 05 17:47:47.572694 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1723/3667] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:47 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1198 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:47.630260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8491b02b-51ec-4b7c-89c7-28bf8b05b92d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:47.638765 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8491b02b-51ec-4b7c-89c7-28bf8b05b92d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1318 microversion: 2.1 time: 0.440063 Oct 05 17:47:47.642723 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1945/3668] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:47 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1318 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:47.776889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b05e0a40-f38c-496c-bcb2-5d5b00d0e40a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:47.777501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b05e0a40-f38c-496c-bcb2-5d5b00d0e40a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:47.789388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05e0a40-f38c-496c-bcb2-5d5b00d0e40a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:47.789899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05e0a40-f38c-496c-bcb2-5d5b00d0e40a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:47.790362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05e0a40-f38c-496c-bcb2-5d5b00d0e40a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:47.791131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05e0a40-f38c-496c-bcb2-5d5b00d0e40a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:47.794910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05e0a40-f38c-496c-bcb2-5d5b00d0e40a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:47.795484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b05e0a40-f38c-496c-bcb2-5d5b00d0e40a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:48.110107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b05e0a40-f38c-496c-bcb2-5d5b00d0e40a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:48.122782 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b05e0a40-f38c-496c-bcb2-5d5b00d0e40a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.349579 Oct 05 17:47:48.132653 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1724/3669] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:47 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:48.592367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6153b9f3-415f-4ff4-ab88-bb18e4ffad06 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:48.594901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6153b9f3-415f-4ff4-ab88-bb18e4ffad06 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:48.606649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6153b9f3-415f-4ff4-ab88-bb18e4ffad06 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:48.609069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6153b9f3-415f-4ff4-ab88-bb18e4ffad06 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:48.609516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6153b9f3-415f-4ff4-ab88-bb18e4ffad06 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:48.613507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6153b9f3-415f-4ff4-ab88-bb18e4ffad06 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:48.614048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6153b9f3-415f-4ff4-ab88-bb18e4ffad06 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:48.615186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6153b9f3-415f-4ff4-ab88-bb18e4ffad06 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:48.668930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-db720aae-bb03-438d-a5d0-e2eb13485cf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:48.669584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-db720aae-bb03-438d-a5d0-e2eb13485cf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:48.678370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db720aae-bb03-438d-a5d0-e2eb13485cf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:48.678861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db720aae-bb03-438d-a5d0-e2eb13485cf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:48.679289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db720aae-bb03-438d-a5d0-e2eb13485cf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:48.680142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db720aae-bb03-438d-a5d0-e2eb13485cf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:48.680596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db720aae-bb03-438d-a5d0-e2eb13485cf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:48.681127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db720aae-bb03-438d-a5d0-e2eb13485cf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:49.024751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-db720aae-bb03-438d-a5d0-e2eb13485cf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:49.042304 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-db720aae-bb03-438d-a5d0-e2eb13485cf9 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1508 microversion: 2.1 time: 0.369188 Oct 05 17:47:49.051164 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1725/3670] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:48 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1508 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:49.060764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aae2e004-997e-452c-9594-a28a44ce0bdb tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:49.062175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aae2e004-997e-452c-9594-a28a44ce0bdb tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:49.068993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2e004-997e-452c-9594-a28a44ce0bdb tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:49.069738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2e004-997e-452c-9594-a28a44ce0bdb tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:49.070564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2e004-997e-452c-9594-a28a44ce0bdb tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:49.072036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2e004-997e-452c-9594-a28a44ce0bdb tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:49.072684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2e004-997e-452c-9594-a28a44ce0bdb tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:49.073277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2e004-997e-452c-9594-a28a44ce0bdb tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:49.197553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6153b9f3-415f-4ff4-ab88-bb18e4ffad06 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:49.207110 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6153b9f3-415f-4ff4-ab88-bb18e4ffad06 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1198 microversion: 2.1 time: 0.621471 Oct 05 17:47:49.207814 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1946/3671] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:48 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1198 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:49.231399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-352fddf9-0b8b-479b-ad9e-b816a1341083 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:49.232341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-352fddf9-0b8b-479b-ad9e-b816a1341083 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:49.265896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-352fddf9-0b8b-479b-ad9e-b816a1341083 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:49.266742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-352fddf9-0b8b-479b-ad9e-b816a1341083 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:49.267379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-352fddf9-0b8b-479b-ad9e-b816a1341083 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:49.268256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-352fddf9-0b8b-479b-ad9e-b816a1341083 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:49.270315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-352fddf9-0b8b-479b-ad9e-b816a1341083 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:49.274569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-352fddf9-0b8b-479b-ad9e-b816a1341083 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:49.332402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aae2e004-997e-452c-9594-a28a44ce0bdb tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:49.342684 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aae2e004-997e-452c-9594-a28a44ce0bdb tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1508 microversion: 2.1 time: 0.286185 Oct 05 17:47:49.349157 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1726/3672] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:49 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1508 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:49.378533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5c5a74b0-ebd9-4f11-91bf-a91ae1bb2005 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:49.381623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5c5a74b0-ebd9-4f11-91bf-a91ae1bb2005 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:49.390819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c5a74b0-ebd9-4f11-91bf-a91ae1bb2005 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:49.394872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c5a74b0-ebd9-4f11-91bf-a91ae1bb2005 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:49.395654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c5a74b0-ebd9-4f11-91bf-a91ae1bb2005 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:49.396657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c5a74b0-ebd9-4f11-91bf-a91ae1bb2005 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:49.397322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c5a74b0-ebd9-4f11-91bf-a91ae1bb2005 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:49.397936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c5a74b0-ebd9-4f11-91bf-a91ae1bb2005 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:49.563854 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5c5a74b0-ebd9-4f11-91bf-a91ae1bb2005 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "PUT /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1080 microversion: 2.1 time: 0.193361 Oct 05 17:47:49.564530 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1727/3673] 10.222.0.70 () {60 vars in 1256 bytes} [Wed Oct 5 17:47:49 2022] PUT /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1080 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:49.587347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25059651-d655-4f78-a0c8-d89e5eba9cb2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:49.588447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-25059651-d655-4f78-a0c8-d89e5eba9cb2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:49.603366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25059651-d655-4f78-a0c8-d89e5eba9cb2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:49.612151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25059651-d655-4f78-a0c8-d89e5eba9cb2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:49.612883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25059651-d655-4f78-a0c8-d89e5eba9cb2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:49.613724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25059651-d655-4f78-a0c8-d89e5eba9cb2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:49.614474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25059651-d655-4f78-a0c8-d89e5eba9cb2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:49.614900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25059651-d655-4f78-a0c8-d89e5eba9cb2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:49.796805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-352fddf9-0b8b-479b-ad9e-b816a1341083 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:49.826725 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-352fddf9-0b8b-479b-ad9e-b816a1341083 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.612513 Oct 05 17:47:49.831673 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1947/3674] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:49 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:50.236122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a6cf0c80-7686-494d-9111-825e2fac1737 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:50.236729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a6cf0c80-7686-494d-9111-825e2fac1737 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:50.262647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6cf0c80-7686-494d-9111-825e2fac1737 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:50.263681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6cf0c80-7686-494d-9111-825e2fac1737 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:50.264582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6cf0c80-7686-494d-9111-825e2fac1737 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:50.265587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6cf0c80-7686-494d-9111-825e2fac1737 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:50.266719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6cf0c80-7686-494d-9111-825e2fac1737 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:50.267380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a6cf0c80-7686-494d-9111-825e2fac1737 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:50.484805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-25059651-d655-4f78-a0c8-d89e5eba9cb2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:50.506265 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-25059651-d655-4f78-a0c8-d89e5eba9cb2 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1506 microversion: 2.1 time: 0.919327 Oct 05 17:47:50.507738 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1728/3675] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:49 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1506 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:50.536777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29613019-2bf2-4c17-828e-1dd0862abe2d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:50.544694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29613019-2bf2-4c17-828e-1dd0862abe2d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:50.558435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29613019-2bf2-4c17-828e-1dd0862abe2d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:50.559196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29613019-2bf2-4c17-828e-1dd0862abe2d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:50.559802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29613019-2bf2-4c17-828e-1dd0862abe2d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:50.560687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29613019-2bf2-4c17-828e-1dd0862abe2d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:50.562984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29613019-2bf2-4c17-828e-1dd0862abe2d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:50.563615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29613019-2bf2-4c17-828e-1dd0862abe2d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:50.822567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a6cf0c80-7686-494d-9111-825e2fac1737 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:50.830693 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a6cf0c80-7686-494d-9111-825e2fac1737 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1198 microversion: 2.1 time: 0.598882 Oct 05 17:47:50.835572 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1948/3676] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:50 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1198 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:51.090818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-576ef041-e4f0-4b1c-a501-b1d0c30551e5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Action: 'create', calling method: .version_select at 0x7f7775116b80>, body: {"keypair": {"name": "tempest-keypair-599424512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgYVe/gS8rJWqaJINue+e/PgYfmFqOPQ1mpfrPN3f8cnx1PpFqCMv1Wr815Qsqh3JwHQnwh/YcI8har3jcEaxG/IpX88yxCFrtVHJqV+MyNk1cOvKqVgCZkCS/g+8nY5Q=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:51.131623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29613019-2bf2-4c17-828e-1dd0862abe2d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:51.153256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-576ef041-e4f0-4b1c-a501-b1d0c30551e5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Getting quotas for project a73261c41f4c4ccfa7a47c2ad99b7148. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:51.157742 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29613019-2bf2-4c17-828e-1dd0862abe2d tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1506 microversion: 2.1 time: 0.629573 Oct 05 17:47:51.159357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-576ef041-e4f0-4b1c-a501-b1d0c30551e5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Getting quotas for user 6829df0c89ba4284beeca7e2123cec90 and project a73261c41f4c4ccfa7a47c2ad99b7148. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:51.159950 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1729/3677] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:50 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:51.177355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f6d3b2a-d363-4d91-a0cc-12dcb475dd88 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:51.178883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5f6d3b2a-d363-4d91-a0cc-12dcb475dd88 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:51.208845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f6d3b2a-d363-4d91-a0cc-12dcb475dd88 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:51.209355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f6d3b2a-d363-4d91-a0cc-12dcb475dd88 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:51.209786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f6d3b2a-d363-4d91-a0cc-12dcb475dd88 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:51.215971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f6d3b2a-d363-4d91-a0cc-12dcb475dd88 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:51.216864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f6d3b2a-d363-4d91-a0cc-12dcb475dd88 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:51.218428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f6d3b2a-d363-4d91-a0cc-12dcb475dd88 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:51.236127 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-576ef041-e4f0-4b1c-a501-b1d0c30551e5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.399288 Oct 05 17:47:51.237337 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1949/3678] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:47:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:51.252786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-552ffb58-bf18-40ba-8a53-f765e9adc7a7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:51.257300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-552ffb58-bf18-40ba-8a53-f765e9adc7a7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:51.265695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-552ffb58-bf18-40ba-8a53-f765e9adc7a7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:51.266852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-552ffb58-bf18-40ba-8a53-f765e9adc7a7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:51.267495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-552ffb58-bf18-40ba-8a53-f765e9adc7a7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:51.268610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-552ffb58-bf18-40ba-8a53-f765e9adc7a7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:51.269268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-552ffb58-bf18-40ba-8a53-f765e9adc7a7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:51.269890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-552ffb58-bf18-40ba-8a53-f765e9adc7a7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:51.361303 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-552ffb58-bf18-40ba-8a53-f765e9adc7a7 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "PUT /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1082 microversion: 2.1 time: 0.122415 Oct 05 17:47:51.362262 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1950/3679] 10.222.0.70 () {60 vars in 1256 bytes} [Wed Oct 5 17:47:51 2022] PUT /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1082 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:51.382075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82c2a475-4d81-4e46-88cf-f0815f2d5d4a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:51.383074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-82c2a475-4d81-4e46-88cf-f0815f2d5d4a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:51.406516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82c2a475-4d81-4e46-88cf-f0815f2d5d4a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:51.407019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82c2a475-4d81-4e46-88cf-f0815f2d5d4a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:51.407458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82c2a475-4d81-4e46-88cf-f0815f2d5d4a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:51.408181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82c2a475-4d81-4e46-88cf-f0815f2d5d4a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:51.408633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82c2a475-4d81-4e46-88cf-f0815f2d5d4a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:51.415110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82c2a475-4d81-4e46-88cf-f0815f2d5d4a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:51.463155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:51.713430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5f6d3b2a-d363-4d91-a0cc-12dcb475dd88 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:51.733218 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5f6d3b2a-d363-4d91-a0cc-12dcb475dd88 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.571016 Oct 05 17:47:51.734441 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1730/3680] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:51 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:51.809758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-82c2a475-4d81-4e46-88cf-f0815f2d5d4a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:51.828873 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-82c2a475-4d81-4e46-88cf-f0815f2d5d4a tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1508 microversion: 2.1 time: 0.451478 Oct 05 17:47:51.834646 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1951/3681] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:51 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1508 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:51.854478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-035e0c40-c73f-49b0-b7f7-4bf972ac86e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:51.855681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-035e0c40-c73f-49b0-b7f7-4bf972ac86e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:51.860457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-748e29cc-385a-4db7-bd3d-fa0e224af6b6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:51.861987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-748e29cc-385a-4db7-bd3d-fa0e224af6b6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:51.871618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:51.873489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-748e29cc-385a-4db7-bd3d-fa0e224af6b6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:51.874260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-748e29cc-385a-4db7-bd3d-fa0e224af6b6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:51.874964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-748e29cc-385a-4db7-bd3d-fa0e224af6b6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:51.876738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-748e29cc-385a-4db7-bd3d-fa0e224af6b6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:51.877793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-748e29cc-385a-4db7-bd3d-fa0e224af6b6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:51.878928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-748e29cc-385a-4db7-bd3d-fa0e224af6b6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:51.879421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:51.881211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035e0c40-c73f-49b0-b7f7-4bf972ac86e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:51.881714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035e0c40-c73f-49b0-b7f7-4bf972ac86e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:51.882154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035e0c40-c73f-49b0-b7f7-4bf972ac86e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:51.901471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035e0c40-c73f-49b0-b7f7-4bf972ac86e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:51.935704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035e0c40-c73f-49b0-b7f7-4bf972ac86e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:51.937356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-035e0c40-c73f-49b0-b7f7-4bf972ac86e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:51.979342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:52.281626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-748e29cc-385a-4db7-bd3d-fa0e224af6b6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:52.292576 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-748e29cc-385a-4db7-bd3d-fa0e224af6b6 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1508 microversion: 2.1 time: 0.436810 Oct 05 17:47:52.299049 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1952/3682] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:51 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:52.325491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b2ff3cf-3a10-4114-9c45-ae4fee98f9e8 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:52.326912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b2ff3cf-3a10-4114-9c45-ae4fee98f9e8 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:52.347889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3cf-3a10-4114-9c45-ae4fee98f9e8 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:52.348706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3cf-3a10-4114-9c45-ae4fee98f9e8 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:52.349245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3cf-3a10-4114-9c45-ae4fee98f9e8 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:52.350074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3cf-3a10-4114-9c45-ae4fee98f9e8 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:52.350658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3cf-3a10-4114-9c45-ae4fee98f9e8 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:52.351141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b2ff3cf-3a10-4114-9c45-ae4fee98f9e8 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:52.400906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b2ff3cf-3a10-4114-9c45-ae4fee98f9e8 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:47:52.544974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-035e0c40-c73f-49b0-b7f7-4bf972ac86e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:52.575392 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-035e0c40-c73f-49b0-b7f7-4bf972ac86e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1198 microversion: 2.1 time: 0.724930 Oct 05 17:47:52.610762 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1731/3683] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:51 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1198 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:52.624115 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b2ff3cf-3a10-4114-9c45-ae4fee98f9e8 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "DELETE /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 204 len: 0 microversion: 2.1 time: 0.289305 Oct 05 17:47:52.628523 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1953/3684] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:47:52 2022] DELETE /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:52.640935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:52.644219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:52.665569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:52.671211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:52.671992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:52.672994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:52.673706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:52.674878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:52.750132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:47:52.762096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3eab4b74-2075-4367-a166-8bd574437ba8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:52.762926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3eab4b74-2075-4367-a166-8bd574437ba8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:52.774834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eab4b74-2075-4367-a166-8bd574437ba8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:52.777986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eab4b74-2075-4367-a166-8bd574437ba8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:52.778655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eab4b74-2075-4367-a166-8bd574437ba8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:52.780551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eab4b74-2075-4367-a166-8bd574437ba8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:52.781393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eab4b74-2075-4367-a166-8bd574437ba8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:52.782984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3eab4b74-2075-4367-a166-8bd574437ba8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:52.868520 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.compute.api [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Instance is already in deleting state, ignoring this request Oct 05 17:47:52.869675 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-36c1a897-4c83-4f8e-b639-94a5465a6030 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "DELETE /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 204 len: 0 microversion: 2.1 time: 0.234816 Oct 05 17:47:52.873884 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1732/3685] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:47:52 2022] DELETE /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:47:52.887235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a6c3133-bfcd-4c67-b36a-19bdd5ea8228 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:52.891213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7a6c3133-bfcd-4c67-b36a-19bdd5ea8228 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:52.911614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a6c3133-bfcd-4c67-b36a-19bdd5ea8228 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:52.912390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a6c3133-bfcd-4c67-b36a-19bdd5ea8228 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:52.915749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a6c3133-bfcd-4c67-b36a-19bdd5ea8228 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:52.916731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a6c3133-bfcd-4c67-b36a-19bdd5ea8228 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:52.917530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a6c3133-bfcd-4c67-b36a-19bdd5ea8228 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:52.918125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a6c3133-bfcd-4c67-b36a-19bdd5ea8228 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:53.075634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3eab4b74-2075-4367-a166-8bd574437ba8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:53.083998 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3eab4b74-2075-4367-a166-8bd574437ba8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.327765 Oct 05 17:47:53.084577 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1954/3686] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:52 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:53.273959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7a6c3133-bfcd-4c67-b36a-19bdd5ea8228 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:53.284431 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a6c3133-bfcd-4c67-b36a-19bdd5ea8228 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1514 microversion: 2.1 time: 0.407434 Oct 05 17:47:53.285473 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1733/3687] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:52 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1514 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:53.636834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5299234-a525-4a4b-bacd-2a8d015fa7c3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:53.637940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5299234-a525-4a4b-bacd-2a8d015fa7c3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:53.653584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5299234-a525-4a4b-bacd-2a8d015fa7c3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:53.654635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5299234-a525-4a4b-bacd-2a8d015fa7c3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:53.655498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5299234-a525-4a4b-bacd-2a8d015fa7c3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:53.656581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5299234-a525-4a4b-bacd-2a8d015fa7c3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:53.658859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5299234-a525-4a4b-bacd-2a8d015fa7c3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:53.659490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5299234-a525-4a4b-bacd-2a8d015fa7c3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:53.810415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-516ff896-7162-4a32-8d11-1417cd2025fa req-302c6b2a-1251-42e3-ae95-788daddb8839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637528bb-a7bd-49c4-baf5-f63095788532", "name": "network-vif-plugged", "status": "completed", "tag": "b0f1bad7-bd89-4f62-bd96-6e8439a2671b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:53.843102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-516ff896-7162-4a32-8d11-1417cd2025fa req-302c6b2a-1251-42e3-ae95-788daddb8839 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:53.844204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-516ff896-7162-4a32-8d11-1417cd2025fa req-302c6b2a-1251-42e3-ae95-788daddb8839 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:53.846108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-516ff896-7162-4a32-8d11-1417cd2025fa req-302c6b2a-1251-42e3-ae95-788daddb8839 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:53.913316 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-516ff896-7162-4a32-8d11-1417cd2025fa req-302c6b2a-1251-42e3-ae95-788daddb8839 service nova] Creating event network-vif-plugged:b0f1bad7-bd89-4f62-bd96-6e8439a2671b for instance 637528bb-a7bd-49c4-baf5-f63095788532 on n-h2-835595-3 Oct 05 17:47:53.921218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f5299234-a525-4a4b-bacd-2a8d015fa7c3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:53.932783 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5299234-a525-4a4b-bacd-2a8d015fa7c3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1198 microversion: 2.1 time: 0.300623 Oct 05 17:47:53.934432 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1955/3688] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:53 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1198 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:53.958825 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-516ff896-7162-4a32-8d11-1417cd2025fa req-302c6b2a-1251-42e3-ae95-788daddb8839 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150065 Oct 05 17:47:53.965215 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1734/3689] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:54.121821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9393858c-d62f-4f8d-a033-fd35634cdcc3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:54.122937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9393858c-d62f-4f8d-a033-fd35634cdcc3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:54.141716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9393858c-d62f-4f8d-a033-fd35634cdcc3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:54.142549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9393858c-d62f-4f8d-a033-fd35634cdcc3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:54.143210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9393858c-d62f-4f8d-a033-fd35634cdcc3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:54.144137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9393858c-d62f-4f8d-a033-fd35634cdcc3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:54.144773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9393858c-d62f-4f8d-a033-fd35634cdcc3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:54.151019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9393858c-d62f-4f8d-a033-fd35634cdcc3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:54.310113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5d912de1-f383-475a-92b0-174e0da33d8b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:54.311147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5d912de1-f383-475a-92b0-174e0da33d8b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:54.325760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d912de1-f383-475a-92b0-174e0da33d8b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:54.328252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d912de1-f383-475a-92b0-174e0da33d8b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:54.328931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d912de1-f383-475a-92b0-174e0da33d8b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:54.331061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d912de1-f383-475a-92b0-174e0da33d8b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:54.332733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d912de1-f383-475a-92b0-174e0da33d8b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:54.334989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d912de1-f383-475a-92b0-174e0da33d8b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:54.742795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9393858c-d62f-4f8d-a033-fd35634cdcc3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:54.761341 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9393858c-d62f-4f8d-a033-fd35634cdcc3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.653838 Oct 05 17:47:54.778126 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1956/3690] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:54 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:54.965935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4f96519-22d5-4384-a771-a9b4930b23d3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:54.966664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b4f96519-22d5-4384-a771-a9b4930b23d3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:55.003768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f96519-22d5-4384-a771-a9b4930b23d3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:55.004680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f96519-22d5-4384-a771-a9b4930b23d3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:55.005348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f96519-22d5-4384-a771-a9b4930b23d3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:55.006309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f96519-22d5-4384-a771-a9b4930b23d3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:55.006967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f96519-22d5-4384-a771-a9b4930b23d3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:55.007590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4f96519-22d5-4384-a771-a9b4930b23d3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:55.264319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5d912de1-f383-475a-92b0-174e0da33d8b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:55.273271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4f96519-22d5-4384-a771-a9b4930b23d3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:55.278263 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5d912de1-f383-475a-92b0-174e0da33d8b tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1514 microversion: 2.1 time: 0.973378 Oct 05 17:47:55.280646 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1735/3691] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:54 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1514 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:55.334157 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b4f96519-22d5-4384-a771-a9b4930b23d3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1198 microversion: 2.1 time: 0.360513 Oct 05 17:47:55.338523 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1957/3692] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:54 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1198 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:55.664189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1092475362", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0a36d798-d9e6-444a-a5a8-a521760a3a2c"}], "security_groups": [{"name": "tempest-securitygroup--244434177"}], "key_name": "tempest-keypair-599424512", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:55.784490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-32d3b772-efcc-41dd-86b6-5db93848c391 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:55.785448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-32d3b772-efcc-41dd-86b6-5db93848c391 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:55.799133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d3b772-efcc-41dd-86b6-5db93848c391 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:55.799942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d3b772-efcc-41dd-86b6-5db93848c391 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:55.800584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d3b772-efcc-41dd-86b6-5db93848c391 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:55.802818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d3b772-efcc-41dd-86b6-5db93848c391 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:55.806808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d3b772-efcc-41dd-86b6-5db93848c391 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:55.808885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d3b772-efcc-41dd-86b6-5db93848c391 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:55.953000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] validate_networks() for [('0a36d798-d9e6-444a-a5a8-a521760a3a2c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:47:56.103383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-32d3b772-efcc-41dd-86b6-5db93848c391 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:56.114535 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-32d3b772-efcc-41dd-86b6-5db93848c391 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1522 microversion: 2.1 time: 0.334346 Oct 05 17:47:56.115326 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1958/3693] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:55 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:47:56.284198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-1795c66b-06e6-47c8-b6bc-50e94d74c2ea req-69bde6bc-0043-48a5-b0f9-d940bb635e55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41294a97-3daa-42bc-988c-4c67fbcaf5f2", "name": "network-vif-deleted", "tag": "678dd377-cdce-4a9c-90fa-1fdc74249a40"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:56.316100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1795c66b-06e6-47c8-b6bc-50e94d74c2ea req-69bde6bc-0043-48a5-b0f9-d940bb635e55 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:56.316612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1795c66b-06e6-47c8-b6bc-50e94d74c2ea req-69bde6bc-0043-48a5-b0f9-d940bb635e55 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:56.317136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1795c66b-06e6-47c8-b6bc-50e94d74c2ea req-69bde6bc-0043-48a5-b0f9-d940bb635e55 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:56.394430 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-1795c66b-06e6-47c8-b6bc-50e94d74c2ea req-69bde6bc-0043-48a5-b0f9-d940bb635e55 service nova] Creating event network-vif-deleted:678dd377-cdce-4a9c-90fa-1fdc74249a40 for instance 41294a97-3daa-42bc-988c-4c67fbcaf5f2 on n-h1-835595-3 Oct 05 17:47:56.432696 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-1795c66b-06e6-47c8-b6bc-50e94d74c2ea req-69bde6bc-0043-48a5-b0f9-d940bb635e55 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152686 Oct 05 17:47:56.445091 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1959/3694] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:47:56.473516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:56.476836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:56.493810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:56.497593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:56.501404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:56.501861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:56.502384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:56.504886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:56.564848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:56.565705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:56.566431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:56.567178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lazy-loading 'fault' on Instance uuid 41294a97-3daa-42bc-988c-4c67fbcaf5f2 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:47:56.690258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8878ab6c93164071bb4602782e3d5e5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '322009e2b6f2443c9c3e8f0a43bd7567', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:56.712513 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e0843ca9-772a-4100-9bde-39cb99151bb0 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 200 len: 1308 microversion: 2.1 time: 0.265747 Oct 05 17:47:56.713444 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1960/3695] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:56 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 1308 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:56.732521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d1c25610-b162-42f7-81e7-73b8e503baf9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:56.733430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d1c25610-b162-42f7-81e7-73b8e503baf9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:56.773287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c25610-b162-42f7-81e7-73b8e503baf9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:56.773809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c25610-b162-42f7-81e7-73b8e503baf9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:56.774259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c25610-b162-42f7-81e7-73b8e503baf9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:56.775026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c25610-b162-42f7-81e7-73b8e503baf9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:56.775492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c25610-b162-42f7-81e7-73b8e503baf9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:56.775920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1c25610-b162-42f7-81e7-73b8e503baf9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:57.065786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d1c25610-b162-42f7-81e7-73b8e503baf9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:57.080755 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d1c25610-b162-42f7-81e7-73b8e503baf9 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1380 microversion: 2.1 time: 0.361344 Oct 05 17:47:57.084755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1961/3696] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:56 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1380 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:57.109830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b07dddee-c480-47b6-a045-06a64b1cbb65 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:57.110577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b07dddee-c480-47b6-a045-06a64b1cbb65 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:57.118846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07dddee-c480-47b6-a045-06a64b1cbb65 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:57.119335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07dddee-c480-47b6-a045-06a64b1cbb65 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:57.120259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07dddee-c480-47b6-a045-06a64b1cbb65 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:57.121129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07dddee-c480-47b6-a045-06a64b1cbb65 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:57.121847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07dddee-c480-47b6-a045-06a64b1cbb65 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:57.122726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b07dddee-c480-47b6-a045-06a64b1cbb65 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:57.192850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Getting quotas for project a73261c41f4c4ccfa7a47c2ad99b7148. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:57.210990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Getting quotas for user 6829df0c89ba4284beeca7e2123cec90 and project a73261c41f4c4ccfa7a47c2ad99b7148. Resources: dict_keys(['metadata_items']) {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:57.246343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:47:57.249638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:47:57.250708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:47:57.251868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:47:57.253466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:47:57.274590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:57.282575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:57.283305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:57.285043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:57.287208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:57.287867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:57.336993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Getting quotas for project a73261c41f4c4ccfa7a47c2ad99b7148. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:47:57.353015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Getting quotas for user 6829df0c89ba4284beeca7e2123cec90 and project a73261c41f4c4ccfa7a47c2ad99b7148. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:47:57.393067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:47:57.401898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:47:57.406848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b07dddee-c480-47b6-a045-06a64b1cbb65 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1531 microversion: 2.1 time: 0.298595 Oct 05 17:47:57.422363 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1962/3697] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:57 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1531 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:57.433471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-553233d7-6bf0-4478-90c3-eb1bf5beab86 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:57.434584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-553233d7-6bf0-4478-90c3-eb1bf5beab86 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:57.443436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553233d7-6bf0-4478-90c3-eb1bf5beab86 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:57.444234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553233d7-6bf0-4478-90c3-eb1bf5beab86 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:57.444958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553233d7-6bf0-4478-90c3-eb1bf5beab86 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:57.445939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553233d7-6bf0-4478-90c3-eb1bf5beab86 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:57.446748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553233d7-6bf0-4478-90c3-eb1bf5beab86 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:57.447582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-553233d7-6bf0-4478-90c3-eb1bf5beab86 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:57.538934 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e1945c8-4f1e-4393-bca5-8e8bf51e2ee8 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.880440 Oct 05 17:47:57.550761 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1736/3698] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:47:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:47:57.567310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2c7f3fb5-f3fe-49ae-951c-7ee8df05fe41 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:57.567951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2c7f3fb5-f3fe-49ae-951c-7ee8df05fe41 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:57.588636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c7f3fb5-f3fe-49ae-951c-7ee8df05fe41 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:57.590896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c7f3fb5-f3fe-49ae-951c-7ee8df05fe41 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:57.599921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c7f3fb5-f3fe-49ae-951c-7ee8df05fe41 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:57.600999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c7f3fb5-f3fe-49ae-951c-7ee8df05fe41 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:57.603502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c7f3fb5-f3fe-49ae-951c-7ee8df05fe41 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:57.604860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c7f3fb5-f3fe-49ae-951c-7ee8df05fe41 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:57.685072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-553233d7-6bf0-4478-90c3-eb1bf5beab86 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:57.697275 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-553233d7-6bf0-4478-90c3-eb1bf5beab86 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1502 microversion: 2.1 time: 0.268092 Oct 05 17:47:57.702870 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1963/3699] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:57 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:57.707684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59ae1204-596d-4f5e-8611-4e4e73d41c57 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:57.708292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-59ae1204-596d-4f5e-8611-4e4e73d41c57 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:57.805919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-59ae1204-596d-4f5e-8611-4e4e73d41c57 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:57.813829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-59ae1204-596d-4f5e-8611-4e4e73d41c57 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1269 microversion: 2.1 time: 0.109802 Oct 05 17:47:57.834990 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1964/3700] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:57 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1269 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:57.834990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-efa922b1-4900-411d-ab7a-301428d6d100 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:57.834990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-efa922b1-4900-411d-ab7a-301428d6d100 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:57.843586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa922b1-4900-411d-ab7a-301428d6d100 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:57.844087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa922b1-4900-411d-ab7a-301428d6d100 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:57.844529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa922b1-4900-411d-ab7a-301428d6d100 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:57.845237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa922b1-4900-411d-ab7a-301428d6d100 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:57.845745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa922b1-4900-411d-ab7a-301428d6d100 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:57.846166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa922b1-4900-411d-ab7a-301428d6d100 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.017207 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2c7f3fb5-f3fe-49ae-951c-7ee8df05fe41 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1531 microversion: 2.1 time: 0.464736 Oct 05 17:47:58.022970 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1737/3701] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:57 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1531 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:58.033316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:58.038864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 41294a97-3daa-42bc-988c-4c67fbcaf5f2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:58.061924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.062472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.062909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.063616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.064070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.064490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.103137 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] HTTP exception thrown: Instance 41294a97-3daa-42bc-988c-4c67fbcaf5f2 could not be found. Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Request method failure captured: Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 HTTP/1.1 Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcKiW_SFoUMM3mTVE7gSip9m8DZG-oBbTJij3hVVvxbg7liVajYeN9UK0XYpgv8GBmizFlP_duzqHYEhYiJSFD6Z_g_KLQaRTq77qkyqW5FkHykstjlykVqb-ZC6hDdX83SHjy2hl-YZ6niBVKf89PmKTU-4MvNSdzFZDqC29fw5aEw Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 322009e2b6f2443c9c3e8f0a43bd7567 Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/322009e2b6f2443c9c3e8f0a43bd7567"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/322009e2b6f2443c9c3e8f0a43bd7567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_322009e2b6f2443c9c3e8f0a43bd7567", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/322009e2b6f2443c9c3e8f0a43bd7567"}]}] Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 322009e2b6f2443c9c3e8f0a43bd7567 Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerDiskConfigTestJSON-418169676-project Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 8878ab6c93164071bb4602782e3d5e5c Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerDiskConfigTestJSON-418169676-project Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 41294a97-3daa-42bc-988c-4c67fbcaf5f2 could not be found. Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '41294a97-3daa-42bc-988c-4c67fbcaf5f2'} Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41294a97-3daa-42bc-988c-4c67fbcaf5f2 could not be found. Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41294a97-3daa-42bc-988c-4c67fbcaf5f2 could not be found. Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.104838 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.112605 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.112605 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.112605 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.112605 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:58.112605 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:58.112605 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41294a97-3daa-42bc-988c-4c67fbcaf5f2 could not be found. Oct 05 17:47:58.112605 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.112605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Returning 404 to user: Instance 41294a97-3daa-42bc-988c-4c67fbcaf5f2 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:58.112605 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c9226302-568d-4ebb-b3ca-3adf7d1fe944 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2" status: 404 len: 111 microversion: 2.1 time: 0.080939 Oct 05 17:47:58.112605 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1738/3702] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:58 2022] GET /compute/v2.1/servers/41294a97-3daa-42bc-988c-4c67fbcaf5f2 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:47:58.115274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd55cab6-fa69-40c5-b54c-a116bed36e34 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:58.119831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd55cab6-fa69-40c5-b54c-a116bed36e34 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.120036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd55cab6-fa69-40c5-b54c-a116bed36e34 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.120314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd55cab6-fa69-40c5-b54c-a116bed36e34 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.142273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd55cab6-fa69-40c5-b54c-a116bed36e34 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.143061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd55cab6-fa69-40c5-b54c-a116bed36e34 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.143514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd55cab6-fa69-40c5-b54c-a116bed36e34 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.196638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-efa922b1-4900-411d-ab7a-301428d6d100 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:58.206335 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-efa922b1-4900-411d-ab7a-301428d6d100 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1516 microversion: 2.1 time: 0.381503 Oct 05 17:47:58.211683 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1965/3703] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:57 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1516 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:58.214361 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bd55cab6-fa69-40c5-b54c-a116bed36e34 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.106036 Oct 05 17:47:58.222744 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1739/3704] 10.222.0.70 () {58 vars in 1176 bytes} [Wed Oct 5 17:47:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:47:58.228735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-835595-3", "block_migration": false, "disk_over_commit": false}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:58.230127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:58.230748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:58.231250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:58.237336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.237759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.238443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.239499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.240141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.241047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.246512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.246512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.246944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.247661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.248094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.248518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.257829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] HTTP exception thrown: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Request method failure captured: Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd HTTP/1.1 Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcKiW_SFoUMM3mTVE7gSip9m8DZG-oBbTJij3hVVvxbg7liVajYeN9UK0XYpgv8GBmizFlP_duzqHYEhYiJSFD6Z_g_KLQaRTq77qkyqW5FkHykstjlykVqb-ZC6hDdX83SHjy2hl-YZ6niBVKf89PmKTU-4MvNSdzFZDqC29fw5aEw Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 322009e2b6f2443c9c3e8f0a43bd7567 Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/322009e2b6f2443c9c3e8f0a43bd7567"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/322009e2b6f2443c9c3e8f0a43bd7567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_322009e2b6f2443c9c3e8f0a43bd7567", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/322009e2b6f2443c9c3e8f0a43bd7567"}]}] Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 322009e2b6f2443c9c3e8f0a43bd7567 Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerDiskConfigTestJSON-418169676-project Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8878ab6c93164071bb4602782e3d5e5c Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerDiskConfigTestJSON-418169676-project Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd'} Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:58.260129 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. Oct 05 17:47:58.269134 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.271561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Returning 404 to user: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:58.273394 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-36a69efd-92c9-41c1-af64-40542e6d7f62 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 404 len: 111 microversion: 2.1 time: 0.059020 Oct 05 17:47:58.274387 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1966/3705] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:47:58 2022] DELETE /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:47:58.279606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbdc74dc-9583-4429-98a0-92449ba9e8dd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:58.282448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dbdc74dc-9583-4429-98a0-92449ba9e8dd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 70d31948-19e3-400e-9579-819f0e872687] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:58.289099 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-dbdc74dc-9583-4429-98a0-92449ba9e8dd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] HTTP exception thrown: Instance 70d31948-19e3-400e-9579-819f0e872687 could not be found. Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbdc74dc-9583-4429-98a0-92449ba9e8dd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Request method failure captured: Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/70d31948-19e3-400e-9579-819f0e872687/action HTTP/1.1 Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 14 Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcMOAOpdE63X8OhW4wsEy2crLrx01LtQ-rp_0wT7KyP_snq49RBe9pW2rDXvGDquoPS8xWknsOpVRp2diM1zITKhR01lPNUgSkUsWER9laVmknlwDrrF_SZj9lTxUjYcrefuqCr0JxKMwpc1ouYu8vVwbNWydS37cc_WZDK5JdlZgNU Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/caf452f31a594c888e1703356c637a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_caf452f31a594c888e1703356c637a91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}] Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 50b3fb554dd64e41bea1109e697b0799 Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: {"rescue": {}} Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 70d31948-19e3-400e-9579-819f0e872687 could not be found. Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '70d31948-19e3-400e-9579-819f0e872687', 'body': {'rescue': {}}} Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70d31948-19e3-400e-9579-819f0e872687 could not be found. Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70d31948-19e3-400e-9579-819f0e872687 could not be found. Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.294981 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.301737 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.301737 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.301737 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:58.301737 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:58.301737 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70d31948-19e3-400e-9579-819f0e872687 could not be found. Oct 05 17:47:58.301737 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.301737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbdc74dc-9583-4429-98a0-92449ba9e8dd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Returning 404 to user: Instance 70d31948-19e3-400e-9579-819f0e872687 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:58.301737 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dbdc74dc-9583-4429-98a0-92449ba9e8dd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/70d31948-19e3-400e-9579-819f0e872687/action" status: 404 len: 111 microversion: 2.1 time: 0.021095 Oct 05 17:47:58.304422 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1967/3706] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:47:58 2022] POST /compute/v2.1/servers/70d31948-19e3-400e-9579-819f0e872687/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:47:58.311607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lazy-loading 'flavor' on Instance uuid 637528bb-a7bd-49c4-baf5-f63095788532 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:47:58.311815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:58.312432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:58.323063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.323649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.324300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.325292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.325940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.326935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.347484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Going to try to live migrate instance to n-h1-835595-3 {{(pid=128843) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 17:47:58.348476 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] HTTP exception thrown: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Request method failure captured: Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd HTTP/1.1 Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcKiW_SFoUMM3mTVE7gSip9m8DZG-oBbTJij3hVVvxbg7liVajYeN9UK0XYpgv8GBmizFlP_duzqHYEhYiJSFD6Z_g_KLQaRTq77qkyqW5FkHykstjlykVqb-ZC6hDdX83SHjy2hl-YZ6niBVKf89PmKTU-4MvNSdzFZDqC29fw5aEw Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 322009e2b6f2443c9c3e8f0a43bd7567 Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/322009e2b6f2443c9c3e8f0a43bd7567"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/322009e2b6f2443c9c3e8f0a43bd7567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_322009e2b6f2443c9c3e8f0a43bd7567", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/322009e2b6f2443c9c3e8f0a43bd7567"}]}] Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 322009e2b6f2443c9c3e8f0a43bd7567 Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerDiskConfigTestJSON-418169676-project Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8878ab6c93164071bb4602782e3d5e5c Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerDiskConfigTestJSON-418169676-project Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd'} Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.350258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.356165 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.356165 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.356165 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.356165 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:58.356165 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:58.356165 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. Oct 05 17:47:58.356165 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.358272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Returning 404 to user: Instance 4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:58.359950 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3aed4e3-8bf8-42a5-9440-07e7ac39f365 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd" status: 404 len: 111 microversion: 2.1 time: 0.054381 Oct 05 17:47:58.360758 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1968/3707] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:58 2022] GET /compute/v2.1/servers/4de54dfc-fe33-4dd8-bdd5-bd0d8c8932dd => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:47:58.367422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9f88c63d-9634-4270-917c-fb5d940b0ee4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:47:58.368276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9f88c63d-9634-4270-917c-fb5d940b0ee4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:58.395075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f88c63d-9634-4270-917c-fb5d940b0ee4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.395075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f88c63d-9634-4270-917c-fb5d940b0ee4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.395075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f88c63d-9634-4270-917c-fb5d940b0ee4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.395075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f88c63d-9634-4270-917c-fb5d940b0ee4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.395075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f88c63d-9634-4270-917c-fb5d940b0ee4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.395075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f88c63d-9634-4270-917c-fb5d940b0ee4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.455958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:47:58.520316 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9f88c63d-9634-4270-917c-fb5d940b0ee4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action" status: 202 len: 0 microversion: 2.1 time: 0.156961 Oct 05 17:47:58.521149 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1969/3708] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:47:58 2022] POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:47:58.542225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:58.542938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:58.560299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.561093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.561702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.562623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.563265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.563856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.581829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] HTTP exception thrown: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Request method failure captured: Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 HTTP/1.1 Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcKiW_SFoUMM3mTVE7gSip9m8DZG-oBbTJij3hVVvxbg7liVajYeN9UK0XYpgv8GBmizFlP_duzqHYEhYiJSFD6Z_g_KLQaRTq77qkyqW5FkHykstjlykVqb-ZC6hDdX83SHjy2hl-YZ6niBVKf89PmKTU-4MvNSdzFZDqC29fw5aEw Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 322009e2b6f2443c9c3e8f0a43bd7567 Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/322009e2b6f2443c9c3e8f0a43bd7567"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/322009e2b6f2443c9c3e8f0a43bd7567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_322009e2b6f2443c9c3e8f0a43bd7567", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/322009e2b6f2443c9c3e8f0a43bd7567"}]}] Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 322009e2b6f2443c9c3e8f0a43bd7567 Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerDiskConfigTestJSON-418169676-project Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8878ab6c93164071bb4602782e3d5e5c Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerDiskConfigTestJSON-418169676-project Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'a3fc4e4d-9f2d-4df2-bf41-9fd764de0382'} Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:58.584169 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. Oct 05 17:47:58.589924 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.595053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Returning 404 to user: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:58.597680 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5fb80de0-6db9-4d46-8ce9-71bbb3828754 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 404 len: 111 microversion: 2.1 time: 0.062882 Oct 05 17:47:58.599732 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1970/3709] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:47:58 2022] DELETE /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:47:58.617338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb9d404a-bcb6-47a7-a5ef-972aefc83882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:58.618217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb9d404a-bcb6-47a7-a5ef-972aefc83882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:58.626582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb9d404a-bcb6-47a7-a5ef-972aefc83882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.628538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb9d404a-bcb6-47a7-a5ef-972aefc83882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.629393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb9d404a-bcb6-47a7-a5ef-972aefc83882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.630734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb9d404a-bcb6-47a7-a5ef-972aefc83882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.632208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb9d404a-bcb6-47a7-a5ef-972aefc83882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.632836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb9d404a-bcb6-47a7-a5ef-972aefc83882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.882013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fb9d404a-bcb6-47a7-a5ef-972aefc83882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:58.895358 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb9d404a-bcb6-47a7-a5ef-972aefc83882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1521 microversion: 2.1 time: 0.294154 Oct 05 17:47:58.896136 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1971/3710] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:58 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:58.915491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:58.916157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] [instance: a3fc4e4d-9f2d-4df2-bf41-9fd764de0382] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:58.924891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.929073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.929757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.931143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.933008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.935700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.958945 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] HTTP exception thrown: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Request method failure captured: Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 HTTP/1.1 Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcKiW_SFoUMM3mTVE7gSip9m8DZG-oBbTJij3hVVvxbg7liVajYeN9UK0XYpgv8GBmizFlP_duzqHYEhYiJSFD6Z_g_KLQaRTq77qkyqW5FkHykstjlykVqb-ZC6hDdX83SHjy2hl-YZ6niBVKf89PmKTU-4MvNSdzFZDqC29fw5aEw Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 322009e2b6f2443c9c3e8f0a43bd7567 Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/322009e2b6f2443c9c3e8f0a43bd7567"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/322009e2b6f2443c9c3e8f0a43bd7567"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_322009e2b6f2443c9c3e8f0a43bd7567", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/322009e2b6f2443c9c3e8f0a43bd7567"}]}] Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 322009e2b6f2443c9c3e8f0a43bd7567 Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-418169676 Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerDiskConfigTestJSON-418169676-project Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8878ab6c93164071bb4602782e3d5e5c Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerDiskConfigTestJSON-418169676-project Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'a3fc4e4d-9f2d-4df2-bf41-9fd764de0382'} Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:47:58.960514 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.965147 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:47:58.965147 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:47:58.965147 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:47:58.965147 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:47:58.965147 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:47:58.965147 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. Oct 05 17:47:58.965147 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:47:58.965147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] Returning 404 to user: Instance a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:47:58.965147 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-220cd3e8-e40a-4248-bc82-85f7520dd809 tempest-ServerDiskConfigTestJSON-418169676 tempest-ServerDiskConfigTestJSON-418169676-project] 10.222.0.70 "GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382" status: 404 len: 111 microversion: 2.1 time: 0.065015 Oct 05 17:47:58.965147 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1972/3711] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:58 2022] GET /compute/v2.1/servers/a3fc4e4d-9f2d-4df2-bf41-9fd764de0382 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:47:58.971328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-af08f511-6137-4081-85a4-14a28657c9d2 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:58.971946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-af08f511-6137-4081-85a4-14a28657c9d2 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:58.981747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af08f511-6137-4081-85a4-14a28657c9d2 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.983283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af08f511-6137-4081-85a4-14a28657c9d2 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.984147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af08f511-6137-4081-85a4-14a28657c9d2 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:58.985091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af08f511-6137-4081-85a4-14a28657c9d2 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:58.985723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af08f511-6137-4081-85a4-14a28657c9d2 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:58.986374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af08f511-6137-4081-85a4-14a28657c9d2 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:59.118523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-af08f511-6137-4081-85a4-14a28657c9d2 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:47:59.137476 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-af08f511-6137-4081-85a4-14a28657c9d2 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1321 microversion: 2.1 time: 0.168228 Oct 05 17:47:59.153517 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1973/3712] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:58 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:47:59.924332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c28ba191-72ca-4170-827b-a8267268a3ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:47:59.925127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c28ba191-72ca-4170-827b-a8267268a3ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:47:59.938555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c28ba191-72ca-4170-827b-a8267268a3ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:59.941651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c28ba191-72ca-4170-827b-a8267268a3ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:59.942329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c28ba191-72ca-4170-827b-a8267268a3ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:47:59.944718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c28ba191-72ca-4170-827b-a8267268a3ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:47:59.945209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c28ba191-72ca-4170-827b-a8267268a3ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:47:59.945649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c28ba191-72ca-4170-827b-a8267268a3ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:00.366517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c28ba191-72ca-4170-827b-a8267268a3ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:00.375491 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c28ba191-72ca-4170-827b-a8267268a3ae tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1501 microversion: 2.1 time: 0.455119 Oct 05 17:48:00.386728 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1974/3713] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:47:59 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1501 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:00.391911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3223536a-f3ee-4608-95f8-372da1bcdaae tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:00.392749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3223536a-f3ee-4608-95f8-372da1bcdaae tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:00.407403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223536a-f3ee-4608-95f8-372da1bcdaae tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:00.408295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223536a-f3ee-4608-95f8-372da1bcdaae tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:00.408970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223536a-f3ee-4608-95f8-372da1bcdaae tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:00.415559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223536a-f3ee-4608-95f8-372da1bcdaae tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:00.416471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223536a-f3ee-4608-95f8-372da1bcdaae tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:00.417163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223536a-f3ee-4608-95f8-372da1bcdaae tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:00.543689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3223536a-f3ee-4608-95f8-372da1bcdaae tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:00.554619 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3223536a-f3ee-4608-95f8-372da1bcdaae tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1327 microversion: 2.1 time: 0.166513 Oct 05 17:48:00.559075 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1975/3714] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:00 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1327 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:00.564523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:00.570947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:00.577838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:00.578809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:00.579332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:00.580284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:00.580971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:00.581621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:00.615905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lazy-loading 'flavor' on Instance uuid d037b8c8-e287-459a-a4b4-ac53b463337d {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:48:00.635711 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] HTTP exception thrown: Cannot 'rescue' instance d037b8c8-e287-459a-a4b4-ac53b463337d while it is in vm_state paused Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Request method failure captured: Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action HTTP/1.1 Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 14 Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcMOAOpdE63X8OhW4wsEy2crLrx01LtQ-rp_0wT7KyP_snq49RBe9pW2rDXvGDquoPS8xWknsOpVRp2diM1zITKhR01lPNUgSkUsWER9laVmknlwDrrF_SZj9lTxUjYcrefuqCr0JxKMwpc1ouYu8vVwbNWydS37cc_WZDK5JdlZgNU Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/caf452f31a594c888e1703356c637a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_caf452f31a594c888e1703356c637a91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}] Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 50b3fb554dd64e41bea1109e697b0799 Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: {"rescue": {}} Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot 'rescue' instance d037b8c8-e287-459a-a4b4-ac53b463337d while it is in vm_state paused Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'd037b8c8-e287-459a-a4b4-ac53b463337d', 'body': {'rescue': {}}} Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d037b8c8-e287-459a-a4b4-ac53b463337d in vm_state paused. Cannot rescue while the instance is in this state. Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance d037b8c8-e287-459a-a4b4-ac53b463337d while it is in vm_state paused Oct 05 17:48:00.638835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:00.649417 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:48:00.649417 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:00.649417 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:48:00.649417 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:48:00.649417 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:48:00.649417 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:48:00.649417 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:48:00.649417 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance d037b8c8-e287-459a-a4b4-ac53b463337d while it is in vm_state paused Oct 05 17:48:00.649417 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:00.653842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Returning 409 to user: Cannot 'rescue' instance d037b8c8-e287-459a-a4b4-ac53b463337d while it is in vm_state paused {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:48:00.655695 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6f08c378-8d6b-407b-94ea-2067e2fb7a56 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action" status: 409 len: 144 microversion: 2.1 time: 0.094820 Oct 05 17:48:00.656734 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1976/3715] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:48:00 2022] POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action => generated 144 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:48:00.666410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-20491892-a158-493c-92cc-8ed4dd133296 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:00.666956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-20491892-a158-493c-92cc-8ed4dd133296 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:00.674302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20491892-a158-493c-92cc-8ed4dd133296 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:00.674814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20491892-a158-493c-92cc-8ed4dd133296 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:00.675250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20491892-a158-493c-92cc-8ed4dd133296 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:00.675963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20491892-a158-493c-92cc-8ed4dd133296 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:00.676505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20491892-a158-493c-92cc-8ed4dd133296 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:00.677523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20491892-a158-493c-92cc-8ed4dd133296 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:00.822888 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-20491892-a158-493c-92cc-8ed4dd133296 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action" status: 202 len: 0 microversion: 2.1 time: 0.159111 Oct 05 17:48:00.824124 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1977/3716] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:48:00 2022] POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:48:00.876083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56e3b9d0-fbb7-4854-89a5-862d93dffc96 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:00.879781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56e3b9d0-fbb7-4854-89a5-862d93dffc96 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:00.898827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56e3b9d0-fbb7-4854-89a5-862d93dffc96 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:00.899596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56e3b9d0-fbb7-4854-89a5-862d93dffc96 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:00.900824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56e3b9d0-fbb7-4854-89a5-862d93dffc96 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:00.901985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56e3b9d0-fbb7-4854-89a5-862d93dffc96 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:00.904625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56e3b9d0-fbb7-4854-89a5-862d93dffc96 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:00.905675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56e3b9d0-fbb7-4854-89a5-862d93dffc96 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:01.690888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-56e3b9d0-fbb7-4854-89a5-862d93dffc96 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:01.732505 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56e3b9d0-fbb7-4854-89a5-862d93dffc96 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1508 microversion: 2.1 time: 0.876943 Oct 05 17:48:01.734202 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1978/3717] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:00 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1508 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:01.741256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e243fec-2de8-48ea-8d42-e4b58297dd53 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:01.742294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7e243fec-2de8-48ea-8d42-e4b58297dd53 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:01.756781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e243fec-2de8-48ea-8d42-e4b58297dd53 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:01.757718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e243fec-2de8-48ea-8d42-e4b58297dd53 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:01.758609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e243fec-2de8-48ea-8d42-e4b58297dd53 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:01.759774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e243fec-2de8-48ea-8d42-e4b58297dd53 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:01.760853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e243fec-2de8-48ea-8d42-e4b58297dd53 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:01.761896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e243fec-2de8-48ea-8d42-e4b58297dd53 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:01.911079 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7854acee-c7cd-443f-bb91-9f91a50fca8c tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532/action" status: 202 len: 0 microversion: 2.1 time: 3.686430 Oct 05 17:48:01.916026 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1740/3718] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:47:58 2022] POST /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532/action => generated 0 bytes in 3692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:48:01.927380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-03f75d39-071e-4738-8bc0-853b81a7d83b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:01.932062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-03f75d39-071e-4738-8bc0-853b81a7d83b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:01.988916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03f75d39-071e-4738-8bc0-853b81a7d83b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:01.991888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03f75d39-071e-4738-8bc0-853b81a7d83b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:01.994082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03f75d39-071e-4738-8bc0-853b81a7d83b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:01.996309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03f75d39-071e-4738-8bc0-853b81a7d83b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:01.997105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03f75d39-071e-4738-8bc0-853b81a7d83b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:01.999628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03f75d39-071e-4738-8bc0-853b81a7d83b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:02.091443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7e243fec-2de8-48ea-8d42-e4b58297dd53 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:02.115323 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7e243fec-2de8-48ea-8d42-e4b58297dd53 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1327 microversion: 2.1 time: 0.377407 Oct 05 17:48:02.116641 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1979/3719] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:01 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1327 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:02.522550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-03f75d39-071e-4738-8bc0-853b81a7d83b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:02.534382 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-03f75d39-071e-4738-8bc0-853b81a7d83b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.615652 Oct 05 17:48:02.535655 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1741/3720] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:01 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:02.762351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1afb1378-2ab9-4b39-963e-11a89586d5e4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:02.763537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1afb1378-2ab9-4b39-963e-11a89586d5e4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:02.787148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1afb1378-2ab9-4b39-963e-11a89586d5e4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:02.795195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1afb1378-2ab9-4b39-963e-11a89586d5e4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:02.797108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1afb1378-2ab9-4b39-963e-11a89586d5e4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:02.798212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1afb1378-2ab9-4b39-963e-11a89586d5e4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:02.799095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1afb1378-2ab9-4b39-963e-11a89586d5e4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:02.799858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1afb1378-2ab9-4b39-963e-11a89586d5e4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:03.146974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fbcc10ca-dc58-46bd-8b97-c89c0abdb826 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:03.147756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fbcc10ca-dc58-46bd-8b97-c89c0abdb826 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:03.161090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fbcc10ca-dc58-46bd-8b97-c89c0abdb826 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:03.161589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fbcc10ca-dc58-46bd-8b97-c89c0abdb826 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:03.162028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fbcc10ca-dc58-46bd-8b97-c89c0abdb826 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:03.165190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fbcc10ca-dc58-46bd-8b97-c89c0abdb826 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:03.165680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fbcc10ca-dc58-46bd-8b97-c89c0abdb826 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:03.166114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fbcc10ca-dc58-46bd-8b97-c89c0abdb826 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:03.181749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1afb1378-2ab9-4b39-963e-11a89586d5e4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:03.193390 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1afb1378-2ab9-4b39-963e-11a89586d5e4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1516 microversion: 2.1 time: 0.434879 Oct 05 17:48:03.194293 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1980/3721] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:02 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1516 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:03.566496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0cab7f56-d8f7-492d-864f-56dc0cc58678 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:03.567262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0cab7f56-d8f7-492d-864f-56dc0cc58678 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:03.590235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7f56-d8f7-492d-864f-56dc0cc58678 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:03.590774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7f56-d8f7-492d-864f-56dc0cc58678 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:03.591215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7f56-d8f7-492d-864f-56dc0cc58678 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:03.591933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7f56-d8f7-492d-864f-56dc0cc58678 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:03.592396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7f56-d8f7-492d-864f-56dc0cc58678 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:03.592822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab7f56-d8f7-492d-864f-56dc0cc58678 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:04.052240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fbcc10ca-dc58-46bd-8b97-c89c0abdb826 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:04.066772 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fbcc10ca-dc58-46bd-8b97-c89c0abdb826 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1394 microversion: 2.1 time: 0.926805 Oct 05 17:48:04.088008 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1742/3722] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:03 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1394 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:04.371783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0cab7f56-d8f7-492d-864f-56dc0cc58678 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:04.386219 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0cab7f56-d8f7-492d-864f-56dc0cc58678 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.829247 Oct 05 17:48:04.389619 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1981/3723] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:03 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:04.714232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-06b6d676-6613-4d01-820b-e31635871e4c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:04.714833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-06b6d676-6613-4d01-820b-e31635871e4c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:04.729187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06b6d676-6613-4d01-820b-e31635871e4c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:04.732929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06b6d676-6613-4d01-820b-e31635871e4c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:04.733442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06b6d676-6613-4d01-820b-e31635871e4c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:04.734269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06b6d676-6613-4d01-820b-e31635871e4c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:04.739050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06b6d676-6613-4d01-820b-e31635871e4c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:04.739506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06b6d676-6613-4d01-820b-e31635871e4c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:05.001605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-06b6d676-6613-4d01-820b-e31635871e4c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lazy-loading 'services' on Instance uuid 6ad2a87d-6f65-4d38-add2-2b119a8a2210 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:48:05.096850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9946d741-44cf-4fab-9a74-53d7b75f251c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:05.097478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9946d741-44cf-4fab-9a74-53d7b75f251c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:05.119357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9946d741-44cf-4fab-9a74-53d7b75f251c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:05.121006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9946d741-44cf-4fab-9a74-53d7b75f251c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:05.122447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9946d741-44cf-4fab-9a74-53d7b75f251c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:05.131532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9946d741-44cf-4fab-9a74-53d7b75f251c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:05.132528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9946d741-44cf-4fab-9a74-53d7b75f251c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:05.133202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9946d741-44cf-4fab-9a74-53d7b75f251c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:05.232608 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-06b6d676-6613-4d01-820b-e31635871e4c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/os-volume_attachments/1d8dc943-9823-4d32-9a21-888cd058b50d" status: 202 len: 0 microversion: 2.1 time: 0.521437 Oct 05 17:48:05.234174 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1743/3724] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 17:48:04 2022] DELETE /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/os-volume_attachments/1d8dc943-9823-4d32-9a21-888cd058b50d => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:48:05.422501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d5e94b2a-9184-43b7-ac3c-4c7aa47960fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:05.423271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d5e94b2a-9184-43b7-ac3c-4c7aa47960fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:05.452522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5e94b2a-9184-43b7-ac3c-4c7aa47960fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:05.461366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5e94b2a-9184-43b7-ac3c-4c7aa47960fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:05.461999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5e94b2a-9184-43b7-ac3c-4c7aa47960fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:05.471352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5e94b2a-9184-43b7-ac3c-4c7aa47960fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:05.485665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5e94b2a-9184-43b7-ac3c-4c7aa47960fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:05.495568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5e94b2a-9184-43b7-ac3c-4c7aa47960fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:06.197265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9946d741-44cf-4fab-9a74-53d7b75f251c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:06.208819 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9946d741-44cf-4fab-9a74-53d7b75f251c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1394 microversion: 2.1 time: 1.116062 Oct 05 17:48:06.209416 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1982/3725] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:05 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1394 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:06.227977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1bfceb13-fc1b-44d3-8a6c-91bb1b1b24c0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:06.237878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1bfceb13-fc1b-44d3-8a6c-91bb1b1b24c0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:06.255535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfceb13-fc1b-44d3-8a6c-91bb1b1b24c0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:06.258611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfceb13-fc1b-44d3-8a6c-91bb1b1b24c0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:06.260031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfceb13-fc1b-44d3-8a6c-91bb1b1b24c0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:06.261014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfceb13-fc1b-44d3-8a6c-91bb1b1b24c0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:06.261722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfceb13-fc1b-44d3-8a6c-91bb1b1b24c0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:06.262783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bfceb13-fc1b-44d3-8a6c-91bb1b1b24c0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:06.306585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-1bfceb13-fc1b-44d3-8a6c-91bb1b1b24c0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lazy-loading 'flavor' on Instance uuid d037b8c8-e287-459a-a4b4-ac53b463337d {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:48:06.471238 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1bfceb13-fc1b-44d3-8a6c-91bb1b1b24c0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action" status: 200 len: 32 microversion: 2.1 time: 0.254589 Oct 05 17:48:06.479484 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1983/3726] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:48:06 2022] POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action => generated 32 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:48:06.488408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-69442914-c958-4e6b-88da-af9902ff3e5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:06.491150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-69442914-c958-4e6b-88da-af9902ff3e5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:06.500024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69442914-c958-4e6b-88da-af9902ff3e5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:06.501079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69442914-c958-4e6b-88da-af9902ff3e5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:06.502199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69442914-c958-4e6b-88da-af9902ff3e5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:06.503786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69442914-c958-4e6b-88da-af9902ff3e5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:06.504785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69442914-c958-4e6b-88da-af9902ff3e5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:06.505917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d5e94b2a-9184-43b7-ac3c-4c7aa47960fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:06.507179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69442914-c958-4e6b-88da-af9902ff3e5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:06.529585 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d5e94b2a-9184-43b7-ac3c-4c7aa47960fc tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 1.110155 Oct 05 17:48:06.533786 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1744/3727] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:05 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:06.564723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:06.959396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-69442914-c958-4e6b-88da-af9902ff3e5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:06.981425 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-69442914-c958-4e6b-88da-af9902ff3e5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.498371 Oct 05 17:48:07.001169 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1984/3728] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:06 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:07.235956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9ca3b5ed-17bf-4146-baa2-75db0f9f48b6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:07.236687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9ca3b5ed-17bf-4146-baa2-75db0f9f48b6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:07.272380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca3b5ed-17bf-4146-baa2-75db0f9f48b6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:07.272899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca3b5ed-17bf-4146-baa2-75db0f9f48b6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:07.273347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca3b5ed-17bf-4146-baa2-75db0f9f48b6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:07.274105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca3b5ed-17bf-4146-baa2-75db0f9f48b6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:07.274933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca3b5ed-17bf-4146-baa2-75db0f9f48b6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:07.275376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ca3b5ed-17bf-4146-baa2-75db0f9f48b6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:07.390563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:07.562053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-29cf13b2-ce51-491e-8646-f890191ab689 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:07.562724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-29cf13b2-ce51-491e-8646-f890191ab689 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:07.580491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29cf13b2-ce51-491e-8646-f890191ab689 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:07.581286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29cf13b2-ce51-491e-8646-f890191ab689 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:07.584669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29cf13b2-ce51-491e-8646-f890191ab689 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:07.585769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29cf13b2-ce51-491e-8646-f890191ab689 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:07.587109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29cf13b2-ce51-491e-8646-f890191ab689 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:07.588848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29cf13b2-ce51-491e-8646-f890191ab689 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:07.812197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:07.952946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9ca3b5ed-17bf-4146-baa2-75db0f9f48b6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:07.966969 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9ca3b5ed-17bf-4146-baa2-75db0f9f48b6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1394 microversion: 2.1 time: 0.735321 Oct 05 17:48:07.967578 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1745/3729] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:07 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1394 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:08.017134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52f33a4b-3ea9-449b-b8c9-0a48bbd42a87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:08.017995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-52f33a4b-3ea9-449b-b8c9-0a48bbd42a87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:08.027023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f33a4b-3ea9-449b-b8c9-0a48bbd42a87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:08.041075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f33a4b-3ea9-449b-b8c9-0a48bbd42a87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:08.042021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f33a4b-3ea9-449b-b8c9-0a48bbd42a87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:08.043066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f33a4b-3ea9-449b-b8c9-0a48bbd42a87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:08.043707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f33a4b-3ea9-449b-b8c9-0a48bbd42a87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:08.044377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f33a4b-3ea9-449b-b8c9-0a48bbd42a87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:08.158424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:08.325752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-29cf13b2-ce51-491e-8646-f890191ab689 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:08.363092 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-29cf13b2-ce51-491e-8646-f890191ab689 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.807870 Oct 05 17:48:08.366546 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1985/3730] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:07 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:08.383245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-60a7d763-107c-49a9-a25f-3b79a60f364f req-aaf352ee-324f-4cfa-816a-8816f6114cbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d56495f4-d64f-4905-9eb3-7708c6dd238a", "tag": "7735bafa-0319-445b-9b1a-e61ec36d4797"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:08.422114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-60a7d763-107c-49a9-a25f-3b79a60f364f req-aaf352ee-324f-4cfa-816a-8816f6114cbe service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:08.422907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-60a7d763-107c-49a9-a25f-3b79a60f364f req-aaf352ee-324f-4cfa-816a-8816f6114cbe service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:08.423672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-60a7d763-107c-49a9-a25f-3b79a60f364f req-aaf352ee-324f-4cfa-816a-8816f6114cbe service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:08.476274 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-60a7d763-107c-49a9-a25f-3b79a60f364f req-aaf352ee-324f-4cfa-816a-8816f6114cbe service nova] Creating event network-changed:7735bafa-0319-445b-9b1a-e61ec36d4797 for instance d56495f4-d64f-4905-9eb3-7708c6dd238a on n-h1-835595-3 Oct 05 17:48:08.491914 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-60a7d763-107c-49a9-a25f-3b79a60f364f req-aaf352ee-324f-4cfa-816a-8816f6114cbe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123598 Oct 05 17:48:08.495811 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1986/3731] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:08.502809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-52f33a4b-3ea9-449b-b8c9-0a48bbd42a87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:08.512574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:08.518579 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-52f33a4b-3ea9-449b-b8c9-0a48bbd42a87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.505831 Oct 05 17:48:08.521465 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1746/3732] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:08 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:08.998529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21e176ef-b21c-45a5-841b-f741bad19843 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:08.999895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21e176ef-b21c-45a5-841b-f741bad19843 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:09.017751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e176ef-b21c-45a5-841b-f741bad19843 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:09.018253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e176ef-b21c-45a5-841b-f741bad19843 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:09.022091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e176ef-b21c-45a5-841b-f741bad19843 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:09.024352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e176ef-b21c-45a5-841b-f741bad19843 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:09.025067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e176ef-b21c-45a5-841b-f741bad19843 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:09.026863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e176ef-b21c-45a5-841b-f741bad19843 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:09.283432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21e176ef-b21c-45a5-841b-f741bad19843 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:09.296646 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21e176ef-b21c-45a5-841b-f741bad19843 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1394 microversion: 2.1 time: 0.307646 Oct 05 17:48:09.297491 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1987/3733] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:08 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1394 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:09.388454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43bbbe61-31ff-4f36-98be-758b6afa9a87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:09.389739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-43bbbe61-31ff-4f36-98be-758b6afa9a87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:09.407590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43bbbe61-31ff-4f36-98be-758b6afa9a87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:09.409242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43bbbe61-31ff-4f36-98be-758b6afa9a87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:09.411241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43bbbe61-31ff-4f36-98be-758b6afa9a87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:09.412244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43bbbe61-31ff-4f36-98be-758b6afa9a87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:09.412712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43bbbe61-31ff-4f36-98be-758b6afa9a87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:09.418103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43bbbe61-31ff-4f36-98be-758b6afa9a87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:09.552420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-041ccf25-a52b-44a6-aae8-9bbb4e3f2f5f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:09.554371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-041ccf25-a52b-44a6-aae8-9bbb4e3f2f5f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:09.563156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-041ccf25-a52b-44a6-aae8-9bbb4e3f2f5f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:09.564630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-041ccf25-a52b-44a6-aae8-9bbb4e3f2f5f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:09.565279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-041ccf25-a52b-44a6-aae8-9bbb4e3f2f5f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:09.567611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-041ccf25-a52b-44a6-aae8-9bbb4e3f2f5f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:09.568506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-041ccf25-a52b-44a6-aae8-9bbb4e3f2f5f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:09.569339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-041ccf25-a52b-44a6-aae8-9bbb4e3f2f5f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:09.666980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-43bbbe61-31ff-4f36-98be-758b6afa9a87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:09.687459 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-43bbbe61-31ff-4f36-98be-758b6afa9a87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.302441 Oct 05 17:48:09.702397 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1747/3734] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:09 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:10.236093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-041ccf25-a52b-44a6-aae8-9bbb4e3f2f5f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:10.244457 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-041ccf25-a52b-44a6-aae8-9bbb4e3f2f5f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.699553 Oct 05 17:48:10.258787 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1988/3735] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:09 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:10.323416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b3fa0386-9553-446e-aa20-c5eb8f2cd5d5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:10.324266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3fa0386-9553-446e-aa20-c5eb8f2cd5d5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:10.332702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fa0386-9553-446e-aa20-c5eb8f2cd5d5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:10.336641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fa0386-9553-446e-aa20-c5eb8f2cd5d5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:10.337370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fa0386-9553-446e-aa20-c5eb8f2cd5d5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:10.338216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fa0386-9553-446e-aa20-c5eb8f2cd5d5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:10.345041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fa0386-9553-446e-aa20-c5eb8f2cd5d5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:10.346091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fa0386-9553-446e-aa20-c5eb8f2cd5d5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:10.716968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7c0ff78e-6279-4aba-8205-0e61610407e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:10.725199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7c0ff78e-6279-4aba-8205-0e61610407e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:10.744248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c0ff78e-6279-4aba-8205-0e61610407e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:10.745505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c0ff78e-6279-4aba-8205-0e61610407e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:10.746915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c0ff78e-6279-4aba-8205-0e61610407e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:10.747932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c0ff78e-6279-4aba-8205-0e61610407e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:10.748984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c0ff78e-6279-4aba-8205-0e61610407e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:10.749630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c0ff78e-6279-4aba-8205-0e61610407e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:11.049358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3fa0386-9553-446e-aa20-c5eb8f2cd5d5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:11.052181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7c0ff78e-6279-4aba-8205-0e61610407e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:11.058384 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b3fa0386-9553-446e-aa20-c5eb8f2cd5d5 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1394 microversion: 2.1 time: 0.739630 Oct 05 17:48:11.063263 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1748/3736] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:10 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1394 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:11.074101 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7c0ff78e-6279-4aba-8205-0e61610407e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.361586 Oct 05 17:48:11.079667 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1989/3737] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:10 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:11.270750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc83154e-8da9-4087-81ac-d051998b01eb tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:11.271847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cc83154e-8da9-4087-81ac-d051998b01eb tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:11.284416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc83154e-8da9-4087-81ac-d051998b01eb tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:11.284814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc83154e-8da9-4087-81ac-d051998b01eb tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:11.285298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc83154e-8da9-4087-81ac-d051998b01eb tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:11.286313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc83154e-8da9-4087-81ac-d051998b01eb tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:11.286578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc83154e-8da9-4087-81ac-d051998b01eb tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:11.287006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc83154e-8da9-4087-81ac-d051998b01eb tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:11.697426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cc83154e-8da9-4087-81ac-d051998b01eb tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:11.710491 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cc83154e-8da9-4087-81ac-d051998b01eb tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.445513 Oct 05 17:48:11.745710 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1749/3738] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:11 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:12.085635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d295fd3-b375-4144-b57d-2227a1d92651 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:12.086403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d295fd3-b375-4144-b57d-2227a1d92651 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:12.095579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d295fd3-b375-4144-b57d-2227a1d92651 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:12.095976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d295fd3-b375-4144-b57d-2227a1d92651 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:12.096426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d295fd3-b375-4144-b57d-2227a1d92651 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:12.101892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bbf134f3-19fe-4a80-93f0-fec25e1d5edb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:12.103097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bbf134f3-19fe-4a80-93f0-fec25e1d5edb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:12.112159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d295fd3-b375-4144-b57d-2227a1d92651 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:12.116038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d295fd3-b375-4144-b57d-2227a1d92651 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:12.117827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d295fd3-b375-4144-b57d-2227a1d92651 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:12.118740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbf134f3-19fe-4a80-93f0-fec25e1d5edb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:12.122484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbf134f3-19fe-4a80-93f0-fec25e1d5edb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:12.124302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbf134f3-19fe-4a80-93f0-fec25e1d5edb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:12.126831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbf134f3-19fe-4a80-93f0-fec25e1d5edb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:12.130178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbf134f3-19fe-4a80-93f0-fec25e1d5edb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:12.134456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbf134f3-19fe-4a80-93f0-fec25e1d5edb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:12.540866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d295fd3-b375-4144-b57d-2227a1d92651 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:12.551847 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d295fd3-b375-4144-b57d-2227a1d92651 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1394 microversion: 2.1 time: 0.469780 Oct 05 17:48:12.567688 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1990/3739] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:12 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1394 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:12.583322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a8944efd-a0ad-4882-9d7e-a25b863e32b6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:12.597870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8944efd-a0ad-4882-9d7e-a25b863e32b6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:12.599746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8944efd-a0ad-4882-9d7e-a25b863e32b6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:12.600419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8944efd-a0ad-4882-9d7e-a25b863e32b6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:12.606630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bbf134f3-19fe-4a80-93f0-fec25e1d5edb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:12.618251 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bbf134f3-19fe-4a80-93f0-fec25e1d5edb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.520415 Oct 05 17:48:12.627535 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1750/3740] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:12 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:12.669318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a8944efd-a0ad-4882-9d7e-a25b863e32b6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Going to try to stop instance {{(pid=128844) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 17:48:12.736428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1a8aa5e9-6a72-497e-bf61-8ea9f2e400ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:12.737297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1a8aa5e9-6a72-497e-bf61-8ea9f2e400ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:12.760483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a8aa5e9-6a72-497e-bf61-8ea9f2e400ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:12.761128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a8aa5e9-6a72-497e-bf61-8ea9f2e400ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:12.761586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a8aa5e9-6a72-497e-bf61-8ea9f2e400ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:12.761792 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a8944efd-a0ad-4882-9d7e-a25b863e32b6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/action" status: 202 len: 0 microversion: 2.1 time: 0.187468 Oct 05 17:48:12.762357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a8aa5e9-6a72-497e-bf61-8ea9f2e400ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:12.762794 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1991/3741] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:48:12 2022] POST /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:48:12.762937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a8aa5e9-6a72-497e-bf61-8ea9f2e400ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:12.772313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d702ba8c-7fd0-4db7-8481-fa4ca4f4258c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:12.775861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d702ba8c-7fd0-4db7-8481-fa4ca4f4258c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:12.784136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a8aa5e9-6a72-497e-bf61-8ea9f2e400ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:12.791324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d702ba8c-7fd0-4db7-8481-fa4ca4f4258c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:12.793013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d702ba8c-7fd0-4db7-8481-fa4ca4f4258c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:12.794927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d702ba8c-7fd0-4db7-8481-fa4ca4f4258c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:12.796987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d702ba8c-7fd0-4db7-8481-fa4ca4f4258c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:12.799374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d702ba8c-7fd0-4db7-8481-fa4ca4f4258c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:12.800085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d702ba8c-7fd0-4db7-8481-fa4ca4f4258c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:13.191039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1a8aa5e9-6a72-497e-bf61-8ea9f2e400ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:13.214157 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1a8aa5e9-6a72-497e-bf61-8ea9f2e400ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.481758 Oct 05 17:48:13.214795 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1751/3742] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:12 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:13.394709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d702ba8c-7fd0-4db7-8481-fa4ca4f4258c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:13.412685 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d702ba8c-7fd0-4db7-8481-fa4ca4f4258c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1679 microversion: 2.1 time: 0.645170 Oct 05 17:48:13.416076 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1992/3743] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:12 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1679 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:13.580102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1574d174-c8dc-43dc-a071-26bfbc3b7753 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:13.580718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1574d174-c8dc-43dc-a071-26bfbc3b7753 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:13.591239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1574d174-c8dc-43dc-a071-26bfbc3b7753 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:13.591239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1574d174-c8dc-43dc-a071-26bfbc3b7753 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:13.591239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1574d174-c8dc-43dc-a071-26bfbc3b7753 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:13.591239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1574d174-c8dc-43dc-a071-26bfbc3b7753 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:13.591239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1574d174-c8dc-43dc-a071-26bfbc3b7753 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:13.591811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1574d174-c8dc-43dc-a071-26bfbc3b7753 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:13.655764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bec3d4af-d665-4cb2-9aed-98c0ebb7298f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:13.656685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bec3d4af-d665-4cb2-9aed-98c0ebb7298f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:13.670271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec3d4af-d665-4cb2-9aed-98c0ebb7298f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:13.671110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec3d4af-d665-4cb2-9aed-98c0ebb7298f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:13.671777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec3d4af-d665-4cb2-9aed-98c0ebb7298f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:13.672567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec3d4af-d665-4cb2-9aed-98c0ebb7298f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:13.673102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec3d4af-d665-4cb2-9aed-98c0ebb7298f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:13.673594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec3d4af-d665-4cb2-9aed-98c0ebb7298f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:14.129173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bec3d4af-d665-4cb2-9aed-98c0ebb7298f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:14.139081 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bec3d4af-d665-4cb2-9aed-98c0ebb7298f tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.491365 Oct 05 17:48:14.151462 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1993/3744] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:13 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:14.160765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1574d174-c8dc-43dc-a071-26bfbc3b7753 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:14.177106 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1574d174-c8dc-43dc-a071-26bfbc3b7753 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1394 microversion: 2.1 time: 0.600572 Oct 05 17:48:14.177776 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1752/3745] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:13 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1394 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:14.241530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-69daa483-2b71-40d6-98e9-9bb22ad7b775 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:14.242169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-69daa483-2b71-40d6-98e9-9bb22ad7b775 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:14.249859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69daa483-2b71-40d6-98e9-9bb22ad7b775 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:14.250385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69daa483-2b71-40d6-98e9-9bb22ad7b775 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:14.250835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69daa483-2b71-40d6-98e9-9bb22ad7b775 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:14.261899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69daa483-2b71-40d6-98e9-9bb22ad7b775 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:14.262428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69daa483-2b71-40d6-98e9-9bb22ad7b775 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:14.262884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69daa483-2b71-40d6-98e9-9bb22ad7b775 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:14.444317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-617a0578-f8ef-43ff-a8ba-5b25370111be tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:14.444835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-617a0578-f8ef-43ff-a8ba-5b25370111be tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:14.451474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-617a0578-f8ef-43ff-a8ba-5b25370111be tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:14.451965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-617a0578-f8ef-43ff-a8ba-5b25370111be tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:14.452402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-617a0578-f8ef-43ff-a8ba-5b25370111be tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:14.453107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-617a0578-f8ef-43ff-a8ba-5b25370111be tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:14.453560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-617a0578-f8ef-43ff-a8ba-5b25370111be tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:14.453981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-617a0578-f8ef-43ff-a8ba-5b25370111be tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:14.897409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-69daa483-2b71-40d6-98e9-9bb22ad7b775 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:14.922266 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-69daa483-2b71-40d6-98e9-9bb22ad7b775 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.685132 Oct 05 17:48:14.941014 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1994/3746] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:14 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:14.944783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-617a0578-f8ef-43ff-a8ba-5b25370111be tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:14.965816 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-617a0578-f8ef-43ff-a8ba-5b25370111be tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1679 microversion: 2.1 time: 0.526079 Oct 05 17:48:14.972112 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1753/3747] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:14 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1679 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:15.177257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ad76cada-9c69-4348-9afb-e9fb041792e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:15.178437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ad76cada-9c69-4348-9afb-e9fb041792e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:15.189682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad76cada-9c69-4348-9afb-e9fb041792e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:15.213492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-565b60aa-0c0a-4843-9e00-72261e9f0570 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:15.214553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-565b60aa-0c0a-4843-9e00-72261e9f0570 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:15.221727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad76cada-9c69-4348-9afb-e9fb041792e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:15.224933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad76cada-9c69-4348-9afb-e9fb041792e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:15.229454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad76cada-9c69-4348-9afb-e9fb041792e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:15.231307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad76cada-9c69-4348-9afb-e9fb041792e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:15.233383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad76cada-9c69-4348-9afb-e9fb041792e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:15.244035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565b60aa-0c0a-4843-9e00-72261e9f0570 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:15.246450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565b60aa-0c0a-4843-9e00-72261e9f0570 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:15.247909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565b60aa-0c0a-4843-9e00-72261e9f0570 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:15.253584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565b60aa-0c0a-4843-9e00-72261e9f0570 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:15.257909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565b60aa-0c0a-4843-9e00-72261e9f0570 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:15.260633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-565b60aa-0c0a-4843-9e00-72261e9f0570 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:15.724314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-565b60aa-0c0a-4843-9e00-72261e9f0570 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:15.737341 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-565b60aa-0c0a-4843-9e00-72261e9f0570 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1394 microversion: 2.1 time: 0.537762 Oct 05 17:48:15.740145 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1754/3748] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:15 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1394 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:15.770034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d266ffd5-3ca9-410f-aae3-1602c87d9c0d req-4c5f0cda-7ccf-426e-bfed-4f112421a9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56495f4-d64f-4905-9eb3-7708c6dd238a", "name": "network-vif-plugged", "status": "completed", "tag": "7735bafa-0319-445b-9b1a-e61ec36d4797"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:15.795830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d266ffd5-3ca9-410f-aae3-1602c87d9c0d req-4c5f0cda-7ccf-426e-bfed-4f112421a9b3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:15.796587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d266ffd5-3ca9-410f-aae3-1602c87d9c0d req-4c5f0cda-7ccf-426e-bfed-4f112421a9b3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:15.797132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d266ffd5-3ca9-410f-aae3-1602c87d9c0d req-4c5f0cda-7ccf-426e-bfed-4f112421a9b3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:15.859488 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d266ffd5-3ca9-410f-aae3-1602c87d9c0d req-4c5f0cda-7ccf-426e-bfed-4f112421a9b3 service nova] Creating event network-vif-plugged:7735bafa-0319-445b-9b1a-e61ec36d4797 for instance d56495f4-d64f-4905-9eb3-7708c6dd238a on n-h1-835595-3 Oct 05 17:48:15.899064 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d266ffd5-3ca9-410f-aae3-1602c87d9c0d req-4c5f0cda-7ccf-426e-bfed-4f112421a9b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158160 Oct 05 17:48:15.900006 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1755/3749] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:15.963696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d36f859-d00f-4e8e-8819-1abbe9b686c2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:15.964407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9d36f859-d00f-4e8e-8819-1abbe9b686c2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:15.977207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d36f859-d00f-4e8e-8819-1abbe9b686c2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:15.977710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d36f859-d00f-4e8e-8819-1abbe9b686c2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:15.978150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d36f859-d00f-4e8e-8819-1abbe9b686c2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:15.978964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d36f859-d00f-4e8e-8819-1abbe9b686c2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:15.979374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d36f859-d00f-4e8e-8819-1abbe9b686c2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:15.979790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d36f859-d00f-4e8e-8819-1abbe9b686c2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:16.126856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ad76cada-9c69-4348-9afb-e9fb041792e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:16.139438 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ad76cada-9c69-4348-9afb-e9fb041792e6 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.966541 Oct 05 17:48:16.140051 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1995/3750] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:15 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:16.165093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b98a0eda-539f-423a-9828-d2db4da88187 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:16.166166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b98a0eda-539f-423a-9828-d2db4da88187 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:16.173318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b98a0eda-539f-423a-9828-d2db4da88187 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:16.174175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b98a0eda-539f-423a-9828-d2db4da88187 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:16.175394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b98a0eda-539f-423a-9828-d2db4da88187 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:16.177121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b98a0eda-539f-423a-9828-d2db4da88187 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:16.178162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b98a0eda-539f-423a-9828-d2db4da88187 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:16.179160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b98a0eda-539f-423a-9828-d2db4da88187 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:16.555751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9d36f859-d00f-4e8e-8819-1abbe9b686c2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:16.569997 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d36f859-d00f-4e8e-8819-1abbe9b686c2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.610274 Oct 05 17:48:16.591106 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1756/3751] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:15 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:16.714777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b98a0eda-539f-423a-9828-d2db4da88187 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:16.727165 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b98a0eda-539f-423a-9828-d2db4da88187 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1679 microversion: 2.1 time: 0.575308 Oct 05 17:48:16.741366 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1996/3752] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:16 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1679 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:16.772175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e5c21532-65ef-4325-8630-f1cd7594553a tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:16.772773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e5c21532-65ef-4325-8630-f1cd7594553a tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:16.789862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5c21532-65ef-4325-8630-f1cd7594553a tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:16.790520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5c21532-65ef-4325-8630-f1cd7594553a tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:16.791193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5c21532-65ef-4325-8630-f1cd7594553a tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:16.793528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5c21532-65ef-4325-8630-f1cd7594553a tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:16.794228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5c21532-65ef-4325-8630-f1cd7594553a tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:16.795930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5c21532-65ef-4325-8630-f1cd7594553a tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:17.169483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e367d4f8-878c-4213-b602-78ff65daef92 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:17.170074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e367d4f8-878c-4213-b602-78ff65daef92 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:17.177163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:17.196467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e367d4f8-878c-4213-b602-78ff65daef92 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:17.196974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e367d4f8-878c-4213-b602-78ff65daef92 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:17.197410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e367d4f8-878c-4213-b602-78ff65daef92 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:17.198121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e367d4f8-878c-4213-b602-78ff65daef92 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:17.198637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e367d4f8-878c-4213-b602-78ff65daef92 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:17.199054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e367d4f8-878c-4213-b602-78ff65daef92 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:17.285971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e5c21532-65ef-4325-8630-f1cd7594553a tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:17.302863 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e5c21532-65ef-4325-8630-f1cd7594553a tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1394 microversion: 2.1 time: 0.539762 Oct 05 17:48:17.306793 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1757/3753] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:16 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1394 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:17.533420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e367d4f8-878c-4213-b602-78ff65daef92 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:17.544848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e367d4f8-878c-4213-b602-78ff65daef92 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.379261 Oct 05 17:48:17.550364 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1997/3754] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:17 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:17.600184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1d4dc776-4b8d-4c79-b142-5042df03e714 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:17.601288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1d4dc776-4b8d-4c79-b142-5042df03e714 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:17.615656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d4dc776-4b8d-4c79-b142-5042df03e714 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:17.617674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d4dc776-4b8d-4c79-b142-5042df03e714 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:17.620370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d4dc776-4b8d-4c79-b142-5042df03e714 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:17.622163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d4dc776-4b8d-4c79-b142-5042df03e714 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:17.623920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d4dc776-4b8d-4c79-b142-5042df03e714 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:17.626128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d4dc776-4b8d-4c79-b142-5042df03e714 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:17.759299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fec3a6c8-c94e-4573-b279-c44070cf2314 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:17.760255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fec3a6c8-c94e-4573-b279-c44070cf2314 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:17.771336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fec3a6c8-c94e-4573-b279-c44070cf2314 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:17.774543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fec3a6c8-c94e-4573-b279-c44070cf2314 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:17.775071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fec3a6c8-c94e-4573-b279-c44070cf2314 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:17.775972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fec3a6c8-c94e-4573-b279-c44070cf2314 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:17.778997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fec3a6c8-c94e-4573-b279-c44070cf2314 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:17.780753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fec3a6c8-c94e-4573-b279-c44070cf2314 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:18.039849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fec3a6c8-c94e-4573-b279-c44070cf2314 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:18.049370 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fec3a6c8-c94e-4573-b279-c44070cf2314 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1679 microversion: 2.1 time: 0.298937 Oct 05 17:48:18.053264 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1998/3755] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:17 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1679 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:18.330057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-91654e47-f5a5-4922-a094-71546eab1c38 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:18.330658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-91654e47-f5a5-4922-a094-71546eab1c38 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:18.348546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91654e47-f5a5-4922-a094-71546eab1c38 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:18.349051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91654e47-f5a5-4922-a094-71546eab1c38 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:18.349494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91654e47-f5a5-4922-a094-71546eab1c38 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:18.355996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91654e47-f5a5-4922-a094-71546eab1c38 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:18.359562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91654e47-f5a5-4922-a094-71546eab1c38 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:18.360029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91654e47-f5a5-4922-a094-71546eab1c38 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:18.745956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-91654e47-f5a5-4922-a094-71546eab1c38 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:18.769949 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-91654e47-f5a5-4922-a094-71546eab1c38 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1575 microversion: 2.1 time: 0.442821 Oct 05 17:48:18.787396 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 1999/3756] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:18 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1575 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:18.795105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78d88aab-e997-486e-9d7f-b99eb3889d87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:18.796410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-78d88aab-e997-486e-9d7f-b99eb3889d87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:18.812032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88aab-e997-486e-9d7f-b99eb3889d87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:18.812702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88aab-e997-486e-9d7f-b99eb3889d87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:18.813818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88aab-e997-486e-9d7f-b99eb3889d87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:18.815710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88aab-e997-486e-9d7f-b99eb3889d87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:18.817853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88aab-e997-486e-9d7f-b99eb3889d87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:18.818566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88aab-e997-486e-9d7f-b99eb3889d87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:18.866115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:19.097627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78d88aab-e997-486e-9d7f-b99eb3889d87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:19.110824 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78d88aab-e997-486e-9d7f-b99eb3889d87 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.328321 Oct 05 17:48:19.121014 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2000/3757] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:18 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:19.139453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84bcd298-77fe-4cf9-bce7-eff80124006e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:19.143800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-84bcd298-77fe-4cf9-bce7-eff80124006e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:19.154924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bcd298-77fe-4cf9-bce7-eff80124006e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:19.157527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bcd298-77fe-4cf9-bce7-eff80124006e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:19.158208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bcd298-77fe-4cf9-bce7-eff80124006e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:19.171584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bcd298-77fe-4cf9-bce7-eff80124006e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:19.176566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bcd298-77fe-4cf9-bce7-eff80124006e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:19.177633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bcd298-77fe-4cf9-bce7-eff80124006e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:19.367554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1d4dc776-4b8d-4c79-b142-5042df03e714 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:19.384106 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1d4dc776-4b8d-4c79-b142-5042df03e714 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 1.789383 Oct 05 17:48:19.384999 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1758/3758] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:17 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:19.409578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4e4df444-e40d-474e-b219-004593c0b48c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:19.410528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4e4df444-e40d-474e-b219-004593c0b48c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:19.417462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e4df444-e40d-474e-b219-004593c0b48c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:19.418270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e4df444-e40d-474e-b219-004593c0b48c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:19.418892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e4df444-e40d-474e-b219-004593c0b48c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:19.420658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e4df444-e40d-474e-b219-004593c0b48c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:19.421307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e4df444-e40d-474e-b219-004593c0b48c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:19.421903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e4df444-e40d-474e-b219-004593c0b48c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:19.458578 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84bcd298-77fe-4cf9-bce7-eff80124006e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.330768 Oct 05 17:48:19.459171 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2001/3759] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:48:19 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a/os-interface => generated 285 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:20.057997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4e4df444-e40d-474e-b219-004593c0b48c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:20.065870 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4e4df444-e40d-474e-b219-004593c0b48c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1679 microversion: 2.1 time: 0.665472 Oct 05 17:48:20.078732 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1759/3760] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:19 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1679 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:20.148925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cbf10d9c-9eb7-41ac-8e83-35560367966e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:20.150826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cbf10d9c-9eb7-41ac-8e83-35560367966e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:20.166084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbf10d9c-9eb7-41ac-8e83-35560367966e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:20.168422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbf10d9c-9eb7-41ac-8e83-35560367966e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:20.169235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbf10d9c-9eb7-41ac-8e83-35560367966e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:20.174808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbf10d9c-9eb7-41ac-8e83-35560367966e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:20.177169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbf10d9c-9eb7-41ac-8e83-35560367966e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:20.179786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cbf10d9c-9eb7-41ac-8e83-35560367966e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:20.411689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3e674e96-9801-4ddd-aee0-b1d8c8f840b5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:20.412288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3e674e96-9801-4ddd-aee0-b1d8c8f840b5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:20.420719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e674e96-9801-4ddd-aee0-b1d8c8f840b5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:20.422858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e674e96-9801-4ddd-aee0-b1d8c8f840b5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:20.429165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e674e96-9801-4ddd-aee0-b1d8c8f840b5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:20.431764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e674e96-9801-4ddd-aee0-b1d8c8f840b5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:20.432572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e674e96-9801-4ddd-aee0-b1d8c8f840b5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:20.434100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e674e96-9801-4ddd-aee0-b1d8c8f840b5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:20.521564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cbf10d9c-9eb7-41ac-8e83-35560367966e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:20.532658 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cbf10d9c-9eb7-41ac-8e83-35560367966e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.387467 Oct 05 17:48:20.534388 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2002/3761] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:20 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:21.094083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c0f35fec-37bf-43c4-a5eb-bc67d438819e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:21.095122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c0f35fec-37bf-43c4-a5eb-bc67d438819e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:21.105729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0f35fec-37bf-43c4-a5eb-bc67d438819e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:21.113041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0f35fec-37bf-43c4-a5eb-bc67d438819e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:21.115054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0f35fec-37bf-43c4-a5eb-bc67d438819e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:21.116143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0f35fec-37bf-43c4-a5eb-bc67d438819e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:21.116614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0f35fec-37bf-43c4-a5eb-bc67d438819e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:21.117049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0f35fec-37bf-43c4-a5eb-bc67d438819e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:21.215411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3e674e96-9801-4ddd-aee0-b1d8c8f840b5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:21.234692 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3e674e96-9801-4ddd-aee0-b1d8c8f840b5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.826737 Oct 05 17:48:21.249945 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1760/3762] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:20 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:21.409088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c0f35fec-37bf-43c4-a5eb-bc67d438819e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:21.425342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c0f35fec-37bf-43c4-a5eb-bc67d438819e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1679 microversion: 2.1 time: 0.333781 Oct 05 17:48:21.427757 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2003/3763] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:21 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1679 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:21.558258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-06967cd7-9529-494c-9b84-eaa3b9782164 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:21.559004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-06967cd7-9529-494c-9b84-eaa3b9782164 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:21.579663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06967cd7-9529-494c-9b84-eaa3b9782164 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:21.580287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06967cd7-9529-494c-9b84-eaa3b9782164 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:21.581843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06967cd7-9529-494c-9b84-eaa3b9782164 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:21.584679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06967cd7-9529-494c-9b84-eaa3b9782164 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:21.589527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06967cd7-9529-494c-9b84-eaa3b9782164 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:21.589983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06967cd7-9529-494c-9b84-eaa3b9782164 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:22.037837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-06967cd7-9529-494c-9b84-eaa3b9782164 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:22.051691 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-06967cd7-9529-494c-9b84-eaa3b9782164 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.498180 Oct 05 17:48:22.068503 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1761/3764] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:21 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:22.267512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c3138ac-56a3-4d74-a188-8ed2a5313e79 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:22.268278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c3138ac-56a3-4d74-a188-8ed2a5313e79 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:22.283611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c3138ac-56a3-4d74-a188-8ed2a5313e79 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:22.286853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c3138ac-56a3-4d74-a188-8ed2a5313e79 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:22.287580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c3138ac-56a3-4d74-a188-8ed2a5313e79 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:22.291132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c3138ac-56a3-4d74-a188-8ed2a5313e79 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:22.293609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c3138ac-56a3-4d74-a188-8ed2a5313e79 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:22.295355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c3138ac-56a3-4d74-a188-8ed2a5313e79 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:22.459154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2dda1087-c67c-4c92-8a9e-d1cd3f8e7763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:22.460162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2dda1087-c67c-4c92-8a9e-d1cd3f8e7763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:22.462554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:22.476927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dda1087-c67c-4c92-8a9e-d1cd3f8e7763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:22.477535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dda1087-c67c-4c92-8a9e-d1cd3f8e7763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:22.478851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dda1087-c67c-4c92-8a9e-d1cd3f8e7763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:22.479686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dda1087-c67c-4c92-8a9e-d1cd3f8e7763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:22.481286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dda1087-c67c-4c92-8a9e-d1cd3f8e7763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:22.482470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dda1087-c67c-4c92-8a9e-d1cd3f8e7763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:22.750627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9c3138ac-56a3-4d74-a188-8ed2a5313e79 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:22.764803 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c3138ac-56a3-4d74-a188-8ed2a5313e79 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.502501 Oct 05 17:48:22.779954 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2004/3765] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:22 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:23.081785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6ed4d7ab-6ec4-4362-97ca-d53f7720a11a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:23.082588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6ed4d7ab-6ec4-4362-97ca-d53f7720a11a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:23.092429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ed4d7ab-6ec4-4362-97ca-d53f7720a11a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:23.092933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ed4d7ab-6ec4-4362-97ca-d53f7720a11a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:23.093374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ed4d7ab-6ec4-4362-97ca-d53f7720a11a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:23.097885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ed4d7ab-6ec4-4362-97ca-d53f7720a11a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:23.106050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ed4d7ab-6ec4-4362-97ca-d53f7720a11a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:23.118207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ed4d7ab-6ec4-4362-97ca-d53f7720a11a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:23.309685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2dda1087-c67c-4c92-8a9e-d1cd3f8e7763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:23.327900 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2dda1087-c67c-4c92-8a9e-d1cd3f8e7763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1679 microversion: 2.1 time: 0.872705 Oct 05 17:48:23.331499 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1762/3766] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:22 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1679 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:23.418325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6ed4d7ab-6ec4-4362-97ca-d53f7720a11a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:23.432980 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6ed4d7ab-6ec4-4362-97ca-d53f7720a11a tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.355377 Oct 05 17:48:23.447054 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2005/3767] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:23 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:23.796340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a4e1025-c1f9-4cb5-aaf7-c1a47585012a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:23.797697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a4e1025-c1f9-4cb5-aaf7-c1a47585012a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:23.828658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a4e1025-c1f9-4cb5-aaf7-c1a47585012a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:23.829176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a4e1025-c1f9-4cb5-aaf7-c1a47585012a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:23.829618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a4e1025-c1f9-4cb5-aaf7-c1a47585012a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:23.830429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a4e1025-c1f9-4cb5-aaf7-c1a47585012a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:23.830885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a4e1025-c1f9-4cb5-aaf7-c1a47585012a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:23.831306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a4e1025-c1f9-4cb5-aaf7-c1a47585012a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:23.932466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-32897e73-e19b-416a-84fd-3f4cac8aaebd tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:23.935202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-32897e73-e19b-416a-84fd-3f4cac8aaebd tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:23.953470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32897e73-e19b-416a-84fd-3f4cac8aaebd tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:23.954197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32897e73-e19b-416a-84fd-3f4cac8aaebd tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:23.954838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32897e73-e19b-416a-84fd-3f4cac8aaebd tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:23.955772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32897e73-e19b-416a-84fd-3f4cac8aaebd tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:23.958561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32897e73-e19b-416a-84fd-3f4cac8aaebd tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:23.959220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32897e73-e19b-416a-84fd-3f4cac8aaebd tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:24.311960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6a4e1025-c1f9-4cb5-aaf7-c1a47585012a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:24.340319 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a4e1025-c1f9-4cb5-aaf7-c1a47585012a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.548671 Oct 05 17:48:24.342008 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1763/3768] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:23 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:24.355201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-511665a5-1701-4d5e-b431-2dbb1fcf0473 req-c0ca99f2-fd3a-4e6f-a16d-51c3f70c2371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d56495f4-d64f-4905-9eb3-7708c6dd238a", "tag": "7735bafa-0319-445b-9b1a-e61ec36d4797"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:24.382304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-511665a5-1701-4d5e-b431-2dbb1fcf0473 req-c0ca99f2-fd3a-4e6f-a16d-51c3f70c2371 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:24.382786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-511665a5-1701-4d5e-b431-2dbb1fcf0473 req-c0ca99f2-fd3a-4e6f-a16d-51c3f70c2371 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:24.383213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-511665a5-1701-4d5e-b431-2dbb1fcf0473 req-c0ca99f2-fd3a-4e6f-a16d-51c3f70c2371 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:24.418388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:24.426104 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-511665a5-1701-4d5e-b431-2dbb1fcf0473 req-c0ca99f2-fd3a-4e6f-a16d-51c3f70c2371 service nova] Creating event network-changed:7735bafa-0319-445b-9b1a-e61ec36d4797 for instance d56495f4-d64f-4905-9eb3-7708c6dd238a on n-h1-835595-3 Oct 05 17:48:24.442101 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-511665a5-1701-4d5e-b431-2dbb1fcf0473 req-c0ca99f2-fd3a-4e6f-a16d-51c3f70c2371 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092421 Oct 05 17:48:24.442834 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1764/3769] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:24.467924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-254b4d3f-da0d-4928-ace6-dfd855d730e0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:24.473965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-254b4d3f-da0d-4928-ace6-dfd855d730e0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:24.508174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-254b4d3f-da0d-4928-ace6-dfd855d730e0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:24.510763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-254b4d3f-da0d-4928-ace6-dfd855d730e0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:24.511643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-254b4d3f-da0d-4928-ace6-dfd855d730e0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:24.515102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-254b4d3f-da0d-4928-ace6-dfd855d730e0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:24.517748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-254b4d3f-da0d-4928-ace6-dfd855d730e0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:24.520764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-254b4d3f-da0d-4928-ace6-dfd855d730e0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:24.577579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-32897e73-e19b-416a-84fd-3f4cac8aaebd tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:24.587212 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-32897e73-e19b-416a-84fd-3f4cac8aaebd tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1575 microversion: 2.1 time: 0.671874 Oct 05 17:48:24.591020 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2006/3770] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:23 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1575 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:24.610608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c58caaba-5f8c-4e06-906d-543443e84fbd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:24.611545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c58caaba-5f8c-4e06-906d-543443e84fbd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:24.626615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58caaba-5f8c-4e06-906d-543443e84fbd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:24.627594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58caaba-5f8c-4e06-906d-543443e84fbd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:24.628301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58caaba-5f8c-4e06-906d-543443e84fbd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:24.629301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58caaba-5f8c-4e06-906d-543443e84fbd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:24.630143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58caaba-5f8c-4e06-906d-543443e84fbd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:24.632107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58caaba-5f8c-4e06-906d-543443e84fbd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:25.028772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c58caaba-5f8c-4e06-906d-543443e84fbd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:25.041663 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c58caaba-5f8c-4e06-906d-543443e84fbd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.444153 Oct 05 17:48:25.057452 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2007/3771] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:24 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:25.315241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-254b4d3f-da0d-4928-ace6-dfd855d730e0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:25.328259 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-254b4d3f-da0d-4928-ace6-dfd855d730e0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1656 microversion: 2.1 time: 0.883589 Oct 05 17:48:25.344689 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1765/3772] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:24 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1656 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:25.360413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42c59066-42f8-48f7-bf01-ec558791fc2c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:25.369768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f489ae5-13b4-4834-8030-54dc319c25c3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:25.379102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0f489ae5-13b4-4834-8030-54dc319c25c3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:25.384070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42c59066-42f8-48f7-bf01-ec558791fc2c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:25.385738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42c59066-42f8-48f7-bf01-ec558791fc2c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:25.386994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42c59066-42f8-48f7-bf01-ec558791fc2c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:25.394884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f489ae5-13b4-4834-8030-54dc319c25c3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:25.399171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f489ae5-13b4-4834-8030-54dc319c25c3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:25.400763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f489ae5-13b4-4834-8030-54dc319c25c3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:25.404047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f489ae5-13b4-4834-8030-54dc319c25c3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:25.404778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f489ae5-13b4-4834-8030-54dc319c25c3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:25.406851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f489ae5-13b4-4834-8030-54dc319c25c3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:25.469800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-42c59066-42f8-48f7-bf01-ec558791fc2c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Going to try to start instance {{(pid=128844) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 17:48:25.571029 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-42c59066-42f8-48f7-bf01-ec558791fc2c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/action" status: 202 len: 0 microversion: 2.1 time: 0.216371 Oct 05 17:48:25.572088 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2008/3773] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:48:25 2022] POST /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:48:25.580621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7345a9f9-022a-4b9b-9b17-73f29e7244f4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:25.586788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7345a9f9-022a-4b9b-9b17-73f29e7244f4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:25.603214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7345a9f9-022a-4b9b-9b17-73f29e7244f4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:25.605977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7345a9f9-022a-4b9b-9b17-73f29e7244f4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:25.606798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7345a9f9-022a-4b9b-9b17-73f29e7244f4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:25.607816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7345a9f9-022a-4b9b-9b17-73f29e7244f4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:25.609372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7345a9f9-022a-4b9b-9b17-73f29e7244f4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:25.610070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7345a9f9-022a-4b9b-9b17-73f29e7244f4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:26.162099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7345a9f9-022a-4b9b-9b17-73f29e7244f4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:26.170676 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7345a9f9-022a-4b9b-9b17-73f29e7244f4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1665 microversion: 2.1 time: 0.593644 Oct 05 17:48:26.171270 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2009/3774] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:25 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1665 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:26.176434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a2ca9ef3-c3e1-40d5-9135-d40c0a085050 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:26.183357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a2ca9ef3-c3e1-40d5-9135-d40c0a085050 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:26.196992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ca9ef3-c3e1-40d5-9135-d40c0a085050 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:26.197713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ca9ef3-c3e1-40d5-9135-d40c0a085050 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:26.198602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ca9ef3-c3e1-40d5-9135-d40c0a085050 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:26.199795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ca9ef3-c3e1-40d5-9135-d40c0a085050 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:26.200559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ca9ef3-c3e1-40d5-9135-d40c0a085050 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:26.202789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2ca9ef3-c3e1-40d5-9135-d40c0a085050 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:26.630748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0f489ae5-13b4-4834-8030-54dc319c25c3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:26.643381 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f489ae5-13b4-4834-8030-54dc319c25c3 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 1.279408 Oct 05 17:48:26.660694 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1766/3775] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:25 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:27.198441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ae89863-6268-4233-a4b7-3e98897f454a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:27.198916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0ae89863-6268-4233-a4b7-3e98897f454a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:27.214123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ae89863-6268-4233-a4b7-3e98897f454a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:27.216968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ae89863-6268-4233-a4b7-3e98897f454a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:27.217687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ae89863-6268-4233-a4b7-3e98897f454a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:27.218629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ae89863-6268-4233-a4b7-3e98897f454a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:27.222153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ae89863-6268-4233-a4b7-3e98897f454a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:27.223153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ae89863-6268-4233-a4b7-3e98897f454a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:27.416664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a2ca9ef3-c3e1-40d5-9135-d40c0a085050 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:27.431661 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a2ca9ef3-c3e1-40d5-9135-d40c0a085050 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 1.258302 Oct 05 17:48:27.433381 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2010/3776] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:26 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:27.669388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae401591-0325-42c2-a2f9-6df22358c765 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:27.670159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae401591-0325-42c2-a2f9-6df22358c765 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:27.687940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae401591-0325-42c2-a2f9-6df22358c765 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:27.688731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae401591-0325-42c2-a2f9-6df22358c765 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:27.690211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae401591-0325-42c2-a2f9-6df22358c765 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:27.692885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae401591-0325-42c2-a2f9-6df22358c765 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:27.694739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae401591-0325-42c2-a2f9-6df22358c765 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:27.698685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae401591-0325-42c2-a2f9-6df22358c765 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:27.915874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0ae89863-6268-4233-a4b7-3e98897f454a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:27.931287 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0ae89863-6268-4233-a4b7-3e98897f454a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1665 microversion: 2.1 time: 0.732468 Oct 05 17:48:27.932887 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1767/3777] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:27 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1665 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:28.445133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ae401591-0325-42c2-a2f9-6df22358c765 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:28.460220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-37ba9535-69ff-4f72-b39a-4db355658353 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:28.460834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-37ba9535-69ff-4f72-b39a-4db355658353 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:28.467957 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae401591-0325-42c2-a2f9-6df22358c765 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1502 microversion: 2.1 time: 0.800717 Oct 05 17:48:28.469299 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2011/3778] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:27 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1502 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:28.475418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37ba9535-69ff-4f72-b39a-4db355658353 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:28.480438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37ba9535-69ff-4f72-b39a-4db355658353 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:28.481037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37ba9535-69ff-4f72-b39a-4db355658353 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:28.484991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37ba9535-69ff-4f72-b39a-4db355658353 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:28.485625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37ba9535-69ff-4f72-b39a-4db355658353 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:28.487391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37ba9535-69ff-4f72-b39a-4db355658353 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:28.502329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acc0b90c-4313-4313-a926-5e3bacfd4411"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:28.505697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:28.523305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:28.524313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:28.525776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:28.527127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:28.530615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:28.531567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:28.576455 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] HTTP exception thrown: Cannot 'attach_volume' instance d037b8c8-e287-459a-a4b4-ac53b463337d while it is in vm_state rescued Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Request method failure captured: Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/os-volume_attachments HTTP/1.1 Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 74 Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcMOAOpdE63X8OhW4wsEy2crLrx01LtQ-rp_0wT7KyP_snq49RBe9pW2rDXvGDquoPS8xWknsOpVRp2diM1zITKhR01lPNUgSkUsWER9laVmknlwDrrF_SZj9lTxUjYcrefuqCr0JxKMwpc1ouYu8vVwbNWydS37cc_WZDK5JdlZgNU Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/caf452f31a594c888e1703356c637a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_caf452f31a594c888e1703356c637a91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}] Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 50b3fb554dd64e41bea1109e697b0799 Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: {"volumeAttachment": {"volumeId": "acc0b90c-4313-4313-a926-5e3bacfd4411"}} Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot 'attach_volume' instance d037b8c8-e287-459a-a4b4-ac53b463337d while it is in vm_state rescued Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': 'd037b8c8-e287-459a-a4b4-ac53b463337d', 'body': {'volumeAttachment': {'volumeId': 'acc0b90c-4313-4313-a926-5e3bacfd4411'}}} Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d037b8c8-e287-459a-a4b4-ac53b463337d in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 05 17:48:28.583422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d037b8c8-e287-459a-a4b4-ac53b463337d while it is in vm_state rescued Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d037b8c8-e287-459a-a4b4-ac53b463337d while it is in vm_state rescued Oct 05 17:48:28.591698 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:28.596493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Returning 409 to user: Cannot 'attach_volume' instance d037b8c8-e287-459a-a4b4-ac53b463337d while it is in vm_state rescued {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:48:28.599769 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-24584f5c-2fe9-4c58-b7d6-4ed672d73277 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.104499 Oct 05 17:48:28.600970 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2012/3779] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 17:48:28 2022] POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/os-volume_attachments => generated 152 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 05 17:48:28.625175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35716f4d-0e8c-4da4-bbd8-ec5ebfd243e2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:28.626138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-35716f4d-0e8c-4da4-bbd8-ec5ebfd243e2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:28.642241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35716f4d-0e8c-4da4-bbd8-ec5ebfd243e2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:28.643914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35716f4d-0e8c-4da4-bbd8-ec5ebfd243e2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:28.646259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35716f4d-0e8c-4da4-bbd8-ec5ebfd243e2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:28.647418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35716f4d-0e8c-4da4-bbd8-ec5ebfd243e2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:28.648410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35716f4d-0e8c-4da4-bbd8-ec5ebfd243e2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:28.649437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35716f4d-0e8c-4da4-bbd8-ec5ebfd243e2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:28.755549 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35716f4d-0e8c-4da4-bbd8-ec5ebfd243e2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action" status: 202 len: 0 microversion: 2.1 time: 0.148398 Oct 05 17:48:28.756911 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2013/3780] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:48:28 2022] POST /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:48:28.787438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-622f4c3b-931f-48a5-ad46-8e66baa91c09 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:28.788857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-622f4c3b-931f-48a5-ad46-8e66baa91c09 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:28.799090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f4c3b-931f-48a5-ad46-8e66baa91c09 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:28.800218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f4c3b-931f-48a5-ad46-8e66baa91c09 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:28.801243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f4c3b-931f-48a5-ad46-8e66baa91c09 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:28.803632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f4c3b-931f-48a5-ad46-8e66baa91c09 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:28.805009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f4c3b-931f-48a5-ad46-8e66baa91c09 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:28.805864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-622f4c3b-931f-48a5-ad46-8e66baa91c09 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:29.080268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-37ba9535-69ff-4f72-b39a-4db355658353 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:29.088764 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-37ba9535-69ff-4f72-b39a-4db355658353 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.632474 Oct 05 17:48:29.089548 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1768/3781] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:28 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:29.533374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1866163670", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "97ef3129-5363-4551-8ba4-63c3be6320b3"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:29.672545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] validate_networks() for [('97ef3129-5363-4551-8ba4-63c3be6320b3', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:48:29.717718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-622f4c3b-931f-48a5-ad46-8e66baa91c09 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:29.745820 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-622f4c3b-931f-48a5-ad46-8e66baa91c09 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1510 microversion: 2.1 time: 0.972481 Oct 05 17:48:29.748400 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2014/3782] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:28 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1510 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:29.760913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90040168-5a3b-42b8-a8ad-37f959095148 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:29.765756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90040168-5a3b-42b8-a8ad-37f959095148 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:29.781518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90040168-5a3b-42b8-a8ad-37f959095148 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:29.782013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90040168-5a3b-42b8-a8ad-37f959095148 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:29.783735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90040168-5a3b-42b8-a8ad-37f959095148 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:29.784481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90040168-5a3b-42b8-a8ad-37f959095148 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:29.789093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90040168-5a3b-42b8-a8ad-37f959095148 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:29.789093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90040168-5a3b-42b8-a8ad-37f959095148 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:30.374540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:48:30.375036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:48:30.375179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90040168-5a3b-42b8-a8ad-37f959095148 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:30.375428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:48:30.375852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:48:30.376263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:48:30.379803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:30.391423 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90040168-5a3b-42b8-a8ad-37f959095148 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1669 microversion: 2.1 time: 0.641335 Oct 05 17:48:30.397610 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2015/3783] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:29 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1669 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:30.413055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:30.413558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:30.413992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:30.415201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9aab1f1b-53e8-4208-a064-9a4cc7277fe3 req-8bc7ce19-3551-4624-9f69-b1ef63205344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637528bb-a7bd-49c4-baf5-f63095788532", "name": "network-vif-unplugged", "status": "completed", "tag": "b0f1bad7-bd89-4f62-bd96-6e8439a2671b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:30.426399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:30.426902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:30.427341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:30.450795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9aab1f1b-53e8-4208-a064-9a4cc7277fe3 req-8bc7ce19-3551-4624-9f69-b1ef63205344 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:30.451467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9aab1f1b-53e8-4208-a064-9a4cc7277fe3 req-8bc7ce19-3551-4624-9f69-b1ef63205344 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:30.455233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9aab1f1b-53e8-4208-a064-9a4cc7277fe3 req-8bc7ce19-3551-4624-9f69-b1ef63205344 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:30.483112 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9aab1f1b-53e8-4208-a064-9a4cc7277fe3 req-8bc7ce19-3551-4624-9f69-b1ef63205344 service nova] Creating event network-vif-unplugged:b0f1bad7-bd89-4f62-bd96-6e8439a2671b for instance 637528bb-a7bd-49c4-baf5-f63095788532 on n-h2-835595-3 Oct 05 17:48:30.486044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Getting quotas for project c1178176876f4a2fabc6a4ff171b0220. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:48:30.504244 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9aab1f1b-53e8-4208-a064-9a4cc7277fe3 req-8bc7ce19-3551-4624-9f69-b1ef63205344 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102886 Oct 05 17:48:30.505036 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2016/3784] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:30.505537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Getting quotas for user 4be4313bf1134d6d9ab526b65eff8d9e and project c1178176876f4a2fabc6a4ff171b0220. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:48:30.519287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ad23b32b-60eb-42c1-8813-967a77348b4b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:30.523435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ad23b32b-60eb-42c1-8813-967a77348b4b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:30.532147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Going to run 3 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:48:30.538246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad23b32b-60eb-42c1-8813-967a77348b4b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:30.538461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 206610c4-627b-4680-9abc-951d50a8d378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:48:30.543560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad23b32b-60eb-42c1-8813-967a77348b4b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:30.544431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad23b32b-60eb-42c1-8813-967a77348b4b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:30.545502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad23b32b-60eb-42c1-8813-967a77348b4b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:30.546191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad23b32b-60eb-42c1-8813-967a77348b4b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:30.546871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad23b32b-60eb-42c1-8813-967a77348b4b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:30.599753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 261b171b-1e5e-4ad4-88be-c38767238817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=206610c4-627b-4680-9abc-951d50a8d378,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:48:30.640906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=261b171b-1e5e-4ad4-88be-c38767238817,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:48:30.747827 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b3fbed1f-9eb1-445b-9784-4de228020959 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.638623 Oct 05 17:48:30.748639 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1769/3785] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:48:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:48:30.761098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2d258bf6-d576-4f16-a44a-950c714978cd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:30.769198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2d258bf6-d576-4f16-a44a-950c714978cd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:30.770440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2d258bf6-d576-4f16-a44a-950c714978cd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Searching by: {'deleted': False, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:48:30.816756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d258bf6-d576-4f16-a44a-950c714978cd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:30.817519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d258bf6-d576-4f16-a44a-950c714978cd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:30.822405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d258bf6-d576-4f16-a44a-950c714978cd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:30.841136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d258bf6-d576-4f16-a44a-950c714978cd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:30.841821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d258bf6-d576-4f16-a44a-950c714978cd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:30.842329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d258bf6-d576-4f16-a44a-950c714978cd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:30.897063 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2d258bf6-d576-4f16-a44a-950c714978cd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.140743 Oct 05 17:48:30.911255 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1770/3786] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:48:30 2022] GET /compute/v2.1/servers => generated 1018 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:30.934701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cb7da77e-d342-4968-99f0-d653bb2d9caf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:30.944064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cb7da77e-d342-4968-99f0-d653bb2d9caf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:30.966198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb7da77e-d342-4968-99f0-d653bb2d9caf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:30.969701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb7da77e-d342-4968-99f0-d653bb2d9caf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:30.971547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb7da77e-d342-4968-99f0-d653bb2d9caf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:30.972284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb7da77e-d342-4968-99f0-d653bb2d9caf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:30.972831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb7da77e-d342-4968-99f0-d653bb2d9caf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:30.973264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb7da77e-d342-4968-99f0-d653bb2d9caf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:31.359320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ad23b32b-60eb-42c1-8813-967a77348b4b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:31.373103 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ad23b32b-60eb-42c1-8813-967a77348b4b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.865966 Oct 05 17:48:31.378472 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2017/3787] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:30 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:31.409131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cb7da77e-d342-4968-99f0-d653bb2d9caf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:31.416921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4dee071d-e8ef-4bce-8b4c-de173f3f7411 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:31.418780 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cb7da77e-d342-4968-99f0-d653bb2d9caf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1510 microversion: 2.1 time: 0.504345 Oct 05 17:48:31.419933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4dee071d-e8ef-4bce-8b4c-de173f3f7411 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:31.422632 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1771/3788] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:30 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1510 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:32.340655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4dee071d-e8ef-4bce-8b4c-de173f3f7411 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:32.363113 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4dee071d-e8ef-4bce-8b4c-de173f3f7411 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1223 microversion: 2.1 time: 0.959970 Oct 05 17:48:32.364549 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2018/3789] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:31 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1223 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:32.400938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d9713614-7776-4a10-ad9f-d9b3dba17cd3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:32.402320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d9713614-7776-4a10-ad9f-d9b3dba17cd3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:32.412965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9713614-7776-4a10-ad9f-d9b3dba17cd3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:32.413595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9713614-7776-4a10-ad9f-d9b3dba17cd3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:32.419746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9713614-7776-4a10-ad9f-d9b3dba17cd3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:32.421933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9713614-7776-4a10-ad9f-d9b3dba17cd3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:32.422624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9713614-7776-4a10-ad9f-d9b3dba17cd3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:32.424114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9713614-7776-4a10-ad9f-d9b3dba17cd3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:32.444050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-72a66697-b360-4ffa-a8da-4bb026353662 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:32.445747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-72a66697-b360-4ffa-a8da-4bb026353662 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:32.473050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72a66697-b360-4ffa-a8da-4bb026353662 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:32.474754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72a66697-b360-4ffa-a8da-4bb026353662 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:32.476405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72a66697-b360-4ffa-a8da-4bb026353662 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:32.479244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72a66697-b360-4ffa-a8da-4bb026353662 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:32.480823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72a66697-b360-4ffa-a8da-4bb026353662 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:32.481926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72a66697-b360-4ffa-a8da-4bb026353662 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:32.721012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d9713614-7776-4a10-ad9f-d9b3dba17cd3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:32.730798 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d9713614-7776-4a10-ad9f-d9b3dba17cd3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.333714 Oct 05 17:48:32.736589 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1772/3790] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:32 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:32.748113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-9672ac2b-49a5-41d1-abdd-81335b4581da req-ab89b5d1-c290-4bf6-b743-8ee99a2a6996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "637528bb-a7bd-49c4-baf5-f63095788532", "tag": "b0f1bad7-bd89-4f62-bd96-6e8439a2671b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:32.773605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9672ac2b-49a5-41d1-abdd-81335b4581da req-ab89b5d1-c290-4bf6-b743-8ee99a2a6996 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:32.773605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9672ac2b-49a5-41d1-abdd-81335b4581da req-ab89b5d1-c290-4bf6-b743-8ee99a2a6996 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:32.773605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9672ac2b-49a5-41d1-abdd-81335b4581da req-ab89b5d1-c290-4bf6-b743-8ee99a2a6996 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:32.809326 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9672ac2b-49a5-41d1-abdd-81335b4581da req-ab89b5d1-c290-4bf6-b743-8ee99a2a6996 service nova] Creating event network-changed:b0f1bad7-bd89-4f62-bd96-6e8439a2671b for instance 637528bb-a7bd-49c4-baf5-f63095788532 on n-h2-835595-3 Oct 05 17:48:32.842603 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-9672ac2b-49a5-41d1-abdd-81335b4581da req-ab89b5d1-c290-4bf6-b743-8ee99a2a6996 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104120 Oct 05 17:48:32.846687 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1773/3791] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:33.279583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-72a66697-b360-4ffa-a8da-4bb026353662 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:33.299760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-72a66697-b360-4ffa-a8da-4bb026353662 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1510 microversion: 2.1 time: 0.859903 Oct 05 17:48:33.319708 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2019/3792] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:32 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1510 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:33.391681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9af7283f-a939-4b07-ae4c-5b78e87f1259 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:33.392755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9af7283f-a939-4b07-ae4c-5b78e87f1259 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:33.403351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9af7283f-a939-4b07-ae4c-5b78e87f1259 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:33.405903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9af7283f-a939-4b07-ae4c-5b78e87f1259 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:33.406723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9af7283f-a939-4b07-ae4c-5b78e87f1259 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:33.409596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9af7283f-a939-4b07-ae4c-5b78e87f1259 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:33.410474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9af7283f-a939-4b07-ae4c-5b78e87f1259 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:33.412997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9af7283f-a939-4b07-ae4c-5b78e87f1259 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:33.547859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9af7283f-a939-4b07-ae4c-5b78e87f1259 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:33.564121 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9af7283f-a939-4b07-ae4c-5b78e87f1259 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1227 microversion: 2.1 time: 0.180223 Oct 05 17:48:33.565676 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1774/3793] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:33 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1227 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:33.767304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21a48e2b-045e-4327-91ec-0f5b0307f020 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:33.770905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21a48e2b-045e-4327-91ec-0f5b0307f020 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:33.783810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21a48e2b-045e-4327-91ec-0f5b0307f020 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:33.785029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21a48e2b-045e-4327-91ec-0f5b0307f020 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:33.785775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21a48e2b-045e-4327-91ec-0f5b0307f020 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:33.787457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21a48e2b-045e-4327-91ec-0f5b0307f020 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:33.788201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21a48e2b-045e-4327-91ec-0f5b0307f020 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:33.788833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21a48e2b-045e-4327-91ec-0f5b0307f020 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:34.302176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21a48e2b-045e-4327-91ec-0f5b0307f020 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:34.325368 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21a48e2b-045e-4327-91ec-0f5b0307f020 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.568179 Oct 05 17:48:34.327376 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2020/3794] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:33 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:34.338347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb30d0a8-6b88-4b89-9ea0-9c148dc8209a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:34.339231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eb30d0a8-6b88-4b89-9ea0-9c148dc8209a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:34.348093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb30d0a8-6b88-4b89-9ea0-9c148dc8209a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:34.348591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb30d0a8-6b88-4b89-9ea0-9c148dc8209a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:34.349025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb30d0a8-6b88-4b89-9ea0-9c148dc8209a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:34.349752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb30d0a8-6b88-4b89-9ea0-9c148dc8209a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:34.350188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb30d0a8-6b88-4b89-9ea0-9c148dc8209a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:34.350643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb30d0a8-6b88-4b89-9ea0-9c148dc8209a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:34.593745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42a708ca-601e-431c-a111-331022dddbd2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:34.593745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-42a708ca-601e-431c-a111-331022dddbd2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:34.630191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42a708ca-601e-431c-a111-331022dddbd2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:34.630773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42a708ca-601e-431c-a111-331022dddbd2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:34.680368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42a708ca-601e-431c-a111-331022dddbd2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:34.680368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42a708ca-601e-431c-a111-331022dddbd2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:34.680368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42a708ca-601e-431c-a111-331022dddbd2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:34.680368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42a708ca-601e-431c-a111-331022dddbd2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:34.709242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb30d0a8-6b88-4b89-9ea0-9c148dc8209a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:34.720690 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb30d0a8-6b88-4b89-9ea0-9c148dc8209a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1516 microversion: 2.1 time: 0.389261 Oct 05 17:48:34.721392 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1775/3795] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:34 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1516 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:35.247591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-42a708ca-601e-431c-a111-331022dddbd2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:35.265501 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-42a708ca-601e-431c-a111-331022dddbd2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1219 microversion: 2.1 time: 0.674890 Oct 05 17:48:35.268068 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2021/3796] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:34 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1219 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:35.350808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-922cc968-cfc9-4c09-9399-51edc8935e12 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:35.351650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-922cc968-cfc9-4c09-9399-51edc8935e12 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:35.374832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-922cc968-cfc9-4c09-9399-51edc8935e12 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:35.375505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-922cc968-cfc9-4c09-9399-51edc8935e12 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:35.376141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-922cc968-cfc9-4c09-9399-51edc8935e12 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:35.378749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-922cc968-cfc9-4c09-9399-51edc8935e12 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:35.379678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-922cc968-cfc9-4c09-9399-51edc8935e12 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:35.380323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-922cc968-cfc9-4c09-9399-51edc8935e12 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:36.250661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-922cc968-cfc9-4c09-9399-51edc8935e12 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:36.260633 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-922cc968-cfc9-4c09-9399-51edc8935e12 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.914562 Oct 05 17:48:36.271649 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1776/3797] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:35 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:36.293284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-29e824f3-c772-4d87-a6b7-42505a154098 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:36.293905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-29e824f3-c772-4d87-a6b7-42505a154098 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:36.305934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e824f3-c772-4d87-a6b7-42505a154098 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:36.310020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e824f3-c772-4d87-a6b7-42505a154098 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:36.311553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e824f3-c772-4d87-a6b7-42505a154098 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:36.312669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e824f3-c772-4d87-a6b7-42505a154098 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:36.317773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e824f3-c772-4d87-a6b7-42505a154098 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:36.318237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e824f3-c772-4d87-a6b7-42505a154098 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:36.767213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-29e824f3-c772-4d87-a6b7-42505a154098 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:36.785541 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-29e824f3-c772-4d87-a6b7-42505a154098 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1293 microversion: 2.1 time: 0.492089 Oct 05 17:48:36.796105 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2022/3798] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:36 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1293 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:37.298052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cafb8f57-79c7-42dc-8ee7-7b308b9327f5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:37.300128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cafb8f57-79c7-42dc-8ee7-7b308b9327f5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:37.317489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafb8f57-79c7-42dc-8ee7-7b308b9327f5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:37.318223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafb8f57-79c7-42dc-8ee7-7b308b9327f5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:37.318820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafb8f57-79c7-42dc-8ee7-7b308b9327f5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:37.319670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafb8f57-79c7-42dc-8ee7-7b308b9327f5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:37.320258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafb8f57-79c7-42dc-8ee7-7b308b9327f5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:37.320800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cafb8f57-79c7-42dc-8ee7-7b308b9327f5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:37.598607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7a411e01-f49a-46f6-a6d9-178a6afac54a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'create', calling method: .version_select at 0x7f77743fdca0>, body: {"keypair": {"name": "tempest-keypair-1533695263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQUDSgnGUzv6F2ipzVBHJfNMhle+NQqA2Nq9rCT2il6jLlom501TCoQfeu3XP0MN6xQj9e6WwquyUaA3mtcJfiRds5et+CPNHpVHLpMdBc5dz7IIXgP69jtw5G0Adwf5A=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:37.645158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-7a411e01-f49a-46f6-a6d9-178a6afac54a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Getting quotas for project caf452f31a594c888e1703356c637a91. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:48:37.652512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-7a411e01-f49a-46f6-a6d9-178a6afac54a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Getting quotas for user 50b3fb554dd64e41bea1109e697b0799 and project caf452f31a594c888e1703356c637a91. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:48:37.707969 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7a411e01-f49a-46f6-a6d9-178a6afac54a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.111918 Oct 05 17:48:37.711674 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2023/3799] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:48:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:48:37.817892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b1483c1-80bb-47a6-a24f-15dec5f82c9f tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:37.818952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5b1483c1-80bb-47a6-a24f-15dec5f82c9f tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:37.834759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b1483c1-80bb-47a6-a24f-15dec5f82c9f tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:37.835681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b1483c1-80bb-47a6-a24f-15dec5f82c9f tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:37.836802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b1483c1-80bb-47a6-a24f-15dec5f82c9f tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:37.838388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b1483c1-80bb-47a6-a24f-15dec5f82c9f tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:37.842400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b1483c1-80bb-47a6-a24f-15dec5f82c9f tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:37.843515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b1483c1-80bb-47a6-a24f-15dec5f82c9f tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:38.027428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cafb8f57-79c7-42dc-8ee7-7b308b9327f5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:38.044761 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cafb8f57-79c7-42dc-8ee7-7b308b9327f5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.752485 Oct 05 17:48:38.047685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5b1483c1-80bb-47a6-a24f-15dec5f82c9f tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:38.049865 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1777/3800] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:37 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:38.075564 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b1483c1-80bb-47a6-a24f-15dec5f82c9f tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1281 microversion: 2.1 time: 0.263868 Oct 05 17:48:38.076183 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2024/3801] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:37 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1281 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:39.073255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3cbc097f-7dfa-4fd6-9ba0-80ef824c58aa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:39.074710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3cbc097f-7dfa-4fd6-9ba0-80ef824c58aa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:39.091980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cbc097f-7dfa-4fd6-9ba0-80ef824c58aa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:39.094450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cbc097f-7dfa-4fd6-9ba0-80ef824c58aa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:39.095179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cbc097f-7dfa-4fd6-9ba0-80ef824c58aa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:39.096116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cbc097f-7dfa-4fd6-9ba0-80ef824c58aa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:39.097005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cbc097f-7dfa-4fd6-9ba0-80ef824c58aa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:39.097754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cbc097f-7dfa-4fd6-9ba0-80ef824c58aa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:39.098943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-20cf2a27-d6a8-4bd2-b683-27a4a5513f26 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:39.099580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-20cf2a27-d6a8-4bd2-b683-27a4a5513f26 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:39.116418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cf2a27-d6a8-4bd2-b683-27a4a5513f26 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:39.116942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cf2a27-d6a8-4bd2-b683-27a4a5513f26 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:39.117385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cf2a27-d6a8-4bd2-b683-27a4a5513f26 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:39.118141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cf2a27-d6a8-4bd2-b683-27a4a5513f26 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:39.118673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cf2a27-d6a8-4bd2-b683-27a4a5513f26 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:39.133861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cf2a27-d6a8-4bd2-b683-27a4a5513f26 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:39.916423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3cbc097f-7dfa-4fd6-9ba0-80ef824c58aa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:39.927730 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3cbc097f-7dfa-4fd6-9ba0-80ef824c58aa tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.858369 Oct 05 17:48:39.942591 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1778/3802] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:39 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:40.114164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-20cf2a27-d6a8-4bd2-b683-27a4a5513f26 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:40.125955 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-20cf2a27-d6a8-4bd2-b683-27a4a5513f26 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1323 microversion: 2.1 time: 1.030823 Oct 05 17:48:40.130403 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2025/3803] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:39 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1323 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:40.755363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5ab6dbcc-66de-438c-ad55-3c7051f4a690 req-2c24e162-8257-42fd-b83e-1b4981cd9ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "206610c4-627b-4680-9abc-951d50a8d378", "tag": "63b73b65-70e7-415d-94c8-d862e9d74d7d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:40.775852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:40.779934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5ab6dbcc-66de-438c-ad55-3c7051f4a690 req-2c24e162-8257-42fd-b83e-1b4981cd9ce2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:40.781400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5ab6dbcc-66de-438c-ad55-3c7051f4a690 req-2c24e162-8257-42fd-b83e-1b4981cd9ce2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:40.782064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5ab6dbcc-66de-438c-ad55-3c7051f4a690 req-2c24e162-8257-42fd-b83e-1b4981cd9ce2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:40.813405 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5ab6dbcc-66de-438c-ad55-3c7051f4a690 req-2c24e162-8257-42fd-b83e-1b4981cd9ce2 service nova] Creating event network-changed:63b73b65-70e7-415d-94c8-d862e9d74d7d for instance 206610c4-627b-4680-9abc-951d50a8d378 on n-h2-835595-3 Oct 05 17:48:40.821547 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5ab6dbcc-66de-438c-ad55-3c7051f4a690 req-2c24e162-8257-42fd-b83e-1b4981cd9ce2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075130 Oct 05 17:48:40.822973 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1779/3804] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:40.951312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:40.957380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8c2f123e-48ef-4345-9772-474195df29c0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:40.958246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8c2f123e-48ef-4345-9772-474195df29c0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:40.976722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c2f123e-48ef-4345-9772-474195df29c0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:40.981479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c2f123e-48ef-4345-9772-474195df29c0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:40.982363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c2f123e-48ef-4345-9772-474195df29c0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:40.984053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c2f123e-48ef-4345-9772-474195df29c0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:40.986681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c2f123e-48ef-4345-9772-474195df29c0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:40.989097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c2f123e-48ef-4345-9772-474195df29c0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:41.156930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1258261112", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "b1e3c98d-9df5-4f37-94ff-8d004d1e96f3"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:41.282224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] validate_networks() for [('b1e3c98d-9df5-4f37-94ff-8d004d1e96f3', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:48:41.666978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c2f123e-48ef-4345-9772-474195df29c0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:41.679470 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8c2f123e-48ef-4345-9772-474195df29c0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.729091 Oct 05 17:48:41.680718 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1780/3805] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:40 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:41.695775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f87ff51a-1285-4e4d-ac4d-d801013f6365 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:41.696511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f87ff51a-1285-4e4d-ac4d-d801013f6365 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:41.704280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f87ff51a-1285-4e4d-ac4d-d801013f6365 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:41.709596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f87ff51a-1285-4e4d-ac4d-d801013f6365 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:41.710227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f87ff51a-1285-4e4d-ac4d-d801013f6365 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:41.711299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f87ff51a-1285-4e4d-ac4d-d801013f6365 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:41.711977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f87ff51a-1285-4e4d-ac4d-d801013f6365 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:41.712583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f87ff51a-1285-4e4d-ac4d-d801013f6365 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:42.133999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f87ff51a-1285-4e4d-ac4d-d801013f6365 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:42.145232 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f87ff51a-1285-4e4d-ac4d-d801013f6365 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1323 microversion: 2.1 time: 0.462812 Oct 05 17:48:42.145923 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1781/3806] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:41 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1323 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:42.703915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b0fa6fc2-6140-4f21-926a-53b9cb35cec7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:42.704696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b0fa6fc2-6140-4f21-926a-53b9cb35cec7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:42.718055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0fa6fc2-6140-4f21-926a-53b9cb35cec7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:42.719219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0fa6fc2-6140-4f21-926a-53b9cb35cec7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:42.720244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0fa6fc2-6140-4f21-926a-53b9cb35cec7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:42.722048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0fa6fc2-6140-4f21-926a-53b9cb35cec7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:42.723481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0fa6fc2-6140-4f21-926a-53b9cb35cec7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:42.727096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b0fa6fc2-6140-4f21-926a-53b9cb35cec7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:43.413624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:48:43.414156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:48:43.414732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:48:43.415306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:48:43.415776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:48:43.430582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:43.431458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:43.435280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:43.436761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:43.437927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:43.438595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:43.477441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Getting quotas for project b2a9e41eecbe4d7991f6a749bba996c1. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:48:43.488784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Getting quotas for user 9991b7e124c54af798228a3a0b78f9a6 and project b2a9e41eecbe4d7991f6a749bba996c1. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:48:43.518783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:48:43.520097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:48:43.594111 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ea325c0d-8897-4535-8438-703370fbc2a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.732352 Oct 05 17:48:43.595013 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2026/3807] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:48:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:48:43.599992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9482756b-d8e0-42b9-aa1a-f3c51e7ecfe5 req-910c950c-9fe7-4583-8edb-807ef364db0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "955b28b3-dd61-4846-94d2-b394f6c55aa4", "tag": "0f5cb3f5-caae-4aeb-8be1-adef920cf7b8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:43.632335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9482756b-d8e0-42b9-aa1a-f3c51e7ecfe5 req-910c950c-9fe7-4583-8edb-807ef364db0d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:43.634858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9482756b-d8e0-42b9-aa1a-f3c51e7ecfe5 req-910c950c-9fe7-4583-8edb-807ef364db0d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:43.640559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9482756b-d8e0-42b9-aa1a-f3c51e7ecfe5 req-910c950c-9fe7-4583-8edb-807ef364db0d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:43.657648 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9482756b-d8e0-42b9-aa1a-f3c51e7ecfe5 req-910c950c-9fe7-4583-8edb-807ef364db0d service nova] Creating event network-changed:0f5cb3f5-caae-4aeb-8be1-adef920cf7b8 for instance 955b28b3-dd61-4846-94d2-b394f6c55aa4 on n-h2-835595-3 Oct 05 17:48:43.683592 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9482756b-d8e0-42b9-aa1a-f3c51e7ecfe5 req-910c950c-9fe7-4583-8edb-807ef364db0d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086924 Oct 05 17:48:43.687567 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2027/3808] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:43.703167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-888d5a40-b2e4-4920-95cf-34ed6ea8cba2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:43.706463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-888d5a40-b2e4-4920-95cf-34ed6ea8cba2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:43.725535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-888d5a40-b2e4-4920-95cf-34ed6ea8cba2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:43.726253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-888d5a40-b2e4-4920-95cf-34ed6ea8cba2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:43.726920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-888d5a40-b2e4-4920-95cf-34ed6ea8cba2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:43.727830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-888d5a40-b2e4-4920-95cf-34ed6ea8cba2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:43.728487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-888d5a40-b2e4-4920-95cf-34ed6ea8cba2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:43.729130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-888d5a40-b2e4-4920-95cf-34ed6ea8cba2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:43.887368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b0fa6fc2-6140-4f21-926a-53b9cb35cec7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:43.900309 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b0fa6fc2-6140-4f21-926a-53b9cb35cec7 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 1.200839 Oct 05 17:48:43.903882 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1782/3809] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:42 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:43.912836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8c3d26e-e5bb-467c-8315-9fed402110a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:43.916012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8c3d26e-e5bb-467c-8315-9fed402110a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:44.184580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c8c3d26e-e5bb-467c-8315-9fed402110a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:44.196361 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8c3d26e-e5bb-467c-8315-9fed402110a2 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1217 microversion: 2.1 time: 0.291245 Oct 05 17:48:44.199231 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1783/3810] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:43 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1217 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:44.210364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-888d5a40-b2e4-4920-95cf-34ed6ea8cba2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:44.232437 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-888d5a40-b2e4-4920-95cf-34ed6ea8cba2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1323 microversion: 2.1 time: 0.542979 Oct 05 17:48:44.244371 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2028/3811] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:43 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1323 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:44.301273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1482932470", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a318cf17-4970-4411-8821-7ec2ee9e9e79"}], "security_groups": [{"name": "tempest-securitygroup--1270604977"}], "key_name": "tempest-keypair-1533695263", "user_data": "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:44.530784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-39d8b2c4-5f38-45ae-b51b-d6ec2945c8c3 req-f38c1657-a1fd-4b4c-90c1-3e75083148f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261b171b-1e5e-4ad4-88be-c38767238817", "tag": "b39d185b-e007-478a-9bb8-4d9a691acd24"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:44.556890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-39d8b2c4-5f38-45ae-b51b-d6ec2945c8c3 req-f38c1657-a1fd-4b4c-90c1-3e75083148f1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:44.559708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-39d8b2c4-5f38-45ae-b51b-d6ec2945c8c3 req-f38c1657-a1fd-4b4c-90c1-3e75083148f1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:44.561192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-39d8b2c4-5f38-45ae-b51b-d6ec2945c8c3 req-f38c1657-a1fd-4b4c-90c1-3e75083148f1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:44.587213 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-39d8b2c4-5f38-45ae-b51b-d6ec2945c8c3 req-f38c1657-a1fd-4b4c-90c1-3e75083148f1 service nova] Creating event network-changed:b39d185b-e007-478a-9bb8-4d9a691acd24 for instance 261b171b-1e5e-4ad4-88be-c38767238817 on n-h1-835595-3 Oct 05 17:48:44.597658 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-39d8b2c4-5f38-45ae-b51b-d6ec2945c8c3 req-f38c1657-a1fd-4b4c-90c1-3e75083148f1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070981 Oct 05 17:48:44.599103 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2029/3812] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:48:44.821449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] validate_networks() for [('a318cf17-4970-4411-8821-7ec2ee9e9e79', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:48:44.932449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f63329e6-43e7-44d5-be74-0f7584f5a4d0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:44.934371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f63329e6-43e7-44d5-be74-0f7584f5a4d0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:44.953396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63329e6-43e7-44d5-be74-0f7584f5a4d0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:44.962077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63329e6-43e7-44d5-be74-0f7584f5a4d0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:44.962540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63329e6-43e7-44d5-be74-0f7584f5a4d0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:44.963355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63329e6-43e7-44d5-be74-0f7584f5a4d0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:44.963827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63329e6-43e7-44d5-be74-0f7584f5a4d0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:44.964402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f63329e6-43e7-44d5-be74-0f7584f5a4d0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:45.809171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f63329e6-43e7-44d5-be74-0f7584f5a4d0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:45.830001 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f63329e6-43e7-44d5-be74-0f7584f5a4d0 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1390 microversion: 2.1 time: 0.902439 Oct 05 17:48:45.830873 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2030/3813] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:44 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1390 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:45.844054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87665f7f-6c6f-40ba-9f69-fb1a19a5e71f tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:45.844910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-87665f7f-6c6f-40ba-9f69-fb1a19a5e71f tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:45.861657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87665f7f-6c6f-40ba-9f69-fb1a19a5e71f tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:45.862682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87665f7f-6c6f-40ba-9f69-fb1a19a5e71f tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:45.863582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87665f7f-6c6f-40ba-9f69-fb1a19a5e71f tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:45.864487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87665f7f-6c6f-40ba-9f69-fb1a19a5e71f tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:45.865132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87665f7f-6c6f-40ba-9f69-fb1a19a5e71f tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:45.866306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87665f7f-6c6f-40ba-9f69-fb1a19a5e71f tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:46.047336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-87665f7f-6c6f-40ba-9f69-fb1a19a5e71f tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:46.062078 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87665f7f-6c6f-40ba-9f69-fb1a19a5e71f tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1277 microversion: 2.1 time: 0.229855 Oct 05 17:48:46.078230 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2031/3814] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:45 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:46.083720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4827080f-9e54-47e6-af86-bf32e357e8d0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:46.084537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4827080f-9e54-47e6-af86-bf32e357e8d0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:46.091553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4827080f-9e54-47e6-af86-bf32e357e8d0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:46.092250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4827080f-9e54-47e6-af86-bf32e357e8d0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:46.092845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4827080f-9e54-47e6-af86-bf32e357e8d0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:46.093725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4827080f-9e54-47e6-af86-bf32e357e8d0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:46.094397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4827080f-9e54-47e6-af86-bf32e357e8d0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:46.094987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4827080f-9e54-47e6-af86-bf32e357e8d0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:46.107885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:48:46.109562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:48:46.110182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:48:46.112067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:48:46.112661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:48:46.128160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:46.129881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:46.130538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:46.131949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:46.132664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:46.133939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:46.160383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Getting quotas for project caf452f31a594c888e1703356c637a91. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:48:46.165937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Getting quotas for user 50b3fb554dd64e41bea1109e697b0799 and project caf452f31a594c888e1703356c637a91. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:48:46.181434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:48:46.184764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:48:46.273374 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b879e940-a396-4688-ba6c-ff9df75aa143 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.978544 Oct 05 17:48:46.275110 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1784/3815] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:48:44 2022] POST /compute/v2.1/servers => generated 409 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:48:46.287193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f08fff0-651c-4c9a-9068-060f6433e299 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:46.287824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f08fff0-651c-4c9a-9068-060f6433e299 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:46.424992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4827080f-9e54-47e6-af86-bf32e357e8d0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:46.425450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4f08fff0-651c-4c9a-9068-060f6433e299 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:46.435994 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f08fff0-651c-4c9a-9068-060f6433e299 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1246 microversion: 2.1 time: 0.152806 Oct 05 17:48:46.439221 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4827080f-9e54-47e6-af86-bf32e357e8d0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1323 microversion: 2.1 time: 0.359463 Oct 05 17:48:46.448914 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1785/3816] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:46 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1246 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:46.451007 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2032/3817] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:46 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1323 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:46.853185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-04eb8953-53b8-4d01-a7a9-e587598a01a4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:46.854351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-04eb8953-53b8-4d01-a7a9-e587598a01a4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:46.869063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04eb8953-53b8-4d01-a7a9-e587598a01a4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:46.869858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04eb8953-53b8-4d01-a7a9-e587598a01a4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:46.870510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04eb8953-53b8-4d01-a7a9-e587598a01a4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:46.871458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04eb8953-53b8-4d01-a7a9-e587598a01a4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:46.871925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04eb8953-53b8-4d01-a7a9-e587598a01a4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:46.872394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04eb8953-53b8-4d01-a7a9-e587598a01a4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:47.086145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a3e7ea96-8d96-4454-b752-58ef54b27a75 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:47.087753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a3e7ea96-8d96-4454-b752-58ef54b27a75 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:47.099985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e7ea96-8d96-4454-b752-58ef54b27a75 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:47.100859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e7ea96-8d96-4454-b752-58ef54b27a75 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:47.101692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e7ea96-8d96-4454-b752-58ef54b27a75 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:47.102807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e7ea96-8d96-4454-b752-58ef54b27a75 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:47.104044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e7ea96-8d96-4454-b752-58ef54b27a75 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:47.106099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e7ea96-8d96-4454-b752-58ef54b27a75 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:47.153491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-04eb8953-53b8-4d01-a7a9-e587598a01a4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:47.155791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:47.163315 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-04eb8953-53b8-4d01-a7a9-e587598a01a4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1380 microversion: 2.1 time: 0.314015 Oct 05 17:48:47.166350 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1786/3818] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:46 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1380 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:47.189815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-31ed6d63-ceed-4677-aa01-03a27d43ece4 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '.version_select at 0x7f777465f700>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:47.196346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31ed6d63-ceed-4677-aa01-03a27d43ece4 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:47.200857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31ed6d63-ceed-4677-aa01-03a27d43ece4 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:47.202689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31ed6d63-ceed-4677-aa01-03a27d43ece4 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:47.224238 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-31ed6d63-ceed-4677-aa01-03a27d43ece4 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.039544 Oct 05 17:48:47.225444 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1787/3819] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:48:47 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:47.239557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-40ee0870-8af8-419c-bd08-dbabdce089e1 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:47.240402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-40ee0870-8af8-419c-bd08-dbabdce089e1 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:47.246815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a3e7ea96-8d96-4454-b752-58ef54b27a75 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:47.259458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ee0870-8af8-419c-bd08-dbabdce089e1 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:47.260198 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a3e7ea96-8d96-4454-b752-58ef54b27a75 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1275 microversion: 2.1 time: 0.178386 Oct 05 17:48:47.261759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2033/3820] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:47 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1275 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:47.262897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ee0870-8af8-419c-bd08-dbabdce089e1 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:47.263394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ee0870-8af8-419c-bd08-dbabdce089e1 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:47.264414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ee0870-8af8-419c-bd08-dbabdce089e1 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:47.265078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ee0870-8af8-419c-bd08-dbabdce089e1 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:47.266441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ee0870-8af8-419c-bd08-dbabdce089e1 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:47.467443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88d8dbab-f29f-4e5a-ac65-3ec84d08c182 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:47.468065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88d8dbab-f29f-4e5a-ac65-3ec84d08c182 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:47.473365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:47.488631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88d8dbab-f29f-4e5a-ac65-3ec84d08c182 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:47.489838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88d8dbab-f29f-4e5a-ac65-3ec84d08c182 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:47.492094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88d8dbab-f29f-4e5a-ac65-3ec84d08c182 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:47.495031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88d8dbab-f29f-4e5a-ac65-3ec84d08c182 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:47.497023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88d8dbab-f29f-4e5a-ac65-3ec84d08c182 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:47.497701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88d8dbab-f29f-4e5a-ac65-3ec84d08c182 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:47.738189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88d8dbab-f29f-4e5a-ac65-3ec84d08c182 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:47.753252 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88d8dbab-f29f-4e5a-ac65-3ec84d08c182 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1323 microversion: 2.1 time: 0.290382 Oct 05 17:48:47.753938 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2034/3821] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:47 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1323 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:47.788932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7961296f-c020-4643-80ad-3e5256ebbbb0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:47.789800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7961296f-c020-4643-80ad-3e5256ebbbb0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:47.802593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7961296f-c020-4643-80ad-3e5256ebbbb0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:47.802985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7961296f-c020-4643-80ad-3e5256ebbbb0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:47.805156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7961296f-c020-4643-80ad-3e5256ebbbb0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:47.807070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7961296f-c020-4643-80ad-3e5256ebbbb0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:47.807701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7961296f-c020-4643-80ad-3e5256ebbbb0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:47.812907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7961296f-c020-4643-80ad-3e5256ebbbb0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:47.900808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7961296f-c020-4643-80ad-3e5256ebbbb0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:47.918066 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7961296f-c020-4643-80ad-3e5256ebbbb0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1242 microversion: 2.1 time: 0.159649 Oct 05 17:48:47.921196 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2035/3822] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:47 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1242 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:48.027722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-dd085afb-674d-4420-aaa8-8c58a8322106 req-50bd4f0a-9c03-4f80-ad91-8b78204a8144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206610c4-627b-4680-9abc-951d50a8d378", "name": "network-vif-plugged", "status": "completed", "tag": "63b73b65-70e7-415d-94c8-d862e9d74d7d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:48.048464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dd085afb-674d-4420-aaa8-8c58a8322106 req-50bd4f0a-9c03-4f80-ad91-8b78204a8144 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.049728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dd085afb-674d-4420-aaa8-8c58a8322106 req-50bd4f0a-9c03-4f80-ad91-8b78204a8144 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.051049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dd085afb-674d-4420-aaa8-8c58a8322106 req-50bd4f0a-9c03-4f80-ad91-8b78204a8144 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:48.075512 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-dd085afb-674d-4420-aaa8-8c58a8322106 req-50bd4f0a-9c03-4f80-ad91-8b78204a8144 service nova] Creating event network-vif-plugged:63b73b65-70e7-415d-94c8-d862e9d74d7d for instance 206610c4-627b-4680-9abc-951d50a8d378 on n-h2-835595-3 Oct 05 17:48:48.088658 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-dd085afb-674d-4420-aaa8-8c58a8322106 req-50bd4f0a-9c03-4f80-ad91-8b78204a8144 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065005 Oct 05 17:48:48.090318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2036/3823] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:48:48.160077 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-40ee0870-8af8-419c-bd08-dbabdce089e1 tempest-LiveMigrationTest-123827372 tempest-LiveMigrationTest-123827372-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1531 microversion: 2.1 time: 0.924309 Oct 05 17:48:48.161573 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1788/3824] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:47 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1531 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:48.198760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ec316d4-aef1-45ce-aa8f-fcfc6ff0a06d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:48.199372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7ec316d4-aef1-45ce-aa8f-fcfc6ff0a06d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:48.210805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ec316d4-aef1-45ce-aa8f-fcfc6ff0a06d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.211761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ec316d4-aef1-45ce-aa8f-fcfc6ff0a06d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.212894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ec316d4-aef1-45ce-aa8f-fcfc6ff0a06d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:48.214421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ec316d4-aef1-45ce-aa8f-fcfc6ff0a06d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.215058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ec316d4-aef1-45ce-aa8f-fcfc6ff0a06d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.215783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ec316d4-aef1-45ce-aa8f-fcfc6ff0a06d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:48.260959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7ec316d4-aef1-45ce-aa8f-fcfc6ff0a06d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:48:48.269540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:48.287422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-34264a1c-25a1-4377-9c5a-c3f71d2f6ce7 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:48.288256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-34264a1c-25a1-4377-9c5a-c3f71d2f6ce7 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:48.300550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34264a1c-25a1-4377-9c5a-c3f71d2f6ce7 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.301273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34264a1c-25a1-4377-9c5a-c3f71d2f6ce7 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.301901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34264a1c-25a1-4377-9c5a-c3f71d2f6ce7 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:48.302919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34264a1c-25a1-4377-9c5a-c3f71d2f6ce7 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.303537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34264a1c-25a1-4377-9c5a-c3f71d2f6ce7 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.304102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34264a1c-25a1-4377-9c5a-c3f71d2f6ce7 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:48.460342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7ec316d4-aef1-45ce-aa8f-fcfc6ff0a06d tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 204 len: 0 microversion: 2.1 time: 0.266813 Oct 05 17:48:48.465775 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2037/3825] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:48:48 2022] DELETE /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:48:48.481861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-938bbf19-cbfa-453a-beee-47be0e8b6adb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:48.489639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-938bbf19-cbfa-453a-beee-47be0e8b6adb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:48.505849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-938bbf19-cbfa-453a-beee-47be0e8b6adb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.506533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-938bbf19-cbfa-453a-beee-47be0e8b6adb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.507112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-938bbf19-cbfa-453a-beee-47be0e8b6adb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:48.508078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-938bbf19-cbfa-453a-beee-47be0e8b6adb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.508930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-938bbf19-cbfa-453a-beee-47be0e8b6adb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.510769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-938bbf19-cbfa-453a-beee-47be0e8b6adb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:48.620419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-34264a1c-25a1-4377-9c5a-c3f71d2f6ce7 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:48.635911 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-34264a1c-25a1-4377-9c5a-c3f71d2f6ce7 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1275 microversion: 2.1 time: 0.353088 Oct 05 17:48:48.649959 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1789/3826] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:48 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1275 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:48.780229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-938bbf19-cbfa-453a-beee-47be0e8b6adb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:48.781968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c9b5fa38-7eed-4e02-a683-166a019d092d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:48.784670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c9b5fa38-7eed-4e02-a683-166a019d092d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:48.799768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9b5fa38-7eed-4e02-a683-166a019d092d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.801873 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-938bbf19-cbfa-453a-beee-47be0e8b6adb tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1386 microversion: 2.1 time: 0.329976 Oct 05 17:48:48.816780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9b5fa38-7eed-4e02-a683-166a019d092d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.817243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9b5fa38-7eed-4e02-a683-166a019d092d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:48.823827 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2038/3827] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:48 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1386 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:48.824360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9b5fa38-7eed-4e02-a683-166a019d092d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.824998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9b5fa38-7eed-4e02-a683-166a019d092d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.825723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c9b5fa38-7eed-4e02-a683-166a019d092d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:48.947675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-65513d8e-f3f3-4e2c-9485-d3068f0b00ff tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:48.948524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-65513d8e-f3f3-4e2c-9485-d3068f0b00ff tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:48.955399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65513d8e-f3f3-4e2c-9485-d3068f0b00ff tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.960840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65513d8e-f3f3-4e2c-9485-d3068f0b00ff tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.961638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65513d8e-f3f3-4e2c-9485-d3068f0b00ff tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:48.962615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65513d8e-f3f3-4e2c-9485-d3068f0b00ff tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:48.969498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65513d8e-f3f3-4e2c-9485-d3068f0b00ff tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:48.974676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65513d8e-f3f3-4e2c-9485-d3068f0b00ff tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:49.073293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65513d8e-f3f3-4e2c-9485-d3068f0b00ff tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:49.105560 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-65513d8e-f3f3-4e2c-9485-d3068f0b00ff tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1298 microversion: 2.1 time: 0.159940 Oct 05 17:48:49.106998 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2039/3828] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:48 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1298 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:49.665101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-473589bc-70e9-408e-916a-7f7daa196111 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:49.665730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-473589bc-70e9-408e-916a-7f7daa196111 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:49.676440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-473589bc-70e9-408e-916a-7f7daa196111 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:49.678597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-473589bc-70e9-408e-916a-7f7daa196111 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:49.679303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-473589bc-70e9-408e-916a-7f7daa196111 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:49.681978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-473589bc-70e9-408e-916a-7f7daa196111 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:49.682760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-473589bc-70e9-408e-916a-7f7daa196111 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:49.683555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-473589bc-70e9-408e-916a-7f7daa196111 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:49.927791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c9b5fa38-7eed-4e02-a683-166a019d092d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:49.950108 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c9b5fa38-7eed-4e02-a683-166a019d092d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1323 microversion: 2.1 time: 1.176297 Oct 05 17:48:49.950821 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1790/3829] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:48 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1323 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:49.955715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d4c3427-be21-4e7a-beb4-de1fcfa435b5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:49.960197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0d4c3427-be21-4e7a-beb4-de1fcfa435b5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:49.977568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d4c3427-be21-4e7a-beb4-de1fcfa435b5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:49.978425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d4c3427-be21-4e7a-beb4-de1fcfa435b5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:49.979124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d4c3427-be21-4e7a-beb4-de1fcfa435b5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:49.980325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d4c3427-be21-4e7a-beb4-de1fcfa435b5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:49.980986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d4c3427-be21-4e7a-beb4-de1fcfa435b5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:49.981622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d4c3427-be21-4e7a-beb4-de1fcfa435b5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:50.007281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-473589bc-70e9-408e-916a-7f7daa196111 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:50.030637 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-473589bc-70e9-408e-916a-7f7daa196111 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1275 microversion: 2.1 time: 0.370484 Oct 05 17:48:50.032325 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2040/3830] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:49 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1275 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:50.136730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1c0f3c8f-80e9-4902-aa32-94e77757e71e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:50.137442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1c0f3c8f-80e9-4902-aa32-94e77757e71e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:50.149155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c8f-80e9-4902-aa32-94e77757e71e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:50.149892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c8f-80e9-4902-aa32-94e77757e71e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:50.153554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c8f-80e9-4902-aa32-94e77757e71e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:50.156937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c8f-80e9-4902-aa32-94e77757e71e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:50.159331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c8f-80e9-4902-aa32-94e77757e71e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:50.161244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c0f3c8f-80e9-4902-aa32-94e77757e71e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:50.284753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1c0f3c8f-80e9-4902-aa32-94e77757e71e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:50.306573 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1c0f3c8f-80e9-4902-aa32-94e77757e71e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1316 microversion: 2.1 time: 0.172946 Oct 05 17:48:50.307757 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2041/3831] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:50 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1316 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:50.429548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-bdc67036-58b9-4cdf-b833-e583159e2b3b req-049db839-cd70-4c9c-9f48-dfaa81e9f75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "637528bb-a7bd-49c4-baf5-f63095788532", "name": "network-vif-deleted", "tag": "b0f1bad7-bd89-4f62-bd96-6e8439a2671b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:50.455079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bdc67036-58b9-4cdf-b833-e583159e2b3b req-049db839-cd70-4c9c-9f48-dfaa81e9f75c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:50.456806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bdc67036-58b9-4cdf-b833-e583159e2b3b req-049db839-cd70-4c9c-9f48-dfaa81e9f75c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:50.457429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-bdc67036-58b9-4cdf-b833-e583159e2b3b req-049db839-cd70-4c9c-9f48-dfaa81e9f75c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:50.482597 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-bdc67036-58b9-4cdf-b833-e583159e2b3b req-049db839-cd70-4c9c-9f48-dfaa81e9f75c service nova] Creating event network-vif-deleted:b0f1bad7-bd89-4f62-bd96-6e8439a2671b for instance 637528bb-a7bd-49c4-baf5-f63095788532 on n-h1-835595-3 Oct 05 17:48:50.502981 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-bdc67036-58b9-4cdf-b833-e583159e2b3b req-049db839-cd70-4c9c-9f48-dfaa81e9f75c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077980 Oct 05 17:48:50.503937 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2042/3832] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 05 17:48:50.979151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1e1718c5-689b-478e-a2d5-a121b1de9ee6 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:50.979882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1e1718c5-689b-478e-a2d5-a121b1de9ee6 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:51.006416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e1718c5-689b-478e-a2d5-a121b1de9ee6 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:51.015976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e1718c5-689b-478e-a2d5-a121b1de9ee6 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:51.025978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e1718c5-689b-478e-a2d5-a121b1de9ee6 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:51.029393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e1718c5-689b-478e-a2d5-a121b1de9ee6 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:51.030156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e1718c5-689b-478e-a2d5-a121b1de9ee6 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:51.030796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e1718c5-689b-478e-a2d5-a121b1de9ee6 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:51.454768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d4c3427-be21-4e7a-beb4-de1fcfa435b5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:51.474476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1e1718c5-689b-478e-a2d5-a121b1de9ee6 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:51.479401 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0d4c3427-be21-4e7a-beb4-de1fcfa435b5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1386 microversion: 2.1 time: 1.521194 Oct 05 17:48:51.482668 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1e1718c5-689b-478e-a2d5-a121b1de9ee6 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1323 microversion: 2.1 time: 0.510393 Oct 05 17:48:51.483076 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1791/3833] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:49 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1386 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:51.494028 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2043/3834] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:50 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1323 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:51.495523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7df414ca-f8bf-4190-9f22-4c6f445015ad tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:51.501074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b56a9161-9e9f-4d0d-badc-f0919bb4e3ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:51.503645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7df414ca-f8bf-4190-9f22-4c6f445015ad tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:51.505338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b56a9161-9e9f-4d0d-badc-f0919bb4e3ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:51.524058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b56a9161-9e9f-4d0d-badc-f0919bb4e3ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:51.524372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:51.524565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b56a9161-9e9f-4d0d-badc-f0919bb4e3ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:51.525023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b56a9161-9e9f-4d0d-badc-f0919bb4e3ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:51.525727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b56a9161-9e9f-4d0d-badc-f0919bb4e3ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:51.532591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7df414ca-f8bf-4190-9f22-4c6f445015ad tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:51.538674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7df414ca-f8bf-4190-9f22-4c6f445015ad tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:51.538967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b56a9161-9e9f-4d0d-badc-f0919bb4e3ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:51.539410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b56a9161-9e9f-4d0d-badc-f0919bb4e3ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:51.541234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7df414ca-f8bf-4190-9f22-4c6f445015ad tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:51.543019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7df414ca-f8bf-4190-9f22-4c6f445015ad tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:51.544360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7df414ca-f8bf-4190-9f22-4c6f445015ad tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:51.545575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7df414ca-f8bf-4190-9f22-4c6f445015ad tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:51.690229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b56a9161-9e9f-4d0d-badc-f0919bb4e3ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:51.706301 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b56a9161-9e9f-4d0d-badc-f0919bb4e3ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1304 microversion: 2.1 time: 0.209680 Oct 05 17:48:51.707685 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2044/3835] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:51 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1304 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:52.296415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-2283e9c3-af61-407e-adc1-a4e5cd8f52e0 req-79c14afb-0805-4505-975d-c80b53ce13f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261b171b-1e5e-4ad4-88be-c38767238817", "name": "network-vif-plugged", "status": "completed", "tag": "b39d185b-e007-478a-9bb8-4d9a691acd24"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:52.321647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2283e9c3-af61-407e-adc1-a4e5cd8f52e0 req-79c14afb-0805-4505-975d-c80b53ce13f3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:52.322443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2283e9c3-af61-407e-adc1-a4e5cd8f52e0 req-79c14afb-0805-4505-975d-c80b53ce13f3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:52.323045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2283e9c3-af61-407e-adc1-a4e5cd8f52e0 req-79c14afb-0805-4505-975d-c80b53ce13f3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:52.339219 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-2283e9c3-af61-407e-adc1-a4e5cd8f52e0 req-79c14afb-0805-4505-975d-c80b53ce13f3 service nova] Creating event network-vif-plugged:b39d185b-e007-478a-9bb8-4d9a691acd24 for instance 261b171b-1e5e-4ad4-88be-c38767238817 on n-h1-835595-3 Oct 05 17:48:52.347339 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-2283e9c3-af61-407e-adc1-a4e5cd8f52e0 req-79c14afb-0805-4505-975d-c80b53ce13f3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054695 Oct 05 17:48:52.348570 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2045/3836] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:52.438699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7df414ca-f8bf-4190-9f22-4c6f445015ad tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:52.450708 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7df414ca-f8bf-4190-9f22-4c6f445015ad tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1317 microversion: 2.1 time: 0.960190 Oct 05 17:48:52.451351 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1792/3837] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:51 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1317 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:52.510528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-003ff98d-560d-45d2-9692-e5b71562eabe tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:52.511398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-003ff98d-560d-45d2-9692-e5b71562eabe tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:52.513032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aed92620-0d73-49bb-a03b-f73873a46e70 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:52.514404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aed92620-0d73-49bb-a03b-f73873a46e70 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:52.519096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-003ff98d-560d-45d2-9692-e5b71562eabe tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:52.520382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-003ff98d-560d-45d2-9692-e5b71562eabe tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:52.521033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-003ff98d-560d-45d2-9692-e5b71562eabe tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:52.521965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-003ff98d-560d-45d2-9692-e5b71562eabe tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:52.522691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-003ff98d-560d-45d2-9692-e5b71562eabe tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:52.523320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-003ff98d-560d-45d2-9692-e5b71562eabe tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:52.528233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aed92620-0d73-49bb-a03b-f73873a46e70 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:52.529052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aed92620-0d73-49bb-a03b-f73873a46e70 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:52.532307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aed92620-0d73-49bb-a03b-f73873a46e70 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:52.533566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aed92620-0d73-49bb-a03b-f73873a46e70 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:52.534593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aed92620-0d73-49bb-a03b-f73873a46e70 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:52.535387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aed92620-0d73-49bb-a03b-f73873a46e70 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:52.723306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aed92620-0d73-49bb-a03b-f73873a46e70 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:52.736542 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aed92620-0d73-49bb-a03b-f73873a46e70 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1183 microversion: 2.1 time: 0.229630 Oct 05 17:48:52.738753 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1793/3838] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:52 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:52.752842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-15c9b844-be7b-4e43-80a8-72fb66b87fe8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:52.754371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-15c9b844-be7b-4e43-80a8-72fb66b87fe8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:52.771230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15c9b844-be7b-4e43-80a8-72fb66b87fe8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:52.773209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15c9b844-be7b-4e43-80a8-72fb66b87fe8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:52.774062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15c9b844-be7b-4e43-80a8-72fb66b87fe8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:52.778486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15c9b844-be7b-4e43-80a8-72fb66b87fe8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:52.779032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15c9b844-be7b-4e43-80a8-72fb66b87fe8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:52.779648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15c9b844-be7b-4e43-80a8-72fb66b87fe8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:52.849763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-003ff98d-560d-45d2-9692-e5b71562eabe tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:52.866450 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-003ff98d-560d-45d2-9692-e5b71562eabe tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1323 microversion: 2.1 time: 0.354439 Oct 05 17:48:52.869949 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2046/3839] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:52 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1323 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:52.960728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-15c9b844-be7b-4e43-80a8-72fb66b87fe8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:52.971418 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-15c9b844-be7b-4e43-80a8-72fb66b87fe8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1304 microversion: 2.1 time: 0.231294 Oct 05 17:48:52.972294 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1794/3840] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:52 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1304 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:53.478903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cc890392-bd1e-46e6-ac50-d025f093fa38 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:53.479977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cc890392-bd1e-46e6-ac50-d025f093fa38 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:53.490836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:53.495914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc890392-bd1e-46e6-ac50-d025f093fa38 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:53.497387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc890392-bd1e-46e6-ac50-d025f093fa38 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:53.498873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc890392-bd1e-46e6-ac50-d025f093fa38 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:53.500428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc890392-bd1e-46e6-ac50-d025f093fa38 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:53.502473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc890392-bd1e-46e6-ac50-d025f093fa38 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:53.503475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc890392-bd1e-46e6-ac50-d025f093fa38 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:53.506129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=12 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:53.760247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23d23594-85aa-4878-813a-da51ae0514de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:53.760857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23d23594-85aa-4878-813a-da51ae0514de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:53.778168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cc890392-bd1e-46e6-ac50-d025f093fa38 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:53.782655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d23594-85aa-4878-813a-da51ae0514de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:53.784129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d23594-85aa-4878-813a-da51ae0514de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:53.787805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d23594-85aa-4878-813a-da51ae0514de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:53.789707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d23594-85aa-4878-813a-da51ae0514de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:53.790104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d23594-85aa-4878-813a-da51ae0514de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:53.790560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d23594-85aa-4878-813a-da51ae0514de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:53.796629 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cc890392-bd1e-46e6-ac50-d025f093fa38 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1317 microversion: 2.1 time: 0.321973 Oct 05 17:48:53.806358 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2047/3841] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:53 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:53.895763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-808cdc00-8fc8-4fee-b37f-ac4aa9c01022 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:53.897641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-808cdc00-8fc8-4fee-b37f-ac4aa9c01022 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:53.913380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-808cdc00-8fc8-4fee-b37f-ac4aa9c01022 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:53.915936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-808cdc00-8fc8-4fee-b37f-ac4aa9c01022 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:53.916612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-808cdc00-8fc8-4fee-b37f-ac4aa9c01022 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:53.918429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-808cdc00-8fc8-4fee-b37f-ac4aa9c01022 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:53.922900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-808cdc00-8fc8-4fee-b37f-ac4aa9c01022 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:53.923362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-808cdc00-8fc8-4fee-b37f-ac4aa9c01022 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:53.988928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23d23594-85aa-4878-813a-da51ae0514de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:54.005116 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23d23594-85aa-4878-813a-da51ae0514de tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1183 microversion: 2.1 time: 0.246268 Oct 05 17:48:54.008214 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1795/3842] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:53 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1183 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:54.017469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-acede457-2eed-4020-9b44-84a042628bed tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:54.018366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-acede457-2eed-4020-9b44-84a042628bed tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:54.040157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acede457-2eed-4020-9b44-84a042628bed tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:54.047859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acede457-2eed-4020-9b44-84a042628bed tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:54.049055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acede457-2eed-4020-9b44-84a042628bed tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:54.050748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acede457-2eed-4020-9b44-84a042628bed tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:54.056847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acede457-2eed-4020-9b44-84a042628bed tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:54.057473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acede457-2eed-4020-9b44-84a042628bed tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:54.226174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-808cdc00-8fc8-4fee-b37f-ac4aa9c01022 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:54.237522 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-808cdc00-8fc8-4fee-b37f-ac4aa9c01022 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1323 microversion: 2.1 time: 0.348591 Oct 05 17:48:54.250982 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2048/3843] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:53 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:54.367332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-579c43c7-8545-4178-a367-3d2745508078 req-95e39e62-78c7-4068-93cd-33a33fbdf0dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955b28b3-dd61-4846-94d2-b394f6c55aa4", "name": "network-vif-plugged", "status": "completed", "tag": "0f5cb3f5-caae-4aeb-8be1-adef920cf7b8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:54.381411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-579c43c7-8545-4178-a367-3d2745508078 req-95e39e62-78c7-4068-93cd-33a33fbdf0dd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:54.381696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-579c43c7-8545-4178-a367-3d2745508078 req-95e39e62-78c7-4068-93cd-33a33fbdf0dd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:54.382133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-579c43c7-8545-4178-a367-3d2745508078 req-95e39e62-78c7-4068-93cd-33a33fbdf0dd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:54.431712 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-579c43c7-8545-4178-a367-3d2745508078 req-95e39e62-78c7-4068-93cd-33a33fbdf0dd service nova] Creating event network-vif-plugged:0f5cb3f5-caae-4aeb-8be1-adef920cf7b8 for instance 955b28b3-dd61-4846-94d2-b394f6c55aa4 on n-h2-835595-3 Oct 05 17:48:54.438783 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-579c43c7-8545-4178-a367-3d2745508078 req-95e39e62-78c7-4068-93cd-33a33fbdf0dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075367 Oct 05 17:48:54.439677 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2049/3844] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:48:54.563591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6818205b-8aaa-4ab5-976e-28b823a0497a req-18a3a18a-b3b1-4c82-b41c-ec70f92b2b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb32c49-9cb8-468c-b59a-0f7470ce6cf0", "tag": "ba505cb4-419d-4473-b832-b42755e1f881"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:54.586999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6818205b-8aaa-4ab5-976e-28b823a0497a req-18a3a18a-b3b1-4c82-b41c-ec70f92b2b9b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:54.587479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6818205b-8aaa-4ab5-976e-28b823a0497a req-18a3a18a-b3b1-4c82-b41c-ec70f92b2b9b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:54.588092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6818205b-8aaa-4ab5-976e-28b823a0497a req-18a3a18a-b3b1-4c82-b41c-ec70f92b2b9b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:54.617042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6818205b-8aaa-4ab5-976e-28b823a0497a req-18a3a18a-b3b1-4c82-b41c-ec70f92b2b9b service nova] Creating event network-changed:ba505cb4-419d-4473-b832-b42755e1f881 for instance 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 on n-h1-835595-3 Oct 05 17:48:54.622105 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6818205b-8aaa-4ab5-976e-28b823a0497a req-18a3a18a-b3b1-4c82-b41c-ec70f92b2b9b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064173 Oct 05 17:48:54.623034 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2050/3845] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:48:54.794890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-acede457-2eed-4020-9b44-84a042628bed tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:54.809418 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-acede457-2eed-4020-9b44-84a042628bed tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1372 microversion: 2.1 time: 0.799730 Oct 05 17:48:54.831335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ac63b93-e7cf-403c-8358-30361fbc29a6 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:54.833118 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1796/3846] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:54 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1372 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:54.835168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ac63b93-e7cf-403c-8358-30361fbc29a6 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:54.846313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ac63b93-e7cf-403c-8358-30361fbc29a6 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:54.847217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ac63b93-e7cf-403c-8358-30361fbc29a6 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:54.847944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ac63b93-e7cf-403c-8358-30361fbc29a6 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:54.848808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ac63b93-e7cf-403c-8358-30361fbc29a6 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:54.849530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ac63b93-e7cf-403c-8358-30361fbc29a6 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:54.850101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ac63b93-e7cf-403c-8358-30361fbc29a6 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:55.033383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-18c74209-4b3e-4bb9-b0e7-a67779057fe3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:55.034249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-18c74209-4b3e-4bb9-b0e7-a67779057fe3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:55.042164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18c74209-4b3e-4bb9-b0e7-a67779057fe3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:55.043240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18c74209-4b3e-4bb9-b0e7-a67779057fe3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:55.043819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18c74209-4b3e-4bb9-b0e7-a67779057fe3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:55.044673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18c74209-4b3e-4bb9-b0e7-a67779057fe3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:55.045458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18c74209-4b3e-4bb9-b0e7-a67779057fe3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:55.046025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18c74209-4b3e-4bb9-b0e7-a67779057fe3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:55.112362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5ac63b93-e7cf-403c-8358-30361fbc29a6 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:55.127654 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ac63b93-e7cf-403c-8358-30361fbc29a6 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1317 microversion: 2.1 time: 0.306339 Oct 05 17:48:55.131288 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2051/3847] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:54 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:55.262114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e92065c7-118d-4768-8a29-2fd546501b53 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:55.262761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e92065c7-118d-4768-8a29-2fd546501b53 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:55.273594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e92065c7-118d-4768-8a29-2fd546501b53 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:55.275252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e92065c7-118d-4768-8a29-2fd546501b53 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:55.276797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e92065c7-118d-4768-8a29-2fd546501b53 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:55.278668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e92065c7-118d-4768-8a29-2fd546501b53 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:55.279130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e92065c7-118d-4768-8a29-2fd546501b53 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:55.279564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e92065c7-118d-4768-8a29-2fd546501b53 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:55.453601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-18c74209-4b3e-4bb9-b0e7-a67779057fe3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:55.494040 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-18c74209-4b3e-4bb9-b0e7-a67779057fe3 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1183 microversion: 2.1 time: 0.458175 Oct 05 17:48:55.495762 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1797/3848] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:55 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1183 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:55.628463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e92065c7-118d-4768-8a29-2fd546501b53 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:55.638145 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e92065c7-118d-4768-8a29-2fd546501b53 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1323 microversion: 2.1 time: 0.380566 Oct 05 17:48:55.655636 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2052/3849] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:55 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1323 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:55.839829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b24b2fed-586c-4e34-a36b-214ffd0ff64e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:55.840461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b24b2fed-586c-4e34-a36b-214ffd0ff64e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:55.847462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24b2fed-586c-4e34-a36b-214ffd0ff64e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:55.854613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24b2fed-586c-4e34-a36b-214ffd0ff64e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:55.855243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24b2fed-586c-4e34-a36b-214ffd0ff64e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:55.856026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24b2fed-586c-4e34-a36b-214ffd0ff64e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:55.857438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24b2fed-586c-4e34-a36b-214ffd0ff64e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:55.857885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24b2fed-586c-4e34-a36b-214ffd0ff64e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:56.150735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:56.153292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4f16a043-1899-4604-a3e7-cabb29bec458 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:56.153913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4f16a043-1899-4604-a3e7-cabb29bec458 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:56.160471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f16a043-1899-4604-a3e7-cabb29bec458 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:56.160976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f16a043-1899-4604-a3e7-cabb29bec458 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:56.161414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f16a043-1899-4604-a3e7-cabb29bec458 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:56.162125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f16a043-1899-4604-a3e7-cabb29bec458 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:56.162612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f16a043-1899-4604-a3e7-cabb29bec458 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:56.171417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f16a043-1899-4604-a3e7-cabb29bec458 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:56.259452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b24b2fed-586c-4e34-a36b-214ffd0ff64e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:56.268196 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b24b2fed-586c-4e34-a36b-214ffd0ff64e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1372 microversion: 2.1 time: 0.432265 Oct 05 17:48:56.270615 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1798/3850] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:55 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1372 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:56.450461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f16a043-1899-4604-a3e7-cabb29bec458 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:56.458257 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4f16a043-1899-4604-a3e7-cabb29bec458 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1317 microversion: 2.1 time: 0.308919 Oct 05 17:48:56.473488 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2053/3851] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:56 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:56.518743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa094751-81c8-41cb-a022-3018236bb5f4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:56.521938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fa094751-81c8-41cb-a022-3018236bb5f4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:56.525263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:56.534811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa094751-81c8-41cb-a022-3018236bb5f4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:56.535328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa094751-81c8-41cb-a022-3018236bb5f4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:56.535764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa094751-81c8-41cb-a022-3018236bb5f4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:56.536636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa094751-81c8-41cb-a022-3018236bb5f4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:56.537236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa094751-81c8-41cb-a022-3018236bb5f4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:56.537802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa094751-81c8-41cb-a022-3018236bb5f4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:56.661587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-528af600-6dc3-4a37-acd2-dea19a43e353 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:56.662168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-528af600-6dc3-4a37-acd2-dea19a43e353 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:56.669654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-528af600-6dc3-4a37-acd2-dea19a43e353 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:56.670148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-528af600-6dc3-4a37-acd2-dea19a43e353 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:56.670640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-528af600-6dc3-4a37-acd2-dea19a43e353 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:56.671349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-528af600-6dc3-4a37-acd2-dea19a43e353 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:56.671809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-528af600-6dc3-4a37-acd2-dea19a43e353 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:56.673640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-528af600-6dc3-4a37-acd2-dea19a43e353 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:56.739618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa094751-81c8-41cb-a022-3018236bb5f4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:56.750078 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa094751-81c8-41cb-a022-3018236bb5f4 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1183 microversion: 2.1 time: 0.235856 Oct 05 17:48:56.766684 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1799/3852] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:56 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1183 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:56.772703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4cbd869a-f2e2-4935-9c93-339cad342517 req-0d47b50a-370a-426b-8b0f-faa52e5fe637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "306c41c5-0f1e-4812-a54d-c31fc031c7d1", "tag": "371d802d-9093-4be5-860b-4f96eed3c8f9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:48:56.784118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4cbd869a-f2e2-4935-9c93-339cad342517 req-0d47b50a-370a-426b-8b0f-faa52e5fe637 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:56.784639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4cbd869a-f2e2-4935-9c93-339cad342517 req-0d47b50a-370a-426b-8b0f-faa52e5fe637 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:56.785063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4cbd869a-f2e2-4935-9c93-339cad342517 req-0d47b50a-370a-426b-8b0f-faa52e5fe637 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:56.797322 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4cbd869a-f2e2-4935-9c93-339cad342517 req-0d47b50a-370a-426b-8b0f-faa52e5fe637 service nova] Creating event network-changed:371d802d-9093-4be5-860b-4f96eed3c8f9 for instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 on n-h2-835595-3 Oct 05 17:48:56.805066 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4cbd869a-f2e2-4935-9c93-339cad342517 req-0d47b50a-370a-426b-8b0f-faa52e5fe637 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036365 Oct 05 17:48:56.805066 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1800/3853] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:56.897655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-528af600-6dc3-4a37-acd2-dea19a43e353 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:56.911667 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-528af600-6dc3-4a37-acd2-dea19a43e353 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1517 microversion: 2.1 time: 0.253583 Oct 05 17:48:56.912948 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2054/3854] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:56 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1517 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:56.942104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-959b6dd9-38f9-4aec-9d0b-ccb07e061665 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:56.943527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-959b6dd9-38f9-4aec-9d0b-ccb07e061665 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 261b171b-1e5e-4ad4-88be-c38767238817] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:56.953936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-959b6dd9-38f9-4aec-9d0b-ccb07e061665 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:56.954719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-959b6dd9-38f9-4aec-9d0b-ccb07e061665 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:56.955393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-959b6dd9-38f9-4aec-9d0b-ccb07e061665 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:56.956188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-959b6dd9-38f9-4aec-9d0b-ccb07e061665 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:56.956743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-959b6dd9-38f9-4aec-9d0b-ccb07e061665 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:56.957720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-959b6dd9-38f9-4aec-9d0b-ccb07e061665 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:57.280852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-959b6dd9-38f9-4aec-9d0b-ccb07e061665 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:57.297032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f4791a64-9bb1-48f5-bb77-9e463e28ba8b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:57.297652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f4791a64-9bb1-48f5-bb77-9e463e28ba8b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:57.299475 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-959b6dd9-38f9-4aec-9d0b-ccb07e061665 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817" status: 200 len: 1517 microversion: 2.1 time: 0.368250 Oct 05 17:48:57.307248 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1801/3855] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:56 2022] GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817 => generated 1517 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:57.316698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4791a64-9bb1-48f5-bb77-9e463e28ba8b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:57.318945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4791a64-9bb1-48f5-bb77-9e463e28ba8b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:57.321376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4791a64-9bb1-48f5-bb77-9e463e28ba8b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:57.322127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4791a64-9bb1-48f5-bb77-9e463e28ba8b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:57.323418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4791a64-9bb1-48f5-bb77-9e463e28ba8b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:57.323856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4791a64-9bb1-48f5-bb77-9e463e28ba8b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:57.325406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb708e10-f635-42d4-8f44-bafefe8ea20d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:57.326202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eb708e10-f635-42d4-8f44-bafefe8ea20d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 206610c4-627b-4680-9abc-951d50a8d378] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:57.335590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb708e10-f635-42d4-8f44-bafefe8ea20d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:57.336313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb708e10-f635-42d4-8f44-bafefe8ea20d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:57.336899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb708e10-f635-42d4-8f44-bafefe8ea20d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:57.337981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb708e10-f635-42d4-8f44-bafefe8ea20d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:57.338648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb708e10-f635-42d4-8f44-bafefe8ea20d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:57.339444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb708e10-f635-42d4-8f44-bafefe8ea20d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:57.676147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb708e10-f635-42d4-8f44-bafefe8ea20d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:57.685022 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb708e10-f635-42d4-8f44-bafefe8ea20d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378" status: 200 len: 1516 microversion: 2.1 time: 0.363926 Oct 05 17:48:57.691150 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1802/3856] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:57 2022] GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 => generated 1516 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:57.696178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a181fee-6587-4d2d-9747-510585c0f623 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:57.699012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a181fee-6587-4d2d-9747-510585c0f623 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:57.713179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a181fee-6587-4d2d-9747-510585c0f623 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:57.714166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a181fee-6587-4d2d-9747-510585c0f623 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:57.720006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a181fee-6587-4d2d-9747-510585c0f623 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:57.721057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a181fee-6587-4d2d-9747-510585c0f623 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:57.721696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a181fee-6587-4d2d-9747-510585c0f623 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:57.722373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a181fee-6587-4d2d-9747-510585c0f623 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:57.878418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:58.015146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a181fee-6587-4d2d-9747-510585c0f623 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:58.026564 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a181fee-6587-4d2d-9747-510585c0f623 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1317 microversion: 2.1 time: 0.334063 Oct 05 17:48:58.028160 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1803/3857] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:57 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:58.033850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0aef0f84-7abd-4f89-89ed-dc89565d0401 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:58.034367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0aef0f84-7abd-4f89-89ed-dc89565d0401 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 206610c4-627b-4680-9abc-951d50a8d378] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:58.041896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aef0f84-7abd-4f89-89ed-dc89565d0401 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.042661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aef0f84-7abd-4f89-89ed-dc89565d0401 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.050249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aef0f84-7abd-4f89-89ed-dc89565d0401 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.051468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aef0f84-7abd-4f89-89ed-dc89565d0401 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.052256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aef0f84-7abd-4f89-89ed-dc89565d0401 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.053223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aef0f84-7abd-4f89-89ed-dc89565d0401 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.085852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0aef0f84-7abd-4f89-89ed-dc89565d0401 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 206610c4-627b-4680-9abc-951d50a8d378] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:48:58.088527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:48:58.227801 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0aef0f84-7abd-4f89-89ed-dc89565d0401 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378" status: 204 len: 0 microversion: 2.1 time: 0.198143 Oct 05 17:48:58.231478 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1804/3858] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:48:58 2022] DELETE /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:48:58.240929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:58.244577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:58.261094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.263292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.268490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.269720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.270438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.271074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.276383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f4791a64-9bb1-48f5-bb77-9e463e28ba8b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:58.286237 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f4791a64-9bb1-48f5-bb77-9e463e28ba8b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1372 microversion: 2.1 time: 0.994868 Oct 05 17:48:58.290683 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2055/3859] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:57 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1372 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:58.307271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:58.313097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:58.320468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Searching by: {'deleted': False, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:48:58.338557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.341376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.343769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.347289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.347818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.349980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.369883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.370592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.371869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.372630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lazy-loading 'fault' on Instance uuid 637528bb-a7bd-49c4-baf5-f63095788532 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:48:58.421850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:48:58.440298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:58.449967 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bac750e2-d2c1-46eb-9bbf-3bfac2c569dd tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 200 len: 1142 microversion: 2.1 time: 0.219755 Oct 05 17:48:58.453937 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1805/3860] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:58 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 1142 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:58.471076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-24136e58-1031-485c-b8a8-24022d22bae5 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:58.472417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-24136e58-1031-485c-b8a8-24022d22bae5 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 206610c4-627b-4680-9abc-951d50a8d378] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:58.491794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24136e58-1031-485c-b8a8-24022d22bae5 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.498716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24136e58-1031-485c-b8a8-24022d22bae5 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.500653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24136e58-1031-485c-b8a8-24022d22bae5 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.501594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24136e58-1031-485c-b8a8-24022d22bae5 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.503862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24136e58-1031-485c-b8a8-24022d22bae5 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.505776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24136e58-1031-485c-b8a8-24022d22bae5 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.537569 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c5d16d25-459f-4fac-aebe-19f134b1e99c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.245494 Oct 05 17:48:58.538657 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2056/3861] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:48:58 2022] GET /compute/v2.1/servers => generated 334 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:48:58.552996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:58.560486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:58.562392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Searching by: {'deleted': False, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:48:58.579856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.581973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.582730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.586175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.587409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.587908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.626356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:48:58.665031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:58.671900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:58.672482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:58.673006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:58.904204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-24136e58-1031-485c-b8a8-24022d22bae5 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:58.917882 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-24136e58-1031-485c-b8a8-24022d22bae5 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378" status: 200 len: 1522 microversion: 2.1 time: 0.460758 Oct 05 17:48:58.936284 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1806/3862] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:58 2022] GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:59.050006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43a9c045-b467-4381-844a-6f266d9449cb tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:59.051681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-43a9c045-b467-4381-844a-6f266d9449cb tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:59.063873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43a9c045-b467-4381-844a-6f266d9449cb tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.066432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43a9c045-b467-4381-844a-6f266d9449cb tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.067780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43a9c045-b467-4381-844a-6f266d9449cb tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.069427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43a9c045-b467-4381-844a-6f266d9449cb tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.071642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43a9c045-b467-4381-844a-6f266d9449cb tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.073042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43a9c045-b467-4381-844a-6f266d9449cb tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.288384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-43a9c045-b467-4381-844a-6f266d9449cb tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:59.301718 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-43a9c045-b467-4381-844a-6f266d9449cb tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1317 microversion: 2.1 time: 0.255963 Oct 05 17:48:59.302390 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1807/3863] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:59 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:48:59.313464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e8903ab-1778-4803-9a8a-beacd9cad071 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:59.314066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6e8903ab-1778-4803-9a8a-beacd9cad071 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:59.322414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e8903ab-1778-4803-9a8a-beacd9cad071 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.323428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e8903ab-1778-4803-9a8a-beacd9cad071 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.324045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e8903ab-1778-4803-9a8a-beacd9cad071 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.326483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e8903ab-1778-4803-9a8a-beacd9cad071 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.327765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e8903ab-1778-4803-9a8a-beacd9cad071 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.328680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e8903ab-1778-4803-9a8a-beacd9cad071 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.344093 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c960a619-5ccc-4267-ac71-f599a94f198e tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.795124 Oct 05 17:48:59.361489 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2057/3864] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:48:58 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:59.372097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d8089f53-e271-481a-b0e3-559ff2a50fbf tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:59.381275 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d8089f53-e271-481a-b0e3-559ff2a50fbf tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013091 Oct 05 17:48:59.389416 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2058/3865] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:48:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:48:59.477537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:59.478130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 637528bb-a7bd-49c4-baf5-f63095788532] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:59.498072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.500549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.501137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.510607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.511610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.512218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.517114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6e8903ab-1778-4803-9a8a-beacd9cad071 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:48:59.525892 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6e8903ab-1778-4803-9a8a-beacd9cad071 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1372 microversion: 2.1 time: 0.216274 Oct 05 17:48:59.527484 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1808/3866] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:59 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:48:59.565148 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] HTTP exception thrown: Instance 637528bb-a7bd-49c4-baf5-f63095788532 could not be found. Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Request method failure captured: Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 HTTP/1.1 Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcH8eciRUicO9Sc63AbUdBQWi79hl1F5-JPzcH7qdsorakIlYbJ3xWNGaQZX7x_XMEI3VWguc4Ab59wksqrwHQyfvfjfNwGyKvrvkMxgiWhEnb1wjLATXZq66MozDXHohccgtEEMtZzwt1j1KMwYhEYNjk-wzqDmXz16nazV655dStY Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f401d1367a73495598bb8a6b882e8618 Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-LiveMigrationTest-332885173 Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f401d1367a73495598bb8a6b882e8618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f401d1367a73495598bb8a6b882e8618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f401d1367a73495598bb8a6b882e8618", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f401d1367a73495598bb8a6b882e8618"}]}] Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-LiveMigrationTest-332885173 Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f401d1367a73495598bb8a6b882e8618 Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-LiveMigrationTest-332885173 Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-LiveMigrationTest-332885173-project Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 695a37f439e94d2e860e51df835827e4 Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-LiveMigrationTest-332885173-project Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 637528bb-a7bd-49c4-baf5-f63095788532 could not be found. Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '637528bb-a7bd-49c4-baf5-f63095788532'} Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 637528bb-a7bd-49c4-baf5-f63095788532 could not be found. Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 637528bb-a7bd-49c4-baf5-f63095788532 could not be found. Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:48:59.571731 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:59.575771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:48:59.575771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:48:59.575771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:48:59.575771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:48:59.575771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:48:59.575771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 637528bb-a7bd-49c4-baf5-f63095788532 could not be found. Oct 05 17:48:59.575771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:48:59.575771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Returning 404 to user: Instance 637528bb-a7bd-49c4-baf5-f63095788532 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:48:59.575771 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-354e590c-80f1-469d-8dc5-3770b28e619b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532" status: 404 len: 111 microversion: 2.1 time: 0.102273 Oct 05 17:48:59.589835 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2059/3867] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:59 2022] GET /compute/v2.1/servers/637528bb-a7bd-49c4-baf5-f63095788532 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:48:59.723666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6fb89841-9ad6-4db0-bec7-c75f51ceb346 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:59.726096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6fb89841-9ad6-4db0-bec7-c75f51ceb346 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:59.736608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fb89841-9ad6-4db0-bec7-c75f51ceb346 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.738711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fb89841-9ad6-4db0-bec7-c75f51ceb346 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.739406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fb89841-9ad6-4db0-bec7-c75f51ceb346 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.741375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fb89841-9ad6-4db0-bec7-c75f51ceb346 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.741931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fb89841-9ad6-4db0-bec7-c75f51ceb346 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.742491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fb89841-9ad6-4db0-bec7-c75f51ceb346 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.773724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6fb89841-9ad6-4db0-bec7-c75f51ceb346 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:48:59.869916 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6fb89841-9ad6-4db0-bec7-c75f51ceb346 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 204 len: 0 microversion: 2.1 time: 0.152565 Oct 05 17:48:59.874070 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1809/3868] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:48:59 2022] DELETE /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:48:59.878969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f06aa763-376c-4d31-8132-6df2af36eb29 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:59.879584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f06aa763-376c-4d31-8132-6df2af36eb29 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:59.887720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06aa763-376c-4d31-8132-6df2af36eb29 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.888221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06aa763-376c-4d31-8132-6df2af36eb29 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.888654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06aa763-376c-4d31-8132-6df2af36eb29 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.889386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06aa763-376c-4d31-8132-6df2af36eb29 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.889820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06aa763-376c-4d31-8132-6df2af36eb29 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.890240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f06aa763-376c-4d31-8132-6df2af36eb29 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.964649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d0401cc5-8ffb-40b4-a456-d3334a7aa519 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:48:59.965663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d0401cc5-8ffb-40b4-a456-d3334a7aa519 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 206610c4-627b-4680-9abc-951d50a8d378] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:48:59.978820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0401cc5-8ffb-40b4-a456-d3334a7aa519 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.987093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0401cc5-8ffb-40b4-a456-d3334a7aa519 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.989300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0401cc5-8ffb-40b4-a456-d3334a7aa519 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:48:59.991518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0401cc5-8ffb-40b4-a456-d3334a7aa519 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:48:59.992512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0401cc5-8ffb-40b4-a456-d3334a7aa519 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:48:59.994180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0401cc5-8ffb-40b4-a456-d3334a7aa519 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:00.242316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f06aa763-376c-4d31-8132-6df2af36eb29 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:00.251175 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f06aa763-376c-4d31-8132-6df2af36eb29 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1699 microversion: 2.1 time: 0.376098 Oct 05 17:49:00.266807 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2060/3869] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:59 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1699 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:00.331587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7c7fb6c-c81f-4742-9f9b-e9f90badec2e tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:00.332507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f7c7fb6c-c81f-4742-9f9b-e9f90badec2e tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:00.350003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7c7fb6c-c81f-4742-9f9b-e9f90badec2e tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:00.351404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7c7fb6c-c81f-4742-9f9b-e9f90badec2e tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:00.352032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7c7fb6c-c81f-4742-9f9b-e9f90badec2e tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:00.367771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7c7fb6c-c81f-4742-9f9b-e9f90badec2e tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:00.369060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7c7fb6c-c81f-4742-9f9b-e9f90badec2e tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:00.369708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7c7fb6c-c81f-4742-9f9b-e9f90badec2e tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:00.575584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d0401cc5-8ffb-40b4-a456-d3334a7aa519 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:00.592650 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d0401cc5-8ffb-40b4-a456-d3334a7aa519 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378" status: 200 len: 1522 microversion: 2.1 time: 0.632740 Oct 05 17:49:00.627127 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1810/3870] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:48:59 2022] GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 => generated 1522 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:00.633958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ad0c099-d64b-4b54-9401-6374a0a7d28c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:00.634570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2ad0c099-d64b-4b54-9401-6374a0a7d28c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:00.657931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad0c099-d64b-4b54-9401-6374a0a7d28c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:00.658474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad0c099-d64b-4b54-9401-6374a0a7d28c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:00.658913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad0c099-d64b-4b54-9401-6374a0a7d28c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:00.659688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad0c099-d64b-4b54-9401-6374a0a7d28c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:00.660152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad0c099-d64b-4b54-9401-6374a0a7d28c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:00.660575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad0c099-d64b-4b54-9401-6374a0a7d28c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:00.748788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f7c7fb6c-c81f-4742-9f9b-e9f90badec2e tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:00.759787 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f7c7fb6c-c81f-4742-9f9b-e9f90badec2e tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1317 microversion: 2.1 time: 0.432243 Oct 05 17:49:00.760600 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2061/3871] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:00 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:01.244674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2ad0c099-d64b-4b54-9401-6374a0a7d28c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:01.263555 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2ad0c099-d64b-4b54-9401-6374a0a7d28c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1372 microversion: 2.1 time: 0.634736 Oct 05 17:49:01.277206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48c600e1-eb31-4356-9fb4-9c650ed5001f tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:01.277404 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1811/3872] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:00 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1372 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:01.277989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-48c600e1-eb31-4356-9fb4-9c650ed5001f tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:01.291029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48c600e1-eb31-4356-9fb4-9c650ed5001f tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:01.291536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48c600e1-eb31-4356-9fb4-9c650ed5001f tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:01.291975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48c600e1-eb31-4356-9fb4-9c650ed5001f tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:01.297485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48c600e1-eb31-4356-9fb4-9c650ed5001f tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:01.301984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48c600e1-eb31-4356-9fb4-9c650ed5001f tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:01.310794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48c600e1-eb31-4356-9fb4-9c650ed5001f tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:01.318810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-46cf97fa-c119-4121-b3ea-7b4450c0ca15 req-292d4dbd-526b-4cd3-940a-2d38f57e2a3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "206610c4-627b-4680-9abc-951d50a8d378", "name": "network-vif-deleted", "tag": "63b73b65-70e7-415d-94c8-d862e9d74d7d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:01.355290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-46cf97fa-c119-4121-b3ea-7b4450c0ca15 req-292d4dbd-526b-4cd3-940a-2d38f57e2a3b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:01.355858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-46cf97fa-c119-4121-b3ea-7b4450c0ca15 req-292d4dbd-526b-4cd3-940a-2d38f57e2a3b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:01.356300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-46cf97fa-c119-4121-b3ea-7b4450c0ca15 req-292d4dbd-526b-4cd3-940a-2d38f57e2a3b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:01.402198 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-46cf97fa-c119-4121-b3ea-7b4450c0ca15 req-292d4dbd-526b-4cd3-940a-2d38f57e2a3b service nova] Creating event network-vif-deleted:63b73b65-70e7-415d-94c8-d862e9d74d7d for instance 206610c4-627b-4680-9abc-951d50a8d378 on n-h2-835595-3 Oct 05 17:49:01.427794 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-46cf97fa-c119-4121-b3ea-7b4450c0ca15 req-292d4dbd-526b-4cd3-940a-2d38f57e2a3b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109133 Oct 05 17:49:01.433338 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1812/3873] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:01.455752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b18f2bbe-06b4-41bc-8043-9efb616135f0 req-3f04951e-8328-4f01-af21-484db0826650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb32c49-9cb8-468c-b59a-0f7470ce6cf0", "name": "network-vif-plugged", "status": "completed", "tag": "ba505cb4-419d-4473-b832-b42755e1f881"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:01.477508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b18f2bbe-06b4-41bc-8043-9efb616135f0 req-3f04951e-8328-4f01-af21-484db0826650 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:01.478484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b18f2bbe-06b4-41bc-8043-9efb616135f0 req-3f04951e-8328-4f01-af21-484db0826650 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:01.479380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b18f2bbe-06b4-41bc-8043-9efb616135f0 req-3f04951e-8328-4f01-af21-484db0826650 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:01.497618 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b18f2bbe-06b4-41bc-8043-9efb616135f0 req-3f04951e-8328-4f01-af21-484db0826650 service nova] Creating event network-vif-plugged:ba505cb4-419d-4473-b832-b42755e1f881 for instance 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 on n-h1-835595-3 Oct 05 17:49:01.505368 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b18f2bbe-06b4-41bc-8043-9efb616135f0 req-3f04951e-8328-4f01-af21-484db0826650 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054100 Oct 05 17:49:01.507447 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1813/3874] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:49:01.618589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:01.619946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 206610c4-627b-4680-9abc-951d50a8d378] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:01.640470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:01.640967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:01.644135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:01.646862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:01.648108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:01.671178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:01.761447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-48c600e1-eb31-4356-9fb4-9c650ed5001f tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:01.771458 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48c600e1-eb31-4356-9fb4-9c650ed5001f tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1699 microversion: 2.1 time: 0.498261 Oct 05 17:49:01.772308 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2062/3875] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:01 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1699 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:01.798374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:01.798374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:01.801231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:01.801231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lazy-loading 'fault' on Instance uuid 206610c4-627b-4680-9abc-951d50a8d378 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:49:01.813688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8de4bf71-dc06-4cc0-9621-05748127e1d0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:01.818773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8de4bf71-dc06-4cc0-9621-05748127e1d0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:01.838308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8de4bf71-dc06-4cc0-9621-05748127e1d0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:01.840630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8de4bf71-dc06-4cc0-9621-05748127e1d0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:01.841084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8de4bf71-dc06-4cc0-9621-05748127e1d0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:01.841816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8de4bf71-dc06-4cc0-9621-05748127e1d0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:01.851820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8de4bf71-dc06-4cc0-9621-05748127e1d0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:01.853737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8de4bf71-dc06-4cc0-9621-05748127e1d0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:02.210731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8de4bf71-dc06-4cc0-9621-05748127e1d0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:02.221763 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8de4bf71-dc06-4cc0-9621-05748127e1d0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1317 microversion: 2.1 time: 0.422415 Oct 05 17:49:02.248579 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2063/3876] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:01 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:02.291844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-812b6c23-4555-4d4f-973b-6b22b49bb85e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:02.292512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-812b6c23-4555-4d4f-973b-6b22b49bb85e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:02.311251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-812b6c23-4555-4d4f-973b-6b22b49bb85e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:02.311776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-812b6c23-4555-4d4f-973b-6b22b49bb85e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:02.312226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-812b6c23-4555-4d4f-973b-6b22b49bb85e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:02.312960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-812b6c23-4555-4d4f-973b-6b22b49bb85e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:02.313419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-812b6c23-4555-4d4f-973b-6b22b49bb85e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:02.313847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-812b6c23-4555-4d4f-973b-6b22b49bb85e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:02.380770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:02.397454 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0fd3b00b-8631-47f8-b571-57e87680ed76 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378" status: 200 len: 1313 microversion: 2.1 time: 0.783663 Oct 05 17:49:02.401213 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1814/3877] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:01 2022] GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 => generated 1313 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:02.687361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-812b6c23-4555-4d4f-973b-6b22b49bb85e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:02.700445 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-812b6c23-4555-4d4f-973b-6b22b49bb85e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1372 microversion: 2.1 time: 0.410638 Oct 05 17:49:02.705105 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2064/3878] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:02 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1372 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:02.797103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a82be4b1-0f1d-47b1-88a2-8a6c315885f6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:02.797777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a82be4b1-0f1d-47b1-88a2-8a6c315885f6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:02.809847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a82be4b1-0f1d-47b1-88a2-8a6c315885f6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:02.810361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a82be4b1-0f1d-47b1-88a2-8a6c315885f6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:02.810801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a82be4b1-0f1d-47b1-88a2-8a6c315885f6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:02.811508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a82be4b1-0f1d-47b1-88a2-8a6c315885f6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:02.811961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a82be4b1-0f1d-47b1-88a2-8a6c315885f6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:02.812383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a82be4b1-0f1d-47b1-88a2-8a6c315885f6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:03.264721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-20b5b536-f551-4b12-8759-b57434b1882c tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:03.266039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-20b5b536-f551-4b12-8759-b57434b1882c tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:03.275749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b5b536-f551-4b12-8759-b57434b1882c tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:03.276573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b5b536-f551-4b12-8759-b57434b1882c tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:03.277248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b5b536-f551-4b12-8759-b57434b1882c tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:03.279215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b5b536-f551-4b12-8759-b57434b1882c tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:03.280122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b5b536-f551-4b12-8759-b57434b1882c tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:03.280777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b5b536-f551-4b12-8759-b57434b1882c tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:03.511075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a82be4b1-0f1d-47b1-88a2-8a6c315885f6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:03.523409 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a82be4b1-0f1d-47b1-88a2-8a6c315885f6 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1699 microversion: 2.1 time: 0.727502 Oct 05 17:49:03.525163 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1815/3879] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:02 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1699 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:03.535756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:03.537562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 206610c4-627b-4680-9abc-951d50a8d378] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:03.558570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:03.558570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:03.558570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:03.558879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:03.567275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:03.567959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:03.618955 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] HTTP exception thrown: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Request method failure captured: Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 HTTP/1.1 Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcNsxc8SAcwEhCqzKuKjoMdpUFxib0WLwrVL8nF_wwKasAMEyXR9A60vazVQC1ju5BhRymI_ysSp47SFEMedF2xphXHJ342pFZTGo7pKAmNNoNgS-VpBUOgGQnCOXdzysiNDDIX_4ewhJvpgRcVLyNDbFi6khuqmDdprIrllslgTNrk Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c1178176876f4a2fabc6a4ff171b0220", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}] Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 4be4313bf1134d6d9ab526b65eff8d9e Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '206610c4-627b-4680-9abc-951d50a8d378'} Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:03.620919 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:03.624995 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:03.624995 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:03.624995 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:03.624995 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:03.624995 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:03.624995 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:03.624995 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:03.624995 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:03.629624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-20b5b536-f551-4b12-8759-b57434b1882c tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:03.640573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Returning 404 to user: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:03.642107 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-20b5b536-f551-4b12-8759-b57434b1882c tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1317 microversion: 2.1 time: 0.383037 Oct 05 17:49:03.654305 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-304a236d-a250-47c4-b90d-b2c8467efb80 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378" status: 404 len: 111 microversion: 2.1 time: 0.116141 Oct 05 17:49:03.654792 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2065/3880] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:03 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:03.654915 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1816/3881] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:03 2022] GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:03.659107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-50f67a58-c445-4514-a865-3ed4fdde6e31 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:03.672429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-50f67a58-c445-4514-a865-3ed4fdde6e31 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:03.674723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-50f67a58-c445-4514-a865-3ed4fdde6e31 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c1178176876f4a2fabc6a4ff171b0220'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:49:03.687251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50f67a58-c445-4514-a865-3ed4fdde6e31 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:03.689884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50f67a58-c445-4514-a865-3ed4fdde6e31 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:03.694848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50f67a58-c445-4514-a865-3ed4fdde6e31 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:03.695969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50f67a58-c445-4514-a865-3ed4fdde6e31 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:03.696662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50f67a58-c445-4514-a865-3ed4fdde6e31 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:03.697419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50f67a58-c445-4514-a865-3ed4fdde6e31 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:03.724497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-731c1302-cbdb-446a-b00e-25825792abf2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:03.725202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-731c1302-cbdb-446a-b00e-25825792abf2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:03.742202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-731c1302-cbdb-446a-b00e-25825792abf2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:03.746014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-731c1302-cbdb-446a-b00e-25825792abf2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:03.746576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-731c1302-cbdb-446a-b00e-25825792abf2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:03.747561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-731c1302-cbdb-446a-b00e-25825792abf2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:03.748315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-731c1302-cbdb-446a-b00e-25825792abf2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:03.748953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-731c1302-cbdb-446a-b00e-25825792abf2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:03.964132 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-50f67a58-c445-4514-a865-3ed4fdde6e31 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.307809 Oct 05 17:49:03.985963 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2066/3882] 10.222.0.70 () {58 vars in 1230 bytes} [Wed Oct 5 17:49:03 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:49:04.004562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59ec1403-962a-478a-8d6b-9217345e782d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59ec1403-962a-478a-8d6b-9217345e782d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Request method failure captured: Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcNsxc8SAcwEhCqzKuKjoMdpUFxib0WLwrVL8nF_wwKasAMEyXR9A60vazVQC1ju5BhRymI_ysSp47SFEMedF2xphXHJ342pFZTGo7pKAmNNoNgS-VpBUOgGQnCOXdzysiNDDIX_4ewhJvpgRcVLyNDbFi6khuqmDdprIrllslgTNrk Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c1178176876f4a2fabc6a4ff171b0220", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}] Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4be4313bf1134d6d9ab526b65eff8d9e Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: action_args: {} Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 05 17:49:04.009944 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 05 17:49:04.013835 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.016165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59ec1403-962a-478a-8d6b-9217345e782d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:04.019495 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-59ec1403-962a-478a-8d6b-9217345e782d tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.030197 Oct 05 17:49:04.020280 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2067/3883] 10.222.0.70 () {58 vars in 1182 bytes} [Wed Oct 5 17:49:03 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:49:04.036952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.062647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:04.063542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Searching by: {'deleted': False, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:49:04.076441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.081672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.082494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.083566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.086946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.087637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.146915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:49:04.239156 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b8799ef0-bb51-4f87-81a9-c67e613d7c2e tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.209652 Oct 05 17:49:04.240011 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2068/3884] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:49:04 2022] GET /compute/v2.1/servers => generated 683 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:04.255685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.271721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:04.273858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.servers [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Removing options 'limit' from query {{(pid=128844) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 05 17:49:04.273858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Searching by: {'deleted': False, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:49:04.288409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.288934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.289358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.290107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.292307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.293345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.360128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:49:04.426146 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dab5c10e-7927-4d5a-8d5c-31c18c1bd7a8 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.177920 Oct 05 17:49:04.427518 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2069/3885] 10.222.0.70 () {58 vars in 1144 bytes} [Wed Oct 5 17:49:04 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:49:04.442116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c55f4e00-65af-44f1-b402-ae72a4c885bb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c55f4e00-65af-44f1-b402-ae72a4c885bb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Request method failure captured: Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcNsxc8SAcwEhCqzKuKjoMdpUFxib0WLwrVL8nF_wwKasAMEyXR9A60vazVQC1ju5BhRymI_ysSp47SFEMedF2xphXHJ342pFZTGo7pKAmNNoNgS-VpBUOgGQnCOXdzysiNDDIX_4ewhJvpgRcVLyNDbFi6khuqmDdprIrllslgTNrk Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c1178176876f4a2fabc6a4ff171b0220", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}] Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4be4313bf1134d6d9ab526b65eff8d9e Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: action_args: {} Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi '-1' Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 05 17:49:04.450681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.455066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c55f4e00-65af-44f1-b402-ae72a4c885bb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:04.457298 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c55f4e00-65af-44f1-b402-ae72a4c885bb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.018962 Oct 05 17:49:04.458229 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2070/3886] 10.222.0.70 () {58 vars in 1142 bytes} [Wed Oct 5 17:49:04 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 17:49:04.481651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7b278e01-e4e5-4eef-82da-ccfa4564bdfd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7b278e01-e4e5-4eef-82da-ccfa4564bdfd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Request method failure captured: Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcNsxc8SAcwEhCqzKuKjoMdpUFxib0WLwrVL8nF_wwKasAMEyXR9A60vazVQC1ju5BhRymI_ysSp47SFEMedF2xphXHJ342pFZTGo7pKAmNNoNgS-VpBUOgGQnCOXdzysiNDDIX_4ewhJvpgRcVLyNDbFi6khuqmDdprIrllslgTNrk Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c1178176876f4a2fabc6a4ff171b0220", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}] Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4be4313bf1134d6d9ab526b65eff8d9e Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: action_args: {} Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'testing' Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 05 17:49:04.491585 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7b278e01-e4e5-4eef-82da-ccfa4564bdfd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:04.495855 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7b278e01-e4e5-4eef-82da-ccfa4564bdfd tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016277 Oct 05 17:49:04.497111 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2071/3887] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:49:04 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 17:49:04.507646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-731c1302-cbdb-446a-b00e-25825792abf2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:04.512213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7cf428c4-4145-483c-8fdd-047685f99406 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.520998 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-731c1302-cbdb-446a-b00e-25825792abf2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1372 microversion: 2.1 time: 0.800327 Oct 05 17:49:04.534302 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1817/3888] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:03 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1372 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:04.534560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7cf428c4-4145-483c-8fdd-047685f99406 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:04.534560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7cf428c4-4145-483c-8fdd-047685f99406 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:49:04.541214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.servers [None req-7cf428c4-4145-483c-8fdd-047685f99406 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Flavor 'non_existing_flavor' could not be found {{(pid=128844) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 05 17:49:04.542340 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7cf428c4-4145-483c-8fdd-047685f99406 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.039814 Oct 05 17:49:04.543292 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2072/3889] 10.222.0.70 () {58 vars in 1178 bytes} [Wed Oct 5 17:49:04 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 17:49:04.555952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-79c2dbe5-ef55-4c16-a89a-1d7fa6360a9b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.564948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-68371fd7-9df8-4811-bf03-34cb40e46c3c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.565572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-68371fd7-9df8-4811-bf03-34cb40e46c3c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:04.568933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-79c2dbe5-ef55-4c16-a89a-1d7fa6360a9b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:04.569702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-79c2dbe5-ef55-4c16-a89a-1d7fa6360a9b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:49:04.577659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79c2dbe5-ef55-4c16-a89a-1d7fa6360a9b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.578403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79c2dbe5-ef55-4c16-a89a-1d7fa6360a9b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.579007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79c2dbe5-ef55-4c16-a89a-1d7fa6360a9b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.580237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79c2dbe5-ef55-4c16-a89a-1d7fa6360a9b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.580830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79c2dbe5-ef55-4c16-a89a-1d7fa6360a9b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.581441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79c2dbe5-ef55-4c16-a89a-1d7fa6360a9b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.594986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68371fd7-9df8-4811-bf03-34cb40e46c3c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.595502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68371fd7-9df8-4811-bf03-34cb40e46c3c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.595948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68371fd7-9df8-4811-bf03-34cb40e46c3c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.596673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68371fd7-9df8-4811-bf03-34cb40e46c3c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.597193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68371fd7-9df8-4811-bf03-34cb40e46c3c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.597621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68371fd7-9df8-4811-bf03-34cb40e46c3c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.709030 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-79c2dbe5-ef55-4c16-a89a-1d7fa6360a9b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.157008 Oct 05 17:49:04.710213 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1818/3890] 10.222.0.70 () {58 vars in 1174 bytes} [Wed Oct 5 17:49:04 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:49:04.715125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-077de56f-b872-445d-b1a7-796a52ac4989 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.715944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-077de56f-b872-445d-b1a7-796a52ac4989 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:04.720828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-68371fd7-9df8-4811-bf03-34cb40e46c3c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6829df0c89ba4284beeca7e2123cec90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a73261c41f4c4ccfa7a47c2ad99b7148', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:04.723507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-077de56f-b872-445d-b1a7-796a52ac4989 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.724148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-077de56f-b872-445d-b1a7-796a52ac4989 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.724746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-077de56f-b872-445d-b1a7-796a52ac4989 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.725603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-077de56f-b872-445d-b1a7-796a52ac4989 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.726243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-077de56f-b872-445d-b1a7-796a52ac4989 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.726858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-077de56f-b872-445d-b1a7-796a52ac4989 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.741855 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-68371fd7-9df8-4811-bf03-34cb40e46c3c tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 200 len: 1632 microversion: 2.1 time: 0.179647 Oct 05 17:49:04.743695 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2073/3891] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:04 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 1632 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:04.753575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c8a6337-0363-4666-89f8-18260b75d4bc tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.759124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5c8a6337-0363-4666-89f8-18260b75d4bc tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:04.760145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5c8a6337-0363-4666-89f8-18260b75d4bc tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:49:04.767336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c8a6337-0363-4666-89f8-18260b75d4bc tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.767947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c8a6337-0363-4666-89f8-18260b75d4bc tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.768480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c8a6337-0363-4666-89f8-18260b75d4bc tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.769337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c8a6337-0363-4666-89f8-18260b75d4bc tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.770635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c8a6337-0363-4666-89f8-18260b75d4bc tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.771795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c8a6337-0363-4666-89f8-18260b75d4bc tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.918169 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c8a6337-0363-4666-89f8-18260b75d4bc tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.172839 Oct 05 17:49:04.927456 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2074/3892] 10.222.0.70 () {58 vars in 1184 bytes} [Wed Oct 5 17:49:04 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:49:04.936421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:04.949083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:04.949733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Searching by: {'deleted': False, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:49:04.970495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.970495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.970495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:04.970495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:04.975316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:04.975787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.035918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:49:05.111900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:05.123776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.123776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.124228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.138194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-077de56f-b872-445d-b1a7-796a52ac4989 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:05.150623 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-077de56f-b872-445d-b1a7-796a52ac4989 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1505 microversion: 2.1 time: 0.439098 Oct 05 17:49:05.153762 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1819/3893] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:04 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1505 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:05.184001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6aa78ff5-6a25-4afe-a1f1-b866c6f92c95 req-8ca505db-f5e4-4a4e-bab7-5d26b18c29f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d56495f4-d64f-4905-9eb3-7708c6dd238a", "name": "network-vif-deleted", "tag": "7735bafa-0319-445b-9b1a-e61ec36d4797"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:05.209129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6aa78ff5-6a25-4afe-a1f1-b866c6f92c95 req-8ca505db-f5e4-4a4e-bab7-5d26b18c29f9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.209982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6aa78ff5-6a25-4afe-a1f1-b866c6f92c95 req-8ca505db-f5e4-4a4e-bab7-5d26b18c29f9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.215626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6aa78ff5-6a25-4afe-a1f1-b866c6f92c95 req-8ca505db-f5e4-4a4e-bab7-5d26b18c29f9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.221042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:05.247644 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6aa78ff5-6a25-4afe-a1f1-b866c6f92c95 req-8ca505db-f5e4-4a4e-bab7-5d26b18c29f9 service nova] Creating event network-vif-deleted:7735bafa-0319-445b-9b1a-e61ec36d4797 for instance d56495f4-d64f-4905-9eb3-7708c6dd238a on n-h1-835595-3 Oct 05 17:49:05.264690 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6aa78ff5-6a25-4afe-a1f1-b866c6f92c95 req-8ca505db-f5e4-4a4e-bab7-5d26b18c29f9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085964 Oct 05 17:49:05.265386 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1820/3894] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:05.280879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-db0a04c7-fbdd-4774-908a-a7afa8a29954 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:05.281526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-db0a04c7-fbdd-4774-908a-a7afa8a29954 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:05.300551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db0a04c7-fbdd-4774-908a-a7afa8a29954 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.301927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db0a04c7-fbdd-4774-908a-a7afa8a29954 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.302449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db0a04c7-fbdd-4774-908a-a7afa8a29954 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.303199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db0a04c7-fbdd-4774-908a-a7afa8a29954 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.303732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db0a04c7-fbdd-4774-908a-a7afa8a29954 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.304163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db0a04c7-fbdd-4774-908a-a7afa8a29954 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.386452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-db0a04c7-fbdd-4774-908a-a7afa8a29954 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:05.393856 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-db0a04c7-fbdd-4774-908a-a7afa8a29954 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0/os-instance-actions/req-ea325c0d-8897-4535-8438-703370fbc2a2" status: 200 len: 313 microversion: 2.1 time: 0.126638 Oct 05 17:49:05.405418 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1821/3895] 10.222.0.70 () {58 vars in 1419 bytes} [Wed Oct 5 17:49:05 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0/os-instance-actions/req-ea325c0d-8897-4535-8438-703370fbc2a2 => generated 313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:05.417800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4df6c2b7-a63a-4161-bfde-a34860d22211 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:05.419376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4df6c2b7-a63a-4161-bfde-a34860d22211 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:05.435012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4df6c2b7-a63a-4161-bfde-a34860d22211 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.435514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4df6c2b7-a63a-4161-bfde-a34860d22211 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.435948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4df6c2b7-a63a-4161-bfde-a34860d22211 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.436661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4df6c2b7-a63a-4161-bfde-a34860d22211 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.437116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4df6c2b7-a63a-4161-bfde-a34860d22211 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.437545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4df6c2b7-a63a-4161-bfde-a34860d22211 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.507123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4df6c2b7-a63a-4161-bfde-a34860d22211 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:49:05.571743 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ad63edb6-a2e5-45fe-8a63-3335aabf3d83 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 3027 microversion: 2.1 time: 0.639991 Oct 05 17:49:05.573098 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2075/3896] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:49:04 2022] GET /compute/v2.1/servers/detail => generated 3027 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:05.579189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-65910a9d-b4d5-470f-a846-75e57e11fe33 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:05.583622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-65910a9d-b4d5-470f-a846-75e57e11fe33 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:05.596154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65910a9d-b4d5-470f-a846-75e57e11fe33 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.597293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65910a9d-b4d5-470f-a846-75e57e11fe33 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.598086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65910a9d-b4d5-470f-a846-75e57e11fe33 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.599042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65910a9d-b4d5-470f-a846-75e57e11fe33 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.599765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65910a9d-b4d5-470f-a846-75e57e11fe33 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.600402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65910a9d-b4d5-470f-a846-75e57e11fe33 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.698593 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4df6c2b7-a63a-4161-bfde-a34860d22211 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 204 len: 0 microversion: 2.1 time: 0.284925 Oct 05 17:49:05.699850 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1822/3897] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:49:05 2022] DELETE /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:49:05.712982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d02977dd-8010-4d66-918a-7eb1703d2882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:05.716221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d02977dd-8010-4d66-918a-7eb1703d2882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:05.724493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:05.732660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02977dd-8010-4d66-918a-7eb1703d2882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.733179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02977dd-8010-4d66-918a-7eb1703d2882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.737059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02977dd-8010-4d66-918a-7eb1703d2882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.739116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02977dd-8010-4d66-918a-7eb1703d2882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.740820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02977dd-8010-4d66-918a-7eb1703d2882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.741554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02977dd-8010-4d66-918a-7eb1703d2882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.775932 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-65910a9d-b4d5-470f-a846-75e57e11fe33 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "POST /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0/action" status: 202 len: 0 microversion: 2.1 time: 0.199243 Oct 05 17:49:05.778905 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2076/3898] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:49:05 2022] POST /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:49:05.798051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd1c925b-45c3-469e-8a4f-3d021fcf31cb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:05.820276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd1c925b-45c3-469e-8a4f-3d021fcf31cb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:05.834803 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd1c925b-45c3-469e-8a4f-3d021fcf31cb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.054658 Oct 05 17:49:05.842623 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2077/3899] 10.222.0.70 () {58 vars in 1178 bytes} [Wed Oct 5 17:49:05 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:49:05.860136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b684d8fa-b87f-408f-aa69-3243aaa723ee tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:05.869856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b684d8fa-b87f-408f-aa69-3243aaa723ee tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:05.896396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b684d8fa-b87f-408f-aa69-3243aaa723ee tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.896897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b684d8fa-b87f-408f-aa69-3243aaa723ee tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.900605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b684d8fa-b87f-408f-aa69-3243aaa723ee tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:05.906305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b684d8fa-b87f-408f-aa69-3243aaa723ee tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:05.907075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b684d8fa-b87f-408f-aa69-3243aaa723ee tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:05.907953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b684d8fa-b87f-408f-aa69-3243aaa723ee tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.265642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d02977dd-8010-4d66-918a-7eb1703d2882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:06.279283 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d02977dd-8010-4d66-918a-7eb1703d2882 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1372 microversion: 2.1 time: 0.576786 Oct 05 17:49:06.281346 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1823/3900] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:05 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1372 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:06.304889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:06.312472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] [instance: d56495f4-d64f-4905-9eb3-7708c6dd238a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:06.326217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.328285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.328747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.329490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.329958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.332000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.365824 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] HTTP exception thrown: Instance d56495f4-d64f-4905-9eb3-7708c6dd238a could not be found. Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Request method failure captured: Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a HTTP/1.1 Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcNGyq-4wKyRMY76mbhzrgVwgYRlvDmTmtWz_VA1FTcC3X_GEz8sVQnCSTfSmlmjq3IO81Hf2xYk9VFr6ME1H661e4O-v3kaK95x1shyITjiFCo6C5p82ANMI1WcCt7MCuwIAxsIIIwy_xZEzeg-qbgcuAeduydmTl8qYI79BF0WHkI Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: a73261c41f4c4ccfa7a47c2ad99b7148 Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-1484940605 Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a73261c41f4c4ccfa7a47c2ad99b7148"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a73261c41f4c4ccfa7a47c2ad99b7148"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a73261c41f4c4ccfa7a47c2ad99b7148", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a73261c41f4c4ccfa7a47c2ad99b7148"}]}] Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-1484940605 Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: a73261c41f4c4ccfa7a47c2ad99b7148 Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-1484940605 Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-1484940605-project Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6829df0c89ba4284beeca7e2123cec90 Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-1484940605-project Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance d56495f4-d64f-4905-9eb3-7708c6dd238a could not be found. Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'd56495f4-d64f-4905-9eb3-7708c6dd238a'} Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d56495f4-d64f-4905-9eb3-7708c6dd238a could not be found. Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d56495f4-d64f-4905-9eb3-7708c6dd238a could not be found. Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:06.370183 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:06.373638 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:06.373638 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:06.373638 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:06.373638 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:06.373638 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:06.373638 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d56495f4-d64f-4905-9eb3-7708c6dd238a could not be found. Oct 05 17:49:06.373638 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:06.373638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Returning 404 to user: Instance d56495f4-d64f-4905-9eb3-7708c6dd238a could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:06.373638 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6aae4f01-2c47-40ef-8573-491b888ae885 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a" status: 404 len: 111 microversion: 2.1 time: 0.089572 Oct 05 17:49:06.374137 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1824/3901] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:06 2022] GET /compute/v2.1/servers/d56495f4-d64f-4905-9eb3-7708c6dd238a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:06.387107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ee080e5e-9422-4aa9-9e8f-aa95b9217c39 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:06.387731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ee080e5e-9422-4aa9-9e8f-aa95b9217c39 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:06.394961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee080e5e-9422-4aa9-9e8f-aa95b9217c39 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.395722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee080e5e-9422-4aa9-9e8f-aa95b9217c39 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.396159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee080e5e-9422-4aa9-9e8f-aa95b9217c39 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.396959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee080e5e-9422-4aa9-9e8f-aa95b9217c39 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.397406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee080e5e-9422-4aa9-9e8f-aa95b9217c39 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.397826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee080e5e-9422-4aa9-9e8f-aa95b9217c39 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.427342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b684d8fa-b87f-408f-aa69-3243aaa723ee tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:06.439909 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b684d8fa-b87f-408f-aa69-3243aaa723ee tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1667 microversion: 2.1 time: 0.592228 Oct 05 17:49:06.440939 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2078/3902] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:05 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1667 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:06.451641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:06.472096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:06.473438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Searching by: {'deleted': False, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:49:06.486994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.487538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.488816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.489612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.490072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.490524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.560108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:49:06.643216 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-36ca6961-daaa-44bd-b4b4-e302afe94818 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.196056 Oct 05 17:49:06.647531 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2079/3903] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:49:06 2022] GET /compute/v2.1/servers => generated 683 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:06.665500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-850b6653-33eb-41d7-9dc8-29ce0a1c80a3 req-bb63366e-2cff-45b7-be69-d6ba7c7cf49d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "306c41c5-0f1e-4812-a54d-c31fc031c7d1", "name": "network-vif-plugged", "status": "completed", "tag": "371d802d-9093-4be5-860b-4f96eed3c8f9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:06.696875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-850b6653-33eb-41d7-9dc8-29ce0a1c80a3 req-bb63366e-2cff-45b7-be69-d6ba7c7cf49d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.699180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-850b6653-33eb-41d7-9dc8-29ce0a1c80a3 req-bb63366e-2cff-45b7-be69-d6ba7c7cf49d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.702015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-850b6653-33eb-41d7-9dc8-29ce0a1c80a3 req-bb63366e-2cff-45b7-be69-d6ba7c7cf49d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.727294 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-850b6653-33eb-41d7-9dc8-29ce0a1c80a3 req-bb63366e-2cff-45b7-be69-d6ba7c7cf49d service nova] Creating event network-vif-plugged:371d802d-9093-4be5-860b-4f96eed3c8f9 for instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 on n-h2-835595-3 Oct 05 17:49:06.733714 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-850b6653-33eb-41d7-9dc8-29ce0a1c80a3 req-bb63366e-2cff-45b7-be69-d6ba7c7cf49d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084793 Oct 05 17:49:06.735108 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2080/3904] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:06.748377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-037fbe55-61b0-405f-8ee1-c162bb62fd71 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] Calling method '.version_select at 0x7f7775394820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:06.789995 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-037fbe55-61b0-405f-8ee1-c162bb62fd71 tempest-ServersTestJSON-1484940605 tempest-ServersTestJSON-1484940605-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-599424512" status: 202 len: 0 microversion: 2.1 time: 0.043303 Oct 05 17:49:06.797266 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2081/3905] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 17:49:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-599424512 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:49:06.811309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:06.812341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 206610c4-627b-4680-9abc-951d50a8d378] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:06.833081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:06.834965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.835501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.835889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.836903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.837369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.837798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.865353 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] HTTP exception thrown: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Request method failure captured: Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 HTTP/1.1 Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcNsxc8SAcwEhCqzKuKjoMdpUFxib0WLwrVL8nF_wwKasAMEyXR9A60vazVQC1ju5BhRymI_ysSp47SFEMedF2xphXHJ342pFZTGo7pKAmNNoNgS-VpBUOgGQnCOXdzysiNDDIX_4ewhJvpgRcVLyNDbFi6khuqmDdprIrllslgTNrk Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c1178176876f4a2fabc6a4ff171b0220", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}] Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4be4313bf1134d6d9ab526b65eff8d9e Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '206610c4-627b-4680-9abc-951d50a8d378'} Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:06.867374 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Returning 404 to user: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-52e7d7bb-bba4-4380-b04a-3e97ccd3811b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378" status: 404 len: 111 microversion: 2.1 time: 0.065018 Oct 05 17:49:06.871455 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2082/3906] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:49:06 2022] DELETE /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:06.878236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4152092d-bdf2-49ce-a1c8-e47eaf5efaeb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:06.878925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4152092d-bdf2-49ce-a1c8-e47eaf5efaeb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 261b171b-1e5e-4ad4-88be-c38767238817] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:06.885264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4152092d-bdf2-49ce-a1c8-e47eaf5efaeb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.885759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4152092d-bdf2-49ce-a1c8-e47eaf5efaeb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.886199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4152092d-bdf2-49ce-a1c8-e47eaf5efaeb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.886935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4152092d-bdf2-49ce-a1c8-e47eaf5efaeb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:06.887391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4152092d-bdf2-49ce-a1c8-e47eaf5efaeb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:06.887818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4152092d-bdf2-49ce-a1c8-e47eaf5efaeb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:06.963696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4152092d-bdf2-49ce-a1c8-e47eaf5efaeb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 261b171b-1e5e-4ad4-88be-c38767238817] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:49:07.122005 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4152092d-bdf2-49ce-a1c8-e47eaf5efaeb tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817" status: 204 len: 0 microversion: 2.1 time: 0.247799 Oct 05 17:49:07.123067 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2083/3907] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:49:06 2022] DELETE /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:49:07.133349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-75d6887d-c049-4922-9410-347e647c5514 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:07.137317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-75d6887d-c049-4922-9410-347e647c5514 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:07.153331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d6887d-c049-4922-9410-347e647c5514 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:07.153834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d6887d-c049-4922-9410-347e647c5514 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:07.154272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d6887d-c049-4922-9410-347e647c5514 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:07.155046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d6887d-c049-4922-9410-347e647c5514 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:07.155499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d6887d-c049-4922-9410-347e647c5514 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:07.155920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d6887d-c049-4922-9410-347e647c5514 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:07.218611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-75d6887d-c049-4922-9410-347e647c5514 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:49:07.238889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ee080e5e-9422-4aa9-9e8f-aa95b9217c39 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:07.251963 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ee080e5e-9422-4aa9-9e8f-aa95b9217c39 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1507 microversion: 2.1 time: 0.876906 Oct 05 17:49:07.252565 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1825/3908] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:06 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1507 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:07.303521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8531d81-afdd-41f6-9886-02bf5cd74fbf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:07.304401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8531d81-afdd-41f6-9886-02bf5cd74fbf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:07.316003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8531d81-afdd-41f6-9886-02bf5cd74fbf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:07.316499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8531d81-afdd-41f6-9886-02bf5cd74fbf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:07.316935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8531d81-afdd-41f6-9886-02bf5cd74fbf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:07.317655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8531d81-afdd-41f6-9886-02bf5cd74fbf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:07.318110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8531d81-afdd-41f6-9886-02bf5cd74fbf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:07.318565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8531d81-afdd-41f6-9886-02bf5cd74fbf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:07.378724 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-75d6887d-c049-4922-9410-347e647c5514 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "DELETE /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 204 len: 0 microversion: 2.1 time: 0.251205 Oct 05 17:49:07.379648 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2084/3909] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:49:07 2022] DELETE /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:49:07.391507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:07.393001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 206610c4-627b-4680-9abc-951d50a8d378] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:07.402591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:07.403426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:07.405179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:07.406475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:07.407905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:07.408408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:07.426944 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] HTTP exception thrown: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Request method failure captured: Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 HTTP/1.1 Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcNsxc8SAcwEhCqzKuKjoMdpUFxib0WLwrVL8nF_wwKasAMEyXR9A60vazVQC1ju5BhRymI_ysSp47SFEMedF2xphXHJ342pFZTGo7pKAmNNoNgS-VpBUOgGQnCOXdzysiNDDIX_4ewhJvpgRcVLyNDbFi6khuqmDdprIrllslgTNrk Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c1178176876f4a2fabc6a4ff171b0220", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}] Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4be4313bf1134d6d9ab526b65eff8d9e Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '206610c4-627b-4680-9abc-951d50a8d378'} Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:07.428950 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:07.432763 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:07.432763 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:07.432763 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:07.432763 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:07.432763 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:07.432763 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:07.432763 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. Oct 05 17:49:07.432763 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:07.432763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Returning 404 to user: Instance 206610c4-627b-4680-9abc-951d50a8d378 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:07.432763 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-acc55044-818f-422d-8131-ddea6860672b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378" status: 404 len: 111 microversion: 2.1 time: 0.046518 Oct 05 17:49:07.433404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2085/3910] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:07 2022] GET /compute/v2.1/servers/206610c4-627b-4680-9abc-951d50a8d378 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:07.446730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76031a92-bf39-41c7-8600-33a10ad74936 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:07.450828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-76031a92-bf39-41c7-8600-33a10ad74936 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 261b171b-1e5e-4ad4-88be-c38767238817] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:07.466995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76031a92-bf39-41c7-8600-33a10ad74936 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:07.468227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76031a92-bf39-41c7-8600-33a10ad74936 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:07.469224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76031a92-bf39-41c7-8600-33a10ad74936 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:07.471473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76031a92-bf39-41c7-8600-33a10ad74936 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:07.475636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76031a92-bf39-41c7-8600-33a10ad74936 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:07.476122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76031a92-bf39-41c7-8600-33a10ad74936 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:07.749486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b8531d81-afdd-41f6-9886-02bf5cd74fbf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:07.761472 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8531d81-afdd-41f6-9886-02bf5cd74fbf tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1372 microversion: 2.1 time: 0.461769 Oct 05 17:49:07.775514 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1826/3911] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:07 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1372 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:07.788070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41a05368-b703-4245-bb2d-ae237d2a6178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:07.788942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-41a05368-b703-4245-bb2d-ae237d2a6178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:07.798722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a05368-b703-4245-bb2d-ae237d2a6178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:07.800576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a05368-b703-4245-bb2d-ae237d2a6178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:07.804616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a05368-b703-4245-bb2d-ae237d2a6178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:07.804616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a05368-b703-4245-bb2d-ae237d2a6178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:07.804616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a05368-b703-4245-bb2d-ae237d2a6178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:07.804616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41a05368-b703-4245-bb2d-ae237d2a6178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:07.864441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76031a92-bf39-41c7-8600-33a10ad74936 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:07.875568 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76031a92-bf39-41c7-8600-33a10ad74936 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817" status: 200 len: 1523 microversion: 2.1 time: 0.435825 Oct 05 17:49:07.891193 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2086/3912] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:07 2022] GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817 => generated 1523 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:08.199312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-41a05368-b703-4245-bb2d-ae237d2a6178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:08.211297 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-41a05368-b703-4245-bb2d-ae237d2a6178 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1667 microversion: 2.1 time: 0.434343 Oct 05 17:49:08.212407 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1827/3913] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:07 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1667 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:08.280579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-adf7f3ca-0805-478f-ba11-30777a520561 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:08.281198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-adf7f3ca-0805-478f-ba11-30777a520561 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:08.288676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adf7f3ca-0805-478f-ba11-30777a520561 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:08.289179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adf7f3ca-0805-478f-ba11-30777a520561 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:08.289664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adf7f3ca-0805-478f-ba11-30777a520561 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:08.290542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adf7f3ca-0805-478f-ba11-30777a520561 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:08.291017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adf7f3ca-0805-478f-ba11-30777a520561 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:08.291433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-adf7f3ca-0805-478f-ba11-30777a520561 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:08.570544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-adf7f3ca-0805-478f-ba11-30777a520561 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:08.593203 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-adf7f3ca-0805-478f-ba11-30777a520561 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1507 microversion: 2.1 time: 0.306885 Oct 05 17:49:08.593710 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2087/3914] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:08 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:08.788381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f4f1fc54-897d-43c1-ac8e-55ce553026c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:08.788984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f4f1fc54-897d-43c1-ac8e-55ce553026c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:08.810651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4f1fc54-897d-43c1-ac8e-55ce553026c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:08.812928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4f1fc54-897d-43c1-ac8e-55ce553026c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:08.814157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4f1fc54-897d-43c1-ac8e-55ce553026c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:08.815226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4f1fc54-897d-43c1-ac8e-55ce553026c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:08.816056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4f1fc54-897d-43c1-ac8e-55ce553026c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:08.816687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4f1fc54-897d-43c1-ac8e-55ce553026c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:08.904006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fa49bef0-a1e3-47b4-8a68-b87f1b79a7a2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:08.904709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fa49bef0-a1e3-47b4-8a68-b87f1b79a7a2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 261b171b-1e5e-4ad4-88be-c38767238817] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:08.914982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa49bef0-a1e3-47b4-8a68-b87f1b79a7a2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:08.915485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa49bef0-a1e3-47b4-8a68-b87f1b79a7a2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:08.915927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa49bef0-a1e3-47b4-8a68-b87f1b79a7a2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:08.916650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa49bef0-a1e3-47b4-8a68-b87f1b79a7a2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:08.917213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa49bef0-a1e3-47b4-8a68-b87f1b79a7a2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:08.917643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa49bef0-a1e3-47b4-8a68-b87f1b79a7a2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:09.231125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fa49bef0-a1e3-47b4-8a68-b87f1b79a7a2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:09.240718 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fa49bef0-a1e3-47b4-8a68-b87f1b79a7a2 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817" status: 200 len: 1523 microversion: 2.1 time: 0.341288 Oct 05 17:49:09.255306 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2088/3915] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:08 2022] GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817 => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:09.263073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b777a4dc-7d69-4fc2-9cd9-4c0bffd489bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:09.264092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b777a4dc-7d69-4fc2-9cd9-4c0bffd489bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:09.273418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b777a4dc-7d69-4fc2-9cd9-4c0bffd489bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:09.277577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f4f1fc54-897d-43c1-ac8e-55ce553026c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:09.285686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b777a4dc-7d69-4fc2-9cd9-4c0bffd489bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:09.286999 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f4f1fc54-897d-43c1-ac8e-55ce553026c5 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1372 microversion: 2.1 time: 0.502523 Oct 05 17:49:09.287638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b777a4dc-7d69-4fc2-9cd9-4c0bffd489bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:09.288615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b777a4dc-7d69-4fc2-9cd9-4c0bffd489bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:09.289469 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1828/3916] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:08 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1372 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:09.290175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b777a4dc-7d69-4fc2-9cd9-4c0bffd489bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:09.306107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b777a4dc-7d69-4fc2-9cd9-4c0bffd489bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:09.581121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3d8b7755-853d-4d77-b3b3-3b2166513e19 req-33c6ced5-1cce-4082-88e9-c5f1a8c3d2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "861d19af-3969-47e3-9887-e20a02de197f", "name": "network-vif-deleted", "tag": "c398e3dd-834e-4b62-9832-e96be5cc76ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:09.629655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3d8b7755-853d-4d77-b3b3-3b2166513e19 req-33c6ced5-1cce-4082-88e9-c5f1a8c3d2a5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:09.641497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3d8b7755-853d-4d77-b3b3-3b2166513e19 req-33c6ced5-1cce-4082-88e9-c5f1a8c3d2a5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:09.643978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3d8b7755-853d-4d77-b3b3-3b2166513e19 req-33c6ced5-1cce-4082-88e9-c5f1a8c3d2a5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:09.704465 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3d8b7755-853d-4d77-b3b3-3b2166513e19 req-33c6ced5-1cce-4082-88e9-c5f1a8c3d2a5 service nova] Creating event network-vif-deleted:c398e3dd-834e-4b62-9832-e96be5cc76ef for instance 861d19af-3969-47e3-9887-e20a02de197f on n-h2-835595-3 Oct 05 17:49:09.718146 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3d8b7755-853d-4d77-b3b3-3b2166513e19 req-33c6ced5-1cce-4082-88e9-c5f1a8c3d2a5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141702 Oct 05 17:49:09.726813 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1829/3917] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:09.748263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c8ff151-74c5-46d9-9b7b-5a8671047d77 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:09.751086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c8ff151-74c5-46d9-9b7b-5a8671047d77 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:09.792167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8ff151-74c5-46d9-9b7b-5a8671047d77 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:09.792906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8ff151-74c5-46d9-9b7b-5a8671047d77 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:09.798616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8ff151-74c5-46d9-9b7b-5a8671047d77 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:09.800704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8ff151-74c5-46d9-9b7b-5a8671047d77 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:09.808960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8ff151-74c5-46d9-9b7b-5a8671047d77 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:09.809307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c8ff151-74c5-46d9-9b7b-5a8671047d77 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.226269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6c8ff151-74c5-46d9-9b7b-5a8671047d77 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:10.241093 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c8ff151-74c5-46d9-9b7b-5a8671047d77 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1505 microversion: 2.1 time: 0.510904 Oct 05 17:49:10.242587 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1830/3918] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:09 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1505 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:10.248849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b17e7d6-676e-4be9-9f6d-040cd869f223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:10.251318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5b17e7d6-676e-4be9-9f6d-040cd869f223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:10.258112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:10.259875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b17e7d6-676e-4be9-9f6d-040cd869f223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.260629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b17e7d6-676e-4be9-9f6d-040cd869f223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.261528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b17e7d6-676e-4be9-9f6d-040cd869f223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.262520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b17e7d6-676e-4be9-9f6d-040cd869f223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.263635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b17e7d6-676e-4be9-9f6d-040cd869f223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.264613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b17e7d6-676e-4be9-9f6d-040cd869f223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.303596 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b17e7d6-676e-4be9-9f6d-040cd869f223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059392 Oct 05 17:49:10.304894 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1831/3919] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:49:10 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:49:10.309801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:10.322965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 261b171b-1e5e-4ad4-88be-c38767238817] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:10.337968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b777a4dc-7d69-4fc2-9cd9-4c0bffd489bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:10.340043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.340764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.343496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.344493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.346323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.346783 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b777a4dc-7d69-4fc2-9cd9-4c0bffd489bf tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 200 len: 1600 microversion: 2.1 time: 1.090050 Oct 05 17:49:10.347439 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2089/3920] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:09 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 1600 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:10.349867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.363234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-679a8cf3-8611-4057-af6b-6d84e5d029b1 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '.version_select at 0x7f77747ccdc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:10.367178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-679a8cf3-8611-4057-af6b-6d84e5d029b1 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:10.377720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-679a8cf3-8611-4057-af6b-6d84e5d029b1 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.382584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-679a8cf3-8611-4057-af6b-6d84e5d029b1 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.385824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-679a8cf3-8611-4057-af6b-6d84e5d029b1 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.386797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-679a8cf3-8611-4057-af6b-6d84e5d029b1 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.387505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-679a8cf3-8611-4057-af6b-6d84e5d029b1 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.388126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-679a8cf3-8611-4057-af6b-6d84e5d029b1 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.449800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.452604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.456250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.457026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lazy-loading 'fault' on Instance uuid 261b171b-1e5e-4ad4-88be-c38767238817 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:49:10.488867 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-679a8cf3-8611-4057-af6b-6d84e5d029b1 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.135985 Oct 05 17:49:10.498746 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2090/3921] 10.222.0.70 () {58 vars in 1296 bytes} [Wed Oct 5 17:49:10 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0/os-instance-actions => generated 611 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:10.506048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cc1b6ab7-a194-46a9-b7f6-545500f3de29 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:10.510199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cc1b6ab7-a194-46a9-b7f6-545500f3de29 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:10.522331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ab7-a194-46a9-b7f6-545500f3de29 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.528105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ab7-a194-46a9-b7f6-545500f3de29 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.528748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ab7-a194-46a9-b7f6-545500f3de29 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.529779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ab7-a194-46a9-b7f6-545500f3de29 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.530420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ab7-a194-46a9-b7f6-545500f3de29 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.530999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc1b6ab7-a194-46a9-b7f6-545500f3de29 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.536985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:10.548492 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-039b5af1-6b18-4f29-9de1-63b0f943441b tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817" status: 200 len: 1313 microversion: 2.1 time: 0.242186 Oct 05 17:49:10.566476 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1832/3922] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:10 2022] GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:10.577177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b68d2461-0b20-4082-a087-2db4af791295 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:10.586721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b68d2461-0b20-4082-a087-2db4af791295 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:10.592823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68d2461-0b20-4082-a087-2db4af791295 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.593317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68d2461-0b20-4082-a087-2db4af791295 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.593743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68d2461-0b20-4082-a087-2db4af791295 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.594493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68d2461-0b20-4082-a087-2db4af791295 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.594940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68d2461-0b20-4082-a087-2db4af791295 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.595359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68d2461-0b20-4082-a087-2db4af791295 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.650409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b68d2461-0b20-4082-a087-2db4af791295 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:49:10.821606 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b68d2461-0b20-4082-a087-2db4af791295 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 204 len: 0 microversion: 2.1 time: 0.253106 Oct 05 17:49:10.825591 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1833/3923] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:49:10 2022] DELETE /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:49:10.831006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-830cc3c9-306e-4f4f-9a9f-6c6581380ad9 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:10.831662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-830cc3c9-306e-4f4f-9a9f-6c6581380ad9 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:10.848805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830cc3c9-306e-4f4f-9a9f-6c6581380ad9 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.849305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830cc3c9-306e-4f4f-9a9f-6c6581380ad9 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.849812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830cc3c9-306e-4f4f-9a9f-6c6581380ad9 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.850813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830cc3c9-306e-4f4f-9a9f-6c6581380ad9 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:10.851340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830cc3c9-306e-4f4f-9a9f-6c6581380ad9 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:10.851829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830cc3c9-306e-4f4f-9a9f-6c6581380ad9 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:10.893257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-830cc3c9-306e-4f4f-9a9f-6c6581380ad9 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:49:10.916493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:10.999630 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-830cc3c9-306e-4f4f-9a9f-6c6581380ad9 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 204 len: 0 microversion: 2.1 time: 0.172368 Oct 05 17:49:11.000486 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1834/3924] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:49:10 2022] DELETE /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:49:11.007030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f071e9a9-9179-4de0-bde8-fc4271e5500d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:11.007848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f071e9a9-9179-4de0-bde8-fc4271e5500d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:11.015147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f071e9a9-9179-4de0-bde8-fc4271e5500d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.016134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f071e9a9-9179-4de0-bde8-fc4271e5500d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.016752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f071e9a9-9179-4de0-bde8-fc4271e5500d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.017578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f071e9a9-9179-4de0-bde8-fc4271e5500d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.018099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f071e9a9-9179-4de0-bde8-fc4271e5500d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.018612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f071e9a9-9179-4de0-bde8-fc4271e5500d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.073345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cc1b6ab7-a194-46a9-b7f6-545500f3de29 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:11.082182 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cc1b6ab7-a194-46a9-b7f6-545500f3de29 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1567 microversion: 2.1 time: 0.582326 Oct 05 17:49:11.088304 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2091/3925] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:10 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1567 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:11.093448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a637a160-ea7d-48d0-a102-e711c2b4f6b0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:11.094064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a637a160-ea7d-48d0-a102-e711c2b4f6b0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:11.110494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a637a160-ea7d-48d0-a102-e711c2b4f6b0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.111057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a637a160-ea7d-48d0-a102-e711c2b4f6b0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.111679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a637a160-ea7d-48d0-a102-e711c2b4f6b0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.112640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a637a160-ea7d-48d0-a102-e711c2b4f6b0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.117151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a637a160-ea7d-48d0-a102-e711c2b4f6b0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.117761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a637a160-ea7d-48d0-a102-e711c2b4f6b0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.237257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f071e9a9-9179-4de0-bde8-fc4271e5500d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:11.251481 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f071e9a9-9179-4de0-bde8-fc4271e5500d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1675 microversion: 2.1 time: 0.249413 Oct 05 17:49:11.252215 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1835/3926] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:11 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:11.266591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b10ce983-db06-42f7-8412-e02a44f927ef tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:11.266591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b10ce983-db06-42f7-8412-e02a44f927ef tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:11.266591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b10ce983-db06-42f7-8412-e02a44f927ef tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.266591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b10ce983-db06-42f7-8412-e02a44f927ef tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.266591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b10ce983-db06-42f7-8412-e02a44f927ef tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.267198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b10ce983-db06-42f7-8412-e02a44f927ef tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.267198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b10ce983-db06-42f7-8412-e02a44f927ef tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.267603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b10ce983-db06-42f7-8412-e02a44f927ef tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.663794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a637a160-ea7d-48d0-a102-e711c2b4f6b0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:11.668467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:11.679157 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a637a160-ea7d-48d0-a102-e711c2b4f6b0 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1511 microversion: 2.1 time: 0.589415 Oct 05 17:49:11.687942 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2092/3927] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:11 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1511 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:11.699018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:11.700994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 861d19af-3969-47e3-9887-e20a02de197f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:11.717781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.721661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.722154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.722954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.723420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.724007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.724123 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b10ce983-db06-42f7-8412-e02a44f927ef tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.470042 Oct 05 17:49:11.734500 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1836/3928] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:49:11 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-interface => generated 285 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:11.740526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:11.742052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 261b171b-1e5e-4ad4-88be-c38767238817] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:11.753159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.754724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.755338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.756641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.757115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.757538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.813412 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] HTTP exception thrown: Instance 861d19af-3969-47e3-9887-e20a02de197f could not be found. Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Request method failure captured: Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f HTTP/1.1 Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcH8eciRUicO9Sc63AbUdBQWi79hl1F5-JPzcH7qdsorakIlYbJ3xWNGaQZX7x_XMEI3VWguc4Ab59wksqrwHQyfvfjfNwGyKvrvkMxgiWhEnb1wjLATXZq66MozDXHohccgtEEMtZzwt1j1KMwYhEYNjk-wzqDmXz16nazV655dStY Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f401d1367a73495598bb8a6b882e8618 Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-LiveMigrationTest-332885173 Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f401d1367a73495598bb8a6b882e8618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f401d1367a73495598bb8a6b882e8618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f401d1367a73495598bb8a6b882e8618", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f401d1367a73495598bb8a6b882e8618"}]}] Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-LiveMigrationTest-332885173 Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f401d1367a73495598bb8a6b882e8618 Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-LiveMigrationTest-332885173 Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-LiveMigrationTest-332885173-project Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 695a37f439e94d2e860e51df835827e4 Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-LiveMigrationTest-332885173-project Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 861d19af-3969-47e3-9887-e20a02de197f could not be found. Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '861d19af-3969-47e3-9887-e20a02de197f'} Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 861d19af-3969-47e3-9887-e20a02de197f could not be found. Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 861d19af-3969-47e3-9887-e20a02de197f could not be found. Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:11.824961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:11.828452 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:11.828452 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:11.828452 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:11.828452 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:11.828452 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:11.828452 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 861d19af-3969-47e3-9887-e20a02de197f could not be found. Oct 05 17:49:11.828452 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:11.828848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Returning 404 to user: Instance 861d19af-3969-47e3-9887-e20a02de197f could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:11.833955 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e16ace07-76e7-4a88-ad91-1f01c5fabf71 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f" status: 404 len: 111 microversion: 2.1 time: 0.144344 Oct 05 17:49:11.834662 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2093/3929] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:11 2022] GET /compute/v2.1/servers/861d19af-3969-47e3-9887-e20a02de197f => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:11.838827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.839356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.839849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.840324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lazy-loading 'fault' on Instance uuid 261b171b-1e5e-4ad4-88be-c38767238817 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:49:11.848933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ada8d537-43fd-4740-8f0c-ebec16f4907b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '.version_select at 0x7f77747ccee0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:11.891806 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ada8d537-43fd-4740-8f0c-ebec16f4907b tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882207205" status: 202 len: 0 microversion: 2.1 time: 0.052354 Oct 05 17:49:11.892756 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2094/3930] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 17:49:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882207205 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:49:11.898494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6346bbd9-ac1d-467a-8985-7ea98ca3e98c req-4714a8f7-b726-47e2-8266-c792bb6472b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261b171b-1e5e-4ad4-88be-c38767238817", "name": "network-vif-deleted", "tag": "b39d185b-e007-478a-9bb8-4d9a691acd24"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:11.911739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6346bbd9-ac1d-467a-8985-7ea98ca3e98c req-4714a8f7-b726-47e2-8266-c792bb6472b6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:11.912230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6346bbd9-ac1d-467a-8985-7ea98ca3e98c req-4714a8f7-b726-47e2-8266-c792bb6472b6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:11.912663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6346bbd9-ac1d-467a-8985-7ea98ca3e98c req-4714a8f7-b726-47e2-8266-c792bb6472b6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:11.928997 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6346bbd9-ac1d-467a-8985-7ea98ca3e98c req-4714a8f7-b726-47e2-8266-c792bb6472b6 service nova] Creating event network-vif-deleted:b39d185b-e007-478a-9bb8-4d9a691acd24 for instance 261b171b-1e5e-4ad4-88be-c38767238817 on n-h1-835595-3 Oct 05 17:49:11.931418 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6346bbd9-ac1d-467a-8985-7ea98ca3e98c req-4714a8f7-b726-47e2-8266-c792bb6472b6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037258 Oct 05 17:49:11.932479 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2095/3931] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:11.991540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:12.004934 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f0a2874d-dfd0-4ee8-9d05-5cf4fb303cc7 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817" status: 200 len: 1313 microversion: 2.1 time: 0.268812 Oct 05 17:49:12.007195 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1837/3932] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:11 2022] GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:12.287537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d700bade-2da4-47d8-8aff-81c13cff5e67 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:12.288250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d700bade-2da4-47d8-8aff-81c13cff5e67 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:12.316099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d700bade-2da4-47d8-8aff-81c13cff5e67 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:12.316849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d700bade-2da4-47d8-8aff-81c13cff5e67 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:12.317435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d700bade-2da4-47d8-8aff-81c13cff5e67 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:12.318356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d700bade-2da4-47d8-8aff-81c13cff5e67 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:12.318964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d700bade-2da4-47d8-8aff-81c13cff5e67 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:12.319707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d700bade-2da4-47d8-8aff-81c13cff5e67 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:12.364687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-eeddd5e5-f8e4-4fe6-ae84-c758a20c27dd req-be008086-c8ce-4618-a8ca-91aa4c094774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "955b28b3-dd61-4846-94d2-b394f6c55aa4", "name": "network-vif-deleted", "tag": "0f5cb3f5-caae-4aeb-8be1-adef920cf7b8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:12.384857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-eeddd5e5-f8e4-4fe6-ae84-c758a20c27dd req-be008086-c8ce-4618-a8ca-91aa4c094774 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:12.385354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-eeddd5e5-f8e4-4fe6-ae84-c758a20c27dd req-be008086-c8ce-4618-a8ca-91aa4c094774 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:12.394742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-eeddd5e5-f8e4-4fe6-ae84-c758a20c27dd req-be008086-c8ce-4618-a8ca-91aa4c094774 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:12.429650 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-eeddd5e5-f8e4-4fe6-ae84-c758a20c27dd req-be008086-c8ce-4618-a8ca-91aa4c094774 service nova] Creating event network-vif-deleted:0f5cb3f5-caae-4aeb-8be1-adef920cf7b8 for instance 955b28b3-dd61-4846-94d2-b394f6c55aa4 on n-h2-835595-3 Oct 05 17:49:12.437248 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-eeddd5e5-f8e4-4fe6-ae84-c758a20c27dd req-be008086-c8ce-4618-a8ca-91aa4c094774 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076431 Oct 05 17:49:12.439747 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1838/3933] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:49:12.710773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-01ab8cd1-4ea8-4feb-9813-f41bd1fdc10b tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:12.711914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-01ab8cd1-4ea8-4feb-9813-f41bd1fdc10b tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:12.724479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01ab8cd1-4ea8-4feb-9813-f41bd1fdc10b tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:12.734939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01ab8cd1-4ea8-4feb-9813-f41bd1fdc10b tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:12.735683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01ab8cd1-4ea8-4feb-9813-f41bd1fdc10b tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:12.737948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01ab8cd1-4ea8-4feb-9813-f41bd1fdc10b tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:12.740032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01ab8cd1-4ea8-4feb-9813-f41bd1fdc10b tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:12.742332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01ab8cd1-4ea8-4feb-9813-f41bd1fdc10b tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:12.804824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d700bade-2da4-47d8-8aff-81c13cff5e67 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:12.815231 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d700bade-2da4-47d8-8aff-81c13cff5e67 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1675 microversion: 2.1 time: 0.537637 Oct 05 17:49:12.833643 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2096/3934] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:12 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1675 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:13.029102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:13.030040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 261b171b-1e5e-4ad4-88be-c38767238817] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:13.037733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:13.038520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:13.039122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:13.040012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:13.040685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:13.041264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:13.071761 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] HTTP exception thrown: Instance 261b171b-1e5e-4ad4-88be-c38767238817 could not be found. Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Request method failure captured: Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817 HTTP/1.1 Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcNsxc8SAcwEhCqzKuKjoMdpUFxib0WLwrVL8nF_wwKasAMEyXR9A60vazVQC1ju5BhRymI_ysSp47SFEMedF2xphXHJ342pFZTGo7pKAmNNoNgS-VpBUOgGQnCOXdzysiNDDIX_4ewhJvpgRcVLyNDbFi6khuqmDdprIrllslgTNrk Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c1178176876f4a2fabc6a4ff171b0220", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}] Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4be4313bf1134d6d9ab526b65eff8d9e Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 261b171b-1e5e-4ad4-88be-c38767238817 could not be found. Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '261b171b-1e5e-4ad4-88be-c38767238817'} Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 261b171b-1e5e-4ad4-88be-c38767238817 could not be found. Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 261b171b-1e5e-4ad4-88be-c38767238817 could not be found. Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:13.075510 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:13.079648 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:13.079648 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:13.079648 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:13.079648 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:13.079648 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:13.079648 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:13.079648 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 261b171b-1e5e-4ad4-88be-c38767238817 could not be found. Oct 05 17:49:13.079648 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:13.081034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Returning 404 to user: Instance 261b171b-1e5e-4ad4-88be-c38767238817 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:13.082147 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4aed3e6e-83fb-4176-8f7d-2bf5a0cf8390 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817" status: 404 len: 111 microversion: 2.1 time: 0.057062 Oct 05 17:49:13.086696 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2097/3935] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:13 2022] GET /compute/v2.1/servers/261b171b-1e5e-4ad4-88be-c38767238817 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:13.092260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:13.093301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:13.101230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:13.101994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:13.102763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:13.104169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:13.104864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:13.106049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:13.179908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-01ab8cd1-4ea8-4feb-9813-f41bd1fdc10b tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:13.191688 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-01ab8cd1-4ea8-4feb-9813-f41bd1fdc10b tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1511 microversion: 2.1 time: 0.486071 Oct 05 17:49:13.200188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:13.200922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:13.201517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:13.202127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lazy-loading 'fault' on Instance uuid 955b28b3-dd61-4846-94d2-b394f6c55aa4 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:49:13.203406 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1839/3936] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:12 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1511 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:13.332063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be4313bf1134d6d9ab526b65eff8d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1178176876f4a2fabc6a4ff171b0220', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:13.369497 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c4d720d3-dc80-4ee8-8306-812e410ee7b0 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 200 len: 1313 microversion: 2.1 time: 0.279573 Oct 05 17:49:13.372328 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2098/3937] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:13 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:13.842754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41b8096d-c8e6-4e4a-b72f-79b69e91d7fa tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:13.843659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-41b8096d-c8e6-4e4a-b72f-79b69e91d7fa tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:13.861212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41b8096d-c8e6-4e4a-b72f-79b69e91d7fa tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:13.861709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41b8096d-c8e6-4e4a-b72f-79b69e91d7fa tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:13.862147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41b8096d-c8e6-4e4a-b72f-79b69e91d7fa tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:13.862954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41b8096d-c8e6-4e4a-b72f-79b69e91d7fa tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:13.863502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41b8096d-c8e6-4e4a-b72f-79b69e91d7fa tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:13.863927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41b8096d-c8e6-4e4a-b72f-79b69e91d7fa tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:14.226386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a2586d73-c76a-4f94-97f2-8bca6d7db2ae tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:14.227665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a2586d73-c76a-4f94-97f2-8bca6d7db2ae tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:14.236214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2586d73-c76a-4f94-97f2-8bca6d7db2ae tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:14.236939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2586d73-c76a-4f94-97f2-8bca6d7db2ae tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:14.239272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2586d73-c76a-4f94-97f2-8bca6d7db2ae tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:14.242106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2586d73-c76a-4f94-97f2-8bca6d7db2ae tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:14.243463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2586d73-c76a-4f94-97f2-8bca6d7db2ae tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:14.244230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2586d73-c76a-4f94-97f2-8bca6d7db2ae tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:14.426050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-41b8096d-c8e6-4e4a-b72f-79b69e91d7fa tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:14.434664 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-41b8096d-c8e6-4e4a-b72f-79b69e91d7fa tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1675 microversion: 2.1 time: 0.595773 Oct 05 17:49:14.435816 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1840/3938] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:13 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1675 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:14.441203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:14.442048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] [instance: 955b28b3-dd61-4846-94d2-b394f6c55aa4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:14.455461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:14.456692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:14.458828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:14.459734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:14.468667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:14.469485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:14.491708 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] HTTP exception thrown: Instance 955b28b3-dd61-4846-94d2-b394f6c55aa4 could not be found. Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Request method failure captured: Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 HTTP/1.1 Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcNsxc8SAcwEhCqzKuKjoMdpUFxib0WLwrVL8nF_wwKasAMEyXR9A60vazVQC1ju5BhRymI_ysSp47SFEMedF2xphXHJ342pFZTGo7pKAmNNoNgS-VpBUOgGQnCOXdzysiNDDIX_4ewhJvpgRcVLyNDbFi6khuqmDdprIrllslgTNrk Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c1178176876f4a2fabc6a4ff171b0220", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c1178176876f4a2fabc6a4ff171b0220"}]}] Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: c1178176876f4a2fabc6a4ff171b0220 Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1752146550 Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 4be4313bf1134d6d9ab526b65eff8d9e Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ListServersNegativeTestJSON-1752146550-project Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 955b28b3-dd61-4846-94d2-b394f6c55aa4 could not be found. Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '955b28b3-dd61-4846-94d2-b394f6c55aa4'} Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 955b28b3-dd61-4846-94d2-b394f6c55aa4 could not be found. Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 955b28b3-dd61-4846-94d2-b394f6c55aa4 could not be found. Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:14.498321 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:14.502129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:14.502129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:14.502129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:14.502129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:14.502129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:14.502129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:14.502129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 955b28b3-dd61-4846-94d2-b394f6c55aa4 could not be found. Oct 05 17:49:14.502129 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:14.504080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] Returning 404 to user: Instance 955b28b3-dd61-4846-94d2-b394f6c55aa4 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:14.506698 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3d486a6c-0acc-4624-80a4-aa28db3cf171 tempest-ListServersNegativeTestJSON-1752146550 tempest-ListServersNegativeTestJSON-1752146550-project] 10.222.0.70 "GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4" status: 404 len: 111 microversion: 2.1 time: 0.069746 Oct 05 17:49:14.513512 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1841/3939] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:14 2022] GET /compute/v2.1/servers/955b28b3-dd61-4846-94d2-b394f6c55aa4 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:14.714636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a2586d73-c76a-4f94-97f2-8bca6d7db2ae tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:14.729725 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a2586d73-c76a-4f94-97f2-8bca6d7db2ae tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1511 microversion: 2.1 time: 0.508145 Oct 05 17:49:14.730364 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2099/3940] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:14 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1511 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:14.982389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c2e53c1e-90a8-470e-b9ee-efb363604c25 req-9992b21d-4111-42ee-b09d-efa2bf5065fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "306c41c5-0f1e-4812-a54d-c31fc031c7d1", "tag": "371d802d-9093-4be5-860b-4f96eed3c8f9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:14.999075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:15.021657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c2e53c1e-90a8-470e-b9ee-efb363604c25 req-9992b21d-4111-42ee-b09d-efa2bf5065fb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:15.022143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c2e53c1e-90a8-470e-b9ee-efb363604c25 req-9992b21d-4111-42ee-b09d-efa2bf5065fb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:15.022601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c2e53c1e-90a8-470e-b9ee-efb363604c25 req-9992b21d-4111-42ee-b09d-efa2bf5065fb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:15.052485 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c2e53c1e-90a8-470e-b9ee-efb363604c25 req-9992b21d-4111-42ee-b09d-efa2bf5065fb service nova] Creating event network-changed:371d802d-9093-4be5-860b-4f96eed3c8f9 for instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 on n-h2-835595-3 Oct 05 17:49:15.065969 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c2e53c1e-90a8-470e-b9ee-efb363604c25 req-9992b21d-4111-42ee-b09d-efa2bf5065fb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088819 Oct 05 17:49:15.067341 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1842/3941] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:15.094236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7f535bbf-62cf-4252-b08d-8aa9fa60552c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:15.095081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7f535bbf-62cf-4252-b08d-8aa9fa60552c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:15.105615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f535bbf-62cf-4252-b08d-8aa9fa60552c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:15.106298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f535bbf-62cf-4252-b08d-8aa9fa60552c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:15.108734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f535bbf-62cf-4252-b08d-8aa9fa60552c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:15.110216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f535bbf-62cf-4252-b08d-8aa9fa60552c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:15.112657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f535bbf-62cf-4252-b08d-8aa9fa60552c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:15.114936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7f535bbf-62cf-4252-b08d-8aa9fa60552c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:15.115726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:15.156763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7f535bbf-62cf-4252-b08d-8aa9fa60552c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:49:15.324082 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7f535bbf-62cf-4252-b08d-8aa9fa60552c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 204 len: 0 microversion: 2.1 time: 0.233467 Oct 05 17:49:15.328818 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2100/3942] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:49:15 2022] DELETE /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:49:15.335065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-478d5488-e4d4-46af-bb32-fab59a752c16 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:15.336020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-478d5488-e4d4-46af-bb32-fab59a752c16 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:15.351723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-478d5488-e4d4-46af-bb32-fab59a752c16 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:15.352249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-478d5488-e4d4-46af-bb32-fab59a752c16 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:15.369587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-478d5488-e4d4-46af-bb32-fab59a752c16 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:15.370399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-478d5488-e4d4-46af-bb32-fab59a752c16 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:15.370882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-478d5488-e4d4-46af-bb32-fab59a752c16 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:15.371920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-478d5488-e4d4-46af-bb32-fab59a752c16 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:15.469853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb92f2dd-ea09-41a5-82ad-97e8a3f530d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:15.470950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eb92f2dd-ea09-41a5-82ad-97e8a3f530d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:15.489034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb92f2dd-ea09-41a5-82ad-97e8a3f530d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:15.490899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb92f2dd-ea09-41a5-82ad-97e8a3f530d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:15.494324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb92f2dd-ea09-41a5-82ad-97e8a3f530d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:15.495248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb92f2dd-ea09-41a5-82ad-97e8a3f530d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:15.496641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb92f2dd-ea09-41a5-82ad-97e8a3f530d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:15.497119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb92f2dd-ea09-41a5-82ad-97e8a3f530d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:16.463944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-478d5488-e4d4-46af-bb32-fab59a752c16 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:16.483538 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-478d5488-e4d4-46af-bb32-fab59a752c16 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1484 microversion: 2.1 time: 1.151624 Oct 05 17:49:16.485751 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1843/3943] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:15 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1484 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:16.503477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:16.504622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=16 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:16.505784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:16.524417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:16.524782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:16.527195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:16.528412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:16.529080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:16.533593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:16.595805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:16.603882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:16.606056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:16.606804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lazy-loading 'fault' on Instance uuid 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:49:16.642234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eb92f2dd-ea09-41a5-82ad-97e8a3f530d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:16.656651 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb92f2dd-ea09-41a5-82ad-97e8a3f530d9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1607 microversion: 2.1 time: 1.196789 Oct 05 17:49:16.675006 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2101/3944] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:15 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1607 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:16.782442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9991b7e124c54af798228a3a0b78f9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a9e41eecbe4d7991f6a749bba996c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:16.814017 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d633e831-1265-4de5-ab54-2fa538459b78 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 200 len: 1307 microversion: 2.1 time: 0.325611 Oct 05 17:49:16.829049 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1844/3945] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:16 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 1307 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:17.097124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-be653775-c4f6-4a0d-8478-a0e44f08d823 req-1023c45d-9dc0-4f6c-b936-c2993330c9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb32c49-9cb8-468c-b59a-0f7470ce6cf0", "name": "network-vif-deleted", "tag": "ba505cb4-419d-4473-b832-b42755e1f881"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:17.123780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-be653775-c4f6-4a0d-8478-a0e44f08d823 req-1023c45d-9dc0-4f6c-b936-c2993330c9af service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:17.124262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-be653775-c4f6-4a0d-8478-a0e44f08d823 req-1023c45d-9dc0-4f6c-b936-c2993330c9af service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:17.124741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-be653775-c4f6-4a0d-8478-a0e44f08d823 req-1023c45d-9dc0-4f6c-b936-c2993330c9af service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:17.167767 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-be653775-c4f6-4a0d-8478-a0e44f08d823 req-1023c45d-9dc0-4f6c-b936-c2993330c9af service nova] Creating event network-vif-deleted:ba505cb4-419d-4473-b832-b42755e1f881 for instance 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 on n-h1-835595-3 Oct 05 17:49:17.179527 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-be653775-c4f6-4a0d-8478-a0e44f08d823 req-1023c45d-9dc0-4f6c-b936-c2993330c9af service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086288 Oct 05 17:49:17.183998 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2102/3946] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:17.514254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dc48c258-b605-4820-8de8-8069354d7338 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:17.517522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dc48c258-b605-4820-8de8-8069354d7338 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:17.528801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc48c258-b605-4820-8de8-8069354d7338 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:17.529886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc48c258-b605-4820-8de8-8069354d7338 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:17.530682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc48c258-b605-4820-8de8-8069354d7338 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:17.531670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc48c258-b605-4820-8de8-8069354d7338 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:17.532355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc48c258-b605-4820-8de8-8069354d7338 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:17.533529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc48c258-b605-4820-8de8-8069354d7338 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:17.689317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70f3c6b4-78ff-4d2b-b3ed-8bcc1500e1c0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:17.690151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-70f3c6b4-78ff-4d2b-b3ed-8bcc1500e1c0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:17.723708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f3c6b4-78ff-4d2b-b3ed-8bcc1500e1c0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:17.724330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f3c6b4-78ff-4d2b-b3ed-8bcc1500e1c0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:17.724790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f3c6b4-78ff-4d2b-b3ed-8bcc1500e1c0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:17.725550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f3c6b4-78ff-4d2b-b3ed-8bcc1500e1c0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:17.726019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f3c6b4-78ff-4d2b-b3ed-8bcc1500e1c0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:17.726488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f3c6b4-78ff-4d2b-b3ed-8bcc1500e1c0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:17.945896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-70f3c6b4-78ff-4d2b-b3ed-8bcc1500e1c0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:17.954802 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-70f3c6b4-78ff-4d2b-b3ed-8bcc1500e1c0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1607 microversion: 2.1 time: 0.269712 Oct 05 17:49:17.955412 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2103/3947] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:17 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1607 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:17.973416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:17.975161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] [instance: 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:17.990997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:17.993957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:17.994725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:17.995730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:17.996403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:17.997015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:18.016222 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] HTTP exception thrown: Instance 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 could not be found. Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Request method failure captured: Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 HTTP/1.1 Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcN4sX8e5k1rC-i-tAVMFfShklcBxHyiN0OX6Wrv1-dkDLQ-dtuzMR1q6bbQJJR4hhhYSI2-qu75B8jguv0kuRzH9FowSpEiAQSaL3z_YPOGW6q5FnCLVApL25BkGTxeYnnnXs0mxXkssAMZHe9sLKrRe896SVYrfy52f7I5Ph-Qlxs Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: b2a9e41eecbe4d7991f6a749bba996c1 Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-InstanceActionsTestJSON-1299856919 Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b2a9e41eecbe4d7991f6a749bba996c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2a9e41eecbe4d7991f6a749bba996c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b2a9e41eecbe4d7991f6a749bba996c1", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b2a9e41eecbe4d7991f6a749bba996c1"}]}] Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-InstanceActionsTestJSON-1299856919 Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: b2a9e41eecbe4d7991f6a749bba996c1 Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1299856919 Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-InstanceActionsTestJSON-1299856919-project Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9991b7e124c54af798228a3a0b78f9a6 Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-InstanceActionsTestJSON-1299856919-project Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 could not be found. Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '2fb32c49-9cb8-468c-b59a-0f7470ce6cf0'} Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 could not be found. Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 could not be found. Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:18.018658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:18.022168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:18.022168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:18.022168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:18.022168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:18.022168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:18.022168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 could not be found. Oct 05 17:49:18.022168 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:18.024363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] Returning 404 to user: Instance 2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:18.025739 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8c503950-b9aa-4719-9f04-19a27c02f8d5 tempest-InstanceActionsTestJSON-1299856919 tempest-InstanceActionsTestJSON-1299856919-project] 10.222.0.70 "GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0" status: 404 len: 111 microversion: 2.1 time: 0.066356 Oct 05 17:49:18.030465 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2104/3948] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:17 2022] GET /compute/v2.1/servers/2fb32c49-9cb8-468c-b59a-0f7470ce6cf0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:18.718342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dc48c258-b605-4820-8de8-8069354d7338 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:18.743187 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dc48c258-b605-4820-8de8-8069354d7338 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 200 len: 1484 microversion: 2.1 time: 1.230356 Oct 05 17:49:18.745214 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1845/3949] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:17 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 1484 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:18.986954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:18.987616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:19.019599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:19.021236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:19.022723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:19.025043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:19.028206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:19.028747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:19.091792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:19.092560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:19.093259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:19.093864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lazy-loading 'fault' on Instance uuid 6ad2a87d-6f65-4d38-add2-2b119a8a2210 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:49:19.201794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:19.213802 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b03054cc-d62a-4ee5-995a-1f8a1597d29b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 200 len: 1328 microversion: 2.1 time: 0.230911 Oct 05 17:49:19.218796 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2105/3950] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:18 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 1328 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:19.693399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-af90d20e-9e04-4f7a-9541-2d59bbd502a0 req-b821ab7e-fab9-4de0-9da6-dd3ace110a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ad2a87d-6f65-4d38-add2-2b119a8a2210", "name": "network-vif-deleted", "tag": "d524c925-1190-4025-83bf-7ff68a7cdb80"}, {"server_uuid": "beaf97b4-53da-43bc-afe6-15350b810193", "name": "network-vif-deleted", "tag": "1a9259fb-7b43-42bb-9bbd-11fc82600a80"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:19.717162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-af90d20e-9e04-4f7a-9541-2d59bbd502a0 req-b821ab7e-fab9-4de0-9da6-dd3ace110a1d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:19.719656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-af90d20e-9e04-4f7a-9541-2d59bbd502a0 req-b821ab7e-fab9-4de0-9da6-dd3ace110a1d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:19.720831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-af90d20e-9e04-4f7a-9541-2d59bbd502a0 req-b821ab7e-fab9-4de0-9da6-dd3ace110a1d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:19.751530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-af90d20e-9e04-4f7a-9541-2d59bbd502a0 req-b821ab7e-fab9-4de0-9da6-dd3ace110a1d service nova] Creating event network-vif-deleted:d524c925-1190-4025-83bf-7ff68a7cdb80 for instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 on n-h1-835595-3 Oct 05 17:49:19.752144 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-af90d20e-9e04-4f7a-9541-2d59bbd502a0 req-b821ab7e-fab9-4de0-9da6-dd3ace110a1d service nova] Creating event network-vif-deleted:1a9259fb-7b43-42bb-9bbd-11fc82600a80 for instance beaf97b4-53da-43bc-afe6-15350b810193 on n-h2-835595-3 Oct 05 17:49:19.769682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:19.770326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: beaf97b4-53da-43bc-afe6-15350b810193] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:19.776874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:19.778387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:19.779745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:19.781094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:19.783762 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-af90d20e-9e04-4f7a-9541-2d59bbd502a0 req-b821ab7e-fab9-4de0-9da6-dd3ace110a1d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094896 Oct 05 17:49:19.784452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:19.785055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:19.788367 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1846/3951] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:19.806548 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] HTTP exception thrown: Instance beaf97b4-53da-43bc-afe6-15350b810193 could not be found. Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Request method failure captured: Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 HTTP/1.1 Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcH8eciRUicO9Sc63AbUdBQWi79hl1F5-JPzcH7qdsorakIlYbJ3xWNGaQZX7x_XMEI3VWguc4Ab59wksqrwHQyfvfjfNwGyKvrvkMxgiWhEnb1wjLATXZq66MozDXHohccgtEEMtZzwt1j1KMwYhEYNjk-wzqDmXz16nazV655dStY Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f401d1367a73495598bb8a6b882e8618 Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-LiveMigrationTest-332885173 Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f401d1367a73495598bb8a6b882e8618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f401d1367a73495598bb8a6b882e8618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f401d1367a73495598bb8a6b882e8618", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f401d1367a73495598bb8a6b882e8618"}]}] Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-LiveMigrationTest-332885173 Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f401d1367a73495598bb8a6b882e8618 Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-LiveMigrationTest-332885173 Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-LiveMigrationTest-332885173-project Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 695a37f439e94d2e860e51df835827e4 Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-LiveMigrationTest-332885173-project Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance beaf97b4-53da-43bc-afe6-15350b810193 could not be found. Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'beaf97b4-53da-43bc-afe6-15350b810193'} Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beaf97b4-53da-43bc-afe6-15350b810193 could not be found. Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beaf97b4-53da-43bc-afe6-15350b810193 could not be found. Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:19.808858 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:19.813071 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:19.813071 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:19.813071 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:19.813071 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:19.813071 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:19.813071 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beaf97b4-53da-43bc-afe6-15350b810193 could not be found. Oct 05 17:49:19.813071 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:49:19.815073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Returning 404 to user: Instance beaf97b4-53da-43bc-afe6-15350b810193 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:19.816417 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88b513c5-da07-4c09-8d39-7ddb9b02061e tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193" status: 404 len: 111 microversion: 2.1 time: 0.050937 Oct 05 17:49:19.820210 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2106/3952] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:19 2022] GET /compute/v2.1/servers/beaf97b4-53da-43bc-afe6-15350b810193 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:19.827064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a1881205-c918-4b9d-b69f-e4359bce1449 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:19.827913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a1881205-c918-4b9d-b69f-e4359bce1449 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:19.835489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1881205-c918-4b9d-b69f-e4359bce1449 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:19.836209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1881205-c918-4b9d-b69f-e4359bce1449 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:19.836827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1881205-c918-4b9d-b69f-e4359bce1449 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:19.837690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1881205-c918-4b9d-b69f-e4359bce1449 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:19.838327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1881205-c918-4b9d-b69f-e4359bce1449 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:19.838950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1881205-c918-4b9d-b69f-e4359bce1449 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:19.877068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a1881205-c918-4b9d-b69f-e4359bce1449 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:49:20.069340 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a1881205-c918-4b9d-b69f-e4359bce1449 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 204 len: 0 microversion: 2.1 time: 0.246527 Oct 05 17:49:20.070454 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1847/3953] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:49:19 2022] DELETE /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:49:20.079729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-efab9b02-3619-4d9d-891a-3e0e39617b90 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:20.080339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-efab9b02-3619-4d9d-891a-3e0e39617b90 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:20.097210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efab9b02-3619-4d9d-891a-3e0e39617b90 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:20.097743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efab9b02-3619-4d9d-891a-3e0e39617b90 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:20.098186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efab9b02-3619-4d9d-891a-3e0e39617b90 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:20.098946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efab9b02-3619-4d9d-891a-3e0e39617b90 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:20.099411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efab9b02-3619-4d9d-891a-3e0e39617b90 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:20.099844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efab9b02-3619-4d9d-891a-3e0e39617b90 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:20.245422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:20.246928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:20.259951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:20.266640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:20.267251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:20.268152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:20.268825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:20.269406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:20.296153 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] HTTP exception thrown: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Request method failure captured: Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 HTTP/1.1 Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcK5oMBjHiudjf7LHriEDEXcKhHOF8QjbltWzRFEVZoTN3IpQ3n_sL0fDG8FbtsTKiaeY8HcTuKzSraQm0Ef92X9oeNRaFg-JPMBuk3lEYyzi41lyLNK-G7bmPf0K1Yc4av0zJlaVFRVDg0PJbRyYOdl5wvP7qN8tKxZlKX6dpLvihg Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ee4220fd6f904e36ada64a2b5f3bf524", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}] Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 418f5619d2f543d98e874a0c48e81d52 Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '6ad2a87d-6f65-4d38-add2-2b119a8a2210'} Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:20.306333 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:20.310633 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:20.310633 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:20.310633 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:20.310633 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:20.310633 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:20.310633 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:49:20.310633 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:20.311972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Returning 404 to user: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:20.313025 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2ca91bfe-77b5-4949-a2d8-40f13348e85f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 404 len: 111 microversion: 2.1 time: 0.073870 Oct 05 17:49:20.314115 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1848/3954] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:20 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:20.322748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69c49e93-50c5-4731-a695-da24b42874a4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '.version_select at 0x7f777463d1f0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:20.365364 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69c49e93-50c5-4731-a695-da24b42874a4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520047779" status: 202 len: 0 microversion: 2.1 time: 0.046777 Oct 05 17:49:20.367031 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1849/3955] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 17:49:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1520047779 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:49:20.561985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-efab9b02-3619-4d9d-891a-3e0e39617b90 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:20.580706 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-efab9b02-3619-4d9d-891a-3e0e39617b90 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1498 microversion: 2.1 time: 0.505404 Oct 05 17:49:20.586157 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2107/3956] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:20 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1498 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:21.620274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8795aa6-c544-4ad6-b569-4735f250f91c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:21.620932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8795aa6-c544-4ad6-b569-4735f250f91c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:21.650764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8795aa6-c544-4ad6-b569-4735f250f91c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:21.651430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8795aa6-c544-4ad6-b569-4735f250f91c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:21.651880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8795aa6-c544-4ad6-b569-4735f250f91c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:21.652629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8795aa6-c544-4ad6-b569-4735f250f91c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:21.653086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8795aa6-c544-4ad6-b569-4735f250f91c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:21.653514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8795aa6-c544-4ad6-b569-4735f250f91c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:22.167742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c8795aa6-c544-4ad6-b569-4735f250f91c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:22.195687 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8795aa6-c544-4ad6-b569-4735f250f91c tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1498 microversion: 2.1 time: 0.583280 Oct 05 17:49:22.200892 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1850/3957] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:21 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1498 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:23.001724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-211e245d-d226-47d2-b0f3-5d3dc8acc81f req-66d7b136-03dd-4a99-883c-e3669fe18294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8bc911-1ed0-4477-95a8-9b63aeb837aa", "name": "network-vif-deleted", "tag": "2adbf98a-5ee3-4501-8cde-8d0b03b4a187"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:23.025007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-211e245d-d226-47d2-b0f3-5d3dc8acc81f req-66d7b136-03dd-4a99-883c-e3669fe18294 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:23.025453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-211e245d-d226-47d2-b0f3-5d3dc8acc81f req-66d7b136-03dd-4a99-883c-e3669fe18294 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:23.025889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-211e245d-d226-47d2-b0f3-5d3dc8acc81f req-66d7b136-03dd-4a99-883c-e3669fe18294 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:23.058049 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-211e245d-d226-47d2-b0f3-5d3dc8acc81f req-66d7b136-03dd-4a99-883c-e3669fe18294 service nova] Creating event network-vif-deleted:2adbf98a-5ee3-4501-8cde-8d0b03b4a187 for instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa on n-h2-835595-3 Oct 05 17:49:23.068649 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-211e245d-d226-47d2-b0f3-5d3dc8acc81f req-66d7b136-03dd-4a99-883c-e3669fe18294 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071932 Oct 05 17:49:23.071123 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2108/3958] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:23.223877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:23.224486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:23.239677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:23.240566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:23.241802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:23.242979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:23.245163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:23.246640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:23.325123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:23.325669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:23.326096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:23.326585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lazy-loading 'fault' on Instance uuid 2c8bc911-1ed0-4477-95a8-9b63aeb837aa {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:49:23.349531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87268d86-9df0-4933-bd7e-f1938bd3ee64 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'create', calling method: .version_select at 0x7f77747ccdc0>, body: {"keypair": {"name": "tempest-keypair-645054697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1conkFu1jAKtkHplWfcXFb5p1mTG7kKofzBjJIjtaZLwh2JaDpOiGk5lTxj30M86XbuK1sy0VL8LN1n659wiveh8bymg31tS73PaBhol0e//1I67a/4E7wJ2363jAe8Q=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:23.398293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '695a37f439e94d2e860e51df835827e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f401d1367a73495598bb8a6b882e8618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:23.416169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-87268d86-9df0-4933-bd7e-f1938bd3ee64 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Getting quotas for project ee4220fd6f904e36ada64a2b5f3bf524. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:49:23.416303 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-84ffb306-682b-4733-8e6a-70e47b50a8e5 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 200 len: 1300 microversion: 2.1 time: 0.196504 Oct 05 17:49:23.431845 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1851/3959] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:23 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 1300 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:23.449627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-87268d86-9df0-4933-bd7e-f1938bd3ee64 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Getting quotas for user 418f5619d2f543d98e874a0c48e81d52 and project ee4220fd6f904e36ada64a2b5f3bf524. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:49:23.513154 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87268d86-9df0-4933-bd7e-f1938bd3ee64 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167685 Oct 05 17:49:23.520793 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2109/3960] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:49:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:24.446012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:24.446012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] [instance: 2c8bc911-1ed0-4477-95a8-9b63aeb837aa] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:24.465043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:24.465550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:24.465988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:24.466738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:24.467193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:24.467613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:24.525088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:24.528640 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] HTTP exception thrown: Instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa could not be found. Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Request method failure captured: Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa HTTP/1.1 Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcH8eciRUicO9Sc63AbUdBQWi79hl1F5-JPzcH7qdsorakIlYbJ3xWNGaQZX7x_XMEI3VWguc4Ab59wksqrwHQyfvfjfNwGyKvrvkMxgiWhEnb1wjLATXZq66MozDXHohccgtEEMtZzwt1j1KMwYhEYNjk-wzqDmXz16nazV655dStY Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f401d1367a73495598bb8a6b882e8618 Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-LiveMigrationTest-332885173 Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f401d1367a73495598bb8a6b882e8618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f401d1367a73495598bb8a6b882e8618"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f401d1367a73495598bb8a6b882e8618", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f401d1367a73495598bb8a6b882e8618"}]}] Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-LiveMigrationTest-332885173 Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f401d1367a73495598bb8a6b882e8618 Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-LiveMigrationTest-332885173 Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-LiveMigrationTest-332885173-project Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 695a37f439e94d2e860e51df835827e4 Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-LiveMigrationTest-332885173-project Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa could not be found. Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '2c8bc911-1ed0-4477-95a8-9b63aeb837aa'} Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa could not be found. Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa could not be found. Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:49:24.532666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:24.537081 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:49:24.537081 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:49:24.537081 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:49:24.537081 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:49:24.537081 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:49:24.537081 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa could not be found. Oct 05 17:49:24.537081 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:49:24.537081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] Returning 404 to user: Instance 2c8bc911-1ed0-4477-95a8-9b63aeb837aa could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:49:24.537943 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-198d0b6b-5328-463d-a2d1-5359688e1954 tempest-LiveMigrationTest-332885173 tempest-LiveMigrationTest-332885173-project] 10.222.0.70 "GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa" status: 404 len: 111 microversion: 2.1 time: 0.096528 Oct 05 17:49:24.538546 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1852/3961] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:24 2022] GET /compute/v2.1/servers/2c8bc911-1ed0-4477-95a8-9b63aeb837aa => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:49:29.641336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-26277896", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1ce965b4-92ba-4ac6-b3d5-60c0776d2f1e"}], "security_groups": [{"name": "tempest-securitygroup--1786916681"}], "key_name": "tempest-keypair-645054697", "user_data": "}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:29.901544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] validate_networks() for [('1ce965b4-92ba-4ac6-b3d5-60c0776d2f1e', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:49:31.247284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:49:31.249342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:49:31.250319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:49:31.250890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:49:31.251458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:49:31.297455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:31.303772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:31.310523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:31.318821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:31.319519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:31.330137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:31.423943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Getting quotas for project ee4220fd6f904e36ada64a2b5f3bf524. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:49:31.443800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Getting quotas for user 418f5619d2f543d98e874a0c48e81d52 and project ee4220fd6f904e36ada64a2b5f3bf524. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:49:31.447113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:31.480876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:49:31.496897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:49:31.751010 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-810bee01-8dec-49a8-9218-13e07c7bf158 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.111348 Oct 05 17:49:31.754472 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2110/3962] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:49:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:49:31.768288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47f0d95d-8746-476d-b246-11f72fe01fb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:31.769119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47f0d95d-8746-476d-b246-11f72fe01fb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:32.088639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-47f0d95d-8746-476d-b246-11f72fe01fb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:32.106032 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47f0d95d-8746-476d-b246-11f72fe01fb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1235 microversion: 2.1 time: 0.344454 Oct 05 17:49:32.131546 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1853/3963] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:31 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1235 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:33.191444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-971a6318-5973-4e27-bcc4-b329c14f035d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:33.196832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-971a6318-5973-4e27-bcc4-b329c14f035d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:33.267658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-971a6318-5973-4e27-bcc4-b329c14f035d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:33.281087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-971a6318-5973-4e27-bcc4-b329c14f035d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:33.290932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-971a6318-5973-4e27-bcc4-b329c14f035d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:33.298804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-971a6318-5973-4e27-bcc4-b329c14f035d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:33.299502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-971a6318-5973-4e27-bcc4-b329c14f035d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:33.304871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-971a6318-5973-4e27-bcc4-b329c14f035d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:33.652978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-971a6318-5973-4e27-bcc4-b329c14f035d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:33.676443 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-971a6318-5973-4e27-bcc4-b329c14f035d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1239 microversion: 2.1 time: 0.502102 Oct 05 17:49:33.700343 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2111/3964] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:33 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1239 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:34.708566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-452b6ed6-4d9d-4e16-a2c5-b537863b74e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:34.709245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-452b6ed6-4d9d-4e16-a2c5-b537863b74e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:34.743076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-452b6ed6-4d9d-4e16-a2c5-b537863b74e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:34.758129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-452b6ed6-4d9d-4e16-a2c5-b537863b74e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:34.760851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-452b6ed6-4d9d-4e16-a2c5-b537863b74e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:34.761811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-452b6ed6-4d9d-4e16-a2c5-b537863b74e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:34.766465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-452b6ed6-4d9d-4e16-a2c5-b537863b74e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:34.769219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-452b6ed6-4d9d-4e16-a2c5-b537863b74e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:35.221804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-452b6ed6-4d9d-4e16-a2c5-b537863b74e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:35.251691 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-452b6ed6-4d9d-4e16-a2c5-b537863b74e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1305 microversion: 2.1 time: 0.547133 Oct 05 17:49:35.274120 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1854/3965] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:34 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1305 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:36.295271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-733bf956-72b4-43ea-b2db-bde4f0aabdb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:36.295896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-733bf956-72b4-43ea-b2db-bde4f0aabdb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:36.316683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-733bf956-72b4-43ea-b2db-bde4f0aabdb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:36.318833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-733bf956-72b4-43ea-b2db-bde4f0aabdb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:36.320370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-733bf956-72b4-43ea-b2db-bde4f0aabdb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:36.321118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-733bf956-72b4-43ea-b2db-bde4f0aabdb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:36.321929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-733bf956-72b4-43ea-b2db-bde4f0aabdb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:36.322564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-733bf956-72b4-43ea-b2db-bde4f0aabdb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:36.568236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-733bf956-72b4-43ea-b2db-bde4f0aabdb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:36.577998 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-733bf956-72b4-43ea-b2db-bde4f0aabdb0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1293 microversion: 2.1 time: 0.292037 Oct 05 17:49:36.581449 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2112/3966] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:36 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1293 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:37.611108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cb43f848-b48c-4838-a5ff-0ccc43b408f2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:37.611732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cb43f848-b48c-4838-a5ff-0ccc43b408f2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:37.630639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb43f848-b48c-4838-a5ff-0ccc43b408f2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:37.633455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb43f848-b48c-4838-a5ff-0ccc43b408f2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:37.637796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb43f848-b48c-4838-a5ff-0ccc43b408f2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:37.638869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb43f848-b48c-4838-a5ff-0ccc43b408f2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:37.639692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb43f848-b48c-4838-a5ff-0ccc43b408f2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:37.640441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb43f848-b48c-4838-a5ff-0ccc43b408f2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:37.835436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cb43f848-b48c-4838-a5ff-0ccc43b408f2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:37.847529 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cb43f848-b48c-4838-a5ff-0ccc43b408f2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1293 microversion: 2.1 time: 0.240709 Oct 05 17:49:37.849336 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1855/3967] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:37 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1293 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:38.875063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47418d0e-d8b6-4bb9-b061-24e4bd669198 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:38.876044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-47418d0e-d8b6-4bb9-b061-24e4bd669198 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:38.897706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47418d0e-d8b6-4bb9-b061-24e4bd669198 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:38.902266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47418d0e-d8b6-4bb9-b061-24e4bd669198 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:38.904291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47418d0e-d8b6-4bb9-b061-24e4bd669198 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:38.907502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47418d0e-d8b6-4bb9-b061-24e4bd669198 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:38.914524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47418d0e-d8b6-4bb9-b061-24e4bd669198 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:38.916247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47418d0e-d8b6-4bb9-b061-24e4bd669198 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:39.604073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-47418d0e-d8b6-4bb9-b061-24e4bd669198 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:39.640643 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-47418d0e-d8b6-4bb9-b061-24e4bd669198 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1361 microversion: 2.1 time: 0.768499 Oct 05 17:49:39.663693 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2113/3968] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:38 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1361 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:40.669747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-34086478-964e-45f5-8291-a5012bca3223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:40.670392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-34086478-964e-45f5-8291-a5012bca3223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:40.673174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:40.679769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34086478-964e-45f5-8291-a5012bca3223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:40.680260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34086478-964e-45f5-8291-a5012bca3223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:40.680692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34086478-964e-45f5-8291-a5012bca3223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:40.681390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34086478-964e-45f5-8291-a5012bca3223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:40.681841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34086478-964e-45f5-8291-a5012bca3223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:40.682260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34086478-964e-45f5-8291-a5012bca3223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:41.601644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-34086478-964e-45f5-8291-a5012bca3223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:41.615810 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-34086478-964e-45f5-8291-a5012bca3223 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1361 microversion: 2.1 time: 0.944980 Oct 05 17:49:41.617415 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1856/3969] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:40 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1361 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:42.642718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54f9b506-293b-44ca-8eb3-73325a072969 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:42.644111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54f9b506-293b-44ca-8eb3-73325a072969 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:42.662168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:42.673080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:42.678210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=10 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:42.686316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f9b506-293b-44ca-8eb3-73325a072969 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:42.687555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f9b506-293b-44ca-8eb3-73325a072969 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:42.688164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f9b506-293b-44ca-8eb3-73325a072969 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:42.690584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f9b506-293b-44ca-8eb3-73325a072969 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:42.694210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f9b506-293b-44ca-8eb3-73325a072969 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:42.694890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f9b506-293b-44ca-8eb3-73325a072969 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:42.709328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:43.345114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1892103087", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "df610d86-535b-4866-b6f5-1beaa840ab25"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:43.405302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] validate_networks() for [('df610d86-535b-4866-b6f5-1beaa840ab25', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:49:44.056565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54f9b506-293b-44ca-8eb3-73325a072969 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:44.065507 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54f9b506-293b-44ca-8eb3-73325a072969 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1361 microversion: 2.1 time: 1.427883 Oct 05 17:49:44.070142 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2114/3970] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:42 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1361 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:44.089701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7de5e25b-169e-4207-9916-0badb19304ca req-fce72be2-86dd-4290-96be-a7a9bfc95fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8dfe89-5f6e-4166-83c3-752427e390a7", "tag": "26bf0817-b57b-4c96-9c76-ea5de5ba9796"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:44.114499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7de5e25b-169e-4207-9916-0badb19304ca req-fce72be2-86dd-4290-96be-a7a9bfc95fef service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:44.120602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7de5e25b-169e-4207-9916-0badb19304ca req-fce72be2-86dd-4290-96be-a7a9bfc95fef service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:44.121325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7de5e25b-169e-4207-9916-0badb19304ca req-fce72be2-86dd-4290-96be-a7a9bfc95fef service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:44.167577 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7de5e25b-169e-4207-9916-0badb19304ca req-fce72be2-86dd-4290-96be-a7a9bfc95fef service nova] Creating event network-changed:26bf0817-b57b-4c96-9c76-ea5de5ba9796 for instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 on n-h1-835595-3 Oct 05 17:49:44.180726 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7de5e25b-169e-4207-9916-0badb19304ca req-fce72be2-86dd-4290-96be-a7a9bfc95fef service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108321 Oct 05 17:49:44.184118 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2115/3971] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:45.098380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f82966fe-1fd4-4424-9b8a-a0c424977355 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:45.099886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f82966fe-1fd4-4424-9b8a-a0c424977355 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:45.122222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f82966fe-1fd4-4424-9b8a-a0c424977355 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:45.122783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f82966fe-1fd4-4424-9b8a-a0c424977355 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:45.123234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f82966fe-1fd4-4424-9b8a-a0c424977355 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:45.123963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f82966fe-1fd4-4424-9b8a-a0c424977355 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:45.124428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f82966fe-1fd4-4424-9b8a-a0c424977355 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:45.124861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f82966fe-1fd4-4424-9b8a-a0c424977355 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:45.492746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f82966fe-1fd4-4424-9b8a-a0c424977355 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:45.501385 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f82966fe-1fd4-4424-9b8a-a0c424977355 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1361 microversion: 2.1 time: 0.408514 Oct 05 17:49:45.502182 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2116/3972] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:45 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:46.493200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:49:46.494255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:49:46.495118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:49:46.495738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:49:46.496392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:49:46.516495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:46.517213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:46.518460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:46.520279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:46.520963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:46.521505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:46.529250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-37c7344a-cc60-4e05-a6b8-c9109a2c637a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:46.530675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-37c7344a-cc60-4e05-a6b8-c9109a2c637a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:46.546831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37c7344a-cc60-4e05-a6b8-c9109a2c637a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:46.548687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37c7344a-cc60-4e05-a6b8-c9109a2c637a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:46.549729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37c7344a-cc60-4e05-a6b8-c9109a2c637a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:46.557152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37c7344a-cc60-4e05-a6b8-c9109a2c637a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:46.557152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37c7344a-cc60-4e05-a6b8-c9109a2c637a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:46.558009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37c7344a-cc60-4e05-a6b8-c9109a2c637a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:46.603952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Getting quotas for project 1727e2848ffa4220a26be5c4da3721f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:49:46.621278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Getting quotas for user cc543f2f785b49fc8a3f03f54c7d3049 and project 1727e2848ffa4220a26be5c4da3721f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:49:46.660257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:49:46.665130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:49:46.813401 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9b92193b-d183-4bea-8e95-66edca7d1d06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.155655 Oct 05 17:49:46.819262 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1857/3973] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:49:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4165 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:49:46.837177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7d39312f-b418-4852-a654-54894bda6511 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:46.838076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7d39312f-b418-4852-a654-54894bda6511 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:46.931547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-37c7344a-cc60-4e05-a6b8-c9109a2c637a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:46.942893 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-37c7344a-cc60-4e05-a6b8-c9109a2c637a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1361 microversion: 2.1 time: 0.417561 Oct 05 17:49:46.944006 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2117/3974] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:46 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1361 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:49:47.075374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d39312f-b418-4852-a654-54894bda6511 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:47.086935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d39312f-b418-4852-a654-54894bda6511 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:47.089159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d39312f-b418-4852-a654-54894bda6511 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:47.091788 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7d39312f-b418-4852-a654-54894bda6511 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1259 microversion: 2.21 time: 0.264761 Oct 05 17:49:47.093800 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1858/3975] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:49:46 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1259 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:49:47.973095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a4a4642c-494b-4729-90bf-fe526412e79f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:47.974568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a4a4642c-494b-4729-90bf-fe526412e79f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:48.003084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a4642c-494b-4729-90bf-fe526412e79f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:48.004017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a4642c-494b-4729-90bf-fe526412e79f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:48.011376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a4642c-494b-4729-90bf-fe526412e79f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:48.012613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a4642c-494b-4729-90bf-fe526412e79f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:48.014928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a4642c-494b-4729-90bf-fe526412e79f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:48.017469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a4642c-494b-4729-90bf-fe526412e79f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:48.121932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:48.122749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:48.135868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:48.136407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:48.136843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:48.163766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:48.164657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:48.165430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:48.406504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a4a4642c-494b-4729-90bf-fe526412e79f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:48.459681 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a4a4642c-494b-4729-90bf-fe526412e79f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1361 microversion: 2.1 time: 0.493597 Oct 05 17:49:48.461074 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2118/3976] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:47 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1361 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:48.720831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:48.734803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:48.740423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:48.744190 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9eb003a8-d257-4405-86ae-a8799af6ba06 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1263 microversion: 2.21 time: 0.626213 Oct 05 17:49:48.749559 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1859/3977] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:49:48 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1263 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:49:49.490108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e839066b-38af-40cd-8c3e-aa27ae5ac473 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:49.491096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e839066b-38af-40cd-8c3e-aa27ae5ac473 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:49.519600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e839066b-38af-40cd-8c3e-aa27ae5ac473 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:49.519972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e839066b-38af-40cd-8c3e-aa27ae5ac473 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:49.520413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e839066b-38af-40cd-8c3e-aa27ae5ac473 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:49.521135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e839066b-38af-40cd-8c3e-aa27ae5ac473 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:49.530509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e839066b-38af-40cd-8c3e-aa27ae5ac473 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:49.534489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e839066b-38af-40cd-8c3e-aa27ae5ac473 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:49.811377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:49.812231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:49.847981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:49.848606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:49.849061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:49.849810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:49.855086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:49.855627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:49.970522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e839066b-38af-40cd-8c3e-aa27ae5ac473 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:49.981758 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e839066b-38af-40cd-8c3e-aa27ae5ac473 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1361 microversion: 2.1 time: 0.497501 Oct 05 17:49:50.000401 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2119/3978] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:49 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1361 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:50.012276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c1d97d3f-3d8e-48a3-ad5f-2e42598e3d37 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05fe0a8e-b756-4ee9-9224-1072ba8f50df"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:50.015008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c1d97d3f-3d8e-48a3-ad5f-2e42598e3d37 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:50.055284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1d97d3f-3d8e-48a3-ad5f-2e42598e3d37 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:50.061219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1d97d3f-3d8e-48a3-ad5f-2e42598e3d37 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:50.064825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1d97d3f-3d8e-48a3-ad5f-2e42598e3d37 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:50.066331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1d97d3f-3d8e-48a3-ad5f-2e42598e3d37 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:50.066966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1d97d3f-3d8e-48a3-ad5f-2e42598e3d37 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:50.078249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c1d97d3f-3d8e-48a3-ad5f-2e42598e3d37 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:50.605312 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c1d97d3f-3d8e-48a3-ad5f-2e42598e3d37 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.603538 Oct 05 17:49:50.607239 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2120/3979] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 17:49:50 2022] POST /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 194 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:50.741385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:50.753925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:50.766104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:50.779781 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a54030f8-7a22-41ea-bc9c-350ebf8054ce tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1255 microversion: 2.21 time: 0.987888 Oct 05 17:49:50.780476 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1860/3980] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:49:49 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1255 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:49:51.011807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79cd7f27-7473-44cd-beee-8083c521412f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:51.012514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-79cd7f27-7473-44cd-beee-8083c521412f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:51.033288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cd7f27-7473-44cd-beee-8083c521412f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:51.033820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cd7f27-7473-44cd-beee-8083c521412f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:51.037367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cd7f27-7473-44cd-beee-8083c521412f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:51.040169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cd7f27-7473-44cd-beee-8083c521412f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:51.041343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cd7f27-7473-44cd-beee-8083c521412f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:51.041939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cd7f27-7473-44cd-beee-8083c521412f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:51.698762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79cd7f27-7473-44cd-beee-8083c521412f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:51.712973 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79cd7f27-7473-44cd-beee-8083c521412f tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1361 microversion: 2.1 time: 0.705935 Oct 05 17:49:51.725491 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2121/3981] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:51 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1361 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:51.805033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-8e8f8260-93aa-43f5-bf87-8b7308c47eea req-b3db4260-6e8b-4677-89a1-33379f3583f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8dfe89-5f6e-4166-83c3-752427e390a7", "name": "network-vif-plugged", "status": "completed", "tag": "26bf0817-b57b-4c96-9c76-ea5de5ba9796"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:51.810901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:51.811771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:51.833272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:51.834822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:51.837072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8e8f8260-93aa-43f5-bf87-8b7308c47eea req-b3db4260-6e8b-4677-89a1-33379f3583f5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:51.839951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8e8f8260-93aa-43f5-bf87-8b7308c47eea req-b3db4260-6e8b-4677-89a1-33379f3583f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:51.840709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8e8f8260-93aa-43f5-bf87-8b7308c47eea req-b3db4260-6e8b-4677-89a1-33379f3583f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:51.843738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:51.849694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:51.850961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:51.854628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:51.866044 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-8e8f8260-93aa-43f5-bf87-8b7308c47eea req-b3db4260-6e8b-4677-89a1-33379f3583f5 service nova] Creating event network-vif-plugged:26bf0817-b57b-4c96-9c76-ea5de5ba9796 for instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 on n-h1-835595-3 Oct 05 17:49:51.887863 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-8e8f8260-93aa-43f5-bf87-8b7308c47eea req-b3db4260-6e8b-4677-89a1-33379f3583f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090833 Oct 05 17:49:51.890835 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1861/3982] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:49:52.193564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:52.208194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:52.214487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:52.217359 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1d3a3825-1b98-438a-bc9e-9494e3b67925 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1317 microversion: 2.21 time: 0.412045 Oct 05 17:49:52.221812 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2122/3983] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:49:51 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:49:52.742699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6969a7ae-ed8b-4068-9cd0-916cb8b025c6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:52.743747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6969a7ae-ed8b-4068-9cd0-916cb8b025c6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:52.755206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6969a7ae-ed8b-4068-9cd0-916cb8b025c6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:52.757000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6969a7ae-ed8b-4068-9cd0-916cb8b025c6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:52.760100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6969a7ae-ed8b-4068-9cd0-916cb8b025c6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:52.761339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6969a7ae-ed8b-4068-9cd0-916cb8b025c6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:52.762321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6969a7ae-ed8b-4068-9cd0-916cb8b025c6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:52.764155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6969a7ae-ed8b-4068-9cd0-916cb8b025c6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:53.250893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:53.252345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:53.267991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:53.269261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:53.271854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:53.277643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:53.278529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:53.279181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:53.408785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:53.425576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:53.427507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:53.431081 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9bba4527-7407-4cb6-ac5b-657147288211 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1317 microversion: 2.21 time: 0.185553 Oct 05 17:49:53.434015 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2123/3984] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:49:53 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:49:54.008061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6969a7ae-ed8b-4068-9cd0-916cb8b025c6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:54.025801 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6969a7ae-ed8b-4068-9cd0-916cb8b025c6 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1361 microversion: 2.1 time: 1.285049 Oct 05 17:49:54.051098 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1862/3985] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:52 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1361 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:54.461357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:54.461988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:54.470372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:54.470877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:54.471368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:54.472072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:54.472678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:54.473419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:54.662163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:54.681113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:54.688399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:54.689713 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-91b0068f-b320-4f84-b2ef-4d2f16b27dad tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1317 microversion: 2.21 time: 0.232522 Oct 05 17:49:54.706481 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2124/3986] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:49:54 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:49:55.058139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-49d8e0df-d951-4c3c-8cb6-8ef15f35c5cf tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:55.059286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-49d8e0df-d951-4c3c-8cb6-8ef15f35c5cf tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:55.076619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d8e0df-d951-4c3c-8cb6-8ef15f35c5cf tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:55.077285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d8e0df-d951-4c3c-8cb6-8ef15f35c5cf tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:55.084155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d8e0df-d951-4c3c-8cb6-8ef15f35c5cf tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:55.087665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d8e0df-d951-4c3c-8cb6-8ef15f35c5cf tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:55.088300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d8e0df-d951-4c3c-8cb6-8ef15f35c5cf tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:55.088906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49d8e0df-d951-4c3c-8cb6-8ef15f35c5cf tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:55.728003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:55.729493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:55.742688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:55.743536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:55.750293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:55.751490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:55.752186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:55.752881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:55.851299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-49d8e0df-d951-4c3c-8cb6-8ef15f35c5cf tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:55.864029 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-49d8e0df-d951-4c3c-8cb6-8ef15f35c5cf tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1546 microversion: 2.1 time: 0.810377 Oct 05 17:49:55.880440 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1863/3987] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:49:55 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1546 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:49:55.896011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b2c8f89-66b5-4a5b-9218-d2cc45546ef2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:55.898681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b2c8f89-66b5-4a5b-9218-d2cc45546ef2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:55.916217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b2c8f89-66b5-4a5b-9218-d2cc45546ef2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:55.918915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b2c8f89-66b5-4a5b-9218-d2cc45546ef2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:55.919802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b2c8f89-66b5-4a5b-9218-d2cc45546ef2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:55.922150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b2c8f89-66b5-4a5b-9218-d2cc45546ef2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:55.924185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b2c8f89-66b5-4a5b-9218-d2cc45546ef2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:55.925063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b2c8f89-66b5-4a5b-9218-d2cc45546ef2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:55.960618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:55.982063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:55.985268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:55.987040 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3277aa88-ff90-43bf-92b4-062398bcc5b5 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1317 microversion: 2.21 time: 0.262962 Oct 05 17:49:55.991376 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2125/3988] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:49:55 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:49:56.389037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1652693057", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:56.427925 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b2c8f89-66b5-4a5b-9218-d2cc45546ef2 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.536896 Oct 05 17:49:56.428542 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1864/3989] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:49:55 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-interface => generated 284 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:49:56.495115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] validate_networks() for [('4e8e6cb3-fe8e-46c0-af83-a96d89af98dc', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:49:57.022505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:57.023466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:57.035779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:57.045401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:57.048065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:57.050813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:57.055193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:57.057983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:57.059619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:57.164420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:49:57.796883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:57.813125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:57.814645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:49:57.815891 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-778a78c3-9360-4062-bafc-6889232d118a tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1359 microversion: 2.21 time: 0.802693 Oct 05 17:49:57.833947 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1865/3990] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:49:57 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1359 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:49:58.808238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:49:58.809375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:49:58.810349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:49:58.811296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:49:58.812014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:49:58.846093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:58.849742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:58.855548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:58.857290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:58.864129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:58.870845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:58.888678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-517292798", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "9c0879dc-a92f-4aaa-9d7d-ab3fc0699df3"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:49:58.995207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Getting quotas for project 8dc71199181f4876b10ed4edfc9bd4c7. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:49:59.008793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Getting quotas for user 7dc3271f68f7486a9264c9ee4e3c1bc2 and project 8dc71199181f4876b10ed4edfc9bd4c7. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:49:59.040041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:49:59.046134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] validate_networks() for [('9c0879dc-a92f-4aaa-9d7d-ab3fc0699df3', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:49:59.059551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:49:59.219739 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4be604d1-fd0f-4ad8-ae46-bd4bb0073b5c tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.093332 Oct 05 17:49:59.221004 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2126/3991] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:49:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:49:59.595177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-afea2479-998d-49c3-847a-dae9a9824544 tempest-QuotaClassesAdminTestJSON-1183532166 tempest-QuotaClassesAdminTestJSON-1183532166-project-admin] Calling method '.version_select at 0x7f7774d12430>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:59.619394 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-afea2479-998d-49c3-847a-dae9a9824544 tempest-QuotaClassesAdminTestJSON-1183532166 tempest-QuotaClassesAdminTestJSON-1183532166-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.395501 Oct 05 17:49:59.620014 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2127/3992] 10.222.0.70 () {58 vars in 1185 bytes} [Wed Oct 5 17:49:59 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:49:59.624789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:49:59.625406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:49:59.642866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:59.644145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:59.644847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:49:59.648713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:49:59.649303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:49:59.650415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:01.833443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:01.844126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:01.850460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:01.851910 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-064f6f5c-5895-46b9-940b-9b828821aa18 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1359 microversion: 2.21 time: 2.230888 Oct 05 17:50:01.855134 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2128/3993] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:49:59 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1359 bytes in 2235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:01.866957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-2fa5d7e1-1262-40d4-8f7c-050a2ddb2dd6 req-5f4faaf5-8912-4a22-829e-6c453e53847c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef777d90-7d38-4c60-92ac-93f7cfe6698c", "tag": "f4692975-e35b-4b98-965a-42e65fe9ec86"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:01.891790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2fa5d7e1-1262-40d4-8f7c-050a2ddb2dd6 req-5f4faaf5-8912-4a22-829e-6c453e53847c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:01.892284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2fa5d7e1-1262-40d4-8f7c-050a2ddb2dd6 req-5f4faaf5-8912-4a22-829e-6c453e53847c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:01.892722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2fa5d7e1-1262-40d4-8f7c-050a2ddb2dd6 req-5f4faaf5-8912-4a22-829e-6c453e53847c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:01.921861 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-2fa5d7e1-1262-40d4-8f7c-050a2ddb2dd6 req-5f4faaf5-8912-4a22-829e-6c453e53847c service nova] Creating event network-changed:f4692975-e35b-4b98-965a-42e65fe9ec86 for instance ef777d90-7d38-4c60-92ac-93f7cfe6698c on n-h2-835595-3 Oct 05 17:50:01.938418 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-2fa5d7e1-1262-40d4-8f7c-050a2ddb2dd6 req-5f4faaf5-8912-4a22-829e-6c453e53847c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077010 Oct 05 17:50:01.939424 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2129/3994] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:01.961233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-881561a8-3aba-4d76-9ddc-6fc9eba65cb6 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:01.966125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-881561a8-3aba-4d76-9ddc-6fc9eba65cb6 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:01.983721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-881561a8-3aba-4d76-9ddc-6fc9eba65cb6 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:01.984047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-881561a8-3aba-4d76-9ddc-6fc9eba65cb6 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:01.984494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-881561a8-3aba-4d76-9ddc-6fc9eba65cb6 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:01.985224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-881561a8-3aba-4d76-9ddc-6fc9eba65cb6 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:01.985683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-881561a8-3aba-4d76-9ddc-6fc9eba65cb6 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:01.986106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-881561a8-3aba-4d76-9ddc-6fc9eba65cb6 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:02.165267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-881561a8-3aba-4d76-9ddc-6fc9eba65cb6 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:02.185602 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-881561a8-3aba-4d76-9ddc-6fc9eba65cb6 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1282 microversion: 2.1 time: 0.242165 Oct 05 17:50:02.191883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:50:02.192397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:50:02.192986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:50:02.193501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:50:02.194014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:50:02.195252 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2130/3995] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:01 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1282 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:02.205991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-52f9aa73-20b9-4c73-8969-09ba64d8a573 tempest-QuotaClassesAdminTestJSON-1183532166 tempest-QuotaClassesAdminTestJSON-1183532166-project-admin] Action: 'update', calling method: .version_select at 0x7f7775394790>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:02.210214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:02.213644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:02.216649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:02.217784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:02.218535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:02.219214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:02.280116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=58 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:02.307204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Getting quotas for project da744f7934fc474db0dff9f8fe7f98a6. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:02.320622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Getting quotas for user deca8f69371b4ecba637e3357501fc59 and project da744f7934fc474db0dff9f8fe7f98a6. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:02.354772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:50:02.357316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:50:02.492837 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1cd42784-c4c9-45c1-af99-e6a65f92349d tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.656922 Oct 05 17:50:02.497515 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1866/3996] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:49:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 4662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:50:02.505712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-34960d8b-bc5f-4d04-9f30-29c5738256bd req-eb4e9bfa-eb70-4175-bd13-dad7573cb669 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c8dfe89-5f6e-4166-83c3-752427e390a7", "tag": "26bf0817-b57b-4c96-9c76-ea5de5ba9796"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:02.575610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-34960d8b-bc5f-4d04-9f30-29c5738256bd req-eb4e9bfa-eb70-4175-bd13-dad7573cb669 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:02.578803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-34960d8b-bc5f-4d04-9f30-29c5738256bd req-eb4e9bfa-eb70-4175-bd13-dad7573cb669 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:02.580671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-34960d8b-bc5f-4d04-9f30-29c5738256bd req-eb4e9bfa-eb70-4175-bd13-dad7573cb669 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:02.609299 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-34960d8b-bc5f-4d04-9f30-29c5738256bd req-eb4e9bfa-eb70-4175-bd13-dad7573cb669 service nova] Creating event network-changed:26bf0817-b57b-4c96-9c76-ea5de5ba9796 for instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 on n-h1-835595-3 Oct 05 17:50:02.625657 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-34960d8b-bc5f-4d04-9f30-29c5738256bd req-eb4e9bfa-eb70-4175-bd13-dad7573cb669 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126629 Oct 05 17:50:02.626677 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1867/3997] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:02.641787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c5ce8ff-0df8-454a-9b1f-f5aa1d31d6a2 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:02.644045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9c5ce8ff-0df8-454a-9b1f-f5aa1d31d6a2 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:02.742170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=11,nova_api:UPDATE=11 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:02.858780 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-52f9aa73-20b9-4c73-8969-09ba64d8a573 tempest-QuotaClassesAdminTestJSON-1183532166 tempest-QuotaClassesAdminTestJSON-1183532166-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.662066 Oct 05 17:50:02.859909 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2131/3998] 10.222.0.70 () {60 vars in 1206 bytes} [Wed Oct 5 17:50:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:02.871230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f0212a5a-609a-45fa-9e90-822f795d6d1a tempest-QuotaClassesAdminTestJSON-1183532166 tempest-QuotaClassesAdminTestJSON-1183532166-project-admin] Calling method '.version_select at 0x7f777436c280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:02.917206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f0212a5a-609a-45fa-9e90-822f795d6d1a tempest-QuotaClassesAdminTestJSON-1183532166 tempest-QuotaClassesAdminTestJSON-1183532166-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.047258 Oct 05 17:50:02.919999 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2132/3999] 10.222.0.70 () {58 vars in 1185 bytes} [Wed Oct 5 17:50:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:02.933842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:02.936348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:02.971438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:02.973770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:02.974232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:02.982063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:02.982602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:02.983039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:03.016864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9c5ce8ff-0df8-454a-9b1f-f5aa1d31d6a2 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:03.032559 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9c5ce8ff-0df8-454a-9b1f-f5aa1d31d6a2 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1224 microversion: 2.1 time: 0.396819 Oct 05 17:50:03.034262 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1868/4000] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:02 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1224 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:03.047712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b9f5b82-0129-4919-bb82-ab339502cc5b tempest-QuotaClassesAdminTestJSON-1183532166 tempest-QuotaClassesAdminTestJSON-1183532166-project-admin] Action: 'update', calling method: .version_select at 0x7f777458ec10>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:03.384794 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b9f5b82-0129-4919-bb82-ab339502cc5b tempest-QuotaClassesAdminTestJSON-1183532166 tempest-QuotaClassesAdminTestJSON-1183532166-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.345080 Oct 05 17:50:03.388344 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1869/4001] 10.222.0.70 () {60 vars in 1206 bytes} [Wed Oct 5 17:50:03 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:03.405023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-22ab5db5-2f8b-43f5-89b5-90f31148aea2 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:03.407523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-22ab5db5-2f8b-43f5-89b5-90f31148aea2 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:03.421984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab5db5-2f8b-43f5-89b5-90f31148aea2 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:03.424062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab5db5-2f8b-43f5-89b5-90f31148aea2 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:03.426320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab5db5-2f8b-43f5-89b5-90f31148aea2 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:03.429370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab5db5-2f8b-43f5-89b5-90f31148aea2 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:03.430062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab5db5-2f8b-43f5-89b5-90f31148aea2 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:03.430712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab5db5-2f8b-43f5-89b5-90f31148aea2 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:03.462186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:03.483892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:03.485751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:03.499840 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90f8c5e2-2c5a-4dde-82e2-c82901fc8b96 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1359 microversion: 2.21 time: 0.578730 Oct 05 17:50:03.512460 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2133/4002] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:02 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1359 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:04.058580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8129c5af-c842-4e22-8fd5-e6d6947a1296 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:04.068507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8129c5af-c842-4e22-8fd5-e6d6947a1296 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:04.089556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c5af-c842-4e22-8fd5-e6d6947a1296 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:04.090061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c5af-c842-4e22-8fd5-e6d6947a1296 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:04.090525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c5af-c842-4e22-8fd5-e6d6947a1296 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:04.091245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c5af-c842-4e22-8fd5-e6d6947a1296 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:04.095636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c5af-c842-4e22-8fd5-e6d6947a1296 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:04.096239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8129c5af-c842-4e22-8fd5-e6d6947a1296 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:04.146985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:04.337463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-22ab5db5-2f8b-43f5-89b5-90f31148aea2 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:04.351753 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-22ab5db5-2f8b-43f5-89b5-90f31148aea2 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1282 microversion: 2.1 time: 0.954484 Oct 05 17:50:04.353133 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1870/4003] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:03 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1282 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:04.438777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8129c5af-c842-4e22-8fd5-e6d6947a1296 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:04.448763 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8129c5af-c842-4e22-8fd5-e6d6947a1296 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1276 microversion: 2.1 time: 0.394333 Oct 05 17:50:04.449374 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2134/4004] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:04 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1276 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:04.543568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:04.553874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:04.570631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:04.571536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:04.572662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:04.573554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:04.574188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:04.577528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:05.256264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:05.272617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:05.278472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:05.284801 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7c04c2e4-c2df-4740-b2f4-78121be5c9de tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1359 microversion: 2.21 time: 0.747433 Oct 05 17:50:05.287821 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1871/4005] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:04 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1359 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:05.379082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c649a67-1d56-41cc-ad2c-feff1e3e352f tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:05.379695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3c649a67-1d56-41cc-ad2c-feff1e3e352f tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:05.396993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c649a67-1d56-41cc-ad2c-feff1e3e352f tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:05.401467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c649a67-1d56-41cc-ad2c-feff1e3e352f tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:05.406017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c649a67-1d56-41cc-ad2c-feff1e3e352f tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:05.408671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c649a67-1d56-41cc-ad2c-feff1e3e352f tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:05.410688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c649a67-1d56-41cc-ad2c-feff1e3e352f tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:05.414434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c649a67-1d56-41cc-ad2c-feff1e3e352f tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:05.478511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-57fa9088-b94a-4239-a896-c1bd8c3bb0d6 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:05.479768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-57fa9088-b94a-4239-a896-c1bd8c3bb0d6 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:05.488289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57fa9088-b94a-4239-a896-c1bd8c3bb0d6 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:05.489330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57fa9088-b94a-4239-a896-c1bd8c3bb0d6 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:05.491243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57fa9088-b94a-4239-a896-c1bd8c3bb0d6 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:05.498138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57fa9088-b94a-4239-a896-c1bd8c3bb0d6 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:05.500043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57fa9088-b94a-4239-a896-c1bd8c3bb0d6 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:05.500676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57fa9088-b94a-4239-a896-c1bd8c3bb0d6 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:05.644832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-57fa9088-b94a-4239-a896-c1bd8c3bb0d6 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:05.657395 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-57fa9088-b94a-4239-a896-c1bd8c3bb0d6 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1282 microversion: 2.1 time: 0.187328 Oct 05 17:50:05.660596 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1872/4006] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:05 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1282 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:05.784842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3c649a67-1d56-41cc-ad2c-feff1e3e352f tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:05.803209 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c649a67-1d56-41cc-ad2c-feff1e3e352f tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1324 microversion: 2.1 time: 0.424928 Oct 05 17:50:05.828099 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2135/4007] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:05 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1324 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:06.310744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:06.311371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:06.329392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:06.329908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:06.330420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:06.332364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:06.333033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:06.333483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:06.683324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:06.691709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2def83e-f6c9-49b1-9ccc-32b7e4882810 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:06.692190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c2def83e-f6c9-49b1-9ccc-32b7e4882810 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:06.705090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:06.706794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:06.707974 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6eb37a70-1b71-4188-ae05-c6032c93bff4 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1359 microversion: 2.21 time: 0.401350 Oct 05 17:50:06.717392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2def83e-f6c9-49b1-9ccc-32b7e4882810 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:06.718188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2def83e-f6c9-49b1-9ccc-32b7e4882810 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:06.718851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2def83e-f6c9-49b1-9ccc-32b7e4882810 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:06.719743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2def83e-f6c9-49b1-9ccc-32b7e4882810 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:06.720362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2def83e-f6c9-49b1-9ccc-32b7e4882810 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:06.720947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2def83e-f6c9-49b1-9ccc-32b7e4882810 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:06.721469 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1873/4008] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:06 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1359 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:06.830952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c114365-6065-4fd5-a9b0-4c0ea5987443 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:06.831829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c114365-6065-4fd5-a9b0-4c0ea5987443 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:06.842886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c114365-6065-4fd5-a9b0-4c0ea5987443 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:06.848142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c114365-6065-4fd5-a9b0-4c0ea5987443 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:06.848891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c114365-6065-4fd5-a9b0-4c0ea5987443 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:06.849810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c114365-6065-4fd5-a9b0-4c0ea5987443 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:06.850507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c114365-6065-4fd5-a9b0-4c0ea5987443 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:06.851178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c114365-6065-4fd5-a9b0-4c0ea5987443 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:07.254249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c2def83e-f6c9-49b1-9ccc-32b7e4882810 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:07.266272 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2def83e-f6c9-49b1-9ccc-32b7e4882810 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1324 microversion: 2.1 time: 0.576082 Oct 05 17:50:07.267452 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2136/4009] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:06 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1324 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:07.283324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6d0d7318-6625-4e9b-9fd2-a2b4abe268b7 req-64d275cd-42f7-4f69-bd19-f34998ae1a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef777d90-7d38-4c60-92ac-93f7cfe6698c", "name": "network-vif-plugged", "status": "completed", "tag": "f4692975-e35b-4b98-965a-42e65fe9ec86"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:07.343287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6d0d7318-6625-4e9b-9fd2-a2b4abe268b7 req-64d275cd-42f7-4f69-bd19-f34998ae1a96 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:07.344050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6d0d7318-6625-4e9b-9fd2-a2b4abe268b7 req-64d275cd-42f7-4f69-bd19-f34998ae1a96 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:07.345089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6d0d7318-6625-4e9b-9fd2-a2b4abe268b7 req-64d275cd-42f7-4f69-bd19-f34998ae1a96 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:07.375723 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6d0d7318-6625-4e9b-9fd2-a2b4abe268b7 req-64d275cd-42f7-4f69-bd19-f34998ae1a96 service nova] Creating event network-vif-plugged:f4692975-e35b-4b98-965a-42e65fe9ec86 for instance ef777d90-7d38-4c60-92ac-93f7cfe6698c on n-h2-835595-3 Oct 05 17:50:07.410868 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6d0d7318-6625-4e9b-9fd2-a2b4abe268b7 req-64d275cd-42f7-4f69-bd19-f34998ae1a96 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135884 Oct 05 17:50:07.412454 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2137/4010] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:07.735220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:07.736573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:07.759695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:07.760194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:07.760645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:07.761366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:07.761824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:07.762247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:08.010606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6c114365-6065-4fd5-a9b0-4c0ea5987443 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:08.025549 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c114365-6065-4fd5-a9b0-4c0ea5987443 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1324 microversion: 2.1 time: 1.200028 Oct 05 17:50:08.026153 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1874/4011] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:06 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1324 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:08.051236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d0472d40-5d51-4172-9678-db7279fb0eb1 req-2faa0a97-2907-4334-803c-48e68e2c9c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110c65b6-160a-482d-8dea-cd00fba96314", "tag": "e2dd34af-8a8d-4ea8-a9ca-1fda98cabd70"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:08.078339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d0472d40-5d51-4172-9678-db7279fb0eb1 req-2faa0a97-2907-4334-803c-48e68e2c9c23 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:08.078839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d0472d40-5d51-4172-9678-db7279fb0eb1 req-2faa0a97-2907-4334-803c-48e68e2c9c23 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:08.079279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d0472d40-5d51-4172-9678-db7279fb0eb1 req-2faa0a97-2907-4334-803c-48e68e2c9c23 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:08.125591 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d0472d40-5d51-4172-9678-db7279fb0eb1 req-2faa0a97-2907-4334-803c-48e68e2c9c23 service nova] Creating event network-changed:e2dd34af-8a8d-4ea8-a9ca-1fda98cabd70 for instance 110c65b6-160a-482d-8dea-cd00fba96314 on n-h1-835595-3 Oct 05 17:50:08.135404 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d0472d40-5d51-4172-9678-db7279fb0eb1 req-2faa0a97-2907-4334-803c-48e68e2c9c23 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099105 Oct 05 17:50:08.136742 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1875/4012] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:08.291801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f434c49a-372c-426c-bc19-5c547f5e822c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:08.292648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f434c49a-372c-426c-bc19-5c547f5e822c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:08.306552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f434c49a-372c-426c-bc19-5c547f5e822c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:08.307606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f434c49a-372c-426c-bc19-5c547f5e822c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:08.308268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f434c49a-372c-426c-bc19-5c547f5e822c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:08.309648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f434c49a-372c-426c-bc19-5c547f5e822c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:08.310741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f434c49a-372c-426c-bc19-5c547f5e822c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:08.311460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f434c49a-372c-426c-bc19-5c547f5e822c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:08.388094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:08.417120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:08.422393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:08.426225 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4f6db4c9-4199-4a64-8536-7b819a688596 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1359 microversion: 2.21 time: 0.696151 Oct 05 17:50:08.427757 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2138/4013] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:07 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1359 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:08.730335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f434c49a-372c-426c-bc19-5c547f5e822c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:08.740422 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f434c49a-372c-426c-bc19-5c547f5e822c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1324 microversion: 2.1 time: 0.453161 Oct 05 17:50:08.755460 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1876/4014] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:08 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1324 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:09.049528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2088423e-e0d0-401f-a317-8413f3edab72 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:09.050752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2088423e-e0d0-401f-a317-8413f3edab72 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:09.053747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:09.062350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2088423e-e0d0-401f-a317-8413f3edab72 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:09.063019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2088423e-e0d0-401f-a317-8413f3edab72 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:09.063612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2088423e-e0d0-401f-a317-8413f3edab72 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:09.064470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2088423e-e0d0-401f-a317-8413f3edab72 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:09.065139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2088423e-e0d0-401f-a317-8413f3edab72 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:09.065701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2088423e-e0d0-401f-a317-8413f3edab72 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:09.131364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ac599c54-c865-42a6-a39d-a38f5a359b26 req-c90bd2b3-4084-486f-999e-0cc6e11b1e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3000d510-2d71-4508-bf70-8fa1fb68aaf5", "tag": "edac4d90-7c6e-4bce-a12d-79f4677577e2"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:09.165747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ac599c54-c865-42a6-a39d-a38f5a359b26 req-c90bd2b3-4084-486f-999e-0cc6e11b1e2b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:09.166259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ac599c54-c865-42a6-a39d-a38f5a359b26 req-c90bd2b3-4084-486f-999e-0cc6e11b1e2b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:09.166741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ac599c54-c865-42a6-a39d-a38f5a359b26 req-c90bd2b3-4084-486f-999e-0cc6e11b1e2b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:09.211187 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ac599c54-c865-42a6-a39d-a38f5a359b26 req-c90bd2b3-4084-486f-999e-0cc6e11b1e2b service nova] Creating event network-changed:edac4d90-7c6e-4bce-a12d-79f4677577e2 for instance 3000d510-2d71-4508-bf70-8fa1fb68aaf5 on n-h2-835595-3 Oct 05 17:50:09.225990 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ac599c54-c865-42a6-a39d-a38f5a359b26 req-c90bd2b3-4084-486f-999e-0cc6e11b1e2b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098071 Oct 05 17:50:09.249412 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1877/4015] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:09.618513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-298171566", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:09.631386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=12 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:09.693013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2088423e-e0d0-401f-a317-8413f3edab72 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:09.707622 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2088423e-e0d0-401f-a317-8413f3edab72 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1324 microversion: 2.1 time: 0.662242 Oct 05 17:50:09.714786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:50:09.718876 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2139/4016] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:09 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1324 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:09.731970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:09.733858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:09.744193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:09.744722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:09.745167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:09.746089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:09.746733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:09.747523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:10.133706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:50:10.135026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:50:10.135671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:50:10.136297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:50:10.136848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:50:10.152080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:10.152860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:10.153458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:10.154421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:10.155447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:10.156042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:10.183985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:10.191870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:10.207944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:50:10.210676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:50:10.287888 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b4679f9-fa10-4808-84c0-8fe89b40807f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953110 Oct 05 17:50:10.289233 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1878/4017] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:50:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 17:50:10.301462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c4e14fd-2344-43e1-9589-aad1af825731 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:10.302098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7c4e14fd-2344-43e1-9589-aad1af825731 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:10.314155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:10.331230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:10.332447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:10.333661 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5bf2faa8-ac73-4757-8835-f05c3c9d8935 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1551 microversion: 2.21 time: 0.613573 Oct 05 17:50:10.334236 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2140/4018] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:09 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1551 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:10.346658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c4e14fd-2344-43e1-9589-aad1af825731 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:10.347618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c4e14fd-2344-43e1-9589-aad1af825731 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:10.348076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c4e14fd-2344-43e1-9589-aad1af825731 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:10.356217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c4e14fd-2344-43e1-9589-aad1af825731 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:10.357168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c4e14fd-2344-43e1-9589-aad1af825731 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:10.357702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c4e14fd-2344-43e1-9589-aad1af825731 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:10.372147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-afbef716-93b3-4413-a894-49b4a2ab4b81 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:10.372773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-afbef716-93b3-4413-a894-49b4a2ab4b81 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:10.616488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-afbef716-93b3-4413-a894-49b4a2ab4b81 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:10.625504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-afbef716-93b3-4413-a894-49b4a2ab4b81 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1216 microversion: 2.1 time: 0.269891 Oct 05 17:50:10.644279 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2141/4019] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:10 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1216 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:10.660381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2cb0160-f0cd-46b3-8876-e15126af9a32 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:10.661527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c2cb0160-f0cd-46b3-8876-e15126af9a32 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:10.677218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2cb0160-f0cd-46b3-8876-e15126af9a32 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:10.677727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2cb0160-f0cd-46b3-8876-e15126af9a32 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:10.678162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2cb0160-f0cd-46b3-8876-e15126af9a32 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:10.678912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2cb0160-f0cd-46b3-8876-e15126af9a32 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:10.679374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2cb0160-f0cd-46b3-8876-e15126af9a32 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:10.679800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2cb0160-f0cd-46b3-8876-e15126af9a32 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:10.767550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c2cb0160-f0cd-46b3-8876-e15126af9a32 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:50:10.852331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7c4e14fd-2344-43e1-9589-aad1af825731 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:10.873051 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7c4e14fd-2344-43e1-9589-aad1af825731 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1324 microversion: 2.1 time: 0.573264 Oct 05 17:50:10.874039 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1879/4020] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:10 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1324 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:10.887801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dd4c2c71-5d1d-41b0-9e36-fba50b174a3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:10.893649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dd4c2c71-5d1d-41b0-9e36-fba50b174a3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:10.916375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd4c2c71-5d1d-41b0-9e36-fba50b174a3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:10.917122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd4c2c71-5d1d-41b0-9e36-fba50b174a3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:10.917727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd4c2c71-5d1d-41b0-9e36-fba50b174a3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:10.918877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd4c2c71-5d1d-41b0-9e36-fba50b174a3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:10.922991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd4c2c71-5d1d-41b0-9e36-fba50b174a3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:10.936644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd4c2c71-5d1d-41b0-9e36-fba50b174a3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:10.982548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-dd4c2c71-5d1d-41b0-9e36-fba50b174a3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lazy-loading 'flavor' on Instance uuid 306c41c5-0f1e-4812-a54d-c31fc031c7d1 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:50:11.054663 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2cb0160-f0cd-46b3-8876-e15126af9a32 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 204 len: 0 microversion: 2.21 time: 0.408460 Oct 05 17:50:11.059871 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2142/4021] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:50:10 2022] DELETE /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:50:11.072442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f7105fc-f8ec-4891-825c-7f77c4fccb7a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:11.075303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8f7105fc-f8ec-4891-825c-7f77c4fccb7a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:11.093998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7105fc-f8ec-4891-825c-7f77c4fccb7a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:11.095387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7105fc-f8ec-4891-825c-7f77c4fccb7a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:11.096173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7105fc-f8ec-4891-825c-7f77c4fccb7a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:11.101866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7105fc-f8ec-4891-825c-7f77c4fccb7a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:11.103121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7105fc-f8ec-4891-825c-7f77c4fccb7a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:11.103784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7105fc-f8ec-4891-825c-7f77c4fccb7a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:11.246134 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dd4c2c71-5d1d-41b0-9e36-fba50b174a3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/action" status: 200 len: 32 microversion: 2.1 time: 0.369135 Oct 05 17:50:11.248136 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1880/4022] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:50:10 2022] POST /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/action => generated 32 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:50:11.263293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:11.264903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:11.296466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:11.296976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:11.297419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:11.300759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:11.301482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:11.304245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:11.473351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8f7105fc-f8ec-4891-825c-7f77c4fccb7a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:11.486068 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f7105fc-f8ec-4891-825c-7f77c4fccb7a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1324 microversion: 2.1 time: 0.424299 Oct 05 17:50:11.486968 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2143/4023] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:11 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1324 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:11.508032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2c30b38f-8872-48ba-9bbe-7bd41b82419c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:11.511945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2c30b38f-8872-48ba-9bbe-7bd41b82419c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:11.521305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c30b38f-8872-48ba-9bbe-7bd41b82419c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:11.522118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c30b38f-8872-48ba-9bbe-7bd41b82419c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:11.522979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c30b38f-8872-48ba-9bbe-7bd41b82419c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:11.524020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c30b38f-8872-48ba-9bbe-7bd41b82419c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:11.524836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c30b38f-8872-48ba-9bbe-7bd41b82419c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:11.526101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c30b38f-8872-48ba-9bbe-7bd41b82419c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:11.746234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2c30b38f-8872-48ba-9bbe-7bd41b82419c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:11.757122 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2c30b38f-8872-48ba-9bbe-7bd41b82419c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.268896 Oct 05 17:50:11.758175 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2144/4024] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:11 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:11.782429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f5e0003-0d60-480c-9a8c-a10ca42c31b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:11.783107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f5e0003-0d60-480c-9a8c-a10ca42c31b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:11.791962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5e0003-0d60-480c-9a8c-a10ca42c31b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:11.792469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5e0003-0d60-480c-9a8c-a10ca42c31b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:11.804306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5e0003-0d60-480c-9a8c-a10ca42c31b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:11.809660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5e0003-0d60-480c-9a8c-a10ca42c31b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:11.811453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5e0003-0d60-480c-9a8c-a10ca42c31b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:11.811860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5e0003-0d60-480c-9a8c-a10ca42c31b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:11.950659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f5e0003-0d60-480c-9a8c-a10ca42c31b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:11.960966 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f5e0003-0d60-480c-9a8c-a10ca42c31b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1268 microversion: 2.1 time: 0.184608 Oct 05 17:50:11.977556 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2145/4025] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:11 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1268 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:11.982876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8aa7e4b5-2fb0-4aef-b82a-e8d495ca3cc1 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:11.983509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8aa7e4b5-2fb0-4aef-b82a-e8d495ca3cc1 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:11.990900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8aa7e4b5-2fb0-4aef-b82a-e8d495ca3cc1 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:11.991405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8aa7e4b5-2fb0-4aef-b82a-e8d495ca3cc1 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:11.992165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8aa7e4b5-2fb0-4aef-b82a-e8d495ca3cc1 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:11.992874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8aa7e4b5-2fb0-4aef-b82a-e8d495ca3cc1 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:11.993330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8aa7e4b5-2fb0-4aef-b82a-e8d495ca3cc1 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:11.996244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8aa7e4b5-2fb0-4aef-b82a-e8d495ca3cc1 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:12.063341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:12.073684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:12.076249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:12.077667 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-41e45d19-115d-4262-8f66-c2da3a434765 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1557 microversion: 2.21 time: 0.824451 Oct 05 17:50:12.078809 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1881/4026] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:11 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1557 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:12.181329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8aa7e4b5-2fb0-4aef-b82a-e8d495ca3cc1 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:12.189691 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8aa7e4b5-2fb0-4aef-b82a-e8d495ca3cc1 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1324 microversion: 2.1 time: 0.210882 Oct 05 17:50:12.191417 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2146/4027] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:11 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1324 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:12.509465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-997023b7-aa20-4130-b6fb-57ed88905da0 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:12.510836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-997023b7-aa20-4130-b6fb-57ed88905da0 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:12.523783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-997023b7-aa20-4130-b6fb-57ed88905da0 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:12.524670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-997023b7-aa20-4130-b6fb-57ed88905da0 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:12.527295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-997023b7-aa20-4130-b6fb-57ed88905da0 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:12.528197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-997023b7-aa20-4130-b6fb-57ed88905da0 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:12.528793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-997023b7-aa20-4130-b6fb-57ed88905da0 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:12.530941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-997023b7-aa20-4130-b6fb-57ed88905da0 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:12.781285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2a9b157-56ca-4374-a1a2-6f336538903f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:12.782055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f2a9b157-56ca-4374-a1a2-6f336538903f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:12.788810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2a9b157-56ca-4374-a1a2-6f336538903f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:12.789444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2a9b157-56ca-4374-a1a2-6f336538903f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:12.789983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2a9b157-56ca-4374-a1a2-6f336538903f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:12.791138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2a9b157-56ca-4374-a1a2-6f336538903f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:12.793505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2a9b157-56ca-4374-a1a2-6f336538903f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:12.794050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2a9b157-56ca-4374-a1a2-6f336538903f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:12.825064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-997023b7-aa20-4130-b6fb-57ed88905da0 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:12.835187 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-997023b7-aa20-4130-b6fb-57ed88905da0 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1324 microversion: 2.1 time: 0.329874 Oct 05 17:50:12.836110 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1882/4028] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:12 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:12.998094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-30c1fe1e-843b-4f7e-8561-5c34a00a5d7f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:12.999100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30c1fe1e-843b-4f7e-8561-5c34a00a5d7f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:13.008155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c1fe1e-843b-4f7e-8561-5c34a00a5d7f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:13.011944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c1fe1e-843b-4f7e-8561-5c34a00a5d7f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:13.013041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c1fe1e-843b-4f7e-8561-5c34a00a5d7f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:13.014502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c1fe1e-843b-4f7e-8561-5c34a00a5d7f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:13.015757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c1fe1e-843b-4f7e-8561-5c34a00a5d7f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:13.016445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30c1fe1e-843b-4f7e-8561-5c34a00a5d7f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:13.041196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f2a9b157-56ca-4374-a1a2-6f336538903f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:13.049876 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f2a9b157-56ca-4374-a1a2-6f336538903f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.272830 Oct 05 17:50:13.053825 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2147/4029] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:12 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:13.109750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:13.112018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:13.124215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:13.125520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:13.126253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:13.127400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:13.128448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:13.130245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:13.200157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-30c1fe1e-843b-4f7e-8561-5c34a00a5d7f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:13.222898 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-30c1fe1e-843b-4f7e-8561-5c34a00a5d7f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1274 microversion: 2.1 time: 0.237468 Oct 05 17:50:13.227685 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1883/4030] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:12 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:13.248418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-acbfb7bd-00b0-4bff-8140-080dab514dce tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:13.249344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-acbfb7bd-00b0-4bff-8140-080dab514dce tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:13.263965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbfb7bd-00b0-4bff-8140-080dab514dce tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:13.265214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbfb7bd-00b0-4bff-8140-080dab514dce tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:13.265912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbfb7bd-00b0-4bff-8140-080dab514dce tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:13.267098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbfb7bd-00b0-4bff-8140-080dab514dce tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:13.268936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbfb7bd-00b0-4bff-8140-080dab514dce tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:13.269685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acbfb7bd-00b0-4bff-8140-080dab514dce tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:13.431706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:13.447685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:13.449988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:13.451520 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f790750-9ded-4837-b86c-5bad52930a16 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1557 microversion: 2.21 time: 0.346483 Oct 05 17:50:13.454995 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2148/4031] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:13 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1557 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:50:13.552519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d5ae09ca-f43d-4005-8bfd-21be326e9154 req-0d03fd77-bb3c-4a93-bcef-16cbd0231a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110c65b6-160a-482d-8dea-cd00fba96314", "name": "network-vif-plugged", "status": "completed", "tag": "e2dd34af-8a8d-4ea8-a9ca-1fda98cabd70"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:13.573099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d5ae09ca-f43d-4005-8bfd-21be326e9154 req-0d03fd77-bb3c-4a93-bcef-16cbd0231a30 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:13.573748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d5ae09ca-f43d-4005-8bfd-21be326e9154 req-0d03fd77-bb3c-4a93-bcef-16cbd0231a30 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:13.574326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d5ae09ca-f43d-4005-8bfd-21be326e9154 req-0d03fd77-bb3c-4a93-bcef-16cbd0231a30 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:13.599894 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d5ae09ca-f43d-4005-8bfd-21be326e9154 req-0d03fd77-bb3c-4a93-bcef-16cbd0231a30 service nova] Creating event network-vif-plugged:e2dd34af-8a8d-4ea8-a9ca-1fda98cabd70 for instance 110c65b6-160a-482d-8dea-cd00fba96314 on n-h1-835595-3 Oct 05 17:50:13.605402 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d5ae09ca-f43d-4005-8bfd-21be326e9154 req-0d03fd77-bb3c-4a93-bcef-16cbd0231a30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058460 Oct 05 17:50:13.606653 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2149/4032] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:50:13.860423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e732ea6d-92ad-4275-b746-4bbde64f65c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:13.861996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e732ea6d-92ad-4275-b746-4bbde64f65c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:13.868372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e732ea6d-92ad-4275-b746-4bbde64f65c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:13.868878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e732ea6d-92ad-4275-b746-4bbde64f65c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:13.869312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e732ea6d-92ad-4275-b746-4bbde64f65c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:13.870042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e732ea6d-92ad-4275-b746-4bbde64f65c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:13.870484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e732ea6d-92ad-4275-b746-4bbde64f65c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:13.870944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e732ea6d-92ad-4275-b746-4bbde64f65c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:14.093562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e732ea6d-92ad-4275-b746-4bbde64f65c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:14.108572 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e732ea6d-92ad-4275-b746-4bbde64f65c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1324 microversion: 2.1 time: 0.251546 Oct 05 17:50:14.126367 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2150/4033] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:13 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1324 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:14.134331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7a96b337-889d-4ce3-980c-7e41e438d2ca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:14.135059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7a96b337-889d-4ce3-980c-7e41e438d2ca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:14.142073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a96b337-889d-4ce3-980c-7e41e438d2ca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:14.142962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a96b337-889d-4ce3-980c-7e41e438d2ca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:14.144104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a96b337-889d-4ce3-980c-7e41e438d2ca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:14.145263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a96b337-889d-4ce3-980c-7e41e438d2ca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:14.145929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a96b337-889d-4ce3-980c-7e41e438d2ca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:14.146645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a96b337-889d-4ce3-980c-7e41e438d2ca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:14.178450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-acbfb7bd-00b0-4bff-8140-080dab514dce tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:14.193237 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-acbfb7bd-00b0-4bff-8140-080dab514dce tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1324 microversion: 2.1 time: 0.963923 Oct 05 17:50:14.207060 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1884/4034] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:13 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1324 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:14.251585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5d8118b6-d04a-4e64-999e-39aa830a4185 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:14.252473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5d8118b6-d04a-4e64-999e-39aa830a4185 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:14.259352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d8118b6-d04a-4e64-999e-39aa830a4185 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:14.260075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d8118b6-d04a-4e64-999e-39aa830a4185 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:14.260696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d8118b6-d04a-4e64-999e-39aa830a4185 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:14.261552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d8118b6-d04a-4e64-999e-39aa830a4185 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:14.262350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d8118b6-d04a-4e64-999e-39aa830a4185 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:14.263007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d8118b6-d04a-4e64-999e-39aa830a4185 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:14.388311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7a96b337-889d-4ce3-980c-7e41e438d2ca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:14.398339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:14.401722 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7a96b337-889d-4ce3-980c-7e41e438d2ca tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.273849 Oct 05 17:50:14.403346 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2151/4035] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:14 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:14.477264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:14.478594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:14.494723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:14.496894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:14.497520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:14.502667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:14.503434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:14.503901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:14.518425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5d8118b6-d04a-4e64-999e-39aa830a4185 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:14.532979 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5d8118b6-d04a-4e64-999e-39aa830a4185 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1274 microversion: 2.1 time: 0.282707 Oct 05 17:50:14.533732 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1885/4036] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:14 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1274 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:14.746151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:14.756153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:14.758846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:14.760108 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e21aa47-d546-4122-b7d4-26411ba6be24 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1557 microversion: 2.21 time: 0.286897 Oct 05 17:50:14.761043 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2152/4037] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:14 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1557 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:15.133245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c85b74c4-812c-4080-8988-5e3c7df2b6fd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:15.134167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c85b74c4-812c-4080-8988-5e3c7df2b6fd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:15.144216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c85b74c4-812c-4080-8988-5e3c7df2b6fd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:15.144985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c85b74c4-812c-4080-8988-5e3c7df2b6fd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:15.146787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c85b74c4-812c-4080-8988-5e3c7df2b6fd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:15.147816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c85b74c4-812c-4080-8988-5e3c7df2b6fd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:15.149651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c85b74c4-812c-4080-8988-5e3c7df2b6fd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:15.151104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c85b74c4-812c-4080-8988-5e3c7df2b6fd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:15.162828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:15.221862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7837c359-33dc-40b2-b94c-3732e8e9f792 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:15.222849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7837c359-33dc-40b2-b94c-3732e8e9f792 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:15.233958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7837c359-33dc-40b2-b94c-3732e8e9f792 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:15.236699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7837c359-33dc-40b2-b94c-3732e8e9f792 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:15.237267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7837c359-33dc-40b2-b94c-3732e8e9f792 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:15.240357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7837c359-33dc-40b2-b94c-3732e8e9f792 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:15.241103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7837c359-33dc-40b2-b94c-3732e8e9f792 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:15.242178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7837c359-33dc-40b2-b94c-3732e8e9f792 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:15.729834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c85b74c4-812c-4080-8988-5e3c7df2b6fd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:15.749479 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c85b74c4-812c-4080-8988-5e3c7df2b6fd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1324 microversion: 2.1 time: 0.612047 Oct 05 17:50:15.763151 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1886/4038] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:15 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1324 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:15.805895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f75bcd99-8858-48b2-8cb4-7142c691765e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:15.806764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f75bcd99-8858-48b2-8cb4-7142c691765e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:15.810354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7837c359-33dc-40b2-b94c-3732e8e9f792 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:15.822074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7837c359-33dc-40b2-b94c-3732e8e9f792 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1324 microversion: 2.1 time: 0.605430 Oct 05 17:50:15.841013 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2153/4039] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:15 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1324 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:15.854167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75bcd99-8858-48b2-8cb4-7142c691765e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:15.859183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75bcd99-8858-48b2-8cb4-7142c691765e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:15.860381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75bcd99-8858-48b2-8cb4-7142c691765e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:15.862217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75bcd99-8858-48b2-8cb4-7142c691765e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:15.862416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f692f763-af20-4f26-b671-e61518f40127 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:15.863323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f692f763-af20-4f26-b671-e61518f40127 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:15.864254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75bcd99-8858-48b2-8cb4-7142c691765e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:15.865624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f75bcd99-8858-48b2-8cb4-7142c691765e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:15.888170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f692f763-af20-4f26-b671-e61518f40127 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:15.890765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f692f763-af20-4f26-b671-e61518f40127 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:15.892435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f692f763-af20-4f26-b671-e61518f40127 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:15.897462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f692f763-af20-4f26-b671-e61518f40127 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:15.898175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f692f763-af20-4f26-b671-e61518f40127 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:15.937896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f692f763-af20-4f26-b671-e61518f40127 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:16.388440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f692f763-af20-4f26-b671-e61518f40127 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:16.398081 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f692f763-af20-4f26-b671-e61518f40127 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1316 microversion: 2.1 time: 0.555601 Oct 05 17:50:16.398712 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2154/4040] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:15 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1316 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:16.407118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-fffe3323-2840-47e0-8fcf-6109e168eebe req-8fa50fb6-d249-4aa5-ab5f-597ee175fd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef777d90-7d38-4c60-92ac-93f7cfe6698c", "name": "network-vif-deleted", "tag": "f4692975-e35b-4b98-965a-42e65fe9ec86"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:16.444613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fffe3323-2840-47e0-8fcf-6109e168eebe req-8fa50fb6-d249-4aa5-ab5f-597ee175fd09 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:16.445125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fffe3323-2840-47e0-8fcf-6109e168eebe req-8fa50fb6-d249-4aa5-ab5f-597ee175fd09 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:16.445560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fffe3323-2840-47e0-8fcf-6109e168eebe req-8fa50fb6-d249-4aa5-ab5f-597ee175fd09 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:16.483001 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-fffe3323-2840-47e0-8fcf-6109e168eebe req-8fa50fb6-d249-4aa5-ab5f-597ee175fd09 service nova] Creating event network-vif-deleted:f4692975-e35b-4b98-965a-42e65fe9ec86 for instance ef777d90-7d38-4c60-92ac-93f7cfe6698c on n-h2-835595-3 Oct 05 17:50:16.493086 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-fffe3323-2840-47e0-8fcf-6109e168eebe req-8fa50fb6-d249-4aa5-ab5f-597ee175fd09 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091893 Oct 05 17:50:16.494015 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2155/4041] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:16.508185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:16.509413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:16.526813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:16.527310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:16.529102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:16.535254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:16.535908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:16.536502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:16.536814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f75bcd99-8858-48b2-8cb4-7142c691765e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:16.562828 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f75bcd99-8858-48b2-8cb4-7142c691765e tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.793816 Oct 05 17:50:16.571836 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1887/4042] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:15 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:16.578000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6397de6a-3278-4f88-a567-95c58c005a6b req-e14826fd-a5d7-417b-b738-898e259adf7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3000d510-2d71-4508-bf70-8fa1fb68aaf5", "name": "network-vif-plugged", "status": "completed", "tag": "edac4d90-7c6e-4bce-a12d-79f4677577e2"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:16.602926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6397de6a-3278-4f88-a567-95c58c005a6b req-e14826fd-a5d7-417b-b738-898e259adf7c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:16.603473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6397de6a-3278-4f88-a567-95c58c005a6b req-e14826fd-a5d7-417b-b738-898e259adf7c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:16.603980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6397de6a-3278-4f88-a567-95c58c005a6b req-e14826fd-a5d7-417b-b738-898e259adf7c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:16.604150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:16.604645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:16.605342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:16.608292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lazy-loading 'fault' on Instance uuid ef777d90-7d38-4c60-92ac-93f7cfe6698c {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:50:16.622312 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6397de6a-3278-4f88-a567-95c58c005a6b req-e14826fd-a5d7-417b-b738-898e259adf7c service nova] Creating event network-vif-plugged:edac4d90-7c6e-4bce-a12d-79f4677577e2 for instance 3000d510-2d71-4508-bf70-8fa1fb68aaf5 on n-h2-835595-3 Oct 05 17:50:16.633347 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6397de6a-3278-4f88-a567-95c58c005a6b req-e14826fd-a5d7-417b-b738-898e259adf7c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060047 Oct 05 17:50:16.639682 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1888/4043] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:16.710828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:16.721408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:16.725960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cc543f2f785b49fc8a3f03f54c7d3049', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1727e2848ffa4220a26be5c4da3721f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:16.730655 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7e16bbdf-61b9-472d-93ed-5e051cfb1934 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 200 len: 1349 microversion: 2.21 time: 0.234767 Oct 05 17:50:16.731258 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2156/4044] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:16 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 1349 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:16.775682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d472be8f-e2d3-4f96-bc69-4e9293b617d9 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:16.776950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d472be8f-e2d3-4f96-bc69-4e9293b617d9 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:16.784152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d472be8f-e2d3-4f96-bc69-4e9293b617d9 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:16.784884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d472be8f-e2d3-4f96-bc69-4e9293b617d9 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:16.785723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d472be8f-e2d3-4f96-bc69-4e9293b617d9 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:16.786670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d472be8f-e2d3-4f96-bc69-4e9293b617d9 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:16.787320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d472be8f-e2d3-4f96-bc69-4e9293b617d9 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:16.787942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d472be8f-e2d3-4f96-bc69-4e9293b617d9 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:16.852023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e55601a-16a6-4107-b8f6-dc2912160ed9 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:16.852631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5e55601a-16a6-4107-b8f6-dc2912160ed9 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:16.862893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e55601a-16a6-4107-b8f6-dc2912160ed9 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:16.863443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e55601a-16a6-4107-b8f6-dc2912160ed9 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:16.863882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e55601a-16a6-4107-b8f6-dc2912160ed9 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:16.864589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e55601a-16a6-4107-b8f6-dc2912160ed9 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:16.865042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e55601a-16a6-4107-b8f6-dc2912160ed9 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:16.865466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e55601a-16a6-4107-b8f6-dc2912160ed9 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:17.109621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d472be8f-e2d3-4f96-bc69-4e9293b617d9 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:17.122221 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d472be8f-e2d3-4f96-bc69-4e9293b617d9 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1521 microversion: 2.1 time: 0.350322 Oct 05 17:50:17.123430 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1889/4045] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:16 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:17.131743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5e55601a-16a6-4107-b8f6-dc2912160ed9 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:17.139802 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e55601a-16a6-4107-b8f6-dc2912160ed9 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1324 microversion: 2.1 time: 0.291643 Oct 05 17:50:17.140594 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2157/4046] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:16 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:17.344442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ec01d43-75f9-4216-a77a-ca579e1352c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1687037243", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ec01d43-75f9-4216-a77a-ca579e1352c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Request method failure captured: Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 243 Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPDB0HtKhVVFgzo3G70bmOQSu9Oy6ownbS_TFV4fh_4AVD6BZ8KonLbuutEMv9pq5wCoXVdkOGjkmJJtCrOwgn0yVq4k_1ovB9WXgnS-CceVVllTc7BtLpmu0OtBw-BOX6O-Ef3ekqxizn0eki1MJwnp2FG9FkAcSOuBc-J2lwa83g Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc71199181f4876b10ed4edfc9bd4c7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}] Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 7dc3271f68f7486a9264c9ee4e3c1bc2 Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1687037243", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1687037243', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '4e8e6cb3-fe8e-46c0-af83-a96d89af98dc'}]}}} Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:17.349156 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.353340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ec01d43-75f9-4216-a77a-ca579e1352c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:17.360483 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0ec01d43-75f9-4216-a77a-ca579e1352c7 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.010611 Oct 05 17:50:17.360483 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1890/4047] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:50:17 2022] POST /compute/v2.1/servers => generated 175 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:50:17.366330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-74661535-5762-4813-b7e5-f0468830baff tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:17.367206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-74661535-5762-4813-b7e5-f0468830baff tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: cee70e01-9ba5-483b-b271-aa3a43ee34d2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:17.373818 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-74661535-5762-4813-b7e5-f0468830baff tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] HTTP exception thrown: Instance cee70e01-9ba5-483b-b271-aa3a43ee34d2 could not be found. Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-74661535-5762-4813-b7e5-f0468830baff tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Request method failure captured: Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/cee70e01-9ba5-483b-b271-aa3a43ee34d2/metadata HTTP/1.1 Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcPDB0HtKhVVFgzo3G70bmOQSu9Oy6ownbS_TFV4fh_4AVD6BZ8KonLbuutEMv9pq5wCoXVdkOGjkmJJtCrOwgn0yVq4k_1ovB9WXgnS-CceVVllTc7BtLpmu0OtBw-BOX6O-Ef3ekqxizn0eki1MJwnp2FG9FkAcSOuBc-J2lwa83g Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc71199181f4876b10ed4edfc9bd4c7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}] Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 7dc3271f68f7486a9264c9ee4e3c1bc2 Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance cee70e01-9ba5-483b-b271-aa3a43ee34d2 could not be found. Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': 'cee70e01-9ba5-483b-b271-aa3a43ee34d2'} Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee70e01-9ba5-483b-b271-aa3a43ee34d2 could not be found. Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee70e01-9ba5-483b-b271-aa3a43ee34d2 could not be found. Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.386112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.401112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:17.401112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:17.401112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee70e01-9ba5-483b-b271-aa3a43ee34d2 could not be found. Oct 05 17:50:17.401112 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.401112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-74661535-5762-4813-b7e5-f0468830baff tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Returning 404 to user: Instance cee70e01-9ba5-483b-b271-aa3a43ee34d2 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:17.401112 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-74661535-5762-4813-b7e5-f0468830baff tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/cee70e01-9ba5-483b-b271-aa3a43ee34d2/metadata" status: 404 len: 111 microversion: 2.1 time: 0.026056 Oct 05 17:50:17.401112 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2158/4048] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:50:17 2022] GET /compute/v2.1/servers/cee70e01-9ba5-483b-b271-aa3a43ee34d2/metadata => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:50:17.421703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4baa6709-580e-448b-9cf3-bfd3222b0421 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:17.422336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4baa6709-580e-448b-9cf3-bfd3222b0421 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:17.432259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4baa6709-580e-448b-9cf3-bfd3222b0421 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:17.432762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4baa6709-580e-448b-9cf3-bfd3222b0421 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:17.433202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4baa6709-580e-448b-9cf3-bfd3222b0421 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:17.433924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4baa6709-580e-448b-9cf3-bfd3222b0421 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:17.434430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4baa6709-580e-448b-9cf3-bfd3222b0421 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:17.434860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4baa6709-580e-448b-9cf3-bfd3222b0421 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:17.469374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-04f2c385-5ae9-47ca-b789-09adf1df94cd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-953205420", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-04f2c385-5ae9-47ca-b789-09adf1df94cd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Request method failure captured: Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 498 Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcPDB0HtKhVVFgzo3G70bmOQSu9Oy6ownbS_TFV4fh_4AVD6BZ8KonLbuutEMv9pq5wCoXVdkOGjkmJJtCrOwgn0yVq4k_1ovB9WXgnS-CceVVllTc7BtLpmu0OtBw-BOX6O-Ef3ekqxizn0eki1MJwnp2FG9FkAcSOuBc-J2lwa83g Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc71199181f4876b10ed4edfc9bd4c7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}] Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 7dc3271f68f7486a9264c9ee4e3c1bc2 Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-953205420", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-953205420', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4e8e6cb3-fe8e-46c0-af83-a96d89af98dc'}]}}} Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 17:50:17.479348 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.482753 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.493057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-04f2c385-5ae9-47ca-b789-09adf1df94cd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:17.495083 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-04f2c385-5ae9-47ca-b789-09adf1df94cd tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.030059 Oct 05 17:50:17.495588 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2159/4049] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:50:17 2022] POST /compute/v2.1/servers => generated 687 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:50:17.561510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-85cf6d65-384a-4be2-b2cc-bd28852a3ea5 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1216925304", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-85cf6d65-384a-4be2-b2cc-bd28852a3ea5 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Request method failure captured: Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 500 Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcPDB0HtKhVVFgzo3G70bmOQSu9Oy6ownbS_TFV4fh_4AVD6BZ8KonLbuutEMv9pq5wCoXVdkOGjkmJJtCrOwgn0yVq4k_1ovB9WXgnS-CceVVllTc7BtLpmu0OtBw-BOX6O-Ef3ekqxizn0eki1MJwnp2FG9FkAcSOuBc-J2lwa83g Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc71199181f4876b10ed4edfc9bd4c7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}] Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 7dc3271f68f7486a9264c9ee4e3c1bc2 Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1216925304", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1216925304', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4e8e6cb3-fe8e-46c0-af83-a96d89af98dc'}]}}} Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 17:50:17.569163 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.571996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-85cf6d65-384a-4be2-b2cc-bd28852a3ea5 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:17.573840 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-85cf6d65-384a-4be2-b2cc-bd28852a3ea5 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.013523 Oct 05 17:50:17.577602 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2160/4050] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:50:17 2022] POST /compute/v2.1/servers => generated 689 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:50:17.595788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b6bf2e26-7a14-49f6-8237-1af42d4925fa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:17.596578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b6bf2e26-7a14-49f6-8237-1af42d4925fa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:17.610588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf2e26-7a14-49f6-8237-1af42d4925fa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:17.614725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf2e26-7a14-49f6-8237-1af42d4925fa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:17.616022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf2e26-7a14-49f6-8237-1af42d4925fa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:17.619175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf2e26-7a14-49f6-8237-1af42d4925fa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:17.619811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf2e26-7a14-49f6-8237-1af42d4925fa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:17.625890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf2e26-7a14-49f6-8237-1af42d4925fa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:17.780105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4baa6709-580e-448b-9cf3-bfd3222b0421 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:17.791788 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4baa6709-580e-448b-9cf3-bfd3222b0421 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1316 microversion: 2.1 time: 0.374295 Oct 05 17:50:17.801585 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1891/4051] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:17 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1316 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:17.808070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab97f87e-87c5-41ae-8e70-84b69b745a3a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1350465231", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab97f87e-87c5-41ae-8e70-84b69b745a3a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Request method failure captured: Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 754 Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPDB0HtKhVVFgzo3G70bmOQSu9Oy6ownbS_TFV4fh_4AVD6BZ8KonLbuutEMv9pq5wCoXVdkOGjkmJJtCrOwgn0yVq4k_1ovB9WXgnS-CceVVllTc7BtLpmu0OtBw-BOX6O-Ef3ekqxizn0eki1MJwnp2FG9FkAcSOuBc-J2lwa83g Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc71199181f4876b10ed4edfc9bd4c7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}] Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 7dc3271f68f7486a9264c9ee4e3c1bc2 Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1350465231", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1350465231', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4e8e6cb3-fe8e-46c0-af83-a96d89af98dc'}]}}} Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:50:17.826003 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:50:17.828546 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:50:17.830910 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:17.830910 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.836003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab97f87e-87c5-41ae-8e70-84b69b745a3a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:17.837167 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ab97f87e-87c5-41ae-8e70-84b69b745a3a tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.034311 Oct 05 17:50:17.838790 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1892/4052] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:50:17 2022] POST /compute/v2.1/servers => generated 1197 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 05 17:50:17.846072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:17.847698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:17.857607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:17.858952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:17.860738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:17.864167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:17.865142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:17.866207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:17.896819 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] HTTP exception thrown: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Request method failure captured: Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c HTTP/1.1 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcO25g1I67YPEr7C57j79QNTqson1qAWdi8KoU_aYeDvvNZQAZ_DMhe6ASrE3jTXaZ2ZxISweN8Aw5KMR96V1SJhrOCn9rWR_mfA4cQO-MCiyUe0rOCfZLHeZneBR1C85w1aOwOi7fERbxB83xgrrtQXL45eLi5a1izumLD2-OwRIrA Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.21 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 1727e2848ffa4220a26be5c4da3721f9 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1868278384 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1727e2848ffa4220a26be5c4da3721f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1727e2848ffa4220a26be5c4da3721f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1727e2848ffa4220a26be5c4da3721f9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1727e2848ffa4220a26be5c4da3721f9"}]}] Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-InstanceActionsV221TestJSON-1868278384 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 1727e2848ffa4220a26be5c4da3721f9 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1868278384 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-InstanceActionsV221TestJSON-1868278384-project Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cc543f2f785b49fc8a3f03f54c7d3049 Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-InstanceActionsV221TestJSON-1868278384-project Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'ef777d90-7d38-4c60-92ac-93f7cfe6698c'} Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.901066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:17.905077 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.905077 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:17.905077 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:17.905077 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:17.905077 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:17.905077 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:17.905077 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:17.905077 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:17.905077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Returning 404 to user: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:17.905077 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3818a862-651f-4261-ad18-818e6059f792 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 404 len: 111 microversion: 2.21 time: 0.062669 Oct 05 17:50:17.908633 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1893/4053] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:17 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:50:17.921093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-60c4f0cb-25ff-4830-8979-4d34c735d7c6 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '.version_select at 0x7f77745ccc10>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:17.923392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-60c4f0cb-25ff-4830-8979-4d34c735d7c6 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:17.938934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60c4f0cb-25ff-4830-8979-4d34c735d7c6 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:17.939448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60c4f0cb-25ff-4830-8979-4d34c735d7c6 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:17.939950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60c4f0cb-25ff-4830-8979-4d34c735d7c6 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:17.940674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60c4f0cb-25ff-4830-8979-4d34c735d7c6 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:17.941132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60c4f0cb-25ff-4830-8979-4d34c735d7c6 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:17.941558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60c4f0cb-25ff-4830-8979-4d34c735d7c6 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.032395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b6bf2e26-7a14-49f6-8237-1af42d4925fa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:18.041655 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b6bf2e26-7a14-49f6-8237-1af42d4925fa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.451143 Oct 05 17:50:18.044953 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2161/4054] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:17 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:18.076677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c1afc32-03cf-4e6e-ac3e-b53be85f0f33 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-797192248", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c1afc32-03cf-4e6e-ac3e-b53be85f0f33 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Request method failure captured: Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 1265 Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcPDB0HtKhVVFgzo3G70bmOQSu9Oy6ownbS_TFV4fh_4AVD6BZ8KonLbuutEMv9pq5wCoXVdkOGjkmJJtCrOwgn0yVq4k_1ovB9WXgnS-CceVVllTc7BtLpmu0OtBw-BOX6O-Ef3ekqxizn0eki1MJwnp2FG9FkAcSOuBc-J2lwa83g Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc71199181f4876b10ed4edfc9bd4c7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}] Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 7dc3271f68f7486a9264c9ee4e3c1bc2 Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-797192248", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "4e8e6cb3-fe8e-46c0-af83-a96d89af98dc"}]}} Oct 05 17:50:18.089327 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-797192248', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '4e8e6cb3-fe8e-46c0-af83-a96d89af98dc'}]}}} Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.091657 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:50:18.092779 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:50:18.094375 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 05 17:50:18.094375 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.094375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c1afc32-03cf-4e6e-ac3e-b53be85f0f33 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:18.094375 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0c1afc32-03cf-4e6e-ac3e-b53be85f0f33 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.037812 Oct 05 17:50:18.100385 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2162/4055] 10.222.0.70 () {60 vars in 1148 bytes} [Wed Oct 5 17:50:18 2022] POST /compute/v2.1/servers => generated 2221 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 05 17:50:18.106855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9aaf3e01-c193-456a-986c-6695a7aaa78e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:18.107361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9aaf3e01-c193-456a-986c-6695a7aaa78e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: b44d837f-38d3-485e-a97e-c2b2ac897470] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:18.114474 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-9aaf3e01-c193-456a-986c-6695a7aaa78e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] HTTP exception thrown: Instance b44d837f-38d3-485e-a97e-c2b2ac897470 could not be found. Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9aaf3e01-c193-456a-986c-6695a7aaa78e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Request method failure captured: Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/b44d837f-38d3-485e-a97e-c2b2ac897470/metadata/test2 HTTP/1.1 Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcPDB0HtKhVVFgzo3G70bmOQSu9Oy6ownbS_TFV4fh_4AVD6BZ8KonLbuutEMv9pq5wCoXVdkOGjkmJJtCrOwgn0yVq4k_1ovB9WXgnS-CceVVllTc7BtLpmu0OtBw-BOX6O-Ef3ekqxizn0eki1MJwnp2FG9FkAcSOuBc-J2lwa83g Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc71199181f4876b10ed4edfc9bd4c7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}] Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 7dc3271f68f7486a9264c9ee4e3c1bc2 Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance b44d837f-38d3-485e-a97e-c2b2ac897470 could not be found. Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': 'b44d837f-38d3-485e-a97e-c2b2ac897470', 'id': 'test2'} Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44d837f-38d3-485e-a97e-c2b2ac897470 could not be found. Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44d837f-38d3-485e-a97e-c2b2ac897470 could not be found. Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:18.117228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:18.130771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:18.130771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:18.130771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44d837f-38d3-485e-a97e-c2b2ac897470 could not be found. Oct 05 17:50:18.130771 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.130771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9aaf3e01-c193-456a-986c-6695a7aaa78e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Returning 404 to user: Instance b44d837f-38d3-485e-a97e-c2b2ac897470 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:18.130771 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9aaf3e01-c193-456a-986c-6695a7aaa78e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/b44d837f-38d3-485e-a97e-c2b2ac897470/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.016111 Oct 05 17:50:18.130771 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2163/4056] 10.222.0.70 () {58 vars in 1281 bytes} [Wed Oct 5 17:50:18 2022] GET /compute/v2.1/servers/b44d837f-38d3-485e-a97e-c2b2ac897470/metadata/test2 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:50:18.133741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a0365127-d99e-4cac-ac5b-f33df0638f36 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:18.134350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a0365127-d99e-4cac-ac5b-f33df0638f36 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:18.137361 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-60c4f0cb-25ff-4830-8979-4d34c735d7c6 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.226809 Oct 05 17:50:18.144763 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1894/4057] 10.222.0.70 () {60 vars in 1337 bytes} [Wed Oct 5 17:50:17 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c/os-instance-actions => generated 611 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:50:18.145426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0365127-d99e-4cac-ac5b-f33df0638f36 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.145426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0365127-d99e-4cac-ac5b-f33df0638f36 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.145426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0365127-d99e-4cac-ac5b-f33df0638f36 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.151925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0365127-d99e-4cac-ac5b-f33df0638f36 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.152612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0365127-d99e-4cac-ac5b-f33df0638f36 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.153710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0365127-d99e-4cac-ac5b-f33df0638f36 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.161074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:18.169906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:18.179186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.179801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.180329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.181129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.181679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.182197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.197440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a0365127-d99e-4cac-ac5b-f33df0638f36 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:50:18.201221 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] HTTP exception thrown: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Request method failure captured: Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c HTTP/1.1 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcO25g1I67YPEr7C57j79QNTqson1qAWdi8KoU_aYeDvvNZQAZ_DMhe6ASrE3jTXaZ2ZxISweN8Aw5KMR96V1SJhrOCn9rWR_mfA4cQO-MCiyUe0rOCfZLHeZneBR1C85w1aOwOi7fERbxB83xgrrtQXL45eLi5a1izumLD2-OwRIrA Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.21 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 1727e2848ffa4220a26be5c4da3721f9 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1868278384 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1727e2848ffa4220a26be5c4da3721f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1727e2848ffa4220a26be5c4da3721f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1727e2848ffa4220a26be5c4da3721f9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1727e2848ffa4220a26be5c4da3721f9"}]}] Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-InstanceActionsV221TestJSON-1868278384 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 1727e2848ffa4220a26be5c4da3721f9 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1868278384 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-InstanceActionsV221TestJSON-1868278384-project Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cc543f2f785b49fc8a3f03f54c7d3049 Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-InstanceActionsV221TestJSON-1868278384-project Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'ef777d90-7d38-4c60-92ac-93f7cfe6698c'} Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:50:18.203237 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:18.207477 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.208959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Returning 404 to user: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:18.209255 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fdb644fd-f75e-4795-8d76-16852baffd42 tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 404 len: 111 microversion: 2.21 time: 0.052118 Oct 05 17:50:18.209833 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1895/4058] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:50:18 2022] DELETE /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:50:18.228790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1ff58e5f-01fe-4b05-bea3-c3db7f1d6331 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:18.233661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1ff58e5f-01fe-4b05-bea3-c3db7f1d6331 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:18.241269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ff58e5f-01fe-4b05-bea3-c3db7f1d6331 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.242801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ff58e5f-01fe-4b05-bea3-c3db7f1d6331 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.243497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ff58e5f-01fe-4b05-bea3-c3db7f1d6331 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.244774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ff58e5f-01fe-4b05-bea3-c3db7f1d6331 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.245489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ff58e5f-01fe-4b05-bea3-c3db7f1d6331 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.246149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ff58e5f-01fe-4b05-bea3-c3db7f1d6331 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.396720 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a0365127-d99e-4cac-ac5b-f33df0638f36 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "DELETE /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 204 len: 0 microversion: 2.1 time: 0.267067 Oct 05 17:50:18.398652 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2164/4059] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:50:18 2022] DELETE /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:50:18.415239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:18.420752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] [instance: ef777d90-7d38-4c60-92ac-93f7cfe6698c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:18.432119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.433159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.433842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.440956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.441676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.442370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.466790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1ff58e5f-01fe-4b05-bea3-c3db7f1d6331 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:18.469374 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] HTTP exception thrown: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:18.476719 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1ff58e5f-01fe-4b05-bea3-c3db7f1d6331 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1324 microversion: 2.1 time: 0.256653 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Request method failure captured: Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c HTTP/1.1 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcO25g1I67YPEr7C57j79QNTqson1qAWdi8KoU_aYeDvvNZQAZ_DMhe6ASrE3jTXaZ2ZxISweN8Aw5KMR96V1SJhrOCn9rWR_mfA4cQO-MCiyUe0rOCfZLHeZneBR1C85w1aOwOi7fERbxB83xgrrtQXL45eLi5a1izumLD2-OwRIrA Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.21 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 1727e2848ffa4220a26be5c4da3721f9 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1868278384 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/1727e2848ffa4220a26be5c4da3721f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1727e2848ffa4220a26be5c4da3721f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_1727e2848ffa4220a26be5c4da3721f9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/1727e2848ffa4220a26be5c4da3721f9"}]}] Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-InstanceActionsV221TestJSON-1868278384 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 1727e2848ffa4220a26be5c4da3721f9 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1868278384 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-InstanceActionsV221TestJSON-1868278384-project Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: cc543f2f785b49fc8a3f03f54c7d3049 Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-InstanceActionsV221TestJSON-1868278384-project Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'ef777d90-7d38-4c60-92ac-93f7cfe6698c'} Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.477121 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:18.481520 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.481520 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:18.481520 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:18.481520 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:18.481520 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:18.481520 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:18.481520 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. Oct 05 17:50:18.481520 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:18.482122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] Returning 404 to user: Instance ef777d90-7d38-4c60-92ac-93f7cfe6698c could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:18.483421 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6526bd47-ac43-4107-8bfb-e52a9d47350e tempest-InstanceActionsV221TestJSON-1868278384 tempest-InstanceActionsV221TestJSON-1868278384-project] 10.222.0.70 "GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c" status: 404 len: 111 microversion: 2.21 time: 0.082625 Oct 05 17:50:18.488302 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2165/4061] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:18 2022] GET /compute/v2.1/servers/ef777d90-7d38-4c60-92ac-93f7cfe6698c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:50:18.488501 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1896/4061] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:18 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:18.500708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1de71982-8b16-417d-bedf-63174647989e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:18.501507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1de71982-8b16-417d-bedf-63174647989e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:18.513559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-92dd2857-ed8f-4a97-b856-6be9b26148d4 req-8ea573d2-d684-422f-90a5-a7f5b3c4884b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a708a04f-a0cd-42d3-92d5-2f5d4dd8577b", "tag": "3c088e78-5e15-41c1-ba4e-784a282e5586"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:18.514920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1de71982-8b16-417d-bedf-63174647989e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.515535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1de71982-8b16-417d-bedf-63174647989e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.523744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1de71982-8b16-417d-bedf-63174647989e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.524673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1de71982-8b16-417d-bedf-63174647989e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.525276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1de71982-8b16-417d-bedf-63174647989e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.525848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1de71982-8b16-417d-bedf-63174647989e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.530158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-92dd2857-ed8f-4a97-b856-6be9b26148d4 req-8ea573d2-d684-422f-90a5-a7f5b3c4884b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.538382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-92dd2857-ed8f-4a97-b856-6be9b26148d4 req-8ea573d2-d684-422f-90a5-a7f5b3c4884b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.538991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-92dd2857-ed8f-4a97-b856-6be9b26148d4 req-8ea573d2-d684-422f-90a5-a7f5b3c4884b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.579832 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-92dd2857-ed8f-4a97-b856-6be9b26148d4 req-8ea573d2-d684-422f-90a5-a7f5b3c4884b service nova] Creating event network-changed:3c088e78-5e15-41c1-ba4e-784a282e5586 for instance a708a04f-a0cd-42d3-92d5-2f5d4dd8577b on n-h1-835595-3 Oct 05 17:50:18.585716 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-92dd2857-ed8f-4a97-b856-6be9b26148d4 req-8ea573d2-d684-422f-90a5-a7f5b3c4884b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075908 Oct 05 17:50:18.586676 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1897/4062] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:50:18.820898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-932f039a-ae6b-4dc9-832f-684145ebdf58 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:18.821746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-932f039a-ae6b-4dc9-832f-684145ebdf58 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:18.842828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-932f039a-ae6b-4dc9-832f-684145ebdf58 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.842828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-932f039a-ae6b-4dc9-832f-684145ebdf58 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.842828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-932f039a-ae6b-4dc9-832f-684145ebdf58 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.842828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-932f039a-ae6b-4dc9-832f-684145ebdf58 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:18.842828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-932f039a-ae6b-4dc9-832f-684145ebdf58 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:18.842828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-932f039a-ae6b-4dc9-832f-684145ebdf58 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:18.945300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1de71982-8b16-417d-bedf-63174647989e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:18.964925 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1de71982-8b16-417d-bedf-63174647989e tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1527 microversion: 2.1 time: 0.475234 Oct 05 17:50:18.972727 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2166/4063] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:18 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1527 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:19.070583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aa826dc5-97db-4bc7-8e89-ac35174c4b87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:19.071461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aa826dc5-97db-4bc7-8e89-ac35174c4b87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:19.083012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa826dc5-97db-4bc7-8e89-ac35174c4b87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:19.084491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa826dc5-97db-4bc7-8e89-ac35174c4b87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:19.087577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa826dc5-97db-4bc7-8e89-ac35174c4b87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:19.088547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa826dc5-97db-4bc7-8e89-ac35174c4b87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:19.089580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-932f039a-ae6b-4dc9-832f-684145ebdf58 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:19.090973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa826dc5-97db-4bc7-8e89-ac35174c4b87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:19.092332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa826dc5-97db-4bc7-8e89-ac35174c4b87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:19.098930 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-932f039a-ae6b-4dc9-832f-684145ebdf58 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1316 microversion: 2.1 time: 0.284891 Oct 05 17:50:19.100389 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1898/4064] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:18 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:19.399483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aa826dc5-97db-4bc7-8e89-ac35174c4b87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:19.409282 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aa826dc5-97db-4bc7-8e89-ac35174c4b87 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.345224 Oct 05 17:50:19.422410 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2167/4065] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:19 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:19.501419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2fa9eec1-de98-40ee-b10d-b5d20cd41ec3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:19.502489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2fa9eec1-de98-40ee-b10d-b5d20cd41ec3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:19.509489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fa9eec1-de98-40ee-b10d-b5d20cd41ec3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:19.510315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fa9eec1-de98-40ee-b10d-b5d20cd41ec3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:19.510966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fa9eec1-de98-40ee-b10d-b5d20cd41ec3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:19.511923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fa9eec1-de98-40ee-b10d-b5d20cd41ec3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:19.512585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fa9eec1-de98-40ee-b10d-b5d20cd41ec3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:19.513903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fa9eec1-de98-40ee-b10d-b5d20cd41ec3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:19.929385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2fa9eec1-de98-40ee-b10d-b5d20cd41ec3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:19.938769 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2fa9eec1-de98-40ee-b10d-b5d20cd41ec3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1521 microversion: 2.1 time: 0.441782 Oct 05 17:50:19.945386 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1899/4066] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:19 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:19.974119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:19.974673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:19.982372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:19.988591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:19.989256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:19.990322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:19.993132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a6c3acba-0a07-4d16-a203-87c44e2fc060 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:19.993818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:19.993946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a6c3acba-0a07-4d16-a203-87c44e2fc060 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:19.994537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.006943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6c3acba-0a07-4d16-a203-87c44e2fc060 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:20.009624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6c3acba-0a07-4d16-a203-87c44e2fc060 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:20.010155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6c3acba-0a07-4d16-a203-87c44e2fc060 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.010972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6c3acba-0a07-4d16-a203-87c44e2fc060 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:20.012735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6c3acba-0a07-4d16-a203-87c44e2fc060 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:20.013653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6c3acba-0a07-4d16-a203-87c44e2fc060 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.040818 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] HTTP exception thrown: Instance is not a member of specified network Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Request method failure captured: Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5/ips/invalid HTTP/1.1 Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcPF2jjCCYFmZwUjhC9QSRE0KgNkXzI57uTYif_FJCXyJxVItpZsmVhtR1Yt02cVQcSuY49peeXYAiwnEmxDV-iXZmGhsbaoAE3nt6TKsNoeDETJOP76pgLV_H5OvtrKJxLFrXOIBs-G06kkOJkigzRuyXzhcXMZeDQ2vrkxyAKGsdU Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: da744f7934fc474db0dff9f8fe7f98a6 Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1753462850 Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da744f7934fc474db0dff9f8fe7f98a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da744f7934fc474db0dff9f8fe7f98a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da744f7934fc474db0dff9f8fe7f98a6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da744f7934fc474db0dff9f8fe7f98a6"}]}] Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1753462850 Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: da744f7934fc474db0dff9f8fe7f98a6 Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1753462850 Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerAddressesNegativeTestJSON-1753462850-project Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: deca8f69371b4ecba637e3357501fc59 Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1753462850-project Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance is not a member of specified network Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': '3000d510-2d71-4508-bf70-8fa1fb68aaf5', 'id': 'invalid'} Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 05 17:50:20.050332 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:20.054802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:20.055840 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9318191f-5bf3-4e79-a61f-300d36e69593 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.085976 Oct 05 17:50:20.063734 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2168/4067] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:50:19 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5/ips/invalid => generated 91 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:50:20.071197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5794bc5-476f-4ac4-83e6-2cac408fcfd7 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:20.077451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5794bc5-476f-4ac4-83e6-2cac408fcfd7 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Failed to fetch instance by id 999 {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 17:50:20.078191 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-e5794bc5-476f-4ac4-83e6-2cac408fcfd7 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] HTTP exception thrown: Instance 999 could not be found. Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5794bc5-476f-4ac4-83e6-2cac408fcfd7 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Request method failure captured: Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcPF2jjCCYFmZwUjhC9QSRE0KgNkXzI57uTYif_FJCXyJxVItpZsmVhtR1Yt02cVQcSuY49peeXYAiwnEmxDV-iXZmGhsbaoAE3nt6TKsNoeDETJOP76pgLV_H5OvtrKJxLFrXOIBs-G06kkOJkigzRuyXzhcXMZeDQ2vrkxyAKGsdU Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: da744f7934fc474db0dff9f8fe7f98a6 Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1753462850 Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da744f7934fc474db0dff9f8fe7f98a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da744f7934fc474db0dff9f8fe7f98a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da744f7934fc474db0dff9f8fe7f98a6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da744f7934fc474db0dff9f8fe7f98a6"}]}] Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1753462850 Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: da744f7934fc474db0dff9f8fe7f98a6 Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1753462850 Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerAddressesNegativeTestJSON-1753462850-project Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: deca8f69371b4ecba637e3357501fc59 Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1753462850-project Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 999 could not be found. Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': '999'} Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 05 17:50:20.079943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:20.085185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5794bc5-476f-4ac4-83e6-2cac408fcfd7 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:20.086242 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5794bc5-476f-4ac4-83e6-2cac408fcfd7 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.021178 Oct 05 17:50:20.092703 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2169/4068] 10.222.0.70 () {58 vars in 1149 bytes} [Wed Oct 5 17:50:20 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:50:20.098382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7e978b0-e1fa-45e8-8381-70807d7937d5 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:20.099123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b7e978b0-e1fa-45e8-8381-70807d7937d5 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:20.106844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7e978b0-e1fa-45e8-8381-70807d7937d5 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:20.107663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7e978b0-e1fa-45e8-8381-70807d7937d5 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:20.108290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7e978b0-e1fa-45e8-8381-70807d7937d5 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.109194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7e978b0-e1fa-45e8-8381-70807d7937d5 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:20.109830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7e978b0-e1fa-45e8-8381-70807d7937d5 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:20.110472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7e978b0-e1fa-45e8-8381-70807d7937d5 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.143970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b7e978b0-e1fa-45e8-8381-70807d7937d5 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:50:20.174685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:20.202794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=16 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:20.259049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=94,nova_api:UPDATE=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:20.272574 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b7e978b0-e1fa-45e8-8381-70807d7937d5 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 204 len: 0 microversion: 2.1 time: 0.177586 Oct 05 17:50:20.277050 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2170/4069] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:50:20 2022] DELETE /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:50:20.284408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c78af60d-695b-453f-88a9-37a923a1d146 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:20.285340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c78af60d-695b-453f-88a9-37a923a1d146 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:20.293700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78af60d-695b-453f-88a9-37a923a1d146 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:20.294448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78af60d-695b-453f-88a9-37a923a1d146 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:20.295062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78af60d-695b-453f-88a9-37a923a1d146 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.295932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78af60d-695b-453f-88a9-37a923a1d146 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:20.296524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78af60d-695b-453f-88a9-37a923a1d146 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:20.297341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c78af60d-695b-453f-88a9-37a923a1d146 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.517078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c78af60d-695b-453f-88a9-37a923a1d146 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:20.528141 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c78af60d-695b-453f-88a9-37a923a1d146 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1316 microversion: 2.1 time: 0.249043 Oct 05 17:50:20.529093 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2171/4070] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:20 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1316 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:20.534543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-14b3cc6e-270f-4465-b3c5-32af1607859a tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:20.535549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-14b3cc6e-270f-4465-b3c5-32af1607859a tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:20.543390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b3cc6e-270f-4465-b3c5-32af1607859a tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:20.543726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b3cc6e-270f-4465-b3c5-32af1607859a tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:20.544172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b3cc6e-270f-4465-b3c5-32af1607859a tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.544901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b3cc6e-270f-4465-b3c5-32af1607859a tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:20.545753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b3cc6e-270f-4465-b3c5-32af1607859a tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:20.546188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b3cc6e-270f-4465-b3c5-32af1607859a tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.582694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:20.622683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=35,nova_cell0:UPDATE=7 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:20.844981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-14b3cc6e-270f-4465-b3c5-32af1607859a tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:20.857420 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-14b3cc6e-270f-4465-b3c5-32af1607859a tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1527 microversion: 2.1 time: 0.326670 Oct 05 17:50:20.859470 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2172/4071] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:20 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1527 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:20.874650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d1b5a69-6d88-4a73-8ca9-cba2c1797a1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:20.875662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a6c3acba-0a07-4d16-a203-87c44e2fc060 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:20.875827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2d1b5a69-6d88-4a73-8ca9-cba2c1797a1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:20.886812 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a6c3acba-0a07-4d16-a203-87c44e2fc060 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1527 microversion: 2.1 time: 0.897399 Oct 05 17:50:20.892470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d1b5a69-6d88-4a73-8ca9-cba2c1797a1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:20.893437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d1b5a69-6d88-4a73-8ca9-cba2c1797a1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:20.895485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d1b5a69-6d88-4a73-8ca9-cba2c1797a1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.899776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d1b5a69-6d88-4a73-8ca9-cba2c1797a1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:20.900547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d1b5a69-6d88-4a73-8ca9-cba2c1797a1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:20.901181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d1b5a69-6d88-4a73-8ca9-cba2c1797a1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:20.907167 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1900/4072] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:19 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1527 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:21.558168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9dd7d86-0e30-43a2-96e2-486913d11b9c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:21.559629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b9dd7d86-0e30-43a2-96e2-486913d11b9c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:21.573540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9dd7d86-0e30-43a2-96e2-486913d11b9c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:21.575473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9dd7d86-0e30-43a2-96e2-486913d11b9c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:21.576100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9dd7d86-0e30-43a2-96e2-486913d11b9c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:21.578235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9dd7d86-0e30-43a2-96e2-486913d11b9c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:21.581067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9dd7d86-0e30-43a2-96e2-486913d11b9c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:21.581778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9dd7d86-0e30-43a2-96e2-486913d11b9c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:21.854848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2d1b5a69-6d88-4a73-8ca9-cba2c1797a1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:21.872268 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2d1b5a69-6d88-4a73-8ca9-cba2c1797a1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 1.009574 Oct 05 17:50:21.893426 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2173/4073] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:20 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:21.899524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1d177df-229c-45f3-a196-67de4400ebfb tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:21.900144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f1d177df-229c-45f3-a196-67de4400ebfb tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:21.907761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d177df-229c-45f3-a196-67de4400ebfb tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:21.908644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d177df-229c-45f3-a196-67de4400ebfb tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:21.909295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d177df-229c-45f3-a196-67de4400ebfb tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:21.910479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d177df-229c-45f3-a196-67de4400ebfb tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:21.911141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d177df-229c-45f3-a196-67de4400ebfb tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:21.912907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1d177df-229c-45f3-a196-67de4400ebfb tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:22.525271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9dd7d86-0e30-43a2-96e2-486913d11b9c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:22.536320 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9dd7d86-0e30-43a2-96e2-486913d11b9c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1316 microversion: 2.1 time: 0.982746 Oct 05 17:50:22.537530 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1901/4074] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:21 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1316 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:22.545327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a21d846e-1b00-4ccd-9b0f-d7e88e37f4e3 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:22.546635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a21d846e-1b00-4ccd-9b0f-d7e88e37f4e3 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:22.555327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a21d846e-1b00-4ccd-9b0f-d7e88e37f4e3 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:22.556136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a21d846e-1b00-4ccd-9b0f-d7e88e37f4e3 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:22.556791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a21d846e-1b00-4ccd-9b0f-d7e88e37f4e3 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:22.557876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a21d846e-1b00-4ccd-9b0f-d7e88e37f4e3 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:22.558572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a21d846e-1b00-4ccd-9b0f-d7e88e37f4e3 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:22.559935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a21d846e-1b00-4ccd-9b0f-d7e88e37f4e3 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:22.646366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f1d177df-229c-45f3-a196-67de4400ebfb tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:22.659294 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f1d177df-229c-45f3-a196-67de4400ebfb tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1527 microversion: 2.1 time: 0.763312 Oct 05 17:50:22.660238 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2174/4075] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:21 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1527 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:22.901277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6129488f-b104-4eca-be53-e58b580f8605 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:22.902080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6129488f-b104-4eca-be53-e58b580f8605 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:22.914737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6129488f-b104-4eca-be53-e58b580f8605 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:22.915245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6129488f-b104-4eca-be53-e58b580f8605 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:22.915692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6129488f-b104-4eca-be53-e58b580f8605 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:22.916504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6129488f-b104-4eca-be53-e58b580f8605 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:22.916856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6129488f-b104-4eca-be53-e58b580f8605 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:22.917446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6129488f-b104-4eca-be53-e58b580f8605 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:23.279078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6129488f-b104-4eca-be53-e58b580f8605 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:23.303669 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6129488f-b104-4eca-be53-e58b580f8605 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.406355 Oct 05 17:50:23.306791 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2175/4076] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:22 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:23.309394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ae54b6dc-f354-4927-8f70-090a478c826b req-beef536d-5be9-4af5-bbcc-671091c82d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110c65b6-160a-482d-8dea-cd00fba96314", "name": "network-vif-deleted", "tag": "e2dd34af-8a8d-4ea8-a9ca-1fda98cabd70"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:23.314794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a21d846e-1b00-4ccd-9b0f-d7e88e37f4e3 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7dc3271f68f7486a9264c9ee4e3c1bc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc71199181f4876b10ed4edfc9bd4c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:23.325403 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a21d846e-1b00-4ccd-9b0f-d7e88e37f4e3 tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 200 len: 1527 microversion: 2.1 time: 0.785308 Oct 05 17:50:23.325611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ae54b6dc-f354-4927-8f70-090a478c826b req-beef536d-5be9-4af5-bbcc-671091c82d48 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:23.326813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ae54b6dc-f354-4927-8f70-090a478c826b req-beef536d-5be9-4af5-bbcc-671091c82d48 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:23.327301 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1902/4077] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:22 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 1527 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:23.327848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ae54b6dc-f354-4927-8f70-090a478c826b req-beef536d-5be9-4af5-bbcc-671091c82d48 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:23.355567 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ae54b6dc-f354-4927-8f70-090a478c826b req-beef536d-5be9-4af5-bbcc-671091c82d48 service nova] Creating event network-vif-deleted:e2dd34af-8a8d-4ea8-a9ca-1fda98cabd70 for instance 110c65b6-160a-482d-8dea-cd00fba96314 on n-h1-835595-3 Oct 05 17:50:23.364723 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ae54b6dc-f354-4927-8f70-090a478c826b req-beef536d-5be9-4af5-bbcc-671091c82d48 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058044 Oct 05 17:50:23.365792 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2176/4078] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:23.562163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e9b789d-f5cc-4b93-a35a-54bbe3f53cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:23.562822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e9b789d-f5cc-4b93-a35a-54bbe3f53cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:23.579045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e9b789d-f5cc-4b93-a35a-54bbe3f53cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:23.584904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e9b789d-f5cc-4b93-a35a-54bbe3f53cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:23.585372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e9b789d-f5cc-4b93-a35a-54bbe3f53cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:23.586148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e9b789d-f5cc-4b93-a35a-54bbe3f53cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:23.588353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e9b789d-f5cc-4b93-a35a-54bbe3f53cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:23.591724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e9b789d-f5cc-4b93-a35a-54bbe3f53cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:23.686953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b1031c9a-3a1c-4315-9e8e-207d88e7fbc3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:23.687690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b1031c9a-3a1c-4315-9e8e-207d88e7fbc3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:23.713160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1031c9a-3a1c-4315-9e8e-207d88e7fbc3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:23.713667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1031c9a-3a1c-4315-9e8e-207d88e7fbc3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:23.714111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1031c9a-3a1c-4315-9e8e-207d88e7fbc3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:23.714866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1031c9a-3a1c-4315-9e8e-207d88e7fbc3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:23.715328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1031c9a-3a1c-4315-9e8e-207d88e7fbc3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:23.715756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1031c9a-3a1c-4315-9e8e-207d88e7fbc3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:23.981025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b1031c9a-3a1c-4315-9e8e-207d88e7fbc3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deca8f69371b4ecba637e3357501fc59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da744f7934fc474db0dff9f8fe7f98a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:23.995166 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b1031c9a-3a1c-4315-9e8e-207d88e7fbc3 tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 200 len: 1485 microversion: 2.1 time: 0.313673 Oct 05 17:50:23.996329 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2177/4079] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:23 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 1485 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:24.002816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-355ec8fc-406b-4e94-a741-de643dfa8cad req-a1cf89ba-262f-458c-9179-d823c91bdd37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a708a04f-a0cd-42d3-92d5-2f5d4dd8577b", "name": "network-vif-plugged", "status": "completed", "tag": "3c088e78-5e15-41c1-ba4e-784a282e5586"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:24.017912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-355ec8fc-406b-4e94-a741-de643dfa8cad req-a1cf89ba-262f-458c-9179-d823c91bdd37 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:24.019916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-355ec8fc-406b-4e94-a741-de643dfa8cad req-a1cf89ba-262f-458c-9179-d823c91bdd37 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:24.020812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-355ec8fc-406b-4e94-a741-de643dfa8cad req-a1cf89ba-262f-458c-9179-d823c91bdd37 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:24.041334 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-355ec8fc-406b-4e94-a741-de643dfa8cad req-a1cf89ba-262f-458c-9179-d823c91bdd37 service nova] Creating event network-vif-plugged:3c088e78-5e15-41c1-ba4e-784a282e5586 for instance a708a04f-a0cd-42d3-92d5-2f5d4dd8577b on n-h1-835595-3 Oct 05 17:50:24.055208 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-355ec8fc-406b-4e94-a741-de643dfa8cad req-a1cf89ba-262f-458c-9179-d823c91bdd37 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056933 Oct 05 17:50:24.056364 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2178/4080] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:24.328374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-afa1073a-4500-4327-bb88-d1f4fcc3a673 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:24.329084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-afa1073a-4500-4327-bb88-d1f4fcc3a673 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:24.348682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afa1073a-4500-4327-bb88-d1f4fcc3a673 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:24.349119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afa1073a-4500-4327-bb88-d1f4fcc3a673 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:24.349567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afa1073a-4500-4327-bb88-d1f4fcc3a673 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:24.354437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afa1073a-4500-4327-bb88-d1f4fcc3a673 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:24.362058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afa1073a-4500-4327-bb88-d1f4fcc3a673 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:24.363436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afa1073a-4500-4327-bb88-d1f4fcc3a673 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:24.582485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2e9b789d-f5cc-4b93-a35a-54bbe3f53cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:24.600908 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e9b789d-f5cc-4b93-a35a-54bbe3f53cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1316 microversion: 2.1 time: 1.038555 Oct 05 17:50:24.617266 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1903/4081] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:23 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1316 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:24.629598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:24.630231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] [instance: 110c65b6-160a-482d-8dea-cd00fba96314] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:24.650308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:24.661863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:24.663246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:24.665202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:24.667123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:24.668408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:24.706895 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] HTTP exception thrown: Instance 110c65b6-160a-482d-8dea-cd00fba96314 could not be found. Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Request method failure captured: Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 HTTP/1.1 Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPDB0HtKhVVFgzo3G70bmOQSu9Oy6ownbS_TFV4fh_4AVD6BZ8KonLbuutEMv9pq5wCoXVdkOGjkmJJtCrOwgn0yVq4k_1ovB9WXgnS-CceVVllTc7BtLpmu0OtBw-BOX6O-Ef3ekqxizn0eki1MJwnp2FG9FkAcSOuBc-J2lwa83g Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_8dc71199181f4876b10ed4edfc9bd4c7", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/8dc71199181f4876b10ed4edfc9bd4c7"}]}] Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 8dc71199181f4876b10ed4edfc9bd4c7 Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1827821868 Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 7dc3271f68f7486a9264c9ee4e3c1bc2 Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1827821868-project Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 110c65b6-160a-482d-8dea-cd00fba96314 could not be found. Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '110c65b6-160a-482d-8dea-cd00fba96314'} Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 110c65b6-160a-482d-8dea-cd00fba96314 could not be found. Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 110c65b6-160a-482d-8dea-cd00fba96314 could not be found. Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:24.709155 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:24.714469 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:24.714469 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:24.714469 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:24.714469 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:24.714469 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:24.714469 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:24.714469 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 110c65b6-160a-482d-8dea-cd00fba96314 could not be found. Oct 05 17:50:24.714469 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:24.717500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] Returning 404 to user: Instance 110c65b6-160a-482d-8dea-cd00fba96314 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:24.718690 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f73b95db-bc38-479e-a99f-8c3b206a873b tempest-ServerMetadataNegativeTestJSON-1827821868 tempest-ServerMetadataNegativeTestJSON-1827821868-project] 10.222.0.70 "GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314" status: 404 len: 111 microversion: 2.1 time: 0.100061 Oct 05 17:50:24.719597 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1904/4082] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:24 2022] GET /compute/v2.1/servers/110c65b6-160a-482d-8dea-cd00fba96314 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:50:24.939849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-afa1073a-4500-4327-bb88-d1f4fcc3a673 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:24.953156 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-afa1073a-4500-4327-bb88-d1f4fcc3a673 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.628267 Oct 05 17:50:24.956037 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2179/4083] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:24 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:25.025997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:25.026653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] [instance: 3000d510-2d71-4508-bf70-8fa1fb68aaf5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:25.045958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:25.046823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:25.047464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:25.048963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:25.049424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:25.049983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:25.077345 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] HTTP exception thrown: Instance 3000d510-2d71-4508-bf70-8fa1fb68aaf5 could not be found. Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Request method failure captured: Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 HTTP/1.1 Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPF2jjCCYFmZwUjhC9QSRE0KgNkXzI57uTYif_FJCXyJxVItpZsmVhtR1Yt02cVQcSuY49peeXYAiwnEmxDV-iXZmGhsbaoAE3nt6TKsNoeDETJOP76pgLV_H5OvtrKJxLFrXOIBs-G06kkOJkigzRuyXzhcXMZeDQ2vrkxyAKGsdU Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: da744f7934fc474db0dff9f8fe7f98a6 Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1753462850 Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/da744f7934fc474db0dff9f8fe7f98a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da744f7934fc474db0dff9f8fe7f98a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_da744f7934fc474db0dff9f8fe7f98a6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/da744f7934fc474db0dff9f8fe7f98a6"}]}] Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1753462850 Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: da744f7934fc474db0dff9f8fe7f98a6 Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1753462850 Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerAddressesNegativeTestJSON-1753462850-project Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: deca8f69371b4ecba637e3357501fc59 Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1753462850-project Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 3000d510-2d71-4508-bf70-8fa1fb68aaf5 could not be found. Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '3000d510-2d71-4508-bf70-8fa1fb68aaf5'} Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3000d510-2d71-4508-bf70-8fa1fb68aaf5 could not be found. Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3000d510-2d71-4508-bf70-8fa1fb68aaf5 could not be found. Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:25.089766 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3000d510-2d71-4508-bf70-8fa1fb68aaf5 could not be found. Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] Returning 404 to user: Instance 3000d510-2d71-4508-bf70-8fa1fb68aaf5 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1ab41eb2-5a17-4e19-a8cc-a7712ff6de2c tempest-ServerAddressesNegativeTestJSON-1753462850 tempest-ServerAddressesNegativeTestJSON-1753462850-project] 10.222.0.70 "GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5" status: 404 len: 111 microversion: 2.1 time: 0.070264 Oct 05 17:50:25.093489 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1905/4084] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:25 2022] GET /compute/v2.1/servers/3000d510-2d71-4508-bf70-8fa1fb68aaf5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:50:25.424096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-45e59a0d-c33c-471b-a6c7-be0944093c56 req-88568929-1f99-4f0a-8609-04c93a213b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3000d510-2d71-4508-bf70-8fa1fb68aaf5", "name": "network-vif-deleted", "tag": "edac4d90-7c6e-4bce-a12d-79f4677577e2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:25.440813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-45e59a0d-c33c-471b-a6c7-be0944093c56 req-88568929-1f99-4f0a-8609-04c93a213b7e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:25.441468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-45e59a0d-c33c-471b-a6c7-be0944093c56 req-88568929-1f99-4f0a-8609-04c93a213b7e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:25.442002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-45e59a0d-c33c-471b-a6c7-be0944093c56 req-88568929-1f99-4f0a-8609-04c93a213b7e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:25.469638 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-45e59a0d-c33c-471b-a6c7-be0944093c56 req-88568929-1f99-4f0a-8609-04c93a213b7e service nova] Creating event network-vif-deleted:edac4d90-7c6e-4bce-a12d-79f4677577e2 for instance 3000d510-2d71-4508-bf70-8fa1fb68aaf5 on n-h2-835595-3 Oct 05 17:50:25.475280 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-45e59a0d-c33c-471b-a6c7-be0944093c56 req-88568929-1f99-4f0a-8609-04c93a213b7e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055171 Oct 05 17:50:25.476552 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2180/4085] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:25.628042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4bc03dc0-e572-4250-8c36-d067ec4be6b6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:25.628487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4bc03dc0-e572-4250-8c36-d067ec4be6b6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:25.645598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc03dc0-e572-4250-8c36-d067ec4be6b6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:25.646104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc03dc0-e572-4250-8c36-d067ec4be6b6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:25.648269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc03dc0-e572-4250-8c36-d067ec4be6b6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:25.649015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc03dc0-e572-4250-8c36-d067ec4be6b6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:25.658158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc03dc0-e572-4250-8c36-d067ec4be6b6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:25.659214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bc03dc0-e572-4250-8c36-d067ec4be6b6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:25.982170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ce677b9-acc0-41d8-9255-4c01538ad29f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:25.986195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7ce677b9-acc0-41d8-9255-4c01538ad29f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:26.013683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ce677b9-acc0-41d8-9255-4c01538ad29f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:26.016428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ce677b9-acc0-41d8-9255-4c01538ad29f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:26.018996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ce677b9-acc0-41d8-9255-4c01538ad29f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:26.024374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ce677b9-acc0-41d8-9255-4c01538ad29f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:26.025618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ce677b9-acc0-41d8-9255-4c01538ad29f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:26.026063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ce677b9-acc0-41d8-9255-4c01538ad29f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:26.368364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7ce677b9-acc0-41d8-9255-4c01538ad29f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:26.396070 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7ce677b9-acc0-41d8-9255-4c01538ad29f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.420695 Oct 05 17:50:26.396685 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2181/4086] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:25 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:26.517158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4bc03dc0-e572-4250-8c36-d067ec4be6b6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:26.530744 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4bc03dc0-e572-4250-8c36-d067ec4be6b6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1316 microversion: 2.1 time: 0.907498 Oct 05 17:50:26.532036 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1906/4087] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:25 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1316 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:27.429084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-988f564a-0e44-4e40-a988-0d914bbaffb8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:27.429621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-988f564a-0e44-4e40-a988-0d914bbaffb8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:27.441205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-988f564a-0e44-4e40-a988-0d914bbaffb8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:27.441699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-988f564a-0e44-4e40-a988-0d914bbaffb8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:27.442153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-988f564a-0e44-4e40-a988-0d914bbaffb8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:27.442871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-988f564a-0e44-4e40-a988-0d914bbaffb8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:27.443323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-988f564a-0e44-4e40-a988-0d914bbaffb8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:27.443739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-988f564a-0e44-4e40-a988-0d914bbaffb8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:27.558395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2668491c-9fd1-477b-a182-7a4218f31672 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:27.559020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2668491c-9fd1-477b-a182-7a4218f31672 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:27.571413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2668491c-9fd1-477b-a182-7a4218f31672 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:27.571916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2668491c-9fd1-477b-a182-7a4218f31672 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:27.572394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2668491c-9fd1-477b-a182-7a4218f31672 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:27.573270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2668491c-9fd1-477b-a182-7a4218f31672 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:27.573735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2668491c-9fd1-477b-a182-7a4218f31672 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:27.574162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2668491c-9fd1-477b-a182-7a4218f31672 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:27.821503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-988f564a-0e44-4e40-a988-0d914bbaffb8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:27.841482 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-988f564a-0e44-4e40-a988-0d914bbaffb8 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.416400 Oct 05 17:50:27.851638 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2182/4088] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:27 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:27.943226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2668491c-9fd1-477b-a182-7a4218f31672 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:27.960819 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2668491c-9fd1-477b-a182-7a4218f31672 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1466 microversion: 2.1 time: 0.405126 Oct 05 17:50:27.961851 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1907/4089] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:27 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1466 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:28.252973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e78f85d7-9815-4357-a465-5cd6bf7b6d8e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:28.253465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e78f85d7-9815-4357-a465-5cd6bf7b6d8e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:28.264446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e78f85d7-9815-4357-a465-5cd6bf7b6d8e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:28.264870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e78f85d7-9815-4357-a465-5cd6bf7b6d8e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:28.265305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e78f85d7-9815-4357-a465-5cd6bf7b6d8e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:28.266021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e78f85d7-9815-4357-a465-5cd6bf7b6d8e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:28.268879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e78f85d7-9815-4357-a465-5cd6bf7b6d8e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:28.269339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e78f85d7-9815-4357-a465-5cd6bf7b6d8e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:28.321665 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e78f85d7-9815-4357-a465-5cd6bf7b6d8e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/ips" status: 200 len: 144 microversion: 2.1 time: 0.072649 Oct 05 17:50:28.331516 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1908/4090] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:50:28 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/ips => generated 144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:28.445921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4b752536-a440-4507-9992-1046fc2c56c6 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:28.447180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4b752536-a440-4507-9992-1046fc2c56c6 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:28.461982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b752536-a440-4507-9992-1046fc2c56c6 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:28.462759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b752536-a440-4507-9992-1046fc2c56c6 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:28.463387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b752536-a440-4507-9992-1046fc2c56c6 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:28.464571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b752536-a440-4507-9992-1046fc2c56c6 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:28.465909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b752536-a440-4507-9992-1046fc2c56c6 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:28.466542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b752536-a440-4507-9992-1046fc2c56c6 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:28.867287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ef782551-d421-4320-817a-728ce899c33a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:28.868059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ef782551-d421-4320-817a-728ce899c33a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:28.903352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef782551-d421-4320-817a-728ce899c33a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:28.905027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef782551-d421-4320-817a-728ce899c33a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:28.907029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef782551-d421-4320-817a-728ce899c33a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:28.908187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef782551-d421-4320-817a-728ce899c33a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:28.912259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef782551-d421-4320-817a-728ce899c33a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:28.913048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef782551-d421-4320-817a-728ce899c33a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:28.936143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:29.305678 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4b752536-a440-4507-9992-1046fc2c56c6 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1617 microversion: 2.1 time: 1.324888 Oct 05 17:50:29.306640 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2183/4091] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:27 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1617 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:29.332742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e0e4b72-f25c-40b3-9407-519413800f92 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Action: 'create', calling method: .version_select at 0x7f7775243670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-665199400", "policies": ["affinity"]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:29.396389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0e0e4b72-f25c-40b3-9407-519413800f92 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:29.405492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0e0e4b72-f25c-40b3-9407-519413800f92 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:29.499869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0e0e4b72-f25c-40b3-9407-519413800f92 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:29.515615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0e0e4b72-f25c-40b3-9407-519413800f92 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_groups'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:29.551507 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0e0e4b72-f25c-40b3-9407-519413800f92 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.222672 Oct 05 17:50:29.554469 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2184/4092] 10.222.0.70 () {60 vars in 1174 bytes} [Wed Oct 5 17:50:29 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:29.814869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1315042410", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3e76ac12-a839-479b-9e5f-c34e96751838"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:29.902797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:50:30.312560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ef782551-d421-4320-817a-728ce899c33a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:30.336824 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ef782551-d421-4320-817a-728ce899c33a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 1.466302 Oct 05 17:50:30.339691 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1909/4093] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:28 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:30.943706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:50:30.944249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:50:30.944595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:50:30.945004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:50:30.945416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:50:30.996513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:30.998849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:30.999544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:31.000545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:31.003452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:31.004181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:31.054805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:31.062504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:31.089855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Going to run 2 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:50:31.095380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 4705a742-0c49-4acf-82cb-71e548a1acd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:50:31.184146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128844) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 05 17:50:31.224608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:31.238312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:31.329710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:31.338431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:31.363610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=4705a742-0c49-4acf-82cb-71e548a1acd2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:50:31.369585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00e54066-7c17-4627-932b-0d11ffa6d9f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:31.371905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00e54066-7c17-4627-932b-0d11ffa6d9f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:31.380625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e54066-7c17-4627-932b-0d11ffa6d9f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:31.381454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e54066-7c17-4627-932b-0d11ffa6d9f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:31.382047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e54066-7c17-4627-932b-0d11ffa6d9f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:31.383228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e54066-7c17-4627-932b-0d11ffa6d9f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:31.383884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e54066-7c17-4627-932b-0d11ffa6d9f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:31.386131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00e54066-7c17-4627-932b-0d11ffa6d9f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:31.397437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:31.474471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:31.486556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:31.624226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:31.643155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:31.803437 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0a07de24-1960-431c-9d7a-7ac0e554e47c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.988976 Oct 05 17:50:31.806764 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2185/4094] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:50:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 1997 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 05 17:50:31.834599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-44665fc7-f58e-475d-b4e0-6da1f349f368 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f303cd1b-0b6d-4e9d-be3a-0f46d920f884"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:31.843256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-44665fc7-f58e-475d-b4e0-6da1f349f368 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:31.875368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44665fc7-f58e-475d-b4e0-6da1f349f368 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:31.878696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44665fc7-f58e-475d-b4e0-6da1f349f368 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:31.881540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44665fc7-f58e-475d-b4e0-6da1f349f368 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:31.884775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44665fc7-f58e-475d-b4e0-6da1f349f368 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:31.885542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44665fc7-f58e-475d-b4e0-6da1f349f368 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:31.886728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-44665fc7-f58e-475d-b4e0-6da1f349f368 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:32.301563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-00e54066-7c17-4627-932b-0d11ffa6d9f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:32.326417 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00e54066-7c17-4627-932b-0d11ffa6d9f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 0.954451 Oct 05 17:50:32.329313 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1910/4095] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:31 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:32.400132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:32.409045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:32.413622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Searching by: {'deleted': False, 'project_id': '4809bb6013894d13a894acb816f7dca8'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:50:32.449466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:32.450202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:32.452196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:32.456880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:32.457584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:32.458854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:32.516652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:50:32.595969 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-44665fc7-f58e-475d-b4e0-6da1f349f368 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.786447 Oct 05 17:50:32.597542 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2186/4096] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 17:50:31 2022] POST /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments => generated 194 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:32.608885 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7225b4ad-9e9e-4dc7-b580-131ce623ff5a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.248026 Oct 05 17:50:32.610240 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1911/4097] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:50:32 2022] GET /compute/v2.1/servers => generated 1003 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:32.623997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d97b3df3-6b7d-4c3c-9b5a-1498cbf70287 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:32.626519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d97b3df3-6b7d-4c3c-9b5a-1498cbf70287 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:33.048438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d97b3df3-6b7d-4c3c-9b5a-1498cbf70287 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:33.065835 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d97b3df3-6b7d-4c3c-9b5a-1498cbf70287 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1219 microversion: 2.1 time: 0.446846 Oct 05 17:50:33.067627 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2187/4098] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:32 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1219 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:33.355276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-20393523-804b-4a80-b305-094059c2c3f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:33.355896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-20393523-804b-4a80-b305-094059c2c3f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:33.368637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20393523-804b-4a80-b305-094059c2c3f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:33.370708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20393523-804b-4a80-b305-094059c2c3f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:33.371851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20393523-804b-4a80-b305-094059c2c3f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:33.374269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20393523-804b-4a80-b305-094059c2c3f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:33.375930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20393523-804b-4a80-b305-094059c2c3f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:33.376691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20393523-804b-4a80-b305-094059c2c3f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:34.089175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12794c74-da9a-4e15-899c-7d5178529fa5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:34.100684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12794c74-da9a-4e15-899c-7d5178529fa5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:34.123824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12794c74-da9a-4e15-899c-7d5178529fa5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:34.126073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12794c74-da9a-4e15-899c-7d5178529fa5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:34.131777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12794c74-da9a-4e15-899c-7d5178529fa5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:34.134229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12794c74-da9a-4e15-899c-7d5178529fa5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:34.137011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12794c74-da9a-4e15-899c-7d5178529fa5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:34.139237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12794c74-da9a-4e15-899c-7d5178529fa5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:34.271154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-12794c74-da9a-4e15-899c-7d5178529fa5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:34.286798 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12794c74-da9a-4e15-899c-7d5178529fa5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1215 microversion: 2.1 time: 0.201066 Oct 05 17:50:34.288427 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2188/4099] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:34 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1215 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:34.689656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-20393523-804b-4a80-b305-094059c2c3f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:34.700596 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-20393523-804b-4a80-b305-094059c2c3f7 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 1.349501 Oct 05 17:50:34.705127 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1912/4100] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:33 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:35.313928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-67119265-4523-4993-84fd-90d4ec193c6c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:35.315707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-67119265-4523-4993-84fd-90d4ec193c6c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:35.337854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67119265-4523-4993-84fd-90d4ec193c6c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:35.339913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67119265-4523-4993-84fd-90d4ec193c6c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:35.341793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67119265-4523-4993-84fd-90d4ec193c6c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:35.342782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67119265-4523-4993-84fd-90d4ec193c6c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:35.346182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67119265-4523-4993-84fd-90d4ec193c6c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:35.346925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67119265-4523-4993-84fd-90d4ec193c6c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:35.557607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-67119265-4523-4993-84fd-90d4ec193c6c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:35.589450 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-67119265-4523-4993-84fd-90d4ec193c6c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1271 microversion: 2.1 time: 0.276880 Oct 05 17:50:35.590577 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2189/4101] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:35 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1271 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:35.769993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5bf718f2-3f02-4006-8036-f5a0f82324a0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:35.770810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5bf718f2-3f02-4006-8036-f5a0f82324a0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:35.816884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bf718f2-3f02-4006-8036-f5a0f82324a0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:35.818497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bf718f2-3f02-4006-8036-f5a0f82324a0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:35.821353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bf718f2-3f02-4006-8036-f5a0f82324a0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:35.825081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bf718f2-3f02-4006-8036-f5a0f82324a0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:35.825760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bf718f2-3f02-4006-8036-f5a0f82324a0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:35.829241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bf718f2-3f02-4006-8036-f5a0f82324a0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:36.634089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d0b66cd-707a-484b-9c53-b430597b1dae tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:36.653151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2d0b66cd-707a-484b-9c53-b430597b1dae tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:36.697513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d0b66cd-707a-484b-9c53-b430597b1dae tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:36.698705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d0b66cd-707a-484b-9c53-b430597b1dae tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:36.699547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d0b66cd-707a-484b-9c53-b430597b1dae tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:36.700900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d0b66cd-707a-484b-9c53-b430597b1dae tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:36.707038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d0b66cd-707a-484b-9c53-b430597b1dae tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:36.710989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d0b66cd-707a-484b-9c53-b430597b1dae tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:37.024645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2d0b66cd-707a-484b-9c53-b430597b1dae tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:37.040406 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2d0b66cd-707a-484b-9c53-b430597b1dae tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1289 microversion: 2.1 time: 0.428909 Oct 05 17:50:37.053754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5bf718f2-3f02-4006-8036-f5a0f82324a0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:37.055691 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2190/4102] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:36 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1289 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:37.072756 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5bf718f2-3f02-4006-8036-f5a0f82324a0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 1.345119 Oct 05 17:50:37.077939 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1913/4103] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:35 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:37.362213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1402052686", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": "none"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:37.483248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:50:37.489157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:50:37.489812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:50:37.492294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:50:37.495982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:50:37.524522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:37.527224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:37.530814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:37.532621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:37.537867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:37.538681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:37.565538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Getting quotas for project 03b640c07a604e6da688d2806df25129. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:37.587758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Getting quotas for user 063a3a072f3c465ca650a59bff7f186a and project 03b640c07a604e6da688d2806df25129. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:37.647046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:50:37.657611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: e85ce98a-9253-4589-aed7-542120d165fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:50:37.834515 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-15fde6db-0984-4f50-bbee-92a759966841 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.777006 Oct 05 17:50:37.835959 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2191/4104] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:50:37.847511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a6ad6c21-e644-49f8-8295-8d1cf6c97873 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:37.848269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a6ad6c21-e644-49f8-8295-8d1cf6c97873 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: e85ce98a-9253-4589-aed7-542120d165fd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:38.068218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5a78ed7b-a5a8-4f69-a4ec-32032d1072e0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:38.068868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5a78ed7b-a5a8-4f69-a4ec-32032d1072e0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:38.083141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a78ed7b-a5a8-4f69-a4ec-32032d1072e0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:38.089782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a78ed7b-a5a8-4f69-a4ec-32032d1072e0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:38.090490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a78ed7b-a5a8-4f69-a4ec-32032d1072e0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:38.091913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a78ed7b-a5a8-4f69-a4ec-32032d1072e0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:38.101094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a78ed7b-a5a8-4f69-a4ec-32032d1072e0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:38.101823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a78ed7b-a5a8-4f69-a4ec-32032d1072e0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:38.252183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a6ad6c21-e644-49f8-8295-8d1cf6c97873 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:38.261374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a6ad6c21-e644-49f8-8295-8d1cf6c97873 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:38.266458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a6ad6c21-e644-49f8-8295-8d1cf6c97873 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:38.269741 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a6ad6c21-e644-49f8-8295-8d1cf6c97873 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd" status: 200 len: 1278 microversion: 2.47 time: 0.426472 Oct 05 17:50:38.270358 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1914/4105] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:37 2022] GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd => generated 1278 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:50:38.294336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5a78ed7b-a5a8-4f69-a4ec-32032d1072e0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:38.309884 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5a78ed7b-a5a8-4f69-a4ec-32032d1072e0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1277 microversion: 2.1 time: 0.246371 Oct 05 17:50:38.321778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f8818a0a-9d42-4896-bb41-ecbfb5dfe9ce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:38.325895 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2192/4106] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:38 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:38.328344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f8818a0a-9d42-4896-bb41-ecbfb5dfe9ce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:38.348712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8818a0a-9d42-4896-bb41-ecbfb5dfe9ce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:38.349489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8818a0a-9d42-4896-bb41-ecbfb5dfe9ce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:38.350100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8818a0a-9d42-4896-bb41-ecbfb5dfe9ce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:38.351171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8818a0a-9d42-4896-bb41-ecbfb5dfe9ce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:38.351788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8818a0a-9d42-4896-bb41-ecbfb5dfe9ce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:38.352361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8818a0a-9d42-4896-bb41-ecbfb5dfe9ce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:38.664975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-490352525", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": "none"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:38.793028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:50:38.794736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:50:38.800287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:50:38.802149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:50:38.816700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:50:38.829909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:38.832007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:38.833413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:38.835113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:38.836459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:38.837700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:38.868525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:38.905952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Getting quotas for project 03b640c07a604e6da688d2806df25129. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:38.920566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Getting quotas for user 063a3a072f3c465ca650a59bff7f186a and project 03b640c07a604e6da688d2806df25129. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:38.960483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:50:38.968095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:50:39.082241 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-28d5dc19-3d61-4dea-aae2-4c7118129ff7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.421988 Oct 05 17:50:39.089328 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2193/4107] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:50:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 05 17:50:39.103986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e7e8977-4631-4e9c-b86d-e6a2949e9caa tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:39.106561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e7e8977-4631-4e9c-b86d-e6a2949e9caa tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:39.158027 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e7e8977-4631-4e9c-b86d-e6a2949e9caa tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "PUT /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 991 microversion: 2.47 time: 0.058817 Oct 05 17:50:39.171375 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2194/4108] 10.222.0.70 () {62 vars in 1297 bytes} [Wed Oct 5 17:50:39 2022] PUT /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:50:39.189247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64ab0992-b9c0-4c34-8c75-c31f18851983 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:39.189890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-64ab0992-b9c0-4c34-8c75-c31f18851983 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:39.313528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-64ab0992-b9c0-4c34-8c75-c31f18851983 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:39.326235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-64ab0992-b9c0-4c34-8c75-c31f18851983 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:39.328051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-64ab0992-b9c0-4c34-8c75-c31f18851983 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:39.329685 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-64ab0992-b9c0-4c34-8c75-c31f18851983 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1277 microversion: 2.47 time: 0.150904 Oct 05 17:50:39.330862 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2195/4109] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:39 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:39.363521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:39.365383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:39.393226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:39.397897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:39.398539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:39.399701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:39.400915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:39.401517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:39.542405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:39.557758 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1277 microversion: 2.1 time: 0.207111 Oct 05 17:50:39.575157 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2196/4110] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:39 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:39.956890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:39.959211 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a64b153e-4db3-452e-b387-f79275aca55c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002671 Oct 05 17:50:39.968012 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2197/4111] 10.222.0.70 () {56 vars in 886 bytes} [Wed Oct 5 17:50:39 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 05 17:50:40.063321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f8818a0a-9d42-4896-bb41-ecbfb5dfe9ce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:40.075497 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f8818a0a-9d42-4896-bb41-ecbfb5dfe9ce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1738 microversion: 2.1 time: 1.803782 Oct 05 17:50:40.079611 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1915/4112] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:38 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1738 bytes in 1808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:40.358308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:40.359587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:40.379192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:40.382922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:40.385383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:40.386994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:40.388282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:40.389493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:40.565185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:40.583915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1c3d562a-2dfd-43ed-8033-76eee2f6c876 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:40.584561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1c3d562a-2dfd-43ed-8033-76eee2f6c876 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:40.591094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:40.592571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:40.593808 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b4b99b2b-bab8-48f6-b61f-0ce79973351b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1329 microversion: 2.47 time: 0.239973 Oct 05 17:50:40.611324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:40.646722 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2198/4113] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:40 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1329 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:50:40.656536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3d562a-2dfd-43ed-8033-76eee2f6c876 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:40.657162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3d562a-2dfd-43ed-8033-76eee2f6c876 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:40.657502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3d562a-2dfd-43ed-8033-76eee2f6c876 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:40.659679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3d562a-2dfd-43ed-8033-76eee2f6c876 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:40.660337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3d562a-2dfd-43ed-8033-76eee2f6c876 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:40.660973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c3d562a-2dfd-43ed-8033-76eee2f6c876 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:40.850779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1c3d562a-2dfd-43ed-8033-76eee2f6c876 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:40.897112 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1c3d562a-2dfd-43ed-8033-76eee2f6c876 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1277 microversion: 2.1 time: 0.317667 Oct 05 17:50:40.905770 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1916/4114] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:40 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1277 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:41.102616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2cb98f27-508a-4cd8-99d3-27b0a0da76ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:41.103775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2cb98f27-508a-4cd8-99d3-27b0a0da76ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:41.118798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cb98f27-508a-4cd8-99d3-27b0a0da76ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:41.120391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cb98f27-508a-4cd8-99d3-27b0a0da76ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:41.122648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cb98f27-508a-4cd8-99d3-27b0a0da76ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:41.123673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cb98f27-508a-4cd8-99d3-27b0a0da76ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:41.124569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cb98f27-508a-4cd8-99d3-27b0a0da76ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:41.125190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2cb98f27-508a-4cd8-99d3-27b0a0da76ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:41.427285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2cb98f27-508a-4cd8-99d3-27b0a0da76ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:41.446473 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2cb98f27-508a-4cd8-99d3-27b0a0da76ab tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1718 microversion: 2.1 time: 0.351431 Oct 05 17:50:41.447478 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2199/4115] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:41 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1718 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:41.678754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:41.679419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:41.706529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:41.707096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:41.713624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:41.724151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:41.724765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:41.732517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:41.744374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:41.745132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:41.764305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:41.764921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:41.765379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:41.766138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:41.766675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:41.767109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:42.281200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:42.299913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:42.305147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:42.309923 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8221cc85-6182-4b14-87e3-cbd02e1cab93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1329 microversion: 2.47 time: 0.636396 Oct 05 17:50:42.313537 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1917/4116] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:41 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1329 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:42.332466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-baa30a0e-6375-448d-b42d-3f74e24695eb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:42.333791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-baa30a0e-6375-448d-b42d-3f74e24695eb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:42.352405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baa30a0e-6375-448d-b42d-3f74e24695eb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:42.354124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baa30a0e-6375-448d-b42d-3f74e24695eb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:42.357455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baa30a0e-6375-448d-b42d-3f74e24695eb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:42.360175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baa30a0e-6375-448d-b42d-3f74e24695eb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:42.362548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baa30a0e-6375-448d-b42d-3f74e24695eb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:42.363118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-baa30a0e-6375-448d-b42d-3f74e24695eb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:42.452404 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] HTTP exception thrown: Cannot 'detach_volume' instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 while it is in vm_state rescued Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Request method failure captured: Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments/05fe0a8e-b756-4ee9-9224-1072ba8f50df HTTP/1.1 Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcMOAOpdE63X8OhW4wsEy2crLrx01LtQ-rp_0wT7KyP_snq49RBe9pW2rDXvGDquoPS8xWknsOpVRp2diM1zITKhR01lPNUgSkUsWER9laVmknlwDrrF_SZj9lTxUjYcrefuqCr0JxKMwpc1ouYu8vVwbNWydS37cc_WZDK5JdlZgNU Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/caf452f31a594c888e1703356c637a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_caf452f31a594c888e1703356c637a91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}] Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 50b3fb554dd64e41bea1109e697b0799 Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot 'detach_volume' instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 while it is in vm_state rescued Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': '306c41c5-0f1e-4812-a54d-c31fc031c7d1', 'id': '05fe0a8e-b756-4ee9-9224-1072ba8f50df'} Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 while it is in vm_state rescued Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:42.463034 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:42.467699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:42.467699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:42.467699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:42.467699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:42.467699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 while it is in vm_state rescued Oct 05 17:50:42.467699 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:42.472157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Returning 409 to user: Cannot 'detach_volume' instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 while it is in vm_state rescued {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:42.475275 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54707ddc-851a-4053-a4fa-f2270265a1d4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "DELETE /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments/05fe0a8e-b756-4ee9-9224-1072ba8f50df" status: 409 len: 152 microversion: 2.1 time: 0.735491 Oct 05 17:50:42.478550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:42.480268 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2200/4117] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 17:50:41 2022] DELETE /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments/05fe0a8e-b756-4ee9-9224-1072ba8f50df => generated 152 bytes in 741 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:50:42.504415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c75d52a-e0d5-43ed-93f6-d4c997e052d0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:42.505250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6c75d52a-e0d5-43ed-93f6-d4c997e052d0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:42.532654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c75d52a-e0d5-43ed-93f6-d4c997e052d0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:42.536389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c75d52a-e0d5-43ed-93f6-d4c997e052d0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:42.537056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c75d52a-e0d5-43ed-93f6-d4c997e052d0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:42.545572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c75d52a-e0d5-43ed-93f6-d4c997e052d0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:42.546405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c75d52a-e0d5-43ed-93f6-d4c997e052d0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:42.547260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c75d52a-e0d5-43ed-93f6-d4c997e052d0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:42.672861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-baa30a0e-6375-448d-b42d-3f74e24695eb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:42.688499 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-baa30a0e-6375-448d-b42d-3f74e24695eb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1277 microversion: 2.1 time: 0.373193 Oct 05 17:50:42.689118 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1918/4118] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:42 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1277 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:42.805636 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6c75d52a-e0d5-43ed-93f6-d4c997e052d0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/action" status: 202 len: 0 microversion: 2.1 time: 0.320442 Oct 05 17:50:42.814618 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2201/4119] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:50:42 2022] POST /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:50:42.822918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-308abc45-4d55-43e4-9d20-6d5e35517b57 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:42.823683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-308abc45-4d55-43e4-9d20-6d5e35517b57 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:42.837497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308abc45-4d55-43e4-9d20-6d5e35517b57 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:42.839441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308abc45-4d55-43e4-9d20-6d5e35517b57 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:42.843352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308abc45-4d55-43e4-9d20-6d5e35517b57 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:42.847068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308abc45-4d55-43e4-9d20-6d5e35517b57 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:42.850517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308abc45-4d55-43e4-9d20-6d5e35517b57 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:42.851792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308abc45-4d55-43e4-9d20-6d5e35517b57 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:43.347909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:43.348916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:43.381758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:43.383302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:43.388573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:43.393465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:43.394737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:43.397574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:43.693213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:43.714473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:43.717121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:43.721982 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dd130f3b-f601-4cf3-95de-b10f8a477a93 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1335 microversion: 2.47 time: 0.380109 Oct 05 17:50:43.724058 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2202/4120] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:43 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1335 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:43.730114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc32c2a6-2a33-4011-835c-5deb3e576ef9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:43.731282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc32c2a6-2a33-4011-835c-5deb3e576ef9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:43.738235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc32c2a6-2a33-4011-835c-5deb3e576ef9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:43.743821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc32c2a6-2a33-4011-835c-5deb3e576ef9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:43.744279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc32c2a6-2a33-4011-835c-5deb3e576ef9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:43.745039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc32c2a6-2a33-4011-835c-5deb3e576ef9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:43.745665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc32c2a6-2a33-4011-835c-5deb3e576ef9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:43.746105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc32c2a6-2a33-4011-835c-5deb3e576ef9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:43.971719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc32c2a6-2a33-4011-835c-5deb3e576ef9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:44.037881 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc32c2a6-2a33-4011-835c-5deb3e576ef9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1277 microversion: 2.1 time: 0.311788 Oct 05 17:50:44.038541 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2203/4121] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:43 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1277 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:44.755393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:44.756343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:44.774113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:44.775156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:44.776083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:44.778535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:44.779335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:44.781533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:44.955533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:44.969513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:44.974948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:44.978742 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-350cdd37-0bf3-4408-a037-dcaf91fb11fc tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1335 microversion: 2.47 time: 0.228361 Oct 05 17:50:44.984396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-308abc45-4d55-43e4-9d20-6d5e35517b57 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:44.993099 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2204/4122] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:44 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1335 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:45.004214 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-308abc45-4d55-43e4-9d20-6d5e35517b57 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1726 microversion: 2.1 time: 2.187261 Oct 05 17:50:45.017719 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1919/4123] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:42 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1726 bytes in 2202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:45.068571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4fcc8576-d8d5-4442-8c6c-2220b8302b22 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:45.069554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4fcc8576-d8d5-4442-8c6c-2220b8302b22 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:45.072716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=91 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:45.079125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fcc8576-d8d5-4442-8c6c-2220b8302b22 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:45.080303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fcc8576-d8d5-4442-8c6c-2220b8302b22 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:45.081253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fcc8576-d8d5-4442-8c6c-2220b8302b22 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:45.082867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fcc8576-d8d5-4442-8c6c-2220b8302b22 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:45.083911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fcc8576-d8d5-4442-8c6c-2220b8302b22 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:45.084533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fcc8576-d8d5-4442-8c6c-2220b8302b22 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:45.403296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4fcc8576-d8d5-4442-8c6c-2220b8302b22 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:45.426440 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4fcc8576-d8d5-4442-8c6c-2220b8302b22 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.361134 Oct 05 17:50:45.429055 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2205/4124] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:45 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:46.023278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:46.024670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:46.029785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eea054f4-1fbf-4de2-be73-411af96569aa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:46.030457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eea054f4-1fbf-4de2-be73-411af96569aa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:46.050431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.050431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.052949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.055123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.055570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eea054f4-1fbf-4de2-be73-411af96569aa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.056241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.057486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eea054f4-1fbf-4de2-be73-411af96569aa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.057667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.058256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eea054f4-1fbf-4de2-be73-411af96569aa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.059278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eea054f4-1fbf-4de2-be73-411af96569aa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.061983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eea054f4-1fbf-4de2-be73-411af96569aa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.062767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eea054f4-1fbf-4de2-be73-411af96569aa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.183381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:46.197968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:46.205154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:46.208084 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ad998195-8a18-47da-8c85-d41a02807dec tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1356 microversion: 2.47 time: 0.189078 Oct 05 17:50:46.212011 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1920/4125] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:46 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1356 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:46.239461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:46.243480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:46.259716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.262809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.263895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.265257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.268769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.269240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.273081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eea054f4-1fbf-4de2-be73-411af96569aa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:46.284234 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eea054f4-1fbf-4de2-be73-411af96569aa tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1732 microversion: 2.1 time: 0.258735 Oct 05 17:50:46.286080 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2206/4126] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:46 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1732 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:46.309825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5aa0acd-3ce7-4adb-9498-af656ef43fbc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:46.310930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5aa0acd-3ce7-4adb-9498-af656ef43fbc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:46.321146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa0acd-3ce7-4adb-9498-af656ef43fbc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.322110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa0acd-3ce7-4adb-9498-af656ef43fbc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.322938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa0acd-3ce7-4adb-9498-af656ef43fbc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.323843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa0acd-3ce7-4adb-9498-af656ef43fbc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.326490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa0acd-3ce7-4adb-9498-af656ef43fbc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.326490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa0acd-3ce7-4adb-9498-af656ef43fbc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.414911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:50:46.415868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:50:46.416600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:50:46.417177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:50:46.418853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:50:46.470576 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5aa0acd-3ce7-4adb-9498-af656ef43fbc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.165791 Oct 05 17:50:46.471733 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2207/4127] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:50:46 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-interface => generated 285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:50:46.479113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47aec8e1-23f0-467e-946e-4bfb463f889e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:46.480067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-47aec8e1-23f0-467e-946e-4bfb463f889e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:46.496177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47aec8e1-23f0-467e-946e-4bfb463f889e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.496955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47aec8e1-23f0-467e-946e-4bfb463f889e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.509495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47aec8e1-23f0-467e-946e-4bfb463f889e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.511801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47aec8e1-23f0-467e-946e-4bfb463f889e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.512807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47aec8e1-23f0-467e-946e-4bfb463f889e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.516083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47aec8e1-23f0-467e-946e-4bfb463f889e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.538669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:46.556463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.556990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.558894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.560797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.561279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.561718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.696178 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-80d54f44-a4ab-48e4-8c91-5d07db6f861e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "POST /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202/action" status: 202 len: 1078 microversion: 2.47 time: 0.464078 Oct 05 17:50:46.709711 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1921/4128] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 17:50:46 2022] POST /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202/action => generated 1078 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 05 17:50:46.735481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4cd6bd61-a806-488a-a56f-e35cf4f6e849 tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f7779562dc0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:46.824314 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4cd6bd61-a806-488a-a56f-e35cf4f6e849 tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/5c05e25e-5e70-4845-9fd8-d9054c1fd6c0" status: 200 len: 351 microversion: 2.1 time: 0.113306 Oct 05 17:50:46.825822 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1922/4129] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:50:46 2022] GET /compute/v2.1/os-volumes/5c05e25e-5e70-4845-9fd8-d9054c1fd6c0 => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:46.834650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:46.835710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:46.855386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.857179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.860184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:46.862139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:46.862767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:46.863329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:47.212814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-47aec8e1-23f0-467e-946e-4bfb463f889e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:47.226455 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-47aec8e1-23f0-467e-946e-4bfb463f889e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.751613 Oct 05 17:50:47.227517 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2208/4130] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:46 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:47.231222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:47.250998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:47.258903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:47.262749 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29952fd5-9740-48bf-8c9a-5c507e581ad5 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.433934 Oct 05 17:50:47.263986 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1923/4131] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:46 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:48.047109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-671ddca8-9ee3-4d06-bb8a-1b9c20e6f87e req-b74710e8-4acd-4843-864a-9b1ddf33f13b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4705a742-0c49-4acf-82cb-71e548a1acd2", "tag": "9b9704d0-a556-4ecd-bfab-26c9679bc57b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:48.066520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-671ddca8-9ee3-4d06-bb8a-1b9c20e6f87e req-b74710e8-4acd-4843-864a-9b1ddf33f13b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:48.068528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-671ddca8-9ee3-4d06-bb8a-1b9c20e6f87e req-b74710e8-4acd-4843-864a-9b1ddf33f13b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:48.070939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-671ddca8-9ee3-4d06-bb8a-1b9c20e6f87e req-b74710e8-4acd-4843-864a-9b1ddf33f13b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:48.096003 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-671ddca8-9ee3-4d06-bb8a-1b9c20e6f87e req-b74710e8-4acd-4843-864a-9b1ddf33f13b service nova] Creating event network-changed:9b9704d0-a556-4ecd-bfab-26c9679bc57b for instance 4705a742-0c49-4acf-82cb-71e548a1acd2 on n-h2-835595-3 Oct 05 17:50:48.107528 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-671ddca8-9ee3-4d06-bb8a-1b9c20e6f87e req-b74710e8-4acd-4843-864a-9b1ddf33f13b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064060 Oct 05 17:50:48.108792 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2209/4132] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:48.251936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b2152436-359b-4410-953e-d4f2049d133e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:48.253418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b2152436-359b-4410-953e-d4f2049d133e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:48.264566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:48.272796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2152436-359b-4410-953e-d4f2049d133e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:48.272796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2152436-359b-4410-953e-d4f2049d133e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:48.273535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2152436-359b-4410-953e-d4f2049d133e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:48.274395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2152436-359b-4410-953e-d4f2049d133e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:48.275211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2152436-359b-4410-953e-d4f2049d133e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:48.275902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2152436-359b-4410-953e-d4f2049d133e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:48.293228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:48.295562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:48.303595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:48.304666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:48.305388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:48.306372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:48.307103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:48.307766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:48.664650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2152436-359b-4410-953e-d4f2049d133e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:48.683208 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b2152436-359b-4410-953e-d4f2049d133e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.436549 Oct 05 17:50:48.684174 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1924/4133] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:48 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:48.802104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:48.812392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:48.819987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:48.823022 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3565130-5b9a-4001-a2a3-7531a2e0aff9 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.534863 Oct 05 17:50:48.823641 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2210/4134] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:48 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:50:49.285254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-443c9422-bd83-4e28-b389-e1ea5fe90650 req-4d151b84-6a8d-4ea5-ad07-cce4d5b5567a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "306c41c5-0f1e-4812-a54d-c31fc031c7d1", "tag": "371d802d-9093-4be5-860b-4f96eed3c8f9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:49.309254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-443c9422-bd83-4e28-b389-e1ea5fe90650 req-4d151b84-6a8d-4ea5-ad07-cce4d5b5567a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:49.309745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-443c9422-bd83-4e28-b389-e1ea5fe90650 req-4d151b84-6a8d-4ea5-ad07-cce4d5b5567a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:49.310179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-443c9422-bd83-4e28-b389-e1ea5fe90650 req-4d151b84-6a8d-4ea5-ad07-cce4d5b5567a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:49.344237 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-443c9422-bd83-4e28-b389-e1ea5fe90650 req-4d151b84-6a8d-4ea5-ad07-cce4d5b5567a service nova] Creating event network-changed:371d802d-9093-4be5-860b-4f96eed3c8f9 for instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 on n-h2-835595-3 Oct 05 17:50:49.365961 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-443c9422-bd83-4e28-b389-e1ea5fe90650 req-4d151b84-6a8d-4ea5-ad07-cce4d5b5567a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084609 Oct 05 17:50:49.367527 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1925/4135] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:50:49.639661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54937d21-0a6b-48db-b68a-d8acc63bc84e tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f77752e2af0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:49.654152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:49.661733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=46 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:49.712633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bae649b4-b2f7-4c13-9729-ccd2a2ddd2a3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:49.713352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bae649b4-b2f7-4c13-9729-ccd2a2ddd2a3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:49.722819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bae649b4-b2f7-4c13-9729-ccd2a2ddd2a3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:49.728221 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54937d21-0a6b-48db-b68a-d8acc63bc84e tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/bf4a6feb-b978-47a0-9289-74a60431bca5" status: 200 len: 351 microversion: 2.1 time: 0.093016 Oct 05 17:50:49.728586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bae649b4-b2f7-4c13-9729-ccd2a2ddd2a3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:49.729471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bae649b4-b2f7-4c13-9729-ccd2a2ddd2a3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:49.730481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bae649b4-b2f7-4c13-9729-ccd2a2ddd2a3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:49.731915 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2211/4136] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:50:49 2022] GET /compute/v2.1/os-volumes/bf4a6feb-b978-47a0-9289-74a60431bca5 => generated 351 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:49.732470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bae649b4-b2f7-4c13-9729-ccd2a2ddd2a3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:49.733690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bae649b4-b2f7-4c13-9729-ccd2a2ddd2a3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:49.793978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:49.860294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:49.861311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:49.938986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:49.946397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:49.955851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:49.959242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:49.961332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:49.965087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:50.144009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bae649b4-b2f7-4c13-9729-ccd2a2ddd2a3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:50.163773 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bae649b4-b2f7-4c13-9729-ccd2a2ddd2a3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.457889 Oct 05 17:50:50.165534 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1926/4137] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:49 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:50.370313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b3f78b99-1389-410e-a739-3922db014744 req-048c3d71-7973-4565-982f-9536124b1606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52330818-f5f6-4744-bdca-28952038b28b", "tag": "9b063444-500f-46cb-8860-efc7dc640e7d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:50.388348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b3f78b99-1389-410e-a739-3922db014744 req-048c3d71-7973-4565-982f-9536124b1606 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:50.391138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b3f78b99-1389-410e-a739-3922db014744 req-048c3d71-7973-4565-982f-9536124b1606 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:50.396981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b3f78b99-1389-410e-a739-3922db014744 req-048c3d71-7973-4565-982f-9536124b1606 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:50.422064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:50.427838 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b3f78b99-1389-410e-a739-3922db014744 req-048c3d71-7973-4565-982f-9536124b1606 service nova] Creating event network-changed:9b063444-500f-46cb-8860-efc7dc640e7d for instance 52330818-f5f6-4744-bdca-28952038b28b on n-h2-835595-3 Oct 05 17:50:50.433585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:50.441661 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b3f78b99-1389-410e-a739-3922db014744 req-048c3d71-7973-4565-982f-9536124b1606 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073664 Oct 05 17:50:50.443854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:50.445692 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1d523e24-f3e1-4476-940b-5987781cff89 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.598467 Oct 05 17:50:50.446059 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1927/4138] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:50.446946 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2212/4139] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:49 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:50:51.135298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a0485045-cede-440f-a553-f326c4e943be tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Action: 'create', calling method: .version_select at 0x7f777465f550>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:51.193384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ff3d3dc-e9fd-45b2-b3f0-bd47f86ba871 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:51.194607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ff3d3dc-e9fd-45b2-b3f0-bd47f86ba871 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:51.200094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a0485045-cede-440f-a553-f326c4e943be tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Getting quotas for project 4cd2c8390fa84e9ab9bcb2ded1b34079. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:51.203025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3dc-e9fd-45b2-b3f0-bd47f86ba871 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:51.203420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3dc-e9fd-45b2-b3f0-bd47f86ba871 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:51.203864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3dc-e9fd-45b2-b3f0-bd47f86ba871 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:51.204561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3dc-e9fd-45b2-b3f0-bd47f86ba871 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:51.220926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a0485045-cede-440f-a553-f326c4e943be tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Getting quotas for user 5e75965e4ffa48b8b1c78576b26bcc4f and project 4cd2c8390fa84e9ab9bcb2ded1b34079. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:51.222649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3dc-e9fd-45b2-b3f0-bd47f86ba871 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:51.223148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff3d3dc-e9fd-45b2-b3f0-bd47f86ba871 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:51.327550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a0485045-cede-440f-a553-f326c4e943be tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Getting quotas for project 4cd2c8390fa84e9ab9bcb2ded1b34079. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:50:51.340272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a0485045-cede-440f-a553-f326c4e943be tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Getting quotas for user 5e75965e4ffa48b8b1c78576b26bcc4f and project 4cd2c8390fa84e9ab9bcb2ded1b34079. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:50:51.378338 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a0485045-cede-440f-a553-f326c4e943be tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.442647 Oct 05 17:50:51.378964 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1928/4140] 10.222.0.70 () {62 vars in 1214 bytes} [Wed Oct 5 17:50:50 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:50:51.396154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5df04d3e-2ffd-4a94-bd0c-baeae949cd98 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:51.402684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5df04d3e-2ffd-4a94-bd0c-baeae949cd98 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:51.420290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5df04d3e-2ffd-4a94-bd0c-baeae949cd98 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:51.420783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5df04d3e-2ffd-4a94-bd0c-baeae949cd98 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:51.421222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5df04d3e-2ffd-4a94-bd0c-baeae949cd98 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:51.426438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5df04d3e-2ffd-4a94-bd0c-baeae949cd98 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:51.427167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5df04d3e-2ffd-4a94-bd0c-baeae949cd98 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:51.427908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5df04d3e-2ffd-4a94-bd0c-baeae949cd98 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:51.503302 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5df04d3e-2ffd-4a94-bd0c-baeae949cd98 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114899 Oct 05 17:50:51.509896 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1929/4141] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:50:51 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:51.519243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4f9926a-9968-43c0-83b7-a620f5e6093b tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:51.542740 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4f9926a-9968-43c0-83b7-a620f5e6093b tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.030612 Oct 05 17:50:51.549815 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1930/4142] 10.222.0.70 () {60 vars in 1193 bytes} [Wed Oct 5 17:50:51 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:50:51.572597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f700f814-74fb-4fec-b821-7afa20ce79af req-115c2c67-a857-4050-9875-f17a32c3ae46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "306c41c5-0f1e-4812-a54d-c31fc031c7d1", "tag": "371d802d-9093-4be5-860b-4f96eed3c8f9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:51.615952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f700f814-74fb-4fec-b821-7afa20ce79af req-115c2c67-a857-4050-9875-f17a32c3ae46 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:51.620224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f700f814-74fb-4fec-b821-7afa20ce79af req-115c2c67-a857-4050-9875-f17a32c3ae46 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:51.623868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f700f814-74fb-4fec-b821-7afa20ce79af req-115c2c67-a857-4050-9875-f17a32c3ae46 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:51.645124 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f700f814-74fb-4fec-b821-7afa20ce79af req-115c2c67-a857-4050-9875-f17a32c3ae46 service nova] Creating event network-changed:371d802d-9093-4be5-860b-4f96eed3c8f9 for instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 on n-h2-835595-3 Oct 05 17:50:51.652868 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f700f814-74fb-4fec-b821-7afa20ce79af req-115c2c67-a857-4050-9875-f17a32c3ae46 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101561 Oct 05 17:50:51.657249 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1931/4143] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:51.671604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:51.672587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:51.682144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:51.682847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:51.683468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:51.684453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:51.685117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:51.685705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:51.770472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0ff3d3dc-e9fd-45b2-b3f0-bd47f86ba871 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:51.782615 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ff3d3dc-e9fd-45b2-b3f0-bd47f86ba871 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.595065 Oct 05 17:50:51.784515 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2213/4144] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:51 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:51.800368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7caeb478-78d1-4acf-b129-208c6ac55763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:51.800891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7caeb478-78d1-4acf-b129-208c6ac55763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:51.807827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7caeb478-78d1-4acf-b129-208c6ac55763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:51.808319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7caeb478-78d1-4acf-b129-208c6ac55763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:51.808754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7caeb478-78d1-4acf-b129-208c6ac55763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:51.809457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7caeb478-78d1-4acf-b129-208c6ac55763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:51.809920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7caeb478-78d1-4acf-b129-208c6ac55763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:51.810367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7caeb478-78d1-4acf-b129-208c6ac55763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:51.833037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:50:51.885565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:51.909782 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7caeb478-78d1-4acf-b129-208c6ac55763 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments/f303cd1b-0b6d-4e9d-be3a-0f46d920f884" status: 200 len: 194 microversion: 2.1 time: 0.123786 Oct 05 17:50:51.914654 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2214/4145] 10.222.0.70 () {58 vars in 1413 bytes} [Wed Oct 5 17:50:51 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments/f303cd1b-0b6d-4e9d-be3a-0f46d920f884 => generated 194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:51.940020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d034bcf8-def4-4dbd-a47c-5111546d2b1b tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:51.961552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:51.971023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:51.973288 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1862175b-ff40-45a0-be80-1dce5024bfd3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.314678 Oct 05 17:50:51.976016 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1932/4146] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:51 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:51.981874 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d034bcf8-def4-4dbd-a47c-5111546d2b1b tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/f2b50a89-2133-4c53-b1c6-d59121fb64b0" status: 200 len: 235 microversion: 2.64 time: 0.065745 Oct 05 17:50:51.994535 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2215/4147] 10.222.0.70 () {60 vars in 1304 bytes} [Wed Oct 5 17:50:51 2022] GET /compute/v2.1/os-server-groups/f2b50a89-2133-4c53-b1c6-d59121fb64b0 => generated 235 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:50:52.005879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a69dfd9-dfa1-4fc9-afe9-00e126ef36ff tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:52.056532 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a69dfd9-dfa1-4fc9-afe9-00e126ef36ff tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/f2b50a89-2133-4c53-b1c6-d59121fb64b0" status: 204 len: 0 microversion: 2.64 time: 0.054673 Oct 05 17:50:52.058455 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1933/4148] 10.222.0.70 () {60 vars in 1307 bytes} [Wed Oct 5 17:50:52 2022] DELETE /compute/v2.1/os-server-groups/f2b50a89-2133-4c53-b1c6-d59121fb64b0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:50:52.067562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-53c20d53-6c45-4a3b-9c37-36961f6ce8a5 tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:52.083992 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-53c20d53-6c45-4a3b-9c37-36961f6ce8a5 tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] HTTP exception thrown: Instance group f2b50a89-2133-4c53-b1c6-d59121fb64b0 could not be found. Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-53c20d53-6c45-4a3b-9c37-36961f6ce8a5 tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Request method failure captured: Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-server-groups/f2b50a89-2133-4c53-b1c6-d59121fb64b0 HTTP/1.1 Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcP647q_0TbiZRc9E7uqqS9KjdkMWyvp8P51FuyWpzvcOSGatN26NzKP2W7sjJzHgUqIyc3uUQ5CsFB7437jfTl9B42RtAQpfSn8pJTX84pY3yxnpDqbRE41WA2FdbuSfb2C9JEL7EeMI_dS8V1_lRLxAODfxpaiI0IK6aGHgjmnZow Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.64 Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 4cd2c8390fa84e9ab9bcb2ded1b34079 Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerGroup264TestJSON-1063674111 Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4cd2c8390fa84e9ab9bcb2ded1b34079"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4cd2c8390fa84e9ab9bcb2ded1b34079"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4cd2c8390fa84e9ab9bcb2ded1b34079", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4cd2c8390fa84e9ab9bcb2ded1b34079"}]}] Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerGroup264TestJSON-1063674111 Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 4cd2c8390fa84e9ab9bcb2ded1b34079 Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1063674111 Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerGroup264TestJSON-1063674111-project Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 5e75965e4ffa48b8b1c78576b26bcc4f Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerGroup264TestJSON-1063674111-project Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance group f2b50a89-2133-4c53-b1c6-d59121fb64b0 could not be found. Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'f2b50a89-2133-4c53-b1c6-d59121fb64b0'} Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group f2b50a89-2133-4c53-b1c6-d59121fb64b0 could not be found. Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group f2b50a89-2133-4c53-b1c6-d59121fb64b0 could not be found. Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:52.086058 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:50:52.092266 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:50:52.092266 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:50:52.092266 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:50:52.092266 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:50:52.092266 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group f2b50a89-2133-4c53-b1c6-d59121fb64b0 could not be found. Oct 05 17:50:52.092266 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:50:52.093860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-53c20d53-6c45-4a3b-9c37-36961f6ce8a5 tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] Returning 404 to user: Instance group f2b50a89-2133-4c53-b1c6-d59121fb64b0 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:50:52.095025 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-53c20d53-6c45-4a3b-9c37-36961f6ce8a5 tempest-ServerGroup264TestJSON-1063674111 tempest-ServerGroup264TestJSON-1063674111-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/f2b50a89-2133-4c53-b1c6-d59121fb64b0" status: 404 len: 117 microversion: 2.64 time: 0.031439 Oct 05 17:50:52.096207 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2216/4149] 10.222.0.70 () {60 vars in 1307 bytes} [Wed Oct 5 17:50:52 2022] DELETE /compute/v2.1/os-server-groups/f2b50a89-2133-4c53-b1c6-d59121fb64b0 => generated 117 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:50:52.811570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4a9ace0-05b6-442b-a3d9-d7cc65bec2da tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:52.812184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4a9ace0-05b6-442b-a3d9-d7cc65bec2da tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:52.817092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87b959a3-3a83-4d0c-b5a2-8480f581db55 tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f77751d6e50>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:52.828631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4a9ace0-05b6-442b-a3d9-d7cc65bec2da tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:52.832172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4a9ace0-05b6-442b-a3d9-d7cc65bec2da tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:52.832630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4a9ace0-05b6-442b-a3d9-d7cc65bec2da tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:52.833661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4a9ace0-05b6-442b-a3d9-d7cc65bec2da tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:52.834271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4a9ace0-05b6-442b-a3d9-d7cc65bec2da tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:52.835081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4a9ace0-05b6-442b-a3d9-d7cc65bec2da tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:52.977614 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87b959a3-3a83-4d0c-b5a2-8480f581db55 tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/7324bc92-f380-40de-bbba-c71ec208c726" status: 200 len: 351 microversion: 2.1 time: 0.169699 Oct 05 17:50:52.978267 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2217/4150] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:50:52 2022] GET /compute/v2.1/os-volumes/7324bc92-f380-40de-bbba-c71ec208c726 => generated 351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:50:52.992332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aecbc72a-0f78-4825-9162-65364e79406e tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f7774dfbb80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:53.196650 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aecbc72a-0f78-4825-9162-65364e79406e tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.208367 Oct 05 17:50:53.208441 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2218/4151] 10.222.0.70 () {58 vars in 1134 bytes} [Wed Oct 5 17:50:52 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:53.208441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:53.208441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:53.218858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:53.219420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:53.219963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:53.226561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:53.227166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:53.227712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:53.363732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:53.376330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:53.379619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:53.386977 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6a8953bd-c097-427a-ba73-6c98088a1738 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.187731 Oct 05 17:50:53.389411 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2219/4152] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:53 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:53.397863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb591d2c-de8f-4dd7-b0f3-648f0f4ee08b tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f7774649940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:53.516297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c4a9ace0-05b6-442b-a3d9-d7cc65bec2da tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:53.525243 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4a9ace0-05b6-442b-a3d9-d7cc65bec2da tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.720145 Oct 05 17:50:53.527575 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1934/4153] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:52 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:53.566353 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb591d2c-de8f-4dd7-b0f3-648f0f4ee08b tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.175613 Oct 05 17:50:53.567221 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2220/4154] 10.222.0.70 () {58 vars in 1149 bytes} [Wed Oct 5 17:50:53 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:53.585565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3d13f125-5ca8-47ab-a32f-1df836b60f7f tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f77795fbaf0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:53.844755 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3d13f125-5ca8-47ab-a32f-1df836b60f7f tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.263079 Oct 05 17:50:53.845673 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1935/4155] 10.222.0.70 () {58 vars in 1134 bytes} [Wed Oct 5 17:50:53 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:53.863838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d9668bc9-e7da-40fa-83c2-7f7747947145 tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f7774794940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:54.086433 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d9668bc9-e7da-40fa-83c2-7f7747947145 tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.231262 Oct 05 17:50:54.087034 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2221/4156] 10.222.0.70 () {58 vars in 1167 bytes} [Wed Oct 5 17:50:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:54.101539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58fa9d41-59ce-4530-aabf-dbe10c4e64b1 tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f77795af670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:54.368733 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-58fa9d41-59ce-4530-aabf-dbe10c4e64b1 tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.271399 Oct 05 17:50:54.369319 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1936/4157] 10.222.0.70 () {58 vars in 1170 bytes} [Wed Oct 5 17:50:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:54.384564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-94ef4868-58c3-4b0d-8ded-2043de2890ef tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f7779465940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:54.413912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:54.414798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:54.425626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:54.428004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:54.431467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:54.432475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:54.433795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:54.439257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:54.583749 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-94ef4868-58c3-4b0d-8ded-2043de2890ef tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.203826 Oct 05 17:50:54.589389 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2222/4158] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:50:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:54.594911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-268f114d-afc7-436a-8cce-5dfe1405359c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:54.596067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-268f114d-afc7-436a-8cce-5dfe1405359c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:54.614120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-268f114d-afc7-436a-8cce-5dfe1405359c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:54.626430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-268f114d-afc7-436a-8cce-5dfe1405359c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:54.627383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-268f114d-afc7-436a-8cce-5dfe1405359c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:54.628592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-268f114d-afc7-436a-8cce-5dfe1405359c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:54.629287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-268f114d-afc7-436a-8cce-5dfe1405359c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:54.629968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-268f114d-afc7-436a-8cce-5dfe1405359c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:54.681263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:54.694640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:54.699991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:54.701556 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c98e7618-bca1-416e-8717-1a95993e301e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.292053 Oct 05 17:50:54.705057 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1937/4159] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:54 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:54.724061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d345fada-9c20-4eba-8f1d-8edc0ce3728b tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f777463d280>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:54.912375 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d345fada-9c20-4eba-8f1d-8edc0ce3728b tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.203102 Oct 05 17:50:54.913626 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1938/4160] 10.222.0.70 () {58 vars in 1188 bytes} [Wed Oct 5 17:50:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:54.934416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c956d0d-cbf1-401c-8433-b1acc054e8e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d59ad511-ef77-498a-8f54-a2f82c94b0ae"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:54.937607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0c956d0d-cbf1-401c-8433-b1acc054e8e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:54.953415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c956d0d-cbf1-401c-8433-b1acc054e8e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:54.954363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c956d0d-cbf1-401c-8433-b1acc054e8e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:54.955312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c956d0d-cbf1-401c-8433-b1acc054e8e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:54.956241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c956d0d-cbf1-401c-8433-b1acc054e8e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:54.956904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c956d0d-cbf1-401c-8433-b1acc054e8e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:54.957669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c956d0d-cbf1-401c-8433-b1acc054e8e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:55.332227 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c956d0d-cbf1-401c-8433-b1acc054e8e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "POST /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.415499 Oct 05 17:50:55.340489 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1939/4161] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 17:50:54 2022] POST /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:55.348531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-679f9db9-d590-4436-8627-b2d3206ccdd8 tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] Calling method '.version_select at 0x7f77795af1f0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:55.500883 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-679f9db9-d590-4436-8627-b2d3206ccdd8 tempest-VolumesTestJSON-858364454 tempest-VolumesTestJSON-858364454-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.158553 Oct 05 17:50:55.502456 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1940/4162] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:50:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:55.516274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7b5db0c5-5b6e-4630-a8ab-e5c52fb3dbbb req-a8124ed8-1a43-4b74-879e-4a6ec9e7f1b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4705a742-0c49-4acf-82cb-71e548a1acd2", "name": "network-vif-plugged", "status": "completed", "tag": "9b9704d0-a556-4ecd-bfab-26c9679bc57b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:50:55.549470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7b5db0c5-5b6e-4630-a8ab-e5c52fb3dbbb req-a8124ed8-1a43-4b74-879e-4a6ec9e7f1b1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:55.549956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7b5db0c5-5b6e-4630-a8ab-e5c52fb3dbbb req-a8124ed8-1a43-4b74-879e-4a6ec9e7f1b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:55.550410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7b5db0c5-5b6e-4630-a8ab-e5c52fb3dbbb req-a8124ed8-1a43-4b74-879e-4a6ec9e7f1b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:55.586642 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7b5db0c5-5b6e-4630-a8ab-e5c52fb3dbbb req-a8124ed8-1a43-4b74-879e-4a6ec9e7f1b1 service nova] Creating event network-vif-plugged:9b9704d0-a556-4ecd-bfab-26c9679bc57b for instance 4705a742-0c49-4acf-82cb-71e548a1acd2 on n-h2-835595-3 Oct 05 17:50:55.593997 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7b5db0c5-5b6e-4630-a8ab-e5c52fb3dbbb req-a8124ed8-1a43-4b74-879e-4a6ec9e7f1b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090225 Oct 05 17:50:55.595182 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1941/4163] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:50:55.737765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:55.739087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:55.783364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:55.783891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:55.788601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:55.789435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:55.789914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:55.794269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:55.805395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-268f114d-afc7-436a-8cce-5dfe1405359c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:55.818698 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-268f114d-afc7-436a-8cce-5dfe1405359c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 1.227853 Oct 05 17:50:55.822660 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2223/4164] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:54 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:55.964685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:55.975810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:55.977367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:55.986792 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d1eddbfb-a911-4392-befe-dfbcd62fadbb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.246803 Oct 05 17:50:55.990452 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1942/4165] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:55 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:56.841451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7503075d-33e0-46f2-8e17-22065e705d2a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:56.842060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7503075d-33e0-46f2-8e17-22065e705d2a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:56.860978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7503075d-33e0-46f2-8e17-22065e705d2a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:56.861473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7503075d-33e0-46f2-8e17-22065e705d2a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:56.861910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7503075d-33e0-46f2-8e17-22065e705d2a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:56.862832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7503075d-33e0-46f2-8e17-22065e705d2a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:56.863727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7503075d-33e0-46f2-8e17-22065e705d2a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:56.864362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7503075d-33e0-46f2-8e17-22065e705d2a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:57.021554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:57.023285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:57.038165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:57.039128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:57.039849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:57.040819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:57.046404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:57.047242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:57.205378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:57.222738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:57.228564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:57.231899 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f1451092-2f58-4b18-93a1-0ef7f84782f0 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.214259 Oct 05 17:50:57.234091 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1943/4166] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:57 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:57.519262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7503075d-33e0-46f2-8e17-22065e705d2a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:57.527796 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7503075d-33e0-46f2-8e17-22065e705d2a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.690389 Oct 05 17:50:57.531944 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2224/4167] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:56 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:50:58.262472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:58.263017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:58.290576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:58.293872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:58.294621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:58.298676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:58.305940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:58.306629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:58.555689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0cf73e38-7b74-436c-9eb1-2e81b3e338af tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:58.556313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0cf73e38-7b74-436c-9eb1-2e81b3e338af tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:58.561274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:58.571747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cf73e38-7b74-436c-9eb1-2e81b3e338af tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:58.572257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cf73e38-7b74-436c-9eb1-2e81b3e338af tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:58.572707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cf73e38-7b74-436c-9eb1-2e81b3e338af tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:58.581547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:58.582457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cf73e38-7b74-436c-9eb1-2e81b3e338af tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:58.585560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cf73e38-7b74-436c-9eb1-2e81b3e338af tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:58.586553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cf73e38-7b74-436c-9eb1-2e81b3e338af tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:58.595604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:58.596872 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b12c1c2d-0f44-474c-9d6e-9c3b8635e19e tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.338716 Oct 05 17:50:58.597446 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1944/4168] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:58 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:50:59.134625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0cf73e38-7b74-436c-9eb1-2e81b3e338af tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:59.148746 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0cf73e38-7b74-436c-9eb1-2e81b3e338af tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.597001 Oct 05 17:50:59.150056 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2225/4169] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:50:58 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:50:59.630826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:50:59.632062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:50:59.648000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:59.648764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:59.649403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:59.650344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:50:59.650978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:50:59.651557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:50:59.933306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:59.952298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:59.953900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:50:59.955363 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c674586-b857-4c3e-ab3b-84b136470957 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.328806 Oct 05 17:50:59.955984 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1945/4170] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:50:59 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:00.172946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d9420d1-d2f7-4e4e-8986-dbc5cc979615 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:00.173641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d9420d1-d2f7-4e4e-8986-dbc5cc979615 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:00.186329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d9420d1-d2f7-4e4e-8986-dbc5cc979615 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:00.194036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d9420d1-d2f7-4e4e-8986-dbc5cc979615 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:00.195817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d9420d1-d2f7-4e4e-8986-dbc5cc979615 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:00.196746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d9420d1-d2f7-4e4e-8986-dbc5cc979615 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:00.200375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d9420d1-d2f7-4e4e-8986-dbc5cc979615 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:00.201000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d9420d1-d2f7-4e4e-8986-dbc5cc979615 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:00.676388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d9420d1-d2f7-4e4e-8986-dbc5cc979615 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:00.689530 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d9420d1-d2f7-4e4e-8986-dbc5cc979615 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.518576 Oct 05 17:51:00.691125 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2226/4171] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:00 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:00.984825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:00.986879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:00.997122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:00.999205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:01.002939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:01.003934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:01.004916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:01.005576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:01.279933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:01.295308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:01.300449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:01.307044 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7d7b0127-3c5b-4c66-980e-5185b77bed75 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.327663 Oct 05 17:51:01.308337 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1946/4172] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:00 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:01.714264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9c50709-b9ca-4a46-bcd4-6ceb3c7b4d06 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:01.715571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9c50709-b9ca-4a46-bcd4-6ceb3c7b4d06 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:01.735546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c50709-b9ca-4a46-bcd4-6ceb3c7b4d06 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:01.740791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c50709-b9ca-4a46-bcd4-6ceb3c7b4d06 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:01.742900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c50709-b9ca-4a46-bcd4-6ceb3c7b4d06 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:01.745112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c50709-b9ca-4a46-bcd4-6ceb3c7b4d06 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:01.747766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c50709-b9ca-4a46-bcd4-6ceb3c7b4d06 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:01.748930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9c50709-b9ca-4a46-bcd4-6ceb3c7b4d06 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:02.209928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9c50709-b9ca-4a46-bcd4-6ceb3c7b4d06 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:02.218775 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9c50709-b9ca-4a46-bcd4-6ceb3c7b4d06 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.509114 Oct 05 17:51:02.222909 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2227/4173] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:01 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:02.336501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:02.338380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:02.340891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:02.380314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:02.381997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:02.383408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:02.389246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:02.390783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:02.393144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:02.632038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:02.655001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:02.656517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:02.657824 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-66996441-57e7-4945-96e4-fbe54687fde1 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.327547 Oct 05 17:51:02.663059 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1947/4174] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:02 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:02.938091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-da38dcba-4281-42ac-a424-67ca62715fe1 req-c4ffd545-d821-4c00-ab07-a933cb1f29e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52330818-f5f6-4744-bdca-28952038b28b", "name": "network-vif-plugged", "status": "completed", "tag": "9b063444-500f-46cb-8860-efc7dc640e7d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:02.966355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-da38dcba-4281-42ac-a424-67ca62715fe1 req-c4ffd545-d821-4c00-ab07-a933cb1f29e2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:02.966837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-da38dcba-4281-42ac-a424-67ca62715fe1 req-c4ffd545-d821-4c00-ab07-a933cb1f29e2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:02.967263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-da38dcba-4281-42ac-a424-67ca62715fe1 req-c4ffd545-d821-4c00-ab07-a933cb1f29e2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:02.982376 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-da38dcba-4281-42ac-a424-67ca62715fe1 req-c4ffd545-d821-4c00-ab07-a933cb1f29e2 service nova] Creating event network-vif-plugged:9b063444-500f-46cb-8860-efc7dc640e7d for instance 52330818-f5f6-4744-bdca-28952038b28b on n-h2-835595-3 Oct 05 17:51:02.988813 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-da38dcba-4281-42ac-a424-67ca62715fe1 req-c4ffd545-d821-4c00-ab07-a933cb1f29e2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054644 Oct 05 17:51:02.989997 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2228/4175] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:03.242028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f00bca29-9857-44cf-bc69-83ae12d5a452 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:03.243079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f00bca29-9857-44cf-bc69-83ae12d5a452 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:03.249835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f00bca29-9857-44cf-bc69-83ae12d5a452 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:03.250351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f00bca29-9857-44cf-bc69-83ae12d5a452 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:03.251039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f00bca29-9857-44cf-bc69-83ae12d5a452 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:03.251792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f00bca29-9857-44cf-bc69-83ae12d5a452 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:03.252442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f00bca29-9857-44cf-bc69-83ae12d5a452 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:03.252871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f00bca29-9857-44cf-bc69-83ae12d5a452 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:03.551723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f00bca29-9857-44cf-bc69-83ae12d5a452 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:03.572672 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f00bca29-9857-44cf-bc69-83ae12d5a452 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1319 microversion: 2.1 time: 0.327471 Oct 05 17:51:03.573676 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1948/4176] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:03 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:03.695841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:03.696617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:03.705431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:03.709995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:03.710643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:03.712088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:03.715163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:03.715723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:03.846060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:03.861748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:03.866352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:03.868802 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a0d3035f-f54d-4129-8905-2bf8f78c2305 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.183656 Oct 05 17:51:03.874425 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2229/4177] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:03 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:04.605461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-820f06f3-0eec-49d0-bbc2-84671ed9a77a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:04.606734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-820f06f3-0eec-49d0-bbc2-84671ed9a77a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:04.630438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-820f06f3-0eec-49d0-bbc2-84671ed9a77a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:04.631004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-820f06f3-0eec-49d0-bbc2-84671ed9a77a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:04.635012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-820f06f3-0eec-49d0-bbc2-84671ed9a77a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:04.637201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-820f06f3-0eec-49d0-bbc2-84671ed9a77a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:04.638891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-820f06f3-0eec-49d0-bbc2-84671ed9a77a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:04.641531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-820f06f3-0eec-49d0-bbc2-84671ed9a77a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:04.897715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:04.899034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:04.914140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:04.914888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:04.915974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:04.917191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:04.917805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:04.918423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:05.047494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-820f06f3-0eec-49d0-bbc2-84671ed9a77a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:05.057274 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-820f06f3-0eec-49d0-bbc2-84671ed9a77a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1468 microversion: 2.1 time: 0.460850 Oct 05 17:51:05.059175 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1949/4178] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:04 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1468 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:05.084037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c68eee3-1788-416e-b3b9-739dc3bcfe17 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:05.085054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9c68eee3-1788-416e-b3b9-739dc3bcfe17 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 4705a742-0c49-4acf-82cb-71e548a1acd2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:05.098540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c68eee3-1788-416e-b3b9-739dc3bcfe17 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:05.100854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c68eee3-1788-416e-b3b9-739dc3bcfe17 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:05.101498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c68eee3-1788-416e-b3b9-739dc3bcfe17 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:05.103546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c68eee3-1788-416e-b3b9-739dc3bcfe17 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:05.104753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c68eee3-1788-416e-b3b9-739dc3bcfe17 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:05.106512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c68eee3-1788-416e-b3b9-739dc3bcfe17 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:05.118847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:05.128229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:05.129657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:05.130900 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e6943611-cdbf-4953-b00b-3ea869434645 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.237285 Oct 05 17:51:05.131461 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2230/4179] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:04 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:05.133481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:05.382870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9c68eee3-1788-416e-b3b9-739dc3bcfe17 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:05.410123 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9c68eee3-1788-416e-b3b9-739dc3bcfe17 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2" status: 200 len: 1469 microversion: 2.1 time: 0.332614 Oct 05 17:51:05.415320 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1950/4180] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:05 2022] GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2 => generated 1469 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:05.437750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:05.449057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:05.450475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Searching by: {'reservation_id': 'r-0ppxrcgs', 'deleted': False, 'project_id': '4809bb6013894d13a894acb816f7dca8'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:51:05.482054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:05.482544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:05.483003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:05.483677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:05.484131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:05.484719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:05.813567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:51:06.005990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:06.021044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:06.022273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:06.022898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:06.158336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:06.159118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:06.169727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:06.170394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:06.172110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:06.177975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:06.178776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:06.179454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:06.307420 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ef0f6046-ce79-4698-b86b-58dfdf755719 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?reservation_id=r-0ppxrcgs" status: 200 len: 2930 microversion: 2.1 time: 0.873809 Oct 05 17:51:06.308755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2231/4181] 10.222.0.70 () {58 vars in 1197 bytes} [Wed Oct 5 17:51:05 2022] GET /compute/v2.1/servers/detail?reservation_id=r-0ppxrcgs => generated 2930 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:06.341035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-af92cb04-b868-48af-9033-07f5b2563f32 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:06.349497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:06.363498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:06.371628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:06.373152 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-858ed07f-e062-4a71-a17b-72baff54f2b2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.219996 Oct 05 17:51:06.381278 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1951/4182] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:06 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:06.381581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.server_groups [None req-af92cb04-b868-48af-9033-07f5b2563f32 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Querying cell 7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) for 2 instances {{(pid=128844) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 05 17:51:06.384324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af92cb04-b868-48af-9033-07f5b2563f32 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:06.385260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af92cb04-b868-48af-9033-07f5b2563f32 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:06.386179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af92cb04-b868-48af-9033-07f5b2563f32 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:06.435195 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-af92cb04-b868-48af-9033-07f5b2563f32 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/3e76ac12-a839-479b-9e5f-c34e96751838" status: 200 len: 265 microversion: 2.1 time: 0.103870 Oct 05 17:51:06.442514 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2232/4183] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:51:06 2022] GET /compute/v2.1/os-server-groups/3e76ac12-a839-479b-9e5f-c34e96751838 => generated 265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:51:06.454842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69a6d2c2-2189-4cde-ac34-2c6e5217aad8 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:06.455964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-69a6d2c2-2189-4cde-ac34-2c6e5217aad8 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] [instance: 4705a742-0c49-4acf-82cb-71e548a1acd2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:06.465725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69a6d2c2-2189-4cde-ac34-2c6e5217aad8 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:06.472956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69a6d2c2-2189-4cde-ac34-2c6e5217aad8 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:06.473687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69a6d2c2-2189-4cde-ac34-2c6e5217aad8 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:06.474776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69a6d2c2-2189-4cde-ac34-2c6e5217aad8 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:06.475443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69a6d2c2-2189-4cde-ac34-2c6e5217aad8 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:06.476103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69a6d2c2-2189-4cde-ac34-2c6e5217aad8 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:06.760676 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69a6d2c2-2189-4cde-ac34-2c6e5217aad8 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2" status: 200 len: 1620 microversion: 2.1 time: 0.310706 Oct 05 17:51:06.761252 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1952/4184] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:06 2022] GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2 => generated 1620 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:06.785297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e5aa825-900d-4078-95f3-916caa666787 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:06.785907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5e5aa825-900d-4078-95f3-916caa666787 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:06.796236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e5aa825-900d-4078-95f3-916caa666787 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:06.796730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e5aa825-900d-4078-95f3-916caa666787 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:06.797166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e5aa825-900d-4078-95f3-916caa666787 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:06.797867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e5aa825-900d-4078-95f3-916caa666787 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:06.798426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e5aa825-900d-4078-95f3-916caa666787 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:06.798853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e5aa825-900d-4078-95f3-916caa666787 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:07.409802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:07.411150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:07.421125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:07.427341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:07.428084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:07.433801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:07.434849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:07.435478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:07.436062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:07.684865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:07.698388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:07.705998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:07.710067 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-50bd52aa-e1fe-4255-b9ec-26c10821babd tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.305285 Oct 05 17:51:07.711851 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1953/4185] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:07 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:07.824469 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e5aa825-900d-4078-95f3-916caa666787 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 200 len: 1619 microversion: 2.1 time: 1.040840 Oct 05 17:51:07.825630 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2233/4186] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:06 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 1619 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:07.852106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a041fc8-5a47-4957-ade4-8cf6ad8ebfbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Action: 'create', calling method: .version_select at 0x7f7779465e50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-608269825", "policies": ["anti-affinity"]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:07.870682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-7a041fc8-5a47-4957-ade4-8cf6ad8ebfbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:07.885382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-7a041fc8-5a47-4957-ade4-8cf6ad8ebfbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:08.008007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-7a041fc8-5a47-4957-ade4-8cf6ad8ebfbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:08.042165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-7a041fc8-5a47-4957-ade4-8cf6ad8ebfbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_groups'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:08.084230 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a041fc8-5a47-4957-ade4-8cf6ad8ebfbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.236228 Oct 05 17:51:08.094142 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1954/4187] 10.222.0.70 () {60 vars in 1174 bytes} [Wed Oct 5 17:51:07 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:08.269970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-479559069", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e62ac756-6129-4cf9-a49a-65dee432aad6"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:08.365224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:51:08.739478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:08.740270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:08.754355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:08.755096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:08.755795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:08.756706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:08.757325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:08.757910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:08.883559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:08.893262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:08.895626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:08.899353 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb8e4345-1a5b-4c11-9c7b-e7029da74aca tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.163692 Oct 05 17:51:08.903642 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1955/4188] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:08 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:08.915192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:51:08.916202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:51:08.916941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:51:08.917554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:51:08.918058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:51:08.947633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:08.958061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:08.958903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:08.959923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:08.960558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:08.961148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:08.999030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:09.015436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:09.045550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Going to run 2 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:51:09.050673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: c166cde4-8dea-46ee-9e5d-e07438f14e4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:51:09.167112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:09.182127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:09.261755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:09.271449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:09.298521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=c166cde4-8dea-46ee-9e5d-e07438f14e4c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:51:09.372785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:09.384278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:09.398012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:09.489252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:09.523630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'server_group_members'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:09.707939 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9b003d36-67bf-416b-9e07-38dcd604544f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.441805 Oct 05 17:51:09.709149 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2234/4189] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:51:08 2022] POST /compute/v2.1/servers => generated 32 bytes in 1444 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 05 17:51:09.718453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:09.724599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:09.725695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Searching by: {'deleted': False, 'project_id': '4809bb6013894d13a894acb816f7dca8'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:51:09.753841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:09.755107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:09.755747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:09.756726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:09.757420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:09.758575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:09.796577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:51:09.836515 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-000db790-0e40-4fc1-9e00-7c6cc07468dd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.123222 Oct 05 17:51:09.845787 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1956/4190] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:51:09 2022] GET /compute/v2.1/servers => generated 1663 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:09.850536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d8a485b2-b844-4783-87ec-8a8f7f1e52b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:09.851155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d8a485b2-b844-4783-87ec-8a8f7f1e52b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:09.931853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:09.932461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:09.946921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:09.949053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:09.949553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:09.950262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:09.950747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:09.955160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:10.046184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d8a485b2-b844-4783-87ec-8a8f7f1e52b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:10.060681 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d8a485b2-b844-4783-87ec-8a8f7f1e52b2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1218 microversion: 2.1 time: 0.214393 Oct 05 17:51:10.061593 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2235/4191] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:09 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1218 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:10.083979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:10.103304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:10.105284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:10.106540 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-819fa7ab-75f9-4f40-991a-3664420b84f8 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.179026 Oct 05 17:51:10.107803 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1957/4192] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:09 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:11.084269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86862ced-c6fb-4ea5-b325-b6be3b351323 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:11.084909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-86862ced-c6fb-4ea5-b325-b6be3b351323 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:11.146252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:11.147412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:11.158084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:11.158607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:11.159044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:11.163185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:11.163673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:11.164113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:11.302499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-86862ced-c6fb-4ea5-b325-b6be3b351323 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:11.327017 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-86862ced-c6fb-4ea5-b325-b6be3b351323 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1218 microversion: 2.1 time: 0.246738 Oct 05 17:51:11.332262 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2236/4193] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:11 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1218 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:11.347489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:11.366338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:11.372267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:11.375409 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e21e47b4-c097-409d-aca2-d9b0265946c2 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.240501 Oct 05 17:51:11.378559 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1958/4194] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:11 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:12.357784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ccd62ff4-9950-485c-b209-806ce65c98e8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:12.359401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ccd62ff4-9950-485c-b209-806ce65c98e8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:12.371957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd62ff4-9950-485c-b209-806ce65c98e8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:12.372703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd62ff4-9950-485c-b209-806ce65c98e8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:12.373316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd62ff4-9950-485c-b209-806ce65c98e8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:12.374191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd62ff4-9950-485c-b209-806ce65c98e8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:12.375566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd62ff4-9950-485c-b209-806ce65c98e8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:12.376146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd62ff4-9950-485c-b209-806ce65c98e8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:12.413099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:12.414735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:12.430911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:12.433025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:12.435118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:12.436059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:12.436964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:12.441017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:12.518891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ccd62ff4-9950-485c-b209-806ce65c98e8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:12.534238 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ccd62ff4-9950-485c-b209-806ce65c98e8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1270 microversion: 2.1 time: 0.181247 Oct 05 17:51:12.536802 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2237/4195] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:12 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1270 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:12.565534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:12.579379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:12.583743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:12.587096 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-221e4f2a-d25b-46dd-a1c8-24fbeba2656b tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.179421 Oct 05 17:51:12.592995 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1959/4196] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:12 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:12.833887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-648cf91b-fe7e-47a2-98f1-a37d0ce881ba tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:12.836886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-648cf91b-fe7e-47a2-98f1-a37d0ce881ba tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:12.851456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-648cf91b-fe7e-47a2-98f1-a37d0ce881ba tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:12.854556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-648cf91b-fe7e-47a2-98f1-a37d0ce881ba tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:12.855397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-648cf91b-fe7e-47a2-98f1-a37d0ce881ba tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:12.856258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-648cf91b-fe7e-47a2-98f1-a37d0ce881ba tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:12.858601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-648cf91b-fe7e-47a2-98f1-a37d0ce881ba tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:12.859618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-648cf91b-fe7e-47a2-98f1-a37d0ce881ba tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:12.931311 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-648cf91b-fe7e-47a2-98f1-a37d0ce881ba tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.102032 Oct 05 17:51:12.934902 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2238/4197] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:12 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments => generated 371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:13.097672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5d92ad5d-c18e-454d-84b5-db172da1fa7a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:13.098302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5d92ad5d-c18e-454d-84b5-db172da1fa7a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:13.120520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d92ad5d-c18e-454d-84b5-db172da1fa7a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:13.124382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d92ad5d-c18e-454d-84b5-db172da1fa7a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:13.125115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d92ad5d-c18e-454d-84b5-db172da1fa7a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:13.130005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d92ad5d-c18e-454d-84b5-db172da1fa7a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:13.131697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d92ad5d-c18e-454d-84b5-db172da1fa7a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:13.134023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d92ad5d-c18e-454d-84b5-db172da1fa7a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:13.241495 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5d92ad5d-c18e-454d-84b5-db172da1fa7a tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments/f303cd1b-0b6d-4e9d-be3a-0f46d920f884" status: 200 len: 194 microversion: 2.1 time: 0.146688 Oct 05 17:51:13.249425 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1960/4198] 10.222.0.70 () {58 vars in 1413 bytes} [Wed Oct 5 17:51:13 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments/f303cd1b-0b6d-4e9d-be3a-0f46d920f884 => generated 194 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:13.257789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e310e088-9cd4-46a6-8c11-cda524da783c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:13.258720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e310e088-9cd4-46a6-8c11-cda524da783c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:13.272595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e310e088-9cd4-46a6-8c11-cda524da783c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:13.273467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e310e088-9cd4-46a6-8c11-cda524da783c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:13.274136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e310e088-9cd4-46a6-8c11-cda524da783c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:13.280017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e310e088-9cd4-46a6-8c11-cda524da783c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:13.280728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e310e088-9cd4-46a6-8c11-cda524da783c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:13.281392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e310e088-9cd4-46a6-8c11-cda524da783c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:13.490773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-e310e088-9cd4-46a6-8c11-cda524da783c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lazy-loading 'services' on Instance uuid 7c8dfe89-5f6e-4166-83c3-752427e390a7 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:51:13.561348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85c21a7a-4e80-432b-ab1d-6c6c8264887c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:13.561979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-85c21a7a-4e80-432b-ab1d-6c6c8264887c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:13.576549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85c21a7a-4e80-432b-ab1d-6c6c8264887c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:13.577050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85c21a7a-4e80-432b-ab1d-6c6c8264887c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:13.577489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85c21a7a-4e80-432b-ab1d-6c6c8264887c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:13.578212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85c21a7a-4e80-432b-ab1d-6c6c8264887c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:13.578696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85c21a7a-4e80-432b-ab1d-6c6c8264887c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:13.579121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85c21a7a-4e80-432b-ab1d-6c6c8264887c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:13.738098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85c21a7a-4e80-432b-ab1d-6c6c8264887c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:13.753160 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e310e088-9cd4-46a6-8c11-cda524da783c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments/f303cd1b-0b6d-4e9d-be3a-0f46d920f884" status: 202 len: 0 microversion: 2.1 time: 0.503500 Oct 05 17:51:13.759616 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2239/4199] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 17:51:13 2022] DELETE /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments/f303cd1b-0b6d-4e9d-be3a-0f46d920f884 => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:51:13.762676 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85c21a7a-4e80-432b-ab1d-6c6c8264887c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1276 microversion: 2.1 time: 0.203343 Oct 05 17:51:13.763737 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1961/4200] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:13 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1276 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:13.766171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:13.771293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:13.790678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:13.795245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:13.796060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:13.797078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:13.797808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:13.799880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:13.843445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:14.184252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:14.194013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:14.204017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:14.205308 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54375e1f-f66a-4a37-a480-9bab46c68db4 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.447340 Oct 05 17:51:14.211208 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2240/4201] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:13 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:14.387096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a93611cb-805e-4b7b-8076-0a92f944e5e2 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Action: 'create', calling method: .version_select at 0x7f7775b51d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-431147828", "metadata": {"Type": "work"}}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a93611cb-805e-4b7b-8076-0a92f944e5e2 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Request method failure captured: Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 121 Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcQR1zxCfuQUgjL9lVStxEv1Vohn-Okk1Mvqy_kofz57emvZD9kuAT5OjdRsg6gwRoRJqxfLOxJVghvPRp4kxG_SQkP77sANBYe3wiU7qtFAVMM70fWKdUX2af2JL3VAOXFlsRjAGgridH60Ow9-JAOOtd7lmj1Gg_vpP5nukyk6VAA Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d10d5077ca114df1b467dbc6546bdc98", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}] Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: d2f8b959fcd6460f8b13aef96f43472e Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-431147828", "metadata": {"Type": "work"}}} Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-431147828', 'metadata': {'Type': 'work'}}}} Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi '#$%' Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:51:14.394695 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 05 17:51:14.399500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.403062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a93611cb-805e-4b7b-8076-0a92f944e5e2 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:14.406070 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a93611cb-805e-4b7b-8076-0a92f944e5e2 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.317883 Oct 05 17:51:14.411988 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1962/4202] 10.222.0.70 () {60 vars in 1156 bytes} [Wed Oct 5 17:51:14 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 324 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 17:51:14.421499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-77dc5975-bb0d-4ef0-9f27-1b279fdcaae3 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Action: 'create', calling method: .version_select at 0x7f77747944c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-484160985", "metadata": {"Type": "work"}}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-77dc5975-bb0d-4ef0-9f27-1b279fdcaae3 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Request method failure captured: Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 119 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcQR1zxCfuQUgjL9lVStxEv1Vohn-Okk1Mvqy_kofz57emvZD9kuAT5OjdRsg6gwRoRJqxfLOxJVghvPRp4kxG_SQkP77sANBYe3wiU7qtFAVMM70fWKdUX2af2JL3VAOXFlsRjAGgridH60Ow9-JAOOtd7lmj1Gg_vpP5nukyk6VAA Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d10d5077ca114df1b467dbc6546bdc98", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}] Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: d2f8b959fcd6460f8b13aef96f43472e Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-484160985", "metadata": {"Type": "work"}}} Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-484160985', 'metadata': {'Type': 'work'}}}} Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi '0' Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:51:14.426019 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-77dc5975-bb0d-4ef0-9f27-1b279fdcaae3 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-77dc5975-bb0d-4ef0-9f27-1b279fdcaae3 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010150 Oct 05 17:51:14.432582 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2241/4203] 10.222.0.70 () {60 vars in 1156 bytes} [Wed Oct 5 17:51:14 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:51:14.438691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52bda6f1-7e5a-44c5-acb9-412265a443b8 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Action: 'create', calling method: .version_select at 0x7f77795d9a60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1531915370", "metadata": {"Type": "work"}}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52bda6f1-7e5a-44c5-acb9-412265a443b8 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Request method failure captured: Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 119 Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcQR1zxCfuQUgjL9lVStxEv1Vohn-Okk1Mvqy_kofz57emvZD9kuAT5OjdRsg6gwRoRJqxfLOxJVghvPRp4kxG_SQkP77sANBYe3wiU7qtFAVMM70fWKdUX2af2JL3VAOXFlsRjAGgridH60Ow9-JAOOtd7lmj1Gg_vpP5nukyk6VAA Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d10d5077ca114df1b467dbc6546bdc98", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}] Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: d2f8b959fcd6460f8b13aef96f43472e Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1531915370", "metadata": {"Type": "work"}}} Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1531915370', 'metadata': {'Type': 'work'}}}} Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi '' Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 17:51:14.450346 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 05 17:51:14.455146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.462018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52bda6f1-7e5a-44c5-acb9-412265a443b8 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:14.463880 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-52bda6f1-7e5a-44c5-acb9-412265a443b8 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029376 Oct 05 17:51:14.481251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-939d6c9f-73b3-48bc-a785-b62dfcd36cca tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Calling method '.version_select at 0x7f7775243af0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:14.484891 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1963/4204] 10.222.0.70 () {60 vars in 1156 bytes} [Wed Oct 5 17:51:14 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:51:14.528430 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-939d6c9f-73b3-48bc-a785-b62dfcd36cca tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] HTTP exception thrown: Volume tempest-invalid-1310564265 could not be found. Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-939d6c9f-73b3-48bc-a785-b62dfcd36cca tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Request method failure captured: Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1310564265 HTTP/1.1 Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcQR1zxCfuQUgjL9lVStxEv1Vohn-Okk1Mvqy_kofz57emvZD9kuAT5OjdRsg6gwRoRJqxfLOxJVghvPRp4kxG_SQkP77sANBYe3wiU7qtFAVMM70fWKdUX2af2JL3VAOXFlsRjAGgridH60Ow9-JAOOtd7lmj1Gg_vpP5nukyk6VAA Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d10d5077ca114df1b467dbc6546bdc98", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}] Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: d2f8b959fcd6460f8b13aef96f43472e Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: exception: Volume tempest-invalid-1310564265 could not be found. Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'tempest-invalid-1310564265'} Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1310564265 could not be found. (HTTP 404) (Request-ID: req-c50c4ba9-464d-4720-8845-eaebc7a9aac8) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 17:51:14.532562 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1310564265 could not be found. Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1310564265 could not be found. Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1310564265 could not be found. Oct 05 17:51:14.537235 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.540987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-939d6c9f-73b3-48bc-a785-b62dfcd36cca tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Returning 404 to user: Volume tempest-invalid-1310564265 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:14.542387 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-939d6c9f-73b3-48bc-a785-b62dfcd36cca tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1310564265" status: 404 len: 99 microversion: 2.1 time: 0.069205 Oct 05 17:51:14.554195 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d5d3351f-6d3f-44b4-ba7a-5d651b0c3a86 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004498 Oct 05 17:51:14.559422 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2242/4205] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 17:51:14 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1310564265 => generated 99 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:51:14.559804 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1964/4206] 10.222.0.70 () {58 vars in 1140 bytes} [Wed Oct 5 17:51:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 05 17:51:14.568569 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aff6b928-10b1-45b8-ba02-21ca69024d15 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007518 Oct 05 17:51:14.569876 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2243/4207] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:51:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 05 17:51:14.580666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a18f9b46-3b99-4fed-8e3a-29955a10ee1a tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Calling method '.version_select at 0x7f77795d98b0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:14.629324 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-a18f9b46-3b99-4fed-8e3a-29955a10ee1a tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] HTTP exception thrown: Volume 22b89a91-642e-4470-8e54-06c8697fe6c6 could not be found. Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a18f9b46-3b99-4fed-8e3a-29955a10ee1a tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Request method failure captured: Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-volumes/22b89a91-642e-4470-8e54-06c8697fe6c6 HTTP/1.1 Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcQR1zxCfuQUgjL9lVStxEv1Vohn-Okk1Mvqy_kofz57emvZD9kuAT5OjdRsg6gwRoRJqxfLOxJVghvPRp4kxG_SQkP77sANBYe3wiU7qtFAVMM70fWKdUX2af2JL3VAOXFlsRjAGgridH60Ow9-JAOOtd7lmj1Gg_vpP5nukyk6VAA Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d10d5077ca114df1b467dbc6546bdc98", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}] Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: d2f8b959fcd6460f8b13aef96f43472e Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: exception: Volume 22b89a91-642e-4470-8e54-06c8697fe6c6 could not be found. Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '22b89a91-642e-4470-8e54-06c8697fe6c6'} Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 22b89a91-642e-4470-8e54-06c8697fe6c6 could not be found. (HTTP 404) (Request-ID: req-270c7125-44c2-40b8-a777-449471a18934) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 17:51:14.653547 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 22b89a91-642e-4470-8e54-06c8697fe6c6 could not be found. Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 22b89a91-642e-4470-8e54-06c8697fe6c6 could not be found. Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 22b89a91-642e-4470-8e54-06c8697fe6c6 could not be found. Oct 05 17:51:14.657999 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.660878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a18f9b46-3b99-4fed-8e3a-29955a10ee1a tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Returning 404 to user: Volume 22b89a91-642e-4470-8e54-06c8697fe6c6 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:14.661903 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a18f9b46-3b99-4fed-8e3a-29955a10ee1a tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/22b89a91-642e-4470-8e54-06c8697fe6c6" status: 404 len: 109 microversion: 2.1 time: 0.086227 Oct 05 17:51:14.662854 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1965/4208] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:51:14 2022] DELETE /compute/v2.1/os-volumes/22b89a91-642e-4470-8e54-06c8697fe6c6 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:51:14.673163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab53b0f8-c6c7-4458-8b84-54d414ebaa30 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Calling method '.version_select at 0x7f7779569940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:14.707261 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ab53b0f8-c6c7-4458-8b84-54d414ebaa30 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] HTTP exception thrown: Volume c77f9aec-080e-41ae-baee-2ae82344a55e could not be found. Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab53b0f8-c6c7-4458-8b84-54d414ebaa30 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Request method failure captured: Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-volumes/c77f9aec-080e-41ae-baee-2ae82344a55e HTTP/1.1 Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcQR1zxCfuQUgjL9lVStxEv1Vohn-Okk1Mvqy_kofz57emvZD9kuAT5OjdRsg6gwRoRJqxfLOxJVghvPRp4kxG_SQkP77sANBYe3wiU7qtFAVMM70fWKdUX2af2JL3VAOXFlsRjAGgridH60Ow9-JAOOtd7lmj1Gg_vpP5nukyk6VAA Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d10d5077ca114df1b467dbc6546bdc98", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d10d5077ca114df1b467dbc6546bdc98"}]}] Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: d10d5077ca114df1b467dbc6546bdc98 Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesNegativeTest-1958647959 Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: d2f8b959fcd6460f8b13aef96f43472e Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesNegativeTest-1958647959-project Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: exception: Volume c77f9aec-080e-41ae-baee-2ae82344a55e could not be found. Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'c77f9aec-080e-41ae-baee-2ae82344a55e'} Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c77f9aec-080e-41ae-baee-2ae82344a55e could not be found. (HTTP 404) (Request-ID: req-132f530d-7904-47e5-b0e7-fdbfe8ef4cc3) Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 17:51:14.709233 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c77f9aec-080e-41ae-baee-2ae82344a55e could not be found. Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c77f9aec-080e-41ae-baee-2ae82344a55e could not be found. Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c77f9aec-080e-41ae-baee-2ae82344a55e could not be found. Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab53b0f8-c6c7-4458-8b84-54d414ebaa30 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] Returning 404 to user: Volume c77f9aec-080e-41ae-baee-2ae82344a55e could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab53b0f8-c6c7-4458-8b84-54d414ebaa30 tempest-VolumesNegativeTest-1958647959 tempest-VolumesNegativeTest-1958647959-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/c77f9aec-080e-41ae-baee-2ae82344a55e" status: 404 len: 109 microversion: 2.1 time: 0.041720 Oct 05 17:51:14.713736 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2244/4209] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:51:14 2022] GET /compute/v2.1/os-volumes/c77f9aec-080e-41ae-baee-2ae82344a55e => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:51:14.788551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-352d86d2-cb4b-4950-811f-1ec94ad6ba84 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:14.789199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-352d86d2-cb4b-4950-811f-1ec94ad6ba84 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:14.800895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-352d86d2-cb4b-4950-811f-1ec94ad6ba84 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:14.801391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-352d86d2-cb4b-4950-811f-1ec94ad6ba84 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:14.801833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-352d86d2-cb4b-4950-811f-1ec94ad6ba84 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:14.802581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-352d86d2-cb4b-4950-811f-1ec94ad6ba84 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:14.803036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-352d86d2-cb4b-4950-811f-1ec94ad6ba84 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:14.803455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-352d86d2-cb4b-4950-811f-1ec94ad6ba84 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:14.948633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-352d86d2-cb4b-4950-811f-1ec94ad6ba84 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:14.959471 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-352d86d2-cb4b-4950-811f-1ec94ad6ba84 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1276 microversion: 2.1 time: 0.174301 Oct 05 17:51:14.978309 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1966/4210] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:14 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:15.240690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:15.241325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:15.259861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:15.276671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:15.277130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:15.277886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:15.279658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:15.280116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:15.850743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:15.864770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:15.870677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:15.872509 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8758a6a4-a975-412d-9127-99b65630f37c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.636935 Oct 05 17:51:15.873874 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2245/4211] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:15 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:15.997477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4c17567-8981-4bbf-aacf-c10db6303cc6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:15.997477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4c17567-8981-4bbf-aacf-c10db6303cc6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:16.009233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4c17567-8981-4bbf-aacf-c10db6303cc6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:16.009730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4c17567-8981-4bbf-aacf-c10db6303cc6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:16.010171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4c17567-8981-4bbf-aacf-c10db6303cc6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:16.015197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4c17567-8981-4bbf-aacf-c10db6303cc6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:16.016202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4c17567-8981-4bbf-aacf-c10db6303cc6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:16.016649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4c17567-8981-4bbf-aacf-c10db6303cc6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:16.210995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c4c17567-8981-4bbf-aacf-c10db6303cc6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:16.230110 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4c17567-8981-4bbf-aacf-c10db6303cc6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1276 microversion: 2.1 time: 0.242538 Oct 05 17:51:16.248789 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1967/4212] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:15 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1276 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:16.572265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-519023994", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:16.690581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] validate_networks() for [('49e351fa-583b-4b46-a2b4-67441c4381dd', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:51:16.914423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:16.915260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:16.944376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:16.944908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:16.946141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:16.947615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:16.949136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:16.949872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:17.152470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:17.164711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:17.166150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:17.171931 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d4fea52d-fde5-40a8-97ce-929e3ec5632c tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1365 microversion: 2.47 time: 0.272418 Oct 05 17:51:17.172711 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1968/4213] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:16 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:17.277634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c7a81ba5-4fbc-4ef4-93e2-7d6e6538ded6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:17.285836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c7a81ba5-4fbc-4ef4-93e2-7d6e6538ded6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:17.306808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a81ba5-4fbc-4ef4-93e2-7d6e6538ded6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:17.308511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a81ba5-4fbc-4ef4-93e2-7d6e6538ded6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:17.312077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a81ba5-4fbc-4ef4-93e2-7d6e6538ded6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:17.314919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a81ba5-4fbc-4ef4-93e2-7d6e6538ded6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:17.316255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a81ba5-4fbc-4ef4-93e2-7d6e6538ded6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:17.323074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a81ba5-4fbc-4ef4-93e2-7d6e6538ded6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:18.060934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:18.530307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7a81ba5-4fbc-4ef4-93e2-7d6e6538ded6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:18.544016 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c7a81ba5-4fbc-4ef4-93e2-7d6e6538ded6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1318 microversion: 2.1 time: 1.284687 Oct 05 17:51:18.544637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:51:18.545097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:51:18.545527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:51:18.546014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:51:18.546634 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1969/4214] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:17 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1318 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:18.547171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:51:18.557560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-886db582-95d4-4801-a4ea-5da4bb4afdc8 req-c46e74eb-f287-4290-8101-a41f9e0226ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94442e3c-35bb-4618-872a-608660ff52e5", "tag": "4c90ccb8-0e9d-4455-9303-16abd6ca05bc"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:18.569528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:18.571095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:18.572494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:18.573925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:18.576070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:18.579295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:18.588887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-886db582-95d4-4801-a4ea-5da4bb4afdc8 req-c46e74eb-f287-4290-8101-a41f9e0226ec service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:18.589439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-886db582-95d4-4801-a4ea-5da4bb4afdc8 req-c46e74eb-f287-4290-8101-a41f9e0226ec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:18.589936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-886db582-95d4-4801-a4ea-5da4bb4afdc8 req-c46e74eb-f287-4290-8101-a41f9e0226ec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:18.624042 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-886db582-95d4-4801-a4ea-5da4bb4afdc8 req-c46e74eb-f287-4290-8101-a41f9e0226ec service nova] Creating event network-changed:4c90ccb8-0e9d-4455-9303-16abd6ca05bc for instance 94442e3c-35bb-4618-872a-608660ff52e5 on n-h2-835595-3 Oct 05 17:51:18.639874 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-886db582-95d4-4801-a4ea-5da4bb4afdc8 req-c46e74eb-f287-4290-8101-a41f9e0226ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088416 Oct 05 17:51:18.642811 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1970/4215] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:18.656325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Getting quotas for project 24b4c2cb71624ca2828cdb3e38d779bd. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:18.658119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:18.660806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:18.674811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Getting quotas for user 4e9085c15c5e41b4b902f223a8558a87 and project 24b4c2cb71624ca2828cdb3e38d779bd. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:18.681433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:18.686000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:18.687714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:18.690023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:18.691903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:18.693439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:18.737139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:51:18.744979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:51:18.811027 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-390a47f9-0a09-45cc-a18b-6c2f5454432c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.477194 Oct 05 17:51:18.812267 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2246/4216] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:51:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 2479 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:51:18.824434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d032250d-4b39-418f-965c-260789fbc8d2 req-c936c688-26c0-4814-adcc-e1056a34af35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c166cde4-8dea-46ee-9e5d-e07438f14e4c", "tag": "18943f16-15f0-4491-825e-57555f57e326"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:18.851536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d032250d-4b39-418f-965c-260789fbc8d2 req-c936c688-26c0-4814-adcc-e1056a34af35 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:18.853702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d032250d-4b39-418f-965c-260789fbc8d2 req-c936c688-26c0-4814-adcc-e1056a34af35 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:18.855078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d032250d-4b39-418f-965c-260789fbc8d2 req-c936c688-26c0-4814-adcc-e1056a34af35 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:18.866402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:18.883100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:18.885681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:18.887900 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d032250d-4b39-418f-965c-260789fbc8d2 req-c936c688-26c0-4814-adcc-e1056a34af35 service nova] Creating event network-changed:18943f16-15f0-4491-825e-57555f57e326 for instance c166cde4-8dea-46ee-9e5d-e07438f14e4c on n-h1-835595-3 Oct 05 17:51:18.889944 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-14b2859d-60ba-49a2-b638-8df8537ab1ad tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1371 microversion: 2.47 time: 0.244666 Oct 05 17:51:18.891338 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1971/4217] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:18 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:18.900787 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d032250d-4b39-418f-965c-260789fbc8d2 req-c936c688-26c0-4814-adcc-e1056a34af35 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086683 Oct 05 17:51:18.904512 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2247/4218] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:18.917906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9967a71e-3daf-4b10-bf6a-bdf131ca790b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:18.918893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9967a71e-3daf-4b10-bf6a-bdf131ca790b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:19.154203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9967a71e-3daf-4b10-bf6a-bdf131ca790b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:19.171839 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9967a71e-3daf-4b10-bf6a-bdf131ca790b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1222 microversion: 2.1 time: 0.276166 Oct 05 17:51:19.173491 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1972/4219] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:18 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1222 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:19.573236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f59a1711-b59d-4985-ad71-d2a5826595e1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:19.574541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f59a1711-b59d-4985-ad71-d2a5826595e1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:19.591580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f59a1711-b59d-4985-ad71-d2a5826595e1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:19.594690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f59a1711-b59d-4985-ad71-d2a5826595e1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:19.596579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f59a1711-b59d-4985-ad71-d2a5826595e1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:19.597928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f59a1711-b59d-4985-ad71-d2a5826595e1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:19.599999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f59a1711-b59d-4985-ad71-d2a5826595e1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:19.601555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f59a1711-b59d-4985-ad71-d2a5826595e1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:19.934787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:19.936357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:19.938672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:19.952627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:19.953385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:19.957028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:19.957983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:19.958673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:19.959251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:19.995955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:20.143868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f59a1711-b59d-4985-ad71-d2a5826595e1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:20.157788 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f59a1711-b59d-4985-ad71-d2a5826595e1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1318 microversion: 2.1 time: 0.584743 Oct 05 17:51:20.159350 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2248/4220] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:19 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1318 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:20.203864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5851cec-4eb6-4361-b250-2e973818f2ee tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:20.204704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5851cec-4eb6-4361-b250-2e973818f2ee tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:20.218159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5851cec-4eb6-4361-b250-2e973818f2ee tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:20.221667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5851cec-4eb6-4361-b250-2e973818f2ee tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:20.233236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5851cec-4eb6-4361-b250-2e973818f2ee tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:20.234133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5851cec-4eb6-4361-b250-2e973818f2ee tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:20.234659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5851cec-4eb6-4361-b250-2e973818f2ee tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:20.254475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5851cec-4eb6-4361-b250-2e973818f2ee tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:20.362184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:20.379958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:20.381423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:20.382706 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1928cdc1-3e4a-4cf2-93c4-afa5a4431eb3 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1371 microversion: 2.47 time: 0.463852 Oct 05 17:51:20.383279 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1973/4221] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:19 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1371 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:20.627772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5851cec-4eb6-4361-b250-2e973818f2ee tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:20.700099 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5851cec-4eb6-4361-b250-2e973818f2ee tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1274 microversion: 2.1 time: 0.500479 Oct 05 17:51:20.700636 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2249/4222] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:20 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1274 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:21.186003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3e4eddfa-cec3-4b64-a8e2-2655e3f5487d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:21.187053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3e4eddfa-cec3-4b64-a8e2-2655e3f5487d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:21.207241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4eddfa-cec3-4b64-a8e2-2655e3f5487d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:21.207815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4eddfa-cec3-4b64-a8e2-2655e3f5487d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:21.212198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4eddfa-cec3-4b64-a8e2-2655e3f5487d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:21.213022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4eddfa-cec3-4b64-a8e2-2655e3f5487d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:21.213502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4eddfa-cec3-4b64-a8e2-2655e3f5487d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:21.215474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e4eddfa-cec3-4b64-a8e2-2655e3f5487d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:21.411461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:21.413293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:21.426721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:21.432377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:21.435491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:21.436929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:21.440329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:21.442270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:21.690154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:21.712239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:21.714379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:21.715856 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-04cdab7c-ac65-45f3-a8ab-4072d27b9c29 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1356 microversion: 2.47 time: 0.310603 Oct 05 17:51:21.716613 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2250/4223] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:21 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1356 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:21.757621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f515e05d-ad14-4225-9e00-ed54587dffa4 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:21.758656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f515e05d-ad14-4225-9e00-ed54587dffa4 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:21.775339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f515e05d-ad14-4225-9e00-ed54587dffa4 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:21.776445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f515e05d-ad14-4225-9e00-ed54587dffa4 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:21.777144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f515e05d-ad14-4225-9e00-ed54587dffa4 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:21.778090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f515e05d-ad14-4225-9e00-ed54587dffa4 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:21.778852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f515e05d-ad14-4225-9e00-ed54587dffa4 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:21.779494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f515e05d-ad14-4225-9e00-ed54587dffa4 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:22.062459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3e4eddfa-cec3-4b64-a8e2-2655e3f5487d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:22.078959 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3e4eddfa-cec3-4b64-a8e2-2655e3f5487d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1318 microversion: 2.1 time: 0.890993 Oct 05 17:51:22.084989 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1974/4224] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:21 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1318 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:22.102965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:22.120073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:22.125560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Searching by: {'deleted': False, 'project_id': '03b640c07a604e6da688d2806df25129'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:51:22.148563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:22.151036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:22.152877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:22.158693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:22.164854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:22.167602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:22.227786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f515e05d-ad14-4225-9e00-ed54587dffa4 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:22.249383 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f515e05d-ad14-4225-9e00-ed54587dffa4 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1274 microversion: 2.1 time: 0.498830 Oct 05 17:51:22.266302 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2251/4225] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:21 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1274 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:22.266302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1db3f56d-074e-4208-9977-7e59f5502b3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:22.267478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1db3f56d-074e-4208-9977-7e59f5502b3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:22.297611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1db3f56d-074e-4208-9977-7e59f5502b3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:22.298311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1db3f56d-074e-4208-9977-7e59f5502b3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:22.311047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1db3f56d-074e-4208-9977-7e59f5502b3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:22.311832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1db3f56d-074e-4208-9977-7e59f5502b3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:22.312319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1db3f56d-074e-4208-9977-7e59f5502b3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:22.312750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1db3f56d-074e-4208-9977-7e59f5502b3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:22.507861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-1db3f56d-074e-4208-9977-7e59f5502b3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lazy-loading 'services' on Instance uuid 306c41c5-0f1e-4812-a54d-c31fc031c7d1 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:51:22.582149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:51:22.682637 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1db3f56d-074e-4208-9977-7e59f5502b3f tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "DELETE /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments/05fe0a8e-b756-4ee9-9224-1072ba8f50df" status: 202 len: 0 microversion: 2.1 time: 0.425375 Oct 05 17:51:22.683244 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2252/4226] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 17:51:22 2022] DELETE /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments/05fe0a8e-b756-4ee9-9224-1072ba8f50df => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:51:22.712798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a772fa5-2c90-42a5-82df-f2fd5f57b19d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:22.725268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2a772fa5-2c90-42a5-82df-f2fd5f57b19d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:22.760305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a772fa5-2c90-42a5-82df-f2fd5f57b19d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:22.760827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a772fa5-2c90-42a5-82df-f2fd5f57b19d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:22.761278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a772fa5-2c90-42a5-82df-f2fd5f57b19d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:22.762016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a772fa5-2c90-42a5-82df-f2fd5f57b19d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:22.762515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a772fa5-2c90-42a5-82df-f2fd5f57b19d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:22.762948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a772fa5-2c90-42a5-82df-f2fd5f57b19d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:22.814865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:22.825228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:22.826119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:22.827301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:22.843748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:22.846713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:22.868205 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2a772fa5-2c90-42a5-82df-f2fd5f57b19d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179896 Oct 05 17:51:22.868805 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2253/4227] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:22 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 197 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:22.979076 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7c453c39-8626-4cbd-9b04-a5be9ddcd1af tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.892071 Oct 05 17:51:22.980773 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1975/4228] 10.222.0.70 () {60 vars in 1187 bytes} [Wed Oct 5 17:51:22 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:23.025736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-412b8cb0-3565-439f-86b1-8044701487ba tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:23.026494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-412b8cb0-3565-439f-86b1-8044701487ba tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:23.036207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-412b8cb0-3565-439f-86b1-8044701487ba tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:23.037052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-412b8cb0-3565-439f-86b1-8044701487ba tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:23.037715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-412b8cb0-3565-439f-86b1-8044701487ba tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:23.039558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-412b8cb0-3565-439f-86b1-8044701487ba tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:23.043203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-412b8cb0-3565-439f-86b1-8044701487ba tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:23.044491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-412b8cb0-3565-439f-86b1-8044701487ba tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:23.102820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f21b0a7e-8737-4ede-b169-4757751d3d01 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:23.103565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f21b0a7e-8737-4ede-b169-4757751d3d01 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:23.128744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21b0a7e-8737-4ede-b169-4757751d3d01 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:23.129504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21b0a7e-8737-4ede-b169-4757751d3d01 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:23.129941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21b0a7e-8737-4ede-b169-4757751d3d01 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:23.130682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21b0a7e-8737-4ede-b169-4757751d3d01 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:23.131134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21b0a7e-8737-4ede-b169-4757751d3d01 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:23.131773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21b0a7e-8737-4ede-b169-4757751d3d01 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:23.140589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-412b8cb0-3565-439f-86b1-8044701487ba tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:51:23.327776 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-412b8cb0-3565-439f-86b1-8044701487ba tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 204 len: 0 microversion: 2.47 time: 0.304541 Oct 05 17:51:23.330378 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2254/4229] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:51:23 2022] DELETE /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:51:23.343539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-da89596f-f93d-4f07-9f06-ae494d335e22 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:23.347104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-da89596f-f93d-4f07-9f06-ae494d335e22 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:23.354539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da89596f-f93d-4f07-9f06-ae494d335e22 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:23.355399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da89596f-f93d-4f07-9f06-ae494d335e22 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:23.356088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da89596f-f93d-4f07-9f06-ae494d335e22 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:23.367934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da89596f-f93d-4f07-9f06-ae494d335e22 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:23.368683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da89596f-f93d-4f07-9f06-ae494d335e22 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:23.369417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da89596f-f93d-4f07-9f06-ae494d335e22 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:23.548978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-da89596f-f93d-4f07-9f06-ae494d335e22 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:23.563924 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-da89596f-f93d-4f07-9f06-ae494d335e22 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1280 microversion: 2.1 time: 0.226177 Oct 05 17:51:23.568024 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2255/4230] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:23 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1280 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:23.581320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f21b0a7e-8737-4ede-b169-4757751d3d01 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:23.591062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:23.591733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:23.594211 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f21b0a7e-8737-4ede-b169-4757751d3d01 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1318 microversion: 2.1 time: 0.495517 Oct 05 17:51:23.598065 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1976/4231] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:23 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1318 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:23.627663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:23.630684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:23.632626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:23.637575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:23.639041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:23.641033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:23.784239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:23.794020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:23.804758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:23.807666 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-66349a15-235b-4ac9-8767-13eb9219300f tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1362 microversion: 2.47 time: 0.237836 Oct 05 17:51:23.811266 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2256/4232] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:23 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:23.882752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e55207b8-c151-4a56-8707-0e50fc1994f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:23.886065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e55207b8-c151-4a56-8707-0e50fc1994f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:23.898344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e55207b8-c151-4a56-8707-0e50fc1994f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:23.912346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e55207b8-c151-4a56-8707-0e50fc1994f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:23.916399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e55207b8-c151-4a56-8707-0e50fc1994f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:23.917277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e55207b8-c151-4a56-8707-0e50fc1994f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:23.917758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e55207b8-c151-4a56-8707-0e50fc1994f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:23.918195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e55207b8-c151-4a56-8707-0e50fc1994f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:24.088184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e55207b8-c151-4a56-8707-0e50fc1994f4 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207684 Oct 05 17:51:24.090093 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1977/4233] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:23 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 197 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:24.351568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bea7e83f-2f68-4ffb-93a3-ab1c5e63c81d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:24.352195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bea7e83f-2f68-4ffb-93a3-ab1c5e63c81d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:24.360064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bea7e83f-2f68-4ffb-93a3-ab1c5e63c81d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:24.363424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bea7e83f-2f68-4ffb-93a3-ab1c5e63c81d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:24.364149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bea7e83f-2f68-4ffb-93a3-ab1c5e63c81d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:24.374176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bea7e83f-2f68-4ffb-93a3-ab1c5e63c81d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:24.375080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bea7e83f-2f68-4ffb-93a3-ab1c5e63c81d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:24.375685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bea7e83f-2f68-4ffb-93a3-ab1c5e63c81d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:24.432253 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bea7e83f-2f68-4ffb-93a3-ab1c5e63c81d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments/d59ad511-ef77-498a-8f54-a2f82c94b0ae" status: 200 len: 194 microversion: 2.1 time: 0.084780 Oct 05 17:51:24.452598 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2257/4234] 10.222.0.70 () {58 vars in 1413 bytes} [Wed Oct 5 17:51:24 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments/d59ad511-ef77-498a-8f54-a2f82c94b0ae => generated 194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:24.458425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41549424-52a3-46bb-978f-49cf6c9728e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:24.459279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-41549424-52a3-46bb-978f-49cf6c9728e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:24.477396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41549424-52a3-46bb-978f-49cf6c9728e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:24.478436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41549424-52a3-46bb-978f-49cf6c9728e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:24.479356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41549424-52a3-46bb-978f-49cf6c9728e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:24.480314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41549424-52a3-46bb-978f-49cf6c9728e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:24.480992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41549424-52a3-46bb-978f-49cf6c9728e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:24.481638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41549424-52a3-46bb-978f-49cf6c9728e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:24.590541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bbcd9bb1-03d4-43f2-b7bf-f5a05e2283c2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:24.591163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bbcd9bb1-03d4-43f2-b7bf-f5a05e2283c2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:24.608782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbcd9bb1-03d4-43f2-b7bf-f5a05e2283c2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:24.614345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbcd9bb1-03d4-43f2-b7bf-f5a05e2283c2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:24.615910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbcd9bb1-03d4-43f2-b7bf-f5a05e2283c2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:24.620794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbcd9bb1-03d4-43f2-b7bf-f5a05e2283c2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:24.624206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbcd9bb1-03d4-43f2-b7bf-f5a05e2283c2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:24.628476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbcd9bb1-03d4-43f2-b7bf-f5a05e2283c2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:24.650710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-41549424-52a3-46bb-978f-49cf6c9728e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lazy-loading 'services' on Instance uuid 7c8dfe89-5f6e-4166-83c3-752427e390a7 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:51:24.788600 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-41549424-52a3-46bb-978f-49cf6c9728e8 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments/d59ad511-ef77-498a-8f54-a2f82c94b0ae" status: 202 len: 0 microversion: 2.1 time: 0.334207 Oct 05 17:51:24.792862 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1978/4235] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 17:51:24 2022] DELETE /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments/d59ad511-ef77-498a-8f54-a2f82c94b0ae => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:51:24.807761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f10a688a-63f9-4f4e-88b9-e20cd087a14a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:24.821051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f10a688a-63f9-4f4e-88b9-e20cd087a14a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:24.852000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10a688a-63f9-4f4e-88b9-e20cd087a14a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:24.855392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10a688a-63f9-4f4e-88b9-e20cd087a14a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:24.858815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10a688a-63f9-4f4e-88b9-e20cd087a14a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:24.861539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10a688a-63f9-4f4e-88b9-e20cd087a14a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:24.865392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10a688a-63f9-4f4e-88b9-e20cd087a14a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:24.867861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10a688a-63f9-4f4e-88b9-e20cd087a14a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:25.579481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bbcd9bb1-03d4-43f2-b7bf-f5a05e2283c2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:25.604950 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bbcd9bb1-03d4-43f2-b7bf-f5a05e2283c2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1322 microversion: 2.1 time: 1.018793 Oct 05 17:51:25.610673 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2258/4236] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:24 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1322 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:25.643967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:25.645130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:25.694105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:25.698419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:25.702696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:25.704060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:25.704960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:25.708003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:25.755816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f10a688a-63f9-4f4e-88b9-e20cd087a14a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:25.798320 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f10a688a-63f9-4f4e-88b9-e20cd087a14a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1318 microversion: 2.1 time: 0.988921 Oct 05 17:51:25.804657 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1979/4237] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:24 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1318 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:25.852509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f1b279b7-3044-4c5c-9e59-0d4a87bead9d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:25.856399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1b279b7-3044-4c5c-9e59-0d4a87bead9d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:25.872679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b279b7-3044-4c5c-9e59-0d4a87bead9d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:25.875261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b279b7-3044-4c5c-9e59-0d4a87bead9d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:25.876233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b279b7-3044-4c5c-9e59-0d4a87bead9d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:25.879494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b279b7-3044-4c5c-9e59-0d4a87bead9d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:25.883802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b279b7-3044-4c5c-9e59-0d4a87bead9d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:25.884486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b279b7-3044-4c5c-9e59-0d4a87bead9d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:26.010417 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f1b279b7-3044-4c5c-9e59-0d4a87bead9d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176948 Oct 05 17:51:26.012372 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1980/4238] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:25 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:26.061161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:26.083126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:26.089359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:26.105286 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-642b39e2-7123-4615-ba21-7d97998202bb tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1362 microversion: 2.47 time: 0.479960 Oct 05 17:51:26.107973 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2259/4239] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:25 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1362 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:26.647409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-16dfb09f-9582-4685-a2ff-4a3ceabfbf8b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:26.648082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-16dfb09f-9582-4685-a2ff-4a3ceabfbf8b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:26.674028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16dfb09f-9582-4685-a2ff-4a3ceabfbf8b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:26.674535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16dfb09f-9582-4685-a2ff-4a3ceabfbf8b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:26.676051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16dfb09f-9582-4685-a2ff-4a3ceabfbf8b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:26.676977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16dfb09f-9582-4685-a2ff-4a3ceabfbf8b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:26.679056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16dfb09f-9582-4685-a2ff-4a3ceabfbf8b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:26.679990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-16dfb09f-9582-4685-a2ff-4a3ceabfbf8b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:26.828810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2796bab2-5aad-4c56-96a3-39af72b035e6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:26.829471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2796bab2-5aad-4c56-96a3-39af72b035e6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:26.852259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2796bab2-5aad-4c56-96a3-39af72b035e6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:26.852754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2796bab2-5aad-4c56-96a3-39af72b035e6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:26.853189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2796bab2-5aad-4c56-96a3-39af72b035e6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:26.853895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2796bab2-5aad-4c56-96a3-39af72b035e6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:26.854376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2796bab2-5aad-4c56-96a3-39af72b035e6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:26.854798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2796bab2-5aad-4c56-96a3-39af72b035e6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:26.939981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:27.080215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-16dfb09f-9582-4685-a2ff-4a3ceabfbf8b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:27.089547 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-16dfb09f-9582-4685-a2ff-4a3ceabfbf8b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1322 microversion: 2.1 time: 0.459946 Oct 05 17:51:27.090137 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1981/4240] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:26 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:27.109878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-356b339d-fa32-4339-a913-4333f6c8a843 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:27.112281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-356b339d-fa32-4339-a913-4333f6c8a843 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:27.154512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-356b339d-fa32-4339-a913-4333f6c8a843 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:27.164286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-356b339d-fa32-4339-a913-4333f6c8a843 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:27.167532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-356b339d-fa32-4339-a913-4333f6c8a843 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:27.168498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-356b339d-fa32-4339-a913-4333f6c8a843 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:27.169435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-356b339d-fa32-4339-a913-4333f6c8a843 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:27.170272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-356b339d-fa32-4339-a913-4333f6c8a843 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:27.286714 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-356b339d-fa32-4339-a913-4333f6c8a843 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183668 Oct 05 17:51:27.288073 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1982/4241] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:27 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:27.299368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2796bab2-5aad-4c56-96a3-39af72b035e6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:27.308150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:27.309023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:27.310406 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2796bab2-5aad-4c56-96a3-39af72b035e6 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1318 microversion: 2.1 time: 0.485740 Oct 05 17:51:27.313666 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2260/4242] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:26 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:27.322102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:27.322834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:27.330710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:27.333272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:27.333909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:27.334867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:27.373680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:27.374448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:27.375372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:27.376195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lazy-loading 'fault' on Instance uuid 5c93d623-fc1b-4dd0-bf0d-96a877907202 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:51:27.579883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:27.599524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:27.604300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:27.605966 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-25da4d60-a58e-46b2-9736-10d0f9623c16 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 200 len: 1367 microversion: 2.47 time: 0.314215 Oct 05 17:51:27.616802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-eb517f86-121d-4f60-aa23-fd744c748442 req-dff58e75-7fcc-4338-8a02-8011c5bee0cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965c02cf-92d4-4b35-90ec-83b1588eb735", "tag": "5ea43710-6e71-4e06-adfb-3fe2a9166d65"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:27.644064 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1983/4243] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:27 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:27.644416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-eb517f86-121d-4f60-aa23-fd744c748442 req-dff58e75-7fcc-4338-8a02-8011c5bee0cf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:27.656864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-eb517f86-121d-4f60-aa23-fd744c748442 req-dff58e75-7fcc-4338-8a02-8011c5bee0cf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:27.660397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-eb517f86-121d-4f60-aa23-fd744c748442 req-dff58e75-7fcc-4338-8a02-8011c5bee0cf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:27.713977 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-eb517f86-121d-4f60-aa23-fd744c748442 req-dff58e75-7fcc-4338-8a02-8011c5bee0cf service nova] Creating event network-changed:5ea43710-6e71-4e06-adfb-3fe2a9166d65 for instance 965c02cf-92d4-4b35-90ec-83b1588eb735 on n-h1-835595-3 Oct 05 17:51:27.745756 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-eb517f86-121d-4f60-aa23-fd744c748442 req-dff58e75-7fcc-4338-8a02-8011c5bee0cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127171 Oct 05 17:51:27.747577 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2261/4244] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:51:28.115626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aedee37c-0f10-4b9c-9eb7-d6cee48d32a7 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:28.116442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aedee37c-0f10-4b9c-9eb7-d6cee48d32a7 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:28.130514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedee37c-0f10-4b9c-9eb7-d6cee48d32a7 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.137305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedee37c-0f10-4b9c-9eb7-d6cee48d32a7 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.138024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedee37c-0f10-4b9c-9eb7-d6cee48d32a7 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.139182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedee37c-0f10-4b9c-9eb7-d6cee48d32a7 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.141870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedee37c-0f10-4b9c-9eb7-d6cee48d32a7 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.142580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aedee37c-0f10-4b9c-9eb7-d6cee48d32a7 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.300762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a1688a6c-ea2e-4e0a-9648-140a488dc516 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:28.308009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a1688a6c-ea2e-4e0a-9648-140a488dc516 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:28.337243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1688a6c-ea2e-4e0a-9648-140a488dc516 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.342031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1688a6c-ea2e-4e0a-9648-140a488dc516 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.343992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1688a6c-ea2e-4e0a-9648-140a488dc516 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.352157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1688a6c-ea2e-4e0a-9648-140a488dc516 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.357239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1688a6c-ea2e-4e0a-9648-140a488dc516 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.358179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1688a6c-ea2e-4e0a-9648-140a488dc516 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.452813 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a1688a6c-ea2e-4e0a-9648-140a488dc516 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156735 Oct 05 17:51:28.457432 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2262/4245] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:28 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:51:28.471500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cad620c1-b7d5-446f-bdb4-60c03801a381 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:28.472555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cad620c1-b7d5-446f-bdb4-60c03801a381 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:28.487586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cad620c1-b7d5-446f-bdb4-60c03801a381 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.495154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cad620c1-b7d5-446f-bdb4-60c03801a381 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.495970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cad620c1-b7d5-446f-bdb4-60c03801a381 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.497007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cad620c1-b7d5-446f-bdb4-60c03801a381 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.498321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cad620c1-b7d5-446f-bdb4-60c03801a381 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.499015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cad620c1-b7d5-446f-bdb4-60c03801a381 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.585229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aedee37c-0f10-4b9c-9eb7-d6cee48d32a7 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:28.598017 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aedee37c-0f10-4b9c-9eb7-d6cee48d32a7 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1322 microversion: 2.1 time: 0.488200 Oct 05 17:51:28.609221 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1984/4246] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:28 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1322 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:28.612451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:28.616475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3c7fa2d8-ec7f-4d2c-863b-3027c7471eb6 req-c52f8e0f-803f-4dd7-a571-b36b431e53ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94442e3c-35bb-4618-872a-608660ff52e5", "name": "network-vif-plugged", "status": "completed", "tag": "4c90ccb8-0e9d-4455-9303-16abd6ca05bc"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:28.640468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3c7fa2d8-ec7f-4d2c-863b-3027c7471eb6 req-c52f8e0f-803f-4dd7-a571-b36b431e53ea service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.644404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3c7fa2d8-ec7f-4d2c-863b-3027c7471eb6 req-c52f8e0f-803f-4dd7-a571-b36b431e53ea service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.645078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3c7fa2d8-ec7f-4d2c-863b-3027c7471eb6 req-c52f8e0f-803f-4dd7-a571-b36b431e53ea service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.674387 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3c7fa2d8-ec7f-4d2c-863b-3027c7471eb6 req-c52f8e0f-803f-4dd7-a571-b36b431e53ea service nova] Creating event network-vif-plugged:4c90ccb8-0e9d-4455-9303-16abd6ca05bc for instance 94442e3c-35bb-4618-872a-608660ff52e5 on n-h2-835595-3 Oct 05 17:51:28.689257 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3c7fa2d8-ec7f-4d2c-863b-3027c7471eb6 req-c52f8e0f-803f-4dd7-a571-b36b431e53ea service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077612 Oct 05 17:51:28.690113 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1985/4247] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:28.695287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=34 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:28.709945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:28.711216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: 5c93d623-fc1b-4dd0-bf0d-96a877907202] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:28.728027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.729512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.730205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.731216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.733925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.734685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.778315 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] HTTP exception thrown: Instance 5c93d623-fc1b-4dd0-bf0d-96a877907202 could not be found. Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Request method failure captured: Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 HTTP/1.1 Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPsB8JJBQygnK2Ie_26FFs8rhq4xiyjKT82ai9M6sIxN5vK8KpRphYmkhzWuHFKmT4giYvmymXcAGDEzPPHgt88ptZWLO_T2e__J2rJGhxdpOuXtaQLRy0_T_Zr2irLGx-LFN-DJVDemqD94M2sdog-gz9-II5c8u69Z7ksepYB1_w Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.47 Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 03b640c07a604e6da688d2806df25129 Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerShowV247Test-2138345829 Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/03b640c07a604e6da688d2806df25129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03b640c07a604e6da688d2806df25129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_03b640c07a604e6da688d2806df25129", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03b640c07a604e6da688d2806df25129"}]}] Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerShowV247Test-2138345829 Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 03b640c07a604e6da688d2806df25129 Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerShowV247Test-2138345829 Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerShowV247Test-2138345829-project Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 063a3a072f3c465ca650a59bff7f186a Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerShowV247Test-2138345829-project Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 5c93d623-fc1b-4dd0-bf0d-96a877907202 could not be found. Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '5c93d623-fc1b-4dd0-bf0d-96a877907202'} Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c93d623-fc1b-4dd0-bf0d-96a877907202 could not be found. Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c93d623-fc1b-4dd0-bf0d-96a877907202 could not be found. Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:28.780213 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:28.784436 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:28.784436 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:28.784436 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:28.784436 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:51:28.784436 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:51:28.784436 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c93d623-fc1b-4dd0-bf0d-96a877907202 could not be found. Oct 05 17:51:28.784436 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:51:28.788707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Returning 404 to user: Instance 5c93d623-fc1b-4dd0-bf0d-96a877907202 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:28.793717 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1906842c-0d04-4cc9-b6f6-0a8d5907d155 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202" status: 404 len: 111 microversion: 2.47 time: 0.102169 Oct 05 17:51:28.794952 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1986/4248] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:28 2022] GET /compute/v2.1/servers/5c93d623-fc1b-4dd0-bf0d-96a877907202 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:51:28.803107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b395d40-4edb-4caf-acd6-1d2ce9877382 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:28.807178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0b395d40-4edb-4caf-acd6-1d2ce9877382 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: e85ce98a-9253-4589-aed7-542120d165fd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:28.810254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cad620c1-b7d5-446f-bdb4-60c03801a381 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:28.819316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b395d40-4edb-4caf-acd6-1d2ce9877382 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.823801 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cad620c1-b7d5-446f-bdb4-60c03801a381 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1318 microversion: 2.1 time: 0.364769 Oct 05 17:51:28.836390 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2263/4249] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:28 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:28.839982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b395d40-4edb-4caf-acd6-1d2ce9877382 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.841368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b395d40-4edb-4caf-acd6-1d2ce9877382 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.842408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b395d40-4edb-4caf-acd6-1d2ce9877382 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:28.843120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b395d40-4edb-4caf-acd6-1d2ce9877382 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:28.845252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b395d40-4edb-4caf-acd6-1d2ce9877382 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:28.909002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0b395d40-4edb-4caf-acd6-1d2ce9877382 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: e85ce98a-9253-4589-aed7-542120d165fd] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:51:29.114368 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0b395d40-4edb-4caf-acd6-1d2ce9877382 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd" status: 204 len: 0 microversion: 2.47 time: 0.314906 Oct 05 17:51:29.115521 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1987/4250] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:51:28 2022] DELETE /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 17:51:29.124997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:29.125616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: e85ce98a-9253-4589-aed7-542120d165fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:29.141138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:29.142027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:29.142745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:29.143667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:29.146427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:29.147287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:29.473129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bdab217c-74fa-4172-b1e4-b03205e437da tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:29.476337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bdab217c-74fa-4172-b1e4-b03205e437da tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:29.490770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdab217c-74fa-4172-b1e4-b03205e437da tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:29.495106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdab217c-74fa-4172-b1e4-b03205e437da tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:29.495910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdab217c-74fa-4172-b1e4-b03205e437da tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:29.496908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdab217c-74fa-4172-b1e4-b03205e437da tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:29.499128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdab217c-74fa-4172-b1e4-b03205e437da tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:29.503928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:29.508994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdab217c-74fa-4172-b1e4-b03205e437da tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:29.524276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:29.527238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:29.530308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:29.535621 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0e2f9e20-224b-44eb-a516-f1bc6237969a tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd" status: 200 len: 1363 microversion: 2.47 time: 0.414689 Oct 05 17:51:29.536192 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2264/4251] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:29 2022] GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:29.599878 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bdab217c-74fa-4172-b1e4-b03205e437da tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134157 Oct 05 17:51:29.609680 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1988/4252] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:29 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:51:29.635567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81212b18-069f-428a-98d9-ecf211257adb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:29.636183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-81212b18-069f-428a-98d9-ecf211257adb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:29.648246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81212b18-069f-428a-98d9-ecf211257adb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:29.648856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81212b18-069f-428a-98d9-ecf211257adb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:29.649307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81212b18-069f-428a-98d9-ecf211257adb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:29.650032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81212b18-069f-428a-98d9-ecf211257adb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:29.650522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81212b18-069f-428a-98d9-ecf211257adb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:29.650953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81212b18-069f-428a-98d9-ecf211257adb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:29.847265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9605b57b-f4ff-4efa-b282-fc3b77c52cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:29.848156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9605b57b-f4ff-4efa-b282-fc3b77c52cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:29.859330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:29.862548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9605b57b-f4ff-4efa-b282-fc3b77c52cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:29.863319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9605b57b-f4ff-4efa-b282-fc3b77c52cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:29.868231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9605b57b-f4ff-4efa-b282-fc3b77c52cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:29.869276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9605b57b-f4ff-4efa-b282-fc3b77c52cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:29.869939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9605b57b-f4ff-4efa-b282-fc3b77c52cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:29.870992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9605b57b-f4ff-4efa-b282-fc3b77c52cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:30.097258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81212b18-069f-428a-98d9-ecf211257adb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:30.110632 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81212b18-069f-428a-98d9-ecf211257adb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1322 microversion: 2.1 time: 0.478693 Oct 05 17:51:30.111560 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2265/4253] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:29 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:30.565083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:30.565715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: e85ce98a-9253-4589-aed7-542120d165fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:30.575265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:30.575752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:30.576191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:30.576914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:30.577368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:30.577795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:30.806603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:30.825131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:30.826605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:30.827842 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b8a7ed8-8265-4642-a366-ad9aea6d5509 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd" status: 200 len: 1363 microversion: 2.47 time: 0.266790 Oct 05 17:51:30.838362 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2266/4254] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:30 2022] GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd => generated 1363 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:30.858057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1c7dec73-8da2-453b-94f2-9293b90bdbce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:30.865871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1c7dec73-8da2-453b-94f2-9293b90bdbce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:30.913922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:30.915515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c7dec73-8da2-453b-94f2-9293b90bdbce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:30.916120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c7dec73-8da2-453b-94f2-9293b90bdbce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:30.935101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c7dec73-8da2-453b-94f2-9293b90bdbce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:30.935884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c7dec73-8da2-453b-94f2-9293b90bdbce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:30.936489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c7dec73-8da2-453b-94f2-9293b90bdbce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:30.939282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c7dec73-8da2-453b-94f2-9293b90bdbce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:31.036446 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1c7dec73-8da2-453b-94f2-9293b90bdbce tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190214 Oct 05 17:51:31.042404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2267/4255] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:30 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:31.056176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-76c1edf7-6227-404b-9563-be9a489d0446 req-72e8247d-2483-4279-8fa5-2fede04e9e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c166cde4-8dea-46ee-9e5d-e07438f14e4c", "name": "network-vif-plugged", "status": "completed", "tag": "18943f16-15f0-4491-825e-57555f57e326"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:31.103595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-76c1edf7-6227-404b-9563-be9a489d0446 req-72e8247d-2483-4279-8fa5-2fede04e9e96 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:31.104109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-76c1edf7-6227-404b-9563-be9a489d0446 req-72e8247d-2483-4279-8fa5-2fede04e9e96 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:31.104553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-76c1edf7-6227-404b-9563-be9a489d0446 req-72e8247d-2483-4279-8fa5-2fede04e9e96 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:31.131817 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-76c1edf7-6227-404b-9563-be9a489d0446 req-72e8247d-2483-4279-8fa5-2fede04e9e96 service nova] Creating event network-vif-plugged:18943f16-15f0-4491-825e-57555f57e326 for instance c166cde4-8dea-46ee-9e5d-e07438f14e4c on n-h1-835595-3 Oct 05 17:51:31.138412 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-76c1edf7-6227-404b-9563-be9a489d0446 req-72e8247d-2483-4279-8fa5-2fede04e9e96 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094559 Oct 05 17:51:31.139892 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2268/4256] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:31.235640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b859975-7368-42cc-8b5d-299754710f26 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:31.237029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5b859975-7368-42cc-8b5d-299754710f26 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:31.252654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b859975-7368-42cc-8b5d-299754710f26 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:31.257446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b859975-7368-42cc-8b5d-299754710f26 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:31.260207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b859975-7368-42cc-8b5d-299754710f26 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:31.265330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b859975-7368-42cc-8b5d-299754710f26 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:31.266084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b859975-7368-42cc-8b5d-299754710f26 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:31.267312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b859975-7368-42cc-8b5d-299754710f26 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:31.383012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9605b57b-f4ff-4efa-b282-fc3b77c52cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:31.395699 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9605b57b-f4ff-4efa-b282-fc3b77c52cbe tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1318 microversion: 2.1 time: 1.552560 Oct 05 17:51:31.399314 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1989/4257] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:29 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1318 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:31.841442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5b859975-7368-42cc-8b5d-299754710f26 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:31.855938 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b859975-7368-42cc-8b5d-299754710f26 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1322 microversion: 2.1 time: 0.629698 Oct 05 17:51:31.857459 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2269/4258] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:31 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:31.868378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:31.869161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: e85ce98a-9253-4589-aed7-542120d165fd] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:31.881164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:31.884050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:31.884647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:31.891675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:31.896472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:31.897890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:32.049840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-593b5c4e-b599-46d2-8eab-3fb48960bc5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:32.052616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-593b5c4e-b599-46d2-8eab-3fb48960bc5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:32.071960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:32.081547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593b5c4e-b599-46d2-8eab-3fb48960bc5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:32.084626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593b5c4e-b599-46d2-8eab-3fb48960bc5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:32.088737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:32.089932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593b5c4e-b599-46d2-8eab-3fb48960bc5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:32.098160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593b5c4e-b599-46d2-8eab-3fb48960bc5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:32.102205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593b5c4e-b599-46d2-8eab-3fb48960bc5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:32.104450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:32.105294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-593b5c4e-b599-46d2-8eab-3fb48960bc5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:32.114206 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-60da35aa-0c8f-43d0-8769-622089d601f7 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd" status: 200 len: 1363 microversion: 2.47 time: 0.250599 Oct 05 17:51:32.122324 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1990/4259] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:31 2022] GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:32.152979 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-593b5c4e-b599-46d2-8eab-3fb48960bc5c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107828 Oct 05 17:51:32.154344 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2270/4260] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:32 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:51:32.417479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:32.424412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7148084c-18ae-4208-a3f4-c8634f384b38 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:32.426189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7148084c-18ae-4208-a3f4-c8634f384b38 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:32.439900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7148084c-18ae-4208-a3f4-c8634f384b38 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:32.440618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7148084c-18ae-4208-a3f4-c8634f384b38 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:32.442654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7148084c-18ae-4208-a3f4-c8634f384b38 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:32.444498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7148084c-18ae-4208-a3f4-c8634f384b38 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:32.445122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7148084c-18ae-4208-a3f4-c8634f384b38 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:32.448906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7148084c-18ae-4208-a3f4-c8634f384b38 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:32.750334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7148084c-18ae-4208-a3f4-c8634f384b38 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:32.762502 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7148084c-18ae-4208-a3f4-c8634f384b38 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1468 microversion: 2.1 time: 0.345999 Oct 05 17:51:32.763641 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1991/4261] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:32 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:32.790733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e73f3684-865c-408a-bba8-ac600e60070a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:32.791359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e73f3684-865c-408a-bba8-ac600e60070a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: c166cde4-8dea-46ee-9e5d-e07438f14e4c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:32.813908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e73f3684-865c-408a-bba8-ac600e60070a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:32.814447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e73f3684-865c-408a-bba8-ac600e60070a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:32.814904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e73f3684-865c-408a-bba8-ac600e60070a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:32.815596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e73f3684-865c-408a-bba8-ac600e60070a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:32.816039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e73f3684-865c-408a-bba8-ac600e60070a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:32.816926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e73f3684-865c-408a-bba8-ac600e60070a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:32.882385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3dea7502-be40-4354-b08b-43a8011d45bc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:32.883455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3dea7502-be40-4354-b08b-43a8011d45bc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:32.899687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:32.946893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea7502-be40-4354-b08b-43a8011d45bc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:32.947652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea7502-be40-4354-b08b-43a8011d45bc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:32.949887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea7502-be40-4354-b08b-43a8011d45bc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:32.953444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea7502-be40-4354-b08b-43a8011d45bc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:32.954147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea7502-be40-4354-b08b-43a8011d45bc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:32.956168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea7502-be40-4354-b08b-43a8011d45bc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:33.173100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3dea7502-be40-4354-b08b-43a8011d45bc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:33.174544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e73f3684-865c-408a-bba8-ac600e60070a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:33.185672 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3dea7502-be40-4354-b08b-43a8011d45bc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1322 microversion: 2.1 time: 0.309498 Oct 05 17:51:33.195232 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e73f3684-865c-408a-bba8-ac600e60070a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c" status: 200 len: 1318 microversion: 2.1 time: 0.410886 Oct 05 17:51:33.195833 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2271/4262] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:32 2022] GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:33.204471 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1992/4263] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:32 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:33.214588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4cd9ab06-9d50-4ba0-9300-2e6810d84e1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:33.216618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:33.221482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4cd9ab06-9d50-4ba0-9300-2e6810d84e1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:33.223006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: e85ce98a-9253-4589-aed7-542120d165fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:33.230241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cd9ab06-9d50-4ba0-9300-2e6810d84e1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:33.231034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cd9ab06-9d50-4ba0-9300-2e6810d84e1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:33.231658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cd9ab06-9d50-4ba0-9300-2e6810d84e1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:33.236326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cd9ab06-9d50-4ba0-9300-2e6810d84e1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:33.237124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cd9ab06-9d50-4ba0-9300-2e6810d84e1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:33.237848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cd9ab06-9d50-4ba0-9300-2e6810d84e1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:33.244792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:33.247711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:33.251541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:33.254015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:33.264410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:33.265095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:33.287543 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4cd9ab06-9d50-4ba0-9300-2e6810d84e1d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081815 Oct 05 17:51:33.293187 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1993/4264] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:33 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:33.477619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:33.497756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:33.500569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '063a3a072f3c465ca650a59bff7f186a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '03b640c07a604e6da688d2806df25129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:33.502218 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5844d9c0-db8f-4fb0-8ffe-9f88032ccd69 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd" status: 200 len: 1363 microversion: 2.47 time: 0.298706 Oct 05 17:51:33.503052 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2272/4265] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:33 2022] GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:34.212382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c3173ce0-dad4-4aa9-a838-eaac6fa30a32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:34.213703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3173ce0-dad4-4aa9-a838-eaac6fa30a32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:34.224512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d14bf745-02c5-4abb-8d92-473304ce6a26 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:34.225364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d14bf745-02c5-4abb-8d92-473304ce6a26 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: c166cde4-8dea-46ee-9e5d-e07438f14e4c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:34.228276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3173ce0-dad4-4aa9-a838-eaac6fa30a32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.229835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3173ce0-dad4-4aa9-a838-eaac6fa30a32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.231345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3173ce0-dad4-4aa9-a838-eaac6fa30a32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.233718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3173ce0-dad4-4aa9-a838-eaac6fa30a32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.234434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3173ce0-dad4-4aa9-a838-eaac6fa30a32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.235479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3173ce0-dad4-4aa9-a838-eaac6fa30a32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.242005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d14bf745-02c5-4abb-8d92-473304ce6a26 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.243853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d14bf745-02c5-4abb-8d92-473304ce6a26 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.245194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d14bf745-02c5-4abb-8d92-473304ce6a26 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.248073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d14bf745-02c5-4abb-8d92-473304ce6a26 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.249933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d14bf745-02c5-4abb-8d92-473304ce6a26 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.252432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d14bf745-02c5-4abb-8d92-473304ce6a26 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.549196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d14bf745-02c5-4abb-8d92-473304ce6a26 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:34.565073 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d14bf745-02c5-4abb-8d92-473304ce6a26 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c" status: 200 len: 1467 microversion: 2.1 time: 0.346491 Oct 05 17:51:34.567078 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2273/4266] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:34 2022] GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c => generated 1467 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:34.582619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92a159af-8497-46a5-99c2-d7e359253368 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:34.589864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92a159af-8497-46a5-99c2-d7e359253368 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:34.610437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92a159af-8497-46a5-99c2-d7e359253368 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.613100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92a159af-8497-46a5-99c2-d7e359253368 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.615677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92a159af-8497-46a5-99c2-d7e359253368 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.617907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92a159af-8497-46a5-99c2-d7e359253368 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.621680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92a159af-8497-46a5-99c2-d7e359253368 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.622476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92a159af-8497-46a5-99c2-d7e359253368 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.658675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c3173ce0-dad4-4aa9-a838-eaac6fa30a32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:34.669285 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c3173ce0-dad4-4aa9-a838-eaac6fa30a32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1322 microversion: 2.1 time: 0.461887 Oct 05 17:51:34.678158 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1994/4267] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:34 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1322 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:34.688800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e0de907f-de49-41ab-a9b1-0449634fe41e req-af321624-583b-4dbe-b4dd-23ee74edcf0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965c02cf-92d4-4b35-90ec-83b1588eb735", "name": "network-vif-plugged", "status": "completed", "tag": "5ea43710-6e71-4e06-adfb-3fe2a9166d65"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:34.725706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e0de907f-de49-41ab-a9b1-0449634fe41e req-af321624-583b-4dbe-b4dd-23ee74edcf0e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.727378 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92a159af-8497-46a5-99c2-d7e359253368 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.158898 Oct 05 17:51:34.733572 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2274/4268] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:34 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1/os-volume_attachments => generated 25 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:51:34.739991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:34.740511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] [instance: e85ce98a-9253-4589-aed7-542120d165fd] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:34.748315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e0de907f-de49-41ab-a9b1-0449634fe41e req-af321624-583b-4dbe-b4dd-23ee74edcf0e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.754971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e0de907f-de49-41ab-a9b1-0449634fe41e req-af321624-583b-4dbe-b4dd-23ee74edcf0e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.771291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.771791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.772236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.772952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.773412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.773845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.781199 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e0de907f-de49-41ab-a9b1-0449634fe41e req-af321624-583b-4dbe-b4dd-23ee74edcf0e service nova] Creating event network-vif-plugged:5ea43710-6e71-4e06-adfb-3fe2a9166d65 for instance 965c02cf-92d4-4b35-90ec-83b1588eb735 on n-h1-835595-3 Oct 05 17:51:34.817248 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e0de907f-de49-41ab-a9b1-0449634fe41e req-af321624-583b-4dbe-b4dd-23ee74edcf0e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140101 Oct 05 17:51:34.821226 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1995/4269] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:34.833344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:34.846887 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] HTTP exception thrown: Instance e85ce98a-9253-4589-aed7-542120d165fd could not be found. Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Request method failure captured: Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd HTTP/1.1 Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcPsB8JJBQygnK2Ie_26FFs8rhq4xiyjKT82ai9M6sIxN5vK8KpRphYmkhzWuHFKmT4giYvmymXcAGDEzPPHgt88ptZWLO_T2e__J2rJGhxdpOuXtaQLRy0_T_Zr2irLGx-LFN-DJVDemqD94M2sdog-gz9-II5c8u69Z7ksepYB1_w Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.47 Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 03b640c07a604e6da688d2806df25129 Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerShowV247Test-2138345829 Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/03b640c07a604e6da688d2806df25129"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03b640c07a604e6da688d2806df25129"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_03b640c07a604e6da688d2806df25129", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/03b640c07a604e6da688d2806df25129"}]}] Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerShowV247Test-2138345829 Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 03b640c07a604e6da688d2806df25129 Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerShowV247Test-2138345829 Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerShowV247Test-2138345829-project Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 063a3a072f3c465ca650a59bff7f186a Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerShowV247Test-2138345829-project Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e85ce98a-9253-4589-aed7-542120d165fd could not be found. Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e85ce98a-9253-4589-aed7-542120d165fd'} Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85ce98a-9253-4589-aed7-542120d165fd could not be found. Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85ce98a-9253-4589-aed7-542120d165fd could not be found. Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:34.851075 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:34.856522 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:34.856522 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:34.856522 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:34.856522 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:51:34.856522 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:51:34.856522 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85ce98a-9253-4589-aed7-542120d165fd could not be found. Oct 05 17:51:34.856522 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:34.856522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] Returning 404 to user: Instance e85ce98a-9253-4589-aed7-542120d165fd could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:34.856522 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1a97f270-14af-4ac5-9c42-97b7c164ce07 tempest-ServerShowV247Test-2138345829 tempest-ServerShowV247Test-2138345829-project] 10.222.0.70 "GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd" status: 404 len: 111 microversion: 2.47 time: 0.118916 Oct 05 17:51:34.860569 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2275/4270] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:34 2022] GET /compute/v2.1/servers/e85ce98a-9253-4589-aed7-542120d165fd => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:51:34.865342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:34.866243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Searching by: {'reservation_id': 'r-6f0cj8el', 'deleted': False, 'project_id': '4809bb6013894d13a894acb816f7dca8'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:51:34.895912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:34.900611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:34.916320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.920825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.926776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.933113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.934261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.934881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.935250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.936704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.937887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:34.942254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:34.943304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:34.944847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:35.062896 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] HTTP exception thrown: Cannot 'reboot' instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d while it is in vm_state rescued Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Request method failure captured: Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d/action HTTP/1.1 Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 28 Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcMOAOpdE63X8OhW4wsEy2crLrx01LtQ-rp_0wT7KyP_snq49RBe9pW2rDXvGDquoPS8xWknsOpVRp2diM1zITKhR01lPNUgSkUsWER9laVmknlwDrrF_SZj9lTxUjYcrefuqCr0JxKMwpc1ouYu8vVwbNWydS37cc_WZDK5JdlZgNU Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/caf452f31a594c888e1703356c637a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_caf452f31a594c888e1703356c637a91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}] Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 50b3fb554dd64e41bea1109e697b0799 Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: {"reboot": {"type": "HARD"}} Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot 'reboot' instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d while it is in vm_state rescued Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'bb5b7961-3ec3-477d-a023-3c8ea6931d2d', 'body': {'reboot': {'type': 'HARD'}}} Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 17:51:35.068358 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d while it is in vm_state rescued Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d while it is in vm_state rescued Oct 05 17:51:35.072600 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:35.074196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Returning 409 to user: Cannot 'reboot' instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d while it is in vm_state rescued {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:35.077219 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d47b178a-920b-4b8f-94eb-1aca5cd4af4b tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d/action" status: 409 len: 145 microversion: 2.1 time: 0.192445 Oct 05 17:51:35.079100 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2276/4271] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:51:34 2022] POST /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d/action => generated 145 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 05 17:51:35.095126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:35.106386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:35.121697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:35.122465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:35.124949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:35.125939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:35.126684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:35.129694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:35.232258 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] HTTP exception thrown: Cannot 'rebuild' instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d while it is in vm_state rescued Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Request method failure captured: Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d/action HTTP/1.1 Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 65 Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcMOAOpdE63X8OhW4wsEy2crLrx01LtQ-rp_0wT7KyP_snq49RBe9pW2rDXvGDquoPS8xWknsOpVRp2diM1zITKhR01lPNUgSkUsWER9laVmknlwDrrF_SZj9lTxUjYcrefuqCr0JxKMwpc1ouYu8vVwbNWydS37cc_WZDK5JdlZgNU Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/caf452f31a594c888e1703356c637a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_caf452f31a594c888e1703356c637a91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}] Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 50b3fb554dd64e41bea1109e697b0799 Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot 'rebuild' instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d while it is in vm_state rescued Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'bb5b7961-3ec3-477d-a023-3c8ea6931d2d', 'body': {'rebuild': {'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e'}}} Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:51:35.240290 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d while it is in vm_state rescued Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d while it is in vm_state rescued Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:35.245658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Returning 409 to user: Cannot 'rebuild' instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d while it is in vm_state rescued {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:35.247323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:51:35.247800 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e9d3bbd3-ae83-4f88-a3f9-2ee8d2e74e03 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "POST /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d/action" status: 409 len: 146 microversion: 2.1 time: 0.159258 Oct 05 17:51:35.249318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2277/4272] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:51:35 2022] POST /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d/action => generated 146 bytes in 163 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:51:35.273362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-15c3f26d-0489-4cce-a1d5-28615726894c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:35.274739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15c3f26d-0489-4cce-a1d5-28615726894c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:35.301140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15c3f26d-0489-4cce-a1d5-28615726894c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:35.301649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15c3f26d-0489-4cce-a1d5-28615726894c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:35.302168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15c3f26d-0489-4cce-a1d5-28615726894c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:35.302826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15c3f26d-0489-4cce-a1d5-28615726894c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:35.303323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15c3f26d-0489-4cce-a1d5-28615726894c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:35.305164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15c3f26d-0489-4cce-a1d5-28615726894c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:35.340266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15c3f26d-0489-4cce-a1d5-28615726894c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:51:35.374252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:35.382684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:35.384129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:35.385092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:35.385863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:35.503183 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-15c3f26d-0489-4cce-a1d5-28615726894c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "DELETE /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 204 len: 0 microversion: 2.1 time: 0.236979 Oct 05 17:51:35.507407 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2278/4273] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:51:35 2022] DELETE /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:51:35.514440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d2c2101d-bf30-4fcf-b1b5-06cfc3d74c73 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:35.515933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d2c2101d-bf30-4fcf-b1b5-06cfc3d74c73 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:35.533275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2c2101d-bf30-4fcf-b1b5-06cfc3d74c73 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:35.534144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2c2101d-bf30-4fcf-b1b5-06cfc3d74c73 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:35.534841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2c2101d-bf30-4fcf-b1b5-06cfc3d74c73 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:35.535787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2c2101d-bf30-4fcf-b1b5-06cfc3d74c73 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:35.536496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2c2101d-bf30-4fcf-b1b5-06cfc3d74c73 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:35.537139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2c2101d-bf30-4fcf-b1b5-06cfc3d74c73 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:35.711723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d2c2101d-bf30-4fcf-b1b5-06cfc3d74c73 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:35.722905 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d2c2101d-bf30-4fcf-b1b5-06cfc3d74c73 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1692 microversion: 2.1 time: 0.212460 Oct 05 17:51:35.723710 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2279/4274] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:35 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1692 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:35.738669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-108e6a89-997c-47bc-ac32-f9a5cc5e00cc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:35.740194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-108e6a89-997c-47bc-ac32-f9a5cc5e00cc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:35.754541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-108e6a89-997c-47bc-ac32-f9a5cc5e00cc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:35.755471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-108e6a89-997c-47bc-ac32-f9a5cc5e00cc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:35.756164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-108e6a89-997c-47bc-ac32-f9a5cc5e00cc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:35.757258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-108e6a89-997c-47bc-ac32-f9a5cc5e00cc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:35.758470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-108e6a89-997c-47bc-ac32-f9a5cc5e00cc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:35.759117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-108e6a89-997c-47bc-ac32-f9a5cc5e00cc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:35.883276 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-26e115ee-cd1f-4d30-8e88-aa694c39ef76 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/detail?reservation_id=r-6f0cj8el" status: 200 len: 2928 microversion: 2.1 time: 1.060730 Oct 05 17:51:35.885028 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1996/4275] 10.222.0.70 () {58 vars in 1197 bytes} [Wed Oct 5 17:51:34 2022] GET /compute/v2.1/servers/detail?reservation_id=r-6f0cj8el => generated 2928 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:35.919040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-90066c9a-a674-47bf-a02a-88dd989fe0e9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:35.968037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.compute.server_groups [None req-90066c9a-a674-47bf-a02a-88dd989fe0e9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Querying cell 7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) for 2 instances {{(pid=128843) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 05 17:51:35.969207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90066c9a-a674-47bf-a02a-88dd989fe0e9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:35.971225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90066c9a-a674-47bf-a02a-88dd989fe0e9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:35.972887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90066c9a-a674-47bf-a02a-88dd989fe0e9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:36.036322 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-90066c9a-a674-47bf-a02a-88dd989fe0e9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/os-server-groups/e62ac756-6129-4cf9-a49a-65dee432aad6" status: 200 len: 270 microversion: 2.1 time: 0.122360 Oct 05 17:51:36.043129 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1997/4276] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:51:35 2022] GET /compute/v2.1/os-server-groups/e62ac756-6129-4cf9-a49a-65dee432aad6 => generated 270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:36.055287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b2c2a055-40ab-4fc0-9eb9-4c129c8c02e9 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:36.056396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b2c2a055-40ab-4fc0-9eb9-4c129c8c02e9 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:36.068137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c2a055-40ab-4fc0-9eb9-4c129c8c02e9 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:36.068883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c2a055-40ab-4fc0-9eb9-4c129c8c02e9 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:36.069480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c2a055-40ab-4fc0-9eb9-4c129c8c02e9 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:36.070411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c2a055-40ab-4fc0-9eb9-4c129c8c02e9 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:36.071024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c2a055-40ab-4fc0-9eb9-4c129c8c02e9 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:36.071733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c2a055-40ab-4fc0-9eb9-4c129c8c02e9 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:36.286626 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b2c2a055-40ab-4fc0-9eb9-4c129c8c02e9 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 200 len: 1619 microversion: 2.1 time: 0.234953 Oct 05 17:51:36.295218 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1998/4277] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:36 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 1619 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:36.314467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1eea9369-a717-41e0-93ae-10c5c811d757 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:36.315634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1eea9369-a717-41e0-93ae-10c5c811d757 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] [instance: c166cde4-8dea-46ee-9e5d-e07438f14e4c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:36.327590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1eea9369-a717-41e0-93ae-10c5c811d757 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:36.328772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1eea9369-a717-41e0-93ae-10c5c811d757 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:36.330721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1eea9369-a717-41e0-93ae-10c5c811d757 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:36.332700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1eea9369-a717-41e0-93ae-10c5c811d757 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:36.334222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1eea9369-a717-41e0-93ae-10c5c811d757 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:36.335778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1eea9369-a717-41e0-93ae-10c5c811d757 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:36.496377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-108e6a89-997c-47bc-ac32-f9a5cc5e00cc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:36.508395 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-108e6a89-997c-47bc-ac32-f9a5cc5e00cc tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1322 microversion: 2.1 time: 0.783090 Oct 05 17:51:36.524122 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2280/4278] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:35 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1322 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:36.615921 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1eea9369-a717-41e0-93ae-10c5c811d757 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c" status: 200 len: 1618 microversion: 2.1 time: 0.303589 Oct 05 17:51:36.616769 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 1999/4279] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:36 2022] GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c => generated 1618 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:36.752697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ceba785-e00d-4e6d-9430-3a9d48f4578a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:36.753410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3ceba785-e00d-4e6d-9430-3a9d48f4578a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:36.763939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ceba785-e00d-4e6d-9430-3a9d48f4578a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:36.764446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ceba785-e00d-4e6d-9430-3a9d48f4578a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:36.764896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ceba785-e00d-4e6d-9430-3a9d48f4578a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:36.765608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ceba785-e00d-4e6d-9430-3a9d48f4578a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:36.766066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ceba785-e00d-4e6d-9430-3a9d48f4578a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:36.766793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ceba785-e00d-4e6d-9430-3a9d48f4578a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:36.828894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1737818015", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "a708a04f-a0cd-42d3-92d5-2f5d4dd8577b"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:36.965186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:51:37.079799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3ceba785-e00d-4e6d-9430-3a9d48f4578a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:37.090062 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ceba785-e00d-4e6d-9430-3a9d48f4578a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1692 microversion: 2.1 time: 0.340910 Oct 05 17:51:37.111755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2281/4280] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:36 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1692 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:37.540170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ed0f12ca-5c79-4f96-a1b2-84120b893490 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:37.541485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ed0f12ca-5c79-4f96-a1b2-84120b893490 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:37.553605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed0f12ca-5c79-4f96-a1b2-84120b893490 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:37.561984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed0f12ca-5c79-4f96-a1b2-84120b893490 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:37.562641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed0f12ca-5c79-4f96-a1b2-84120b893490 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:37.563890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed0f12ca-5c79-4f96-a1b2-84120b893490 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:37.564501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed0f12ca-5c79-4f96-a1b2-84120b893490 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:37.565107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed0f12ca-5c79-4f96-a1b2-84120b893490 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:37.588127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:51:37.588624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:51:37.588993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:51:37.589400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:51:37.589806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:51:37.610524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:37.610524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:37.610524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:37.615273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:37.619696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:37.620539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:37.664620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:37.671858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:37.730416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:51:37.732789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:51:37.798205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ed0f12ca-5c79-4f96-a1b2-84120b893490 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:37.807093 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ed0f12ca-5c79-4f96-a1b2-84120b893490 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1517 microversion: 2.1 time: 0.273467 Oct 05 17:51:37.807681 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2282/4281] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:37 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1517 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:37.833039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-198a429d-72c6-41a4-bf0e-0f9529454e53 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:37.835833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-198a429d-72c6-41a4-bf0e-0f9529454e53 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:37.847677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-198a429d-72c6-41a4-bf0e-0f9529454e53 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:37.848183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-198a429d-72c6-41a4-bf0e-0f9529454e53 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:37.848632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-198a429d-72c6-41a4-bf0e-0f9529454e53 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:37.849347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-198a429d-72c6-41a4-bf0e-0f9529454e53 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:37.849808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-198a429d-72c6-41a4-bf0e-0f9529454e53 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:37.850237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-198a429d-72c6-41a4-bf0e-0f9529454e53 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:37.881384 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-086bc2fd-7efa-4cbe-996b-2c038cbe34f2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.055064 Oct 05 17:51:37.883048 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2000/4282] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:51:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:51:37.919400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b7d80b3d-36a4-4105-8685-147764c6ec12 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:37.919400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b7d80b3d-36a4-4105-8685-147764c6ec12 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:37.924633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-198a429d-72c6-41a4-bf0e-0f9529454e53 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lazy-loading 'flavor' on Instance uuid 965c02cf-92d4-4b35-90ec-83b1588eb735 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:51:38.064748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7d80b3d-36a4-4105-8685-147764c6ec12 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:38.072694 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b7d80b3d-36a4-4105-8685-147764c6ec12 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1217 microversion: 2.1 time: 0.181080 Oct 05 17:51:38.090397 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2001/4283] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:37 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:38.119879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed74e260-0ddc-4e89-9f3c-20e6650c43d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:38.120508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed74e260-0ddc-4e89-9f3c-20e6650c43d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:38.132213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed74e260-0ddc-4e89-9f3c-20e6650c43d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:38.132708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed74e260-0ddc-4e89-9f3c-20e6650c43d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:38.133366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed74e260-0ddc-4e89-9f3c-20e6650c43d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:38.134554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed74e260-0ddc-4e89-9f3c-20e6650c43d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:38.137234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed74e260-0ddc-4e89-9f3c-20e6650c43d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:38.137917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed74e260-0ddc-4e89-9f3c-20e6650c43d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:38.178677 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-198a429d-72c6-41a4-bf0e-0f9529454e53 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "POST /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735/action" status: 200 len: 32 microversion: 2.1 time: 0.350639 Oct 05 17:51:38.188187 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2283/4284] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:51:37 2022] POST /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 05 17:51:38.220573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7c2c779d-b91f-43f8-9ca3-f53af58a9cb6 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:38.223345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7c2c779d-b91f-43f8-9ca3-f53af58a9cb6 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:38.255526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c2c779d-b91f-43f8-9ca3-f53af58a9cb6 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:38.260656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c2c779d-b91f-43f8-9ca3-f53af58a9cb6 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:38.262547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c2c779d-b91f-43f8-9ca3-f53af58a9cb6 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:38.264782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c2c779d-b91f-43f8-9ca3-f53af58a9cb6 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:38.268106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c2c779d-b91f-43f8-9ca3-f53af58a9cb6 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:38.269768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c2c779d-b91f-43f8-9ca3-f53af58a9cb6 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:38.756273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ed74e260-0ddc-4e89-9f3c-20e6650c43d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:38.765345 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed74e260-0ddc-4e89-9f3c-20e6650c43d2 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1692 microversion: 2.1 time: 0.650006 Oct 05 17:51:38.779824 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2002/4285] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:38 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1692 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:38.963904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7c2c779d-b91f-43f8-9ca3-f53af58a9cb6 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:38.977079 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7c2c779d-b91f-43f8-9ca3-f53af58a9cb6 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.776176 Oct 05 17:51:38.999119 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2284/4286] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:38 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:39.104247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-46d720a2-c0f9-4404-b08b-fa8bb3b77d7a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:39.105108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-46d720a2-c0f9-4404-b08b-fa8bb3b77d7a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:39.126176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d720a2-c0f9-4404-b08b-fa8bb3b77d7a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:39.126755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d720a2-c0f9-4404-b08b-fa8bb3b77d7a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:39.127198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d720a2-c0f9-4404-b08b-fa8bb3b77d7a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:39.127916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d720a2-c0f9-4404-b08b-fa8bb3b77d7a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:39.128366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d720a2-c0f9-4404-b08b-fa8bb3b77d7a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:39.134193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d720a2-c0f9-4404-b08b-fa8bb3b77d7a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:39.792446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-434302059", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": "none"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:39.897472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-46d720a2-c0f9-4404-b08b-fa8bb3b77d7a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:39.909399 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-46d720a2-c0f9-4404-b08b-fa8bb3b77d7a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1221 microversion: 2.1 time: 0.808868 Oct 05 17:51:39.917620 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2003/4287] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:39 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1221 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:39.932953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76a84599-e866-4e03-9950-8decaccccbe0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:39.944462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-76a84599-e866-4e03-9950-8decaccccbe0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:39.951998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:51:39.953876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:51:39.954661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:51:39.958738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:51:39.959569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:51:39.961983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76a84599-e866-4e03-9950-8decaccccbe0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:39.962910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76a84599-e866-4e03-9950-8decaccccbe0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:39.963396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76a84599-e866-4e03-9950-8decaccccbe0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:39.964313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76a84599-e866-4e03-9950-8decaccccbe0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:39.965119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76a84599-e866-4e03-9950-8decaccccbe0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:39.965724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76a84599-e866-4e03-9950-8decaccccbe0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:39.988215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:39.988768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:39.990378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:39.994900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:39.996427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:39.997041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:40.052271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Getting quotas for project 6026cfbf11d644a5ac3fb3b3346ced0e. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:40.072953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Getting quotas for user 121e857ad87945c087137f591fa1c7f5 and project 6026cfbf11d644a5ac3fb3b3346ced0e. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:40.107605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:51:40.114568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:51:40.238000 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c1cef5c-6178-4720-b460-4b82e9b7bec2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.916251 Oct 05 17:51:40.238977 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2285/4288] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:51:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 918 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:51:40.258474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b8a852b5-fa95-4520-9052-593043c14627 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:40.259377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b8a852b5-fa95-4520-9052-593043c14627 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:40.269928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8a852b5-fa95-4520-9052-593043c14627 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:40.270722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8a852b5-fa95-4520-9052-593043c14627 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:40.286257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8a852b5-fa95-4520-9052-593043c14627 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:40.287394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8a852b5-fa95-4520-9052-593043c14627 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:40.289024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8a852b5-fa95-4520-9052-593043c14627 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:40.294468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8a852b5-fa95-4520-9052-593043c14627 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:40.919835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b8a852b5-fa95-4520-9052-593043c14627 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:40.933203 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b8a852b5-fa95-4520-9052-593043c14627 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.685294 Oct 05 17:51:40.934670 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2286/4289] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:40 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:40.948142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a8b9f6d5-0820-47f0-a346-0ce453a95385 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:40.952306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a8b9f6d5-0820-47f0-a346-0ce453a95385 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:41.270883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8b9f6d5-0820-47f0-a346-0ce453a95385 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:41.287358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8b9f6d5-0820-47f0-a346-0ce453a95385 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:41.297917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8b9f6d5-0820-47f0-a346-0ce453a95385 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:41.299169 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a8b9f6d5-0820-47f0-a346-0ce453a95385 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1277 microversion: 2.54 time: 0.362668 Oct 05 17:51:41.299744 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2287/4290] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:40 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1277 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:41.304330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5720c56-fea0-47bf-9c86-d23f896ccdde tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:41.304938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5720c56-fea0-47bf-9c86-d23f896ccdde tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:41.336123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5720c56-fea0-47bf-9c86-d23f896ccdde tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:41.339221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5720c56-fea0-47bf-9c86-d23f896ccdde tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:41.339862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5720c56-fea0-47bf-9c86-d23f896ccdde tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:41.340714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5720c56-fea0-47bf-9c86-d23f896ccdde tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:41.343245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5720c56-fea0-47bf-9c86-d23f896ccdde tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:41.343806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5720c56-fea0-47bf-9c86-d23f896ccdde tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:41.365026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-76a84599-e866-4e03-9950-8decaccccbe0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:41.379421 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76a84599-e866-4e03-9950-8decaccccbe0 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1692 microversion: 2.1 time: 1.460654 Oct 05 17:51:41.382533 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2004/4291] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:39 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1692 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:41.555082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5720c56-fea0-47bf-9c86-d23f896ccdde tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:41.564282 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5720c56-fea0-47bf-9c86-d23f896ccdde tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1275 microversion: 2.1 time: 0.263432 Oct 05 17:51:41.571256 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2288/4292] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:41 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1275 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:41.961105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cbe98c9e-9296-49bd-94c9-13ae6b8d3e5b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:41.962226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cbe98c9e-9296-49bd-94c9-13ae6b8d3e5b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:41.978092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe98c9e-9296-49bd-94c9-13ae6b8d3e5b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:41.978770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe98c9e-9296-49bd-94c9-13ae6b8d3e5b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:41.979225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe98c9e-9296-49bd-94c9-13ae6b8d3e5b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:41.979964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe98c9e-9296-49bd-94c9-13ae6b8d3e5b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:41.980427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe98c9e-9296-49bd-94c9-13ae6b8d3e5b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:41.983522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbe98c9e-9296-49bd-94c9-13ae6b8d3e5b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:42.326687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:42.327450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:42.334974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:42.335462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:42.335902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:42.336601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:42.337062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:42.337493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:42.616853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:42.631270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:42.637351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:42.638981 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21d31c32-27d2-495a-b20c-f4d9859aba1c tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1329 microversion: 2.54 time: 0.316644 Oct 05 17:51:42.655157 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2289/4293] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:42 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1329 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:42.673497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-57b4a88a-959d-493d-9085-2a0f24154a85 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:42.676389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-57b4a88a-959d-493d-9085-2a0f24154a85 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:42.689530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b4a88a-959d-493d-9085-2a0f24154a85 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:42.695030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b4a88a-959d-493d-9085-2a0f24154a85 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:42.695798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b4a88a-959d-493d-9085-2a0f24154a85 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:42.696843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b4a88a-959d-493d-9085-2a0f24154a85 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:42.697525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b4a88a-959d-493d-9085-2a0f24154a85 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:42.698791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b4a88a-959d-493d-9085-2a0f24154a85 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:42.709270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cbe98c9e-9296-49bd-94c9-13ae6b8d3e5b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:42.725155 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cbe98c9e-9296-49bd-94c9-13ae6b8d3e5b tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.771267 Oct 05 17:51:42.727732 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2005/4294] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:41 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:42.745523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a8998886-418c-4f80-9cc1-e4576ae6e9d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:42.747789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a8998886-418c-4f80-9cc1-e4576ae6e9d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:42.770470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8998886-418c-4f80-9cc1-e4576ae6e9d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:42.782626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8998886-418c-4f80-9cc1-e4576ae6e9d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:42.783465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8998886-418c-4f80-9cc1-e4576ae6e9d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:42.785124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8998886-418c-4f80-9cc1-e4576ae6e9d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:42.789297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8998886-418c-4f80-9cc1-e4576ae6e9d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:42.794762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8998886-418c-4f80-9cc1-e4576ae6e9d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:42.935392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-57b4a88a-959d-493d-9085-2a0f24154a85 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:42.948446 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-57b4a88a-959d-493d-9085-2a0f24154a85 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 200 len: 1624 microversion: 2.1 time: 0.291826 Oct 05 17:51:42.949376 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2290/4295] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:42 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 1624 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:42.956358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3f1a8fa5-3875-43f6-ac01-2f5c4655c584 req-c612eb7e-ceb8-4bb0-9984-eaea2b167b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "306c41c5-0f1e-4812-a54d-c31fc031c7d1", "name": "network-vif-deleted", "tag": "371d802d-9093-4be5-860b-4f96eed3c8f9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:42.980530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3f1a8fa5-3875-43f6-ac01-2f5c4655c584 req-c612eb7e-ceb8-4bb0-9984-eaea2b167b70 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:42.981819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3f1a8fa5-3875-43f6-ac01-2f5c4655c584 req-c612eb7e-ceb8-4bb0-9984-eaea2b167b70 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:42.982260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3f1a8fa5-3875-43f6-ac01-2f5c4655c584 req-c612eb7e-ceb8-4bb0-9984-eaea2b167b70 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:43.022425 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3f1a8fa5-3875-43f6-ac01-2f5c4655c584 req-c612eb7e-ceb8-4bb0-9984-eaea2b167b70 service nova] Creating event network-vif-deleted:371d802d-9093-4be5-860b-4f96eed3c8f9 for instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 on n-h2-835595-3 Oct 05 17:51:43.039472 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3f1a8fa5-3875-43f6-ac01-2f5c4655c584 req-c612eb7e-ceb8-4bb0-9984-eaea2b167b70 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087340 Oct 05 17:51:43.045724 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2291/4296] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:43.096514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84c72665-fc0d-48a1-a75e-0f80b3e68310 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:43.099411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-84c72665-fc0d-48a1-a75e-0f80b3e68310 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:43.107363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84c72665-fc0d-48a1-a75e-0f80b3e68310 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:43.108361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84c72665-fc0d-48a1-a75e-0f80b3e68310 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:43.109021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84c72665-fc0d-48a1-a75e-0f80b3e68310 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:43.110089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84c72665-fc0d-48a1-a75e-0f80b3e68310 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:43.110891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84c72665-fc0d-48a1-a75e-0f80b3e68310 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:43.111513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84c72665-fc0d-48a1-a75e-0f80b3e68310 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:43.194951 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84c72665-fc0d-48a1-a75e-0f80b3e68310 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103029 Oct 05 17:51:43.198892 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2292/4297] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:43 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:51:43.422340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79aa02d9-d24a-46a0-a818-70b9233db13d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:43.425820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-79aa02d9-d24a-46a0-a818-70b9233db13d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:43.440331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79aa02d9-d24a-46a0-a818-70b9233db13d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:43.441076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79aa02d9-d24a-46a0-a818-70b9233db13d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:43.442819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79aa02d9-d24a-46a0-a818-70b9233db13d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:43.449382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79aa02d9-d24a-46a0-a818-70b9233db13d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:43.449382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79aa02d9-d24a-46a0-a818-70b9233db13d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:43.449382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79aa02d9-d24a-46a0-a818-70b9233db13d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:43.538022 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79aa02d9-d24a-46a0-a818-70b9233db13d tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118456 Oct 05 17:51:43.558594 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2293/4298] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 17:51:43 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 17:51:43.607251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a8998886-418c-4f80-9cc1-e4576ae6e9d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:43.635120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:43.647106 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a8998886-418c-4f80-9cc1-e4576ae6e9d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1275 microversion: 2.1 time: 0.915191 Oct 05 17:51:43.670173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c38b9c4-2ae0-4d53-9e4d-226204051477 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:43.670766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5c38b9c4-2ae0-4d53-9e4d-226204051477 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:43.675730 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2006/4299] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:42 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1275 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:43.679102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c38b9c4-2ae0-4d53-9e4d-226204051477 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:43.680216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c38b9c4-2ae0-4d53-9e4d-226204051477 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:43.680906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c38b9c4-2ae0-4d53-9e4d-226204051477 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:43.681933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c38b9c4-2ae0-4d53-9e4d-226204051477 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:43.682661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c38b9c4-2ae0-4d53-9e4d-226204051477 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:43.683322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c38b9c4-2ae0-4d53-9e4d-226204051477 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:43.706725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:43.708213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:43.737063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:43.738512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:43.741018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:43.746636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:43.749807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5c38b9c4-2ae0-4d53-9e4d-226204051477 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:51:43.756320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:43.760841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:43.764233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:43.917445 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c38b9c4-2ae0-4d53-9e4d-226204051477 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 204 len: 0 microversion: 2.1 time: 0.253414 Oct 05 17:51:43.928832 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2294/4300] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:51:43 2022] DELETE /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:51:43.929948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-11f3193f-59d1-48d2-8e9e-00117f95c4ba tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:43.930826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-11f3193f-59d1-48d2-8e9e-00117f95c4ba tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:43.938078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11f3193f-59d1-48d2-8e9e-00117f95c4ba tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:43.938988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11f3193f-59d1-48d2-8e9e-00117f95c4ba tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:43.939573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11f3193f-59d1-48d2-8e9e-00117f95c4ba tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:43.940397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11f3193f-59d1-48d2-8e9e-00117f95c4ba tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:43.941791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11f3193f-59d1-48d2-8e9e-00117f95c4ba tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:43.942874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11f3193f-59d1-48d2-8e9e-00117f95c4ba tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:44.419700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:44.434706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:44.436467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:44.440677 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9f7d3f3b-7aba-48ef-b929-971ff208b292 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1335 microversion: 2.54 time: 0.756531 Oct 05 17:51:44.441672 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2007/4301] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:43 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1335 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:44.471606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b2dac0d2-ae45-41af-b565-8476125b4595 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:44.479282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b2dac0d2-ae45-41af-b565-8476125b4595 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:44.501268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2dac0d2-ae45-41af-b565-8476125b4595 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:44.504357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2dac0d2-ae45-41af-b565-8476125b4595 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:44.507171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2dac0d2-ae45-41af-b565-8476125b4595 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:44.509572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2dac0d2-ae45-41af-b565-8476125b4595 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:44.510661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2dac0d2-ae45-41af-b565-8476125b4595 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:44.511352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2dac0d2-ae45-41af-b565-8476125b4595 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:44.910599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11f3193f-59d1-48d2-8e9e-00117f95c4ba tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:44.939383 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-11f3193f-59d1-48d2-8e9e-00117f95c4ba tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 1.013553 Oct 05 17:51:44.940360 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2295/4302] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:43 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:44.948849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:44.949521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: 306c41c5-0f1e-4812-a54d-c31fc031c7d1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:44.964642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:44.965484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:44.966751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:44.968154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:44.968780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:44.969947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:44.987256 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] HTTP exception thrown: Instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 could not be found. Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Request method failure captured: Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 HTTP/1.1 Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcMOAOpdE63X8OhW4wsEy2crLrx01LtQ-rp_0wT7KyP_snq49RBe9pW2rDXvGDquoPS8xWknsOpVRp2diM1zITKhR01lPNUgSkUsWER9laVmknlwDrrF_SZj9lTxUjYcrefuqCr0JxKMwpc1ouYu8vVwbNWydS37cc_WZDK5JdlZgNU Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/caf452f31a594c888e1703356c637a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_caf452f31a594c888e1703356c637a91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}] Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 50b3fb554dd64e41bea1109e697b0799 Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 could not be found. Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '306c41c5-0f1e-4812-a54d-c31fc031c7d1'} Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 could not be found. Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 could not be found. Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:44.989532 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:44.993599 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:44.993599 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:44.993599 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:44.993599 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:44.993599 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:51:44.993599 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:51:44.993599 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 could not be found. Oct 05 17:51:44.993599 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:44.995880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Returning 404 to user: Instance 306c41c5-0f1e-4812-a54d-c31fc031c7d1 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:44.997939 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3335e331-886b-4aef-a8d5-659d70f82f2c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1" status: 404 len: 111 microversion: 2.1 time: 0.054958 Oct 05 17:51:45.002242 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2296/4303] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:44 2022] GET /compute/v2.1/servers/306c41c5-0f1e-4812-a54d-c31fc031c7d1 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:51:45.008018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c753a5dc-a004-4148-8d2d-e470e1f00e7d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:45.009516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c753a5dc-a004-4148-8d2d-e470e1f00e7d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:45.024223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c753a5dc-a004-4148-8d2d-e470e1f00e7d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:45.024906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c753a5dc-a004-4148-8d2d-e470e1f00e7d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:45.025422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c753a5dc-a004-4148-8d2d-e470e1f00e7d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:45.029672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2dac0d2-ae45-41af-b565-8476125b4595 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:45.037898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c753a5dc-a004-4148-8d2d-e470e1f00e7d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:45.039447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c753a5dc-a004-4148-8d2d-e470e1f00e7d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:45.041779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c753a5dc-a004-4148-8d2d-e470e1f00e7d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:45.042009 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b2dac0d2-ae45-41af-b565-8476125b4595 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1670 microversion: 2.1 time: 0.597656 Oct 05 17:51:45.044100 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2008/4304] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:44 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1670 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:45.055367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-99fc3f36-a370-46b3-9417-bc77c4fa48bc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '.version_select at 0x7f777966bdc0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:45.108811 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-99fc3f36-a370-46b3-9417-bc77c4fa48bc tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533695263" status: 202 len: 0 microversion: 2.1 time: 0.063224 Oct 05 17:51:45.115246 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2009/4305] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 17:51:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1533695263 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:51:45.474073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:45.474717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:45.490319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:45.490836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:45.491296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:45.493298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:45.493931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:45.494582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:45.814684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:45.828629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:45.835576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:45.846511 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-df7cff03-4c05-4614-a042-ea7149bd758d tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1335 microversion: 2.54 time: 0.369432 Oct 05 17:51:45.847554 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2010/4306] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:45 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1335 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:45.978047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d7a8b774-700a-4bc7-9238-92a60fe11a4e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:45.979343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d7a8b774-700a-4bc7-9238-92a60fe11a4e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:45.997138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7a8b774-700a-4bc7-9238-92a60fe11a4e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:45.997910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7a8b774-700a-4bc7-9238-92a60fe11a4e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:45.998675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7a8b774-700a-4bc7-9238-92a60fe11a4e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:46.001902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7a8b774-700a-4bc7-9238-92a60fe11a4e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:46.002864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7a8b774-700a-4bc7-9238-92a60fe11a4e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:46.004188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7a8b774-700a-4bc7-9238-92a60fe11a4e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:46.071693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c753a5dc-a004-4148-8d2d-e470e1f00e7d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:46.094756 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c753a5dc-a004-4148-8d2d-e470e1f00e7d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1317 microversion: 2.1 time: 1.090991 Oct 05 17:51:46.095683 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2297/4307] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:45 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1317 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:46.105000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-286a53eb-7263-4b7a-a7e4-cc6939548c09 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:46.106005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-286a53eb-7263-4b7a-a7e4-cc6939548c09 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:46.119120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-286a53eb-7263-4b7a-a7e4-cc6939548c09 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:46.119737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-286a53eb-7263-4b7a-a7e4-cc6939548c09 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:46.120182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-286a53eb-7263-4b7a-a7e4-cc6939548c09 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:46.120897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-286a53eb-7263-4b7a-a7e4-cc6939548c09 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:46.122540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-286a53eb-7263-4b7a-a7e4-cc6939548c09 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:46.122997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-286a53eb-7263-4b7a-a7e4-cc6939548c09 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:46.272562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d7a8b774-700a-4bc7-9238-92a60fe11a4e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:46.285025 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d7a8b774-700a-4bc7-9238-92a60fe11a4e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.322655 Oct 05 17:51:46.300252 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2011/4308] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:45 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:46.481624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-286a53eb-7263-4b7a-a7e4-cc6939548c09 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:46.493413 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-286a53eb-7263-4b7a-a7e4-cc6939548c09 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1670 microversion: 2.1 time: 0.396374 Oct 05 17:51:46.508247 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2298/4309] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:46 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1670 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:46.879311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:46.879945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:46.891549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:46.892791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:46.893745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:46.894991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:46.895622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:46.896615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:47.120525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3e684838-f7aa-4300-ab81-9aee8c7bed9d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:47.121825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3e684838-f7aa-4300-ab81-9aee8c7bed9d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:47.131306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e684838-f7aa-4300-ab81-9aee8c7bed9d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:47.132451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e684838-f7aa-4300-ab81-9aee8c7bed9d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:47.132967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e684838-f7aa-4300-ab81-9aee8c7bed9d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:47.134547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e684838-f7aa-4300-ab81-9aee8c7bed9d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:47.135092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e684838-f7aa-4300-ab81-9aee8c7bed9d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:47.135587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e684838-f7aa-4300-ab81-9aee8c7bed9d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:47.186219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:47.198175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:47.199688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:47.200964 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-272ceb8c-e2f2-4785-b444-cbe2b82cb0c4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1335 microversion: 2.54 time: 0.328849 Oct 05 17:51:47.217824 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2012/4310] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:46 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1335 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:47.314192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6619a536-4a72-4c8b-9945-b944a4182e9c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:47.314956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6619a536-4a72-4c8b-9945-b944a4182e9c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:47.339634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6619a536-4a72-4c8b-9945-b944a4182e9c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:47.342143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6619a536-4a72-4c8b-9945-b944a4182e9c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:47.343002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6619a536-4a72-4c8b-9945-b944a4182e9c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:47.347996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6619a536-4a72-4c8b-9945-b944a4182e9c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:47.348723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6619a536-4a72-4c8b-9945-b944a4182e9c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:47.349351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6619a536-4a72-4c8b-9945-b944a4182e9c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:47.426832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3e684838-f7aa-4300-ab81-9aee8c7bed9d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:47.436638 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3e684838-f7aa-4300-ab81-9aee8c7bed9d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1317 microversion: 2.1 time: 0.323075 Oct 05 17:51:47.438892 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2299/4311] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:47 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:47.523555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e7da349d-bf27-4c53-9cee-1ea5c7bcc448 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:47.524179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e7da349d-bf27-4c53-9cee-1ea5c7bcc448 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:47.539281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7da349d-bf27-4c53-9cee-1ea5c7bcc448 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:47.540046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7da349d-bf27-4c53-9cee-1ea5c7bcc448 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:47.540630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7da349d-bf27-4c53-9cee-1ea5c7bcc448 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:47.541511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7da349d-bf27-4c53-9cee-1ea5c7bcc448 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:47.542162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7da349d-bf27-4c53-9cee-1ea5c7bcc448 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:47.542761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7da349d-bf27-4c53-9cee-1ea5c7bcc448 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:47.635570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:47.738237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e7da349d-bf27-4c53-9cee-1ea5c7bcc448 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:47.757136 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e7da349d-bf27-4c53-9cee-1ea5c7bcc448 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1670 microversion: 2.1 time: 0.241466 Oct 05 17:51:47.763788 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2300/4312] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:47 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:48.072751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:48.160659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6619a536-4a72-4c8b-9945-b944a4182e9c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:48.170735 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6619a536-4a72-4c8b-9945-b944a4182e9c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.865565 Oct 05 17:51:48.171775 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2013/4313] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:47 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:48.228023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:48.228573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:48.245057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:48.245815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:48.250575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:48.254694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:48.255518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:48.256175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:48.356071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:48.367039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:48.369104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:48.370570 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d9e799ca-30cc-4a10-bf19-367f270a9985 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1356 microversion: 2.54 time: 0.146554 Oct 05 17:51:48.386919 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2301/4314] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:48 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:48.399633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e51ab24d-5265-4858-aa31-c47ba0fc5d8a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Action: 'create', calling method: .version_select at 0x7f7775af19d0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-286319029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJaC+XMb7RwvN9739tyBXLIbQE29I5f7NmJTIqIdEqMACQ6uG744ihSjKUOOS6DexJJu350mdNG2ez5fFxOEoB9KCboXST/pVWe08sl18TWoAkScACm1cho2KwMvkRD5w=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:48.420725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e51ab24d-5265-4858-aa31-c47ba0fc5d8a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Getting quotas for project 6026cfbf11d644a5ac3fb3b3346ced0e. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:51:48.427420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-e51ab24d-5265-4858-aa31-c47ba0fc5d8a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Getting quotas for user 121e857ad87945c087137f591fa1c7f5 and project 6026cfbf11d644a5ac3fb3b3346ced0e. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:51:48.460528 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e51ab24d-5265-4858-aa31-c47ba0fc5d8a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.065088 Oct 05 17:51:48.461795 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2014/4315] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Oct 5 17:51:48 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 67 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 17:51:48.467962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ed9837d-ba38-4d20-974a-538ed45298f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:48.469143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ed9837d-ba38-4d20-974a-538ed45298f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:48.476340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed9837d-ba38-4d20-974a-538ed45298f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:48.477068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed9837d-ba38-4d20-974a-538ed45298f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:48.477662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed9837d-ba38-4d20-974a-538ed45298f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:48.478558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed9837d-ba38-4d20-974a-538ed45298f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:48.479490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed9837d-ba38-4d20-974a-538ed45298f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:48.480210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed9837d-ba38-4d20-974a-538ed45298f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:48.482117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-286319029", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:48.491555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:48.502659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:48.503760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:48.504533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:48.505794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:48.506516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:48.507419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:48.683781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:51:48.684205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:51:48.684683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:51:48.685302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:51:48.685722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:51:48.699719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5ed9837d-ba38-4d20-974a-538ed45298f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:48.710410 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ed9837d-ba38-4d20-974a-538ed45298f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1317 microversion: 2.1 time: 0.252588 Oct 05 17:51:48.711666 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2302/4316] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:48 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:48.794548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb2d478e-be90-4677-93b1-8d0b9788358b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:48.797883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb2d478e-be90-4677-93b1-8d0b9788358b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:48.811901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:48.814802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb2d478e-be90-4677-93b1-8d0b9788358b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:48.820261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb2d478e-be90-4677-93b1-8d0b9788358b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:48.821208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb2d478e-be90-4677-93b1-8d0b9788358b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:48.822201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb2d478e-be90-4677-93b1-8d0b9788358b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:48.823147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb2d478e-be90-4677-93b1-8d0b9788358b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:48.823799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb2d478e-be90-4677-93b1-8d0b9788358b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:48.859934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:48.875420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:48.875420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:48.875703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:48.876430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:48.876894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:48.877321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:48.960962 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fff04f8c-6348-4165-ae6b-bf7d425599f0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "POST /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364/action" status: 202 len: 1138 microversion: 2.54 time: 0.491894 Oct 05 17:51:48.966222 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2015/4317] 10.222.0.70 () {62 vars in 1320 bytes} [Wed Oct 5 17:51:48 2022] POST /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364/action => generated 1138 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 05 17:51:48.989570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:49.001392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:49.008294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:49.008991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:49.009594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:49.010521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:49.014827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:49.015478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:49.294882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fb2d478e-be90-4677-93b1-8d0b9788358b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:49.314601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb2d478e-be90-4677-93b1-8d0b9788358b tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1670 microversion: 2.1 time: 0.529038 Oct 05 17:51:49.317903 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2303/4318] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:48 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1670 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:49.330088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-14c821b9-4270-41a4-928d-52d4585d6335 req-e008bb75-99a2-46d7-8d17-8af6ae08f5ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "048ef2f6-9aa3-4c95-ad02-641dbc67680c", "tag": "537edeaa-e0fc-471d-b966-0beb77f35cab"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:49.358164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-14c821b9-4270-41a4-928d-52d4585d6335 req-e008bb75-99a2-46d7-8d17-8af6ae08f5ac service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:49.358890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-14c821b9-4270-41a4-928d-52d4585d6335 req-e008bb75-99a2-46d7-8d17-8af6ae08f5ac service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:49.359546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-14c821b9-4270-41a4-928d-52d4585d6335 req-e008bb75-99a2-46d7-8d17-8af6ae08f5ac service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:49.375249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:49.383478 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-14c821b9-4270-41a4-928d-52d4585d6335 req-e008bb75-99a2-46d7-8d17-8af6ae08f5ac service nova] Creating event network-changed:537edeaa-e0fc-471d-b966-0beb77f35cab for instance 048ef2f6-9aa3-4c95-ad02-641dbc67680c on n-h2-835595-3 Oct 05 17:51:49.390694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:49.391436 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-14c821b9-4270-41a4-928d-52d4585d6335 req-e008bb75-99a2-46d7-8d17-8af6ae08f5ac service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070240 Oct 05 17:51:49.393635 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2304/4319] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:49.396600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:49.398124 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-54ac4675-27e9-4a90-acdd-16b0ed2df739 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.412987 Oct 05 17:51:49.402764 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2016/4320] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:48 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:49.403470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d39ab4c-a113-4a79-bbc0-c1852623b269 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:49.404674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d39ab4c-a113-4a79-bbc0-c1852623b269 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:49.424060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d39ab4c-a113-4a79-bbc0-c1852623b269 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:49.424573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d39ab4c-a113-4a79-bbc0-c1852623b269 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:49.426247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d39ab4c-a113-4a79-bbc0-c1852623b269 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:49.427027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d39ab4c-a113-4a79-bbc0-c1852623b269 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:49.428046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d39ab4c-a113-4a79-bbc0-c1852623b269 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:49.429278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d39ab4c-a113-4a79-bbc0-c1852623b269 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:49.738717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3204d1ea-8f98-4318-b3bf-e12afe7b69d0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:49.739646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3204d1ea-8f98-4318-b3bf-e12afe7b69d0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:49.752540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3204d1ea-8f98-4318-b3bf-e12afe7b69d0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:49.755215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3204d1ea-8f98-4318-b3bf-e12afe7b69d0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:49.755856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3204d1ea-8f98-4318-b3bf-e12afe7b69d0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:49.756754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3204d1ea-8f98-4318-b3bf-e12afe7b69d0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:49.759015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3204d1ea-8f98-4318-b3bf-e12afe7b69d0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:49.759639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3204d1ea-8f98-4318-b3bf-e12afe7b69d0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:49.820006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d39ab4c-a113-4a79-bbc0-c1852623b269 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:49.832161 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d39ab4c-a113-4a79-bbc0-c1852623b269 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.434138 Oct 05 17:51:49.853666 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2305/4321] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:49 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:50.347867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3204d1ea-8f98-4318-b3bf-e12afe7b69d0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:50.349896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79cc0cda-281d-4040-a68c-ac264022abd4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:50.351946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-79cc0cda-281d-4040-a68c-ac264022abd4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:50.356706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:50.356877 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3204d1ea-8f98-4318-b3bf-e12afe7b69d0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1317 microversion: 2.1 time: 0.622064 Oct 05 17:51:50.360730 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2017/4322] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:49 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:50.387093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cc0cda-281d-4040-a68c-ac264022abd4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:50.388054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cc0cda-281d-4040-a68c-ac264022abd4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:50.392003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cc0cda-281d-4040-a68c-ac264022abd4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:50.393124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cc0cda-281d-4040-a68c-ac264022abd4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:50.395501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cc0cda-281d-4040-a68c-ac264022abd4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:50.397441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79cc0cda-281d-4040-a68c-ac264022abd4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:50.429954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:50.430620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:50.448463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:50.455527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:50.456044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:50.456805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:50.457286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:50.457712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:50.743174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79cc0cda-281d-4040-a68c-ac264022abd4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:50.752317 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79cc0cda-281d-4040-a68c-ac264022abd4 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1670 microversion: 2.1 time: 0.409488 Oct 05 17:51:50.775592 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2306/4323] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:50 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1670 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:50.815137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:50.830428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:50.831868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:50.833060 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed194fab-7e3f-4f8d-b666-1f0fecc970dc tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.407563 Oct 05 17:51:50.833641 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2018/4324] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:50 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:50.860716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9eb50abd-4516-4dae-8e8b-0c47b2562eab tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:50.861665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9eb50abd-4516-4dae-8e8b-0c47b2562eab tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:50.876599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eb50abd-4516-4dae-8e8b-0c47b2562eab tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:50.877297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eb50abd-4516-4dae-8e8b-0c47b2562eab tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:50.877917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eb50abd-4516-4dae-8e8b-0c47b2562eab tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:50.878820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eb50abd-4516-4dae-8e8b-0c47b2562eab tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:50.879430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eb50abd-4516-4dae-8e8b-0c47b2562eab tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:50.880035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9eb50abd-4516-4dae-8e8b-0c47b2562eab tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:51.134919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9eb50abd-4516-4dae-8e8b-0c47b2562eab tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:51.143632 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9eb50abd-4516-4dae-8e8b-0c47b2562eab tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.286782 Oct 05 17:51:51.149145 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2307/4325] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:50 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:51.395621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb5eba0e-c215-40a7-a798-ddfacdb9eef4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:51.397553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eb5eba0e-c215-40a7-a798-ddfacdb9eef4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:51.416092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb5eba0e-c215-40a7-a798-ddfacdb9eef4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:51.416874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb5eba0e-c215-40a7-a798-ddfacdb9eef4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:51.417485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb5eba0e-c215-40a7-a798-ddfacdb9eef4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:51.418838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb5eba0e-c215-40a7-a798-ddfacdb9eef4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:51.419454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb5eba0e-c215-40a7-a798-ddfacdb9eef4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:51.420032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb5eba0e-c215-40a7-a798-ddfacdb9eef4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:51.785136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0de057d9-7277-4133-b4d1-a3196e0a71ca tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:51.785870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0de057d9-7277-4133-b4d1-a3196e0a71ca tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:51.787661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:51.805923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de057d9-7277-4133-b4d1-a3196e0a71ca tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:51.806724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de057d9-7277-4133-b4d1-a3196e0a71ca tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:51.807386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de057d9-7277-4133-b4d1-a3196e0a71ca tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:51.808250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de057d9-7277-4133-b4d1-a3196e0a71ca tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:51.808861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de057d9-7277-4133-b4d1-a3196e0a71ca tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:51.809437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de057d9-7277-4133-b4d1-a3196e0a71ca tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:51.897866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0de057d9-7277-4133-b4d1-a3196e0a71ca tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:51.913901 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0de057d9-7277-4133-b4d1-a3196e0a71ca tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1602 microversion: 2.1 time: 0.132583 Oct 05 17:51:51.930464 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2308/4326] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:51 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1602 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:51.936781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:51.937384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:51.944296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:51.944830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:51.945266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:51.945971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:51.946647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:51.947228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:52.131164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:52.140526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:52.142081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:52.144454 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3e9c9194-b6ef-4dfe-960a-5649853dc2c1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.212830 Oct 05 17:51:52.148264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb5eba0e-c215-40a7-a798-ddfacdb9eef4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:52.151878 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2309/4327] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:51 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:52.162422 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb5eba0e-c215-40a7-a798-ddfacdb9eef4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1317 microversion: 2.1 time: 0.782056 Oct 05 17:51:52.162422 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2019/4328] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:51 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1317 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:52.184887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a81d636d-27e9-4166-a586-defb2627ff1e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:52.189401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a81d636d-27e9-4166-a586-defb2627ff1e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:52.201645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81d636d-27e9-4166-a586-defb2627ff1e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:52.202157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81d636d-27e9-4166-a586-defb2627ff1e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:52.202649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81d636d-27e9-4166-a586-defb2627ff1e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:52.203354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81d636d-27e9-4166-a586-defb2627ff1e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:52.203871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81d636d-27e9-4166-a586-defb2627ff1e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:52.204874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a81d636d-27e9-4166-a586-defb2627ff1e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:52.497746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a81d636d-27e9-4166-a586-defb2627ff1e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:52.511464 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a81d636d-27e9-4166-a586-defb2627ff1e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.346636 Oct 05 17:51:52.526376 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2310/4329] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:52 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:52.937400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f987068e-4b20-4ef5-8250-231e68ec567e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:52.938072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f987068e-4b20-4ef5-8250-231e68ec567e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:52.943395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:52.951359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f987068e-4b20-4ef5-8250-231e68ec567e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:52.954616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f987068e-4b20-4ef5-8250-231e68ec567e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:52.955147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f987068e-4b20-4ef5-8250-231e68ec567e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:52.956064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f987068e-4b20-4ef5-8250-231e68ec567e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:52.956592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f987068e-4b20-4ef5-8250-231e68ec567e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:52.962782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f987068e-4b20-4ef5-8250-231e68ec567e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:53.180860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:53.182134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:53.192183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:53.194804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:53.204978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:53.205830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:53.206424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:53.206952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:53.251137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:53.359639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f987068e-4b20-4ef5-8250-231e68ec567e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:53.373103 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f987068e-4b20-4ef5-8250-231e68ec567e tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1602 microversion: 2.1 time: 0.438140 Oct 05 17:51:53.378261 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2020/4330] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:52 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1602 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:53.393860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-be4be147-9536-45d4-bf46-e403817da7d9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:53.397432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-be4be147-9536-45d4-bf46-e403817da7d9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:53.415016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4be147-9536-45d4-bf46-e403817da7d9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:53.415758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4be147-9536-45d4-bf46-e403817da7d9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:53.417358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4be147-9536-45d4-bf46-e403817da7d9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:53.419638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4be147-9536-45d4-bf46-e403817da7d9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:53.421548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4be147-9536-45d4-bf46-e403817da7d9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:53.422155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4be147-9536-45d4-bf46-e403817da7d9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:53.527020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:53.554920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:53.566947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:53.569486 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f52e3230-3f95-4b2e-9751-cccaf23acca0 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.391326 Oct 05 17:51:53.569486 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2311/4331] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:53 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:53.580076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6f9bcde6-a03c-4b22-a147-8f82749077a7 req-c9db0ba3-41a8-4395-a33b-3e6840a4fe34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c8dfe89-5f6e-4166-83c3-752427e390a7", "name": "network-vif-deleted", "tag": "26bf0817-b57b-4c96-9c76-ea5de5ba9796"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:53.595955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6f9bcde6-a03c-4b22-a147-8f82749077a7 req-c9db0ba3-41a8-4395-a33b-3e6840a4fe34 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:53.596790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6f9bcde6-a03c-4b22-a147-8f82749077a7 req-c9db0ba3-41a8-4395-a33b-3e6840a4fe34 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:53.598533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6f9bcde6-a03c-4b22-a147-8f82749077a7 req-c9db0ba3-41a8-4395-a33b-3e6840a4fe34 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:53.638053 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6f9bcde6-a03c-4b22-a147-8f82749077a7 req-c9db0ba3-41a8-4395-a33b-3e6840a4fe34 service nova] Creating event network-vif-deleted:26bf0817-b57b-4c96-9c76-ea5de5ba9796 for instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 on n-h1-835595-3 Oct 05 17:51:53.653482 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6f9bcde6-a03c-4b22-a147-8f82749077a7 req-c9db0ba3-41a8-4395-a33b-3e6840a4fe34 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075922 Oct 05 17:51:53.655484 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2312/4332] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:53.671332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-28205636-3998-46da-a682-bf8d979889f3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:53.673055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-28205636-3998-46da-a682-bf8d979889f3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:53.692164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28205636-3998-46da-a682-bf8d979889f3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:53.693326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28205636-3998-46da-a682-bf8d979889f3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:53.695640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28205636-3998-46da-a682-bf8d979889f3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:53.697667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28205636-3998-46da-a682-bf8d979889f3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:53.698919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28205636-3998-46da-a682-bf8d979889f3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:53.700118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28205636-3998-46da-a682-bf8d979889f3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:54.158627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-28205636-3998-46da-a682-bf8d979889f3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:54.168140 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-28205636-3998-46da-a682-bf8d979889f3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.509699 Oct 05 17:51:54.173129 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2313/4333] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:53 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:54.241525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-be4be147-9536-45d4-bf46-e403817da7d9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:54.252136 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-be4be147-9536-45d4-bf46-e403817da7d9 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1317 microversion: 2.1 time: 0.872437 Oct 05 17:51:54.259267 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2021/4334] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:53 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1317 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:54.401232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:54.401998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:54.416204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:54.418209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:54.420584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:54.421466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:54.423435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:54.424651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:54.539197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:54.540357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:54.541109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:54.542159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lazy-loading 'fault' on Instance uuid 7c8dfe89-5f6e-4166-83c3-752427e390a7 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:51:54.599037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:54.599649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:54.610679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:54.611637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:54.612283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:54.615354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:54.616041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:54.618026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:54.683911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418f5619d2f543d98e874a0c48e81d52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4220fd6f904e36ada64a2b5f3bf524', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:54.695461 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cc267719-bf8d-4964-bbdb-81b8a285dee0 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 200 len: 1325 microversion: 2.1 time: 0.296043 Oct 05 17:51:54.699923 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2314/4335] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:54 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 1325 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:54.822460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:54.834730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:54.841018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:54.844238 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c2057a95-7659-4bcf-b874-9ee84e6883c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.249974 Oct 05 17:51:54.849780 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2022/4336] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:54 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:55.212904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-55beb0de-ce4c-44f8-977a-78862454c466 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:55.215042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-55beb0de-ce4c-44f8-977a-78862454c466 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:55.228473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55beb0de-ce4c-44f8-977a-78862454c466 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:55.229345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55beb0de-ce4c-44f8-977a-78862454c466 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:55.229956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55beb0de-ce4c-44f8-977a-78862454c466 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:55.231217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55beb0de-ce4c-44f8-977a-78862454c466 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:55.231987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55beb0de-ce4c-44f8-977a-78862454c466 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:55.232578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55beb0de-ce4c-44f8-977a-78862454c466 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:55.282626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fb5b2541-a890-4be4-b6fe-1564021bf8d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:55.283557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fb5b2541-a890-4be4-b6fe-1564021bf8d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:55.300909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb5b2541-a890-4be4-b6fe-1564021bf8d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:55.302655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb5b2541-a890-4be4-b6fe-1564021bf8d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:55.316616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb5b2541-a890-4be4-b6fe-1564021bf8d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:55.325080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb5b2541-a890-4be4-b6fe-1564021bf8d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:55.325695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb5b2541-a890-4be4-b6fe-1564021bf8d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:55.326911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb5b2541-a890-4be4-b6fe-1564021bf8d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:55.334641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:55.635822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-55beb0de-ce4c-44f8-977a-78862454c466 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:55.677329 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-55beb0de-ce4c-44f8-977a-78862454c466 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.478799 Oct 05 17:51:55.694738 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2315/4337] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:55 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:55.727414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:55.728053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:55.740111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:55.741250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:55.742963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:55.744000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:55.744874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:55.745532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:55.751145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fb5b2541-a890-4be4-b6fe-1564021bf8d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:55.762853 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fb5b2541-a890-4be4-b6fe-1564021bf8d4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1317 microversion: 2.1 time: 0.487000 Oct 05 17:51:55.779111 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2023/4338] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:55 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1317 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:55.805947 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] HTTP exception thrown: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Request method failure captured: Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 HTTP/1.1 Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcK5oMBjHiudjf7LHriEDEXcKhHOF8QjbltWzRFEVZoTN3IpQ3n_sL0fDG8FbtsTKiaeY8HcTuKzSraQm0Ef92X9oeNRaFg-JPMBuk3lEYyzi41lyLNK-G7bmPf0K1Yc4av0zJlaVFRVDg0PJbRyYOdl5wvP7qN8tKxZlKX6dpLvihg Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ee4220fd6f904e36ada64a2b5f3bf524", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}] Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 418f5619d2f543d98e874a0c48e81d52 Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '7c8dfe89-5f6e-4166-83c3-752427e390a7'} Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:51:55.808180 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:55.814007 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:51:55.814007 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:51:55.814007 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:51:55.814007 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:51:55.814007 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:51:55.814007 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:51:55.814007 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:51:55.817150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Returning 404 to user: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:51:55.818718 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1cbe3364-705e-4498-a369-3ecc8c6fe152 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 404 len: 111 microversion: 2.1 time: 0.097048 Oct 05 17:51:55.820169 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2316/4339] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:55 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:51:55.829918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1b6d8ea4-56ce-4225-9ed2-a718d25ac6e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '.version_select at 0x7f7775995b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:55.872773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:55.874063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:55.887081 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1b6d8ea4-56ce-4225-9ed2-a718d25ac6e9 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-645054697" status: 202 len: 0 microversion: 2.1 time: 0.057351 Oct 05 17:51:55.889274 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2024/4340] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 17:51:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-645054697 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:51:55.894725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:55.898673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:55.899618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:55.900394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:55.901586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:55.912844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:56.213640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6b372f41-0446-4e8c-a59b-6f0a6075fb36 req-e5f03a2c-f8e5-4cde-a965-0522905a4611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048ef2f6-9aa3-4c95-ad02-641dbc67680c", "name": "network-vif-plugged", "status": "completed", "tag": "537edeaa-e0fc-471d-b966-0beb77f35cab"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:56.242145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6b372f41-0446-4e8c-a59b-6f0a6075fb36 req-e5f03a2c-f8e5-4cde-a965-0522905a4611 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:56.244937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6b372f41-0446-4e8c-a59b-6f0a6075fb36 req-e5f03a2c-f8e5-4cde-a965-0522905a4611 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:56.246740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6b372f41-0446-4e8c-a59b-6f0a6075fb36 req-e5f03a2c-f8e5-4cde-a965-0522905a4611 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:56.265177 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6b372f41-0446-4e8c-a59b-6f0a6075fb36 req-e5f03a2c-f8e5-4cde-a965-0522905a4611 service nova] Creating event network-vif-plugged:537edeaa-e0fc-471d-b966-0beb77f35cab for instance 048ef2f6-9aa3-4c95-ad02-641dbc67680c on n-h2-835595-3 Oct 05 17:51:56.282886 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6b372f41-0446-4e8c-a59b-6f0a6075fb36 req-e5f03a2c-f8e5-4cde-a965-0522905a4611 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076219 Oct 05 17:51:56.286389 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2025/4341] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:51:56.327363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:56.355745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:56.362505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:56.368292 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9425b9cd-af8f-4cee-b6c1-be6b135f4d09 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.498320 Oct 05 17:51:56.369408 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2317/4342] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:55 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:51:56.476901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-61fbe507-88ae-4190-b3c8-09d9eef44bcd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:56.477548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-61fbe507-88ae-4190-b3c8-09d9eef44bcd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:56.488135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fbe507-88ae-4190-b3c8-09d9eef44bcd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:56.489472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fbe507-88ae-4190-b3c8-09d9eef44bcd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:56.489948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fbe507-88ae-4190-b3c8-09d9eef44bcd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:56.494141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fbe507-88ae-4190-b3c8-09d9eef44bcd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:56.495587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fbe507-88ae-4190-b3c8-09d9eef44bcd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:56.496040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fbe507-88ae-4190-b3c8-09d9eef44bcd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:56.566411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-61fbe507-88ae-4190-b3c8-09d9eef44bcd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:51:56.703418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-532fc9ae-2e47-4730-a8f2-097762592c77 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:56.704134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-532fc9ae-2e47-4730-a8f2-097762592c77 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:56.723991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-532fc9ae-2e47-4730-a8f2-097762592c77 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:56.724528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-532fc9ae-2e47-4730-a8f2-097762592c77 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:56.724975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-532fc9ae-2e47-4730-a8f2-097762592c77 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:56.725711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-532fc9ae-2e47-4730-a8f2-097762592c77 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:56.726423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-532fc9ae-2e47-4730-a8f2-097762592c77 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:56.726858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-532fc9ae-2e47-4730-a8f2-097762592c77 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:56.815290 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-61fbe507-88ae-4190-b3c8-09d9eef44bcd tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 204 len: 0 microversion: 2.1 time: 0.342775 Oct 05 17:51:56.817220 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2026/4343] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:51:56 2022] DELETE /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:51:56.833014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0fddeed6-c6e3-43b0-bf0e-de606bd43e6d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:56.834729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0fddeed6-c6e3-43b0-bf0e-de606bd43e6d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:56.845978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fddeed6-c6e3-43b0-bf0e-de606bd43e6d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:56.849151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fddeed6-c6e3-43b0-bf0e-de606bd43e6d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:56.849888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fddeed6-c6e3-43b0-bf0e-de606bd43e6d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:56.853720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fddeed6-c6e3-43b0-bf0e-de606bd43e6d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:56.854516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fddeed6-c6e3-43b0-bf0e-de606bd43e6d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:56.856585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0fddeed6-c6e3-43b0-bf0e-de606bd43e6d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:57.086538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-532fc9ae-2e47-4730-a8f2-097762592c77 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:57.101572 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-532fc9ae-2e47-4730-a8f2-097762592c77 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.401833 Oct 05 17:51:57.102199 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2318/4344] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:56 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:51:57.118157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25340820-c3f6-403e-8dc9-beb16d878f71 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:57.119060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25340820-c3f6-403e-8dc9-beb16d878f71 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:57.139418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25340820-c3f6-403e-8dc9-beb16d878f71 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:57.139865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25340820-c3f6-403e-8dc9-beb16d878f71 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:57.140317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25340820-c3f6-403e-8dc9-beb16d878f71 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:57.159612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25340820-c3f6-403e-8dc9-beb16d878f71 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:57.160333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25340820-c3f6-403e-8dc9-beb16d878f71 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:57.160993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25340820-c3f6-403e-8dc9-beb16d878f71 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:57.271252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0fddeed6-c6e3-43b0-bf0e-de606bd43e6d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:57.287433 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0fddeed6-c6e3-43b0-bf0e-de606bd43e6d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1317 microversion: 2.1 time: 0.468780 Oct 05 17:51:57.288263 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2027/4345] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:56 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1317 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:57.395029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:57.395646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:57.409988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:57.410518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:57.410958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:57.419137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:57.419646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:57.420090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:57.475019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25340820-c3f6-403e-8dc9-beb16d878f71 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:57.497620 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25340820-c3f6-403e-8dc9-beb16d878f71 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1508 microversion: 2.1 time: 0.391407 Oct 05 17:51:57.500622 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2319/4346] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:57 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1508 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:57.584999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:57.594180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:57.596150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:57.598484 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-619c8919-e9b2-4270-b564-ba9221b005e2 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.207545 Oct 05 17:51:57.599933 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2028/4347] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:57 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:58.125045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1871b0ad-4856-4a8e-9dd1-2c6b30f6fc73 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:58.125752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1871b0ad-4856-4a8e-9dd1-2c6b30f6fc73 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:58.142163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1871b0ad-4856-4a8e-9dd1-2c6b30f6fc73 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:58.142937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1871b0ad-4856-4a8e-9dd1-2c6b30f6fc73 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:58.143580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1871b0ad-4856-4a8e-9dd1-2c6b30f6fc73 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:58.144481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1871b0ad-4856-4a8e-9dd1-2c6b30f6fc73 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:58.144912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1871b0ad-4856-4a8e-9dd1-2c6b30f6fc73 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:58.145419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1871b0ad-4856-4a8e-9dd1-2c6b30f6fc73 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:58.315996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b73343c-7c0e-4491-9420-41606c54b708 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:58.317468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0b73343c-7c0e-4491-9420-41606c54b708 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:58.328957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b73343c-7c0e-4491-9420-41606c54b708 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:58.333509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b73343c-7c0e-4491-9420-41606c54b708 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:58.334237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b73343c-7c0e-4491-9420-41606c54b708 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:58.335252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b73343c-7c0e-4491-9420-41606c54b708 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:58.338625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b73343c-7c0e-4491-9420-41606c54b708 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:58.339373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b73343c-7c0e-4491-9420-41606c54b708 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:58.437581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:51:58.504198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1871b0ad-4856-4a8e-9dd1-2c6b30f6fc73 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:58.528806 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1871b0ad-4856-4a8e-9dd1-2c6b30f6fc73 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.401485 Oct 05 17:51:58.532361 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2320/4348] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:58 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:58.539289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e8c171a-4b20-4ca0-bd05-2b592287603a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:58.539925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e8c171a-4b20-4ca0-bd05-2b592287603a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:58.555300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e8c171a-4b20-4ca0-bd05-2b592287603a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:58.558738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e8c171a-4b20-4ca0-bd05-2b592287603a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:58.560301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e8c171a-4b20-4ca0-bd05-2b592287603a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:58.561451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e8c171a-4b20-4ca0-bd05-2b592287603a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:58.562816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e8c171a-4b20-4ca0-bd05-2b592287603a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:58.564816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e8c171a-4b20-4ca0-bd05-2b592287603a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:58.778130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e8c171a-4b20-4ca0-bd05-2b592287603a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:58.787356 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e8c171a-4b20-4ca0-bd05-2b592287603a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1508 microversion: 2.1 time: 0.253353 Oct 05 17:51:58.787457 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2321/4349] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:58 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:58.818377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:58.820125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:58.832712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:58.833207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:58.833639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:58.840158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:58.841052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:58.842975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:58.877761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0b73343c-7c0e-4491-9420-41606c54b708 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:58.887029 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0b73343c-7c0e-4491-9420-41606c54b708 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1467 microversion: 2.1 time: 0.575364 Oct 05 17:51:58.914213 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2029/4350] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:58 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1467 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:58.919414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab1e7088-a1f4-40ea-bf1a-726bdea7cf49 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:58.925676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ab1e7088-a1f4-40ea-bf1a-726bdea7cf49 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:58.942233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab1e7088-a1f4-40ea-bf1a-726bdea7cf49 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:58.945193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab1e7088-a1f4-40ea-bf1a-726bdea7cf49 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:58.945984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab1e7088-a1f4-40ea-bf1a-726bdea7cf49 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:58.949586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab1e7088-a1f4-40ea-bf1a-726bdea7cf49 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:58.951698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab1e7088-a1f4-40ea-bf1a-726bdea7cf49 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:58.952247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab1e7088-a1f4-40ea-bf1a-726bdea7cf49 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:58.962466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:58.983483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:58.985044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:58.993107 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0925fe6d-c7f8-4c80-b9bc-3316aca72533 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.193856 Oct 05 17:51:59.002359 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2322/4351] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:51:58 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:51:59.428151 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ab1e7088-a1f4-40ea-bf1a-726bdea7cf49 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1618 microversion: 2.1 time: 0.512337 Oct 05 17:51:59.430492 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2030/4352] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:58 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1618 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:51:59.558456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb1b306a-1388-4d8d-b9d4-8ff6801bd56f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:51:59.559012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb1b306a-1388-4d8d-b9d4-8ff6801bd56f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:51:59.573929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb1b306a-1388-4d8d-b9d4-8ff6801bd56f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:59.574702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb1b306a-1388-4d8d-b9d4-8ff6801bd56f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:59.575308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb1b306a-1388-4d8d-b9d4-8ff6801bd56f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:59.576211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb1b306a-1388-4d8d-b9d4-8ff6801bd56f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:51:59.592497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb1b306a-1388-4d8d-b9d4-8ff6801bd56f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:51:59.593252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb1b306a-1388-4d8d-b9d4-8ff6801bd56f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:51:59.703822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1504832329", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["a708a04f-a0cd-42d3-92d5-2f5d4dd8577b"]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:51:59.796720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:51:59.970761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fb1b306a-1388-4d8d-b9d4-8ff6801bd56f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:51:59.985866 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb1b306a-1388-4d8d-b9d4-8ff6801bd56f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.432423 Oct 05 17:51:59.998837 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2323/4353] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:59 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:00.002365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e3414b1-a854-46f0-9531-ba52ea35129d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:00.005288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0e3414b1-a854-46f0-9531-ba52ea35129d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:00.027625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e3414b1-a854-46f0-9531-ba52ea35129d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:00.028134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e3414b1-a854-46f0-9531-ba52ea35129d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:00.031018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e3414b1-a854-46f0-9531-ba52ea35129d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:00.033093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e3414b1-a854-46f0-9531-ba52ea35129d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:00.035675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e3414b1-a854-46f0-9531-ba52ea35129d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:00.038204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e3414b1-a854-46f0-9531-ba52ea35129d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:01.366054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:52:01.367082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:52:01.367897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:52:01.368326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:52:01.368750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:52:01.385848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:01.386375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:01.387494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:01.388249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:01.388711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:01.389140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:01.474885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:52:01.487184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:52:01.508169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0e3414b1-a854-46f0-9531-ba52ea35129d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:01.520411 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0e3414b1-a854-46f0-9531-ba52ea35129d tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1508 microversion: 2.1 time: 1.530734 Oct 05 17:52:01.523732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:52:01.531837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:52:01.545927 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2324/4354] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:51:59 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1508 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:01.557436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:01.558482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:01.566991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:01.567822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:01.568623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:01.569710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:01.570416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:01.571127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:01.652412 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b6e02d23-7b36-4bec-b73e-ceb483f15996 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.953114 Oct 05 17:52:01.653081 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2031/4355] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:51:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 17:52:01.658704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d79ae602-888a-4e5c-aff5-26ba0df65497 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:01.680471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d79ae602-888a-4e5c-aff5-26ba0df65497 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:01.691352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79ae602-888a-4e5c-aff5-26ba0df65497 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:01.691852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79ae602-888a-4e5c-aff5-26ba0df65497 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:01.692291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79ae602-888a-4e5c-aff5-26ba0df65497 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:01.693011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79ae602-888a-4e5c-aff5-26ba0df65497 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:01.693467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79ae602-888a-4e5c-aff5-26ba0df65497 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:01.693898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79ae602-888a-4e5c-aff5-26ba0df65497 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:01.808869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:01.848454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:01.855724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:01.858652 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ec5e5140-4fcb-4994-a8ef-a50216a1c5ec tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.311425 Oct 05 17:52:01.864526 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2325/4356] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:01 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:01.883014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-1a9744f9-e2bf-42c4-be0e-d93c9674713d req-e977fa05-21d6-4fb0-8163-dd0cb413a588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb5b7961-3ec3-477d-a023-3c8ea6931d2d", "name": "network-vif-deleted", "tag": "fbfa1a3c-3784-4cab-a410-88a06e481889"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:01.927212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1a9744f9-e2bf-42c4-be0e-d93c9674713d req-e977fa05-21d6-4fb0-8163-dd0cb413a588 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:01.928157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1a9744f9-e2bf-42c4-be0e-d93c9674713d req-e977fa05-21d6-4fb0-8163-dd0cb413a588 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:01.935281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1a9744f9-e2bf-42c4-be0e-d93c9674713d req-e977fa05-21d6-4fb0-8163-dd0cb413a588 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:02.001978 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-1a9744f9-e2bf-42c4-be0e-d93c9674713d req-e977fa05-21d6-4fb0-8163-dd0cb413a588 service nova] Creating event network-vif-deleted:fbfa1a3c-3784-4cab-a410-88a06e481889 for instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d on n-h1-835595-3 Oct 05 17:52:02.015418 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-1a9744f9-e2bf-42c4-be0e-d93c9674713d req-e977fa05-21d6-4fb0-8163-dd0cb413a588 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143466 Oct 05 17:52:02.019669 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2326/4357] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:02.039508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-94c1dca6-c78b-41cc-b59e-7c89d6890c13 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:02.053847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-94c1dca6-c78b-41cc-b59e-7c89d6890c13 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:02.235933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d79ae602-888a-4e5c-aff5-26ba0df65497 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:02.273024 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d79ae602-888a-4e5c-aff5-26ba0df65497 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.615922 Oct 05 17:52:02.278723 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2032/4358] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:01 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:02.313764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-94c1dca6-c78b-41cc-b59e-7c89d6890c13 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:02.324565 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-94c1dca6-c78b-41cc-b59e-7c89d6890c13 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1217 microversion: 2.1 time: 0.303603 Oct 05 17:52:02.329378 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2327/4359] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:02 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1217 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:02.564944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:02.566216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:02.579641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:02.583750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:02.585888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:02.590802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:02.596520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:02.598907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:02.723982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:02.728380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:02.729550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:02.731489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lazy-loading 'fault' on Instance uuid bb5b7961-3ec3-477d-a023-3c8ea6931d2d {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:52:02.869085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:02.880089 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48e5f92e-0dd2-47ec-9159-e5e08d45c592 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 200 len: 1312 microversion: 2.1 time: 0.319255 Oct 05 17:52:02.883138 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2033/4360] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:02 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 1312 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:02.903801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:02.906767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:02.918694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:02.919762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:02.920369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:02.921523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:02.922401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:02.923728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:03.230457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:03.251617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:03.259268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:03.263737 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9dd971ef-3eb6-425a-a39c-1a7bd1a5d4d4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.376381 Oct 05 17:52:03.271148 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2328/4361] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:02 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:03.301247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dbf62952-607b-479a-b96f-a477100e16f8 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:03.301866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dbf62952-607b-479a-b96f-a477100e16f8 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:03.314831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbf62952-607b-479a-b96f-a477100e16f8 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:03.320561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbf62952-607b-479a-b96f-a477100e16f8 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:03.326075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbf62952-607b-479a-b96f-a477100e16f8 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:03.327169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbf62952-607b-479a-b96f-a477100e16f8 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:03.329777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbf62952-607b-479a-b96f-a477100e16f8 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:03.330263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbf62952-607b-479a-b96f-a477100e16f8 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:03.355718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f83e7ca8-35a6-4448-8f32-ef4694eee1f4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:03.356354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f83e7ca8-35a6-4448-8f32-ef4694eee1f4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:03.370664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f83e7ca8-35a6-4448-8f32-ef4694eee1f4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:03.372104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f83e7ca8-35a6-4448-8f32-ef4694eee1f4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:03.372570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f83e7ca8-35a6-4448-8f32-ef4694eee1f4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:03.373299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f83e7ca8-35a6-4448-8f32-ef4694eee1f4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:03.373759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f83e7ca8-35a6-4448-8f32-ef4694eee1f4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:03.374185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f83e7ca8-35a6-4448-8f32-ef4694eee1f4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:03.701155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f83e7ca8-35a6-4448-8f32-ef4694eee1f4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:03.724394 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f83e7ca8-35a6-4448-8f32-ef4694eee1f4 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1213 microversion: 2.1 time: 0.372528 Oct 05 17:52:03.725577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dbf62952-607b-479a-b96f-a477100e16f8 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:03.726943 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2329/4362] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:03 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1213 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:03.734505 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dbf62952-607b-479a-b96f-a477100e16f8 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.437253 Oct 05 17:52:03.750881 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2034/4363] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:03 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:03.911721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:03.912728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: bb5b7961-3ec3-477d-a023-3c8ea6931d2d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:03.926433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:03.926912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:03.930552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:03.931477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:03.932102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:03.934327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:03.975760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] HTTP exception thrown: Instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d could not be found. Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Request method failure captured: Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d HTTP/1.1 Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcMOAOpdE63X8OhW4wsEy2crLrx01LtQ-rp_0wT7KyP_snq49RBe9pW2rDXvGDquoPS8xWknsOpVRp2diM1zITKhR01lPNUgSkUsWER9laVmknlwDrrF_SZj9lTxUjYcrefuqCr0JxKMwpc1ouYu8vVwbNWydS37cc_WZDK5JdlZgNU Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/caf452f31a594c888e1703356c637a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_caf452f31a594c888e1703356c637a91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}] Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 50b3fb554dd64e41bea1109e697b0799 Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d could not be found. Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'bb5b7961-3ec3-477d-a023-3c8ea6931d2d'} Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d could not be found. Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d could not be found. Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:03.978109 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:03.982802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:03.982802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:03.982802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:03.982802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:03.982802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:52:03.982802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:52:03.982802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d could not be found. Oct 05 17:52:03.982802 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:03.988002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Returning 404 to user: Instance bb5b7961-3ec3-477d-a023-3c8ea6931d2d could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:52:03.989812 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-249b8d91-cf6e-4bae-b35e-e3100270562c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d" status: 404 len: 111 microversion: 2.1 time: 0.083216 Oct 05 17:52:03.991311 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2330/4364] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:03 2022] GET /compute/v2.1/servers/bb5b7961-3ec3-477d-a023-3c8ea6931d2d => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:52:04.001880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bc4704df-e4dc-41e6-8e09-dfcf4881b30c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:04.002884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bc4704df-e4dc-41e6-8e09-dfcf4881b30c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:04.017810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc4704df-e4dc-41e6-8e09-dfcf4881b30c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:04.019004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc4704df-e4dc-41e6-8e09-dfcf4881b30c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:04.019688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc4704df-e4dc-41e6-8e09-dfcf4881b30c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:04.020793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc4704df-e4dc-41e6-8e09-dfcf4881b30c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:04.021858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc4704df-e4dc-41e6-8e09-dfcf4881b30c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:04.022601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc4704df-e4dc-41e6-8e09-dfcf4881b30c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:04.064057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bc4704df-e4dc-41e6-8e09-dfcf4881b30c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:52:04.220255 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bc4704df-e4dc-41e6-8e09-dfcf4881b30c tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 204 len: 0 microversion: 2.1 time: 0.223223 Oct 05 17:52:04.222096 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2035/4365] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:52:03 2022] DELETE /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:52:04.245753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-60bb3348-3b82-4126-b109-81d595cf1527 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:04.247547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-60bb3348-3b82-4126-b109-81d595cf1527 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:04.272299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60bb3348-3b82-4126-b109-81d595cf1527 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:04.272882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60bb3348-3b82-4126-b109-81d595cf1527 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:04.273334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60bb3348-3b82-4126-b109-81d595cf1527 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:04.274082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60bb3348-3b82-4126-b109-81d595cf1527 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:04.274911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60bb3348-3b82-4126-b109-81d595cf1527 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:04.280131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60bb3348-3b82-4126-b109-81d595cf1527 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:04.289291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:04.298792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:04.299803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:04.350612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:04.351132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:04.351579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:04.352305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:04.357782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:04.358594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:04.556754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:04.565499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:04.566983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:04.577070 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6fbc7359-f615-4ce1-a5dc-7b507aa0a047 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.284691 Oct 05 17:52:04.577721 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2036/4366] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:04 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:52:04.752091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a70d40a4-ffbd-4fd7-8191-1f58b1f01ece tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:04.752725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a70d40a4-ffbd-4fd7-8191-1f58b1f01ece tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:04.763532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a70d40a4-ffbd-4fd7-8191-1f58b1f01ece tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:04.768329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a70d40a4-ffbd-4fd7-8191-1f58b1f01ece tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:04.768971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a70d40a4-ffbd-4fd7-8191-1f58b1f01ece tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:04.771246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a70d40a4-ffbd-4fd7-8191-1f58b1f01ece tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:04.771725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a70d40a4-ffbd-4fd7-8191-1f58b1f01ece tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:04.772194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a70d40a4-ffbd-4fd7-8191-1f58b1f01ece tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:04.806628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-60bb3348-3b82-4126-b109-81d595cf1527 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:04.828013 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-60bb3348-3b82-4126-b109-81d595cf1527 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.600333 Oct 05 17:52:04.832124 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2331/4367] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:04 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:04.848325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bec0cf0c-4ee2-4bb5-bda1-ce7d563077e3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:04.849800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bec0cf0c-4ee2-4bb5-bda1-ce7d563077e3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:04.869669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec0cf0c-4ee2-4bb5-bda1-ce7d563077e3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:04.871495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec0cf0c-4ee2-4bb5-bda1-ce7d563077e3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:04.872542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec0cf0c-4ee2-4bb5-bda1-ce7d563077e3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:04.873667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec0cf0c-4ee2-4bb5-bda1-ce7d563077e3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:04.874961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec0cf0c-4ee2-4bb5-bda1-ce7d563077e3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:04.876873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bec0cf0c-4ee2-4bb5-bda1-ce7d563077e3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:05.037579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a70d40a4-ffbd-4fd7-8191-1f58b1f01ece tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:05.051112 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a70d40a4-ffbd-4fd7-8191-1f58b1f01ece tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1277 microversion: 2.1 time: 0.303195 Oct 05 17:52:05.067107 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2037/4368] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:04 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1277 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:05.195721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bec0cf0c-4ee2-4bb5-bda1-ce7d563077e3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:05.206886 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bec0cf0c-4ee2-4bb5-bda1-ce7d563077e3 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.372388 Oct 05 17:52:05.209299 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2332/4369] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:04 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:05.608571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:05.609552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:05.623215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:05.625489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:05.627276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:05.629121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:05.630668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:05.631872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:05.678738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:05.820660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:05.849053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:05.855285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:05.858443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d8f42050-ce8e-4908-ba07-4d282df9a683 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:05.859162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d8f42050-ce8e-4908-ba07-4d282df9a683 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:05.859298 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2a206014-d844-4cba-86fe-09d126e4fbc4 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.255746 Oct 05 17:52:05.874305 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2038/4370] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:05 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:05.874524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8f42050-ce8e-4908-ba07-4d282df9a683 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:05.874524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8f42050-ce8e-4908-ba07-4d282df9a683 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:05.875179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8f42050-ce8e-4908-ba07-4d282df9a683 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:05.881716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8f42050-ce8e-4908-ba07-4d282df9a683 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:05.881716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8f42050-ce8e-4908-ba07-4d282df9a683 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:05.881716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d8f42050-ce8e-4908-ba07-4d282df9a683 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:06.075746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a49bfda-dfc6-405a-bdd0-ca08ef3b2815 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:06.076379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a49bfda-dfc6-405a-bdd0-ca08ef3b2815 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:06.085328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a49bfda-dfc6-405a-bdd0-ca08ef3b2815 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:06.088468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a49bfda-dfc6-405a-bdd0-ca08ef3b2815 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:06.090061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a49bfda-dfc6-405a-bdd0-ca08ef3b2815 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:06.092010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a49bfda-dfc6-405a-bdd0-ca08ef3b2815 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:06.092687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a49bfda-dfc6-405a-bdd0-ca08ef3b2815 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:06.093123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a49bfda-dfc6-405a-bdd0-ca08ef3b2815 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:06.276679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6a49bfda-dfc6-405a-bdd0-ca08ef3b2815 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:06.287001 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a49bfda-dfc6-405a-bdd0-ca08ef3b2815 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1277 microversion: 2.1 time: 0.215027 Oct 05 17:52:06.287839 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2039/4371] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:06 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:06.292869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-88bc96f9-20bb-40b3-8acb-1890565fc30f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:06.293960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-88bc96f9-20bb-40b3-8acb-1890565fc30f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:06.301041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88bc96f9-20bb-40b3-8acb-1890565fc30f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:06.301871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88bc96f9-20bb-40b3-8acb-1890565fc30f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:06.302559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88bc96f9-20bb-40b3-8acb-1890565fc30f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:06.303562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88bc96f9-20bb-40b3-8acb-1890565fc30f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:06.304256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88bc96f9-20bb-40b3-8acb-1890565fc30f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:06.305050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88bc96f9-20bb-40b3-8acb-1890565fc30f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:06.521689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d8f42050-ce8e-4908-ba07-4d282df9a683 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:06.534760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d8f42050-ce8e-4908-ba07-4d282df9a683 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 0.680429 Oct 05 17:52:06.536392 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2333/4372] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:05 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:06.629469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-88bc96f9-20bb-40b3-8acb-1890565fc30f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:06.638963 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-88bc96f9-20bb-40b3-8acb-1890565fc30f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.349850 Oct 05 17:52:06.642516 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2040/4373] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:06 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:06.890815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:06.892348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:06.916644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:06.917377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:06.918544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:06.920307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:06.920991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:06.932922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:07.046227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:07.069707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:07.073762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:07.091729 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b041eb36-c8e7-4993-8ab8-56a84a730d19 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.206244 Oct 05 17:52:07.098686 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2334/4374] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:06 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:07.314516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f04b7a5-bf8c-4cf6-8c71-64c787e4980b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:07.315143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9f04b7a5-bf8c-4cf6-8c71-64c787e4980b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:07.340342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f04b7a5-bf8c-4cf6-8c71-64c787e4980b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:07.340844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f04b7a5-bf8c-4cf6-8c71-64c787e4980b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:07.341765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f04b7a5-bf8c-4cf6-8c71-64c787e4980b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:07.350101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f04b7a5-bf8c-4cf6-8c71-64c787e4980b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:07.351027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f04b7a5-bf8c-4cf6-8c71-64c787e4980b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:07.351849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f04b7a5-bf8c-4cf6-8c71-64c787e4980b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:07.566908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f04b7a5-bf8c-4cf6-8c71-64c787e4980b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:07.575376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d363557e-5ffc-40e6-9584-3741b96a6437 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:07.580300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d363557e-5ffc-40e6-9584-3741b96a6437 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:07.596028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9f04b7a5-bf8c-4cf6-8c71-64c787e4980b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1277 microversion: 2.1 time: 0.285692 Oct 05 17:52:07.601884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d363557e-5ffc-40e6-9584-3741b96a6437 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:07.602452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d363557e-5ffc-40e6-9584-3741b96a6437 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:07.603349 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2041/4375] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:07 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1277 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:07.606771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d363557e-5ffc-40e6-9584-3741b96a6437 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:07.607929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d363557e-5ffc-40e6-9584-3741b96a6437 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:07.608789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d363557e-5ffc-40e6-9584-3741b96a6437 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:07.610519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d363557e-5ffc-40e6-9584-3741b96a6437 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:07.666724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65a44973-99dc-4b33-9f03-e4b241ffe9b2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:07.667274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-65a44973-99dc-4b33-9f03-e4b241ffe9b2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:07.698503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65a44973-99dc-4b33-9f03-e4b241ffe9b2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:07.698810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65a44973-99dc-4b33-9f03-e4b241ffe9b2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:07.699267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65a44973-99dc-4b33-9f03-e4b241ffe9b2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:07.700030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65a44973-99dc-4b33-9f03-e4b241ffe9b2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:07.700493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65a44973-99dc-4b33-9f03-e4b241ffe9b2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:07.704000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65a44973-99dc-4b33-9f03-e4b241ffe9b2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:08.718941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d363557e-5ffc-40e6-9584-3741b96a6437 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:08.738564 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d363557e-5ffc-40e6-9584-3741b96a6437 tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1522 microversion: 2.1 time: 1.183181 Oct 05 17:52:08.761128 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2335/4376] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:07 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1522 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:08.770262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:08.771226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:08.786947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:08.790077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:08.790774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:08.791962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:08.795621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:08.797806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:08.900570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65a44973-99dc-4b33-9f03-e4b241ffe9b2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:08.931855 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-65a44973-99dc-4b33-9f03-e4b241ffe9b2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 1.270548 Oct 05 17:52:08.933091 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2042/4377] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:07 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:08.942633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5175c436-4a16-4492-9db9-3e9f8608cf6a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:08.943482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5175c436-4a16-4492-9db9-3e9f8608cf6a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:08.958749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5175c436-4a16-4492-9db9-3e9f8608cf6a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:08.959382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5175c436-4a16-4492-9db9-3e9f8608cf6a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:08.959912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5175c436-4a16-4492-9db9-3e9f8608cf6a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:08.960856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5175c436-4a16-4492-9db9-3e9f8608cf6a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:08.962491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5175c436-4a16-4492-9db9-3e9f8608cf6a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:08.963896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5175c436-4a16-4492-9db9-3e9f8608cf6a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:09.012038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:09.032108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:09.034134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:09.035670 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9b0c9db4-5070-4aeb-8982-fb63134b27c7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.272354 Oct 05 17:52:09.037121 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2336/4378] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:08 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:09.177833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5175c436-4a16-4492-9db9-3e9f8608cf6a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:09.194730 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5175c436-4a16-4492-9db9-3e9f8608cf6a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1275 microversion: 2.1 time: 0.254127 Oct 05 17:52:09.209930 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2043/4379] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:08 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1275 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:09.551216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-0e41e444-280e-435c-9cc6-6cd2c3fb2fea req-85dc0d2e-aa3b-408e-8570-101283080b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d037b8c8-e287-459a-a4b4-ac53b463337d", "name": "network-vif-deleted", "tag": "2a95d002-7741-4d80-9a3d-939f6d945694"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:09.578705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0e41e444-280e-435c-9cc6-6cd2c3fb2fea req-85dc0d2e-aa3b-408e-8570-101283080b69 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:09.585335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0e41e444-280e-435c-9cc6-6cd2c3fb2fea req-85dc0d2e-aa3b-408e-8570-101283080b69 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:09.585896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0e41e444-280e-435c-9cc6-6cd2c3fb2fea req-85dc0d2e-aa3b-408e-8570-101283080b69 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:09.615563 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-0e41e444-280e-435c-9cc6-6cd2c3fb2fea req-85dc0d2e-aa3b-408e-8570-101283080b69 service nova] Creating event network-vif-deleted:2a95d002-7741-4d80-9a3d-939f6d945694 for instance d037b8c8-e287-459a-a4b4-ac53b463337d on n-h2-835595-3 Oct 05 17:52:09.626097 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-0e41e444-280e-435c-9cc6-6cd2c3fb2fea req-85dc0d2e-aa3b-408e-8570-101283080b69 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078200 Oct 05 17:52:09.628358 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2337/4380] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:09.778886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:09.779728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:09.801182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:09.804267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:09.807357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:09.808427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:09.812139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:09.820164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:09.914262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:09.915021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:09.915593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:09.916200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lazy-loading 'fault' on Instance uuid d037b8c8-e287-459a-a4b4-ac53b463337d {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:52:09.958408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12aa35e6-c0e1-4d27-b37b-6cc2d209e9eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:09.960017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12aa35e6-c0e1-4d27-b37b-6cc2d209e9eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:09.977810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12aa35e6-c0e1-4d27-b37b-6cc2d209e9eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:09.978327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12aa35e6-c0e1-4d27-b37b-6cc2d209e9eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:09.978761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12aa35e6-c0e1-4d27-b37b-6cc2d209e9eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:09.980508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12aa35e6-c0e1-4d27-b37b-6cc2d209e9eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:09.982313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12aa35e6-c0e1-4d27-b37b-6cc2d209e9eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:09.983955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12aa35e6-c0e1-4d27-b37b-6cc2d209e9eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:10.083650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50b3fb554dd64e41bea1109e697b0799', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'caf452f31a594c888e1703356c637a91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:10.097986 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-22ba8ac1-16de-44e1-80a8-d669394372ea tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 200 len: 1311 microversion: 2.1 time: 0.324288 Oct 05 17:52:10.099371 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2044/4381] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:09 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 1311 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:10.111561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:10.114083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:10.129122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:10.135034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:10.136321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:10.137384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:10.138161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:10.139118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:10.312331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:10.323930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:10.333186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:10.345761 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9e9dd3fe-9852-4010-9c9b-1c59645fad02 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.236052 Oct 05 17:52:10.346961 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2045/4382] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:10 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:10.352037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f37db396-4649-4886-8d44-daa25ce31cab tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:10.355222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f37db396-4649-4886-8d44-daa25ce31cab tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:10.365540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37db396-4649-4886-8d44-daa25ce31cab tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:10.371001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37db396-4649-4886-8d44-daa25ce31cab tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:10.371725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37db396-4649-4886-8d44-daa25ce31cab tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:10.372705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37db396-4649-4886-8d44-daa25ce31cab tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:10.373977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37db396-4649-4886-8d44-daa25ce31cab tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:10.376036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f37db396-4649-4886-8d44-daa25ce31cab tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:10.529588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f37db396-4649-4886-8d44-daa25ce31cab tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:10.539901 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f37db396-4649-4886-8d44-daa25ce31cab tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1275 microversion: 2.1 time: 0.191586 Oct 05 17:52:10.545593 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2046/4383] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:10 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:10.881650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-12aa35e6-c0e1-4d27-b37b-6cc2d209e9eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:10.909100 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12aa35e6-c0e1-4d27-b37b-6cc2d209e9eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 0.955448 Oct 05 17:52:10.909739 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2338/4384] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:09 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:11.124337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:11.125601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] [instance: d037b8c8-e287-459a-a4b4-ac53b463337d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:11.137624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:11.138358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:11.142434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:11.143244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:11.143939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:11.144949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:11.179933 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] HTTP exception thrown: Instance d037b8c8-e287-459a-a4b4-ac53b463337d could not be found. Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Request method failure captured: Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d HTTP/1.1 Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcMOAOpdE63X8OhW4wsEy2crLrx01LtQ-rp_0wT7KyP_snq49RBe9pW2rDXvGDquoPS8xWknsOpVRp2diM1zITKhR01lPNUgSkUsWER9laVmknlwDrrF_SZj9lTxUjYcrefuqCr0JxKMwpc1ouYu8vVwbNWydS37cc_WZDK5JdlZgNU Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/caf452f31a594c888e1703356c637a91"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_caf452f31a594c888e1703356c637a91", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/caf452f31a594c888e1703356c637a91"}]}] Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: caf452f31a594c888e1703356c637a91 Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1651695402 Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 50b3fb554dd64e41bea1109e697b0799 Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1651695402-project Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance d037b8c8-e287-459a-a4b4-ac53b463337d could not be found. Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'd037b8c8-e287-459a-a4b4-ac53b463337d'} Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d037b8c8-e287-459a-a4b4-ac53b463337d could not be found. Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d037b8c8-e287-459a-a4b4-ac53b463337d could not be found. Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:52:11.186268 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:11.190906 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:52:11.190906 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:11.190906 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:11.190906 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:11.190906 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:52:11.190906 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:52:11.190906 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d037b8c8-e287-459a-a4b4-ac53b463337d could not be found. Oct 05 17:52:11.190906 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:52:11.192392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] Returning 404 to user: Instance d037b8c8-e287-459a-a4b4-ac53b463337d could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:52:11.193434 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-25282ad0-d521-42e4-91e3-8455503ca30a tempest-ServerRescueNegativeTestJSON-1651695402 tempest-ServerRescueNegativeTestJSON-1651695402-project] 10.222.0.70 "GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d" status: 404 len: 111 microversion: 2.1 time: 0.073304 Oct 05 17:52:11.197135 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2047/4385] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:11 2022] GET /compute/v2.1/servers/d037b8c8-e287-459a-a4b4-ac53b463337d => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:52:11.382527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:11.388726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:11.428289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:11.428789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:11.429224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:11.429934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:11.430481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:11.430909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:11.576564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9305e6f3-9660-4522-bd15-04e6bc35c975 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:11.577630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9305e6f3-9660-4522-bd15-04e6bc35c975 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:11.582720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:11.583412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:11.595050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9305e6f3-9660-4522-bd15-04e6bc35c975 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:11.598967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9305e6f3-9660-4522-bd15-04e6bc35c975 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:11.599477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9305e6f3-9660-4522-bd15-04e6bc35c975 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:11.606437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9305e6f3-9660-4522-bd15-04e6bc35c975 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:11.606992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9305e6f3-9660-4522-bd15-04e6bc35c975 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:11.607430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9305e6f3-9660-4522-bd15-04e6bc35c975 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:11.783507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:11.802445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:11.807027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:11.808194 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e68697ae-682f-4e26-af65-f7786649fa9e tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.434842 Oct 05 17:52:11.812252 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2339/4386] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:11 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:52:11.826619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:11.827169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:11.846818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:11.847563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:11.848193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:11.851369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:11.852447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:11.852902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:11.936027 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] HTTP exception thrown: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Request method failure captured: Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 HTTP/1.1 Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcK5oMBjHiudjf7LHriEDEXcKhHOF8QjbltWzRFEVZoTN3IpQ3n_sL0fDG8FbtsTKiaeY8HcTuKzSraQm0Ef92X9oeNRaFg-JPMBuk3lEYyzi41lyLNK-G7bmPf0K1Yc4av0zJlaVFRVDg0PJbRyYOdl5wvP7qN8tKxZlKX6dpLvihg Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ee4220fd6f904e36ada64a2b5f3bf524", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}] Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 418f5619d2f543d98e874a0c48e81d52 Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '7c8dfe89-5f6e-4166-83c3-752427e390a7'} Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:52:11.947092 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:52:11.952650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:11.955515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Returning 404 to user: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:52:11.962199 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f1dd97f3-d198-4636-9096-de4389814713 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 404 len: 111 microversion: 2.1 time: 0.148649 Oct 05 17:52:11.963853 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2340/4387] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:52:11 2022] DELETE /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:52:11.993013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e96c9440-6eb4-41f2-8aab-01adf0d3bd2c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:11.999268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e96c9440-6eb4-41f2-8aab-01adf0d3bd2c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:12.022845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e96c9440-6eb4-41f2-8aab-01adf0d3bd2c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:12.032002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e96c9440-6eb4-41f2-8aab-01adf0d3bd2c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:12.035269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e96c9440-6eb4-41f2-8aab-01adf0d3bd2c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:12.036416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e96c9440-6eb4-41f2-8aab-01adf0d3bd2c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:12.042139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e96c9440-6eb4-41f2-8aab-01adf0d3bd2c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:12.042981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e96c9440-6eb4-41f2-8aab-01adf0d3bd2c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:12.319773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:12.352228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9305e6f3-9660-4522-bd15-04e6bc35c975 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:12.363451 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9305e6f3-9660-4522-bd15-04e6bc35c975 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1317 microversion: 2.1 time: 0.795394 Oct 05 17:52:12.371769 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2048/4388] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:11 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1317 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:12.376902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:12.377428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 7c8dfe89-5f6e-4166-83c3-752427e390a7] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:12.397994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:12.398529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:12.398966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:12.399687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:12.405535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:12.406239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:12.461393 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] HTTP exception thrown: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Request method failure captured: Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 HTTP/1.1 Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcK5oMBjHiudjf7LHriEDEXcKhHOF8QjbltWzRFEVZoTN3IpQ3n_sL0fDG8FbtsTKiaeY8HcTuKzSraQm0Ef92X9oeNRaFg-JPMBuk3lEYyzi41lyLNK-G7bmPf0K1Yc4av0zJlaVFRVDg0PJbRyYOdl5wvP7qN8tKxZlKX6dpLvihg Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ee4220fd6f904e36ada64a2b5f3bf524", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}] Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 418f5619d2f543d98e874a0c48e81d52 Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '7c8dfe89-5f6e-4166-83c3-752427e390a7'} Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:12.478668 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:52:12.483463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:12.483463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:12.483463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:12.483463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:52:12.483463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:52:12.483463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. Oct 05 17:52:12.483463 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:52:12.495772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Returning 404 to user: Instance 7c8dfe89-5f6e-4166-83c3-752427e390a7 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:52:12.499422 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8023ec4-821d-4a33-851b-2d36ae742bee tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7" status: 404 len: 111 microversion: 2.1 time: 0.126521 Oct 05 17:52:12.513484 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2049/4389] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:12 2022] GET /compute/v2.1/servers/7c8dfe89-5f6e-4166-83c3-752427e390a7 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:52:12.843872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:12.844956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:12.861446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:12.862258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:12.862992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:12.871829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:12.872584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:12.873189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:14.013971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:14.025136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:14.029631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:14.042561 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e16bde5f-319c-4033-95ad-b4c183154669 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 1.206274 Oct 05 17:52:14.058986 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2050/4390] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:12 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:14.070453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4889460b-c557-4621-8aa4-b9895b68408c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:14.083040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4889460b-c557-4621-8aa4-b9895b68408c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:14.113481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4889460b-c557-4621-8aa4-b9895b68408c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:14.115584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4889460b-c557-4621-8aa4-b9895b68408c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:14.121534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4889460b-c557-4621-8aa4-b9895b68408c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:14.122504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4889460b-c557-4621-8aa4-b9895b68408c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:14.123266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4889460b-c557-4621-8aa4-b9895b68408c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:14.123953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4889460b-c557-4621-8aa4-b9895b68408c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:14.344629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e96c9440-6eb4-41f2-8aab-01adf0d3bd2c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:14.359135 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e96c9440-6eb4-41f2-8aab-01adf0d3bd2c tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1523 microversion: 2.1 time: 2.391132 Oct 05 17:52:14.369294 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2341/4391] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:11 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1523 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:14.820213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4889460b-c557-4621-8aa4-b9895b68408c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:14.841218 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4889460b-c557-4621-8aa4-b9895b68408c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1317 microversion: 2.1 time: 0.776911 Oct 05 17:52:14.842968 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2051/4392] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:14 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1317 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:15.077939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:15.079217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:15.102321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:15.118335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:15.125216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:15.130236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:15.136232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:15.136755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:15.389508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3639815f-79c8-465d-acbc-2a5cd40cad32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:15.390827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3639815f-79c8-465d-acbc-2a5cd40cad32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:15.409536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3639815f-79c8-465d-acbc-2a5cd40cad32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:15.417522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3639815f-79c8-465d-acbc-2a5cd40cad32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:15.417984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3639815f-79c8-465d-acbc-2a5cd40cad32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:15.418782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3639815f-79c8-465d-acbc-2a5cd40cad32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:15.419246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3639815f-79c8-465d-acbc-2a5cd40cad32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:15.419681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3639815f-79c8-465d-acbc-2a5cd40cad32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:15.733843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:15.759227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:15.764396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:15.771939 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-090c2cc4-7922-4d54-8e2f-0f9032b1490b tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.700953 Oct 05 17:52:15.775753 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2342/4393] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:15 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:15.870920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ab16726-8cb3-4566-8c98-61af4f670c1a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:15.872403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8ab16726-8cb3-4566-8c98-61af4f670c1a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:15.882257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ab16726-8cb3-4566-8c98-61af4f670c1a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:15.884405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ab16726-8cb3-4566-8c98-61af4f670c1a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:15.885025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ab16726-8cb3-4566-8c98-61af4f670c1a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:15.888547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ab16726-8cb3-4566-8c98-61af4f670c1a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:15.897241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ab16726-8cb3-4566-8c98-61af4f670c1a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:15.897961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ab16726-8cb3-4566-8c98-61af4f670c1a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:16.648068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3639815f-79c8-465d-acbc-2a5cd40cad32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:16.662157 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3639815f-79c8-465d-acbc-2a5cd40cad32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1503 microversion: 2.1 time: 1.276960 Oct 05 17:52:16.662801 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2052/4394] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:15 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1503 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:17.026194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8ab16726-8cb3-4566-8c98-61af4f670c1a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:17.030865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-68e52f1e-cdeb-4803-8d34-18b0ac4c131b req-0e9661fc-ec02-422a-89eb-f2d7e1d8a643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d8a7cb4-80c2-4ac1-bc2c-2647d3111697", "tag": "c1bd9e9c-7035-4f99-84c8-5d5b5359b755"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:17.035364 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8ab16726-8cb3-4566-8c98-61af4f670c1a tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1317 microversion: 2.1 time: 1.169196 Oct 05 17:52:17.035951 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2343/4395] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:15 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1317 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:17.051945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-57d8b876-781a-49f2-a515-297444907e0a tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Action: 'create', calling method: .version_select at 0x7f7774738940>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1773645499", "description": "tempest-description-124169317"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:17.059459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-68e52f1e-cdeb-4803-8d34-18b0ac4c131b req-0e9661fc-ec02-422a-89eb-f2d7e1d8a643 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:17.059942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-68e52f1e-cdeb-4803-8d34-18b0ac4c131b req-0e9661fc-ec02-422a-89eb-f2d7e1d8a643 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:17.060370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-68e52f1e-cdeb-4803-8d34-18b0ac4c131b req-0e9661fc-ec02-422a-89eb-f2d7e1d8a643 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:17.109157 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-68e52f1e-cdeb-4803-8d34-18b0ac4c131b req-0e9661fc-ec02-422a-89eb-f2d7e1d8a643 service nova] Creating event network-changed:c1bd9e9c-7035-4f99-84c8-5d5b5359b755 for instance 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 on n-h2-835595-3 Oct 05 17:52:17.115640 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-68e52f1e-cdeb-4803-8d34-18b0ac4c131b req-0e9661fc-ec02-422a-89eb-f2d7e1d8a643 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.444378 Oct 05 17:52:17.118580 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2053/4396] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:17.126322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:17.129719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:17.136398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:17.138218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:17.138898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:17.139518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:17.140427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:17.141126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:17.141710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:17.316177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:17.329114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:17.331246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:17.332672 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dafcfcd6-d495-4714-ac1d-60db6bc3ca51 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.212605 Oct 05 17:52:17.333440 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2054/4397] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:17 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:17.730099 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-57d8b876-781a-49f2-a515-297444907e0a tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.682549 Oct 05 17:52:17.744539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-26e84a8a-4b86-4a34-acea-a4cbbb0bbd1f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1773645499"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:17.745390 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2344/4398] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:52:17 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:17.746352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-26e84a8a-4b86-4a34-acea-a4cbbb0bbd1f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:17.758827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e84a8a-4b86-4a34-acea-a4cbbb0bbd1f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:17.763960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e84a8a-4b86-4a34-acea-a4cbbb0bbd1f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:17.764414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e84a8a-4b86-4a34-acea-a4cbbb0bbd1f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:17.765165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e84a8a-4b86-4a34-acea-a4cbbb0bbd1f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:17.765626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e84a8a-4b86-4a34-acea-a4cbbb0bbd1f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:17.770183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26e84a8a-4b86-4a34-acea-a4cbbb0bbd1f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:18.059449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f222e1aa-7dd7-4e23-a4e7-9cff21172779 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:18.060074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f222e1aa-7dd7-4e23-a4e7-9cff21172779 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:18.066590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f222e1aa-7dd7-4e23-a4e7-9cff21172779 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:18.067081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f222e1aa-7dd7-4e23-a4e7-9cff21172779 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:18.067512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f222e1aa-7dd7-4e23-a4e7-9cff21172779 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:18.068218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f222e1aa-7dd7-4e23-a4e7-9cff21172779 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:18.068674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f222e1aa-7dd7-4e23-a4e7-9cff21172779 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:18.069094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f222e1aa-7dd7-4e23-a4e7-9cff21172779 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:18.211903 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.network.security_group_api [None req-26e84a8a-4b86-4a34-acea-a4cbbb0bbd1f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Adding security group 4c02309a-56aa-4b11-a1b1-06f85ee9a3c1 to port 5ea43710-6e71-4e06-adfb-3fe2a9166d65 Oct 05 17:52:18.525785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f222e1aa-7dd7-4e23-a4e7-9cff21172779 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:18.536003 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f222e1aa-7dd7-4e23-a4e7-9cff21172779 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1317 microversion: 2.1 time: 0.480577 Oct 05 17:52:18.538118 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2345/4399] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:18 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:18.545989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:18.546658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:18.560383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:18.560991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:18.561760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:18.563559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:18.564342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:18.564963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:18.691297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:18.729250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:18.733481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:18.735559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4182fcdd-d554-47c3-84df-efe6a906e0fd tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.195948 Oct 05 17:52:18.736853 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2346/4400] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:18 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:19.480714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bdeaa801-70b4-4657-92ee-cf07fdfe4a5f tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-805757056", "availability_zone": "foo_zone"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:19.513575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.aggregate [None req-bdeaa801-70b4-4657-92ee-cf07fdfe4a5f tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Generated uuid 44155943-aa4b-411a-8ee3-9b615e92fa20 for aggregate {{(pid=128844) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 05 17:52:19.544595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=90 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:19.566384 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bdeaa801-70b4-4657-92ee-cf07fdfe4a5f tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.276204 Oct 05 17:52:19.576464 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2347/4401] 10.222.0.70 () {60 vars in 1164 bytes} [Wed Oct 5 17:52:19 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:19.582647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:19.583128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:19.591874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:19.592520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:19.593035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:19.593831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:19.594648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:19.595080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:19.616938 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] HTTP exception thrown: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Request method failure captured: Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 HTTP/1.1 Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcK5oMBjHiudjf7LHriEDEXcKhHOF8QjbltWzRFEVZoTN3IpQ3n_sL0fDG8FbtsTKiaeY8HcTuKzSraQm0Ef92X9oeNRaFg-JPMBuk3lEYyzi41lyLNK-G7bmPf0K1Yc4av0zJlaVFRVDg0PJbRyYOdl5wvP7qN8tKxZlKX6dpLvihg Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ee4220fd6f904e36ada64a2b5f3bf524", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}] Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 418f5619d2f543d98e874a0c48e81d52 Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '6ad2a87d-6f65-4d38-add2-2b119a8a2210'} Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:52:19.619578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Returning 404 to user: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ff1deab-effc-4982-9427-440462680369 tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 404 len: 111 microversion: 2.1 time: 0.043196 Oct 05 17:52:19.625821 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2348/4402] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:52:19 2022] DELETE /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:52:19.627777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-32d64543-72fc-46b6-a999-8143c034ddd5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:19.628057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-32d64543-72fc-46b6-a999-8143c034ddd5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:19.635245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d64543-72fc-46b6-a999-8143c034ddd5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:19.635721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d64543-72fc-46b6-a999-8143c034ddd5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:19.637984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d64543-72fc-46b6-a999-8143c034ddd5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:19.638889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d64543-72fc-46b6-a999-8143c034ddd5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:19.639364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d64543-72fc-46b6-a999-8143c034ddd5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:19.639791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32d64543-72fc-46b6-a999-8143c034ddd5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:19.895810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-32d64543-72fc-46b6-a999-8143c034ddd5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:19.921274 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-32d64543-72fc-46b6-a999-8143c034ddd5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1317 microversion: 2.1 time: 0.297927 Oct 05 17:52:19.934635 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2349/4403] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:19 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1317 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:19.941952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-52880631-3f9f-438b-8a91-c6991dfc0d5d tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:19.984711 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-52880631-3f9f-438b-8a91-c6991dfc0d5d tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.048081 Oct 05 17:52:19.987305 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2350/4404] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:52:19 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:19.998724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:20.000683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] [instance: 6ad2a87d-6f65-4d38-add2-2b119a8a2210] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:20.026377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:20.030646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:20.031362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:20.035193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:20.039625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:20.040459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:20.073154 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] HTTP exception thrown: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Request method failure captured: Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 HTTP/1.1 Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcK5oMBjHiudjf7LHriEDEXcKhHOF8QjbltWzRFEVZoTN3IpQ3n_sL0fDG8FbtsTKiaeY8HcTuKzSraQm0Ef92X9oeNRaFg-JPMBuk3lEYyzi41lyLNK-G7bmPf0K1Yc4av0zJlaVFRVDg0PJbRyYOdl5wvP7qN8tKxZlKX6dpLvihg Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ee4220fd6f904e36ada64a2b5f3bf524", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ee4220fd6f904e36ada64a2b5f3bf524"}]}] Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: ee4220fd6f904e36ada64a2b5f3bf524 Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1757995579 Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 418f5619d2f543d98e874a0c48e81d52 Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeTestJSON-1757995579-project Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '6ad2a87d-6f65-4d38-add2-2b119a8a2210'} Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:20.076566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:20.081566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:20.081566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:20.081566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:20.081566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:52:20.081566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:52:20.081566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. Oct 05 17:52:20.081566 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:20.085184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-26e84a8a-4b86-4a34-acea-a4cbbb0bbd1f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "POST /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735/action" status: 202 len: 0 microversion: 2.1 time: 2.344867 Oct 05 17:52:20.086793 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2055/4405] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:52:17 2022] POST /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735/action => generated 0 bytes in 2347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:52:20.092434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:20.093433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:20.099209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] Returning 404 to user: Instance 6ad2a87d-6f65-4d38-add2-2b119a8a2210 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:52:20.102369 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ec57c54-e971-4ff4-a983-e39b1cc2ea6c tempest-AttachVolumeTestJSON-1757995579 tempest-AttachVolumeTestJSON-1757995579-project] 10.222.0.70 "GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210" status: 404 len: 111 microversion: 2.1 time: 0.113768 Oct 05 17:52:20.109169 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2351/4406] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:19 2022] GET /compute/v2.1/servers/6ad2a87d-6f65-4d38-add2-2b119a8a2210 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:52:20.112793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:20.116279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:20.120369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-52092cbf-5959-4a57-b5ce-9549c4f3f3c7 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:20.121243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:20.125933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:20.126960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:20.127414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:20.138849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52092cbf-5959-4a57-b5ce-9549c4f3f3c7 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:20.147298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52092cbf-5959-4a57-b5ce-9549c4f3f3c7 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:20.151441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52092cbf-5959-4a57-b5ce-9549c4f3f3c7 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:20.152631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52092cbf-5959-4a57-b5ce-9549c4f3f3c7 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:20.153454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52092cbf-5959-4a57-b5ce-9549c4f3f3c7 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:20.154115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-52092cbf-5959-4a57-b5ce-9549c4f3f3c7 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:20.251655 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-52092cbf-5959-4a57-b5ce-9549c4f3f3c7 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.140721 Oct 05 17:52:20.255713 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2352/4407] 10.222.0.70 () {58 vars in 1176 bytes} [Wed Oct 5 17:52:20 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:20.273068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-acaada85-74d0-4d35-a35c-e381605c275f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1773645499"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:20.277334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-acaada85-74d0-4d35-a35c-e381605c275f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:20.295449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaada85-74d0-4d35-a35c-e381605c275f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:20.295995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaada85-74d0-4d35-a35c-e381605c275f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:20.296444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaada85-74d0-4d35-a35c-e381605c275f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:20.297210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaada85-74d0-4d35-a35c-e381605c275f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:20.297679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaada85-74d0-4d35-a35c-e381605c275f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:20.298108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaada85-74d0-4d35-a35c-e381605c275f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:20.503917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:20.514700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:20.523171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:20.524656 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7923480a-7a77-4e0f-bb43-bc6b1e834b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1407 microversion: 2.54 time: 0.436370 Oct 05 17:52:20.525426 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2056/4408] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:20 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:20.542451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-06c2cdab-a99e-4c7e-974e-67a24651a401 req-c5c5f3a4-5cfe-4c78-85aa-fb48034f6903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965c02cf-92d4-4b35-90ec-83b1588eb735", "tag": "5ea43710-6e71-4e06-adfb-3fe2a9166d65"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:20.563964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-06c2cdab-a99e-4c7e-974e-67a24651a401 req-c5c5f3a4-5cfe-4c78-85aa-fb48034f6903 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:20.565231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-06c2cdab-a99e-4c7e-974e-67a24651a401 req-c5c5f3a4-5cfe-4c78-85aa-fb48034f6903 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:20.565657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-06c2cdab-a99e-4c7e-974e-67a24651a401 req-c5c5f3a4-5cfe-4c78-85aa-fb48034f6903 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:20.586687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:20.588861 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-06c2cdab-a99e-4c7e-974e-67a24651a401 req-c5c5f3a4-5cfe-4c78-85aa-fb48034f6903 service nova] Creating event network-changed:5ea43710-6e71-4e06-adfb-3fe2a9166d65 for instance 965c02cf-92d4-4b35-90ec-83b1588eb735 on n-h1-835595-3 Oct 05 17:52:20.603139 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-06c2cdab-a99e-4c7e-974e-67a24651a401 req-c5c5f3a4-5cfe-4c78-85aa-fb48034f6903 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076265 Oct 05 17:52:20.607689 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2057/4409] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:20.623232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ad527c94-7b8a-4dda-9a0e-6123de95f238 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:20.636149 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ad527c94-7b8a-4dda-9a0e-6123de95f238 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.027157 Oct 05 17:52:20.637078 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.network.security_group_api [None req-acaada85-74d0-4d35-a35c-e381605c275f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Removing security group 4c02309a-56aa-4b11-a1b1-06f85ee9a3c1 from port 5ea43710-6e71-4e06-adfb-3fe2a9166d65 Oct 05 17:52:20.647681 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2058/4410] 10.222.0.70 () {58 vars in 1143 bytes} [Wed Oct 5 17:52:20 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:20.652758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ea24582-17b0-4133-94e7-a6a7d0cb8d45 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-835595-3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:20.671313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ea24582-17b0-4133-94e7-a6a7d0cb8d45 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:20.671817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ea24582-17b0-4133-94e7-a6a7d0cb8d45 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:20.672320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ea24582-17b0-4133-94e7-a6a7d0cb8d45 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:21.205590 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ea24582-17b0-4133-94e7-a6a7d0cb8d45 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.556540 Oct 05 17:52:21.207414 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2059/4411] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:52:20 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:52:21.213063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7e09fab9-d2d4-47b1-aa05-eb3e869d4b49 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:21.214159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7e09fab9-d2d4-47b1-aa05-eb3e869d4b49 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:21.230130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e09fab9-d2d4-47b1-aa05-eb3e869d4b49 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:21.231190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e09fab9-d2d4-47b1-aa05-eb3e869d4b49 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:21.232433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e09fab9-d2d4-47b1-aa05-eb3e869d4b49 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:21.238086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e09fab9-d2d4-47b1-aa05-eb3e869d4b49 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:21.238963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e09fab9-d2d4-47b1-aa05-eb3e869d4b49 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:21.239640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e09fab9-d2d4-47b1-aa05-eb3e869d4b49 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:21.490359 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-acaada85-74d0-4d35-a35c-e381605c275f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "POST /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735/action" status: 202 len: 0 microversion: 2.1 time: 1.223541 Oct 05 17:52:21.493449 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2353/4412] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:52:20 2022] POST /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735/action => generated 0 bytes in 1237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:52:21.518964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-852805c5-5570-4487-a77c-74b086a7b984 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:21.546399 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-852805c5-5570-4487-a77c-74b086a7b984 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.036997 Oct 05 17:52:21.548497 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2354/4413] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:52:21 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:21.558099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a80c47c4-eb7c-4ede-a3f7-ce91063abb0c req-2327dcb2-9cb7-401c-8e26-0aae9be3d3cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965c02cf-92d4-4b35-90ec-83b1588eb735", "tag": "5ea43710-6e71-4e06-adfb-3fe2a9166d65"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:21.577288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a80c47c4-eb7c-4ede-a3f7-ce91063abb0c req-2327dcb2-9cb7-401c-8e26-0aae9be3d3cf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:21.578155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a80c47c4-eb7c-4ede-a3f7-ce91063abb0c req-2327dcb2-9cb7-401c-8e26-0aae9be3d3cf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:21.579261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a80c47c4-eb7c-4ede-a3f7-ce91063abb0c req-2327dcb2-9cb7-401c-8e26-0aae9be3d3cf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:21.598139 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a80c47c4-eb7c-4ede-a3f7-ce91063abb0c req-2327dcb2-9cb7-401c-8e26-0aae9be3d3cf service nova] Creating event network-changed:5ea43710-6e71-4e06-adfb-3fe2a9166d65 for instance 965c02cf-92d4-4b35-90ec-83b1588eb735 on n-h1-835595-3 Oct 05 17:52:21.604970 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a80c47c4-eb7c-4ede-a3f7-ce91063abb0c req-2327dcb2-9cb7-401c-8e26-0aae9be3d3cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053303 Oct 05 17:52:21.606527 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2355/4414] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:21.615384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3aa1d6ab-ecfc-4975-8a7a-09a04e7fac32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Action: 'create', calling method: .version_select at 0x7f777410dca0>, body: {"pool": null} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:21.947216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7e09fab9-d2d4-47b1-aa05-eb3e869d4b49 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:21.965068 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7e09fab9-d2d4-47b1-aa05-eb3e869d4b49 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1321 microversion: 2.1 time: 0.754061 Oct 05 17:52:21.965790 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2060/4415] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:21 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1321 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:21.979185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:21.982475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:22.011540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:22.012574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:22.013528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:22.014463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:22.018671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:22.019301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:22.287969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:22.301267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:22.310409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:22.315817 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2b9fee1e-fcf8-467b-a2ce-c30ff566258a tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1413 microversion: 2.54 time: 0.348911 Oct 05 17:52:22.317158 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2061/4416] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:21 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1413 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:22.329743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8a34b9e5-5d59-4c51-81d1-be0b2495bf65 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-670605857", "availability_zone": "foo_zone"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:22.629096 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8a34b9e5-5d59-4c51-81d1-be0b2495bf65 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.305585 Oct 05 17:52:22.631001 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2062/4417] 10.222.0.70 () {60 vars in 1173 bytes} [Wed Oct 5 17:52:22 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:22.649836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-af8ba5df-6cc5-49ce-8d64-58dd64204a5e tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:22.715226 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-af8ba5df-6cc5-49ce-8d64-58dd64204a5e tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.074045 Oct 05 17:52:22.719467 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2063/4418] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:52:22 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:22.733552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b693f076-6a6e-4004-845d-1437e52c40df tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:22.747490 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b693f076-6a6e-4004-845d-1437e52c40df tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.021183 Oct 05 17:52:22.748978 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2064/4419] 10.222.0.70 () {58 vars in 1152 bytes} [Wed Oct 5 17:52:22 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:22.760379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b43ed42-de11-4f12-a3b1-a3aab1305668 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-835595-3"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:22.779176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b43ed42-de11-4f12-a3b1-a3aab1305668 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:22.779941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b43ed42-de11-4f12-a3b1-a3aab1305668 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:22.781000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b43ed42-de11-4f12-a3b1-a3aab1305668 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:23.108208 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b43ed42-de11-4f12-a3b1-a3aab1305668 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.351516 Oct 05 17:52:23.109110 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2065/4420] 10.222.0.70 () {60 vars in 1194 bytes} [Wed Oct 5 17:52:22 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:52:23.115399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-941eeacb-6cfa-4eed-beaf-d0efa2499171 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:23.116229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-941eeacb-6cfa-4eed-beaf-d0efa2499171 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:23.126115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-941eeacb-6cfa-4eed-beaf-d0efa2499171 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:23.126884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-941eeacb-6cfa-4eed-beaf-d0efa2499171 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:23.127515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-941eeacb-6cfa-4eed-beaf-d0efa2499171 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:23.128498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-941eeacb-6cfa-4eed-beaf-d0efa2499171 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:23.129148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-941eeacb-6cfa-4eed-beaf-d0efa2499171 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:23.129765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-941eeacb-6cfa-4eed-beaf-d0efa2499171 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:24.291636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-941eeacb-6cfa-4eed-beaf-d0efa2499171 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:24.307109 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-941eeacb-6cfa-4eed-beaf-d0efa2499171 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1317 microversion: 2.1 time: 1.196309 Oct 05 17:52:24.308502 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2066/4421] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:23 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1317 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:24.326118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-34e40754-413f-458f-821d-3833d9d634a6 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:24.360074 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-34e40754-413f-458f-821d-3833d9d634a6 tempest-TestAggregatesBasicOps-1317322770 tempest-TestAggregatesBasicOps-1317322770-project-admin] 10.222.0.70 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.050050 Oct 05 17:52:24.361572 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2067/4422] 10.222.0.70 () {58 vars in 1155 bytes} [Wed Oct 5 17:52:24 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 05 17:52:24.387331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:24.388150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:24.405963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:24.407508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:24.408997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:24.410761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:24.412291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:24.414704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:24.629507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:24.640676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:24.648747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:24.650444 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6305a0dd-e33a-496f-a0a4-d193c51b17e7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1398 microversion: 2.54 time: 0.287617 Oct 05 17:52:24.651551 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2068/4423] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:24 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1398 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:24.681954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-073cc6fe-f31d-4fc7-a877-0b4b382c8b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '.version_select at 0x7f7775b960d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:24.724057 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-073cc6fe-f31d-4fc7-a877-0b4b382c8b11 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-286319029" status: 204 len: 0 microversion: 2.54 time: 0.046154 Oct 05 17:52:24.724953 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2069/4424] 10.222.0.70 () {60 vars in 1316 bytes} [Wed Oct 5 17:52:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-286319029 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 17:52:24.737695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-486e9a59-b964-46ec-b712-ad8c9c1fb546 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:24.738452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-486e9a59-b964-46ec-b712-ad8c9c1fb546 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:24.746451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-486e9a59-b964-46ec-b712-ad8c9c1fb546 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:24.747136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-486e9a59-b964-46ec-b712-ad8c9c1fb546 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:24.747807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-486e9a59-b964-46ec-b712-ad8c9c1fb546 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:24.751231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-486e9a59-b964-46ec-b712-ad8c9c1fb546 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:24.751708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-486e9a59-b964-46ec-b712-ad8c9c1fb546 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:24.752314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-486e9a59-b964-46ec-b712-ad8c9c1fb546 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:24.827776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-486e9a59-b964-46ec-b712-ad8c9c1fb546 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:52:25.013811 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-486e9a59-b964-46ec-b712-ad8c9c1fb546 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 204 len: 0 microversion: 2.54 time: 0.279480 Oct 05 17:52:25.015455 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2070/4425] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:52:24 2022] DELETE /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 17:52:25.027661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:25.028914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:25.039342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:25.040580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:25.041255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:25.042219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:25.042936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:25.043652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:25.234170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:25.251742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:25.257072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:25.261425 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8ce181b3-2bf9-4679-b4c5-c688ac46b2f1 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1404 microversion: 2.54 time: 0.239595 Oct 05 17:52:25.262846 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2071/4426] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:25 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1404 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:52:25.329534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55befafa-f535-4c59-baad-92e342af5525 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:25.330190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-55befafa-f535-4c59-baad-92e342af5525 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:25.347718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55befafa-f535-4c59-baad-92e342af5525 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:25.349213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55befafa-f535-4c59-baad-92e342af5525 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:25.349666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55befafa-f535-4c59-baad-92e342af5525 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:25.350420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55befafa-f535-4c59-baad-92e342af5525 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:25.350883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55befafa-f535-4c59-baad-92e342af5525 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:25.351315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55befafa-f535-4c59-baad-92e342af5525 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:25.754841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-55befafa-f535-4c59-baad-92e342af5525 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:25.764743 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-55befafa-f535-4c59-baad-92e342af5525 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1317 microversion: 2.1 time: 0.439063 Oct 05 17:52:25.784245 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2072/4427] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:25 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:25.796837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-83e2304a-0dd1-4b2f-8f88-a683157aff4b req-e988004e-ae94-407c-ba26-602207de1e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8a7cb4-80c2-4ac1-bc2c-2647d3111697", "name": "network-vif-plugged", "status": "completed", "tag": "c1bd9e9c-7035-4f99-84c8-5d5b5359b755"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:25.820622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-83e2304a-0dd1-4b2f-8f88-a683157aff4b req-e988004e-ae94-407c-ba26-602207de1e49 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:25.822077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-83e2304a-0dd1-4b2f-8f88-a683157aff4b req-e988004e-ae94-407c-ba26-602207de1e49 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:25.832146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-83e2304a-0dd1-4b2f-8f88-a683157aff4b req-e988004e-ae94-407c-ba26-602207de1e49 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:25.849783 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-83e2304a-0dd1-4b2f-8f88-a683157aff4b req-e988004e-ae94-407c-ba26-602207de1e49 service nova] Creating event network-vif-plugged:c1bd9e9c-7035-4f99-84c8-5d5b5359b755 for instance 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 on n-h2-835595-3 Oct 05 17:52:25.864233 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-83e2304a-0dd1-4b2f-8f88-a683157aff4b req-e988004e-ae94-407c-ba26-602207de1e49 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077360 Oct 05 17:52:25.865160 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2073/4428] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:26.292142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:26.292846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:26.301431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:26.302117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:26.302776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:26.303738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:26.304344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:26.305129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:26.496404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:26.508363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:26.510002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:26.511435 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d8cad293-be74-4bff-abd6-fcbb32e57029 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1404 microversion: 2.54 time: 0.225370 Oct 05 17:52:26.512541 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2074/4429] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:26 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1404 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:26.736846 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3aa1d6ab-ecfc-4975-8a7a-09a04e7fac32 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.128878 Oct 05 17:52:26.737729 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2356/4430] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:52:21 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:26.751190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.17"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:26.754012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:26.772684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:26.773809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:26.774534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:26.775496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:26.776173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:26.776818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:26.790663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf74c403-1c96-42d7-b073-ee2365beda96 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:26.791859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bf74c403-1c96-42d7-b073-ee2365beda96 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:26.812025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf74c403-1c96-42d7-b073-ee2365beda96 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:26.812534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf74c403-1c96-42d7-b073-ee2365beda96 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:26.813032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf74c403-1c96-42d7-b073-ee2365beda96 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:26.827531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf74c403-1c96-42d7-b073-ee2365beda96 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:26.828725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf74c403-1c96-42d7-b073-ee2365beda96 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:26.830728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf74c403-1c96-42d7-b073-ee2365beda96 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:26.833498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "refresh_cache-965c02cf-92d4-4b35-90ec-83b1588eb735" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:52:26.834143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquired lock "refresh_cache-965c02cf-92d4-4b35-90ec-83b1588eb735" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:52:26.850512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:27.233059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bf74c403-1c96-42d7-b073-ee2365beda96 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:27.246961 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf74c403-1c96-42d7-b073-ee2365beda96 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1317 microversion: 2.1 time: 0.459226 Oct 05 17:52:27.249176 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2357/4431] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:26 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:27.541155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:27.541770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:27.562756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:27.563576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:27.567561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:27.571187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:27.572663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:27.575078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:27.743263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:27.744505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:27.745093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:27.745696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lazy-loading 'fault' on Instance uuid cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:52:27.820132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:27.829876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:27.832236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '121e857ad87945c087137f591fa1c7f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6026cfbf11d644a5ac3fb3b3346ced0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:27.833801 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a976ccf5-9698-4b14-9b4f-032957be98b9 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 200 len: 1409 microversion: 2.54 time: 0.296788 Oct 05 17:52:27.846309 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2358/4432] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:27 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 1409 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:52:28.284723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae88d362-104f-4ec7-866f-9b9a8e1714d7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:28.286493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae88d362-104f-4ec7-866f-9b9a8e1714d7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:28.304626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae88d362-104f-4ec7-866f-9b9a8e1714d7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:28.312433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae88d362-104f-4ec7-866f-9b9a8e1714d7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:28.314530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae88d362-104f-4ec7-866f-9b9a8e1714d7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:28.319195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae88d362-104f-4ec7-866f-9b9a8e1714d7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:28.322071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae88d362-104f-4ec7-866f-9b9a8e1714d7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:28.322867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae88d362-104f-4ec7-866f-9b9a8e1714d7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:28.967668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ae88d362-104f-4ec7-866f-9b9a8e1714d7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:28.980834 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae88d362-104f-4ec7-866f-9b9a8e1714d7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1467 microversion: 2.1 time: 0.703733 Oct 05 17:52:28.997811 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2359/4433] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:28 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1467 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:28.997811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:28.997811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] [instance: cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:29.029254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:29.029790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:29.030241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:29.030987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:29.031489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:29.031922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:29.055173 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] HTTP exception thrown: Instance cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 could not be found. Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Request method failure captured: Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 HTTP/1.1 Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcQrGnrT2JtfSoZzQbvDwm8Q1wrPxud2fKlhpUBjwbGxTDzwSk2D4UFuTFf2NA6kA3cRwrFnU3ECLz7ercxmQBSQBP8gzo3dfpiZpoVVUYXVdm8xNfDlUJpK3qjf-YXcs959n-C1sQzAtkzq7CqRtT04ktqcnkDoPjQlVstxZVFJ3Qc Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.54 Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 6026cfbf11d644a5ac3fb3b3346ced0e Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerShowV254Test-563231610 Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/6026cfbf11d644a5ac3fb3b3346ced0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "tempest-type-763207890", "name": "tempest-service-1727420019", "endpoints": []}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6026cfbf11d644a5ac3fb3b3346ced0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_6026cfbf11d644a5ac3fb3b3346ced0e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/6026cfbf11d644a5ac3fb3b3346ced0e"}]}] Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerShowV254Test-563231610 Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 6026cfbf11d644a5ac3fb3b3346ced0e Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerShowV254Test-563231610 Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerShowV254Test-563231610-project Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 121e857ad87945c087137f591fa1c7f5 Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerShowV254Test-563231610-project Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 could not be found. Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364'} Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 could not be found. Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 could not be found. Oct 05 17:52:29.060989 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 could not be found. Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] Returning 404 to user: Instance cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b713d08-1bc4-47c6-9fb5-6cd111a3f8a7 tempest-ServerShowV254Test-563231610 tempest-ServerShowV254Test-563231610-project] 10.222.0.70 "GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364" status: 404 len: 111 microversion: 2.54 time: 0.080212 Oct 05 17:52:29.065119 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2360/4434] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:28 2022] GET /compute/v2.1/servers/cd5e5c2e-eec9-4e3e-a8f6-e01f10fce364 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:52:29.079349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3a84e90-9853-49b8-8526-b50a66dccf79 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:29.079973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c3a84e90-9853-49b8-8526-b50a66dccf79 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:29.107100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a84e90-9853-49b8-8526-b50a66dccf79 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:29.107870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a84e90-9853-49b8-8526-b50a66dccf79 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:29.109826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a84e90-9853-49b8-8526-b50a66dccf79 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:29.111071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a84e90-9853-49b8-8526-b50a66dccf79 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:29.112463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a84e90-9853-49b8-8526-b50a66dccf79 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:29.113142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3a84e90-9853-49b8-8526-b50a66dccf79 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:29.734814 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3a84e90-9853-49b8-8526-b50a66dccf79 tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1618 microversion: 2.1 time: 0.668117 Oct 05 17:52:29.737353 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2361/4435] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:29 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1618 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:30.216692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-236653959", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "a708a04f-a0cd-42d3-92d5-2f5d4dd8577b"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:30.250899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:30.304741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:52:31.461235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Building network info cache for instance {{(pid=128843) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 17:52:31.987172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:52:31.988402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:52:31.989070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:52:31.989647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:52:31.990213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:52:32.011560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:32.012303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:32.012897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:32.013821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:32.015040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:32.016378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:32.062844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:52:32.076665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Getting quotas for user f9ba173edb2b403493b6a65942cf6bab and project 4809bb6013894d13a894acb816f7dca8. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:52:32.122121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:52:32.124557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:52:32.224595 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bbe80bff-f114-45b5-835e-14504d2c0087 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.013125 Oct 05 17:52:32.225585 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2362/4436] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:52:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:52:32.231920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-97214975-66fa-4e12-b07a-affac0ebf070 req-109eca6c-5874-4a22-b17a-932d34916fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965c02cf-92d4-4b35-90ec-83b1588eb735", "tag": "5ea43710-6e71-4e06-adfb-3fe2a9166d65"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:32.263990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-97214975-66fa-4e12-b07a-affac0ebf070 req-109eca6c-5874-4a22-b17a-932d34916fde service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:32.264656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-97214975-66fa-4e12-b07a-affac0ebf070 req-109eca6c-5874-4a22-b17a-932d34916fde service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:32.265282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-97214975-66fa-4e12-b07a-affac0ebf070 req-109eca6c-5874-4a22-b17a-932d34916fde service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:32.283745 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-97214975-66fa-4e12-b07a-affac0ebf070 req-109eca6c-5874-4a22-b17a-932d34916fde service nova] Creating event network-changed:5ea43710-6e71-4e06-adfb-3fe2a9166d65 for instance 965c02cf-92d4-4b35-90ec-83b1588eb735 on n-h1-835595-3 Oct 05 17:52:32.296566 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-97214975-66fa-4e12-b07a-affac0ebf070 req-109eca6c-5874-4a22-b17a-932d34916fde service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067658 Oct 05 17:52:32.297858 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2363/4437] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:32.305045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1c658909-6777-4416-8e65-e53500d5118b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:32.308118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1c658909-6777-4416-8e65-e53500d5118b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:32.638379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1c658909-6777-4416-8e65-e53500d5118b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:32.655077 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1c658909-6777-4416-8e65-e53500d5118b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1216 microversion: 2.1 time: 0.350818 Oct 05 17:52:32.662907 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2364/4438] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:32 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1216 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:33.688376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9236f05e-7d49-4be3-b3b1-bca752cf9ef5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:33.690070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9236f05e-7d49-4be3-b3b1-bca752cf9ef5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:33.701620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9236f05e-7d49-4be3-b3b1-bca752cf9ef5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:33.705193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9236f05e-7d49-4be3-b3b1-bca752cf9ef5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:33.710429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9236f05e-7d49-4be3-b3b1-bca752cf9ef5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:33.711513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9236f05e-7d49-4be3-b3b1-bca752cf9ef5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:33.712248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9236f05e-7d49-4be3-b3b1-bca752cf9ef5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:33.713108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9236f05e-7d49-4be3-b3b1-bca752cf9ef5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:34.071548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9236f05e-7d49-4be3-b3b1-bca752cf9ef5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:34.096871 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9236f05e-7d49-4be3-b3b1-bca752cf9ef5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1212 microversion: 2.1 time: 0.412290 Oct 05 17:52:34.099049 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2365/4439] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:33 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1212 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:34.764151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Updating instance_info_cache with network_info: [{"id": "5ea43710-6e71-4e06-adfb-3fe2a9166d65", "address": "fa:16:3e:61:f3:03", "network": {"id": "49e351fa-583b-4b46-a2b4-67441c4381dd", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1710746099-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "24b4c2cb71624ca2828cdb3e38d779bd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5ea43710-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128843) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:52:34.782383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Releasing lock "refresh_cache-965c02cf-92d4-4b35-90ec-83b1588eb735" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:52:34.783972 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-070fd8e1-1236-437a-bb60-a164dbe57154 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "POST /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735/action" status: 202 len: 0 microversion: 2.1 time: 8.037641 Oct 05 17:52:34.786542 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2075/4440] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:52:26 2022] POST /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735/action => generated 0 bytes in 8041 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 05 17:52:34.796367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.17"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:35.124349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:35.124985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:35.140113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:35.140658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:35.141113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:35.141796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:35.142254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:35.142707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:35.307089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:35.317306 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1274 microversion: 2.1 time: 0.196953 Oct 05 17:52:35.331200 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2076/4441] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:35 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1274 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:35.890585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:35.903654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:35.904422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:35.904966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:35.906133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:35.907025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:35.919904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:36.158812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:36.160871 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002281 Oct 05 17:52:36.161931 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2077/4442] 10.222.0.70 () {56 vars in 886 bytes} [Wed Oct 5 17:52:36 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 05 17:52:36.170137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:36.171692 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002034 Oct 05 17:52:36.172777 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2078/4443] 10.222.0.70 () {54 vars in 1035 bytes} [Wed Oct 5 17:52:36 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 05 17:52:36.180514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:36.181881 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001796 Oct 05 17:52:36.182584 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2079/4444] 10.222.0.70 () {54 vars in 1041 bytes} [Wed Oct 5 17:52:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:52:36.192726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:36.195784 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d50b970-fdb7-4a2a-bdad-26818fe501bb tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001796 Oct 05 17:52:36.197330 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2080/4445] 10.222.0.70 () {56 vars in 886 bytes} [Wed Oct 5 17:52:36 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 05 17:52:36.366308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed7acc62-c921-4176-8f59-89a3e34aef45 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:36.367395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed7acc62-c921-4176-8f59-89a3e34aef45 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:36.382814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed7acc62-c921-4176-8f59-89a3e34aef45 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:36.385817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed7acc62-c921-4176-8f59-89a3e34aef45 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:36.388690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed7acc62-c921-4176-8f59-89a3e34aef45 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:36.392519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed7acc62-c921-4176-8f59-89a3e34aef45 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:36.395697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed7acc62-c921-4176-8f59-89a3e34aef45 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:36.397328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed7acc62-c921-4176-8f59-89a3e34aef45 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:36.599743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ed7acc62-c921-4176-8f59-89a3e34aef45 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:36.615009 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed7acc62-c921-4176-8f59-89a3e34aef45 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1274 microversion: 2.1 time: 0.258872 Oct 05 17:52:36.615967 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2081/4446] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:36 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1274 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:37.579993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "refresh_cache-965c02cf-92d4-4b35-90ec-83b1588eb735" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:52:37.580484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquired lock "refresh_cache-965c02cf-92d4-4b35-90ec-83b1588eb735" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:52:37.638328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bef22298-77d1-4353-a4b4-4fbba1f40c0b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:37.639475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bef22298-77d1-4353-a4b4-4fbba1f40c0b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:37.656114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef22298-77d1-4353-a4b4-4fbba1f40c0b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:37.656932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef22298-77d1-4353-a4b4-4fbba1f40c0b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:37.657555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef22298-77d1-4353-a4b4-4fbba1f40c0b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:37.658520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef22298-77d1-4353-a4b4-4fbba1f40c0b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:37.659188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef22298-77d1-4353-a4b4-4fbba1f40c0b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:37.659813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef22298-77d1-4353-a4b4-4fbba1f40c0b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:37.825433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bef22298-77d1-4353-a4b4-4fbba1f40c0b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:37.846216 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bef22298-77d1-4353-a4b4-4fbba1f40c0b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1274 microversion: 2.1 time: 0.211638 Oct 05 17:52:37.847289 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2082/4447] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:37 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1274 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:38.871685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9a1347d-93a7-4ce0-88fb-9755e5b1c169 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:38.872997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a9a1347d-93a7-4ce0-88fb-9755e5b1c169 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:38.880049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9a1347d-93a7-4ce0-88fb-9755e5b1c169 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:38.891256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9a1347d-93a7-4ce0-88fb-9755e5b1c169 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:38.894573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9a1347d-93a7-4ce0-88fb-9755e5b1c169 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:38.895150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9a1347d-93a7-4ce0-88fb-9755e5b1c169 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:38.895785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9a1347d-93a7-4ce0-88fb-9755e5b1c169 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:38.898195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9a1347d-93a7-4ce0-88fb-9755e5b1c169 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:38.942680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:39.087030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a9a1347d-93a7-4ce0-88fb-9755e5b1c169 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:39.096111 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a9a1347d-93a7-4ce0-88fb-9755e5b1c169 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1274 microversion: 2.1 time: 0.228868 Oct 05 17:52:39.100400 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2083/4448] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:38 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1274 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:40.130128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d7e5d513-f1b6-461d-9fdb-c73403146328 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:40.131814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d7e5d513-f1b6-461d-9fdb-c73403146328 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:40.148783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7e5d513-f1b6-461d-9fdb-c73403146328 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:40.150226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7e5d513-f1b6-461d-9fdb-c73403146328 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:40.151840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7e5d513-f1b6-461d-9fdb-c73403146328 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:40.156276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7e5d513-f1b6-461d-9fdb-c73403146328 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:40.156944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7e5d513-f1b6-461d-9fdb-c73403146328 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:40.157546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7e5d513-f1b6-461d-9fdb-c73403146328 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:40.572308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d7e5d513-f1b6-461d-9fdb-c73403146328 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:40.586175 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d7e5d513-f1b6-461d-9fdb-c73403146328 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.459733 Oct 05 17:52:40.591181 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2084/4449] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:40 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:41.623383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dc523757-56a3-47b2-ac63-16e668448bfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:41.626317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dc523757-56a3-47b2-ac63-16e668448bfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:41.638540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc523757-56a3-47b2-ac63-16e668448bfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:41.639492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc523757-56a3-47b2-ac63-16e668448bfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:41.640301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc523757-56a3-47b2-ac63-16e668448bfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:41.644732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc523757-56a3-47b2-ac63-16e668448bfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:41.645674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc523757-56a3-47b2-ac63-16e668448bfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:41.646260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc523757-56a3-47b2-ac63-16e668448bfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:42.038780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:42.170662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dc523757-56a3-47b2-ac63-16e668448bfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:42.178972 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dc523757-56a3-47b2-ac63-16e668448bfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.569750 Oct 05 17:52:42.182626 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2085/4450] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:41 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:42.373691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Building network info cache for instance {{(pid=128844) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 17:52:42.647799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:42.889547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3f8cd5ae-7897-4b35-8ff7-3659783abf63 req-cda4dd6d-d9b3-4bb6-a73d-a99ffd3ba5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "965c02cf-92d4-4b35-90ec-83b1588eb735", "tag": "5ea43710-6e71-4e06-adfb-3fe2a9166d65"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:42.912807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3f8cd5ae-7897-4b35-8ff7-3659783abf63 req-cda4dd6d-d9b3-4bb6-a73d-a99ffd3ba5c0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:42.913921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3f8cd5ae-7897-4b35-8ff7-3659783abf63 req-cda4dd6d-d9b3-4bb6-a73d-a99ffd3ba5c0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:42.914927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3f8cd5ae-7897-4b35-8ff7-3659783abf63 req-cda4dd6d-d9b3-4bb6-a73d-a99ffd3ba5c0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:42.944050 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3f8cd5ae-7897-4b35-8ff7-3659783abf63 req-cda4dd6d-d9b3-4bb6-a73d-a99ffd3ba5c0 service nova] Creating event network-changed:5ea43710-6e71-4e06-adfb-3fe2a9166d65 for instance 965c02cf-92d4-4b35-90ec-83b1588eb735 on n-h1-835595-3 Oct 05 17:52:42.952369 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3f8cd5ae-7897-4b35-8ff7-3659783abf63 req-cda4dd6d-d9b3-4bb6-a73d-a99ffd3ba5c0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.556661 Oct 05 17:52:42.957437 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2086/4451] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:52:43.204819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53b9562e-cb8f-4e51-969f-f9ea0b44dd23 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:43.205902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-53b9562e-cb8f-4e51-969f-f9ea0b44dd23 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:43.220697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53b9562e-cb8f-4e51-969f-f9ea0b44dd23 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:43.223935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53b9562e-cb8f-4e51-969f-f9ea0b44dd23 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:43.225850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53b9562e-cb8f-4e51-969f-f9ea0b44dd23 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:43.229697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53b9562e-cb8f-4e51-969f-f9ea0b44dd23 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:43.230413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53b9562e-cb8f-4e51-969f-f9ea0b44dd23 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:43.231269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53b9562e-cb8f-4e51-969f-f9ea0b44dd23 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:43.979188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-53b9562e-cb8f-4e51-969f-f9ea0b44dd23 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:43.991721 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53b9562e-cb8f-4e51-969f-f9ea0b44dd23 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.789336 Oct 05 17:52:44.008244 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2087/4452] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:43 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:45.020753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5e326085-2071-401d-9401-4a26a8a2ac7c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:45.022742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5e326085-2071-401d-9401-4a26a8a2ac7c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:45.026098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:45.036760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e326085-2071-401d-9401-4a26a8a2ac7c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:45.040966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e326085-2071-401d-9401-4a26a8a2ac7c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:45.045652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e326085-2071-401d-9401-4a26a8a2ac7c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:45.046623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e326085-2071-401d-9401-4a26a8a2ac7c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:45.047440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e326085-2071-401d-9401-4a26a8a2ac7c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:45.049816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e326085-2071-401d-9401-4a26a8a2ac7c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:45.503875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5e326085-2071-401d-9401-4a26a8a2ac7c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:45.514937 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5e326085-2071-401d-9401-4a26a8a2ac7c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.497962 Oct 05 17:52:45.515624 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2088/4453] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:45 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:45.692099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b122282f-02d1-4f36-8039-2e54544e181c req-81d4a245-fdc5-48fd-a09d-fc9513b6121d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6058f114-d9d4-47fd-b7e0-d8691f8ef2ba", "tag": "b0118119-e3ce-4dcf-922e-7af3fe81b08a"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:45.716024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b122282f-02d1-4f36-8039-2e54544e181c req-81d4a245-fdc5-48fd-a09d-fc9513b6121d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:45.716773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b122282f-02d1-4f36-8039-2e54544e181c req-81d4a245-fdc5-48fd-a09d-fc9513b6121d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:45.717428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b122282f-02d1-4f36-8039-2e54544e181c req-81d4a245-fdc5-48fd-a09d-fc9513b6121d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:45.750190 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b122282f-02d1-4f36-8039-2e54544e181c req-81d4a245-fdc5-48fd-a09d-fc9513b6121d service nova] Creating event network-changed:b0118119-e3ce-4dcf-922e-7af3fe81b08a for instance 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba on n-h1-835595-3 Oct 05 17:52:45.763249 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b122282f-02d1-4f36-8039-2e54544e181c req-81d4a245-fdc5-48fd-a09d-fc9513b6121d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074713 Oct 05 17:52:45.766356 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2089/4454] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:45.897660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:45.964598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Updating instance_info_cache with network_info: [{"id": "5ea43710-6e71-4e06-adfb-3fe2a9166d65", "address": "fa:16:3e:61:f3:03", "network": {"id": "49e351fa-583b-4b46-a2b4-67441c4381dd", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1710746099-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "24b4c2cb71624ca2828cdb3e38d779bd", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5ea43710-6e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128844) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:52:45.982898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Releasing lock "refresh_cache-965c02cf-92d4-4b35-90ec-83b1588eb735" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:52:45.988990 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-402f399f-b48b-433a-bd8e-9cdc625d3bd2 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "POST /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735/action" status: 202 len: 0 microversion: 2.1 time: 11.196728 Oct 05 17:52:45.995819 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2366/4455] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:52:34 2022] POST /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735/action => generated 0 bytes in 11206 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 05 17:52:46.001041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6585eda2-2031-45c1-a6cd-47c8a2c2f539 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '.version_select at 0x7f777535d9d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:46.546220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-980f5d63-c376-48e3-9b8a-7c7c2a94ed97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:46.547363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-980f5d63-c376-48e3-9b8a-7c7c2a94ed97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:46.557290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-980f5d63-c376-48e3-9b8a-7c7c2a94ed97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:46.563610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-980f5d63-c376-48e3-9b8a-7c7c2a94ed97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:46.564588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-980f5d63-c376-48e3-9b8a-7c7c2a94ed97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:46.566222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-980f5d63-c376-48e3-9b8a-7c7c2a94ed97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:46.568013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-980f5d63-c376-48e3-9b8a-7c7c2a94ed97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:46.568870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-980f5d63-c376-48e3-9b8a-7c7c2a94ed97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:47.428192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-980f5d63-c376-48e3-9b8a-7c7c2a94ed97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:47.445903 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-980f5d63-c376-48e3-9b8a-7c7c2a94ed97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.902843 Oct 05 17:52:47.449188 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2367/4456] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:46 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:48.472132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a5d1735a-f9de-4ef8-9732-78137fcf0839 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:48.472973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a5d1735a-f9de-4ef8-9732-78137fcf0839 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:48.489562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d1735a-f9de-4ef8-9732-78137fcf0839 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:48.490338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d1735a-f9de-4ef8-9732-78137fcf0839 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:48.490938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d1735a-f9de-4ef8-9732-78137fcf0839 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:48.491847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d1735a-f9de-4ef8-9732-78137fcf0839 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:48.492459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d1735a-f9de-4ef8-9732-78137fcf0839 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:48.493365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d1735a-f9de-4ef8-9732-78137fcf0839 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:49.121318 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6585eda2-2031-45c1-a6cd-47c8a2c2f539 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/e069fcda-61e4-4070-8497-1fbde4111c7c" status: 202 len: 0 microversion: 2.1 time: 3.125988 Oct 05 17:52:49.122189 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2090/4457] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:52:45 2022] DELETE /compute/v2.1/os-floating-ips/e069fcda-61e4-4070-8497-1fbde4111c7c => generated 0 bytes in 3128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:52:49.140460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a3999ab6-8bd7-4927-8500-f8c96f7c4480 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '.version_select at 0x7f777434c790>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:49.193564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a5d1735a-f9de-4ef8-9732-78137fcf0839 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:49.207737 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a5d1735a-f9de-4ef8-9732-78137fcf0839 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.739444 Oct 05 17:52:49.208239 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2368/4458] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:48 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:49.820295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1265449947", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "1098a5f8-40d7-4546-acdb-0b6d99f89f02"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:49.927586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] validate_networks() for [('1098a5f8-40d7-4546-acdb-0b6d99f89f02', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:52:50.076109 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a3999ab6-8bd7-4927-8500-f8c96f7c4480 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/4c02309a-56aa-4b11-a1b1-06f85ee9a3c1" status: 202 len: 0 microversion: 2.1 time: 0.942688 Oct 05 17:52:50.077267 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2091/4459] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:52:49 2022] DELETE /compute/v2.1/os-security-groups/4c02309a-56aa-4b11-a1b1-06f85ee9a3c1 => generated 0 bytes in 944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:52:50.086557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab42ef14-e252-47d3-a336-2dd64182f4b9 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:50.087315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ab42ef14-e252-47d3-a336-2dd64182f4b9 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:50.112002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab42ef14-e252-47d3-a336-2dd64182f4b9 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:50.112527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab42ef14-e252-47d3-a336-2dd64182f4b9 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:50.113089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab42ef14-e252-47d3-a336-2dd64182f4b9 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:50.115944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab42ef14-e252-47d3-a336-2dd64182f4b9 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:50.115944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab42ef14-e252-47d3-a336-2dd64182f4b9 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:50.118919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab42ef14-e252-47d3-a336-2dd64182f4b9 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:50.177350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ab42ef14-e252-47d3-a336-2dd64182f4b9 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:52:50.401918 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ab42ef14-e252-47d3-a336-2dd64182f4b9 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "DELETE /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 204 len: 0 microversion: 2.1 time: 0.315605 Oct 05 17:52:50.409717 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2092/4460] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:52:50 2022] DELETE /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:52:50.459272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f27821bf-a065-4bca-9fea-09ed556daa20 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:50.460534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f27821bf-a065-4bca-9fea-09ed556daa20 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:50.470433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f27821bf-a065-4bca-9fea-09ed556daa20 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:50.471157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f27821bf-a065-4bca-9fea-09ed556daa20 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:50.471939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f27821bf-a065-4bca-9fea-09ed556daa20 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:50.472980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f27821bf-a065-4bca-9fea-09ed556daa20 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:50.474005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f27821bf-a065-4bca-9fea-09ed556daa20 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:50.474846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f27821bf-a065-4bca-9fea-09ed556daa20 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:50.824534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f27821bf-a065-4bca-9fea-09ed556daa20 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:50.835317 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f27821bf-a065-4bca-9fea-09ed556daa20 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.416034 Oct 05 17:52:50.837397 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2093/4461] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:50 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:50.844623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-393bf949-8d60-4b39-8dda-66d7b42f579e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:50.853470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-393bf949-8d60-4b39-8dda-66d7b42f579e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:50.870619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393bf949-8d60-4b39-8dda-66d7b42f579e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:50.871397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393bf949-8d60-4b39-8dda-66d7b42f579e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:50.872545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393bf949-8d60-4b39-8dda-66d7b42f579e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:50.873452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393bf949-8d60-4b39-8dda-66d7b42f579e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:50.874312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393bf949-8d60-4b39-8dda-66d7b42f579e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:50.875026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-393bf949-8d60-4b39-8dda-66d7b42f579e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:51.529014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-393bf949-8d60-4b39-8dda-66d7b42f579e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:51.544537 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-393bf949-8d60-4b39-8dda-66d7b42f579e tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1509 microversion: 2.1 time: 0.705904 Oct 05 17:52:51.545131 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2094/4462] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:50 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1509 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:51.711750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:52:51.713107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:52:51.713748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:52:51.715054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:52:51.715686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:52:51.737875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:51.740838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:51.741538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:51.743540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:51.744885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:51.747081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:51.810979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Getting quotas for project d8595df03de94371a169df3c7be34376. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:52:51.830535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Getting quotas for user 26a82779aadd4be08ecebeb0dc98f603 and project d8595df03de94371a169df3c7be34376. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:52:51.862244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2e56512-c1de-41f2-b4cf-3ee4eb4563b7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:51.863064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d2e56512-c1de-41f2-b4cf-3ee4eb4563b7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:51.875305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2e56512-c1de-41f2-b4cf-3ee4eb4563b7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:51.878178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2e56512-c1de-41f2-b4cf-3ee4eb4563b7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:51.878857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:52:51.879795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2e56512-c1de-41f2-b4cf-3ee4eb4563b7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:51.882020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2e56512-c1de-41f2-b4cf-3ee4eb4563b7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:51.882708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2e56512-c1de-41f2-b4cf-3ee4eb4563b7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:51.883980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2e56512-c1de-41f2-b4cf-3ee4eb4563b7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:51.889961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:52:52.003122 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-72d6731c-2216-4aa9-a58f-ae76b9633cc2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.454865 Oct 05 17:52:52.013001 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2369/4463] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 17:52:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2465 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 17:52:52.018754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-51ce18c0-984f-43bf-bdbe-bf8723143423 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:52.022082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-51ce18c0-984f-43bf-bdbe-bf8723143423 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:52.145010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-51ce18c0-984f-43bf-bdbe-bf8723143423 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:52.159219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-51ce18c0-984f-43bf-bdbe-bf8723143423 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:52.161974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-51ce18c0-984f-43bf-bdbe-bf8723143423 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:52.163793 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-51ce18c0-984f-43bf-bdbe-bf8723143423 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1262 microversion: 2.26 time: 0.149478 Oct 05 17:52:52.164599 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2370/4464] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:52 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:52.571416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c047c7b2-482f-44a2-acea-99b542975577 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:52.572186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c047c7b2-482f-44a2-acea-99b542975577 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:52.589843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047c7b2-482f-44a2-acea-99b542975577 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:52.598947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047c7b2-482f-44a2-acea-99b542975577 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:52.599565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047c7b2-482f-44a2-acea-99b542975577 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:52.600460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047c7b2-482f-44a2-acea-99b542975577 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:52.601113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047c7b2-482f-44a2-acea-99b542975577 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:52.601645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047c7b2-482f-44a2-acea-99b542975577 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:52.659001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d2e56512-c1de-41f2-b4cf-3ee4eb4563b7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:52.688540 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d2e56512-c1de-41f2-b4cf-3ee4eb4563b7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.831182 Oct 05 17:52:52.690113 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2095/4465] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:51 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:53.192344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:53.193274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:53.212083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:53.214753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:53.215381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:53.218383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:53.219182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:53.219825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:53.389237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:53.427573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:53.432177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:53.438981 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0bbe07d7-2066-40a7-b29b-f59059e6b94a tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1258 microversion: 2.26 time: 0.250287 Oct 05 17:52:53.440704 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2096/4466] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:53 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1258 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:52:53.718206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c047c7b2-482f-44a2-acea-99b542975577 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:53.730058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f10d8b80-b33e-4104-bc1d-2b3a75b9acd8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:53.732778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f10d8b80-b33e-4104-bc1d-2b3a75b9acd8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:53.742824 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c047c7b2-482f-44a2-acea-99b542975577 tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1509 microversion: 2.1 time: 1.175286 Oct 05 17:52:53.743975 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2371/4467] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:52 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1509 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:53.761550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10d8b80-b33e-4104-bc1d-2b3a75b9acd8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:53.763007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10d8b80-b33e-4104-bc1d-2b3a75b9acd8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:53.763396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10d8b80-b33e-4104-bc1d-2b3a75b9acd8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:53.765688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10d8b80-b33e-4104-bc1d-2b3a75b9acd8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:53.768528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10d8b80-b33e-4104-bc1d-2b3a75b9acd8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:53.769296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f10d8b80-b33e-4104-bc1d-2b3a75b9acd8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:54.029893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f10d8b80-b33e-4104-bc1d-2b3a75b9acd8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:54.046672 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f10d8b80-b33e-4104-bc1d-2b3a75b9acd8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.335551 Oct 05 17:52:54.049086 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2097/4468] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:53 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:54.470043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:54.471089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:54.481861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:54.482900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:54.483980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:54.485331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:54.485961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:54.487194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:54.688145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:54.700815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:54.708754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:54.713322 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a0dd11b1-16ce-46c6-aa27-bff1b77354c4 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1320 microversion: 2.26 time: 0.247559 Oct 05 17:52:54.717291 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2372/4469] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:54 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1320 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:54.769138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-816a616e-09bb-4618-9d90-f65050060f2f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:54.769752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-816a616e-09bb-4618-9d90-f65050060f2f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:54.788473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-816a616e-09bb-4618-9d90-f65050060f2f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:54.790518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-816a616e-09bb-4618-9d90-f65050060f2f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:54.791748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-816a616e-09bb-4618-9d90-f65050060f2f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:54.795800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-816a616e-09bb-4618-9d90-f65050060f2f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:54.796716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-816a616e-09bb-4618-9d90-f65050060f2f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:54.797549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-816a616e-09bb-4618-9d90-f65050060f2f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:55.076156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9fae5846-8025-438e-9505-421320950bc5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:55.077588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9fae5846-8025-438e-9505-421320950bc5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:55.098756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fae5846-8025-438e-9505-421320950bc5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:55.101601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fae5846-8025-438e-9505-421320950bc5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:55.102246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fae5846-8025-438e-9505-421320950bc5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:55.103097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fae5846-8025-438e-9505-421320950bc5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:55.105700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fae5846-8025-438e-9505-421320950bc5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:55.107534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9fae5846-8025-438e-9505-421320950bc5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:55.576727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9fae5846-8025-438e-9505-421320950bc5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:55.606684 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9fae5846-8025-438e-9505-421320950bc5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.529655 Oct 05 17:52:55.611397 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2373/4470] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:55 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:52:55.644892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-816a616e-09bb-4618-9d90-f65050060f2f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e9085c15c5e41b4b902f223a8558a87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24b4c2cb71624ca2828cdb3e38d779bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:55.662745 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-816a616e-09bb-4618-9d90-f65050060f2f tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 200 len: 1509 microversion: 2.1 time: 0.899819 Oct 05 17:52:55.667322 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2098/4471] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:54 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 1509 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:55.714521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-865f60e2-28de-417b-8b9c-af93bc293ece req-59ed4149-bd56-4ab8-bd6b-f325b1d13eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "965c02cf-92d4-4b35-90ec-83b1588eb735", "name": "network-vif-deleted", "tag": "5ea43710-6e71-4e06-adfb-3fe2a9166d65"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:55.743922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-865f60e2-28de-417b-8b9c-af93bc293ece req-59ed4149-bd56-4ab8-bd6b-f325b1d13eb5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:55.744408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-865f60e2-28de-417b-8b9c-af93bc293ece req-59ed4149-bd56-4ab8-bd6b-f325b1d13eb5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:55.745017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-865f60e2-28de-417b-8b9c-af93bc293ece req-59ed4149-bd56-4ab8-bd6b-f325b1d13eb5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:55.779479 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-865f60e2-28de-417b-8b9c-af93bc293ece req-59ed4149-bd56-4ab8-bd6b-f325b1d13eb5 service nova] Creating event network-vif-deleted:5ea43710-6e71-4e06-adfb-3fe2a9166d65 for instance 965c02cf-92d4-4b35-90ec-83b1588eb735 on n-h1-835595-3 Oct 05 17:52:55.805774 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-865f60e2-28de-417b-8b9c-af93bc293ece req-59ed4149-bd56-4ab8-bd6b-f325b1d13eb5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100582 Oct 05 17:52:55.807464 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2099/4472] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:55.820007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:55.824970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:55.845964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:55.846498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:55.847111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:55.847830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:55.848285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:55.848709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:56.009618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:56.027233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:56.029223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:56.033086 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4c84391f-114b-4f6b-82f5-d32c8a319c50 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1320 microversion: 2.26 time: 0.220282 Oct 05 17:52:56.033703 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2100/4473] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:55 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:52:56.226589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c7037515-1790-4438-8c64-2fee9dd4c9ce req-691992e1-534c-49d3-858f-93b5d988d45d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6058f114-d9d4-47fd-b7e0-d8691f8ef2ba", "name": "network-vif-plugged", "status": "completed", "tag": "b0118119-e3ce-4dcf-922e-7af3fe81b08a"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:56.249937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c7037515-1790-4438-8c64-2fee9dd4c9ce req-691992e1-534c-49d3-858f-93b5d988d45d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:56.250474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c7037515-1790-4438-8c64-2fee9dd4c9ce req-691992e1-534c-49d3-858f-93b5d988d45d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:56.254396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c7037515-1790-4438-8c64-2fee9dd4c9ce req-691992e1-534c-49d3-858f-93b5d988d45d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:56.304423 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c7037515-1790-4438-8c64-2fee9dd4c9ce req-691992e1-534c-49d3-858f-93b5d988d45d service nova] Creating event network-vif-plugged:b0118119-e3ce-4dcf-922e-7af3fe81b08a for instance 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba on n-h1-835595-3 Oct 05 17:52:56.319764 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c7037515-1790-4438-8c64-2fee9dd4c9ce req-691992e1-534c-49d3-858f-93b5d988d45d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.706885 Oct 05 17:52:56.321036 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2374/4474] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:56.637101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bf9e1299-0313-4089-ac68-9f0702b07bd3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:56.637805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bf9e1299-0313-4089-ac68-9f0702b07bd3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:56.653823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf9e1299-0313-4089-ac68-9f0702b07bd3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:56.655211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf9e1299-0313-4089-ac68-9f0702b07bd3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:56.656350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf9e1299-0313-4089-ac68-9f0702b07bd3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:56.657901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf9e1299-0313-4089-ac68-9f0702b07bd3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:56.661007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf9e1299-0313-4089-ac68-9f0702b07bd3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:56.664715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf9e1299-0313-4089-ac68-9f0702b07bd3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:56.691468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:56.692180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] [instance: 965c02cf-92d4-4b35-90ec-83b1588eb735] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:56.713277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:56.719473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:56.720498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:56.721274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:56.723087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:56.723526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:56.779621 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] HTTP exception thrown: Instance 965c02cf-92d4-4b35-90ec-83b1588eb735 could not be found. Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Request method failure captured: Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 HTTP/1.1 Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcQUmF3QlUR0z0W5H2R4l3Mv4V5i8zzGIN2zrby7Dv8lU_5WHauY4yV8pGv6HXrk2upLMXKB9N536fpyTZY4BkUo7pfpCrVptmrTi6Q70IMhyWsI5EkKHBkdj58jbjyDtcdyNx88Ihas6ScBsqOTQVdtNR42f-sn5wcDPQ3C1o3VTRA Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 24b4c2cb71624ca2828cdb3e38d779bd Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1929919261 Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/24b4c2cb71624ca2828cdb3e38d779bd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24b4c2cb71624ca2828cdb3e38d779bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_24b4c2cb71624ca2828cdb3e38d779bd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/24b4c2cb71624ca2828cdb3e38d779bd"}]}] Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1929919261 Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 24b4c2cb71624ca2828cdb3e38d779bd Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1929919261 Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerRescueTestJSONUnderV235-1929919261-project Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4e9085c15c5e41b4b902f223a8558a87 Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1929919261-project Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 965c02cf-92d4-4b35-90ec-83b1588eb735 could not be found. Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '965c02cf-92d4-4b35-90ec-83b1588eb735'} Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 965c02cf-92d4-4b35-90ec-83b1588eb735 could not be found. Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 965c02cf-92d4-4b35-90ec-83b1588eb735 could not be found. Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:56.780882 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:52:56.785228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:56.785228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:52:56.785228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:52:56.785228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:52:56.785228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:52:56.785228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:52:56.785228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 965c02cf-92d4-4b35-90ec-83b1588eb735 could not be found. Oct 05 17:52:56.785228 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:52:56.785228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] Returning 404 to user: Instance 965c02cf-92d4-4b35-90ec-83b1588eb735 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:52:56.792056 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-baafb886-9af2-4ddc-a285-bc9635c424eb tempest-ServerRescueTestJSONUnderV235-1929919261 tempest-ServerRescueTestJSONUnderV235-1929919261-project] 10.222.0.70 "GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735" status: 404 len: 111 microversion: 2.1 time: 0.106732 Oct 05 17:52:56.796824 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2375/4475] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:56 2022] GET /compute/v2.1/servers/965c02cf-92d4-4b35-90ec-83b1588eb735 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:52:57.061879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:57.062626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:57.073743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:57.074243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:57.078950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:57.079730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:57.080195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:57.085055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:57.101250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=82,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:57.217194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bf9e1299-0313-4089-ac68-9f0702b07bd3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:57.231768 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bf9e1299-0313-4089-ac68-9f0702b07bd3 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1316 microversion: 2.1 time: 0.599809 Oct 05 17:52:57.247085 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2101/4476] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:56 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1316 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:57.739876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:57.803142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:57.817696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:57.822980 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b530e895-0320-4717-90ac-adad2dcb3f65 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1362 microversion: 2.26 time: 0.763098 Oct 05 17:52:57.826778 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2376/4477] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:57 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1362 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:52:58.263457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9d9107ae-fcc0-4534-bbda-77b7b993ebb4 req-bd7f0f60-afea-43d1-a95b-7391b1943989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9df49402-0559-45cd-b453-ed262dd67cfb", "tag": "b4568980-a238-4914-975e-8a76a37137f1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:52:58.264874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e3dbb640-97f6-44e6-9ac3-e30bb2783231 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:58.265612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e3dbb640-97f6-44e6-9ac3-e30bb2783231 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:58.291831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3dbb640-97f6-44e6-9ac3-e30bb2783231 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:58.292093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9d9107ae-fcc0-4534-bbda-77b7b993ebb4 req-bd7f0f60-afea-43d1-a95b-7391b1943989 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:58.292339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3dbb640-97f6-44e6-9ac3-e30bb2783231 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:58.292490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9d9107ae-fcc0-4534-bbda-77b7b993ebb4 req-bd7f0f60-afea-43d1-a95b-7391b1943989 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:58.294011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3dbb640-97f6-44e6-9ac3-e30bb2783231 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:58.294156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9d9107ae-fcc0-4534-bbda-77b7b993ebb4 req-bd7f0f60-afea-43d1-a95b-7391b1943989 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:58.296759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3dbb640-97f6-44e6-9ac3-e30bb2783231 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:58.299789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3dbb640-97f6-44e6-9ac3-e30bb2783231 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:58.300478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3dbb640-97f6-44e6-9ac3-e30bb2783231 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:58.324253 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9d9107ae-fcc0-4534-bbda-77b7b993ebb4 req-bd7f0f60-afea-43d1-a95b-7391b1943989 service nova] Creating event network-changed:b4568980-a238-4914-975e-8a76a37137f1 for instance 9df49402-0559-45cd-b453-ed262dd67cfb on n-h2-835595-3 Oct 05 17:52:58.335188 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9d9107ae-fcc0-4534-bbda-77b7b993ebb4 req-bd7f0f60-afea-43d1-a95b-7391b1943989 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081081 Oct 05 17:52:58.340594 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2377/4478] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:52:58.343611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:52:58.637002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e3dbb640-97f6-44e6-9ac3-e30bb2783231 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:58.651515 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e3dbb640-97f6-44e6-9ac3-e30bb2783231 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1466 microversion: 2.1 time: 0.395000 Oct 05 17:52:58.653288 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2102/4479] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:58 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1466 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:58.679410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-961c3d49-a05e-4c00-a57a-87d5ed806e7a tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:58.680513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-961c3d49-a05e-4c00-a57a-87d5ed806e7a tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:58.693355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961c3d49-a05e-4c00-a57a-87d5ed806e7a tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:58.698501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961c3d49-a05e-4c00-a57a-87d5ed806e7a tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:58.699123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961c3d49-a05e-4c00-a57a-87d5ed806e7a tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:58.700030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961c3d49-a05e-4c00-a57a-87d5ed806e7a tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:58.703319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961c3d49-a05e-4c00-a57a-87d5ed806e7a tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:58.703995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-961c3d49-a05e-4c00-a57a-87d5ed806e7a tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:58.857883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:58.858567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:58.875025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:58.878299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:58.878809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:58.879565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:58.880481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:58.881799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:59.024824 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-961c3d49-a05e-4c00-a57a-87d5ed806e7a tempest-ServersOnMultiNodesTest-1059057604 tempest-ServersOnMultiNodesTest-1059057604-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1617 microversion: 2.1 time: 0.350687 Oct 05 17:52:59.027306 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2378/4480] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:58 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1617 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:52:59.055527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9181ebc8-7295-4299-9322-a8af7a9f3e3c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:59.056416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9181ebc8-7295-4299-9322-a8af7a9f3e3c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:59.082524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9181ebc8-7295-4299-9322-a8af7a9f3e3c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:59.083047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9181ebc8-7295-4299-9322-a8af7a9f3e3c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:59.083455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9181ebc8-7295-4299-9322-a8af7a9f3e3c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:59.084171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9181ebc8-7295-4299-9322-a8af7a9f3e3c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:59.084615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9181ebc8-7295-4299-9322-a8af7a9f3e3c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:59.085219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9181ebc8-7295-4299-9322-a8af7a9f3e3c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:59.169123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9181ebc8-7295-4299-9322-a8af7a9f3e3c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:52:59.274476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:59.291670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:59.299959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:59.309049 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a5ac7b4c-286e-48f9-9dbb-84d9da7891d7 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1362 microversion: 2.26 time: 0.456586 Oct 05 17:52:59.311809 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2103/4481] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:52:58 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1362 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:52:59.369620 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9181ebc8-7295-4299-9322-a8af7a9f3e3c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 204 len: 0 microversion: 2.1 time: 0.321545 Oct 05 17:52:59.370248 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2379/4482] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:52:59 2022] DELETE /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:52:59.389186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-08392a64-9e7e-41cc-a79f-b36070a089a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:52:59.391080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-08392a64-9e7e-41cc-a79f-b36070a089a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:52:59.399625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08392a64-9e7e-41cc-a79f-b36070a089a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:59.400505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08392a64-9e7e-41cc-a79f-b36070a089a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:59.401159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08392a64-9e7e-41cc-a79f-b36070a089a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:59.402418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08392a64-9e7e-41cc-a79f-b36070a089a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:52:59.403728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08392a64-9e7e-41cc-a79f-b36070a089a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:52:59.404517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08392a64-9e7e-41cc-a79f-b36070a089a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:52:59.622927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08392a64-9e7e-41cc-a79f-b36070a089a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:52:59.632331 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-08392a64-9e7e-41cc-a79f-b36070a089a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1472 microversion: 2.1 time: 0.257704 Oct 05 17:52:59.633444 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2104/4483] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:52:59 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1472 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:00.343133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:00.344628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:00.366111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:00.367328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:00.374575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:00.375403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:00.375876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:00.376310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:00.658137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e51da2ec-5592-474b-8c6e-d9402eeb9126 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:00.658761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e51da2ec-5592-474b-8c6e-d9402eeb9126 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:00.671189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e51da2ec-5592-474b-8c6e-d9402eeb9126 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:00.671757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e51da2ec-5592-474b-8c6e-d9402eeb9126 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:00.672197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e51da2ec-5592-474b-8c6e-d9402eeb9126 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:00.672917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e51da2ec-5592-474b-8c6e-d9402eeb9126 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:00.673376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e51da2ec-5592-474b-8c6e-d9402eeb9126 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:00.683004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e51da2ec-5592-474b-8c6e-d9402eeb9126 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:01.650811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:01.664585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:01.666235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:01.667438 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-585bcf0e-6c1a-4aa4-b765-e84f64e6fdb3 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1362 microversion: 2.26 time: 1.331064 Oct 05 17:53:01.672833 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2380/4484] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:00 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1362 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:01.736261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e51da2ec-5592-474b-8c6e-d9402eeb9126 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:01.756124 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e51da2ec-5592-474b-8c6e-d9402eeb9126 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1472 microversion: 2.1 time: 1.099511 Oct 05 17:53:01.757500 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2105/4485] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:00 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1472 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:53:02.599191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ab6eb3ad-b4d6-410c-8387-5d416d859396 req-36b77c0f-ea09-4d9d-9a4c-ec721c02b74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6058f114-d9d4-47fd-b7e0-d8691f8ef2ba", "name": "network-vif-deleted", "tag": "b0118119-e3ce-4dcf-922e-7af3fe81b08a"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:02.617704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:02.619968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:02.629599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ab6eb3ad-b4d6-410c-8387-5d416d859396 req-36b77c0f-ea09-4d9d-9a4c-ec721c02b74e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:02.630510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ab6eb3ad-b4d6-410c-8387-5d416d859396 req-36b77c0f-ea09-4d9d-9a4c-ec721c02b74e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:02.631288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ab6eb3ad-b4d6-410c-8387-5d416d859396 req-36b77c0f-ea09-4d9d-9a4c-ec721c02b74e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:02.663638 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ab6eb3ad-b4d6-410c-8387-5d416d859396 req-36b77c0f-ea09-4d9d-9a4c-ec721c02b74e service nova] Creating event network-vif-deleted:b0118119-e3ce-4dcf-922e-7af3fe81b08a for instance 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba on n-h1-835595-3 Oct 05 17:53:02.676486 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ab6eb3ad-b4d6-410c-8387-5d416d859396 req-36b77c0f-ea09-4d9d-9a4c-ec721c02b74e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081429 Oct 05 17:53:02.678727 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2381/4486] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:02.693240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:02.693671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:02.719124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:02.719474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:02.719887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:02.720603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:02.721042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:02.721829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:02.798861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:02.800050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:02.810479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:02.811262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:02.811944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:02.813915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:02.814542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:02.815330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:02.907432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:02.908552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:02.910118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:02.910894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lazy-loading 'fault' on Instance uuid 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:03.238131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:03.254609 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0db73aaa-c404-47de-93b3-ece8a321bf8f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 200 len: 1306 microversion: 2.1 time: 0.475769 Oct 05 17:53:03.255219 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2382/4487] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:02 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 1306 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:03.268986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:03.277199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:03.278704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:03.295166 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1dd7cba2-cafa-4de9-8dc9-f721c4f93e1f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1362 microversion: 2.26 time: 0.605827 Oct 05 17:53:03.310619 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2106/4488] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:02 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1362 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:03.970796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a9256b9-6041-417d-b906-dcf9a7e1e79d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'create', calling method: .version_select at 0x7f77740d3820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1969127260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnSQ9nF1DefqVNdq9rMJZ2tjh1NOX4WQFlJkWjIq4f7776PtqOkDfxUsRrvfE6HIrKJFw0jfhQkR3ZXR7NcRcooYf2jpOLdbIdKSPQGFt6eDufYEMw4BARwsr6FZLjjZA=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:04.026140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9a9256b9-6041-417d-b906-dcf9a7e1e79d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:53:04.059950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9a9256b9-6041-417d-b906-dcf9a7e1e79d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for user 06d379a97d474b74a29e62848a4e4696 and project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:53:04.117709 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a9256b9-6041-417d-b906-dcf9a7e1e79d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.511341 Oct 05 17:53:04.118699 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2383/4489] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:53:03 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:04.279206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:04.280025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:04.303004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:04.303501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:04.303942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:04.304662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:04.305116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:04.305536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:04.328045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:04.328664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:04.342101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:04.342636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:04.347238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:04.352282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:04.352774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:04.353208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:04.403998 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] HTTP exception thrown: Instance 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba could not be found. Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Request method failure captured: Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba HTTP/1.1 Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPPFtxqN7OJ2tSq8Z6kZ1F1V29UfBavlxJsEUtebkivrobdBh4ZNnPHiDHKe9sWSp4OiMXp3s7tmDOr0QSg4nJI8aD-s-T1lZihFG8nZsOhFrnvT7iiSkfpy0-vSMOuon7gSJXAZARlz8HYSW6z_XLc0a6PSxY78f7eXNikBFy8rD4 Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4809bb6013894d13a894acb816f7dca8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}] Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f9ba173edb2b403493b6a65942cf6bab Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba could not be found. Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '6058f114-d9d4-47fd-b7e0-d8691f8ef2ba'} Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba could not be found. Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba could not be found. Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:04.414900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:04.419770 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:04.419770 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:04.419770 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:04.419770 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:04.419770 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:04.419770 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba could not be found. Oct 05 17:53:04.419770 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:04.421058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Returning 404 to user: Instance 6058f114-d9d4-47fd-b7e0-d8691f8ef2ba could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:04.426084 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2a85b609-2d07-43a3-b6bb-da12cdf3ec00 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba" status: 404 len: 111 microversion: 2.1 time: 0.149417 Oct 05 17:53:04.428297 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2107/4490] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:04 2022] GET /compute/v2.1/servers/6058f114-d9d4-47fd-b7e0-d8691f8ef2ba => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:53:04.448612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f26a5cc3-8819-471c-8e7e-e35f06381105 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:04.454788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f26a5cc3-8819-471c-8e7e-e35f06381105 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:04.467782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f26a5cc3-8819-471c-8e7e-e35f06381105 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:04.469974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f26a5cc3-8819-471c-8e7e-e35f06381105 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:04.472117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f26a5cc3-8819-471c-8e7e-e35f06381105 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:04.474558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f26a5cc3-8819-471c-8e7e-e35f06381105 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:04.476363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f26a5cc3-8819-471c-8e7e-e35f06381105 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:04.477109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f26a5cc3-8819-471c-8e7e-e35f06381105 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:04.560441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f26a5cc3-8819-471c-8e7e-e35f06381105 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:53:04.740894 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f26a5cc3-8819-471c-8e7e-e35f06381105 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 204 len: 0 microversion: 2.1 time: 0.306856 Oct 05 17:53:04.744343 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2108/4491] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:53:04 2022] DELETE /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:53:04.757276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-50eda8d2-d3ce-467d-9feb-00c77e635424 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:04.759081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-50eda8d2-d3ce-467d-9feb-00c77e635424 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:04.768941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50eda8d2-d3ce-467d-9feb-00c77e635424 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:04.769953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50eda8d2-d3ce-467d-9feb-00c77e635424 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:04.770653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50eda8d2-d3ce-467d-9feb-00c77e635424 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:04.772495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50eda8d2-d3ce-467d-9feb-00c77e635424 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:04.773355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50eda8d2-d3ce-467d-9feb-00c77e635424 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:04.774720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50eda8d2-d3ce-467d-9feb-00c77e635424 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:04.844776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:04.854986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:04.856430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:04.857587 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3b00044-bdce-4c8b-afc0-b7200600669c tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1362 microversion: 2.26 time: 0.534139 Oct 05 17:53:04.868623 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2384/4492] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:04 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:05.216481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50eda8d2-d3ce-467d-9feb-00c77e635424 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:05.253452 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-50eda8d2-d3ce-467d-9feb-00c77e635424 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1473 microversion: 2.1 time: 0.503793 Oct 05 17:53:05.281371 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2109/4493] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:04 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1473 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:53:05.906499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:05.907154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:05.938740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:05.939569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:05.940115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:05.941007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:05.941781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:05.942475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:06.285221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c14b9e75-63ee-4ba2-b91c-7e9cfcbbd527 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:06.286592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c14b9e75-63ee-4ba2-b91c-7e9cfcbbd527 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:06.303776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c14b9e75-63ee-4ba2-b91c-7e9cfcbbd527 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:06.304280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c14b9e75-63ee-4ba2-b91c-7e9cfcbbd527 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:06.304712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c14b9e75-63ee-4ba2-b91c-7e9cfcbbd527 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:06.305685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c14b9e75-63ee-4ba2-b91c-7e9cfcbbd527 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:06.306098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c14b9e75-63ee-4ba2-b91c-7e9cfcbbd527 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:06.306556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c14b9e75-63ee-4ba2-b91c-7e9cfcbbd527 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:06.389860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:06.402750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:06.404222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:06.415498 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5f4dffc9-e4fa-4369-92d4-06ee315666f0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1362 microversion: 2.26 time: 0.520009 Oct 05 17:53:06.418053 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2385/4494] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:05 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1362 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:06.710172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c14b9e75-63ee-4ba2-b91c-7e9cfcbbd527 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:06.719770 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c14b9e75-63ee-4ba2-b91c-7e9cfcbbd527 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1473 microversion: 2.1 time: 0.438970 Oct 05 17:53:06.735190 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2110/4495] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:06 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1473 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:53:07.450233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:07.453277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:07.469728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:07.471380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:07.477888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-47dec209-c729-401c-94eb-2a7a78ca6c8f req-2ca54fb6-3fdd-4514-9f20-49c49df840c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d8a7cb4-80c2-4ac1-bc2c-2647d3111697", "name": "network-vif-deleted", "tag": "c1bd9e9c-7035-4f99-84c8-5d5b5359b755"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:07.484368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:07.490590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:07.491339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:07.495894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:07.518635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-47dec209-c729-401c-94eb-2a7a78ca6c8f req-2ca54fb6-3fdd-4514-9f20-49c49df840c6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:07.528246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-47dec209-c729-401c-94eb-2a7a78ca6c8f req-2ca54fb6-3fdd-4514-9f20-49c49df840c6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:07.534559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-47dec209-c729-401c-94eb-2a7a78ca6c8f req-2ca54fb6-3fdd-4514-9f20-49c49df840c6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:07.571927 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-47dec209-c729-401c-94eb-2a7a78ca6c8f req-2ca54fb6-3fdd-4514-9f20-49c49df840c6 service nova] Creating event network-vif-deleted:c1bd9e9c-7035-4f99-84c8-5d5b5359b755 for instance 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 on n-h2-835595-3 Oct 05 17:53:07.606538 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-47dec209-c729-401c-94eb-2a7a78ca6c8f req-2ca54fb6-3fdd-4514-9f20-49c49df840c6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132309 Oct 05 17:53:07.607174 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2111/4496] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:53:07.752895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:07.753700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:07.768038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:07.773592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:07.778511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:07.783263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:07.784011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:07.784460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:07.969725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:07.970715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:07.971342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:07.973351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lazy-loading 'fault' on Instance uuid 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:08.015445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:08.027270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:08.034424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:08.056921 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c14171ba-8310-40cc-8b76-c0abe6f9f7fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1362 microversion: 2.26 time: 0.611363 Oct 05 17:53:08.061429 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2386/4497] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:07 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1362 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:08.114177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:08.124690 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d2c1ebbd-0188-40d8-b5d5-2ff370656cf2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 200 len: 1307 microversion: 2.1 time: 0.382373 Oct 05 17:53:08.139213 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2112/4498] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:07 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:08.713462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a4e9383d-bfc5-4be5-bfb2-ae62265c3285 req-9b3acd27-1737-4559-87a8-1a6040a6d122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df49402-0559-45cd-b453-ed262dd67cfb", "name": "network-vif-plugged", "status": "completed", "tag": "b4568980-a238-4914-975e-8a76a37137f1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:08.746705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a4e9383d-bfc5-4be5-bfb2-ae62265c3285 req-9b3acd27-1737-4559-87a8-1a6040a6d122 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:08.747192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a4e9383d-bfc5-4be5-bfb2-ae62265c3285 req-9b3acd27-1737-4559-87a8-1a6040a6d122 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:08.747619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a4e9383d-bfc5-4be5-bfb2-ae62265c3285 req-9b3acd27-1737-4559-87a8-1a6040a6d122 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:08.771794 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a4e9383d-bfc5-4be5-bfb2-ae62265c3285 req-9b3acd27-1737-4559-87a8-1a6040a6d122 service nova] Creating event network-vif-plugged:b4568980-a238-4914-975e-8a76a37137f1 for instance 9df49402-0559-45cd-b453-ed262dd67cfb on n-h2-835595-3 Oct 05 17:53:08.792317 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a4e9383d-bfc5-4be5-bfb2-ae62265c3285 req-9b3acd27-1737-4559-87a8-1a6040a6d122 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085045 Oct 05 17:53:08.792935 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2387/4499] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:09.087500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:09.088363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:09.100518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:09.101125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:09.102547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:09.103981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:09.104753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:09.105535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:09.158312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:09.160561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:09.174169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:09.175266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:09.176068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:09.177148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:09.177959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:09.178559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:09.201213 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] HTTP exception thrown: Instance 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 could not be found. Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Request method failure captured: Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 HTTP/1.1 Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcPPFtxqN7OJ2tSq8Z6kZ1F1V29UfBavlxJsEUtebkivrobdBh4ZNnPHiDHKe9sWSp4OiMXp3s7tmDOr0QSg4nJI8aD-s-T1lZihFG8nZsOhFrnvT7iiSkfpy0-vSMOuon7gSJXAZARlz8HYSW6z_XLc0a6PSxY78f7eXNikBFy8rD4 Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4809bb6013894d13a894acb816f7dca8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}] Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f9ba173edb2b403493b6a65942cf6bab Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 could not be found. Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '0d8a7cb4-80c2-4ac1-bc2c-2647d3111697'} Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 could not be found. Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 could not be found. Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:09.205162 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:09.209952 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:09.209952 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:09.209952 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:09.209952 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:09.209952 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:09.209952 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 could not be found. Oct 05 17:53:09.209952 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:09.211827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Returning 404 to user: Instance 0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:09.215198 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0377396c-9efe-4d84-b49f-f5dcb2922a30 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697" status: 404 len: 111 microversion: 2.1 time: 0.068352 Oct 05 17:53:09.215996 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2388/4500] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:09 2022] GET /compute/v2.1/servers/0d8a7cb4-80c2-4ac1-bc2c-2647d3111697 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:53:09.230266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2b59cf4a-5d0f-4db3-b122-3dded93706f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:09.231943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2b59cf4a-5d0f-4db3-b122-3dded93706f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:09.247009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b59cf4a-5d0f-4db3-b122-3dded93706f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:09.248432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b59cf4a-5d0f-4db3-b122-3dded93706f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:09.251172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b59cf4a-5d0f-4db3-b122-3dded93706f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:09.253143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b59cf4a-5d0f-4db3-b122-3dded93706f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:09.253629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b59cf4a-5d0f-4db3-b122-3dded93706f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:09.254192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b59cf4a-5d0f-4db3-b122-3dded93706f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:09.322772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2b59cf4a-5d0f-4db3-b122-3dded93706f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:53:09.400179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:09.416316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:09.419769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:09.420926 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f01b9a85-658b-4e19-8946-ab2f6d4828fb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1362 microversion: 2.26 time: 0.339679 Oct 05 17:53:09.427372 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2113/4501] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:09 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:09.492872 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2b59cf4a-5d0f-4db3-b122-3dded93706f7 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "DELETE /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 204 len: 0 microversion: 2.1 time: 0.272117 Oct 05 17:53:09.497411 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2389/4502] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:53:09 2022] DELETE /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:53:09.505143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5e01b80f-f688-4744-9c3a-8e8315c99e6f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:09.506252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5e01b80f-f688-4744-9c3a-8e8315c99e6f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:09.512801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e01b80f-f688-4744-9c3a-8e8315c99e6f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:09.513549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e01b80f-f688-4744-9c3a-8e8315c99e6f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:09.514143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e01b80f-f688-4744-9c3a-8e8315c99e6f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:09.515311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e01b80f-f688-4744-9c3a-8e8315c99e6f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:09.515952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e01b80f-f688-4744-9c3a-8e8315c99e6f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:09.516714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e01b80f-f688-4744-9c3a-8e8315c99e6f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:09.807008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5e01b80f-f688-4744-9c3a-8e8315c99e6f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:09.821692 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5e01b80f-f688-4744-9c3a-8e8315c99e6f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1473 microversion: 2.1 time: 0.317668 Oct 05 17:53:09.824496 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2114/4503] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:09 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1473 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:10.245506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7435fbe3-f23f-4428-a88e-121b8fc6a04c tempest-ExtensionsTest-2062236406 tempest-ExtensionsTest-2062236406-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:10.249060 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7435fbe3-f23f-4428-a88e-121b8fc6a04c tempest-ExtensionsTest-2062236406 tempest-ExtensionsTest-2062236406-project] 10.222.0.70 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.381083 Oct 05 17:53:10.250756 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2390/4504] 10.222.0.70 () {58 vars in 1170 bytes} [Wed Oct 5 17:53:09 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:10.262734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-098f0fc5-f41f-4a1d-b68b-955d2adb9d0f tempest-ExtensionsTest-2062236406 tempest-ExtensionsTest-2062236406-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:10.267164 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-098f0fc5-f41f-4a1d-b68b-955d2adb9d0f tempest-ExtensionsTest-2062236406 tempest-ExtensionsTest-2062236406-project] 10.222.0.70 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.011768 Oct 05 17:53:10.269246 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2115/4505] 10.222.0.70 () {58 vars in 1134 bytes} [Wed Oct 5 17:53:10 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:53:10.448672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:10.449736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:10.456515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:10.457923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:10.458603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:10.459804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:10.460722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:10.461493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:10.763029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:10.774035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:10.775650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:10.776943 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e3fffd83-be0c-4240-ba29-685bb447d85d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1362 microversion: 2.26 time: 0.332342 Oct 05 17:53:10.778107 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2391/4506] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:10 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1362 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:10.849596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-11654cf7-f397-462b-948d-b6250603d8d1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:10.850831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-11654cf7-f397-462b-948d-b6250603d8d1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:10.864833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11654cf7-f397-462b-948d-b6250603d8d1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:10.868619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11654cf7-f397-462b-948d-b6250603d8d1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:10.869186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11654cf7-f397-462b-948d-b6250603d8d1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:10.870000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11654cf7-f397-462b-948d-b6250603d8d1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:10.870563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11654cf7-f397-462b-948d-b6250603d8d1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:10.871226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11654cf7-f397-462b-948d-b6250603d8d1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:11.039276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-11654cf7-f397-462b-948d-b6250603d8d1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:11.051413 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-11654cf7-f397-462b-948d-b6250603d8d1 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1473 microversion: 2.1 time: 0.206451 Oct 05 17:53:11.054424 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2116/4507] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:10 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1473 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:11.806948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:11.807702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:11.825011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:11.825531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:11.825978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:11.826757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:11.827213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:11.833109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:11.894203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d857275d-e630-4d7d-9549-91096223cd7f req-cce597a6-ecb7-4bed-b638-96516bb9ce8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048ef2f6-9aa3-4c95-ad02-641dbc67680c", "name": "network-vif-deleted", "tag": "537edeaa-e0fc-471d-b966-0beb77f35cab"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:11.922583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d857275d-e630-4d7d-9549-91096223cd7f req-cce597a6-ecb7-4bed-b638-96516bb9ce8d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:11.927499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d857275d-e630-4d7d-9549-91096223cd7f req-cce597a6-ecb7-4bed-b638-96516bb9ce8d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:11.933879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d857275d-e630-4d7d-9549-91096223cd7f req-cce597a6-ecb7-4bed-b638-96516bb9ce8d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:11.957815 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d857275d-e630-4d7d-9549-91096223cd7f req-cce597a6-ecb7-4bed-b638-96516bb9ce8d service nova] Creating event network-vif-deleted:537edeaa-e0fc-471d-b966-0beb77f35cab for instance 048ef2f6-9aa3-4c95-ad02-641dbc67680c on n-h2-835595-3 Oct 05 17:53:11.975718 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d857275d-e630-4d7d-9549-91096223cd7f req-cce597a6-ecb7-4bed-b638-96516bb9ce8d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088635 Oct 05 17:53:11.976956 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2117/4508] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:12.074958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:12.075675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:12.094566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.095082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.095703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.096896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.097523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.098113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.163108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.167944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.168603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.169235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lazy-loading 'fault' on Instance uuid 048ef2f6-9aa3-4c95-ad02-641dbc67680c {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:12.268313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:12.283869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:12.289900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:12.300967 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-59bee9da-2460-4596-8718-59af74567c41 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1547 microversion: 2.26 time: 0.499629 Oct 05 17:53:12.302564 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2392/4509] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:11 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1547 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 17:53:12.332594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f77740fc820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:12.353289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.354549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.356412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.357072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:12.366365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.367118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.367871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.369096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.369824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.370427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.407671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:12.417388 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-147025ba-8819-4b22-ae2c-4ba34361b19d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 200 len: 1307 microversion: 2.1 time: 0.346522 Oct 05 17:53:12.418023 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2118/4510] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:12 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 1307 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:53:12.442611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.443222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.444849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.484462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:12.486087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.486572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.487008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.535500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:12.559127 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2ea2d02-f089-441d-8b2a-66400a967527 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-1450572657" status: 201 len: 0 microversion: 2.26 time: 0.233584 Oct 05 17:53:12.564476 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2393/4511] 10.222.0.70 () {62 vars in 1380 bytes} [Wed Oct 5 17:53:12 2022] PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-1450572657 => generated 0 bytes in 238 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 05 17:53:12.572946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ba5ee630-47db-4d50-9c4a-b14146844987 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f77742ee9d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:12.580147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba5ee630-47db-4d50-9c4a-b14146844987 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.580651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba5ee630-47db-4d50-9c4a-b14146844987 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.581109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba5ee630-47db-4d50-9c4a-b14146844987 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.600460 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ba5ee630-47db-4d50-9c4a-b14146844987 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-1450572657" status: 204 len: 0 microversion: 2.26 time: 0.033419 Oct 05 17:53:12.605058 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2119/4512] 10.222.0.70 () {60 vars in 1361 bytes} [Wed Oct 5 17:53:12 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-1450572657 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:53:12.615573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f77740c65e0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:12.624810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.625359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.626091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.627028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:12.635791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.636738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.637772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.639401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.640315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.641188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.737658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.741224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.741903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.776009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:12.848182 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8b39a925-8742-4f6b-a6ae-e13deebee976 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 204 len: 0 microversion: 2.26 time: 0.238612 Oct 05 17:53:12.850039 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2394/4513] 10.222.0.70 () {60 vars in 1295 bytes} [Wed Oct 5 17:53:12 2022] DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 17:53:12.863502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69a8213b-a053-4efc-9d27-85c7ffebddb2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f7774354940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:12.879797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69a8213b-a053-4efc-9d27-85c7ffebddb2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.881587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69a8213b-a053-4efc-9d27-85c7ffebddb2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.882223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69a8213b-a053-4efc-9d27-85c7ffebddb2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.886310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:12.898426 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69a8213b-a053-4efc-9d27-85c7ffebddb2 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 200 len: 12 microversion: 2.26 time: 0.041017 Oct 05 17:53:12.912895 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2120/4514] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Oct 5 17:53:12 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 12 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:12.913123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f777409adc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:12.926985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:12.930575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.935242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.937734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.938442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:12.960822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.961344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.961793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.962551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.963007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.963432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:12.996879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:12.997690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:12.998136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.008458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.009002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.009440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.038528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:13.056375 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1e550817-c540-4831-9577-948122abef28 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-1505709883" status: 201 len: 0 microversion: 2.26 time: 0.149956 Oct 05 17:53:13.057623 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2395/4515] 10.222.0.70 () {62 vars in 1380 bytes} [Wed Oct 5 17:53:12 2022] PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-1505709883 => generated 0 bytes in 152 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 05 17:53:13.069542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a4a991c7-6ac0-4c25-8050-2a2eeade421b tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f7775bb8700>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:13.086742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4a991c7-6ac0-4c25-8050-2a2eeade421b tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.087248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4a991c7-6ac0-4c25-8050-2a2eeade421b tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.087694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4a991c7-6ac0-4c25-8050-2a2eeade421b tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.113018 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a4a991c7-6ac0-4c25-8050-2a2eeade421b tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 200 len: 36 microversion: 2.26 time: 0.049380 Oct 05 17:53:13.114334 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2121/4516] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Oct 5 17:53:13 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 36 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:13.125729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f77740b9af0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:13.140348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.140859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.141291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.141781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:13.156284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.156791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.157249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.157974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.158507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.158929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.205148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.210060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.210574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.253823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:13.288931 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5db4bace-3e99-42b8-a314-c1756e0d25e0 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-1505709883" status: 204 len: 0 microversion: 2.26 time: 0.167372 Oct 05 17:53:13.290229 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2396/4517] 10.222.0.70 () {60 vars in 1364 bytes} [Wed Oct 5 17:53:13 2022] DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-1505709883 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:53:13.300395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5d3c11bc-51cd-497a-82e3-cbb9ce64128b tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f7774a45160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:13.313578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d3c11bc-51cd-497a-82e3-cbb9ce64128b tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.314501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d3c11bc-51cd-497a-82e3-cbb9ce64128b tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.315264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d3c11bc-51cd-497a-82e3-cbb9ce64128b tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.332214 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5d3c11bc-51cd-497a-82e3-cbb9ce64128b tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 200 len: 12 microversion: 2.26 time: 0.037062 Oct 05 17:53:13.333416 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2122/4518] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Oct 5 17:53:13 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 12 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:13.344940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f77740e18b0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:13.366814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.368850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.371177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.371994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:13.390541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.391053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.391495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.392218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.392673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.393095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.444905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:13.445662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 048ef2f6-9aa3-4c95-ad02-641dbc67680c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:13.455206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.455704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.457308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.458183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.459907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.461676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.462614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.464042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.466482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.489306 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] HTTP exception thrown: Instance 048ef2f6-9aa3-4c95-ad02-641dbc67680c could not be found. Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Request method failure captured: Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c HTTP/1.1 Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPPFtxqN7OJ2tSq8Z6kZ1F1V29UfBavlxJsEUtebkivrobdBh4ZNnPHiDHKe9sWSp4OiMXp3s7tmDOr0QSg4nJI8aD-s-T1lZihFG8nZsOhFrnvT7iiSkfpy0-vSMOuon7gSJXAZARlz8HYSW6z_XLc0a6PSxY78f7eXNikBFy8rD4 Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4809bb6013894d13a894acb816f7dca8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}] Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f9ba173edb2b403493b6a65942cf6bab Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 048ef2f6-9aa3-4c95-ad02-641dbc67680c could not be found. Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '048ef2f6-9aa3-4c95-ad02-641dbc67680c'} Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 048ef2f6-9aa3-4c95-ad02-641dbc67680c could not be found. Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 048ef2f6-9aa3-4c95-ad02-641dbc67680c could not be found. Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:13.492874 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:13.497808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:13.497808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:13.497808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:13.497808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:13.497808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:13.497808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 048ef2f6-9aa3-4c95-ad02-641dbc67680c could not be found. Oct 05 17:53:13.497808 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:13.498269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:13.501768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Returning 404 to user: Instance 048ef2f6-9aa3-4c95-ad02-641dbc67680c could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:13.503152 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fc411893-913d-44a3-bacb-f7ff95829ec8 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c" status: 404 len: 111 microversion: 2.1 time: 0.062831 Oct 05 17:53:13.504310 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2123/4519] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:13 2022] GET /compute/v2.1/servers/048ef2f6-9aa3-4c95-ad02-641dbc67680c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:53:13.523150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6cc79acd-f854-4c9e-91e4-a4a9c3f08dfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:13.524405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6cc79acd-f854-4c9e-91e4-a4a9c3f08dfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: c166cde4-8dea-46ee-9e5d-e07438f14e4c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:13.532203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cc79acd-f854-4c9e-91e4-a4a9c3f08dfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.532904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cc79acd-f854-4c9e-91e4-a4a9c3f08dfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.533440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cc79acd-f854-4c9e-91e4-a4a9c3f08dfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.534251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cc79acd-f854-4c9e-91e4-a4a9c3f08dfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.534947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cc79acd-f854-4c9e-91e4-a4a9c3f08dfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.535468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cc79acd-f854-4c9e-91e4-a4a9c3f08dfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.542665 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-15e2e05c-1cb5-4d87-957d-e572c2da212d tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 204 len: 0 microversion: 2.26 time: 0.203128 Oct 05 17:53:13.543689 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2397/4520] 10.222.0.70 () {60 vars in 1295 bytes} [Wed Oct 5 17:53:13 2022] DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:53:13.555080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f77740b9940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:13.566827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.567436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.568112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.568693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:13.575166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.575777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.576585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.578197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.578853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.579378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.585977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6cc79acd-f854-4c9e-91e4-a4a9c3f08dfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: c166cde4-8dea-46ee-9e5d-e07438f14e4c] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:53:13.616772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.617890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.619108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.631056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.632106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.632897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.674346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:13.693764 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8fa023fb-3c17-4151-8d24-089292006460 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-359803045" status: 201 len: 0 microversion: 2.26 time: 0.144024 Oct 05 17:53:13.695049 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2398/4521] 10.222.0.70 () {62 vars in 1377 bytes} [Wed Oct 5 17:53:13 2022] PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-359803045 => generated 0 bytes in 147 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Oct 05 17:53:13.708462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f77746cf940>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:13.733418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.734076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.736517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.738438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:13.754724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.756651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.758086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.759483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.760838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.762599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.769325 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6cc79acd-f854-4c9e-91e4-a4a9c3f08dfd tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c" status: 204 len: 0 microversion: 2.1 time: 0.260088 Oct 05 17:53:13.776851 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2124/4522] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:53:13 2022] DELETE /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:53:13.793706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bbb3c3d0-8dcd-4173-beab-3020874a1182 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:13.795254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bbb3c3d0-8dcd-4173-beab-3020874a1182 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:13.804170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbb3c3d0-8dcd-4173-beab-3020874a1182 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.805512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbb3c3d0-8dcd-4173-beab-3020874a1182 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.806161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbb3c3d0-8dcd-4173-beab-3020874a1182 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.808215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbb3c3d0-8dcd-4173-beab-3020874a1182 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.808892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbb3c3d0-8dcd-4173-beab-3020874a1182 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.809819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bbb3c3d0-8dcd-4173-beab-3020874a1182 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.825921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.826922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.827642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.851984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:13.854310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:13.856188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:13.858922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bbb3c3d0-8dcd-4173-beab-3020874a1182 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:53:13.929644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:13.975068 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c83805ea-46b8-4f0c-9a03-7bab221b93be tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-796309702" status: 201 len: 0 microversion: 2.26 time: 0.273247 Oct 05 17:53:13.976674 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2399/4523] 10.222.0.70 () {62 vars in 1377 bytes} [Wed Oct 5 17:53:13 2022] PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-796309702 => generated 0 bytes in 276 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 05 17:53:13.998489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f77740fcf70>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:14.019834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.023636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.025193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.026597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:14.040947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.041866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.042433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.043459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.044414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.045039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.088000 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bbb3c3d0-8dcd-4173-beab-3020874a1182 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "DELETE /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 204 len: 0 microversion: 2.1 time: 0.304795 Oct 05 17:53:14.088743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:14.094890 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2125/4524] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:53:13 2022] DELETE /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:53:14.098090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.099536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.101365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.111101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8670ccf5-241a-4b6f-a2f7-1f9b376a1b89 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:14.112518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8670ccf5-241a-4b6f-a2f7-1f9b376a1b89 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: c166cde4-8dea-46ee-9e5d-e07438f14e4c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:14.119050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=84,nova_cell1:SAVEPOINT=4,nova_cell1:INSERT=4,nova_cell1:RELEASE=4,nova_cell1:DELETE=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:14.120482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8670ccf5-241a-4b6f-a2f7-1f9b376a1b89 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.121238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8670ccf5-241a-4b6f-a2f7-1f9b376a1b89 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.122012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8670ccf5-241a-4b6f-a2f7-1f9b376a1b89 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.123232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8670ccf5-241a-4b6f-a2f7-1f9b376a1b89 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.123893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8670ccf5-241a-4b6f-a2f7-1f9b376a1b89 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.124760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8670ccf5-241a-4b6f-a2f7-1f9b376a1b89 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.137988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:14.167821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7cd61146-9a7e-49f9-b64e-2d70331bd1f9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 204 len: 0 microversion: 2.26 time: 0.186088 Oct 05 17:53:14.169039 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2400/4525] 10.222.0.70 () {60 vars in 1295 bytes} [Wed Oct 5 17:53:13 2022] DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:53:14.182807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6196dd21-cbe8-42d1-9f50-0010b4c4787f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f777432b670>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:14.203761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6196dd21-cbe8-42d1-9f50-0010b4c4787f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.205215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6196dd21-cbe8-42d1-9f50-0010b4c4787f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.206731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6196dd21-cbe8-42d1-9f50-0010b4c4787f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.228886 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6196dd21-cbe8-42d1-9f50-0010b4c4787f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 200 len: 12 microversion: 2.26 time: 0.054892 Oct 05 17:53:14.236850 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2401/4526] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Oct 5 17:53:14 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:14.251508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f777408e310>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:14.280825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.282229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.284644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.286332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:14.297359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.298082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.298930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.299858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.300586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.301221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.354669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.356212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.357401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.381383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:14.419018 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0bc8b356-8329-493f-ab43-7fda7b089e05 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 204 len: 0 microversion: 2.26 time: 0.178322 Oct 05 17:53:14.426152 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2402/4527] 10.222.0.70 () {60 vars in 1295 bytes} [Wed Oct 5 17:53:14 2022] DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 17:53:14.439663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f7774058af0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:14.461551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.463437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.465568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.468165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:14.479991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.481989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.482737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.484360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.486110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.486639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.499540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8670ccf5-241a-4b6f-a2f7-1f9b376a1b89 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:14.511142 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8670ccf5-241a-4b6f-a2f7-1f9b376a1b89 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c" status: 200 len: 1473 microversion: 2.1 time: 0.414877 Oct 05 17:53:14.512143 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2126/4528] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:14 2022] GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c => generated 1473 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:14.546626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.547333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.548019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.557635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.558265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.558839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.600149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:14.646580 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2ff1245-20eb-48cc-a6fb-5d6a3997e6e9 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-696468604" status: 201 len: 0 microversion: 2.26 time: 0.212991 Oct 05 17:53:14.648841 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2403/4529] 10.222.0.70 () {62 vars in 1377 bytes} [Wed Oct 5 17:53:14 2022] PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-696468604 => generated 0 bytes in 218 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 05 17:53:14.659079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f7775d93550>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:14.662972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:14.670381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.671272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.672026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.672835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:14.681961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.682713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.683909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.685898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.687583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.688198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.739711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.749814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.750447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.773548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.774439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.776024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.846117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:14.878697 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-788f0fdc-9e61-42e6-8437-8cdc965be7b6 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-1299743124" status: 201 len: 0 microversion: 2.26 time: 0.223605 Oct 05 17:53:14.882465 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2127/4530] 10.222.0.70 () {62 vars in 1380 bytes} [Wed Oct 5 17:53:14 2022] PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags/tempest-tag-1299743124 => generated 0 bytes in 228 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 05 17:53:14.892762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Action: 'update_all', calling method: .version_select at 0x7f777408eb80>, body: {"tags": ["tempest-tag-172177237", "tempest-tag-1411884725"]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:14.907617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.915157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.915901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.916608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:14.935754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.936257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.936692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.937511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.937968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.938423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:14.989104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:14.989589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:14.990025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.051818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:15.095315 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b9ec6415-6bce-4e22-971d-939b44ebc63f tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 200 len: 61 microversion: 2.26 time: 0.206637 Oct 05 17:53:15.098501 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2404/4531] 10.222.0.70 () {62 vars in 1312 bytes} [Wed Oct 5 17:53:14 2022] PUT /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 61 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:15.107612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1041671a-f7e6-4480-8a07-5e4be1d46c11 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f777535d9d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:15.126976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1041671a-f7e6-4480-8a07-5e4be1d46c11 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.139562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1041671a-f7e6-4480-8a07-5e4be1d46c11 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.140890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1041671a-f7e6-4480-8a07-5e4be1d46c11 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.171618 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1041671a-f7e6-4480-8a07-5e4be1d46c11 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 200 len: 61 microversion: 2.26 time: 0.069026 Oct 05 17:53:15.176852 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2128/4532] 10.222.0.70 () {60 vars in 1292 bytes} [Wed Oct 5 17:53:15 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 61 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:15.188928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '.version_select at 0x7f7774058e50>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:15.206622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.207134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.207579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.208065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:15.220927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.221467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.221898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.224845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.225498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.226951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.321727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.322788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.324209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.358870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lazy-loading 'flavor' on Instance uuid 9df49402-0559-45cd-b453-ed262dd67cfb {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:53:15.405387 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35c7d9d7-dd7f-42ed-8edb-a06d77798077 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags" status: 204 len: 0 microversion: 2.26 time: 0.220317 Oct 05 17:53:15.407577 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2405/4533] 10.222.0.70 () {60 vars in 1295 bytes} [Wed Oct 5 17:53:15 2022] DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb/tags => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:53:15.420800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a942e9db-a408-4e5a-ae52-385992e78acb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:15.421325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a942e9db-a408-4e5a-ae52-385992e78acb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:15.439065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a942e9db-a408-4e5a-ae52-385992e78acb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.439482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a942e9db-a408-4e5a-ae52-385992e78acb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.450130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a942e9db-a408-4e5a-ae52-385992e78acb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.451111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a942e9db-a408-4e5a-ae52-385992e78acb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.451618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a942e9db-a408-4e5a-ae52-385992e78acb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.452059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a942e9db-a408-4e5a-ae52-385992e78acb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.518254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a942e9db-a408-4e5a-ae52-385992e78acb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:53:15.539714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a4bd4180-405d-44bc-8616-2a7c54cc398c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:15.540396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a4bd4180-405d-44bc-8616-2a7c54cc398c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: c166cde4-8dea-46ee-9e5d-e07438f14e4c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:15.554771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4bd4180-405d-44bc-8616-2a7c54cc398c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.558839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4bd4180-405d-44bc-8616-2a7c54cc398c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.558839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4bd4180-405d-44bc-8616-2a7c54cc398c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.560756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4bd4180-405d-44bc-8616-2a7c54cc398c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.561235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4bd4180-405d-44bc-8616-2a7c54cc398c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.561665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4bd4180-405d-44bc-8616-2a7c54cc398c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.689366 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a942e9db-a408-4e5a-ae52-385992e78acb tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 204 len: 0 microversion: 2.26 time: 0.274641 Oct 05 17:53:15.692250 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2129/4534] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 17:53:15 2022] DELETE /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 17:53:15.707373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:15.709335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:15.732487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.736096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.736973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:15.741527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:15.746367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:15.748620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:16.555786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a4bd4180-405d-44bc-8616-2a7c54cc398c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:16.571770 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a4bd4180-405d-44bc-8616-2a7c54cc398c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c" status: 200 len: 1473 microversion: 2.1 time: 1.038198 Oct 05 17:53:16.573611 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2406/4535] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:15 2022] GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c => generated 1473 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:16.753003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:16.774915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:16.777342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:16.780581 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-896dfd8c-3e4c-4c86-9a04-373d1280ac80 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1553 microversion: 2.26 time: 1.082059 Oct 05 17:53:16.794048 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2130/4536] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:15 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1553 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:17.610051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-11b95df6-dc17-47eb-b5bd-dd6119095074 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:17.610848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-11b95df6-dc17-47eb-b5bd-dd6119095074 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: c166cde4-8dea-46ee-9e5d-e07438f14e4c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:17.634870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b95df6-dc17-47eb-b5bd-dd6119095074 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:17.636248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b95df6-dc17-47eb-b5bd-dd6119095074 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:17.636846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b95df6-dc17-47eb-b5bd-dd6119095074 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:17.637736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b95df6-dc17-47eb-b5bd-dd6119095074 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:17.638401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b95df6-dc17-47eb-b5bd-dd6119095074 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:17.638975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b95df6-dc17-47eb-b5bd-dd6119095074 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:17.740734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-be9fb4d6-83c1-40c8-9706-51c217a530ad req-b6c2e4f0-cf6a-4b09-be5f-c4f2bfc0016d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94442e3c-35bb-4618-872a-608660ff52e5", "name": "network-vif-deleted", "tag": "4c90ccb8-0e9d-4455-9303-16abd6ca05bc"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:17.769518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-be9fb4d6-83c1-40c8-9706-51c217a530ad req-b6c2e4f0-cf6a-4b09-be5f-c4f2bfc0016d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:17.770155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-be9fb4d6-83c1-40c8-9706-51c217a530ad req-b6c2e4f0-cf6a-4b09-be5f-c4f2bfc0016d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:17.770487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-be9fb4d6-83c1-40c8-9706-51c217a530ad req-b6c2e4f0-cf6a-4b09-be5f-c4f2bfc0016d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:17.822054 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-be9fb4d6-83c1-40c8-9706-51c217a530ad req-b6c2e4f0-cf6a-4b09-be5f-c4f2bfc0016d service nova] Creating event network-vif-deleted:4c90ccb8-0e9d-4455-9303-16abd6ca05bc for instance 94442e3c-35bb-4618-872a-608660ff52e5 on n-h2-835595-3 Oct 05 17:53:17.834464 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-be9fb4d6-83c1-40c8-9706-51c217a530ad req-b6c2e4f0-cf6a-4b09-be5f-c4f2bfc0016d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100816 Oct 05 17:53:17.836074 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2131/4537] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:53:17.848571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:17.849362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:17.864080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:17.864590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:17.865028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:17.865739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:17.866193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:17.866643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:18.529787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11b95df6-dc17-47eb-b5bd-dd6119095074 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:18.532100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:18.542034 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-11b95df6-dc17-47eb-b5bd-dd6119095074 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c" status: 200 len: 1431 microversion: 2.1 time: 0.944794 Oct 05 17:53:18.543890 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2407/4538] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:17 2022] GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c => generated 1431 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:18.549245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:18.553482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:18.555991 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0e8de178-7aeb-4ee9-9e67-75e3e894fde5 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1553 microversion: 2.26 time: 0.718764 Oct 05 17:53:18.571405 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2132/4539] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:17 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1553 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:18.891688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d1de1fbf-f6c3-475d-bac4-85e52e77a4ea req-718adada-9eb1-4c72-98c0-4f30a0c069d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c166cde4-8dea-46ee-9e5d-e07438f14e4c", "name": "network-vif-deleted", "tag": "18943f16-15f0-4491-825e-57555f57e326"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:18.931996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d1de1fbf-f6c3-475d-bac4-85e52e77a4ea req-718adada-9eb1-4c72-98c0-4f30a0c069d9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:18.932655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d1de1fbf-f6c3-475d-bac4-85e52e77a4ea req-718adada-9eb1-4c72-98c0-4f30a0c069d9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:18.933271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d1de1fbf-f6c3-475d-bac4-85e52e77a4ea req-718adada-9eb1-4c72-98c0-4f30a0c069d9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:18.972368 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d1de1fbf-f6c3-475d-bac4-85e52e77a4ea req-718adada-9eb1-4c72-98c0-4f30a0c069d9 service nova] Creating event network-vif-deleted:18943f16-15f0-4491-825e-57555f57e326 for instance c166cde4-8dea-46ee-9e5d-e07438f14e4c on n-h1-835595-3 Oct 05 17:53:18.988346 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d1de1fbf-f6c3-475d-bac4-85e52e77a4ea req-718adada-9eb1-4c72-98c0-4f30a0c069d9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103479 Oct 05 17:53:18.989485 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2408/4540] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:19.569950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:19.570707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: c166cde4-8dea-46ee-9e5d-e07438f14e4c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:19.590068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:19.590795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:19.595762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:19.597388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:19.602069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:19.604220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:19.609329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:19.610245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:19.612551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:19.618938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:19.620368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:19.621504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:19.623530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:19.627640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:19.673321 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] HTTP exception thrown: Instance c166cde4-8dea-46ee-9e5d-e07438f14e4c could not be found. Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Request method failure captured: Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c HTTP/1.1 Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPPFtxqN7OJ2tSq8Z6kZ1F1V29UfBavlxJsEUtebkivrobdBh4ZNnPHiDHKe9sWSp4OiMXp3s7tmDOr0QSg4nJI8aD-s-T1lZihFG8nZsOhFrnvT7iiSkfpy0-vSMOuon7gSJXAZARlz8HYSW6z_XLc0a6PSxY78f7eXNikBFy8rD4 Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4809bb6013894d13a894acb816f7dca8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}] Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f9ba173edb2b403493b6a65942cf6bab Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance c166cde4-8dea-46ee-9e5d-e07438f14e4c could not be found. Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'c166cde4-8dea-46ee-9e5d-e07438f14e4c'} Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c166cde4-8dea-46ee-9e5d-e07438f14e4c could not be found. Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c166cde4-8dea-46ee-9e5d-e07438f14e4c could not be found. Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:19.675040 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:19.682140 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:19.682140 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:19.682140 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:19.682140 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:19.682140 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:19.682140 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c166cde4-8dea-46ee-9e5d-e07438f14e4c could not be found. Oct 05 17:53:19.682140 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:19.686220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Returning 404 to user: Instance c166cde4-8dea-46ee-9e5d-e07438f14e4c could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:19.692923 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-687e7975-e9ec-4d1d-9415-485692e5654f tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c" status: 404 len: 111 microversion: 2.1 time: 0.126766 Oct 05 17:53:19.693536 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2133/4541] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:19 2022] GET /compute/v2.1/servers/c166cde4-8dea-46ee-9e5d-e07438f14e4c => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:53:19.701406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:19.705609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 94442e3c-35bb-4618-872a-608660ff52e5] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:19.716253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:19.716751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:19.717181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:19.717883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:19.722618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:19.724566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:19.736143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:19.758053 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] HTTP exception thrown: Instance 94442e3c-35bb-4618-872a-608660ff52e5 could not be found. Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Request method failure captured: Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 HTTP/1.1 Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPPFtxqN7OJ2tSq8Z6kZ1F1V29UfBavlxJsEUtebkivrobdBh4ZNnPHiDHKe9sWSp4OiMXp3s7tmDOr0QSg4nJI8aD-s-T1lZihFG8nZsOhFrnvT7iiSkfpy0-vSMOuon7gSJXAZARlz8HYSW6z_XLc0a6PSxY78f7eXNikBFy8rD4 Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4809bb6013894d13a894acb816f7dca8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}] Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f9ba173edb2b403493b6a65942cf6bab Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 94442e3c-35bb-4618-872a-608660ff52e5 could not be found. Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '94442e3c-35bb-4618-872a-608660ff52e5'} Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94442e3c-35bb-4618-872a-608660ff52e5 could not be found. Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94442e3c-35bb-4618-872a-608660ff52e5 could not be found. Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:19.759929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:19.764059 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:19.764059 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:19.764059 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:19.764059 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:19.764059 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:19.764059 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94442e3c-35bb-4618-872a-608660ff52e5 could not be found. Oct 05 17:53:19.764059 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:19.766019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Returning 404 to user: Instance 94442e3c-35bb-4618-872a-608660ff52e5 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:19.767107 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0d525d53-79ff-4c19-b97b-c278e7c41942 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5" status: 404 len: 111 microversion: 2.1 time: 0.069524 Oct 05 17:53:19.768206 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2134/4542] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:19 2022] GET /compute/v2.1/servers/94442e3c-35bb-4618-872a-608660ff52e5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:53:19.776652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d473d69e-ce3c-4be1-a62f-3b67700ec3c5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:19.815586 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d473d69e-ce3c-4be1-a62f-3b67700ec3c5 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/e62ac756-6129-4cf9-a49a-65dee432aad6" status: 204 len: 0 microversion: 2.1 time: 0.043370 Oct 05 17:53:19.816590 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2135/4543] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:53:19 2022] DELETE /compute/v2.1/os-server-groups/e62ac756-6129-4cf9-a49a-65dee432aad6 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:53:19.829102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8b96668-518e-4bd3-85fe-89c7ece44743 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:19.831198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8b96668-518e-4bd3-85fe-89c7ece44743 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 4705a742-0c49-4acf-82cb-71e548a1acd2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:19.843699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b96668-518e-4bd3-85fe-89c7ece44743 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:19.844921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b96668-518e-4bd3-85fe-89c7ece44743 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:19.846690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b96668-518e-4bd3-85fe-89c7ece44743 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:19.848051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b96668-518e-4bd3-85fe-89c7ece44743 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:19.848995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b96668-518e-4bd3-85fe-89c7ece44743 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:19.850512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b96668-518e-4bd3-85fe-89c7ece44743 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:19.935260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8b96668-518e-4bd3-85fe-89c7ece44743 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 4705a742-0c49-4acf-82cb-71e548a1acd2] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:53:20.133527 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8b96668-518e-4bd3-85fe-89c7ece44743 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2" status: 204 len: 0 microversion: 2.1 time: 0.308651 Oct 05 17:53:20.134150 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2136/4544] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:53:19 2022] DELETE /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:53:20.158912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ae22b4fd-8c45-4a20-ada7-7fdf12227692 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:20.164299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ae22b4fd-8c45-4a20-ada7-7fdf12227692 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:20.187998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae22b4fd-8c45-4a20-ada7-7fdf12227692 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:20.190994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae22b4fd-8c45-4a20-ada7-7fdf12227692 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:20.191735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae22b4fd-8c45-4a20-ada7-7fdf12227692 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:20.193778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae22b4fd-8c45-4a20-ada7-7fdf12227692 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:20.197847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae22b4fd-8c45-4a20-ada7-7fdf12227692 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:20.198553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae22b4fd-8c45-4a20-ada7-7fdf12227692 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:20.234757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ae22b4fd-8c45-4a20-ada7-7fdf12227692 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:53:20.407624 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ae22b4fd-8c45-4a20-ada7-7fdf12227692 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "DELETE /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 204 len: 0 microversion: 2.1 time: 0.267850 Oct 05 17:53:20.408246 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2137/4545] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:53:20 2022] DELETE /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:53:20.419400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9a516e1-c3d0-4f18-bfe6-39096f873a5e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:20.420409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b9a516e1-c3d0-4f18-bfe6-39096f873a5e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 4705a742-0c49-4acf-82cb-71e548a1acd2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:20.438217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9a516e1-c3d0-4f18-bfe6-39096f873a5e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:20.442019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9a516e1-c3d0-4f18-bfe6-39096f873a5e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:20.453061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9a516e1-c3d0-4f18-bfe6-39096f873a5e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:20.458696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9a516e1-c3d0-4f18-bfe6-39096f873a5e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:20.461197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9a516e1-c3d0-4f18-bfe6-39096f873a5e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:20.467444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9a516e1-c3d0-4f18-bfe6-39096f873a5e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:20.941297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:20.955213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:20.956682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:20.957903 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cb740dce-6906-4ad8-9985-af8ba48bc63e tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1553 microversion: 2.26 time: 1.372205 Oct 05 17:53:20.978222 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2409/4546] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:19 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1553 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:21.178520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-1256de30-cb24-44bb-9833-ad065a1f5867 req-c8a387a3-4e9f-487f-896d-9bb6fec66de6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9df49402-0559-45cd-b453-ed262dd67cfb", "name": "network-vif-deleted", "tag": "b4568980-a238-4914-975e-8a76a37137f1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:21.200943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1256de30-cb24-44bb-9833-ad065a1f5867 req-c8a387a3-4e9f-487f-896d-9bb6fec66de6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:21.204519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1256de30-cb24-44bb-9833-ad065a1f5867 req-c8a387a3-4e9f-487f-896d-9bb6fec66de6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:21.205130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1256de30-cb24-44bb-9833-ad065a1f5867 req-c8a387a3-4e9f-487f-896d-9bb6fec66de6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:21.220658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9a516e1-c3d0-4f18-bfe6-39096f873a5e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:21.240256 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9a516e1-c3d0-4f18-bfe6-39096f873a5e tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2" status: 200 len: 1475 microversion: 2.1 time: 0.826905 Oct 05 17:53:21.246252 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2138/4547] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:20 2022] GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2 => generated 1475 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:21.261994 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-1256de30-cb24-44bb-9833-ad065a1f5867 req-c8a387a3-4e9f-487f-896d-9bb6fec66de6 service nova] Creating event network-vif-deleted:b4568980-a238-4914-975e-8a76a37137f1 for instance 9df49402-0559-45cd-b453-ed262dd67cfb on n-h2-835595-3 Oct 05 17:53:21.276249 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-1256de30-cb24-44bb-9833-ad065a1f5867 req-c8a387a3-4e9f-487f-896d-9bb6fec66de6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100359 Oct 05 17:53:21.280176 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2410/4548] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:53:21.985865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:21.986603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:22.000869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:22.002506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:22.003679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:22.004731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:22.006137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:22.012906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:22.112905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1617607639", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "af0f1dde-a878-4944-931d-90b7cf478af9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1969127260", "security_groups": [{"name": "tempest-secgroup-smoke-1454495267"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:22.218586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:22.231189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:22.237032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '26a82779aadd4be08ecebeb0dc98f603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd8595df03de94371a169df3c7be34376', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:22.239636 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb8dc214-8509-4b3a-a465-6dca7daa7681 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 200 len: 1347 microversion: 2.26 time: 0.258631 Oct 05 17:53:22.243622 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2139/4549] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:21 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 1347 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 17:53:22.452581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] validate_networks() for [('af0f1dde-a878-4944-931d-90b7cf478af9', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:53:22.957215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ec0e0f5-7f2d-4af8-883f-0baf79e2be38 tempest-ComputeTenantNetworksTest-947862184 tempest-ComputeTenantNetworksTest-947862184-project] Calling method '.version_select at 0x7f7774314b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:23.518736 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0ec0e0f5-7f2d-4af8-883f-0baf79e2be38 tempest-ComputeTenantNetworksTest-947862184 tempest-ComputeTenantNetworksTest-947862184-project] 10.222.0.70 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.262123 Oct 05 17:53:23.519417 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2140/4550] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 17:53:22 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:53:23.525298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-edeca149-becd-441e-8d1d-33e3ddda4e8d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:23.526011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-edeca149-becd-441e-8d1d-33e3ddda4e8d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 4705a742-0c49-4acf-82cb-71e548a1acd2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:23.539526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edeca149-becd-441e-8d1d-33e3ddda4e8d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:23.542842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edeca149-becd-441e-8d1d-33e3ddda4e8d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:23.543692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edeca149-becd-441e-8d1d-33e3ddda4e8d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:23.544658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edeca149-becd-441e-8d1d-33e3ddda4e8d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:23.545321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edeca149-becd-441e-8d1d-33e3ddda4e8d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:23.546231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edeca149-becd-441e-8d1d-33e3ddda4e8d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:24.238603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:53:24.239079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:53:24.239489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:53:24.239901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:53:24.240317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:53:24.259541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:24.260046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:24.260484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:24.261220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:24.261682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:24.264951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:24.298109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:53:24.304763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for user 06d379a97d474b74a29e62848a4e4696 and project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:53:24.322715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:53:24.325805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:53:24.440942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-edeca149-becd-441e-8d1d-33e3ddda4e8d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:24.453946 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d61bde76-c34f-47a0-9acc-feae7c486bae tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.338678 Oct 05 17:53:24.454945 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-edeca149-becd-441e-8d1d-33e3ddda4e8d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2" status: 200 len: 1475 microversion: 2.1 time: 0.934463 Oct 05 17:53:24.460503 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2141/4551] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:23 2022] GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2 => generated 1475 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:24.464117 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2411/4552] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:53:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 17:53:24.470865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6dbda538-22e4-4afc-a27a-72146035dad5 tempest-ComputeTenantNetworksTest-947862184 tempest-ComputeTenantNetworksTest-947862184-project] Calling method '.version_select at 0x7f77740bb4c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:24.475114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:24.475762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] [instance: 9df49402-0559-45cd-b453-ed262dd67cfb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:24.521981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:24.522670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:24.525671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:24.526536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:24.530470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:24.531003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:24.622771 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] HTTP exception thrown: Instance 9df49402-0559-45cd-b453-ed262dd67cfb could not be found. Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Request method failure captured: Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb HTTP/1.1 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcRxoe5tWHmUrxE-5-lQ9EEHi_MUL6IhwBkDPxtJ32ny23rDLzeoapAOwW62LGCGKi-KAhga5QsKQiVDU0ya2hDQL4MaNvSPnkZMEtCdU7pGpBvdvPrg1tNUSWoy7YnsRvtcQeXEkDMn7jcQ_0MIvV9MLM40Zf2nId5DgxNfO0cFMKs Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.26 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: d8595df03de94371a169df3c7be34376 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerTagsTestJSON-1205646724 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d8595df03de94371a169df3c7be34376"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8595df03de94371a169df3c7be34376"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d8595df03de94371a169df3c7be34376", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d8595df03de94371a169df3c7be34376"}]}] Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerTagsTestJSON-1205646724 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: d8595df03de94371a169df3c7be34376 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerTagsTestJSON-1205646724 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerTagsTestJSON-1205646724-project Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 26a82779aadd4be08ecebeb0dc98f603 Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerTagsTestJSON-1205646724-project Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 9df49402-0559-45cd-b453-ed262dd67cfb could not be found. Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '9df49402-0559-45cd-b453-ed262dd67cfb'} Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9df49402-0559-45cd-b453-ed262dd67cfb could not be found. Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9df49402-0559-45cd-b453-ed262dd67cfb could not be found. Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:24.629146 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:24.633823 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:24.633823 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:24.633823 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:24.633823 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:24.633823 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:24.633823 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9df49402-0559-45cd-b453-ed262dd67cfb could not be found. Oct 05 17:53:24.633823 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:24.635387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] Returning 404 to user: Instance 9df49402-0559-45cd-b453-ed262dd67cfb could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:24.638594 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c58547fe-698b-4fe3-a747-2847282b4bf8 tempest-ServerTagsTestJSON-1205646724 tempest-ServerTagsTestJSON-1205646724-project] 10.222.0.70 "GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb" status: 404 len: 111 microversion: 2.26 time: 0.175763 Oct 05 17:53:24.639375 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2142/4553] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 17:53:24 2022] GET /compute/v2.1/servers/9df49402-0559-45cd-b453-ed262dd67cfb => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:53:24.672100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cfa74883-9ed6-478e-ab6f-cdaa1d9409a4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:24.673800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cfa74883-9ed6-478e-ab6f-cdaa1d9409a4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:24.864262 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6dbda538-22e4-4afc-a27a-72146035dad5 tempest-ComputeTenantNetworksTest-947862184 tempest-ComputeTenantNetworksTest-947862184-project] 10.222.0.70 "GET /compute/v2.1/os-tenant-networks/b9611b8d-0feb-4c29-b96f-f41d56410abd" status: 200 len: 140 microversion: 2.1 time: 0.398705 Oct 05 17:53:24.865491 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2412/4554] 10.222.0.70 () {58 vars in 1269 bytes} [Wed Oct 5 17:53:24 2022] GET /compute/v2.1/os-tenant-networks/b9611b8d-0feb-4c29-b96f-f41d56410abd => generated 140 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:25.196274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6b805cf5-6e07-4a5c-8833-eea9ca122d4b req-590425fb-ed87-40c5-93b5-4ca0013b298a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52330818-f5f6-4744-bdca-28952038b28b", "name": "network-vif-deleted", "tag": "9b063444-500f-46cb-8860-efc7dc640e7d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:25.271154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6b805cf5-6e07-4a5c-8833-eea9ca122d4b req-590425fb-ed87-40c5-93b5-4ca0013b298a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:25.272473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6b805cf5-6e07-4a5c-8833-eea9ca122d4b req-590425fb-ed87-40c5-93b5-4ca0013b298a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:25.274173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6b805cf5-6e07-4a5c-8833-eea9ca122d4b req-590425fb-ed87-40c5-93b5-4ca0013b298a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:25.290981 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6b805cf5-6e07-4a5c-8833-eea9ca122d4b req-590425fb-ed87-40c5-93b5-4ca0013b298a service nova] Creating event network-vif-deleted:9b063444-500f-46cb-8860-efc7dc640e7d for instance 52330818-f5f6-4744-bdca-28952038b28b on n-h2-835595-3 Oct 05 17:53:25.297216 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6b805cf5-6e07-4a5c-8833-eea9ca122d4b req-590425fb-ed87-40c5-93b5-4ca0013b298a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109704 Oct 05 17:53:25.298577 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2413/4555] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:25.499832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13f1e761-cfb4-4401-8bac-523f6f9a0a2b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:25.521244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13f1e761-cfb4-4401-8bac-523f6f9a0a2b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 4705a742-0c49-4acf-82cb-71e548a1acd2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:25.556482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f1e761-cfb4-4401-8bac-523f6f9a0a2b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:25.557047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f1e761-cfb4-4401-8bac-523f6f9a0a2b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:25.557557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f1e761-cfb4-4401-8bac-523f6f9a0a2b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:25.558514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f1e761-cfb4-4401-8bac-523f6f9a0a2b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:25.558978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f1e761-cfb4-4401-8bac-523f6f9a0a2b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:25.565792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13f1e761-cfb4-4401-8bac-523f6f9a0a2b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:26.600605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cfa74883-9ed6-478e-ab6f-cdaa1d9409a4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:26.610899 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cfa74883-9ed6-478e-ab6f-cdaa1d9409a4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1267 microversion: 2.1 time: 1.963557 Oct 05 17:53:26.613120 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2143/4556] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:24 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1267 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:26.625539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-70fe13cf-e874-4b08-b9aa-93673c7fffa9 req-b84ced34-b8c8-4326-9be5-0b9bfc0915dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4705a742-0c49-4acf-82cb-71e548a1acd2", "name": "network-vif-deleted", "tag": "9b9704d0-a556-4ecd-bfab-26c9679bc57b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:26.677327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-70fe13cf-e874-4b08-b9aa-93673c7fffa9 req-b84ced34-b8c8-4326-9be5-0b9bfc0915dd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:26.677821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-70fe13cf-e874-4b08-b9aa-93673c7fffa9 req-b84ced34-b8c8-4326-9be5-0b9bfc0915dd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:26.678252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-70fe13cf-e874-4b08-b9aa-93673c7fffa9 req-b84ced34-b8c8-4326-9be5-0b9bfc0915dd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:26.730990 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-70fe13cf-e874-4b08-b9aa-93673c7fffa9 req-b84ced34-b8c8-4326-9be5-0b9bfc0915dd service nova] Creating event network-vif-deleted:9b9704d0-a556-4ecd-bfab-26c9679bc57b for instance 4705a742-0c49-4acf-82cb-71e548a1acd2 on n-h2-835595-3 Oct 05 17:53:26.755673 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-70fe13cf-e874-4b08-b9aa-93673c7fffa9 req-b84ced34-b8c8-4326-9be5-0b9bfc0915dd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139286 Oct 05 17:53:26.757890 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2144/4557] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:27.225626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-13f1e761-cfb4-4401-8bac-523f6f9a0a2b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:27.245549 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13f1e761-cfb4-4401-8bac-523f6f9a0a2b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2" status: 200 len: 1433 microversion: 2.1 time: 1.762014 Oct 05 17:53:27.253317 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2414/4558] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:25 2022] GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2 => generated 1433 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:53:27.644192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2f6c9d24-06c3-42af-b150-bea1f3c7183a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:27.647068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2f6c9d24-06c3-42af-b150-bea1f3c7183a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:27.662212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f6c9d24-06c3-42af-b150-bea1f3c7183a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:27.663281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f6c9d24-06c3-42af-b150-bea1f3c7183a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:27.663729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f6c9d24-06c3-42af-b150-bea1f3c7183a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:27.680771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f6c9d24-06c3-42af-b150-bea1f3c7183a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:27.681285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f6c9d24-06c3-42af-b150-bea1f3c7183a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:27.684012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f6c9d24-06c3-42af-b150-bea1f3c7183a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:27.854823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2f6c9d24-06c3-42af-b150-bea1f3c7183a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:27.873246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2f6c9d24-06c3-42af-b150-bea1f3c7183a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1325 microversion: 2.1 time: 0.239429 Oct 05 17:53:27.876907 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2145/4559] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:27 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1325 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:28.276589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:28.277461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 4705a742-0c49-4acf-82cb-71e548a1acd2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:28.292838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:28.295386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:28.296370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:28.298729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:28.300970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:28.302680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:28.346964 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] HTTP exception thrown: Instance 4705a742-0c49-4acf-82cb-71e548a1acd2 could not be found. Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Request method failure captured: Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2 HTTP/1.1 Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcPPFtxqN7OJ2tSq8Z6kZ1F1V29UfBavlxJsEUtebkivrobdBh4ZNnPHiDHKe9sWSp4OiMXp3s7tmDOr0QSg4nJI8aD-s-T1lZihFG8nZsOhFrnvT7iiSkfpy0-vSMOuon7gSJXAZARlz8HYSW6z_XLc0a6PSxY78f7eXNikBFy8rD4 Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4809bb6013894d13a894acb816f7dca8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}] Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f9ba173edb2b403493b6a65942cf6bab Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 4705a742-0c49-4acf-82cb-71e548a1acd2 could not be found. Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4705a742-0c49-4acf-82cb-71e548a1acd2'} Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4705a742-0c49-4acf-82cb-71e548a1acd2 could not be found. Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4705a742-0c49-4acf-82cb-71e548a1acd2 could not be found. Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:28.350423 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:28.355350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:28.355350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:28.355350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:28.355350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:28.355350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:28.355350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4705a742-0c49-4acf-82cb-71e548a1acd2 could not be found. Oct 05 17:53:28.355350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:28.355350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Returning 404 to user: Instance 4705a742-0c49-4acf-82cb-71e548a1acd2 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:28.355350 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-83ceb70b-72eb-402f-a2b9-a94c8458a29c tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2" status: 404 len: 111 microversion: 2.1 time: 0.081030 Oct 05 17:53:28.355350 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2415/4560] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:28 2022] GET /compute/v2.1/servers/4705a742-0c49-4acf-82cb-71e548a1acd2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:53:28.364762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:28.366192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: 52330818-f5f6-4744-bdca-28952038b28b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:28.377904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:28.381652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:28.382837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:28.384373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:28.385025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:28.385735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:28.419991 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] HTTP exception thrown: Instance 52330818-f5f6-4744-bdca-28952038b28b could not be found. Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Request method failure captured: Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b HTTP/1.1 Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPPFtxqN7OJ2tSq8Z6kZ1F1V29UfBavlxJsEUtebkivrobdBh4ZNnPHiDHKe9sWSp4OiMXp3s7tmDOr0QSg4nJI8aD-s-T1lZihFG8nZsOhFrnvT7iiSkfpy0-vSMOuon7gSJXAZARlz8HYSW6z_XLc0a6PSxY78f7eXNikBFy8rD4 Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4809bb6013894d13a894acb816f7dca8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}] Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f9ba173edb2b403493b6a65942cf6bab Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 52330818-f5f6-4744-bdca-28952038b28b could not be found. Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '52330818-f5f6-4744-bdca-28952038b28b'} Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52330818-f5f6-4744-bdca-28952038b28b could not be found. Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52330818-f5f6-4744-bdca-28952038b28b could not be found. Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:28.422971 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:28.427620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:28.427620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:28.427620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:28.427620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:28.427620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:28.427620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52330818-f5f6-4744-bdca-28952038b28b could not be found. Oct 05 17:53:28.427620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:28.429662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Returning 404 to user: Instance 52330818-f5f6-4744-bdca-28952038b28b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:28.431491 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e4ca0b54-b606-4e79-a3af-b8f6695ee04d tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b" status: 404 len: 111 microversion: 2.1 time: 0.072649 Oct 05 17:53:28.432764 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2146/4561] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:28 2022] GET /compute/v2.1/servers/52330818-f5f6-4744-bdca-28952038b28b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:53:28.446481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1c57325a-8db8-4c02-9d45-bfa6e47d91c0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:28.519204 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1c57325a-8db8-4c02-9d45-bfa6e47d91c0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "DELETE /compute/v2.1/os-server-groups/3e76ac12-a839-479b-9e5f-c34e96751838" status: 204 len: 0 microversion: 2.1 time: 0.081146 Oct 05 17:53:28.520565 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2416/4562] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 17:53:28 2022] DELETE /compute/v2.1/os-server-groups/3e76ac12-a839-479b-9e5f-c34e96751838 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:53:28.533112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00459b21-c9fa-4fc1-93fe-39a1439a5ae0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:28.534767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00459b21-c9fa-4fc1-93fe-39a1439a5ae0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:28.545847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00459b21-c9fa-4fc1-93fe-39a1439a5ae0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:28.547094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00459b21-c9fa-4fc1-93fe-39a1439a5ae0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:28.547748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00459b21-c9fa-4fc1-93fe-39a1439a5ae0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:28.548714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00459b21-c9fa-4fc1-93fe-39a1439a5ae0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:28.549180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00459b21-c9fa-4fc1-93fe-39a1439a5ae0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:28.549640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00459b21-c9fa-4fc1-93fe-39a1439a5ae0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:28.602684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00459b21-c9fa-4fc1-93fe-39a1439a5ae0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:53:28.743789 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00459b21-c9fa-4fc1-93fe-39a1439a5ae0 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 204 len: 0 microversion: 2.1 time: 0.217992 Oct 05 17:53:28.745255 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2147/4563] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:53:28 2022] DELETE /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:53:28.753526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-00a27436-f054-4381-80b7-4f9c133ed81b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:28.754213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-00a27436-f054-4381-80b7-4f9c133ed81b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:28.773858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a27436-f054-4381-80b7-4f9c133ed81b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:28.774721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a27436-f054-4381-80b7-4f9c133ed81b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:28.775357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a27436-f054-4381-80b7-4f9c133ed81b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:28.776264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a27436-f054-4381-80b7-4f9c133ed81b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:28.776915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a27436-f054-4381-80b7-4f9c133ed81b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:28.777529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a27436-f054-4381-80b7-4f9c133ed81b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:28.899257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7063fe34-8baa-4452-bc1c-f4153a534dcd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:28.900113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7063fe34-8baa-4452-bc1c-f4153a534dcd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:28.916904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7063fe34-8baa-4452-bc1c-f4153a534dcd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:28.919823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7063fe34-8baa-4452-bc1c-f4153a534dcd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:28.921311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7063fe34-8baa-4452-bc1c-f4153a534dcd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:28.923536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7063fe34-8baa-4452-bc1c-f4153a534dcd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:28.925040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7063fe34-8baa-4452-bc1c-f4153a534dcd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:28.928632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7063fe34-8baa-4452-bc1c-f4153a534dcd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:29.124841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-00a27436-f054-4381-80b7-4f9c133ed81b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:29.166627 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-00a27436-f054-4381-80b7-4f9c133ed81b tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1472 microversion: 2.1 time: 0.414502 Oct 05 17:53:29.170739 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2417/4564] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:28 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1472 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:53:29.637179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7063fe34-8baa-4452-bc1c-f4153a534dcd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:29.648536 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7063fe34-8baa-4452-bc1c-f4153a534dcd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1393 microversion: 2.1 time: 0.753591 Oct 05 17:53:29.650453 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2148/4565] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:28 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1393 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:30.195017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54696444-4e2a-4613-a699-0cbfc5129a97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:30.196590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54696444-4e2a-4613-a699-0cbfc5129a97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:30.222217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54696444-4e2a-4613-a699-0cbfc5129a97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:30.224226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54696444-4e2a-4613-a699-0cbfc5129a97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:30.226416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54696444-4e2a-4613-a699-0cbfc5129a97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:30.236033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54696444-4e2a-4613-a699-0cbfc5129a97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:30.238450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54696444-4e2a-4613-a699-0cbfc5129a97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:30.249357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54696444-4e2a-4613-a699-0cbfc5129a97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:30.808866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9e077b5b-383a-40c2-82de-297a1b7f0e7d tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Action: 'create', calling method: .version_select at 0x7f77742cb160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2094373563"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:31.050271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54696444-4e2a-4613-a699-0cbfc5129a97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ba173edb2b403493b6a65942cf6bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4809bb6013894d13a894acb816f7dca8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:31.063192 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54696444-4e2a-4613-a699-0cbfc5129a97 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 200 len: 1472 microversion: 2.1 time: 0.874135 Oct 05 17:53:31.063989 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2418/4566] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:30 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 1472 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:31.068759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-95fb97a3-9f46-4b74-be5c-03200ae6e50e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:31.069374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-95fb97a3-9f46-4b74-be5c-03200ae6e50e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:31.102946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95fb97a3-9f46-4b74-be5c-03200ae6e50e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:31.103831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95fb97a3-9f46-4b74-be5c-03200ae6e50e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:31.105729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95fb97a3-9f46-4b74-be5c-03200ae6e50e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:31.106672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95fb97a3-9f46-4b74-be5c-03200ae6e50e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:31.110008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95fb97a3-9f46-4b74-be5c-03200ae6e50e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:31.110881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95fb97a3-9f46-4b74-be5c-03200ae6e50e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:31.125404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:31.381951 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9e077b5b-383a-40c2-82de-297a1b7f0e7d tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.799641 Oct 05 17:53:31.383817 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2149/4567] 10.222.0.70 () {60 vars in 1155 bytes} [Wed Oct 5 17:53:30 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 804 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 05 17:53:31.390617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1e547fbe-27af-4330-b31b-35a42ef6c8d8 req-50483dba-e0d7-4248-85b6-4cb14973aaa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a708a04f-a0cd-42d3-92d5-2f5d4dd8577b", "name": "network-vif-deleted", "tag": "3c088e78-5e15-41c1-ba4e-784a282e5586"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:31.450340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1e547fbe-27af-4330-b31b-35a42ef6c8d8 req-50483dba-e0d7-4248-85b6-4cb14973aaa6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:31.452165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1e547fbe-27af-4330-b31b-35a42ef6c8d8 req-50483dba-e0d7-4248-85b6-4cb14973aaa6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:31.455356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1e547fbe-27af-4330-b31b-35a42ef6c8d8 req-50483dba-e0d7-4248-85b6-4cb14973aaa6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:31.495655 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1e547fbe-27af-4330-b31b-35a42ef6c8d8 req-50483dba-e0d7-4248-85b6-4cb14973aaa6 service nova] Creating event network-vif-deleted:3c088e78-5e15-41c1-ba4e-784a282e5586 for instance a708a04f-a0cd-42d3-92d5-2f5d4dd8577b on n-h1-835595-3 Oct 05 17:53:31.521973 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1e547fbe-27af-4330-b31b-35a42ef6c8d8 req-50483dba-e0d7-4248-85b6-4cb14973aaa6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133545 Oct 05 17:53:31.522673 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2150/4568] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:31.541518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-59903dfd-b957-4a22-89a3-a80117b41aea tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f7774314dc0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:31.715805 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-59903dfd-b957-4a22-89a3-a80117b41aea tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b" status: 200 len: 345 microversion: 2.1 time: 0.190158 Oct 05 17:53:31.718779 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2151/4569] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:53:31 2022] GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b => generated 345 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:32.162909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:32.164933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] [instance: a708a04f-a0cd-42d3-92d5-2f5d4dd8577b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:32.179761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:32.180263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:32.180703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:32.181421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:32.181892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:32.197195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:32.221030 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] HTTP exception thrown: Instance a708a04f-a0cd-42d3-92d5-2f5d4dd8577b could not be found. Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Request method failure captured: Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b HTTP/1.1 Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcPPFtxqN7OJ2tSq8Z6kZ1F1V29UfBavlxJsEUtebkivrobdBh4ZNnPHiDHKe9sWSp4OiMXp3s7tmDOr0QSg4nJI8aD-s-T1lZihFG8nZsOhFrnvT7iiSkfpy0-vSMOuon7gSJXAZARlz8HYSW6z_XLc0a6PSxY78f7eXNikBFy8rD4 Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4809bb6013894d13a894acb816f7dca8", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4809bb6013894d13a894acb816f7dca8"}]}] Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4809bb6013894d13a894acb816f7dca8 Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1593276147 Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f9ba173edb2b403493b6a65942cf6bab Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersOnMultiNodesTest-1593276147-project Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a708a04f-a0cd-42d3-92d5-2f5d4dd8577b could not be found. Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a708a04f-a0cd-42d3-92d5-2f5d4dd8577b'} Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a708a04f-a0cd-42d3-92d5-2f5d4dd8577b could not be found. Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a708a04f-a0cd-42d3-92d5-2f5d4dd8577b could not be found. Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:32.225169 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:32.232102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:32.232102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:32.232102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:32.232102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:32.232102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:32.232102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a708a04f-a0cd-42d3-92d5-2f5d4dd8577b could not be found. Oct 05 17:53:32.232102 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:32.247268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] Returning 404 to user: Instance a708a04f-a0cd-42d3-92d5-2f5d4dd8577b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:32.248225 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8e42d04-baaf-4ad6-bd87-bcb075c922a2 tempest-ServersOnMultiNodesTest-1593276147 tempest-ServersOnMultiNodesTest-1593276147-project] 10.222.0.70 "GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b" status: 404 len: 111 microversion: 2.1 time: 0.089555 Oct 05 17:53:32.248812 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2152/4570] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:32 2022] GET /compute/v2.1/servers/a708a04f-a0cd-42d3-92d5-2f5d4dd8577b => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:53:32.293083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-95fb97a3-9f46-4b74-be5c-03200ae6e50e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:32.307354 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-95fb97a3-9f46-4b74-be5c-03200ae6e50e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1393 microversion: 2.1 time: 1.241552 Oct 05 17:53:32.307985 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2419/4571] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:31 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1393 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:32.732912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-37b74ca8-b2a6-4e2f-a475-92f1e59ac1e5 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f77743148b0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:32.818048 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-37b74ca8-b2a6-4e2f-a475-92f1e59ac1e5 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b" status: 200 len: 345 microversion: 2.1 time: 0.088979 Oct 05 17:53:32.825616 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2153/4572] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:53:32 2022] GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b => generated 345 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:33.335301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d7eac203-ff0b-405e-a0b1-0b1bab936a65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:33.336334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d7eac203-ff0b-405e-a0b1-0b1bab936a65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:33.362411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7eac203-ff0b-405e-a0b1-0b1bab936a65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:33.363753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7eac203-ff0b-405e-a0b1-0b1bab936a65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:33.364447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7eac203-ff0b-405e-a0b1-0b1bab936a65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:33.366472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7eac203-ff0b-405e-a0b1-0b1bab936a65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:33.367511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7eac203-ff0b-405e-a0b1-0b1bab936a65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:33.372000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7eac203-ff0b-405e-a0b1-0b1bab936a65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:33.838096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-988c0104-cde9-420d-b0c4-fe2fa00d3584 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f77743085e0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:33.883602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d7eac203-ff0b-405e-a0b1-0b1bab936a65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:33.898261 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d7eac203-ff0b-405e-a0b1-0b1bab936a65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1393 microversion: 2.1 time: 0.570702 Oct 05 17:53:33.902475 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2420/4573] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:33 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1393 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:33.929708 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-988c0104-cde9-420d-b0c4-fe2fa00d3584 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b" status: 200 len: 346 microversion: 2.1 time: 0.100469 Oct 05 17:53:33.930300 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2154/4574] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:53:33 2022] GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:33.944967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3fb2eb68-d360-444b-a205-48c929302772 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Action: 'create', calling method: .version_select at 0x7f77740b9ee0>, body: {"snapshot": {"volume_id": "06a967c7-0d91-4662-81ff-8077ee127c2b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-933638381"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:34.116246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-06f7a459-02c1-452e-b8a8-a0b127c89535 req-35db0245-b3ba-43ec-a97a-959d7115abff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8bee32-1d91-4dcf-a8be-8e0b26b77790", "tag": "2e0451f7-6590-4750-ab4b-0ea667cb7622"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:34.139986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-06f7a459-02c1-452e-b8a8-a0b127c89535 req-35db0245-b3ba-43ec-a97a-959d7115abff service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:34.155678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-06f7a459-02c1-452e-b8a8-a0b127c89535 req-35db0245-b3ba-43ec-a97a-959d7115abff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:34.156181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-06f7a459-02c1-452e-b8a8-a0b127c89535 req-35db0245-b3ba-43ec-a97a-959d7115abff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:34.198092 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-06f7a459-02c1-452e-b8a8-a0b127c89535 req-35db0245-b3ba-43ec-a97a-959d7115abff service nova] Creating event network-changed:2e0451f7-6590-4750-ab4b-0ea667cb7622 for instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 on n-h1-835595-3 Oct 05 17:53:34.207219 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3fb2eb68-d360-444b-a205-48c929302772 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.266695 Oct 05 17:53:34.208649 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-06f7a459-02c1-452e-b8a8-a0b127c89535 req-35db0245-b3ba-43ec-a97a-959d7115abff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097304 Oct 05 17:53:34.209452 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2155/4575] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:34.216645 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2421/4576] 10.222.0.70 () {60 vars in 1162 bytes} [Wed Oct 5 17:53:33 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:34.219492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eec2047c-e117-4d3c-9cde-c7a6b677969d tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f77742cb700>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:34.277236 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eec2047c-e117-4d3c-9cde-c7a6b677969d tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa" status: 200 len: 286 microversion: 2.1 time: 0.061893 Oct 05 17:53:34.283866 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2156/4577] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:53:34 2022] GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:53:34.286784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:34.291333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5fd615da-77d4-4142-9f2c-87ccc8052e7d tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f777408ed30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:34.319806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:34.455529 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5fd615da-77d4-4142-9f2c-87ccc8052e7d tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.169413 Oct 05 17:53:34.468435 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2422/4578] 10.222.0.70 () {58 vars in 1140 bytes} [Wed Oct 5 17:53:34 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:34.482925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-122a15fe-fdd9-4089-8447-7a38c33204a1 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f77743148b0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:34.600142 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-122a15fe-fdd9-4089-8447-7a38c33204a1 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa" status: 200 len: 286 microversion: 2.1 time: 0.123570 Oct 05 17:53:34.601155 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2157/4579] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:53:34 2022] GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa => generated 286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:34.928826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-06cca376-ccf0-44bf-884a-ad36b2e12648 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:34.930262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-06cca376-ccf0-44bf-884a-ad36b2e12648 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:34.945916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06cca376-ccf0-44bf-884a-ad36b2e12648 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:34.950553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06cca376-ccf0-44bf-884a-ad36b2e12648 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:34.951951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06cca376-ccf0-44bf-884a-ad36b2e12648 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:34.957675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06cca376-ccf0-44bf-884a-ad36b2e12648 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:34.958851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06cca376-ccf0-44bf-884a-ad36b2e12648 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:34.960459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06cca376-ccf0-44bf-884a-ad36b2e12648 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:35.614147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-14704b5c-be7c-4ea5-a3a2-bac14c97ea2c tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f7774308310>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:35.707334 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-14704b5c-be7c-4ea5-a3a2-bac14c97ea2c tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa" status: 200 len: 286 microversion: 2.1 time: 0.098172 Oct 05 17:53:35.708611 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2158/4580] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:53:35 2022] GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:36.012081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-06cca376-ccf0-44bf-884a-ad36b2e12648 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:36.030866 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-06cca376-ccf0-44bf-884a-ad36b2e12648 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1393 microversion: 2.1 time: 1.111434 Oct 05 17:53:36.056782 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2423/4581] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:34 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1393 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:36.720776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f5f904c5-161f-4d61-bfbf-00de14fcffc2 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f77743084c0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:36.734352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:36.791872 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f5f904c5-161f-4d61-bfbf-00de14fcffc2 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa" status: 200 len: 286 microversion: 2.1 time: 0.075235 Oct 05 17:53:36.792747 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2159/4582] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:53:36 2022] GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:37.072209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49f0b38d-317c-4bfa-8737-363fd6dd3db4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:37.072720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-49f0b38d-317c-4bfa-8737-363fd6dd3db4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:37.080864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f0b38d-317c-4bfa-8737-363fd6dd3db4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:37.081716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f0b38d-317c-4bfa-8737-363fd6dd3db4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:37.082427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f0b38d-317c-4bfa-8737-363fd6dd3db4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:37.083383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f0b38d-317c-4bfa-8737-363fd6dd3db4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:37.084057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f0b38d-317c-4bfa-8737-363fd6dd3db4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:37.084869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f0b38d-317c-4bfa-8737-363fd6dd3db4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:37.511614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-49f0b38d-317c-4bfa-8737-363fd6dd3db4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:37.521418 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49f0b38d-317c-4bfa-8737-363fd6dd3db4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1393 microversion: 2.1 time: 0.453425 Oct 05 17:53:37.528613 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2424/4583] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:37 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1393 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:37.805966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb2f3d40-cffa-4518-98e0-daee16f77705 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f77742d21f0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:37.867828 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb2f3d40-cffa-4518-98e0-daee16f77705 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa" status: 200 len: 287 microversion: 2.1 time: 0.066641 Oct 05 17:53:37.868926 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2160/4584] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:53:37 2022] GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:37.881158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-917acc45-9da8-4321-80ad-d5f7399a7e40 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f777404faf0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:38.028121 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-917acc45-9da8-4321-80ad-d5f7399a7e40 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "DELETE /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa" status: 202 len: 0 microversion: 2.1 time: 0.150663 Oct 05 17:53:38.028989 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2425/4585] 10.222.0.70 () {58 vars in 1254 bytes} [Wed Oct 5 17:53:37 2022] DELETE /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:53:38.038800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-badf7d29-aaec-4f0f-8500-edd2d7108ee6 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f77742cb790>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:38.104546 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-badf7d29-aaec-4f0f-8500-edd2d7108ee6 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa" status: 200 len: 286 microversion: 2.1 time: 0.071389 Oct 05 17:53:38.105161 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2161/4586] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:53:38 2022] GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:53:38.551759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aa122648-0f2b-433e-b2e8-2c3f2a9ac270 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:38.553155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aa122648-0f2b-433e-b2e8-2c3f2a9ac270 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:38.585336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa122648-0f2b-433e-b2e8-2c3f2a9ac270 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:38.586122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa122648-0f2b-433e-b2e8-2c3f2a9ac270 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:38.586772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa122648-0f2b-433e-b2e8-2c3f2a9ac270 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:38.588147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa122648-0f2b-433e-b2e8-2c3f2a9ac270 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:38.588793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa122648-0f2b-433e-b2e8-2c3f2a9ac270 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:38.589444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aa122648-0f2b-433e-b2e8-2c3f2a9ac270 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:38.885004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-99deb70e-cc80-4a43-b374-880ee51bdc0a tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:38.889164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99deb70e-cc80-4a43-b374-880ee51bdc0a tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:38.889969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99deb70e-cc80-4a43-b374-880ee51bdc0a tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:38.892507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99deb70e-cc80-4a43-b374-880ee51bdc0a tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:38.893961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99deb70e-cc80-4a43-b374-880ee51bdc0a tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:38.894625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99deb70e-cc80-4a43-b374-880ee51bdc0a tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:38.896224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99deb70e-cc80-4a43-b374-880ee51bdc0a tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:38.944422 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-99deb70e-cc80-4a43-b374-880ee51bdc0a tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.381810 Oct 05 17:53:38.945646 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2162/4587] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:53:38 2022] GET /compute/v2.1/os-services => generated 944 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:53:38.970984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2bc8d806-ad76-4e86-bb52-7253a278e137 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:38.979265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bc8d806-ad76-4e86-bb52-7253a278e137 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:38.980241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bc8d806-ad76-4e86-bb52-7253a278e137 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:38.980945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bc8d806-ad76-4e86-bb52-7253a278e137 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:38.986203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bc8d806-ad76-4e86-bb52-7253a278e137 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:38.988807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bc8d806-ad76-4e86-bb52-7253a278e137 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:38.990408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2bc8d806-ad76-4e86-bb52-7253a278e137 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:39.042441 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2bc8d806-ad76-4e86-bb52-7253a278e137 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?host=n-d-835595-3" status: 200 len: 578 microversion: 2.1 time: 0.079863 Oct 05 17:53:39.052679 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2163/4588] 10.222.0.70 () {58 vars in 1172 bytes} [Wed Oct 5 17:53:38 2022] GET /compute/v2.1/os-services?host=n-d-835595-3 => generated 578 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:39.057946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-12aa8693-84e3-4a87-bedb-6c932670fb32 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:39.061834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12aa8693-84e3-4a87-bedb-6c932670fb32 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:39.062768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12aa8693-84e3-4a87-bedb-6c932670fb32 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:39.063391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12aa8693-84e3-4a87-bedb-6c932670fb32 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:39.064325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12aa8693-84e3-4a87-bedb-6c932670fb32 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:39.065071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12aa8693-84e3-4a87-bedb-6c932670fb32 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:39.065824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12aa8693-84e3-4a87-bedb-6c932670fb32 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:39.098442 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-12aa8693-84e3-4a87-bedb-6c932670fb32 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044436 Oct 05 17:53:39.109219 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2164/4589] 10.222.0.70 () {58 vars in 1176 bytes} [Wed Oct 5 17:53:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:39.116816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b93c19e-d887-4f43-b340-6d971d1bff45 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:39.126887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b93c19e-d887-4f43-b340-6d971d1bff45 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:39.128451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b93c19e-d887-4f43-b340-6d971d1bff45 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:39.129205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b93c19e-d887-4f43-b340-6d971d1bff45 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:39.130848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b93c19e-d887-4f43-b340-6d971d1bff45 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:39.131501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b93c19e-d887-4f43-b340-6d971d1bff45 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:39.132086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b93c19e-d887-4f43-b340-6d971d1bff45 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:39.166263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aa122648-0f2b-433e-b2e8-2c3f2a9ac270 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:39.180391 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aa122648-0f2b-433e-b2e8-2c3f2a9ac270 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1393 microversion: 2.1 time: 0.632543 Oct 05 17:53:39.182860 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2426/4590] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:38 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1393 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:39.193738 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b93c19e-d887-4f43-b340-6d971d1bff45 tempest-ServicesAdminTestJSON-311794846 tempest-ServicesAdminTestJSON-311794846-project-admin] 10.222.0.70 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.083099 Oct 05 17:53:39.194933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-33c29d8a-f1ab-4cc6-ad83-7be93da8720f tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f777404fca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:39.199450 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2165/4591] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:53:39 2022] GET /compute/v2.1/os-services => generated 944 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:39.257216 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-33c29d8a-f1ab-4cc6-ad83-7be93da8720f tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa" status: 200 len: 286 microversion: 2.1 time: 0.072085 Oct 05 17:53:39.258169 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2427/4592] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:53:39 2022] GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:40.208891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7674c478-ec33-47d1-8bd0-14695dcbb13d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:40.209644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7674c478-ec33-47d1-8bd0-14695dcbb13d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:40.226346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7674c478-ec33-47d1-8bd0-14695dcbb13d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:40.229613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7674c478-ec33-47d1-8bd0-14695dcbb13d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:40.230529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7674c478-ec33-47d1-8bd0-14695dcbb13d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:40.231505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7674c478-ec33-47d1-8bd0-14695dcbb13d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:40.231986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7674c478-ec33-47d1-8bd0-14695dcbb13d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:40.236531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7674c478-ec33-47d1-8bd0-14695dcbb13d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:40.247524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:40.272380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a3fa0970-4db5-467e-937c-db8d753488c7 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f777404f280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:40.347894 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a3fa0970-4db5-467e-937c-db8d753488c7 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa" status: 200 len: 286 microversion: 2.1 time: 0.080385 Oct 05 17:53:40.348906 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2428/4593] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:53:40 2022] GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:53:40.957436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7674c478-ec33-47d1-8bd0-14695dcbb13d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:40.968599 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7674c478-ec33-47d1-8bd0-14695dcbb13d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1393 microversion: 2.1 time: 0.763151 Oct 05 17:53:40.983863 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2166/4594] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:40 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1393 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:41.363585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-50917306-4e5b-413e-b06b-3d255bcb30b8 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f777408eca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:41.419581 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-50917306-4e5b-413e-b06b-3d255bcb30b8 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] HTTP exception thrown: Snapshot d3a5aa82-a5e5-4722-a0bd-86b6ca558daa could not be found. Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-50917306-4e5b-413e-b06b-3d255bcb30b8 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Request method failure captured: Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa HTTP/1.1 Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcSa_wDTLCSwqHG9QHbnbmidW3Kv6CbChRbfyMJtkT89Whch56imIFbFYQRHxa-2NPoyTWaIpXHgcHxeM652nbGltOz3P8WBNIwZNpxGPUYVzaOHU0xrTPmL-wBwEkojkngky1eug302fRFSiIGi0TYuGIcl1HvE1U3G05V4rCQn5Nw Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: b8207e416eb345febea3cabf31f87d80 Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8207e416eb345febea3cabf31f87d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8207e416eb345febea3cabf31f87d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8207e416eb345febea3cabf31f87d80", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8207e416eb345febea3cabf31f87d80"}]}] Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: b8207e416eb345febea3cabf31f87d80 Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesSnapshotsTestJSON-1946284235-project Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 2929db08ff89440e8895e479882fd625 Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1946284235-project Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: exception: Snapshot d3a5aa82-a5e5-4722-a0bd-86b6ca558daa could not be found. Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'd3a5aa82-a5e5-4722-a0bd-86b6ca558daa'} Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d3a5aa82-a5e5-4722-a0bd-86b6ca558daa could not be found. (HTTP 404) (Request-ID: req-fb8dff41-75ac-417c-87b2-8c030c20d2d4) Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 17:53:41.429479 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d3a5aa82-a5e5-4722-a0bd-86b6ca558daa could not be found. Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d3a5aa82-a5e5-4722-a0bd-86b6ca558daa could not be found. Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d3a5aa82-a5e5-4722-a0bd-86b6ca558daa could not be found. Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-50917306-4e5b-413e-b06b-3d255bcb30b8 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Returning 404 to user: Snapshot d3a5aa82-a5e5-4722-a0bd-86b6ca558daa could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-50917306-4e5b-413e-b06b-3d255bcb30b8 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa" status: 404 len: 111 microversion: 2.1 time: 0.073978 Oct 05 17:53:41.437369 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2429/4595] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 17:53:41 2022] GET /compute/v2.1/os-snapshots/d3a5aa82-a5e5-4722-a0bd-86b6ca558daa => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:53:41.440717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cbd43712-fbc0-4a2b-a7b6-aaf091d7e089 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f77742c6ee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:41.556038 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cbd43712-fbc0-4a2b-a7b6-aaf091d7e089 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b" status: 202 len: 0 microversion: 2.1 time: 0.119465 Oct 05 17:53:41.556675 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2167/4596] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:53:41 2022] DELETE /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:53:41.567411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd3728f7-6d2a-42f1-8ab3-fe0c6bf4adb1 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f777408edc0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:41.707014 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd3728f7-6d2a-42f1-8ab3-fe0c6bf4adb1 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b" status: 200 len: 345 microversion: 2.1 time: 0.145490 Oct 05 17:53:41.707934 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2430/4597] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:53:41 2022] GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:42.001421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-54cbf6c7-69a1-4fc0-86d0-1629ba74717c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:42.002299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-54cbf6c7-69a1-4fc0-86d0-1629ba74717c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:42.015608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:DELETE=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:42.017735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54cbf6c7-69a1-4fc0-86d0-1629ba74717c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:42.020991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54cbf6c7-69a1-4fc0-86d0-1629ba74717c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:42.022153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54cbf6c7-69a1-4fc0-86d0-1629ba74717c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:42.023863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54cbf6c7-69a1-4fc0-86d0-1629ba74717c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:42.025641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54cbf6c7-69a1-4fc0-86d0-1629ba74717c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:42.026871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54cbf6c7-69a1-4fc0-86d0-1629ba74717c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:42.516830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-54cbf6c7-69a1-4fc0-86d0-1629ba74717c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:42.526346 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-54cbf6c7-69a1-4fc0-86d0-1629ba74717c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1393 microversion: 2.1 time: 0.532564 Oct 05 17:53:42.529330 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2168/4598] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:41 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1393 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:42.722565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63679071-ed9d-470f-923d-e1c073515ad5 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f77740258b0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:42.845897 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63679071-ed9d-470f-923d-e1c073515ad5 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b" status: 200 len: 345 microversion: 2.1 time: 0.127925 Oct 05 17:53:42.846582 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2431/4599] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:53:42 2022] GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:43.067884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-52b0db1d-b564-490d-94b3-cf23cbccf725 req-579581a3-4674-4d5c-a4d1-1b3281b8a9fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8bee32-1d91-4dcf-a8be-8e0b26b77790", "name": "network-vif-plugged", "status": "completed", "tag": "2e0451f7-6590-4750-ab4b-0ea667cb7622"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:43.099473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-52b0db1d-b564-490d-94b3-cf23cbccf725 req-579581a3-4674-4d5c-a4d1-1b3281b8a9fd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:43.099969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-52b0db1d-b564-490d-94b3-cf23cbccf725 req-579581a3-4674-4d5c-a4d1-1b3281b8a9fd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:43.100416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-52b0db1d-b564-490d-94b3-cf23cbccf725 req-579581a3-4674-4d5c-a4d1-1b3281b8a9fd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:43.151401 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-52b0db1d-b564-490d-94b3-cf23cbccf725 req-579581a3-4674-4d5c-a4d1-1b3281b8a9fd service nova] Creating event network-vif-plugged:2e0451f7-6590-4750-ab4b-0ea667cb7622 for instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 on n-h1-835595-3 Oct 05 17:53:43.173207 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-52b0db1d-b564-490d-94b3-cf23cbccf725 req-579581a3-4674-4d5c-a4d1-1b3281b8a9fd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109993 Oct 05 17:53:43.174440 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2169/4600] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:43.552549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-977fe837-1125-474e-ad94-96a5ade40a23 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:43.553294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-977fe837-1125-474e-ad94-96a5ade40a23 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:43.560293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:43.572728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977fe837-1125-474e-ad94-96a5ade40a23 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:43.578933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977fe837-1125-474e-ad94-96a5ade40a23 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:43.580658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977fe837-1125-474e-ad94-96a5ade40a23 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:43.581762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977fe837-1125-474e-ad94-96a5ade40a23 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:43.582583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977fe837-1125-474e-ad94-96a5ade40a23 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:43.583244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-977fe837-1125-474e-ad94-96a5ade40a23 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:43.826886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-977fe837-1125-474e-ad94-96a5ade40a23 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:43.847900 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-977fe837-1125-474e-ad94-96a5ade40a23 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1393 microversion: 2.1 time: 0.301800 Oct 05 17:53:43.849039 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2432/4601] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:43 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1393 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:43.862238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85380d7e-7e53-4a76-acb5-58a98bc61eec tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f77742a3a60>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:43.954146 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85380d7e-7e53-4a76-acb5-58a98bc61eec tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b" status: 200 len: 345 microversion: 2.1 time: 0.096643 Oct 05 17:53:43.958330 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2170/4602] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:53:43 2022] GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:53:44.874359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56024c9f-dda8-40e7-9833-32debd56255c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:44.876546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56024c9f-dda8-40e7-9833-32debd56255c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:44.890968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56024c9f-dda8-40e7-9833-32debd56255c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:44.891743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56024c9f-dda8-40e7-9833-32debd56255c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:44.892557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56024c9f-dda8-40e7-9833-32debd56255c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:44.894700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56024c9f-dda8-40e7-9833-32debd56255c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:44.895551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56024c9f-dda8-40e7-9833-32debd56255c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:44.896242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56024c9f-dda8-40e7-9833-32debd56255c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:44.971537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-35b99fea-ccf9-4e2e-ba1d-f57a2f283cd8 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f7774354670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:45.042586 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-35b99fea-ccf9-4e2e-ba1d-f57a2f283cd8 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] HTTP exception thrown: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-35b99fea-ccf9-4e2e-ba1d-f57a2f283cd8 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Request method failure captured: Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b HTTP/1.1 Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcSa_wDTLCSwqHG9QHbnbmidW3Kv6CbChRbfyMJtkT89Whch56imIFbFYQRHxa-2NPoyTWaIpXHgcHxeM652nbGltOz3P8WBNIwZNpxGPUYVzaOHU0xrTPmL-wBwEkojkngky1eug302fRFSiIGi0TYuGIcl1HvE1U3G05V4rCQn5Nw Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: b8207e416eb345febea3cabf31f87d80 Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8207e416eb345febea3cabf31f87d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8207e416eb345febea3cabf31f87d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8207e416eb345febea3cabf31f87d80", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8207e416eb345febea3cabf31f87d80"}]}] Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: b8207e416eb345febea3cabf31f87d80 Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-VolumesSnapshotsTestJSON-1946284235-project Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 2929db08ff89440e8895e479882fd625 Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1946284235-project Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: exception: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '06a967c7-0d91-4662-81ff-8077ee127c2b'} Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. (HTTP 404) (Request-ID: req-3536aef9-07e5-4a08-91a7-bcd72a874549) Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 17:53:45.045114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-35b99fea-ccf9-4e2e-ba1d-f57a2f283cd8 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Returning 404 to user: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-35b99fea-ccf9-4e2e-ba1d-f57a2f283cd8 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b" status: 404 len: 109 microversion: 2.1 time: 0.082381 Oct 05 17:53:45.049235 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2171/4603] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:53:44 2022] GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:53:45.064381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4fd427f7-ee53-4ac8-99ad-6ced6db40786 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f7774314b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:45.114640 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-4fd427f7-ee53-4ac8-99ad-6ced6db40786 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] HTTP exception thrown: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4fd427f7-ee53-4ac8-99ad-6ced6db40786 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Request method failure captured: Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b HTTP/1.1 Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcSa_wDTLCSwqHG9QHbnbmidW3Kv6CbChRbfyMJtkT89Whch56imIFbFYQRHxa-2NPoyTWaIpXHgcHxeM652nbGltOz3P8WBNIwZNpxGPUYVzaOHU0xrTPmL-wBwEkojkngky1eug302fRFSiIGi0TYuGIcl1HvE1U3G05V4rCQn5Nw Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: b8207e416eb345febea3cabf31f87d80 Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8207e416eb345febea3cabf31f87d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8207e416eb345febea3cabf31f87d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8207e416eb345febea3cabf31f87d80", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8207e416eb345febea3cabf31f87d80"}]}] Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: b8207e416eb345febea3cabf31f87d80 Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-VolumesSnapshotsTestJSON-1946284235-project Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 2929db08ff89440e8895e479882fd625 Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1946284235-project Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: exception: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '06a967c7-0d91-4662-81ff-8077ee127c2b'} Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. (HTTP 404) (Request-ID: req-9cca059e-af26-42e7-a966-beef1dac1468) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 17:53:45.116586 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4fd427f7-ee53-4ac8-99ad-6ced6db40786 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Returning 404 to user: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4fd427f7-ee53-4ac8-99ad-6ced6db40786 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "DELETE /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b" status: 404 len: 109 microversion: 2.1 time: 0.064390 Oct 05 17:53:45.122063 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2172/4604] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 17:53:45 2022] DELETE /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:53:45.131550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55ed3e58-bdd8-43d4-8d30-42c13e4d7bd5 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Calling method '.version_select at 0x7f7774314b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:45.188960 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-55ed3e58-bdd8-43d4-8d30-42c13e4d7bd5 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] HTTP exception thrown: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55ed3e58-bdd8-43d4-8d30-42c13e4d7bd5 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Request method failure captured: Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b HTTP/1.1 Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcSa_wDTLCSwqHG9QHbnbmidW3Kv6CbChRbfyMJtkT89Whch56imIFbFYQRHxa-2NPoyTWaIpXHgcHxeM652nbGltOz3P8WBNIwZNpxGPUYVzaOHU0xrTPmL-wBwEkojkngky1eug302fRFSiIGi0TYuGIcl1HvE1U3G05V4rCQn5Nw Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: b8207e416eb345febea3cabf31f87d80 Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b8207e416eb345febea3cabf31f87d80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8207e416eb345febea3cabf31f87d80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b8207e416eb345febea3cabf31f87d80", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b8207e416eb345febea3cabf31f87d80"}]}] Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: b8207e416eb345febea3cabf31f87d80 Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1946284235 Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-VolumesSnapshotsTestJSON-1946284235-project Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 2929db08ff89440e8895e479882fd625 Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1946284235-project Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: exception: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '06a967c7-0d91-4662-81ff-8077ee127c2b'} Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. (HTTP 404) (Request-ID: req-927d99af-442e-4313-b4d5-58cc683964ba) Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 05 17:53:45.192007 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. Oct 05 17:53:45.196761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:53:45.206827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55ed3e58-bdd8-43d4-8d30-42c13e4d7bd5 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] Returning 404 to user: Volume 06a967c7-0d91-4662-81ff-8077ee127c2b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:53:45.206827 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-55ed3e58-bdd8-43d4-8d30-42c13e4d7bd5 tempest-VolumesSnapshotsTestJSON-1946284235 tempest-VolumesSnapshotsTestJSON-1946284235-project] 10.222.0.70 "GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b" status: 404 len: 109 microversion: 2.1 time: 0.079548 Oct 05 17:53:45.208321 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2173/4605] 10.222.0.70 () {58 vars in 1245 bytes} [Wed Oct 5 17:53:45 2022] GET /compute/v2.1/os-volumes/06a967c7-0d91-4662-81ff-8077ee127c2b => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:53:45.284488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-56024c9f-dda8-40e7-9833-32debd56255c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:45.293433 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56024c9f-dda8-40e7-9833-32debd56255c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1566 microversion: 2.1 time: 0.425690 Oct 05 17:53:45.311003 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2433/4606] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:44 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1566 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:45.330358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-175a0bb8-65e8-45eb-b85d-3822d69147f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:45.331418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-175a0bb8-65e8-45eb-b85d-3822d69147f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:45.344789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-175a0bb8-65e8-45eb-b85d-3822d69147f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:45.345784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-175a0bb8-65e8-45eb-b85d-3822d69147f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:45.346463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-175a0bb8-65e8-45eb-b85d-3822d69147f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:45.347347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-175a0bb8-65e8-45eb-b85d-3822d69147f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:45.347960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-175a0bb8-65e8-45eb-b85d-3822d69147f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:45.348545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-175a0bb8-65e8-45eb-b85d-3822d69147f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:45.705443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-175a0bb8-65e8-45eb-b85d-3822d69147f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:45.715846 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-175a0bb8-65e8-45eb-b85d-3822d69147f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1566 microversion: 2.1 time: 0.391692 Oct 05 17:53:45.730696 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2174/4607] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:45 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1566 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:50.986428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-89039bac-5568-4768-9067-91374d957325 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:53:50.987050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-89039bac-5568-4768-9067-91374d957325 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:53:51.005950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89039bac-5568-4768-9067-91374d957325 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:51.006814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89039bac-5568-4768-9067-91374d957325 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:51.007568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89039bac-5568-4768-9067-91374d957325 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:51.008463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89039bac-5568-4768-9067-91374d957325 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:51.009099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89039bac-5568-4768-9067-91374d957325 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:51.009788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89039bac-5568-4768-9067-91374d957325 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:51.041273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1bb12316-f95e-45f1-af91-8f1bafefdefd req-573c422a-a569-4049-9f8d-d774a6595d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8bee32-1d91-4dcf-a8be-8e0b26b77790", "tag": "2e0451f7-6590-4750-ab4b-0ea667cb7622"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:51.080381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:53:51.084334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1bb12316-f95e-45f1-af91-8f1bafefdefd req-573c422a-a569-4049-9f8d-d774a6595d0f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:53:51.086178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1bb12316-f95e-45f1-af91-8f1bafefdefd req-573c422a-a569-4049-9f8d-d774a6595d0f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:53:51.088528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1bb12316-f95e-45f1-af91-8f1bafefdefd req-573c422a-a569-4049-9f8d-d774a6595d0f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:53:51.109948 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1bb12316-f95e-45f1-af91-8f1bafefdefd req-573c422a-a569-4049-9f8d-d774a6595d0f service nova] Creating event network-changed:2e0451f7-6590-4750-ab4b-0ea667cb7622 for instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 on n-h1-835595-3 Oct 05 17:53:51.119023 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1bb12316-f95e-45f1-af91-8f1bafefdefd req-573c422a-a569-4049-9f8d-d774a6595d0f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095799 Oct 05 17:53:51.120256 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2175/4608] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:53:51.571787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-89039bac-5568-4768-9067-91374d957325 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:53:51.589191 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-89039bac-5568-4768-9067-91374d957325 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1566 microversion: 2.1 time: 0.608952 Oct 05 17:53:51.590270 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2434/4609] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:53:50 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1566 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:53:59.062398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1948411293", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "24932b3d-624c-45a1-8b2b-3202881311a2"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:53:59.184876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] validate_networks() for [('24932b3d-624c-45a1-8b2b-3202881311a2', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:54:00.375197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:54:00.375197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:54:00.375860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:54:00.376184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:54:00.376773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:54:00.390159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:00.390678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:00.391110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:00.391823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:00.392708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:00.393533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:00.412314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Getting quotas for project c84d0069489c415ba7219e61ff0ef20f. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:54:00.418228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Getting quotas for user f75bf061b0784e77aef92ed595337f3f and project c84d0069489c415ba7219e61ff0ef20f. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:54:00.433060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:54:00.437576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:54:00.495130 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cd6a9790-fbf7-468b-9794-9ed6e6327b4e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.237992 Oct 05 17:54:00.496520 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2176/4610] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:53:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2240 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:54:00.508817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cfc08246-7ee5-4456-aa10-caafef4ad9dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:00.510911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cfc08246-7ee5-4456-aa10-caafef4ad9dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:01.090692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cfc08246-7ee5-4456-aa10-caafef4ad9dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:01.103599 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cfc08246-7ee5-4456-aa10-caafef4ad9dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1224 microversion: 2.1 time: 0.599587 Oct 05 17:54:01.106247 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2435/4611] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:00 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1224 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:02.131884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-26d8c3d6-272e-4356-8922-eac6f4ff2d70 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:02.132496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-26d8c3d6-272e-4356-8922-eac6f4ff2d70 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:02.141086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26d8c3d6-272e-4356-8922-eac6f4ff2d70 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:02.141853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26d8c3d6-272e-4356-8922-eac6f4ff2d70 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:02.142504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26d8c3d6-272e-4356-8922-eac6f4ff2d70 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:02.143452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26d8c3d6-272e-4356-8922-eac6f4ff2d70 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:02.144839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26d8c3d6-272e-4356-8922-eac6f4ff2d70 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:02.145619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26d8c3d6-272e-4356-8922-eac6f4ff2d70 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:02.225217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-26d8c3d6-272e-4356-8922-eac6f4ff2d70 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:02.241140 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-26d8c3d6-272e-4356-8922-eac6f4ff2d70 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1276 microversion: 2.1 time: 0.110688 Oct 05 17:54:02.242182 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2177/4612] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:02 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:03.271363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7da09459-0f0f-494c-a8ff-271f63416a8d tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:03.272732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7da09459-0f0f-494c-a8ff-271f63416a8d tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:03.278730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=46 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:03.301578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7da09459-0f0f-494c-a8ff-271f63416a8d tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:03.302093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7da09459-0f0f-494c-a8ff-271f63416a8d tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:03.302566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7da09459-0f0f-494c-a8ff-271f63416a8d tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:03.305464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7da09459-0f0f-494c-a8ff-271f63416a8d tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:03.308984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7da09459-0f0f-494c-a8ff-271f63416a8d tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:03.309508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7da09459-0f0f-494c-a8ff-271f63416a8d tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:03.459979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7da09459-0f0f-494c-a8ff-271f63416a8d tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:03.497448 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7da09459-0f0f-494c-a8ff-271f63416a8d tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1282 microversion: 2.1 time: 0.229989 Oct 05 17:54:03.514323 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2436/4613] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:03 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1282 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:04.530475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9112be28-fc16-48b2-958c-f7ff15184651 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:04.531819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9112be28-fc16-48b2-958c-f7ff15184651 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:04.547287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9112be28-fc16-48b2-958c-f7ff15184651 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:04.547773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9112be28-fc16-48b2-958c-f7ff15184651 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:04.548204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9112be28-fc16-48b2-958c-f7ff15184651 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:04.553166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9112be28-fc16-48b2-958c-f7ff15184651 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:04.553527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9112be28-fc16-48b2-958c-f7ff15184651 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:04.553960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9112be28-fc16-48b2-958c-f7ff15184651 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:04.769771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9112be28-fc16-48b2-958c-f7ff15184651 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:04.780209 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9112be28-fc16-48b2-958c-f7ff15184651 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1324 microversion: 2.1 time: 0.254156 Oct 05 17:54:04.797446 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2178/4614] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:04 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1324 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:05.805202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f75a52a1-925d-485b-bb20-f5973e2f2ccf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:05.806597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f75a52a1-925d-485b-bb20-f5973e2f2ccf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:05.822442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f75a52a1-925d-485b-bb20-f5973e2f2ccf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:05.823574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f75a52a1-925d-485b-bb20-f5973e2f2ccf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:05.828423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f75a52a1-925d-485b-bb20-f5973e2f2ccf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:05.829244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f75a52a1-925d-485b-bb20-f5973e2f2ccf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:05.829743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f75a52a1-925d-485b-bb20-f5973e2f2ccf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:05.830157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f75a52a1-925d-485b-bb20-f5973e2f2ccf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:06.554870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f75a52a1-925d-485b-bb20-f5973e2f2ccf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:06.568169 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f75a52a1-925d-485b-bb20-f5973e2f2ccf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1324 microversion: 2.1 time: 0.767010 Oct 05 17:54:06.569249 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2437/4615] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:05 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1324 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:07.591353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-025df212-bd1e-488f-9011-926e00378e77 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:07.602265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-025df212-bd1e-488f-9011-926e00378e77 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:07.619993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-025df212-bd1e-488f-9011-926e00378e77 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:07.620863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-025df212-bd1e-488f-9011-926e00378e77 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:07.621537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-025df212-bd1e-488f-9011-926e00378e77 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:07.623070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-025df212-bd1e-488f-9011-926e00378e77 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:07.626408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-025df212-bd1e-488f-9011-926e00378e77 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:07.627127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-025df212-bd1e-488f-9011-926e00378e77 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:07.763142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6ab75732-ee0b-419a-9ff5-fedbe54c72e5 req-d25e20d7-fca0-4724-acd0-a769b7e0a054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54208b0-d0d4-4423-9695-42ac2b01e3f6", "tag": "9f48b921-1485-4227-a071-674db7f6bf40"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:07.780579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6ab75732-ee0b-419a-9ff5-fedbe54c72e5 req-d25e20d7-fca0-4724-acd0-a769b7e0a054 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:07.802919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6ab75732-ee0b-419a-9ff5-fedbe54c72e5 req-d25e20d7-fca0-4724-acd0-a769b7e0a054 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:07.804048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6ab75732-ee0b-419a-9ff5-fedbe54c72e5 req-d25e20d7-fca0-4724-acd0-a769b7e0a054 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:07.827426 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6ab75732-ee0b-419a-9ff5-fedbe54c72e5 req-d25e20d7-fca0-4724-acd0-a769b7e0a054 service nova] Creating event network-changed:9f48b921-1485-4227-a071-674db7f6bf40 for instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 on n-h2-835595-3 Oct 05 17:54:07.839122 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6ab75732-ee0b-419a-9ff5-fedbe54c72e5 req-d25e20d7-fca0-4724-acd0-a769b7e0a054 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079895 Oct 05 17:54:07.840187 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2438/4616] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:54:08.076520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-025df212-bd1e-488f-9011-926e00378e77 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:08.089474 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-025df212-bd1e-488f-9011-926e00378e77 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1324 microversion: 2.1 time: 0.501362 Oct 05 17:54:08.099421 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2179/4617] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:07 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1324 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:09.119687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-53297444-e473-4aaf-ad4a-1b3013abe4a4 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:09.120450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-53297444-e473-4aaf-ad4a-1b3013abe4a4 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:09.136294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53297444-e473-4aaf-ad4a-1b3013abe4a4 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:09.138401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53297444-e473-4aaf-ad4a-1b3013abe4a4 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:09.139552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53297444-e473-4aaf-ad4a-1b3013abe4a4 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:09.140251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53297444-e473-4aaf-ad4a-1b3013abe4a4 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:09.142077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53297444-e473-4aaf-ad4a-1b3013abe4a4 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:09.146667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53297444-e473-4aaf-ad4a-1b3013abe4a4 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:09.650269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-53297444-e473-4aaf-ad4a-1b3013abe4a4 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:09.657975 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-53297444-e473-4aaf-ad4a-1b3013abe4a4 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1324 microversion: 2.1 time: 0.544441 Oct 05 17:54:09.672217 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2439/4618] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:09 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1324 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:10.399193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5a8484dd-0edd-46df-b815-10b9265392a6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:10.403516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5a8484dd-0edd-46df-b815-10b9265392a6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:10.411680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:10.414737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a8484dd-0edd-46df-b815-10b9265392a6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:10.415456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a8484dd-0edd-46df-b815-10b9265392a6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:10.416523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a8484dd-0edd-46df-b815-10b9265392a6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:10.417543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a8484dd-0edd-46df-b815-10b9265392a6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:10.418420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a8484dd-0edd-46df-b815-10b9265392a6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:10.419233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a8484dd-0edd-46df-b815-10b9265392a6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:10.428712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=42 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:10.429963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:10.493950 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5a8484dd-0edd-46df-b815-10b9265392a6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790/action" status: 200 len: 24574 microversion: 2.1 time: 0.099049 Oct 05 17:54:10.496293 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2180/4619] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:54:10 2022] POST /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790/action => generated 24574 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:54:10.689212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-671e00b0-e866-4deb-b825-2103f6256fd9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:10.690614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-671e00b0-e866-4deb-b825-2103f6256fd9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:10.708329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-671e00b0-e866-4deb-b825-2103f6256fd9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:10.708329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-671e00b0-e866-4deb-b825-2103f6256fd9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:10.708554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-671e00b0-e866-4deb-b825-2103f6256fd9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:10.709600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-671e00b0-e866-4deb-b825-2103f6256fd9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:10.710339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-671e00b0-e866-4deb-b825-2103f6256fd9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:10.710967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-671e00b0-e866-4deb-b825-2103f6256fd9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:11.098115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:11.322408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-671e00b0-e866-4deb-b825-2103f6256fd9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:11.338001 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-671e00b0-e866-4deb-b825-2103f6256fd9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1324 microversion: 2.1 time: 0.656912 Oct 05 17:54:11.350402 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2440/4620] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:10 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1324 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:12.368073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e96c3356-701e-413d-afc8-1a98ab3d424e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:12.369881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e96c3356-701e-413d-afc8-1a98ab3d424e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:12.378878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:12.397504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96c3356-701e-413d-afc8-1a98ab3d424e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:12.398971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96c3356-701e-413d-afc8-1a98ab3d424e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:12.400521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96c3356-701e-413d-afc8-1a98ab3d424e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:12.405721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96c3356-701e-413d-afc8-1a98ab3d424e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:12.407211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96c3356-701e-413d-afc8-1a98ab3d424e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:12.407854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96c3356-701e-413d-afc8-1a98ab3d424e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:13.154377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e96c3356-701e-413d-afc8-1a98ab3d424e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:13.170539 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e96c3356-701e-413d-afc8-1a98ab3d424e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1324 microversion: 2.1 time: 0.809702 Oct 05 17:54:13.182383 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2181/4621] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:12 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1324 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:14.086701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-76e27b81-8baa-4e5d-af86-28b4dcd090bd req-f59b4122-59bf-40e2-a899-97df0dc8443a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54208b0-d0d4-4423-9695-42ac2b01e3f6", "name": "network-vif-plugged", "status": "completed", "tag": "9f48b921-1485-4227-a071-674db7f6bf40"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:14.107581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=20 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:14.113293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-76e27b81-8baa-4e5d-af86-28b4dcd090bd req-f59b4122-59bf-40e2-a899-97df0dc8443a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:14.114851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-76e27b81-8baa-4e5d-af86-28b4dcd090bd req-f59b4122-59bf-40e2-a899-97df0dc8443a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:14.115498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-76e27b81-8baa-4e5d-af86-28b4dcd090bd req-f59b4122-59bf-40e2-a899-97df0dc8443a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:14.157142 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-76e27b81-8baa-4e5d-af86-28b4dcd090bd req-f59b4122-59bf-40e2-a899-97df0dc8443a service nova] Creating event network-vif-plugged:9f48b921-1485-4227-a071-674db7f6bf40 for instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 on n-h2-835595-3 Oct 05 17:54:14.172348 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-76e27b81-8baa-4e5d-af86-28b4dcd090bd req-f59b4122-59bf-40e2-a899-97df0dc8443a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090076 Oct 05 17:54:14.175003 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2441/4622] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:54:14.199052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d8c14c0f-d042-4f40-b00c-c22fd51630be tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:14.199682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d8c14c0f-d042-4f40-b00c-c22fd51630be tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:14.233007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c14c0f-d042-4f40-b00c-c22fd51630be tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:14.235931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c14c0f-d042-4f40-b00c-c22fd51630be tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:14.236896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c14c0f-d042-4f40-b00c-c22fd51630be tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:14.237892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c14c0f-d042-4f40-b00c-c22fd51630be tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:14.238485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c14c0f-d042-4f40-b00c-c22fd51630be tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:14.239085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8c14c0f-d042-4f40-b00c-c22fd51630be tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:14.595471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d8c14c0f-d042-4f40-b00c-c22fd51630be tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:14.606012 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d8c14c0f-d042-4f40-b00c-c22fd51630be tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1324 microversion: 2.1 time: 0.411942 Oct 05 17:54:14.606656 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2182/4623] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:14 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1324 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:15.633350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4c4eac9-38ec-4425-b80c-83d254762b95 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:15.634054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b4c4eac9-38ec-4425-b80c-83d254762b95 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:15.659012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4c4eac9-38ec-4425-b80c-83d254762b95 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:15.659584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4c4eac9-38ec-4425-b80c-83d254762b95 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:15.660075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4c4eac9-38ec-4425-b80c-83d254762b95 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:15.660780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4c4eac9-38ec-4425-b80c-83d254762b95 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:15.666684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4c4eac9-38ec-4425-b80c-83d254762b95 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:15.667097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4c4eac9-38ec-4425-b80c-83d254762b95 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:16.119409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4c4eac9-38ec-4425-b80c-83d254762b95 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:16.142323 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b4c4eac9-38ec-4425-b80c-83d254762b95 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1324 microversion: 2.1 time: 0.514230 Oct 05 17:54:16.143740 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2442/4624] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:15 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1324 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:17.169661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-09c02e70-ea3d-4bd6-9ef5-1043eac0a5cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:17.171006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-09c02e70-ea3d-4bd6-9ef5-1043eac0a5cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:17.224710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09c02e70-ea3d-4bd6-9ef5-1043eac0a5cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:17.225407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09c02e70-ea3d-4bd6-9ef5-1043eac0a5cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:17.226068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09c02e70-ea3d-4bd6-9ef5-1043eac0a5cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:17.227883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09c02e70-ea3d-4bd6-9ef5-1043eac0a5cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:17.229624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09c02e70-ea3d-4bd6-9ef5-1043eac0a5cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:17.235326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09c02e70-ea3d-4bd6-9ef5-1043eac0a5cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:17.790688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09c02e70-ea3d-4bd6-9ef5-1043eac0a5cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:17.802542 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-09c02e70-ea3d-4bd6-9ef5-1043eac0a5cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1519 microversion: 2.1 time: 0.639699 Oct 05 17:54:17.811904 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2183/4625] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:17 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1519 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:17.829047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb0dea8b-5895-4a1d-aa43-f2643b329496 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Action: 'create', calling method: .version_select at 0x7f776ffcdaf0>, body: {"pool": null} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:21.124305 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb0dea8b-5895-4a1d-aa43-f2643b329496 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.298728 Oct 05 17:54:21.125072 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2443/4626] 10.222.0.70 () {60 vars in 1170 bytes} [Wed Oct 5 17:54:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:54:21.462554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-593896497", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "24932b3d-624c-45a1-8b2b-3202881311a2"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:21.528523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7296fac-2ff4-430e-b9ea-ab089871a344 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:21.529487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b7296fac-2ff4-430e-b9ea-ab089871a344 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:21.560217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7296fac-2ff4-430e-b9ea-ab089871a344 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:21.560735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7296fac-2ff4-430e-b9ea-ab089871a344 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:21.561199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7296fac-2ff4-430e-b9ea-ab089871a344 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:21.561921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7296fac-2ff4-430e-b9ea-ab089871a344 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:21.562409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7296fac-2ff4-430e-b9ea-ab089871a344 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:21.562842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7296fac-2ff4-430e-b9ea-ab089871a344 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:21.585302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] validate_networks() for [('24932b3d-624c-45a1-8b2b-3202881311a2', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:54:22.425222 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b7296fac-2ff4-430e-b9ea-ab089871a344 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1835 microversion: 2.1 time: 0.902573 Oct 05 17:54:22.433691 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2444/4627] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:21 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1835 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:54:22.453925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3208dfd1-1540-4cc2-9858-b2c007035ff4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:22.454564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3208dfd1-1540-4cc2-9858-b2c007035ff4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:22.484595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3208dfd1-1540-4cc2-9858-b2c007035ff4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:22.485097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3208dfd1-1540-4cc2-9858-b2c007035ff4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:22.485538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3208dfd1-1540-4cc2-9858-b2c007035ff4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:22.486362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3208dfd1-1540-4cc2-9858-b2c007035ff4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:22.486829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3208dfd1-1540-4cc2-9858-b2c007035ff4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:22.487262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3208dfd1-1540-4cc2-9858-b2c007035ff4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:22.878908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3208dfd1-1540-4cc2-9858-b2c007035ff4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:22.900497 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3208dfd1-1540-4cc2-9858-b2c007035ff4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1684 microversion: 2.1 time: 0.450359 Oct 05 17:54:22.901499 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2445/4628] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:22 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1684 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:54:23.041155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-797be2c0-b7f5-4270-9afd-266d76fc0e68 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:23.047145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-797be2c0-b7f5-4270-9afd-266d76fc0e68 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:23.059821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797be2c0-b7f5-4270-9afd-266d76fc0e68 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:23.070347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797be2c0-b7f5-4270-9afd-266d76fc0e68 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:23.071952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797be2c0-b7f5-4270-9afd-266d76fc0e68 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:23.074067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797be2c0-b7f5-4270-9afd-266d76fc0e68 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:23.075636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797be2c0-b7f5-4270-9afd-266d76fc0e68 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:23.077571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-797be2c0-b7f5-4270-9afd-266d76fc0e68 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:23.111408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:54:23.111916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:54:23.112309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:54:23.112711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:54:23.113219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:54:23.129035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:23.129035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:23.129035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:23.129878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:23.130876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:23.132766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:23.152825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Getting quotas for project c84d0069489c415ba7219e61ff0ef20f. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:54:23.160968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Getting quotas for user f75bf061b0784e77aef92ed595337f3f and project c84d0069489c415ba7219e61ff0ef20f. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:54:23.175371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:54:23.178682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:54:23.195368 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-797be2c0-b7f5-4270-9afd-266d76fc0e68 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790/action" status: 200 len: 32647 microversion: 2.1 time: 0.159979 Oct 05 17:54:23.196995 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2446/4629] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:54:23 2022] POST /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790/action => generated 32647 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:54:23.261435 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b8328d6-dce2-48fd-b4e2-d6d6ba0d91ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803967 Oct 05 17:54:23.263145 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2184/4630] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:54:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:54:23.278245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b90de742-ca3d-445c-a3f1-159760779fbe tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:23.279086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b90de742-ca3d-445c-a3f1-159760779fbe tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:23.347903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:23.348908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:23.364117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:23.364614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:23.365300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:23.366203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:23.366874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:23.368205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:23.562866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b90de742-ca3d-445c-a3f1-159760779fbe tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:23.575628 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b90de742-ca3d-445c-a3f1-159760779fbe tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1223 microversion: 2.1 time: 0.304361 Oct 05 17:54:23.578251 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2447/4631] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:23 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1223 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:23.581137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '282f8307511c4d20abe7f4eab19c7d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096b4b9aecbd42f086e1c8427a4ef118', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:23.583538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] flavor_id is None. Assuming migration. {{(pid=128843) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 05 17:54:23.585561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128843) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 17:54:23.825981 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b12c21f-fecf-4c1a-be98-264d96a1f58b tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790/action" status: 202 len: 0 microversion: 2.1 time: 0.478245 Oct 05 17:54:23.830590 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2185/4632] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:54:23 2022] POST /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:54:23.837395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fccad9ae-fa86-417c-bde6-1be2e2871495 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:23.838814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fccad9ae-fa86-417c-bde6-1be2e2871495 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:23.895138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fccad9ae-fa86-417c-bde6-1be2e2871495 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:23.895661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fccad9ae-fa86-417c-bde6-1be2e2871495 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:23.896114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fccad9ae-fa86-417c-bde6-1be2e2871495 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:23.896851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fccad9ae-fa86-417c-bde6-1be2e2871495 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:23.897316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fccad9ae-fa86-417c-bde6-1be2e2871495 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:23.897744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fccad9ae-fa86-417c-bde6-1be2e2871495 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:24.451840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fccad9ae-fa86-417c-bde6-1be2e2871495 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:24.463968 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fccad9ae-fa86-417c-bde6-1be2e2871495 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1693 microversion: 2.1 time: 0.632420 Oct 05 17:54:24.474303 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2448/4633] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:23 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1693 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:24.603552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5207ae97-1ab2-473a-b3fd-8d705cb3b996 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:24.604294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5207ae97-1ab2-473a-b3fd-8d705cb3b996 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:24.632724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5207ae97-1ab2-473a-b3fd-8d705cb3b996 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:24.637865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5207ae97-1ab2-473a-b3fd-8d705cb3b996 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:24.640140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5207ae97-1ab2-473a-b3fd-8d705cb3b996 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:24.642824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5207ae97-1ab2-473a-b3fd-8d705cb3b996 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:24.647258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5207ae97-1ab2-473a-b3fd-8d705cb3b996 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:24.648882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5207ae97-1ab2-473a-b3fd-8d705cb3b996 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:24.923709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5207ae97-1ab2-473a-b3fd-8d705cb3b996 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:24.936191 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5207ae97-1ab2-473a-b3fd-8d705cb3b996 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1219 microversion: 2.1 time: 0.334131 Oct 05 17:54:24.937399 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2186/4634] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:24 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1219 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:25.500396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f44fdf20-03b8-4195-b82f-b1177db46966 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:25.501016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f44fdf20-03b8-4195-b82f-b1177db46966 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:25.511237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f44fdf20-03b8-4195-b82f-b1177db46966 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:25.512905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f44fdf20-03b8-4195-b82f-b1177db46966 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:25.514567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f44fdf20-03b8-4195-b82f-b1177db46966 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:25.515684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f44fdf20-03b8-4195-b82f-b1177db46966 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:25.517586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f44fdf20-03b8-4195-b82f-b1177db46966 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:25.519025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f44fdf20-03b8-4195-b82f-b1177db46966 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:25.961800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5fd68799-c9f3-4ad9-bdd2-127f13b68e34 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:25.962874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5fd68799-c9f3-4ad9-bdd2-127f13b68e34 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:25.981665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fd68799-c9f3-4ad9-bdd2-127f13b68e34 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:25.983100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fd68799-c9f3-4ad9-bdd2-127f13b68e34 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:25.988789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fd68799-c9f3-4ad9-bdd2-127f13b68e34 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:25.989220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fd68799-c9f3-4ad9-bdd2-127f13b68e34 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:25.989712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fd68799-c9f3-4ad9-bdd2-127f13b68e34 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:25.993133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fd68799-c9f3-4ad9-bdd2-127f13b68e34 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:26.143150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5fd68799-c9f3-4ad9-bdd2-127f13b68e34 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:26.152309 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5fd68799-c9f3-4ad9-bdd2-127f13b68e34 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1281 microversion: 2.1 time: 0.195441 Oct 05 17:54:26.158554 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2187/4635] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:25 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1281 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:26.543644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f44fdf20-03b8-4195-b82f-b1177db46966 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:26.556383 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f44fdf20-03b8-4195-b82f-b1177db46966 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1693 microversion: 2.1 time: 1.059848 Oct 05 17:54:26.557757 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2449/4636] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:25 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1693 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:27.184982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-daaa07dd-8e44-488b-a7c4-9b803fe7163e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:27.185585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-daaa07dd-8e44-488b-a7c4-9b803fe7163e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:27.201874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa07dd-8e44-488b-a7c4-9b803fe7163e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:27.202398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa07dd-8e44-488b-a7c4-9b803fe7163e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:27.203032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa07dd-8e44-488b-a7c4-9b803fe7163e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:27.203761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa07dd-8e44-488b-a7c4-9b803fe7163e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:27.204209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa07dd-8e44-488b-a7c4-9b803fe7163e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:27.204635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa07dd-8e44-488b-a7c4-9b803fe7163e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:27.343931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-daaa07dd-8e44-488b-a7c4-9b803fe7163e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:27.363154 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-daaa07dd-8e44-488b-a7c4-9b803fe7163e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1281 microversion: 2.1 time: 0.181979 Oct 05 17:54:27.363746 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2188/4637] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:27 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:27.580257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6750ca63-7329-4d78-b194-5f0652763960 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:27.580892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6750ca63-7329-4d78-b194-5f0652763960 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:27.591928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6750ca63-7329-4d78-b194-5f0652763960 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:27.596027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6750ca63-7329-4d78-b194-5f0652763960 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:27.596390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6750ca63-7329-4d78-b194-5f0652763960 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:27.597365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6750ca63-7329-4d78-b194-5f0652763960 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:27.599111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6750ca63-7329-4d78-b194-5f0652763960 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:27.601918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6750ca63-7329-4d78-b194-5f0652763960 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:28.263783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6750ca63-7329-4d78-b194-5f0652763960 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:28.274272 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6750ca63-7329-4d78-b194-5f0652763960 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1693 microversion: 2.1 time: 0.698232 Oct 05 17:54:28.281052 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2450/4638] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:27 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1693 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:28.386466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e5888e89-9b1a-48a4-bc35-d8f3cc39488c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:28.387155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e5888e89-9b1a-48a4-bc35-d8f3cc39488c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:28.402611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5888e89-9b1a-48a4-bc35-d8f3cc39488c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:28.403495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5888e89-9b1a-48a4-bc35-d8f3cc39488c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:28.406138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5888e89-9b1a-48a4-bc35-d8f3cc39488c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:28.408018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5888e89-9b1a-48a4-bc35-d8f3cc39488c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:28.412822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5888e89-9b1a-48a4-bc35-d8f3cc39488c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:28.416108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5888e89-9b1a-48a4-bc35-d8f3cc39488c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:28.756326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e5888e89-9b1a-48a4-bc35-d8f3cc39488c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:28.766412 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e5888e89-9b1a-48a4-bc35-d8f3cc39488c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1323 microversion: 2.1 time: 0.383915 Oct 05 17:54:28.767013 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2189/4639] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:28 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1323 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:29.308607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e6d0938b-94b9-4b96-a254-f98ea1e44792 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:29.309921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e6d0938b-94b9-4b96-a254-f98ea1e44792 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:29.318023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d0938b-94b9-4b96-a254-f98ea1e44792 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:29.318977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d0938b-94b9-4b96-a254-f98ea1e44792 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:29.319626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d0938b-94b9-4b96-a254-f98ea1e44792 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:29.320387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d0938b-94b9-4b96-a254-f98ea1e44792 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:29.320850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d0938b-94b9-4b96-a254-f98ea1e44792 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:29.321278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d0938b-94b9-4b96-a254-f98ea1e44792 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:29.796663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e18bc24b-0277-439a-b14a-459c6d8f5683 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:29.797491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e18bc24b-0277-439a-b14a-459c6d8f5683 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:29.813976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e18bc24b-0277-439a-b14a-459c6d8f5683 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:29.814703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e18bc24b-0277-439a-b14a-459c6d8f5683 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:29.817176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e18bc24b-0277-439a-b14a-459c6d8f5683 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:29.818036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e18bc24b-0277-439a-b14a-459c6d8f5683 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:29.820412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e18bc24b-0277-439a-b14a-459c6d8f5683 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:29.820963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e18bc24b-0277-439a-b14a-459c6d8f5683 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:29.969681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e6d0938b-94b9-4b96-a254-f98ea1e44792 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:29.981966 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e6d0938b-94b9-4b96-a254-f98ea1e44792 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1698 microversion: 2.1 time: 0.678057 Oct 05 17:54:29.983791 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2451/4640] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:29 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1698 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:30.103601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d29cf652-6537-40fb-ac74-a740b8d4d415 req-21463d17-30de-4bdf-8bab-a55e64dfceb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43006e8-cc9f-4fca-9a04-bf7b23a2d83a", "tag": "b03b2af8-2f45-469c-9c72-5044637b7b8d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:30.120035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d29cf652-6537-40fb-ac74-a740b8d4d415 req-21463d17-30de-4bdf-8bab-a55e64dfceb7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:30.122867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d29cf652-6537-40fb-ac74-a740b8d4d415 req-21463d17-30de-4bdf-8bab-a55e64dfceb7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:30.135003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d29cf652-6537-40fb-ac74-a740b8d4d415 req-21463d17-30de-4bdf-8bab-a55e64dfceb7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:30.149468 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d29cf652-6537-40fb-ac74-a740b8d4d415 req-21463d17-30de-4bdf-8bab-a55e64dfceb7 service nova] Creating event network-changed:b03b2af8-2f45-469c-9c72-5044637b7b8d for instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a on n-h1-835595-3 Oct 05 17:54:30.170441 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d29cf652-6537-40fb-ac74-a740b8d4d415 req-21463d17-30de-4bdf-8bab-a55e64dfceb7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070487 Oct 05 17:54:30.172310 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2452/4641] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:54:30.263425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e18bc24b-0277-439a-b14a-459c6d8f5683 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:30.276589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e18bc24b-0277-439a-b14a-459c6d8f5683 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1323 microversion: 2.1 time: 0.488634 Oct 05 17:54:30.278311 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2190/4642] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:29 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1323 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:31.009661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e860be8a-5728-442c-8562-b7f4558b6127 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:31.010630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e860be8a-5728-442c-8562-b7f4558b6127 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:31.025191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860be8a-5728-442c-8562-b7f4558b6127 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:31.031098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860be8a-5728-442c-8562-b7f4558b6127 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:31.031563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860be8a-5728-442c-8562-b7f4558b6127 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:31.036357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860be8a-5728-442c-8562-b7f4558b6127 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:31.036848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860be8a-5728-442c-8562-b7f4558b6127 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:31.037470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e860be8a-5728-442c-8562-b7f4558b6127 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:31.302236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9ef5214-a027-4ea7-b51c-c6db8719123c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:31.302916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b9ef5214-a027-4ea7-b51c-c6db8719123c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:31.321199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9ef5214-a027-4ea7-b51c-c6db8719123c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:31.321698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9ef5214-a027-4ea7-b51c-c6db8719123c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:31.322136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9ef5214-a027-4ea7-b51c-c6db8719123c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:31.322880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9ef5214-a027-4ea7-b51c-c6db8719123c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:31.323338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9ef5214-a027-4ea7-b51c-c6db8719123c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:31.323762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9ef5214-a027-4ea7-b51c-c6db8719123c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:31.868539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9ef5214-a027-4ea7-b51c-c6db8719123c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:31.880603 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9ef5214-a027-4ea7-b51c-c6db8719123c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1323 microversion: 2.1 time: 0.582199 Oct 05 17:54:31.891390 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2191/4643] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:31 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1323 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:32.019506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e860be8a-5728-442c-8562-b7f4558b6127 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:32.028822 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e860be8a-5728-442c-8562-b7f4558b6127 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1698 microversion: 2.1 time: 1.025485 Oct 05 17:54:32.034824 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2453/4644] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:31 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1698 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:32.910299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-342edc1e-8f64-42e2-ab7e-1a93959cbfc9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:32.912068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-342edc1e-8f64-42e2-ab7e-1a93959cbfc9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:32.930129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-342edc1e-8f64-42e2-ab7e-1a93959cbfc9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:32.934430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-342edc1e-8f64-42e2-ab7e-1a93959cbfc9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:32.934906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-342edc1e-8f64-42e2-ab7e-1a93959cbfc9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:32.937886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-342edc1e-8f64-42e2-ab7e-1a93959cbfc9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:32.938388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-342edc1e-8f64-42e2-ab7e-1a93959cbfc9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:32.939409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-342edc1e-8f64-42e2-ab7e-1a93959cbfc9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:33.060143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f0f33b19-723e-418c-8d7f-cf22117484d3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:33.060744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f0f33b19-723e-418c-8d7f-cf22117484d3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:33.071774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f33b19-723e-418c-8d7f-cf22117484d3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:33.074730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f33b19-723e-418c-8d7f-cf22117484d3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:33.076122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f33b19-723e-418c-8d7f-cf22117484d3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:33.077939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f33b19-723e-418c-8d7f-cf22117484d3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:33.080005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f33b19-723e-418c-8d7f-cf22117484d3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:33.080674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0f33b19-723e-418c-8d7f-cf22117484d3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:33.145690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:33.169463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:33.362169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-342edc1e-8f64-42e2-ab7e-1a93959cbfc9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:33.374539 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-342edc1e-8f64-42e2-ab7e-1a93959cbfc9 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1323 microversion: 2.1 time: 0.468448 Oct 05 17:54:33.381276 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2192/4645] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:32 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1323 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:33.481358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f0f33b19-723e-418c-8d7f-cf22117484d3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:33.490641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=87 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:33.499044 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f0f33b19-723e-418c-8d7f-cf22117484d3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1698 microversion: 2.1 time: 0.443416 Oct 05 17:54:33.503742 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2454/4646] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:33 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1698 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:34.429488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cba29276-9fb1-4a6a-b096-329a0844ce8e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:34.431437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cba29276-9fb1-4a6a-b096-329a0844ce8e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:34.447729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba29276-9fb1-4a6a-b096-329a0844ce8e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:34.449210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba29276-9fb1-4a6a-b096-329a0844ce8e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:34.450916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba29276-9fb1-4a6a-b096-329a0844ce8e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:34.455441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba29276-9fb1-4a6a-b096-329a0844ce8e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:34.456225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba29276-9fb1-4a6a-b096-329a0844ce8e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:34.460123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cba29276-9fb1-4a6a-b096-329a0844ce8e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:34.527235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c0291ded-7ced-4083-943e-4ed459c7a410 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:34.528498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c0291ded-7ced-4083-943e-4ed459c7a410 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:34.530816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:34.561680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0291ded-7ced-4083-943e-4ed459c7a410 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:34.562205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0291ded-7ced-4083-943e-4ed459c7a410 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:34.563699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0291ded-7ced-4083-943e-4ed459c7a410 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:34.568655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0291ded-7ced-4083-943e-4ed459c7a410 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:34.574047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0291ded-7ced-4083-943e-4ed459c7a410 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:34.577695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c0291ded-7ced-4083-943e-4ed459c7a410 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:35.236561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c0291ded-7ced-4083-943e-4ed459c7a410 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:35.245960 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c0291ded-7ced-4083-943e-4ed459c7a410 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1698 microversion: 2.1 time: 0.723475 Oct 05 17:54:35.273939 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2455/4647] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:34 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1698 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:54:35.715785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cba29276-9fb1-4a6a-b096-329a0844ce8e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:35.730577 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cba29276-9fb1-4a6a-b096-329a0844ce8e tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1323 microversion: 2.1 time: 1.326040 Oct 05 17:54:35.734869 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2193/4648] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:34 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1323 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:36.273710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5518370-6b8e-424c-8803-a3a487cd787c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:36.274422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d5518370-6b8e-424c-8803-a3a487cd787c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:36.295396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5518370-6b8e-424c-8803-a3a487cd787c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:36.297242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5518370-6b8e-424c-8803-a3a487cd787c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:36.303347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5518370-6b8e-424c-8803-a3a487cd787c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:36.304514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5518370-6b8e-424c-8803-a3a487cd787c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:36.305222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5518370-6b8e-424c-8803-a3a487cd787c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:36.306072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5518370-6b8e-424c-8803-a3a487cd787c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:36.688647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d5518370-6b8e-424c-8803-a3a487cd787c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:36.706620 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d5518370-6b8e-424c-8803-a3a487cd787c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1698 microversion: 2.1 time: 0.427772 Oct 05 17:54:36.726570 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2456/4649] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:36 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1698 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:36.755608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b4d53f0e-a926-46ac-bc59-ac6b099d251a tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:36.757008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b4d53f0e-a926-46ac-bc59-ac6b099d251a tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:36.772364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4d53f0e-a926-46ac-bc59-ac6b099d251a tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:36.775969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4d53f0e-a926-46ac-bc59-ac6b099d251a tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:36.778660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4d53f0e-a926-46ac-bc59-ac6b099d251a tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:36.784323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4d53f0e-a926-46ac-bc59-ac6b099d251a tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:36.786349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4d53f0e-a926-46ac-bc59-ac6b099d251a tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:36.788292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4d53f0e-a926-46ac-bc59-ac6b099d251a tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:37.359734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b4d53f0e-a926-46ac-bc59-ac6b099d251a tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:37.386695 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b4d53f0e-a926-46ac-bc59-ac6b099d251a tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1323 microversion: 2.1 time: 0.633668 Oct 05 17:54:37.388727 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2194/4650] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:36 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1323 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:37.734325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1134d43f-1ed9-4507-9c8b-bcc2e8e2fa74 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:37.734937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1134d43f-1ed9-4507-9c8b-bcc2e8e2fa74 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:37.745580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1134d43f-1ed9-4507-9c8b-bcc2e8e2fa74 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:37.746079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1134d43f-1ed9-4507-9c8b-bcc2e8e2fa74 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:37.746560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1134d43f-1ed9-4507-9c8b-bcc2e8e2fa74 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:37.747278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1134d43f-1ed9-4507-9c8b-bcc2e8e2fa74 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:37.747731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1134d43f-1ed9-4507-9c8b-bcc2e8e2fa74 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:37.748531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1134d43f-1ed9-4507-9c8b-bcc2e8e2fa74 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:38.413050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c04ab74e-c823-486d-bdf6-71470e6e82df tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:38.414369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c04ab74e-c823-486d-bdf6-71470e6e82df tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:38.460768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c04ab74e-c823-486d-bdf6-71470e6e82df tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:38.462978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c04ab74e-c823-486d-bdf6-71470e6e82df tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:38.465191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c04ab74e-c823-486d-bdf6-71470e6e82df tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:38.468378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c04ab74e-c823-486d-bdf6-71470e6e82df tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:38.470527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c04ab74e-c823-486d-bdf6-71470e6e82df tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:38.471247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c04ab74e-c823-486d-bdf6-71470e6e82df tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:39.588245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1134d43f-1ed9-4507-9c8b-bcc2e8e2fa74 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:39.605560 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1134d43f-1ed9-4507-9c8b-bcc2e8e2fa74 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1698 microversion: 2.1 time: 1.874646 Oct 05 17:54:39.630982 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2457/4651] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:37 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1698 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:39.889570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c04ab74e-c823-486d-bdf6-71470e6e82df tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:39.906361 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c04ab74e-c823-486d-bdf6-71470e6e82df tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1323 microversion: 2.1 time: 1.496217 Oct 05 17:54:39.908610 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2195/4652] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:38 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1323 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:40.637970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c55f4910-a9e3-4cfd-97b0-5a8bd5120585 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:40.639695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c55f4910-a9e3-4cfd-97b0-5a8bd5120585 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:40.670578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c55f4910-a9e3-4cfd-97b0-5a8bd5120585 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:40.671827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c55f4910-a9e3-4cfd-97b0-5a8bd5120585 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:40.673376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c55f4910-a9e3-4cfd-97b0-5a8bd5120585 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:40.676770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c55f4910-a9e3-4cfd-97b0-5a8bd5120585 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:40.678981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c55f4910-a9e3-4cfd-97b0-5a8bd5120585 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:40.679717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c55f4910-a9e3-4cfd-97b0-5a8bd5120585 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:40.916016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-8f030f8c-48d2-4f03-90f4-11b73052e9f8 req-d30340e9-1bbc-42c2-b74e-2d8f0465f55f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43006e8-cc9f-4fca-9a04-bf7b23a2d83a", "name": "network-vif-plugged", "status": "completed", "tag": "b03b2af8-2f45-469c-9c72-5044637b7b8d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:40.968004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8f030f8c-48d2-4f03-90f4-11b73052e9f8 req-d30340e9-1bbc-42c2-b74e-2d8f0465f55f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:40.972224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8f030f8c-48d2-4f03-90f4-11b73052e9f8 req-d30340e9-1bbc-42c2-b74e-2d8f0465f55f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:40.973646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8f030f8c-48d2-4f03-90f4-11b73052e9f8 req-d30340e9-1bbc-42c2-b74e-2d8f0465f55f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:40.982199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:41.035756 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-8f030f8c-48d2-4f03-90f4-11b73052e9f8 req-d30340e9-1bbc-42c2-b74e-2d8f0465f55f service nova] Creating event network-vif-plugged:b03b2af8-2f45-469c-9c72-5044637b7b8d for instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a on n-h1-835595-3 Oct 05 17:54:41.048857 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-8f030f8c-48d2-4f03-90f4-11b73052e9f8 req-d30340e9-1bbc-42c2-b74e-2d8f0465f55f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133237 Oct 05 17:54:41.052500 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2196/4653] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:54:41.066506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-17b0ba58-535c-4fbf-920a-8d92e5ae1e37 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:41.070749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-17b0ba58-535c-4fbf-920a-8d92e5ae1e37 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:41.082267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b0ba58-535c-4fbf-920a-8d92e5ae1e37 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:41.085285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b0ba58-535c-4fbf-920a-8d92e5ae1e37 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:41.086107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b0ba58-535c-4fbf-920a-8d92e5ae1e37 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:41.088852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b0ba58-535c-4fbf-920a-8d92e5ae1e37 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:41.089491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b0ba58-535c-4fbf-920a-8d92e5ae1e37 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:41.090657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-17b0ba58-535c-4fbf-920a-8d92e5ae1e37 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:41.999038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c55f4910-a9e3-4cfd-97b0-5a8bd5120585 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:42.010498 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c55f4910-a9e3-4cfd-97b0-5a8bd5120585 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1698 microversion: 2.1 time: 1.380278 Oct 05 17:54:42.023997 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2458/4654] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:40 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1698 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:42.103634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-17b0ba58-535c-4fbf-920a-8d92e5ae1e37 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:42.126895 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-17b0ba58-535c-4fbf-920a-8d92e5ae1e37 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1323 microversion: 2.1 time: 1.069831 Oct 05 17:54:42.127515 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2197/4655] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:41 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1323 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:43.039062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1f1384d1-edc2-4fec-ae4d-fd7a253be1bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:43.040282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1f1384d1-edc2-4fec-ae4d-fd7a253be1bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:43.049991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f1384d1-edc2-4fec-ae4d-fd7a253be1bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:43.054645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f1384d1-edc2-4fec-ae4d-fd7a253be1bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:43.055101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f1384d1-edc2-4fec-ae4d-fd7a253be1bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:43.056170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f1384d1-edc2-4fec-ae4d-fd7a253be1bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:43.056643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f1384d1-edc2-4fec-ae4d-fd7a253be1bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:43.057082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f1384d1-edc2-4fec-ae4d-fd7a253be1bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:43.151789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-acb4974d-9e3e-4e25-81f5-d3b6d45265ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:43.153594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-acb4974d-9e3e-4e25-81f5-d3b6d45265ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:43.166519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:43.183571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acb4974d-9e3e-4e25-81f5-d3b6d45265ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:43.187240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acb4974d-9e3e-4e25-81f5-d3b6d45265ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:43.187907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acb4974d-9e3e-4e25-81f5-d3b6d45265ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:43.192264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acb4974d-9e3e-4e25-81f5-d3b6d45265ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:43.193652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acb4974d-9e3e-4e25-81f5-d3b6d45265ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:43.213147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acb4974d-9e3e-4e25-81f5-d3b6d45265ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:43.988558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1f1384d1-edc2-4fec-ae4d-fd7a253be1bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:44.002171 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1f1384d1-edc2-4fec-ae4d-fd7a253be1bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1697 microversion: 2.1 time: 0.965042 Oct 05 17:54:44.003295 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2459/4656] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:43 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1697 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:44.011076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6e7719ba-c697-4dd5-9b69-762f502ba5c0 req-305ee124-4e2a-4c84-9aca-48286d0001d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8bee32-1d91-4dcf-a8be-8e0b26b77790", "name": "network-vif-unplugged", "status": "completed", "tag": "2e0451f7-6590-4750-ab4b-0ea667cb7622"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:44.043130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6e7719ba-c697-4dd5-9b69-762f502ba5c0 req-305ee124-4e2a-4c84-9aca-48286d0001d6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:44.043696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6e7719ba-c697-4dd5-9b69-762f502ba5c0 req-305ee124-4e2a-4c84-9aca-48286d0001d6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:44.045779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6e7719ba-c697-4dd5-9b69-762f502ba5c0 req-305ee124-4e2a-4c84-9aca-48286d0001d6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:44.105082 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6e7719ba-c697-4dd5-9b69-762f502ba5c0 req-305ee124-4e2a-4c84-9aca-48286d0001d6 service nova] Creating event network-vif-unplugged:2e0451f7-6590-4750-ab4b-0ea667cb7622 for instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 on n-h2-835595-3 Oct 05 17:54:44.127178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-6e7719ba-c697-4dd5-9b69-762f502ba5c0 req-305ee124-4e2a-4c84-9aca-48286d0001d6 service nova] Instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:54:44.166718 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6e7719ba-c697-4dd5-9b69-762f502ba5c0 req-305ee124-4e2a-4c84-9aca-48286d0001d6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158630 Oct 05 17:54:44.167557 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2460/4657] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:54:44.207945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-acb4974d-9e3e-4e25-81f5-d3b6d45265ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:44.218875 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-acb4974d-9e3e-4e25-81f5-d3b6d45265ba tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1323 microversion: 2.1 time: 1.072402 Oct 05 17:54:44.231032 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2198/4658] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:43 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1323 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:54:45.035664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-72cc65e7-389d-4d55-950a-4b352dd4c6bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:45.037128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-72cc65e7-389d-4d55-950a-4b352dd4c6bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:45.045512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=40 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:54:45.056581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72cc65e7-389d-4d55-950a-4b352dd4c6bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:45.057080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72cc65e7-389d-4d55-950a-4b352dd4c6bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:45.057511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72cc65e7-389d-4d55-950a-4b352dd4c6bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:45.058219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72cc65e7-389d-4d55-950a-4b352dd4c6bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:45.058711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72cc65e7-389d-4d55-950a-4b352dd4c6bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:45.059132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72cc65e7-389d-4d55-950a-4b352dd4c6bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:45.278945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8d054728-a193-4d6a-92db-cc290584a932 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:45.279617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8d054728-a193-4d6a-92db-cc290584a932 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:45.298202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d054728-a193-4d6a-92db-cc290584a932 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:45.298945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d054728-a193-4d6a-92db-cc290584a932 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:45.299578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d054728-a193-4d6a-92db-cc290584a932 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:45.300479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d054728-a193-4d6a-92db-cc290584a932 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:45.301121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d054728-a193-4d6a-92db-cc290584a932 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:45.301758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d054728-a193-4d6a-92db-cc290584a932 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:45.811832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-72cc65e7-389d-4d55-950a-4b352dd4c6bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:45.822139 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-72cc65e7-389d-4d55-950a-4b352dd4c6bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1697 microversion: 2.1 time: 0.792150 Oct 05 17:54:45.823810 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2461/4659] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:45 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1697 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:45.858566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d054728-a193-4d6a-92db-cc290584a932 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:45.876021 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8d054728-a193-4d6a-92db-cc290584a932 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 200 len: 1518 microversion: 2.1 time: 0.600914 Oct 05 17:54:45.876870 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2199/4660] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:45 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 1518 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:54:45.904741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.149"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:45.907380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:45.914747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:45.915462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:45.916076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:45.916981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:45.919048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:45.920760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:45.990583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "refresh_cache-b54208b0-d0d4-4423-9695-42ac2b01e3f6" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:54:45.993673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquired lock "refresh_cache-b54208b0-d0d4-4423-9695-42ac2b01e3f6" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:54:46.461462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-675d7ca8-80c6-4179-9edf-c36b907b2aa6 req-48007fb8-9479-4091-98cb-94d63665c497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8bee32-1d91-4dcf-a8be-8e0b26b77790", "tag": "2e0451f7-6590-4750-ab4b-0ea667cb7622"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:46.472674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-675d7ca8-80c6-4179-9edf-c36b907b2aa6 req-48007fb8-9479-4091-98cb-94d63665c497 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:46.473527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-675d7ca8-80c6-4179-9edf-c36b907b2aa6 req-48007fb8-9479-4091-98cb-94d63665c497 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:46.474176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-675d7ca8-80c6-4179-9edf-c36b907b2aa6 req-48007fb8-9479-4091-98cb-94d63665c497 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:46.487065 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-675d7ca8-80c6-4179-9edf-c36b907b2aa6 req-48007fb8-9479-4091-98cb-94d63665c497 service nova] Creating event network-changed:2e0451f7-6590-4750-ab4b-0ea667cb7622 for instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 on n-h2-835595-3 Oct 05 17:54:46.493226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-675d7ca8-80c6-4179-9edf-c36b907b2aa6 req-48007fb8-9479-4091-98cb-94d63665c497 service nova] Instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:54:46.505243 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-675d7ca8-80c6-4179-9edf-c36b907b2aa6 req-48007fb8-9479-4091-98cb-94d63665c497 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047621 Oct 05 17:54:46.506655 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2200/4661] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:54:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:54:46.848040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2391e128-4ec6-4bbf-b0c4-2d6e7c69ebcf tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:46.849222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2391e128-4ec6-4bbf-b0c4-2d6e7c69ebcf tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:46.856528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2391e128-4ec6-4bbf-b0c4-2d6e7c69ebcf tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:46.860886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2391e128-4ec6-4bbf-b0c4-2d6e7c69ebcf tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:46.861550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2391e128-4ec6-4bbf-b0c4-2d6e7c69ebcf tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:46.862582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2391e128-4ec6-4bbf-b0c4-2d6e7c69ebcf tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:46.863209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2391e128-4ec6-4bbf-b0c4-2d6e7c69ebcf tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:46.863805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2391e128-4ec6-4bbf-b0c4-2d6e7c69ebcf tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:47.691325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2391e128-4ec6-4bbf-b0c4-2d6e7c69ebcf tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:47.716845 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2391e128-4ec6-4bbf-b0c4-2d6e7c69ebcf tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1697 microversion: 2.1 time: 0.868742 Oct 05 17:54:47.731535 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2201/4662] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:46 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1697 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:54:48.765307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7740f999-a009-4fe8-a1b2-4915dd2bd43f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:48.770759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7740f999-a009-4fe8-a1b2-4915dd2bd43f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:48.824164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7740f999-a009-4fe8-a1b2-4915dd2bd43f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:48.824673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7740f999-a009-4fe8-a1b2-4915dd2bd43f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:48.829690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7740f999-a009-4fe8-a1b2-4915dd2bd43f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:48.834434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7740f999-a009-4fe8-a1b2-4915dd2bd43f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:48.836600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7740f999-a009-4fe8-a1b2-4915dd2bd43f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:48.844094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7740f999-a009-4fe8-a1b2-4915dd2bd43f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:49.065561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Building network info cache for instance {{(pid=128844) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 17:54:49.413106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7740f999-a009-4fe8-a1b2-4915dd2bd43f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:49.421544 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7740f999-a009-4fe8-a1b2-4915dd2bd43f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1695 microversion: 2.1 time: 0.680157 Oct 05 17:54:49.426351 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2202/4663] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:48 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1695 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:49.431235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-01d9862f-145c-4342-9995-48a61128f708 req-cf3e466b-6e9e-4325-9c50-5a9b3b09e0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54208b0-d0d4-4423-9695-42ac2b01e3f6", "tag": "9f48b921-1485-4227-a071-674db7f6bf40"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:49.458064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-01d9862f-145c-4342-9995-48a61128f708 req-cf3e466b-6e9e-4325-9c50-5a9b3b09e0e0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:49.458876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-01d9862f-145c-4342-9995-48a61128f708 req-cf3e466b-6e9e-4325-9c50-5a9b3b09e0e0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:49.459469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-01d9862f-145c-4342-9995-48a61128f708 req-cf3e466b-6e9e-4325-9c50-5a9b3b09e0e0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:49.511188 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-01d9862f-145c-4342-9995-48a61128f708 req-cf3e466b-6e9e-4325-9c50-5a9b3b09e0e0 service nova] Creating event network-changed:9f48b921-1485-4227-a071-674db7f6bf40 for instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 on n-h2-835595-3 Oct 05 17:54:49.517501 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-01d9862f-145c-4342-9995-48a61128f708 req-cf3e466b-6e9e-4325-9c50-5a9b3b09e0e0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089673 Oct 05 17:54:49.518669 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2203/4664] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:54:50.455606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9725e310-f24e-43d7-a21a-7537cc9e2364 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:50.456481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9725e310-f24e-43d7-a21a-7537cc9e2364 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:50.468952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9725e310-f24e-43d7-a21a-7537cc9e2364 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:50.472132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9725e310-f24e-43d7-a21a-7537cc9e2364 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:50.472865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9725e310-f24e-43d7-a21a-7537cc9e2364 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:50.473834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9725e310-f24e-43d7-a21a-7537cc9e2364 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:50.477938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9725e310-f24e-43d7-a21a-7537cc9e2364 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:50.478761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9725e310-f24e-43d7-a21a-7537cc9e2364 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:51.140964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9725e310-f24e-43d7-a21a-7537cc9e2364 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:51.151955 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9725e310-f24e-43d7-a21a-7537cc9e2364 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1692 microversion: 2.1 time: 0.700768 Oct 05 17:54:51.180922 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2204/4665] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:50 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1692 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:51.192700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c0a228f5-ca87-47eb-9319-cabab323b70a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:51.195918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c0a228f5-ca87-47eb-9319-cabab323b70a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:51.204969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0a228f5-ca87-47eb-9319-cabab323b70a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:51.205725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0a228f5-ca87-47eb-9319-cabab323b70a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:51.206611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0a228f5-ca87-47eb-9319-cabab323b70a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:51.208053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0a228f5-ca87-47eb-9319-cabab323b70a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:51.208764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0a228f5-ca87-47eb-9319-cabab323b70a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:51.209392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0a228f5-ca87-47eb-9319-cabab323b70a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:51.313283 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c0a228f5-ca87-47eb-9319-cabab323b70a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790/action" status: 204 len: 0 microversion: 2.1 time: 0.128351 Oct 05 17:54:51.317315 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2205/4666] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:54:51 2022] POST /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790/action => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:54:51.342535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-727e0489-1d1a-4f7a-8cb5-f727d4ef276d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:51.343586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-727e0489-1d1a-4f7a-8cb5-f727d4ef276d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:51.350525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-727e0489-1d1a-4f7a-8cb5-f727d4ef276d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:51.351055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-727e0489-1d1a-4f7a-8cb5-f727d4ef276d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:51.351720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-727e0489-1d1a-4f7a-8cb5-f727d4ef276d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:51.353209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-727e0489-1d1a-4f7a-8cb5-f727d4ef276d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:51.353899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-727e0489-1d1a-4f7a-8cb5-f727d4ef276d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:51.354589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-727e0489-1d1a-4f7a-8cb5-f727d4ef276d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:51.859875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-727e0489-1d1a-4f7a-8cb5-f727d4ef276d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:51.868324 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-727e0489-1d1a-4f7a-8cb5-f727d4ef276d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1692 microversion: 2.1 time: 0.545903 Oct 05 17:54:51.886689 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2206/4667] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:51 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1692 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:52.008203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Updating instance_info_cache with network_info: [{"id": "9f48b921-1485-4227-a071-674db7f6bf40", "address": "fa:16:3e:39:c2:b2", "network": {"id": "24932b3d-624c-45a1-8b2b-3202881311a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-279283541-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c84d0069489c415ba7219e61ff0ef20f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f48b921-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128844) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:54:52.026938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Releasing lock "refresh_cache-b54208b0-d0d4-4423-9695-42ac2b01e3f6" {{(pid=128844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:54:52.028522 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-af9a6c28-14e8-41cc-baaf-87f4cc4b8bc0 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "POST /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6/action" status: 202 len: 0 microversion: 2.1 time: 6.128705 Oct 05 17:54:52.030691 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2462/4668] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:54:45 2022] POST /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6/action => generated 0 bytes in 6132 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 17:54:52.039292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.149"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:52.041959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:52.056717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:52.057225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:52.057663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:52.058421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:52.060822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:52.063153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:52.112222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "refresh_cache-b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:54:52.118512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquired lock "refresh_cache-b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:54:52.915739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b950c26-9782-4435-ab09-4616b48b2fcb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:52.916361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5b950c26-9782-4435-ab09-4616b48b2fcb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:52.942943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b950c26-9782-4435-ab09-4616b48b2fcb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:52.943860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b950c26-9782-4435-ab09-4616b48b2fcb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:52.944315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b950c26-9782-4435-ab09-4616b48b2fcb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:52.948225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b950c26-9782-4435-ab09-4616b48b2fcb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:52.951878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b950c26-9782-4435-ab09-4616b48b2fcb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:52.952370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b950c26-9782-4435-ab09-4616b48b2fcb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:54.049379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5b950c26-9782-4435-ab09-4616b48b2fcb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:54.063779 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b950c26-9782-4435-ab09-4616b48b2fcb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1692 microversion: 2.1 time: 1.162740 Oct 05 17:54:54.064794 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2463/4669] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:52 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1692 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:54.273422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a935ba1b-3419-4b04-9518-d8126a181ab6 req-6ff7f69b-b11c-4df2-813b-a66cc284f9b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8bee32-1d91-4dcf-a8be-8e0b26b77790", "name": "network-vif-plugged", "status": "completed", "tag": "2e0451f7-6590-4750-ab4b-0ea667cb7622"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:54.291738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a935ba1b-3419-4b04-9518-d8126a181ab6 req-6ff7f69b-b11c-4df2-813b-a66cc284f9b5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:54.295240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a935ba1b-3419-4b04-9518-d8126a181ab6 req-6ff7f69b-b11c-4df2-813b-a66cc284f9b5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:54.297680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a935ba1b-3419-4b04-9518-d8126a181ab6 req-6ff7f69b-b11c-4df2-813b-a66cc284f9b5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:54.317726 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a935ba1b-3419-4b04-9518-d8126a181ab6 req-6ff7f69b-b11c-4df2-813b-a66cc284f9b5 service nova] Creating event network-vif-plugged:2e0451f7-6590-4750-ab4b-0ea667cb7622 for instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 on n-h2-835595-3 Oct 05 17:54:54.343641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-a935ba1b-3419-4b04-9518-d8126a181ab6 req-6ff7f69b-b11c-4df2-813b-a66cc284f9b5 service nova] Instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:54:54.378357 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a935ba1b-3419-4b04-9518-d8126a181ab6 req-6ff7f69b-b11c-4df2-813b-a66cc284f9b5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106873 Oct 05 17:54:54.379641 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2464/4670] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:54:55.095354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-39a1fc76-f83c-40ac-8f7e-97ec20595e90 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:55.096864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-39a1fc76-f83c-40ac-8f7e-97ec20595e90 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:55.112432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a1fc76-f83c-40ac-8f7e-97ec20595e90 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:55.112924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a1fc76-f83c-40ac-8f7e-97ec20595e90 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:55.113359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a1fc76-f83c-40ac-8f7e-97ec20595e90 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:55.119551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a1fc76-f83c-40ac-8f7e-97ec20595e90 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:55.121348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a1fc76-f83c-40ac-8f7e-97ec20595e90 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:55.121803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a1fc76-f83c-40ac-8f7e-97ec20595e90 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:56.265426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-39a1fc76-f83c-40ac-8f7e-97ec20595e90 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:56.288896 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-39a1fc76-f83c-40ac-8f7e-97ec20595e90 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1692 microversion: 2.1 time: 1.199073 Oct 05 17:54:56.289495 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2465/4671] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:55 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1692 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:54:57.315754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ed6dc33a-e2f6-4e69-89f7-831163861894 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:54:57.317193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ed6dc33a-e2f6-4e69-89f7-831163861894 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:54:57.325566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed6dc33a-e2f6-4e69-89f7-831163861894 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:57.326694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed6dc33a-e2f6-4e69-89f7-831163861894 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:57.327347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed6dc33a-e2f6-4e69-89f7-831163861894 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:57.328588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed6dc33a-e2f6-4e69-89f7-831163861894 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:57.329845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed6dc33a-e2f6-4e69-89f7-831163861894 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:57.330333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed6dc33a-e2f6-4e69-89f7-831163861894 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:58.098344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ed6dc33a-e2f6-4e69-89f7-831163861894 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:54:58.130933 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ed6dc33a-e2f6-4e69-89f7-831163861894 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1684 microversion: 2.1 time: 0.818956 Oct 05 17:54:58.147888 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2466/4672] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:54:57 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1684 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:54:58.218563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-25466e43-a8db-4d42-a46e-ee8b4ba06b46 req-da422738-fcb3-4e21-932f-331214887d5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54208b0-d0d4-4423-9695-42ac2b01e3f6", "tag": "9f48b921-1485-4227-a071-674db7f6bf40"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:54:58.239546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-25466e43-a8db-4d42-a46e-ee8b4ba06b46 req-da422738-fcb3-4e21-932f-331214887d5e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:54:58.240316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-25466e43-a8db-4d42-a46e-ee8b4ba06b46 req-da422738-fcb3-4e21-932f-331214887d5e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:54:58.242729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-25466e43-a8db-4d42-a46e-ee8b4ba06b46 req-da422738-fcb3-4e21-932f-331214887d5e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:54:58.275134 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-25466e43-a8db-4d42-a46e-ee8b4ba06b46 req-da422738-fcb3-4e21-932f-331214887d5e service nova] Creating event network-changed:9f48b921-1485-4227-a071-674db7f6bf40 for instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 on n-h2-835595-3 Oct 05 17:54:58.288465 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-25466e43-a8db-4d42-a46e-ee8b4ba06b46 req-da422738-fcb3-4e21-932f-331214887d5e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082134 Oct 05 17:54:58.294542 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2467/4673] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:54:58.479525 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.network.neutron [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] re-assign floating IP 172.25.5.149 from instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 Oct 05 17:54:58.615149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Building network info cache for instance {{(pid=128843) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 17:55:00.381386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-473d2936-f202-41e8-986f-0f86037aafa2 req-8dd20db4-03aa-457e-9493-698b426a3b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43006e8-cc9f-4fca-9a04-bf7b23a2d83a", "tag": "b03b2af8-2f45-469c-9c72-5044637b7b8d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:00.406682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-473d2936-f202-41e8-986f-0f86037aafa2 req-8dd20db4-03aa-457e-9493-698b426a3b07 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:00.408835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-473d2936-f202-41e8-986f-0f86037aafa2 req-8dd20db4-03aa-457e-9493-698b426a3b07 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:00.409358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-473d2936-f202-41e8-986f-0f86037aafa2 req-8dd20db4-03aa-457e-9493-698b426a3b07 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:00.446469 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-473d2936-f202-41e8-986f-0f86037aafa2 req-8dd20db4-03aa-457e-9493-698b426a3b07 service nova] Creating event network-changed:b03b2af8-2f45-469c-9c72-5044637b7b8d for instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a on n-h1-835595-3 Oct 05 17:55:00.464705 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-473d2936-f202-41e8-986f-0f86037aafa2 req-8dd20db4-03aa-457e-9493-698b426a3b07 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087816 Oct 05 17:55:00.466941 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2468/4674] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:55:01.570637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Updating instance_info_cache with network_info: [{"id": "9f48b921-1485-4227-a071-674db7f6bf40", "address": "fa:16:3e:39:c2:b2", "network": {"id": "24932b3d-624c-45a1-8b2b-3202881311a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-279283541-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c84d0069489c415ba7219e61ff0ef20f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f48b921-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128843) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:55:01.583484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Building network info cache for instance {{(pid=128843) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 17:55:02.057370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=19 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:55:03.813242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Updating instance_info_cache with network_info: [{"id": "b03b2af8-2f45-469c-9c72-5044637b7b8d", "address": "fa:16:3e:99:2a:c6", "network": {"id": "24932b3d-624c-45a1-8b2b-3202881311a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-279283541-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c84d0069489c415ba7219e61ff0ef20f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb03b2af8-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128843) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:55:03.835052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Releasing lock "refresh_cache-b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:55:03.838935 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-920654bf-5862-46fe-8d0a-fc4659636948 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "POST /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a/action" status: 202 len: 0 microversion: 2.1 time: 11.801186 Oct 05 17:55:03.841186 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2207/4675] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:54:52 2022] POST /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a/action => generated 0 bytes in 11807 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 17:55:03.852740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.149"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:04.819300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:04.832929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:04.834152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:04.834634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:04.837357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:04.838646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:04.839600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:04.900067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=76,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:55:05.581248 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] HTTP exception thrown: Floating IP 172.25.5.149 is not associated with instance b54208b0-d0d4-4423-9695-42ac2b01e3f6. Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Request method failure captured: Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6/action HTTP/1.1 Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 49 Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcS13DEcGCBOyE-kb7E0-WlGEt62VGwZxeABDGBokLg1wGiWhZykO23kWbO2LJ9qdMDFBxruqka3njEEPPaQFxWCPMGaN1ZD7vg1f2R-5xwjnVx2B3g5wugtnsvHwHA4Yom8YgSmqmG-5ffEMoJXE8at0fnO1PY9qiX1s1xnO_kR_1Q Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c84d0069489c415ba7219e61ff0ef20f Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d0069489c415ba7219e61ff0ef20f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d0069489c415ba7219e61ff0ef20f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d0069489c415ba7219e61ff0ef20f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d0069489c415ba7219e61ff0ef20f"}]}] Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c84d0069489c415ba7219e61ff0ef20f Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FloatingIPsAssociationTestJSON-1576689819-project Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f75bf061b0784e77aef92ed595337f3f Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1576689819-project Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: {"removeFloatingIp": {"address": "172.25.5.149"}} Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: exception: Floating IP 172.25.5.149 is not associated with instance b54208b0-d0d4-4423-9695-42ac2b01e3f6. Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'b54208b0-d0d4-4423-9695-42ac2b01e3f6', 'body': {'removeFloatingIp': {'address': '172.25.5.149'}}} Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.149 is not associated with instance b54208b0-d0d4-4423-9695-42ac2b01e3f6. Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.149 is not associated with instance b54208b0-d0d4-4423-9695-42ac2b01e3f6. Oct 05 17:55:05.583426 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:05.598365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Returning 409 to user: Floating IP 172.25.5.149 is not associated with instance b54208b0-d0d4-4423-9695-42ac2b01e3f6. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:55:05.602093 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-780cc18c-a74f-40ad-bc76-7b2cd66288cf tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "POST /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6/action" status: 409 len: 146 microversion: 2.1 time: 1.753918 Oct 05 17:55:05.603143 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2469/4676] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:55:03 2022] POST /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6/action => generated 146 bytes in 1758 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 17:55:05.615347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.149"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:06.036836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:06.060085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:06.062426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:06.064552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:06.067846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:06.069502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:06.071399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:06.687982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "refresh_cache-b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:55:06.689031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquired lock "refresh_cache-b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:55:08.824061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Building network info cache for instance {{(pid=128843) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 17:55:08.868298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-88cca165-dfb7-4dbd-abe9-2c817b1cff77 req-49e76847-73ec-48e9-8136-7c0ae851a343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43006e8-cc9f-4fca-9a04-bf7b23a2d83a", "tag": "b03b2af8-2f45-469c-9c72-5044637b7b8d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:08.896534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88cca165-dfb7-4dbd-abe9-2c817b1cff77 req-49e76847-73ec-48e9-8136-7c0ae851a343 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:08.897227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88cca165-dfb7-4dbd-abe9-2c817b1cff77 req-49e76847-73ec-48e9-8136-7c0ae851a343 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:08.897995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88cca165-dfb7-4dbd-abe9-2c817b1cff77 req-49e76847-73ec-48e9-8136-7c0ae851a343 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:08.919936 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-88cca165-dfb7-4dbd-abe9-2c817b1cff77 req-49e76847-73ec-48e9-8136-7c0ae851a343 service nova] Creating event network-changed:b03b2af8-2f45-469c-9c72-5044637b7b8d for instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a on n-h1-835595-3 Oct 05 17:55:08.930583 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-88cca165-dfb7-4dbd-abe9-2c817b1cff77 req-49e76847-73ec-48e9-8136-7c0ae851a343 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066826 Oct 05 17:55:08.931850 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2470/4677] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:55:10.880969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Updating instance_info_cache with network_info: [{"id": "b03b2af8-2f45-469c-9c72-5044637b7b8d", "address": "fa:16:3e:99:2a:c6", "network": {"id": "24932b3d-624c-45a1-8b2b-3202881311a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-279283541-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c84d0069489c415ba7219e61ff0ef20f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb03b2af8-2f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128843) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:55:10.899014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Releasing lock "refresh_cache-b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:55:10.900162 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c34149bf-ebee-4eec-8d93-77adcd302ca3 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "POST /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a/action" status: 202 len: 0 microversion: 2.1 time: 5.291382 Oct 05 17:55:10.902118 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2208/4678] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:55:05 2022] POST /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a/action => generated 0 bytes in 5294 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 17:55:10.911979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a1684d94-2437-4810-9c37-2188e734ef85 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:10.913120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a1684d94-2437-4810-9c37-2188e734ef85 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:10.934320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1684d94-2437-4810-9c37-2188e734ef85 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:10.935227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1684d94-2437-4810-9c37-2188e734ef85 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:10.935906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1684d94-2437-4810-9c37-2188e734ef85 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:10.937052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1684d94-2437-4810-9c37-2188e734ef85 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:10.937286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1684d94-2437-4810-9c37-2188e734ef85 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:10.937943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1684d94-2437-4810-9c37-2188e734ef85 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:10.966520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a1684d94-2437-4810-9c37-2188e734ef85 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:55:11.099604 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a1684d94-2437-4810-9c37-2188e734ef85 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 204 len: 0 microversion: 2.1 time: 0.192517 Oct 05 17:55:11.100476 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2471/4679] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:55:10 2022] DELETE /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:55:11.114086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.149"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:11.116669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:11.137998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:11.138598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:11.139042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:11.139770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:11.140230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:11.140661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:11.143701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:55:11.192273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "refresh_cache-b54208b0-d0d4-4423-9695-42ac2b01e3f6" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:55:11.192273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquired lock "refresh_cache-b54208b0-d0d4-4423-9695-42ac2b01e3f6" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:55:15.110303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Building network info cache for instance {{(pid=128843) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 17:55:15.116624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ce38b48b-fc86-4e2e-9fae-0b53e3786d26 req-5e0e6b76-c7a4-47d1-8ebf-18f07c4f72eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43006e8-cc9f-4fca-9a04-bf7b23a2d83a", "name": "network-vif-deleted", "tag": "b03b2af8-2f45-469c-9c72-5044637b7b8d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:15.145442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:55:15.151697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ce38b48b-fc86-4e2e-9fae-0b53e3786d26 req-5e0e6b76-c7a4-47d1-8ebf-18f07c4f72eb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:15.155096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ce38b48b-fc86-4e2e-9fae-0b53e3786d26 req-5e0e6b76-c7a4-47d1-8ebf-18f07c4f72eb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:15.155653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ce38b48b-fc86-4e2e-9fae-0b53e3786d26 req-5e0e6b76-c7a4-47d1-8ebf-18f07c4f72eb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:15.187336 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ce38b48b-fc86-4e2e-9fae-0b53e3786d26 req-5e0e6b76-c7a4-47d1-8ebf-18f07c4f72eb service nova] Creating event network-vif-deleted:b03b2af8-2f45-469c-9c72-5044637b7b8d for instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a on n-h1-835595-3 Oct 05 17:55:15.200117 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ce38b48b-fc86-4e2e-9fae-0b53e3786d26 req-5e0e6b76-c7a4-47d1-8ebf-18f07c4f72eb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093118 Oct 05 17:55:15.211312 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2472/4680] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:55:16.547210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-22696a82-a012-4fdc-aa3b-b953cdc54d65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:16.549634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-22696a82-a012-4fdc-aa3b-b953cdc54d65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:16.565881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22696a82-a012-4fdc-aa3b-b953cdc54d65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:16.569610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22696a82-a012-4fdc-aa3b-b953cdc54d65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:16.575274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22696a82-a012-4fdc-aa3b-b953cdc54d65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:16.576371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22696a82-a012-4fdc-aa3b-b953cdc54d65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:16.577182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22696a82-a012-4fdc-aa3b-b953cdc54d65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:16.577817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-22696a82-a012-4fdc-aa3b-b953cdc54d65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:16.680746 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-22696a82-a012-4fdc-aa3b-b953cdc54d65 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790/action" status: 200 len: 24579 microversion: 2.1 time: 0.138658 Oct 05 17:55:16.682644 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2473/4681] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:55:16 2022] POST /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790/action => generated 24579 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 17:55:17.306111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6bcc4c2e-be97-4a10-9981-4301d9c138dc req-e50a3e4d-097c-4b10-ac4e-4e3a07597ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54208b0-d0d4-4423-9695-42ac2b01e3f6", "tag": "9f48b921-1485-4227-a071-674db7f6bf40"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:17.323593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6bcc4c2e-be97-4a10-9981-4301d9c138dc req-e50a3e4d-097c-4b10-ac4e-4e3a07597ed6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:17.324723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6bcc4c2e-be97-4a10-9981-4301d9c138dc req-e50a3e4d-097c-4b10-ac4e-4e3a07597ed6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:17.325373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6bcc4c2e-be97-4a10-9981-4301d9c138dc req-e50a3e4d-097c-4b10-ac4e-4e3a07597ed6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:17.359508 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6bcc4c2e-be97-4a10-9981-4301d9c138dc req-e50a3e4d-097c-4b10-ac4e-4e3a07597ed6 service nova] Creating event network-changed:9f48b921-1485-4227-a071-674db7f6bf40 for instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 on n-h2-835595-3 Oct 05 17:55:17.381016 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6bcc4c2e-be97-4a10-9981-4301d9c138dc req-e50a3e4d-097c-4b10-ac4e-4e3a07597ed6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072183 Oct 05 17:55:17.387684 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2474/4682] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:55:18.340176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Updating instance_info_cache with network_info: [{"id": "9f48b921-1485-4227-a071-674db7f6bf40", "address": "fa:16:3e:39:c2:b2", "network": {"id": "24932b3d-624c-45a1-8b2b-3202881311a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-279283541-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c84d0069489c415ba7219e61ff0ef20f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f48b921-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128843) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:55:18.360196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Releasing lock "refresh_cache-b54208b0-d0d4-4423-9695-42ac2b01e3f6" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:55:18.361083 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-198c9169-c20f-49ec-85ab-836115a630dc tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "POST /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6/action" status: 202 len: 0 microversion: 2.1 time: 7.252073 Oct 05 17:55:18.365082 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2209/4683] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:55:11 2022] POST /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6/action => generated 0 bytes in 7253 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 17:55:18.370720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5cd337fb-a9be-418c-bb7b-6e102e8c6f0c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '.version_select at 0x7f77747cf160>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:19.222504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5cd337fb-a9be-418c-bb7b-6e102e8c6f0c tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/os-floating-ips/7f6ee3c5-9ed5-4cfd-930a-9935488828f7" status: 200 len: 184 microversion: 2.1 time: 0.856009 Oct 05 17:55:19.223098 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2475/4684] 10.222.0.70 () {58 vars in 1260 bytes} [Wed Oct 5 17:55:18 2022] GET /compute/v2.1/os-floating-ips/7f6ee3c5-9ed5-4cfd-930a-9935488828f7 => generated 184 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:55:19.238649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.149"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:19.836959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:19.846121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:19.847637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:19.848478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:19.858440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:19.859414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:19.860190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:20.864526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "refresh_cache-b54208b0-d0d4-4423-9695-42ac2b01e3f6" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 05 17:55:20.865737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquired lock "refresh_cache-b54208b0-d0d4-4423-9695-42ac2b01e3f6" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 05 17:55:23.203980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4637f23e-ab53-4861-874c-6afcd898f255 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:23.205378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4637f23e-ab53-4861-874c-6afcd898f255 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:23.216655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4637f23e-ab53-4861-874c-6afcd898f255 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:23.217710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4637f23e-ab53-4861-874c-6afcd898f255 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:23.222224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4637f23e-ab53-4861-874c-6afcd898f255 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:23.224897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4637f23e-ab53-4861-874c-6afcd898f255 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:23.225561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4637f23e-ab53-4861-874c-6afcd898f255 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:23.230889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4637f23e-ab53-4861-874c-6afcd898f255 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:23.704162 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4637f23e-ab53-4861-874c-6afcd898f255 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1835 microversion: 2.1 time: 0.504089 Oct 05 17:55:23.715482 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2476/4685] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:55:23 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1835 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:55:24.347501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Building network info cache for instance {{(pid=128843) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 05 17:55:24.385319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-2330f2ad-d1e2-4190-ba26-5b21bf77a50d req-fe19466f-5b05-4009-808f-e9c3dbf634bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54208b0-d0d4-4423-9695-42ac2b01e3f6", "tag": "9f48b921-1485-4227-a071-674db7f6bf40"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:24.402467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2330f2ad-d1e2-4190-ba26-5b21bf77a50d req-fe19466f-5b05-4009-808f-e9c3dbf634bc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:24.406219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2330f2ad-d1e2-4190-ba26-5b21bf77a50d req-fe19466f-5b05-4009-808f-e9c3dbf634bc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:24.406886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2330f2ad-d1e2-4190-ba26-5b21bf77a50d req-fe19466f-5b05-4009-808f-e9c3dbf634bc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:24.423598 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-2330f2ad-d1e2-4190-ba26-5b21bf77a50d req-fe19466f-5b05-4009-808f-e9c3dbf634bc service nova] Creating event network-changed:9f48b921-1485-4227-a071-674db7f6bf40 for instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 on n-h2-835595-3 Oct 05 17:55:24.444122 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-2330f2ad-d1e2-4190-ba26-5b21bf77a50d req-fe19466f-5b05-4009-808f-e9c3dbf634bc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063552 Oct 05 17:55:24.453458 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2477/4686] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:55:27.729715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Updating instance_info_cache with network_info: [{"id": "9f48b921-1485-4227-a071-674db7f6bf40", "address": "fa:16:3e:39:c2:b2", "network": {"id": "24932b3d-624c-45a1-8b2b-3202881311a2", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-279283541-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "c84d0069489c415ba7219e61ff0ef20f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9f48b921-14", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128843) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 17:55:27.747719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Releasing lock "refresh_cache-b54208b0-d0d4-4423-9695-42ac2b01e3f6" {{(pid=128843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 05 17:55:27.748722 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1f82cf39-a597-4a89-a38f-290a1d215e71 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "POST /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6/action" status: 202 len: 0 microversion: 2.1 time: 8.516821 Oct 05 17:55:27.761755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:27.762443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:27.764362 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2210/4687] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:55:19 2022] POST /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6/action => generated 0 bytes in 8533 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 05 17:55:27.778382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:27.778987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:27.779438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:27.782856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:27.785177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:27.786034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:27.821768 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] HTTP exception thrown: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Request method failure captured: Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a HTTP/1.1 Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcS13DEcGCBOyE-kb7E0-WlGEt62VGwZxeABDGBokLg1wGiWhZykO23kWbO2LJ9qdMDFBxruqka3njEEPPaQFxWCPMGaN1ZD7vg1f2R-5xwjnVx2B3g5wugtnsvHwHA4Yom8YgSmqmG-5ffEMoJXE8at0fnO1PY9qiX1s1xnO_kR_1Q Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c84d0069489c415ba7219e61ff0ef20f Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d0069489c415ba7219e61ff0ef20f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d0069489c415ba7219e61ff0ef20f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d0069489c415ba7219e61ff0ef20f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d0069489c415ba7219e61ff0ef20f"}]}] Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c84d0069489c415ba7219e61ff0ef20f Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FloatingIPsAssociationTestJSON-1576689819-project Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f75bf061b0784e77aef92ed595337f3f Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1576689819-project Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'b43006e8-cc9f-4fca-9a04-bf7b23a2d83a'} Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:55:27.823605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:27.828469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Returning 404 to user: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:55:27.834431 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-741dbb48-c425-448b-9d57-9794c0a22bd8 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 404 len: 111 microversion: 2.1 time: 0.069560 Oct 05 17:55:27.835171 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2478/4688] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:55:27 2022] DELETE /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:55:27.843584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:27.844716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b43006e8-cc9f-4fca-9a04-bf7b23a2d83a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:27.860311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:27.863024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:27.863492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:27.871751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:27.872261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:27.872777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:27.911043 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] HTTP exception thrown: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Request method failure captured: Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a HTTP/1.1 Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcS13DEcGCBOyE-kb7E0-WlGEt62VGwZxeABDGBokLg1wGiWhZykO23kWbO2LJ9qdMDFBxruqka3njEEPPaQFxWCPMGaN1ZD7vg1f2R-5xwjnVx2B3g5wugtnsvHwHA4Yom8YgSmqmG-5ffEMoJXE8at0fnO1PY9qiX1s1xnO_kR_1Q Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: c84d0069489c415ba7219e61ff0ef20f Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d0069489c415ba7219e61ff0ef20f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d0069489c415ba7219e61ff0ef20f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d0069489c415ba7219e61ff0ef20f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d0069489c415ba7219e61ff0ef20f"}]}] Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: c84d0069489c415ba7219e61ff0ef20f Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-FloatingIPsAssociationTestJSON-1576689819-project Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: f75bf061b0784e77aef92ed595337f3f Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1576689819-project Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'b43006e8-cc9f-4fca-9a04-bf7b23a2d83a'} Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:55:27.913391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:55:27.920901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:55:27.920901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:27.920901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:55:27.920901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:55:27.920901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:55:27.920901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:55:27.920901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. Oct 05 17:55:27.920901 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:55:27.924076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Returning 404 to user: Instance b43006e8-cc9f-4fca-9a04-bf7b23a2d83a could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:55:27.926417 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-edb2ab74-77b5-4a83-a7dd-3b784eeef2e2 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a" status: 404 len: 111 microversion: 2.1 time: 0.085980 Oct 05 17:55:27.939093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac3edf59-4fc4-4ea7-8893-cebd12749daa tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '.version_select at 0x7f77740c6700>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:27.945039 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2211/4689] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:55:27 2022] GET /compute/v2.1/servers/b43006e8-cc9f-4fca-9a04-bf7b23a2d83a => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:55:28.297973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3989c176-fb7c-43c3-854b-3c0bd075d333 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:28.298811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3989c176-fb7c-43c3-854b-3c0bd075d333 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:28.311731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3989c176-fb7c-43c3-854b-3c0bd075d333 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:28.316939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3989c176-fb7c-43c3-854b-3c0bd075d333 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:28.317401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3989c176-fb7c-43c3-854b-3c0bd075d333 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:28.318154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3989c176-fb7c-43c3-854b-3c0bd075d333 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:28.318661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3989c176-fb7c-43c3-854b-3c0bd075d333 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:28.329249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3989c176-fb7c-43c3-854b-3c0bd075d333 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:28.376186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3989c176-fb7c-43c3-854b-3c0bd075d333 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:55:28.549105 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3989c176-fb7c-43c3-854b-3c0bd075d333 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 204 len: 0 microversion: 2.1 time: 0.254813 Oct 05 17:55:28.550189 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2212/4690] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:55:28 2022] DELETE /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 17:55:28.558373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6f45a201-036c-42b7-983b-3baf9c6582aa req-404c5e52-ddac-4491-9493-0badb5e989a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d8bee32-1d91-4dcf-a8be-8e0b26b77790", "tag": "2e0451f7-6590-4750-ab4b-0ea667cb7622"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:28.584571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6f45a201-036c-42b7-983b-3baf9c6582aa req-404c5e52-ddac-4491-9493-0badb5e989a8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:28.587496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6f45a201-036c-42b7-983b-3baf9c6582aa req-404c5e52-ddac-4491-9493-0badb5e989a8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:28.589249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6f45a201-036c-42b7-983b-3baf9c6582aa req-404c5e52-ddac-4491-9493-0badb5e989a8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:29.322961 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6f45a201-036c-42b7-983b-3baf9c6582aa req-404c5e52-ddac-4491-9493-0badb5e989a8 service nova] Creating event network-changed:2e0451f7-6590-4750-ab4b-0ea667cb7622 for instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 on n-h2-835595-3 Oct 05 17:55:29.331265 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6f45a201-036c-42b7-983b-3baf9c6582aa req-404c5e52-ddac-4491-9493-0badb5e989a8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.779755 Oct 05 17:55:29.332384 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2213/4691] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:55:29.340909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c0d4efc7-8acf-4dbe-aae2-1d96a012ade5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:29.342051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c0d4efc7-8acf-4dbe-aae2-1d96a012ade5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:29.353591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d4efc7-8acf-4dbe-aae2-1d96a012ade5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:29.355026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d4efc7-8acf-4dbe-aae2-1d96a012ade5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:29.355711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d4efc7-8acf-4dbe-aae2-1d96a012ade5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:29.363781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d4efc7-8acf-4dbe-aae2-1d96a012ade5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:29.365526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d4efc7-8acf-4dbe-aae2-1d96a012ade5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:29.366196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c0d4efc7-8acf-4dbe-aae2-1d96a012ade5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:30.259141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c0d4efc7-8acf-4dbe-aae2-1d96a012ade5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:55:30.271432 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c0d4efc7-8acf-4dbe-aae2-1d96a012ade5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1690 microversion: 2.1 time: 0.936367 Oct 05 17:55:30.272387 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2214/4692] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:55:29 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1690 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:55:31.297755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d5b2ad4f-273b-479e-bb68-c5c89f02167b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:31.299295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d5b2ad4f-273b-479e-bb68-c5c89f02167b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:31.321448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5b2ad4f-273b-479e-bb68-c5c89f02167b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:31.328600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5b2ad4f-273b-479e-bb68-c5c89f02167b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:31.329904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5b2ad4f-273b-479e-bb68-c5c89f02167b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:31.332430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5b2ad4f-273b-479e-bb68-c5c89f02167b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:31.333086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5b2ad4f-273b-479e-bb68-c5c89f02167b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:31.336852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d5b2ad4f-273b-479e-bb68-c5c89f02167b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:32.618426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d5b2ad4f-273b-479e-bb68-c5c89f02167b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:55:32.635343 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d5b2ad4f-273b-479e-bb68-c5c89f02167b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1690 microversion: 2.1 time: 1.339331 Oct 05 17:55:32.637860 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2215/4693] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:55:31 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1690 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:55:33.318474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a70a1da2-ff95-410f-ac4c-ba44a4ca73c0 req-ef7500e2-be5d-44e4-a2ee-6f0cd97d656a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d8bee32-1d91-4dcf-a8be-8e0b26b77790", "name": "network-vif-deleted", "tag": "2e0451f7-6590-4750-ab4b-0ea667cb7622"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:33.355724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:55:33.389108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a70a1da2-ff95-410f-ac4c-ba44a4ca73c0 req-ef7500e2-be5d-44e4-a2ee-6f0cd97d656a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:33.390142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a70a1da2-ff95-410f-ac4c-ba44a4ca73c0 req-ef7500e2-be5d-44e4-a2ee-6f0cd97d656a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:33.390938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a70a1da2-ff95-410f-ac4c-ba44a4ca73c0 req-ef7500e2-be5d-44e4-a2ee-6f0cd97d656a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:33.416260 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a70a1da2-ff95-410f-ac4c-ba44a4ca73c0 req-ef7500e2-be5d-44e4-a2ee-6f0cd97d656a service nova] Creating event network-vif-deleted:2e0451f7-6590-4750-ab4b-0ea667cb7622 for instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 on n-h2-835595-3 Oct 05 17:55:33.449586 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a70a1da2-ff95-410f-ac4c-ba44a4ca73c0 req-ef7500e2-be5d-44e4-a2ee-6f0cd97d656a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141793 Oct 05 17:55:33.453850 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2216/4694] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:55:33.663932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:33.666318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:33.686716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:33.688272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:33.688999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:33.690129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:33.690849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:33.691534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:33.743361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:33.744924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:33.745580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:33.746208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lazy-loading 'fault' on Instance uuid 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:55:33.873570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:55:33.882183 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6bf41758-be2b-4bd4-8dae-345de92f6b79 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 200 len: 1357 microversion: 2.1 time: 0.225304 Oct 05 17:55:33.894900 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2217/4695] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:55:33 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:55:33.906149 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac3edf59-4fc4-4ea7-8893-cebd12749daa tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "DELETE /compute/v2.1/os-floating-ips/7f6ee3c5-9ed5-4cfd-930a-9935488828f7" status: 202 len: 0 microversion: 2.1 time: 5.970683 Oct 05 17:55:33.909345 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2479/4696] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 17:55:27 2022] DELETE /compute/v2.1/os-floating-ips/7f6ee3c5-9ed5-4cfd-930a-9935488828f7 => generated 0 bytes in 5977 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:55:33.918249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed1f709e-503b-46f9-b5a8-ab5a16e6d231 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:33.918914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed1f709e-503b-46f9-b5a8-ab5a16e6d231 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:33.948287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f709e-503b-46f9-b5a8-ab5a16e6d231 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:33.948786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f709e-503b-46f9-b5a8-ab5a16e6d231 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:33.952813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f709e-503b-46f9-b5a8-ab5a16e6d231 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:33.953892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f709e-503b-46f9-b5a8-ab5a16e6d231 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:33.957417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f709e-503b-46f9-b5a8-ab5a16e6d231 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:33.958421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f709e-503b-46f9-b5a8-ab5a16e6d231 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:34.027660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed1f709e-503b-46f9-b5a8-ab5a16e6d231 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:55:34.271622 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed1f709e-503b-46f9-b5a8-ab5a16e6d231 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 204 len: 0 microversion: 2.1 time: 0.360431 Oct 05 17:55:34.272785 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2218/4697] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:55:33 2022] DELETE /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:55:34.281642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ebd06d77-cadc-402c-9fc9-88c2fd729391 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:34.282388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ebd06d77-cadc-402c-9fc9-88c2fd729391 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:34.301878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebd06d77-cadc-402c-9fc9-88c2fd729391 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:34.302411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebd06d77-cadc-402c-9fc9-88c2fd729391 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:34.306943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebd06d77-cadc-402c-9fc9-88c2fd729391 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:34.308055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebd06d77-cadc-402c-9fc9-88c2fd729391 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:34.308772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebd06d77-cadc-402c-9fc9-88c2fd729391 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:34.309445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ebd06d77-cadc-402c-9fc9-88c2fd729391 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:34.862976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ebd06d77-cadc-402c-9fc9-88c2fd729391 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:55:34.883562 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ebd06d77-cadc-402c-9fc9-88c2fd729391 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1525 microversion: 2.1 time: 0.606620 Oct 05 17:55:34.888461 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2480/4698] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:55:34 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1525 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:55:34.914317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:34.915250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 5d8bee32-1d91-4dcf-a8be-8e0b26b77790] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:34.930639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:34.932415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:34.933318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:34.934325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:34.936255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:34.942075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:34.975738 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] HTTP exception thrown: Instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 could not be found. Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Request method failure captured: Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 HTTP/1.1 Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcR9hsASNeCxKdaWPh__rNnLpLGu_NRFNi62uQj9y73P1T9S0pslSwuq_12rTMXyGYm4d-Umm-79M42ROeTVnTLUWyZ4RZkWarKlFVLotx_WpwXcOjA-s_3fPDnuAoX-R_bMMcbYM0Kd8mJ9oPRpxXfRyUZdm3yiMPoJSkAHu7laR8I Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: ff799a13bddf49c0bc8b23c02eabf9ac Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ff799a13bddf49c0bc8b23c02eabf9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff799a13bddf49c0bc8b23c02eabf9ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ff799a13bddf49c0bc8b23c02eabf9ac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff799a13bddf49c0bc8b23c02eabf9ac"}]}] Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: ff799a13bddf49c0bc8b23c02eabf9ac Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestNetworkAdvancedServerOps-1621598017-project Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 06d379a97d474b74a29e62848a4e4696 Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1621598017-project Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 could not be found. Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '5d8bee32-1d91-4dcf-a8be-8e0b26b77790'} Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 could not be found. Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 could not be found. Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:55:34.979276 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:55:34.984967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:55:34.984967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:34.984967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:55:34.984967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:55:34.984967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:55:34.984967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:55:34.984967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 could not be found. Oct 05 17:55:34.984967 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:55:34.989365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Returning 404 to user: Instance 5d8bee32-1d91-4dcf-a8be-8e0b26b77790 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:55:34.995033 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0a3170e2-4e1b-4d49-a053-1d8c8e8733bb tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790" status: 404 len: 111 microversion: 2.1 time: 0.086628 Oct 05 17:55:35.000892 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2219/4699] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:55:34 2022] GET /compute/v2.1/servers/5d8bee32-1d91-4dcf-a8be-8e0b26b77790 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:55:35.917720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-298fc992-3c11-49aa-b236-e298dc15df99 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:35.921632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-298fc992-3c11-49aa-b236-e298dc15df99 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:35.951555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-298fc992-3c11-49aa-b236-e298dc15df99 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:35.954692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-298fc992-3c11-49aa-b236-e298dc15df99 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:35.955370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-298fc992-3c11-49aa-b236-e298dc15df99 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:35.958342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-298fc992-3c11-49aa-b236-e298dc15df99 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:35.958999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-298fc992-3c11-49aa-b236-e298dc15df99 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:35.959634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-298fc992-3c11-49aa-b236-e298dc15df99 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:35.969065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:55:37.370442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-783234ac-ceec-4e16-84a0-7957f7793c84 req-97d963cb-f4bd-49fd-8798-495058c6b4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54208b0-d0d4-4423-9695-42ac2b01e3f6", "name": "network-vif-deleted", "tag": "9f48b921-1485-4227-a071-674db7f6bf40"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:37.379714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-298fc992-3c11-49aa-b236-e298dc15df99 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f75bf061b0784e77aef92ed595337f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c84d0069489c415ba7219e61ff0ef20f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:55:37.390362 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-298fc992-3c11-49aa-b236-e298dc15df99 tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 200 len: 1525 microversion: 2.1 time: 1.478487 Oct 05 17:55:37.393821 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2481/4700] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:55:35 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 1525 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:55:37.419498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-783234ac-ceec-4e16-84a0-7957f7793c84 req-97d963cb-f4bd-49fd-8798-495058c6b4f4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:37.420376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-783234ac-ceec-4e16-84a0-7957f7793c84 req-97d963cb-f4bd-49fd-8798-495058c6b4f4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:37.420996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-783234ac-ceec-4e16-84a0-7957f7793c84 req-97d963cb-f4bd-49fd-8798-495058c6b4f4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:37.436008 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-783234ac-ceec-4e16-84a0-7957f7793c84 req-97d963cb-f4bd-49fd-8798-495058c6b4f4 service nova] Creating event network-vif-deleted:9f48b921-1485-4227-a071-674db7f6bf40 for instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 on n-h2-835595-3 Oct 05 17:55:37.441642 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-783234ac-ceec-4e16-84a0-7957f7793c84 req-97d963cb-f4bd-49fd-8798-495058c6b4f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075533 Oct 05 17:55:37.442839 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2220/4701] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:55:38.419433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:38.420060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] [instance: b54208b0-d0d4-4423-9695-42ac2b01e3f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:55:38.434477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:38.435075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:38.435506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:38.436238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:38.436698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:38.437119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:38.494982 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] HTTP exception thrown: Instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 could not be found. Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Request method failure captured: Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 HTTP/1.1 Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcS13DEcGCBOyE-kb7E0-WlGEt62VGwZxeABDGBokLg1wGiWhZykO23kWbO2LJ9qdMDFBxruqka3njEEPPaQFxWCPMGaN1ZD7vg1f2R-5xwjnVx2B3g5wugtnsvHwHA4Yom8YgSmqmG-5ffEMoJXE8at0fnO1PY9qiX1s1xnO_kR_1Q Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c84d0069489c415ba7219e61ff0ef20f Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c84d0069489c415ba7219e61ff0ef20f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d0069489c415ba7219e61ff0ef20f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c84d0069489c415ba7219e61ff0ef20f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c84d0069489c415ba7219e61ff0ef20f"}]}] Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c84d0069489c415ba7219e61ff0ef20f Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1576689819 Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-FloatingIPsAssociationTestJSON-1576689819-project Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: f75bf061b0784e77aef92ed595337f3f Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1576689819-project Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 could not be found. Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'b54208b0-d0d4-4423-9695-42ac2b01e3f6'} Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 could not be found. Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 could not be found. Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:38.496851 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 could not be found. Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] Returning 404 to user: Instance b54208b0-d0d4-4423-9695-42ac2b01e3f6 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c43928b4-ccda-4f26-99ec-130983357eea tempest-FloatingIPsAssociationTestJSON-1576689819 tempest-FloatingIPsAssociationTestJSON-1576689819-project] 10.222.0.70 "GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6" status: 404 len: 111 microversion: 2.1 time: 0.083005 Oct 05 17:55:38.502824 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2482/4702] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:55:38 2022] GET /compute/v2.1/servers/b54208b0-d0d4-4423-9695-42ac2b01e3f6 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:55:43.686533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] Calling method '.version_select at 0x7f77742cf550>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:43.688621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:43.689120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:43.689582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:43.696295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=74,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:55:43.755169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:43.755950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:43.756654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:43.792929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:55:43.794508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:55:43.795125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:55:43.807226 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d0dff699-f0b6-4616-b8e1-8be0da3fcf76 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155 tempest-PortsAdminExtendedAttrsIpV6TestJSON-325682155-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.435912 Oct 05 17:55:43.808161 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2221/4703] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:55:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:55:49.248148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e2c965a8-dccf-417f-a93b-70d3811114cd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '.version_select at 0x7f77746cfee0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:55:49.274667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=17 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:55:49.278553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=7 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:55:49.302204 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e2c965a8-dccf-417f-a93b-70d3811114cd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1969127260" status: 202 len: 0 microversion: 2.1 time: 0.064062 Oct 05 17:55:49.304912 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2483/4704] 10.222.0.70 () {58 vars in 1284 bytes} [Wed Oct 5 17:55:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1969127260 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:55:49.343449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9a81263f-e31c-44af-be31-4f216e108728 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'create', calling method: .version_select at 0x7f777434c820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-74455598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxg29HNTMNMuyyayVa3Wp2fJn0XMfxKlSl74cbOc9vmklPhjtB9fOYD+dpI23AFl4XolAXyd5LIaGBStEkM00bmYsvN4f1onZgko6y3vOiceyWSwBTJ7wK4NFGV4UeW/g=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:55:49.373249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-9a81263f-e31c-44af-be31-4f216e108728 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:55:49.378940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-9a81263f-e31c-44af-be31-4f216e108728 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for user 06d379a97d474b74a29e62848a4e4696 and project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:55:49.409007 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9a81263f-e31c-44af-be31-4f216e108728 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.069520 Oct 05 17:55:49.411201 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2222/4705] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:55:49 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:56:18.071822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:56:18.427306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79fc4daa-fcd5-452f-8e90-2e0f3be4f1b1 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f77740b9b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-755813925", "description": "tempest-description-648757020"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:18.811590 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79fc4daa-fcd5-452f-8e90-2e0f3be4f1b1 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.746134 Oct 05 17:56:18.812889 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2484/4706] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:56:18 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:56:18.824925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=5 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:56:18.825694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:56:18.826622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:56:18.848116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f252c31f-ed15-4fcd-84f5-46377a419cdd tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f7774341ca0>, body: {"security_group_rule": {"parent_group_id": "6dbdd716-e55a-4019-beae-cdd8e4cff17e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:20.576778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1585792282", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "950c7202-b672-4a94-8c62-6f0845797d6e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-74455598", "security_groups": [{"name": "tempest-secgroup-smoke-601853457"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:20.839018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] validate_networks() for [('950c7202-b672-4a94-8c62-6f0845797d6e', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:56:20.895619 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f252c31f-ed15-4fcd-84f5-46377a419cdd tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.073069 Oct 05 17:56:20.896565 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2223/4707] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:56:18 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2075 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:56:20.910566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-34f128cf-aa14-4ef9-b7d5-1b31d9dab014 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f77743089d0>, body: {"security_group_rule": {"parent_group_id": "6dbdd716-e55a-4019-beae-cdd8e4cff17e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:21.131527 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-34f128cf-aa14-4ef9-b7d5-1b31d9dab014 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] HTTP exception thrown: This rule already exists in group 6dbdd716-e55a-4019-beae-cdd8e4cff17e Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-34f128cf-aa14-4ef9-b7d5-1b31d9dab014 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Request method failure captured: Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 138 Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcVB1hhhh-lm1csgio0RE-CxkNSPFK-1d0WWL3FRKGigkO3QQToWdofbhd2YEsTz5rIW1S1E8dtiatf2xcexhY_NhEphZDpon9fRRvAxqLsy-YF-FZyPx-07W-P6KDwzNsQqefmMngFbZLjsEJT98XFLbwzu06zP2TidKuagUCFqSOA Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c95ba6cb3b994980870cc5aab22cee3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}] Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 60cce5aae97440faa7279dc3855da9c1 Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: {"security_group_rule": {"parent_group_id": "6dbdd716-e55a-4019-beae-cdd8e4cff17e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: exception: This rule already exists in group 6dbdd716-e55a-4019-beae-cdd8e4cff17e Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6dbdd716-e55a-4019-beae-cdd8e4cff17e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 6dbdd716-e55a-4019-beae-cdd8e4cff17e Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 6dbdd716-e55a-4019-beae-cdd8e4cff17e Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:21.133591 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:21.139929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:56:21.139929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:56:21.139929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 6dbdd716-e55a-4019-beae-cdd8e4cff17e Oct 05 17:56:21.139929 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:21.139929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-34f128cf-aa14-4ef9-b7d5-1b31d9dab014 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Returning 400 to user: This rule already exists in group 6dbdd716-e55a-4019-beae-cdd8e4cff17e {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:56:21.139929 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-34f128cf-aa14-4ef9-b7d5-1b31d9dab014 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.230730 Oct 05 17:56:21.139929 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2224/4708] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:56:20 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 17:56:21.144539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1e79aaa5-c8a1-4d02-a232-a880d244b004 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Calling method '.version_select at 0x7f777434c670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:22.281319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:56:22.282363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:56:22.283224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:56:22.283826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:56:22.284425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:56:22.327786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:22.328380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:22.328830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:22.329574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:22.330154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:22.330509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:22.373933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:56:22.398426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for user 06d379a97d474b74a29e62848a4e4696 and project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:56:22.424894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:56:22.427775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:56:22.535631 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [8ba94276-b5f9-4ec5-ae97-36f570342fd5] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 17:56:22.840938 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1e79aaa5-c8a1-4d02-a232-a880d244b004 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/3392106a-f832-4a44-bdf1-5f39d0e60003" status: 202 len: 0 microversion: 2.1 time: 1.700006 Oct 05 17:56:22.841855 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2225/4709] 10.222.0.70 () {58 vars in 1287 bytes} [Wed Oct 5 17:56:21 2022] DELETE /compute/v2.1/os-security-group-rules/3392106a-f832-4a44-bdf1-5f39d0e60003 => generated 0 bytes in 1702 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:56:22.850932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6149022f-ac9f-423e-a07a-47893cd451d7 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f77742cb280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-2093164111", "description": "tempest-description-1841737075"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:23.418682 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6149022f-ac9f-423e-a07a-47893cd451d7 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.571780 Oct 05 17:56:23.419716 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2226/4710] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:56:22 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:56:23.432790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-932f3340-772c-4174-8064-0c348e55e88a tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f77745e0160>, body: {"security_group_rule": {"parent_group_id": "67c2ddac-edf8-41a2-b4cb-8da4c55f4014", "ip_protocol": "tcp", "from_port": 1834323182, "to_port": 22}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:23.551729 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [8ba94276-b5f9-4ec5-ae97-36f570342fd5] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 33262. Oct 05 17:56:23.555725 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac28ac34-8401-4fc2-b324-9318dd1c1da5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.982938 Oct 05 17:56:23.557567 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2485/4711] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:56:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 2985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:56:23.571566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3451781-30e0-4ace-adf6-40834995adf8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:23.572444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c3451781-30e0-4ace-adf6-40834995adf8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:24.035268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c3451781-30e0-4ace-adf6-40834995adf8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:24.046700 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3451781-30e0-4ace-adf6-40834995adf8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1265 microversion: 2.1 time: 0.476106 Oct 05 17:56:24.061870 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2486/4712] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:23 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1265 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:56:24.281453 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-932f3340-772c-4174-8064-0c348e55e88a tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] HTTP exception thrown: Invalid port range 1834323182:22. Former value cannot be greater than the later Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-932f3340-772c-4174-8064-0c348e55e88a tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Request method failure captured: Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 146 Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcVB1hhhh-lm1csgio0RE-CxkNSPFK-1d0WWL3FRKGigkO3QQToWdofbhd2YEsTz5rIW1S1E8dtiatf2xcexhY_NhEphZDpon9fRRvAxqLsy-YF-FZyPx-07W-P6KDwzNsQqefmMngFbZLjsEJT98XFLbwzu06zP2TidKuagUCFqSOA Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c95ba6cb3b994980870cc5aab22cee3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}] Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 60cce5aae97440faa7279dc3855da9c1 Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: {"security_group_rule": {"parent_group_id": "67c2ddac-edf8-41a2-b4cb-8da4c55f4014", "ip_protocol": "tcp", "from_port": 1834323182, "to_port": 22}} Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid port range 1834323182:22. Former value cannot be greater than the later Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'security_group_rule': {'parent_group_id': '67c2ddac-edf8-41a2-b4cb-8da4c55f4014', 'ip_protocol': 'tcp', 'from_port': 1834323182, 'to_port': 22}}} Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1834323182:22. Former value cannot be greater than the later Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1834323182:22. Former value cannot be greater than the later Oct 05 17:56:24.284190 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1834323182:22. Former value cannot be greater than the later Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-932f3340-772c-4174-8064-0c348e55e88a tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Returning 400 to user: Invalid port range 1834323182:22. Former value cannot be greater than the later {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-932f3340-772c-4174-8064-0c348e55e88a tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.857137 Oct 05 17:56:24.289458 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2227/4713] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:56:23 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 859 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:56:24.297295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-daadefc2-1d21-4d58-8ee3-8630fb4da839 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f7774d78dc0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-831207058", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:24.300728 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-daadefc2-1d21-4d58-8ee3-8630fb4da839 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] HTTP exception thrown: Security group id should be uuid Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-daadefc2-1d21-4d58-8ee3-8630fb4da839 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Request method failure captured: Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 130 Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcVB1hhhh-lm1csgio0RE-CxkNSPFK-1d0WWL3FRKGigkO3QQToWdofbhd2YEsTz5rIW1S1E8dtiatf2xcexhY_NhEphZDpon9fRRvAxqLsy-YF-FZyPx-07W-P6KDwzNsQqefmMngFbZLjsEJT98XFLbwzu06zP2TidKuagUCFqSOA Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c95ba6cb3b994980870cc5aab22cee3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}] Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 60cce5aae97440faa7279dc3855da9c1 Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-831207058", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: exception: Security group id should be uuid Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-831207058', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:56:24.302768 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:56:24.309955 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 05 17:56:24.309955 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:56:24.309955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-daadefc2-1d21-4d58-8ee3-8630fb4da839 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Returning 400 to user: Security group id should be uuid {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:56:24.315506 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-daadefc2-1d21-4d58-8ee3-8630fb4da839 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.021196 Oct 05 17:56:24.318145 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2487/4714] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:56:24 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:56:24.331583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c20493bb-dd01-45da-bf81-90aa7804eaf3 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f77742cf040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1055663715", "description": "tempest-description-863032614"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:25.072631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63a9360d-71ed-4455-b983-ac642815b810 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:25.074051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63a9360d-71ed-4455-b983-ac642815b810 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:25.088576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63a9360d-71ed-4455-b983-ac642815b810 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:25.089478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63a9360d-71ed-4455-b983-ac642815b810 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:25.090705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63a9360d-71ed-4455-b983-ac642815b810 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:25.091715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63a9360d-71ed-4455-b983-ac642815b810 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:25.092563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63a9360d-71ed-4455-b983-ac642815b810 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:25.102918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63a9360d-71ed-4455-b983-ac642815b810 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:25.260325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63a9360d-71ed-4455-b983-ac642815b810 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:25.268372 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63a9360d-71ed-4455-b983-ac642815b810 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1317 microversion: 2.1 time: 0.201221 Oct 05 17:56:25.274123 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2488/4715] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:25 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:56:26.303176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b0e3356b-024d-4616-b2ea-6cedbbb4806f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:26.303176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b0e3356b-024d-4616-b2ea-6cedbbb4806f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:26.321401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0e3356b-024d-4616-b2ea-6cedbbb4806f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:26.321921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0e3356b-024d-4616-b2ea-6cedbbb4806f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:26.322423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0e3356b-024d-4616-b2ea-6cedbbb4806f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:26.323168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0e3356b-024d-4616-b2ea-6cedbbb4806f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:26.323630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0e3356b-024d-4616-b2ea-6cedbbb4806f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:26.324065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0e3356b-024d-4616-b2ea-6cedbbb4806f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:26.437346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b0e3356b-024d-4616-b2ea-6cedbbb4806f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:26.446243 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b0e3356b-024d-4616-b2ea-6cedbbb4806f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1323 microversion: 2.1 time: 0.149282 Oct 05 17:56:26.468680 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2489/4716] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:26 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1323 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:56:26.837517 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c20493bb-dd01-45da-bf81-90aa7804eaf3 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.513596 Oct 05 17:56:26.845946 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2228/4717] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:56:24 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:56:26.852252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e15ba61-f1ee-4a7f-b326-3a903c9a85c7 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f77740c61f0>, body: {"security_group_rule": {"parent_group_id": "48492a1b-4df3-4bfd-a6e5-10d551e1ea3c", "ip_protocol": "tempest-999-199774865", "from_port": 22, "to_port": 22}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:27.224979 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-7e15ba61-f1ee-4a7f-b326-3a903c9a85c7 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] HTTP exception thrown: Invalid IP protocol tempest-999-199774865. Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e15ba61-f1ee-4a7f-b326-3a903c9a85c7 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Request method failure captured: Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 156 Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcVB1hhhh-lm1csgio0RE-CxkNSPFK-1d0WWL3FRKGigkO3QQToWdofbhd2YEsTz5rIW1S1E8dtiatf2xcexhY_NhEphZDpon9fRRvAxqLsy-YF-FZyPx-07W-P6KDwzNsQqefmMngFbZLjsEJT98XFLbwzu06zP2TidKuagUCFqSOA Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c95ba6cb3b994980870cc5aab22cee3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}] Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 60cce5aae97440faa7279dc3855da9c1 Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: {"security_group_rule": {"parent_group_id": "48492a1b-4df3-4bfd-a6e5-10d551e1ea3c", "ip_protocol": "tempest-999-199774865", "from_port": 22, "to_port": 22}} Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: method: Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid IP protocol tempest-999-199774865. Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'security_group_rule': {'parent_group_id': '48492a1b-4df3-4bfd-a6e5-10d551e1ea3c', 'ip_protocol': 'tempest-999-199774865', 'from_port': 22, 'to_port': 22}}} Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-199774865. Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-199774865. Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:56:27.231579 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:27.237994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:56:27.237994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:27.237994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:27.237994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:27.237994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:56:27.237994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:56:27.237994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-199774865. Oct 05 17:56:27.237994 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:56:27.240858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e15ba61-f1ee-4a7f-b326-3a903c9a85c7 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Returning 400 to user: Invalid IP protocol tempest-999-199774865. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:56:27.245746 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7e15ba61-f1ee-4a7f-b326-3a903c9a85c7 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.398382 Oct 05 17:56:27.247271 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2490/4718] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:56:26 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 401 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 17:56:27.258072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c45cc8d2-193c-49d0-bb11-816495f13e2f tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f77749a2700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1731331947", "description": "tempest-description-22147209"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:27.482194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21c139d5-b96f-442f-a6d5-fb017ba4a329 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:27.483549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21c139d5-b96f-442f-a6d5-fb017ba4a329 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:27.493144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21c139d5-b96f-442f-a6d5-fb017ba4a329 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:27.493991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21c139d5-b96f-442f-a6d5-fb017ba4a329 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:27.495258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21c139d5-b96f-442f-a6d5-fb017ba4a329 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:27.496200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21c139d5-b96f-442f-a6d5-fb017ba4a329 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:27.497309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21c139d5-b96f-442f-a6d5-fb017ba4a329 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:27.498099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21c139d5-b96f-442f-a6d5-fb017ba4a329 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:27.667093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21c139d5-b96f-442f-a6d5-fb017ba4a329 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:27.678539 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21c139d5-b96f-442f-a6d5-fb017ba4a329 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1323 microversion: 2.1 time: 0.203765 Oct 05 17:56:27.682772 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2491/4719] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:27 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1323 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:56:28.709934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c95d6d7f-1fdb-4df3-8953-0f85b97a173f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:28.710752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c95d6d7f-1fdb-4df3-8953-0f85b97a173f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:28.723282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c95d6d7f-1fdb-4df3-8953-0f85b97a173f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:28.726967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c95d6d7f-1fdb-4df3-8953-0f85b97a173f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:28.727692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c95d6d7f-1fdb-4df3-8953-0f85b97a173f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:28.728644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c95d6d7f-1fdb-4df3-8953-0f85b97a173f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:28.729287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c95d6d7f-1fdb-4df3-8953-0f85b97a173f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:28.731025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c95d6d7f-1fdb-4df3-8953-0f85b97a173f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:28.940565 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c45cc8d2-193c-49d0-bb11-816495f13e2f tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.687773 Oct 05 17:56:28.942507 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2229/4720] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:56:27 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:56:28.954702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-78d038d5-e2f4-479c-89ff-8b6ba247fef2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f777434c310>, body: {"security_group_rule": {"parent_group_id": "05da9645-207d-4de5-8b6c-300d7a567ed1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:29.218774 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-78d038d5-e2f4-479c-89ff-8b6ba247fef2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-78d038d5-e2f4-479c-89ff-8b6ba247fef2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Request method failure captured: Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 138 Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcVB1hhhh-lm1csgio0RE-CxkNSPFK-1d0WWL3FRKGigkO3QQToWdofbhd2YEsTz5rIW1S1E8dtiatf2xcexhY_NhEphZDpon9fRRvAxqLsy-YF-FZyPx-07W-P6KDwzNsQqefmMngFbZLjsEJT98XFLbwzu06zP2TidKuagUCFqSOA Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c95ba6cb3b994980870cc5aab22cee3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}] Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 60cce5aae97440faa7279dc3855da9c1 Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: {"security_group_rule": {"parent_group_id": "05da9645-207d-4de5-8b6c-300d7a567ed1", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'security_group_rule': {'parent_group_id': '05da9645-207d-4de5-8b6c-300d7a567ed1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 05 17:56:29.220801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:29.226644 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:29.226644 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:29.226644 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:29.226644 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:29.226644 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:29.226644 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:56:29.226644 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:56:29.226644 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 05 17:56:29.226644 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:29.229095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-78d038d5-e2f4-479c-89ff-8b6ba247fef2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:56:29.230418 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-78d038d5-e2f4-479c-89ff-8b6ba247fef2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.279765 Oct 05 17:56:29.236397 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2230/4721] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:56:28 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 286 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 17:56:29.242244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-402afb2e-67d5-415e-82d2-258adc8aee5f tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f7774308dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-551475677", "description": "tempest-description-405394722"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:29.340543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c95d6d7f-1fdb-4df3-8953-0f85b97a173f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:29.355503 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c95d6d7f-1fdb-4df3-8953-0f85b97a173f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1323 microversion: 2.1 time: 0.649937 Oct 05 17:56:29.370952 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2492/4722] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:28 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1323 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:56:30.392827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-acff3a35-aeff-403c-84ba-93f58c92e8fa tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:30.394080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-acff3a35-aeff-403c-84ba-93f58c92e8fa tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:30.419472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acff3a35-aeff-403c-84ba-93f58c92e8fa tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:30.424305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acff3a35-aeff-403c-84ba-93f58c92e8fa tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:30.424905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acff3a35-aeff-403c-84ba-93f58c92e8fa tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:30.428667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acff3a35-aeff-403c-84ba-93f58c92e8fa tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:30.436981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acff3a35-aeff-403c-84ba-93f58c92e8fa tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:30.437782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acff3a35-aeff-403c-84ba-93f58c92e8fa tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:30.692367 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-402afb2e-67d5-415e-82d2-258adc8aee5f tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.454647 Oct 05 17:56:30.693051 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2231/4723] 10.222.0.70 () {60 vars in 1180 bytes} [Wed Oct 5 17:56:29 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:56:30.706755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca146a98-b020-4bd7-b4a7-1a2d9ba53c0e tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f77742ee9d0>, body: {"security_group_rule": {"parent_group_id": "8da2f85f-6162-4e1a-bcb0-755fe19e7bb4", "ip_protocol": "tcp", "from_port": 22, "to_port": 1617653093}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:31.038093 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-ca146a98-b020-4bd7-b4a7-1a2d9ba53c0e tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] HTTP exception thrown: Invalid port range 22:1617653093. Valid TCP ports should be between 1-65535 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca146a98-b020-4bd7-b4a7-1a2d9ba53c0e tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Request method failure captured: Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 146 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcVB1hhhh-lm1csgio0RE-CxkNSPFK-1d0WWL3FRKGigkO3QQToWdofbhd2YEsTz5rIW1S1E8dtiatf2xcexhY_NhEphZDpon9fRRvAxqLsy-YF-FZyPx-07W-P6KDwzNsQqefmMngFbZLjsEJT98XFLbwzu06zP2TidKuagUCFqSOA Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c95ba6cb3b994980870cc5aab22cee3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}] Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 60cce5aae97440faa7279dc3855da9c1 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: {"security_group_rule": {"parent_group_id": "8da2f85f-6162-4e1a-bcb0-755fe19e7bb4", "ip_protocol": "tcp", "from_port": 22, "to_port": 1617653093}} Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid port range 22:1617653093. Valid TCP ports should be between 1-65535 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8da2f85f-6162-4e1a-bcb0-755fe19e7bb4', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1617653093}}} Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1617653093. Valid TCP ports should be between 1-65535 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1617653093. Valid TCP ports should be between 1-65535 Oct 05 17:56:31.039734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1617653093. Valid TCP ports should be between 1-65535 Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca146a98-b020-4bd7-b4a7-1a2d9ba53c0e tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Returning 400 to user: Invalid port range 22:1617653093. Valid TCP ports should be between 1-65535 {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ca146a98-b020-4bd7-b4a7-1a2d9ba53c0e tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.338454 Oct 05 17:56:31.051961 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2232/4724] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:56:30 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 340 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 17:56:31.053350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-353cb016-ab1d-4c73-9004-7ceda1ae3047 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Action: 'create', calling method: .version_select at 0x7f7774a4f430>, body: {"security_group_rule": {"parent_group_id": "7458ab26-269e-4e08-b0cb-bccefe6f766a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:31.388135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-353cb016-ab1d-4c73-9004-7ceda1ae3047 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7458ab26-269e-4e08-b0cb-bccefe6f766a does not exist", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:56:31.389002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.security_group_api [None req-353cb016-ab1d-4c73-9004-7ceda1ae3047 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Neutron security group 7458ab26-269e-4e08-b0cb-bccefe6f766a not found {{(pid=128843) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 05 17:56:31.389741 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-353cb016-ab1d-4c73-9004-7ceda1ae3047 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] HTTP exception thrown: Security group 7458ab26-269e-4e08-b0cb-bccefe6f766a does not exist Oct 05 17:56:31.389741 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-0c484935-79a0-47d4-bb54-b335cdf83f87'] Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-353cb016-ab1d-4c73-9004-7ceda1ae3047 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Request method failure captured: Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 138 Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcVB1hhhh-lm1csgio0RE-CxkNSPFK-1d0WWL3FRKGigkO3QQToWdofbhd2YEsTz5rIW1S1E8dtiatf2xcexhY_NhEphZDpon9fRRvAxqLsy-YF-FZyPx-07W-P6KDwzNsQqefmMngFbZLjsEJT98XFLbwzu06zP2TidKuagUCFqSOA Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c95ba6cb3b994980870cc5aab22cee3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}] Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 60cce5aae97440faa7279dc3855da9c1 Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: {"security_group_rule": {"parent_group_id": "7458ab26-269e-4e08-b0cb-bccefe6f766a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: exception: Security group 7458ab26-269e-4e08-b0cb-bccefe6f766a does not exist Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-0c484935-79a0-47d4-bb54-b335cdf83f87'] Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'security_group_rule': {'parent_group_id': '7458ab26-269e-4e08-b0cb-bccefe6f766a', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:56:31.392963 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7458ab26-269e-4e08-b0cb-bccefe6f766a does not exist Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c484935-79a0-47d4-bb54-b335cdf83f87'] Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7458ab26-269e-4e08-b0cb-bccefe6f766a does not exist Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c484935-79a0-47d4-bb54-b335cdf83f87'] Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7458ab26-269e-4e08-b0cb-bccefe6f766a does not exist Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c484935-79a0-47d4-bb54-b335cdf83f87'] Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7458ab26-269e-4e08-b0cb-bccefe6f766a does not exist Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0c484935-79a0-47d4-bb54-b335cdf83f87'] Oct 05 17:56:31.398308 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.403701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-353cb016-ab1d-4c73-9004-7ceda1ae3047 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Returning 404 to user: Security group 7458ab26-269e-4e08-b0cb-bccefe6f766a does not exist Oct 05 17:56:31.403701 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-0c484935-79a0-47d4-bb54-b335cdf83f87'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:56:31.404883 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-353cb016-ab1d-4c73-9004-7ceda1ae3047 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.356190 Oct 05 17:56:31.406049 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2233/4725] 10.222.0.70 () {60 vars in 1195 bytes} [Wed Oct 5 17:56:31 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 358 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 17:56:31.417521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ab980d9-5f70-4c06-81a9-739e8b107cf2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Calling method '.version_select at 0x7f7775d8d040>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:31.540539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-acff3a35-aeff-403c-84ba-93f58c92e8fa tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:31.566220 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-acff3a35-aeff-403c-84ba-93f58c92e8fa tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1390 microversion: 2.1 time: 1.190553 Oct 05 17:56:31.575857 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2493/4726] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:30 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1390 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:56:31.643468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG neutronclient.v2_0.client [None req-2ab980d9-5f70-4c06-81a9-739e8b107cf2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 8d52d929-57b9-4914-b116-e3bd15f32b6a does not exist", "detail": ""}} {{(pid=128843) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 05 17:56:31.644734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.security_group_api [None req-2ab980d9-5f70-4c06-81a9-739e8b107cf2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Neutron security group rule 8d52d929-57b9-4914-b116-e3bd15f32b6a not found {{(pid=128843) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 05 17:56:31.645280 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-2ab980d9-5f70-4c06-81a9-739e8b107cf2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] HTTP exception thrown: Security group rule 8d52d929-57b9-4914-b116-e3bd15f32b6a does not exist Oct 05 17:56:31.645280 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-f7880751-6876-44e4-863f-f6c595c07ba8'] Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ab980d9-5f70-4c06-81a9-739e8b107cf2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Request method failure captured: Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/os-security-group-rules/8d52d929-57b9-4914-b116-e3bd15f32b6a HTTP/1.1 Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcVB1hhhh-lm1csgio0RE-CxkNSPFK-1d0WWL3FRKGigkO3QQToWdofbhd2YEsTz5rIW1S1E8dtiatf2xcexhY_NhEphZDpon9fRRvAxqLsy-YF-FZyPx-07W-P6KDwzNsQqefmMngFbZLjsEJT98XFLbwzu06zP2TidKuagUCFqSOA Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c95ba6cb3b994980870cc5aab22cee3a", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c95ba6cb3b994980870cc5aab22cee3a"}]}] Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: c95ba6cb3b994980870cc5aab22cee3a Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424 Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 60cce5aae97440faa7279dc3855da9c1 Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-304591424-project Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: exception: Security group rule 8d52d929-57b9-4914-b116-e3bd15f32b6a does not exist Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-f7880751-6876-44e4-863f-f6c595c07ba8'] Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '8d52d929-57b9-4914-b116-e3bd15f32b6a'} Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 05 17:56:31.647426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 8d52d929-57b9-4914-b116-e3bd15f32b6a does not exist Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7880751-6876-44e4-863f-f6c595c07ba8'] Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 8d52d929-57b9-4914-b116-e3bd15f32b6a does not exist Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7880751-6876-44e4-863f-f6c595c07ba8'] Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 8d52d929-57b9-4914-b116-e3bd15f32b6a does not exist Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7880751-6876-44e4-863f-f6c595c07ba8'] Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 8d52d929-57b9-4914-b116-e3bd15f32b6a does not exist Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f7880751-6876-44e4-863f-f6c595c07ba8'] Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ab980d9-5f70-4c06-81a9-739e8b107cf2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Returning 404 to user: Security group rule 8d52d929-57b9-4914-b116-e3bd15f32b6a does not exist Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: Neutron server returns request_ids: ['req-f7880751-6876-44e4-863f-f6c595c07ba8'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2ab980d9-5f70-4c06-81a9-739e8b107cf2 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-group-rules/8d52d929-57b9-4914-b116-e3bd15f32b6a" status: 404 len: 199 microversion: 2.1 time: 0.237734 Oct 05 17:56:31.661458 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2234/4727] 10.222.0.70 () {58 vars in 1287 bytes} [Wed Oct 5 17:56:31 2022] DELETE /compute/v2.1/os-security-group-rules/8d52d929-57b9-4914-b116-e3bd15f32b6a => generated 199 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:56:31.664684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5831afb8-e030-4465-8358-933be785deea tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Calling method '.version_select at 0x7f777410d700>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:32.354659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:56:32.601256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5a90ad6-fb1b-45c2-bdbd-2357617bc6ef tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:32.603277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5a90ad6-fb1b-45c2-bdbd-2357617bc6ef tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:32.621119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a90ad6-fb1b-45c2-bdbd-2357617bc6ef tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:32.626380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a90ad6-fb1b-45c2-bdbd-2357617bc6ef tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:32.627043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a90ad6-fb1b-45c2-bdbd-2357617bc6ef tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:32.629109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a90ad6-fb1b-45c2-bdbd-2357617bc6ef tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:32.631706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a90ad6-fb1b-45c2-bdbd-2357617bc6ef tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:32.632964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a90ad6-fb1b-45c2-bdbd-2357617bc6ef tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:33.572408 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5831afb8-e030-4465-8358-933be785deea tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/8da2f85f-6162-4e1a-bcb0-755fe19e7bb4" status: 202 len: 0 microversion: 2.1 time: 1.917223 Oct 05 17:56:33.573621 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2494/4728] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:56:31 2022] DELETE /compute/v2.1/os-security-groups/8da2f85f-6162-4e1a-bcb0-755fe19e7bb4 => generated 0 bytes in 1919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:56:33.582650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-2d135d08-2b5d-4b14-b2c4-814209ac551d req-7b03dd76-691d-46c2-bcbd-9f433c0042ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:33.611416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2d135d08-2b5d-4b14-b2c4-814209ac551d req-7b03dd76-691d-46c2-bcbd-9f433c0042ba service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:33.621458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2d135d08-2b5d-4b14-b2c4-814209ac551d req-7b03dd76-691d-46c2-bcbd-9f433c0042ba service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:33.629358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2d135d08-2b5d-4b14-b2c4-814209ac551d req-7b03dd76-691d-46c2-bcbd-9f433c0042ba service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:33.662731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c5a90ad6-fb1b-45c2-bdbd-2357617bc6ef tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:33.675475 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c5a90ad6-fb1b-45c2-bdbd-2357617bc6ef tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1390 microversion: 2.1 time: 1.079493 Oct 05 17:56:33.675809 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2235/4729] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:32 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1390 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:56:33.676968 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-2d135d08-2b5d-4b14-b2c4-814209ac551d req-7b03dd76-691d-46c2-bcbd-9f433c0042ba service nova] Creating event network-changed:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h1-835595-3 Oct 05 17:56:33.688384 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-2d135d08-2b5d-4b14-b2c4-814209ac551d req-7b03dd76-691d-46c2-bcbd-9f433c0042ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111492 Oct 05 17:56:33.692331 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2495/4730] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:56:33.696063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d25c467-3f8b-4819-8281-598667a4a23d tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Calling method '.version_select at 0x7f7774a54b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:34.543733 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4d25c467-3f8b-4819-8281-598667a4a23d tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/05da9645-207d-4de5-8b6c-300d7a567ed1" status: 202 len: 0 microversion: 2.1 time: 0.857673 Oct 05 17:56:34.544391 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2236/4731] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:56:33 2022] DELETE /compute/v2.1/os-security-groups/05da9645-207d-4de5-8b6c-300d7a567ed1 => generated 0 bytes in 868 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:56:34.553789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c5a1b31b-1483-43c9-aa09-cedd02a3fa4b tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Calling method '.version_select at 0x7f7774d78a60>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:34.560252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:56:34.702120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aad977e0-38dc-4dad-8546-e8ee10c54984 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:34.703162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aad977e0-38dc-4dad-8546-e8ee10c54984 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:34.713200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad977e0-38dc-4dad-8546-e8ee10c54984 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:34.713691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad977e0-38dc-4dad-8546-e8ee10c54984 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:34.714126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad977e0-38dc-4dad-8546-e8ee10c54984 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:34.719416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad977e0-38dc-4dad-8546-e8ee10c54984 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:34.719959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad977e0-38dc-4dad-8546-e8ee10c54984 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:34.720669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad977e0-38dc-4dad-8546-e8ee10c54984 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:35.012246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aad977e0-38dc-4dad-8546-e8ee10c54984 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:35.022555 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aad977e0-38dc-4dad-8546-e8ee10c54984 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1390 microversion: 2.1 time: 0.324718 Oct 05 17:56:35.024849 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2237/4732] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:34 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1390 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:56:36.045507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51e2b0f3-7a2c-4738-a419-837cbd8ce371 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:36.047244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51e2b0f3-7a2c-4738-a419-837cbd8ce371 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:36.080738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51e2b0f3-7a2c-4738-a419-837cbd8ce371 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:36.083770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51e2b0f3-7a2c-4738-a419-837cbd8ce371 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:36.085796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51e2b0f3-7a2c-4738-a419-837cbd8ce371 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:36.089655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51e2b0f3-7a2c-4738-a419-837cbd8ce371 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:36.090558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51e2b0f3-7a2c-4738-a419-837cbd8ce371 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:36.091229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51e2b0f3-7a2c-4738-a419-837cbd8ce371 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:36.695332 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c5a1b31b-1483-43c9-aa09-cedd02a3fa4b tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/48492a1b-4df3-4bfd-a6e5-10d551e1ea3c" status: 202 len: 0 microversion: 2.1 time: 2.146412 Oct 05 17:56:36.699435 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2496/4733] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:56:34 2022] DELETE /compute/v2.1/os-security-groups/48492a1b-4df3-4bfd-a6e5-10d551e1ea3c => generated 0 bytes in 2151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:56:36.704950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4db5f295-96d4-40dd-8417-6f59b1b982eb tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Calling method '.version_select at 0x7f777410d0d0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:36.920607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-51e2b0f3-7a2c-4738-a419-837cbd8ce371 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:36.980931 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51e2b0f3-7a2c-4738-a419-837cbd8ce371 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1390 microversion: 2.1 time: 0.934764 Oct 05 17:56:36.986327 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2238/4734] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:36 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1390 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:56:37.841758 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4db5f295-96d4-40dd-8417-6f59b1b982eb tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/67c2ddac-edf8-41a2-b4cb-8da4c55f4014" status: 202 len: 0 microversion: 2.1 time: 1.140327 Oct 05 17:56:37.847246 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2497/4735] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:56:36 2022] DELETE /compute/v2.1/os-security-groups/67c2ddac-edf8-41a2-b4cb-8da4c55f4014 => generated 0 bytes in 1147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:56:37.852982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-515a6dc7-8022-4e1b-a1c2-6da36c90f676 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] Calling method '.version_select at 0x7f7774a4f0d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:38.006804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-85b935ab-b927-4ac0-a7f3-8d3b808300fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:38.008393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-85b935ab-b927-4ac0-a7f3-8d3b808300fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:38.027670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85b935ab-b927-4ac0-a7f3-8d3b808300fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:38.028600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85b935ab-b927-4ac0-a7f3-8d3b808300fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:38.034483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85b935ab-b927-4ac0-a7f3-8d3b808300fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:38.035751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85b935ab-b927-4ac0-a7f3-8d3b808300fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:38.037143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85b935ab-b927-4ac0-a7f3-8d3b808300fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:38.038011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-85b935ab-b927-4ac0-a7f3-8d3b808300fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:38.524555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-85b935ab-b927-4ac0-a7f3-8d3b808300fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:38.537501 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-85b935ab-b927-4ac0-a7f3-8d3b808300fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1390 microversion: 2.1 time: 0.536614 Oct 05 17:56:38.554323 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2498/4736] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:37 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1390 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:56:39.504984 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-515a6dc7-8022-4e1b-a1c2-6da36c90f676 tempest-SecurityGroupRulesNegativeTestJSON-304591424 tempest-SecurityGroupRulesNegativeTestJSON-304591424-project] 10.222.0.70 "DELETE /compute/v2.1/os-security-groups/6dbdd716-e55a-4019-beae-cdd8e4cff17e" status: 202 len: 0 microversion: 2.1 time: 1.657323 Oct 05 17:56:39.505696 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2239/4737] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 17:56:37 2022] DELETE /compute/v2.1/os-security-groups/6dbdd716-e55a-4019-beae-cdd8e4cff17e => generated 0 bytes in 1659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 17:56:39.567683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-177d601a-4717-472a-8044-00309007b389 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:39.568937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-177d601a-4717-472a-8044-00309007b389 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:39.582914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-177d601a-4717-472a-8044-00309007b389 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:39.584910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-177d601a-4717-472a-8044-00309007b389 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:39.587334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-177d601a-4717-472a-8044-00309007b389 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:39.588993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-177d601a-4717-472a-8044-00309007b389 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:39.590976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-177d601a-4717-472a-8044-00309007b389 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:39.594422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-177d601a-4717-472a-8044-00309007b389 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:39.981563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-177d601a-4717-472a-8044-00309007b389 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:39.993817 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-177d601a-4717-472a-8044-00309007b389 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1390 microversion: 2.1 time: 0.428759 Oct 05 17:56:39.996382 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2499/4738] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:39 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1390 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:56:41.029738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52d1c311-0cd7-40da-80c1-9c1c23b6273e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:41.031348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-52d1c311-0cd7-40da-80c1-9c1c23b6273e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:41.083858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d1c311-0cd7-40da-80c1-9c1c23b6273e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:41.085508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d1c311-0cd7-40da-80c1-9c1c23b6273e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:41.086180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d1c311-0cd7-40da-80c1-9c1c23b6273e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:41.087637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d1c311-0cd7-40da-80c1-9c1c23b6273e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:41.088801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d1c311-0cd7-40da-80c1-9c1c23b6273e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:41.089510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52d1c311-0cd7-40da-80c1-9c1c23b6273e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:42.452553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3c17ff4b-f13e-427e-aab2-620c95cd4cd6 req-eacd80f0-c582-45f4-8c19-92768d582f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "name": "network-vif-plugged", "status": "completed", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:42.472925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3c17ff4b-f13e-427e-aab2-620c95cd4cd6 req-eacd80f0-c582-45f4-8c19-92768d582f11 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:42.473493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3c17ff4b-f13e-427e-aab2-620c95cd4cd6 req-eacd80f0-c582-45f4-8c19-92768d582f11 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:42.473940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3c17ff4b-f13e-427e-aab2-620c95cd4cd6 req-eacd80f0-c582-45f4-8c19-92768d582f11 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:42.492741 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3c17ff4b-f13e-427e-aab2-620c95cd4cd6 req-eacd80f0-c582-45f4-8c19-92768d582f11 service nova] Creating event network-vif-plugged:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h1-835595-3 Oct 05 17:56:42.506752 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3c17ff4b-f13e-427e-aab2-620c95cd4cd6 req-eacd80f0-c582-45f4-8c19-92768d582f11 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068367 Oct 05 17:56:42.508512 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2500/4739] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:56:42.695923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-52d1c311-0cd7-40da-80c1-9c1c23b6273e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:42.741199 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-52d1c311-0cd7-40da-80c1-9c1c23b6273e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1390 microversion: 2.1 time: 1.722155 Oct 05 17:56:42.745465 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2240/4740] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:41 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1390 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:56:43.769277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac265c69-1647-45d9-b498-692e3b6075f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:43.770054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac265c69-1647-45d9-b498-692e3b6075f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:43.784509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac265c69-1647-45d9-b498-692e3b6075f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:43.785016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac265c69-1647-45d9-b498-692e3b6075f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:43.788707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac265c69-1647-45d9-b498-692e3b6075f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:43.791345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac265c69-1647-45d9-b498-692e3b6075f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:43.795490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac265c69-1647-45d9-b498-692e3b6075f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:43.796692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac265c69-1647-45d9-b498-692e3b6075f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:44.711810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ac265c69-1647-45d9-b498-692e3b6075f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:44.722379 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac265c69-1647-45d9-b498-692e3b6075f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1390 microversion: 2.1 time: 0.958129 Oct 05 17:56:44.726594 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2501/4741] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:43 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1390 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:56:45.756703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4ebf5aec-2da3-4540-8b11-aac3055c0f7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:45.757889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4ebf5aec-2da3-4540-8b11-aac3055c0f7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:45.769552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ebf5aec-2da3-4540-8b11-aac3055c0f7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:45.772972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ebf5aec-2da3-4540-8b11-aac3055c0f7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:45.779643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ebf5aec-2da3-4540-8b11-aac3055c0f7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:45.783148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ebf5aec-2da3-4540-8b11-aac3055c0f7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:45.783760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ebf5aec-2da3-4540-8b11-aac3055c0f7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:45.784313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ebf5aec-2da3-4540-8b11-aac3055c0f7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:47.180217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4ebf5aec-2da3-4540-8b11-aac3055c0f7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:47.193889 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4ebf5aec-2da3-4540-8b11-aac3055c0f7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1561 microversion: 2.1 time: 1.438828 Oct 05 17:56:47.210452 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2241/4742] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:45 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1561 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:56:47.224363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b5e0837-201f-4dab-adcb-6fc9512d7cfe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:47.225079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b5e0837-201f-4dab-adcb-6fc9512d7cfe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:47.247498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b5e0837-201f-4dab-adcb-6fc9512d7cfe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:47.248101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b5e0837-201f-4dab-adcb-6fc9512d7cfe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:47.254371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b5e0837-201f-4dab-adcb-6fc9512d7cfe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:47.255215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b5e0837-201f-4dab-adcb-6fc9512d7cfe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:47.255717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b5e0837-201f-4dab-adcb-6fc9512d7cfe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:47.256164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b5e0837-201f-4dab-adcb-6fc9512d7cfe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:47.855073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b5e0837-201f-4dab-adcb-6fc9512d7cfe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:47.866955 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b5e0837-201f-4dab-adcb-6fc9512d7cfe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1561 microversion: 2.1 time: 0.645424 Oct 05 17:56:47.869104 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2502/4743] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:47 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1561 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:56:56.928719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4b934f0-301a-41d0-b121-139d48609039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:56:56.928719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4b934f0-301a-41d0-b121-139d48609039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:56:56.933715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:56:56.940356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b934f0-301a-41d0-b121-139d48609039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:56.940863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b934f0-301a-41d0-b121-139d48609039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:56.941306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b934f0-301a-41d0-b121-139d48609039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:56.942022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b934f0-301a-41d0-b121-139d48609039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:56.942616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b934f0-301a-41d0-b121-139d48609039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:56.942914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b934f0-301a-41d0-b121-139d48609039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:56.968753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5f912925-0971-43db-8eeb-36c37e286cbe req-0e0f2474-d2ca-46f5-8997-8409302ed9d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:56:56.983665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:56:57.012679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5f912925-0971-43db-8eeb-36c37e286cbe req-0e0f2474-d2ca-46f5-8997-8409302ed9d2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:56:57.013195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5f912925-0971-43db-8eeb-36c37e286cbe req-0e0f2474-d2ca-46f5-8997-8409302ed9d2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:56:57.013776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5f912925-0971-43db-8eeb-36c37e286cbe req-0e0f2474-d2ca-46f5-8997-8409302ed9d2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:56:57.076837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=61 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:56:57.112590 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5f912925-0971-43db-8eeb-36c37e286cbe req-0e0f2474-d2ca-46f5-8997-8409302ed9d2 service nova] Creating event network-changed:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h1-835595-3 Oct 05 17:56:57.119710 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5f912925-0971-43db-8eeb-36c37e286cbe req-0e0f2474-d2ca-46f5-8997-8409302ed9d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156269 Oct 05 17:56:57.121414 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2503/4744] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:56:58.751905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c4b934f0-301a-41d0-b121-139d48609039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:56:58.762801 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4b934f0-301a-41d0-b121-139d48609039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1561 microversion: 2.1 time: 1.841364 Oct 05 17:56:58.776237 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2242/4745] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:56:56 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1561 bytes in 1857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:10.225248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d34f17bb-b5a4-4720-b507-ea2393caa4b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:57:10.227637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d34f17bb-b5a4-4720-b507-ea2393caa4b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:10.245062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:57:10.253563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d34f17bb-b5a4-4720-b507-ea2393caa4b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:10.254087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d34f17bb-b5a4-4720-b507-ea2393caa4b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:10.261014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d34f17bb-b5a4-4720-b507-ea2393caa4b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:10.261951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d34f17bb-b5a4-4720-b507-ea2393caa4b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:10.262699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d34f17bb-b5a4-4720-b507-ea2393caa4b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:10.263159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d34f17bb-b5a4-4720-b507-ea2393caa4b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:10.433380 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d34f17bb-b5a4-4720-b507-ea2393caa4b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044/action" status: 200 len: 24569 microversion: 2.1 time: 0.210163 Oct 05 17:57:10.433627 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2504/4746] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:57:10 2022] POST /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044/action => generated 24569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:57:18.297603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:57:18.298512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=36 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:57:18.550328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-74230fc3-9b12-4551-b391-2e32dd18ea66 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Action: 'create', calling method: .version_select at 0x7f7774341c10>, body: {"keypair": {"name": "tempest-keypair-1170756101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVYf8mc8r0GEhTCQ8zHduf8zxTjIF8SvFu62E8LiXW6hmRvFa31183UfHduTx/RGwtuoZUd6/P6ar9GMSqpNI1a64JnqWC4ZIdjIDzoG4XAPKI3KcrUIgetT+tFYIgeBA=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:57:18.580321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-74230fc3-9b12-4551-b391-2e32dd18ea66 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Getting quotas for project 537bc13f867c45bba57e4215209ff2a9. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:57:18.596155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-74230fc3-9b12-4551-b391-2e32dd18ea66 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Getting quotas for user 70e2714f5b5442498655de65ce5de666 and project 537bc13f867c45bba57e4215209ff2a9. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:57:18.652298 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-74230fc3-9b12-4551-b391-2e32dd18ea66 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.360108 Oct 05 17:57:18.654338 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2243/4747] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:57:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:57:21.537977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a5632c0-94b1-43ab-a3f8-e1341ad577b7 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:21.539411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3a5632c0-94b1-43ab-a3f8-e1341ad577b7 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:21.545142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:57:21.546788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:57:21.560409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5632c0-94b1-43ab-a3f8-e1341ad577b7 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:21.562520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5632c0-94b1-43ab-a3f8-e1341ad577b7 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:21.563662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5632c0-94b1-43ab-a3f8-e1341ad577b7 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:21.567083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5632c0-94b1-43ab-a3f8-e1341ad577b7 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:21.570064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5632c0-94b1-43ab-a3f8-e1341ad577b7 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:21.570784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a5632c0-94b1-43ab-a3f8-e1341ad577b7 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:22.744625 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a5632c0-94b1-43ab-a3f8-e1341ad577b7 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1831 microversion: 2.1 time: 1.213940 Oct 05 17:57:22.750668 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2505/4748] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:21 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1831 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:22.773021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-68e0d6f3-1282-4659-8c9a-986b1debe37c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:22.773638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-68e0d6f3-1282-4659-8c9a-986b1debe37c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:22.802641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e0d6f3-1282-4659-8c9a-986b1debe37c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:22.803345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e0d6f3-1282-4659-8c9a-986b1debe37c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:22.806797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e0d6f3-1282-4659-8c9a-986b1debe37c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:22.811073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e0d6f3-1282-4659-8c9a-986b1debe37c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:22.819501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e0d6f3-1282-4659-8c9a-986b1debe37c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:22.821710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e0d6f3-1282-4659-8c9a-986b1debe37c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:24.367080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-68e0d6f3-1282-4659-8c9a-986b1debe37c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:24.389860 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-68e0d6f3-1282-4659-8c9a-986b1debe37c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1680 microversion: 2.1 time: 1.622295 Oct 05 17:57:24.394189 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2244/4749] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:22 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1680 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:24.628575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4b8d9669-6437-4bff-ab5b-ec0c4d61e20b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:57:24.632571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4b8d9669-6437-4bff-ab5b-ec0c4d61e20b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:24.645431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b8d9669-6437-4bff-ab5b-ec0c4d61e20b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:24.648481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b8d9669-6437-4bff-ab5b-ec0c4d61e20b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:24.649185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b8d9669-6437-4bff-ab5b-ec0c4d61e20b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:24.651938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b8d9669-6437-4bff-ab5b-ec0c4d61e20b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:24.654712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b8d9669-6437-4bff-ab5b-ec0c4d61e20b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:24.655375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b8d9669-6437-4bff-ab5b-ec0c4d61e20b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:24.752327 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4b8d9669-6437-4bff-ab5b-ec0c4d61e20b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044/action" status: 200 len: 32646 microversion: 2.1 time: 0.127896 Oct 05 17:57:24.754024 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2506/4750] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:57:24 2022] POST /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044/action => generated 32646 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:57:24.899223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:57:24.900737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:24.929018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:24.931855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:24.934050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:24.935112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:24.936955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:24.938260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:25.088746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '282f8307511c4d20abe7f4eab19c7d36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096b4b9aecbd42f086e1c8427a4ef118', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:25.089655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] flavor_id is None. Assuming migration. {{(pid=128843) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 05 17:57:25.090368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128843) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 17:57:25.559746 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9355dfa4-d943-48fd-8841-09810dc4b144 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044/action" status: 202 len: 0 microversion: 2.1 time: 0.665514 Oct 05 17:57:25.562615 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2245/4751] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:57:24 2022] POST /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:57:25.569880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9b49b1e4-391f-406c-8dbd-88794db6d184 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:25.570646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9b49b1e4-391f-406c-8dbd-88794db6d184 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:25.590032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b49b1e4-391f-406c-8dbd-88794db6d184 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:25.590562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b49b1e4-391f-406c-8dbd-88794db6d184 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:25.591004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b49b1e4-391f-406c-8dbd-88794db6d184 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:25.591724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b49b1e4-391f-406c-8dbd-88794db6d184 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:25.592180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b49b1e4-391f-406c-8dbd-88794db6d184 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:25.592609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b49b1e4-391f-406c-8dbd-88794db6d184 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:27.498016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9b49b1e4-391f-406c-8dbd-88794db6d184 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:27.512264 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9b49b1e4-391f-406c-8dbd-88794db6d184 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1689 microversion: 2.1 time: 1.947219 Oct 05 17:57:27.527268 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2507/4752] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:25 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1689 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:28.536959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9aa6f04-0180-4be1-b6c8-8a09b7ab1def tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:28.537727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a9aa6f04-0180-4be1-b6c8-8a09b7ab1def tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:28.550271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9aa6f04-0180-4be1-b6c8-8a09b7ab1def tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:28.565370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9aa6f04-0180-4be1-b6c8-8a09b7ab1def tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:28.566217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9aa6f04-0180-4be1-b6c8-8a09b7ab1def tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:28.567037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9aa6f04-0180-4be1-b6c8-8a09b7ab1def tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:28.567531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9aa6f04-0180-4be1-b6c8-8a09b7ab1def tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:28.581310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9aa6f04-0180-4be1-b6c8-8a09b7ab1def tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:28.661661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:57:29.892815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a9aa6f04-0180-4be1-b6c8-8a09b7ab1def tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:29.905229 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a9aa6f04-0180-4be1-b6c8-8a09b7ab1def tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1689 microversion: 2.1 time: 1.372370 Oct 05 17:57:29.908036 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2246/4753] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:28 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1689 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:30.933758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-abf1c4ab-ac48-43f4-b2fd-b09858670919 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:30.934571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-abf1c4ab-ac48-43f4-b2fd-b09858670919 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:30.951365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abf1c4ab-ac48-43f4-b2fd-b09858670919 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:30.951733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abf1c4ab-ac48-43f4-b2fd-b09858670919 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:30.960724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abf1c4ab-ac48-43f4-b2fd-b09858670919 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:30.961693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abf1c4ab-ac48-43f4-b2fd-b09858670919 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:30.965267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abf1c4ab-ac48-43f4-b2fd-b09858670919 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:30.965814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abf1c4ab-ac48-43f4-b2fd-b09858670919 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:32.005751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-abf1c4ab-ac48-43f4-b2fd-b09858670919 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:32.014760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-abf1c4ab-ac48-43f4-b2fd-b09858670919 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1689 microversion: 2.1 time: 1.085072 Oct 05 17:57:32.015359 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2508/4754] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:30 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1689 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:33.058191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e28c3de-7401-4351-9dfe-2e250161399e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:33.078885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e28c3de-7401-4351-9dfe-2e250161399e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:33.114019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e28c3de-7401-4351-9dfe-2e250161399e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:33.114852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e28c3de-7401-4351-9dfe-2e250161399e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:33.117083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e28c3de-7401-4351-9dfe-2e250161399e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:33.120008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e28c3de-7401-4351-9dfe-2e250161399e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:33.123329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e28c3de-7401-4351-9dfe-2e250161399e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:33.124306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e28c3de-7401-4351-9dfe-2e250161399e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:34.597729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2e28c3de-7401-4351-9dfe-2e250161399e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:34.630608 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e28c3de-7401-4351-9dfe-2e250161399e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1689 microversion: 2.1 time: 1.589050 Oct 05 17:57:34.634736 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2247/4755] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:33 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1689 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:35.659315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-97a7e0e5-c476-4376-b6be-65fefb688054 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:35.659936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-97a7e0e5-c476-4376-b6be-65fefb688054 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:35.675047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97a7e0e5-c476-4376-b6be-65fefb688054 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:35.675555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97a7e0e5-c476-4376-b6be-65fefb688054 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:35.676001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97a7e0e5-c476-4376-b6be-65fefb688054 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:35.676727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97a7e0e5-c476-4376-b6be-65fefb688054 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:35.680959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97a7e0e5-c476-4376-b6be-65fefb688054 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:35.692632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97a7e0e5-c476-4376-b6be-65fefb688054 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:36.210732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-97a7e0e5-c476-4376-b6be-65fefb688054 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:36.221143 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-97a7e0e5-c476-4376-b6be-65fefb688054 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1694 microversion: 2.1 time: 0.565948 Oct 05 17:57:36.224355 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2509/4756] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:35 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1694 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:37.252007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2afed876-b357-489e-b66f-b9b7dd6cfe47 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:37.253374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2afed876-b357-489e-b66f-b9b7dd6cfe47 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:37.266498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afed876-b357-489e-b66f-b9b7dd6cfe47 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:37.272339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afed876-b357-489e-b66f-b9b7dd6cfe47 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:37.276475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afed876-b357-489e-b66f-b9b7dd6cfe47 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:37.280665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afed876-b357-489e-b66f-b9b7dd6cfe47 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:37.283557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afed876-b357-489e-b66f-b9b7dd6cfe47 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:37.284838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2afed876-b357-489e-b66f-b9b7dd6cfe47 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:37.793972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2afed876-b357-489e-b66f-b9b7dd6cfe47 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:37.805771 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2afed876-b357-489e-b66f-b9b7dd6cfe47 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1694 microversion: 2.1 time: 0.557792 Oct 05 17:57:37.816402 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2248/4757] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:37 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1694 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:38.834132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e6937ca5-ab8a-4128-b0ff-2ba7016629f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:38.835427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e6937ca5-ab8a-4128-b0ff-2ba7016629f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:38.851582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6937ca5-ab8a-4128-b0ff-2ba7016629f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:38.852399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6937ca5-ab8a-4128-b0ff-2ba7016629f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:38.853096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6937ca5-ab8a-4128-b0ff-2ba7016629f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:38.854233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6937ca5-ab8a-4128-b0ff-2ba7016629f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:38.855023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6937ca5-ab8a-4128-b0ff-2ba7016629f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:38.855772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6937ca5-ab8a-4128-b0ff-2ba7016629f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:39.611092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e6937ca5-ab8a-4128-b0ff-2ba7016629f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:39.627796 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e6937ca5-ab8a-4128-b0ff-2ba7016629f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1694 microversion: 2.1 time: 0.798675 Oct 05 17:57:39.628424 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2510/4758] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:38 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1694 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:40.650887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b96e4843-7ed6-4fbb-ab4c-de65741d28e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:40.652148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b96e4843-7ed6-4fbb-ab4c-de65741d28e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:40.672632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b96e4843-7ed6-4fbb-ab4c-de65741d28e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:40.673369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b96e4843-7ed6-4fbb-ab4c-de65741d28e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:40.674736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b96e4843-7ed6-4fbb-ab4c-de65741d28e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:40.675773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b96e4843-7ed6-4fbb-ab4c-de65741d28e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:40.676421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b96e4843-7ed6-4fbb-ab4c-de65741d28e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:40.677084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b96e4843-7ed6-4fbb-ab4c-de65741d28e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:41.340570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b96e4843-7ed6-4fbb-ab4c-de65741d28e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:41.349732 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b96e4843-7ed6-4fbb-ab4c-de65741d28e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1694 microversion: 2.1 time: 0.702590 Oct 05 17:57:41.367009 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2249/4759] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:40 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1694 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:42.380487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4379ae6c-4fa1-4e3a-a536-01d9fac8dc87 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:42.381115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4379ae6c-4fa1-4e3a-a536-01d9fac8dc87 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:42.392136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4379ae6c-4fa1-4e3a-a536-01d9fac8dc87 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:42.392643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4379ae6c-4fa1-4e3a-a536-01d9fac8dc87 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:42.393093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4379ae6c-4fa1-4e3a-a536-01d9fac8dc87 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:42.393812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4379ae6c-4fa1-4e3a-a536-01d9fac8dc87 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:42.394312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4379ae6c-4fa1-4e3a-a536-01d9fac8dc87 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:42.402072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4379ae6c-4fa1-4e3a-a536-01d9fac8dc87 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:43.287543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4379ae6c-4fa1-4e3a-a536-01d9fac8dc87 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:43.308481 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4379ae6c-4fa1-4e3a-a536-01d9fac8dc87 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1694 microversion: 2.1 time: 0.929480 Oct 05 17:57:43.325543 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2511/4760] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:42 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1694 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:44.341442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ee61cb12-d6ca-4ad3-b8f3-cf6acc5db6f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:44.343039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ee61cb12-d6ca-4ad3-b8f3-cf6acc5db6f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:44.358152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee61cb12-d6ca-4ad3-b8f3-cf6acc5db6f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:44.363354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee61cb12-d6ca-4ad3-b8f3-cf6acc5db6f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:44.366712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee61cb12-d6ca-4ad3-b8f3-cf6acc5db6f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:44.369270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee61cb12-d6ca-4ad3-b8f3-cf6acc5db6f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:44.372165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee61cb12-d6ca-4ad3-b8f3-cf6acc5db6f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:44.375478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee61cb12-d6ca-4ad3-b8f3-cf6acc5db6f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:46.203007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ee61cb12-d6ca-4ad3-b8f3-cf6acc5db6f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:46.221791 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ee61cb12-d6ca-4ad3-b8f3-cf6acc5db6f1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1694 microversion: 2.1 time: 1.885865 Oct 05 17:57:46.223047 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2250/4761] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:44 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1694 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:47.249301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92e546c8-6bc3-4175-9d4b-0e1e1f65bb29 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:47.249930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92e546c8-6bc3-4175-9d4b-0e1e1f65bb29 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:47.270508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92e546c8-6bc3-4175-9d4b-0e1e1f65bb29 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:47.271014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92e546c8-6bc3-4175-9d4b-0e1e1f65bb29 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:47.271508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92e546c8-6bc3-4175-9d4b-0e1e1f65bb29 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:47.273557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92e546c8-6bc3-4175-9d4b-0e1e1f65bb29 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:47.274249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92e546c8-6bc3-4175-9d4b-0e1e1f65bb29 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:47.274946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92e546c8-6bc3-4175-9d4b-0e1e1f65bb29 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:47.720685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92e546c8-6bc3-4175-9d4b-0e1e1f65bb29 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:47.732915 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92e546c8-6bc3-4175-9d4b-0e1e1f65bb29 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1694 microversion: 2.1 time: 0.488245 Oct 05 17:57:47.738540 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2512/4762] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:47 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1694 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:48.761015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de631fc2-13e5-45d6-a9f0-3ace590160f7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:48.761642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-de631fc2-13e5-45d6-a9f0-3ace590160f7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:48.765819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:57:48.778652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de631fc2-13e5-45d6-a9f0-3ace590160f7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:48.780128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de631fc2-13e5-45d6-a9f0-3ace590160f7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:48.781343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de631fc2-13e5-45d6-a9f0-3ace590160f7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:48.784744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de631fc2-13e5-45d6-a9f0-3ace590160f7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:48.785728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de631fc2-13e5-45d6-a9f0-3ace590160f7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:48.787139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de631fc2-13e5-45d6-a9f0-3ace590160f7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:48.810678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:57:49.557453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-de631fc2-13e5-45d6-a9f0-3ace590160f7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:49.573822 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de631fc2-13e5-45d6-a9f0-3ace590160f7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1694 microversion: 2.1 time: 0.815126 Oct 05 17:57:49.577243 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2251/4763] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:48 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1694 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:50.604584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2e652457-7ef0-4509-b6fd-d12009ca61b4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:50.605262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2e652457-7ef0-4509-b6fd-d12009ca61b4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:50.616799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e652457-7ef0-4509-b6fd-d12009ca61b4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:50.617627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e652457-7ef0-4509-b6fd-d12009ca61b4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:50.618229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e652457-7ef0-4509-b6fd-d12009ca61b4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:50.620306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e652457-7ef0-4509-b6fd-d12009ca61b4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:50.621479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e652457-7ef0-4509-b6fd-d12009ca61b4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:50.623175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e652457-7ef0-4509-b6fd-d12009ca61b4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:51.005674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2e652457-7ef0-4509-b6fd-d12009ca61b4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:51.016938 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2e652457-7ef0-4509-b6fd-d12009ca61b4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1694 microversion: 2.1 time: 0.416378 Oct 05 17:57:51.019175 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2513/4764] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:50 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1694 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:52.045608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0835dccf-df17-4b53-ab97-b082fdd6095a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:52.046209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0835dccf-df17-4b53-ab97-b082fdd6095a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:52.060720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0835dccf-df17-4b53-ab97-b082fdd6095a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:52.061460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0835dccf-df17-4b53-ab97-b082fdd6095a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:52.062059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0835dccf-df17-4b53-ab97-b082fdd6095a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:52.065233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0835dccf-df17-4b53-ab97-b082fdd6095a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:52.065862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0835dccf-df17-4b53-ab97-b082fdd6095a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:52.066497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0835dccf-df17-4b53-ab97-b082fdd6095a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:53.366389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0835dccf-df17-4b53-ab97-b082fdd6095a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:53.375765 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0835dccf-df17-4b53-ab97-b082fdd6095a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1694 microversion: 2.1 time: 1.334207 Oct 05 17:57:53.390378 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2252/4765] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:52 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1694 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:54.420197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-896d388a-4927-4112-aef0-e3f938ef092b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:54.421652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-896d388a-4927-4112-aef0-e3f938ef092b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:54.434025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=19 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:57:54.441582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-896d388a-4927-4112-aef0-e3f938ef092b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:54.443661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-896d388a-4927-4112-aef0-e3f938ef092b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:54.444746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-896d388a-4927-4112-aef0-e3f938ef092b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:54.446156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-896d388a-4927-4112-aef0-e3f938ef092b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:54.448930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-896d388a-4927-4112-aef0-e3f938ef092b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:54.452595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-896d388a-4927-4112-aef0-e3f938ef092b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:54.461799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=53 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:57:55.096497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-896d388a-4927-4112-aef0-e3f938ef092b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:55.141129 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-896d388a-4927-4112-aef0-e3f938ef092b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1693 microversion: 2.1 time: 0.737999 Oct 05 17:57:55.145123 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2514/4766] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:54 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1693 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:56.166111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b3641d1e-b6f5-4464-b7fa-34997981717b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:56.167780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3641d1e-b6f5-4464-b7fa-34997981717b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:56.182188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3641d1e-b6f5-4464-b7fa-34997981717b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:56.183277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3641d1e-b6f5-4464-b7fa-34997981717b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:56.185361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3641d1e-b6f5-4464-b7fa-34997981717b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:56.186327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3641d1e-b6f5-4464-b7fa-34997981717b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:56.187925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3641d1e-b6f5-4464-b7fa-34997981717b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:56.192810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3641d1e-b6f5-4464-b7fa-34997981717b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:57.669135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-98d2019d-afe2-46cb-80af-78782b2198cc req-46f4311d-7f46-4972-b77a-071a0ab3bc0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "name": "network-vif-unplugged", "status": "completed", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:57:57.682375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-98d2019d-afe2-46cb-80af-78782b2198cc req-46f4311d-7f46-4972-b77a-071a0ab3bc0a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:57.694807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-98d2019d-afe2-46cb-80af-78782b2198cc req-46f4311d-7f46-4972-b77a-071a0ab3bc0a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:57.695597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-98d2019d-afe2-46cb-80af-78782b2198cc req-46f4311d-7f46-4972-b77a-071a0ab3bc0a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:57.723603 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-98d2019d-afe2-46cb-80af-78782b2198cc req-46f4311d-7f46-4972-b77a-071a0ab3bc0a service nova] Creating event network-vif-unplugged:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h2-835595-3 Oct 05 17:57:57.725607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3641d1e-b6f5-4464-b7fa-34997981717b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:57.741948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-98d2019d-afe2-46cb-80af-78782b2198cc req-46f4311d-7f46-4972-b77a-071a0ab3bc0a service nova] Instance 28955122-95bb-4fc5-9f90-7ed314793044 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:57:57.743444 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b3641d1e-b6f5-4464-b7fa-34997981717b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1693 microversion: 2.1 time: 1.579583 Oct 05 17:57:57.761896 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2253/4767] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:56 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1693 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:57:57.773289 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-98d2019d-afe2-46cb-80af-78782b2198cc req-46f4311d-7f46-4972-b77a-071a0ab3bc0a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.386286 Oct 05 17:57:57.775072 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2515/4768] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:57:58.776152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f0c7d3b5-6ea7-4faa-9e6b-cee8ff1260a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:57:58.777843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f0c7d3b5-6ea7-4faa-9e6b-cee8ff1260a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:57:58.794572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0c7d3b5-6ea7-4faa-9e6b-cee8ff1260a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:58.796174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0c7d3b5-6ea7-4faa-9e6b-cee8ff1260a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:58.796897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0c7d3b5-6ea7-4faa-9e6b-cee8ff1260a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:58.798219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0c7d3b5-6ea7-4faa-9e6b-cee8ff1260a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:57:58.799047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0c7d3b5-6ea7-4faa-9e6b-cee8ff1260a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:57:58.799687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0c7d3b5-6ea7-4faa-9e6b-cee8ff1260a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:57:59.822459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f0c7d3b5-6ea7-4faa-9e6b-cee8ff1260a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:57:59.853375 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f0c7d3b5-6ea7-4faa-9e6b-cee8ff1260a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1693 microversion: 2.1 time: 1.084861 Oct 05 17:57:59.889263 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2254/4769] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:57:58 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1693 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:00.943211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0d19b104-f8fd-4b39-af25-55e1a2282d3f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:00.948920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0d19b104-f8fd-4b39-af25-55e1a2282d3f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:00.973542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d19b104-f8fd-4b39-af25-55e1a2282d3f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:00.974447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d19b104-f8fd-4b39-af25-55e1a2282d3f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:00.977982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d19b104-f8fd-4b39-af25-55e1a2282d3f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:00.979541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d19b104-f8fd-4b39-af25-55e1a2282d3f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:00.980568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d19b104-f8fd-4b39-af25-55e1a2282d3f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:00.981398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d19b104-f8fd-4b39-af25-55e1a2282d3f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:01.017580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-fa77d998-3c3b-47e7-a1b6-3a221f6f1106 req-25f44198-3b43-4c79-be0a-5069c709a476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:01.075779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fa77d998-3c3b-47e7-a1b6-3a221f6f1106 req-25f44198-3b43-4c79-be0a-5069c709a476 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:01.080696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fa77d998-3c3b-47e7-a1b6-3a221f6f1106 req-25f44198-3b43-4c79-be0a-5069c709a476 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:01.081653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fa77d998-3c3b-47e7-a1b6-3a221f6f1106 req-25f44198-3b43-4c79-be0a-5069c709a476 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:01.155130 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-fa77d998-3c3b-47e7-a1b6-3a221f6f1106 req-25f44198-3b43-4c79-be0a-5069c709a476 service nova] Creating event network-changed:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h2-835595-3 Oct 05 17:58:01.171898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-fa77d998-3c3b-47e7-a1b6-3a221f6f1106 req-25f44198-3b43-4c79-be0a-5069c709a476 service nova] Instance 28955122-95bb-4fc5-9f90-7ed314793044 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:58:01.186858 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [req-fa77d998-3c3b-47e7-a1b6-3a221f6f1106 req-25f44198-3b43-4c79-be0a-5069c709a476 service nova] [4653666a-cd96-43eb-aa4e-49d0d71941b0] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 17:58:01.546134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0d19b104-f8fd-4b39-af25-55e1a2282d3f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:01.558378 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0d19b104-f8fd-4b39-af25-55e1a2282d3f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1693 microversion: 2.1 time: 0.657976 Oct 05 17:58:01.560715 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2516/4770] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:00 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1693 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:01.576662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-115420292", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b643b79b-3063-437d-8012-2316c1aa3a43"}], "security_groups": [{"name": "tempest-securitygroup--347112921"}], "key_name": "tempest-keypair-1170756101", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "08002017-77c5-42b9-8526-4446401a876a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:01.913867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] validate_networks() for [('b643b79b-3063-437d-8012-2316c1aa3a43', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 17:58:02.198775 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [req-fa77d998-3c3b-47e7-a1b6-3a221f6f1106 req-25f44198-3b43-4c79-be0a-5069c709a476 service nova] [4653666a-cd96-43eb-aa4e-49d0d71941b0] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 35746. Oct 05 17:58:02.220750 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-fa77d998-3c3b-47e7-a1b6-3a221f6f1106 req-25f44198-3b43-4c79-be0a-5069c709a476 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.225930 Oct 05 17:58:02.222363 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2255/4771] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:58:02.593868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85bafff5-913f-4758-b2b6-1f40ccce4d38 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:02.595291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-85bafff5-913f-4758-b2b6-1f40ccce4d38 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:02.610928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85bafff5-913f-4758-b2b6-1f40ccce4d38 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:02.612011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85bafff5-913f-4758-b2b6-1f40ccce4d38 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:02.615019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85bafff5-913f-4758-b2b6-1f40ccce4d38 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:02.616860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85bafff5-913f-4758-b2b6-1f40ccce4d38 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:02.618856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85bafff5-913f-4758-b2b6-1f40ccce4d38 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:02.621241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85bafff5-913f-4758-b2b6-1f40ccce4d38 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:03.224096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85bafff5-913f-4758-b2b6-1f40ccce4d38 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:03.239333 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85bafff5-913f-4758-b2b6-1f40ccce4d38 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1693 microversion: 2.1 time: 0.652600 Oct 05 17:58:03.242009 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2256/4772] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:02 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1693 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:58:03.613145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Getting quotas for project 537bc13f867c45bba57e4215209ff2a9. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:58:03.624853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Getting quotas for user 70e2714f5b5442498655de65ce5de666 and project 537bc13f867c45bba57e4215209ff2a9. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:58:03.652022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 17:58:03.652721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 17:58:03.653339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 17:58:03.654140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 17:58:03.654595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 17:58:03.665094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:03.665684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:03.666212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:03.667300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:03.674409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:03.675304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:03.734316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Getting quotas for project 537bc13f867c45bba57e4215209ff2a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:58:03.762062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Getting quotas for user 70e2714f5b5442498655de65ce5de666 and project 537bc13f867c45bba57e4215209ff2a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:58:03.949843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 17:58:03.952211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08002017-77c5-42b9-8526-4446401a876a',volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 17:58:04.313931 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9b17b4f-3689-4f48-8365-3a3b1b6f8c49 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.751201 Oct 05 17:58:04.320032 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2517/4773] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:58:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 2759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 17:58:04.334554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5a8283c-7041-4558-94f0-2ef65cb03bc1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:04.342789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5a8283c-7041-4558-94f0-2ef65cb03bc1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:04.532266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f5a8283c-7041-4558-94f0-2ef65cb03bc1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:04.546715 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5a8283c-7041-4558-94f0-2ef65cb03bc1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1121 microversion: 2.1 time: 0.219230 Oct 05 17:58:04.548957 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2518/4774] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:04 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1121 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:04.683051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7467cc38-b77e-4c41-8980-19c9c0ea817a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:04.683795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7467cc38-b77e-4c41-8980-19c9c0ea817a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:04.697334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467cc38-b77e-4c41-8980-19c9c0ea817a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:04.698121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467cc38-b77e-4c41-8980-19c9c0ea817a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:04.702168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467cc38-b77e-4c41-8980-19c9c0ea817a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:04.703170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467cc38-b77e-4c41-8980-19c9c0ea817a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:04.703783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467cc38-b77e-4c41-8980-19c9c0ea817a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:04.704313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467cc38-b77e-4c41-8980-19c9c0ea817a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:05.573541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ff7a4e98-08c0-410a-8ddc-158b1624df15 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:05.574218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ff7a4e98-08c0-410a-8ddc-158b1624df15 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:05.680660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ff7a4e98-08c0-410a-8ddc-158b1624df15 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:05.698699 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ff7a4e98-08c0-410a-8ddc-158b1624df15 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1121 microversion: 2.1 time: 0.127157 Oct 05 17:58:05.713524 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2519/4775] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:05 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1121 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:58:06.721162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64d66050-3670-4608-9b1f-0d552bb2c6f0 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:06.727075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-64d66050-3670-4608-9b1f-0d552bb2c6f0 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:06.752135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d66050-3670-4608-9b1f-0d552bb2c6f0 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:06.752709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d66050-3670-4608-9b1f-0d552bb2c6f0 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:06.753151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d66050-3670-4608-9b1f-0d552bb2c6f0 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:06.753889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d66050-3670-4608-9b1f-0d552bb2c6f0 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:06.766632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d66050-3670-4608-9b1f-0d552bb2c6f0 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:06.767352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64d66050-3670-4608-9b1f-0d552bb2c6f0 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:06.929129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-64d66050-3670-4608-9b1f-0d552bb2c6f0 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:06.940839 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-64d66050-3670-4608-9b1f-0d552bb2c6f0 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1227 microversion: 2.1 time: 0.223430 Oct 05 17:58:06.970872 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2520/4776] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:06 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1227 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:07.283467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7467cc38-b77e-4c41-8980-19c9c0ea817a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:07.293295 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7467cc38-b77e-4c41-8980-19c9c0ea817a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1693 microversion: 2.1 time: 3.027007 Oct 05 17:58:07.294088 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2257/4777] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:04 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1693 bytes in 3028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:58:07.982416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ccd4dc1e-f435-40c4-a456-ffe9054ebc02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:07.983200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ccd4dc1e-f435-40c4-a456-ffe9054ebc02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:08.006632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd4dc1e-f435-40c4-a456-ffe9054ebc02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:08.007205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd4dc1e-f435-40c4-a456-ffe9054ebc02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:08.012344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd4dc1e-f435-40c4-a456-ffe9054ebc02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:08.013147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd4dc1e-f435-40c4-a456-ffe9054ebc02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:08.016315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd4dc1e-f435-40c4-a456-ffe9054ebc02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:08.016769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ccd4dc1e-f435-40c4-a456-ffe9054ebc02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:08.322503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa089f47-47f7-4940-8fe9-90c0733461c4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:08.323203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa089f47-47f7-4940-8fe9-90c0733461c4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:08.337808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa089f47-47f7-4940-8fe9-90c0733461c4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:08.338317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa089f47-47f7-4940-8fe9-90c0733461c4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:08.338827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa089f47-47f7-4940-8fe9-90c0733461c4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:08.339605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa089f47-47f7-4940-8fe9-90c0733461c4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:08.340016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa089f47-47f7-4940-8fe9-90c0733461c4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:08.340438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa089f47-47f7-4940-8fe9-90c0733461c4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:08.453726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ccd4dc1e-f435-40c4-a456-ffe9054ebc02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:08.470897 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ccd4dc1e-f435-40c4-a456-ffe9054ebc02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1237 microversion: 2.1 time: 0.487572 Oct 05 17:58:08.471620 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2521/4778] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:07 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1237 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:09.012382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa089f47-47f7-4940-8fe9-90c0733461c4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:09.023413 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa089f47-47f7-4940-8fe9-90c0733461c4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1688 microversion: 2.1 time: 0.704130 Oct 05 17:58:09.024939 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2258/4779] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:08 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1688 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:58:09.051725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4fbf0ac7-b122-42bc-a4c0-01b8d503b466 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:09.052336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4fbf0ac7-b122-42bc-a4c0-01b8d503b466 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:09.066850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fbf0ac7-b122-42bc-a4c0-01b8d503b466 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:09.072695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fbf0ac7-b122-42bc-a4c0-01b8d503b466 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:09.073459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fbf0ac7-b122-42bc-a4c0-01b8d503b466 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:09.074746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fbf0ac7-b122-42bc-a4c0-01b8d503b466 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:09.075711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fbf0ac7-b122-42bc-a4c0-01b8d503b466 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:09.076304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fbf0ac7-b122-42bc-a4c0-01b8d503b466 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:09.380318 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4fbf0ac7-b122-42bc-a4c0-01b8d503b466 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044/action" status: 202 len: 0 microversion: 2.1 time: 0.332387 Oct 05 17:58:09.384645 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2522/4780] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:58:09 2022] POST /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:58:09.389777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-241c6209-29de-40d9-a47e-df14156d2dec tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:09.390488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-241c6209-29de-40d9-a47e-df14156d2dec tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:09.409190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-241c6209-29de-40d9-a47e-df14156d2dec tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:09.412792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-241c6209-29de-40d9-a47e-df14156d2dec tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:09.413287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-241c6209-29de-40d9-a47e-df14156d2dec tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:09.415513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-241c6209-29de-40d9-a47e-df14156d2dec tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:09.416005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-241c6209-29de-40d9-a47e-df14156d2dec tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:09.416447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-241c6209-29de-40d9-a47e-df14156d2dec tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:09.498713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02870e02-2178-4ce0-a451-1b99a1b9f2c7 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:09.499683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02870e02-2178-4ce0-a451-1b99a1b9f2c7 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:09.521942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02870e02-2178-4ce0-a451-1b99a1b9f2c7 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:09.522784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02870e02-2178-4ce0-a451-1b99a1b9f2c7 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:09.524836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02870e02-2178-4ce0-a451-1b99a1b9f2c7 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:09.525712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02870e02-2178-4ce0-a451-1b99a1b9f2c7 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:09.528695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02870e02-2178-4ce0-a451-1b99a1b9f2c7 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:09.529348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02870e02-2178-4ce0-a451-1b99a1b9f2c7 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:09.952656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-241c6209-29de-40d9-a47e-df14156d2dec tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:09.971897 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-241c6209-29de-40d9-a47e-df14156d2dec tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1687 microversion: 2.1 time: 0.580639 Oct 05 17:58:09.996723 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2259/4781] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:09 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1687 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:58:10.018331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-02870e02-2178-4ce0-a451-1b99a1b9f2c7 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:10.030428 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02870e02-2178-4ce0-a451-1b99a1b9f2c7 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1237 microversion: 2.1 time: 0.537378 Oct 05 17:58:10.053097 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2523/4782] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:09 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1237 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:11.008338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43c86948-fff1-4931-ad44-9cb1ad453e07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:11.009677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-43c86948-fff1-4931-ad44-9cb1ad453e07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:11.026383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43c86948-fff1-4931-ad44-9cb1ad453e07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:11.037237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43c86948-fff1-4931-ad44-9cb1ad453e07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:11.037927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43c86948-fff1-4931-ad44-9cb1ad453e07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:11.040260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43c86948-fff1-4931-ad44-9cb1ad453e07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:11.040754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43c86948-fff1-4931-ad44-9cb1ad453e07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:11.041203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43c86948-fff1-4931-ad44-9cb1ad453e07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:11.059702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56d817b6-a6ca-4b7c-af54-bbb383279d34 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:11.060971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56d817b6-a6ca-4b7c-af54-bbb383279d34 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:11.080775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d817b6-a6ca-4b7c-af54-bbb383279d34 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:11.081133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d817b6-a6ca-4b7c-af54-bbb383279d34 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:11.095435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d817b6-a6ca-4b7c-af54-bbb383279d34 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:11.095435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d817b6-a6ca-4b7c-af54-bbb383279d34 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:11.095435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d817b6-a6ca-4b7c-af54-bbb383279d34 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:11.095435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d817b6-a6ca-4b7c-af54-bbb383279d34 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:12.067225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-56d817b6-a6ca-4b7c-af54-bbb383279d34 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:12.078380 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56d817b6-a6ca-4b7c-af54-bbb383279d34 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1304 microversion: 2.1 time: 1.023329 Oct 05 17:58:12.085853 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2524/4783] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:11 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1304 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:12.433710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-aaecf2b0-9551-44d7-81c2-8125490a62f0 req-27b37e49-46f9-43ab-9ff6-06af6e17c5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "name": "network-vif-plugged", "status": "completed", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:12.479397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aaecf2b0-9551-44d7-81c2-8125490a62f0 req-27b37e49-46f9-43ab-9ff6-06af6e17c5c3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:12.479928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aaecf2b0-9551-44d7-81c2-8125490a62f0 req-27b37e49-46f9-43ab-9ff6-06af6e17c5c3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:12.480423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-aaecf2b0-9551-44d7-81c2-8125490a62f0 req-27b37e49-46f9-43ab-9ff6-06af6e17c5c3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:12.526601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-aaecf2b0-9551-44d7-81c2-8125490a62f0 req-27b37e49-46f9-43ab-9ff6-06af6e17c5c3 service nova] Creating event network-vif-plugged:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h2-835595-3 Oct 05 17:58:12.547663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-aaecf2b0-9551-44d7-81c2-8125490a62f0 req-27b37e49-46f9-43ab-9ff6-06af6e17c5c3 service nova] Instance 28955122-95bb-4fc5-9f90-7ed314793044 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:58:12.619504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-aaecf2b0-9551-44d7-81c2-8125490a62f0 req-27b37e49-46f9-43ab-9ff6-06af6e17c5c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.528722 Oct 05 17:58:12.623702 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2525/4784] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:58:13.070000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-43c86948-fff1-4931-ad44-9cb1ad453e07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:13.080715 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-43c86948-fff1-4931-ad44-9cb1ad453e07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1687 microversion: 2.1 time: 2.077103 Oct 05 17:58:13.081323 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2260/4785] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:11 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1687 bytes in 2078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:13.116029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e09099c6-c1a7-4788-8652-e5466d34af02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:13.117635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e09099c6-c1a7-4788-8652-e5466d34af02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:13.132141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e09099c6-c1a7-4788-8652-e5466d34af02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:13.132941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e09099c6-c1a7-4788-8652-e5466d34af02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:13.133706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e09099c6-c1a7-4788-8652-e5466d34af02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:13.134641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e09099c6-c1a7-4788-8652-e5466d34af02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:13.136304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e09099c6-c1a7-4788-8652-e5466d34af02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:13.138009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e09099c6-c1a7-4788-8652-e5466d34af02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:13.689468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e09099c6-c1a7-4788-8652-e5466d34af02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:13.691879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:58:13.709835 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e09099c6-c1a7-4788-8652-e5466d34af02 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1304 microversion: 2.1 time: 0.601528 Oct 05 17:58:13.717078 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2526/4786] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:13 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1304 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:14.012308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-998c1389-5992-4c14-b392-3ffd311e33cd req-c0147ccd-8995-4751-9f92-e214e84bf93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68811bf-34bf-4dc7-8f52-d445af3b3757", "tag": "c53ad36e-b5ce-48cf-b1d4-7532b8c53013"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:14.061138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-998c1389-5992-4c14-b392-3ffd311e33cd req-c0147ccd-8995-4751-9f92-e214e84bf93a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:14.061951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-998c1389-5992-4c14-b392-3ffd311e33cd req-c0147ccd-8995-4751-9f92-e214e84bf93a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:14.067374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-998c1389-5992-4c14-b392-3ffd311e33cd req-c0147ccd-8995-4751-9f92-e214e84bf93a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:14.108811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99ac91bf-58e4-49a4-97fe-95ef2df1ca6d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:14.109561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99ac91bf-58e4-49a4-97fe-95ef2df1ca6d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:14.118322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99ac91bf-58e4-49a4-97fe-95ef2df1ca6d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:14.118891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99ac91bf-58e4-49a4-97fe-95ef2df1ca6d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:14.125809 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-998c1389-5992-4c14-b392-3ffd311e33cd req-c0147ccd-8995-4751-9f92-e214e84bf93a service nova] Creating event network-changed:c53ad36e-b5ce-48cf-b1d4-7532b8c53013 for instance e68811bf-34bf-4dc7-8f52-d445af3b3757 on n-h1-835595-3 Oct 05 17:58:14.134881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99ac91bf-58e4-49a4-97fe-95ef2df1ca6d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:14.136894 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-998c1389-5992-4c14-b392-3ffd311e33cd req-c0147ccd-8995-4751-9f92-e214e84bf93a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.581566 Oct 05 17:58:14.137358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99ac91bf-58e4-49a4-97fe-95ef2df1ca6d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:14.138228 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2261/4787] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:58:14.139119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99ac91bf-58e4-49a4-97fe-95ef2df1ca6d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:14.139119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99ac91bf-58e4-49a4-97fe-95ef2df1ca6d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:14.756477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9df076b3-dba8-4381-9b54-6079316d9237 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:14.757198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9df076b3-dba8-4381-9b54-6079316d9237 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:14.793172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df076b3-dba8-4381-9b54-6079316d9237 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:14.793705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df076b3-dba8-4381-9b54-6079316d9237 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:14.794165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df076b3-dba8-4381-9b54-6079316d9237 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:14.803205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df076b3-dba8-4381-9b54-6079316d9237 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:14.803737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df076b3-dba8-4381-9b54-6079316d9237 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:14.804186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df076b3-dba8-4381-9b54-6079316d9237 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:14.948734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99ac91bf-58e4-49a4-97fe-95ef2df1ca6d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:14.966345 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99ac91bf-58e4-49a4-97fe-95ef2df1ca6d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1687 microversion: 2.1 time: 0.858948 Oct 05 17:58:14.972337 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2527/4788] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:14 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1687 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:58:15.599479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9df076b3-dba8-4381-9b54-6079316d9237 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:15.618468 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9df076b3-dba8-4381-9b54-6079316d9237 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1304 microversion: 2.1 time: 0.880050 Oct 05 17:58:15.623200 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2262/4789] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:14 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1304 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:15.999077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ddbda6ea-9f00-424f-a6e2-751e73eed2a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:15.999912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ddbda6ea-9f00-424f-a6e2-751e73eed2a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:16.016807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=14 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:58:16.022806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddbda6ea-9f00-424f-a6e2-751e73eed2a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:16.025966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddbda6ea-9f00-424f-a6e2-751e73eed2a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:16.027002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddbda6ea-9f00-424f-a6e2-751e73eed2a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:16.029166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddbda6ea-9f00-424f-a6e2-751e73eed2a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:16.030473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddbda6ea-9f00-424f-a6e2-751e73eed2a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:16.031336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddbda6ea-9f00-424f-a6e2-751e73eed2a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:16.649802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a700b8af-b11a-4794-8e3f-62b22e697398 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:16.650506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a700b8af-b11a-4794-8e3f-62b22e697398 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:16.701184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a700b8af-b11a-4794-8e3f-62b22e697398 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:16.713749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a700b8af-b11a-4794-8e3f-62b22e697398 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:16.717161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a700b8af-b11a-4794-8e3f-62b22e697398 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:16.720003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a700b8af-b11a-4794-8e3f-62b22e697398 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:16.720957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a700b8af-b11a-4794-8e3f-62b22e697398 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:16.724183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a700b8af-b11a-4794-8e3f-62b22e697398 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:17.500869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ddbda6ea-9f00-424f-a6e2-751e73eed2a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:17.524505 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ddbda6ea-9f00-424f-a6e2-751e73eed2a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1687 microversion: 2.1 time: 1.531777 Oct 05 17:58:17.530018 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2528/4790] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:15 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1687 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:17.825644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a700b8af-b11a-4794-8e3f-62b22e697398 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:17.850851 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a700b8af-b11a-4794-8e3f-62b22e697398 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1304 microversion: 2.1 time: 1.205192 Oct 05 17:58:17.866789 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2263/4791] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:16 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1304 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:58:18.570240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0de0b7cd-7d24-48ea-88e4-a8871b5f620d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:18.615421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0de0b7cd-7d24-48ea-88e4-a8871b5f620d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:18.663814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de0b7cd-7d24-48ea-88e4-a8871b5f620d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:18.671218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de0b7cd-7d24-48ea-88e4-a8871b5f620d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:18.676728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de0b7cd-7d24-48ea-88e4-a8871b5f620d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:18.695079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de0b7cd-7d24-48ea-88e4-a8871b5f620d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:18.695687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de0b7cd-7d24-48ea-88e4-a8871b5f620d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:18.696136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0de0b7cd-7d24-48ea-88e4-a8871b5f620d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:18.880923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ff5d583d-706b-4f14-8ec2-a9b9669a12aa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:18.881518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ff5d583d-706b-4f14-8ec2-a9b9669a12aa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:18.901146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=26 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:58:18.962765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff5d583d-706b-4f14-8ec2-a9b9669a12aa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:18.965014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff5d583d-706b-4f14-8ec2-a9b9669a12aa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:18.968946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff5d583d-706b-4f14-8ec2-a9b9669a12aa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:18.972785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff5d583d-706b-4f14-8ec2-a9b9669a12aa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:18.974907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff5d583d-706b-4f14-8ec2-a9b9669a12aa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:18.976956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff5d583d-706b-4f14-8ec2-a9b9669a12aa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:19.010052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=72 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:58:19.361459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0de0b7cd-7d24-48ea-88e4-a8871b5f620d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:19.377748 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0de0b7cd-7d24-48ea-88e4-a8871b5f620d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1687 microversion: 2.1 time: 0.822252 Oct 05 17:58:19.379714 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2529/4792] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:18 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1687 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:19.775830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ff5d583d-706b-4f14-8ec2-a9b9669a12aa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:19.790699 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ff5d583d-706b-4f14-8ec2-a9b9669a12aa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1304 microversion: 2.1 time: 0.916529 Oct 05 17:58:19.795186 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2264/4793] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:18 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1304 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:20.085560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-04530157-9c43-4f41-bd4f-0472f53c3b1e req-d9a5ba66-d7e2-48d5-badc-2a89f704bc11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "name": "network-vif-unplugged", "status": "completed", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:20.123225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-04530157-9c43-4f41-bd4f-0472f53c3b1e req-d9a5ba66-d7e2-48d5-badc-2a89f704bc11 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:20.129932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-04530157-9c43-4f41-bd4f-0472f53c3b1e req-d9a5ba66-d7e2-48d5-badc-2a89f704bc11 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:20.132160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-04530157-9c43-4f41-bd4f-0472f53c3b1e req-d9a5ba66-d7e2-48d5-badc-2a89f704bc11 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:20.180025 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-04530157-9c43-4f41-bd4f-0472f53c3b1e req-d9a5ba66-d7e2-48d5-badc-2a89f704bc11 service nova] Creating event network-vif-unplugged:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h1-835595-3 Oct 05 17:58:20.203405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-04530157-9c43-4f41-bd4f-0472f53c3b1e req-d9a5ba66-d7e2-48d5-badc-2a89f704bc11 service nova] Instance 28955122-95bb-4fc5-9f90-7ed314793044 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:58:20.245598 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-04530157-9c43-4f41-bd4f-0472f53c3b1e req-d9a5ba66-d7e2-48d5-badc-2a89f704bc11 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162108 Oct 05 17:58:20.256490 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2530/4794] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:58:20.413661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9e528ef-58c6-428d-a817-05d79c2f6042 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:20.415340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f9e528ef-58c6-428d-a817-05d79c2f6042 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:20.436593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9e528ef-58c6-428d-a817-05d79c2f6042 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:20.439534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9e528ef-58c6-428d-a817-05d79c2f6042 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:20.448565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9e528ef-58c6-428d-a817-05d79c2f6042 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:20.454614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9e528ef-58c6-428d-a817-05d79c2f6042 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:20.455102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9e528ef-58c6-428d-a817-05d79c2f6042 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:20.455562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9e528ef-58c6-428d-a817-05d79c2f6042 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:20.835250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b75e47c-9c1a-4090-a2e7-bc54c976711a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:20.836095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1b75e47c-9c1a-4090-a2e7-bc54c976711a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:20.854803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b75e47c-9c1a-4090-a2e7-bc54c976711a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:20.859284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b75e47c-9c1a-4090-a2e7-bc54c976711a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:20.862993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b75e47c-9c1a-4090-a2e7-bc54c976711a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:20.863904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b75e47c-9c1a-4090-a2e7-bc54c976711a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:20.864495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b75e47c-9c1a-4090-a2e7-bc54c976711a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:20.865032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b75e47c-9c1a-4090-a2e7-bc54c976711a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:21.261377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f9e528ef-58c6-428d-a817-05d79c2f6042 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:21.296871 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f9e528ef-58c6-428d-a817-05d79c2f6042 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1687 microversion: 2.1 time: 0.885038 Oct 05 17:58:21.300324 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2265/4795] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:20 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1687 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:21.748314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b75e47c-9c1a-4090-a2e7-bc54c976711a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:21.767767 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b75e47c-9c1a-4090-a2e7-bc54c976711a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 0.931531 Oct 05 17:58:21.772165 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2531/4796] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:20 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:58:22.321591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a050069-2e2c-4c8f-94b3-1138b748ff07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:22.323445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7a050069-2e2c-4c8f-94b3-1138b748ff07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:22.343700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a050069-2e2c-4c8f-94b3-1138b748ff07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:22.350149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a050069-2e2c-4c8f-94b3-1138b748ff07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:22.350797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a050069-2e2c-4c8f-94b3-1138b748ff07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:22.351855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a050069-2e2c-4c8f-94b3-1138b748ff07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:22.355114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a050069-2e2c-4c8f-94b3-1138b748ff07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:22.355820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a050069-2e2c-4c8f-94b3-1138b748ff07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:22.371993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d2bcb1d9-b042-4d02-a9b1-863242dea0a3 req-b2d1d0e7-cf96-42c7-ba40-8f8c89a57bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:22.410125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d2bcb1d9-b042-4d02-a9b1-863242dea0a3 req-b2d1d0e7-cf96-42c7-ba40-8f8c89a57bae service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:22.411075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d2bcb1d9-b042-4d02-a9b1-863242dea0a3 req-b2d1d0e7-cf96-42c7-ba40-8f8c89a57bae service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:22.411540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d2bcb1d9-b042-4d02-a9b1-863242dea0a3 req-b2d1d0e7-cf96-42c7-ba40-8f8c89a57bae service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:22.465164 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d2bcb1d9-b042-4d02-a9b1-863242dea0a3 req-b2d1d0e7-cf96-42c7-ba40-8f8c89a57bae service nova] Creating event network-changed:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h1-835595-3 Oct 05 17:58:22.473033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:58:22.486724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-d2bcb1d9-b042-4d02-a9b1-863242dea0a3 req-b2d1d0e7-cf96-42c7-ba40-8f8c89a57bae service nova] Instance 28955122-95bb-4fc5-9f90-7ed314793044 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 17:58:22.518744 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d2bcb1d9-b042-4d02-a9b1-863242dea0a3 req-b2d1d0e7-cf96-42c7-ba40-8f8c89a57bae service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151178 Oct 05 17:58:22.523033 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2532/4797] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:58:22.826820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12094509-bb2d-4f26-bb9e-739013e7abb3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:22.828826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12094509-bb2d-4f26-bb9e-739013e7abb3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:22.852810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12094509-bb2d-4f26-bb9e-739013e7abb3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:22.859230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12094509-bb2d-4f26-bb9e-739013e7abb3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:22.859833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12094509-bb2d-4f26-bb9e-739013e7abb3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:22.861406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12094509-bb2d-4f26-bb9e-739013e7abb3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:22.865442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12094509-bb2d-4f26-bb9e-739013e7abb3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:22.866213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12094509-bb2d-4f26-bb9e-739013e7abb3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:23.525134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7a050069-2e2c-4c8f-94b3-1138b748ff07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:23.540218 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a050069-2e2c-4c8f-94b3-1138b748ff07 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1687 microversion: 2.1 time: 1.222787 Oct 05 17:58:23.541680 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2266/4798] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:22 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1687 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:23.899892 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 17:58:23.904408 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 17:58:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 (ip 10.222.0.70) !!! Oct 05 17:58:24.574003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-118b19f4-113c-4152-ae83-4da673d79850 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:24.583127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-118b19f4-113c-4152-ae83-4da673d79850 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:24.601468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-118b19f4-113c-4152-ae83-4da673d79850 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:24.602994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-118b19f4-113c-4152-ae83-4da673d79850 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:24.603630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-118b19f4-113c-4152-ae83-4da673d79850 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:24.605395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-118b19f4-113c-4152-ae83-4da673d79850 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:24.606057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-118b19f4-113c-4152-ae83-4da673d79850 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:24.606668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-118b19f4-113c-4152-ae83-4da673d79850 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:24.692659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-12094509-bb2d-4f26-bb9e-739013e7abb3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:24.716520 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12094509-bb2d-4f26-bb9e-739013e7abb3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 1.899132 Oct 05 17:58:24.717136 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2533/4799] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:22 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:25.749981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e9aa9872-be08-414d-8aeb-ed36f31c05a1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:25.750697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e9aa9872-be08-414d-8aeb-ed36f31c05a1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:25.764026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:58:25.784679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9aa9872-be08-414d-8aeb-ed36f31c05a1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:25.787292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9aa9872-be08-414d-8aeb-ed36f31c05a1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:25.787791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9aa9872-be08-414d-8aeb-ed36f31c05a1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:25.791952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9aa9872-be08-414d-8aeb-ed36f31c05a1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:25.794920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9aa9872-be08-414d-8aeb-ed36f31c05a1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:25.795533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e9aa9872-be08-414d-8aeb-ed36f31c05a1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:26.432808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-118b19f4-113c-4152-ae83-4da673d79850 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:26.448665 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-118b19f4-113c-4152-ae83-4da673d79850 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1687 microversion: 2.1 time: 1.885503 Oct 05 17:58:26.456276 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2267/4800] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:24 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1687 bytes in 1896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:26.724880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e9aa9872-be08-414d-8aeb-ed36f31c05a1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:26.735744 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e9aa9872-be08-414d-8aeb-ed36f31c05a1 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 0.995707 Oct 05 17:58:26.736534 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2534/4801] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:25 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:27.481836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-94dfd49f-18ad-472c-8214-a0b286bfb53a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:27.482602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-94dfd49f-18ad-472c-8214-a0b286bfb53a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:27.518218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94dfd49f-18ad-472c-8214-a0b286bfb53a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:27.521609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94dfd49f-18ad-472c-8214-a0b286bfb53a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:27.525833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94dfd49f-18ad-472c-8214-a0b286bfb53a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:27.528678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94dfd49f-18ad-472c-8214-a0b286bfb53a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:27.530486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94dfd49f-18ad-472c-8214-a0b286bfb53a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:27.531489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94dfd49f-18ad-472c-8214-a0b286bfb53a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:27.763824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3a275a8-5af4-4d1f-b68d-0367838c6872 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:27.764668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b3a275a8-5af4-4d1f-b68d-0367838c6872 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:27.793291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3a275a8-5af4-4d1f-b68d-0367838c6872 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:27.797431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3a275a8-5af4-4d1f-b68d-0367838c6872 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:27.797952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3a275a8-5af4-4d1f-b68d-0367838c6872 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:27.802052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3a275a8-5af4-4d1f-b68d-0367838c6872 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:27.804486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3a275a8-5af4-4d1f-b68d-0367838c6872 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:27.806011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3a275a8-5af4-4d1f-b68d-0367838c6872 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:28.229191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3a275a8-5af4-4d1f-b68d-0367838c6872 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:28.244085 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3a275a8-5af4-4d1f-b68d-0367838c6872 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 0.479143 Oct 05 17:58:28.246378 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2535/4802] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:27 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:28.383742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-94dfd49f-18ad-472c-8214-a0b286bfb53a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:28.402978 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-94dfd49f-18ad-472c-8214-a0b286bfb53a tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1687 microversion: 2.1 time: 0.926316 Oct 05 17:58:28.419683 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2268/4803] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:27 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1687 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:29.271161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4967551-b2c3-4660-8f63-70b7e86fa94e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:29.274202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b4967551-b2c3-4660-8f63-70b7e86fa94e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:29.287214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4967551-b2c3-4660-8f63-70b7e86fa94e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:29.289612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4967551-b2c3-4660-8f63-70b7e86fa94e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:29.294605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4967551-b2c3-4660-8f63-70b7e86fa94e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:29.295697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4967551-b2c3-4660-8f63-70b7e86fa94e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:29.296341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4967551-b2c3-4660-8f63-70b7e86fa94e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:29.296917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4967551-b2c3-4660-8f63-70b7e86fa94e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:29.448698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e5b4831e-d3e6-4707-9858-9c3d276b0d14 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:29.449836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e5b4831e-d3e6-4707-9858-9c3d276b0d14 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:29.461904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5b4831e-d3e6-4707-9858-9c3d276b0d14 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:29.465625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5b4831e-d3e6-4707-9858-9c3d276b0d14 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:29.467172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5b4831e-d3e6-4707-9858-9c3d276b0d14 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:29.468253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5b4831e-d3e6-4707-9858-9c3d276b0d14 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:29.470884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5b4831e-d3e6-4707-9858-9c3d276b0d14 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:29.471531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5b4831e-d3e6-4707-9858-9c3d276b0d14 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:29.850716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e5b4831e-d3e6-4707-9858-9c3d276b0d14 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:29.863493 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e5b4831e-d3e6-4707-9858-9c3d276b0d14 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1680 microversion: 2.1 time: 0.419576 Oct 05 17:58:29.864683 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2269/4804] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:29 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1680 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:30.337422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4967551-b2c3-4660-8f63-70b7e86fa94e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:30.348553 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b4967551-b2c3-4660-8f63-70b7e86fa94e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 1.083579 Oct 05 17:58:30.355733 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2536/4805] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:29 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:31.383484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-551ed957-c1f8-4724-a833-9b99fd72103e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:31.384147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-551ed957-c1f8-4724-a833-9b99fd72103e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:31.406771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-551ed957-c1f8-4724-a833-9b99fd72103e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:31.407249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-551ed957-c1f8-4724-a833-9b99fd72103e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:31.407694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-551ed957-c1f8-4724-a833-9b99fd72103e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:31.408413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-551ed957-c1f8-4724-a833-9b99fd72103e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:31.408870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-551ed957-c1f8-4724-a833-9b99fd72103e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:31.439064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-551ed957-c1f8-4724-a833-9b99fd72103e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:31.848054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-551ed957-c1f8-4724-a833-9b99fd72103e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:31.863376 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-551ed957-c1f8-4724-a833-9b99fd72103e tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 0.485720 Oct 05 17:58:31.863997 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2270/4806] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:31 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:32.889961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c17b963d-edca-4b51-8aac-2bb2f799bafa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:32.890797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c17b963d-edca-4b51-8aac-2bb2f799bafa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:32.921155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c17b963d-edca-4b51-8aac-2bb2f799bafa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:32.942842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c17b963d-edca-4b51-8aac-2bb2f799bafa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:32.943558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c17b963d-edca-4b51-8aac-2bb2f799bafa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:32.947801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c17b963d-edca-4b51-8aac-2bb2f799bafa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:32.948751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c17b963d-edca-4b51-8aac-2bb2f799bafa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:32.950965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c17b963d-edca-4b51-8aac-2bb2f799bafa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:33.507635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c17b963d-edca-4b51-8aac-2bb2f799bafa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:33.516343 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c17b963d-edca-4b51-8aac-2bb2f799bafa tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 0.630821 Oct 05 17:58:33.542808 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2537/4807] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:32 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:34.556502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-687d1fe3-41ef-48fa-bb09-13f535bc48e2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:34.558516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-687d1fe3-41ef-48fa-bb09-13f535bc48e2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:34.569886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687d1fe3-41ef-48fa-bb09-13f535bc48e2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:34.577999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687d1fe3-41ef-48fa-bb09-13f535bc48e2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:34.578733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687d1fe3-41ef-48fa-bb09-13f535bc48e2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:34.579743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687d1fe3-41ef-48fa-bb09-13f535bc48e2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:34.580446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687d1fe3-41ef-48fa-bb09-13f535bc48e2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:34.581127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-687d1fe3-41ef-48fa-bb09-13f535bc48e2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:34.940446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-687d1fe3-41ef-48fa-bb09-13f535bc48e2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:34.973683 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-687d1fe3-41ef-48fa-bb09-13f535bc48e2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 0.418350 Oct 05 17:58:34.974940 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2271/4808] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:34 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:35.997427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5808a81-31cf-4a41-a965-10f631e7206a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:36.009240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5808a81-31cf-4a41-a965-10f631e7206a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:36.023439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5808a81-31cf-4a41-a965-10f631e7206a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:36.032396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5808a81-31cf-4a41-a965-10f631e7206a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:36.034018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5808a81-31cf-4a41-a965-10f631e7206a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:36.034912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5808a81-31cf-4a41-a965-10f631e7206a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:36.037732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5808a81-31cf-4a41-a965-10f631e7206a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:36.038405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5808a81-31cf-4a41-a965-10f631e7206a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:36.916345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5808a81-31cf-4a41-a965-10f631e7206a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:36.948167 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5808a81-31cf-4a41-a965-10f631e7206a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 0.955578 Oct 05 17:58:36.963879 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2538/4809] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:35 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:37.392086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5898f573-4ff6-4815-8897-08646cf516f5 req-db5c2c2e-398b-428b-a52d-74a0a4c88910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "name": "network-vif-plugged", "status": "completed", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:37.431276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5898f573-4ff6-4815-8897-08646cf516f5 req-db5c2c2e-398b-428b-a52d-74a0a4c88910 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:37.436504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5898f573-4ff6-4815-8897-08646cf516f5 req-db5c2c2e-398b-428b-a52d-74a0a4c88910 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:37.442910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5898f573-4ff6-4815-8897-08646cf516f5 req-db5c2c2e-398b-428b-a52d-74a0a4c88910 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:37.492841 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5898f573-4ff6-4815-8897-08646cf516f5 req-db5c2c2e-398b-428b-a52d-74a0a4c88910 service nova] Creating event network-vif-plugged:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h1-835595-3 Oct 05 17:58:37.555807 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5898f573-4ff6-4815-8897-08646cf516f5 req-db5c2c2e-398b-428b-a52d-74a0a4c88910 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199642 Oct 05 17:58:37.556358 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2272/4810] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:58:37.973837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78d88908-74e8-4178-9d80-c73d158ba1d8 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:37.976034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-78d88908-74e8-4178-9d80-c73d158ba1d8 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:37.991765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88908-74e8-4178-9d80-c73d158ba1d8 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:37.992895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88908-74e8-4178-9d80-c73d158ba1d8 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:37.993527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88908-74e8-4178-9d80-c73d158ba1d8 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:37.994867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88908-74e8-4178-9d80-c73d158ba1d8 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:37.997647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88908-74e8-4178-9d80-c73d158ba1d8 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:37.998261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78d88908-74e8-4178-9d80-c73d158ba1d8 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:38.800107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78d88908-74e8-4178-9d80-c73d158ba1d8 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:38.808386 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78d88908-74e8-4178-9d80-c73d158ba1d8 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 0.839373 Oct 05 17:58:38.813998 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2539/4811] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:37 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:39.622271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-221e4dd9-0b74-45c5-8d6e-2676129f743f req-eadb2dff-aa4b-41f8-9c89-afd84082c5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68811bf-34bf-4dc7-8f52-d445af3b3757", "name": "network-vif-plugged", "status": "completed", "tag": "c53ad36e-b5ce-48cf-b1d4-7532b8c53013"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:39.649236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-221e4dd9-0b74-45c5-8d6e-2676129f743f req-eadb2dff-aa4b-41f8-9c89-afd84082c5bb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:39.649993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-221e4dd9-0b74-45c5-8d6e-2676129f743f req-eadb2dff-aa4b-41f8-9c89-afd84082c5bb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:39.651594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-221e4dd9-0b74-45c5-8d6e-2676129f743f req-eadb2dff-aa4b-41f8-9c89-afd84082c5bb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:39.710557 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-221e4dd9-0b74-45c5-8d6e-2676129f743f req-eadb2dff-aa4b-41f8-9c89-afd84082c5bb service nova] Creating event network-vif-plugged:c53ad36e-b5ce-48cf-b1d4-7532b8c53013 for instance e68811bf-34bf-4dc7-8f52-d445af3b3757 on n-h1-835595-3 Oct 05 17:58:39.745813 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-221e4dd9-0b74-45c5-8d6e-2676129f743f req-eadb2dff-aa4b-41f8-9c89-afd84082c5bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123332 Oct 05 17:58:39.767461 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2273/4812] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:58:39.841363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eeac23d5-6e4e-45eb-b308-8368ccc04fbe tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:39.842059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eeac23d5-6e4e-45eb-b308-8368ccc04fbe tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:39.863207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eeac23d5-6e4e-45eb-b308-8368ccc04fbe tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:39.864049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eeac23d5-6e4e-45eb-b308-8368ccc04fbe tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:39.864646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eeac23d5-6e4e-45eb-b308-8368ccc04fbe tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:39.865716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eeac23d5-6e4e-45eb-b308-8368ccc04fbe tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:39.866373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eeac23d5-6e4e-45eb-b308-8368ccc04fbe tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:39.868335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eeac23d5-6e4e-45eb-b308-8368ccc04fbe tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:40.778437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eeac23d5-6e4e-45eb-b308-8368ccc04fbe tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:40.814023 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eeac23d5-6e4e-45eb-b308-8368ccc04fbe tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1292 microversion: 2.1 time: 0.977023 Oct 05 17:58:40.815046 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2540/4813] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:39 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1292 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:41.841358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-649325fc-3728-475a-8de8-4669214cc529 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:41.842076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-649325fc-3728-475a-8de8-4669214cc529 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:41.875407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-649325fc-3728-475a-8de8-4669214cc529 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:41.875910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-649325fc-3728-475a-8de8-4669214cc529 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:41.876357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-649325fc-3728-475a-8de8-4669214cc529 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:41.877079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-649325fc-3728-475a-8de8-4669214cc529 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:41.877540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-649325fc-3728-475a-8de8-4669214cc529 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:41.877971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-649325fc-3728-475a-8de8-4669214cc529 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:42.501148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-649325fc-3728-475a-8de8-4669214cc529 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:42.515642 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-649325fc-3728-475a-8de8-4669214cc529 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1483 microversion: 2.1 time: 0.678497 Oct 05 17:58:42.537705 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2274/4814] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:41 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1483 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:42.552148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-67867e90-3349-416b-a4e2-9adee7d641fb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:42.552760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-67867e90-3349-416b-a4e2-9adee7d641fb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:42.574033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67867e90-3349-416b-a4e2-9adee7d641fb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:42.574740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67867e90-3349-416b-a4e2-9adee7d641fb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:42.575201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67867e90-3349-416b-a4e2-9adee7d641fb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:42.575969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67867e90-3349-416b-a4e2-9adee7d641fb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:42.576428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67867e90-3349-416b-a4e2-9adee7d641fb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:42.576862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67867e90-3349-416b-a4e2-9adee7d641fb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:42.823311 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-67867e90-3349-416b-a4e2-9adee7d641fb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.275795 Oct 05 17:58:42.824158 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2541/4815] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 17:58:42 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:58:46.195884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a8bff2b2-9405-4772-bb79-a1baa51e5e36 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:58:46.197172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a8bff2b2-9405-4772-bb79-a1baa51e5e36 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:46.215713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8bff2b2-9405-4772-bb79-a1baa51e5e36 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:46.221802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8bff2b2-9405-4772-bb79-a1baa51e5e36 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:46.231714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4b84ad4d-cf45-4070-8b78-565ac7991436 req-733280e5-5523-4a94-9e86-4a7611c16e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e68811bf-34bf-4dc7-8f52-d445af3b3757", "tag": "c53ad36e-b5ce-48cf-b1d4-7532b8c53013"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:46.238389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8bff2b2-9405-4772-bb79-a1baa51e5e36 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:46.239506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8bff2b2-9405-4772-bb79-a1baa51e5e36 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:46.242523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8bff2b2-9405-4772-bb79-a1baa51e5e36 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:46.243184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8bff2b2-9405-4772-bb79-a1baa51e5e36 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:46.256955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4b84ad4d-cf45-4070-8b78-565ac7991436 req-733280e5-5523-4a94-9e86-4a7611c16e6d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:46.268824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4b84ad4d-cf45-4070-8b78-565ac7991436 req-733280e5-5523-4a94-9e86-4a7611c16e6d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:46.269678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4b84ad4d-cf45-4070-8b78-565ac7991436 req-733280e5-5523-4a94-9e86-4a7611c16e6d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:46.302306 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4b84ad4d-cf45-4070-8b78-565ac7991436 req-733280e5-5523-4a94-9e86-4a7611c16e6d service nova] Creating event network-changed:c53ad36e-b5ce-48cf-b1d4-7532b8c53013 for instance e68811bf-34bf-4dc7-8f52-d445af3b3757 on n-h1-835595-3 Oct 05 17:58:46.329738 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4b84ad4d-cf45-4070-8b78-565ac7991436 req-733280e5-5523-4a94-9e86-4a7611c16e6d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104025 Oct 05 17:58:46.338552 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2542/4816] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:58:47.609120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a8bff2b2-9405-4772-bb79-a1baa51e5e36 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:58:47.617837 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a8bff2b2-9405-4772-bb79-a1baa51e5e36 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1483 microversion: 2.1 time: 1.427077 Oct 05 17:58:47.629838 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2275/4817] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:58:46 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1483 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:58:54.264534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a996d27e-3228-4e40-ac62-3ce8360b79ba tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:58:54.267167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a996d27e-3228-4e40-ac62-3ce8360b79ba tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:58:54.293259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a996d27e-3228-4e40-ac62-3ce8360b79ba tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:54.297370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a996d27e-3228-4e40-ac62-3ce8360b79ba tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:54.298091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a996d27e-3228-4e40-ac62-3ce8360b79ba tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:54.298989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a996d27e-3228-4e40-ac62-3ce8360b79ba tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:58:54.303261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a996d27e-3228-4e40-ac62-3ce8360b79ba tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:58:54.304020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a996d27e-3228-4e40-ac62-3ce8360b79ba tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:58:54.315599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=55 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:58:54.415132 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a996d27e-3228-4e40-ac62-3ce8360b79ba tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044/action" status: 200 len: 63145 microversion: 2.1 time: 0.154349 Oct 05 17:58:54.429275 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2543/4818] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 17:58:54 2022] POST /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044/action => generated 63145 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 17:59:00.643864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=23 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:00.649527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=63 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:01.209233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a6bcd7ea-959e-49c3-bf32-fbd2c59e0cf2 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:01.210024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a6bcd7ea-959e-49c3-bf32-fbd2c59e0cf2 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:01.227561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6bcd7ea-959e-49c3-bf32-fbd2c59e0cf2 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:01.232429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6bcd7ea-959e-49c3-bf32-fbd2c59e0cf2 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:01.233335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6bcd7ea-959e-49c3-bf32-fbd2c59e0cf2 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:01.234368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6bcd7ea-959e-49c3-bf32-fbd2c59e0cf2 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:01.234963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6bcd7ea-959e-49c3-bf32-fbd2c59e0cf2 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:01.236352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a6bcd7ea-959e-49c3-bf32-fbd2c59e0cf2 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:02.740828 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a6bcd7ea-959e-49c3-bf32-fbd2c59e0cf2 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1831 microversion: 2.1 time: 2.110551 Oct 05 17:59:02.743891 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2276/4819] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:00 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1831 bytes in 2114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:07.423011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7639812b-73c9-4c53-ad02-401683c0def0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:07.423873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7639812b-73c9-4c53-ad02-401683c0def0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:07.435269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f180379a-07b4-472c-8062-e93f405374e1 req-0f98e24e-cd24-4ca9-9752-d7086d40b2c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:59:07.458553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=19 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:07.459478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:07.468687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f180379a-07b4-472c-8062-e93f405374e1 req-0f98e24e-cd24-4ca9-9752-d7086d40b2c7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:07.469187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f180379a-07b4-472c-8062-e93f405374e1 req-0f98e24e-cd24-4ca9-9752-d7086d40b2c7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:07.470338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7639812b-73c9-4c53-ad02-401683c0def0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:07.470889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7639812b-73c9-4c53-ad02-401683c0def0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:07.471378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7639812b-73c9-4c53-ad02-401683c0def0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:07.475388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7639812b-73c9-4c53-ad02-401683c0def0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:07.476474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f180379a-07b4-472c-8062-e93f405374e1 req-0f98e24e-cd24-4ca9-9752-d7086d40b2c7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:07.477245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7639812b-73c9-4c53-ad02-401683c0def0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:07.484095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7639812b-73c9-4c53-ad02-401683c0def0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:07.542357 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f180379a-07b4-472c-8062-e93f405374e1 req-0f98e24e-cd24-4ca9-9752-d7086d40b2c7 service nova] Creating event network-changed:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h1-835595-3 Oct 05 17:59:07.569893 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f180379a-07b4-472c-8062-e93f405374e1 req-0f98e24e-cd24-4ca9-9752-d7086d40b2c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134923 Oct 05 17:59:07.570614 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2277/4820] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 17:59:07.622229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7639812b-73c9-4c53-ad02-401683c0def0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:59:07.804466 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7639812b-73c9-4c53-ad02-401683c0def0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "DELETE /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 204 len: 0 microversion: 2.1 time: 0.387334 Oct 05 17:59:07.804997 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2544/4821] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:59:07 2022] DELETE /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:59:07.815544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ad1ce03-aa39-460e-b839-c453916d0601 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:07.816567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7ad1ce03-aa39-460e-b839-c453916d0601 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:07.843564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ad1ce03-aa39-460e-b839-c453916d0601 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:07.848573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ad1ce03-aa39-460e-b839-c453916d0601 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:07.849148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ad1ce03-aa39-460e-b839-c453916d0601 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:07.852125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ad1ce03-aa39-460e-b839-c453916d0601 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:07.852617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ad1ce03-aa39-460e-b839-c453916d0601 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:07.860868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ad1ce03-aa39-460e-b839-c453916d0601 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:08.505475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7ad1ce03-aa39-460e-b839-c453916d0601 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:08.516382 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ad1ce03-aa39-460e-b839-c453916d0601 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1567 microversion: 2.1 time: 0.706146 Oct 05 17:59:08.527888 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2278/4822] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:07 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1567 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:09.545027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fc501f38-cc1d-4083-81de-98548507833f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:09.546547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fc501f38-cc1d-4083-81de-98548507833f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:09.577019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc501f38-cc1d-4083-81de-98548507833f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:09.577596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc501f38-cc1d-4083-81de-98548507833f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:09.585205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc501f38-cc1d-4083-81de-98548507833f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:09.599807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc501f38-cc1d-4083-81de-98548507833f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:09.600534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc501f38-cc1d-4083-81de-98548507833f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:09.610688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc501f38-cc1d-4083-81de-98548507833f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:10.187051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fc501f38-cc1d-4083-81de-98548507833f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:10.202972 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fc501f38-cc1d-4083-81de-98548507833f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1567 microversion: 2.1 time: 0.656148 Oct 05 17:59:10.204227 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2545/4823] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:09 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1567 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:11.229996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc00a528-16d2-4a24-94b2-e70f92171ce2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:11.230724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cc00a528-16d2-4a24-94b2-e70f92171ce2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:11.255022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc00a528-16d2-4a24-94b2-e70f92171ce2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:11.257045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc00a528-16d2-4a24-94b2-e70f92171ce2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:11.257917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc00a528-16d2-4a24-94b2-e70f92171ce2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:11.258948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc00a528-16d2-4a24-94b2-e70f92171ce2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:11.266085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc00a528-16d2-4a24-94b2-e70f92171ce2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:11.267130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc00a528-16d2-4a24-94b2-e70f92171ce2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:12.640144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3a5db5bb-7be9-457a-a570-e6213045b6b1 req-ebabf0ad-9e58-456b-87ec-eb86ed728238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28955122-95bb-4fc5-9f90-7ed314793044", "name": "network-vif-deleted", "tag": "4fe05ff2-89e3-419e-a973-507293bdd5a2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:59:12.702336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3a5db5bb-7be9-457a-a570-e6213045b6b1 req-ebabf0ad-9e58-456b-87ec-eb86ed728238 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:12.703127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3a5db5bb-7be9-457a-a570-e6213045b6b1 req-ebabf0ad-9e58-456b-87ec-eb86ed728238 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:12.703827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3a5db5bb-7be9-457a-a570-e6213045b6b1 req-ebabf0ad-9e58-456b-87ec-eb86ed728238 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:12.707644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cc00a528-16d2-4a24-94b2-e70f92171ce2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:12.724043 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3a5db5bb-7be9-457a-a570-e6213045b6b1 req-ebabf0ad-9e58-456b-87ec-eb86ed728238 service nova] Creating event network-vif-deleted:4fe05ff2-89e3-419e-a973-507293bdd5a2 for instance 28955122-95bb-4fc5-9f90-7ed314793044 on n-h1-835595-3 Oct 05 17:59:12.725105 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3a5db5bb-7be9-457a-a570-e6213045b6b1 req-ebabf0ad-9e58-456b-87ec-eb86ed728238 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091304 Oct 05 17:59:12.726322 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2546/4824] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:59:12.743201 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cc00a528-16d2-4a24-94b2-e70f92171ce2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 200 len: 1567 microversion: 2.1 time: 1.520132 Oct 05 17:59:12.763216 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2279/4825] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:11 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 1567 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:13.790060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:13.791956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 28955122-95bb-4fc5-9f90-7ed314793044] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:13.826370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:13.828717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:13.829366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:13.834591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:13.835306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:13.837511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:13.893209 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] HTTP exception thrown: Instance 28955122-95bb-4fc5-9f90-7ed314793044 could not be found. Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Request method failure captured: Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 HTTP/1.1 Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcR9hsASNeCxKdaWPh__rNnLpLGu_NRFNi62uQj9y73P1T9S0pslSwuq_12rTMXyGYm4d-Umm-79M42ROeTVnTLUWyZ4RZkWarKlFVLotx_WpwXcOjA-s_3fPDnuAoX-R_bMMcbYM0Kd8mJ9oPRpxXfRyUZdm3yiMPoJSkAHu7laR8I Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: ff799a13bddf49c0bc8b23c02eabf9ac Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ff799a13bddf49c0bc8b23c02eabf9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff799a13bddf49c0bc8b23c02eabf9ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ff799a13bddf49c0bc8b23c02eabf9ac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff799a13bddf49c0bc8b23c02eabf9ac"}]}] Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: ff799a13bddf49c0bc8b23c02eabf9ac Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestNetworkAdvancedServerOps-1621598017-project Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 06d379a97d474b74a29e62848a4e4696 Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1621598017-project Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 28955122-95bb-4fc5-9f90-7ed314793044 could not be found. Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '28955122-95bb-4fc5-9f90-7ed314793044'} Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28955122-95bb-4fc5-9f90-7ed314793044 could not be found. Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28955122-95bb-4fc5-9f90-7ed314793044 could not be found. Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:59:13.896817 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:59:13.903160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:59:13.903160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:59:13.903160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:59:13.903160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:59:13.903160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:59:13.903160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:59:13.903160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28955122-95bb-4fc5-9f90-7ed314793044 could not be found. Oct 05 17:59:13.903160 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:59:13.905994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Returning 404 to user: Instance 28955122-95bb-4fc5-9f90-7ed314793044 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:59:13.907148 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8ef2ba46-bf95-4bcd-9276-0aebba58c9b0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044" status: 404 len: 111 microversion: 2.1 time: 0.126800 Oct 05 17:59:13.914426 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2547/4826] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:13 2022] GET /compute/v2.1/servers/28955122-95bb-4fc5-9f90-7ed314793044 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:59:23.951265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:23.956177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:23.956960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Searching by: {'deleted': False, 'project_id': '537bc13f867c45bba57e4215209ff2a9'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:59:23.966083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:23.966887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=20 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:23.988312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:23.988808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:23.989311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:23.990052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:23.999042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:23.999621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:24.067668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:59:24.110658 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-91e76983-6ae6-4eea-86a4-0cc6aba1675d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.163365 Oct 05 17:59:24.112032 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2280/4827] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 17:59:23 2022] GET /compute/v2.1/servers => generated 343 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:59:24.134969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:24.149892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:24.151530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Searching by: {'deleted': False, 'project_id': '537bc13f867c45bba57e4215209ff2a9'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 17:59:24.155964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:24.158409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:24.166268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:24.168225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:24.169073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:24.170215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:24.171134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:24.171939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:24.238715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 17:59:24.373565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:24.392820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:24.393707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:24.395069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:25.540363 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9734072f-8369-4ed2-a3e1-2a779cd1c81a tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 1.419449 Oct 05 17:59:25.541339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2548/4828] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 17:59:24 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:59:25.569450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a5876fa3-c7a6-4fe9-abf0-aa0774b917c4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:25.585419 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a5876fa3-c7a6-4fe9-abf0-aa0774b917c4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020482 Oct 05 17:59:25.591919 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2281/4829] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 17:59:25 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:59:25.964686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac959007-9e68-45e7-9f48-54350a574db2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:25.965454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac959007-9e68-45e7-9f48-54350a574db2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:26.025789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac959007-9e68-45e7-9f48-54350a574db2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:26.027391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac959007-9e68-45e7-9f48-54350a574db2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:26.028616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac959007-9e68-45e7-9f48-54350a574db2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:26.036141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac959007-9e68-45e7-9f48-54350a574db2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:26.037793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac959007-9e68-45e7-9f48-54350a574db2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:26.039321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac959007-9e68-45e7-9f48-54350a574db2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:26.080325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac959007-9e68-45e7-9f48-54350a574db2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 17:59:26.248200 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac959007-9e68-45e7-9f48-54350a574db2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 204 len: 0 microversion: 2.1 time: 0.291813 Oct 05 17:59:26.248821 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2549/4830] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 17:59:25 2022] DELETE /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 17:59:26.262343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-059a7d20-cce2-4108-8188-6b8b24e263a4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:26.262974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-059a7d20-cce2-4108-8188-6b8b24e263a4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:26.298832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059a7d20-cce2-4108-8188-6b8b24e263a4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:26.316741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059a7d20-cce2-4108-8188-6b8b24e263a4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:26.320172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059a7d20-cce2-4108-8188-6b8b24e263a4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:26.333395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059a7d20-cce2-4108-8188-6b8b24e263a4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:26.334013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059a7d20-cce2-4108-8188-6b8b24e263a4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:26.334516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059a7d20-cce2-4108-8188-6b8b24e263a4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:27.396229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-059a7d20-cce2-4108-8188-6b8b24e263a4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:27.408658 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-059a7d20-cce2-4108-8188-6b8b24e263a4 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1608 microversion: 2.1 time: 1.154614 Oct 05 17:59:27.427920 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2282/4831] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:26 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1608 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:28.140512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-493ea1fa-d74c-4c50-b44d-f0ecb416efa1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '.version_select at 0x7f7774649ca0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:28.198343 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-493ea1fa-d74c-4c50-b44d-f0ecb416efa1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-74455598" status: 202 len: 0 microversion: 2.1 time: 0.067402 Oct 05 17:59:28.199566 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2550/4832] 10.222.0.70 () {58 vars in 1278 bytes} [Wed Oct 5 17:59:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-74455598 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:59:28.259968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d83f3184-a550-4a55-9ca3-887b32b1d66e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'create', calling method: .version_select at 0x7f777598b160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-119614768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKURAWC0LEecyEyxcHYDMQMJnnsgTmdcG/ogLAuYkI9fSGzfD1Z9hJZdBV5OkkdSWr8s4dLQHNTLkS/apn1JnlArjxgj60KjY2of5pgiINz/h+PQDGKen4nP4ICZxL0XdA=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:59:28.358786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-d83f3184-a550-4a55-9ca3-887b32b1d66e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 17:59:28.388622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-d83f3184-a550-4a55-9ca3-887b32b1d66e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for user 06d379a97d474b74a29e62848a4e4696 and project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 17:59:28.447731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99c45a44-da94-45fa-b843-5eadde947c06 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:28.448749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99c45a44-da94-45fa-b843-5eadde947c06 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:28.474365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99c45a44-da94-45fa-b843-5eadde947c06 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:28.474872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99c45a44-da94-45fa-b843-5eadde947c06 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:28.475436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99c45a44-da94-45fa-b843-5eadde947c06 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:28.483861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99c45a44-da94-45fa-b843-5eadde947c06 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:28.484390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99c45a44-da94-45fa-b843-5eadde947c06 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:28.489867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99c45a44-da94-45fa-b843-5eadde947c06 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:28.514042 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d83f3184-a550-4a55-9ca3-887b32b1d66e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.274148 Oct 05 17:59:28.519047 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2283/4833] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 17:59:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:59:29.373830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99c45a44-da94-45fa-b843-5eadde947c06 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:29.407596 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99c45a44-da94-45fa-b843-5eadde947c06 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1608 microversion: 2.1 time: 0.963649 Oct 05 17:59:29.419929 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2551/4834] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:28 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1608 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:59:30.442656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4cdc8c98-d783-4ae7-b5a7-7ed6ac7bc670 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:30.443862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4cdc8c98-d783-4ae7-b5a7-7ed6ac7bc670 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:30.473472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cdc8c98-d783-4ae7-b5a7-7ed6ac7bc670 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:30.474008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cdc8c98-d783-4ae7-b5a7-7ed6ac7bc670 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:30.474498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cdc8c98-d783-4ae7-b5a7-7ed6ac7bc670 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:30.475232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cdc8c98-d783-4ae7-b5a7-7ed6ac7bc670 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:30.475698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cdc8c98-d783-4ae7-b5a7-7ed6ac7bc670 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:30.476141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cdc8c98-d783-4ae7-b5a7-7ed6ac7bc670 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:31.216494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4cdc8c98-d783-4ae7-b5a7-7ed6ac7bc670 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:31.232185 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4cdc8c98-d783-4ae7-b5a7-7ed6ac7bc670 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1608 microversion: 2.1 time: 0.794699 Oct 05 17:59:31.232790 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2284/4835] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:30 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1608 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 17:59:32.281875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d2042ef-33e2-4c20-b4a9-e3ae4af3c4d6 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:32.282999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d2042ef-33e2-4c20-b4a9-e3ae4af3c4d6 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:32.306464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d2042ef-33e2-4c20-b4a9-e3ae4af3c4d6 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:32.310024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d2042ef-33e2-4c20-b4a9-e3ae4af3c4d6 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:32.312391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d2042ef-33e2-4c20-b4a9-e3ae4af3c4d6 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:32.313353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d2042ef-33e2-4c20-b4a9-e3ae4af3c4d6 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:32.316020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d2042ef-33e2-4c20-b4a9-e3ae4af3c4d6 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:32.322651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d2042ef-33e2-4c20-b4a9-e3ae4af3c4d6 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:33.430444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3d2042ef-33e2-4c20-b4a9-e3ae4af3c4d6 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:33.448932 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d2042ef-33e2-4c20-b4a9-e3ae4af3c4d6 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1541 microversion: 2.1 time: 1.171371 Oct 05 17:59:33.465065 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2552/4836] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:32 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1541 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:34.441806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-9a1b051c-5700-4d82-a717-5b49fdfcf761 req-42ced87c-70c3-47f5-9401-d3a2401ce4bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e68811bf-34bf-4dc7-8f52-d445af3b3757", "name": "network-vif-deleted", "tag": "c53ad36e-b5ce-48cf-b1d4-7532b8c53013"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:59:34.456624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:34.462788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9a1b051c-5700-4d82-a717-5b49fdfcf761 req-42ced87c-70c3-47f5-9401-d3a2401ce4bd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:34.463552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9a1b051c-5700-4d82-a717-5b49fdfcf761 req-42ced87c-70c3-47f5-9401-d3a2401ce4bd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:34.464206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9a1b051c-5700-4d82-a717-5b49fdfcf761 req-42ced87c-70c3-47f5-9401-d3a2401ce4bd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:34.474226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-757afde1-802f-4f29-bd57-deb88ed347f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:34.475809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-757afde1-802f-4f29-bd57-deb88ed347f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:34.486583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:34.492610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:34.496903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-757afde1-802f-4f29-bd57-deb88ed347f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:34.502958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-757afde1-802f-4f29-bd57-deb88ed347f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:34.503781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-757afde1-802f-4f29-bd57-deb88ed347f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:34.504938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-757afde1-802f-4f29-bd57-deb88ed347f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:34.505631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-757afde1-802f-4f29-bd57-deb88ed347f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:34.506321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-757afde1-802f-4f29-bd57-deb88ed347f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:34.513407 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9a1b051c-5700-4d82-a717-5b49fdfcf761 req-42ced87c-70c3-47f5-9401-d3a2401ce4bd service nova] Creating event network-vif-deleted:c53ad36e-b5ce-48cf-b1d4-7532b8c53013 for instance e68811bf-34bf-4dc7-8f52-d445af3b3757 on n-h1-835595-3 Oct 05 17:59:34.539656 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-9a1b051c-5700-4d82-a717-5b49fdfcf761 req-42ced87c-70c3-47f5-9401-d3a2401ce4bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102838 Oct 05 17:59:34.541748 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2285/4837] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 17:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 17:59:34.869344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-757afde1-802f-4f29-bd57-deb88ed347f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:34.879128 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-757afde1-802f-4f29-bd57-deb88ed347f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1252 microversion: 2.1 time: 0.410226 Oct 05 17:59:34.889944 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2553/4838] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:34 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1252 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:35.922113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9586c7d0-5dbf-4a4e-acab-df602f0e0feb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:35.924235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9586c7d0-5dbf-4a4e-acab-df602f0e0feb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:35.942868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9586c7d0-5dbf-4a4e-acab-df602f0e0feb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:35.945742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9586c7d0-5dbf-4a4e-acab-df602f0e0feb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:35.948301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9586c7d0-5dbf-4a4e-acab-df602f0e0feb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:35.950471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9586c7d0-5dbf-4a4e-acab-df602f0e0feb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:35.952084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9586c7d0-5dbf-4a4e-acab-df602f0e0feb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:35.952794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9586c7d0-5dbf-4a4e-acab-df602f0e0feb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:36.211922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9586c7d0-5dbf-4a4e-acab-df602f0e0feb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:36.226551 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9586c7d0-5dbf-4a4e-acab-df602f0e0feb tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1252 microversion: 2.1 time: 0.308629 Oct 05 17:59:36.233283 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2286/4839] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:35 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1252 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:37.259729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b8f29e71-e6fb-4806-8b43-64ea64cfa59b tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:37.260617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b8f29e71-e6fb-4806-8b43-64ea64cfa59b tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:37.299521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8f29e71-e6fb-4806-8b43-64ea64cfa59b tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:37.301271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8f29e71-e6fb-4806-8b43-64ea64cfa59b tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:37.302438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8f29e71-e6fb-4806-8b43-64ea64cfa59b tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:37.307301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8f29e71-e6fb-4806-8b43-64ea64cfa59b tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:37.308035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8f29e71-e6fb-4806-8b43-64ea64cfa59b tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:37.309281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8f29e71-e6fb-4806-8b43-64ea64cfa59b tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:37.518119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b8f29e71-e6fb-4806-8b43-64ea64cfa59b tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:37.526860 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b8f29e71-e6fb-4806-8b43-64ea64cfa59b tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1252 microversion: 2.1 time: 0.274524 Oct 05 17:59:37.530496 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2554/4840] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:37 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1252 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:38.555892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8135ae49-926f-4270-9eb5-77ee6d823fc3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:38.556651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8135ae49-926f-4270-9eb5-77ee6d823fc3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:38.570744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:38.576760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8135ae49-926f-4270-9eb5-77ee6d823fc3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:38.585962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8135ae49-926f-4270-9eb5-77ee6d823fc3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:38.586605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8135ae49-926f-4270-9eb5-77ee6d823fc3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:38.587558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8135ae49-926f-4270-9eb5-77ee6d823fc3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:38.588129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8135ae49-926f-4270-9eb5-77ee6d823fc3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:38.599072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8135ae49-926f-4270-9eb5-77ee6d823fc3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:38.998430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8135ae49-926f-4270-9eb5-77ee6d823fc3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:39.011183 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8135ae49-926f-4270-9eb5-77ee6d823fc3 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1252 microversion: 2.1 time: 0.461594 Oct 05 17:59:39.026903 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2287/4841] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:38 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1252 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:40.039869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e8a5338-18e5-441f-90cf-b030aa0de4f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:40.041474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e8a5338-18e5-441f-90cf-b030aa0de4f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:40.055478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8a5338-18e5-441f-90cf-b030aa0de4f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:40.058304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8a5338-18e5-441f-90cf-b030aa0de4f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:40.058875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8a5338-18e5-441f-90cf-b030aa0de4f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:40.060392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8a5338-18e5-441f-90cf-b030aa0de4f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:40.060936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8a5338-18e5-441f-90cf-b030aa0de4f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:40.062474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8a5338-18e5-441f-90cf-b030aa0de4f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:40.424342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4e8a5338-18e5-441f-90cf-b030aa0de4f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:40.440891 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e8a5338-18e5-441f-90cf-b030aa0de4f2 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1252 microversion: 2.1 time: 0.403891 Oct 05 17:59:40.448903 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2555/4842] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:40 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1252 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:41.472847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b5e13b13-d248-4bae-8151-cf3c66dd6cdc tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:41.475060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b5e13b13-d248-4bae-8151-cf3c66dd6cdc tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:41.496199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5e13b13-d248-4bae-8151-cf3c66dd6cdc tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:41.497467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5e13b13-d248-4bae-8151-cf3c66dd6cdc tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:41.498193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5e13b13-d248-4bae-8151-cf3c66dd6cdc tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:41.500878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5e13b13-d248-4bae-8151-cf3c66dd6cdc tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:41.504058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5e13b13-d248-4bae-8151-cf3c66dd6cdc tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:41.505060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5e13b13-d248-4bae-8151-cf3c66dd6cdc tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:41.940989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b5e13b13-d248-4bae-8151-cf3c66dd6cdc tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:41.950664 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b5e13b13-d248-4bae-8151-cf3c66dd6cdc tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1252 microversion: 2.1 time: 0.481679 Oct 05 17:59:41.977230 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2288/4843] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:41 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1252 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:42.991732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2724790-88b7-4e9a-8726-32a15e0a16ec tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:42.992356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c2724790-88b7-4e9a-8726-32a15e0a16ec tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:43.015714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2724790-88b7-4e9a-8726-32a15e0a16ec tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:43.016503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2724790-88b7-4e9a-8726-32a15e0a16ec tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:43.017120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2724790-88b7-4e9a-8726-32a15e0a16ec tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:43.018391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2724790-88b7-4e9a-8726-32a15e0a16ec tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:43.021288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2724790-88b7-4e9a-8726-32a15e0a16ec tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:43.040048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2724790-88b7-4e9a-8726-32a15e0a16ec tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:44.072564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c2724790-88b7-4e9a-8726-32a15e0a16ec tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:44.082171 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2724790-88b7-4e9a-8726-32a15e0a16ec tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1252 microversion: 2.1 time: 1.094811 Oct 05 17:59:44.086886 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2556/4844] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:42 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1252 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:45.117206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:45.117846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:45.132855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:45.138184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:45.139312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:45.141254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:45.148267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:45.151660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:45.282110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:45.283381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:45.285867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:45.287125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lazy-loading 'fault' on Instance uuid e68811bf-34bf-4dc7-8f52-d445af3b3757 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 17:59:45.523491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70e2714f5b5442498655de65ce5de666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537bc13f867c45bba57e4215209ff2a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 17:59:45.539414 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-308b3d90-d274-45ee-a453-b37a69b6e074 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 200 len: 1257 microversion: 2.1 time: 0.429053 Oct 05 17:59:45.542573 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2289/4845] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:45 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 1257 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 17:59:46.569751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:46.570482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] [instance: e68811bf-34bf-4dc7-8f52-d445af3b3757] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 17:59:46.593532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:46.594028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:46.594495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:46.607622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 17:59:46.612406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 17:59:46.613157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 17:59:46.674811 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] HTTP exception thrown: Instance e68811bf-34bf-4dc7-8f52-d445af3b3757 could not be found. Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Request method failure captured: Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 HTTP/1.1 Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcV-C-AkEb4qQpQL04OTS1KwIkbFiWmz_LyL3RiQRWsrNQLveS72uwGpa1JmpStcM-qqwerXlGKvXDdeCFc2to-58PWeaxufW5TifWdDqht5g9xun1Fegnwx7nobaRbDMoEoxOJ1RA19m0VAtEmeSnstI8PGJd0juWS2xlxU73PmDxM Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 537bc13f867c45bba57e4215209ff2a9 Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestBootFromVolume-1422552812 Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/537bc13f867c45bba57e4215209ff2a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/537bc13f867c45bba57e4215209ff2a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_537bc13f867c45bba57e4215209ff2a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/537bc13f867c45bba57e4215209ff2a9"}]}] Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestBootFromVolume-1422552812 Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 537bc13f867c45bba57e4215209ff2a9 Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1422552812 Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestBootFromVolume-1422552812-project Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 70e2714f5b5442498655de65ce5de666 Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestBootFromVolume-1422552812-project Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e68811bf-34bf-4dc7-8f52-d445af3b3757 could not be found. Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e68811bf-34bf-4dc7-8f52-d445af3b3757'} Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e68811bf-34bf-4dc7-8f52-d445af3b3757 could not be found. Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e68811bf-34bf-4dc7-8f52-d445af3b3757 could not be found. Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 17:59:46.676871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:59:46.681823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 17:59:46.681823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 17:59:46.681823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 17:59:46.681823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 17:59:46.681823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 17:59:46.681823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e68811bf-34bf-4dc7-8f52-d445af3b3757 could not be found. Oct 05 17:59:46.681823 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 17:59:46.685956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Returning 404 to user: Instance e68811bf-34bf-4dc7-8f52-d445af3b3757 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 17:59:46.688285 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c8d67f1f-83b5-4e17-9c56-b392cd1d4f13 tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757" status: 404 len: 111 microversion: 2.1 time: 0.123811 Oct 05 17:59:46.690062 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2557/4846] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 17:59:46 2022] GET /compute/v2.1/servers/e68811bf-34bf-4dc7-8f52-d445af3b3757 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 17:59:46.714294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fb00a01b-92ae-42a0-8d10-8b7847e01e5d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] Calling method '.version_select at 0x7f7774d6edc0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 17:59:46.786822 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fb00a01b-92ae-42a0-8d10-8b7847e01e5d tempest-ServersTestBootFromVolume-1422552812 tempest-ServersTestBootFromVolume-1422552812-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170756101" status: 202 len: 0 microversion: 2.1 time: 0.079431 Oct 05 17:59:46.791335 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2290/4847] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 17:59:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1170756101 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 17:59:57.565419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1940184119", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "2e9177a8-f385-4550-83d9-27751b7f7ed5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-119614768", "security_groups": [{"name": "tempest-secgroup-smoke-1175152586"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 17:59:57.585522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:57.587095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 17:59:58.727836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] validate_networks() for [('2e9177a8-f385-4550-83d9-27751b7f7ed5', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:00:04.662444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:00:04.663357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:00:04.665640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:00:04.666378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:00:04.667076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:00:04.708265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:04.709115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:04.730134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:04.731771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:04.733151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:04.733985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:04.816548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:00:04.830712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for user 06d379a97d474b74a29e62848a4e4696 and project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:00:04.849240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1886895660", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "864e1b11-de58-4912-8820-e91615fce639"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:04.900047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:00:04.905042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:00:04.931522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=48 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:04.934796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:04.937149 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:00:04.937654 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.70) !!! Oct 05 18:00:05.050727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] validate_networks() for [('864e1b11-de58-4912-8820-e91615fce639', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:00:05.145760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c5a5c43a-a09c-4878-8348-6b37d3069698 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 7.585277 Oct 05 18:00:05.147759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2558/4848] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 17:59:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 7589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:00:05.185488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a22e71f-c0fb-467b-8582-9ea44d508448 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:05.187608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1a22e71f-c0fb-467b-8582-9ea44d508448 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:05.357707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1a22e71f-c0fb-467b-8582-9ea44d508448 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:05.370451 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1a22e71f-c0fb-467b-8582-9ea44d508448 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1266 microversion: 2.1 time: 0.214046 Oct 05 18:00:05.373773 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2559/4849] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:05 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:06.399067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6ff885f-46c9-455d-8753-6975f7df0359 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:06.403925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c6ff885f-46c9-455d-8753-6975f7df0359 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:06.799676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c6ff885f-46c9-455d-8753-6975f7df0359 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:06.815911 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c6ff885f-46c9-455d-8753-6975f7df0359 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1266 microversion: 2.1 time: 0.412985 Oct 05 18:00:06.834114 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2560/4850] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:06 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1266 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:07.849867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6cef1a3f-fc3b-4ad2-80c8-83f849bb0a7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:07.850662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6cef1a3f-fc3b-4ad2-80c8-83f849bb0a7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:07.874287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cef1a3f-fc3b-4ad2-80c8-83f849bb0a7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:07.879065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cef1a3f-fc3b-4ad2-80c8-83f849bb0a7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:07.881688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cef1a3f-fc3b-4ad2-80c8-83f849bb0a7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:07.883894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cef1a3f-fc3b-4ad2-80c8-83f849bb0a7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:07.885224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cef1a3f-fc3b-4ad2-80c8-83f849bb0a7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:07.887497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6cef1a3f-fc3b-4ad2-80c8-83f849bb0a7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:07.993328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:00:07.993835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:00:07.994197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:00:07.994637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:00:07.995051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:00:08.016745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:08.017238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:08.023943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:08.025049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:08.025743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:08.035076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:08.075606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Getting quotas for project dbe08ff0f6ae4de2b0f29978c2f82bd3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:00:08.081729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Getting quotas for user 4892ca792aab4b2fafd3eea8188a706a and project dbe08ff0f6ae4de2b0f29978c2f82bd3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:00:08.095154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:00:08.097776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:00:08.189505 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4696f3c-b3e2-4d4a-b60c-9cb1a9c40bc3 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.350928 Oct 05 18:00:08.196474 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2291/4851] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:00:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:00:08.210378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a465197-0857-43ad-a6ea-76d7cda53a96 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:08.226501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a465197-0857-43ad-a6ea-76d7cda53a96 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:08.365374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a465197-0857-43ad-a6ea-76d7cda53a96 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:08.386475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6cef1a3f-fc3b-4ad2-80c8-83f849bb0a7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:08.392352 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a465197-0857-43ad-a6ea-76d7cda53a96 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1219 microversion: 2.1 time: 0.172706 Oct 05 18:00:08.393910 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2292/4852] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:08 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1219 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:08.420802 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6cef1a3f-fc3b-4ad2-80c8-83f849bb0a7b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1336 microversion: 2.1 time: 0.579297 Oct 05 18:00:08.438931 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2561/4853] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:07 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1336 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:09.425168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c58403ef-5c37-4d3a-ae20-58f15dadf087 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:09.427085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c58403ef-5c37-4d3a-ae20-58f15dadf087 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:09.445874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-439f97b2-1584-4db2-9fca-ee5ad8ee50a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:09.446581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-439f97b2-1584-4db2-9fca-ee5ad8ee50a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:09.449186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58403ef-5c37-4d3a-ae20-58f15dadf087 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:09.449691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58403ef-5c37-4d3a-ae20-58f15dadf087 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:09.454921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58403ef-5c37-4d3a-ae20-58f15dadf087 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:09.455697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58403ef-5c37-4d3a-ae20-58f15dadf087 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:09.456376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58403ef-5c37-4d3a-ae20-58f15dadf087 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:09.456956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c58403ef-5c37-4d3a-ae20-58f15dadf087 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:09.470985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-439f97b2-1584-4db2-9fca-ee5ad8ee50a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:09.471695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-439f97b2-1584-4db2-9fca-ee5ad8ee50a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:09.472156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-439f97b2-1584-4db2-9fca-ee5ad8ee50a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:09.472915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-439f97b2-1584-4db2-9fca-ee5ad8ee50a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:09.473383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-439f97b2-1584-4db2-9fca-ee5ad8ee50a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:09.473815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-439f97b2-1584-4db2-9fca-ee5ad8ee50a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:09.751244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c58403ef-5c37-4d3a-ae20-58f15dadf087 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:09.751860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-439f97b2-1584-4db2-9fca-ee5ad8ee50a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:09.767297 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c58403ef-5c37-4d3a-ae20-58f15dadf087 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1215 microversion: 2.1 time: 0.347686 Oct 05 18:00:09.773205 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-439f97b2-1584-4db2-9fca-ee5ad8ee50a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1324 microversion: 2.1 time: 0.331767 Oct 05 18:00:09.775757 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2293/4854] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:09 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1215 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:09.780341 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2562/4855] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:09 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:10.810496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-825b22af-9c5d-4bba-a7f1-4765fec6c74a tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:10.811122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-825b22af-9c5d-4bba-a7f1-4765fec6c74a tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:10.819317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a52c368d-ba61-4eb3-bd1a-20deacf4f6e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:10.820129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a52c368d-ba61-4eb3-bd1a-20deacf4f6e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:10.832928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52c368d-ba61-4eb3-bd1a-20deacf4f6e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:10.832928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52c368d-ba61-4eb3-bd1a-20deacf4f6e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:10.832928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52c368d-ba61-4eb3-bd1a-20deacf4f6e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:10.832928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52c368d-ba61-4eb3-bd1a-20deacf4f6e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:10.832928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52c368d-ba61-4eb3-bd1a-20deacf4f6e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:10.832928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52c368d-ba61-4eb3-bd1a-20deacf4f6e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:10.837003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-825b22af-9c5d-4bba-a7f1-4765fec6c74a tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:10.837501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-825b22af-9c5d-4bba-a7f1-4765fec6c74a tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:10.837996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-825b22af-9c5d-4bba-a7f1-4765fec6c74a tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:10.838672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-825b22af-9c5d-4bba-a7f1-4765fec6c74a tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:10.839121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-825b22af-9c5d-4bba-a7f1-4765fec6c74a tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:10.839543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-825b22af-9c5d-4bba-a7f1-4765fec6c74a tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:11.208892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-825b22af-9c5d-4bba-a7f1-4765fec6c74a tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:11.222623 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-825b22af-9c5d-4bba-a7f1-4765fec6c74a tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1277 microversion: 2.1 time: 0.415980 Oct 05 18:00:11.223377 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2294/4856] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:10 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1277 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:12.077479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a52c368d-ba61-4eb3-bd1a-20deacf4f6e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:12.092231 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a52c368d-ba61-4eb3-bd1a-20deacf4f6e7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1392 microversion: 2.1 time: 1.275633 Oct 05 18:00:12.102807 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2563/4857] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:10 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1392 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:12.250147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-20a910cf-f71b-4b94-9995-0875327084a6 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:12.250864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-20a910cf-f71b-4b94-9995-0875327084a6 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:12.264153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20a910cf-f71b-4b94-9995-0875327084a6 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:12.267500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20a910cf-f71b-4b94-9995-0875327084a6 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:12.268743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20a910cf-f71b-4b94-9995-0875327084a6 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:12.270969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20a910cf-f71b-4b94-9995-0875327084a6 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:12.273332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20a910cf-f71b-4b94-9995-0875327084a6 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:12.274116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20a910cf-f71b-4b94-9995-0875327084a6 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:13.141203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a4a72a8a-cf03-4e0f-8d86-c6c9762eaab4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:13.147256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a4a72a8a-cf03-4e0f-8d86-c6c9762eaab4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:13.162178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a72a8a-cf03-4e0f-8d86-c6c9762eaab4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:13.168844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a72a8a-cf03-4e0f-8d86-c6c9762eaab4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:13.177643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a72a8a-cf03-4e0f-8d86-c6c9762eaab4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:13.184578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a72a8a-cf03-4e0f-8d86-c6c9762eaab4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:13.185346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a72a8a-cf03-4e0f-8d86-c6c9762eaab4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:13.186064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a72a8a-cf03-4e0f-8d86-c6c9762eaab4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:13.873951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-20a910cf-f71b-4b94-9995-0875327084a6 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:13.888735 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-20a910cf-f71b-4b94-9995-0875327084a6 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1319 microversion: 2.1 time: 1.643134 Oct 05 18:00:13.890904 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2295/4858] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:12 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1319 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:14.022381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a4a72a8a-cf03-4e0f-8d86-c6c9762eaab4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:14.047489 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a4a72a8a-cf03-4e0f-8d86-c6c9762eaab4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1392 microversion: 2.1 time: 0.915335 Oct 05 18:00:14.055998 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2564/4859] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:13 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1392 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:14.395400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a7dc89d1-f06b-4dfd-8bb3-5299a3c89914 req-980e2155-626f-45f4-ac76-b138d914c267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86acc933-de7c-46d4-83a9-e27cd3be3862", "tag": "77af47bc-66b5-4636-aca9-3a61a8db6572"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:14.430032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a7dc89d1-f06b-4dfd-8bb3-5299a3c89914 req-980e2155-626f-45f4-ac76-b138d914c267 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:14.432087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a7dc89d1-f06b-4dfd-8bb3-5299a3c89914 req-980e2155-626f-45f4-ac76-b138d914c267 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:14.434204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a7dc89d1-f06b-4dfd-8bb3-5299a3c89914 req-980e2155-626f-45f4-ac76-b138d914c267 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:14.465200 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a7dc89d1-f06b-4dfd-8bb3-5299a3c89914 req-980e2155-626f-45f4-ac76-b138d914c267 service nova] Creating event network-changed:77af47bc-66b5-4636-aca9-3a61a8db6572 for instance 86acc933-de7c-46d4-83a9-e27cd3be3862 on n-h1-835595-3 Oct 05 18:00:14.478732 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a7dc89d1-f06b-4dfd-8bb3-5299a3c89914 req-980e2155-626f-45f4-ac76-b138d914c267 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086791 Oct 05 18:00:14.479810 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2296/4860] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:00:14.920295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4ea929b5-58b2-4650-9ccd-1fa2c2dff591 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:14.920916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4ea929b5-58b2-4650-9ccd-1fa2c2dff591 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:14.931922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:14.940890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ea929b5-58b2-4650-9ccd-1fa2c2dff591 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:14.944336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ea929b5-58b2-4650-9ccd-1fa2c2dff591 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:14.944961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ea929b5-58b2-4650-9ccd-1fa2c2dff591 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:14.946775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ea929b5-58b2-4650-9ccd-1fa2c2dff591 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:14.949415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ea929b5-58b2-4650-9ccd-1fa2c2dff591 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:14.950066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ea929b5-58b2-4650-9ccd-1fa2c2dff591 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:15.083386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-68beea13-2acb-4e57-9e1d-32d33bf0edc9 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:15.084970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-68beea13-2acb-4e57-9e1d-32d33bf0edc9 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:15.095123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68beea13-2acb-4e57-9e1d-32d33bf0edc9 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:15.095618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68beea13-2acb-4e57-9e1d-32d33bf0edc9 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:15.096286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68beea13-2acb-4e57-9e1d-32d33bf0edc9 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:15.097181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68beea13-2acb-4e57-9e1d-32d33bf0edc9 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:15.097809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68beea13-2acb-4e57-9e1d-32d33bf0edc9 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:15.098995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68beea13-2acb-4e57-9e1d-32d33bf0edc9 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:15.344109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4ea929b5-58b2-4650-9ccd-1fa2c2dff591 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:15.363484 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4ea929b5-58b2-4650-9ccd-1fa2c2dff591 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1319 microversion: 2.1 time: 0.447745 Oct 05 18:00:15.369331 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2565/4861] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:14 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:15.665961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-68beea13-2acb-4e57-9e1d-32d33bf0edc9 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:15.686946 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-68beea13-2acb-4e57-9e1d-32d33bf0edc9 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1392 microversion: 2.1 time: 0.610181 Oct 05 18:00:15.687599 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2297/4862] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:15 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1392 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:16.402104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-98e44e67-153c-43b0-a9cd-de056f795471 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:16.403158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-98e44e67-153c-43b0-a9cd-de056f795471 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:16.420194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98e44e67-153c-43b0-a9cd-de056f795471 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:16.423407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98e44e67-153c-43b0-a9cd-de056f795471 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:16.424863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98e44e67-153c-43b0-a9cd-de056f795471 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:16.426324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98e44e67-153c-43b0-a9cd-de056f795471 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:16.428481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98e44e67-153c-43b0-a9cd-de056f795471 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:16.430062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98e44e67-153c-43b0-a9cd-de056f795471 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:16.721536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ccd23096-70dd-4ae3-914c-b3f0f4eae3d0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:16.722696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ccd23096-70dd-4ae3-914c-b3f0f4eae3d0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:16.734376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccd23096-70dd-4ae3-914c-b3f0f4eae3d0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:16.741004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccd23096-70dd-4ae3-914c-b3f0f4eae3d0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:16.743318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccd23096-70dd-4ae3-914c-b3f0f4eae3d0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:16.744270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccd23096-70dd-4ae3-914c-b3f0f4eae3d0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:16.745273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccd23096-70dd-4ae3-914c-b3f0f4eae3d0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:16.745965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccd23096-70dd-4ae3-914c-b3f0f4eae3d0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:16.804476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=10 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:17.398246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ccd23096-70dd-4ae3-914c-b3f0f4eae3d0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:17.412490 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ccd23096-70dd-4ae3-914c-b3f0f4eae3d0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1392 microversion: 2.1 time: 0.694795 Oct 05 18:00:17.413794 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2298/4863] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:16 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1392 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:17.428731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-35af9873-8165-42fd-b6fc-b8301ff48547 req-fd325978-4e9f-49ed-aad2-2ad0b4f012f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d259fb4-b583-48fb-acd0-f7a360848cff", "tag": "add13fde-06d4-4349-be8f-7eca46986bc8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:17.451518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-35af9873-8165-42fd-b6fc-b8301ff48547 req-fd325978-4e9f-49ed-aad2-2ad0b4f012f2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:17.458880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-35af9873-8165-42fd-b6fc-b8301ff48547 req-fd325978-4e9f-49ed-aad2-2ad0b4f012f2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:17.462526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-35af9873-8165-42fd-b6fc-b8301ff48547 req-fd325978-4e9f-49ed-aad2-2ad0b4f012f2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:17.497382 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-35af9873-8165-42fd-b6fc-b8301ff48547 req-fd325978-4e9f-49ed-aad2-2ad0b4f012f2 service nova] Creating event network-changed:add13fde-06d4-4349-be8f-7eca46986bc8 for instance 3d259fb4-b583-48fb-acd0-f7a360848cff on n-h2-835595-3 Oct 05 18:00:17.512387 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-35af9873-8165-42fd-b6fc-b8301ff48547 req-fd325978-4e9f-49ed-aad2-2ad0b4f012f2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092249 Oct 05 18:00:17.513757 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2299/4864] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:00:18.324226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-98e44e67-153c-43b0-a9cd-de056f795471 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:18.336231 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-98e44e67-153c-43b0-a9cd-de056f795471 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1319 microversion: 2.1 time: 1.943274 Oct 05 18:00:18.340759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2566/4865] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:16 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1319 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:18.438077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5840317-8a0c-4262-9400-63d14f28ba83 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:18.438817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5840317-8a0c-4262-9400-63d14f28ba83 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:18.442712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:18.448037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:18.467547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5840317-8a0c-4262-9400-63d14f28ba83 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:18.471751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5840317-8a0c-4262-9400-63d14f28ba83 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:18.472508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5840317-8a0c-4262-9400-63d14f28ba83 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:18.473711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5840317-8a0c-4262-9400-63d14f28ba83 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:18.476052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5840317-8a0c-4262-9400-63d14f28ba83 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:18.476703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5840317-8a0c-4262-9400-63d14f28ba83 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:18.807597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c5840317-8a0c-4262-9400-63d14f28ba83 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:18.817543 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c5840317-8a0c-4262-9400-63d14f28ba83 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1392 microversion: 2.1 time: 0.383912 Oct 05 18:00:18.825277 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2300/4866] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:18 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1392 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:19.366708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b0dee86-6111-4af9-a237-91a586d27a70 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:19.367355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b0dee86-6111-4af9-a237-91a586d27a70 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:19.388643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b0dee86-6111-4af9-a237-91a586d27a70 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:19.389077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b0dee86-6111-4af9-a237-91a586d27a70 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:19.391614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b0dee86-6111-4af9-a237-91a586d27a70 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:19.394137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b0dee86-6111-4af9-a237-91a586d27a70 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:19.394846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b0dee86-6111-4af9-a237-91a586d27a70 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:19.395868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b0dee86-6111-4af9-a237-91a586d27a70 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:19.734359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b0dee86-6111-4af9-a237-91a586d27a70 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:19.748570 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b0dee86-6111-4af9-a237-91a586d27a70 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1319 microversion: 2.1 time: 0.384454 Oct 05 18:00:19.749564 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2567/4867] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:19 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1319 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:19.856032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-786f1c88-563e-49e5-9268-b25496ba577d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:19.856759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-786f1c88-563e-49e5-9268-b25496ba577d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:19.877578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-786f1c88-563e-49e5-9268-b25496ba577d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:19.878736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-786f1c88-563e-49e5-9268-b25496ba577d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:19.880012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-786f1c88-563e-49e5-9268-b25496ba577d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:19.884190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-786f1c88-563e-49e5-9268-b25496ba577d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:19.885364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-786f1c88-563e-49e5-9268-b25496ba577d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:19.886550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-786f1c88-563e-49e5-9268-b25496ba577d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:20.585544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-786f1c88-563e-49e5-9268-b25496ba577d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:20.594233 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-786f1c88-563e-49e5-9268-b25496ba577d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1392 microversion: 2.1 time: 0.742701 Oct 05 18:00:20.594868 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2301/4868] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:19 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1392 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:20.775444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-45fb16e0-6d75-4e34-a649-e96928a46b6e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:20.776117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-45fb16e0-6d75-4e34-a649-e96928a46b6e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:20.792154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45fb16e0-6d75-4e34-a649-e96928a46b6e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:20.792661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45fb16e0-6d75-4e34-a649-e96928a46b6e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:20.793108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45fb16e0-6d75-4e34-a649-e96928a46b6e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:20.793831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45fb16e0-6d75-4e34-a649-e96928a46b6e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:20.794320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45fb16e0-6d75-4e34-a649-e96928a46b6e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:20.794753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45fb16e0-6d75-4e34-a649-e96928a46b6e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:21.326482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b069f9b3-db8b-455f-b27e-6fae16bfcfab req-66c33409-6949-4e42-bebe-a529d49be7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86acc933-de7c-46d4-83a9-e27cd3be3862", "name": "network-vif-plugged", "status": "completed", "tag": "77af47bc-66b5-4636-aca9-3a61a8db6572"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:21.339431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b069f9b3-db8b-455f-b27e-6fae16bfcfab req-66c33409-6949-4e42-bebe-a529d49be7b1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:21.352508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b069f9b3-db8b-455f-b27e-6fae16bfcfab req-66c33409-6949-4e42-bebe-a529d49be7b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:21.353207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b069f9b3-db8b-455f-b27e-6fae16bfcfab req-66c33409-6949-4e42-bebe-a529d49be7b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:21.384785 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b069f9b3-db8b-455f-b27e-6fae16bfcfab req-66c33409-6949-4e42-bebe-a529d49be7b1 service nova] Creating event network-vif-plugged:77af47bc-66b5-4636-aca9-3a61a8db6572 for instance 86acc933-de7c-46d4-83a9-e27cd3be3862 on n-h1-835595-3 Oct 05 18:00:21.395952 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b069f9b3-db8b-455f-b27e-6fae16bfcfab req-66c33409-6949-4e42-bebe-a529d49be7b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073079 Oct 05 18:00:21.399467 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2302/4869] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:00:21.618212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-22ec4ff7-c5a4-4615-bf37-032997753039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:21.618957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-22ec4ff7-c5a4-4615-bf37-032997753039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:21.631389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ec4ff7-c5a4-4615-bf37-032997753039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:21.631879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ec4ff7-c5a4-4615-bf37-032997753039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:21.632379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ec4ff7-c5a4-4615-bf37-032997753039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:21.633089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ec4ff7-c5a4-4615-bf37-032997753039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:21.633607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ec4ff7-c5a4-4615-bf37-032997753039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:21.634031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ec4ff7-c5a4-4615-bf37-032997753039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:22.089788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-22ec4ff7-c5a4-4615-bf37-032997753039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:22.097954 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-22ec4ff7-c5a4-4615-bf37-032997753039 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1392 microversion: 2.1 time: 0.484232 Oct 05 18:00:22.098614 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2303/4870] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:21 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1392 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:22.463748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-45fb16e0-6d75-4e34-a649-e96928a46b6e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:22.473911 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-45fb16e0-6d75-4e34-a649-e96928a46b6e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1319 microversion: 2.1 time: 1.702298 Oct 05 18:00:22.477273 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2568/4871] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:20 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1319 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:23.124798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a2eb9028-dcea-45e5-aeae-b312a7a4cae5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:23.125426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a2eb9028-dcea-45e5-aeae-b312a7a4cae5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:23.134772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2eb9028-dcea-45e5-aeae-b312a7a4cae5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:23.135115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2eb9028-dcea-45e5-aeae-b312a7a4cae5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:23.135556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2eb9028-dcea-45e5-aeae-b312a7a4cae5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:23.136274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2eb9028-dcea-45e5-aeae-b312a7a4cae5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:23.136739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2eb9028-dcea-45e5-aeae-b312a7a4cae5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:23.137176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2eb9028-dcea-45e5-aeae-b312a7a4cae5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:23.503326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fbf59790-2ae1-47fe-b3c5-5b0beed901a2 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:23.504748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fbf59790-2ae1-47fe-b3c5-5b0beed901a2 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:23.517041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbf59790-2ae1-47fe-b3c5-5b0beed901a2 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:23.519896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbf59790-2ae1-47fe-b3c5-5b0beed901a2 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:23.520620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbf59790-2ae1-47fe-b3c5-5b0beed901a2 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:23.523121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbf59790-2ae1-47fe-b3c5-5b0beed901a2 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:23.525204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbf59790-2ae1-47fe-b3c5-5b0beed901a2 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:23.527879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fbf59790-2ae1-47fe-b3c5-5b0beed901a2 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:23.647947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a2eb9028-dcea-45e5-aeae-b312a7a4cae5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:23.667840 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a2eb9028-dcea-45e5-aeae-b312a7a4cae5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1392 microversion: 2.1 time: 0.541903 Oct 05 18:00:23.670267 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2304/4872] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:23 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1392 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:23.686082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-8616e250-f202-45f3-ad97-ed6d6b235bd0 req-9bd1c503-9f2f-44fe-9ae1-31ab9e212f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d259fb4-b583-48fb-acd0-f7a360848cff", "name": "network-vif-plugged", "status": "completed", "tag": "add13fde-06d4-4349-be8f-7eca46986bc8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:23.689201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8616e250-f202-45f3-ad97-ed6d6b235bd0 req-9bd1c503-9f2f-44fe-9ae1-31ab9e212f0d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:23.689695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8616e250-f202-45f3-ad97-ed6d6b235bd0 req-9bd1c503-9f2f-44fe-9ae1-31ab9e212f0d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:23.690186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8616e250-f202-45f3-ad97-ed6d6b235bd0 req-9bd1c503-9f2f-44fe-9ae1-31ab9e212f0d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:23.702744 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-8616e250-f202-45f3-ad97-ed6d6b235bd0 req-9bd1c503-9f2f-44fe-9ae1-31ab9e212f0d service nova] Creating event network-vif-plugged:add13fde-06d4-4349-be8f-7eca46986bc8 for instance 3d259fb4-b583-48fb-acd0-f7a360848cff on n-h2-835595-3 Oct 05 18:00:23.708141 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-8616e250-f202-45f3-ad97-ed6d6b235bd0 req-9bd1c503-9f2f-44fe-9ae1-31ab9e212f0d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036554 Oct 05 18:00:23.709258 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2305/4873] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:00:24.000755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fbf59790-2ae1-47fe-b3c5-5b0beed901a2 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:24.015486 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fbf59790-2ae1-47fe-b3c5-5b0beed901a2 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1319 microversion: 2.1 time: 0.515723 Oct 05 18:00:24.018347 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2569/4874] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:23 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1319 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:24.695173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-50f4944c-0f92-489e-9443-79138692d433 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:24.696639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-50f4944c-0f92-489e-9443-79138692d433 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:24.719319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f4944c-0f92-489e-9443-79138692d433 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:24.720143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f4944c-0f92-489e-9443-79138692d433 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:24.720593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f4944c-0f92-489e-9443-79138692d433 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:24.721344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f4944c-0f92-489e-9443-79138692d433 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:24.721810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f4944c-0f92-489e-9443-79138692d433 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:24.722992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50f4944c-0f92-489e-9443-79138692d433 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:25.043224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a15f720c-da6d-49d1-801b-b0ccedf335f7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:25.043841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a15f720c-da6d-49d1-801b-b0ccedf335f7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:25.074184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a15f720c-da6d-49d1-801b-b0ccedf335f7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:25.078383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a15f720c-da6d-49d1-801b-b0ccedf335f7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:25.082720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a15f720c-da6d-49d1-801b-b0ccedf335f7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:25.083885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a15f720c-da6d-49d1-801b-b0ccedf335f7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:25.090976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a15f720c-da6d-49d1-801b-b0ccedf335f7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:25.092914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a15f720c-da6d-49d1-801b-b0ccedf335f7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:25.651539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50f4944c-0f92-489e-9443-79138692d433 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:25.663786 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-50f4944c-0f92-489e-9443-79138692d433 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1564 microversion: 2.1 time: 0.973761 Oct 05 18:00:25.665511 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2306/4875] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:24 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1564 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:25.695577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dd7c3976-7cbb-4c5d-974a-b14e6feda0f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:25.696310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dd7c3976-7cbb-4c5d-974a-b14e6feda0f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:25.722093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd7c3976-7cbb-4c5d-974a-b14e6feda0f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:25.725423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd7c3976-7cbb-4c5d-974a-b14e6feda0f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:25.725877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd7c3976-7cbb-4c5d-974a-b14e6feda0f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:25.728846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd7c3976-7cbb-4c5d-974a-b14e6feda0f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:25.729476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd7c3976-7cbb-4c5d-974a-b14e6feda0f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:25.729764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd7c3976-7cbb-4c5d-974a-b14e6feda0f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:26.056273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a15f720c-da6d-49d1-801b-b0ccedf335f7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:26.078556 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a15f720c-da6d-49d1-801b-b0ccedf335f7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1319 microversion: 2.1 time: 1.039018 Oct 05 18:00:26.083311 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2570/4876] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:25 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1319 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:26.536959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dd7c3976-7cbb-4c5d-974a-b14e6feda0f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:26.549499 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dd7c3976-7cbb-4c5d-974a-b14e6feda0f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1564 microversion: 2.1 time: 0.860715 Oct 05 18:00:26.550115 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2307/4877] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:25 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1564 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:27.106788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8ae4b4e-1888-46f5-84a4-a40a84c486fd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:27.108540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c8ae4b4e-1888-46f5-84a4-a40a84c486fd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:27.125939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8ae4b4e-1888-46f5-84a4-a40a84c486fd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:27.129157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8ae4b4e-1888-46f5-84a4-a40a84c486fd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:27.129895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8ae4b4e-1888-46f5-84a4-a40a84c486fd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:27.131013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8ae4b4e-1888-46f5-84a4-a40a84c486fd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:27.133265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8ae4b4e-1888-46f5-84a4-a40a84c486fd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:27.134106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8ae4b4e-1888-46f5-84a4-a40a84c486fd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:27.733771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8ae4b4e-1888-46f5-84a4-a40a84c486fd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:27.736422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=67 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:27.748240 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c8ae4b4e-1888-46f5-84a4-a40a84c486fd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1508 microversion: 2.1 time: 0.644054 Oct 05 18:00:27.753262 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2571/4878] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:27 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1508 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:33.703751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-368800285", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:33.904201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] validate_networks() for [('7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:00:35.144336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:00:35.145522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:00:35.146189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:00:35.147103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:00:35.148208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:00:35.154938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:35.167590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:35.171540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:35.172350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:35.174083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:35.176000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:35.177476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:35.209386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=77 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:35.238657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:00:35.252001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for user 9ea1c284fc254cc7a51d9e67d4fe8168 and project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:00:35.296313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:00:35.299879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:00:35.464867 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4de9760-163f-4d6b-958d-cbd646491076 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.165436 Oct 05 18:00:35.475421 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2308/4879] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:00:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:00:35.480163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30ed93cc-43d4-4107-a007-ff7c703ae9fa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:35.480856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-30ed93cc-43d4-4107-a007-ff7c703ae9fa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:35.504949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:35.704160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-30ed93cc-43d4-4107-a007-ff7c703ae9fa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:35.733937 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-30ed93cc-43d4-4107-a007-ff7c703ae9fa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1214 microversion: 2.1 time: 0.260390 Oct 05 18:00:35.735509 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2572/4880] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:35 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1214 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:36.761550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ac85cde-93b6-4c04-ac35-a197a9d36412 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:36.762174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ac85cde-93b6-4c04-ac35-a197a9d36412 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:36.788553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ac85cde-93b6-4c04-ac35-a197a9d36412 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:36.789179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ac85cde-93b6-4c04-ac35-a197a9d36412 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:36.789738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ac85cde-93b6-4c04-ac35-a197a9d36412 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:36.793289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ac85cde-93b6-4c04-ac35-a197a9d36412 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:36.798149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ac85cde-93b6-4c04-ac35-a197a9d36412 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:36.798845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ac85cde-93b6-4c04-ac35-a197a9d36412 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:37.036346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e427980-468a-4f47-acf2-a63d07b3ac20 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:37.037398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5e427980-468a-4f47-acf2-a63d07b3ac20 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:37.064309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e427980-468a-4f47-acf2-a63d07b3ac20 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:37.065584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e427980-468a-4f47-acf2-a63d07b3ac20 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:37.072843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e427980-468a-4f47-acf2-a63d07b3ac20 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:37.073993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e427980-468a-4f47-acf2-a63d07b3ac20 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:37.081236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e427980-468a-4f47-acf2-a63d07b3ac20 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:37.088542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e427980-468a-4f47-acf2-a63d07b3ac20 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:37.204893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3ac85cde-93b6-4c04-ac35-a197a9d36412 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:37.219276 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ac85cde-93b6-4c04-ac35-a197a9d36412 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1218 microversion: 2.1 time: 0.463176 Oct 05 18:00:37.262060 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2309/4881] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:36 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1218 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:37.298520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ba31a7e4-7be8-4659-b12c-4a3d6803776e req-4ec37a82-f57b-4ace-b19a-b8f7ffe26aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86acc933-de7c-46d4-83a9-e27cd3be3862", "tag": "77af47bc-66b5-4636-aca9-3a61a8db6572"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:37.377781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ba31a7e4-7be8-4659-b12c-4a3d6803776e req-4ec37a82-f57b-4ace-b19a-b8f7ffe26aaa service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:37.379739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ba31a7e4-7be8-4659-b12c-4a3d6803776e req-4ec37a82-f57b-4ace-b19a-b8f7ffe26aaa service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:37.380196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ba31a7e4-7be8-4659-b12c-4a3d6803776e req-4ec37a82-f57b-4ace-b19a-b8f7ffe26aaa service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:37.465534 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ba31a7e4-7be8-4659-b12c-4a3d6803776e req-4ec37a82-f57b-4ace-b19a-b8f7ffe26aaa service nova] Creating event network-changed:77af47bc-66b5-4636-aca9-3a61a8db6572 for instance 86acc933-de7c-46d4-83a9-e27cd3be3862 on n-h1-835595-3 Oct 05 18:00:37.481396 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ba31a7e4-7be8-4659-b12c-4a3d6803776e req-4ec37a82-f57b-4ace-b19a-b8f7ffe26aaa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213497 Oct 05 18:00:37.484523 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2310/4882] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:00:37.510646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5e427980-468a-4f47-acf2-a63d07b3ac20 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:37.532974 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e427980-468a-4f47-acf2-a63d07b3ac20 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1564 microversion: 2.1 time: 0.494212 Oct 05 18:00:37.536089 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2573/4883] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:37 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1564 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:38.244625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b00a9a6-cdd2-4ac4-93b8-09e3534df620 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:38.246721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b00a9a6-cdd2-4ac4-93b8-09e3534df620 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:38.261316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b00a9a6-cdd2-4ac4-93b8-09e3534df620 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:38.262038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b00a9a6-cdd2-4ac4-93b8-09e3534df620 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:38.263396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b00a9a6-cdd2-4ac4-93b8-09e3534df620 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:38.264316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b00a9a6-cdd2-4ac4-93b8-09e3534df620 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:38.265806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b00a9a6-cdd2-4ac4-93b8-09e3534df620 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:38.267112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b00a9a6-cdd2-4ac4-93b8-09e3534df620 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:38.739965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b00a9a6-cdd2-4ac4-93b8-09e3534df620 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:38.760179 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b00a9a6-cdd2-4ac4-93b8-09e3534df620 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1272 microversion: 2.1 time: 0.518787 Oct 05 18:00:38.785632 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2311/4884] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:38 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1272 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:39.791977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e3c6c5fb-6d45-434f-b805-08d4afdb6586 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:39.793224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e3c6c5fb-6d45-434f-b805-08d4afdb6586 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:39.809455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3c6c5fb-6d45-434f-b805-08d4afdb6586 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:39.816840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3c6c5fb-6d45-434f-b805-08d4afdb6586 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:39.817492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3c6c5fb-6d45-434f-b805-08d4afdb6586 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:39.818452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3c6c5fb-6d45-434f-b805-08d4afdb6586 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:39.819084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3c6c5fb-6d45-434f-b805-08d4afdb6586 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:39.819707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3c6c5fb-6d45-434f-b805-08d4afdb6586 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:40.064057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e3c6c5fb-6d45-434f-b805-08d4afdb6586 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:40.080742 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e3c6c5fb-6d45-434f-b805-08d4afdb6586 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1272 microversion: 2.1 time: 0.290132 Oct 05 18:00:40.082076 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2574/4885] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:39 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1272 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:41.108026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-004ec0e1-5285-4098-b52b-474100633993 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:41.109319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-004ec0e1-5285-4098-b52b-474100633993 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:41.127341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-004ec0e1-5285-4098-b52b-474100633993 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:41.128172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-004ec0e1-5285-4098-b52b-474100633993 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:41.128966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-004ec0e1-5285-4098-b52b-474100633993 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:41.130994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-004ec0e1-5285-4098-b52b-474100633993 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:41.132313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-004ec0e1-5285-4098-b52b-474100633993 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:41.133471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-004ec0e1-5285-4098-b52b-474100633993 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:41.842106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-004ec0e1-5285-4098-b52b-474100633993 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:41.859626 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-004ec0e1-5285-4098-b52b-474100633993 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1314 microversion: 2.1 time: 0.756687 Oct 05 18:00:41.868294 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2312/4886] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:41 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:42.896749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3fe0e14-106f-4ab5-a4cb-00f684a25316 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:42.898106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b3fe0e14-106f-4ab5-a4cb-00f684a25316 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:42.916369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fe0e14-106f-4ab5-a4cb-00f684a25316 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:42.916879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fe0e14-106f-4ab5-a4cb-00f684a25316 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:42.917317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fe0e14-106f-4ab5-a4cb-00f684a25316 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:42.918048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fe0e14-106f-4ab5-a4cb-00f684a25316 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:42.918534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fe0e14-106f-4ab5-a4cb-00f684a25316 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:42.918961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fe0e14-106f-4ab5-a4cb-00f684a25316 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:44.043341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3fe0e14-106f-4ab5-a4cb-00f684a25316 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:44.052954 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3fe0e14-106f-4ab5-a4cb-00f684a25316 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1314 microversion: 2.1 time: 1.160271 Oct 05 18:00:44.053574 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2575/4887] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:42 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1314 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:44.453496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1667176972", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "4d26fec2-e2c8-42d8-941d-2909b6cab1a9"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:44.601363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] validate_networks() for [('4d26fec2-e2c8-42d8-941d-2909b6cab1a9', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:00:44.718960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-06758159-8f30-4af0-9515-75cc58842033 req-18248068-e159-4148-8173-95c4f11e19ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "067a432f-a320-4421-859f-fc9decbef21c", "tag": "75a37487-e6c8-4818-8bfb-1446b107d83b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:44.745279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-06758159-8f30-4af0-9515-75cc58842033 req-18248068-e159-4148-8173-95c4f11e19ee service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:44.746127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-06758159-8f30-4af0-9515-75cc58842033 req-18248068-e159-4148-8173-95c4f11e19ee service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:44.749922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-06758159-8f30-4af0-9515-75cc58842033 req-18248068-e159-4148-8173-95c4f11e19ee service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:44.808372 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-06758159-8f30-4af0-9515-75cc58842033 req-18248068-e159-4148-8173-95c4f11e19ee service nova] Creating event network-changed:75a37487-e6c8-4818-8bfb-1446b107d83b for instance 067a432f-a320-4421-859f-fc9decbef21c on n-h1-835595-3 Oct 05 18:00:44.824768 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-06758159-8f30-4af0-9515-75cc58842033 req-18248068-e159-4148-8173-95c4f11e19ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109994 Oct 05 18:00:44.830753 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2576/4888] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:00:45.083665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3955785a-00f9-479c-8f80-beec8569e5be tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:45.084357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3955785a-00f9-479c-8f80-beec8569e5be tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:45.112316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3955785a-00f9-479c-8f80-beec8569e5be tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:45.122718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3955785a-00f9-479c-8f80-beec8569e5be tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:45.123212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3955785a-00f9-479c-8f80-beec8569e5be tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:45.123999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3955785a-00f9-479c-8f80-beec8569e5be tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:45.124652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3955785a-00f9-479c-8f80-beec8569e5be tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:45.125279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3955785a-00f9-479c-8f80-beec8569e5be tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:45.209097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:45.280871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:45.509962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3955785a-00f9-479c-8f80-beec8569e5be tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:45.519311 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3955785a-00f9-479c-8f80-beec8569e5be tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1314 microversion: 2.1 time: 0.439801 Oct 05 18:00:45.523443 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2577/4889] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:45 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:46.469366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:00:46.469954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:00:46.470270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:00:46.470713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:00:46.471586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:00:46.497610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:46.498113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:46.498593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:46.499329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:46.499784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:46.500208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:46.539917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Getting quotas for project fa2e496707614956b6153196e1bda2ec. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:00:46.546258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Getting quotas for user 35a7710f0d5d48a19daf802de6eeaae0 and project fa2e496707614956b6153196e1bda2ec. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:00:46.555910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4c92f99c-702f-401c-b753-69da6ded0096 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:46.560441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4c92f99c-702f-401c-b753-69da6ded0096 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:46.560599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:00:46.571246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:00:46.584511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:46.587410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c92f99c-702f-401c-b753-69da6ded0096 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:46.590515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c92f99c-702f-401c-b753-69da6ded0096 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:46.592687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c92f99c-702f-401c-b753-69da6ded0096 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:46.595129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c92f99c-702f-401c-b753-69da6ded0096 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:46.595761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c92f99c-702f-401c-b753-69da6ded0096 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:46.596383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c92f99c-702f-401c-b753-69da6ded0096 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:46.712443 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a4973576-200c-4a4d-8701-32a8dd4bd0d4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.263759 Oct 05 18:00:46.713513 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2313/4890] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:00:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:00:46.734174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fe6bb7c1-30e6-4f38-81dd-8a33a3eca2fd tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:46.735147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fe6bb7c1-30e6-4f38-81dd-8a33a3eca2fd tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:46.850900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe6bb7c1-30e6-4f38-81dd-8a33a3eca2fd tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:46.860762 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fe6bb7c1-30e6-4f38-81dd-8a33a3eca2fd tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1214 microversion: 2.1 time: 0.139679 Oct 05 18:00:46.863983 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2314/4891] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:46 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1214 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:47.457270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c92f99c-702f-401c-b753-69da6ded0096 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:47.472634 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4c92f99c-702f-401c-b753-69da6ded0096 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1314 microversion: 2.1 time: 0.927406 Oct 05 18:00:47.474826 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2578/4892] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:46 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1314 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:47.891129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a3d12e34-45b1-41f6-b2ed-e17d2dc6758b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:47.891719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a3d12e34-45b1-41f6-b2ed-e17d2dc6758b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:47.936884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3d12e34-45b1-41f6-b2ed-e17d2dc6758b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:47.940868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3d12e34-45b1-41f6-b2ed-e17d2dc6758b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:47.944364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3d12e34-45b1-41f6-b2ed-e17d2dc6758b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:47.947674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3d12e34-45b1-41f6-b2ed-e17d2dc6758b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:47.954725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3d12e34-45b1-41f6-b2ed-e17d2dc6758b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:47.955457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3d12e34-45b1-41f6-b2ed-e17d2dc6758b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:48.216508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a3d12e34-45b1-41f6-b2ed-e17d2dc6758b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:48.235138 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a3d12e34-45b1-41f6-b2ed-e17d2dc6758b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1218 microversion: 2.1 time: 0.346786 Oct 05 18:00:48.236958 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2315/4893] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:47 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1218 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:48.508194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-725a0d04-66f1-469b-a8c6-1d6a49e5c24a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:48.509090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-725a0d04-66f1-469b-a8c6-1d6a49e5c24a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:48.516460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-725a0d04-66f1-469b-a8c6-1d6a49e5c24a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:48.516957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-725a0d04-66f1-469b-a8c6-1d6a49e5c24a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:48.517413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-725a0d04-66f1-469b-a8c6-1d6a49e5c24a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:48.518113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-725a0d04-66f1-469b-a8c6-1d6a49e5c24a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:48.518599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-725a0d04-66f1-469b-a8c6-1d6a49e5c24a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:48.519026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-725a0d04-66f1-469b-a8c6-1d6a49e5c24a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:48.884382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-725a0d04-66f1-469b-a8c6-1d6a49e5c24a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:48.908291 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-725a0d04-66f1-469b-a8c6-1d6a49e5c24a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1314 microversion: 2.1 time: 0.403896 Oct 05 18:00:48.908958 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2579/4894] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:48 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:49.263144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-28d54dc5-57b3-4498-9832-7aa33bb82c32 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:49.264178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-28d54dc5-57b3-4498-9832-7aa33bb82c32 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:49.280324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28d54dc5-57b3-4498-9832-7aa33bb82c32 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:49.280840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28d54dc5-57b3-4498-9832-7aa33bb82c32 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:49.281282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28d54dc5-57b3-4498-9832-7aa33bb82c32 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:49.282013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28d54dc5-57b3-4498-9832-7aa33bb82c32 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:49.282511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28d54dc5-57b3-4498-9832-7aa33bb82c32 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:49.282937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28d54dc5-57b3-4498-9832-7aa33bb82c32 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:49.756996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-28d54dc5-57b3-4498-9832-7aa33bb82c32 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:49.769074 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-28d54dc5-57b3-4498-9832-7aa33bb82c32 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1272 microversion: 2.1 time: 0.511746 Oct 05 18:00:49.790699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0b8225be-618d-4653-8d12-0a6732e56b08 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:49.793773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0b8225be-618d-4653-8d12-0a6732e56b08 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:49.795283 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2316/4895] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:49 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1272 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:49.818920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8225be-618d-4653-8d12-0a6732e56b08 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:49.820995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8225be-618d-4653-8d12-0a6732e56b08 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:49.825133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8225be-618d-4653-8d12-0a6732e56b08 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:49.826472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8225be-618d-4653-8d12-0a6732e56b08 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:49.827183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8225be-618d-4653-8d12-0a6732e56b08 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:49.827859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b8225be-618d-4653-8d12-0a6732e56b08 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:49.920248 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0b8225be-618d-4653-8d12-0a6732e56b08 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862/action" status: 200 len: 24564 microversion: 2.1 time: 0.133291 Oct 05 18:00:49.932572 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2580/4896] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:00:49 2022] POST /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862/action => generated 24564 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:00:49.936857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-223a3305-cf9a-4e56-9b87-a31c907472d8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:49.937797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-223a3305-cf9a-4e56-9b87-a31c907472d8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:49.946652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-223a3305-cf9a-4e56-9b87-a31c907472d8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:49.955735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-223a3305-cf9a-4e56-9b87-a31c907472d8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:49.956362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-223a3305-cf9a-4e56-9b87-a31c907472d8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:49.958341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-223a3305-cf9a-4e56-9b87-a31c907472d8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:49.959214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-223a3305-cf9a-4e56-9b87-a31c907472d8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:49.959678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-223a3305-cf9a-4e56-9b87-a31c907472d8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:50.614190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-223a3305-cf9a-4e56-9b87-a31c907472d8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:50.684015 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-223a3305-cf9a-4e56-9b87-a31c907472d8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1314 microversion: 2.1 time: 0.751018 Oct 05 18:00:50.694455 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2317/4897] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:49 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1314 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:50.807843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13ef1ccc-9b83-4aa7-8324-2b4800e09ea1 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:50.809553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13ef1ccc-9b83-4aa7-8324-2b4800e09ea1 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:50.841445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef1ccc-9b83-4aa7-8324-2b4800e09ea1 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:50.841861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef1ccc-9b83-4aa7-8324-2b4800e09ea1 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:50.843238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef1ccc-9b83-4aa7-8324-2b4800e09ea1 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:50.844890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef1ccc-9b83-4aa7-8324-2b4800e09ea1 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:50.846265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef1ccc-9b83-4aa7-8324-2b4800e09ea1 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:50.848271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef1ccc-9b83-4aa7-8324-2b4800e09ea1 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:51.194003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-13ef1ccc-9b83-4aa7-8324-2b4800e09ea1 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:51.205042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13ef1ccc-9b83-4aa7-8324-2b4800e09ea1 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1314 microversion: 2.1 time: 0.401663 Oct 05 18:00:51.205644 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2581/4898] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:50 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:51.718634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e21bd43-0854-4c14-8ad6-e94d4ed3742e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:51.719521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e21bd43-0854-4c14-8ad6-e94d4ed3742e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:51.733118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e21bd43-0854-4c14-8ad6-e94d4ed3742e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:51.734932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e21bd43-0854-4c14-8ad6-e94d4ed3742e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:51.736533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e21bd43-0854-4c14-8ad6-e94d4ed3742e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:51.737280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e21bd43-0854-4c14-8ad6-e94d4ed3742e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:51.739884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e21bd43-0854-4c14-8ad6-e94d4ed3742e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:51.741512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e21bd43-0854-4c14-8ad6-e94d4ed3742e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:52.241207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-60c3b2af-9590-44e3-a294-6e087938bd65 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:52.243504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-60c3b2af-9590-44e3-a294-6e087938bd65 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:52.257175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60c3b2af-9590-44e3-a294-6e087938bd65 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:52.262062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60c3b2af-9590-44e3-a294-6e087938bd65 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:52.264211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60c3b2af-9590-44e3-a294-6e087938bd65 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:52.266914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60c3b2af-9590-44e3-a294-6e087938bd65 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:52.267576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60c3b2af-9590-44e3-a294-6e087938bd65 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:52.268853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60c3b2af-9590-44e3-a294-6e087938bd65 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:52.827886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2e21bd43-0854-4c14-8ad6-e94d4ed3742e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:52.845293 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e21bd43-0854-4c14-8ad6-e94d4ed3742e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1314 microversion: 2.1 time: 1.136989 Oct 05 18:00:52.846732 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2318/4899] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:51 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1314 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:53.101865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-60c3b2af-9590-44e3-a294-6e087938bd65 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:53.114630 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-60c3b2af-9590-44e3-a294-6e087938bd65 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1314 microversion: 2.1 time: 0.889038 Oct 05 18:00:53.118113 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2582/4900] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:52 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1314 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:53.816385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-91a00276-4f39-4bb4-ae22-95ef85fe6c05 req-63e6df94-2a73-4ad4-a3b6-b6d64bd4246f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "348bdaad-4d98-4c6f-9005-d287813e1131", "tag": "1e252219-1316-46c4-a02b-e9339a450fbb"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:53.842994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-91a00276-4f39-4bb4-ae22-95ef85fe6c05 req-63e6df94-2a73-4ad4-a3b6-b6d64bd4246f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:53.843580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-91a00276-4f39-4bb4-ae22-95ef85fe6c05 req-63e6df94-2a73-4ad4-a3b6-b6d64bd4246f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:53.843965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-91a00276-4f39-4bb4-ae22-95ef85fe6c05 req-63e6df94-2a73-4ad4-a3b6-b6d64bd4246f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:53.881520 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-91a00276-4f39-4bb4-ae22-95ef85fe6c05 req-63e6df94-2a73-4ad4-a3b6-b6d64bd4246f service nova] Creating event network-changed:1e252219-1316-46c4-a02b-e9339a450fbb for instance 348bdaad-4d98-4c6f-9005-d287813e1131 on n-h2-835595-3 Oct 05 18:00:53.885209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ae412d0-fb4c-4f41-a87e-f134ad0d9c93 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:53.891469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8ae412d0-fb4c-4f41-a87e-f134ad0d9c93 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:53.894006 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-91a00276-4f39-4bb4-ae22-95ef85fe6c05 req-63e6df94-2a73-4ad4-a3b6-b6d64bd4246f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082194 Oct 05 18:00:53.899077 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2319/4901] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:00:53.922140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae412d0-fb4c-4f41-a87e-f134ad0d9c93 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:53.922674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae412d0-fb4c-4f41-a87e-f134ad0d9c93 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:53.923112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae412d0-fb4c-4f41-a87e-f134ad0d9c93 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:53.924134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae412d0-fb4c-4f41-a87e-f134ad0d9c93 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:53.924295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae412d0-fb4c-4f41-a87e-f134ad0d9c93 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:53.938101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ae412d0-fb4c-4f41-a87e-f134ad0d9c93 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:54.143383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7d64ae1f-2dd8-4d48-b550-7ce7ffc5ef9a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:54.144152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7d64ae1f-2dd8-4d48-b550-7ce7ffc5ef9a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:54.154984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d64ae1f-2dd8-4d48-b550-7ce7ffc5ef9a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:54.155706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d64ae1f-2dd8-4d48-b550-7ce7ffc5ef9a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:54.156815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d64ae1f-2dd8-4d48-b550-7ce7ffc5ef9a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:54.158820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d64ae1f-2dd8-4d48-b550-7ce7ffc5ef9a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:54.159482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d64ae1f-2dd8-4d48-b550-7ce7ffc5ef9a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:54.160230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d64ae1f-2dd8-4d48-b550-7ce7ffc5ef9a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:54.317113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8ae412d0-fb4c-4f41-a87e-f134ad0d9c93 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:54.331612 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8ae412d0-fb4c-4f41-a87e-f134ad0d9c93 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1314 microversion: 2.1 time: 0.462313 Oct 05 18:00:54.335227 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2583/4902] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:53 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:54.522113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d64ae1f-2dd8-4d48-b550-7ce7ffc5ef9a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:54.533726 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7d64ae1f-2dd8-4d48-b550-7ce7ffc5ef9a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1314 microversion: 2.1 time: 0.395890 Oct 05 18:00:54.553215 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2320/4903] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:54 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:55.361735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76ca4320-f52f-47cf-8b41-e9e2168f4b83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:55.362802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-76ca4320-f52f-47cf-8b41-e9e2168f4b83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:55.391971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76ca4320-f52f-47cf-8b41-e9e2168f4b83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:55.392495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76ca4320-f52f-47cf-8b41-e9e2168f4b83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:55.392942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76ca4320-f52f-47cf-8b41-e9e2168f4b83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:55.393689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76ca4320-f52f-47cf-8b41-e9e2168f4b83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:55.394153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76ca4320-f52f-47cf-8b41-e9e2168f4b83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:55.394630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76ca4320-f52f-47cf-8b41-e9e2168f4b83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:55.560622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a31411b-99d6-4c8c-a770-d773dec48d49 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:55.561459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a31411b-99d6-4c8c-a770-d773dec48d49 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:55.582741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a31411b-99d6-4c8c-a770-d773dec48d49 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:55.583495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a31411b-99d6-4c8c-a770-d773dec48d49 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:55.584170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a31411b-99d6-4c8c-a770-d773dec48d49 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:55.585121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a31411b-99d6-4c8c-a770-d773dec48d49 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:55.592148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a31411b-99d6-4c8c-a770-d773dec48d49 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:55.592963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a31411b-99d6-4c8c-a770-d773dec48d49 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:55.996398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a31411b-99d6-4c8c-a770-d773dec48d49 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:56.016218 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a31411b-99d6-4c8c-a770-d773dec48d49 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1314 microversion: 2.1 time: 0.452900 Oct 05 18:00:56.048464 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2321/4904] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:55 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:56.053481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-435c4c36-4bdd-4ae3-a75f-8ab3342a671c req-8e740275-0fa1-49f8-9799-236208f88f36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067a432f-a320-4421-859f-fc9decbef21c", "name": "network-vif-plugged", "status": "completed", "tag": "75a37487-e6c8-4818-8bfb-1446b107d83b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:00:56.087825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-435c4c36-4bdd-4ae3-a75f-8ab3342a671c req-8e740275-0fa1-49f8-9799-236208f88f36 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:56.088404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-435c4c36-4bdd-4ae3-a75f-8ab3342a671c req-8e740275-0fa1-49f8-9799-236208f88f36 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:56.090181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-435c4c36-4bdd-4ae3-a75f-8ab3342a671c req-8e740275-0fa1-49f8-9799-236208f88f36 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:56.113096 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-435c4c36-4bdd-4ae3-a75f-8ab3342a671c req-8e740275-0fa1-49f8-9799-236208f88f36 service nova] Creating event network-vif-plugged:75a37487-e6c8-4818-8bfb-1446b107d83b for instance 067a432f-a320-4421-859f-fc9decbef21c on n-h1-835595-3 Oct 05 18:00:56.130641 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-435c4c36-4bdd-4ae3-a75f-8ab3342a671c req-8e740275-0fa1-49f8-9799-236208f88f36 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080573 Oct 05 18:00:56.135443 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2322/4905] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:00:56.613695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76ca4320-f52f-47cf-8b41-e9e2168f4b83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:56.624606 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76ca4320-f52f-47cf-8b41-e9e2168f4b83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1314 microversion: 2.1 time: 1.268255 Oct 05 18:00:56.631798 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2584/4906] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:55 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1314 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:57.045682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:57.051987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:00:57.064956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23d06b37-649b-49e3-afba-a7d246f719a6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:57.065957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23d06b37-649b-49e3-afba-a7d246f719a6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:57.078663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d06b37-649b-49e3-afba-a7d246f719a6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:57.079662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d06b37-649b-49e3-afba-a7d246f719a6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:57.080288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d06b37-649b-49e3-afba-a7d246f719a6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:57.082117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d06b37-649b-49e3-afba-a7d246f719a6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:57.082901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d06b37-649b-49e3-afba-a7d246f719a6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:57.083531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d06b37-649b-49e3-afba-a7d246f719a6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:57.436795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23d06b37-649b-49e3-afba-a7d246f719a6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:57.452101 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23d06b37-649b-49e3-afba-a7d246f719a6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1314 microversion: 2.1 time: 0.401933 Oct 05 18:00:57.453280 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2323/4907] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:57 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:57.655660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-71d93665-7542-45f2-864b-c89493d9d605 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:57.657571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-71d93665-7542-45f2-864b-c89493d9d605 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:57.684786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d93665-7542-45f2-864b-c89493d9d605 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:57.696041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d93665-7542-45f2-864b-c89493d9d605 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:57.700899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d93665-7542-45f2-864b-c89493d9d605 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:57.702436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d93665-7542-45f2-864b-c89493d9d605 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:57.705090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d93665-7542-45f2-864b-c89493d9d605 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:57.709873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d93665-7542-45f2-864b-c89493d9d605 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:58.481181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f5e82ff4-1f26-4fa9-9fe8-0b2ab26c3bde tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:58.482620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f5e82ff4-1f26-4fa9-9fe8-0b2ab26c3bde tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:58.494534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5e82ff4-1f26-4fa9-9fe8-0b2ab26c3bde tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:58.496534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5e82ff4-1f26-4fa9-9fe8-0b2ab26c3bde tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:58.497546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5e82ff4-1f26-4fa9-9fe8-0b2ab26c3bde tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:58.500925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5e82ff4-1f26-4fa9-9fe8-0b2ab26c3bde tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:58.501665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5e82ff4-1f26-4fa9-9fe8-0b2ab26c3bde tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:58.502401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5e82ff4-1f26-4fa9-9fe8-0b2ab26c3bde tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:58.821805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f5e82ff4-1f26-4fa9-9fe8-0b2ab26c3bde tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:58.836217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-71d93665-7542-45f2-864b-c89493d9d605 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:00:58.837231 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f5e82ff4-1f26-4fa9-9fe8-0b2ab26c3bde tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1314 microversion: 2.1 time: 0.354094 Oct 05 18:00:58.837945 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2324/4908] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:58 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:00:58.845893 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-71d93665-7542-45f2-864b-c89493d9d605 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1314 microversion: 2.1 time: 1.194804 Oct 05 18:00:58.866316 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2585/4909] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:57 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1314 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:00:59.870739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0892c12d-1ccc-46bd-ba03-aa9c2b8c7817 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:59.873163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0892c12d-1ccc-46bd-ba03-aa9c2b8c7817 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:59.873558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-072fd59a-a7cd-4e0f-aab7-a48cf4608457 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:00:59.874727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-072fd59a-a7cd-4e0f-aab7-a48cf4608457 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:00:59.885176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-072fd59a-a7cd-4e0f-aab7-a48cf4608457 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:59.889476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-072fd59a-a7cd-4e0f-aab7-a48cf4608457 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:59.890129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-072fd59a-a7cd-4e0f-aab7-a48cf4608457 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:59.891298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-072fd59a-a7cd-4e0f-aab7-a48cf4608457 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:59.895110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-072fd59a-a7cd-4e0f-aab7-a48cf4608457 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:59.895827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-072fd59a-a7cd-4e0f-aab7-a48cf4608457 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:59.897178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0892c12d-1ccc-46bd-ba03-aa9c2b8c7817 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:59.900544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0892c12d-1ccc-46bd-ba03-aa9c2b8c7817 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:59.901212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0892c12d-1ccc-46bd-ba03-aa9c2b8c7817 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:00:59.902955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0892c12d-1ccc-46bd-ba03-aa9c2b8c7817 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:00:59.904378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0892c12d-1ccc-46bd-ba03-aa9c2b8c7817 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:00:59.908875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0892c12d-1ccc-46bd-ba03-aa9c2b8c7817 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:00.193142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0892c12d-1ccc-46bd-ba03-aa9c2b8c7817 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:00.201410 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0892c12d-1ccc-46bd-ba03-aa9c2b8c7817 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1314 microversion: 2.1 time: 0.341119 Oct 05 18:01:00.205429 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2325/4910] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:59 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:00.450665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-072fd59a-a7cd-4e0f-aab7-a48cf4608457 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:00.459000 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-072fd59a-a7cd-4e0f-aab7-a48cf4608457 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1500 microversion: 2.1 time: 0.589739 Oct 05 18:01:00.459599 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2586/4911] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:00:59 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1500 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:00.493347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8ffe71c-ef96-46b3-a5cd-d5d71e8af4fb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:00.494468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8ffe71c-ef96-46b3-a5cd-d5d71e8af4fb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:00.509143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8ffe71c-ef96-46b3-a5cd-d5d71e8af4fb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:00.509709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8ffe71c-ef96-46b3-a5cd-d5d71e8af4fb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:00.510156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8ffe71c-ef96-46b3-a5cd-d5d71e8af4fb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:00.511286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8ffe71c-ef96-46b3-a5cd-d5d71e8af4fb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:00.511757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8ffe71c-ef96-46b3-a5cd-d5d71e8af4fb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:00.512185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8ffe71c-ef96-46b3-a5cd-d5d71e8af4fb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:00.581873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8ffe71c-ef96-46b3-a5cd-d5d71e8af4fb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:01:00.781752 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8ffe71c-ef96-46b3-a5cd-d5d71e8af4fb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 204 len: 0 microversion: 2.1 time: 0.296496 Oct 05 18:01:00.785202 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2326/4912] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:01:00 2022] DELETE /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:01:00.790907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c334683b-c35f-40ef-a96f-e9ee2a856935 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:00.791542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c334683b-c35f-40ef-a96f-e9ee2a856935 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:00.804173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c334683b-c35f-40ef-a96f-e9ee2a856935 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:00.804681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c334683b-c35f-40ef-a96f-e9ee2a856935 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:00.805162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c334683b-c35f-40ef-a96f-e9ee2a856935 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:00.805932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c334683b-c35f-40ef-a96f-e9ee2a856935 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:00.806368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c334683b-c35f-40ef-a96f-e9ee2a856935 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:00.814386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c334683b-c35f-40ef-a96f-e9ee2a856935 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:00.951885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1573a769-e2f5-41c7-97d8-7fac052988d7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:00.953353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1573a769-e2f5-41c7-97d8-7fac052988d7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:00.980547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1573a769-e2f5-41c7-97d8-7fac052988d7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:00.982696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1573a769-e2f5-41c7-97d8-7fac052988d7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:00.983404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1573a769-e2f5-41c7-97d8-7fac052988d7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:00.987080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1573a769-e2f5-41c7-97d8-7fac052988d7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:00.988531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1573a769-e2f5-41c7-97d8-7fac052988d7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:00.990085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1573a769-e2f5-41c7-97d8-7fac052988d7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:01.063303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:01.280710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c334683b-c35f-40ef-a96f-e9ee2a856935 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:01.305019 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c334683b-c35f-40ef-a96f-e9ee2a856935 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1506 microversion: 2.1 time: 0.518200 Oct 05 18:01:01.328522 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2587/4913] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:00 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:01.333909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-acb339fe-cfb5-4302-a11f-e05567b08563 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:01.342478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-acb339fe-cfb5-4302-a11f-e05567b08563 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:01.352403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acb339fe-cfb5-4302-a11f-e05567b08563 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:01.353175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acb339fe-cfb5-4302-a11f-e05567b08563 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:01.353778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acb339fe-cfb5-4302-a11f-e05567b08563 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:01.354791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acb339fe-cfb5-4302-a11f-e05567b08563 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:01.355411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acb339fe-cfb5-4302-a11f-e05567b08563 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:01.356029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acb339fe-cfb5-4302-a11f-e05567b08563 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:01.437558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1573a769-e2f5-41c7-97d8-7fac052988d7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:01.450442 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1573a769-e2f5-41c7-97d8-7fac052988d7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1682 microversion: 2.1 time: 0.520811 Oct 05 18:01:01.456664 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2327/4914] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:00 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1682 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:01.876964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-daef6ed0-0d92-468f-86e8-a6d928bce28e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:01.879751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-daef6ed0-0d92-468f-86e8-a6d928bce28e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:01.896282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daef6ed0-0d92-468f-86e8-a6d928bce28e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:01.897268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daef6ed0-0d92-468f-86e8-a6d928bce28e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:01.897920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daef6ed0-0d92-468f-86e8-a6d928bce28e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:01.899235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daef6ed0-0d92-468f-86e8-a6d928bce28e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:01.899896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daef6ed0-0d92-468f-86e8-a6d928bce28e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:01.900556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daef6ed0-0d92-468f-86e8-a6d928bce28e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:01.947073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-acb339fe-cfb5-4302-a11f-e05567b08563 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:01.965298 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-acb339fe-cfb5-4302-a11f-e05567b08563 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1314 microversion: 2.1 time: 0.633464 Oct 05 18:01:01.966542 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2588/4915] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:01 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:02.176517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c6e29aab-98ae-4e90-8f2c-3cb8d611d59d req-f7946760-6610-424d-8aa7-f11fde695370 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348bdaad-4d98-4c6f-9005-d287813e1131", "name": "network-vif-plugged", "status": "completed", "tag": "1e252219-1316-46c4-a02b-e9339a450fbb"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:02.188030 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-daef6ed0-0d92-468f-86e8-a6d928bce28e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862/action" status: 200 len: 32644 microversion: 2.1 time: 0.316284 Oct 05 18:01:02.189629 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2328/4916] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:01:01 2022] POST /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862/action => generated 32644 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 18:01:02.211721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c6e29aab-98ae-4e90-8f2c-3cb8d611d59d req-f7946760-6610-424d-8aa7-f11fde695370 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:02.217099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c6e29aab-98ae-4e90-8f2c-3cb8d611d59d req-f7946760-6610-424d-8aa7-f11fde695370 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:02.218140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c6e29aab-98ae-4e90-8f2c-3cb8d611d59d req-f7946760-6610-424d-8aa7-f11fde695370 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:02.297976 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c6e29aab-98ae-4e90-8f2c-3cb8d611d59d req-f7946760-6610-424d-8aa7-f11fde695370 service nova] Creating event network-vif-plugged:1e252219-1316-46c4-a02b-e9339a450fbb for instance 348bdaad-4d98-4c6f-9005-d287813e1131 on n-h2-835595-3 Oct 05 18:01:02.316522 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c6e29aab-98ae-4e90-8f2c-3cb8d611d59d req-f7946760-6610-424d-8aa7-f11fde695370 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145666 Oct 05 18:01:02.319428 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2589/4917] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:01:02.340325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2433d54-4477-4a5b-b5ed-f1d92d2ed23d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:02.341130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d2433d54-4477-4a5b-b5ed-f1d92d2ed23d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:02.362088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2433d54-4477-4a5b-b5ed-f1d92d2ed23d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:02.362651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2433d54-4477-4a5b-b5ed-f1d92d2ed23d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:02.363439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2433d54-4477-4a5b-b5ed-f1d92d2ed23d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:02.364458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2433d54-4477-4a5b-b5ed-f1d92d2ed23d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:02.366869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2433d54-4477-4a5b-b5ed-f1d92d2ed23d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:02.368443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2433d54-4477-4a5b-b5ed-f1d92d2ed23d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:02.382206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce1d6ed2-ee99-455f-b295-04a97a8b3da4 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:02.384162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ce1d6ed2-ee99-455f-b295-04a97a8b3da4 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:02.395867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1d6ed2-ee99-455f-b295-04a97a8b3da4 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:02.397755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1d6ed2-ee99-455f-b295-04a97a8b3da4 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:02.398697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1d6ed2-ee99-455f-b295-04a97a8b3da4 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:02.400275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1d6ed2-ee99-455f-b295-04a97a8b3da4 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:02.401295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1d6ed2-ee99-455f-b295-04a97a8b3da4 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:02.402012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1d6ed2-ee99-455f-b295-04a97a8b3da4 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:02.914429 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ce1d6ed2-ee99-455f-b295-04a97a8b3da4 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1833 microversion: 2.1 time: 0.536708 Oct 05 18:01:02.915086 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2590/4918] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:02 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1833 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:02.953411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:02.962805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:02.988486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:02.989002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:02.989446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:02.990432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:02.991059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:02.991659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:03.039984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:03.095006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lazy-loading 'flavor' on Instance uuid 86acc933-de7c-46d4-83a9-e27cd3be3862 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:01:03.116470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Going to try to live migrate instance to another host {{(pid=128844) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 05 18:01:04.339743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d2433d54-4477-4a5b-b5ed-f1d92d2ed23d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:04.362618 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d2433d54-4477-4a5b-b5ed-f1d92d2ed23d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1506 microversion: 2.1 time: 2.029201 Oct 05 18:01:04.372826 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2329/4919] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:02 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1506 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:04.402238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b47421a-d97c-4a99-a9f1-427ea22f438a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:04.403270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5b47421a-d97c-4a99-a9f1-427ea22f438a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:04.422819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b47421a-d97c-4a99-a9f1-427ea22f438a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:04.424593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b47421a-d97c-4a99-a9f1-427ea22f438a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:04.425218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b47421a-d97c-4a99-a9f1-427ea22f438a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:04.426133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b47421a-d97c-4a99-a9f1-427ea22f438a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:04.427840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b47421a-d97c-4a99-a9f1-427ea22f438a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:04.430879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b47421a-d97c-4a99-a9f1-427ea22f438a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:05.005059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5b47421a-d97c-4a99-a9f1-427ea22f438a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:05.020583 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b47421a-d97c-4a99-a9f1-427ea22f438a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1497 microversion: 2.1 time: 0.635309 Oct 05 18:01:05.021796 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2330/4920] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:04 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1497 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:05.030795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f0d8efa7-8298-4751-8db4-f591b9e4e871 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50139422-f07b-4a75-bd0a-a1e54b3fd962", "device": "/dev/sdb"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:05.037204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f0d8efa7-8298-4751-8db4-f591b9e4e871 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:05.057793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0d8efa7-8298-4751-8db4-f591b9e4e871 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:05.058887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0d8efa7-8298-4751-8db4-f591b9e4e871 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:05.059523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0d8efa7-8298-4751-8db4-f591b9e4e871 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:05.060461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0d8efa7-8298-4751-8db4-f591b9e4e871 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:05.061107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0d8efa7-8298-4751-8db4-f591b9e4e871 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:05.061719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0d8efa7-8298-4751-8db4-f591b9e4e871 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:05.524442 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f0d8efa7-8298-4751-8db4-f591b9e4e871 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "POST /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.499167 Oct 05 18:01:05.525707 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2331/4921] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:01:05 2022] POST /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:01:05.553333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-33a85d97-4ce2-4368-be22-19d7e3e2d6aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:05.555226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-33a85d97-4ce2-4368-be22-19d7e3e2d6aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:05.585816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:05.601115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a85d97-4ce2-4368-be22-19d7e3e2d6aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:05.605606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a85d97-4ce2-4368-be22-19d7e3e2d6aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:05.607304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a85d97-4ce2-4368-be22-19d7e3e2d6aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:05.631684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a85d97-4ce2-4368-be22-19d7e3e2d6aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:05.632244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a85d97-4ce2-4368-be22-19d7e3e2d6aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:05.632696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33a85d97-4ce2-4368-be22-19d7e3e2d6aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:05.862598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-33a85d97-4ce2-4368-be22-19d7e3e2d6aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:05.878394 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-33a85d97-4ce2-4368-be22-19d7e3e2d6aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 200 len: 1299 microversion: 2.1 time: 0.349202 Oct 05 18:01:05.880713 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2332/4922] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:05 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 1299 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:05.899897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e74a4916-60ac-4f08-9bd6-bc2341a417f7 req-c1af5c58-16d8-482d-b008-9000498ab454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "067a432f-a320-4421-859f-fc9decbef21c", "name": "network-vif-deleted", "tag": "75a37487-e6c8-4818-8bfb-1446b107d83b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:05.919615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e74a4916-60ac-4f08-9bd6-bc2341a417f7 req-c1af5c58-16d8-482d-b008-9000498ab454 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:05.920263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e74a4916-60ac-4f08-9bd6-bc2341a417f7 req-c1af5c58-16d8-482d-b008-9000498ab454 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:05.928679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e74a4916-60ac-4f08-9bd6-bc2341a417f7 req-c1af5c58-16d8-482d-b008-9000498ab454 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:06.006399 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e74a4916-60ac-4f08-9bd6-bc2341a417f7 req-c1af5c58-16d8-482d-b008-9000498ab454 service nova] Creating event network-vif-deleted:75a37487-e6c8-4818-8bfb-1446b107d83b for instance 067a432f-a320-4421-859f-fc9decbef21c on n-h1-835595-3 Oct 05 18:01:06.041892 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e74a4916-60ac-4f08-9bd6-bc2341a417f7 req-c1af5c58-16d8-482d-b008-9000498ab454 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159542 Oct 05 18:01:06.046046 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2333/4923] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:01:06.070217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d1b21187-a8d8-423b-86cf-604188e5b58d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:06.080534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d1b21187-a8d8-423b-86cf-604188e5b58d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:06.106815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1b21187-a8d8-423b-86cf-604188e5b58d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:06.107231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1b21187-a8d8-423b-86cf-604188e5b58d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:06.107676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1b21187-a8d8-423b-86cf-604188e5b58d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:06.108406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1b21187-a8d8-423b-86cf-604188e5b58d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:06.108863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1b21187-a8d8-423b-86cf-604188e5b58d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:06.109304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1b21187-a8d8-423b-86cf-604188e5b58d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:06.196475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d1b21187-a8d8-423b-86cf-604188e5b58d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:01:06.405411 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d1b21187-a8d8-423b-86cf-604188e5b58d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "DELETE /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 204 len: 0 microversion: 2.1 time: 0.339120 Oct 05 18:01:06.406166 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2334/4924] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:01:06 2022] DELETE /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:01:06.425100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2c3ffd90-c857-4078-ad37-a4fb7ac7ee29 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:06.425759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2c3ffd90-c857-4078-ad37-a4fb7ac7ee29 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:06.451424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c3ffd90-c857-4078-ad37-a4fb7ac7ee29 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:06.451925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c3ffd90-c857-4078-ad37-a4fb7ac7ee29 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:06.452366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c3ffd90-c857-4078-ad37-a4fb7ac7ee29 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:06.453085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c3ffd90-c857-4078-ad37-a4fb7ac7ee29 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:06.470339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c3ffd90-c857-4078-ad37-a4fb7ac7ee29 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:06.471070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c3ffd90-c857-4078-ad37-a4fb7ac7ee29 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:07.059532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2c3ffd90-c857-4078-ad37-a4fb7ac7ee29 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:07.074602 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2c3ffd90-c857-4078-ad37-a4fb7ac7ee29 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1503 microversion: 2.1 time: 0.662334 Oct 05 18:01:07.077943 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2335/4925] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:06 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1503 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:07.094795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:07.097945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:07.118552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:07.119137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:07.119585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:07.125371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:07.126091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:07.126571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:07.152311 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c HTTP/1.1 Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '067a432f-a320-4421-859f-fc9decbef21c'} Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:01:07.154372 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:01:07.158922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:07.158922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:01:07.158922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:01:07.158922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:01:07.158922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:01:07.158922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:01:07.158922 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:01:07.161784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:01:07.163121 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b83f04e-3002-46f3-9574-f1898565825f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 404 len: 111 microversion: 2.1 time: 0.083786 Oct 05 18:01:07.182886 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2336/4926] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:07 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:01:07.349600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2134471413", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:07.448718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] validate_networks() for [('7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:01:07.991240 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dc33d67e-3b1a-4c05-a7bf-cd1afa6d449a tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862/action" status: 202 len: 0 microversion: 2.1 time: 5.042465 Oct 05 18:01:07.992081 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2591/4927] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:01:02 2022] POST /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862/action => generated 0 bytes in 5044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 18:01:08.001777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c6f3f2f-d61e-4ecf-ad70-5b3a98e42906 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:08.005825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6c6f3f2f-d61e-4ecf-ad70-5b3a98e42906 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:08.034429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=44 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:08.036251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c6f3f2f-d61e-4ecf-ad70-5b3a98e42906 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:08.036774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c6f3f2f-d61e-4ecf-ad70-5b3a98e42906 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:08.037211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c6f3f2f-d61e-4ecf-ad70-5b3a98e42906 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:08.037941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c6f3f2f-d61e-4ecf-ad70-5b3a98e42906 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:08.038430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c6f3f2f-d61e-4ecf-ad70-5b3a98e42906 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:08.052178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c6f3f2f-d61e-4ecf-ad70-5b3a98e42906 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:09.066830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6c6f3f2f-d61e-4ecf-ad70-5b3a98e42906 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:09.077820 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6c6f3f2f-d61e-4ecf-ad70-5b3a98e42906 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1692 microversion: 2.1 time: 1.080479 Oct 05 18:01:09.084200 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2592/4928] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:07 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1692 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:09.134760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86f9fecd-7c72-47f9-893c-ae0561b13780 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:09.136869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-86f9fecd-7c72-47f9-893c-ae0561b13780 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:09.154315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86f9fecd-7c72-47f9-893c-ae0561b13780 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:09.167644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86f9fecd-7c72-47f9-893c-ae0561b13780 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:09.168409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86f9fecd-7c72-47f9-893c-ae0561b13780 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:09.178917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86f9fecd-7c72-47f9-893c-ae0561b13780 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:09.179708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86f9fecd-7c72-47f9-893c-ae0561b13780 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:09.180316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86f9fecd-7c72-47f9-893c-ae0561b13780 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:10.124438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:01:10.128189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:01:10.128903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:01:10.129474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:01:10.130103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:01:10.155855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:10.157728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:10.158204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:10.162572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:10.164226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:10.164688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:10.219518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-86f9fecd-7c72-47f9-893c-ae0561b13780 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:10.235702 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-86f9fecd-7c72-47f9-893c-ae0561b13780 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1503 microversion: 2.1 time: 1.131489 Oct 05 18:01:10.236175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:01:10.240287 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2593/4929] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:09 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1503 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:10.250292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for user 9ea1c284fc254cc7a51d9e67d4fe8168 and project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:01:10.255065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a2f023d5-9ebf-4c1d-8662-e4b76a8e7a9b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:10.259115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a2f023d5-9ebf-4c1d-8662-e4b76a8e7a9b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:10.284349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:01:10.285788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2f023d5-9ebf-4c1d-8662-e4b76a8e7a9b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:10.286473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2f023d5-9ebf-4c1d-8662-e4b76a8e7a9b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:10.286938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2f023d5-9ebf-4c1d-8662-e4b76a8e7a9b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:10.287659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:01:10.287796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2f023d5-9ebf-4c1d-8662-e4b76a8e7a9b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:10.288153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2f023d5-9ebf-4c1d-8662-e4b76a8e7a9b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:10.288593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2f023d5-9ebf-4c1d-8662-e4b76a8e7a9b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:10.405158 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f269eb02-9928-4bef-963d-1f1354eec9a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.060596 Oct 05 18:01:10.410139 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2337/4930] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 18:01:10.421322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-629feb7a-2b6b-4774-b09b-7a5b50e049a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:10.422239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-629feb7a-2b6b-4774-b09b-7a5b50e049a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:10.752514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-629feb7a-2b6b-4774-b09b-7a5b50e049a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:10.763711 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-629feb7a-2b6b-4774-b09b-7a5b50e049a6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1215 microversion: 2.1 time: 0.348257 Oct 05 18:01:10.772414 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2338/4931] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:10 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1215 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:10.793034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-650ce793-19b2-4105-be90-02e43a788c6d req-8f122541-8843-4c9b-9c45-9dbdf05f534a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "348bdaad-4d98-4c6f-9005-d287813e1131", "name": "network-vif-deleted", "tag": "1e252219-1316-46c4-a02b-e9339a450fbb"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:10.833962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-650ce793-19b2-4105-be90-02e43a788c6d req-8f122541-8843-4c9b-9c45-9dbdf05f534a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:10.837234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-650ce793-19b2-4105-be90-02e43a788c6d req-8f122541-8843-4c9b-9c45-9dbdf05f534a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:10.837693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-650ce793-19b2-4105-be90-02e43a788c6d req-8f122541-8843-4c9b-9c45-9dbdf05f534a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:10.894594 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-650ce793-19b2-4105-be90-02e43a788c6d req-8f122541-8843-4c9b-9c45-9dbdf05f534a service nova] Creating event network-vif-deleted:1e252219-1316-46c4-a02b-e9339a450fbb for instance 348bdaad-4d98-4c6f-9005-d287813e1131 on n-h2-835595-3 Oct 05 18:01:10.931024 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-650ce793-19b2-4105-be90-02e43a788c6d req-8f122541-8843-4c9b-9c45-9dbdf05f534a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150321 Oct 05 18:01:10.931711 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2339/4932] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:01:11.103004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a2f023d5-9ebf-4c1d-8662-e4b76a8e7a9b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:11.115081 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a2f023d5-9ebf-4c1d-8662-e4b76a8e7a9b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1692 microversion: 2.1 time: 0.873711 Oct 05 18:01:11.130549 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2594/4933] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:10 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1692 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:11.272165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:11.273736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:11.310587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:11.311101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:11.311547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:11.312277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:11.312739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:11.313165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:11.422353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:11.423251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:11.423864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:11.424477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lazy-loading 'fault' on Instance uuid 348bdaad-4d98-4c6f-9005-d287813e1131 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:01:11.803829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0b321ed9-5b07-41fb-ab33-28951da82bd4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:11.804249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0b321ed9-5b07-41fb-ab33-28951da82bd4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:11.817038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b321ed9-5b07-41fb-ab33-28951da82bd4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:11.820910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b321ed9-5b07-41fb-ab33-28951da82bd4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:11.821444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b321ed9-5b07-41fb-ab33-28951da82bd4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:11.822303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b321ed9-5b07-41fb-ab33-28951da82bd4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:11.822774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b321ed9-5b07-41fb-ab33-28951da82bd4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:11.834554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:11.839533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b321ed9-5b07-41fb-ab33-28951da82bd4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:11.850366 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-67746af5-a98d-47f7-8783-98b9138f8845 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 200 len: 1304 microversion: 2.1 time: 0.578106 Oct 05 18:01:11.851890 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2340/4934] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:11 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 1304 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:12.155986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f017a1f-f14f-4d22-b6ae-19509cf37db0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:12.156602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5f017a1f-f14f-4d22-b6ae-19509cf37db0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:12.187198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f017a1f-f14f-4d22-b6ae-19509cf37db0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:12.188073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f017a1f-f14f-4d22-b6ae-19509cf37db0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:12.188545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f017a1f-f14f-4d22-b6ae-19509cf37db0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:12.189307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f017a1f-f14f-4d22-b6ae-19509cf37db0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:12.189776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f017a1f-f14f-4d22-b6ae-19509cf37db0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:12.190209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f017a1f-f14f-4d22-b6ae-19509cf37db0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:12.210897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0b321ed9-5b07-41fb-ab33-28951da82bd4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:12.224143 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0b321ed9-5b07-41fb-ab33-28951da82bd4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1211 microversion: 2.1 time: 0.425440 Oct 05 18:01:12.244630 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2595/4935] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:11 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1211 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:12.603025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4072605f-a0eb-4cef-ab21-96e8e24737c1 req-dab73b3d-aa29-46dd-9861-73975108ccb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86acc933-de7c-46d4-83a9-e27cd3be3862", "name": "network-vif-unplugged", "status": "completed", "tag": "77af47bc-66b5-4636-aca9-3a61a8db6572"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:12.650025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4072605f-a0eb-4cef-ab21-96e8e24737c1 req-dab73b3d-aa29-46dd-9861-73975108ccb1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:12.654754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4072605f-a0eb-4cef-ab21-96e8e24737c1 req-dab73b3d-aa29-46dd-9861-73975108ccb1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:12.655258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4072605f-a0eb-4cef-ab21-96e8e24737c1 req-dab73b3d-aa29-46dd-9861-73975108ccb1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:12.691132 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4072605f-a0eb-4cef-ab21-96e8e24737c1 req-dab73b3d-aa29-46dd-9861-73975108ccb1 service nova] Creating event network-vif-unplugged:77af47bc-66b5-4636-aca9-3a61a8db6572 for instance 86acc933-de7c-46d4-83a9-e27cd3be3862 on n-h1-835595-3 Oct 05 18:01:12.697796 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4072605f-a0eb-4cef-ab21-96e8e24737c1 req-dab73b3d-aa29-46dd-9861-73975108ccb1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099682 Oct 05 18:01:12.700989 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2596/4936] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:01:12.881383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:12.882175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: 348bdaad-4d98-4c6f-9005-d287813e1131] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:12.914508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:12.931783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:12.933486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:12.935865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:12.937699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:12.941018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:12.996138 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] HTTP exception thrown: Instance 348bdaad-4d98-4c6f-9005-d287813e1131 could not be found. Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Request method failure captured: Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 HTTP/1.1 Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZIZ9XZcx6zRwh_t_TzqkxkDHA861V6rBZXykCsBwjQOfh-7w7BOUeW2kH7JHCuk1R_Hj_CKELEbkkbWqALE-JFDCen9y64YoT42QisiJ9vRVTsz5OvNVFI_9UPd20Qga7RQR8JiAzC5NAF88Gbx2Oj64n8CTS3-WSTYj9o8fmelFU Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fa2e496707614956b6153196e1bda2ec Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesActionsTest-1953322454 Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fa2e496707614956b6153196e1bda2ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa2e496707614956b6153196e1bda2ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fa2e496707614956b6153196e1bda2ec", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa2e496707614956b6153196e1bda2ec"}]}] Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesActionsTest-1953322454 Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fa2e496707614956b6153196e1bda2ec Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesActionsTest-1953322454 Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesActionsTest-1953322454-project Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 35a7710f0d5d48a19daf802de6eeaae0 Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesActionsTest-1953322454-project Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 348bdaad-4d98-4c6f-9005-d287813e1131 could not be found. Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '348bdaad-4d98-4c6f-9005-d287813e1131'} Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 348bdaad-4d98-4c6f-9005-d287813e1131 could not be found. Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 348bdaad-4d98-4c6f-9005-d287813e1131 could not be found. Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:01:13.003298 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:13.007918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:13.007918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:01:13.007918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:01:13.007918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:01:13.007918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:01:13.007918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 348bdaad-4d98-4c6f-9005-d287813e1131 could not be found. Oct 05 18:01:13.007918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:13.021182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Returning 404 to user: Instance 348bdaad-4d98-4c6f-9005-d287813e1131 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:01:13.029000 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-66280b4a-e560-421c-9215-aea746d4949f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131" status: 404 len: 111 microversion: 2.1 time: 0.151138 Oct 05 18:01:13.030817 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2597/4937] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:12 2022] GET /compute/v2.1/servers/348bdaad-4d98-4c6f-9005-d287813e1131 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:01:13.256141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-016aea9c-6d76-4528-80cc-7a4a70f6e59c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:13.256758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-016aea9c-6d76-4528-80cc-7a4a70f6e59c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:13.273400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-016aea9c-6d76-4528-80cc-7a4a70f6e59c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:13.274817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-016aea9c-6d76-4528-80cc-7a4a70f6e59c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:13.281116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-016aea9c-6d76-4528-80cc-7a4a70f6e59c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:13.284107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-016aea9c-6d76-4528-80cc-7a4a70f6e59c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:13.284668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-016aea9c-6d76-4528-80cc-7a4a70f6e59c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:13.285123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-016aea9c-6d76-4528-80cc-7a4a70f6e59c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:13.519187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-016aea9c-6d76-4528-80cc-7a4a70f6e59c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:13.532025 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-016aea9c-6d76-4528-80cc-7a4a70f6e59c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1273 microversion: 2.1 time: 0.280367 Oct 05 18:01:13.540252 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2598/4938] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:13 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1273 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:13.556196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-470033604", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "4d26fec2-e2c8-42d8-941d-2909b6cab1a9"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:13.705052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] validate_networks() for [('4d26fec2-e2c8-42d8-941d-2909b6cab1a9', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:01:14.126677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5f017a1f-f14f-4d22-b6ae-19509cf37db0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:14.143368 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5f017a1f-f14f-4d22-b6ae-19509cf37db0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1692 microversion: 2.1 time: 1.991268 Oct 05 18:01:14.159483 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2341/4939] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:12 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1692 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:14.571384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-219da7c4-5508-418d-ba7f-b7d33d8dfdad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:14.572005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-219da7c4-5508-418d-ba7f-b7d33d8dfdad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:14.592599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-219da7c4-5508-418d-ba7f-b7d33d8dfdad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:14.593093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-219da7c4-5508-418d-ba7f-b7d33d8dfdad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:14.593532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-219da7c4-5508-418d-ba7f-b7d33d8dfdad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:14.604033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-219da7c4-5508-418d-ba7f-b7d33d8dfdad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:14.604659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-219da7c4-5508-418d-ba7f-b7d33d8dfdad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:14.605626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-219da7c4-5508-418d-ba7f-b7d33d8dfdad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:14.835342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-219da7c4-5508-418d-ba7f-b7d33d8dfdad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:14.845018 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-219da7c4-5508-418d-ba7f-b7d33d8dfdad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1273 microversion: 2.1 time: 0.277418 Oct 05 18:01:14.848602 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2342/4940] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:14 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1273 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:14.995733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5ae8ee0c-e0c6-4fda-8df5-3f8238b66b1c req-0ee8015b-63c8-48cc-914c-2e4db76b0ac1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86acc933-de7c-46d4-83a9-e27cd3be3862", "tag": "77af47bc-66b5-4636-aca9-3a61a8db6572"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:15.022080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5ae8ee0c-e0c6-4fda-8df5-3f8238b66b1c req-0ee8015b-63c8-48cc-914c-2e4db76b0ac1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:15.027080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5ae8ee0c-e0c6-4fda-8df5-3f8238b66b1c req-0ee8015b-63c8-48cc-914c-2e4db76b0ac1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:15.028712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5ae8ee0c-e0c6-4fda-8df5-3f8238b66b1c req-0ee8015b-63c8-48cc-914c-2e4db76b0ac1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:15.068367 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5ae8ee0c-e0c6-4fda-8df5-3f8238b66b1c req-0ee8015b-63c8-48cc-914c-2e4db76b0ac1 service nova] Creating event network-changed:77af47bc-66b5-4636-aca9-3a61a8db6572 for instance 86acc933-de7c-46d4-83a9-e27cd3be3862 on n-h1-835595-3 Oct 05 18:01:15.075168 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5ae8ee0c-e0c6-4fda-8df5-3f8238b66b1c req-0ee8015b-63c8-48cc-914c-2e4db76b0ac1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087820 Oct 05 18:01:15.078363 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2343/4941] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:01:15.174019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c24663b-d531-4ea6-9a36-446fbf5e1f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:15.175547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c24663b-d531-4ea6-9a36-446fbf5e1f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:15.191047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c24663b-d531-4ea6-9a36-446fbf5e1f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:15.191556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c24663b-d531-4ea6-9a36-446fbf5e1f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:15.191995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c24663b-d531-4ea6-9a36-446fbf5e1f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:15.192742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c24663b-d531-4ea6-9a36-446fbf5e1f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:15.193196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c24663b-d531-4ea6-9a36-446fbf5e1f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:15.193621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c24663b-d531-4ea6-9a36-446fbf5e1f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:15.724388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:01:15.724806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:01:15.725274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:01:15.725728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:01:15.726147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:01:15.741179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:15.742351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:15.743072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:15.743936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:15.744541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:15.745077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:15.767938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Getting quotas for project fa2e496707614956b6153196e1bda2ec. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:01:15.774441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Getting quotas for user 35a7710f0d5d48a19daf802de6eeaae0 and project fa2e496707614956b6153196e1bda2ec. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:01:15.798583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:01:15.801360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:01:15.882966 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-06ca9386-b37b-4816-91fb-b7107f51be87 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.335213 Oct 05 18:01:15.891833 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2599/4942] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:01:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:01:15.903546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-df4d31c0-1c4f-4b7c-818a-627b885be988 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:15.920863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-df4d31c0-1c4f-4b7c-818a-627b885be988 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:15.932239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df4d31c0-1c4f-4b7c-818a-627b885be988 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:15.934903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df4d31c0-1c4f-4b7c-818a-627b885be988 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:15.935528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df4d31c0-1c4f-4b7c-818a-627b885be988 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:15.936560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df4d31c0-1c4f-4b7c-818a-627b885be988 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:15.940174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df4d31c0-1c4f-4b7c-818a-627b885be988 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:15.940945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df4d31c0-1c4f-4b7c-818a-627b885be988 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:16.201077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-df4d31c0-1c4f-4b7c-818a-627b885be988 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:16.216010 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-df4d31c0-1c4f-4b7c-818a-627b885be988 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1315 microversion: 2.1 time: 0.322454 Oct 05 18:01:16.216801 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2600/4943] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:15 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:16.226755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7b4ba6b-e651-4471-8d39-1beb5703e98a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:16.229820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f7b4ba6b-e651-4471-8d39-1beb5703e98a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:16.406951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6c24663b-d531-4ea6-9a36-446fbf5e1f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:16.419424 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c24663b-d531-4ea6-9a36-446fbf5e1f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1692 microversion: 2.1 time: 1.249949 Oct 05 18:01:16.443138 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2344/4944] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:15 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1692 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:16.921918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f7b4ba6b-e651-4471-8d39-1beb5703e98a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:16.931707 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f7b4ba6b-e651-4471-8d39-1beb5703e98a tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1213 microversion: 2.1 time: 0.711793 Oct 05 18:01:16.935833 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2601/4945] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:16 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1213 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:17.244577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85e6d246-3bb7-4104-a9af-83df9cd59d0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:17.245474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-85e6d246-3bb7-4104-a9af-83df9cd59d0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:17.261057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e6d246-3bb7-4104-a9af-83df9cd59d0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:17.266794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e6d246-3bb7-4104-a9af-83df9cd59d0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:17.270552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e6d246-3bb7-4104-a9af-83df9cd59d0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:17.271698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e6d246-3bb7-4104-a9af-83df9cd59d0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:17.273811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e6d246-3bb7-4104-a9af-83df9cd59d0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:17.274845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e6d246-3bb7-4104-a9af-83df9cd59d0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:17.319718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:17.450415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb68511e-4184-4c81-92c6-fbdb57149d25 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:17.451035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb68511e-4184-4c81-92c6-fbdb57149d25 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:17.462737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb68511e-4184-4c81-92c6-fbdb57149d25 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:17.463243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb68511e-4184-4c81-92c6-fbdb57149d25 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:17.468569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb68511e-4184-4c81-92c6-fbdb57149d25 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:17.469991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb68511e-4184-4c81-92c6-fbdb57149d25 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:17.473552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb68511e-4184-4c81-92c6-fbdb57149d25 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:17.475488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb68511e-4184-4c81-92c6-fbdb57149d25 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:17.962014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fb68511e-4184-4c81-92c6-fbdb57149d25 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:17.973941 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb68511e-4184-4c81-92c6-fbdb57149d25 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1692 microversion: 2.1 time: 0.529224 Oct 05 18:01:17.989048 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2602/4946] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:17 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1692 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:17.991435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-73823b5c-af4a-4776-a12d-e24c9c82e8e4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:17.992486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-73823b5c-af4a-4776-a12d-e24c9c82e8e4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:18.009307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73823b5c-af4a-4776-a12d-e24c9c82e8e4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:18.010110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73823b5c-af4a-4776-a12d-e24c9c82e8e4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:18.010577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73823b5c-af4a-4776-a12d-e24c9c82e8e4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:18.011295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73823b5c-af4a-4776-a12d-e24c9c82e8e4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:18.011756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73823b5c-af4a-4776-a12d-e24c9c82e8e4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:18.012176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-73823b5c-af4a-4776-a12d-e24c9c82e8e4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:18.172106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85e6d246-3bb7-4104-a9af-83df9cd59d0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:18.188565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-73823b5c-af4a-4776-a12d-e24c9c82e8e4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:18.191921 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85e6d246-3bb7-4104-a9af-83df9cd59d0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1315 microversion: 2.1 time: 0.950610 Oct 05 18:01:18.195050 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2345/4947] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:17 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:18.214928 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-73823b5c-af4a-4776-a12d-e24c9c82e8e4 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1265 microversion: 2.1 time: 0.235942 Oct 05 18:01:18.237590 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2603/4948] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:17 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:19.002740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3fa7b0c2-31b0-4077-8312-9534fdcd36e4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:19.004125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3fa7b0c2-31b0-4077-8312-9534fdcd36e4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:19.052016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fa7b0c2-31b0-4077-8312-9534fdcd36e4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:19.052555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fa7b0c2-31b0-4077-8312-9534fdcd36e4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:19.053010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fa7b0c2-31b0-4077-8312-9534fdcd36e4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:19.059627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fa7b0c2-31b0-4077-8312-9534fdcd36e4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:19.061937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fa7b0c2-31b0-4077-8312-9534fdcd36e4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:19.062589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3fa7b0c2-31b0-4077-8312-9534fdcd36e4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:19.219188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a75a1df-0e6a-4e30-ae81-2ea4dca45725 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:19.220072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1a75a1df-0e6a-4e30-ae81-2ea4dca45725 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:19.239021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a75a1df-0e6a-4e30-ae81-2ea4dca45725 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:19.239577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a75a1df-0e6a-4e30-ae81-2ea4dca45725 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:19.239988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a75a1df-0e6a-4e30-ae81-2ea4dca45725 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:19.240749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a75a1df-0e6a-4e30-ae81-2ea4dca45725 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:19.241211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a75a1df-0e6a-4e30-ae81-2ea4dca45725 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:19.241634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a75a1df-0e6a-4e30-ae81-2ea4dca45725 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:19.626542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1a75a1df-0e6a-4e30-ae81-2ea4dca45725 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:19.646822 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1a75a1df-0e6a-4e30-ae81-2ea4dca45725 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1315 microversion: 2.1 time: 0.434355 Oct 05 18:01:19.661925 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2604/4949] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:19 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1315 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:19.661925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e82fa50e-732c-4e40-b17c-d78076c5b5e3 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:19.661925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e82fa50e-732c-4e40-b17c-d78076c5b5e3 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:19.685067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e82fa50e-732c-4e40-b17c-d78076c5b5e3 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:19.685579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e82fa50e-732c-4e40-b17c-d78076c5b5e3 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:19.686024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e82fa50e-732c-4e40-b17c-d78076c5b5e3 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:19.686779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e82fa50e-732c-4e40-b17c-d78076c5b5e3 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:19.687243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e82fa50e-732c-4e40-b17c-d78076c5b5e3 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:19.687673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e82fa50e-732c-4e40-b17c-d78076c5b5e3 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:19.874535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e82fa50e-732c-4e40-b17c-d78076c5b5e3 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:19.882646 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e82fa50e-732c-4e40-b17c-d78076c5b5e3 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1271 microversion: 2.1 time: 0.233592 Oct 05 18:01:19.898686 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2605/4950] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:19 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1271 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:20.213059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:20.671984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9bd8b9f-17e0-44c3-9eeb-e77be085aab0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:20.674040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b9bd8b9f-17e0-44c3-9eeb-e77be085aab0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:20.698061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bd8b9f-17e0-44c3-9eeb-e77be085aab0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:20.698633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bd8b9f-17e0-44c3-9eeb-e77be085aab0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:20.699367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bd8b9f-17e0-44c3-9eeb-e77be085aab0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:20.700089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bd8b9f-17e0-44c3-9eeb-e77be085aab0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:20.700626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bd8b9f-17e0-44c3-9eeb-e77be085aab0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:20.701057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9bd8b9f-17e0-44c3-9eeb-e77be085aab0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:20.758101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:20.851498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3fa7b0c2-31b0-4077-8312-9534fdcd36e4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:20.891491 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3fa7b0c2-31b0-4077-8312-9534fdcd36e4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1692 microversion: 2.1 time: 1.893965 Oct 05 18:01:20.896248 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2346/4951] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:18 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1692 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:20.913415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d940b380-a783-4274-98c9-e39d600d1461 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:20.914428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d940b380-a783-4274-98c9-e39d600d1461 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:20.926242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d940b380-a783-4274-98c9-e39d600d1461 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:20.930328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d940b380-a783-4274-98c9-e39d600d1461 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:20.931697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d940b380-a783-4274-98c9-e39d600d1461 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:20.937084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d940b380-a783-4274-98c9-e39d600d1461 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:20.942712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d940b380-a783-4274-98c9-e39d600d1461 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:20.943616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d940b380-a783-4274-98c9-e39d600d1461 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:21.772155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b9bd8b9f-17e0-44c3-9eeb-e77be085aab0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:21.807417 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b9bd8b9f-17e0-44c3-9eeb-e77be085aab0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1315 microversion: 2.1 time: 1.141966 Oct 05 18:01:21.816336 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2606/4952] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:20 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1315 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:21.839336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d891553b-963b-41de-a9ab-379d4573d802 req-0dfa8be3-d615-4578-a73c-ce6186c02685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20aa0b2c-3b0c-4f45-857c-24c41c351050", "tag": "0d6a31a2-1794-46f7-9caf-a38581b7530a"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:21.865752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d891553b-963b-41de-a9ab-379d4573d802 req-0dfa8be3-d615-4578-a73c-ce6186c02685 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:21.866720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d891553b-963b-41de-a9ab-379d4573d802 req-0dfa8be3-d615-4578-a73c-ce6186c02685 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:21.867497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d891553b-963b-41de-a9ab-379d4573d802 req-0dfa8be3-d615-4578-a73c-ce6186c02685 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:21.907096 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d891553b-963b-41de-a9ab-379d4573d802 req-0dfa8be3-d615-4578-a73c-ce6186c02685 service nova] Creating event network-changed:0d6a31a2-1794-46f7-9caf-a38581b7530a for instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 on n-h1-835595-3 Oct 05 18:01:21.915841 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d891553b-963b-41de-a9ab-379d4573d802 req-0dfa8be3-d615-4578-a73c-ce6186c02685 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097914 Oct 05 18:01:21.917127 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2607/4953] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:01:21.923348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a155ac6-feb9-4cf9-af1c-828aeea1757c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:21.924447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9a155ac6-feb9-4cf9-af1c-828aeea1757c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:21.933725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a155ac6-feb9-4cf9-af1c-828aeea1757c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:21.934732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a155ac6-feb9-4cf9-af1c-828aeea1757c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:21.946294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a155ac6-feb9-4cf9-af1c-828aeea1757c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:21.947470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a155ac6-feb9-4cf9-af1c-828aeea1757c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:21.949361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a155ac6-feb9-4cf9-af1c-828aeea1757c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:21.950066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a155ac6-feb9-4cf9-af1c-828aeea1757c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:22.004060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d940b380-a783-4274-98c9-e39d600d1461 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:22.016574 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d940b380-a783-4274-98c9-e39d600d1461 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1313 microversion: 2.1 time: 1.115023 Oct 05 18:01:22.032553 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2347/4954] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:20 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1313 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:22.847761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3e0b8ae6-24ae-4f8e-9552-4819f0be33f5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:22.848396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3e0b8ae6-24ae-4f8e-9552-4819f0be33f5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:22.860102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e0b8ae6-24ae-4f8e-9552-4819f0be33f5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:22.862643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e0b8ae6-24ae-4f8e-9552-4819f0be33f5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:22.863128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e0b8ae6-24ae-4f8e-9552-4819f0be33f5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:22.863925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e0b8ae6-24ae-4f8e-9552-4819f0be33f5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:22.864405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e0b8ae6-24ae-4f8e-9552-4819f0be33f5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:22.864831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e0b8ae6-24ae-4f8e-9552-4819f0be33f5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:23.041415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9a155ac6-feb9-4cf9-af1c-828aeea1757c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:23.056371 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a155ac6-feb9-4cf9-af1c-828aeea1757c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1692 microversion: 2.1 time: 1.134764 Oct 05 18:01:23.057103 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2608/4955] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:21 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1692 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:23.080415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3fb17272-daff-4116-9b28-04f130858195 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:23.081329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3fb17272-daff-4116-9b28-04f130858195 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:23.090920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3fb17272-daff-4116-9b28-04f130858195 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:23.091930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3fb17272-daff-4116-9b28-04f130858195 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:23.092730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3fb17272-daff-4116-9b28-04f130858195 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:23.093865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3fb17272-daff-4116-9b28-04f130858195 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:23.095097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3fb17272-daff-4116-9b28-04f130858195 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:23.095726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3fb17272-daff-4116-9b28-04f130858195 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:23.485043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3fb17272-daff-4116-9b28-04f130858195 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:23.496129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:23.503865 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3fb17272-daff-4116-9b28-04f130858195 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1313 microversion: 2.1 time: 0.428724 Oct 05 18:01:23.521830 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2609/4956] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:23 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:23.620222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3e0b8ae6-24ae-4f8e-9552-4819f0be33f5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:23.649438 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3e0b8ae6-24ae-4f8e-9552-4819f0be33f5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1315 microversion: 2.1 time: 0.805535 Oct 05 18:01:23.650823 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2348/4957] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:22 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:24.082905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5374b1fd-e4f2-4cd9-bff5-feb36ad86672 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:24.083699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5374b1fd-e4f2-4cd9-bff5-feb36ad86672 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:24.101733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5374b1fd-e4f2-4cd9-bff5-feb36ad86672 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:24.102562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5374b1fd-e4f2-4cd9-bff5-feb36ad86672 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:24.103636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5374b1fd-e4f2-4cd9-bff5-feb36ad86672 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:24.104603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5374b1fd-e4f2-4cd9-bff5-feb36ad86672 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:24.107070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5374b1fd-e4f2-4cd9-bff5-feb36ad86672 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:24.110550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5374b1fd-e4f2-4cd9-bff5-feb36ad86672 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:24.117870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-14f297ec-0c90-4b86-9178-fc6d14386322 req-7e6e86fb-e4a8-455b-b5de-0dd206af8f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7c1dfea-777d-4015-9ca1-3cb42b19bd1b", "tag": "79b7376f-ce01-4256-8319-695ff2c33ff2"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:24.164352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-14f297ec-0c90-4b86-9178-fc6d14386322 req-7e6e86fb-e4a8-455b-b5de-0dd206af8f05 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:24.165095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-14f297ec-0c90-4b86-9178-fc6d14386322 req-7e6e86fb-e4a8-455b-b5de-0dd206af8f05 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:24.165553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-14f297ec-0c90-4b86-9178-fc6d14386322 req-7e6e86fb-e4a8-455b-b5de-0dd206af8f05 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:24.199618 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-14f297ec-0c90-4b86-9178-fc6d14386322 req-7e6e86fb-e4a8-455b-b5de-0dd206af8f05 service nova] Creating event network-changed:79b7376f-ce01-4256-8319-695ff2c33ff2 for instance e7c1dfea-777d-4015-9ca1-3cb42b19bd1b on n-h2-835595-3 Oct 05 18:01:24.212831 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-14f297ec-0c90-4b86-9178-fc6d14386322 req-7e6e86fb-e4a8-455b-b5de-0dd206af8f05 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099313 Oct 05 18:01:24.213469 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2349/4958] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:01:24.532199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7509552b-f639-4c9d-b9c0-b8c9ac6a7866 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:24.533831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7509552b-f639-4c9d-b9c0-b8c9ac6a7866 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:24.545737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7509552b-f639-4c9d-b9c0-b8c9ac6a7866 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:24.551585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7509552b-f639-4c9d-b9c0-b8c9ac6a7866 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:24.553976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7509552b-f639-4c9d-b9c0-b8c9ac6a7866 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:24.554964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7509552b-f639-4c9d-b9c0-b8c9ac6a7866 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:24.557242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5374b1fd-e4f2-4cd9-bff5-feb36ad86672 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:24.568494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7509552b-f639-4c9d-b9c0-b8c9ac6a7866 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:24.571488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7509552b-f639-4c9d-b9c0-b8c9ac6a7866 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:24.608379 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5374b1fd-e4f2-4cd9-bff5-feb36ad86672 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1692 microversion: 2.1 time: 0.526582 Oct 05 18:01:24.627440 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2610/4959] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:24 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1692 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:24.674714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b98aec8-b023-475f-b7de-c104430fbe67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:24.682070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6b98aec8-b023-475f-b7de-c104430fbe67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:24.703129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b98aec8-b023-475f-b7de-c104430fbe67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:24.709889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b98aec8-b023-475f-b7de-c104430fbe67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:24.710661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b98aec8-b023-475f-b7de-c104430fbe67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:24.711522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b98aec8-b023-475f-b7de-c104430fbe67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:24.712273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b98aec8-b023-475f-b7de-c104430fbe67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:24.718065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b98aec8-b023-475f-b7de-c104430fbe67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:25.133861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6b98aec8-b023-475f-b7de-c104430fbe67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:25.144097 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b98aec8-b023-475f-b7de-c104430fbe67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1315 microversion: 2.1 time: 0.473551 Oct 05 18:01:25.145015 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2611/4960] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:24 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:25.639592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d6366906-b0d3-44a0-97c6-39afe430bb5b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:25.640082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d6366906-b0d3-44a0-97c6-39afe430bb5b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:25.646403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6366906-b0d3-44a0-97c6-39afe430bb5b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:25.646896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6366906-b0d3-44a0-97c6-39afe430bb5b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:25.647335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6366906-b0d3-44a0-97c6-39afe430bb5b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:25.648027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6366906-b0d3-44a0-97c6-39afe430bb5b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:25.648658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6366906-b0d3-44a0-97c6-39afe430bb5b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:25.649096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6366906-b0d3-44a0-97c6-39afe430bb5b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:25.675486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7509552b-f639-4c9d-b9c0-b8c9ac6a7866 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:25.696994 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7509552b-f639-4c9d-b9c0-b8c9ac6a7866 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1313 microversion: 2.1 time: 1.168912 Oct 05 18:01:25.703225 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2350/4961] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:24 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1313 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:25.754871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:25.806686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d6366906-b0d3-44a0-97c6-39afe430bb5b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:25.817841 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d6366906-b0d3-44a0-97c6-39afe430bb5b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1692 microversion: 2.1 time: 0.182272 Oct 05 18:01:25.835644 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2612/4962] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:25 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1692 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:26.169137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3356ca14-d926-432b-bc49-e619ae956e2a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:26.170077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3356ca14-d926-432b-bc49-e619ae956e2a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:26.179425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3356ca14-d926-432b-bc49-e619ae956e2a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:26.180524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3356ca14-d926-432b-bc49-e619ae956e2a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:26.181182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3356ca14-d926-432b-bc49-e619ae956e2a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:26.182104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3356ca14-d926-432b-bc49-e619ae956e2a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:26.183504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3356ca14-d926-432b-bc49-e619ae956e2a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:26.184718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3356ca14-d926-432b-bc49-e619ae956e2a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:26.726666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ead4a7aa-2474-485b-afb7-2d35fc426e64 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:26.727952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ead4a7aa-2474-485b-afb7-2d35fc426e64 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:26.737386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead4a7aa-2474-485b-afb7-2d35fc426e64 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:26.738193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead4a7aa-2474-485b-afb7-2d35fc426e64 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:26.738867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead4a7aa-2474-485b-afb7-2d35fc426e64 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:26.740052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead4a7aa-2474-485b-afb7-2d35fc426e64 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:26.740772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead4a7aa-2474-485b-afb7-2d35fc426e64 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:26.741426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ead4a7aa-2474-485b-afb7-2d35fc426e64 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:26.933840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:27.064310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ead4a7aa-2474-485b-afb7-2d35fc426e64 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:27.082883 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ead4a7aa-2474-485b-afb7-2d35fc426e64 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1313 microversion: 2.1 time: 0.361112 Oct 05 18:01:27.085388 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2613/4963] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:26 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:27.101700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-394e3499-4cc4-426b-a52a-619d069a902f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:27.102436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-394e3499-4cc4-426b-a52a-619d069a902f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:27.102586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3356ca14-d926-432b-bc49-e619ae956e2a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:27.113622 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3356ca14-d926-432b-bc49-e619ae956e2a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1315 microversion: 2.1 time: 0.948473 Oct 05 18:01:27.115690 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2351/4964] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:26 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:27.126157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394e3499-4cc4-426b-a52a-619d069a902f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:27.126157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394e3499-4cc4-426b-a52a-619d069a902f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:27.126157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394e3499-4cc4-426b-a52a-619d069a902f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:27.126157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394e3499-4cc4-426b-a52a-619d069a902f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:27.126157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394e3499-4cc4-426b-a52a-619d069a902f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:27.126157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394e3499-4cc4-426b-a52a-619d069a902f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:27.301537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-394e3499-4cc4-426b-a52a-619d069a902f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:27.311756 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-394e3499-4cc4-426b-a52a-619d069a902f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1692 microversion: 2.1 time: 0.223862 Oct 05 18:01:27.313328 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2614/4965] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:27 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1692 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:28.112983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-353acda3-795c-4c3a-bad0-17591618e1ac tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:28.113685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-353acda3-795c-4c3a-bad0-17591618e1ac tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:28.120832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-353acda3-795c-4c3a-bad0-17591618e1ac tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:28.121693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-353acda3-795c-4c3a-bad0-17591618e1ac tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:28.122667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-353acda3-795c-4c3a-bad0-17591618e1ac tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:28.123540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-353acda3-795c-4c3a-bad0-17591618e1ac tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:28.124538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-353acda3-795c-4c3a-bad0-17591618e1ac tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:28.125117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-353acda3-795c-4c3a-bad0-17591618e1ac tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:28.146124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-75d367f3-b09a-45ae-9026-5e718eb900ad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:28.147487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-75d367f3-b09a-45ae-9026-5e718eb900ad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:28.161478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d367f3-b09a-45ae-9026-5e718eb900ad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:28.162013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d367f3-b09a-45ae-9026-5e718eb900ad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:28.164940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d367f3-b09a-45ae-9026-5e718eb900ad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:28.165762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d367f3-b09a-45ae-9026-5e718eb900ad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:28.166238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d367f3-b09a-45ae-9026-5e718eb900ad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:28.170039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75d367f3-b09a-45ae-9026-5e718eb900ad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:28.469180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-353acda3-795c-4c3a-bad0-17591618e1ac tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:28.483795 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-353acda3-795c-4c3a-bad0-17591618e1ac tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1313 microversion: 2.1 time: 0.373358 Oct 05 18:01:28.499759 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2352/4966] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:28 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1313 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:28.514216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f81adb3e-d346-43a1-800c-da9032c6a467 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:28.514873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f81adb3e-d346-43a1-800c-da9032c6a467 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:28.528167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81adb3e-d346-43a1-800c-da9032c6a467 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:28.528973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81adb3e-d346-43a1-800c-da9032c6a467 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:28.529420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81adb3e-d346-43a1-800c-da9032c6a467 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:28.530154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81adb3e-d346-43a1-800c-da9032c6a467 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:28.530645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81adb3e-d346-43a1-800c-da9032c6a467 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:28.531080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81adb3e-d346-43a1-800c-da9032c6a467 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:28.593382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-75d367f3-b09a-45ae-9026-5e718eb900ad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:28.621643 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-75d367f3-b09a-45ae-9026-5e718eb900ad tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1315 microversion: 2.1 time: 0.481349 Oct 05 18:01:28.624830 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2615/4967] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:28 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:28.812371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f81adb3e-d346-43a1-800c-da9032c6a467 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:28.824487 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f81adb3e-d346-43a1-800c-da9032c6a467 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1682 microversion: 2.1 time: 0.324256 Oct 05 18:01:28.825903 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2353/4968] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:28 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1682 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:28.858446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-20a0f6a8-3a13-4c39-afbd-cdb83e0fee18 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:28.859277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-20a0f6a8-3a13-4c39-afbd-cdb83e0fee18 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:28.872170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a0f6a8-3a13-4c39-afbd-cdb83e0fee18 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:28.872982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a0f6a8-3a13-4c39-afbd-cdb83e0fee18 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:28.873415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a0f6a8-3a13-4c39-afbd-cdb83e0fee18 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:28.888563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a0f6a8-3a13-4c39-afbd-cdb83e0fee18 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:28.889072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a0f6a8-3a13-4c39-afbd-cdb83e0fee18 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:28.889588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20a0f6a8-3a13-4c39-afbd-cdb83e0fee18 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:29.509033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c52047d-b597-4313-8fb5-5ca5db293b0b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:29.509812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7c52047d-b597-4313-8fb5-5ca5db293b0b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:29.524685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c52047d-b597-4313-8fb5-5ca5db293b0b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:29.526424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c52047d-b597-4313-8fb5-5ca5db293b0b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:29.529484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c52047d-b597-4313-8fb5-5ca5db293b0b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:29.532193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c52047d-b597-4313-8fb5-5ca5db293b0b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:29.532811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c52047d-b597-4313-8fb5-5ca5db293b0b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:29.533338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c52047d-b597-4313-8fb5-5ca5db293b0b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:29.665337 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-20a0f6a8-3a13-4c39-afbd-cdb83e0fee18 tempest-TestNetworkAdvancedServerOps-1862277636 tempest-TestNetworkAdvancedServerOps-1862277636-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1833 microversion: 2.1 time: 0.817131 Oct 05 18:01:29.669132 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2616/4969] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:28 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1833 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:29.674270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ccd8bd6-5137-4307-9540-790ee6f329d3 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:29.676797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ccd8bd6-5137-4307-9540-790ee6f329d3 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:29.699020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccd8bd6-5137-4307-9540-790ee6f329d3 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:29.705978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccd8bd6-5137-4307-9540-790ee6f329d3 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:29.708304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccd8bd6-5137-4307-9540-790ee6f329d3 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:29.709192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccd8bd6-5137-4307-9540-790ee6f329d3 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:29.715038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccd8bd6-5137-4307-9540-790ee6f329d3 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:29.715038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccd8bd6-5137-4307-9540-790ee6f329d3 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:29.880895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7c52047d-b597-4313-8fb5-5ca5db293b0b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:29.893027 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7c52047d-b597-4313-8fb5-5ca5db293b0b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1313 microversion: 2.1 time: 0.387047 Oct 05 18:01:29.895369 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2354/4970] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:29 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:29.905380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f49ed71-640e-40cb-bdcb-4f5d18dae4bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:29.909941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f49ed71-640e-40cb-bdcb-4f5d18dae4bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:29.927130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f49ed71-640e-40cb-bdcb-4f5d18dae4bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:29.929568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f49ed71-640e-40cb-bdcb-4f5d18dae4bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:29.930225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f49ed71-640e-40cb-bdcb-4f5d18dae4bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:29.931191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f49ed71-640e-40cb-bdcb-4f5d18dae4bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:29.935973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f49ed71-640e-40cb-bdcb-4f5d18dae4bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:29.936600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f49ed71-640e-40cb-bdcb-4f5d18dae4bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:30.304485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5ccd8bd6-5137-4307-9540-790ee6f329d3 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:30.315835 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ccd8bd6-5137-4307-9540-790ee6f329d3 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1315 microversion: 2.1 time: 0.645227 Oct 05 18:01:30.319281 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2617/4971] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:29 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1315 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:30.324788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-678886b9-51cb-41b6-8e22-133315b20f83 req-2be41d92-e67b-4c4a-b9c6-eda9faf4b4f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20aa0b2c-3b0c-4f45-857c-24c41c351050", "name": "network-vif-plugged", "status": "completed", "tag": "0d6a31a2-1794-46f7-9caf-a38581b7530a"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:30.355006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-678886b9-51cb-41b6-8e22-133315b20f83 req-2be41d92-e67b-4c4a-b9c6-eda9faf4b4f6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:30.355778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-678886b9-51cb-41b6-8e22-133315b20f83 req-2be41d92-e67b-4c4a-b9c6-eda9faf4b4f6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:30.356359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-678886b9-51cb-41b6-8e22-133315b20f83 req-2be41d92-e67b-4c4a-b9c6-eda9faf4b4f6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:30.405580 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-678886b9-51cb-41b6-8e22-133315b20f83 req-2be41d92-e67b-4c4a-b9c6-eda9faf4b4f6 service nova] Creating event network-vif-plugged:0d6a31a2-1794-46f7-9caf-a38581b7530a for instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 on n-h1-835595-3 Oct 05 18:01:30.435026 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-678886b9-51cb-41b6-8e22-133315b20f83 req-2be41d92-e67b-4c4a-b9c6-eda9faf4b4f6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113960 Oct 05 18:01:30.435663 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2618/4972] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:01:30.839160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4f49ed71-640e-40cb-bdcb-4f5d18dae4bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:30.876676 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f49ed71-640e-40cb-bdcb-4f5d18dae4bd tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1682 microversion: 2.1 time: 0.979938 Oct 05 18:01:30.879524 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2355/4973] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:29 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1682 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:30.921421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-46a05495-738c-4fbd-9f66-ee7c8d7d4fd6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:30.922248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-46a05495-738c-4fbd-9f66-ee7c8d7d4fd6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:30.941297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a05495-738c-4fbd-9f66-ee7c8d7d4fd6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:30.941904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a05495-738c-4fbd-9f66-ee7c8d7d4fd6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:30.942451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a05495-738c-4fbd-9f66-ee7c8d7d4fd6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:30.950410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a05495-738c-4fbd-9f66-ee7c8d7d4fd6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:30.953024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a05495-738c-4fbd-9f66-ee7c8d7d4fd6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:30.954671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46a05495-738c-4fbd-9f66-ee7c8d7d4fd6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:31.345646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4eb22125-03a6-40ab-a55f-7024980d6573 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:31.346737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4eb22125-03a6-40ab-a55f-7024980d6573 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:31.364187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb22125-03a6-40ab-a55f-7024980d6573 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:31.367240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb22125-03a6-40ab-a55f-7024980d6573 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:31.368118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb22125-03a6-40ab-a55f-7024980d6573 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:31.373106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb22125-03a6-40ab-a55f-7024980d6573 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:31.376456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb22125-03a6-40ab-a55f-7024980d6573 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:31.377362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb22125-03a6-40ab-a55f-7024980d6573 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:31.807950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46a05495-738c-4fbd-9f66-ee7c8d7d4fd6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:31.817701 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-46a05495-738c-4fbd-9f66-ee7c8d7d4fd6 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1313 microversion: 2.1 time: 0.900692 Oct 05 18:01:31.826206 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2619/4974] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:30 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1313 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:31.839750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-272801a6-4385-48f7-8d6a-3b244cdd2268 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:31.848263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-272801a6-4385-48f7-8d6a-3b244cdd2268 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:31.908921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-272801a6-4385-48f7-8d6a-3b244cdd2268 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:31.913189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-272801a6-4385-48f7-8d6a-3b244cdd2268 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:31.927810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-272801a6-4385-48f7-8d6a-3b244cdd2268 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:31.938166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-272801a6-4385-48f7-8d6a-3b244cdd2268 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:31.946126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-272801a6-4385-48f7-8d6a-3b244cdd2268 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:31.948715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-272801a6-4385-48f7-8d6a-3b244cdd2268 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:31.989787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4eb22125-03a6-40ab-a55f-7024980d6573 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:32.026418 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4eb22125-03a6-40ab-a55f-7024980d6573 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1315 microversion: 2.1 time: 0.683779 Oct 05 18:01:32.029787 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2356/4975] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:31 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1315 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:01:32.088108 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-272801a6-4385-48f7-8d6a-3b244cdd2268 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862/action" status: 200 len: 38646 microversion: 2.1 time: 0.257616 Oct 05 18:01:32.088863 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2620/4976] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:01:31 2022] POST /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862/action => generated 38646 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:01:32.473560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ad99060b-36b8-49a8-8841-196c8d279a95 req-5040ff9e-6a97-4f99-86e7-a8695cc38b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c1dfea-777d-4015-9ca1-3cb42b19bd1b", "name": "network-vif-plugged", "status": "completed", "tag": "79b7376f-ce01-4256-8319-695ff2c33ff2"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:32.527705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ad99060b-36b8-49a8-8841-196c8d279a95 req-5040ff9e-6a97-4f99-86e7-a8695cc38b26 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:32.528199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ad99060b-36b8-49a8-8841-196c8d279a95 req-5040ff9e-6a97-4f99-86e7-a8695cc38b26 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:32.530385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ad99060b-36b8-49a8-8841-196c8d279a95 req-5040ff9e-6a97-4f99-86e7-a8695cc38b26 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:32.567363 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ad99060b-36b8-49a8-8841-196c8d279a95 req-5040ff9e-6a97-4f99-86e7-a8695cc38b26 service nova] Creating event network-vif-plugged:79b7376f-ce01-4256-8319-695ff2c33ff2 for instance e7c1dfea-777d-4015-9ca1-3cb42b19bd1b on n-h2-835595-3 Oct 05 18:01:32.576541 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ad99060b-36b8-49a8-8841-196c8d279a95 req-5040ff9e-6a97-4f99-86e7-a8695cc38b26 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108640 Oct 05 18:01:32.577819 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2357/4977] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:01:32.848609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b903ce78-4006-41d9-8a64-133b287596c8 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:32.849567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b903ce78-4006-41d9-8a64-133b287596c8 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:32.858670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b903ce78-4006-41d9-8a64-133b287596c8 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:32.859427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b903ce78-4006-41d9-8a64-133b287596c8 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:32.860034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b903ce78-4006-41d9-8a64-133b287596c8 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:32.861135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b903ce78-4006-41d9-8a64-133b287596c8 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:32.861740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b903ce78-4006-41d9-8a64-133b287596c8 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:32.862334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b903ce78-4006-41d9-8a64-133b287596c8 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:33.052853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-04528161-d45b-4120-a876-7cc59242de51 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:33.053381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-04528161-d45b-4120-a876-7cc59242de51 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:33.064502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04528161-d45b-4120-a876-7cc59242de51 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:33.071285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04528161-d45b-4120-a876-7cc59242de51 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:33.072276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04528161-d45b-4120-a876-7cc59242de51 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:33.073215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04528161-d45b-4120-a876-7cc59242de51 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:33.074534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04528161-d45b-4120-a876-7cc59242de51 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:33.075143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-04528161-d45b-4120-a876-7cc59242de51 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:33.484284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-04528161-d45b-4120-a876-7cc59242de51 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:33.493330 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-04528161-d45b-4120-a876-7cc59242de51 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1502 microversion: 2.1 time: 0.445354 Oct 05 18:01:33.497072 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2358/4978] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:33 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1502 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:33.916715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b903ce78-4006-41d9-8a64-133b287596c8 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:33.925117 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b903ce78-4006-41d9-8a64-133b287596c8 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1313 microversion: 2.1 time: 1.081069 Oct 05 18:01:33.945817 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2621/4979] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:32 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1313 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:34.949317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7f104505-73c7-41cf-af10-99c4b0f3559d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:34.950272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7f104505-73c7-41cf-af10-99c4b0f3559d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:34.959365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f104505-73c7-41cf-af10-99c4b0f3559d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:34.963000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f104505-73c7-41cf-af10-99c4b0f3559d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:34.965777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f104505-73c7-41cf-af10-99c4b0f3559d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:34.971945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f104505-73c7-41cf-af10-99c4b0f3559d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:34.972686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f104505-73c7-41cf-af10-99c4b0f3559d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:34.973172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7f104505-73c7-41cf-af10-99c4b0f3559d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:35.949179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7f104505-73c7-41cf-af10-99c4b0f3559d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:35.959377 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7f104505-73c7-41cf-af10-99c4b0f3559d tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1497 microversion: 2.1 time: 1.014051 Oct 05 18:01:35.964784 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2359/4980] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:34 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1497 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:36.496170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25ee3e36-899e-44c7-81ad-264923359a6f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9514348-aa92-46c0-b59c-373e3bf348b8"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:36.499118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25ee3e36-899e-44c7-81ad-264923359a6f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:36.519827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25ee3e36-899e-44c7-81ad-264923359a6f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:36.520334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25ee3e36-899e-44c7-81ad-264923359a6f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:36.520785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25ee3e36-899e-44c7-81ad-264923359a6f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:36.530869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25ee3e36-899e-44c7-81ad-264923359a6f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:36.531786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25ee3e36-899e-44c7-81ad-264923359a6f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:36.534085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25ee3e36-899e-44c7-81ad-264923359a6f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:37.069546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a4358f45-fd38-4773-b6bd-222486a9237b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:37.070203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a4358f45-fd38-4773-b6bd-222486a9237b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:37.086917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:37.099190 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25ee3e36-899e-44c7-81ad-264923359a6f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.602879 Oct 05 18:01:37.099890 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2622/4981] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:01:36 2022] POST /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050/os-volume_attachments => generated 194 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:01:37.104311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4358f45-fd38-4773-b6bd-222486a9237b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:37.111029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4358f45-fd38-4773-b6bd-222486a9237b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:37.111726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4358f45-fd38-4773-b6bd-222486a9237b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:37.113720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4358f45-fd38-4773-b6bd-222486a9237b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:37.115401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4358f45-fd38-4773-b6bd-222486a9237b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:37.119853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4358f45-fd38-4773-b6bd-222486a9237b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:37.185122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a4358f45-fd38-4773-b6bd-222486a9237b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:01:37.500224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b6bf37f6-4c9b-477b-b89f-bd0794866b51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:37.502064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b6bf37f6-4c9b-477b-b89f-bd0794866b51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:37.540343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf37f6-4c9b-477b-b89f-bd0794866b51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:37.545905 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a4358f45-fd38-4773-b6bd-222486a9237b tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 204 len: 0 microversion: 2.1 time: 0.485775 Oct 05 18:01:37.546394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf37f6-4c9b-477b-b89f-bd0794866b51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:37.547791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf37f6-4c9b-477b-b89f-bd0794866b51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:37.547791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf37f6-4c9b-477b-b89f-bd0794866b51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:37.549825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf37f6-4c9b-477b-b89f-bd0794866b51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:37.551648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6bf37f6-4c9b-477b-b89f-bd0794866b51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:37.552433 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2360/4982] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:01:37 2022] DELETE /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:01:37.572488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-cc5ac9b8-a88d-45ca-b282-cea4e5cf56fe req-39ae792b-abd0-4167-a006-0a5427e45d66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86acc933-de7c-46d4-83a9-e27cd3be3862", "tag": "77af47bc-66b5-4636-aca9-3a61a8db6572"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:37.604201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-cc5ac9b8-a88d-45ca-b282-cea4e5cf56fe req-39ae792b-abd0-4167-a006-0a5427e45d66 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:37.606718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-cc5ac9b8-a88d-45ca-b282-cea4e5cf56fe req-39ae792b-abd0-4167-a006-0a5427e45d66 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:37.610764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-cc5ac9b8-a88d-45ca-b282-cea4e5cf56fe req-39ae792b-abd0-4167-a006-0a5427e45d66 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:37.649731 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-cc5ac9b8-a88d-45ca-b282-cea4e5cf56fe req-39ae792b-abd0-4167-a006-0a5427e45d66 service nova] Creating event network-changed:77af47bc-66b5-4636-aca9-3a61a8db6572 for instance 86acc933-de7c-46d4-83a9-e27cd3be3862 on n-h2-835595-3 Oct 05 18:01:37.666146 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-cc5ac9b8-a88d-45ca-b282-cea4e5cf56fe req-39ae792b-abd0-4167-a006-0a5427e45d66 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106270 Oct 05 18:01:37.668535 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2361/4983] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:01:37.679960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b6bf37f6-4c9b-477b-b89f-bd0794866b51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:01:37.686459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e887eb95-5dbc-4029-933c-b59bb866aa6e tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:37.733336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e887eb95-5dbc-4029-933c-b59bb866aa6e tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:37.779795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e887eb95-5dbc-4029-933c-b59bb866aa6e tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:37.783595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e887eb95-5dbc-4029-933c-b59bb866aa6e tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:37.784637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e887eb95-5dbc-4029-933c-b59bb866aa6e tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:37.792392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e887eb95-5dbc-4029-933c-b59bb866aa6e tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:37.793891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e887eb95-5dbc-4029-933c-b59bb866aa6e tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:37.798598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e887eb95-5dbc-4029-933c-b59bb866aa6e tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:37.855919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:37.951820 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b6bf37f6-4c9b-477b-b89f-bd0794866b51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "DELETE /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 204 len: 0 microversion: 2.1 time: 0.458952 Oct 05 18:01:37.957133 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2623/4984] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:01:37 2022] DELETE /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:01:37.970749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-147ca3cb-50dc-42d4-90e6-a8bb224f08a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:37.971467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-147ca3cb-50dc-42d4-90e6-a8bb224f08a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:37.998778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-147ca3cb-50dc-42d4-90e6-a8bb224f08a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:38.003660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-147ca3cb-50dc-42d4-90e6-a8bb224f08a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:38.004285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-147ca3cb-50dc-42d4-90e6-a8bb224f08a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:38.005180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-147ca3cb-50dc-42d4-90e6-a8bb224f08a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:38.005804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-147ca3cb-50dc-42d4-90e6-a8bb224f08a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:38.008457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-147ca3cb-50dc-42d4-90e6-a8bb224f08a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:38.066100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:38.351607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e887eb95-5dbc-4029-933c-b59bb866aa6e tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:38.361331 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e887eb95-5dbc-4029-933c-b59bb866aa6e tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1503 microversion: 2.1 time: 0.688689 Oct 05 18:01:38.364471 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2362/4985] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:37 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1503 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:38.754723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-147ca3cb-50dc-42d4-90e6-a8bb224f08a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:38.764803 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-147ca3cb-50dc-42d4-90e6-a8bb224f08a2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1688 microversion: 2.1 time: 0.806137 Oct 05 18:01:38.767924 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2624/4986] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:37 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1688 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:39.394702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d07529ba-4bbb-4557-8f98-156fa9b7835f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:39.395989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d07529ba-4bbb-4557-8f98-156fa9b7835f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:39.418076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d07529ba-4bbb-4557-8f98-156fa9b7835f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:39.425465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d07529ba-4bbb-4557-8f98-156fa9b7835f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:39.429624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d07529ba-4bbb-4557-8f98-156fa9b7835f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:39.430657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d07529ba-4bbb-4557-8f98-156fa9b7835f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:39.438803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d07529ba-4bbb-4557-8f98-156fa9b7835f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:39.441356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d07529ba-4bbb-4557-8f98-156fa9b7835f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:39.795440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84bdaac0-2680-4738-948f-5d32a98076b8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:39.797167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-84bdaac0-2680-4738-948f-5d32a98076b8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:39.799780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:01:39.827590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bdaac0-2680-4738-948f-5d32a98076b8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:39.828478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bdaac0-2680-4738-948f-5d32a98076b8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:39.829197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bdaac0-2680-4738-948f-5d32a98076b8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:39.830168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bdaac0-2680-4738-948f-5d32a98076b8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:39.831006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bdaac0-2680-4738-948f-5d32a98076b8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:39.831680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84bdaac0-2680-4738-948f-5d32a98076b8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:40.358330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d07529ba-4bbb-4557-8f98-156fa9b7835f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:40.404190 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d07529ba-4bbb-4557-8f98-156fa9b7835f tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1503 microversion: 2.1 time: 1.010343 Oct 05 18:01:40.405824 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2363/4987] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:39 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1503 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:40.966006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1bb58f18-ea96-4e20-bf52-1169fb984c9e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:40.966772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1bb58f18-ea96-4e20-bf52-1169fb984c9e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:40.973517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bb58f18-ea96-4e20-bf52-1169fb984c9e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:40.974012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bb58f18-ea96-4e20-bf52-1169fb984c9e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:40.979667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bb58f18-ea96-4e20-bf52-1169fb984c9e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:40.987360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bb58f18-ea96-4e20-bf52-1169fb984c9e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:40.988093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bb58f18-ea96-4e20-bf52-1169fb984c9e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:40.988728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bb58f18-ea96-4e20-bf52-1169fb984c9e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:41.033518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-84bdaac0-2680-4738-948f-5d32a98076b8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:41.046314 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84bdaac0-2680-4738-948f-5d32a98076b8 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 200 len: 1688 microversion: 2.1 time: 1.254691 Oct 05 18:01:41.060157 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2625/4988] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:39 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 1688 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:41.109340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-1bb58f18-ea96-4e20-bf52-1169fb984c9e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lazy-loading 'services' on Instance uuid 3d259fb4-b583-48fb-acd0-f7a360848cff {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:01:41.138394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6c23499c-5d66-4dbb-9e34-da0912fa4628 req-b9f8c016-6daa-42fa-81ab-dd1f12060398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86acc933-de7c-46d4-83a9-e27cd3be3862", "name": "network-vif-deleted", "tag": "77af47bc-66b5-4636-aca9-3a61a8db6572"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:41.162043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6c23499c-5d66-4dbb-9e34-da0912fa4628 req-b9f8c016-6daa-42fa-81ab-dd1f12060398 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:41.164683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6c23499c-5d66-4dbb-9e34-da0912fa4628 req-b9f8c016-6daa-42fa-81ab-dd1f12060398 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:41.166188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6c23499c-5d66-4dbb-9e34-da0912fa4628 req-b9f8c016-6daa-42fa-81ab-dd1f12060398 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:41.208066 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6c23499c-5d66-4dbb-9e34-da0912fa4628 req-b9f8c016-6daa-42fa-81ab-dd1f12060398 service nova] Creating event network-vif-deleted:77af47bc-66b5-4636-aca9-3a61a8db6572 for instance 86acc933-de7c-46d4-83a9-e27cd3be3862 on n-h2-835595-3 Oct 05 18:01:41.220525 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6c23499c-5d66-4dbb-9e34-da0912fa4628 req-b9f8c016-6daa-42fa-81ab-dd1f12060398 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087139 Oct 05 18:01:41.225096 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2626/4989] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:01:41.310828 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1bb58f18-ea96-4e20-bf52-1169fb984c9e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff/os-volume_attachments/50139422-f07b-4a75-bd0a-a1e54b3fd962" status: 202 len: 0 microversion: 2.1 time: 0.348347 Oct 05 18:01:41.312201 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2364/4990] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:01:40 2022] DELETE /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff/os-volume_attachments/50139422-f07b-4a75-bd0a-a1e54b3fd962 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:01:41.431703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-74d4e18e-b9db-4d49-9288-65e5dedf20fe tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:41.432813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-74d4e18e-b9db-4d49-9288-65e5dedf20fe tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:41.451709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74d4e18e-b9db-4d49-9288-65e5dedf20fe tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:41.452209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74d4e18e-b9db-4d49-9288-65e5dedf20fe tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:41.452625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74d4e18e-b9db-4d49-9288-65e5dedf20fe tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:41.453343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74d4e18e-b9db-4d49-9288-65e5dedf20fe tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:41.462485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74d4e18e-b9db-4d49-9288-65e5dedf20fe tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:41.466064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74d4e18e-b9db-4d49-9288-65e5dedf20fe tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:41.852977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-74d4e18e-b9db-4d49-9288-65e5dedf20fe tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:41.865363 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-74d4e18e-b9db-4d49-9288-65e5dedf20fe tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1461 microversion: 2.1 time: 0.437898 Oct 05 18:01:41.865959 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2627/4991] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:41 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1461 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:42.084748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:42.085564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: 86acc933-de7c-46d4-83a9-e27cd3be3862] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:42.113492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:42.114310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:42.114909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:42.115791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:42.116398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:42.117044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:42.154691 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] HTTP exception thrown: Instance 86acc933-de7c-46d4-83a9-e27cd3be3862 could not be found. Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Request method failure captured: Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 HTTP/1.1 Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcR9hsASNeCxKdaWPh__rNnLpLGu_NRFNi62uQj9y73P1T9S0pslSwuq_12rTMXyGYm4d-Umm-79M42ROeTVnTLUWyZ4RZkWarKlFVLotx_WpwXcOjA-s_3fPDnuAoX-R_bMMcbYM0Kd8mJ9oPRpxXfRyUZdm3yiMPoJSkAHu7laR8I Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: ff799a13bddf49c0bc8b23c02eabf9ac Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ff799a13bddf49c0bc8b23c02eabf9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff799a13bddf49c0bc8b23c02eabf9ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ff799a13bddf49c0bc8b23c02eabf9ac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff799a13bddf49c0bc8b23c02eabf9ac"}]}] Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: ff799a13bddf49c0bc8b23c02eabf9ac Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestNetworkAdvancedServerOps-1621598017-project Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 06d379a97d474b74a29e62848a4e4696 Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1621598017-project Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 86acc933-de7c-46d4-83a9-e27cd3be3862 could not be found. Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '86acc933-de7c-46d4-83a9-e27cd3be3862'} Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86acc933-de7c-46d4-83a9-e27cd3be3862 could not be found. Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86acc933-de7c-46d4-83a9-e27cd3be3862 could not be found. Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:01:42.156414 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:01:42.161285 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:01:42.161285 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:42.161285 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:01:42.161285 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:01:42.161285 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:01:42.161285 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:01:42.161285 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86acc933-de7c-46d4-83a9-e27cd3be3862 could not be found. Oct 05 18:01:42.161285 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:01:42.163396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Returning 404 to user: Instance 86acc933-de7c-46d4-83a9-e27cd3be3862 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:01:42.164595 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ebf5d1d-5d3c-4559-85cc-c23397da2fc7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862" status: 404 len: 111 microversion: 2.1 time: 0.093771 Oct 05 18:01:42.165726 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2365/4992] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:42 2022] GET /compute/v2.1/servers/86acc933-de7c-46d4-83a9-e27cd3be3862 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:01:42.897678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:42.898513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:42.921248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:42.922110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:42.925690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:42.928557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:42.929414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:42.931032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:42.993715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:42.994511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:42.995112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:42.995735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lazy-loading 'fault' on Instance uuid e7c1dfea-777d-4015-9ca1-3cb42b19bd1b {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:01:43.854250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f8319dd8-98bf-4552-a355-a003927df6d9 req-d3a39ff4-fb83-4d48-a6e1-79e2217e7350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7c1dfea-777d-4015-9ca1-3cb42b19bd1b", "name": "network-vif-deleted", "tag": "79b7376f-ce01-4256-8319-695ff2c33ff2"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:43.855129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35a7710f0d5d48a19daf802de6eeaae0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa2e496707614956b6153196e1bda2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:43.863573 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-498e3d25-be23-4220-b5c6-3a09716f0711 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 200 len: 1303 microversion: 2.1 time: 0.970744 Oct 05 18:01:43.867684 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2628/4993] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:42 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 1303 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:43.879164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f8319dd8-98bf-4552-a355-a003927df6d9 req-d3a39ff4-fb83-4d48-a6e1-79e2217e7350 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:43.882857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f8319dd8-98bf-4552-a355-a003927df6d9 req-d3a39ff4-fb83-4d48-a6e1-79e2217e7350 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:43.883607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f8319dd8-98bf-4552-a355-a003927df6d9 req-d3a39ff4-fb83-4d48-a6e1-79e2217e7350 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:43.909170 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f8319dd8-98bf-4552-a355-a003927df6d9 req-d3a39ff4-fb83-4d48-a6e1-79e2217e7350 service nova] Creating event network-vif-deleted:79b7376f-ce01-4256-8319-695ff2c33ff2 for instance e7c1dfea-777d-4015-9ca1-3cb42b19bd1b on n-h2-835595-3 Oct 05 18:01:43.924274 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f8319dd8-98bf-4552-a355-a003927df6d9 req-d3a39ff4-fb83-4d48-a6e1-79e2217e7350 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074742 Oct 05 18:01:43.925501 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2366/4994] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:01:44.905991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:44.911592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] [instance: e7c1dfea-777d-4015-9ca1-3cb42b19bd1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:44.921951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:44.935605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:44.935768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:44.940303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:44.940794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:44.941235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:45.018858 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] HTTP exception thrown: Instance e7c1dfea-777d-4015-9ca1-3cb42b19bd1b could not be found. Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Request method failure captured: Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b HTTP/1.1 Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZIZ9XZcx6zRwh_t_TzqkxkDHA861V6rBZXykCsBwjQOfh-7w7BOUeW2kH7JHCuk1R_Hj_CKELEbkkbWqALE-JFDCen9y64YoT42QisiJ9vRVTsz5OvNVFI_9UPd20Qga7RQR8JiAzC5NAF88Gbx2Oj64n8CTS3-WSTYj9o8fmelFU Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fa2e496707614956b6153196e1bda2ec Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesActionsTest-1953322454 Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fa2e496707614956b6153196e1bda2ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa2e496707614956b6153196e1bda2ec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fa2e496707614956b6153196e1bda2ec", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa2e496707614956b6153196e1bda2ec"}]}] Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesActionsTest-1953322454 Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fa2e496707614956b6153196e1bda2ec Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesActionsTest-1953322454 Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesActionsTest-1953322454-project Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 35a7710f0d5d48a19daf802de6eeaae0 Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesActionsTest-1953322454-project Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e7c1dfea-777d-4015-9ca1-3cb42b19bd1b could not be found. Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e7c1dfea-777d-4015-9ca1-3cb42b19bd1b'} Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7c1dfea-777d-4015-9ca1-3cb42b19bd1b could not be found. Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7c1dfea-777d-4015-9ca1-3cb42b19bd1b could not be found. Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:01:45.027578 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:45.033789 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:45.033789 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:01:45.033789 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:01:45.033789 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:01:45.033789 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:01:45.033789 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7c1dfea-777d-4015-9ca1-3cb42b19bd1b could not be found. Oct 05 18:01:45.033789 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:45.033789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] Returning 404 to user: Instance e7c1dfea-777d-4015-9ca1-3cb42b19bd1b could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:01:45.034523 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bd676068-fd45-4b98-bdb0-a9449cbeef35 tempest-VolumesActionsTest-1953322454 tempest-VolumesActionsTest-1953322454-project] 10.222.0.70 "GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b" status: 404 len: 111 microversion: 2.1 time: 0.140788 Oct 05 18:01:45.042438 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2629/4995] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:44 2022] GET /compute/v2.1/servers/e7c1dfea-777d-4015-9ca1-3cb42b19bd1b => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:01:50.307337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6465b21b-e7a4-4e2e-817d-71d4c7fe9d73 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '.version_select at 0x7f777489c280>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:50.355347 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6465b21b-e7a4-4e2e-817d-71d4c7fe9d73 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-119614768" status: 202 len: 0 microversion: 2.1 time: 0.048280 Oct 05 18:01:50.361491 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2367/4996] 10.222.0.70 () {58 vars in 1281 bytes} [Wed Oct 5 18:01:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-119614768 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:01:50.389452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87192bb9-a6fc-440e-b146-ffb902dff9f4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'create', calling method: .version_select at 0x7f7774d78b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-423023667", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxhFVCO0WaIcN1lK5NB4Dh0lrAuxNoac8SI+XtPY6lYCR/BrYMcYG7xO23clVq0gBRg6l0Ib5PGPQUCJIBlnZYEetzQ2S7ESIkx5uSJH0xOyoCzMBjEr0/wvdPPLUjStw=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:50.408845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-87192bb9-a6fc-440e-b146-ffb902dff9f4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:01:50.416137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-87192bb9-a6fc-440e-b146-ffb902dff9f4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for user 06d379a97d474b74a29e62848a4e4696 and project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:01:50.469493 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87192bb9-a6fc-440e-b146-ffb902dff9f4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.083954 Oct 05 18:01:50.474135 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2630/4997] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:01:50 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:01:51.531779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-98889c71-1bc4-4bc6-a48c-90488dd39887 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:51.533273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-98889c71-1bc4-4bc6-a48c-90488dd39887 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:51.550223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98889c71-1bc4-4bc6-a48c-90488dd39887 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:51.554557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98889c71-1bc4-4bc6-a48c-90488dd39887 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:51.555432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98889c71-1bc4-4bc6-a48c-90488dd39887 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:51.557526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98889c71-1bc4-4bc6-a48c-90488dd39887 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:51.559908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98889c71-1bc4-4bc6-a48c-90488dd39887 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:51.560623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98889c71-1bc4-4bc6-a48c-90488dd39887 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:51.642167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-98889c71-1bc4-4bc6-a48c-90488dd39887 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:01:51.792807 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-98889c71-1bc4-4bc6-a48c-90488dd39887 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "DELETE /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 204 len: 0 microversion: 2.1 time: 0.265782 Oct 05 18:01:51.794323 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2368/4998] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:01:51 2022] DELETE /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:01:51.803277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63ab275c-e739-43f7-b06e-79ab2cf8141e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:51.804204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63ab275c-e739-43f7-b06e-79ab2cf8141e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:51.812735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63ab275c-e739-43f7-b06e-79ab2cf8141e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:51.813233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63ab275c-e739-43f7-b06e-79ab2cf8141e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:51.813668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63ab275c-e739-43f7-b06e-79ab2cf8141e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:51.814600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63ab275c-e739-43f7-b06e-79ab2cf8141e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:51.816325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63ab275c-e739-43f7-b06e-79ab2cf8141e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:51.816768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63ab275c-e739-43f7-b06e-79ab2cf8141e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:52.864607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63ab275c-e739-43f7-b06e-79ab2cf8141e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:52.883016 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63ab275c-e739-43f7-b06e-79ab2cf8141e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1514 microversion: 2.1 time: 1.084181 Oct 05 18:01:52.900244 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2631/4999] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:51 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1514 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:53.909895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-493c4f4f-04f9-49f8-83f5-3a603016ad9f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:53.910443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-493c4f4f-04f9-49f8-83f5-3a603016ad9f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:53.927990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493c4f4f-04f9-49f8-83f5-3a603016ad9f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:53.929508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493c4f4f-04f9-49f8-83f5-3a603016ad9f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:53.931873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493c4f4f-04f9-49f8-83f5-3a603016ad9f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:53.932898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493c4f4f-04f9-49f8-83f5-3a603016ad9f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:53.935977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493c4f4f-04f9-49f8-83f5-3a603016ad9f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:53.936710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-493c4f4f-04f9-49f8-83f5-3a603016ad9f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:54.749792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-493c4f4f-04f9-49f8-83f5-3a603016ad9f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:54.768439 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-493c4f4f-04f9-49f8-83f5-3a603016ad9f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1514 microversion: 2.1 time: 0.862503 Oct 05 18:01:54.772022 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2369/5000] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:53 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1514 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:55.219648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a23b1024-0e9d-46e4-b4fc-f2e4059345a3 req-da10228c-4b2f-462f-9f41-0ea4cb324173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d259fb4-b583-48fb-acd0-f7a360848cff", "name": "network-vif-deleted", "tag": "add13fde-06d4-4349-be8f-7eca46986bc8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:01:55.252803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a23b1024-0e9d-46e4-b4fc-f2e4059345a3 req-da10228c-4b2f-462f-9f41-0ea4cb324173 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:55.254028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a23b1024-0e9d-46e4-b4fc-f2e4059345a3 req-da10228c-4b2f-462f-9f41-0ea4cb324173 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:55.254669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a23b1024-0e9d-46e4-b4fc-f2e4059345a3 req-da10228c-4b2f-462f-9f41-0ea4cb324173 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:55.268628 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a23b1024-0e9d-46e4-b4fc-f2e4059345a3 req-da10228c-4b2f-462f-9f41-0ea4cb324173 service nova] Creating event network-vif-deleted:add13fde-06d4-4349-be8f-7eca46986bc8 for instance 3d259fb4-b583-48fb-acd0-f7a360848cff on n-h2-835595-3 Oct 05 18:01:55.275184 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a23b1024-0e9d-46e4-b4fc-f2e4059345a3 req-da10228c-4b2f-462f-9f41-0ea4cb324173 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059638 Oct 05 18:01:55.276320 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2632/5001] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:01:55.798774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:55.799463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:55.836267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:55.838170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:55.838660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:55.843810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:55.844299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:55.845741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:55.966037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:55.966557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:55.966992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:55.974210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lazy-loading 'fault' on Instance uuid 3d259fb4-b583-48fb-acd0-f7a360848cff {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:01:56.343800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:01:56.375011 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-419debf6-5964-460c-bfa6-1757d7e46f03 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 200 len: 1309 microversion: 2.1 time: 0.579385 Oct 05 18:01:56.393171 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2370/5002] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:55 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 1309 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:01:57.399750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:01:57.401867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: 3d259fb4-b583-48fb-acd0-f7a360848cff] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:01:57.444857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:57.454744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:57.455460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:57.457011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:01:57.461103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:01:57.463763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:01:57.497005 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] HTTP exception thrown: Instance 3d259fb4-b583-48fb-acd0-f7a360848cff could not be found. Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Request method failure captured: Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff HTTP/1.1 Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcWqi4JjZoRKBDYbncFpKjxieQFvUhiEmLFT-TAFCYWtWkZIrNr1dN7zZifyX79gxvEg0kcXN5OTMmyJpztIfKnT7wuDN2uwjGu-OduJEJvWOop2zlIT_h3XUxyUU9A9LzaZ9CVxSfCojakJaJ9LVSrQZWNNSXAnHTDlXZZ8j9-noyM Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: dbe08ff0f6ae4de2b0f29978c2f82bd3 Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1665593778 Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dbe08ff0f6ae4de2b0f29978c2f82bd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dbe08ff0f6ae4de2b0f29978c2f82bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dbe08ff0f6ae4de2b0f29978c2f82bd3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dbe08ff0f6ae4de2b0f29978c2f82bd3"}]}] Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesSnapshotTestJSON-1665593778 Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: dbe08ff0f6ae4de2b0f29978c2f82bd3 Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1665593778 Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesSnapshotTestJSON-1665593778-project Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4892ca792aab4b2fafd3eea8188a706a Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesSnapshotTestJSON-1665593778-project Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 3d259fb4-b583-48fb-acd0-f7a360848cff could not be found. Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '3d259fb4-b583-48fb-acd0-f7a360848cff'} Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d259fb4-b583-48fb-acd0-f7a360848cff could not be found. Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d259fb4-b583-48fb-acd0-f7a360848cff could not be found. Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:01:57.502100 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:57.506676 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:01:57.506676 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:01:57.506676 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:01:57.506676 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:01:57.506676 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:01:57.506676 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d259fb4-b583-48fb-acd0-f7a360848cff could not be found. Oct 05 18:01:57.506676 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:01:57.510023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Returning 404 to user: Instance 3d259fb4-b583-48fb-acd0-f7a360848cff could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:01:57.513348 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2b7346c4-d547-4a41-b7c9-d95787c824ac tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff" status: 404 len: 111 microversion: 2.1 time: 0.118064 Oct 05 18:01:57.515127 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2633/5003] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:01:57 2022] GET /compute/v2.1/servers/3d259fb4-b583-48fb-acd0-f7a360848cff => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:02:01.121467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eef05f3a-b42f-46af-b125-4ef0cb068df6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:01.122032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eef05f3a-b42f-46af-b125-4ef0cb068df6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:01.147241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eef05f3a-b42f-46af-b125-4ef0cb068df6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:01.151156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eef05f3a-b42f-46af-b125-4ef0cb068df6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:01.157586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eef05f3a-b42f-46af-b125-4ef0cb068df6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:01.160046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eef05f3a-b42f-46af-b125-4ef0cb068df6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:01.160897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eef05f3a-b42f-46af-b125-4ef0cb068df6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:01.171959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eef05f3a-b42f-46af-b125-4ef0cb068df6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:01.326021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eef05f3a-b42f-46af-b125-4ef0cb068df6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:02:01.574263 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eef05f3a-b42f-46af-b125-4ef0cb068df6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 204 len: 0 microversion: 2.1 time: 0.457112 Oct 05 18:02:01.579136 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2371/5004] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:02:01 2022] DELETE /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:02:01.603245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b1ec64cd-bc5a-4dd7-8bb8-94cf29cfd15d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:01.605072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b1ec64cd-bc5a-4dd7-8bb8-94cf29cfd15d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:01.622439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:01.656470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1ec64cd-bc5a-4dd7-8bb8-94cf29cfd15d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:01.658142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1ec64cd-bc5a-4dd7-8bb8-94cf29cfd15d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:01.658789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1ec64cd-bc5a-4dd7-8bb8-94cf29cfd15d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:01.666906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1ec64cd-bc5a-4dd7-8bb8-94cf29cfd15d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:01.670529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1ec64cd-bc5a-4dd7-8bb8-94cf29cfd15d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:01.671439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1ec64cd-bc5a-4dd7-8bb8-94cf29cfd15d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:02.183338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b1ec64cd-bc5a-4dd7-8bb8-94cf29cfd15d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:02.216345 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b1ec64cd-bc5a-4dd7-8bb8-94cf29cfd15d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1554 microversion: 2.1 time: 0.619693 Oct 05 18:02:02.222928 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2634/5005] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:01 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1554 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:03.250684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5de1ad22-dfd7-4dae-b1c4-577d3d6602f8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:03.252058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5de1ad22-dfd7-4dae-b1c4-577d3d6602f8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:03.263900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de1ad22-dfd7-4dae-b1c4-577d3d6602f8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:03.266298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de1ad22-dfd7-4dae-b1c4-577d3d6602f8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:03.268088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de1ad22-dfd7-4dae-b1c4-577d3d6602f8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:03.268990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de1ad22-dfd7-4dae-b1c4-577d3d6602f8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:03.270888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de1ad22-dfd7-4dae-b1c4-577d3d6602f8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:03.272649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de1ad22-dfd7-4dae-b1c4-577d3d6602f8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:04.521415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5de1ad22-dfd7-4dae-b1c4-577d3d6602f8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:04.544210 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5de1ad22-dfd7-4dae-b1c4-577d3d6602f8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1554 microversion: 2.1 time: 1.296131 Oct 05 18:02:04.546615 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2372/5006] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:03 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1554 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:05.573717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bd5de7ea-de25-44bd-9e66-0de592c449bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:05.575014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bd5de7ea-de25-44bd-9e66-0de592c449bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:05.632640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5de7ea-de25-44bd-9e66-0de592c449bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:05.639245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5de7ea-de25-44bd-9e66-0de592c449bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:05.654197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5de7ea-de25-44bd-9e66-0de592c449bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:05.659456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5de7ea-de25-44bd-9e66-0de592c449bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:05.660718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5de7ea-de25-44bd-9e66-0de592c449bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:05.666582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5de7ea-de25-44bd-9e66-0de592c449bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:06.073668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bd5de7ea-de25-44bd-9e66-0de592c449bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:06.108069 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bd5de7ea-de25-44bd-9e66-0de592c449bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1512 microversion: 2.1 time: 0.540626 Oct 05 18:02:06.109624 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2635/5007] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:05 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1512 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:06.246145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-0789deb3-7541-4a17-bc52-b6ffd3df418d req-e72662c0-5252-46f9-9915-3b952dbef646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20aa0b2c-3b0c-4f45-857c-24c41c351050", "name": "network-vif-deleted", "tag": "0d6a31a2-1794-46f7-9caf-a38581b7530a"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:06.282936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0789deb3-7541-4a17-bc52-b6ffd3df418d req-e72662c0-5252-46f9-9915-3b952dbef646 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:06.284583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0789deb3-7541-4a17-bc52-b6ffd3df418d req-e72662c0-5252-46f9-9915-3b952dbef646 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:06.286319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0789deb3-7541-4a17-bc52-b6ffd3df418d req-e72662c0-5252-46f9-9915-3b952dbef646 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:06.316044 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-0789deb3-7541-4a17-bc52-b6ffd3df418d req-e72662c0-5252-46f9-9915-3b952dbef646 service nova] Creating event network-vif-deleted:0d6a31a2-1794-46f7-9caf-a38581b7530a for instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 on n-h1-835595-3 Oct 05 18:02:06.323607 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-0789deb3-7541-4a17-bc52-b6ffd3df418d req-e72662c0-5252-46f9-9915-3b952dbef646 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085058 Oct 05 18:02:06.325157 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2373/5008] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:02:07.132811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2292c61-64cb-49a5-bd8d-40ed361db17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:07.134419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b2292c61-64cb-49a5-bd8d-40ed361db17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:07.157206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2292c61-64cb-49a5-bd8d-40ed361db17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:07.165483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2292c61-64cb-49a5-bd8d-40ed361db17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:07.166449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2292c61-64cb-49a5-bd8d-40ed361db17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:07.167444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2292c61-64cb-49a5-bd8d-40ed361db17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:07.168137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2292c61-64cb-49a5-bd8d-40ed361db17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:07.168830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2292c61-64cb-49a5-bd8d-40ed361db17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:07.583607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b2292c61-64cb-49a5-bd8d-40ed361db17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:07.597963 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2292c61-64cb-49a5-bd8d-40ed361db17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1346 microversion: 2.1 time: 0.469501 Oct 05 18:02:07.602518 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2636/5009] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:07 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1346 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:08.628285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ee0eed86-ac29-46d4-a7fc-cb3629f3699b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:08.629163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ee0eed86-ac29-46d4-a7fc-cb3629f3699b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:08.632329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:08.669753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee0eed86-ac29-46d4-a7fc-cb3629f3699b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:08.693626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee0eed86-ac29-46d4-a7fc-cb3629f3699b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:08.694654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee0eed86-ac29-46d4-a7fc-cb3629f3699b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:08.695536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee0eed86-ac29-46d4-a7fc-cb3629f3699b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:08.696147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee0eed86-ac29-46d4-a7fc-cb3629f3699b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:08.696704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee0eed86-ac29-46d4-a7fc-cb3629f3699b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:08.716422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=73,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:09.046230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ee0eed86-ac29-46d4-a7fc-cb3629f3699b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:09.059753 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ee0eed86-ac29-46d4-a7fc-cb3629f3699b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1346 microversion: 2.1 time: 0.436671 Oct 05 18:02:09.066616 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2374/5010] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:08 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1346 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:10.093611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-37deb0ef-ea0c-46c6-bc9d-33977c90f70f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:10.094888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-37deb0ef-ea0c-46c6-bc9d-33977c90f70f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:10.112966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:10.115350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37deb0ef-ea0c-46c6-bc9d-33977c90f70f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:10.126754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37deb0ef-ea0c-46c6-bc9d-33977c90f70f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:10.127550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37deb0ef-ea0c-46c6-bc9d-33977c90f70f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:10.143254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37deb0ef-ea0c-46c6-bc9d-33977c90f70f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:10.146650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37deb0ef-ea0c-46c6-bc9d-33977c90f70f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:10.149842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37deb0ef-ea0c-46c6-bc9d-33977c90f70f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:10.181157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=56 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:10.710204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-37deb0ef-ea0c-46c6-bc9d-33977c90f70f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:10.730039 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-37deb0ef-ea0c-46c6-bc9d-33977c90f70f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1346 microversion: 2.1 time: 0.640739 Oct 05 18:02:10.766650 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2637/5011] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:10 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1346 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:11.763876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00bd049f-f19e-4eb9-a455-e93c716a8f31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:11.765111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00bd049f-f19e-4eb9-a455-e93c716a8f31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:11.794513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00bd049f-f19e-4eb9-a455-e93c716a8f31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:11.795096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00bd049f-f19e-4eb9-a455-e93c716a8f31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:11.795554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00bd049f-f19e-4eb9-a455-e93c716a8f31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:11.796311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00bd049f-f19e-4eb9-a455-e93c716a8f31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:11.796803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00bd049f-f19e-4eb9-a455-e93c716a8f31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:11.809430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00bd049f-f19e-4eb9-a455-e93c716a8f31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:12.964065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-00bd049f-f19e-4eb9-a455-e93c716a8f31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:12.982024 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00bd049f-f19e-4eb9-a455-e93c716a8f31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1346 microversion: 2.1 time: 1.222764 Oct 05 18:02:12.992236 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2375/5012] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:11 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1346 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:14.023521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a222e8eb-182e-4778-9f61-573f6df71625 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:14.024222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a222e8eb-182e-4778-9f61-573f6df71625 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:14.033647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a222e8eb-182e-4778-9f61-573f6df71625 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:14.044449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a222e8eb-182e-4778-9f61-573f6df71625 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:14.049492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a222e8eb-182e-4778-9f61-573f6df71625 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:14.052025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a222e8eb-182e-4778-9f61-573f6df71625 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:14.055825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a222e8eb-182e-4778-9f61-573f6df71625 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:14.058636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a222e8eb-182e-4778-9f61-573f6df71625 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:14.098957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1657415576", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "874e4917-60a7-4b0c-80f9-ae0badb4305a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-423023667", "security_groups": [{"name": "tempest-secgroup-smoke-75914562"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:14.427435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a222e8eb-182e-4778-9f61-573f6df71625 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:14.452113 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a222e8eb-182e-4778-9f61-573f6df71625 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 200 len: 1346 microversion: 2.1 time: 0.435357 Oct 05 18:02:14.452733 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2638/5013] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:14 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 1346 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:14.820668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1357549729", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "864e1b11-de58-4912-8820-e91615fce639"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:22.970255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=11 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:24.171296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=5 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:24.432918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=11 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:24.860599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=5 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:38.406393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] validate_networks() for [('864e1b11-de58-4912-8820-e91615fce639', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:02:38.623468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] validate_networks() for [('874e4917-60a7-4b0c-80f9-ae0badb4305a', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:02:39.383555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:02:39.383997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:02:39.384481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:02:39.384895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:02:39.385316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:02:39.401752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:39.402264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:39.402740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:39.404773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:39.405265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:39.405706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:39.462846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Getting quotas for project dbe08ff0f6ae4de2b0f29978c2f82bd3. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:02:39.481061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Getting quotas for user 4892ca792aab4b2fafd3eea8188a706a and project dbe08ff0f6ae4de2b0f29978c2f82bd3. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:02:39.520925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:02:39.526808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:02:39.670352 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2a8b6123-7576-411f-9b10-70736fc8e6f9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 24.852998 Oct 05 18:02:39.681270 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2639/5014] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:02:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 24866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 18:02:39.699285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:39.699936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:39.725520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:39.726109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:39.726608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:39.731705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:39.732227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:39.732667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:39.766754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:02:39.767349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:02:39.767654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:02:39.768059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:02:39.774954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:02:39.797408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:39.805667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:39.807301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:39.809279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:39.810839 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:02:39.816126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:39.818036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 HTTP/1.1 Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '20aa0b2c-3b0c-4f45-857c-24c41c351050'} Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:02:39.819036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:39.824477 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:02:39.824477 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:02:39.824477 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:02:39.824477 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:02:39.824477 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:02:39.824477 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:02:39.824477 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:39.824477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:02:39.824477 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4745e8ae-b2dd-4b20-97a2-402cfe848645 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 404 len: 111 microversion: 2.1 time: 0.138335 Oct 05 18:02:39.824477 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2640/5015] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:39 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:02:39.829351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-563cb74a-6879-4d63-a914-7c289a10b14b tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:39.829984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-563cb74a-6879-4d63-a914-7c289a10b14b tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:39.945894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:02:39.964898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Getting quotas for user 06d379a97d474b74a29e62848a4e4696 and project ff799a13bddf49c0bc8b23c02eabf9ac. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:02:40.036684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-563cb74a-6879-4d63-a914-7c289a10b14b tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:40.039738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:02:40.056839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:02:40.109836 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-563cb74a-6879-4d63-a914-7c289a10b14b tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1219 microversion: 2.1 time: 0.284195 Oct 05 18:02:40.128485 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2641/5016] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:39 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1219 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:40.169592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:40.179193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:40.189440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:40.190243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:40.190882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:40.191769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:40.192402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:40.193007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:40.217070 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:02:40.226504 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ebbdcf9-ae99-4b70-aa01-c977bdb66c51 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 26.132095 Oct 05 18:02:40.227798 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2376/5017] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:02:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 26134 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050/os-volume_attachments HTTP/1.1 Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': '20aa0b2c-3b0c-4f45-857c-24c41c351050'} Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:02:40.233819 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6c715185-d9a3-4277-ae4d-be22f135ded6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.073534 Oct 05 18:02:40.240748 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2642/5018] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:02:40 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050/os-volume_attachments => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:02:40.251053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5e257baf-4f43-4cfc-94f2-e1cdf4a6ba71 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:40.255538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5e257baf-4f43-4cfc-94f2-e1cdf4a6ba71 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:40.463798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5e257baf-4f43-4cfc-94f2-e1cdf4a6ba71 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:40.484459 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5e257baf-4f43-4cfc-94f2-e1cdf4a6ba71 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1266 microversion: 2.1 time: 0.238934 Oct 05 18:02:40.487430 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2377/5019] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:40 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:40.692585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1178250678", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:40.801047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] validate_networks() for [('7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:02:41.136225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d6570eae-be50-4a90-9fad-d2cd74985dcd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:41.136872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d6570eae-be50-4a90-9fad-d2cd74985dcd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:41.157057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6570eae-be50-4a90-9fad-d2cd74985dcd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:41.157596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6570eae-be50-4a90-9fad-d2cd74985dcd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:41.158046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6570eae-be50-4a90-9fad-d2cd74985dcd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:41.169662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6570eae-be50-4a90-9fad-d2cd74985dcd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:41.170372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6570eae-be50-4a90-9fad-d2cd74985dcd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:41.174023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6570eae-be50-4a90-9fad-d2cd74985dcd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:41.429144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d6570eae-be50-4a90-9fad-d2cd74985dcd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:41.454372 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d6570eae-be50-4a90-9fad-d2cd74985dcd tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1215 microversion: 2.1 time: 0.306972 Oct 05 18:02:41.467535 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2378/5020] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:41 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:02:41.514236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1e033150-7848-47f9-b5a1-aec538a3efed tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:41.515140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1e033150-7848-47f9-b5a1-aec538a3efed tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:41.530779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e033150-7848-47f9-b5a1-aec538a3efed tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:41.532606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e033150-7848-47f9-b5a1-aec538a3efed tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:41.533243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e033150-7848-47f9-b5a1-aec538a3efed tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:41.536038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e033150-7848-47f9-b5a1-aec538a3efed tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:41.540586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e033150-7848-47f9-b5a1-aec538a3efed tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:41.541449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1e033150-7848-47f9-b5a1-aec538a3efed tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:41.745246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1e033150-7848-47f9-b5a1-aec538a3efed tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:41.759637 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1e033150-7848-47f9-b5a1-aec538a3efed tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1270 microversion: 2.1 time: 0.249138 Oct 05 18:02:41.760237 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2379/5021] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:41 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:42.135345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:02:42.136058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:02:42.136699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:02:42.137239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:02:42.138070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:02:42.157615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:42.166546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:42.167500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:42.169690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:42.172775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:42.173337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:42.246701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:02:42.265869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for user 9ea1c284fc254cc7a51d9e67d4fe8168 and project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:02:42.322172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:02:42.324652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:02:42.413083 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-da1e60b9-aca8-401b-8b3b-adc72acaed10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.724221 Oct 05 18:02:42.419860 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2643/5022] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:02:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:02:42.425919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ffb72ce7-2b6b-460c-b1b1-b7b3692932f6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:42.426585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ffb72ce7-2b6b-460c-b1b1-b7b3692932f6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:42.486323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f620c689-0817-4baa-809b-98a662332cdb tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:42.487204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f620c689-0817-4baa-809b-98a662332cdb tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:42.512880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f620c689-0817-4baa-809b-98a662332cdb tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:42.530359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f620c689-0817-4baa-809b-98a662332cdb tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:42.534572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f620c689-0817-4baa-809b-98a662332cdb tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:42.540448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f620c689-0817-4baa-809b-98a662332cdb tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:42.542177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f620c689-0817-4baa-809b-98a662332cdb tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:42.549620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f620c689-0817-4baa-809b-98a662332cdb tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:42.823605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ffb72ce7-2b6b-460c-b1b1-b7b3692932f6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:42.833179 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ffb72ce7-2b6b-460c-b1b1-b7b3692932f6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4" status: 200 len: 1215 microversion: 2.1 time: 0.411638 Oct 05 18:02:42.836016 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2380/5023] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:42 2022] GET /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 => generated 1215 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:42.863668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41fff47e-6489-4143-8401-5256d66d0546 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:42.869528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-41fff47e-6489-4143-8401-5256d66d0546 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:42.886645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f620c689-0817-4baa-809b-98a662332cdb tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:42.903085 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f620c689-0817-4baa-809b-98a662332cdb tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1289 microversion: 2.1 time: 0.419960 Oct 05 18:02:42.903667 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2644/5024] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:42 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1289 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:42.914606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41fff47e-6489-4143-8401-5256d66d0546 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:42.914606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41fff47e-6489-4143-8401-5256d66d0546 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:42.914606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41fff47e-6489-4143-8401-5256d66d0546 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:42.914606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41fff47e-6489-4143-8401-5256d66d0546 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:42.916252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41fff47e-6489-4143-8401-5256d66d0546 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:42.919453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41fff47e-6489-4143-8401-5256d66d0546 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:42.944068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-57477265-62c6-4db2-b941-77125ec502bd tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:42.944593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-57477265-62c6-4db2-b941-77125ec502bd tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:43.023012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-57477265-62c6-4db2-b941-77125ec502bd tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:02:43.185865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-41fff47e-6489-4143-8401-5256d66d0546 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:43.212625 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-41fff47e-6489-4143-8401-5256d66d0546 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1336 microversion: 2.1 time: 0.370806 Oct 05 18:02:43.219997 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2381/5025] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:42 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1336 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:43.935875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-13d1c37e-fa39-4243-b669-9cdc44d6bc46 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:43.936579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-13d1c37e-fa39-4243-b669-9cdc44d6bc46 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:43.955986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13d1c37e-fa39-4243-b669-9cdc44d6bc46 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:43.957429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13d1c37e-fa39-4243-b669-9cdc44d6bc46 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:43.958099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13d1c37e-fa39-4243-b669-9cdc44d6bc46 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:43.959170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13d1c37e-fa39-4243-b669-9cdc44d6bc46 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:43.959853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13d1c37e-fa39-4243-b669-9cdc44d6bc46 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:43.962231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13d1c37e-fa39-4243-b669-9cdc44d6bc46 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:44.024061 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.api [None req-57477265-62c6-4db2-b941-77125ec502bd tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4] Instance Mapping does not exist while attempting local delete cleanup. Oct 05 18:02:44.025017 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-57477265-62c6-4db2-b941-77125ec502bd tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4" status: 204 len: 0 microversion: 2.1 time: 1.120281 Oct 05 18:02:44.026048 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2645/5026] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:02:42 2022] DELETE /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:02:44.043180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24f53648-cf43-4a9e-9b9c-d4752460c4f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:44.048112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-24f53648-cf43-4a9e-9b9c-d4752460c4f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:44.075416 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-24f53648-cf43-4a9e-9b9c-d4752460c4f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24f53648-cf43-4a9e-9b9c-d4752460c4f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 HTTP/1.1 Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '7fe22d75-5c2f-4405-aa2c-a25ecf4916d4'} Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:02:44.080089 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:02:44.088302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:02:44.088302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:02:44.088302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:02:44.088302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:02:44.088302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:02:44.090571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24f53648-cf43-4a9e-9b9c-d4752460c4f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:02:44.094132 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-24f53648-cf43-4a9e-9b9c-d4752460c4f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4" status: 404 len: 111 microversion: 2.1 time: 0.062144 Oct 05 18:02:44.097461 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2646/5027] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:44 2022] GET /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:02:44.238105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-212741e2-ed14-4828-8c31-c1608596ac5c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:44.239004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-212741e2-ed14-4828-8c31-c1608596ac5c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:44.247240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-212741e2-ed14-4828-8c31-c1608596ac5c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:44.248301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-212741e2-ed14-4828-8c31-c1608596ac5c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:44.248922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-212741e2-ed14-4828-8c31-c1608596ac5c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:44.249819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-212741e2-ed14-4828-8c31-c1608596ac5c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:44.250476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-212741e2-ed14-4828-8c31-c1608596ac5c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:44.251074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-212741e2-ed14-4828-8c31-c1608596ac5c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:44.441095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-13d1c37e-fa39-4243-b669-9cdc44d6bc46 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:44.459142 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-13d1c37e-fa39-4243-b669-9cdc44d6bc46 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1319 microversion: 2.1 time: 0.530184 Oct 05 18:02:44.465464 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2382/5028] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:43 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1319 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:44.473994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2030736977", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:44.636951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] validate_networks() for [('7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:02:44.845444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-212741e2-ed14-4828-8c31-c1608596ac5c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:44.858072 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-212741e2-ed14-4828-8c31-c1608596ac5c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1390 microversion: 2.1 time: 0.623723 Oct 05 18:02:44.858725 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2647/5029] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:44 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1390 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:02:45.492590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-def08c2b-dc70-4dbd-9935-35061f344137 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:45.493273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-def08c2b-dc70-4dbd-9935-35061f344137 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:45.517965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-def08c2b-dc70-4dbd-9935-35061f344137 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:45.520635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-def08c2b-dc70-4dbd-9935-35061f344137 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:45.521173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-def08c2b-dc70-4dbd-9935-35061f344137 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:45.522026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-def08c2b-dc70-4dbd-9935-35061f344137 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:45.531085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-def08c2b-dc70-4dbd-9935-35061f344137 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:45.532820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-def08c2b-dc70-4dbd-9935-35061f344137 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:46.265649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:02:46.266215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:02:46.266573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:02:46.266989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:02:46.267405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:02:46.272998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-def08c2b-dc70-4dbd-9935-35061f344137 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:46.280274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:46.280723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:46.281174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:46.281919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:46.286756 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-def08c2b-dc70-4dbd-9935-35061f344137 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1319 microversion: 2.1 time: 0.798825 Oct 05 18:02:46.299045 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2648/5030] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:45 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1319 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:46.301342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:46.306254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:46.314337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ca1d6ff-00b7-4f8e-8884-381385b59976 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:46.314965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8ca1d6ff-00b7-4f8e-8884-381385b59976 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:46.341210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca1d6ff-00b7-4f8e-8884-381385b59976 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:46.341725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca1d6ff-00b7-4f8e-8884-381385b59976 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:46.342259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca1d6ff-00b7-4f8e-8884-381385b59976 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:46.350562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca1d6ff-00b7-4f8e-8884-381385b59976 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:46.351363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca1d6ff-00b7-4f8e-8884-381385b59976 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:46.353728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ca1d6ff-00b7-4f8e-8884-381385b59976 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:46.356620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:02:46.373860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for user 9ea1c284fc254cc7a51d9e67d4fe8168 and project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:02:46.395739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:02:46.398602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:02:46.454372 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eac228fb-8cd6-4148-a49e-3257394b71f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.987676 Oct 05 18:02:46.455643 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2383/5031] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:02:46.501052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48b35c72-8647-47bb-bc80-9b11aba1dcde tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:46.502065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48b35c72-8647-47bb-bc80-9b11aba1dcde tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:46.695870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48b35c72-8647-47bb-bc80-9b11aba1dcde tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:46.703754 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48b35c72-8647-47bb-bc80-9b11aba1dcde tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1215 microversion: 2.1 time: 0.238939 Oct 05 18:02:46.708697 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2384/5032] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:46 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:46.795340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8ca1d6ff-00b7-4f8e-8884-381385b59976 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:46.808559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8ca1d6ff-00b7-4f8e-8884-381385b59976 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1390 microversion: 2.1 time: 0.500615 Oct 05 18:02:46.809247 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2649/5033] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:46 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1390 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:46.965705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-538e5c32-4619-4688-a9a4-420e143f6b54 req-48ba2007-fb30-4c54-9ef2-6cd38828a21f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbd4073-50d6-4c67-8ee5-447f772298a0", "tag": "ea6385e4-12b8-44d1-94e9-c6103b6b8376"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:47.007623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-538e5c32-4619-4688-a9a4-420e143f6b54 req-48ba2007-fb30-4c54-9ef2-6cd38828a21f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:47.008142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-538e5c32-4619-4688-a9a4-420e143f6b54 req-48ba2007-fb30-4c54-9ef2-6cd38828a21f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:47.011318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-538e5c32-4619-4688-a9a4-420e143f6b54 req-48ba2007-fb30-4c54-9ef2-6cd38828a21f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:47.068586 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-538e5c32-4619-4688-a9a4-420e143f6b54 req-48ba2007-fb30-4c54-9ef2-6cd38828a21f service nova] Creating event network-changed:ea6385e4-12b8-44d1-94e9-c6103b6b8376 for instance ccbd4073-50d6-4c67-8ee5-447f772298a0 on n-h1-835595-3 Oct 05 18:02:47.083295 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-538e5c32-4619-4688-a9a4-420e143f6b54 req-48ba2007-fb30-4c54-9ef2-6cd38828a21f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122430 Oct 05 18:02:47.086607 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2385/5034] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:02:47.313350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e0f7987f-8a7a-4390-b20e-80c0eff39b1e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:47.313981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e0f7987f-8a7a-4390-b20e-80c0eff39b1e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:47.337226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0f7987f-8a7a-4390-b20e-80c0eff39b1e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:47.337804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0f7987f-8a7a-4390-b20e-80c0eff39b1e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:47.345476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0f7987f-8a7a-4390-b20e-80c0eff39b1e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:47.346444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0f7987f-8a7a-4390-b20e-80c0eff39b1e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:47.346951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0f7987f-8a7a-4390-b20e-80c0eff39b1e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:47.347399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0f7987f-8a7a-4390-b20e-80c0eff39b1e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:47.701099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7ca54d92-db91-4772-b586-99c5d05cfe49 req-1676d3da-9135-4059-8959-c7f989253662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0c3807c-eb9a-4c1f-a519-b3d2c98ba866", "tag": "ea45799e-94b3-4c8d-927f-e5c706a76fe8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:47.735494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e0f7987f-8a7a-4390-b20e-80c0eff39b1e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:47.737845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7ca54d92-db91-4772-b586-99c5d05cfe49 req-1676d3da-9135-4059-8959-c7f989253662 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:47.739071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7ca54d92-db91-4772-b586-99c5d05cfe49 req-1676d3da-9135-4059-8959-c7f989253662 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:47.742134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7ca54d92-db91-4772-b586-99c5d05cfe49 req-1676d3da-9135-4059-8959-c7f989253662 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:47.756061 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e0f7987f-8a7a-4390-b20e-80c0eff39b1e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1319 microversion: 2.1 time: 0.444646 Oct 05 18:02:47.757662 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2650/5035] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:47 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:47.774932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-125fc316-7d9f-4451-aaae-a9a76a519e0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:47.775555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-125fc316-7d9f-4451-aaae-a9a76a519e0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:47.785455 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7ca54d92-db91-4772-b586-99c5d05cfe49 req-1676d3da-9135-4059-8959-c7f989253662 service nova] Creating event network-changed:ea45799e-94b3-4c8d-927f-e5c706a76fe8 for instance b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 on n-h1-835595-3 Oct 05 18:02:47.797015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-125fc316-7d9f-4451-aaae-a9a76a519e0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:47.800367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-125fc316-7d9f-4451-aaae-a9a76a519e0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:47.803540 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7ca54d92-db91-4772-b586-99c5d05cfe49 req-1676d3da-9135-4059-8959-c7f989253662 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106368 Oct 05 18:02:47.803864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-125fc316-7d9f-4451-aaae-a9a76a519e0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:47.805044 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2386/5036] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:02:47.805822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-125fc316-7d9f-4451-aaae-a9a76a519e0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:47.808410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-125fc316-7d9f-4451-aaae-a9a76a519e0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:47.808861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-125fc316-7d9f-4451-aaae-a9a76a519e0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:47.840602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a00f57d-443e-4e63-9dc9-1d48b5312e70 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:47.841644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a00f57d-443e-4e63-9dc9-1d48b5312e70 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:47.854192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a00f57d-443e-4e63-9dc9-1d48b5312e70 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:47.855098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a00f57d-443e-4e63-9dc9-1d48b5312e70 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:47.855808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a00f57d-443e-4e63-9dc9-1d48b5312e70 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:47.858792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a00f57d-443e-4e63-9dc9-1d48b5312e70 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:47.859547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a00f57d-443e-4e63-9dc9-1d48b5312e70 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:47.860827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a00f57d-443e-4e63-9dc9-1d48b5312e70 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:48.101552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-125fc316-7d9f-4451-aaae-a9a76a519e0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:48.124559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-125fc316-7d9f-4451-aaae-a9a76a519e0b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1219 microversion: 2.1 time: 0.355327 Oct 05 18:02:48.127616 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2651/5037] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:47 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1219 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:48.666157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a00f57d-443e-4e63-9dc9-1d48b5312e70 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:48.676306 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a00f57d-443e-4e63-9dc9-1d48b5312e70 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1390 microversion: 2.1 time: 0.840136 Oct 05 18:02:48.677046 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2387/5038] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:47 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1390 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:02:48.782979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bb579bdc-e739-46a1-a656-ee962844669c tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:48.783602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bb579bdc-e739-46a1-a656-ee962844669c tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:48.796408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb579bdc-e739-46a1-a656-ee962844669c tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:48.796910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb579bdc-e739-46a1-a656-ee962844669c tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:48.797347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb579bdc-e739-46a1-a656-ee962844669c tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:48.798068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb579bdc-e739-46a1-a656-ee962844669c tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:48.799670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb579bdc-e739-46a1-a656-ee962844669c tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:48.800115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb579bdc-e739-46a1-a656-ee962844669c tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:49.148952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-12b622ef-8bd7-4ac5-bffc-c115c5f07175 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:49.150214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-12b622ef-8bd7-4ac5-bffc-c115c5f07175 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:49.164067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12b622ef-8bd7-4ac5-bffc-c115c5f07175 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:49.164827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12b622ef-8bd7-4ac5-bffc-c115c5f07175 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:49.165426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12b622ef-8bd7-4ac5-bffc-c115c5f07175 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:49.166318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12b622ef-8bd7-4ac5-bffc-c115c5f07175 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:49.171197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12b622ef-8bd7-4ac5-bffc-c115c5f07175 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:49.171893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12b622ef-8bd7-4ac5-bffc-c115c5f07175 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:49.264755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-12b622ef-8bd7-4ac5-bffc-c115c5f07175 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:49.275185 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-12b622ef-8bd7-4ac5-bffc-c115c5f07175 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1285 microversion: 2.1 time: 0.130115 Oct 05 18:02:49.292381 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2388/5039] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:49 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:02:49.701688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd66d130-d571-43a0-a1c4-93faefc28ac1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:49.705161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd66d130-d571-43a0-a1c4-93faefc28ac1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:49.725163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd66d130-d571-43a0-a1c4-93faefc28ac1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:49.725676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd66d130-d571-43a0-a1c4-93faefc28ac1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:49.726121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd66d130-d571-43a0-a1c4-93faefc28ac1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:49.732817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd66d130-d571-43a0-a1c4-93faefc28ac1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:49.733283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd66d130-d571-43a0-a1c4-93faefc28ac1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:49.733742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd66d130-d571-43a0-a1c4-93faefc28ac1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:49.817935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bb579bdc-e739-46a1-a656-ee962844669c tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:49.833113 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bb579bdc-e739-46a1-a656-ee962844669c tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1319 microversion: 2.1 time: 1.052062 Oct 05 18:02:49.834271 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2652/5040] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:48 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1319 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:50.078841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fd66d130-d571-43a0-a1c4-93faefc28ac1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:50.090002 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fd66d130-d571-43a0-a1c4-93faefc28ac1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1390 microversion: 2.1 time: 0.392536 Oct 05 18:02:50.091739 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2389/5041] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:49 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1390 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:50.316561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-14e53e8a-9f57-45db-bd73-ab7c33f4e2bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:50.317292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-14e53e8a-9f57-45db-bd73-ab7c33f4e2bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:50.325431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14e53e8a-9f57-45db-bd73-ab7c33f4e2bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:50.326241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14e53e8a-9f57-45db-bd73-ab7c33f4e2bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:50.327035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14e53e8a-9f57-45db-bd73-ab7c33f4e2bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:50.328110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14e53e8a-9f57-45db-bd73-ab7c33f4e2bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:50.328828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14e53e8a-9f57-45db-bd73-ab7c33f4e2bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:50.329541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14e53e8a-9f57-45db-bd73-ab7c33f4e2bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:50.441206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-14e53e8a-9f57-45db-bd73-ab7c33f4e2bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:50.452338 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-14e53e8a-9f57-45db-bd73-ab7c33f4e2bb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1273 microversion: 2.1 time: 0.140254 Oct 05 18:02:50.466841 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2653/5042] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:50 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:50.864864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9e3775f3-bd50-4d42-ba21-486d3b152622 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:50.886670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9e3775f3-bd50-4d42-ba21-486d3b152622 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:50.932625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3775f3-bd50-4d42-ba21-486d3b152622 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:50.939073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3775f3-bd50-4d42-ba21-486d3b152622 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:50.941977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3775f3-bd50-4d42-ba21-486d3b152622 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:50.949516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3775f3-bd50-4d42-ba21-486d3b152622 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:50.967824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3775f3-bd50-4d42-ba21-486d3b152622 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:50.977963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e3775f3-bd50-4d42-ba21-486d3b152622 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:51.120688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b5139c6-f4da-4436-af25-b31eec66d8a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:51.121729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1b5139c6-f4da-4436-af25-b31eec66d8a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:51.144254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b5139c6-f4da-4436-af25-b31eec66d8a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:51.145946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b5139c6-f4da-4436-af25-b31eec66d8a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:51.146711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b5139c6-f4da-4436-af25-b31eec66d8a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:51.147756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b5139c6-f4da-4436-af25-b31eec66d8a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:51.194528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b5139c6-f4da-4436-af25-b31eec66d8a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:51.195352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b5139c6-f4da-4436-af25-b31eec66d8a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:51.590562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9e3775f3-bd50-4d42-ba21-486d3b152622 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:51.618898 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9e3775f3-bd50-4d42-ba21-486d3b152622 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1319 microversion: 2.1 time: 0.765271 Oct 05 18:02:51.641150 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2390/5043] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:50 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1319 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:51.646433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-527410d1-3ce6-4a34-b4b5-64d4ebd791c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:51.647205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-527410d1-3ce6-4a34-b4b5-64d4ebd791c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:51.661267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527410d1-3ce6-4a34-b4b5-64d4ebd791c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:51.661588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527410d1-3ce6-4a34-b4b5-64d4ebd791c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:51.668107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527410d1-3ce6-4a34-b4b5-64d4ebd791c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:51.669042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527410d1-3ce6-4a34-b4b5-64d4ebd791c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:51.669713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527410d1-3ce6-4a34-b4b5-64d4ebd791c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:51.670331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527410d1-3ce6-4a34-b4b5-64d4ebd791c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:51.989714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-527410d1-3ce6-4a34-b4b5-64d4ebd791c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:51.999943 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-527410d1-3ce6-4a34-b4b5-64d4ebd791c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1315 microversion: 2.1 time: 0.371248 Oct 05 18:02:52.006337 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2391/5044] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:51 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:52.089267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b5139c6-f4da-4436-af25-b31eec66d8a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:52.109420 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b5139c6-f4da-4436-af25-b31eec66d8a0 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1390 microversion: 2.1 time: 0.996040 Oct 05 18:02:52.138851 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2654/5045] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:51 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1390 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:52.651782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-94a53439-c551-4ba4-855d-c915b495a2a9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:52.652667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-94a53439-c551-4ba4-855d-c915b495a2a9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:52.673843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94a53439-c551-4ba4-855d-c915b495a2a9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:52.675311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94a53439-c551-4ba4-855d-c915b495a2a9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:52.676610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94a53439-c551-4ba4-855d-c915b495a2a9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:52.679285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94a53439-c551-4ba4-855d-c915b495a2a9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:52.679761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94a53439-c551-4ba4-855d-c915b495a2a9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:52.683839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-94a53439-c551-4ba4-855d-c915b495a2a9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:52.926990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-94a53439-c551-4ba4-855d-c915b495a2a9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:52.946055 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-94a53439-c551-4ba4-855d-c915b495a2a9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1319 microversion: 2.1 time: 0.297886 Oct 05 18:02:52.948274 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2392/5046] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:52 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:53.025033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21e9f522-1cff-4973-bea9-b3aec0db4834 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:53.025856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21e9f522-1cff-4973-bea9-b3aec0db4834 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:53.050234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:53.058427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e9f522-1cff-4973-bea9-b3aec0db4834 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:53.059230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e9f522-1cff-4973-bea9-b3aec0db4834 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:53.059935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e9f522-1cff-4973-bea9-b3aec0db4834 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:53.060882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e9f522-1cff-4973-bea9-b3aec0db4834 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:53.061511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e9f522-1cff-4973-bea9-b3aec0db4834 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:53.062103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21e9f522-1cff-4973-bea9-b3aec0db4834 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:53.154063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-66620478-f2bb-49ec-b8fc-a7056f827a99 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:53.154736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-66620478-f2bb-49ec-b8fc-a7056f827a99 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:53.167727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66620478-f2bb-49ec-b8fc-a7056f827a99 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:53.168234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66620478-f2bb-49ec-b8fc-a7056f827a99 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:53.175047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66620478-f2bb-49ec-b8fc-a7056f827a99 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:53.177445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66620478-f2bb-49ec-b8fc-a7056f827a99 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:53.178396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66620478-f2bb-49ec-b8fc-a7056f827a99 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:53.181360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66620478-f2bb-49ec-b8fc-a7056f827a99 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:53.291692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=16 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:53.436014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21e9f522-1cff-4973-bea9-b3aec0db4834 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:53.446125 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21e9f522-1cff-4973-bea9-b3aec0db4834 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1315 microversion: 2.1 time: 0.425238 Oct 05 18:02:53.451905 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2655/5047] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:53 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:53.547278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66620478-f2bb-49ec-b8fc-a7056f827a99 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:53.559730 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-66620478-f2bb-49ec-b8fc-a7056f827a99 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1390 microversion: 2.1 time: 0.410869 Oct 05 18:02:53.576779 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2393/5048] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:53 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1390 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:53.615128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-083c134d-fdea-4f77-abd7-c9238327b72a req-3ab79bb8-81e8-495e-b491-e67cfee86f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbd4073-50d6-4c67-8ee5-447f772298a0", "name": "network-vif-plugged", "status": "completed", "tag": "ea6385e4-12b8-44d1-94e9-c6103b6b8376"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:53.642545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-083c134d-fdea-4f77-abd7-c9238327b72a req-3ab79bb8-81e8-495e-b491-e67cfee86f17 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:53.643044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-083c134d-fdea-4f77-abd7-c9238327b72a req-3ab79bb8-81e8-495e-b491-e67cfee86f17 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:53.643492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-083c134d-fdea-4f77-abd7-c9238327b72a req-3ab79bb8-81e8-495e-b491-e67cfee86f17 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:53.680297 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-083c134d-fdea-4f77-abd7-c9238327b72a req-3ab79bb8-81e8-495e-b491-e67cfee86f17 service nova] Creating event network-vif-plugged:ea6385e4-12b8-44d1-94e9-c6103b6b8376 for instance ccbd4073-50d6-4c67-8ee5-447f772298a0 on n-h1-835595-3 Oct 05 18:02:53.700214 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-083c134d-fdea-4f77-abd7-c9238327b72a req-3ab79bb8-81e8-495e-b491-e67cfee86f17 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088690 Oct 05 18:02:53.713095 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2656/5049] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:02:53.857184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f7478e52-6bd3-4223-bf89-34e9044dc936 req-df8591e0-04c3-4cc2-ab3a-46dbf73b5717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4df58bf7-bd68-47ff-8761-115c79276c6a", "tag": "e6f12cb4-f32d-4d0d-a3ca-1c2d05888315"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:53.890133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f7478e52-6bd3-4223-bf89-34e9044dc936 req-df8591e0-04c3-4cc2-ab3a-46dbf73b5717 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:53.890656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f7478e52-6bd3-4223-bf89-34e9044dc936 req-df8591e0-04c3-4cc2-ab3a-46dbf73b5717 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:53.891103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f7478e52-6bd3-4223-bf89-34e9044dc936 req-df8591e0-04c3-4cc2-ab3a-46dbf73b5717 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:53.932860 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f7478e52-6bd3-4223-bf89-34e9044dc936 req-df8591e0-04c3-4cc2-ab3a-46dbf73b5717 service nova] Creating event network-changed:e6f12cb4-f32d-4d0d-a3ca-1c2d05888315 for instance 4df58bf7-bd68-47ff-8761-115c79276c6a on n-h2-835595-3 Oct 05 18:02:53.940355 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f7478e52-6bd3-4223-bf89-34e9044dc936 req-df8591e0-04c3-4cc2-ab3a-46dbf73b5717 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087070 Oct 05 18:02:53.943651 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2394/5050] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:02:53.972083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-744af1c1-57e2-4d4a-8519-a59a028241c8 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:53.973172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-744af1c1-57e2-4d4a-8519-a59a028241c8 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:53.982505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-744af1c1-57e2-4d4a-8519-a59a028241c8 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:53.985912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-744af1c1-57e2-4d4a-8519-a59a028241c8 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:53.989019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-744af1c1-57e2-4d4a-8519-a59a028241c8 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:53.990365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-744af1c1-57e2-4d4a-8519-a59a028241c8 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:53.993762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-744af1c1-57e2-4d4a-8519-a59a028241c8 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:53.994601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-744af1c1-57e2-4d4a-8519-a59a028241c8 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:54.422036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-744af1c1-57e2-4d4a-8519-a59a028241c8 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:54.434536 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-744af1c1-57e2-4d4a-8519-a59a028241c8 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1319 microversion: 2.1 time: 0.468876 Oct 05 18:02:54.442336 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2657/5051] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:53 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1319 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:54.475348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-944db5b2-e0fb-473a-b291-98479207fc05 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:54.476223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-944db5b2-e0fb-473a-b291-98479207fc05 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:54.484064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-944db5b2-e0fb-473a-b291-98479207fc05 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:54.484686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-944db5b2-e0fb-473a-b291-98479207fc05 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:54.485760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-944db5b2-e0fb-473a-b291-98479207fc05 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:54.486581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-944db5b2-e0fb-473a-b291-98479207fc05 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:54.487110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-944db5b2-e0fb-473a-b291-98479207fc05 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:54.487606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-944db5b2-e0fb-473a-b291-98479207fc05 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:54.583702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-28f70ff5-67d3-4492-8c66-76ae65b46027 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:54.584780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-28f70ff5-67d3-4492-8c66-76ae65b46027 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:54.596854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28f70ff5-67d3-4492-8c66-76ae65b46027 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:54.598990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28f70ff5-67d3-4492-8c66-76ae65b46027 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:54.599743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28f70ff5-67d3-4492-8c66-76ae65b46027 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:54.600707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28f70ff5-67d3-4492-8c66-76ae65b46027 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:54.602981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28f70ff5-67d3-4492-8c66-76ae65b46027 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:54.605246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28f70ff5-67d3-4492-8c66-76ae65b46027 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:54.700420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-944db5b2-e0fb-473a-b291-98479207fc05 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:54.711748 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-944db5b2-e0fb-473a-b291-98479207fc05 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1315 microversion: 2.1 time: 0.242165 Oct 05 18:02:54.712416 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2395/5052] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:54 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:55.039790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-28f70ff5-67d3-4492-8c66-76ae65b46027 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:55.051649 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-28f70ff5-67d3-4492-8c66-76ae65b46027 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1390 microversion: 2.1 time: 0.472238 Oct 05 18:02:55.052421 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2658/5053] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:54 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1390 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:02:55.461756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3dc2e878-82a0-4668-9969-8f599ede7789 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:55.462754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3dc2e878-82a0-4668-9969-8f599ede7789 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:55.478269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc2e878-82a0-4668-9969-8f599ede7789 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:55.481070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc2e878-82a0-4668-9969-8f599ede7789 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:55.481741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc2e878-82a0-4668-9969-8f599ede7789 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:55.485630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc2e878-82a0-4668-9969-8f599ede7789 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:55.501729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc2e878-82a0-4668-9969-8f599ede7789 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:55.506388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc2e878-82a0-4668-9969-8f599ede7789 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:55.686161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3dc2e878-82a0-4668-9969-8f599ede7789 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:55.696094 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3dc2e878-82a0-4668-9969-8f599ede7789 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1319 microversion: 2.1 time: 0.241700 Oct 05 18:02:55.697253 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2396/5054] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:55 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:55.740232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4c48e811-1562-459f-90eb-a892b88b1f09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:55.740894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4c48e811-1562-459f-90eb-a892b88b1f09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:55.749517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c48e811-1562-459f-90eb-a892b88b1f09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:55.750238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c48e811-1562-459f-90eb-a892b88b1f09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:55.750910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c48e811-1562-459f-90eb-a892b88b1f09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:55.752506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c48e811-1562-459f-90eb-a892b88b1f09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:55.753170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c48e811-1562-459f-90eb-a892b88b1f09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:55.753806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c48e811-1562-459f-90eb-a892b88b1f09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:55.779841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3d47c88d-bb72-4dcf-8cc8-0e2dc7730519 req-d87de40d-b9dc-4486-bd67-95baa2369a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c3807c-eb9a-4c1f-a519-b3d2c98ba866", "name": "network-vif-plugged", "status": "completed", "tag": "ea45799e-94b3-4c8d-927f-e5c706a76fe8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:55.796293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3d47c88d-bb72-4dcf-8cc8-0e2dc7730519 req-d87de40d-b9dc-4486-bd67-95baa2369a58 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:55.797672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3d47c88d-bb72-4dcf-8cc8-0e2dc7730519 req-d87de40d-b9dc-4486-bd67-95baa2369a58 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:55.798525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3d47c88d-bb72-4dcf-8cc8-0e2dc7730519 req-d87de40d-b9dc-4486-bd67-95baa2369a58 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:55.812170 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3d47c88d-bb72-4dcf-8cc8-0e2dc7730519 req-d87de40d-b9dc-4486-bd67-95baa2369a58 service nova] Creating event network-vif-plugged:ea45799e-94b3-4c8d-927f-e5c706a76fe8 for instance b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 on n-h1-835595-3 Oct 05 18:02:55.818963 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3d47c88d-bb72-4dcf-8cc8-0e2dc7730519 req-d87de40d-b9dc-4486-bd67-95baa2369a58 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043192 Oct 05 18:02:55.824783 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2397/5055] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:02:56.080019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-907db520-6376-4b19-97cc-f6770eb152ca tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:56.080567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-907db520-6376-4b19-97cc-f6770eb152ca tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:56.094076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-907db520-6376-4b19-97cc-f6770eb152ca tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:56.094661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-907db520-6376-4b19-97cc-f6770eb152ca tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:56.095114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-907db520-6376-4b19-97cc-f6770eb152ca tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:56.095821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-907db520-6376-4b19-97cc-f6770eb152ca tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:56.096278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-907db520-6376-4b19-97cc-f6770eb152ca tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:56.096714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-907db520-6376-4b19-97cc-f6770eb152ca tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:56.219853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c48e811-1562-459f-90eb-a892b88b1f09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:56.240559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4c48e811-1562-459f-90eb-a892b88b1f09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1315 microversion: 2.1 time: 0.504729 Oct 05 18:02:56.244218 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2659/5056] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:55 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1315 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:56.320700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:56.413258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-907db520-6376-4b19-97cc-f6770eb152ca tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:56.426804 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-907db520-6376-4b19-97cc-f6770eb152ca tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1561 microversion: 2.1 time: 0.348488 Oct 05 18:02:56.429033 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2398/5057] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:56 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1561 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:02:56.450964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c5fe9af-3745-4e31-8a65-ed6fa6e5808c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:56.451726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5c5fe9af-3745-4e31-8a65-ed6fa6e5808c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:56.460153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c5fe9af-3745-4e31-8a65-ed6fa6e5808c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:56.462863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c5fe9af-3745-4e31-8a65-ed6fa6e5808c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:56.463511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c5fe9af-3745-4e31-8a65-ed6fa6e5808c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:56.464359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c5fe9af-3745-4e31-8a65-ed6fa6e5808c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:56.466891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c5fe9af-3745-4e31-8a65-ed6fa6e5808c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:56.467381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c5fe9af-3745-4e31-8a65-ed6fa6e5808c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:56.720949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9efac1c9-73e1-4971-aebb-a2c95152b049 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:56.722379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9efac1c9-73e1-4971-aebb-a2c95152b049 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:56.739295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=18 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:56.742480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9efac1c9-73e1-4971-aebb-a2c95152b049 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:56.743239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9efac1c9-73e1-4971-aebb-a2c95152b049 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:56.744389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9efac1c9-73e1-4971-aebb-a2c95152b049 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:56.745328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9efac1c9-73e1-4971-aebb-a2c95152b049 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:56.746124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9efac1c9-73e1-4971-aebb-a2c95152b049 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:56.748397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9efac1c9-73e1-4971-aebb-a2c95152b049 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:56.808416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:56.957298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5c5fe9af-3745-4e31-8a65-ed6fa6e5808c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:56.969796 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c5fe9af-3745-4e31-8a65-ed6fa6e5808c tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1561 microversion: 2.1 time: 0.523858 Oct 05 18:02:56.970332 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2660/5058] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:56 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1561 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:57.268873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-077c03ee-6991-444b-accb-def653b51bb2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:57.270714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-077c03ee-6991-444b-accb-def653b51bb2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:57.284559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-077c03ee-6991-444b-accb-def653b51bb2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:57.285478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-077c03ee-6991-444b-accb-def653b51bb2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:57.287867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-077c03ee-6991-444b-accb-def653b51bb2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:57.291107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-077c03ee-6991-444b-accb-def653b51bb2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:57.292923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-077c03ee-6991-444b-accb-def653b51bb2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:57.297764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-077c03ee-6991-444b-accb-def653b51bb2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:57.419345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9efac1c9-73e1-4971-aebb-a2c95152b049 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:57.442411 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9efac1c9-73e1-4971-aebb-a2c95152b049 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1319 microversion: 2.1 time: 0.724865 Oct 05 18:02:57.445692 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2399/5059] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:56 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1319 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:57.769482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-077c03ee-6991-444b-accb-def653b51bb2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:57.773567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:02:57.789229 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-077c03ee-6991-444b-accb-def653b51bb2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1315 microversion: 2.1 time: 0.520400 Oct 05 18:02:57.816951 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2661/5060] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:57 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:58.409074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-93fa7543-1a4b-4577-b1b6-2dc2a5a4c7e8 req-b7b3a098-7dc0-44bf-8c9b-0e66ba802153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df58bf7-bd68-47ff-8761-115c79276c6a", "name": "network-vif-plugged", "status": "completed", "tag": "e6f12cb4-f32d-4d0d-a3ca-1c2d05888315"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:58.439042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-93fa7543-1a4b-4577-b1b6-2dc2a5a4c7e8 req-b7b3a098-7dc0-44bf-8c9b-0e66ba802153 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:58.439941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-93fa7543-1a4b-4577-b1b6-2dc2a5a4c7e8 req-b7b3a098-7dc0-44bf-8c9b-0e66ba802153 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:58.442540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-93fa7543-1a4b-4577-b1b6-2dc2a5a4c7e8 req-b7b3a098-7dc0-44bf-8c9b-0e66ba802153 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:58.474932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-72e58103-56b4-4436-bfd0-f718bd0bbc62 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:58.475625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-72e58103-56b4-4436-bfd0-f718bd0bbc62 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:58.479640 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-93fa7543-1a4b-4577-b1b6-2dc2a5a4c7e8 req-b7b3a098-7dc0-44bf-8c9b-0e66ba802153 service nova] Creating event network-vif-plugged:e6f12cb4-f32d-4d0d-a3ca-1c2d05888315 for instance 4df58bf7-bd68-47ff-8761-115c79276c6a on n-h2-835595-3 Oct 05 18:02:58.488064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72e58103-56b4-4436-bfd0-f718bd0bbc62 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:58.488416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72e58103-56b4-4436-bfd0-f718bd0bbc62 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:58.488860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72e58103-56b4-4436-bfd0-f718bd0bbc62 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:58.489587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72e58103-56b4-4436-bfd0-f718bd0bbc62 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:58.490047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72e58103-56b4-4436-bfd0-f718bd0bbc62 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:58.500971 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-93fa7543-1a4b-4577-b1b6-2dc2a5a4c7e8 req-b7b3a098-7dc0-44bf-8c9b-0e66ba802153 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097118 Oct 05 18:02:58.501687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72e58103-56b4-4436-bfd0-f718bd0bbc62 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:58.532501 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2400/5061] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:02:58.829902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5ff1693c-1ebd-4a03-a8e4-e679c8937715 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:02:58.830656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5ff1693c-1ebd-4a03-a8e4-e679c8937715 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:58.858396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ff1693c-1ebd-4a03-a8e4-e679c8937715 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:58.859321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ff1693c-1ebd-4a03-a8e4-e679c8937715 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:58.859786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ff1693c-1ebd-4a03-a8e4-e679c8937715 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:58.860565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ff1693c-1ebd-4a03-a8e4-e679c8937715 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:58.861036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ff1693c-1ebd-4a03-a8e4-e679c8937715 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:58.861466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ff1693c-1ebd-4a03-a8e4-e679c8937715 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:59.083348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-72e58103-56b4-4436-bfd0-f718bd0bbc62 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:59.094881 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-72e58103-56b4-4436-bfd0-f718bd0bbc62 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1508 microversion: 2.1 time: 0.630546 Oct 05 18:02:59.110308 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2662/5062] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:58 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1508 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:02:59.140455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1c3d96bc-ea33-4d4d-95d6-9176cfa3598e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f8fe624-2368-43cd-b153-fbcc036990ff", "device": "/dev/sdb"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:02:59.145460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1c3d96bc-ea33-4d4d-95d6-9176cfa3598e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:02:59.164382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c3d96bc-ea33-4d4d-95d6-9176cfa3598e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:59.170983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c3d96bc-ea33-4d4d-95d6-9176cfa3598e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:59.171825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c3d96bc-ea33-4d4d-95d6-9176cfa3598e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:59.172716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c3d96bc-ea33-4d4d-95d6-9176cfa3598e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:02:59.173421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c3d96bc-ea33-4d4d-95d6-9176cfa3598e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:02:59.173981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c3d96bc-ea33-4d4d-95d6-9176cfa3598e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:02:59.609103 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1c3d96bc-ea33-4d4d-95d6-9176cfa3598e tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "POST /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485481 Oct 05 18:02:59.609927 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2663/5063] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:02:59 2022] POST /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866/os-volume_attachments => generated 194 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:02:59.703020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5ff1693c-1ebd-4a03-a8e4-e679c8937715 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:02:59.712540 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5ff1693c-1ebd-4a03-a8e4-e679c8937715 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1315 microversion: 2.1 time: 0.887637 Oct 05 18:02:59.717399 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2401/5064] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:02:58 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1315 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:00.742347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4bd807e6-085a-43fc-9258-3618775a749c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:00.743072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4bd807e6-085a-43fc-9258-3618775a749c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:00.751015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bd807e6-085a-43fc-9258-3618775a749c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:00.751795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bd807e6-085a-43fc-9258-3618775a749c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:00.752804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bd807e6-085a-43fc-9258-3618775a749c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:00.753779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bd807e6-085a-43fc-9258-3618775a749c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:00.755180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bd807e6-085a-43fc-9258-3618775a749c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:00.755835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bd807e6-085a-43fc-9258-3618775a749c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:01.010691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4bd807e6-085a-43fc-9258-3618775a749c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:01.021341 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4bd807e6-085a-43fc-9258-3618775a749c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1502 microversion: 2.1 time: 0.284658 Oct 05 18:03:01.027352 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2664/5065] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:00 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1502 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:01.053755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-823241ab-1333-4c81-bb9e-2a0695e5fd83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:01.055074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-823241ab-1333-4c81-bb9e-2a0695e5fd83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:01.069032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-823241ab-1333-4c81-bb9e-2a0695e5fd83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:01.070847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-823241ab-1333-4c81-bb9e-2a0695e5fd83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:01.071221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-823241ab-1333-4c81-bb9e-2a0695e5fd83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:01.074585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-823241ab-1333-4c81-bb9e-2a0695e5fd83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:01.075968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-823241ab-1333-4c81-bb9e-2a0695e5fd83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:01.076423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-823241ab-1333-4c81-bb9e-2a0695e5fd83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:01.222761 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-823241ab-1333-4c81-bb9e-2a0695e5fd83 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a/action" status: 202 len: 0 microversion: 2.1 time: 0.170382 Oct 05 18:03:01.224551 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2402/5066] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:03:01 2022] POST /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:03:01.242706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-477c5ee4-1f27-4ad8-9484-5d0fa7b67234 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:01.244530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-477c5ee4-1f27-4ad8-9484-5d0fa7b67234 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:01.261043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-477c5ee4-1f27-4ad8-9484-5d0fa7b67234 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:01.263793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-477c5ee4-1f27-4ad8-9484-5d0fa7b67234 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:01.264548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-477c5ee4-1f27-4ad8-9484-5d0fa7b67234 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:01.265682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-477c5ee4-1f27-4ad8-9484-5d0fa7b67234 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:01.266426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-477c5ee4-1f27-4ad8-9484-5d0fa7b67234 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:01.269273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-477c5ee4-1f27-4ad8-9484-5d0fa7b67234 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:01.732930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-477c5ee4-1f27-4ad8-9484-5d0fa7b67234 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:01.750256 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-477c5ee4-1f27-4ad8-9484-5d0fa7b67234 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1507 microversion: 2.1 time: 0.521132 Oct 05 18:03:01.754511 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2665/5067] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:01 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1507 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:01.761020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80abf5c4-2e3e-4c21-ae8d-d6486dbb9856 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:01.761983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-80abf5c4-2e3e-4c21-ae8d-d6486dbb9856 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:01.772663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80abf5c4-2e3e-4c21-ae8d-d6486dbb9856 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:01.774975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80abf5c4-2e3e-4c21-ae8d-d6486dbb9856 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:01.778823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80abf5c4-2e3e-4c21-ae8d-d6486dbb9856 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:01.780057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80abf5c4-2e3e-4c21-ae8d-d6486dbb9856 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:01.780854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80abf5c4-2e3e-4c21-ae8d-d6486dbb9856 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:01.781543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80abf5c4-2e3e-4c21-ae8d-d6486dbb9856 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:02.156683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-80abf5c4-2e3e-4c21-ae8d-d6486dbb9856 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:02.171377 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-80abf5c4-2e3e-4c21-ae8d-d6486dbb9856 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1561 microversion: 2.1 time: 0.414883 Oct 05 18:03:02.172438 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2403/5068] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:01 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1561 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:02.400988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-05fcc663-1cb0-4dc4-8b83-1c4dc9d37825 req-679cdf5c-b17e-4c46-a22d-d9f8a825d436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbd4073-50d6-4c67-8ee5-447f772298a0", "tag": "ea6385e4-12b8-44d1-94e9-c6103b6b8376"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:02.430912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-05fcc663-1cb0-4dc4-8b83-1c4dc9d37825 req-679cdf5c-b17e-4c46-a22d-d9f8a825d436 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:02.432234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-05fcc663-1cb0-4dc4-8b83-1c4dc9d37825 req-679cdf5c-b17e-4c46-a22d-d9f8a825d436 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:02.433718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-05fcc663-1cb0-4dc4-8b83-1c4dc9d37825 req-679cdf5c-b17e-4c46-a22d-d9f8a825d436 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:02.466868 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-05fcc663-1cb0-4dc4-8b83-1c4dc9d37825 req-679cdf5c-b17e-4c46-a22d-d9f8a825d436 service nova] Creating event network-changed:ea6385e4-12b8-44d1-94e9-c6103b6b8376 for instance ccbd4073-50d6-4c67-8ee5-447f772298a0 on n-h1-835595-3 Oct 05 18:03:02.486001 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-05fcc663-1cb0-4dc4-8b83-1c4dc9d37825 req-679cdf5c-b17e-4c46-a22d-d9f8a825d436 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.688895 Oct 05 18:03:02.493317 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2666/5069] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:03:02.777845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4882ccb6-084a-43de-b90f-4a47bc2d56f0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:02.778615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4882ccb6-084a-43de-b90f-4a47bc2d56f0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:02.796555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4882ccb6-084a-43de-b90f-4a47bc2d56f0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:02.797645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4882ccb6-084a-43de-b90f-4a47bc2d56f0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:02.799334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4882ccb6-084a-43de-b90f-4a47bc2d56f0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:02.801975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4882ccb6-084a-43de-b90f-4a47bc2d56f0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:02.802564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4882ccb6-084a-43de-b90f-4a47bc2d56f0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:02.803052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4882ccb6-084a-43de-b90f-4a47bc2d56f0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:03.140955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4882ccb6-084a-43de-b90f-4a47bc2d56f0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:03.150161 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4882ccb6-084a-43de-b90f-4a47bc2d56f0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1487 microversion: 2.1 time: 0.376791 Oct 05 18:03:03.150719 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2404/5070] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:02 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1487 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:03.173238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae199ebd-4166-4da9-8a8a-425f5766896e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:03.173831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae199ebd-4166-4da9-8a8a-425f5766896e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:03.183186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae199ebd-4166-4da9-8a8a-425f5766896e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:03.184000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae199ebd-4166-4da9-8a8a-425f5766896e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:03.184646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae199ebd-4166-4da9-8a8a-425f5766896e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:03.185581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae199ebd-4166-4da9-8a8a-425f5766896e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:03.186244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae199ebd-4166-4da9-8a8a-425f5766896e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:03.186890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae199ebd-4166-4da9-8a8a-425f5766896e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:03.215905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae199ebd-4166-4da9-8a8a-425f5766896e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:03:03.349639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:03.368209 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae199ebd-4166-4da9-8a8a-425f5766896e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 204 len: 0 microversion: 2.1 time: 0.199330 Oct 05 18:03:03.369320 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2667/5071] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:03:03 2022] DELETE /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:03:03.378996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aee181c0-a3b4-4896-9542-48c4f7a45971 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:03.380659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aee181c0-a3b4-4896-9542-48c4f7a45971 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:03.400895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aee181c0-a3b4-4896-9542-48c4f7a45971 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:03.401407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aee181c0-a3b4-4896-9542-48c4f7a45971 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:03.408768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aee181c0-a3b4-4896-9542-48c4f7a45971 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:03.410067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aee181c0-a3b4-4896-9542-48c4f7a45971 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:03.410588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aee181c0-a3b4-4896-9542-48c4f7a45971 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:03.411059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aee181c0-a3b4-4896-9542-48c4f7a45971 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:03.753840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aee181c0-a3b4-4896-9542-48c4f7a45971 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:03.776342 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aee181c0-a3b4-4896-9542-48c4f7a45971 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1493 microversion: 2.1 time: 0.396410 Oct 05 18:03:03.779217 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2405/5072] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:03 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1493 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:04.801080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81091a55-2376-4869-a7c0-ba429a60740c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:04.802352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-81091a55-2376-4869-a7c0-ba429a60740c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:04.838035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81091a55-2376-4869-a7c0-ba429a60740c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:04.838703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81091a55-2376-4869-a7c0-ba429a60740c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:04.842550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81091a55-2376-4869-a7c0-ba429a60740c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:04.843719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81091a55-2376-4869-a7c0-ba429a60740c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:04.844248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81091a55-2376-4869-a7c0-ba429a60740c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:04.844671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81091a55-2376-4869-a7c0-ba429a60740c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:06.712223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81091a55-2376-4869-a7c0-ba429a60740c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:06.733706 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81091a55-2376-4869-a7c0-ba429a60740c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1493 microversion: 2.1 time: 1.936926 Oct 05 18:03:06.744522 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2668/5073] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:04 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1493 bytes in 1949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:07.577901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-feb702d8-e350-45e6-8621-f8a24d8700ca req-27ec3f03-3041-4ba5-a8ca-148ce6524488 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4df58bf7-bd68-47ff-8761-115c79276c6a", "name": "network-vif-deleted", "tag": "e6f12cb4-f32d-4d0d-a3ca-1c2d05888315"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:07.587233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:07.603372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-feb702d8-e350-45e6-8621-f8a24d8700ca req-27ec3f03-3041-4ba5-a8ca-148ce6524488 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:07.604192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-feb702d8-e350-45e6-8621-f8a24d8700ca req-27ec3f03-3041-4ba5-a8ca-148ce6524488 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:07.604829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-feb702d8-e350-45e6-8621-f8a24d8700ca req-27ec3f03-3041-4ba5-a8ca-148ce6524488 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:07.658814 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-feb702d8-e350-45e6-8621-f8a24d8700ca req-27ec3f03-3041-4ba5-a8ca-148ce6524488 service nova] Creating event network-vif-deleted:e6f12cb4-f32d-4d0d-a3ca-1c2d05888315 for instance 4df58bf7-bd68-47ff-8761-115c79276c6a on n-h2-835595-3 Oct 05 18:03:07.682056 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-feb702d8-e350-45e6-8621-f8a24d8700ca req-27ec3f03-3041-4ba5-a8ca-148ce6524488 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107940 Oct 05 18:03:07.692904 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2406/5074] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:03:07.778915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:07.779616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:07.815849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:07.816366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:07.816811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:07.817539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:07.818001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:07.818543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:07.906494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:07.906987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:07.909538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:07.910206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lazy-loading 'fault' on Instance uuid 4df58bf7-bd68-47ff-8761-115c79276c6a {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:03:08.014179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:08.024269 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ea981150-9095-48ba-8fbe-9c364755788e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 200 len: 1305 microversion: 2.1 time: 0.251997 Oct 05 18:03:08.030870 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2669/5075] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:07 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 1305 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:09.060154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:09.060853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:09.074777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:09.077122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:09.077735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:09.080244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:09.082065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:09.082732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:09.119600 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a HTTP/1.1 Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4df58bf7-bd68-47ff-8761-115c79276c6a'} Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:03:09.124066 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:03:09.129303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:03:09.129303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:03:09.129303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:03:09.129303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:03:09.129303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:03:09.129303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:03:09.129303 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:03:09.133746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:03:09.137281 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fae82fd8-8faa-4520-8ba6-cd692b78e2bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 404 len: 111 microversion: 2.1 time: 0.082512 Oct 05 18:03:09.138136 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2407/5076] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:09 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:03:09.422004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-638778032", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:09.524046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] validate_networks() for [('7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:03:10.567748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:03:10.568459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:03:10.568743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:03:10.571444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:03:10.572078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:03:10.596139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:10.596668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:10.597115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:10.597969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:10.598383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:10.598819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:10.663817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:03:10.676616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for user 9ea1c284fc254cc7a51d9e67d4fe8168 and project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:03:10.708870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:03:10.714943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:03:10.901426 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6a56353d-31de-47a2-b520-0cfd511a4ee7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.475187 Oct 05 18:03:10.907434 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2670/5077] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:03:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:03:10.919256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43299543-848c-4e01-98aa-cf82a31b1f23 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:10.919890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-43299543-848c-4e01-98aa-cf82a31b1f23 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:11.146579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-43299543-848c-4e01-98aa-cf82a31b1f23 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:11.157800 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-43299543-848c-4e01-98aa-cf82a31b1f23 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1214 microversion: 2.1 time: 0.242687 Oct 05 18:03:11.162752 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2408/5078] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:10 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1214 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:12.191868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-de791bb1-7a2d-4533-9ec1-44f836d0e9c0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:12.193907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-de791bb1-7a2d-4533-9ec1-44f836d0e9c0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:12.456771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-de791bb1-7a2d-4533-9ec1-44f836d0e9c0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:12.466075 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-de791bb1-7a2d-4533-9ec1-44f836d0e9c0 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1214 microversion: 2.1 time: 0.282646 Oct 05 18:03:12.472777 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2671/5079] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:12 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1214 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:13.518096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bf49d068-1d01-4f63-a048-b7c46a51d650 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:13.518985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bf49d068-1d01-4f63-a048-b7c46a51d650 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:13.537771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf49d068-1d01-4f63-a048-b7c46a51d650 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:13.548150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf49d068-1d01-4f63-a048-b7c46a51d650 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:13.548449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf49d068-1d01-4f63-a048-b7c46a51d650 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:13.549391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf49d068-1d01-4f63-a048-b7c46a51d650 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:13.550507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf49d068-1d01-4f63-a048-b7c46a51d650 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:13.551125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf49d068-1d01-4f63-a048-b7c46a51d650 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:13.649097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bf49d068-1d01-4f63-a048-b7c46a51d650 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:13.674157 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bf49d068-1d01-4f63-a048-b7c46a51d650 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1266 microversion: 2.1 time: 0.158400 Oct 05 18:03:13.686643 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2409/5080] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:13 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:14.702716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1648c63f-7ad9-4164-bdc0-0a48b54796d9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:14.706852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1648c63f-7ad9-4164-bdc0-0a48b54796d9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:14.759946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1648c63f-7ad9-4164-bdc0-0a48b54796d9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:14.759946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1648c63f-7ad9-4164-bdc0-0a48b54796d9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:14.759946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1648c63f-7ad9-4164-bdc0-0a48b54796d9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:14.759946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1648c63f-7ad9-4164-bdc0-0a48b54796d9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:14.759946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1648c63f-7ad9-4164-bdc0-0a48b54796d9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:14.759946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1648c63f-7ad9-4164-bdc0-0a48b54796d9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:14.931369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1648c63f-7ad9-4164-bdc0-0a48b54796d9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:14.945631 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1648c63f-7ad9-4164-bdc0-0a48b54796d9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1272 microversion: 2.1 time: 0.246981 Oct 05 18:03:14.946262 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2672/5081] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:14 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1272 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:15.973643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ee19cc98-8c90-4aca-a1d1-ffb4974d3d28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:15.979321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ee19cc98-8c90-4aca-a1d1-ffb4974d3d28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:15.997641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee19cc98-8c90-4aca-a1d1-ffb4974d3d28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:16.012518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee19cc98-8c90-4aca-a1d1-ffb4974d3d28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:16.014070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee19cc98-8c90-4aca-a1d1-ffb4974d3d28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:16.017219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee19cc98-8c90-4aca-a1d1-ffb4974d3d28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:16.018707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee19cc98-8c90-4aca-a1d1-ffb4974d3d28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:16.020470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ee19cc98-8c90-4aca-a1d1-ffb4974d3d28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:16.382330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ee19cc98-8c90-4aca-a1d1-ffb4974d3d28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:16.392015 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ee19cc98-8c90-4aca-a1d1-ffb4974d3d28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1314 microversion: 2.1 time: 0.422986 Oct 05 18:03:16.393477 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2410/5082] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:15 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:17.417768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f41ae483-6250-4ce9-9d70-8e074fee8e32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:17.419272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f41ae483-6250-4ce9-9d70-8e074fee8e32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:17.432411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f41ae483-6250-4ce9-9d70-8e074fee8e32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:17.434097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f41ae483-6250-4ce9-9d70-8e074fee8e32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:17.438052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f41ae483-6250-4ce9-9d70-8e074fee8e32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:17.439666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f41ae483-6250-4ce9-9d70-8e074fee8e32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:17.442899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f41ae483-6250-4ce9-9d70-8e074fee8e32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:17.444001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f41ae483-6250-4ce9-9d70-8e074fee8e32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:17.874478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f41ae483-6250-4ce9-9d70-8e074fee8e32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:17.889317 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f41ae483-6250-4ce9-9d70-8e074fee8e32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1314 microversion: 2.1 time: 0.476043 Oct 05 18:03:17.891377 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2411/5083] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:17 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:17.944194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a4ea879c-d601-47bb-acff-eeb3182ce6d8 req-628f1995-c253-4f0c-bf5c-d1f29049f731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0555770d-5774-4f39-b4ad-3fa29ac7ba32", "tag": "4cf55f4f-324b-4fe1-82a3-d58ee09ee530"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:17.981643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a4ea879c-d601-47bb-acff-eeb3182ce6d8 req-628f1995-c253-4f0c-bf5c-d1f29049f731 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:17.982513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a4ea879c-d601-47bb-acff-eeb3182ce6d8 req-628f1995-c253-4f0c-bf5c-d1f29049f731 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:17.985025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a4ea879c-d601-47bb-acff-eeb3182ce6d8 req-628f1995-c253-4f0c-bf5c-d1f29049f731 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:18.026582 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a4ea879c-d601-47bb-acff-eeb3182ce6d8 req-628f1995-c253-4f0c-bf5c-d1f29049f731 service nova] Creating event network-changed:4cf55f4f-324b-4fe1-82a3-d58ee09ee530 for instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 on n-h2-835595-3 Oct 05 18:03:18.043159 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a4ea879c-d601-47bb-acff-eeb3182ce6d8 req-628f1995-c253-4f0c-bf5c-d1f29049f731 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.725443 Oct 05 18:03:18.045325 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2673/5084] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:03:18.917682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fb8e2036-9721-4709-aa01-d5748be5e95a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:18.917682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fb8e2036-9721-4709-aa01-d5748be5e95a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:18.927640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb8e2036-9721-4709-aa01-d5748be5e95a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:18.928127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb8e2036-9721-4709-aa01-d5748be5e95a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:18.928563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb8e2036-9721-4709-aa01-d5748be5e95a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:18.936632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb8e2036-9721-4709-aa01-d5748be5e95a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:18.937363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb8e2036-9721-4709-aa01-d5748be5e95a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:18.939923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb8e2036-9721-4709-aa01-d5748be5e95a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:19.260804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fb8e2036-9721-4709-aa01-d5748be5e95a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:19.284735 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fb8e2036-9721-4709-aa01-d5748be5e95a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1314 microversion: 2.1 time: 0.364133 Oct 05 18:03:19.298698 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2412/5085] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:18 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:20.310795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d3e8c03a-81ba-4fd8-a365-44c183c76a4c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:20.312412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d3e8c03a-81ba-4fd8-a365-44c183c76a4c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:20.337223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e8c03a-81ba-4fd8-a365-44c183c76a4c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:20.341467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e8c03a-81ba-4fd8-a365-44c183c76a4c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:20.346738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e8c03a-81ba-4fd8-a365-44c183c76a4c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:20.348442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e8c03a-81ba-4fd8-a365-44c183c76a4c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:20.349176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e8c03a-81ba-4fd8-a365-44c183c76a4c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:20.350952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e8c03a-81ba-4fd8-a365-44c183c76a4c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:20.636991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:21.574247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9cb06edc-3237-44e0-8267-d42482f008e2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:21.579482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9cb06edc-3237-44e0-8267-d42482f008e2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:21.593144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:21.595731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cb06edc-3237-44e0-8267-d42482f008e2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:21.599062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cb06edc-3237-44e0-8267-d42482f008e2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:21.600172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cb06edc-3237-44e0-8267-d42482f008e2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:21.601110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cb06edc-3237-44e0-8267-d42482f008e2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:21.601743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cb06edc-3237-44e0-8267-d42482f008e2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:21.607097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cb06edc-3237-44e0-8267-d42482f008e2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:21.661135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d3e8c03a-81ba-4fd8-a365-44c183c76a4c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:21.675382 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d3e8c03a-81ba-4fd8-a365-44c183c76a4c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1314 microversion: 2.1 time: 1.369272 Oct 05 18:03:21.677510 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2674/5086] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:20 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1314 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:21.753156 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9cb06edc-3237-44e0-8267-d42482f008e2 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0/action" status: 200 len: 24544 microversion: 2.1 time: 0.182563 Oct 05 18:03:21.753935 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2413/5087] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:03:21 2022] POST /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0/action => generated 24544 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:03:22.716423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a601f41e-a628-4378-8c53-d768e6874ee9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:22.717725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a601f41e-a628-4378-8c53-d768e6874ee9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:22.720865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:22.759302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a601f41e-a628-4378-8c53-d768e6874ee9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:22.760106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a601f41e-a628-4378-8c53-d768e6874ee9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:22.773980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a601f41e-a628-4378-8c53-d768e6874ee9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:22.782999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a601f41e-a628-4378-8c53-d768e6874ee9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:22.783810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a601f41e-a628-4378-8c53-d768e6874ee9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:22.785042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a601f41e-a628-4378-8c53-d768e6874ee9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:23.270880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a601f41e-a628-4378-8c53-d768e6874ee9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:23.289741 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a601f41e-a628-4378-8c53-d768e6874ee9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1314 microversion: 2.1 time: 0.585047 Oct 05 18:03:23.292001 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2675/5088] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:22 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:24.318162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ceb1530e-091c-42f8-81dc-3bdeab137a2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:24.320074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ceb1530e-091c-42f8-81dc-3bdeab137a2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:24.337503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceb1530e-091c-42f8-81dc-3bdeab137a2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:24.338261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceb1530e-091c-42f8-81dc-3bdeab137a2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:24.338957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceb1530e-091c-42f8-81dc-3bdeab137a2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:24.343559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceb1530e-091c-42f8-81dc-3bdeab137a2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:24.345539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceb1530e-091c-42f8-81dc-3bdeab137a2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:24.346338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ceb1530e-091c-42f8-81dc-3bdeab137a2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:24.691587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ceb1530e-091c-42f8-81dc-3bdeab137a2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:24.706638 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ceb1530e-091c-42f8-81dc-3bdeab137a2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1314 microversion: 2.1 time: 0.393763 Oct 05 18:03:24.732615 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2414/5089] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:24 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:25.345580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-85d0c7c1-d205-4f72-9712-1a50888bb03e req-6ebfc619-9cc9-465e-82be-b872620aef8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0555770d-5774-4f39-b4ad-3fa29ac7ba32", "name": "network-vif-plugged", "status": "completed", "tag": "4cf55f4f-324b-4fe1-82a3-d58ee09ee530"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:25.398374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-85d0c7c1-d205-4f72-9712-1a50888bb03e req-6ebfc619-9cc9-465e-82be-b872620aef8c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:25.405413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-85d0c7c1-d205-4f72-9712-1a50888bb03e req-6ebfc619-9cc9-465e-82be-b872620aef8c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:25.407441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-85d0c7c1-d205-4f72-9712-1a50888bb03e req-6ebfc619-9cc9-465e-82be-b872620aef8c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:25.430706 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-85d0c7c1-d205-4f72-9712-1a50888bb03e req-6ebfc619-9cc9-465e-82be-b872620aef8c service nova] Creating event network-vif-plugged:4cf55f4f-324b-4fe1-82a3-d58ee09ee530 for instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 on n-h2-835595-3 Oct 05 18:03:25.438158 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-85d0c7c1-d205-4f72-9712-1a50888bb03e req-6ebfc619-9cc9-465e-82be-b872620aef8c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.673932 Oct 05 18:03:25.439931 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2676/5090] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:03:25.737781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e924feb7-c83f-4f30-80e4-450262118a7a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:25.746257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e924feb7-c83f-4f30-80e4-450262118a7a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:25.772018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e924feb7-c83f-4f30-80e4-450262118a7a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:25.772602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e924feb7-c83f-4f30-80e4-450262118a7a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:25.774629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e924feb7-c83f-4f30-80e4-450262118a7a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:25.778308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e924feb7-c83f-4f30-80e4-450262118a7a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:25.781694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e924feb7-c83f-4f30-80e4-450262118a7a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:25.782257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e924feb7-c83f-4f30-80e4-450262118a7a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:26.202697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e924feb7-c83f-4f30-80e4-450262118a7a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:26.215045 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e924feb7-c83f-4f30-80e4-450262118a7a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1314 microversion: 2.1 time: 0.479538 Oct 05 18:03:26.216363 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2415/5091] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:25 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:27.250491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f6514247-da55-48f3-ba05-e772fe81d849 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:27.251855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f6514247-da55-48f3-ba05-e772fe81d849 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:27.270227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6514247-da55-48f3-ba05-e772fe81d849 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:27.271074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6514247-da55-48f3-ba05-e772fe81d849 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:27.271716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6514247-da55-48f3-ba05-e772fe81d849 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:27.272614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6514247-da55-48f3-ba05-e772fe81d849 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:27.273240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6514247-da55-48f3-ba05-e772fe81d849 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:27.273838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6514247-da55-48f3-ba05-e772fe81d849 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:27.987251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f6514247-da55-48f3-ba05-e772fe81d849 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:28.000442 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f6514247-da55-48f3-ba05-e772fe81d849 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1501 microversion: 2.1 time: 0.761090 Oct 05 18:03:28.007149 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2677/5092] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:27 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1501 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:28.031640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69356daf-a669-4416-91aa-427355c856dc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:28.032231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-69356daf-a669-4416-91aa-427355c856dc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:28.051188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69356daf-a669-4416-91aa-427355c856dc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:28.051773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69356daf-a669-4416-91aa-427355c856dc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:28.052234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69356daf-a669-4416-91aa-427355c856dc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:28.053060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69356daf-a669-4416-91aa-427355c856dc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:28.059891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69356daf-a669-4416-91aa-427355c856dc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:28.060416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69356daf-a669-4416-91aa-427355c856dc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:28.075793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:28.176379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-69356daf-a669-4416-91aa-427355c856dc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lazy-loading 'flavor' on Instance uuid 0555770d-5774-4f39-b4ad-3fa29ac7ba32 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:03:28.670865 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69356daf-a669-4416-91aa-427355c856dc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32/action" status: 202 len: 0 microversion: 2.1 time: 0.643361 Oct 05 18:03:28.671975 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2416/5093] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:03:28 2022] POST /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32/action => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:03:28.697402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c2423da2-7969-42f7-bff1-cc92bc536647 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:28.700737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c2423da2-7969-42f7-bff1-cc92bc536647 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:28.722892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2423da2-7969-42f7-bff1-cc92bc536647 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:28.736252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2423da2-7969-42f7-bff1-cc92bc536647 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:28.736824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2423da2-7969-42f7-bff1-cc92bc536647 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:28.740775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2423da2-7969-42f7-bff1-cc92bc536647 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:28.741361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2423da2-7969-42f7-bff1-cc92bc536647 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:28.741884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c2423da2-7969-42f7-bff1-cc92bc536647 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:28.745715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:29.085794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c2423da2-7969-42f7-bff1-cc92bc536647 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:29.108630 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c2423da2-7969-42f7-bff1-cc92bc536647 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.430309 Oct 05 18:03:29.130054 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2678/5094] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:28 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:30.156825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-96f5eac8-032e-42ed-942a-105c3978514d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:30.170604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-96f5eac8-032e-42ed-942a-105c3978514d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:30.226832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96f5eac8-032e-42ed-942a-105c3978514d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:30.230912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96f5eac8-032e-42ed-942a-105c3978514d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:30.231935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96f5eac8-032e-42ed-942a-105c3978514d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:30.233776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96f5eac8-032e-42ed-942a-105c3978514d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:30.234750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96f5eac8-032e-42ed-942a-105c3978514d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:30.236736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96f5eac8-032e-42ed-942a-105c3978514d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:30.521830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-96f5eac8-032e-42ed-942a-105c3978514d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:30.543385 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-96f5eac8-032e-42ed-942a-105c3978514d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.405998 Oct 05 18:03:30.544234 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2417/5095] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:30 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:31.573051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3dcc0aff-c157-4bf2-8abe-82579a376c04 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:31.573791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3dcc0aff-c157-4bf2-8abe-82579a376c04 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:31.584497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dcc0aff-c157-4bf2-8abe-82579a376c04 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:31.585267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dcc0aff-c157-4bf2-8abe-82579a376c04 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:31.585875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dcc0aff-c157-4bf2-8abe-82579a376c04 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:31.586831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dcc0aff-c157-4bf2-8abe-82579a376c04 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:31.587455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dcc0aff-c157-4bf2-8abe-82579a376c04 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:31.588051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dcc0aff-c157-4bf2-8abe-82579a376c04 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:31.932395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3dcc0aff-c157-4bf2-8abe-82579a376c04 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:31.944373 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3dcc0aff-c157-4bf2-8abe-82579a376c04 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.375625 Oct 05 18:03:31.970039 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2679/5096] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:31 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:32.692641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:32.696542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:32.719225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:32.719726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:32.720163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:32.720890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:32.724510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:32.725413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:32.875727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:03:32.877338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:03:32.879401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:03:32.880628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:03:32.885329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:03:32.977899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a9ca6b3a-a83e-40e8-b199-272799ca7416 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:32.978569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a9ca6b3a-a83e-40e8-b199-272799ca7416 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:32.995710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9ca6b3a-a83e-40e8-b199-272799ca7416 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:32.996656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9ca6b3a-a83e-40e8-b199-272799ca7416 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:32.997296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9ca6b3a-a83e-40e8-b199-272799ca7416 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:32.999370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9ca6b3a-a83e-40e8-b199-272799ca7416 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:33.000918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9ca6b3a-a83e-40e8-b199-272799ca7416 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:33.002953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9ca6b3a-a83e-40e8-b199-272799ca7416 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:33.071708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:33.089181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:33.089686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:33.090120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:33.092916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:33.094477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:33.095423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:33.216721 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-041e964d-3e2a-441e-a242-1135ede49f57 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0/action" status: 202 len: 1137 microversion: 2.1 time: 0.526814 Oct 05 18:03:33.233099 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2418/5097] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:03:32 2022] POST /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0/action => generated 1137 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 05 18:03:33.243461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97edf255-5e13-428c-8e32-6a6ed3a872a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:33.244523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-97edf255-5e13-428c-8e32-6a6ed3a872a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:33.253728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97edf255-5e13-428c-8e32-6a6ed3a872a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:33.254552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97edf255-5e13-428c-8e32-6a6ed3a872a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:33.255249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97edf255-5e13-428c-8e32-6a6ed3a872a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:33.256561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97edf255-5e13-428c-8e32-6a6ed3a872a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:33.257310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97edf255-5e13-428c-8e32-6a6ed3a872a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:33.257957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97edf255-5e13-428c-8e32-6a6ed3a872a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:33.428960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a9ca6b3a-a83e-40e8-b199-272799ca7416 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:33.439404 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a9ca6b3a-a83e-40e8-b199-272799ca7416 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.466670 Oct 05 18:03:33.440827 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2680/5098] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:32 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:33.449827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-785798110", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9f337617-552f-467e-b9da-7c80a8dfe6cc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "adb1494a-27b0-43e0-8027-66e89e0c81ad"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:33.536651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-97edf255-5e13-428c-8e32-6a6ed3a872a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:33.553837 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-97edf255-5e13-428c-8e32-6a6ed3a872a7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.316572 Oct 05 18:03:33.566307 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2419/5099] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:33 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:33.595833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] validate_networks() for [('adb1494a-27b0-43e0-8027-66e89e0c81ad', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:03:34.324655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:03:34.325699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:03:34.326380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:03:34.326956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:03:34.327566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:03:34.342854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:34.343653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:34.346873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:34.348052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:34.348749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:34.349403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:34.396543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:03:34.408811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for user 8a900e5bf82d462a9113d6e6461ea3a0 and project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:03:34.497095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27ba01d5-6166-4227-acce-2d954d88f28a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:34.501631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-27ba01d5-6166-4227-acce-2d954d88f28a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:34.546340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27ba01d5-6166-4227-acce-2d954d88f28a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:34.548798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27ba01d5-6166-4227-acce-2d954d88f28a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:34.563212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27ba01d5-6166-4227-acce-2d954d88f28a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:34.566456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:03:34.567369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27ba01d5-6166-4227-acce-2d954d88f28a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:34.567862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27ba01d5-6166-4227-acce-2d954d88f28a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:34.568337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27ba01d5-6166-4227-acce-2d954d88f28a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:34.569532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9f337617-552f-467e-b9da-7c80a8dfe6cc',volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:03:34.883218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=55,nova_api:INSERT=5 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:34.931180 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6aa9a065-b3b4-4fb8-85d0-3b5cd8c8bd84 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.488829 Oct 05 18:03:34.932150 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2681/5100] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:03:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:03:34.967974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a400ba6d-0a7e-480e-8366-af67e91ec1bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:34.977733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a400ba6d-0a7e-480e-8366-af67e91ec1bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:35.028959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a400ba6d-0a7e-480e-8366-af67e91ec1bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:35.029499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a400ba6d-0a7e-480e-8366-af67e91ec1bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:35.029946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a400ba6d-0a7e-480e-8366-af67e91ec1bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:35.030705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a400ba6d-0a7e-480e-8366-af67e91ec1bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:35.031788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a400ba6d-0a7e-480e-8366-af67e91ec1bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:35.031788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a400ba6d-0a7e-480e-8366-af67e91ec1bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:35.059093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-27ba01d5-6166-4227-acce-2d954d88f28a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:35.069852 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-27ba01d5-6166-4227-acce-2d954d88f28a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.606145 Oct 05 18:03:35.071684 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2420/5101] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:34 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:35.076670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2a53a216-6593-4ffa-a848-6333013584d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:35.077572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2a53a216-6593-4ffa-a848-6333013584d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:35.198053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2a53a216-6593-4ffa-a848-6333013584d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:35.205359 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2a53a216-6593-4ffa-a848-6333013584d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1056 microversion: 2.1 time: 0.132325 Oct 05 18:03:35.219213 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2421/5102] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:35 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1056 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:35.406374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a400ba6d-0a7e-480e-8366-af67e91ec1bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:35.417811 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a400ba6d-0a7e-480e-8366-af67e91ec1bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.478089 Oct 05 18:03:35.434499 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2682/5103] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:34 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:36.099137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-83a94c4a-e784-4fa5-9484-1b23be03b853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:36.099773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-83a94c4a-e784-4fa5-9484-1b23be03b853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:36.115881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83a94c4a-e784-4fa5-9484-1b23be03b853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:36.117080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83a94c4a-e784-4fa5-9484-1b23be03b853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:36.118251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83a94c4a-e784-4fa5-9484-1b23be03b853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:36.119606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83a94c4a-e784-4fa5-9484-1b23be03b853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:36.120459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83a94c4a-e784-4fa5-9484-1b23be03b853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:36.121623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83a94c4a-e784-4fa5-9484-1b23be03b853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:36.234232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9f73734-59b0-4023-be94-1fe662e04681 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:36.235258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9f73734-59b0-4023-be94-1fe662e04681 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:36.247523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f73734-59b0-4023-be94-1fe662e04681 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:36.248200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f73734-59b0-4023-be94-1fe662e04681 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:36.249172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f73734-59b0-4023-be94-1fe662e04681 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:36.251050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f73734-59b0-4023-be94-1fe662e04681 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:36.251629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f73734-59b0-4023-be94-1fe662e04681 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:36.252149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9f73734-59b0-4023-be94-1fe662e04681 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:36.401680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-83a94c4a-e784-4fa5-9484-1b23be03b853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:36.421548 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-83a94c4a-e784-4fa5-9484-1b23be03b853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.323000 Oct 05 18:03:36.425180 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2422/5104] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:36 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:36.437579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9f73734-59b0-4023-be94-1fe662e04681 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:36.447454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2f57933-176e-46d1-8428-5f797b21cf5f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:36.448154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2f57933-176e-46d1-8428-5f797b21cf5f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:36.451358 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9f73734-59b0-4023-be94-1fe662e04681 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1154 microversion: 2.1 time: 0.223591 Oct 05 18:03:36.452339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2683/5105] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:36 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1154 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:36.492109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2f57933-176e-46d1-8428-5f797b21cf5f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:36.493278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2f57933-176e-46d1-8428-5f797b21cf5f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:36.497163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2f57933-176e-46d1-8428-5f797b21cf5f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:36.498023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2f57933-176e-46d1-8428-5f797b21cf5f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:36.498878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2f57933-176e-46d1-8428-5f797b21cf5f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:36.499591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2f57933-176e-46d1-8428-5f797b21cf5f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:36.971764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2f57933-176e-46d1-8428-5f797b21cf5f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:36.984219 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c2f57933-176e-46d1-8428-5f797b21cf5f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.544727 Oct 05 18:03:36.985711 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2423/5106] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:36 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:37.447317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a1f6f323-6d2f-4c35-900a-efa319925c18 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:37.449417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a1f6f323-6d2f-4c35-900a-efa319925c18 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:37.461867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1f6f323-6d2f-4c35-900a-efa319925c18 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:37.462941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1f6f323-6d2f-4c35-900a-efa319925c18 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:37.463558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1f6f323-6d2f-4c35-900a-efa319925c18 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:37.464459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1f6f323-6d2f-4c35-900a-efa319925c18 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:37.480275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-78810a5b-5410-43fc-af43-17a5b0259919 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:37.481060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-78810a5b-5410-43fc-af43-17a5b0259919 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:37.481817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1f6f323-6d2f-4c35-900a-efa319925c18 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:37.482516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1f6f323-6d2f-4c35-900a-efa319925c18 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:37.497320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78810a5b-5410-43fc-af43-17a5b0259919 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:37.500321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78810a5b-5410-43fc-af43-17a5b0259919 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:37.501447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78810a5b-5410-43fc-af43-17a5b0259919 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:37.503121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78810a5b-5410-43fc-af43-17a5b0259919 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:37.505258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78810a5b-5410-43fc-af43-17a5b0259919 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:37.506033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78810a5b-5410-43fc-af43-17a5b0259919 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:37.732156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-78810a5b-5410-43fc-af43-17a5b0259919 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:37.755776 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-78810a5b-5410-43fc-af43-17a5b0259919 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1172 microversion: 2.1 time: 0.278189 Oct 05 18:03:37.759665 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2424/5107] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:37 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1172 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:37.893546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a1f6f323-6d2f-4c35-900a-efa319925c18 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:37.908926 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a1f6f323-6d2f-4c35-900a-efa319925c18 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.460340 Oct 05 18:03:37.910340 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2684/5108] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:37 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:38.018114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85fe1460-815f-4c5b-bb4b-ff7adcbe6c11 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:38.020357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-85fe1460-815f-4c5b-bb4b-ff7adcbe6c11 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:38.048499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85fe1460-815f-4c5b-bb4b-ff7adcbe6c11 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:38.051214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85fe1460-815f-4c5b-bb4b-ff7adcbe6c11 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:38.051707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85fe1460-815f-4c5b-bb4b-ff7adcbe6c11 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:38.052739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85fe1460-815f-4c5b-bb4b-ff7adcbe6c11 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:38.053249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85fe1460-815f-4c5b-bb4b-ff7adcbe6c11 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:38.053688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85fe1460-815f-4c5b-bb4b-ff7adcbe6c11 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:38.786903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-001682fa-f4cb-474a-b283-7ab0cb931ce5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:38.788370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-001682fa-f4cb-474a-b283-7ab0cb931ce5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:38.816702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001682fa-f4cb-474a-b283-7ab0cb931ce5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:38.817483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001682fa-f4cb-474a-b283-7ab0cb931ce5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:38.818198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001682fa-f4cb-474a-b283-7ab0cb931ce5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:38.820003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001682fa-f4cb-474a-b283-7ab0cb931ce5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:38.820631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001682fa-f4cb-474a-b283-7ab0cb931ce5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:38.822213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-001682fa-f4cb-474a-b283-7ab0cb931ce5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:38.829454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85fe1460-815f-4c5b-bb4b-ff7adcbe6c11 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:38.841175 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85fe1460-815f-4c5b-bb4b-ff7adcbe6c11 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.827262 Oct 05 18:03:38.842393 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2425/5109] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:38 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:38.934970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c65489a9-7a10-41f4-8f73-6cd7bf7c79c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:38.935598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c65489a9-7a10-41f4-8f73-6cd7bf7c79c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:38.967871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c65489a9-7a10-41f4-8f73-6cd7bf7c79c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:38.971999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c65489a9-7a10-41f4-8f73-6cd7bf7c79c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:38.972500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c65489a9-7a10-41f4-8f73-6cd7bf7c79c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:38.973254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c65489a9-7a10-41f4-8f73-6cd7bf7c79c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:38.973725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c65489a9-7a10-41f4-8f73-6cd7bf7c79c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:38.984913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c65489a9-7a10-41f4-8f73-6cd7bf7c79c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:39.327421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-001682fa-f4cb-474a-b283-7ab0cb931ce5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:39.347930 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-001682fa-f4cb-474a-b283-7ab0cb931ce5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1214 microversion: 2.1 time: 0.568643 Oct 05 18:03:39.348570 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2685/5110] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:38 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1214 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:39.582359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c65489a9-7a10-41f4-8f73-6cd7bf7c79c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:39.598467 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c65489a9-7a10-41f4-8f73-6cd7bf7c79c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.664179 Oct 05 18:03:39.599944 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2426/5111] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:38 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:39.869801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bad0776a-ff38-4937-a6ec-36276f442228 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:39.870476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bad0776a-ff38-4937-a6ec-36276f442228 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:39.881939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bad0776a-ff38-4937-a6ec-36276f442228 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:39.882468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bad0776a-ff38-4937-a6ec-36276f442228 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:39.882911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bad0776a-ff38-4937-a6ec-36276f442228 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:39.883630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bad0776a-ff38-4937-a6ec-36276f442228 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:39.884089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bad0776a-ff38-4937-a6ec-36276f442228 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:39.884509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bad0776a-ff38-4937-a6ec-36276f442228 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:40.282894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bad0776a-ff38-4937-a6ec-36276f442228 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:40.298476 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bad0776a-ff38-4937-a6ec-36276f442228 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.433213 Oct 05 18:03:40.299684 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2686/5112] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:39 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:40.371863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27c43ca0-e9bd-4a7d-a30b-22ffbdc3502e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:40.372471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-27c43ca0-e9bd-4a7d-a30b-22ffbdc3502e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:40.382492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=50 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:40.390832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c43ca0-e9bd-4a7d-a30b-22ffbdc3502e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:40.391618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c43ca0-e9bd-4a7d-a30b-22ffbdc3502e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:40.392235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c43ca0-e9bd-4a7d-a30b-22ffbdc3502e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:40.393205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c43ca0-e9bd-4a7d-a30b-22ffbdc3502e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:40.393882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c43ca0-e9bd-4a7d-a30b-22ffbdc3502e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:40.394501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c43ca0-e9bd-4a7d-a30b-22ffbdc3502e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:40.623249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0bdf095d-d89f-498a-81c7-6dbfc432d41f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:40.624953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0bdf095d-d89f-498a-81c7-6dbfc432d41f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:40.643891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bdf095d-d89f-498a-81c7-6dbfc432d41f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:40.644565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bdf095d-d89f-498a-81c7-6dbfc432d41f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:40.645289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bdf095d-d89f-498a-81c7-6dbfc432d41f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:40.646235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bdf095d-d89f-498a-81c7-6dbfc432d41f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:40.646846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bdf095d-d89f-498a-81c7-6dbfc432d41f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:40.650932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bdf095d-d89f-498a-81c7-6dbfc432d41f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:40.933479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0bdf095d-d89f-498a-81c7-6dbfc432d41f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:40.944215 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0bdf095d-d89f-498a-81c7-6dbfc432d41f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.324885 Oct 05 18:03:40.951592 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2687/5113] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:40 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:40.959679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f9462ec8-3515-48cb-9170-dd5bca890552 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:40.960170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f9462ec8-3515-48cb-9170-dd5bca890552 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:40.986959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9462ec8-3515-48cb-9170-dd5bca890552 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:40.987458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9462ec8-3515-48cb-9170-dd5bca890552 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:40.988088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9462ec8-3515-48cb-9170-dd5bca890552 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:40.988991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9462ec8-3515-48cb-9170-dd5bca890552 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:40.991966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9462ec8-3515-48cb-9170-dd5bca890552 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:40.992621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f9462ec8-3515-48cb-9170-dd5bca890552 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:41.011519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-27c43ca0-e9bd-4a7d-a30b-22ffbdc3502e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:41.019995 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-27c43ca0-e9bd-4a7d-a30b-22ffbdc3502e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1214 microversion: 2.1 time: 0.652792 Oct 05 18:03:41.032920 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2427/5114] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:40 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1214 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:41.208096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-f9462ec8-3515-48cb-9170-dd5bca890552 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lazy-loading 'services' on Instance uuid b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:03:41.324285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cdb02513-86df-4af7-bac8-1e7778b0508b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:41.325008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cdb02513-86df-4af7-bac8-1e7778b0508b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:41.338111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdb02513-86df-4af7-bac8-1e7778b0508b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:41.353814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdb02513-86df-4af7-bac8-1e7778b0508b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:41.355174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdb02513-86df-4af7-bac8-1e7778b0508b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:41.360270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdb02513-86df-4af7-bac8-1e7778b0508b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:41.360874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdb02513-86df-4af7-bac8-1e7778b0508b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:41.362719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cdb02513-86df-4af7-bac8-1e7778b0508b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:41.390547 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f9462ec8-3515-48cb-9170-dd5bca890552 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866/os-volume_attachments/6f8fe624-2368-43cd-b153-fbcc036990ff" status: 202 len: 0 microversion: 2.1 time: 0.434315 Oct 05 18:03:41.392363 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2688/5115] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:03:40 2022] DELETE /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866/os-volume_attachments/6f8fe624-2368-43cd-b153-fbcc036990ff => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:03:41.420720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-20d8f199-625b-4f3c-a155-75184e6b02dd req-f7616a0b-674c-43e9-a3b7-aac9e19fa079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c51f5174-3b29-4512-a2c1-40f69f17e0a2", "tag": "9e63a8ee-0e56-4769-a839-b2029d871fd8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:41.444533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-20d8f199-625b-4f3c-a155-75184e6b02dd req-f7616a0b-674c-43e9-a3b7-aac9e19fa079 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:41.445602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-20d8f199-625b-4f3c-a155-75184e6b02dd req-f7616a0b-674c-43e9-a3b7-aac9e19fa079 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:41.446348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-20d8f199-625b-4f3c-a155-75184e6b02dd req-f7616a0b-674c-43e9-a3b7-aac9e19fa079 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:41.461676 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-20d8f199-625b-4f3c-a155-75184e6b02dd req-f7616a0b-674c-43e9-a3b7-aac9e19fa079 service nova] Creating event network-changed:9e63a8ee-0e56-4769-a839-b2029d871fd8 for instance c51f5174-3b29-4512-a2c1-40f69f17e0a2 on n-h1-835595-3 Oct 05 18:03:41.469473 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-20d8f199-625b-4f3c-a155-75184e6b02dd req-f7616a0b-674c-43e9-a3b7-aac9e19fa079 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065602 Oct 05 18:03:41.470810 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2689/5116] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:03:41.757987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cdb02513-86df-4af7-bac8-1e7778b0508b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:41.767192 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cdb02513-86df-4af7-bac8-1e7778b0508b tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.446903 Oct 05 18:03:41.785288 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2428/5117] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:41 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:41.976670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e23ac3b8-8c9b-4d5c-8a7d-042c294d7692 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:41.978775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e23ac3b8-8c9b-4d5c-8a7d-042c294d7692 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:41.998176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e23ac3b8-8c9b-4d5c-8a7d-042c294d7692 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:41.998852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e23ac3b8-8c9b-4d5c-8a7d-042c294d7692 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:42.000494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e23ac3b8-8c9b-4d5c-8a7d-042c294d7692 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:42.001559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e23ac3b8-8c9b-4d5c-8a7d-042c294d7692 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:42.002887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e23ac3b8-8c9b-4d5c-8a7d-042c294d7692 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:42.003333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e23ac3b8-8c9b-4d5c-8a7d-042c294d7692 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:42.057979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2de1be96-6abe-48ef-8e8c-1544a29c002d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:42.058640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2de1be96-6abe-48ef-8e8c-1544a29c002d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:42.070413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de1be96-6abe-48ef-8e8c-1544a29c002d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:42.070913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de1be96-6abe-48ef-8e8c-1544a29c002d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:42.071344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de1be96-6abe-48ef-8e8c-1544a29c002d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:42.072057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de1be96-6abe-48ef-8e8c-1544a29c002d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:42.072509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de1be96-6abe-48ef-8e8c-1544a29c002d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:42.072925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de1be96-6abe-48ef-8e8c-1544a29c002d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:42.287537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e23ac3b8-8c9b-4d5c-8a7d-042c294d7692 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:42.300227 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e23ac3b8-8c9b-4d5c-8a7d-042c294d7692 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.327695 Oct 05 18:03:42.316811 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2690/5118] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:41 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:42.577084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2de1be96-6abe-48ef-8e8c-1544a29c002d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:42.589774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:42.601912 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2de1be96-6abe-48ef-8e8c-1544a29c002d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1214 microversion: 2.1 time: 0.544868 Oct 05 18:03:42.602829 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2429/5119] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:42 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1214 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:42.793070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f4205666-531a-4a2a-ab26-f7156117b9c1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:42.794111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f4205666-531a-4a2a-ab26-f7156117b9c1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:42.800861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4205666-531a-4a2a-ab26-f7156117b9c1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:42.801608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4205666-531a-4a2a-ab26-f7156117b9c1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:42.802308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4205666-531a-4a2a-ab26-f7156117b9c1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:42.804257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4205666-531a-4a2a-ab26-f7156117b9c1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:42.804947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4205666-531a-4a2a-ab26-f7156117b9c1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:42.805554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4205666-531a-4a2a-ab26-f7156117b9c1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:42.997501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f4205666-531a-4a2a-ab26-f7156117b9c1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:43.007521 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f4205666-531a-4a2a-ab26-f7156117b9c1 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.218813 Oct 05 18:03:43.020077 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2691/5120] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:42 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:43.332844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-81df2b35-9c50-4f29-9178-59c7c6f3a30a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:43.334553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-81df2b35-9c50-4f29-9178-59c7c6f3a30a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:43.342867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81df2b35-9c50-4f29-9178-59c7c6f3a30a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:43.343615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81df2b35-9c50-4f29-9178-59c7c6f3a30a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:43.344392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81df2b35-9c50-4f29-9178-59c7c6f3a30a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:43.345546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81df2b35-9c50-4f29-9178-59c7c6f3a30a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:43.346658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81df2b35-9c50-4f29-9178-59c7c6f3a30a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:43.347451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81df2b35-9c50-4f29-9178-59c7c6f3a30a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:43.630189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-af53367e-4b3d-4f35-b695-6ef198e234c6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:43.631578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-af53367e-4b3d-4f35-b695-6ef198e234c6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:43.642618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af53367e-4b3d-4f35-b695-6ef198e234c6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:43.642618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af53367e-4b3d-4f35-b695-6ef198e234c6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:43.645634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af53367e-4b3d-4f35-b695-6ef198e234c6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:43.651073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af53367e-4b3d-4f35-b695-6ef198e234c6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:43.652289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af53367e-4b3d-4f35-b695-6ef198e234c6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:43.653244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af53367e-4b3d-4f35-b695-6ef198e234c6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:43.946424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-af53367e-4b3d-4f35-b695-6ef198e234c6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:43.955192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-81df2b35-9c50-4f29-9178-59c7c6f3a30a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:43.957461 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-af53367e-4b3d-4f35-b695-6ef198e234c6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1214 microversion: 2.1 time: 0.333879 Oct 05 18:03:43.958732 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2692/5121] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:43 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:43.980216 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-81df2b35-9c50-4f29-9178-59c7c6f3a30a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.652468 Oct 05 18:03:43.981842 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2430/5122] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:43 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:44.033262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e2f1fe7-6dd4-4dee-807a-6ab84e7439f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:44.033767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0e2f1fe7-6dd4-4dee-807a-6ab84e7439f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:44.045961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f1fe7-6dd4-4dee-807a-6ab84e7439f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:44.046795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f1fe7-6dd4-4dee-807a-6ab84e7439f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:44.047934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f1fe7-6dd4-4dee-807a-6ab84e7439f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:44.053672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f1fe7-6dd4-4dee-807a-6ab84e7439f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:44.054686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f1fe7-6dd4-4dee-807a-6ab84e7439f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:44.055628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e2f1fe7-6dd4-4dee-807a-6ab84e7439f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:44.229572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0e2f1fe7-6dd4-4dee-807a-6ab84e7439f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:44.239046 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0e2f1fe7-6dd4-4dee-807a-6ab84e7439f6 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.209658 Oct 05 18:03:44.239558 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2693/5123] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:44 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:44.983029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6643a251-f465-4dbe-a4a9-53e433686edf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:44.983677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6643a251-f465-4dbe-a4a9-53e433686edf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:44.991280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6643a251-f465-4dbe-a4a9-53e433686edf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:44.991818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6643a251-f465-4dbe-a4a9-53e433686edf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:44.992262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6643a251-f465-4dbe-a4a9-53e433686edf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:44.992983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6643a251-f465-4dbe-a4a9-53e433686edf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:44.993442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6643a251-f465-4dbe-a4a9-53e433686edf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:44.993878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6643a251-f465-4dbe-a4a9-53e433686edf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:45.005215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-721f604b-3bcd-42e1-a5b3-03698a65672d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:45.006483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-721f604b-3bcd-42e1-a5b3-03698a65672d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:45.008825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:45.009519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:45.017743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-721f604b-3bcd-42e1-a5b3-03698a65672d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:45.018246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-721f604b-3bcd-42e1-a5b3-03698a65672d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:45.018931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-721f604b-3bcd-42e1-a5b3-03698a65672d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:45.019848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-721f604b-3bcd-42e1-a5b3-03698a65672d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:45.020305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-721f604b-3bcd-42e1-a5b3-03698a65672d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:45.021047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-721f604b-3bcd-42e1-a5b3-03698a65672d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:45.153791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6643a251-f465-4dbe-a4a9-53e433686edf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:45.162337 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6643a251-f465-4dbe-a4a9-53e433686edf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1214 microversion: 2.1 time: 0.183124 Oct 05 18:03:45.162870 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2431/5124] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:44 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1214 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:45.174075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-721f604b-3bcd-42e1-a5b3-03698a65672d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:45.182438 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-721f604b-3bcd-42e1-a5b3-03698a65672d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.181596 Oct 05 18:03:45.183016 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2694/5125] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:44 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:45.263687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bdfb26cf-e638-472d-896d-e33cadddadd4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:45.264310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bdfb26cf-e638-472d-896d-e33cadddadd4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:45.266430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:45.272788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdfb26cf-e638-472d-896d-e33cadddadd4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:45.273281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdfb26cf-e638-472d-896d-e33cadddadd4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:45.273720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdfb26cf-e638-472d-896d-e33cadddadd4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:45.274463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdfb26cf-e638-472d-896d-e33cadddadd4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:45.274929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdfb26cf-e638-472d-896d-e33cadddadd4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:45.275360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdfb26cf-e638-472d-896d-e33cadddadd4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:45.416503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bdfb26cf-e638-472d-896d-e33cadddadd4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:45.424657 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bdfb26cf-e638-472d-896d-e33cadddadd4 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.165205 Oct 05 18:03:45.425245 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2432/5126] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:45 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:46.185595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7cc51051-0e5c-462e-829b-be69266815b5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:46.186297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7cc51051-0e5c-462e-829b-be69266815b5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:46.193649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc51051-0e5c-462e-829b-be69266815b5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:46.194147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc51051-0e5c-462e-829b-be69266815b5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:46.194621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc51051-0e5c-462e-829b-be69266815b5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:46.195329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc51051-0e5c-462e-829b-be69266815b5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:46.195787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc51051-0e5c-462e-829b-be69266815b5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:46.196212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc51051-0e5c-462e-829b-be69266815b5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:46.205102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b1885d1-2cef-4b89-a97d-e863543d8f28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:46.205754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b1885d1-2cef-4b89-a97d-e863543d8f28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:46.211824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:46.212937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1885d1-2cef-4b89-a97d-e863543d8f28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:46.213411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1885d1-2cef-4b89-a97d-e863543d8f28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:46.213875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1885d1-2cef-4b89-a97d-e863543d8f28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:46.214659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1885d1-2cef-4b89-a97d-e863543d8f28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:46.215124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1885d1-2cef-4b89-a97d-e863543d8f28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:46.215561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b1885d1-2cef-4b89-a97d-e863543d8f28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:46.335983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7cc51051-0e5c-462e-829b-be69266815b5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:46.344415 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7cc51051-0e5c-462e-829b-be69266815b5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1214 microversion: 2.1 time: 0.162973 Oct 05 18:03:46.345023 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2695/5127] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:46 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1214 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:46.353842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3b1885d1-2cef-4b89-a97d-e863543d8f28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:46.362178 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b1885d1-2cef-4b89-a97d-e863543d8f28 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.161044 Oct 05 18:03:46.362798 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2433/5128] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:46 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:46.448701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f01cf50e-ab55-4121-94ad-0f459ef548b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:46.449313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f01cf50e-ab55-4121-94ad-0f459ef548b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:46.455930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f01cf50e-ab55-4121-94ad-0f459ef548b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:46.456428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f01cf50e-ab55-4121-94ad-0f459ef548b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:46.456864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f01cf50e-ab55-4121-94ad-0f459ef548b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:46.457565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f01cf50e-ab55-4121-94ad-0f459ef548b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:46.458022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f01cf50e-ab55-4121-94ad-0f459ef548b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:46.458585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f01cf50e-ab55-4121-94ad-0f459ef548b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:46.595686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f01cf50e-ab55-4121-94ad-0f459ef548b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:46.604891 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f01cf50e-ab55-4121-94ad-0f459ef548b7 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.160110 Oct 05 18:03:46.605514 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2696/5129] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:46 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:47.368029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a75a00a3-a478-46f5-87be-734245b6ba28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:47.368671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a75a00a3-a478-46f5-87be-734245b6ba28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:47.376586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a75a00a3-a478-46f5-87be-734245b6ba28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:47.377086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a75a00a3-a478-46f5-87be-734245b6ba28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:47.377512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a75a00a3-a478-46f5-87be-734245b6ba28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:47.378236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a75a00a3-a478-46f5-87be-734245b6ba28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:47.378725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a75a00a3-a478-46f5-87be-734245b6ba28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:47.379146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a75a00a3-a478-46f5-87be-734245b6ba28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:47.388038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fabb579b-a40a-4a03-9861-d6f4f76590b5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:47.388682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fabb579b-a40a-4a03-9861-d6f4f76590b5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:47.397421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fabb579b-a40a-4a03-9861-d6f4f76590b5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:47.398443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fabb579b-a40a-4a03-9861-d6f4f76590b5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:47.399765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fabb579b-a40a-4a03-9861-d6f4f76590b5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:47.400823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fabb579b-a40a-4a03-9861-d6f4f76590b5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:47.401349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fabb579b-a40a-4a03-9861-d6f4f76590b5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:47.401871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fabb579b-a40a-4a03-9861-d6f4f76590b5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:47.556797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a75a00a3-a478-46f5-87be-734245b6ba28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:47.566255 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a75a00a3-a478-46f5-87be-734245b6ba28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1214 microversion: 2.1 time: 0.202319 Oct 05 18:03:47.567080 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2434/5130] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:47 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1214 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:47.598401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c30c8d2-7b75-4219-a2f7-bd7bd4a04d4f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:47.602323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c30c8d2-7b75-4219-a2f7-bd7bd4a04d4f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:47.611363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c30c8d2-7b75-4219-a2f7-bd7bd4a04d4f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:47.612100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c30c8d2-7b75-4219-a2f7-bd7bd4a04d4f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:47.612696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c30c8d2-7b75-4219-a2f7-bd7bd4a04d4f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:47.614234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c30c8d2-7b75-4219-a2f7-bd7bd4a04d4f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:47.615322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c30c8d2-7b75-4219-a2f7-bd7bd4a04d4f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:47.615944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c30c8d2-7b75-4219-a2f7-bd7bd4a04d4f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:47.625554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fabb579b-a40a-4a03-9861-d6f4f76590b5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:47.647206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fabb579b-a40a-4a03-9861-d6f4f76590b5 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.265548 Oct 05 18:03:47.649815 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2697/5131] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:47 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:47.658023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-019bc984-c2d7-489d-86fb-59c2190e04bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:47.659676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-019bc984-c2d7-489d-86fb-59c2190e04bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:47.668737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c30c8d2-7b75-4219-a2f7-bd7bd4a04d4f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:03:47.677974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019bc984-c2d7-489d-86fb-59c2190e04bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:47.678852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019bc984-c2d7-489d-86fb-59c2190e04bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:47.681832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019bc984-c2d7-489d-86fb-59c2190e04bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:47.682686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019bc984-c2d7-489d-86fb-59c2190e04bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:47.683173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019bc984-c2d7-489d-86fb-59c2190e04bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:47.683628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019bc984-c2d7-489d-86fb-59c2190e04bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:47.820998 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c30c8d2-7b75-4219-a2f7-bd7bd4a04d4f tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 204 len: 0 microversion: 2.1 time: 0.228835 Oct 05 18:03:47.821683 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2435/5132] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:03:47 2022] DELETE /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:03:47.834946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c716bc0-e535-4eb4-8ab6-1f8e738316d9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:47.835747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3c716bc0-e535-4eb4-8ab6-1f8e738316d9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:47.847987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c716bc0-e535-4eb4-8ab6-1f8e738316d9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:47.848709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c716bc0-e535-4eb4-8ab6-1f8e738316d9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:47.849452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c716bc0-e535-4eb4-8ab6-1f8e738316d9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:47.850348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c716bc0-e535-4eb4-8ab6-1f8e738316d9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:47.851248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c716bc0-e535-4eb4-8ab6-1f8e738316d9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:47.851828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c716bc0-e535-4eb4-8ab6-1f8e738316d9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:47.908584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-019bc984-c2d7-489d-86fb-59c2190e04bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:47.920672 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-019bc984-c2d7-489d-86fb-59c2190e04bc tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.269370 Oct 05 18:03:47.921425 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2698/5133] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:47 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:48.008215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3c716bc0-e535-4eb4-8ab6-1f8e738316d9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:48.017238 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c716bc0-e535-4eb4-8ab6-1f8e738316d9 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1514 microversion: 2.1 time: 0.190593 Oct 05 18:03:48.018123 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2436/5134] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:47 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:48.590319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7c336653-c4ed-43b2-b36c-686b736a7930 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:48.591218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7c336653-c4ed-43b2-b36c-686b736a7930 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:48.609323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c336653-c4ed-43b2-b36c-686b736a7930 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:48.609829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c336653-c4ed-43b2-b36c-686b736a7930 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:48.610263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c336653-c4ed-43b2-b36c-686b736a7930 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:48.611186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c336653-c4ed-43b2-b36c-686b736a7930 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:48.611820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c336653-c4ed-43b2-b36c-686b736a7930 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:48.612410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c336653-c4ed-43b2-b36c-686b736a7930 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:48.672757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ac56295f-2998-4faa-b733-f3d8019f18d2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:48.673546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ac56295f-2998-4faa-b733-f3d8019f18d2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:48.685364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac56295f-2998-4faa-b733-f3d8019f18d2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:48.687138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac56295f-2998-4faa-b733-f3d8019f18d2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:48.690104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac56295f-2998-4faa-b733-f3d8019f18d2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:48.691163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac56295f-2998-4faa-b733-f3d8019f18d2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:48.691905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac56295f-2998-4faa-b733-f3d8019f18d2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:48.692591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac56295f-2998-4faa-b733-f3d8019f18d2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:48.801200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7c336653-c4ed-43b2-b36c-686b736a7930 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:48.811350 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7c336653-c4ed-43b2-b36c-686b736a7930 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1214 microversion: 2.1 time: 0.225991 Oct 05 18:03:48.815342 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2699/5135] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:48 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1214 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:48.926490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ac56295f-2998-4faa-b733-f3d8019f18d2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:48.936171 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ac56295f-2998-4faa-b733-f3d8019f18d2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.267525 Oct 05 18:03:48.939711 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2437/5136] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:48 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:48.946331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dcb3662f-b9d7-4b8e-b9a9-30d8087645f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:48.947161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dcb3662f-b9d7-4b8e-b9a9-30d8087645f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:48.960511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcb3662f-b9d7-4b8e-b9a9-30d8087645f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:48.961428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcb3662f-b9d7-4b8e-b9a9-30d8087645f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:48.961879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcb3662f-b9d7-4b8e-b9a9-30d8087645f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:48.970807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcb3662f-b9d7-4b8e-b9a9-30d8087645f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:48.971454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcb3662f-b9d7-4b8e-b9a9-30d8087645f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:48.971916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dcb3662f-b9d7-4b8e-b9a9-30d8087645f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:49.041270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-992b08c1-96b3-4d24-a367-dd16346edebe tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:49.041948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-992b08c1-96b3-4d24-a367-dd16346edebe tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:49.050958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992b08c1-96b3-4d24-a367-dd16346edebe tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:49.054075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992b08c1-96b3-4d24-a367-dd16346edebe tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:49.054718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992b08c1-96b3-4d24-a367-dd16346edebe tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:49.057784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992b08c1-96b3-4d24-a367-dd16346edebe tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:49.058502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992b08c1-96b3-4d24-a367-dd16346edebe tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:49.059100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992b08c1-96b3-4d24-a367-dd16346edebe tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:49.331749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-992b08c1-96b3-4d24-a367-dd16346edebe tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:49.342854 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-992b08c1-96b3-4d24-a367-dd16346edebe tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1514 microversion: 2.1 time: 0.305482 Oct 05 18:03:49.355535 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2438/5137] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:49 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1514 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:49.797250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dcb3662f-b9d7-4b8e-b9a9-30d8087645f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:49.809204 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dcb3662f-b9d7-4b8e-b9a9-30d8087645f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1689 microversion: 2.1 time: 0.866731 Oct 05 18:03:49.815776 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2700/5138] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:48 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1689 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:49.840413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-15122791-21bb-4b72-a93b-683343414906 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:49.841225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-15122791-21bb-4b72-a93b-683343414906 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:49.849995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15122791-21bb-4b72-a93b-683343414906 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:49.850872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15122791-21bb-4b72-a93b-683343414906 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:49.851379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15122791-21bb-4b72-a93b-683343414906 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:49.852184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15122791-21bb-4b72-a93b-683343414906 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:49.852723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15122791-21bb-4b72-a93b-683343414906 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:49.853251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15122791-21bb-4b72-a93b-683343414906 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:49.964514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-abcdbe45-4bfb-4769-93b8-398446deaf6a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:49.965408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-abcdbe45-4bfb-4769-93b8-398446deaf6a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:49.972605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abcdbe45-4bfb-4769-93b8-398446deaf6a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:49.973544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abcdbe45-4bfb-4769-93b8-398446deaf6a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:49.974316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abcdbe45-4bfb-4769-93b8-398446deaf6a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:49.975261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abcdbe45-4bfb-4769-93b8-398446deaf6a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:49.975942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abcdbe45-4bfb-4769-93b8-398446deaf6a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:49.976604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-abcdbe45-4bfb-4769-93b8-398446deaf6a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:50.005649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-15122791-21bb-4b72-a93b-683343414906 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:50.014880 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-15122791-21bb-4b72-a93b-683343414906 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1214 microversion: 2.1 time: 0.181347 Oct 05 18:03:50.030696 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2439/5139] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:49 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1214 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:50.130505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-abcdbe45-4bfb-4769-93b8-398446deaf6a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:50.139251 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-abcdbe45-4bfb-4769-93b8-398446deaf6a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.178882 Oct 05 18:03:50.139839 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2701/5140] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:49 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:50.371042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55c73073-46c3-4fe5-a3cf-726921aad4f1 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:50.372065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-55c73073-46c3-4fe5-a3cf-726921aad4f1 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:50.387021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55c73073-46c3-4fe5-a3cf-726921aad4f1 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:50.387575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55c73073-46c3-4fe5-a3cf-726921aad4f1 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:50.388769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55c73073-46c3-4fe5-a3cf-726921aad4f1 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:50.390950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55c73073-46c3-4fe5-a3cf-726921aad4f1 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:50.392847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55c73073-46c3-4fe5-a3cf-726921aad4f1 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:50.393447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55c73073-46c3-4fe5-a3cf-726921aad4f1 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:50.560494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-55c73073-46c3-4fe5-a3cf-726921aad4f1 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:50.569817 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-55c73073-46c3-4fe5-a3cf-726921aad4f1 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1514 microversion: 2.1 time: 0.203975 Oct 05 18:03:50.578330 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2440/5141] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:50 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:50.835805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f740db4d-c15d-4904-8920-789f5a04ff33 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:50.836937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f740db4d-c15d-4904-8920-789f5a04ff33 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:50.848414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f740db4d-c15d-4904-8920-789f5a04ff33 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:50.849237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f740db4d-c15d-4904-8920-789f5a04ff33 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:50.850960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f740db4d-c15d-4904-8920-789f5a04ff33 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:50.853126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f740db4d-c15d-4904-8920-789f5a04ff33 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:50.854783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f740db4d-c15d-4904-8920-789f5a04ff33 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:50.855394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f740db4d-c15d-4904-8920-789f5a04ff33 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:51.039934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f4e231d7-4cc9-46af-a8f7-8573535e21a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:51.040751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f4e231d7-4cc9-46af-a8f7-8573535e21a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:51.050753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e231d7-4cc9-46af-a8f7-8573535e21a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:51.051899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e231d7-4cc9-46af-a8f7-8573535e21a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:51.052918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e231d7-4cc9-46af-a8f7-8573535e21a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:51.054001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e231d7-4cc9-46af-a8f7-8573535e21a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:51.054757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e231d7-4cc9-46af-a8f7-8573535e21a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:51.055409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e231d7-4cc9-46af-a8f7-8573535e21a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:51.082677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f740db4d-c15d-4904-8920-789f5a04ff33 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:51.101613 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f740db4d-c15d-4904-8920-789f5a04ff33 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1695 microversion: 2.1 time: 0.270997 Oct 05 18:03:51.102255 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2702/5142] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:50 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1695 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:51.167195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6a86088a-f0ce-4e71-8426-25302709f8d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:51.167953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6a86088a-f0ce-4e71-8426-25302709f8d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:51.177014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a86088a-f0ce-4e71-8426-25302709f8d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:51.178112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a86088a-f0ce-4e71-8426-25302709f8d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:51.178730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a86088a-f0ce-4e71-8426-25302709f8d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:51.180455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a86088a-f0ce-4e71-8426-25302709f8d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:51.181165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a86088a-f0ce-4e71-8426-25302709f8d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:51.181814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a86088a-f0ce-4e71-8426-25302709f8d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:51.308016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f4e231d7-4cc9-46af-a8f7-8573535e21a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:51.326233 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f4e231d7-4cc9-46af-a8f7-8573535e21a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1202 microversion: 2.1 time: 0.291739 Oct 05 18:03:51.327662 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2441/5143] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:51 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1202 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:51.375667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6a86088a-f0ce-4e71-8426-25302709f8d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:51.387349 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6a86088a-f0ce-4e71-8426-25302709f8d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.228276 Oct 05 18:03:51.388679 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2703/5144] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:51 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:51.473636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-711f1b57-263f-4adf-b328-2c109e1dad36 req-fe8fad1c-100b-41a4-a351-a8a79077bc02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0c3807c-eb9a-4c1f-a519-b3d2c98ba866", "name": "network-vif-deleted", "tag": "ea45799e-94b3-4c8d-927f-e5c706a76fe8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:51.484571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-711f1b57-263f-4adf-b328-2c109e1dad36 req-fe8fad1c-100b-41a4-a351-a8a79077bc02 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:51.485462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-711f1b57-263f-4adf-b328-2c109e1dad36 req-fe8fad1c-100b-41a4-a351-a8a79077bc02 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:51.486724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-711f1b57-263f-4adf-b328-2c109e1dad36 req-fe8fad1c-100b-41a4-a351-a8a79077bc02 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:51.500960 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-711f1b57-263f-4adf-b328-2c109e1dad36 req-fe8fad1c-100b-41a4-a351-a8a79077bc02 service nova] Creating event network-vif-deleted:ea45799e-94b3-4c8d-927f-e5c706a76fe8 for instance b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 on n-h1-835595-3 Oct 05 18:03:51.506357 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-711f1b57-263f-4adf-b328-2c109e1dad36 req-fe8fad1c-100b-41a4-a351-a8a79077bc02 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036396 Oct 05 18:03:51.507230 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2442/5145] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:03:51.593586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7beb3954-9fef-4258-b50e-3cb2818e3689 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:51.596501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7beb3954-9fef-4258-b50e-3cb2818e3689 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:51.608303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7beb3954-9fef-4258-b50e-3cb2818e3689 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:51.609065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7beb3954-9fef-4258-b50e-3cb2818e3689 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:51.609745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7beb3954-9fef-4258-b50e-3cb2818e3689 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:51.610740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7beb3954-9fef-4258-b50e-3cb2818e3689 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:51.611438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7beb3954-9fef-4258-b50e-3cb2818e3689 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:51.611957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7beb3954-9fef-4258-b50e-3cb2818e3689 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:51.765455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7beb3954-9fef-4258-b50e-3cb2818e3689 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:51.781631 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7beb3954-9fef-4258-b50e-3cb2818e3689 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1472 microversion: 2.1 time: 0.191847 Oct 05 18:03:51.790820 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2704/5146] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:51 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1472 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:52.133462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5de5e7d4-e856-4078-9709-08a73e870682 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:52.135021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5de5e7d4-e856-4078-9709-08a73e870682 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:52.145756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de5e7d4-e856-4078-9709-08a73e870682 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:52.146610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de5e7d4-e856-4078-9709-08a73e870682 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:52.147491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de5e7d4-e856-4078-9709-08a73e870682 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:52.148799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de5e7d4-e856-4078-9709-08a73e870682 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:52.149458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de5e7d4-e856-4078-9709-08a73e870682 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:52.150102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5de5e7d4-e856-4078-9709-08a73e870682 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:52.325693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5de5e7d4-e856-4078-9709-08a73e870682 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:52.335050 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5de5e7d4-e856-4078-9709-08a73e870682 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1695 microversion: 2.1 time: 0.208052 Oct 05 18:03:52.336820 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2443/5147] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:52 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1695 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:52.353656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c36dd999-42f3-435f-bed8-679870b19f5d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:52.354151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c36dd999-42f3-435f-bed8-679870b19f5d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:52.364916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c36dd999-42f3-435f-bed8-679870b19f5d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:52.370484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c36dd999-42f3-435f-bed8-679870b19f5d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:52.371105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c36dd999-42f3-435f-bed8-679870b19f5d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:52.372028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c36dd999-42f3-435f-bed8-679870b19f5d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:52.372838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c36dd999-42f3-435f-bed8-679870b19f5d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:52.373741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c36dd999-42f3-435f-bed8-679870b19f5d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:52.413167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8c11b4a3-2f6a-4bf9-a2ee-ea6d89f0a54e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:52.414294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8c11b4a3-2f6a-4bf9-a2ee-ea6d89f0a54e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:52.424890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c11b4a3-2f6a-4bf9-a2ee-ea6d89f0a54e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:52.425751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c11b4a3-2f6a-4bf9-a2ee-ea6d89f0a54e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:52.426419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c11b4a3-2f6a-4bf9-a2ee-ea6d89f0a54e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:52.428656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c11b4a3-2f6a-4bf9-a2ee-ea6d89f0a54e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:52.429295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c11b4a3-2f6a-4bf9-a2ee-ea6d89f0a54e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:52.430220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c11b4a3-2f6a-4bf9-a2ee-ea6d89f0a54e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:52.662063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c36dd999-42f3-435f-bed8-679870b19f5d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:52.675696 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c36dd999-42f3-435f-bed8-679870b19f5d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1202 microversion: 2.1 time: 0.326357 Oct 05 18:03:52.686577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c11b4a3-2f6a-4bf9-a2ee-ea6d89f0a54e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:52.687587 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2705/5148] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:52 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1202 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:52.698379 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8c11b4a3-2f6a-4bf9-a2ee-ea6d89f0a54e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.289047 Oct 05 18:03:52.701404 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2444/5149] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:52 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:52.813640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:52.815026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:52.830503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:52.832275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:52.833004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:52.834179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:52.835265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:52.840894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:52.889960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:52.890922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:52.891795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:52.892487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lazy-loading 'fault' on Instance uuid b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:03:53.017285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4892ca792aab4b2fafd3eea8188a706a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe08ff0f6ae4de2b0f29978c2f82bd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:53.026691 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-862cbd4b-3bc2-4686-bae6-73185abaf818 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 200 len: 1309 microversion: 2.1 time: 0.221331 Oct 05 18:03:53.033338 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2706/5150] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:52 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 1309 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:53.362236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-abcb3c34-d9e7-4277-98e5-93416095e41e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:53.362890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-abcb3c34-d9e7-4277-98e5-93416095e41e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:53.369722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abcb3c34-d9e7-4277-98e5-93416095e41e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:53.370136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abcb3c34-d9e7-4277-98e5-93416095e41e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:53.378778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abcb3c34-d9e7-4277-98e5-93416095e41e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:53.379651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abcb3c34-d9e7-4277-98e5-93416095e41e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:53.380061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abcb3c34-d9e7-4277-98e5-93416095e41e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:53.380558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-abcb3c34-d9e7-4277-98e5-93416095e41e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:53.430193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:03:53.613105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-abcb3c34-d9e7-4277-98e5-93416095e41e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:53.621504 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-abcb3c34-d9e7-4277-98e5-93416095e41e tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1680 microversion: 2.1 time: 0.263041 Oct 05 18:03:53.623367 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2445/5151] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:53 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1680 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:53.701379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13a2d7dd-3162-4f99-a715-a5adb7362deb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:53.702589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13a2d7dd-3162-4f99-a715-a5adb7362deb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:53.710663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a2d7dd-3162-4f99-a715-a5adb7362deb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:53.711707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a2d7dd-3162-4f99-a715-a5adb7362deb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:53.712241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a2d7dd-3162-4f99-a715-a5adb7362deb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:53.713039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a2d7dd-3162-4f99-a715-a5adb7362deb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:53.715984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a2d7dd-3162-4f99-a715-a5adb7362deb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:53.716557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13a2d7dd-3162-4f99-a715-a5adb7362deb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:53.723565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-09286a34-f5c6-445b-9fcd-031ea8cbf3d6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:53.724395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-09286a34-f5c6-445b-9fcd-031ea8cbf3d6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:53.735168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09286a34-f5c6-445b-9fcd-031ea8cbf3d6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:53.735906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09286a34-f5c6-445b-9fcd-031ea8cbf3d6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:53.736464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09286a34-f5c6-445b-9fcd-031ea8cbf3d6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:53.738437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09286a34-f5c6-445b-9fcd-031ea8cbf3d6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:53.739563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09286a34-f5c6-445b-9fcd-031ea8cbf3d6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:53.741180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-09286a34-f5c6-445b-9fcd-031ea8cbf3d6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:53.904147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-09286a34-f5c6-445b-9fcd-031ea8cbf3d6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:53.914634 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-09286a34-f5c6-445b-9fcd-031ea8cbf3d6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1507 microversion: 2.1 time: 0.195085 Oct 05 18:03:53.916257 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2446/5152] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:53 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:54.035878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-13a2d7dd-3162-4f99-a715-a5adb7362deb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:54.047115 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13a2d7dd-3162-4f99-a715-a5adb7362deb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1202 microversion: 2.1 time: 0.350862 Oct 05 18:03:54.049151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:54.049891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] [instance: b0c3807c-eb9a-4c1f-a519-b3d2c98ba866] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:54.057927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:54.064993 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2707/5153] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:53 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1202 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:54.066595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:54.067308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:54.068192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:54.068753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:54.069291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:54.100720 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] HTTP exception thrown: Instance b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 could not be found. Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Request method failure captured: Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 HTTP/1.1 Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcWqi4JjZoRKBDYbncFpKjxieQFvUhiEmLFT-TAFCYWtWkZIrNr1dN7zZifyX79gxvEg0kcXN5OTMmyJpztIfKnT7wuDN2uwjGu-OduJEJvWOop2zlIT_h3XUxyUU9A9LzaZ9CVxSfCojakJaJ9LVSrQZWNNSXAnHTDlXZZ8j9-noyM Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: dbe08ff0f6ae4de2b0f29978c2f82bd3 Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1665593778 Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/dbe08ff0f6ae4de2b0f29978c2f82bd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dbe08ff0f6ae4de2b0f29978c2f82bd3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_dbe08ff0f6ae4de2b0f29978c2f82bd3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/dbe08ff0f6ae4de2b0f29978c2f82bd3"}]}] Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-VolumesSnapshotTestJSON-1665593778 Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: dbe08ff0f6ae4de2b0f29978c2f82bd3 Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1665593778 Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-VolumesSnapshotTestJSON-1665593778-project Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 4892ca792aab4b2fafd3eea8188a706a Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-VolumesSnapshotTestJSON-1665593778-project Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 could not be found. Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'b0c3807c-eb9a-4c1f-a519-b3d2c98ba866'} Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 could not be found. Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 could not be found. Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:03:54.102606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:03:54.107998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:03:54.107998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:03:54.107998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:03:54.107998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:03:54.107998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:03:54.107998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 could not be found. Oct 05 18:03:54.107998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:03:54.107998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] Returning 404 to user: Instance b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:03:54.109650 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0137c98a-06f9-453e-a9e4-f2e47f9befc7 tempest-VolumesSnapshotTestJSON-1665593778 tempest-VolumesSnapshotTestJSON-1665593778-project] 10.222.0.70 "GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866" status: 404 len: 111 microversion: 2.1 time: 0.063593 Oct 05 18:03:54.111431 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2447/5154] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:54 2022] GET /compute/v2.1/servers/b0c3807c-eb9a-4c1f-a519-b3d2c98ba866 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:03:54.944187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4cb8a568-e414-4082-987b-53e2c436e564 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:54.945706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4cb8a568-e414-4082-987b-53e2c436e564 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:54.966034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cb8a568-e414-4082-987b-53e2c436e564 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:54.967036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cb8a568-e414-4082-987b-53e2c436e564 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:54.969135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cb8a568-e414-4082-987b-53e2c436e564 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:54.971421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cb8a568-e414-4082-987b-53e2c436e564 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:54.972664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cb8a568-e414-4082-987b-53e2c436e564 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:54.973291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4cb8a568-e414-4082-987b-53e2c436e564 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:55.075338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d12031b5-e6e3-4f5b-948a-f58c48344f1d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:55.075957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d12031b5-e6e3-4f5b-948a-f58c48344f1d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:55.089785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d12031b5-e6e3-4f5b-948a-f58c48344f1d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:55.092939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d12031b5-e6e3-4f5b-948a-f58c48344f1d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:55.093534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d12031b5-e6e3-4f5b-948a-f58c48344f1d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:55.095775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d12031b5-e6e3-4f5b-948a-f58c48344f1d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:55.097617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d12031b5-e6e3-4f5b-948a-f58c48344f1d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:55.098526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d12031b5-e6e3-4f5b-948a-f58c48344f1d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:55.349390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d12031b5-e6e3-4f5b-948a-f58c48344f1d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:55.367496 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d12031b5-e6e3-4f5b-948a-f58c48344f1d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1202 microversion: 2.1 time: 0.298468 Oct 05 18:03:55.383099 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2448/5155] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:55 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1202 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:55.389547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4cb8a568-e414-4082-987b-53e2c436e564 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:55.400281 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4cb8a568-e414-4082-987b-53e2c436e564 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1528 microversion: 2.1 time: 0.460773 Oct 05 18:03:55.402502 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2708/5156] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:54 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1528 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:55.658456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5bb225f5-ff5c-40e3-8fe4-7544b3afa009 req-7d97f43a-0eae-4744-b1fa-2bf4a7e154b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbd4073-50d6-4c67-8ee5-447f772298a0", "name": "network-vif-plugged", "status": "completed", "tag": "ea6385e4-12b8-44d1-94e9-c6103b6b8376"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:55.687022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5bb225f5-ff5c-40e3-8fe4-7544b3afa009 req-7d97f43a-0eae-4744-b1fa-2bf4a7e154b9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:55.694456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5bb225f5-ff5c-40e3-8fe4-7544b3afa009 req-7d97f43a-0eae-4744-b1fa-2bf4a7e154b9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:55.695058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5bb225f5-ff5c-40e3-8fe4-7544b3afa009 req-7d97f43a-0eae-4744-b1fa-2bf4a7e154b9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:55.739050 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5bb225f5-ff5c-40e3-8fe4-7544b3afa009 req-7d97f43a-0eae-4744-b1fa-2bf4a7e154b9 service nova] Creating event network-vif-plugged:ea6385e4-12b8-44d1-94e9-c6103b6b8376 for instance ccbd4073-50d6-4c67-8ee5-447f772298a0 on n-h1-835595-3 Oct 05 18:03:55.783045 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5bb225f5-ff5c-40e3-8fe4-7544b3afa009 req-7d97f43a-0eae-4744-b1fa-2bf4a7e154b9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124986 Oct 05 18:03:55.786554 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2449/5157] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:03:56.396445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a03a96e-cdf5-4fbe-9874-20616381ff60 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:56.397930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2a03a96e-cdf5-4fbe-9874-20616381ff60 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:56.423671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a03a96e-cdf5-4fbe-9874-20616381ff60 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:56.424247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a03a96e-cdf5-4fbe-9874-20616381ff60 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:56.427611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a03a96e-cdf5-4fbe-9874-20616381ff60 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:56.428043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a03a96e-cdf5-4fbe-9874-20616381ff60 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:56.428537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a03a96e-cdf5-4fbe-9874-20616381ff60 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:56.430381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a03a96e-cdf5-4fbe-9874-20616381ff60 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:56.431054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fe784f97-bef9-4164-9d7c-73cd0efe19d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:56.436049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fe784f97-bef9-4164-9d7c-73cd0efe19d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:56.466730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe784f97-bef9-4164-9d7c-73cd0efe19d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:56.467287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe784f97-bef9-4164-9d7c-73cd0efe19d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:56.468795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe784f97-bef9-4164-9d7c-73cd0efe19d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:56.469577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe784f97-bef9-4164-9d7c-73cd0efe19d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:56.470053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe784f97-bef9-4164-9d7c-73cd0efe19d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:56.475963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe784f97-bef9-4164-9d7c-73cd0efe19d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:56.836934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe784f97-bef9-4164-9d7c-73cd0efe19d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:56.856460 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fe784f97-bef9-4164-9d7c-73cd0efe19d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.427453 Oct 05 18:03:56.859076 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2450/5158] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:56 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:57.291431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2a03a96e-cdf5-4fbe-9874-20616381ff60 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:57.300246 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2a03a96e-cdf5-4fbe-9874-20616381ff60 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1202 microversion: 2.1 time: 0.909172 Oct 05 18:03:57.316737 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2709/5159] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:56 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1202 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:57.864626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c0d72c98-bf71-4e03-b6c0-29fa2129fad3 req-dbf81a40-3fbc-430f-8d42-7e5446381831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0555770d-5774-4f39-b4ad-3fa29ac7ba32", "name": "network-vif-plugged", "status": "completed", "tag": "4cf55f4f-324b-4fe1-82a3-d58ee09ee530"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:03:57.892502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-380d4cac-5911-4b87-9b72-bb1816b7adb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:57.893223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-380d4cac-5911-4b87-9b72-bb1816b7adb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:57.894810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c0d72c98-bf71-4e03-b6c0-29fa2129fad3 req-dbf81a40-3fbc-430f-8d42-7e5446381831 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:57.895351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c0d72c98-bf71-4e03-b6c0-29fa2129fad3 req-dbf81a40-3fbc-430f-8d42-7e5446381831 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:57.898021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c0d72c98-bf71-4e03-b6c0-29fa2129fad3 req-dbf81a40-3fbc-430f-8d42-7e5446381831 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:57.919337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380d4cac-5911-4b87-9b72-bb1816b7adb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:57.920481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380d4cac-5911-4b87-9b72-bb1816b7adb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:57.922232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380d4cac-5911-4b87-9b72-bb1816b7adb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:57.942682 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c0d72c98-bf71-4e03-b6c0-29fa2129fad3 req-dbf81a40-3fbc-430f-8d42-7e5446381831 service nova] Creating event network-vif-plugged:4cf55f4f-324b-4fe1-82a3-d58ee09ee530 for instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 on n-h2-835595-3 Oct 05 18:03:57.952303 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c0d72c98-bf71-4e03-b6c0-29fa2129fad3 req-dbf81a40-3fbc-430f-8d42-7e5446381831 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092375 Oct 05 18:03:57.956010 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2451/5160] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:03:57.962971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380d4cac-5911-4b87-9b72-bb1816b7adb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:57.964448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380d4cac-5911-4b87-9b72-bb1816b7adb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:57.969661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380d4cac-5911-4b87-9b72-bb1816b7adb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:58.333064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a8754d1-672b-4f78-b2d3-0fc0424b6f5f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:58.334351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a8754d1-672b-4f78-b2d3-0fc0424b6f5f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:58.349440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a8754d1-672b-4f78-b2d3-0fc0424b6f5f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:58.351011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a8754d1-672b-4f78-b2d3-0fc0424b6f5f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:58.351462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a8754d1-672b-4f78-b2d3-0fc0424b6f5f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:58.355152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a8754d1-672b-4f78-b2d3-0fc0424b6f5f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:58.355647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a8754d1-672b-4f78-b2d3-0fc0424b6f5f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:58.356178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a8754d1-672b-4f78-b2d3-0fc0424b6f5f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:58.529646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-380d4cac-5911-4b87-9b72-bb1816b7adb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:58.541091 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-380d4cac-5911-4b87-9b72-bb1816b7adb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.659695 Oct 05 18:03:58.544323 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2710/5161] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:57 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:03:58.799762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6a8754d1-672b-4f78-b2d3-0fc0424b6f5f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:03:58.819018 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a8754d1-672b-4f78-b2d3-0fc0424b6f5f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1202 microversion: 2.1 time: 0.490891 Oct 05 18:03:58.838680 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2452/5162] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:58 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1202 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:03:59.568355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-57b40a9f-f881-4467-922e-f9741b12800d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:59.569813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-57b40a9f-f881-4467-922e-f9741b12800d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:59.583404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b40a9f-f881-4467-922e-f9741b12800d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:59.595200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b40a9f-f881-4467-922e-f9741b12800d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:59.596705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b40a9f-f881-4467-922e-f9741b12800d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:59.602729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b40a9f-f881-4467-922e-f9741b12800d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:59.604195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b40a9f-f881-4467-922e-f9741b12800d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:59.607540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57b40a9f-f881-4467-922e-f9741b12800d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:59.846493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3053fb87-7094-46e9-86e2-08f7e201634b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:03:59.847278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3053fb87-7094-46e9-86e2-08f7e201634b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:03:59.860244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3053fb87-7094-46e9-86e2-08f7e201634b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:59.861094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3053fb87-7094-46e9-86e2-08f7e201634b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:59.861664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3053fb87-7094-46e9-86e2-08f7e201634b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:03:59.862530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3053fb87-7094-46e9-86e2-08f7e201634b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:03:59.866810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3053fb87-7094-46e9-86e2-08f7e201634b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:03:59.867357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3053fb87-7094-46e9-86e2-08f7e201634b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:00.202042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3053fb87-7094-46e9-86e2-08f7e201634b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:00.219383 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3053fb87-7094-46e9-86e2-08f7e201634b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1202 microversion: 2.1 time: 0.376975 Oct 05 18:04:00.223071 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2453/5163] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:59 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1202 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:00.353182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-57b40a9f-f881-4467-922e-f9741b12800d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:00.358914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:00.390906 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-57b40a9f-f881-4467-922e-f9741b12800d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.826577 Oct 05 18:04:00.391866 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2711/5164] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:03:59 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:01.249488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c565ddc6-e5cd-4105-8076-d97cbeab52f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:01.250333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c565ddc6-e5cd-4105-8076-d97cbeab52f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:01.261600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c565ddc6-e5cd-4105-8076-d97cbeab52f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:01.262037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c565ddc6-e5cd-4105-8076-d97cbeab52f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:01.306197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c565ddc6-e5cd-4105-8076-d97cbeab52f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:01.307045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c565ddc6-e5cd-4105-8076-d97cbeab52f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:01.315314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c565ddc6-e5cd-4105-8076-d97cbeab52f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:01.315853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c565ddc6-e5cd-4105-8076-d97cbeab52f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:01.414388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-31ccdb39-73fb-4d95-a88f-e821ed224f69 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:01.415789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-31ccdb39-73fb-4d95-a88f-e821ed224f69 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:01.429023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31ccdb39-73fb-4d95-a88f-e821ed224f69 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:01.430022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31ccdb39-73fb-4d95-a88f-e821ed224f69 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:01.431626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31ccdb39-73fb-4d95-a88f-e821ed224f69 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:01.437199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31ccdb39-73fb-4d95-a88f-e821ed224f69 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:01.438039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31ccdb39-73fb-4d95-a88f-e821ed224f69 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:01.438761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31ccdb39-73fb-4d95-a88f-e821ed224f69 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:01.821180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31ccdb39-73fb-4d95-a88f-e821ed224f69 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:01.847504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-31ccdb39-73fb-4d95-a88f-e821ed224f69 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.437584 Oct 05 18:04:01.851238 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2712/5165] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:01 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:01.904325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c565ddc6-e5cd-4105-8076-d97cbeab52f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:01.919298 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c565ddc6-e5cd-4105-8076-d97cbeab52f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1202 microversion: 2.1 time: 0.674219 Oct 05 18:04:01.921004 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2454/5166] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:01 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1202 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:02.886098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-515781e5-9fe4-44be-bda9-fd2386ea983c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:02.887088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-515781e5-9fe4-44be-bda9-fd2386ea983c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:02.906510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-515781e5-9fe4-44be-bda9-fd2386ea983c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:02.919613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-515781e5-9fe4-44be-bda9-fd2386ea983c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:02.920093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-515781e5-9fe4-44be-bda9-fd2386ea983c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:02.927174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-515781e5-9fe4-44be-bda9-fd2386ea983c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:02.933713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-515781e5-9fe4-44be-bda9-fd2386ea983c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:02.934201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-515781e5-9fe4-44be-bda9-fd2386ea983c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:02.951182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8d11e0a1-64f4-4071-9e6a-ff4689301674 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:02.951807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8d11e0a1-64f4-4071-9e6a-ff4689301674 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:02.968716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d11e0a1-64f4-4071-9e6a-ff4689301674 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:02.969236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d11e0a1-64f4-4071-9e6a-ff4689301674 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:02.982820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d11e0a1-64f4-4071-9e6a-ff4689301674 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:02.983595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d11e0a1-64f4-4071-9e6a-ff4689301674 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:02.984073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d11e0a1-64f4-4071-9e6a-ff4689301674 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:02.984556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d11e0a1-64f4-4071-9e6a-ff4689301674 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:03.424312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-515781e5-9fe4-44be-bda9-fd2386ea983c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:03.436691 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-515781e5-9fe4-44be-bda9-fd2386ea983c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.556667 Oct 05 18:04:03.439183 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2713/5167] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:02 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:03.750907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d11e0a1-64f4-4071-9e6a-ff4689301674 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:03.760813 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8d11e0a1-64f4-4071-9e6a-ff4689301674 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1202 microversion: 2.1 time: 0.818690 Oct 05 18:04:03.761408 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2455/5168] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:02 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1202 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:04.209600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e366d74b-3251-4fe4-94e9-24928e14d518 req-f2cc92fc-01ab-4420-b7f5-f1e9ece139f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51f5174-3b29-4512-a2c1-40f69f17e0a2", "name": "network-vif-plugged", "status": "completed", "tag": "9e63a8ee-0e56-4769-a839-b2029d871fd8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:04.228295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e366d74b-3251-4fe4-94e9-24928e14d518 req-f2cc92fc-01ab-4420-b7f5-f1e9ece139f5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:04.246756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e366d74b-3251-4fe4-94e9-24928e14d518 req-f2cc92fc-01ab-4420-b7f5-f1e9ece139f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:04.251750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e366d74b-3251-4fe4-94e9-24928e14d518 req-f2cc92fc-01ab-4420-b7f5-f1e9ece139f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:04.303793 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e366d74b-3251-4fe4-94e9-24928e14d518 req-f2cc92fc-01ab-4420-b7f5-f1e9ece139f5 service nova] Creating event network-vif-plugged:9e63a8ee-0e56-4769-a839-b2029d871fd8 for instance c51f5174-3b29-4512-a2c1-40f69f17e0a2 on n-h1-835595-3 Oct 05 18:04:04.324297 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e366d74b-3251-4fe4-94e9-24928e14d518 req-f2cc92fc-01ab-4420-b7f5-f1e9ece139f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118522 Oct 05 18:04:04.328005 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2714/5169] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:04.473249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a0ca67d9-09cf-40d1-a6f8-bd4abc9e0a87 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:04.474662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a0ca67d9-09cf-40d1-a6f8-bd4abc9e0a87 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:04.525072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ca67d9-09cf-40d1-a6f8-bd4abc9e0a87 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:04.526923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ca67d9-09cf-40d1-a6f8-bd4abc9e0a87 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:04.533382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ca67d9-09cf-40d1-a6f8-bd4abc9e0a87 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:04.543333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ca67d9-09cf-40d1-a6f8-bd4abc9e0a87 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:04.550880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ca67d9-09cf-40d1-a6f8-bd4abc9e0a87 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:04.553904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0ca67d9-09cf-40d1-a6f8-bd4abc9e0a87 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:04.797060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2ca2037-de9a-4778-a164-adcf75126bbf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:04.798003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b2ca2037-de9a-4778-a164-adcf75126bbf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:04.831104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ca2037-de9a-4778-a164-adcf75126bbf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:04.845922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ca2037-de9a-4778-a164-adcf75126bbf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:04.847116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ca2037-de9a-4778-a164-adcf75126bbf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:04.856238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ca2037-de9a-4778-a164-adcf75126bbf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:04.857548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ca2037-de9a-4778-a164-adcf75126bbf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:04.862174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2ca2037-de9a-4778-a164-adcf75126bbf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:05.421259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0ca67d9-09cf-40d1-a6f8-bd4abc9e0a87 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:05.448783 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a0ca67d9-09cf-40d1-a6f8-bd4abc9e0a87 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.989667 Oct 05 18:04:05.453092 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2456/5170] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:04 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:05.894130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b2ca2037-de9a-4778-a164-adcf75126bbf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:05.907907 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2ca2037-de9a-4778-a164-adcf75126bbf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1202 microversion: 2.1 time: 1.124219 Oct 05 18:04:05.912404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2715/5171] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:04 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1202 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:06.479685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dd6ba8e3-998d-465d-94cd-d976532638bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:06.481520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dd6ba8e3-998d-465d-94cd-d976532638bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:06.514526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd6ba8e3-998d-465d-94cd-d976532638bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:06.515763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd6ba8e3-998d-465d-94cd-d976532638bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:06.516956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd6ba8e3-998d-465d-94cd-d976532638bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:06.518087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd6ba8e3-998d-465d-94cd-d976532638bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:06.518770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd6ba8e3-998d-465d-94cd-d976532638bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:06.519614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd6ba8e3-998d-465d-94cd-d976532638bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:06.941702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3db5dd6d-39e3-41b9-a0e0-e1c32630cdaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:06.943105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3db5dd6d-39e3-41b9-a0e0-e1c32630cdaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:06.954539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=71 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:06.963491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3db5dd6d-39e3-41b9-a0e0-e1c32630cdaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:06.968228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3db5dd6d-39e3-41b9-a0e0-e1c32630cdaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:06.970167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3db5dd6d-39e3-41b9-a0e0-e1c32630cdaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:06.972624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3db5dd6d-39e3-41b9-a0e0-e1c32630cdaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:06.973321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3db5dd6d-39e3-41b9-a0e0-e1c32630cdaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:06.979386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3db5dd6d-39e3-41b9-a0e0-e1c32630cdaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:07.441693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3db5dd6d-39e3-41b9-a0e0-e1c32630cdaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:07.455454 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3db5dd6d-39e3-41b9-a0e0-e1c32630cdaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1388 microversion: 2.1 time: 0.519541 Oct 05 18:04:07.456925 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2716/5172] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:06 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1388 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:07.488304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-14b7ef1b-b9c6-47e0-8193-0dcea40192d7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:07.490592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-14b7ef1b-b9c6-47e0-8193-0dcea40192d7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:07.505109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b7ef1b-b9c6-47e0-8193-0dcea40192d7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:07.505869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b7ef1b-b9c6-47e0-8193-0dcea40192d7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:07.506713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b7ef1b-b9c6-47e0-8193-0dcea40192d7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:07.507771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b7ef1b-b9c6-47e0-8193-0dcea40192d7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:07.508961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b7ef1b-b9c6-47e0-8193-0dcea40192d7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:07.509854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-14b7ef1b-b9c6-47e0-8193-0dcea40192d7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:07.642264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dd6ba8e3-998d-465d-94cd-d976532638bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:07.652308 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dd6ba8e3-998d-465d-94cd-d976532638bf tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 1.180041 Oct 05 18:04:07.661262 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2457/5173] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:06 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:07.842062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-14b7ef1b-b9c6-47e0-8193-0dcea40192d7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:07.852501 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-14b7ef1b-b9c6-47e0-8193-0dcea40192d7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1388 microversion: 2.1 time: 0.373049 Oct 05 18:04:07.853518 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2717/5174] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:07 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1388 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:07.891741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4ae7a82a-1496-436f-a596-66f878d499f2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:07.892956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4ae7a82a-1496-436f-a596-66f878d499f2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:07.912219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ae7a82a-1496-436f-a596-66f878d499f2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:07.916368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ae7a82a-1496-436f-a596-66f878d499f2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:07.917131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ae7a82a-1496-436f-a596-66f878d499f2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:07.918189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ae7a82a-1496-436f-a596-66f878d499f2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:07.918969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ae7a82a-1496-436f-a596-66f878d499f2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:07.920385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ae7a82a-1496-436f-a596-66f878d499f2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:08.693959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a5bfcff2-621d-4e5d-b991-6765d7f101aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:08.695082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a5bfcff2-621d-4e5d-b991-6765d7f101aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:08.718388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5bfcff2-621d-4e5d-b991-6765d7f101aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:08.719202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5bfcff2-621d-4e5d-b991-6765d7f101aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:08.721771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5bfcff2-621d-4e5d-b991-6765d7f101aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:08.724893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5bfcff2-621d-4e5d-b991-6765d7f101aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:08.729551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5bfcff2-621d-4e5d-b991-6765d7f101aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:08.730414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5bfcff2-621d-4e5d-b991-6765d7f101aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:08.960615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4ae7a82a-1496-436f-a596-66f878d499f2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:08.969114 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4ae7a82a-1496-436f-a596-66f878d499f2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1388 microversion: 2.1 time: 1.081629 Oct 05 18:04:08.976753 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2458/5175] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:07 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1388 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:08.997984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e27f917-7b82-4d59-8981-93d5a3e4287a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:08.998858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e27f917-7b82-4d59-8981-93d5a3e4287a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:09.022142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e27f917-7b82-4d59-8981-93d5a3e4287a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:09.022142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e27f917-7b82-4d59-8981-93d5a3e4287a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:09.022142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e27f917-7b82-4d59-8981-93d5a3e4287a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:09.022142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e27f917-7b82-4d59-8981-93d5a3e4287a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:09.022142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e27f917-7b82-4d59-8981-93d5a3e4287a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:09.022142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e27f917-7b82-4d59-8981-93d5a3e4287a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:09.084804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e27f917-7b82-4d59-8981-93d5a3e4287a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:04:09.128681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a5bfcff2-621d-4e5d-b991-6765d7f101aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:09.137520 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a5bfcff2-621d-4e5d-b991-6765d7f101aa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.450840 Oct 05 18:04:09.143038 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2718/5176] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:08 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:09.444827 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8e27f917-7b82-4d59-8981-93d5a3e4287a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 204 len: 0 microversion: 2.1 time: 0.451185 Oct 05 18:04:09.456732 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2459/5177] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:04:08 2022] DELETE /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 18:04:09.467190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-61fca5f7-f992-4ee0-9a33-fb3c145fa963 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:09.467824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-61fca5f7-f992-4ee0-9a33-fb3c145fa963 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:09.499870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fca5f7-f992-4ee0-9a33-fb3c145fa963 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:09.500409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fca5f7-f992-4ee0-9a33-fb3c145fa963 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:09.502750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fca5f7-f992-4ee0-9a33-fb3c145fa963 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:09.509790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fca5f7-f992-4ee0-9a33-fb3c145fa963 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:09.510698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fca5f7-f992-4ee0-9a33-fb3c145fa963 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:09.514889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61fca5f7-f992-4ee0-9a33-fb3c145fa963 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:10.192276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d15701d3-4c06-4439-b6d2-210b2751f8eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:10.194295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d15701d3-4c06-4439-b6d2-210b2751f8eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:10.239796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d15701d3-4c06-4439-b6d2-210b2751f8eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:10.243014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d15701d3-4c06-4439-b6d2-210b2751f8eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:10.243486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d15701d3-4c06-4439-b6d2-210b2751f8eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:10.244249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d15701d3-4c06-4439-b6d2-210b2751f8eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:10.247293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d15701d3-4c06-4439-b6d2-210b2751f8eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:10.247758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d15701d3-4c06-4439-b6d2-210b2751f8eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:10.630706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d15701d3-4c06-4439-b6d2-210b2751f8eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:10.648814 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d15701d3-4c06-4439-b6d2-210b2751f8eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.480969 Oct 05 18:04:10.684692 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2460/5178] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:10 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:10.743922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-61fca5f7-f992-4ee0-9a33-fb3c145fa963 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:10.761615 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-61fca5f7-f992-4ee0-9a33-fb3c145fa963 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1394 microversion: 2.1 time: 1.303501 Oct 05 18:04:10.764242 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2719/5179] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:09 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1394 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:11.471206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-283198359", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "31f751aa-c1b6-4ea8-aca1-484b51a4135c"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:11.480966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:11.623486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] validate_networks() for [('31f751aa-c1b6-4ea8-aca1-484b51a4135c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:04:11.689685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-709f02a3-d6e8-4c7f-85d3-5ea2a0cdf9f4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:11.690793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-709f02a3-d6e8-4c7f-85d3-5ea2a0cdf9f4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:11.700406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-709f02a3-d6e8-4c7f-85d3-5ea2a0cdf9f4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:11.706347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-709f02a3-d6e8-4c7f-85d3-5ea2a0cdf9f4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:11.715869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-709f02a3-d6e8-4c7f-85d3-5ea2a0cdf9f4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:11.718403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-709f02a3-d6e8-4c7f-85d3-5ea2a0cdf9f4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:11.723290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-709f02a3-d6e8-4c7f-85d3-5ea2a0cdf9f4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:11.725641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-709f02a3-d6e8-4c7f-85d3-5ea2a0cdf9f4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:12.466789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-709f02a3-d6e8-4c7f-85d3-5ea2a0cdf9f4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:12.487744 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-709f02a3-d6e8-4c7f-85d3-5ea2a0cdf9f4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.803330 Oct 05 18:04:12.488387 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2720/5180] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:11 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:12.525975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-509cc679-c787-4bec-9529-a8f5009e9316 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:12.526628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-509cc679-c787-4bec-9529-a8f5009e9316 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:12.577115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-509cc679-c787-4bec-9529-a8f5009e9316 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:12.577611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-509cc679-c787-4bec-9529-a8f5009e9316 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:12.578030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-509cc679-c787-4bec-9529-a8f5009e9316 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:12.578835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-509cc679-c787-4bec-9529-a8f5009e9316 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:12.579293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-509cc679-c787-4bec-9529-a8f5009e9316 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:12.579719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-509cc679-c787-4bec-9529-a8f5009e9316 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:12.791480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-509cc679-c787-4bec-9529-a8f5009e9316 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:12.808428 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-509cc679-c787-4bec-9529-a8f5009e9316 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1352 microversion: 2.1 time: 0.307265 Oct 05 18:04:12.811073 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2721/5181] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:12 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1352 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:13.049744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5ec67805-22d7-4b93-894b-03b64b0e7215 req-4ce00d46-454c-40b3-99b3-eb0e796f6bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c51f5174-3b29-4512-a2c1-40f69f17e0a2", "name": "network-vif-deleted", "tag": "9e63a8ee-0e56-4769-a839-b2029d871fd8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:13.081093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ec67805-22d7-4b93-894b-03b64b0e7215 req-4ce00d46-454c-40b3-99b3-eb0e796f6bc3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:13.085020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ec67805-22d7-4b93-894b-03b64b0e7215 req-4ce00d46-454c-40b3-99b3-eb0e796f6bc3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:13.087112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ec67805-22d7-4b93-894b-03b64b0e7215 req-4ce00d46-454c-40b3-99b3-eb0e796f6bc3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:13.133344 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5ec67805-22d7-4b93-894b-03b64b0e7215 req-4ce00d46-454c-40b3-99b3-eb0e796f6bc3 service nova] Creating event network-vif-deleted:9e63a8ee-0e56-4769-a839-b2029d871fd8 for instance c51f5174-3b29-4512-a2c1-40f69f17e0a2 on n-h1-835595-3 Oct 05 18:04:13.151254 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5ec67805-22d7-4b93-894b-03b64b0e7215 req-4ce00d46-454c-40b3-99b3-eb0e796f6bc3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105126 Oct 05 18:04:13.162434 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2722/5182] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:04:13.494813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:04:13.494813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:04:13.495363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:04:13.495698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:04:13.496325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:04:13.519408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-166369b1-3beb-4818-9735-336192f9377d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:13.520189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-166369b1-3beb-4818-9735-336192f9377d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:13.536113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:13.536690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:13.539214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-166369b1-3beb-4818-9735-336192f9377d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:13.542254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:13.544053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:13.545806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:13.548850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-166369b1-3beb-4818-9735-336192f9377d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:13.549736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:13.550759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-166369b1-3beb-4818-9735-336192f9377d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:13.554211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-166369b1-3beb-4818-9735-336192f9377d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:13.555008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-166369b1-3beb-4818-9735-336192f9377d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:13.559185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-166369b1-3beb-4818-9735-336192f9377d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:13.648093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Getting quotas for project c6a9a279da9349f7a7c130855591e99d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:04:13.676667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Getting quotas for user a7606296b7564e2b9ab5b9d1dbe5996d and project c6a9a279da9349f7a7c130855591e99d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:04:13.716693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:04:13.719155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:04:13.819871 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-be9608ea-076e-4d01-ae36-a4bf834134df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.127791 Oct 05 18:04:13.821377 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2461/5183] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:04:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 3136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:04:13.837506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-795de1b3-4840-463d-9f2b-9ea0635f9628 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:13.838863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-795de1b3-4840-463d-9f2b-9ea0635f9628 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:14.022488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-795de1b3-4840-463d-9f2b-9ea0635f9628 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:14.032570 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-795de1b3-4840-463d-9f2b-9ea0635f9628 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1213 microversion: 2.1 time: 0.198652 Oct 05 18:04:14.035104 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2462/5184] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:13 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1213 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:14.047079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ec418b5d-77f2-437a-9615-7323d06cd4e5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:14.049934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ec418b5d-77f2-437a-9615-7323d06cd4e5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:14.066854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec418b5d-77f2-437a-9615-7323d06cd4e5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:14.067568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec418b5d-77f2-437a-9615-7323d06cd4e5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:14.069324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec418b5d-77f2-437a-9615-7323d06cd4e5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:14.071446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec418b5d-77f2-437a-9615-7323d06cd4e5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:14.072139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec418b5d-77f2-437a-9615-7323d06cd4e5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:14.073317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ec418b5d-77f2-437a-9615-7323d06cd4e5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:14.277945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-166369b1-3beb-4818-9735-336192f9377d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:14.293168 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-166369b1-3beb-4818-9735-336192f9377d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.779221 Oct 05 18:04:14.307104 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2723/5185] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:13 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:14.362226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ec418b5d-77f2-437a-9615-7323d06cd4e5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:14.373470 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ec418b5d-77f2-437a-9615-7323d06cd4e5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1187 microversion: 2.1 time: 0.336083 Oct 05 18:04:14.379291 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2463/5186] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:14 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1187 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:15.064426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1127d38-f6b2-4579-bb21-bb0ab789e85d tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:15.065406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f1127d38-f6b2-4579-bb21-bb0ab789e85d tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:15.263296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f1127d38-f6b2-4579-bb21-bb0ab789e85d tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:15.274068 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f1127d38-f6b2-4579-bb21-bb0ab789e85d tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1213 microversion: 2.1 time: 0.212007 Oct 05 18:04:15.278200 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2724/5187] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:15 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1213 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:15.329060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-06ec0f46-7260-4fa8-9203-34b4bdd1d38b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:15.330850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-06ec0f46-7260-4fa8-9203-34b4bdd1d38b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:15.359791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06ec0f46-7260-4fa8-9203-34b4bdd1d38b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:15.361573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06ec0f46-7260-4fa8-9203-34b4bdd1d38b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:15.363167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06ec0f46-7260-4fa8-9203-34b4bdd1d38b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:15.364726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06ec0f46-7260-4fa8-9203-34b4bdd1d38b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:15.369382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06ec0f46-7260-4fa8-9203-34b4bdd1d38b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:15.370188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06ec0f46-7260-4fa8-9203-34b4bdd1d38b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:15.396583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:15.420900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ba259fe1-8def-4f39-874a-218bc15276e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:15.425039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ba259fe1-8def-4f39-874a-218bc15276e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:15.525668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba259fe1-8def-4f39-874a-218bc15276e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:15.526734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba259fe1-8def-4f39-874a-218bc15276e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:15.527437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba259fe1-8def-4f39-874a-218bc15276e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:15.528438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba259fe1-8def-4f39-874a-218bc15276e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:15.533412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba259fe1-8def-4f39-874a-218bc15276e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:15.534171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba259fe1-8def-4f39-874a-218bc15276e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:16.073629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-06ec0f46-7260-4fa8-9203-34b4bdd1d38b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:16.085777 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-06ec0f46-7260-4fa8-9203-34b4bdd1d38b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.765088 Oct 05 18:04:16.094966 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2464/5188] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:15 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:16.308976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-515f8a03-7a85-491d-93f1-905a741fd732 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:16.310270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-515f8a03-7a85-491d-93f1-905a741fd732 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:16.371649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba259fe1-8def-4f39-874a-218bc15276e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:16.381037 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ba259fe1-8def-4f39-874a-218bc15276e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1187 microversion: 2.1 time: 0.971639 Oct 05 18:04:16.384664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-515f8a03-7a85-491d-93f1-905a741fd732 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:16.385932 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2725/5189] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:15 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1187 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:16.391333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-515f8a03-7a85-491d-93f1-905a741fd732 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:16.400097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-515f8a03-7a85-491d-93f1-905a741fd732 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:16.408474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-515f8a03-7a85-491d-93f1-905a741fd732 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:16.410029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-515f8a03-7a85-491d-93f1-905a741fd732 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:16.412494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-515f8a03-7a85-491d-93f1-905a741fd732 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:16.788521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-515f8a03-7a85-491d-93f1-905a741fd732 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:16.839265 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-515f8a03-7a85-491d-93f1-905a741fd732 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1265 microversion: 2.1 time: 0.543277 Oct 05 18:04:16.846970 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2465/5190] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:16 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1265 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:17.119588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4db82f6b-86ae-4e20-a4f0-54963bef1bb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:17.120479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4db82f6b-86ae-4e20-a4f0-54963bef1bb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:17.136033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4db82f6b-86ae-4e20-a4f0-54963bef1bb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:17.147255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4db82f6b-86ae-4e20-a4f0-54963bef1bb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:17.151214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4db82f6b-86ae-4e20-a4f0-54963bef1bb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:17.152182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4db82f6b-86ae-4e20-a4f0-54963bef1bb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:17.160421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4db82f6b-86ae-4e20-a4f0-54963bef1bb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:17.161250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4db82f6b-86ae-4e20-a4f0-54963bef1bb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:17.440369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7de08e55-2eba-4617-be48-d17e0a6752cf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:17.441356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7de08e55-2eba-4617-be48-d17e0a6752cf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:17.467920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7de08e55-2eba-4617-be48-d17e0a6752cf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:17.471742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7de08e55-2eba-4617-be48-d17e0a6752cf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:17.472493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7de08e55-2eba-4617-be48-d17e0a6752cf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:17.473350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7de08e55-2eba-4617-be48-d17e0a6752cf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:17.473970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7de08e55-2eba-4617-be48-d17e0a6752cf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:17.474523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7de08e55-2eba-4617-be48-d17e0a6752cf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:17.674700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7de08e55-2eba-4617-be48-d17e0a6752cf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:17.688671 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7de08e55-2eba-4617-be48-d17e0a6752cf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1187 microversion: 2.1 time: 0.260426 Oct 05 18:04:17.690155 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2466/5191] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:17 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1187 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:17.713467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4db82f6b-86ae-4e20-a4f0-54963bef1bb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:17.731603 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4db82f6b-86ae-4e20-a4f0-54963bef1bb8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.612118 Oct 05 18:04:17.742387 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2726/5192] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:17 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:17.869576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b7fee447-9779-475c-8b68-0d6de21e4a7b tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:17.870638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b7fee447-9779-475c-8b68-0d6de21e4a7b tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:17.885426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7fee447-9779-475c-8b68-0d6de21e4a7b tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:17.887513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7fee447-9779-475c-8b68-0d6de21e4a7b tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:17.893733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7fee447-9779-475c-8b68-0d6de21e4a7b tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:17.898454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7fee447-9779-475c-8b68-0d6de21e4a7b tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:17.900394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7fee447-9779-475c-8b68-0d6de21e4a7b tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:17.903614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7fee447-9779-475c-8b68-0d6de21e4a7b tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:18.068124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7fee447-9779-475c-8b68-0d6de21e4a7b tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:18.081078 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b7fee447-9779-475c-8b68-0d6de21e4a7b tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1271 microversion: 2.1 time: 0.215594 Oct 05 18:04:18.083647 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2467/5193] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:17 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:18.717908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-55178f64-f913-489c-b1cd-321ddeb6c2c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:18.719752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-55178f64-f913-489c-b1cd-321ddeb6c2c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:18.735644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55178f64-f913-489c-b1cd-321ddeb6c2c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:18.738740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55178f64-f913-489c-b1cd-321ddeb6c2c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:18.740424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55178f64-f913-489c-b1cd-321ddeb6c2c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:18.751737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55178f64-f913-489c-b1cd-321ddeb6c2c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:18.753113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55178f64-f913-489c-b1cd-321ddeb6c2c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:18.762346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-06c72c22-fab2-4af0-8682-1de32ec0c967 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:18.764528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-06c72c22-fab2-4af0-8682-1de32ec0c967 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:18.770953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55178f64-f913-489c-b1cd-321ddeb6c2c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:18.815447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06c72c22-fab2-4af0-8682-1de32ec0c967 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:18.817233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06c72c22-fab2-4af0-8682-1de32ec0c967 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:18.818814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06c72c22-fab2-4af0-8682-1de32ec0c967 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:18.822503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06c72c22-fab2-4af0-8682-1de32ec0c967 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:18.825307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06c72c22-fab2-4af0-8682-1de32ec0c967 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:18.828520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06c72c22-fab2-4af0-8682-1de32ec0c967 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:19.077856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-55178f64-f913-489c-b1cd-321ddeb6c2c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:19.119850 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-55178f64-f913-489c-b1cd-321ddeb6c2c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1187 microversion: 2.1 time: 0.407231 Oct 05 18:04:19.121368 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2727/5194] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:18 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1187 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:19.137203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-128aa75d-92ff-49a5-8e95-47345b57eaf2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:19.140125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-128aa75d-92ff-49a5-8e95-47345b57eaf2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:19.151724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-06c72c22-fab2-4af0-8682-1de32ec0c967 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:19.161594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-128aa75d-92ff-49a5-8e95-47345b57eaf2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:19.164719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-128aa75d-92ff-49a5-8e95-47345b57eaf2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:19.165546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-128aa75d-92ff-49a5-8e95-47345b57eaf2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:19.166200 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-06c72c22-fab2-4af0-8682-1de32ec0c967 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.407647 Oct 05 18:04:19.166352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-128aa75d-92ff-49a5-8e95-47345b57eaf2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:19.166753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-128aa75d-92ff-49a5-8e95-47345b57eaf2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:19.167184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-128aa75d-92ff-49a5-8e95-47345b57eaf2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:19.174793 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2468/5195] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:18 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:19.331334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-128aa75d-92ff-49a5-8e95-47345b57eaf2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:19.344815 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-128aa75d-92ff-49a5-8e95-47345b57eaf2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1271 microversion: 2.1 time: 0.222059 Oct 05 18:04:19.355003 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2728/5196] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:19 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1271 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:19.920735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da638388-9687-462a-91a7-0f0c676d3772 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:19.923547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da638388-9687-462a-91a7-0f0c676d3772 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:19.959039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da638388-9687-462a-91a7-0f0c676d3772 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:19.959551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da638388-9687-462a-91a7-0f0c676d3772 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:19.984548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da638388-9687-462a-91a7-0f0c676d3772 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:19.988100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da638388-9687-462a-91a7-0f0c676d3772 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:19.991894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da638388-9687-462a-91a7-0f0c676d3772 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:19.995827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da638388-9687-462a-91a7-0f0c676d3772 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:20.148656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4b92af09-b7f7-4112-9a4e-85dcba30069c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:20.149395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4b92af09-b7f7-4112-9a4e-85dcba30069c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:20.170559 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da638388-9687-462a-91a7-0f0c676d3772 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "POST /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0/action" status: 200 len: 24564 microversion: 2.1 time: 0.256403 Oct 05 18:04:20.171621 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2469/5197] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:04:19 2022] POST /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0/action => generated 24564 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:04:20.177415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b92af09-b7f7-4112-9a4e-85dcba30069c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:20.178124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b92af09-b7f7-4112-9a4e-85dcba30069c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:20.181206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b92af09-b7f7-4112-9a4e-85dcba30069c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:20.187283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b92af09-b7f7-4112-9a4e-85dcba30069c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:20.191325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b92af09-b7f7-4112-9a4e-85dcba30069c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:20.192087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b92af09-b7f7-4112-9a4e-85dcba30069c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:20.208206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a4b69a3c-f557-4b20-ab01-9198708034eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:20.209135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a4b69a3c-f557-4b20-ab01-9198708034eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:20.229684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4b69a3c-f557-4b20-ab01-9198708034eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:20.230552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4b69a3c-f557-4b20-ab01-9198708034eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:20.231236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4b69a3c-f557-4b20-ab01-9198708034eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:20.232122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4b69a3c-f557-4b20-ab01-9198708034eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:20.232758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4b69a3c-f557-4b20-ab01-9198708034eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:20.233354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4b69a3c-f557-4b20-ab01-9198708034eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:20.758038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a4b69a3c-f557-4b20-ab01-9198708034eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:20.766529 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a4b69a3c-f557-4b20-ab01-9198708034eb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.562820 Oct 05 18:04:20.774661 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2470/5198] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:20 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:20.788574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9adbf51-1894-49f3-a402-d7a1c498b313 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:20.789215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a9adbf51-1894-49f3-a402-d7a1c498b313 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:20.810659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9adbf51-1894-49f3-a402-d7a1c498b313 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:20.811156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9adbf51-1894-49f3-a402-d7a1c498b313 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:20.811594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9adbf51-1894-49f3-a402-d7a1c498b313 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:20.812315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9adbf51-1894-49f3-a402-d7a1c498b313 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:20.812773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9adbf51-1894-49f3-a402-d7a1c498b313 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:20.813200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9adbf51-1894-49f3-a402-d7a1c498b313 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:20.831896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4b92af09-b7f7-4112-9a4e-85dcba30069c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:20.847338 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4b92af09-b7f7-4112-9a4e-85dcba30069c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1187 microversion: 2.1 time: 0.703974 Oct 05 18:04:20.850430 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2729/5199] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:20 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1187 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:21.262684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a9adbf51-1894-49f3-a402-d7a1c498b313 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:21.277774 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a9adbf51-1894-49f3-a402-d7a1c498b313 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1313 microversion: 2.1 time: 0.501796 Oct 05 18:04:21.297820 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2471/5200] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:20 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1313 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:21.577751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-0eac93f5-f678-4cfe-85fe-ea10994f862d req-9a6d5be2-ade9-4365-a27c-1ac598ef94c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f3443bc-76be-4645-8f88-da00a65d4ea6", "tag": "78dd1c33-cdd3-42c0-b7d4-d60054df4fc9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:21.625641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0eac93f5-f678-4cfe-85fe-ea10994f862d req-9a6d5be2-ade9-4365-a27c-1ac598ef94c6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:21.626888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0eac93f5-f678-4cfe-85fe-ea10994f862d req-9a6d5be2-ade9-4365-a27c-1ac598ef94c6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:21.627409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0eac93f5-f678-4cfe-85fe-ea10994f862d req-9a6d5be2-ade9-4365-a27c-1ac598ef94c6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:21.724000 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-0eac93f5-f678-4cfe-85fe-ea10994f862d req-9a6d5be2-ade9-4365-a27c-1ac598ef94c6 service nova] Creating event network-changed:78dd1c33-cdd3-42c0-b7d4-d60054df4fc9 for instance 7f3443bc-76be-4645-8f88-da00a65d4ea6 on n-h2-835595-3 Oct 05 18:04:21.738601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-0eac93f5-f678-4cfe-85fe-ea10994f862d req-9a6d5be2-ade9-4365-a27c-1ac598ef94c6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164728 Oct 05 18:04:21.744792 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2730/5201] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:21.792449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a81d995b-6959-4947-a6d1-088465c269c2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:21.793368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a81d995b-6959-4947-a6d1-088465c269c2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:21.809519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81d995b-6959-4947-a6d1-088465c269c2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:21.816220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81d995b-6959-4947-a6d1-088465c269c2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:21.818902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81d995b-6959-4947-a6d1-088465c269c2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:21.821072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81d995b-6959-4947-a6d1-088465c269c2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:21.824104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81d995b-6959-4947-a6d1-088465c269c2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:21.827777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a81d995b-6959-4947-a6d1-088465c269c2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:21.879502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-da9637ef-5bc9-47b8-9566-e58207afc3de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:21.880670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-da9637ef-5bc9-47b8-9566-e58207afc3de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:21.919282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da9637ef-5bc9-47b8-9566-e58207afc3de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:21.924492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da9637ef-5bc9-47b8-9566-e58207afc3de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:21.928779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da9637ef-5bc9-47b8-9566-e58207afc3de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:21.929840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da9637ef-5bc9-47b8-9566-e58207afc3de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:21.934918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da9637ef-5bc9-47b8-9566-e58207afc3de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:21.938131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-da9637ef-5bc9-47b8-9566-e58207afc3de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:22.037389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:22.176510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a81d995b-6959-4947-a6d1-088465c269c2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:22.198096 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a81d995b-6959-4947-a6d1-088465c269c2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.402472 Oct 05 18:04:22.199156 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2472/5202] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:21 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:22.305353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bfdebf4d-3b17-4325-b2e9-6fbc707c6de2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:22.307849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bfdebf4d-3b17-4325-b2e9-6fbc707c6de2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:22.336450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfdebf4d-3b17-4325-b2e9-6fbc707c6de2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:22.339271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfdebf4d-3b17-4325-b2e9-6fbc707c6de2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:22.344443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfdebf4d-3b17-4325-b2e9-6fbc707c6de2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:22.349661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfdebf4d-3b17-4325-b2e9-6fbc707c6de2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:22.351731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfdebf4d-3b17-4325-b2e9-6fbc707c6de2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:22.354929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfdebf4d-3b17-4325-b2e9-6fbc707c6de2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:22.867596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-da9637ef-5bc9-47b8-9566-e58207afc3de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:22.888185 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-da9637ef-5bc9-47b8-9566-e58207afc3de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1187 microversion: 2.1 time: 1.014662 Oct 05 18:04:22.889543 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2731/5203] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:21 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1187 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:22.986884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bfdebf4d-3b17-4325-b2e9-6fbc707c6de2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:23.002480 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bfdebf4d-3b17-4325-b2e9-6fbc707c6de2 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1313 microversion: 2.1 time: 0.701323 Oct 05 18:04:23.008899 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2473/5204] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:22 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1313 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:23.223805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c10c3312-954c-452c-a67f-826a419f7b8d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:23.225015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c10c3312-954c-452c-a67f-826a419f7b8d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:23.244360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c10c3312-954c-452c-a67f-826a419f7b8d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:23.246216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c10c3312-954c-452c-a67f-826a419f7b8d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:23.247019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c10c3312-954c-452c-a67f-826a419f7b8d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:23.249119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c10c3312-954c-452c-a67f-826a419f7b8d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:23.250246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c10c3312-954c-452c-a67f-826a419f7b8d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:23.266424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c10c3312-954c-452c-a67f-826a419f7b8d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:23.731252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c10c3312-954c-452c-a67f-826a419f7b8d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:23.743366 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c10c3312-954c-452c-a67f-826a419f7b8d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.525176 Oct 05 18:04:23.781568 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2732/5205] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:23 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:23.914353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-84f3c5b3-e739-4aba-b3d9-8fe082bfbeed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:23.915086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-84f3c5b3-e739-4aba-b3d9-8fe082bfbeed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:23.935343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:23.949288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84f3c5b3-e739-4aba-b3d9-8fe082bfbeed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:23.949892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84f3c5b3-e739-4aba-b3d9-8fe082bfbeed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:23.953197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84f3c5b3-e739-4aba-b3d9-8fe082bfbeed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:23.954052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84f3c5b3-e739-4aba-b3d9-8fe082bfbeed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:23.956430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84f3c5b3-e739-4aba-b3d9-8fe082bfbeed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:23.957049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84f3c5b3-e739-4aba-b3d9-8fe082bfbeed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:24.035458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8d736052-ad65-436b-ae1c-90f7730158fa tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:24.036118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8d736052-ad65-436b-ae1c-90f7730158fa tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:24.047552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:24.053186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d736052-ad65-436b-ae1c-90f7730158fa tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:24.053727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d736052-ad65-436b-ae1c-90f7730158fa tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:24.059117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d736052-ad65-436b-ae1c-90f7730158fa tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:24.061486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d736052-ad65-436b-ae1c-90f7730158fa tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:24.061486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d736052-ad65-436b-ae1c-90f7730158fa tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:24.069092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d736052-ad65-436b-ae1c-90f7730158fa tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:24.326569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8d736052-ad65-436b-ae1c-90f7730158fa tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:24.338577 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8d736052-ad65-436b-ae1c-90f7730158fa tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1313 microversion: 2.1 time: 0.306518 Oct 05 18:04:24.339511 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2733/5206] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:24 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:24.390731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-84f3c5b3-e739-4aba-b3d9-8fe082bfbeed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:24.411434 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-84f3c5b3-e739-4aba-b3d9-8fe082bfbeed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 200 len: 1187 microversion: 2.1 time: 0.501040 Oct 05 18:04:24.414994 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2474/5207] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:23 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 1187 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:24.788673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bd5155fc-a1ba-4f2c-8852-8de60702addc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:24.789309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bd5155fc-a1ba-4f2c-8852-8de60702addc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:24.804579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5155fc-a1ba-4f2c-8852-8de60702addc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:24.816700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5155fc-a1ba-4f2c-8852-8de60702addc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:24.824633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5155fc-a1ba-4f2c-8852-8de60702addc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:24.832087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5155fc-a1ba-4f2c-8852-8de60702addc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:24.832839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5155fc-a1ba-4f2c-8852-8de60702addc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:24.835184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd5155fc-a1ba-4f2c-8852-8de60702addc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:25.270632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:25.406571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bd5155fc-a1ba-4f2c-8852-8de60702addc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:25.415324 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bd5155fc-a1ba-4f2c-8852-8de60702addc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.630699 Oct 05 18:04:25.422583 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2734/5208] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:24 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:25.431943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f46befa-d478-4400-9a66-f51d8bff107c tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:25.432791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2f46befa-d478-4400-9a66-f51d8bff107c tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:25.448155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f46befa-d478-4400-9a66-f51d8bff107c tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:25.448664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f46befa-d478-4400-9a66-f51d8bff107c tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:25.453879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f46befa-d478-4400-9a66-f51d8bff107c tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:25.457527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f46befa-d478-4400-9a66-f51d8bff107c tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:25.458116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f46befa-d478-4400-9a66-f51d8bff107c tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:25.460547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f46befa-d478-4400-9a66-f51d8bff107c tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:25.535971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dd8ff43f-4891-4c9c-9cec-558d150a7440 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Action: 'create', calling method: .version_select at 0x7f77795fb1f0>, body: {"keypair": {"name": "tempest-TestServerBasicOps-265410653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7m7zL4ZyAooGZUW3ztKx5JBdigq5YFt53ksXr4JM4ceng99g4z6bslB2Ytl3sondu/VzKM4o9Idk5SDeu38OF8pRreKXJHtiZIwWRcfKumriPQ+NlY9vtArRn6PpGrNA=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:25.597577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-dd8ff43f-4891-4c9c-9cec-558d150a7440 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Getting quotas for project 14572c4c5fab494c83daf6f61e3c521f. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:04:25.626678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-dd8ff43f-4891-4c9c-9cec-558d150a7440 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Getting quotas for user 82ea967494ce48eb9d82b39d97c942b8 and project 14572c4c5fab494c83daf6f61e3c521f. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:04:25.735088 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dd8ff43f-4891-4c9c-9cec-558d150a7440 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.682619 Oct 05 18:04:25.738720 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2475/5209] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:04:25 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:25.756085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:25.783493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: c51f5174-3b29-4512-a2c1-40f69f17e0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:25.808767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:25.809273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:25.814270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:25.819508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:25.823251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:25.827107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:25.888023 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance c51f5174-3b29-4512-a2c1-40f69f17e0a2 could not be found. Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 HTTP/1.1 Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance c51f5174-3b29-4512-a2c1-40f69f17e0a2 could not be found. Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'c51f5174-3b29-4512-a2c1-40f69f17e0a2'} Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c51f5174-3b29-4512-a2c1-40f69f17e0a2 could not be found. Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c51f5174-3b29-4512-a2c1-40f69f17e0a2 could not be found. Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:04:25.889741 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:04:25.896078 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:25.896078 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:04:25.896078 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:04:25.896078 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:04:25.896078 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:04:25.896078 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c51f5174-3b29-4512-a2c1-40f69f17e0a2 could not be found. Oct 05 18:04:25.896078 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:04:25.896078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance c51f5174-3b29-4512-a2c1-40f69f17e0a2 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:04:25.896078 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9591fd54-94ae-4ff6-8cf0-6a0294165e97 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2" status: 404 len: 111 microversion: 2.1 time: 0.139443 Oct 05 18:04:25.899673 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2476/5210] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:25 2022] GET /compute/v2.1/servers/c51f5174-3b29-4512-a2c1-40f69f17e0a2 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:04:26.315879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f46befa-d478-4400-9a66-f51d8bff107c tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:26.329429 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f46befa-d478-4400-9a66-f51d8bff107c tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1313 microversion: 2.1 time: 0.905378 Oct 05 18:04:26.332181 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2735/5211] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:25 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:26.450956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed776ae2-afc1-41ac-9ad5-a0ce05daf1d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:26.451768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed776ae2-afc1-41ac-9ad5-a0ce05daf1d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:26.487250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed776ae2-afc1-41ac-9ad5-a0ce05daf1d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:26.493392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed776ae2-afc1-41ac-9ad5-a0ce05daf1d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:26.495083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed776ae2-afc1-41ac-9ad5-a0ce05daf1d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:26.496021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed776ae2-afc1-41ac-9ad5-a0ce05daf1d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:26.496796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed776ae2-afc1-41ac-9ad5-a0ce05daf1d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:26.497476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed776ae2-afc1-41ac-9ad5-a0ce05daf1d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:26.786373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ed776ae2-afc1-41ac-9ad5-a0ce05daf1d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:26.797535 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed776ae2-afc1-41ac-9ad5-a0ce05daf1d4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.353189 Oct 05 18:04:26.800133 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2477/5212] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:26 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:27.356960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-415f791d-9ca7-4fdb-baaa-d9358dcd62df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:27.357934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-415f791d-9ca7-4fdb-baaa-d9358dcd62df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:27.371050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-415f791d-9ca7-4fdb-baaa-d9358dcd62df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:27.372108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-415f791d-9ca7-4fdb-baaa-d9358dcd62df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:27.373228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-415f791d-9ca7-4fdb-baaa-d9358dcd62df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:27.374679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-415f791d-9ca7-4fdb-baaa-d9358dcd62df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:27.378836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-415f791d-9ca7-4fdb-baaa-d9358dcd62df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:27.379629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-415f791d-9ca7-4fdb-baaa-d9358dcd62df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:27.774003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-415f791d-9ca7-4fdb-baaa-d9358dcd62df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:27.782142 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-415f791d-9ca7-4fdb-baaa-d9358dcd62df tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1313 microversion: 2.1 time: 0.428967 Oct 05 18:04:27.787009 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2736/5213] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:27 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1313 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:27.826496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0dd23648-9d94-4463-98c4-b48cae95cbfa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:27.827787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0dd23648-9d94-4463-98c4-b48cae95cbfa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:27.841142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dd23648-9d94-4463-98c4-b48cae95cbfa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:27.851363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dd23648-9d94-4463-98c4-b48cae95cbfa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:27.853587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dd23648-9d94-4463-98c4-b48cae95cbfa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:27.856148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dd23648-9d94-4463-98c4-b48cae95cbfa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:27.857926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dd23648-9d94-4463-98c4-b48cae95cbfa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:27.865356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0dd23648-9d94-4463-98c4-b48cae95cbfa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:28.207930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0dd23648-9d94-4463-98c4-b48cae95cbfa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:28.225305 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0dd23648-9d94-4463-98c4-b48cae95cbfa tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.402687 Oct 05 18:04:28.247789 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2478/5214] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:27 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:28.534070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1065777022", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-265410653", "security_groups": [{"name": "tempest-secgroup-smoke-958614069"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "bce721c5-a7bb-401f-aea2-a119f6d84a7a"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:28.809291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-46a69972-9293-4052-a263-df1e960a83a3 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:28.809908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-46a69972-9293-4052-a263-df1e960a83a3 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:28.828231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46a69972-9293-4052-a263-df1e960a83a3 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:28.829525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46a69972-9293-4052-a263-df1e960a83a3 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:28.830140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46a69972-9293-4052-a263-df1e960a83a3 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:28.839827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46a69972-9293-4052-a263-df1e960a83a3 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:28.841022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46a69972-9293-4052-a263-df1e960a83a3 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:28.842125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46a69972-9293-4052-a263-df1e960a83a3 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:28.924843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] validate_networks() for [('bce721c5-a7bb-401f-aea2-a119f6d84a7a', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:04:29.089820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-46a69972-9293-4052-a263-df1e960a83a3 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:29.104485 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-46a69972-9293-4052-a263-df1e960a83a3 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1313 microversion: 2.1 time: 0.299005 Oct 05 18:04:29.105528 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2479/5215] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:28 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:29.261744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e3d0c05e-304a-42c4-bf73-c6f16a6f70b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:29.266490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e3d0c05e-304a-42c4-bf73-c6f16a6f70b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:29.288877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3d0c05e-304a-42c4-bf73-c6f16a6f70b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:29.294750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3d0c05e-304a-42c4-bf73-c6f16a6f70b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:29.295302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3d0c05e-304a-42c4-bf73-c6f16a6f70b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:29.302579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3d0c05e-304a-42c4-bf73-c6f16a6f70b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:29.303498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3d0c05e-304a-42c4-bf73-c6f16a6f70b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:29.309369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3d0c05e-304a-42c4-bf73-c6f16a6f70b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:29.658627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e3d0c05e-304a-42c4-bf73-c6f16a6f70b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:29.676531 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e3d0c05e-304a-42c4-bf73-c6f16a6f70b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1523 microversion: 2.1 time: 0.424524 Oct 05 18:04:29.677200 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2480/5216] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:29 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1523 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:29.734240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48398629-5307-4ede-9a7b-1ae439b49c6f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:29.741650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48398629-5307-4ede-9a7b-1ae439b49c6f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:29.760104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48398629-5307-4ede-9a7b-1ae439b49c6f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:29.763644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48398629-5307-4ede-9a7b-1ae439b49c6f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:29.764103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48398629-5307-4ede-9a7b-1ae439b49c6f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:29.764853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48398629-5307-4ede-9a7b-1ae439b49c6f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:29.765353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48398629-5307-4ede-9a7b-1ae439b49c6f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:29.765734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48398629-5307-4ede-9a7b-1ae439b49c6f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:29.888671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48398629-5307-4ede-9a7b-1ae439b49c6f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:04:29.995160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:30.120975 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48398629-5307-4ede-9a7b-1ae439b49c6f tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 204 len: 0 microversion: 2.1 time: 0.420977 Oct 05 18:04:30.121912 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2481/5217] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:04:29 2022] DELETE /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:04:30.128346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-50f1147e-7ad3-4efe-afbb-625745594e3f req-0e235873-99e2-4283-a013-b3499dd17fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccbd4073-50d6-4c67-8ee5-447f772298a0", "tag": "ea6385e4-12b8-44d1-94e9-c6103b6b8376"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:30.162576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-50f1147e-7ad3-4efe-afbb-625745594e3f req-0e235873-99e2-4283-a013-b3499dd17fd6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:30.163086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-50f1147e-7ad3-4efe-afbb-625745594e3f req-0e235873-99e2-4283-a013-b3499dd17fd6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:30.163733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-50f1147e-7ad3-4efe-afbb-625745594e3f req-0e235873-99e2-4283-a013-b3499dd17fd6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:30.188344 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-50f1147e-7ad3-4efe-afbb-625745594e3f req-0e235873-99e2-4283-a013-b3499dd17fd6 service nova] Creating event network-changed:ea6385e4-12b8-44d1-94e9-c6103b6b8376 for instance ccbd4073-50d6-4c67-8ee5-447f772298a0 on n-h1-835595-3 Oct 05 18:04:30.205112 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-50f1147e-7ad3-4efe-afbb-625745594e3f req-0e235873-99e2-4283-a013-b3499dd17fd6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081278 Oct 05 18:04:30.215126 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2482/5218] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:30.229334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b6593d4-0816-40b4-8c2d-a0b457c32c4d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:30.240260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b6593d4-0816-40b4-8c2d-a0b457c32c4d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:30.258050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6593d4-0816-40b4-8c2d-a0b457c32c4d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:30.262880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6593d4-0816-40b4-8c2d-a0b457c32c4d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:30.264420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6593d4-0816-40b4-8c2d-a0b457c32c4d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:30.266992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6593d4-0816-40b4-8c2d-a0b457c32c4d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:30.267609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6593d4-0816-40b4-8c2d-a0b457c32c4d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:30.268787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b6593d4-0816-40b4-8c2d-a0b457c32c4d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:30.345608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Getting quotas for project 14572c4c5fab494c83daf6f61e3c521f. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:04:30.386359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Getting quotas for user 82ea967494ce48eb9d82b39d97c942b8 and project 14572c4c5fab494c83daf6f61e3c521f. Resources: dict_keys(['metadata_items']) {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:04:30.448965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:04:30.451205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:04:30.454001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:04:30.454913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:04:30.458505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:04:30.481357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:30.482332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:30.483025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:30.483991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:30.485679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:30.486415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:30.546670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Getting quotas for project 14572c4c5fab494c83daf6f61e3c521f. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:04:30.558389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Getting quotas for user 82ea967494ce48eb9d82b39d97c942b8 and project 14572c4c5fab494c83daf6f61e3c521f. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:04:30.572716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8b6593d4-0816-40b4-8c2d-a0b457c32c4d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:30.581877 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b6593d4-0816-40b4-8c2d-a0b457c32c4d tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1686 microversion: 2.1 time: 0.360624 Oct 05 18:04:30.589697 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2483/5219] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:30 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1686 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:30.614543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:04:30.627384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e61112fd-3445-4d1b-a6ae-253e3505267e tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:30.628545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e61112fd-3445-4d1b-a6ae-253e3505267e tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:30.633367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:04:30.645320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e61112fd-3445-4d1b-a6ae-253e3505267e tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:30.647572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e61112fd-3445-4d1b-a6ae-253e3505267e tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:30.648208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e61112fd-3445-4d1b-a6ae-253e3505267e tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:30.650550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e61112fd-3445-4d1b-a6ae-253e3505267e tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:30.651182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e61112fd-3445-4d1b-a6ae-253e3505267e tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:30.652282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e61112fd-3445-4d1b-a6ae-253e3505267e tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:30.791952 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02a460fa-53ef-4907-90d3-a60478c322d7 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.262972 Oct 05 18:04:30.793532 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2737/5220] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:04:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 2265 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:04:30.802779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d1ac8cf8-f84f-4375-af0d-254bed3b8853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:30.803863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d1ac8cf8-f84f-4375-af0d-254bed3b8853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:30.816972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1ac8cf8-f84f-4375-af0d-254bed3b8853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:30.821083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1ac8cf8-f84f-4375-af0d-254bed3b8853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:30.822173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1ac8cf8-f84f-4375-af0d-254bed3b8853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:30.823249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1ac8cf8-f84f-4375-af0d-254bed3b8853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:30.823942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1ac8cf8-f84f-4375-af0d-254bed3b8853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:30.827091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1ac8cf8-f84f-4375-af0d-254bed3b8853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:31.051981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e61112fd-3445-4d1b-a6ae-253e3505267e tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:31.064527 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e61112fd-3445-4d1b-a6ae-253e3505267e tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1313 microversion: 2.1 time: 0.461787 Oct 05 18:04:31.067449 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2484/5221] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:30 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1313 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:31.091794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-140b61f6-6891-411a-8a2c-c1f6f800fe04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:31.097878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-140b61f6-6891-411a-8a2c-c1f6f800fe04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:31.179333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-140b61f6-6891-411a-8a2c-c1f6f800fe04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:31.197419 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-140b61f6-6891-411a-8a2c-c1f6f800fe04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1302 microversion: 2.1 time: 0.127384 Oct 05 18:04:31.198027 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2485/5222] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:31 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1302 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:31.206352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a6c30d59-71a2-4a1b-ad96-202d2865b14f req-d209aed0-3444-4c4a-8cb2-bde3128b37f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3443bc-76be-4645-8f88-da00a65d4ea6", "name": "network-vif-plugged", "status": "completed", "tag": "78dd1c33-cdd3-42c0-b7d4-d60054df4fc9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:31.244315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a6c30d59-71a2-4a1b-ad96-202d2865b14f req-d209aed0-3444-4c4a-8cb2-bde3128b37f5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:31.244315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a6c30d59-71a2-4a1b-ad96-202d2865b14f req-d209aed0-3444-4c4a-8cb2-bde3128b37f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:31.244315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a6c30d59-71a2-4a1b-ad96-202d2865b14f req-d209aed0-3444-4c4a-8cb2-bde3128b37f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:31.284623 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a6c30d59-71a2-4a1b-ad96-202d2865b14f req-d209aed0-3444-4c4a-8cb2-bde3128b37f5 service nova] Creating event network-vif-plugged:78dd1c33-cdd3-42c0-b7d4-d60054df4fc9 for instance 7f3443bc-76be-4645-8f88-da00a65d4ea6 on n-h2-835595-3 Oct 05 18:04:31.319961 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a6c30d59-71a2-4a1b-ad96-202d2865b14f req-d209aed0-3444-4c4a-8cb2-bde3128b37f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112501 Oct 05 18:04:31.321312 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2486/5223] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:31.618867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1483a1fc-f4ec-4c50-a5c3-d83e8e75f406 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:31.620108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1483a1fc-f4ec-4c50-a5c3-d83e8e75f406 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:31.633652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1483a1fc-f4ec-4c50-a5c3-d83e8e75f406 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:31.635600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1483a1fc-f4ec-4c50-a5c3-d83e8e75f406 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:31.637082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1483a1fc-f4ec-4c50-a5c3-d83e8e75f406 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:31.639118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1483a1fc-f4ec-4c50-a5c3-d83e8e75f406 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:31.640050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1483a1fc-f4ec-4c50-a5c3-d83e8e75f406 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:31.641067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1483a1fc-f4ec-4c50-a5c3-d83e8e75f406 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:31.758873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d1ac8cf8-f84f-4375-af0d-254bed3b8853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:31.772717 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d1ac8cf8-f84f-4375-af0d-254bed3b8853 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1505 microversion: 2.1 time: 0.977820 Oct 05 18:04:31.779567 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2738/5224] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:30 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1505 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:32.095098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6624e6d2-312b-443f-a918-9936bf9403f1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:32.095736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6624e6d2-312b-443f-a918-9936bf9403f1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:32.121985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6624e6d2-312b-443f-a918-9936bf9403f1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:32.126747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6624e6d2-312b-443f-a918-9936bf9403f1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:32.128086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6624e6d2-312b-443f-a918-9936bf9403f1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:32.133830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6624e6d2-312b-443f-a918-9936bf9403f1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:32.145850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6624e6d2-312b-443f-a918-9936bf9403f1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:32.147035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6624e6d2-312b-443f-a918-9936bf9403f1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:32.343869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1483a1fc-f4ec-4c50-a5c3-d83e8e75f406 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:32.357101 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1483a1fc-f4ec-4c50-a5c3-d83e8e75f406 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1686 microversion: 2.1 time: 0.748261 Oct 05 18:04:32.358017 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2487/5225] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:31 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1686 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:32.374838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b3a305b3-ec6f-4394-8d28-5626d237dd22 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:32.379876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3a305b3-ec6f-4394-8d28-5626d237dd22 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:32.395301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3a305b3-ec6f-4394-8d28-5626d237dd22 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:32.395301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3a305b3-ec6f-4394-8d28-5626d237dd22 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:32.395301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3a305b3-ec6f-4394-8d28-5626d237dd22 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:32.395301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3a305b3-ec6f-4394-8d28-5626d237dd22 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:32.395301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3a305b3-ec6f-4394-8d28-5626d237dd22 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:32.395301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3a305b3-ec6f-4394-8d28-5626d237dd22 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:32.625735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3a305b3-ec6f-4394-8d28-5626d237dd22 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:32.635268 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b3a305b3-ec6f-4394-8d28-5626d237dd22 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1298 microversion: 2.1 time: 0.276085 Oct 05 18:04:32.639167 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2488/5226] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:32 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1298 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:32.803933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8c228ea1-db16-4689-8153-b2a89612c80d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:32.804544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8c228ea1-db16-4689-8153-b2a89612c80d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:32.812163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c228ea1-db16-4689-8153-b2a89612c80d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:32.812662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c228ea1-db16-4689-8153-b2a89612c80d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:32.813093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c228ea1-db16-4689-8153-b2a89612c80d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:32.813795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c228ea1-db16-4689-8153-b2a89612c80d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:32.814239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c228ea1-db16-4689-8153-b2a89612c80d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:32.823198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c228ea1-db16-4689-8153-b2a89612c80d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:32.864360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6624e6d2-312b-443f-a918-9936bf9403f1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:32.874145 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6624e6d2-312b-443f-a918-9936bf9403f1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1313 microversion: 2.1 time: 0.784292 Oct 05 18:04:32.882980 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2739/5227] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:32 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1313 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:33.137720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c228ea1-db16-4689-8153-b2a89612c80d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:33.148403 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8c228ea1-db16-4689-8153-b2a89612c80d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1505 microversion: 2.1 time: 0.348281 Oct 05 18:04:33.150854 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2489/5228] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:32 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1505 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:33.394329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8812ad44-a340-48c1-be1a-c3b9f2b560fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:33.397193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8812ad44-a340-48c1-be1a-c3b9f2b560fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:33.420428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8812ad44-a340-48c1-be1a-c3b9f2b560fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:33.420861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8812ad44-a340-48c1-be1a-c3b9f2b560fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:33.425762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8812ad44-a340-48c1-be1a-c3b9f2b560fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:33.429303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8812ad44-a340-48c1-be1a-c3b9f2b560fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:33.429817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8812ad44-a340-48c1-be1a-c3b9f2b560fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:33.431718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8812ad44-a340-48c1-be1a-c3b9f2b560fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:33.624693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8812ad44-a340-48c1-be1a-c3b9f2b560fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06d379a97d474b74a29e62848a4e4696', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff799a13bddf49c0bc8b23c02eabf9ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:33.640887 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8812ad44-a340-48c1-be1a-c3b9f2b560fe tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 200 len: 1501 microversion: 2.1 time: 0.259091 Oct 05 18:04:33.641885 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2740/5229] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:33 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 1501 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:33.665006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b94bba2-a5bf-4097-b342-585e8906bcc5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:33.665625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5b94bba2-a5bf-4097-b342-585e8906bcc5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:33.675530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b94bba2-a5bf-4097-b342-585e8906bcc5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:33.676028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b94bba2-a5bf-4097-b342-585e8906bcc5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:33.676516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b94bba2-a5bf-4097-b342-585e8906bcc5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:33.691402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b94bba2-a5bf-4097-b342-585e8906bcc5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:33.692240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b94bba2-a5bf-4097-b342-585e8906bcc5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:33.692641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5b94bba2-a5bf-4097-b342-585e8906bcc5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:33.707211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-dfa01963-8447-4f8c-abcb-cc5d1ab98bb0 req-5cc59a42-a523-4cab-8f12-495191a0ed06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccbd4073-50d6-4c67-8ee5-447f772298a0", "name": "network-vif-deleted", "tag": "ea6385e4-12b8-44d1-94e9-c6103b6b8376"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:33.721502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dfa01963-8447-4f8c-abcb-cc5d1ab98bb0 req-5cc59a42-a523-4cab-8f12-495191a0ed06 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:33.721954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dfa01963-8447-4f8c-abcb-cc5d1ab98bb0 req-5cc59a42-a523-4cab-8f12-495191a0ed06 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:33.737281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dfa01963-8447-4f8c-abcb-cc5d1ab98bb0 req-5cc59a42-a523-4cab-8f12-495191a0ed06 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:33.769762 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-dfa01963-8447-4f8c-abcb-cc5d1ab98bb0 req-5cc59a42-a523-4cab-8f12-495191a0ed06 service nova] Creating event network-vif-deleted:ea6385e4-12b8-44d1-94e9-c6103b6b8376 for instance ccbd4073-50d6-4c67-8ee5-447f772298a0 on n-h1-835595-3 Oct 05 18:04:33.788266 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-dfa01963-8447-4f8c-abcb-cc5d1ab98bb0 req-5cc59a42-a523-4cab-8f12-495191a0ed06 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085096 Oct 05 18:04:33.801316 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2741/5230] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:33.909428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ecdb087e-e715-4573-b4d1-75bc6c34c9e9 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:33.911418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ecdb087e-e715-4573-b4d1-75bc6c34c9e9 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:33.934592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdb087e-e715-4573-b4d1-75bc6c34c9e9 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:33.935214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdb087e-e715-4573-b4d1-75bc6c34c9e9 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:33.939932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdb087e-e715-4573-b4d1-75bc6c34c9e9 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:33.940798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdb087e-e715-4573-b4d1-75bc6c34c9e9 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:33.941287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdb087e-e715-4573-b4d1-75bc6c34c9e9 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:33.946099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdb087e-e715-4573-b4d1-75bc6c34c9e9 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:34.181300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5b94bba2-a5bf-4097-b342-585e8906bcc5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:34.190102 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b94bba2-a5bf-4097-b342-585e8906bcc5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1360 microversion: 2.1 time: 0.529322 Oct 05 18:04:34.209583 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2490/5231] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:33 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1360 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:34.209583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6cece9fe-4dfe-4a17-a6fc-0bb5b978fe4b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:34.218549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6cece9fe-4dfe-4a17-a6fc-0bb5b978fe4b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:34.243134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cece9fe-4dfe-4a17-a6fc-0bb5b978fe4b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:34.246742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cece9fe-4dfe-4a17-a6fc-0bb5b978fe4b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:34.248440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cece9fe-4dfe-4a17-a6fc-0bb5b978fe4b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:34.252571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cece9fe-4dfe-4a17-a6fc-0bb5b978fe4b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:34.254150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cece9fe-4dfe-4a17-a6fc-0bb5b978fe4b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:34.258735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cece9fe-4dfe-4a17-a6fc-0bb5b978fe4b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:34.441278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ecdb087e-e715-4573-b4d1-75bc6c34c9e9 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:34.454694 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ecdb087e-e715-4573-b4d1-75bc6c34c9e9 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1497 microversion: 2.1 time: 0.550518 Oct 05 18:04:34.455607 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2742/5232] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:33 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1497 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:34.673150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:34.674106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] [instance: ccbd4073-50d6-4c67-8ee5-447f772298a0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:34.703964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:34.704584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:34.707207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:34.711107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:34.713546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:34.714251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:34.748421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6cece9fe-4dfe-4a17-a6fc-0bb5b978fe4b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:34.760434 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6cece9fe-4dfe-4a17-a6fc-0bb5b978fe4b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1505 microversion: 2.1 time: 0.560965 Oct 05 18:04:34.763046 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2491/5233] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:34 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:34.790076 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] HTTP exception thrown: Instance ccbd4073-50d6-4c67-8ee5-447f772298a0 could not be found. Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Request method failure captured: Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 HTTP/1.1 Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcR9hsASNeCxKdaWPh__rNnLpLGu_NRFNi62uQj9y73P1T9S0pslSwuq_12rTMXyGYm4d-Umm-79M42ROeTVnTLUWyZ4RZkWarKlFVLotx_WpwXcOjA-s_3fPDnuAoX-R_bMMcbYM0Kd8mJ9oPRpxXfRyUZdm3yiMPoJSkAHu7laR8I Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: ff799a13bddf49c0bc8b23c02eabf9ac Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/ff799a13bddf49c0bc8b23c02eabf9ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff799a13bddf49c0bc8b23c02eabf9ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_ff799a13bddf49c0bc8b23c02eabf9ac", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/ff799a13bddf49c0bc8b23c02eabf9ac"}]}] Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: ff799a13bddf49c0bc8b23c02eabf9ac Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1621598017 Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestNetworkAdvancedServerOps-1621598017-project Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 06d379a97d474b74a29e62848a4e4696 Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1621598017-project Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance ccbd4073-50d6-4c67-8ee5-447f772298a0 could not be found. Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'ccbd4073-50d6-4c67-8ee5-447f772298a0'} Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccbd4073-50d6-4c67-8ee5-447f772298a0 could not be found. Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccbd4073-50d6-4c67-8ee5-447f772298a0 could not be found. Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:04:34.793073 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:04:34.799690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:04:34.799690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:34.799690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:04:34.799690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:04:34.799690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:04:34.799690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:04:34.799690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccbd4073-50d6-4c67-8ee5-447f772298a0 could not be found. Oct 05 18:04:34.799690 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:04:34.799690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Returning 404 to user: Instance ccbd4073-50d6-4c67-8ee5-447f772298a0 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:04:34.800976 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-64943bd6-e8cc-47e3-ad07-c8eb231105b3 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0" status: 404 len: 111 microversion: 2.1 time: 0.134998 Oct 05 18:04:34.809648 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2743/5234] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:34 2022] GET /compute/v2.1/servers/ccbd4073-50d6-4c67-8ee5-447f772298a0 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:04:34.870306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-784cd380-4e93-4c46-be82-58a7a21ac036 req-3a8936a0-1d1b-4299-a13e-7b481cd425cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0555770d-5774-4f39-b4ad-3fa29ac7ba32", "name": "network-vif-unplugged", "status": "completed", "tag": "4cf55f4f-324b-4fe1-82a3-d58ee09ee530"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:34.892786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-784cd380-4e93-4c46-be82-58a7a21ac036 req-3a8936a0-1d1b-4299-a13e-7b481cd425cb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:34.894225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-784cd380-4e93-4c46-be82-58a7a21ac036 req-3a8936a0-1d1b-4299-a13e-7b481cd425cb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:34.896812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-784cd380-4e93-4c46-be82-58a7a21ac036 req-3a8936a0-1d1b-4299-a13e-7b481cd425cb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:34.931469 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-784cd380-4e93-4c46-be82-58a7a21ac036 req-3a8936a0-1d1b-4299-a13e-7b481cd425cb service nova] Creating event network-vif-unplugged:4cf55f4f-324b-4fe1-82a3-d58ee09ee530 for instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 on n-h2-835595-3 Oct 05 18:04:34.945085 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-784cd380-4e93-4c46-be82-58a7a21ac036 req-3a8936a0-1d1b-4299-a13e-7b481cd425cb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080536 Oct 05 18:04:34.945721 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2492/5235] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:04:35.223901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5c8df16-7eb4-4924-8bba-c31f2fbf3c02 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:35.225166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d5c8df16-7eb4-4924-8bba-c31f2fbf3c02 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:35.239776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5c8df16-7eb4-4924-8bba-c31f2fbf3c02 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:35.243669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5c8df16-7eb4-4924-8bba-c31f2fbf3c02 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:35.244193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5c8df16-7eb4-4924-8bba-c31f2fbf3c02 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:35.245871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5c8df16-7eb4-4924-8bba-c31f2fbf3c02 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:35.246423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5c8df16-7eb4-4924-8bba-c31f2fbf3c02 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:35.260505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5c8df16-7eb4-4924-8bba-c31f2fbf3c02 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:35.786920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8a2d9751-1f35-4b4e-808c-d74b3028d17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:35.787817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8a2d9751-1f35-4b4e-808c-d74b3028d17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:35.812495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a2d9751-1f35-4b4e-808c-d74b3028d17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:35.814821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a2d9751-1f35-4b4e-808c-d74b3028d17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:35.815281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a2d9751-1f35-4b4e-808c-d74b3028d17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:35.819095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a2d9751-1f35-4b4e-808c-d74b3028d17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:35.819588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a2d9751-1f35-4b4e-808c-d74b3028d17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:35.823546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a2d9751-1f35-4b4e-808c-d74b3028d17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:35.972877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d5c8df16-7eb4-4924-8bba-c31f2fbf3c02 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:35.986204 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d5c8df16-7eb4-4924-8bba-c31f2fbf3c02 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1427 microversion: 2.1 time: 0.767053 Oct 05 18:04:36.003928 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2744/5236] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:35 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1427 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:36.409058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8a2d9751-1f35-4b4e-808c-d74b3028d17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:36.419204 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8a2d9751-1f35-4b4e-808c-d74b3028d17a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 200 len: 1448 microversion: 2.1 time: 0.637630 Oct 05 18:04:36.419810 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2493/5237] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:35 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 1448 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:36.449663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:36.450689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:36.462333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:36.463274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:36.465205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:36.466224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:36.471728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:36.472899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:36.526045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:04:36.547313 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.api [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Working on deleting snapshot 57822454-f4cf-409e-8e2b-90ee81ba3a80 from shelved instance... Oct 05 18:04:37.009715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e0cfbe5-b8be-4f27-80db-2e9391f34f2f tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:37.011193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e0cfbe5-b8be-4f27-80db-2e9391f34f2f tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:37.021494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:37.026613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e0cfbe5-b8be-4f27-80db-2e9391f34f2f tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:37.028093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e0cfbe5-b8be-4f27-80db-2e9391f34f2f tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:37.030773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e0cfbe5-b8be-4f27-80db-2e9391f34f2f tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:37.032607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e0cfbe5-b8be-4f27-80db-2e9391f34f2f tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:37.034925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e0cfbe5-b8be-4f27-80db-2e9391f34f2f tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:37.035696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e0cfbe5-b8be-4f27-80db-2e9391f34f2f tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:37.394253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8e0cfbe5-b8be-4f27-80db-2e9391f34f2f tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:37.419834 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8e0cfbe5-b8be-4f27-80db-2e9391f34f2f tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1427 microversion: 2.1 time: 0.412943 Oct 05 18:04:37.445883 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2494/5238] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:37 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1427 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:38.002908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:38.021587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Doing local delete in cell 7b356d48-72d2-49eb-8427-f4c09b8b2828(cell1) {{(pid=128844) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 05 18:04:38.022399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:38.022899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:38.023399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:38.023751 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.api [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 05 18:04:38.041673 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [6a13e436-ee33-426c-b4c8-8f7d5ba6e4d5] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 18:04:38.150960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-0d7a0b6e-7b2c-4529-8fb2-38edfb1ac6b2 req-dd240543-f612-4848-b5d1-a675430a4737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdba702-9493-4ecd-b235-130e14ded381", "tag": "d9df39d1-abfc-4113-a208-43effcd9dbfc"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:38.193322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0d7a0b6e-7b2c-4529-8fb2-38edfb1ac6b2 req-dd240543-f612-4848-b5d1-a675430a4737 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:38.194152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0d7a0b6e-7b2c-4529-8fb2-38edfb1ac6b2 req-dd240543-f612-4848-b5d1-a675430a4737 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:38.196058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0d7a0b6e-7b2c-4529-8fb2-38edfb1ac6b2 req-dd240543-f612-4848-b5d1-a675430a4737 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:38.240674 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-0d7a0b6e-7b2c-4529-8fb2-38edfb1ac6b2 req-dd240543-f612-4848-b5d1-a675430a4737 service nova] Creating event network-changed:d9df39d1-abfc-4113-a208-43effcd9dbfc for instance 0fdba702-9493-4ecd-b235-130e14ded381 on n-h1-835595-3 Oct 05 18:04:38.264610 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-0d7a0b6e-7b2c-4529-8fb2-38edfb1ac6b2 req-dd240543-f612-4848-b5d1-a675430a4737 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116862 Oct 05 18:04:38.265499 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2495/5239] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:04:38.451233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-26aaa0c5-ece7-4202-8612-3578fad6ea5e tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:38.452143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-26aaa0c5-ece7-4202-8612-3578fad6ea5e tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:38.471220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26aaa0c5-ece7-4202-8612-3578fad6ea5e tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:38.471715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26aaa0c5-ece7-4202-8612-3578fad6ea5e tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:38.472148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26aaa0c5-ece7-4202-8612-3578fad6ea5e tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:38.472856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26aaa0c5-ece7-4202-8612-3578fad6ea5e tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:38.473484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26aaa0c5-ece7-4202-8612-3578fad6ea5e tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:38.473911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26aaa0c5-ece7-4202-8612-3578fad6ea5e tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:39.048919 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [6a13e436-ee33-426c-b4c8-8f7d5ba6e4d5] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 45068. Oct 05 18:04:39.055488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] deallocate_for_instance() {{(pid=128844) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 05 18:04:39.246642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-26aaa0c5-ece7-4202-8612-3578fad6ea5e tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:39.265471 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-26aaa0c5-ece7-4202-8612-3578fad6ea5e tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1427 microversion: 2.1 time: 0.818994 Oct 05 18:04:39.271053 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2496/5240] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:38 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1427 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:40.106780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5c77af3-8019-4376-8692-acf51f9c1035 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:40.107667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5c77af3-8019-4376-8692-acf51f9c1035 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:40.119145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c77af3-8019-4376-8692-acf51f9c1035 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:40.123386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c77af3-8019-4376-8692-acf51f9c1035 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:40.124445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c77af3-8019-4376-8692-acf51f9c1035 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:40.126912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c77af3-8019-4376-8692-acf51f9c1035 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:40.129481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c77af3-8019-4376-8692-acf51f9c1035 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:40.130426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c77af3-8019-4376-8692-acf51f9c1035 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:40.228419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5c77af3-8019-4376-8692-acf51f9c1035 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:04:40.478631 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c5c77af3-8019-4376-8692-acf51f9c1035 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 204 len: 0 microversion: 2.1 time: 0.375586 Oct 05 18:04:40.482123 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2497/5241] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:04:40 2022] DELETE /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 18:04:40.497177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:40.498095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dd72fc9d-fcbd-425d-86db-2bae532fbb04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:40.500064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dd72fc9d-fcbd-425d-86db-2bae532fbb04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:40.519320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd72fc9d-fcbd-425d-86db-2bae532fbb04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:40.519769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd72fc9d-fcbd-425d-86db-2bae532fbb04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:40.520486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd72fc9d-fcbd-425d-86db-2bae532fbb04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:40.522486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd72fc9d-fcbd-425d-86db-2bae532fbb04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:40.523712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd72fc9d-fcbd-425d-86db-2bae532fbb04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:40.527406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd72fc9d-fcbd-425d-86db-2bae532fbb04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:40.598721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=10 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:41.197106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:41.331280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dd72fc9d-fcbd-425d-86db-2bae532fbb04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:41.344450 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dd72fc9d-fcbd-425d-86db-2bae532fbb04 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1427 microversion: 2.1 time: 0.858748 Oct 05 18:04:41.347552 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2498/5242] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:40 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1427 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:41.359591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4db19ffc-453a-4717-a153-d8d84a7f4331 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:41.360608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4db19ffc-453a-4717-a153-d8d84a7f4331 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:41.379611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4db19ffc-453a-4717-a153-d8d84a7f4331 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:41.380406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4db19ffc-453a-4717-a153-d8d84a7f4331 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:41.381109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4db19ffc-453a-4717-a153-d8d84a7f4331 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:41.382124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4db19ffc-453a-4717-a153-d8d84a7f4331 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:41.387513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4db19ffc-453a-4717-a153-d8d84a7f4331 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:41.388086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4db19ffc-453a-4717-a153-d8d84a7f4331 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:41.498762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Updating instance_info_cache with network_info: [] {{(pid=128844) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 05 18:04:41.984705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:42.010112 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-faac0a1a-1ef2-47ed-9363-10b05189a286 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 204 len: 0 microversion: 2.1 time: 5.563949 Oct 05 18:04:42.011481 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2745/5243] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:04:36 2022] DELETE /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 0 bytes in 5566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:04:42.025712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b6869b1e-bfd5-4ac3-a1e0-c87b28ab5e53 req-c5930911-c0a8-4e58-a491-514c8ad80028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0555770d-5774-4f39-b4ad-3fa29ac7ba32", "name": "network-vif-deleted", "tag": "4cf55f4f-324b-4fe1-82a3-d58ee09ee530"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:42.055480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b6869b1e-bfd5-4ac3-a1e0-c87b28ab5e53 req-c5930911-c0a8-4e58-a491-514c8ad80028 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:42.056033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b6869b1e-bfd5-4ac3-a1e0-c87b28ab5e53 req-c5930911-c0a8-4e58-a491-514c8ad80028 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:42.056484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b6869b1e-bfd5-4ac3-a1e0-c87b28ab5e53 req-c5930911-c0a8-4e58-a491-514c8ad80028 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:42.085363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.server_external_events [req-b6869b1e-bfd5-4ac3-a1e0-c87b28ab5e53 req-c5930911-c0a8-4e58-a491-514c8ad80028 service nova] Unable to find a host for instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32. Dropping event network-vif-deleted {{(pid=128844) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 18:04:42.086729 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b6869b1e-bfd5-4ac3-a1e0-c87b28ab5e53 req-c5930911-c0a8-4e58-a491-514c8ad80028 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.073754 Oct 05 18:04:42.088220 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2746/5244] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 18:04:42.094213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1836155111", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "fe4e22fe-87b4-4504-897e-32f6b8e627eb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "adb1494a-27b0-43e0-8027-66e89e0c81ad"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:42.180591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4db19ffc-453a-4717-a153-d8d84a7f4331 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:42.185764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:42.192471 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4db19ffc-453a-4717-a153-d8d84a7f4331 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1503 microversion: 2.1 time: 0.843382 Oct 05 18:04:42.212035 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2499/5245] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:41 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1503 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:42.224938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:42.228367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:42.244033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:42.244525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:42.244965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:42.245660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:42.252389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] validate_networks() for [('adb1494a-27b0-43e0-8027-66e89e0c81ad', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:04:42.254972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:42.258593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:42.282599 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 HTTP/1.1 Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '0555770d-5774-4f39-b4ad-3fa29ac7ba32'} Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:04:42.291660 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:04:42.311142 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:42.311142 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:04:42.311142 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:04:42.311142 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:04:42.311142 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:04:42.311142 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:04:42.311142 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:04:42.321664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:04:42.328924 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f8556ff1-95d6-4ae8-b243-b2cbfa7bf543 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 404 len: 111 microversion: 2.1 time: 0.115173 Oct 05 18:04:42.338418 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2500/5246] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:42 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:04:42.383992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4cc3ac0a-bdd1-4a38-a3b8-281743f63bf8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:42.384614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4cc3ac0a-bdd1-4a38-a3b8-281743f63bf8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:42.426760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc3ac0a-bdd1-4a38-a3b8-281743f63bf8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:42.428057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc3ac0a-bdd1-4a38-a3b8-281743f63bf8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:42.429107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc3ac0a-bdd1-4a38-a3b8-281743f63bf8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:42.431597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc3ac0a-bdd1-4a38-a3b8-281743f63bf8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:42.432352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc3ac0a-bdd1-4a38-a3b8-281743f63bf8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:42.434974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc3ac0a-bdd1-4a38-a3b8-281743f63bf8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:42.952228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4cc3ac0a-bdd1-4a38-a3b8-281743f63bf8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:42.964876 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4cc3ac0a-bdd1-4a38-a3b8-281743f63bf8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1427 microversion: 2.1 time: 0.587456 Oct 05 18:04:42.967427 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2501/5247] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:42 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1427 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:42.979152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1417396956", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:43.109051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] validate_networks() for [('7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:04:43.356172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:04:43.356716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:04:43.357129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:04:43.357680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:04:43.357994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:04:43.374497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:43.376533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:43.377297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:43.378532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:43.382210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:43.382757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:43.410114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:04:43.418181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for user 8a900e5bf82d462a9113d6e6461ea3a0 and project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:04:43.557498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:04:43.559584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fe4e22fe-87b4-4504-897e-32f6b8e627eb',volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:04:43.919069 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1937dca0-521c-47c0-a233-abd40714f84a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.828053 Oct 05 18:04:43.920175 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2747/5248] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:04:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:04:43.945785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:43.952070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:43.977589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:43.982747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:43.983456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:43.989101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:43.993645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:43.994474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:44.121825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:44.127175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:44.127839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:44.132179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lazy-loading 'fault' on Instance uuid 7f3443bc-76be-4645-8f88-da00a65d4ea6 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:04:44.217757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7606296b7564e2b9ab5b9d1dbe5996d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6a9a279da9349f7a7c130855591e99d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:44.236945 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c6f1dec-258e-4f0a-a0e1-17ee2cf89879 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 200 len: 1303 microversion: 2.1 time: 0.312892 Oct 05 18:04:44.253698 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2748/5249] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:43 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 1303 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:44.266183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79e4f5f3-9a89-4477-8edd-4947bb62b4d9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:44.269025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-79e4f5f3-9a89-4477-8edd-4947bb62b4d9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:44.361142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:04:44.362729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:04:44.368593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:04:44.369092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:04:44.370876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:04:44.389077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:44.389628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:44.390074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:44.390979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:44.391436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:44.391891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:44.413330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:04:44.420006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for user 9ea1c284fc254cc7a51d9e67d4fe8168 and project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:04:44.447470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:04:44.453103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:04:44.560340 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-75205fb3-8892-4069-8bd8-41799e7f7829 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589132 Oct 05 18:04:44.561320 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2502/5250] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:04:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:04:44.576572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79e4f5f3-9a89-4477-8edd-4947bb62b4d9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:44.585180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5cc111fd-ec26-44f9-a549-42f3e5d6bbc1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:44.603102 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79e4f5f3-9a89-4477-8edd-4947bb62b4d9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1057 microversion: 2.1 time: 0.345157 Oct 05 18:04:44.603472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5cc111fd-ec26-44f9-a549-42f3e5d6bbc1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:44.612874 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2749/5251] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:44 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1057 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:44.617859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ea9e92fb-5585-4edc-8ae8-addf3ee65fd2 req-cf44262c-f5a9-40ff-8eaf-c5b4e5a7a6e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f3443bc-76be-4645-8f88-da00a65d4ea6", "name": "network-vif-deleted", "tag": "78dd1c33-cdd3-42c0-b7d4-d60054df4fc9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:44.637862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cc111fd-ec26-44f9-a549-42f3e5d6bbc1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:44.638445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cc111fd-ec26-44f9-a549-42f3e5d6bbc1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:44.638853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cc111fd-ec26-44f9-a549-42f3e5d6bbc1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:44.639576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cc111fd-ec26-44f9-a549-42f3e5d6bbc1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:44.640033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cc111fd-ec26-44f9-a549-42f3e5d6bbc1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:44.640617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5cc111fd-ec26-44f9-a549-42f3e5d6bbc1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:44.658300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ea9e92fb-5585-4edc-8ae8-addf3ee65fd2 req-cf44262c-f5a9-40ff-8eaf-c5b4e5a7a6e9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:44.658787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ea9e92fb-5585-4edc-8ae8-addf3ee65fd2 req-cf44262c-f5a9-40ff-8eaf-c5b4e5a7a6e9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:44.659225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ea9e92fb-5585-4edc-8ae8-addf3ee65fd2 req-cf44262c-f5a9-40ff-8eaf-c5b4e5a7a6e9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:44.690711 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ea9e92fb-5585-4edc-8ae8-addf3ee65fd2 req-cf44262c-f5a9-40ff-8eaf-c5b4e5a7a6e9 service nova] Creating event network-vif-deleted:78dd1c33-cdd3-42c0-b7d4-d60054df4fc9 for instance 7f3443bc-76be-4645-8f88-da00a65d4ea6 on n-h2-835595-3 Oct 05 18:04:44.704132 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ea9e92fb-5585-4edc-8ae8-addf3ee65fd2 req-cf44262c-f5a9-40ff-8eaf-c5b4e5a7a6e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089504 Oct 05 18:04:44.717115 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2750/5252] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:44.731933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ee138135-c318-4705-b377-0f2e327dcfe6 req-cf2443ff-3c36-495a-aba9-6d54abef4580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdba702-9493-4ecd-b235-130e14ded381", "name": "network-vif-plugged", "status": "completed", "tag": "d9df39d1-abfc-4113-a208-43effcd9dbfc"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:44.757452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ee138135-c318-4705-b377-0f2e327dcfe6 req-cf2443ff-3c36-495a-aba9-6d54abef4580 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:44.761768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ee138135-c318-4705-b377-0f2e327dcfe6 req-cf2443ff-3c36-495a-aba9-6d54abef4580 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:44.762496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ee138135-c318-4705-b377-0f2e327dcfe6 req-cf2443ff-3c36-495a-aba9-6d54abef4580 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:44.789929 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ee138135-c318-4705-b377-0f2e327dcfe6 req-cf2443ff-3c36-495a-aba9-6d54abef4580 service nova] Creating event network-vif-plugged:d9df39d1-abfc-4113-a208-43effcd9dbfc for instance 0fdba702-9493-4ecd-b235-130e14ded381 on n-h1-835595-3 Oct 05 18:04:44.803557 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ee138135-c318-4705-b377-0f2e327dcfe6 req-cf2443ff-3c36-495a-aba9-6d54abef4580 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081964 Oct 05 18:04:44.805221 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2751/5253] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:44.836077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0d7b7fc8-de7d-4d3c-95d5-a29ab5814013 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:44.836887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0d7b7fc8-de7d-4d3c-95d5-a29ab5814013 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:44.979613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0d7b7fc8-de7d-4d3c-95d5-a29ab5814013 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:45.039919 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0d7b7fc8-de7d-4d3c-95d5-a29ab5814013 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1215 microversion: 2.1 time: 0.230487 Oct 05 18:04:45.058051 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2752/5254] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:44 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1215 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:45.206751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5cc111fd-ec26-44f9-a549-42f3e5d6bbc1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:45.226466 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5cc111fd-ec26-44f9-a549-42f3e5d6bbc1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1427 microversion: 2.1 time: 0.663496 Oct 05 18:04:45.233597 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2503/5255] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:44 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1427 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:45.276877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:45.277914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] [instance: 7f3443bc-76be-4645-8f88-da00a65d4ea6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:45.331907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:45.337870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:45.338586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:45.343398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:45.344330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:45.346589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:45.376297 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] HTTP exception thrown: Instance 7f3443bc-76be-4645-8f88-da00a65d4ea6 could not be found. Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Request method failure captured: Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 HTTP/1.1 Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPccUtxGCkCR59QxsMZ3OF4_xX_gMw9YydFGEjIYqHCRQ1bDaYre8qSE-TzJPwAQKuu555HfqpAYHKVAlsBZrAfY0Cpskcmc0vVKFgJ5IZvKo4ScQz2AK_XWv7HPR5wfi2QMC4yIRfa2ouhn47PRzZrnEIa7VU7jYHfLLXpj8BgchGWA Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c6a9a279da9349f7a7c130855591e99d Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-VolumesActionsTest-1742842597 Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c6a9a279da9349f7a7c130855591e99d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6a9a279da9349f7a7c130855591e99d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c6a9a279da9349f7a7c130855591e99d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c6a9a279da9349f7a7c130855591e99d"}]}] Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-VolumesActionsTest-1742842597 Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c6a9a279da9349f7a7c130855591e99d Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-VolumesActionsTest-1742842597 Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-VolumesActionsTest-1742842597-project Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: a7606296b7564e2b9ab5b9d1dbe5996d Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-VolumesActionsTest-1742842597-project Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 7f3443bc-76be-4645-8f88-da00a65d4ea6 could not be found. Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '7f3443bc-76be-4645-8f88-da00a65d4ea6'} Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f3443bc-76be-4645-8f88-da00a65d4ea6 could not be found. Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f3443bc-76be-4645-8f88-da00a65d4ea6 could not be found. Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:04:45.378575 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:04:45.383650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:04:45.383650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:04:45.383650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:04:45.383650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:04:45.383650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:04:45.383650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f3443bc-76be-4645-8f88-da00a65d4ea6 could not be found. Oct 05 18:04:45.383650 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:04:45.386134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] Returning 404 to user: Instance 7f3443bc-76be-4645-8f88-da00a65d4ea6 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:04:45.387575 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fa146f09-4269-4e75-bf8a-3315da6ebec1 tempest-VolumesActionsTest-1742842597 tempest-VolumesActionsTest-1742842597-project] 10.222.0.70 "GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6" status: 404 len: 111 microversion: 2.1 time: 0.125328 Oct 05 18:04:45.392501 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2753/5256] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:45 2022] GET /compute/v2.1/servers/7f3443bc-76be-4645-8f88-da00a65d4ea6 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:04:45.638607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00dbb8bc-8548-416e-9f0a-f276df35b3e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:45.639833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00dbb8bc-8548-416e-9f0a-f276df35b3e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:45.649056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b128262-7787-44c5-9a1c-01be196671f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] Calling method '.version_select at 0x7f77795cfc10>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:45.660498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00dbb8bc-8548-416e-9f0a-f276df35b3e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:45.666025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00dbb8bc-8548-416e-9f0a-f276df35b3e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:45.666383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00dbb8bc-8548-416e-9f0a-f276df35b3e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:45.667129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00dbb8bc-8548-416e-9f0a-f276df35b3e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:45.667570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00dbb8bc-8548-416e-9f0a-f276df35b3e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:45.667973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00dbb8bc-8548-416e-9f0a-f276df35b3e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:45.704288 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b128262-7787-44c5-9a1c-01be196671f5 tempest-TestNetworkAdvancedServerOps-1621598017 tempest-TestNetworkAdvancedServerOps-1621598017-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-423023667" status: 202 len: 0 microversion: 2.1 time: 0.058431 Oct 05 18:04:45.709339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2754/5257] 10.222.0.70 () {58 vars in 1281 bytes} [Wed Oct 5 18:04:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-423023667 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:04:45.878149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-00dbb8bc-8548-416e-9f0a-f276df35b3e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:45.891770 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00dbb8bc-8548-416e-9f0a-f276df35b3e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1099 microversion: 2.1 time: 0.266187 Oct 05 18:04:45.906666 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2504/5258] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:45 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1099 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:46.072228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0864f88d-201b-4946-8ab1-50e444d5a9d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:46.073075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0864f88d-201b-4946-8ab1-50e444d5a9d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:46.095664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0864f88d-201b-4946-8ab1-50e444d5a9d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:46.096178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0864f88d-201b-4946-8ab1-50e444d5a9d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:46.096622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0864f88d-201b-4946-8ab1-50e444d5a9d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:46.099017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0864f88d-201b-4946-8ab1-50e444d5a9d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:46.101672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0864f88d-201b-4946-8ab1-50e444d5a9d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:46.102117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0864f88d-201b-4946-8ab1-50e444d5a9d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:46.204626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0864f88d-201b-4946-8ab1-50e444d5a9d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:46.215792 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0864f88d-201b-4946-8ab1-50e444d5a9d7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1211 microversion: 2.1 time: 0.149578 Oct 05 18:04:46.216386 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2755/5259] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:46 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1211 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:46.262339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4fe4b35-e7b4-4916-a3a5-50d376d1fdbb tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:46.264350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4fe4b35-e7b4-4916-a3a5-50d376d1fdbb tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:46.271843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4fe4b35-e7b4-4916-a3a5-50d376d1fdbb tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:46.273664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4fe4b35-e7b4-4916-a3a5-50d376d1fdbb tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:46.274711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4fe4b35-e7b4-4916-a3a5-50d376d1fdbb tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:46.275487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4fe4b35-e7b4-4916-a3a5-50d376d1fdbb tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:46.275993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4fe4b35-e7b4-4916-a3a5-50d376d1fdbb tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:46.276482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4fe4b35-e7b4-4916-a3a5-50d376d1fdbb tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:46.656928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c4fe4b35-e7b4-4916-a3a5-50d376d1fdbb tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:46.688755 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4fe4b35-e7b4-4916-a3a5-50d376d1fdbb tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1427 microversion: 2.1 time: 0.428408 Oct 05 18:04:46.689953 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2505/5260] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:46 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1427 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:46.923690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-39bfa0f9-92bc-47e1-8648-d916b2bea619 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:46.924928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-39bfa0f9-92bc-47e1-8648-d916b2bea619 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:46.936766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39bfa0f9-92bc-47e1-8648-d916b2bea619 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:46.937613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39bfa0f9-92bc-47e1-8648-d916b2bea619 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:46.938237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39bfa0f9-92bc-47e1-8648-d916b2bea619 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:46.943415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39bfa0f9-92bc-47e1-8648-d916b2bea619 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:46.944168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39bfa0f9-92bc-47e1-8648-d916b2bea619 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:46.947468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39bfa0f9-92bc-47e1-8648-d916b2bea619 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:47.240127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c4b8df3-4ad3-4280-a8f0-27f9933a4c9c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:47.241663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9c4b8df3-4ad3-4280-a8f0-27f9933a4c9c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:47.258725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-39bfa0f9-92bc-47e1-8648-d916b2bea619 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:47.270207 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-39bfa0f9-92bc-47e1-8648-d916b2bea619 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1173 microversion: 2.1 time: 0.349994 Oct 05 18:04:47.271180 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2756/5261] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:46 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1173 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:47.288968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4b8df3-4ad3-4280-a8f0-27f9933a4c9c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:47.294170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4b8df3-4ad3-4280-a8f0-27f9933a4c9c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:47.301854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4b8df3-4ad3-4280-a8f0-27f9933a4c9c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:47.320943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4b8df3-4ad3-4280-a8f0-27f9933a4c9c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:47.321916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4b8df3-4ad3-4280-a8f0-27f9933a4c9c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:47.338391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c4b8df3-4ad3-4280-a8f0-27f9933a4c9c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:47.507969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9c4b8df3-4ad3-4280-a8f0-27f9933a4c9c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:47.524636 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9c4b8df3-4ad3-4280-a8f0-27f9933a4c9c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1275 microversion: 2.1 time: 0.288713 Oct 05 18:04:47.525238 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2506/5262] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:47 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1275 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:47.731421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b549ed88-eef7-4fe1-af7d-1af6256286ea tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:47.732744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b549ed88-eef7-4fe1-af7d-1af6256286ea tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:47.752088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b549ed88-eef7-4fe1-af7d-1af6256286ea tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:47.753268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b549ed88-eef7-4fe1-af7d-1af6256286ea tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:47.754969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b549ed88-eef7-4fe1-af7d-1af6256286ea tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:47.759410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b549ed88-eef7-4fe1-af7d-1af6256286ea tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:47.760200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b549ed88-eef7-4fe1-af7d-1af6256286ea tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:47.761684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b549ed88-eef7-4fe1-af7d-1af6256286ea tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:48.297152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2c6f4ad8-fe5d-4cf4-a119-f8d320822c58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:48.298575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2c6f4ad8-fe5d-4cf4-a119-f8d320822c58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:48.312232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c6f4ad8-fe5d-4cf4-a119-f8d320822c58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:48.314874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c6f4ad8-fe5d-4cf4-a119-f8d320822c58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:48.315983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c6f4ad8-fe5d-4cf4-a119-f8d320822c58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:48.317033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c6f4ad8-fe5d-4cf4-a119-f8d320822c58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:48.321072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c6f4ad8-fe5d-4cf4-a119-f8d320822c58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:48.321758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c6f4ad8-fe5d-4cf4-a119-f8d320822c58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:48.440975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2c6f4ad8-fe5d-4cf4-a119-f8d320822c58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:48.452349 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2c6f4ad8-fe5d-4cf4-a119-f8d320822c58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1173 microversion: 2.1 time: 0.159005 Oct 05 18:04:48.460164 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2507/5263] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:48 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1173 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:48.554547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-032f52f9-54a6-4b53-820a-d3ae063d4714 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:48.555905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-032f52f9-54a6-4b53-820a-d3ae063d4714 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:48.564297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-032f52f9-54a6-4b53-820a-d3ae063d4714 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:48.570829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b549ed88-eef7-4fe1-af7d-1af6256286ea tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:48.575832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-032f52f9-54a6-4b53-820a-d3ae063d4714 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:48.580830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-032f52f9-54a6-4b53-820a-d3ae063d4714 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:48.584286 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b549ed88-eef7-4fe1-af7d-1af6256286ea tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1606 microversion: 2.1 time: 0.857749 Oct 05 18:04:48.586491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-032f52f9-54a6-4b53-820a-d3ae063d4714 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:48.587230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-032f52f9-54a6-4b53-820a-d3ae063d4714 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:48.588162 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2757/5264] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:47 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1606 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:48.599205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-032f52f9-54a6-4b53-820a-d3ae063d4714 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:48.633068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f8d37334-7b07-41d5-b0d3-79dc2edea9ed tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:48.634987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f8d37334-7b07-41d5-b0d3-79dc2edea9ed tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:48.654828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8d37334-7b07-41d5-b0d3-79dc2edea9ed tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:48.655658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8d37334-7b07-41d5-b0d3-79dc2edea9ed tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:48.656314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8d37334-7b07-41d5-b0d3-79dc2edea9ed tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:48.657605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8d37334-7b07-41d5-b0d3-79dc2edea9ed tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:48.658661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8d37334-7b07-41d5-b0d3-79dc2edea9ed tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:48.659303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8d37334-7b07-41d5-b0d3-79dc2edea9ed tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:48.759301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-032f52f9-54a6-4b53-820a-d3ae063d4714 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:48.771796 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-032f52f9-54a6-4b53-820a-d3ae063d4714 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1273 microversion: 2.1 time: 0.222163 Oct 05 18:04:48.795552 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2508/5265] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:48 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1273 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:49.476980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a776391-3423-46cc-bdac-e21d64c1aad7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:49.478527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0a776391-3423-46cc-bdac-e21d64c1aad7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:49.495397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a776391-3423-46cc-bdac-e21d64c1aad7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:49.497979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a776391-3423-46cc-bdac-e21d64c1aad7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:49.499195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a776391-3423-46cc-bdac-e21d64c1aad7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:49.501433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a776391-3423-46cc-bdac-e21d64c1aad7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:49.504737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a776391-3423-46cc-bdac-e21d64c1aad7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:49.505794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a776391-3423-46cc-bdac-e21d64c1aad7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:49.695122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0a776391-3423-46cc-bdac-e21d64c1aad7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:49.708000 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0a776391-3423-46cc-bdac-e21d64c1aad7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1215 microversion: 2.1 time: 0.235620 Oct 05 18:04:49.709308 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2509/5266] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:49 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:49.799424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9eb25ddd-37f7-436a-aa9b-0ab79c9edd3e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:49.800219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9eb25ddd-37f7-436a-aa9b-0ab79c9edd3e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:49.815912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb25ddd-37f7-436a-aa9b-0ab79c9edd3e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:49.819520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb25ddd-37f7-436a-aa9b-0ab79c9edd3e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:49.820115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb25ddd-37f7-436a-aa9b-0ab79c9edd3e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:49.820981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb25ddd-37f7-436a-aa9b-0ab79c9edd3e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:49.821733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb25ddd-37f7-436a-aa9b-0ab79c9edd3e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:49.824900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9eb25ddd-37f7-436a-aa9b-0ab79c9edd3e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:50.019819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f8d37334-7b07-41d5-b0d3-79dc2edea9ed tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:50.037216 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f8d37334-7b07-41d5-b0d3-79dc2edea9ed tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1606 microversion: 2.1 time: 1.422896 Oct 05 18:04:50.049461 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2758/5267] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:48 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1606 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:50.072857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-45cea4eb-c1ab-4c46-b76c-2b5ba70f96c5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:50.079077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-45cea4eb-c1ab-4c46-b76c-2b5ba70f96c5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:50.107823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45cea4eb-c1ab-4c46-b76c-2b5ba70f96c5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:50.108539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45cea4eb-c1ab-4c46-b76c-2b5ba70f96c5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:50.109168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45cea4eb-c1ab-4c46-b76c-2b5ba70f96c5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:50.112893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45cea4eb-c1ab-4c46-b76c-2b5ba70f96c5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:50.125993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45cea4eb-c1ab-4c46-b76c-2b5ba70f96c5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:50.126771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45cea4eb-c1ab-4c46-b76c-2b5ba70f96c5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:50.260861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9eb25ddd-37f7-436a-aa9b-0ab79c9edd3e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:50.269240 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9eb25ddd-37f7-436a-aa9b-0ab79c9edd3e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1315 microversion: 2.1 time: 0.474037 Oct 05 18:04:50.278637 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2510/5268] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:49 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:50.656339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-45cea4eb-c1ab-4c46-b76c-2b5ba70f96c5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:50.699190 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-45cea4eb-c1ab-4c46-b76c-2b5ba70f96c5 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1606 microversion: 2.1 time: 0.631322 Oct 05 18:04:50.699804 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2759/5269] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:50 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1606 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:50.733691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2f189061-981b-4458-b529-83656413a223 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:50.734140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2f189061-981b-4458-b529-83656413a223 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:50.754123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f189061-981b-4458-b529-83656413a223 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:50.754722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f189061-981b-4458-b529-83656413a223 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:50.755399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f189061-981b-4458-b529-83656413a223 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:50.756324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f189061-981b-4458-b529-83656413a223 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:50.756991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f189061-981b-4458-b529-83656413a223 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:50.757616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f189061-981b-4458-b529-83656413a223 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:51.097433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2f189061-981b-4458-b529-83656413a223 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:51.151600 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2f189061-981b-4458-b529-83656413a223 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1215 microversion: 2.1 time: 0.422085 Oct 05 18:04:51.159639 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2511/5270] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:50 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1215 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:51.295349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a80a9951-bef3-405e-bfee-4a20e0b84b20 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:51.298695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a80a9951-bef3-405e-bfee-4a20e0b84b20 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:51.330728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a80a9951-bef3-405e-bfee-4a20e0b84b20 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:51.331452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a80a9951-bef3-405e-bfee-4a20e0b84b20 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:51.331990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a80a9951-bef3-405e-bfee-4a20e0b84b20 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:51.333487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a80a9951-bef3-405e-bfee-4a20e0b84b20 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:51.334045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a80a9951-bef3-405e-bfee-4a20e0b84b20 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:51.342952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a80a9951-bef3-405e-bfee-4a20e0b84b20 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:51.899460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a80a9951-bef3-405e-bfee-4a20e0b84b20 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:51.918455 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a80a9951-bef3-405e-bfee-4a20e0b84b20 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1315 microversion: 2.1 time: 0.626990 Oct 05 18:04:51.949156 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2760/5271] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:51 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1315 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:52.178429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-21bc9596-099e-438a-ac67-45a5a5c8ac1a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:52.179839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-21bc9596-099e-438a-ac67-45a5a5c8ac1a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:52.201040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bc9596-099e-438a-ac67-45a5a5c8ac1a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:52.214019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bc9596-099e-438a-ac67-45a5a5c8ac1a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:52.221291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bc9596-099e-438a-ac67-45a5a5c8ac1a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:52.228859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bc9596-099e-438a-ac67-45a5a5c8ac1a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:52.231050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bc9596-099e-438a-ac67-45a5a5c8ac1a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:52.231613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bc9596-099e-438a-ac67-45a5a5c8ac1a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:52.303285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-509130bb-7d96-40af-88b7-3e2d671b913f req-6bd5e778-f81d-4e6f-b57b-41c10ee11c0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08fb6775-32b9-4aa9-85bb-1720cad0a1fe", "tag": "e0226d6c-12ae-4b6d-b570-3adbe98456cd"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:52.325372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-509130bb-7d96-40af-88b7-3e2d671b913f req-6bd5e778-f81d-4e6f-b57b-41c10ee11c0b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:52.329190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-509130bb-7d96-40af-88b7-3e2d671b913f req-6bd5e778-f81d-4e6f-b57b-41c10ee11c0b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:52.333437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-509130bb-7d96-40af-88b7-3e2d671b913f req-6bd5e778-f81d-4e6f-b57b-41c10ee11c0b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:52.362975 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-509130bb-7d96-40af-88b7-3e2d671b913f req-6bd5e778-f81d-4e6f-b57b-41c10ee11c0b service nova] Creating event network-changed:e0226d6c-12ae-4b6d-b570-3adbe98456cd for instance 08fb6775-32b9-4aa9-85bb-1720cad0a1fe on n-h2-835595-3 Oct 05 18:04:52.379334 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-509130bb-7d96-40af-88b7-3e2d671b913f req-6bd5e778-f81d-4e6f-b57b-41c10ee11c0b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081111 Oct 05 18:04:52.380340 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2761/5272] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:52.617046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-21bc9596-099e-438a-ac67-45a5a5c8ac1a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:52.631972 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-21bc9596-099e-438a-ac67-45a5a5c8ac1a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1215 microversion: 2.1 time: 0.457414 Oct 05 18:04:52.632802 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2512/5273] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:52 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1215 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:52.958843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6aca81cf-edd2-4678-a06d-b9e2b7acbfc7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:52.959593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6aca81cf-edd2-4678-a06d-b9e2b7acbfc7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:52.980169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aca81cf-edd2-4678-a06d-b9e2b7acbfc7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:52.980949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aca81cf-edd2-4678-a06d-b9e2b7acbfc7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:52.981421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aca81cf-edd2-4678-a06d-b9e2b7acbfc7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:52.982188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aca81cf-edd2-4678-a06d-b9e2b7acbfc7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:52.982687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aca81cf-edd2-4678-a06d-b9e2b7acbfc7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:52.985514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6aca81cf-edd2-4678-a06d-b9e2b7acbfc7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:53.399769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:53.499683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6aca81cf-edd2-4678-a06d-b9e2b7acbfc7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:53.514996 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6aca81cf-edd2-4678-a06d-b9e2b7acbfc7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1315 microversion: 2.1 time: 0.561030 Oct 05 18:04:53.520079 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2762/5274] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:52 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:53.657223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6677e59f-241e-462a-a49f-4e776c86c3f3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:53.657839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6677e59f-241e-462a-a49f-4e776c86c3f3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:53.674542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6677e59f-241e-462a-a49f-4e776c86c3f3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:53.675041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6677e59f-241e-462a-a49f-4e776c86c3f3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:53.675473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6677e59f-241e-462a-a49f-4e776c86c3f3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:53.676210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6677e59f-241e-462a-a49f-4e776c86c3f3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:53.676663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6677e59f-241e-462a-a49f-4e776c86c3f3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:53.677080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6677e59f-241e-462a-a49f-4e776c86c3f3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:54.389545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6677e59f-241e-462a-a49f-4e776c86c3f3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:54.409105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:54.431973 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6677e59f-241e-462a-a49f-4e776c86c3f3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1215 microversion: 2.1 time: 0.778494 Oct 05 18:04:54.438633 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2513/5275] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:53 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1215 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:54.473463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-68c4e012-d6a7-44f9-a5a2-79fe31968681 req-3901a145-1cc4-426b-9b2e-9fbac5e3bf46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40af7dd2-0a4d-49e3-87ab-798958f50b1b", "tag": "b2ebc6e6-ad62-4c19-ba2c-1ee07130a1ea"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:54.501639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-68c4e012-d6a7-44f9-a5a2-79fe31968681 req-3901a145-1cc4-426b-9b2e-9fbac5e3bf46 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:54.502126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-68c4e012-d6a7-44f9-a5a2-79fe31968681 req-3901a145-1cc4-426b-9b2e-9fbac5e3bf46 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:54.502588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-68c4e012-d6a7-44f9-a5a2-79fe31968681 req-3901a145-1cc4-426b-9b2e-9fbac5e3bf46 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:54.534072 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-68c4e012-d6a7-44f9-a5a2-79fe31968681 req-3901a145-1cc4-426b-9b2e-9fbac5e3bf46 service nova] Creating event network-changed:b2ebc6e6-ad62-4c19-ba2c-1ee07130a1ea for instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b on n-h2-835595-3 Oct 05 18:04:54.542225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b130946a-9b8f-4243-a982-c8c6b20db1f7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:54.543333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b130946a-9b8f-4243-a982-c8c6b20db1f7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:54.551855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:54.553417 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-68c4e012-d6a7-44f9-a5a2-79fe31968681 req-3901a145-1cc4-426b-9b2e-9fbac5e3bf46 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083620 Oct 05 18:04:54.554258 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2763/5276] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:54.564289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b130946a-9b8f-4243-a982-c8c6b20db1f7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:54.566524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b130946a-9b8f-4243-a982-c8c6b20db1f7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:54.567239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b130946a-9b8f-4243-a982-c8c6b20db1f7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:54.569782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b130946a-9b8f-4243-a982-c8c6b20db1f7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:54.572681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b130946a-9b8f-4243-a982-c8c6b20db1f7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:54.573412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b130946a-9b8f-4243-a982-c8c6b20db1f7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:54.854006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b130946a-9b8f-4243-a982-c8c6b20db1f7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:54.869768 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b130946a-9b8f-4243-a982-c8c6b20db1f7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1315 microversion: 2.1 time: 0.332720 Oct 05 18:04:54.876042 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2514/5277] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:54 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1315 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:55.206533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9d321417-f905-43ef-a962-1b25b1ae7a90 req-9704578d-0afb-4085-9407-033d1a2f3c64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fdba702-9493-4ecd-b235-130e14ded381", "tag": "d9df39d1-abfc-4113-a208-43effcd9dbfc"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:55.221473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=10 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:55.225866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9d321417-f905-43ef-a962-1b25b1ae7a90 req-9704578d-0afb-4085-9407-033d1a2f3c64 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:55.228056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9d321417-f905-43ef-a962-1b25b1ae7a90 req-9704578d-0afb-4085-9407-033d1a2f3c64 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:55.230339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9d321417-f905-43ef-a962-1b25b1ae7a90 req-9704578d-0afb-4085-9407-033d1a2f3c64 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:55.258859 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9d321417-f905-43ef-a962-1b25b1ae7a90 req-9704578d-0afb-4085-9407-033d1a2f3c64 service nova] Creating event network-changed:d9df39d1-abfc-4113-a208-43effcd9dbfc for instance 0fdba702-9493-4ecd-b235-130e14ded381 on n-h1-835595-3 Oct 05 18:04:55.272221 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9d321417-f905-43ef-a962-1b25b1ae7a90 req-9704578d-0afb-4085-9407-033d1a2f3c64 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067348 Oct 05 18:04:55.273528 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2764/5278] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:55.464489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43b9a0ad-5484-4efe-b94c-fd108941e53a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:55.465404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-43b9a0ad-5484-4efe-b94c-fd108941e53a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:55.474216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43b9a0ad-5484-4efe-b94c-fd108941e53a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:55.478942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43b9a0ad-5484-4efe-b94c-fd108941e53a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:55.479594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43b9a0ad-5484-4efe-b94c-fd108941e53a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:55.481057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43b9a0ad-5484-4efe-b94c-fd108941e53a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:55.483940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43b9a0ad-5484-4efe-b94c-fd108941e53a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:55.484714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43b9a0ad-5484-4efe-b94c-fd108941e53a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:55.899746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3fc11c3-b57a-4c84-8219-d526b4413eb6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:55.900449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b3fc11c3-b57a-4c84-8219-d526b4413eb6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:55.935966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fc11c3-b57a-4c84-8219-d526b4413eb6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:55.951229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fc11c3-b57a-4c84-8219-d526b4413eb6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:55.951682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fc11c3-b57a-4c84-8219-d526b4413eb6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:55.952436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fc11c3-b57a-4c84-8219-d526b4413eb6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:55.952897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fc11c3-b57a-4c84-8219-d526b4413eb6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:55.962779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3fc11c3-b57a-4c84-8219-d526b4413eb6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:56.218460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-43b9a0ad-5484-4efe-b94c-fd108941e53a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:56.230024 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-43b9a0ad-5484-4efe-b94c-fd108941e53a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1215 microversion: 2.1 time: 0.769507 Oct 05 18:04:56.233178 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2515/5279] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:55 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1215 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:56.492433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3fc11c3-b57a-4c84-8219-d526b4413eb6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:56.506034 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3fc11c3-b57a-4c84-8219-d526b4413eb6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1315 microversion: 2.1 time: 0.612653 Oct 05 18:04:56.511137 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2765/5280] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:55 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1315 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:04:57.253768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a97e4aff-52fd-4d33-be71-2cfff053f601 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:57.254881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a97e4aff-52fd-4d33-be71-2cfff053f601 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:57.278168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a97e4aff-52fd-4d33-be71-2cfff053f601 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:57.279281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a97e4aff-52fd-4d33-be71-2cfff053f601 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:57.279895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a97e4aff-52fd-4d33-be71-2cfff053f601 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:57.280843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a97e4aff-52fd-4d33-be71-2cfff053f601 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:57.281473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a97e4aff-52fd-4d33-be71-2cfff053f601 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:57.282065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a97e4aff-52fd-4d33-be71-2cfff053f601 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:57.541025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7ef9a8f4-f8f6-48e5-aaa1-255798e2e453 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:57.543421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7ef9a8f4-f8f6-48e5-aaa1-255798e2e453 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:57.568080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ef9a8f4-f8f6-48e5-aaa1-255798e2e453 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:57.568592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ef9a8f4-f8f6-48e5-aaa1-255798e2e453 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:57.579481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ef9a8f4-f8f6-48e5-aaa1-255798e2e453 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:57.580389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ef9a8f4-f8f6-48e5-aaa1-255798e2e453 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:57.580943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ef9a8f4-f8f6-48e5-aaa1-255798e2e453 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:57.581324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7ef9a8f4-f8f6-48e5-aaa1-255798e2e453 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:57.595489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a97e4aff-52fd-4d33-be71-2cfff053f601 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:57.609229 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a97e4aff-52fd-4d33-be71-2cfff053f601 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1215 microversion: 2.1 time: 0.359779 Oct 05 18:04:57.612068 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2516/5281] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:57 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1215 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:58.503411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7ef9a8f4-f8f6-48e5-aaa1-255798e2e453 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:58.512196 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7ef9a8f4-f8f6-48e5-aaa1-255798e2e453 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1315 microversion: 2.1 time: 0.977605 Oct 05 18:04:58.513577 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2766/5282] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:57 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1315 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:58.639863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a7b2f4c7-3700-4410-889f-66b49d33b955 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:58.640488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a7b2f4c7-3700-4410-889f-66b49d33b955 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:58.650935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7b2f4c7-3700-4410-889f-66b49d33b955 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:58.651532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7b2f4c7-3700-4410-889f-66b49d33b955 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:58.652161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7b2f4c7-3700-4410-889f-66b49d33b955 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:58.653129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7b2f4c7-3700-4410-889f-66b49d33b955 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:58.653848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7b2f4c7-3700-4410-889f-66b49d33b955 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:58.654494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7b2f4c7-3700-4410-889f-66b49d33b955 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:58.836617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a7b2f4c7-3700-4410-889f-66b49d33b955 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:58.838922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:04:58.852257 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a7b2f4c7-3700-4410-889f-66b49d33b955 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1215 microversion: 2.1 time: 0.218077 Oct 05 18:04:58.853440 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2517/5283] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:58 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:58.946028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-faa37ecb-cbb2-4f7f-b6da-12ec5793e25b req-a381c2f4-bd7b-4a0b-9ec9-5966f7c9d31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40af7dd2-0a4d-49e3-87ab-798958f50b1b", "name": "network-vif-plugged", "status": "completed", "tag": "b2ebc6e6-ad62-4c19-ba2c-1ee07130a1ea"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:04:58.968090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-faa37ecb-cbb2-4f7f-b6da-12ec5793e25b req-a381c2f4-bd7b-4a0b-9ec9-5966f7c9d31b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:58.970173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-faa37ecb-cbb2-4f7f-b6da-12ec5793e25b req-a381c2f4-bd7b-4a0b-9ec9-5966f7c9d31b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:58.971498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-faa37ecb-cbb2-4f7f-b6da-12ec5793e25b req-a381c2f4-bd7b-4a0b-9ec9-5966f7c9d31b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:58.994236 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-faa37ecb-cbb2-4f7f-b6da-12ec5793e25b req-a381c2f4-bd7b-4a0b-9ec9-5966f7c9d31b service nova] Creating event network-vif-plugged:b2ebc6e6-ad62-4c19-ba2c-1ee07130a1ea for instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b on n-h2-835595-3 Oct 05 18:04:59.013132 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-faa37ecb-cbb2-4f7f-b6da-12ec5793e25b req-a381c2f4-bd7b-4a0b-9ec9-5966f7c9d31b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070823 Oct 05 18:04:59.013771 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2767/5284] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:04:59.539085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-828801c1-f840-4d7f-a64a-dfb8f2f1ba44 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:59.539734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-828801c1-f840-4d7f-a64a-dfb8f2f1ba44 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:59.546566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-828801c1-f840-4d7f-a64a-dfb8f2f1ba44 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:59.547087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-828801c1-f840-4d7f-a64a-dfb8f2f1ba44 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:59.547583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-828801c1-f840-4d7f-a64a-dfb8f2f1ba44 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:59.548329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-828801c1-f840-4d7f-a64a-dfb8f2f1ba44 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:59.548803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-828801c1-f840-4d7f-a64a-dfb8f2f1ba44 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:59.549223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-828801c1-f840-4d7f-a64a-dfb8f2f1ba44 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:59.698696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-828801c1-f840-4d7f-a64a-dfb8f2f1ba44 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:04:59.710679 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-828801c1-f840-4d7f-a64a-dfb8f2f1ba44 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1315 microversion: 2.1 time: 0.177085 Oct 05 18:04:59.716393 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2518/5285] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:59 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:04:59.880639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ed830e1-ad72-4b7d-b287-fd2a5832c40b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:04:59.884436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ed830e1-ad72-4b7d-b287-fd2a5832c40b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:04:59.895322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed830e1-ad72-4b7d-b287-fd2a5832c40b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:59.896054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed830e1-ad72-4b7d-b287-fd2a5832c40b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:59.896610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed830e1-ad72-4b7d-b287-fd2a5832c40b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:04:59.897514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed830e1-ad72-4b7d-b287-fd2a5832c40b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:04:59.898346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed830e1-ad72-4b7d-b287-fd2a5832c40b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:04:59.899071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ed830e1-ad72-4b7d-b287-fd2a5832c40b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:00.068754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5ed830e1-ad72-4b7d-b287-fd2a5832c40b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:00.078946 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ed830e1-ad72-4b7d-b287-fd2a5832c40b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1203 microversion: 2.1 time: 0.202962 Oct 05 18:05:00.095079 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2768/5286] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:04:59 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1203 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:00.733595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-82cc31db-9d37-4368-9d75-e6bfacb475cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:00.734988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-82cc31db-9d37-4368-9d75-e6bfacb475cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:00.744909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82cc31db-9d37-4368-9d75-e6bfacb475cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:00.745601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82cc31db-9d37-4368-9d75-e6bfacb475cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:00.746239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82cc31db-9d37-4368-9d75-e6bfacb475cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:00.747169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82cc31db-9d37-4368-9d75-e6bfacb475cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:00.747797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82cc31db-9d37-4368-9d75-e6bfacb475cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:00.748394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82cc31db-9d37-4368-9d75-e6bfacb475cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:01.009760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-82cc31db-9d37-4368-9d75-e6bfacb475cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:01.018604 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-82cc31db-9d37-4368-9d75-e6bfacb475cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1502 microversion: 2.1 time: 0.288856 Oct 05 18:05:01.035838 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2519/5287] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:00 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:01.045346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d92d8d69-0e0e-4962-a392-bcc5425ac89a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:01.060833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d92d8d69-0e0e-4962-a392-bcc5425ac89a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:01.061591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d92d8d69-0e0e-4962-a392-bcc5425ac89a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:01.062246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d92d8d69-0e0e-4962-a392-bcc5425ac89a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:01.066528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:UPDATE=11,nova_cell1:DELETE=2,nova_cell1:SELECT=87 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:01.104104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d27e6254-6bcf-4c40-945d-98fae7a84532 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:01.104642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d27e6254-6bcf-4c40-945d-98fae7a84532 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:01.115726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d27e6254-6bcf-4c40-945d-98fae7a84532 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:01.116501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d27e6254-6bcf-4c40-945d-98fae7a84532 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:01.117171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d27e6254-6bcf-4c40-945d-98fae7a84532 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:01.118091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d27e6254-6bcf-4c40-945d-98fae7a84532 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:01.118578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d92d8d69-0e0e-4962-a392-bcc5425ac89a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Going to try to stop instance {{(pid=128844) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 18:05:01.125134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d27e6254-6bcf-4c40-945d-98fae7a84532 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:01.125878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d27e6254-6bcf-4c40-945d-98fae7a84532 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:01.204558 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d92d8d69-0e0e-4962-a392-bcc5425ac89a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b/action" status: 202 len: 0 microversion: 2.1 time: 0.162868 Oct 05 18:05:01.214511 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2769/5288] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:05:01 2022] POST /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:05:01.232281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1e7b2717-4272-4d8e-bfd8-db5e46abedc6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:01.236013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1e7b2717-4272-4d8e-bfd8-db5e46abedc6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:01.252651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e7b2717-4272-4d8e-bfd8-db5e46abedc6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:01.253185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e7b2717-4272-4d8e-bfd8-db5e46abedc6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:01.253631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e7b2717-4272-4d8e-bfd8-db5e46abedc6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:01.254434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e7b2717-4272-4d8e-bfd8-db5e46abedc6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:01.259031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e7b2717-4272-4d8e-bfd8-db5e46abedc6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:01.259835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1e7b2717-4272-4d8e-bfd8-db5e46abedc6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:01.358065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d27e6254-6bcf-4c40-945d-98fae7a84532 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:01.369763 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d27e6254-6bcf-4c40-945d-98fae7a84532 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1203 microversion: 2.1 time: 0.269785 Oct 05 18:05:01.372058 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2520/5289] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:01 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1203 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:01.513956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1e7b2717-4272-4d8e-bfd8-db5e46abedc6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:01.524529 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1e7b2717-4272-4d8e-bfd8-db5e46abedc6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.301935 Oct 05 18:05:01.525517 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2770/5290] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:01 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:02.399766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-62d123fd-e192-4091-a3b7-9e99e73026c3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:02.401159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-62d123fd-e192-4091-a3b7-9e99e73026c3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:02.421891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62d123fd-e192-4091-a3b7-9e99e73026c3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:02.424703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62d123fd-e192-4091-a3b7-9e99e73026c3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:02.425397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62d123fd-e192-4091-a3b7-9e99e73026c3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:02.429713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62d123fd-e192-4091-a3b7-9e99e73026c3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:02.430459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62d123fd-e192-4091-a3b7-9e99e73026c3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:02.430960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62d123fd-e192-4091-a3b7-9e99e73026c3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:02.549768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-032193ce-96ff-48c8-8071-64dd7abda272 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:02.551065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-032193ce-96ff-48c8-8071-64dd7abda272 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:02.566945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-032193ce-96ff-48c8-8071-64dd7abda272 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:02.567457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-032193ce-96ff-48c8-8071-64dd7abda272 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:02.567893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-032193ce-96ff-48c8-8071-64dd7abda272 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:02.568604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-032193ce-96ff-48c8-8071-64dd7abda272 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:02.569056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-032193ce-96ff-48c8-8071-64dd7abda272 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:02.569474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-032193ce-96ff-48c8-8071-64dd7abda272 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:02.730112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-62d123fd-e192-4091-a3b7-9e99e73026c3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:02.740721 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-62d123fd-e192-4091-a3b7-9e99e73026c3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1203 microversion: 2.1 time: 0.351552 Oct 05 18:05:02.741833 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2521/5291] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:02 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1203 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:02.845704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-032193ce-96ff-48c8-8071-64dd7abda272 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:02.854930 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-032193ce-96ff-48c8-8071-64dd7abda272 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.309019 Oct 05 18:05:02.856389 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2771/5292] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:02 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:03.764729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da5d9a84-ed31-40a9-bb97-67bd0a1a1ef7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:03.765339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da5d9a84-ed31-40a9-bb97-67bd0a1a1ef7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:03.780733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da5d9a84-ed31-40a9-bb97-67bd0a1a1ef7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:03.781375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da5d9a84-ed31-40a9-bb97-67bd0a1a1ef7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:03.781872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da5d9a84-ed31-40a9-bb97-67bd0a1a1ef7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:03.782692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da5d9a84-ed31-40a9-bb97-67bd0a1a1ef7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:03.783203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da5d9a84-ed31-40a9-bb97-67bd0a1a1ef7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:03.783684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da5d9a84-ed31-40a9-bb97-67bd0a1a1ef7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:03.883141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4dd0bb97-5112-4ff4-a117-63850b6e8268 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:03.884400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4dd0bb97-5112-4ff4-a117-63850b6e8268 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:03.898157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dd0bb97-5112-4ff4-a117-63850b6e8268 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:03.900117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dd0bb97-5112-4ff4-a117-63850b6e8268 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:03.902881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dd0bb97-5112-4ff4-a117-63850b6e8268 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:03.904195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dd0bb97-5112-4ff4-a117-63850b6e8268 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:03.904831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dd0bb97-5112-4ff4-a117-63850b6e8268 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:03.905480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4dd0bb97-5112-4ff4-a117-63850b6e8268 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:03.981154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-da5d9a84-ed31-40a9-bb97-67bd0a1a1ef7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:03.990365 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da5d9a84-ed31-40a9-bb97-67bd0a1a1ef7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1203 microversion: 2.1 time: 0.229160 Oct 05 18:05:04.002540 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2522/5293] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:03 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1203 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:04.075889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4dd0bb97-5112-4ff4-a117-63850b6e8268 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:04.084300 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4dd0bb97-5112-4ff4-a117-63850b6e8268 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.205695 Oct 05 18:05:04.085549 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2772/5294] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:03 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:05.014629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-74730348-183a-4fbd-bc87-52e9e068cfc7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:05.015289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-74730348-183a-4fbd-bc87-52e9e068cfc7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:05.032711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74730348-183a-4fbd-bc87-52e9e068cfc7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:05.033167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74730348-183a-4fbd-bc87-52e9e068cfc7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:05.033610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74730348-183a-4fbd-bc87-52e9e068cfc7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:05.034355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74730348-183a-4fbd-bc87-52e9e068cfc7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:05.034822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74730348-183a-4fbd-bc87-52e9e068cfc7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:05.035250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74730348-183a-4fbd-bc87-52e9e068cfc7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:05.107756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a8a5ba2a-4670-4920-8bcc-1f336a1903c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:05.108369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a8a5ba2a-4670-4920-8bcc-1f336a1903c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:05.123683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a5ba2a-4670-4920-8bcc-1f336a1903c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:05.124532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a5ba2a-4670-4920-8bcc-1f336a1903c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:05.124995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a5ba2a-4670-4920-8bcc-1f336a1903c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:05.125914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a5ba2a-4670-4920-8bcc-1f336a1903c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:05.126572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a5ba2a-4670-4920-8bcc-1f336a1903c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:05.127164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8a5ba2a-4670-4920-8bcc-1f336a1903c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:05.254946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-74730348-183a-4fbd-bc87-52e9e068cfc7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:05.264698 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-74730348-183a-4fbd-bc87-52e9e068cfc7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1203 microversion: 2.1 time: 0.253879 Oct 05 18:05:05.280141 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2523/5295] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:05 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1203 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:05.365257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8a5ba2a-4670-4920-8bcc-1f336a1903c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:05.377293 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a8a5ba2a-4670-4920-8bcc-1f336a1903c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.273431 Oct 05 18:05:05.394370 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2773/5296] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:05 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:06.294170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-35da17f6-d64f-4d33-a518-3a33da101d41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:06.298643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-35da17f6-d64f-4d33-a518-3a33da101d41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:06.308220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35da17f6-d64f-4d33-a518-3a33da101d41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:06.309006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35da17f6-d64f-4d33-a518-3a33da101d41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:06.309637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35da17f6-d64f-4d33-a518-3a33da101d41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:06.310399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35da17f6-d64f-4d33-a518-3a33da101d41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:06.310904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35da17f6-d64f-4d33-a518-3a33da101d41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:06.311541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35da17f6-d64f-4d33-a518-3a33da101d41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:06.401773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7db2f6c-0cbb-4053-aa24-d9844fd14c46 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:06.403100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b7db2f6c-0cbb-4053-aa24-d9844fd14c46 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:06.419575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7db2f6c-0cbb-4053-aa24-d9844fd14c46 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:06.419992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7db2f6c-0cbb-4053-aa24-d9844fd14c46 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:06.420439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7db2f6c-0cbb-4053-aa24-d9844fd14c46 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:06.421175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7db2f6c-0cbb-4053-aa24-d9844fd14c46 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:06.421636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7db2f6c-0cbb-4053-aa24-d9844fd14c46 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:06.422069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7db2f6c-0cbb-4053-aa24-d9844fd14c46 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:06.564020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-35da17f6-d64f-4d33-a518-3a33da101d41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:06.576045 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-35da17f6-d64f-4d33-a518-3a33da101d41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1203 microversion: 2.1 time: 0.286861 Oct 05 18:05:06.577419 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2524/5297] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:06 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1203 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:06.901325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b7db2f6c-0cbb-4053-aa24-d9844fd14c46 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:06.926086 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b7db2f6c-0cbb-4053-aa24-d9844fd14c46 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.528488 Oct 05 18:05:06.933066 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2774/5298] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:06 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:07.601292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-05dab39f-1c45-4fd7-9422-a52aeb1bf90f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:07.601954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-05dab39f-1c45-4fd7-9422-a52aeb1bf90f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:07.619452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:07.621028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05dab39f-1c45-4fd7-9422-a52aeb1bf90f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:07.626820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05dab39f-1c45-4fd7-9422-a52aeb1bf90f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:07.627717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05dab39f-1c45-4fd7-9422-a52aeb1bf90f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:07.628136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05dab39f-1c45-4fd7-9422-a52aeb1bf90f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:07.628609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05dab39f-1c45-4fd7-9422-a52aeb1bf90f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:07.639680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05dab39f-1c45-4fd7-9422-a52aeb1bf90f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:07.956188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0d117c67-41b8-4aa8-bc8e-7441c2e1bd09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:07.956907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0d117c67-41b8-4aa8-bc8e-7441c2e1bd09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:07.981260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d117c67-41b8-4aa8-bc8e-7441c2e1bd09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:07.981768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d117c67-41b8-4aa8-bc8e-7441c2e1bd09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:07.982209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d117c67-41b8-4aa8-bc8e-7441c2e1bd09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:07.991303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d117c67-41b8-4aa8-bc8e-7441c2e1bd09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:07.992879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d117c67-41b8-4aa8-bc8e-7441c2e1bd09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:07.993336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d117c67-41b8-4aa8-bc8e-7441c2e1bd09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:08.002047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-05dab39f-1c45-4fd7-9422-a52aeb1bf90f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:08.015725 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-05dab39f-1c45-4fd7-9422-a52aeb1bf90f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1203 microversion: 2.1 time: 0.418946 Oct 05 18:05:08.016328 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2525/5299] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:07 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1203 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:08.284142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0d117c67-41b8-4aa8-bc8e-7441c2e1bd09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:08.300632 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0d117c67-41b8-4aa8-bc8e-7441c2e1bd09 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.348279 Oct 05 18:05:08.317387 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2775/5300] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:07 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:08.899387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-0b7a7475-2f28-4dba-ab5c-01061a1e4210 req-d0b20f5b-79be-4ff7-b263-3710a793dfc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fb6775-32b9-4aa9-85bb-1720cad0a1fe", "name": "network-vif-plugged", "status": "completed", "tag": "e0226d6c-12ae-4b6d-b570-3adbe98456cd"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:08.915023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0b7a7475-2f28-4dba-ab5c-01061a1e4210 req-d0b20f5b-79be-4ff7-b263-3710a793dfc9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:08.915758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0b7a7475-2f28-4dba-ab5c-01061a1e4210 req-d0b20f5b-79be-4ff7-b263-3710a793dfc9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:08.916361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0b7a7475-2f28-4dba-ab5c-01061a1e4210 req-d0b20f5b-79be-4ff7-b263-3710a793dfc9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:08.933238 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-0b7a7475-2f28-4dba-ab5c-01061a1e4210 req-d0b20f5b-79be-4ff7-b263-3710a793dfc9 service nova] Creating event network-vif-plugged:e0226d6c-12ae-4b6d-b570-3adbe98456cd for instance 08fb6775-32b9-4aa9-85bb-1720cad0a1fe on n-h2-835595-3 Oct 05 18:05:08.939287 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-0b7a7475-2f28-4dba-ab5c-01061a1e4210 req-d0b20f5b-79be-4ff7-b263-3710a793dfc9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043385 Oct 05 18:05:08.940373 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2526/5301] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:05:09.045281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-71698947-b273-4bde-a895-0c01d924bc70 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:09.045924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-71698947-b273-4bde-a895-0c01d924bc70 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:09.053817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:09.055659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71698947-b273-4bde-a895-0c01d924bc70 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:09.056363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71698947-b273-4bde-a895-0c01d924bc70 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:09.056902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71698947-b273-4bde-a895-0c01d924bc70 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:09.058013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71698947-b273-4bde-a895-0c01d924bc70 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:09.059737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71698947-b273-4bde-a895-0c01d924bc70 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:09.060446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71698947-b273-4bde-a895-0c01d924bc70 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:09.278485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-71698947-b273-4bde-a895-0c01d924bc70 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:09.288948 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-71698947-b273-4bde-a895-0c01d924bc70 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1203 microversion: 2.1 time: 0.250293 Oct 05 18:05:09.290082 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2776/5302] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:09 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1203 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:09.325776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9a62b2c9-0821-49db-8a25-be196f62d58d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:09.326514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9a62b2c9-0821-49db-8a25-be196f62d58d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:09.340862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a62b2c9-0821-49db-8a25-be196f62d58d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:09.341373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a62b2c9-0821-49db-8a25-be196f62d58d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:09.341802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a62b2c9-0821-49db-8a25-be196f62d58d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:09.342539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a62b2c9-0821-49db-8a25-be196f62d58d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:09.342997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a62b2c9-0821-49db-8a25-be196f62d58d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:09.343419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a62b2c9-0821-49db-8a25-be196f62d58d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:09.538591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9a62b2c9-0821-49db-8a25-be196f62d58d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:09.547239 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9a62b2c9-0821-49db-8a25-be196f62d58d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.225974 Oct 05 18:05:09.548502 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2527/5303] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:09 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:10.317032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9f26fd3e-a265-4c44-96c2-416904648787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:10.318023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9f26fd3e-a265-4c44-96c2-416904648787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:10.326813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f26fd3e-a265-4c44-96c2-416904648787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:10.327371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f26fd3e-a265-4c44-96c2-416904648787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:10.327819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f26fd3e-a265-4c44-96c2-416904648787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:10.328543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f26fd3e-a265-4c44-96c2-416904648787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:10.329029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f26fd3e-a265-4c44-96c2-416904648787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:10.329524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f26fd3e-a265-4c44-96c2-416904648787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:10.513136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9f26fd3e-a265-4c44-96c2-416904648787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:10.521409 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9f26fd3e-a265-4c44-96c2-416904648787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1390 microversion: 2.1 time: 0.209976 Oct 05 18:05:10.535694 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2777/5304] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:10 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1390 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:10.543816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc87bdbc-8a9f-49ac-882d-37e718e13912 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:10.544427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cc87bdbc-8a9f-49ac-882d-37e718e13912 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:10.552096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc87bdbc-8a9f-49ac-882d-37e718e13912 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:10.552819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc87bdbc-8a9f-49ac-882d-37e718e13912 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:10.553424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc87bdbc-8a9f-49ac-882d-37e718e13912 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:10.554316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc87bdbc-8a9f-49ac-882d-37e718e13912 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:10.554957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc87bdbc-8a9f-49ac-882d-37e718e13912 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:10.555552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc87bdbc-8a9f-49ac-882d-37e718e13912 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:10.572046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f431e75e-0714-4f0f-9bfc-7a228597f1bc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:10.572655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f431e75e-0714-4f0f-9bfc-7a228597f1bc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:10.581650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f431e75e-0714-4f0f-9bfc-7a228597f1bc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:10.582477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f431e75e-0714-4f0f-9bfc-7a228597f1bc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:10.583495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f431e75e-0714-4f0f-9bfc-7a228597f1bc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:10.584403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f431e75e-0714-4f0f-9bfc-7a228597f1bc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:10.584868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f431e75e-0714-4f0f-9bfc-7a228597f1bc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:10.585301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f431e75e-0714-4f0f-9bfc-7a228597f1bc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:10.739619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cc87bdbc-8a9f-49ac-882d-37e718e13912 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:10.754130 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cc87bdbc-8a9f-49ac-882d-37e718e13912 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1390 microversion: 2.1 time: 0.211561 Oct 05 18:05:10.755053 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2528/5305] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:10 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1390 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:10.785448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-89025a02-10e1-4c38-82d8-48e6bf80a4e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:10.786161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-89025a02-10e1-4c38-82d8-48e6bf80a4e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:10.792389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89025a02-10e1-4c38-82d8-48e6bf80a4e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:10.792957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89025a02-10e1-4c38-82d8-48e6bf80a4e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:10.793475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89025a02-10e1-4c38-82d8-48e6bf80a4e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:10.794610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89025a02-10e1-4c38-82d8-48e6bf80a4e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:10.795278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89025a02-10e1-4c38-82d8-48e6bf80a4e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:10.795906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89025a02-10e1-4c38-82d8-48e6bf80a4e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:10.836073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f431e75e-0714-4f0f-9bfc-7a228597f1bc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:10.846104 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f431e75e-0714-4f0f-9bfc-7a228597f1bc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.278529 Oct 05 18:05:10.846979 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2778/5306] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:10 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:10.968418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-89025a02-10e1-4c38-82d8-48e6bf80a4e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:10.976837 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-89025a02-10e1-4c38-82d8-48e6bf80a4e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1390 microversion: 2.1 time: 0.204306 Oct 05 18:05:10.990708 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2529/5307] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:10 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1390 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:11.006239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-77fd4b25-4b13-410f-87ba-a1e569ae0313 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:11.008311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-77fd4b25-4b13-410f-87ba-a1e569ae0313 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:11.015188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77fd4b25-4b13-410f-87ba-a1e569ae0313 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:11.016075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77fd4b25-4b13-410f-87ba-a1e569ae0313 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:11.016744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77fd4b25-4b13-410f-87ba-a1e569ae0313 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:11.017710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77fd4b25-4b13-410f-87ba-a1e569ae0313 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:11.018420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77fd4b25-4b13-410f-87ba-a1e569ae0313 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:11.019073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77fd4b25-4b13-410f-87ba-a1e569ae0313 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:11.051503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-77fd4b25-4b13-410f-87ba-a1e569ae0313 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:05:11.178490 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-77fd4b25-4b13-410f-87ba-a1e569ae0313 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 204 len: 0 microversion: 2.1 time: 0.182056 Oct 05 18:05:11.182380 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2779/5308] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:05:10 2022] DELETE /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 18:05:11.189084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69acb911-8f37-467e-8917-82d1f29dabdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:11.189702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-69acb911-8f37-467e-8917-82d1f29dabdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:11.197196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69acb911-8f37-467e-8917-82d1f29dabdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:11.198185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69acb911-8f37-467e-8917-82d1f29dabdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:11.198848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69acb911-8f37-467e-8917-82d1f29dabdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:11.199724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69acb911-8f37-467e-8917-82d1f29dabdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:11.200372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69acb911-8f37-467e-8917-82d1f29dabdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:11.201015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69acb911-8f37-467e-8917-82d1f29dabdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:11.397421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-69acb911-8f37-467e-8917-82d1f29dabdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:11.406571 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69acb911-8f37-467e-8917-82d1f29dabdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1396 microversion: 2.1 time: 0.221698 Oct 05 18:05:11.407247 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2530/5309] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:11 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1396 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:11.870406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8bd63834-f329-40d7-9b0c-1bd74a05bcef tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:11.871849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8bd63834-f329-40d7-9b0c-1bd74a05bcef tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:11.879486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bd63834-f329-40d7-9b0c-1bd74a05bcef tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:11.880319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bd63834-f329-40d7-9b0c-1bd74a05bcef tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:11.881009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bd63834-f329-40d7-9b0c-1bd74a05bcef tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:11.881962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bd63834-f329-40d7-9b0c-1bd74a05bcef tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:11.882678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bd63834-f329-40d7-9b0c-1bd74a05bcef tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:11.883334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8bd63834-f329-40d7-9b0c-1bd74a05bcef tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:12.056745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8bd63834-f329-40d7-9b0c-1bd74a05bcef tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:12.065378 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8bd63834-f329-40d7-9b0c-1bd74a05bcef tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.199276 Oct 05 18:05:12.068362 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2780/5310] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:11 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:12.429346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d3a005fa-1125-4c3f-8688-3806a87f5a17 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:12.430003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d3a005fa-1125-4c3f-8688-3806a87f5a17 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:12.446692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3a005fa-1125-4c3f-8688-3806a87f5a17 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:12.447355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3a005fa-1125-4c3f-8688-3806a87f5a17 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:12.447814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3a005fa-1125-4c3f-8688-3806a87f5a17 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:12.454634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3a005fa-1125-4c3f-8688-3806a87f5a17 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:12.454634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3a005fa-1125-4c3f-8688-3806a87f5a17 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:12.454634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3a005fa-1125-4c3f-8688-3806a87f5a17 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:12.689260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d3a005fa-1125-4c3f-8688-3806a87f5a17 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:12.698615 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d3a005fa-1125-4c3f-8688-3806a87f5a17 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1396 microversion: 2.1 time: 0.273303 Oct 05 18:05:12.700437 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2531/5311] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:12 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1396 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:13.090059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5178025a-d191-4806-b5bf-d28bb1eab55c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:13.090714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5178025a-d191-4806-b5bf-d28bb1eab55c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:13.101978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5178025a-d191-4806-b5bf-d28bb1eab55c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:13.102576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5178025a-d191-4806-b5bf-d28bb1eab55c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:13.102969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5178025a-d191-4806-b5bf-d28bb1eab55c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:13.108191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5178025a-d191-4806-b5bf-d28bb1eab55c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:13.108719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5178025a-d191-4806-b5bf-d28bb1eab55c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:13.114751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5178025a-d191-4806-b5bf-d28bb1eab55c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:13.323711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5178025a-d191-4806-b5bf-d28bb1eab55c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:13.336804 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5178025a-d191-4806-b5bf-d28bb1eab55c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.251414 Oct 05 18:05:13.337823 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2781/5312] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:13 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:13.617731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-2708ef07-3e3e-4728-b645-a25560536fc3 req-e0af5809-ef46-4818-9846-44658427d20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fb6775-32b9-4aa9-85bb-1720cad0a1fe", "name": "network-vif-deleted", "tag": "e0226d6c-12ae-4b6d-b570-3adbe98456cd"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:13.632078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2708ef07-3e3e-4728-b645-a25560536fc3 req-e0af5809-ef46-4818-9846-44658427d20d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:13.632953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2708ef07-3e3e-4728-b645-a25560536fc3 req-e0af5809-ef46-4818-9846-44658427d20d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:13.633639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2708ef07-3e3e-4728-b645-a25560536fc3 req-e0af5809-ef46-4818-9846-44658427d20d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:13.663359 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-2708ef07-3e3e-4728-b645-a25560536fc3 req-e0af5809-ef46-4818-9846-44658427d20d service nova] Creating event network-vif-deleted:e0226d6c-12ae-4b6d-b570-3adbe98456cd for instance 08fb6775-32b9-4aa9-85bb-1720cad0a1fe on n-h2-835595-3 Oct 05 18:05:13.675703 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-2708ef07-3e3e-4728-b645-a25560536fc3 req-e0af5809-ef46-4818-9846-44658427d20d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061925 Oct 05 18:05:13.692446 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2532/5313] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:05:13.725989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbcf0634-a6c0-4450-a3fd-c4500797e45a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:13.727027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dbcf0634-a6c0-4450-a3fd-c4500797e45a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:13.734517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbcf0634-a6c0-4450-a3fd-c4500797e45a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:13.735272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbcf0634-a6c0-4450-a3fd-c4500797e45a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:13.736035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbcf0634-a6c0-4450-a3fd-c4500797e45a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:13.737196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbcf0634-a6c0-4450-a3fd-c4500797e45a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:13.738009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbcf0634-a6c0-4450-a3fd-c4500797e45a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:13.738681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbcf0634-a6c0-4450-a3fd-c4500797e45a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:13.830811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dbcf0634-a6c0-4450-a3fd-c4500797e45a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:13.839821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dbcf0634-a6c0-4450-a3fd-c4500797e45a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1188 microversion: 2.1 time: 0.118690 Oct 05 18:05:13.841086 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2782/5314] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:13 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1188 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:14.362248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a0f58ec-b38c-41da-b015-d3681d4e4d62 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:14.363465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7a0f58ec-b38c-41da-b015-d3681d4e4d62 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:14.372370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a0f58ec-b38c-41da-b015-d3681d4e4d62 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:14.372872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a0f58ec-b38c-41da-b015-d3681d4e4d62 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:14.373311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a0f58ec-b38c-41da-b015-d3681d4e4d62 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:14.374025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a0f58ec-b38c-41da-b015-d3681d4e4d62 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:14.374867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a0f58ec-b38c-41da-b015-d3681d4e4d62 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:14.375295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a0f58ec-b38c-41da-b015-d3681d4e4d62 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:14.567496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7a0f58ec-b38c-41da-b015-d3681d4e4d62 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:14.576841 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a0f58ec-b38c-41da-b015-d3681d4e4d62 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.220187 Oct 05 18:05:14.577987 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2533/5315] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:14 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:14.863046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47a39755-24ab-4ad7-9b4e-b34b7fa4dcff tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:14.863718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-47a39755-24ab-4ad7-9b4e-b34b7fa4dcff tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:14.871462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47a39755-24ab-4ad7-9b4e-b34b7fa4dcff tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:14.871949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47a39755-24ab-4ad7-9b4e-b34b7fa4dcff tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:14.872363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47a39755-24ab-4ad7-9b4e-b34b7fa4dcff tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:14.873057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47a39755-24ab-4ad7-9b4e-b34b7fa4dcff tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:14.873506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47a39755-24ab-4ad7-9b4e-b34b7fa4dcff tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:14.873917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47a39755-24ab-4ad7-9b4e-b34b7fa4dcff tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:14.877467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:14.945371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-47a39755-24ab-4ad7-9b4e-b34b7fa4dcff tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:14.954059 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-47a39755-24ab-4ad7-9b4e-b34b7fa4dcff tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1188 microversion: 2.1 time: 0.095044 Oct 05 18:05:14.954674 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2783/5316] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:14 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:15.602814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4de4a861-06f2-43ad-be05-930bdbc3fc77 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:15.607476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4de4a861-06f2-43ad-be05-930bdbc3fc77 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:15.620599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4de4a861-06f2-43ad-be05-930bdbc3fc77 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:15.621112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4de4a861-06f2-43ad-be05-930bdbc3fc77 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:15.621559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4de4a861-06f2-43ad-be05-930bdbc3fc77 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:15.622252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4de4a861-06f2-43ad-be05-930bdbc3fc77 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:15.622728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4de4a861-06f2-43ad-be05-930bdbc3fc77 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:15.623162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4de4a861-06f2-43ad-be05-930bdbc3fc77 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:15.795131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4de4a861-06f2-43ad-be05-930bdbc3fc77 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:15.804653 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4de4a861-06f2-43ad-be05-930bdbc3fc77 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.205387 Oct 05 18:05:15.822998 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2534/5317] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:15 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:15.979042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ef9052b0-d603-4cac-a10b-d161549ba6a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:15.980205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ef9052b0-d603-4cac-a10b-d161549ba6a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:15.995052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef9052b0-d603-4cac-a10b-d161549ba6a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:15.995742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef9052b0-d603-4cac-a10b-d161549ba6a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:15.997408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef9052b0-d603-4cac-a10b-d161549ba6a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:15.999485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef9052b0-d603-4cac-a10b-d161549ba6a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:16.000118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef9052b0-d603-4cac-a10b-d161549ba6a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:16.000736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef9052b0-d603-4cac-a10b-d161549ba6a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:16.087396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ef9052b0-d603-4cac-a10b-d161549ba6a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:16.097859 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ef9052b0-d603-4cac-a10b-d161549ba6a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1188 microversion: 2.1 time: 0.122916 Oct 05 18:05:16.099126 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2784/5318] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:15 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1188 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:16.836286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c0ac960-6213-47ad-b77b-39f6a195f3b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:16.836895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9c0ac960-6213-47ad-b77b-39f6a195f3b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:16.845322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c0ac960-6213-47ad-b77b-39f6a195f3b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:16.846236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c0ac960-6213-47ad-b77b-39f6a195f3b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:16.848047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c0ac960-6213-47ad-b77b-39f6a195f3b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:16.849109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c0ac960-6213-47ad-b77b-39f6a195f3b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:16.853354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c0ac960-6213-47ad-b77b-39f6a195f3b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:16.853999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c0ac960-6213-47ad-b77b-39f6a195f3b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:17.033105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9c0ac960-6213-47ad-b77b-39f6a195f3b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:17.044366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:17.061325 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9c0ac960-6213-47ad-b77b-39f6a195f3b2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.228760 Oct 05 18:05:17.062526 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2535/5319] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:16 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:17.123252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-00a4788d-2e07-4af3-9691-9db64c7c40d3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:17.123972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-00a4788d-2e07-4af3-9691-9db64c7c40d3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:17.132311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a4788d-2e07-4af3-9691-9db64c7c40d3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:17.133140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a4788d-2e07-4af3-9691-9db64c7c40d3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:17.133974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a4788d-2e07-4af3-9691-9db64c7c40d3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:17.134955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a4788d-2e07-4af3-9691-9db64c7c40d3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:17.136554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a4788d-2e07-4af3-9691-9db64c7c40d3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:17.137234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00a4788d-2e07-4af3-9691-9db64c7c40d3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:17.244001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-00a4788d-2e07-4af3-9691-9db64c7c40d3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:17.253162 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-00a4788d-2e07-4af3-9691-9db64c7c40d3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1188 microversion: 2.1 time: 0.134049 Oct 05 18:05:17.253755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2785/5320] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:17 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1188 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:18.085932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-780d8c6c-1c6f-43ce-847e-3868ef58cd10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:18.087449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-780d8c6c-1c6f-43ce-847e-3868ef58cd10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:18.112162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780d8c6c-1c6f-43ce-847e-3868ef58cd10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:18.113150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780d8c6c-1c6f-43ce-847e-3868ef58cd10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:18.114685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780d8c6c-1c6f-43ce-847e-3868ef58cd10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:18.115921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780d8c6c-1c6f-43ce-847e-3868ef58cd10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:18.116571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780d8c6c-1c6f-43ce-847e-3868ef58cd10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:18.120568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-780d8c6c-1c6f-43ce-847e-3868ef58cd10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:18.281919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76c2e4c6-43a6-4000-8655-393c7e5fb5a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:18.282644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-76c2e4c6-43a6-4000-8655-393c7e5fb5a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:18.295755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76c2e4c6-43a6-4000-8655-393c7e5fb5a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:18.296266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76c2e4c6-43a6-4000-8655-393c7e5fb5a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:18.296705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76c2e4c6-43a6-4000-8655-393c7e5fb5a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:18.297421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76c2e4c6-43a6-4000-8655-393c7e5fb5a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:18.297879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76c2e4c6-43a6-4000-8655-393c7e5fb5a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:18.298464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76c2e4c6-43a6-4000-8655-393c7e5fb5a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:18.394266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-780d8c6c-1c6f-43ce-847e-3868ef58cd10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:18.410040 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-780d8c6c-1c6f-43ce-847e-3868ef58cd10 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.328536 Oct 05 18:05:18.411191 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2536/5321] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:18 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:18.503608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76c2e4c6-43a6-4000-8655-393c7e5fb5a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:18.526386 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76c2e4c6-43a6-4000-8655-393c7e5fb5a6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 200 len: 1188 microversion: 2.1 time: 0.242911 Oct 05 18:05:18.526386 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2786/5322] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:18 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 1188 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:19.433257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-07014637-17aa-427a-9b8e-b16cf3d8d370 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:19.433854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-07014637-17aa-427a-9b8e-b16cf3d8d370 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:19.441059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07014637-17aa-427a-9b8e-b16cf3d8d370 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:19.441595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07014637-17aa-427a-9b8e-b16cf3d8d370 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:19.442025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07014637-17aa-427a-9b8e-b16cf3d8d370 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:19.442787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07014637-17aa-427a-9b8e-b16cf3d8d370 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:19.443231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07014637-17aa-427a-9b8e-b16cf3d8d370 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:19.443899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07014637-17aa-427a-9b8e-b16cf3d8d370 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:19.540832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:19.543258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 08fb6775-32b9-4aa9-85bb-1720cad0a1fe] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:19.561372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:19.565387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:19.566051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:19.567331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:19.568092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:19.569245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:19.604937 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance 08fb6775-32b9-4aa9-85bb-1720cad0a1fe could not be found. Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe HTTP/1.1 Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 08fb6775-32b9-4aa9-85bb-1720cad0a1fe could not be found. Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '08fb6775-32b9-4aa9-85bb-1720cad0a1fe'} Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08fb6775-32b9-4aa9-85bb-1720cad0a1fe could not be found. Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08fb6775-32b9-4aa9-85bb-1720cad0a1fe could not be found. Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:19.607282 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:19.612189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:19.612189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:19.612189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:19.612189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:19.612189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:19.612189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08fb6775-32b9-4aa9-85bb-1720cad0a1fe could not be found. Oct 05 18:05:19.612189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:19.616532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance 08fb6775-32b9-4aa9-85bb-1720cad0a1fe could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:19.617725 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d04e7f85-0cf0-4b65-b520-9d10df7e844d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe" status: 404 len: 111 microversion: 2.1 time: 0.083415 Oct 05 18:05:19.623345 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2787/5323] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:19 2022] GET /compute/v2.1/servers/08fb6775-32b9-4aa9-85bb-1720cad0a1fe => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:05:19.646143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-07014637-17aa-427a-9b8e-b16cf3d8d370 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:19.659017 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-07014637-17aa-427a-9b8e-b16cf3d8d370 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.229421 Oct 05 18:05:19.659988 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2537/5324] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:19 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:20.688030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0a5897e2-a99e-4b20-8d2f-6ae2894db075 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:20.689915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0a5897e2-a99e-4b20-8d2f-6ae2894db075 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:20.716431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a5897e2-a99e-4b20-8d2f-6ae2894db075 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:20.717219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a5897e2-a99e-4b20-8d2f-6ae2894db075 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:20.717872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a5897e2-a99e-4b20-8d2f-6ae2894db075 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:20.719418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a5897e2-a99e-4b20-8d2f-6ae2894db075 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:20.720813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a5897e2-a99e-4b20-8d2f-6ae2894db075 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:20.721528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0a5897e2-a99e-4b20-8d2f-6ae2894db075 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:20.971177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0a5897e2-a99e-4b20-8d2f-6ae2894db075 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:20.979740 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0a5897e2-a99e-4b20-8d2f-6ae2894db075 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.298434 Oct 05 18:05:20.980337 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2788/5325] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:20 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:22.004967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29835622-711c-4338-b495-bfb0df5f232c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:22.006534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29835622-711c-4338-b495-bfb0df5f232c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:22.021537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29835622-711c-4338-b495-bfb0df5f232c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:22.022428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29835622-711c-4338-b495-bfb0df5f232c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:22.023055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29835622-711c-4338-b495-bfb0df5f232c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:22.023946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29835622-711c-4338-b495-bfb0df5f232c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:22.027153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29835622-711c-4338-b495-bfb0df5f232c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:22.028079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29835622-711c-4338-b495-bfb0df5f232c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:23.024395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29835622-711c-4338-b495-bfb0df5f232c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:23.040987 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29835622-711c-4338-b495-bfb0df5f232c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 1.039240 Oct 05 18:05:23.043050 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2538/5326] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:21 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:24.065122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0d24715-31c9-46ca-a1d4-a4aa4b23610d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:24.065777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0d24715-31c9-46ca-a1d4-a4aa4b23610d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:24.083142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0d24715-31c9-46ca-a1d4-a4aa4b23610d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:24.083677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0d24715-31c9-46ca-a1d4-a4aa4b23610d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:24.084341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0d24715-31c9-46ca-a1d4-a4aa4b23610d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:24.085125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0d24715-31c9-46ca-a1d4-a4aa4b23610d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:24.085638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0d24715-31c9-46ca-a1d4-a4aa4b23610d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:24.086119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0d24715-31c9-46ca-a1d4-a4aa4b23610d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:24.490089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0d24715-31c9-46ca-a1d4-a4aa4b23610d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:24.500131 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0d24715-31c9-46ca-a1d4-a4aa4b23610d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.438869 Oct 05 18:05:24.504034 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2789/5327] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:24 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:24.788868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9ee19950-e166-4873-9b14-ca70b7349180 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:24.790000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9ee19950-e166-4873-9b14-ca70b7349180 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:24.801589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ee19950-e166-4873-9b14-ca70b7349180 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:24.804274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ee19950-e166-4873-9b14-ca70b7349180 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:24.805819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ee19950-e166-4873-9b14-ca70b7349180 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:24.806250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ee19950-e166-4873-9b14-ca70b7349180 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:24.806565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ee19950-e166-4873-9b14-ca70b7349180 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:24.806912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ee19950-e166-4873-9b14-ca70b7349180 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:24.864700 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9ee19950-e166-4873-9b14-ca70b7349180 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.079698 Oct 05 18:05:24.870345 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2539/5328] 10.222.0.70 () {58 vars in 1293 bytes} [Wed Oct 5 18:05:24 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381/os-server-password => generated 116 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:05:25.528278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1fbd596d-8662-427f-892d-b3a62d78068d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:25.528902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1fbd596d-8662-427f-892d-b3a62d78068d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:25.547639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbd596d-8662-427f-892d-b3a62d78068d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:25.551270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbd596d-8662-427f-892d-b3a62d78068d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:25.552044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbd596d-8662-427f-892d-b3a62d78068d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:25.553294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbd596d-8662-427f-892d-b3a62d78068d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:25.554126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbd596d-8662-427f-892d-b3a62d78068d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:25.554757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fbd596d-8662-427f-892d-b3a62d78068d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:25.765990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1fbd596d-8662-427f-892d-b3a62d78068d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:25.779915 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1fbd596d-8662-427f-892d-b3a62d78068d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.255816 Oct 05 18:05:25.780516 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2790/5329] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:25 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:26.803848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9cc727d4-d42b-4a8a-bd87-658ca9551552 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:26.804586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9cc727d4-d42b-4a8a-bd87-658ca9551552 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:26.811486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cc727d4-d42b-4a8a-bd87-658ca9551552 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:26.812285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cc727d4-d42b-4a8a-bd87-658ca9551552 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:26.813064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cc727d4-d42b-4a8a-bd87-658ca9551552 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:26.814007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cc727d4-d42b-4a8a-bd87-658ca9551552 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:26.814928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cc727d4-d42b-4a8a-bd87-658ca9551552 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:26.815593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cc727d4-d42b-4a8a-bd87-658ca9551552 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:26.995702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9cc727d4-d42b-4a8a-bd87-658ca9551552 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:27.006145 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9cc727d4-d42b-4a8a-bd87-658ca9551552 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.206545 Oct 05 18:05:27.008534 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2540/5330] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:26 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:28.033416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ac77f49-2581-4a50-b45b-ecba16606a8e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:28.034300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3ac77f49-2581-4a50-b45b-ecba16606a8e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:28.047857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ac77f49-2581-4a50-b45b-ecba16606a8e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:28.048404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ac77f49-2581-4a50-b45b-ecba16606a8e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:28.048841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ac77f49-2581-4a50-b45b-ecba16606a8e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:28.049566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ac77f49-2581-4a50-b45b-ecba16606a8e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:28.050016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ac77f49-2581-4a50-b45b-ecba16606a8e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:28.050474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ac77f49-2581-4a50-b45b-ecba16606a8e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:28.210911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3ac77f49-2581-4a50-b45b-ecba16606a8e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:28.223666 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ac77f49-2581-4a50-b45b-ecba16606a8e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.194295 Oct 05 18:05:28.224685 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2791/5331] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:28 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:29.256752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4fb8543b-a3a0-4ca6-88b4-d4d49863dd92 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:29.257420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4fb8543b-a3a0-4ca6-88b4-d4d49863dd92 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:29.265945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fb8543b-a3a0-4ca6-88b4-d4d49863dd92 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:29.266449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fb8543b-a3a0-4ca6-88b4-d4d49863dd92 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:29.266889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fb8543b-a3a0-4ca6-88b4-d4d49863dd92 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:29.267734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fb8543b-a3a0-4ca6-88b4-d4d49863dd92 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:29.268091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fb8543b-a3a0-4ca6-88b4-d4d49863dd92 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:29.268747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fb8543b-a3a0-4ca6-88b4-d4d49863dd92 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:29.485958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4fb8543b-a3a0-4ca6-88b4-d4d49863dd92 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:29.495989 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4fb8543b-a3a0-4ca6-88b4-d4d49863dd92 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.243396 Oct 05 18:05:29.497736 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2541/5332] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:29 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:30.526345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12c6e3d9-4463-491c-bf90-f64c05b4eb3a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:30.527046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12c6e3d9-4463-491c-bf90-f64c05b4eb3a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:30.542737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c6e3d9-4463-491c-bf90-f64c05b4eb3a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:30.543360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c6e3d9-4463-491c-bf90-f64c05b4eb3a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:30.543816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c6e3d9-4463-491c-bf90-f64c05b4eb3a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:30.544554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c6e3d9-4463-491c-bf90-f64c05b4eb3a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:30.545058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c6e3d9-4463-491c-bf90-f64c05b4eb3a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:30.546707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c6e3d9-4463-491c-bf90-f64c05b4eb3a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:30.971010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-12c6e3d9-4463-491c-bf90-f64c05b4eb3a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:30.990152 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12c6e3d9-4463-491c-bf90-f64c05b4eb3a tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.471357 Oct 05 18:05:30.994476 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2792/5333] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:30 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:32.020003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-83afde6f-ba60-4f3f-af0c-f9c2a4361269 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:32.022668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-83afde6f-ba60-4f3f-af0c-f9c2a4361269 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:32.045338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83afde6f-ba60-4f3f-af0c-f9c2a4361269 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:32.045851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83afde6f-ba60-4f3f-af0c-f9c2a4361269 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:32.046393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83afde6f-ba60-4f3f-af0c-f9c2a4361269 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:32.047077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83afde6f-ba60-4f3f-af0c-f9c2a4361269 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:32.047533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83afde6f-ba60-4f3f-af0c-f9c2a4361269 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:32.047962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83afde6f-ba60-4f3f-af0c-f9c2a4361269 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:32.242307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-83afde6f-ba60-4f3f-af0c-f9c2a4361269 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:32.254000 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-83afde6f-ba60-4f3f-af0c-f9c2a4361269 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1512 microversion: 2.1 time: 0.238535 Oct 05 18:05:32.257193 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2542/5334] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:32 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:33.581798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f468174d-d674-4073-b388-7dedb3b2cdd2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:33.582470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f468174d-d674-4073-b388-7dedb3b2cdd2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:33.588911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f468174d-d674-4073-b388-7dedb3b2cdd2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:33.589400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f468174d-d674-4073-b388-7dedb3b2cdd2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:33.589832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f468174d-d674-4073-b388-7dedb3b2cdd2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:33.590553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f468174d-d674-4073-b388-7dedb3b2cdd2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:33.591003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f468174d-d674-4073-b388-7dedb3b2cdd2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:33.591419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f468174d-d674-4073-b388-7dedb3b2cdd2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:33.746152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f468174d-d674-4073-b388-7dedb3b2cdd2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:33.756718 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f468174d-d674-4073-b388-7dedb3b2cdd2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1489 microversion: 2.1 time: 0.472993 Oct 05 18:05:33.762343 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2793/5335] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:33 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1489 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:33.781716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5e412bd-148c-4370-b161-b1e44931624c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:33.782356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5e412bd-148c-4370-b161-b1e44931624c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:33.792557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e412bd-148c-4370-b161-b1e44931624c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:33.793055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e412bd-148c-4370-b161-b1e44931624c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:33.793498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e412bd-148c-4370-b161-b1e44931624c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:33.794369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e412bd-148c-4370-b161-b1e44931624c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:33.795080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e412bd-148c-4370-b161-b1e44931624c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:33.795686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e412bd-148c-4370-b161-b1e44931624c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:33.828978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5e412bd-148c-4370-b161-b1e44931624c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:05:33.957286 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c5e412bd-148c-4370-b161-b1e44931624c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 204 len: 0 microversion: 2.1 time: 0.179636 Oct 05 18:05:33.959121 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2543/5336] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:05:33 2022] DELETE /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:05:33.967398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ee9518f-17dd-40f3-ad05-bcf30b651a31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:33.968026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ee9518f-17dd-40f3-ad05-bcf30b651a31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:33.975988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ee9518f-17dd-40f3-ad05-bcf30b651a31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:33.976550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ee9518f-17dd-40f3-ad05-bcf30b651a31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:33.977562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ee9518f-17dd-40f3-ad05-bcf30b651a31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:33.981036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ee9518f-17dd-40f3-ad05-bcf30b651a31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:33.981530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ee9518f-17dd-40f3-ad05-bcf30b651a31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:33.981997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ee9518f-17dd-40f3-ad05-bcf30b651a31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:34.175939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5ee9518f-17dd-40f3-ad05-bcf30b651a31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:34.201577 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ee9518f-17dd-40f3-ad05-bcf30b651a31 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1495 microversion: 2.1 time: 0.237980 Oct 05 18:05:34.204222 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2794/5337] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:33 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1495 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:35.230144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-77d876dc-df43-42d3-993e-2cf1c358741c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:35.231044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-77d876dc-df43-42d3-993e-2cf1c358741c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:35.243390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77d876dc-df43-42d3-993e-2cf1c358741c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:35.243881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77d876dc-df43-42d3-993e-2cf1c358741c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:35.244312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77d876dc-df43-42d3-993e-2cf1c358741c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:35.245026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77d876dc-df43-42d3-993e-2cf1c358741c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:35.245476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77d876dc-df43-42d3-993e-2cf1c358741c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:35.245891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77d876dc-df43-42d3-993e-2cf1c358741c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:35.404591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-77d876dc-df43-42d3-993e-2cf1c358741c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:35.412918 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-77d876dc-df43-42d3-993e-2cf1c358741c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1495 microversion: 2.1 time: 0.187473 Oct 05 18:05:35.429103 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2544/5338] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:35 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1495 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:36.172820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e808574e-7dd8-4e8f-8762-8601a97d5084 req-18d848a1-5ca8-4338-9d3f-a470ec87bd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40af7dd2-0a4d-49e3-87ab-798958f50b1b", "name": "network-vif-deleted", "tag": "b2ebc6e6-ad62-4c19-ba2c-1ee07130a1ea"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:36.223559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e808574e-7dd8-4e8f-8762-8601a97d5084 req-18d848a1-5ca8-4338-9d3f-a470ec87bd88 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:36.224441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e808574e-7dd8-4e8f-8762-8601a97d5084 req-18d848a1-5ca8-4338-9d3f-a470ec87bd88 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:36.226547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e808574e-7dd8-4e8f-8762-8601a97d5084 req-18d848a1-5ca8-4338-9d3f-a470ec87bd88 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:36.280656 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e808574e-7dd8-4e8f-8762-8601a97d5084 req-18d848a1-5ca8-4338-9d3f-a470ec87bd88 service nova] Creating event network-vif-deleted:b2ebc6e6-ad62-4c19-ba2c-1ee07130a1ea for instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b on n-h2-835595-3 Oct 05 18:05:36.292115 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e808574e-7dd8-4e8f-8762-8601a97d5084 req-18d848a1-5ca8-4338-9d3f-a470ec87bd88 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123656 Oct 05 18:05:36.293221 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2795/5339] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:05:36.441017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:36.442944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:36.465648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:36.466555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:36.468236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:36.471290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:36.473534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:36.479896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:36.543392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:36.544136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:36.544812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:36.545779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lazy-loading 'fault' on Instance uuid 40af7dd2-0a4d-49e3-87ab-798958f50b1b {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:05:36.595109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:36.605356 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3edb9181-d968-4c6a-b614-e2cea396a8c8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 200 len: 1305 microversion: 2.1 time: 0.170290 Oct 05 18:05:36.618924 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2545/5340] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:36 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 1305 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:37.631685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:37.633059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:37.639810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:37.640492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:37.641127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:37.642005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:37.642678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:37.643274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:37.657837 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b HTTP/1.1 Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '40af7dd2-0a4d-49e3-87ab-798958f50b1b'} Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:37.659974 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:37.665739 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:37.665739 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:37.665739 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:37.665739 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:37.665739 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:37.665739 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:37.665739 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:37.667080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:37.668116 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1627775f-b1cf-4003-bf49-34afe8e4150b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 404 len: 111 microversion: 2.1 time: 0.042510 Oct 05 18:05:37.672435 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2796/5341] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:37 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:05:37.767137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1139594128", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:37.779195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:37.841013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] validate_networks() for [('7fa55975-a6de-43ea-a0f2-ea2a2b1a4ad5', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:05:38.754893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:05:38.756645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:05:38.757358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:05:38.758451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:05:38.759330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:05:38.776372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:38.777767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:38.778440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:38.780223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:38.781040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:38.781655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:38.828543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:05:38.836604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Getting quotas for user 9ea1c284fc254cc7a51d9e67d4fe8168 and project 46afad05f9ae454fbdf427fb1f6a2eb3. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:05:38.862748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:05:38.866215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:05:38.992458 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d1164387-567b-4d3d-a8b9-6a88d679c31e tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.230225 Oct 05 18:05:39.004636 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2546/5342] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:05:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 18:05:39.016607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-206297bf-1fda-4af1-924b-49e3fddd0841 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:39.017226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-206297bf-1fda-4af1-924b-49e3fddd0841 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:39.223851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-206297bf-1fda-4af1-924b-49e3fddd0841 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:39.231392 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-206297bf-1fda-4af1-924b-49e3fddd0841 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1215 microversion: 2.1 time: 0.220346 Oct 05 18:05:39.242552 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2797/5343] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:39 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:40.256780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-67fd0bd2-7d21-4661-acd0-df58f62207b4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:40.257406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-67fd0bd2-7d21-4661-acd0-df58f62207b4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:40.272008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67fd0bd2-7d21-4661-acd0-df58f62207b4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:40.272946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67fd0bd2-7d21-4661-acd0-df58f62207b4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:40.274140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67fd0bd2-7d21-4661-acd0-df58f62207b4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:40.275641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67fd0bd2-7d21-4661-acd0-df58f62207b4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:40.277009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67fd0bd2-7d21-4661-acd0-df58f62207b4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:40.278053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67fd0bd2-7d21-4661-acd0-df58f62207b4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:40.401777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-67fd0bd2-7d21-4661-acd0-df58f62207b4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:40.410894 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-67fd0bd2-7d21-4661-acd0-df58f62207b4 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1267 microversion: 2.1 time: 0.158832 Oct 05 18:05:40.413855 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2547/5344] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:40 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:41.451145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-394830e9-8cf6-43fa-9e20-467f7f5e3b67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:41.451847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-394830e9-8cf6-43fa-9e20-467f7f5e3b67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:41.457594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:41.469204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394830e9-8cf6-43fa-9e20-467f7f5e3b67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:41.469788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394830e9-8cf6-43fa-9e20-467f7f5e3b67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:41.474464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394830e9-8cf6-43fa-9e20-467f7f5e3b67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:41.475380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394830e9-8cf6-43fa-9e20-467f7f5e3b67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:41.475861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394830e9-8cf6-43fa-9e20-467f7f5e3b67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:41.476294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-394830e9-8cf6-43fa-9e20-467f7f5e3b67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:42.048822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-394830e9-8cf6-43fa-9e20-467f7f5e3b67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:42.058556 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-394830e9-8cf6-43fa-9e20-467f7f5e3b67 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1315 microversion: 2.1 time: 0.618689 Oct 05 18:05:42.059745 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2798/5345] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:41 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1315 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:42.875404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-2ec817fe-454e-4392-ba05-ca148f2fa9ad req-61ab1649-952f-455a-ac80-b0fafc95e4bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cef4b9c7-a98d-4313-a2c7-9b6c8b793e46", "tag": "521abf8a-9c51-49d1-a6bf-5a21bf1bcd27"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:42.900706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2ec817fe-454e-4392-ba05-ca148f2fa9ad req-61ab1649-952f-455a-ac80-b0fafc95e4bb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:42.905405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2ec817fe-454e-4392-ba05-ca148f2fa9ad req-61ab1649-952f-455a-ac80-b0fafc95e4bb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:42.907191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2ec817fe-454e-4392-ba05-ca148f2fa9ad req-61ab1649-952f-455a-ac80-b0fafc95e4bb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:42.958412 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-2ec817fe-454e-4392-ba05-ca148f2fa9ad req-61ab1649-952f-455a-ac80-b0fafc95e4bb service nova] Creating event network-changed:521abf8a-9c51-49d1-a6bf-5a21bf1bcd27 for instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 on n-h2-835595-3 Oct 05 18:05:42.968437 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-2ec817fe-454e-4392-ba05-ca148f2fa9ad req-61ab1649-952f-455a-ac80-b0fafc95e4bb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099075 Oct 05 18:05:42.969067 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2548/5346] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:05:43.088394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ea7cb9e-e11c-4784-88d7-bf461b6e58ec tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:43.089588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ea7cb9e-e11c-4784-88d7-bf461b6e58ec tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:43.101010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ea7cb9e-e11c-4784-88d7-bf461b6e58ec tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:43.101702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ea7cb9e-e11c-4784-88d7-bf461b6e58ec tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:43.105563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ea7cb9e-e11c-4784-88d7-bf461b6e58ec tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:43.106743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ea7cb9e-e11c-4784-88d7-bf461b6e58ec tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:43.107670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ea7cb9e-e11c-4784-88d7-bf461b6e58ec tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:43.107953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ea7cb9e-e11c-4784-88d7-bf461b6e58ec tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:43.410887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ea7cb9e-e11c-4784-88d7-bf461b6e58ec tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:43.421584 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ea7cb9e-e11c-4784-88d7-bf461b6e58ec tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1315 microversion: 2.1 time: 0.336892 Oct 05 18:05:43.426314 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2799/5347] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:43 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:44.289741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-301135690", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:44.353633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] validate_networks() for None {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:05:44.453023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c92a9c01-2cc5-458b-96e3-3e2f07a6bcca tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:44.453902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c92a9c01-2cc5-458b-96e3-3e2f07a6bcca tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:44.468083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c92a9c01-2cc5-458b-96e3-3e2f07a6bcca tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:44.468956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c92a9c01-2cc5-458b-96e3-3e2f07a6bcca tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:44.469625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c92a9c01-2cc5-458b-96e3-3e2f07a6bcca tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:44.471141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c92a9c01-2cc5-458b-96e3-3e2f07a6bcca tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:44.473013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c92a9c01-2cc5-458b-96e3-3e2f07a6bcca tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:44.473717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c92a9c01-2cc5-458b-96e3-3e2f07a6bcca tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:44.858395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:05:44.859004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:05:44.859556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:05:44.860035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:05:44.860638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:05:44.877538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:44.878162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:44.879064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:44.880638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:44.881133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:44.881848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:44.912250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Getting quotas for project 0d0e1365956143a182f7a45142d5f389. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:05:44.921111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Getting quotas for user 41c41f2da6d646508118b4aaf38321d2 and project 0d0e1365956143a182f7a45142d5f389. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:05:44.942167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:05:44.949233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:05:45.022593 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-18498abb-607b-433b-bd0f-ff5f938bde2b tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737340 Oct 05 18:05:45.023576 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2549/5348] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:05:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:05:45.040019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d3671994-ae81-4c5e-bade-ea8ef05b9f89 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:45.040751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d3671994-ae81-4c5e-bade-ea8ef05b9f89 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:45.126564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d3671994-ae81-4c5e-bade-ea8ef05b9f89 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:45.137161 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d3671994-ae81-4c5e-bade-ea8ef05b9f89 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1214 microversion: 2.1 time: 0.101468 Oct 05 18:05:45.152010 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2550/5349] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:45 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1214 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:45.338477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c92a9c01-2cc5-458b-96e3-3e2f07a6bcca tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:45.346989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=88 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:45.368166 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c92a9c01-2cc5-458b-96e3-3e2f07a6bcca tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1315 microversion: 2.1 time: 0.918585 Oct 05 18:05:45.368796 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2800/5350] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:44 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:46.162688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f1ee8ebb-50ef-49d2-9c41-c28c274da4b0 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:46.163322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1ee8ebb-50ef-49d2-9c41-c28c274da4b0 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:46.175291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ee8ebb-50ef-49d2-9c41-c28c274da4b0 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:46.175930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ee8ebb-50ef-49d2-9c41-c28c274da4b0 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:46.176369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ee8ebb-50ef-49d2-9c41-c28c274da4b0 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:46.182566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ee8ebb-50ef-49d2-9c41-c28c274da4b0 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:46.184778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ee8ebb-50ef-49d2-9c41-c28c274da4b0 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:46.185700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ee8ebb-50ef-49d2-9c41-c28c274da4b0 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:46.292021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1ee8ebb-50ef-49d2-9c41-c28c274da4b0 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:46.301472 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f1ee8ebb-50ef-49d2-9c41-c28c274da4b0 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1210 microversion: 2.1 time: 0.142979 Oct 05 18:05:46.318834 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2551/5351] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:46 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1210 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:46.396838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e0db6673-ca9d-4252-95cf-0cfc21267e39 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:46.414706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e0db6673-ca9d-4252-95cf-0cfc21267e39 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:46.423307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0db6673-ca9d-4252-95cf-0cfc21267e39 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:46.424355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0db6673-ca9d-4252-95cf-0cfc21267e39 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:46.424980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0db6673-ca9d-4252-95cf-0cfc21267e39 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:46.425996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0db6673-ca9d-4252-95cf-0cfc21267e39 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:46.426685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0db6673-ca9d-4252-95cf-0cfc21267e39 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:46.427630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0db6673-ca9d-4252-95cf-0cfc21267e39 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:46.654628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e0db6673-ca9d-4252-95cf-0cfc21267e39 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:46.664780 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e0db6673-ca9d-4252-95cf-0cfc21267e39 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1315 microversion: 2.1 time: 0.274554 Oct 05 18:05:46.667527 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2801/5352] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:46 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:47.260913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-52d03fc6-2190-49e4-a16b-0c900825fa47 req-6db45e12-13b5-4330-99c0-2daadf1ca5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef4b9c7-a98d-4313-a2c7-9b6c8b793e46", "name": "network-vif-plugged", "status": "completed", "tag": "521abf8a-9c51-49d1-a6bf-5a21bf1bcd27"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:47.283747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-52d03fc6-2190-49e4-a16b-0c900825fa47 req-6db45e12-13b5-4330-99c0-2daadf1ca5ab service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:47.284158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-52d03fc6-2190-49e4-a16b-0c900825fa47 req-6db45e12-13b5-4330-99c0-2daadf1ca5ab service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:47.284627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-52d03fc6-2190-49e4-a16b-0c900825fa47 req-6db45e12-13b5-4330-99c0-2daadf1ca5ab service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:47.301355 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-52d03fc6-2190-49e4-a16b-0c900825fa47 req-6db45e12-13b5-4330-99c0-2daadf1ca5ab service nova] Creating event network-vif-plugged:521abf8a-9c51-49d1-a6bf-5a21bf1bcd27 for instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 on n-h2-835595-3 Oct 05 18:05:47.309862 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-52d03fc6-2190-49e4-a16b-0c900825fa47 req-6db45e12-13b5-4330-99c0-2daadf1ca5ab service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052377 Oct 05 18:05:47.313572 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2552/5353] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:05:47.331272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3234e8c-bed1-4cfa-9dcc-2142b1b8d7a5 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:47.333290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b3234e8c-bed1-4cfa-9dcc-2142b1b8d7a5 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:47.355599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3234e8c-bed1-4cfa-9dcc-2142b1b8d7a5 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:47.358790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3234e8c-bed1-4cfa-9dcc-2142b1b8d7a5 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:47.361127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3234e8c-bed1-4cfa-9dcc-2142b1b8d7a5 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:47.365384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3234e8c-bed1-4cfa-9dcc-2142b1b8d7a5 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:47.370002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3234e8c-bed1-4cfa-9dcc-2142b1b8d7a5 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:47.370784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3234e8c-bed1-4cfa-9dcc-2142b1b8d7a5 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:47.576723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3234e8c-bed1-4cfa-9dcc-2142b1b8d7a5 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:47.594579 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3234e8c-bed1-4cfa-9dcc-2142b1b8d7a5 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1272 microversion: 2.1 time: 0.266878 Oct 05 18:05:47.596817 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2802/5354] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:47 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1272 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:47.692895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ad4d4d2-dc18-4072-9685-e3997ac33249 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:47.693606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2ad4d4d2-dc18-4072-9685-e3997ac33249 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:47.710515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad4d4d2-dc18-4072-9685-e3997ac33249 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:47.711229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad4d4d2-dc18-4072-9685-e3997ac33249 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:47.711907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad4d4d2-dc18-4072-9685-e3997ac33249 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:47.712871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad4d4d2-dc18-4072-9685-e3997ac33249 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:47.713554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad4d4d2-dc18-4072-9685-e3997ac33249 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:47.714207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ad4d4d2-dc18-4072-9685-e3997ac33249 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:48.002526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2ad4d4d2-dc18-4072-9685-e3997ac33249 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:48.011513 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2ad4d4d2-dc18-4072-9685-e3997ac33249 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1315 microversion: 2.1 time: 0.322901 Oct 05 18:05:48.028672 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2553/5355] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:47 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:48.621502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ba66b40-e402-41d4-a5d8-87ac826fac4c tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:48.622239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ba66b40-e402-41d4-a5d8-87ac826fac4c tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:48.652176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ba66b40-e402-41d4-a5d8-87ac826fac4c tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:48.654981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ba66b40-e402-41d4-a5d8-87ac826fac4c tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:48.656926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ba66b40-e402-41d4-a5d8-87ac826fac4c tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:48.663310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ba66b40-e402-41d4-a5d8-87ac826fac4c tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:48.666696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ba66b40-e402-41d4-a5d8-87ac826fac4c tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:48.667426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ba66b40-e402-41d4-a5d8-87ac826fac4c tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:48.966672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9ba66b40-e402-41d4-a5d8-87ac826fac4c tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:48.974838 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ba66b40-e402-41d4-a5d8-87ac826fac4c tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1314 microversion: 2.1 time: 0.358028 Oct 05 18:05:48.975430 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2803/5356] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:48 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:49.041350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8bb5838b-8286-49de-81bc-1680fc0bdb56 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:49.041993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8bb5838b-8286-49de-81bc-1680fc0bdb56 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:49.056395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bb5838b-8286-49de-81bc-1680fc0bdb56 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:49.057037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bb5838b-8286-49de-81bc-1680fc0bdb56 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:49.061729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bb5838b-8286-49de-81bc-1680fc0bdb56 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:49.062626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bb5838b-8286-49de-81bc-1680fc0bdb56 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:49.063274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bb5838b-8286-49de-81bc-1680fc0bdb56 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:49.063728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bb5838b-8286-49de-81bc-1680fc0bdb56 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:49.091140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:49.378549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8bb5838b-8286-49de-81bc-1680fc0bdb56 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:49.388202 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8bb5838b-8286-49de-81bc-1680fc0bdb56 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1501 microversion: 2.1 time: 0.351725 Oct 05 18:05:49.390234 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2554/5357] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:49 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1501 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:49.411487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02c89f17-5a81-4055-b53c-4e301acb6653 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:49.412303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02c89f17-5a81-4055-b53c-4e301acb6653 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:49.417756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:49.419413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02c89f17-5a81-4055-b53c-4e301acb6653 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:49.420124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02c89f17-5a81-4055-b53c-4e301acb6653 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:49.420741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02c89f17-5a81-4055-b53c-4e301acb6653 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:49.421630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02c89f17-5a81-4055-b53c-4e301acb6653 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:49.422271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02c89f17-5a81-4055-b53c-4e301acb6653 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:49.422897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02c89f17-5a81-4055-b53c-4e301acb6653 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:49.453023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-02c89f17-5a81-4055-b53c-4e301acb6653 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lazy-loading 'flavor' on Instance uuid cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:05:49.537911 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02c89f17-5a81-4055-b53c-4e301acb6653 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "POST /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46/action" status: 202 len: 0 microversion: 2.1 time: 0.130740 Oct 05 18:05:49.550561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aeb99f7f-f519-43e6-b640-f74361d0925f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:49.551393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aeb99f7f-f519-43e6-b640-f74361d0925f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:49.555452 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2804/5358] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:05:49 2022] POST /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:05:49.562009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aeb99f7f-f519-43e6-b640-f74361d0925f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:49.563083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aeb99f7f-f519-43e6-b640-f74361d0925f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:49.563752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aeb99f7f-f519-43e6-b640-f74361d0925f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:49.566249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aeb99f7f-f519-43e6-b640-f74361d0925f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:49.568758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aeb99f7f-f519-43e6-b640-f74361d0925f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:49.569884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aeb99f7f-f519-43e6-b640-f74361d0925f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:49.599405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-714deecc-ff5b-462a-aa47-32a882dee99c req-94e836d2-99e3-43c3-a8cd-a293b8d78c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25e8ea3b-6f47-4c3b-b686-f27627abfa45", "tag": "f61cdcde-5a5b-4659-bfa9-5cd9c724094d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:49.616639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-714deecc-ff5b-462a-aa47-32a882dee99c req-94e836d2-99e3-43c3-a8cd-a293b8d78c2b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:49.617133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-714deecc-ff5b-462a-aa47-32a882dee99c req-94e836d2-99e3-43c3-a8cd-a293b8d78c2b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:49.617569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-714deecc-ff5b-462a-aa47-32a882dee99c req-94e836d2-99e3-43c3-a8cd-a293b8d78c2b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:49.631821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-714deecc-ff5b-462a-aa47-32a882dee99c req-94e836d2-99e3-43c3-a8cd-a293b8d78c2b service nova] Creating event network-changed:f61cdcde-5a5b-4659-bfa9-5cd9c724094d for instance 25e8ea3b-6f47-4c3b-b686-f27627abfa45 on n-h1-835595-3 Oct 05 18:05:49.636759 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-714deecc-ff5b-462a-aa47-32a882dee99c req-94e836d2-99e3-43c3-a8cd-a293b8d78c2b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045043 Oct 05 18:05:49.637903 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2805/5359] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:05:49.892210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aeb99f7f-f519-43e6-b640-f74361d0925f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:49.903720 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aeb99f7f-f519-43e6-b640-f74361d0925f tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1509 microversion: 2.1 time: 0.359349 Oct 05 18:05:49.924628 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2555/5360] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:49 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1509 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:50.002333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88763c3a-808b-4131-88fc-2afb7ed5a623 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:50.003195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88763c3a-808b-4131-88fc-2afb7ed5a623 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:50.014999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88763c3a-808b-4131-88fc-2afb7ed5a623 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:50.016353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88763c3a-808b-4131-88fc-2afb7ed5a623 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:50.017163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88763c3a-808b-4131-88fc-2afb7ed5a623 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:50.018309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88763c3a-808b-4131-88fc-2afb7ed5a623 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:50.020417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88763c3a-808b-4131-88fc-2afb7ed5a623 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:50.021828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88763c3a-808b-4131-88fc-2afb7ed5a623 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:50.265558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88763c3a-808b-4131-88fc-2afb7ed5a623 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:50.274113 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88763c3a-808b-4131-88fc-2afb7ed5a623 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1314 microversion: 2.1 time: 0.280600 Oct 05 18:05:50.277277 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2806/5361] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:49 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:50.933557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4e95dea5-c170-424f-a372-70d379b3ae57 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:50.934955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4e95dea5-c170-424f-a372-70d379b3ae57 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:50.946239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e95dea5-c170-424f-a372-70d379b3ae57 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:50.947061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e95dea5-c170-424f-a372-70d379b3ae57 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:50.947500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e95dea5-c170-424f-a372-70d379b3ae57 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:50.948447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e95dea5-c170-424f-a372-70d379b3ae57 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:50.949138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e95dea5-c170-424f-a372-70d379b3ae57 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:50.949577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e95dea5-c170-424f-a372-70d379b3ae57 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:51.169960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4e95dea5-c170-424f-a372-70d379b3ae57 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:51.179195 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4e95dea5-c170-424f-a372-70d379b3ae57 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1492 microversion: 2.1 time: 0.251522 Oct 05 18:05:51.180164 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2556/5362] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:50 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1492 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:51.209040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b6cf3372-00b9-42c9-a751-06cdc7c09b7c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:51.210845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b6cf3372-00b9-42c9-a751-06cdc7c09b7c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:51.223011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6cf3372-00b9-42c9-a751-06cdc7c09b7c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:51.225524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6cf3372-00b9-42c9-a751-06cdc7c09b7c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:51.226246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6cf3372-00b9-42c9-a751-06cdc7c09b7c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:51.232835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6cf3372-00b9-42c9-a751-06cdc7c09b7c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:51.233600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6cf3372-00b9-42c9-a751-06cdc7c09b7c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:51.234161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6cf3372-00b9-42c9-a751-06cdc7c09b7c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:51.283164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b6cf3372-00b9-42c9-a751-06cdc7c09b7c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:05:51.303972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-15208252-7c2f-440b-b252-4658f32ecdb9 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:51.304627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-15208252-7c2f-440b-b252-4658f32ecdb9 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:51.313632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15208252-7c2f-440b-b252-4658f32ecdb9 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:51.320475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15208252-7c2f-440b-b252-4658f32ecdb9 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:51.321455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15208252-7c2f-440b-b252-4658f32ecdb9 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:51.323998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15208252-7c2f-440b-b252-4658f32ecdb9 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:51.324958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15208252-7c2f-440b-b252-4658f32ecdb9 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:51.326147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-15208252-7c2f-440b-b252-4658f32ecdb9 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:51.420867 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b6cf3372-00b9-42c9-a751-06cdc7c09b7c tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 204 len: 0 microversion: 2.1 time: 0.220816 Oct 05 18:05:51.422257 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2807/5363] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:05:51 2022] DELETE /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:05:51.439402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92c42ba1-6313-4809-b397-d373c55a7630 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:51.441205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92c42ba1-6313-4809-b397-d373c55a7630 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:51.450037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c42ba1-6313-4809-b397-d373c55a7630 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:51.452124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c42ba1-6313-4809-b397-d373c55a7630 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:51.452864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c42ba1-6313-4809-b397-d373c55a7630 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:51.455140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c42ba1-6313-4809-b397-d373c55a7630 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:51.455724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c42ba1-6313-4809-b397-d373c55a7630 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:51.456252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c42ba1-6313-4809-b397-d373c55a7630 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:51.643355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92c42ba1-6313-4809-b397-d373c55a7630 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:51.673523 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92c42ba1-6313-4809-b397-d373c55a7630 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1498 microversion: 2.1 time: 0.240187 Oct 05 18:05:51.675371 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2808/5364] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:51 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1498 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:51.904859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-15208252-7c2f-440b-b252-4658f32ecdb9 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:51.917278 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-15208252-7c2f-440b-b252-4658f32ecdb9 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1314 microversion: 2.1 time: 0.619600 Oct 05 18:05:51.919107 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2557/5365] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:51 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1314 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:52.717754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e31df9d8-63bd-43f8-b962-e422669b1b53 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:52.718851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e31df9d8-63bd-43f8-b962-e422669b1b53 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:52.752455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e31df9d8-63bd-43f8-b962-e422669b1b53 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:52.753724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e31df9d8-63bd-43f8-b962-e422669b1b53 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:52.754767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e31df9d8-63bd-43f8-b962-e422669b1b53 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:52.756352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e31df9d8-63bd-43f8-b962-e422669b1b53 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:52.757140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e31df9d8-63bd-43f8-b962-e422669b1b53 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:52.757893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e31df9d8-63bd-43f8-b962-e422669b1b53 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:52.950944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6de8e1a2-07e6-49bb-b6a7-a939b8f1007e tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:52.952203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6de8e1a2-07e6-49bb-b6a7-a939b8f1007e tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:52.962034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6de8e1a2-07e6-49bb-b6a7-a939b8f1007e tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:52.962840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6de8e1a2-07e6-49bb-b6a7-a939b8f1007e tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:52.963454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6de8e1a2-07e6-49bb-b6a7-a939b8f1007e tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:52.964473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6de8e1a2-07e6-49bb-b6a7-a939b8f1007e tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:52.965001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6de8e1a2-07e6-49bb-b6a7-a939b8f1007e tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:52.965423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6de8e1a2-07e6-49bb-b6a7-a939b8f1007e tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:53.039788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e31df9d8-63bd-43f8-b962-e422669b1b53 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:53.049748 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e31df9d8-63bd-43f8-b962-e422669b1b53 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1498 microversion: 2.1 time: 0.339299 Oct 05 18:05:53.050433 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2809/5366] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:52 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1498 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:53.556651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6de8e1a2-07e6-49bb-b6a7-a939b8f1007e tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:53.564599 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6de8e1a2-07e6-49bb-b6a7-a939b8f1007e tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1314 microversion: 2.1 time: 0.623400 Oct 05 18:05:53.565522 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2558/5367] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:52 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:53.584404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b275934a-0de1-45c3-b0c5-b15c58676728 req-7d3e7479-dd2b-407b-97e0-8761b1272f7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cef4b9c7-a98d-4313-a2c7-9b6c8b793e46", "name": "network-vif-deleted", "tag": "521abf8a-9c51-49d1-a6bf-5a21bf1bcd27"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:53.595670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b275934a-0de1-45c3-b0c5-b15c58676728 req-7d3e7479-dd2b-407b-97e0-8761b1272f7f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:53.597488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b275934a-0de1-45c3-b0c5-b15c58676728 req-7d3e7479-dd2b-407b-97e0-8761b1272f7f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:53.598726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b275934a-0de1-45c3-b0c5-b15c58676728 req-7d3e7479-dd2b-407b-97e0-8761b1272f7f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:53.635161 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b275934a-0de1-45c3-b0c5-b15c58676728 req-7d3e7479-dd2b-407b-97e0-8761b1272f7f service nova] Creating event network-vif-deleted:521abf8a-9c51-49d1-a6bf-5a21bf1bcd27 for instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 on n-h2-835595-3 Oct 05 18:05:53.640557 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b275934a-0de1-45c3-b0c5-b15c58676728 req-7d3e7479-dd2b-407b-97e0-8761b1272f7f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060958 Oct 05 18:05:53.641750 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2810/5368] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:05:54.075581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:54.076913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:54.088348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:54.090898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:54.092934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:54.095255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:54.095962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:54.096412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:54.116527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1853064208", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:54.181387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:54.181890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:54.182354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:54.182862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lazy-loading 'fault' on Instance uuid cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:05:54.225448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:05:54.266970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ea1c284fc254cc7a51d9e67d4fe8168', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46afad05f9ae454fbdf427fb1f6a2eb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:54.283405 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29b931b7-3037-4140-97be-b35b487abfc9 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 200 len: 1305 microversion: 2.1 time: 0.212260 Oct 05 18:05:54.289360 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2559/5369] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:54 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 1305 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:54.591963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47706552-fa37-4486-ad30-cc66d483a008 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:54.592863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47706552-fa37-4486-ad30-cc66d483a008 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:54.600710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47706552-fa37-4486-ad30-cc66d483a008 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:54.601578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47706552-fa37-4486-ad30-cc66d483a008 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:54.602250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47706552-fa37-4486-ad30-cc66d483a008 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:54.603232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47706552-fa37-4486-ad30-cc66d483a008 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:54.603939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47706552-fa37-4486-ad30-cc66d483a008 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:54.604593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47706552-fa37-4486-ad30-cc66d483a008 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:54.662599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:05:54.663313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:05:54.663965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:05:54.664580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:05:54.665168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:05:54.682212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:54.683841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:54.686932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:54.693842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:54.694527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:54.695072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:54.735721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Getting quotas for project a07ffeb0acb742c5b3504289ea57234f. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:05:54.752151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Getting quotas for user 6a18ec64caf24ef184c0d8725197367c and project a07ffeb0acb742c5b3504289ea57234f. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:05:54.776730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:05:54.789275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:05:54.860844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-47706552-fa37-4486-ad30-cc66d483a008 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:54.864935 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-620a5b89-4e07-44a1-ae47-641e78e277d5 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.753509 Oct 05 18:05:54.866245 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2811/5370] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:05:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 18:05:54.893478 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47706552-fa37-4486-ad30-cc66d483a008 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1314 microversion: 2.1 time: 0.291404 Oct 05 18:05:54.895886 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2560/5371] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:54 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:54.939604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e6c6d431-640a-4a21-bdbf-c555ad020a94 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:54.941402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e6c6d431-640a-4a21-bdbf-c555ad020a94 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.156367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e6c6d431-640a-4a21-bdbf-c555ad020a94 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:55.166547 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e6c6d431-640a-4a21-bdbf-c555ad020a94 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1214 microversion: 2.1 time: 0.291857 Oct 05 18:05:55.169507 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2812/5372] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:54 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1214 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:55.318814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.319452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.326563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:55.328439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=14 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:55.330615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.331289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.332155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.333132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.333963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.334990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.354150 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 HTTP/1.1 Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'cef4b9c7-a98d-4313-a2c7-9b6c8b793e46'} Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.356748 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.368391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.368391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.368391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.368391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.368391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.368391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.368391 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.371046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.371975 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-52942d72-f9f6-4565-a8d4-9c3ea5b5f18b tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 404 len: 111 microversion: 2.1 time: 0.063070 Oct 05 18:05:55.372905 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2561/5373] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:55 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:05:55.385871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.386603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.394048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.394803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.395422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.396113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.396560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.396981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.413156 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 HTTP/1.1 Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'cef4b9c7-a98d-4313-a2c7-9b6c8b793e46'} Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.415082 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-36a12d69-6a96-418e-bcec-cd9e40c87594 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 404 len: 111 microversion: 2.1 time: 0.037140 Oct 05 18:05:55.420659 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2813/5374] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:05:55 2022] DELETE /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:05:55.427420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.428326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: cef4b9c7-a98d-4313-a2c7-9b6c8b793e46] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.435063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.435813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.436448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.437331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.437961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.438611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.454577 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 HTTP/1.1 Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'cef4b9c7-a98d-4313-a2c7-9b6c8b793e46'} Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.456150 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.461900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.461900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.461900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.461900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.461900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.461900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. Oct 05 18:05:55.461900 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.461900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.461900 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e48d0544-d122-4166-8698-969cd4820ec8 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46" status: 404 len: 111 microversion: 2.1 time: 0.034770 Oct 05 18:05:55.461900 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2562/5375] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:55 2022] GET /compute/v2.1/servers/cef4b9c7-a98d-4313-a2c7-9b6c8b793e46 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:05:55.469019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.469735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.476172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.476735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.477228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.478001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.478562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.479040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.494650 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b HTTP/1.1 Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '40af7dd2-0a4d-49e3-87ab-798958f50b1b'} Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.496442 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-05b72503-fb88-4294-af9d-e8b54c34e1cc tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 404 len: 111 microversion: 2.1 time: 0.034203 Oct 05 18:05:55.502302 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2814/5376] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:05:55 2022] DELETE /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:05:55.508848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.509466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 40af7dd2-0a4d-49e3-87ab-798958f50b1b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.516095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.516586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.517019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.517721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.518175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.518629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.533018 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b HTTP/1.1 Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '40af7dd2-0a4d-49e3-87ab-798958f50b1b'} Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.534587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.540918 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.540918 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.540918 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.540918 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.540918 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.540918 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. Oct 05 18:05:55.540918 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.540918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 40af7dd2-0a4d-49e3-87ab-798958f50b1b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.540918 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c1950732-c03a-4588-9122-67b71a751e89 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b" status: 404 len: 111 microversion: 2.1 time: 0.031094 Oct 05 18:05:55.540918 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2563/5377] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:55 2022] GET /compute/v2.1/servers/40af7dd2-0a4d-49e3-87ab-798958f50b1b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:05:55.547333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.547845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.555689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.556257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.557295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.557431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.557897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.558322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.577332 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 HTTP/1.1 Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '0555770d-5774-4f39-b4ad-3fa29ac7ba32'} Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.579026 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6d3fa134-b6a0-4861-b762-36cd3d3120c7 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 404 len: 111 microversion: 2.1 time: 0.037303 Oct 05 18:05:55.583804 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2815/5378] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:05:55 2022] DELETE /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:05:55.590395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.591052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 0555770d-5774-4f39-b4ad-3fa29ac7ba32] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.597501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.597997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.598566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.599562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.600027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.600453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.617442 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 HTTP/1.1 Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '0555770d-5774-4f39-b4ad-3fa29ac7ba32'} Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.619058 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.625316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.625316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.625316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.625316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.625316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.625316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. Oct 05 18:05:55.625316 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.625316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 0555770d-5774-4f39-b4ad-3fa29ac7ba32 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.625316 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ab61ac89-e0bf-433c-9a60-de58c619daa2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32" status: 404 len: 111 microversion: 2.1 time: 0.034492 Oct 05 18:05:55.625316 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2564/5379] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:55 2022] GET /compute/v2.1/servers/0555770d-5774-4f39-b4ad-3fa29ac7ba32 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:05:55.638511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.638857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.646626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.647663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.647973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.648691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.649345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.649779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.664491 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a HTTP/1.1 Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4df58bf7-bd68-47ff-8761-115c79276c6a'} Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.666177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:05:55.671172 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.672624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.673850 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f4a38e2-6fd7-4cdc-a64f-232be2216dc2 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 404 len: 111 microversion: 2.1 time: 0.045111 Oct 05 18:05:55.677333 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2816/5380] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:05:55 2022] DELETE /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:05:55.683028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.683652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 4df58bf7-bd68-47ff-8761-115c79276c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.690094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.690628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.691384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.692326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.692788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.693212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.710454 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a HTTP/1.1 Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4df58bf7-bd68-47ff-8761-115c79276c6a'} Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.712026 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.720526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.720526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.720526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.720526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.720526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.720526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. Oct 05 18:05:55.720526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.720526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 4df58bf7-bd68-47ff-8761-115c79276c6a could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.720526 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9dc1b180-8254-4fbf-864f-ce8643153735 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a" status: 404 len: 111 microversion: 2.1 time: 0.034876 Oct 05 18:05:55.720526 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2565/5381] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:55 2022] GET /compute/v2.1/servers/4df58bf7-bd68-47ff-8761-115c79276c6a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:05:55.722817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec930d70-2f85-4ff6-a687-43691808763d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.723346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ec930d70-2f85-4ff6-a687-43691808763d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.731682 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-ec930d70-2f85-4ff6-a687-43691808763d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec930d70-2f85-4ff6-a687-43691808763d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 HTTP/1.1 Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '7fe22d75-5c2f-4405-aa2c-a25ecf4916d4'} Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.733270 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec930d70-2f85-4ff6-a687-43691808763d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ec930d70-2f85-4ff6-a687-43691808763d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4" status: 404 len: 111 microversion: 2.1 time: 0.016411 Oct 05 18:05:55.739279 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2817/5382] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:05:55 2022] DELETE /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:05:55.748807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1562dc42-7714-43c1-9d90-c293d5efebd6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.752949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1562dc42-7714-43c1-9d90-c293d5efebd6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.764648 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-1562dc42-7714-43c1-9d90-c293d5efebd6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1562dc42-7714-43c1-9d90-c293d5efebd6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 HTTP/1.1 Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '7fe22d75-5c2f-4405-aa2c-a25ecf4916d4'} Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:05:55.767115 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:05:55.775655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:05:55.775655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:05:55.775655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:05:55.775655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. Oct 05 18:05:55.775655 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:05:55.775655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1562dc42-7714-43c1-9d90-c293d5efebd6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:05:55.775655 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1562dc42-7714-43c1-9d90-c293d5efebd6 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4" status: 404 len: 111 microversion: 2.1 time: 0.029171 Oct 05 18:05:55.775655 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2566/5383] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:55 2022] GET /compute/v2.1/servers/7fe22d75-5c2f-4405-aa2c-a25ecf4916d4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:05:55.924221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d1e5207-a5fa-4016-bf71-df78ed3e9208 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:55.925116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d1e5207-a5fa-4016-bf71-df78ed3e9208 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:55.941634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1e5207-a5fa-4016-bf71-df78ed3e9208 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.942144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1e5207-a5fa-4016-bf71-df78ed3e9208 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.942914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1e5207-a5fa-4016-bf71-df78ed3e9208 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:55.945794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1e5207-a5fa-4016-bf71-df78ed3e9208 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:55.946273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1e5207-a5fa-4016-bf71-df78ed3e9208 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:55.946729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1e5207-a5fa-4016-bf71-df78ed3e9208 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:56.193506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4078cee5-ad59-4297-9069-6d9a051faa92 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:56.195006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4078cee5-ad59-4297-9069-6d9a051faa92 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:56.222971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4078cee5-ad59-4297-9069-6d9a051faa92 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:56.223833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4078cee5-ad59-4297-9069-6d9a051faa92 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:56.224554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4078cee5-ad59-4297-9069-6d9a051faa92 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:56.227872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4078cee5-ad59-4297-9069-6d9a051faa92 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:56.230699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4078cee5-ad59-4297-9069-6d9a051faa92 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:56.233849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4078cee5-ad59-4297-9069-6d9a051faa92 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:56.257997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d1e5207-a5fa-4016-bf71-df78ed3e9208 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:56.269082 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d1e5207-a5fa-4016-bf71-df78ed3e9208 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1314 microversion: 2.1 time: 0.349254 Oct 05 18:05:56.270132 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2818/5384] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:55 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:56.350944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4078cee5-ad59-4297-9069-6d9a051faa92 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:56.361177 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4078cee5-ad59-4297-9069-6d9a051faa92 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1266 microversion: 2.1 time: 0.174795 Oct 05 18:05:56.367657 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2567/5385] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:56 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:56.608538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1780245253", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "17dd75de-232f-439c-8209-8ce1000f7bc2", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "adb1494a-27b0-43e0-8027-66e89e0c81ad"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:56.760909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] validate_networks() for [('adb1494a-27b0-43e0-8027-66e89e0c81ad', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:05:57.150504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4c37d853-eb2c-4bd5-b092-4209714ce6c0 req-f79f041b-7b7d-4ed6-92e6-1a8929dcde04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e8ea3b-6f47-4c3b-b686-f27627abfa45", "name": "network-vif-plugged", "status": "completed", "tag": "f61cdcde-5a5b-4659-bfa9-5cd9c724094d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:05:57.170077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4c37d853-eb2c-4bd5-b092-4209714ce6c0 req-f79f041b-7b7d-4ed6-92e6-1a8929dcde04 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:57.171043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4c37d853-eb2c-4bd5-b092-4209714ce6c0 req-f79f041b-7b7d-4ed6-92e6-1a8929dcde04 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:57.171778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4c37d853-eb2c-4bd5-b092-4209714ce6c0 req-f79f041b-7b7d-4ed6-92e6-1a8929dcde04 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:57.191430 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4c37d853-eb2c-4bd5-b092-4209714ce6c0 req-f79f041b-7b7d-4ed6-92e6-1a8929dcde04 service nova] Creating event network-vif-plugged:f61cdcde-5a5b-4659-bfa9-5cd9c724094d for instance 25e8ea3b-6f47-4c3b-b686-f27627abfa45 on n-h1-835595-3 Oct 05 18:05:57.202478 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4c37d853-eb2c-4bd5-b092-4209714ce6c0 req-f79f041b-7b7d-4ed6-92e6-1a8929dcde04 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058208 Oct 05 18:05:57.203544 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2568/5386] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:05:57.309679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f2a917c-885c-4025-afc3-a1232eba5edf tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:57.311594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9f2a917c-885c-4025-afc3-a1232eba5edf tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:57.323975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f2a917c-885c-4025-afc3-a1232eba5edf tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:57.325808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f2a917c-885c-4025-afc3-a1232eba5edf tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:57.328706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f2a917c-885c-4025-afc3-a1232eba5edf tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:57.329601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f2a917c-885c-4025-afc3-a1232eba5edf tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:57.330184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f2a917c-885c-4025-afc3-a1232eba5edf tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:57.331793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f2a917c-885c-4025-afc3-a1232eba5edf tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:57.572786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f2a917c-885c-4025-afc3-a1232eba5edf tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:57.582600 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9f2a917c-885c-4025-afc3-a1232eba5edf tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1314 microversion: 2.1 time: 0.277651 Oct 05 18:05:57.587400 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2569/5387] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:57 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:57.599758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dff61460-1cae-4fa5-bab6-2f7e0f3a1931 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:57.602639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dff61460-1cae-4fa5-bab6-2f7e0f3a1931 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:57.611036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dff61460-1cae-4fa5-bab6-2f7e0f3a1931 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:57.613606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dff61460-1cae-4fa5-bab6-2f7e0f3a1931 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:57.615291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dff61460-1cae-4fa5-bab6-2f7e0f3a1931 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:57.616062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dff61460-1cae-4fa5-bab6-2f7e0f3a1931 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:57.616555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dff61460-1cae-4fa5-bab6-2f7e0f3a1931 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:57.621887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dff61460-1cae-4fa5-bab6-2f7e0f3a1931 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:57.716672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dff61460-1cae-4fa5-bab6-2f7e0f3a1931 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:57.743575 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dff61460-1cae-4fa5-bab6-2f7e0f3a1931 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1272 microversion: 2.1 time: 0.154171 Oct 05 18:05:57.746273 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2570/5388] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:57 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:58.148477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:05:58.149010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:05:58.150665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:05:58.150665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:05:58.150665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:05:58.168464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:58.169386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:58.170086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:58.171115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:58.171879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:58.172911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:58.228398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:05:58.237401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for user 8a900e5bf82d462a9113d6e6461ea3a0 and project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:05:58.260248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:05:58.263901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='17dd75de-232f-439c-8209-8ce1000f7bc2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:05:58.383493 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8cfaa952-dc6e-43ba-88f4-6e4bdb4bb05b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.778747 Oct 05 18:05:58.385749 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2819/5389] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:05:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:05:58.395487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-982097b0-c184-4cec-ad5c-9c796a3c90df tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:58.404542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-982097b0-c184-4cec-ad5c-9c796a3c90df tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:58.522850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-982097b0-c184-4cec-ad5c-9c796a3c90df tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:58.544531 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-982097b0-c184-4cec-ad5c-9c796a3c90df tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1057 microversion: 2.1 time: 0.152946 Oct 05 18:05:58.547071 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2571/5390] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:58 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1057 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:58.613280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7acfae2a-829c-4b7b-9c95-d6d7602f64ac tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:58.614112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7acfae2a-829c-4b7b-9c95-d6d7602f64ac tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:58.634704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7acfae2a-829c-4b7b-9c95-d6d7602f64ac tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:58.637482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7acfae2a-829c-4b7b-9c95-d6d7602f64ac tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:58.638940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7acfae2a-829c-4b7b-9c95-d6d7602f64ac tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:58.641105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7acfae2a-829c-4b7b-9c95-d6d7602f64ac tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:58.642584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7acfae2a-829c-4b7b-9c95-d6d7602f64ac tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:58.643601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7acfae2a-829c-4b7b-9c95-d6d7602f64ac tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:58.773257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b1cb12be-9568-4885-b8c5-98a81de45d22 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:58.774560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b1cb12be-9568-4885-b8c5-98a81de45d22 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:58.788350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1cb12be-9568-4885-b8c5-98a81de45d22 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:58.789285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1cb12be-9568-4885-b8c5-98a81de45d22 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:58.790163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1cb12be-9568-4885-b8c5-98a81de45d22 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:58.790524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1cb12be-9568-4885-b8c5-98a81de45d22 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:58.791045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1cb12be-9568-4885-b8c5-98a81de45d22 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:58.791755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1cb12be-9568-4885-b8c5-98a81de45d22 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:58.918462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b1cb12be-9568-4885-b8c5-98a81de45d22 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:58.932119 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b1cb12be-9568-4885-b8c5-98a81de45d22 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1272 microversion: 2.1 time: 0.162831 Oct 05 18:05:58.946309 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2572/5391] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:58 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:59.010637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7acfae2a-829c-4b7b-9c95-d6d7602f64ac tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:59.023703 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7acfae2a-829c-4b7b-9c95-d6d7602f64ac tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1464 microversion: 2.1 time: 0.415455 Oct 05 18:05:59.024848 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2820/5392] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:58 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1464 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:59.091279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f61e890a-3ba6-4428-81a1-414f3a213498 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:59.091939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f61e890a-3ba6-4428-81a1-414f3a213498 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:59.100738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f61e890a-3ba6-4428-81a1-414f3a213498 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:59.101581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f61e890a-3ba6-4428-81a1-414f3a213498 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:59.102260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f61e890a-3ba6-4428-81a1-414f3a213498 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:59.103568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f61e890a-3ba6-4428-81a1-414f3a213498 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:59.104280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f61e890a-3ba6-4428-81a1-414f3a213498 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:59.105626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f61e890a-3ba6-4428-81a1-414f3a213498 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:59.138897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f61e890a-3ba6-4428-81a1-414f3a213498 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:05:59.288845 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f61e890a-3ba6-4428-81a1-414f3a213498 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "DELETE /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 204 len: 0 microversion: 2.1 time: 0.203119 Oct 05 18:05:59.291359 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2573/5393] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:05:59 2022] DELETE /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:05:59.301508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6950740e-e62d-4abe-8098-ad0369a4e3ae tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:59.302943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6950740e-e62d-4abe-8098-ad0369a4e3ae tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:59.317839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6950740e-e62d-4abe-8098-ad0369a4e3ae tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:59.318643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6950740e-e62d-4abe-8098-ad0369a4e3ae tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:59.320217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6950740e-e62d-4abe-8098-ad0369a4e3ae tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:59.323586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6950740e-e62d-4abe-8098-ad0369a4e3ae tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:59.324685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6950740e-e62d-4abe-8098-ad0369a4e3ae tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:59.326837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6950740e-e62d-4abe-8098-ad0369a4e3ae tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:59.385392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:59.574888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-02f4de2b-7f37-4af3-951f-27706d997440 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:59.576521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-02f4de2b-7f37-4af3-951f-27706d997440 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:59.588651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4de2b-7f37-4af3-951f-27706d997440 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:59.589534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4de2b-7f37-4af3-951f-27706d997440 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:59.590848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4de2b-7f37-4af3-951f-27706d997440 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:59.591932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4de2b-7f37-4af3-951f-27706d997440 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:59.592655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4de2b-7f37-4af3-951f-27706d997440 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:59.594269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4de2b-7f37-4af3-951f-27706d997440 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:59.671215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6950740e-e62d-4abe-8098-ad0369a4e3ae tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:59.683004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-02f4de2b-7f37-4af3-951f-27706d997440 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:05:59.685262 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6950740e-e62d-4abe-8098-ad0369a4e3ae tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1470 microversion: 2.1 time: 0.388454 Oct 05 18:05:59.685962 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2821/5394] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:59 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1470 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:05:59.692040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:05:59.698218 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-02f4de2b-7f37-4af3-951f-27706d997440 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1109 microversion: 2.1 time: 0.130507 Oct 05 18:05:59.699348 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2574/5395] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:59 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1109 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:05:59.971582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dd26d4a7-d17b-4f42-a81e-bd3c922119f6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:05:59.972781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dd26d4a7-d17b-4f42-a81e-bd3c922119f6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:05:59.984790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd26d4a7-d17b-4f42-a81e-bd3c922119f6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:59.985962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd26d4a7-d17b-4f42-a81e-bd3c922119f6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:59.987419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd26d4a7-d17b-4f42-a81e-bd3c922119f6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:05:59.988526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd26d4a7-d17b-4f42-a81e-bd3c922119f6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:05:59.989782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd26d4a7-d17b-4f42-a81e-bd3c922119f6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:05:59.990573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd26d4a7-d17b-4f42-a81e-bd3c922119f6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.472073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:00.473241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:00.481077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.481867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.482525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.483494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.484123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.484767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.505535 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 HTTP/1.1 Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '20aa0b2c-3b0c-4f45-857c-24c41c351050'} Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:06:00.508543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:06:00.513540 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.515768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:06:00.516869 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-709b7763-cf4f-4b58-ba5a-2efebdfbf3f1 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 404 len: 111 microversion: 2.1 time: 0.050828 Oct 05 18:06:00.518349 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2575/5396] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:06:00 2022] DELETE /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:06:00.536998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:00.537739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 20aa0b2c-3b0c-4f45-857c-24c41c351050] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:00.544694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:06:00.547814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.548749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.549370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.551261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.552089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.552975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.579534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd26d4a7-d17b-4f42-a81e-bd3c922119f6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:00.589895 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 HTTP/1.1 Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '20aa0b2c-3b0c-4f45-857c-24c41c351050'} Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:00.593646 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.601114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.601114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:00.601114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:00.601114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:06:00.601114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:06:00.601114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. Oct 05 18:06:00.601114 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.604639 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dd26d4a7-d17b-4f42-a81e-bd3c922119f6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1314 microversion: 2.1 time: 0.638158 Oct 05 18:06:00.604966 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2822/5397] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:05:59 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1314 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:00.620037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 20aa0b2c-3b0c-4f45-857c-24c41c351050 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:06:00.621243 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e6c07b7-5d85-486a-9a1e-45e5cc80e3cb tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050" status: 404 len: 111 microversion: 2.1 time: 0.097650 Oct 05 18:06:00.625317 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2576/5398] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:00 2022] GET /compute/v2.1/servers/20aa0b2c-3b0c-4f45-857c-24c41c351050 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:06:00.634509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:00.635039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:00.646028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.646867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.653788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.654711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.655203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.655638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.688566 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c HTTP/1.1 Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '067a432f-a320-4421-859f-fc9decbef21c'} Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:06:00.691645 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:06:00.697721 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1fec1d62-7fb4-4795-999d-0d810a63bc32 tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "DELETE /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 404 len: 111 microversion: 2.1 time: 0.065773 Oct 05 18:06:00.702790 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2823/5399] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:06:00 2022] DELETE /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:06:00.705798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:00.706810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] [instance: 067a432f-a320-4421-859f-fc9decbef21c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:00.713899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d7a75934-bdfc-42a6-8d2d-a361e3a4a409 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:00.714549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d7a75934-bdfc-42a6-8d2d-a361e3a4a409 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:00.724356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.725759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.726422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7a75934-bdfc-42a6-8d2d-a361e3a4a409 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.726887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7a75934-bdfc-42a6-8d2d-a361e3a4a409 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.727267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.727434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7a75934-bdfc-42a6-8d2d-a361e3a4a409 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.728021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7a75934-bdfc-42a6-8d2d-a361e3a4a409 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.728477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7a75934-bdfc-42a6-8d2d-a361e3a4a409 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.728893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d7a75934-bdfc-42a6-8d2d-a361e3a4a409 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.730561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.731409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.733144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.777200 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] HTTP exception thrown: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Request method failure captured: Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c HTTP/1.1 Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcZAk95X-P9vgWff_l7KT2W8v7_ldFY-DLHnlo1bl8Yemy_IbkiL2VA6Wn_lwg7Mx2hoPZtLMIXcHNcDSFWbCAEbj2EE7Qpo8C9VGkSzT3I0tfLCOGpn8O-yBzSxp0ZOQBHIT2ByAQ89nNrtXBBbBsCumk7WYFr3le5A-yXuULs0RhI Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_46afad05f9ae454fbdf427fb1f6a2eb3", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/46afad05f9ae454fbdf427fb1f6a2eb3"}]}] Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 46afad05f9ae454fbdf427fb1f6a2eb3 Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1098764899 Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9ea1c284fc254cc7a51d9e67d4fe8168 Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1098764899-project Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '067a432f-a320-4421-859f-fc9decbef21c'} Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:00.780612 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.786622 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:00.786622 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:00.786622 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:00.786622 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:06:00.786622 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:06:00.786622 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. Oct 05 18:06:00.786622 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:00.786622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] Returning 404 to user: Instance 067a432f-a320-4421-859f-fc9decbef21c could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:06:00.789362 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e6158c4c-0caf-4b28-a8ab-09ece235cf2d tempest-DeleteServersTestJSON-1098764899 tempest-DeleteServersTestJSON-1098764899-project] 10.222.0.70 "GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c" status: 404 len: 111 microversion: 2.1 time: 0.087743 Oct 05 18:06:00.792743 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2577/5400] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:00 2022] GET /compute/v2.1/servers/067a432f-a320-4421-859f-fc9decbef21c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:06:00.803231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e30f4a35-2bc1-4004-b0a1-732a12d80db6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:00.803982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e30f4a35-2bc1-4004-b0a1-732a12d80db6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:00.819911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e30f4a35-2bc1-4004-b0a1-732a12d80db6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.822645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e30f4a35-2bc1-4004-b0a1-732a12d80db6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.823188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e30f4a35-2bc1-4004-b0a1-732a12d80db6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:00.824046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e30f4a35-2bc1-4004-b0a1-732a12d80db6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:00.825659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e30f4a35-2bc1-4004-b0a1-732a12d80db6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:00.826161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e30f4a35-2bc1-4004-b0a1-732a12d80db6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:01.009542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e30f4a35-2bc1-4004-b0a1-732a12d80db6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:01.023659 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e30f4a35-2bc1-4004-b0a1-732a12d80db6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1127 microversion: 2.1 time: 0.229614 Oct 05 18:06:01.024264 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2578/5401] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:00 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1127 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:01.513313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3afb9c0c-8890-4000-8c7b-a337d5e24ef6 req-8a59d855-9061-42de-8a76-94a9d11b53fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25e8ea3b-6f47-4c3b-b686-f27627abfa45", "name": "network-vif-deleted", "tag": "f61cdcde-5a5b-4659-bfa9-5cd9c724094d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:06:01.536202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3afb9c0c-8890-4000-8c7b-a337d5e24ef6 req-8a59d855-9061-42de-8a76-94a9d11b53fc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:01.537796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3afb9c0c-8890-4000-8c7b-a337d5e24ef6 req-8a59d855-9061-42de-8a76-94a9d11b53fc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:01.538866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3afb9c0c-8890-4000-8c7b-a337d5e24ef6 req-8a59d855-9061-42de-8a76-94a9d11b53fc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:01.554134 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3afb9c0c-8890-4000-8c7b-a337d5e24ef6 req-8a59d855-9061-42de-8a76-94a9d11b53fc service nova] Creating event network-vif-deleted:f61cdcde-5a5b-4659-bfa9-5cd9c724094d for instance 25e8ea3b-6f47-4c3b-b686-f27627abfa45 on n-h1-835595-3 Oct 05 18:06:01.562180 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3afb9c0c-8890-4000-8c7b-a337d5e24ef6 req-8a59d855-9061-42de-8a76-94a9d11b53fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055674 Oct 05 18:06:01.576825 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2579/5402] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:06:01.630147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-08e2c234-8b80-47d7-b927-fcb9cb7bdfe8 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:01.631528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-08e2c234-8b80-47d7-b927-fcb9cb7bdfe8 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:01.645597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08e2c234-8b80-47d7-b927-fcb9cb7bdfe8 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:01.647915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08e2c234-8b80-47d7-b927-fcb9cb7bdfe8 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:01.649703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08e2c234-8b80-47d7-b927-fcb9cb7bdfe8 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:01.651224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08e2c234-8b80-47d7-b927-fcb9cb7bdfe8 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:01.651864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08e2c234-8b80-47d7-b927-fcb9cb7bdfe8 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:01.652415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08e2c234-8b80-47d7-b927-fcb9cb7bdfe8 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:01.724695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d7a75934-bdfc-42a6-8d2d-a361e3a4a409 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41c41f2da6d646508118b4aaf38321d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d0e1365956143a182f7a45142d5f389', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:01.754876 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d7a75934-bdfc-42a6-8d2d-a361e3a4a409 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 200 len: 1470 microversion: 2.1 time: 1.041636 Oct 05 18:06:01.774791 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2824/5403] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:00 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 1470 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:01.969000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08e2c234-8b80-47d7-b927-fcb9cb7bdfe8 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:01.979117 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-08e2c234-8b80-47d7-b927-fcb9cb7bdfe8 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1314 microversion: 2.1 time: 0.354972 Oct 05 18:06:01.980483 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2580/5404] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:01 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:06:02.049212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a9e1914e-b1fa-41b4-8f77-30bf31075aaa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:02.050425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a9e1914e-b1fa-41b4-8f77-30bf31075aaa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:02.057584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9e1914e-b1fa-41b4-8f77-30bf31075aaa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:02.060438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9e1914e-b1fa-41b4-8f77-30bf31075aaa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:02.061244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9e1914e-b1fa-41b4-8f77-30bf31075aaa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:02.064807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9e1914e-b1fa-41b4-8f77-30bf31075aaa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:02.066208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9e1914e-b1fa-41b4-8f77-30bf31075aaa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:02.066973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9e1914e-b1fa-41b4-8f77-30bf31075aaa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:02.470648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a9e1914e-b1fa-41b4-8f77-30bf31075aaa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:02.483089 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a9e1914e-b1fa-41b4-8f77-30bf31075aaa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1127 microversion: 2.1 time: 0.435608 Oct 05 18:06:02.483717 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2825/5405] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:02 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1127 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:02.783290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:02.784604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] [instance: 25e8ea3b-6f47-4c3b-b686-f27627abfa45] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:02.792859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:02.793350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:02.794970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:02.795729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:02.796588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:02.797030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:02.812407 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] HTTP exception thrown: Instance 25e8ea3b-6f47-4c3b-b686-f27627abfa45 could not be found. Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Request method failure captured: Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 HTTP/1.1 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcd1WwdbDZ59QCtSI_5WpKaKa6Hlfkor_ob6XwqZXFZoq82HW1b5To1Utulj40Td-wJ215Pl4wf3DneMhYKhRjep2GgazhbsurEP_5Vv0BtYFNXLwXgwX12WPjJjI7zijjXja84y0pgq0Uou4vbUky47f54tEDrhl_HJtsDTtTQSeK8 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 0d0e1365956143a182f7a45142d5f389 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-VolumesNegativeTest-1651999132 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/0d0e1365956143a182f7a45142d5f389"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0d0e1365956143a182f7a45142d5f389"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_0d0e1365956143a182f7a45142d5f389", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/0d0e1365956143a182f7a45142d5f389"}]}] Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-VolumesNegativeTest-1651999132 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 0d0e1365956143a182f7a45142d5f389 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-VolumesNegativeTest-1651999132 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-VolumesNegativeTest-1651999132-project Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 41c41f2da6d646508118b4aaf38321d2 Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-VolumesNegativeTest-1651999132-project Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 25e8ea3b-6f47-4c3b-b686-f27627abfa45 could not be found. Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '25e8ea3b-6f47-4c3b-b686-f27627abfa45'} Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25e8ea3b-6f47-4c3b-b686-f27627abfa45 could not be found. Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25e8ea3b-6f47-4c3b-b686-f27627abfa45 could not be found. Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:02.814191 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:02.824908 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:02.824908 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:02.824908 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:02.824908 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:06:02.824908 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:06:02.824908 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25e8ea3b-6f47-4c3b-b686-f27627abfa45 could not be found. Oct 05 18:06:02.824908 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:02.824908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] Returning 404 to user: Instance 25e8ea3b-6f47-4c3b-b686-f27627abfa45 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:06:02.824908 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-458c84a5-a6c1-4f8d-9d22-721aabd854f8 tempest-VolumesNegativeTest-1651999132 tempest-VolumesNegativeTest-1651999132-project] 10.222.0.70 "GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45" status: 404 len: 111 microversion: 2.1 time: 0.037190 Oct 05 18:06:02.824908 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2581/5406] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:02 2022] GET /compute/v2.1/servers/25e8ea3b-6f47-4c3b-b686-f27627abfa45 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:06:03.004924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25b68282-2545-4448-9111-a170d3a6ff9a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:03.007362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25b68282-2545-4448-9111-a170d3a6ff9a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:03.018040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b68282-2545-4448-9111-a170d3a6ff9a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:03.019661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b68282-2545-4448-9111-a170d3a6ff9a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:03.020117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b68282-2545-4448-9111-a170d3a6ff9a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:03.022856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b68282-2545-4448-9111-a170d3a6ff9a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:03.024807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b68282-2545-4448-9111-a170d3a6ff9a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:03.025273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b68282-2545-4448-9111-a170d3a6ff9a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:03.507868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da7db736-0b46-4efe-bc73-22c3f1f520de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:03.508747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da7db736-0b46-4efe-bc73-22c3f1f520de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:03.517252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da7db736-0b46-4efe-bc73-22c3f1f520de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:03.518533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da7db736-0b46-4efe-bc73-22c3f1f520de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:03.521418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da7db736-0b46-4efe-bc73-22c3f1f520de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:03.523977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da7db736-0b46-4efe-bc73-22c3f1f520de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:03.528518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da7db736-0b46-4efe-bc73-22c3f1f520de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:03.529401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da7db736-0b46-4efe-bc73-22c3f1f520de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:03.590027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25b68282-2545-4448-9111-a170d3a6ff9a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:03.600529 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25b68282-2545-4448-9111-a170d3a6ff9a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1314 microversion: 2.1 time: 0.601198 Oct 05 18:06:03.614952 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2826/5407] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:02 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:03.655320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-da7db736-0b46-4efe-bc73-22c3f1f520de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:03.667842 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da7db736-0b46-4efe-bc73-22c3f1f520de tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1127 microversion: 2.1 time: 0.164926 Oct 05 18:06:03.668993 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2582/5408] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:03 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1127 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:04.179100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-90e9df40-08e6-44b4-9eae-bd84983243ae req-3f3d7d53-d1ff-458d-84af-92241e0e73c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45e3f18f-be09-45f1-b0b9-8291c36c2a77", "tag": "08e21991-beaf-4a5d-b250-1959cbe6da12"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:06:04.211100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-90e9df40-08e6-44b4-9eae-bd84983243ae req-3f3d7d53-d1ff-458d-84af-92241e0e73c7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:04.213510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-90e9df40-08e6-44b4-9eae-bd84983243ae req-3f3d7d53-d1ff-458d-84af-92241e0e73c7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:04.214090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-90e9df40-08e6-44b4-9eae-bd84983243ae req-3f3d7d53-d1ff-458d-84af-92241e0e73c7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:04.244078 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-90e9df40-08e6-44b4-9eae-bd84983243ae req-3f3d7d53-d1ff-458d-84af-92241e0e73c7 service nova] Creating event network-changed:08e21991-beaf-4a5d-b250-1959cbe6da12 for instance 45e3f18f-be09-45f1-b0b9-8291c36c2a77 on n-h2-835595-3 Oct 05 18:06:04.267404 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-90e9df40-08e6-44b4-9eae-bd84983243ae req-3f3d7d53-d1ff-458d-84af-92241e0e73c7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088613 Oct 05 18:06:04.269395 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2827/5409] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:06:04.628958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9440d6bd-a805-43cb-92ba-63175d94d02c tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:04.629589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9440d6bd-a805-43cb-92ba-63175d94d02c tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:04.644030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9440d6bd-a805-43cb-92ba-63175d94d02c tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:04.644541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9440d6bd-a805-43cb-92ba-63175d94d02c tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:04.644970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9440d6bd-a805-43cb-92ba-63175d94d02c tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:04.645684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9440d6bd-a805-43cb-92ba-63175d94d02c tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:04.646152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9440d6bd-a805-43cb-92ba-63175d94d02c tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:04.646596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9440d6bd-a805-43cb-92ba-63175d94d02c tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:04.701064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f3a7ea7b-0941-4b6d-8604-940f858d230b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:04.705457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f3a7ea7b-0941-4b6d-8604-940f858d230b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:04.739505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a7ea7b-0941-4b6d-8604-940f858d230b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:04.744974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a7ea7b-0941-4b6d-8604-940f858d230b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:04.745596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a7ea7b-0941-4b6d-8604-940f858d230b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:04.749139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a7ea7b-0941-4b6d-8604-940f858d230b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:04.750133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a7ea7b-0941-4b6d-8604-940f858d230b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:04.751961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a7ea7b-0941-4b6d-8604-940f858d230b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:05.171328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9440d6bd-a805-43cb-92ba-63175d94d02c tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:05.183725 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9440d6bd-a805-43cb-92ba-63175d94d02c tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1314 microversion: 2.1 time: 0.559193 Oct 05 18:06:05.188266 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2583/5410] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:04 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:05.763773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f3a7ea7b-0941-4b6d-8604-940f858d230b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:05.795674 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f3a7ea7b-0941-4b6d-8604-940f858d230b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 1.099486 Oct 05 18:06:05.805542 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2828/5411] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:04 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:06.214946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-026d3f6e-68e9-434c-9f25-0c4deaf918d6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:06.216152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-026d3f6e-68e9-434c-9f25-0c4deaf918d6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:06.228333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-026d3f6e-68e9-434c-9f25-0c4deaf918d6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:06.233547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-026d3f6e-68e9-434c-9f25-0c4deaf918d6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:06.234343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-026d3f6e-68e9-434c-9f25-0c4deaf918d6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:06.235437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-026d3f6e-68e9-434c-9f25-0c4deaf918d6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:06.236375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-026d3f6e-68e9-434c-9f25-0c4deaf918d6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:06.237134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-026d3f6e-68e9-434c-9f25-0c4deaf918d6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:06.825613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd03d21f-f5b5-45f4-9c64-5663f1a090eb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:06.838483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fd03d21f-f5b5-45f4-9c64-5663f1a090eb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:06.887216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd03d21f-f5b5-45f4-9c64-5663f1a090eb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:06.890460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd03d21f-f5b5-45f4-9c64-5663f1a090eb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:06.891002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd03d21f-f5b5-45f4-9c64-5663f1a090eb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:06.891779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd03d21f-f5b5-45f4-9c64-5663f1a090eb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:06.892261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd03d21f-f5b5-45f4-9c64-5663f1a090eb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:06.892696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd03d21f-f5b5-45f4-9c64-5663f1a090eb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:07.096776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-026d3f6e-68e9-434c-9f25-0c4deaf918d6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:07.109701 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-026d3f6e-68e9-434c-9f25-0c4deaf918d6 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1314 microversion: 2.1 time: 0.899015 Oct 05 18:06:07.174235 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2584/5412] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:06 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1314 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:08.146987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-878fbae8-f860-424b-a30d-5db3cdf8c90a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:08.147873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-878fbae8-f860-424b-a30d-5db3cdf8c90a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:08.172166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-878fbae8-f860-424b-a30d-5db3cdf8c90a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:08.174218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-878fbae8-f860-424b-a30d-5db3cdf8c90a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:08.175613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-878fbae8-f860-424b-a30d-5db3cdf8c90a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:08.198832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-878fbae8-f860-424b-a30d-5db3cdf8c90a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:08.199862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-878fbae8-f860-424b-a30d-5db3cdf8c90a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:08.199989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:06:08.201834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-878fbae8-f860-424b-a30d-5db3cdf8c90a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:08.252017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=14 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:06:08.528417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:06:09.036721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd03d21f-f5b5-45f4-9c64-5663f1a090eb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:09.064404 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd03d21f-f5b5-45f4-9c64-5663f1a090eb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 2.242686 Oct 05 18:06:09.070805 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2829/5413] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:06 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:06:09.473996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-878fbae8-f860-424b-a30d-5db3cdf8c90a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:09.495188 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-878fbae8-f860-424b-a30d-5db3cdf8c90a tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1314 microversion: 2.1 time: 1.353506 Oct 05 18:06:09.496826 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2585/5414] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:08 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1314 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:10.094813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a332e429-5060-440c-8159-6f7e91d584ef tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:10.096056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a332e429-5060-440c-8159-6f7e91d584ef tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:10.115971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:06:10.157403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a332e429-5060-440c-8159-6f7e91d584ef tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:10.158023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a332e429-5060-440c-8159-6f7e91d584ef tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:10.158547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a332e429-5060-440c-8159-6f7e91d584ef tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:10.159612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a332e429-5060-440c-8159-6f7e91d584ef tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:10.161820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a332e429-5060-440c-8159-6f7e91d584ef tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:10.171103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a332e429-5060-440c-8159-6f7e91d584ef tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:10.510126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7c68702e-fc76-435c-92f3-f91401c83c32 req-33c36de1-a8b3-46a9-813f-41c519587863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e149a2f9-cf84-45a8-b501-042db0064557", "tag": "40e6252d-8c5b-4778-a3fb-36af1192fa5b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:06:10.532398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7c68702e-fc76-435c-92f3-f91401c83c32 req-33c36de1-a8b3-46a9-813f-41c519587863 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:10.533204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7c68702e-fc76-435c-92f3-f91401c83c32 req-33c36de1-a8b3-46a9-813f-41c519587863 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:10.534115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7c68702e-fc76-435c-92f3-f91401c83c32 req-33c36de1-a8b3-46a9-813f-41c519587863 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:10.562991 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7c68702e-fc76-435c-92f3-f91401c83c32 req-33c36de1-a8b3-46a9-813f-41c519587863 service nova] Creating event network-changed:40e6252d-8c5b-4778-a3fb-36af1192fa5b for instance e149a2f9-cf84-45a8-b501-042db0064557 on n-h2-835595-3 Oct 05 18:06:10.576279 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7c68702e-fc76-435c-92f3-f91401c83c32 req-33c36de1-a8b3-46a9-813f-41c519587863 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070738 Oct 05 18:06:10.576905 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2586/5415] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:06:10.582719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-945266b2-6d60-4a50-822b-49159cc208ce tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:10.588901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-945266b2-6d60-4a50-822b-49159cc208ce tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:10.605924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-945266b2-6d60-4a50-822b-49159cc208ce tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:10.607159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-945266b2-6d60-4a50-822b-49159cc208ce tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:10.607807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-945266b2-6d60-4a50-822b-49159cc208ce tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:10.608724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-945266b2-6d60-4a50-822b-49159cc208ce tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:10.609391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-945266b2-6d60-4a50-822b-49159cc208ce tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:10.610040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-945266b2-6d60-4a50-822b-49159cc208ce tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:10.983659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a332e429-5060-440c-8159-6f7e91d584ef tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:11.005148 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a332e429-5060-440c-8159-6f7e91d584ef tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.914467 Oct 05 18:06:11.007163 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2830/5416] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:10 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:11.389841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-945266b2-6d60-4a50-822b-49159cc208ce tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:11.404216 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-945266b2-6d60-4a50-822b-49159cc208ce tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1314 microversion: 2.1 time: 0.825920 Oct 05 18:06:11.404883 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2587/5417] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:10 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:12.029873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0912b8c9-fe3c-4aca-9790-cfde1e7cee0d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:12.030676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0912b8c9-fe3c-4aca-9790-cfde1e7cee0d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:12.044011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0912b8c9-fe3c-4aca-9790-cfde1e7cee0d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:12.044797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0912b8c9-fe3c-4aca-9790-cfde1e7cee0d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:12.054745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0912b8c9-fe3c-4aca-9790-cfde1e7cee0d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:12.055629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0912b8c9-fe3c-4aca-9790-cfde1e7cee0d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:12.056341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0912b8c9-fe3c-4aca-9790-cfde1e7cee0d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:12.056986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0912b8c9-fe3c-4aca-9790-cfde1e7cee0d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:12.404982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0912b8c9-fe3c-4aca-9790-cfde1e7cee0d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:12.429715 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0912b8c9-fe3c-4aca-9790-cfde1e7cee0d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.403564 Oct 05 18:06:12.441415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ff53d55-f0ff-4ded-8aa1-04ad61226a05 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:12.442234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0ff53d55-f0ff-4ded-8aa1-04ad61226a05 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:12.443154 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2831/5418] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:12 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:12.464782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ff53d55-f0ff-4ded-8aa1-04ad61226a05 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:12.465293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ff53d55-f0ff-4ded-8aa1-04ad61226a05 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:12.465734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ff53d55-f0ff-4ded-8aa1-04ad61226a05 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:12.466490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ff53d55-f0ff-4ded-8aa1-04ad61226a05 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:12.466963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ff53d55-f0ff-4ded-8aa1-04ad61226a05 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:12.467392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ff53d55-f0ff-4ded-8aa1-04ad61226a05 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:12.977957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0ff53d55-f0ff-4ded-8aa1-04ad61226a05 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:12.987972 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0ff53d55-f0ff-4ded-8aa1-04ad61226a05 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1314 microversion: 2.1 time: 0.558479 Oct 05 18:06:12.993854 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2588/5419] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:12 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:13.185816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d72b5f68-6913-4cca-a8cd-42932c7d1657 req-ea23b610-798b-46e1-b04f-f6ba9cf7dbfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e3f18f-be09-45f1-b0b9-8291c36c2a77", "name": "network-vif-plugged", "status": "completed", "tag": "08e21991-beaf-4a5d-b250-1959cbe6da12"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:06:13.216869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d72b5f68-6913-4cca-a8cd-42932c7d1657 req-ea23b610-798b-46e1-b04f-f6ba9cf7dbfb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:13.221191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d72b5f68-6913-4cca-a8cd-42932c7d1657 req-ea23b610-798b-46e1-b04f-f6ba9cf7dbfb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:13.223745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d72b5f68-6913-4cca-a8cd-42932c7d1657 req-ea23b610-798b-46e1-b04f-f6ba9cf7dbfb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:13.300173 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d72b5f68-6913-4cca-a8cd-42932c7d1657 req-ea23b610-798b-46e1-b04f-f6ba9cf7dbfb service nova] Creating event network-vif-plugged:08e21991-beaf-4a5d-b250-1959cbe6da12 for instance 45e3f18f-be09-45f1-b0b9-8291c36c2a77 on n-h2-835595-3 Oct 05 18:06:13.340782 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d72b5f68-6913-4cca-a8cd-42932c7d1657 req-ea23b610-798b-46e1-b04f-f6ba9cf7dbfb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150920 Oct 05 18:06:13.344183 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2832/5420] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:06:13.477411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4492e0bb-6004-407a-958d-17c752f2f6e3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:13.478711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4492e0bb-6004-407a-958d-17c752f2f6e3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:13.493307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4492e0bb-6004-407a-958d-17c752f2f6e3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:13.496298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4492e0bb-6004-407a-958d-17c752f2f6e3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:13.499941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4492e0bb-6004-407a-958d-17c752f2f6e3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:13.500920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4492e0bb-6004-407a-958d-17c752f2f6e3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:13.501568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4492e0bb-6004-407a-958d-17c752f2f6e3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:13.502480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4492e0bb-6004-407a-958d-17c752f2f6e3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:14.017815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-490858a4-dc73-470a-9622-3eb87d1db676 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:14.019041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-490858a4-dc73-470a-9622-3eb87d1db676 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:14.031321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-490858a4-dc73-470a-9622-3eb87d1db676 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:14.034603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-490858a4-dc73-470a-9622-3eb87d1db676 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:14.043604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-490858a4-dc73-470a-9622-3eb87d1db676 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:14.044674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-490858a4-dc73-470a-9622-3eb87d1db676 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:14.051884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-490858a4-dc73-470a-9622-3eb87d1db676 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:14.071400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-490858a4-dc73-470a-9622-3eb87d1db676 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:14.375316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4492e0bb-6004-407a-958d-17c752f2f6e3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:14.392496 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4492e0bb-6004-407a-958d-17c752f2f6e3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.918862 Oct 05 18:06:14.408445 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2589/5421] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:13 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:15.420690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-461308aa-3654-4bf1-8d70-6b3d89a94845 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:15.421992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-461308aa-3654-4bf1-8d70-6b3d89a94845 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:15.440916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461308aa-3654-4bf1-8d70-6b3d89a94845 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:15.454573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461308aa-3654-4bf1-8d70-6b3d89a94845 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:15.455243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461308aa-3654-4bf1-8d70-6b3d89a94845 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:15.456237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461308aa-3654-4bf1-8d70-6b3d89a94845 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:15.456833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461308aa-3654-4bf1-8d70-6b3d89a94845 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:15.457383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461308aa-3654-4bf1-8d70-6b3d89a94845 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:15.719405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-490858a4-dc73-470a-9622-3eb87d1db676 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:15.773116 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-490858a4-dc73-470a-9622-3eb87d1db676 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1314 microversion: 2.1 time: 1.759599 Oct 05 18:06:15.774053 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2833/5422] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:14 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1314 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:06:15.855019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-461308aa-3654-4bf1-8d70-6b3d89a94845 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:15.868990 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-461308aa-3654-4bf1-8d70-6b3d89a94845 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.452430 Oct 05 18:06:15.869829 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2590/5423] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:15 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:06:16.801736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-57a27757-6c6b-4cd6-acbe-8bdefe15b984 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:16.803499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-57a27757-6c6b-4cd6-acbe-8bdefe15b984 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:16.820533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57a27757-6c6b-4cd6-acbe-8bdefe15b984 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:16.821042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57a27757-6c6b-4cd6-acbe-8bdefe15b984 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:16.821494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57a27757-6c6b-4cd6-acbe-8bdefe15b984 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:16.822225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57a27757-6c6b-4cd6-acbe-8bdefe15b984 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:16.822743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57a27757-6c6b-4cd6-acbe-8bdefe15b984 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:16.829366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-57a27757-6c6b-4cd6-acbe-8bdefe15b984 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:16.896672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-198126aa-b98d-4931-8a9c-32a26bd5c2cb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:16.897838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-198126aa-b98d-4931-8a9c-32a26bd5c2cb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:16.931862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198126aa-b98d-4931-8a9c-32a26bd5c2cb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:16.932837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198126aa-b98d-4931-8a9c-32a26bd5c2cb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:16.933431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198126aa-b98d-4931-8a9c-32a26bd5c2cb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:16.934477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198126aa-b98d-4931-8a9c-32a26bd5c2cb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:16.935115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198126aa-b98d-4931-8a9c-32a26bd5c2cb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:16.946090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-198126aa-b98d-4931-8a9c-32a26bd5c2cb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:17.219054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-57a27757-6c6b-4cd6-acbe-8bdefe15b984 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:17.229806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-198126aa-b98d-4931-8a9c-32a26bd5c2cb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:17.229968 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-57a27757-6c6b-4cd6-acbe-8bdefe15b984 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1464 microversion: 2.1 time: 0.435058 Oct 05 18:06:17.233887 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2834/5424] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:16 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1464 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:17.242029 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-198126aa-b98d-4931-8a9c-32a26bd5c2cb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.352700 Oct 05 18:06:17.259172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1b0f221-a56b-4dff-9c76-a929ad7a5b3e tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c143d3ab-c5b7-495d-9df6-d7e21f2a1512", "device": "/dev/sdb"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:06:17.259601 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2591/5425] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:16 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:17.268944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f1b0f221-a56b-4dff-9c76-a929ad7a5b3e tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:17.275823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b0f221-a56b-4dff-9c76-a929ad7a5b3e tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:17.276528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b0f221-a56b-4dff-9c76-a929ad7a5b3e tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:17.277231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b0f221-a56b-4dff-9c76-a929ad7a5b3e tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:17.278417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b0f221-a56b-4dff-9c76-a929ad7a5b3e tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:17.279066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b0f221-a56b-4dff-9c76-a929ad7a5b3e tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:17.280465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b0f221-a56b-4dff-9c76-a929ad7a5b3e tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:18.265133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd86246c-982a-4a25-aad8-1ff7322cc8e6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:18.265929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bd86246c-982a-4a25-aad8-1ff7322cc8e6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:18.274072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd86246c-982a-4a25-aad8-1ff7322cc8e6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:18.274580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd86246c-982a-4a25-aad8-1ff7322cc8e6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:18.275040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd86246c-982a-4a25-aad8-1ff7322cc8e6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:18.277469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd86246c-982a-4a25-aad8-1ff7322cc8e6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:18.277930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd86246c-982a-4a25-aad8-1ff7322cc8e6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:18.278385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd86246c-982a-4a25-aad8-1ff7322cc8e6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:18.553440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bd86246c-982a-4a25-aad8-1ff7322cc8e6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:18.561497 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bd86246c-982a-4a25-aad8-1ff7322cc8e6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.300266 Oct 05 18:06:18.562362 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2592/5426] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:18 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:06:18.681787 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f1b0f221-a56b-4dff-9c76-a929ad7a5b3e tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "POST /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.430274 Oct 05 18:06:18.683522 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2835/5427] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:06:17 2022] POST /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77/os-volume_attachments => generated 194 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:06:19.584928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0187b423-ecf4-4024-ab47-4335b80f02a0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:19.586299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0187b423-ecf4-4024-ab47-4335b80f02a0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:19.605748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0187b423-ecf4-4024-ab47-4335b80f02a0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:19.606628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0187b423-ecf4-4024-ab47-4335b80f02a0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:19.607203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0187b423-ecf4-4024-ab47-4335b80f02a0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:19.608319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0187b423-ecf4-4024-ab47-4335b80f02a0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:19.609170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0187b423-ecf4-4024-ab47-4335b80f02a0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:19.609735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0187b423-ecf4-4024-ab47-4335b80f02a0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:19.991255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0187b423-ecf4-4024-ab47-4335b80f02a0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:20.002636 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0187b423-ecf4-4024-ab47-4335b80f02a0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.422273 Oct 05 18:06:20.028504 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2593/5428] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:19 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:21.029821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c1e59d3-eb24-4415-abb2-30b661246b40 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:21.030733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3c1e59d3-eb24-4415-abb2-30b661246b40 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:21.043875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c1e59d3-eb24-4415-abb2-30b661246b40 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:21.044382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c1e59d3-eb24-4415-abb2-30b661246b40 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:21.044860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c1e59d3-eb24-4415-abb2-30b661246b40 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:21.045589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c1e59d3-eb24-4415-abb2-30b661246b40 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:21.046054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c1e59d3-eb24-4415-abb2-30b661246b40 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:21.046530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c1e59d3-eb24-4415-abb2-30b661246b40 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:21.247816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3c1e59d3-eb24-4415-abb2-30b661246b40 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:21.258559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c1e59d3-eb24-4415-abb2-30b661246b40 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.236894 Oct 05 18:06:21.260154 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2836/5429] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:21 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:22.281275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2c76c0d-2fee-41f3-8fd7-413327fb7eec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:22.281888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d2c76c0d-2fee-41f3-8fd7-413327fb7eec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:22.303060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c76c0d-2fee-41f3-8fd7-413327fb7eec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:22.309568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c76c0d-2fee-41f3-8fd7-413327fb7eec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:22.310955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c76c0d-2fee-41f3-8fd7-413327fb7eec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:22.313274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c76c0d-2fee-41f3-8fd7-413327fb7eec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:22.314578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c76c0d-2fee-41f3-8fd7-413327fb7eec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:22.316439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2c76c0d-2fee-41f3-8fd7-413327fb7eec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:22.582211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d2c76c0d-2fee-41f3-8fd7-413327fb7eec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:22.604855 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d2c76c0d-2fee-41f3-8fd7-413327fb7eec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.321849 Oct 05 18:06:22.620565 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2594/5430] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:22 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:23.630852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-31621787-2411-4fe8-8260-10d3ac67c0aa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:23.631789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-31621787-2411-4fe8-8260-10d3ac67c0aa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:23.653346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31621787-2411-4fe8-8260-10d3ac67c0aa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:23.661937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31621787-2411-4fe8-8260-10d3ac67c0aa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:23.662577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31621787-2411-4fe8-8260-10d3ac67c0aa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:23.663468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31621787-2411-4fe8-8260-10d3ac67c0aa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:23.664095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31621787-2411-4fe8-8260-10d3ac67c0aa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:23.667475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31621787-2411-4fe8-8260-10d3ac67c0aa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:24.043278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31621787-2411-4fe8-8260-10d3ac67c0aa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:24.052535 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-31621787-2411-4fe8-8260-10d3ac67c0aa tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.427801 Oct 05 18:06:24.053132 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2837/5431] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:23 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:25.083736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-83c3d588-dc4b-48cc-b474-9cac0706429c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:25.098251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-83c3d588-dc4b-48cc-b474-9cac0706429c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:25.109621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83c3d588-dc4b-48cc-b474-9cac0706429c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:25.110890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83c3d588-dc4b-48cc-b474-9cac0706429c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:25.111551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83c3d588-dc4b-48cc-b474-9cac0706429c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:25.112808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83c3d588-dc4b-48cc-b474-9cac0706429c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:25.113657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83c3d588-dc4b-48cc-b474-9cac0706429c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:25.114940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83c3d588-dc4b-48cc-b474-9cac0706429c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:25.151645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:06:25.412852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-83c3d588-dc4b-48cc-b474-9cac0706429c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:25.422498 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-83c3d588-dc4b-48cc-b474-9cac0706429c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.345815 Oct 05 18:06:25.423799 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2595/5432] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:25 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:26.445828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-371ac702-619e-4af5-9288-7f8f3435e12e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:26.446591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-371ac702-619e-4af5-9288-7f8f3435e12e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:26.468076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371ac702-619e-4af5-9288-7f8f3435e12e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:26.469691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371ac702-619e-4af5-9288-7f8f3435e12e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:26.470468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371ac702-619e-4af5-9288-7f8f3435e12e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:26.471239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371ac702-619e-4af5-9288-7f8f3435e12e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:26.471807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371ac702-619e-4af5-9288-7f8f3435e12e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:26.473282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371ac702-619e-4af5-9288-7f8f3435e12e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:26.677213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-371ac702-619e-4af5-9288-7f8f3435e12e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:26.680133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:06:26.688232 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-371ac702-619e-4af5-9288-7f8f3435e12e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1169 microversion: 2.1 time: 0.246832 Oct 05 18:06:26.689044 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2838/5433] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:26 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1169 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:06:27.715466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9e0a3ca-165a-4cb5-a3a8-3a140b41aa10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:27.716180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a9e0a3ca-165a-4cb5-a3a8-3a140b41aa10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:27.725710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3ca-165a-4cb5-a3a8-3a140b41aa10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:27.726207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3ca-165a-4cb5-a3a8-3a140b41aa10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:27.726739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3ca-165a-4cb5-a3a8-3a140b41aa10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:27.727448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3ca-165a-4cb5-a3a8-3a140b41aa10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:27.728817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3ca-165a-4cb5-a3a8-3a140b41aa10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:27.729385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9e0a3ca-165a-4cb5-a3a8-3a140b41aa10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:27.976083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a9e0a3ca-165a-4cb5-a3a8-3a140b41aa10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:27.987958 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a9e0a3ca-165a-4cb5-a3a8-3a140b41aa10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1215 microversion: 2.1 time: 0.277351 Oct 05 18:06:27.991189 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2596/5434] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:27 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1215 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:29.015237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e485c9b3-1c10-4b4d-9bf7-f30d4868971e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:29.018958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e485c9b3-1c10-4b4d-9bf7-f30d4868971e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:29.034529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e485c9b3-1c10-4b4d-9bf7-f30d4868971e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:29.042728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e485c9b3-1c10-4b4d-9bf7-f30d4868971e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:29.043691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e485c9b3-1c10-4b4d-9bf7-f30d4868971e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:29.044587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e485c9b3-1c10-4b4d-9bf7-f30d4868971e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:29.045339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e485c9b3-1c10-4b4d-9bf7-f30d4868971e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:29.047942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e485c9b3-1c10-4b4d-9bf7-f30d4868971e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:29.603074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e485c9b3-1c10-4b4d-9bf7-f30d4868971e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:29.630325 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e485c9b3-1c10-4b4d-9bf7-f30d4868971e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1203 microversion: 2.1 time: 0.615799 Oct 05 18:06:29.633416 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2839/5435] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:29 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1203 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:30.655472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b34cd61-679a-4efa-80e0-92b3f938ec07 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:30.656304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b34cd61-679a-4efa-80e0-92b3f938ec07 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:30.660607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=42 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:06:30.684244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b34cd61-679a-4efa-80e0-92b3f938ec07 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:30.684832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b34cd61-679a-4efa-80e0-92b3f938ec07 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:30.685348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b34cd61-679a-4efa-80e0-92b3f938ec07 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:30.686140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b34cd61-679a-4efa-80e0-92b3f938ec07 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:30.689615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b34cd61-679a-4efa-80e0-92b3f938ec07 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:30.690061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b34cd61-679a-4efa-80e0-92b3f938ec07 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:31.181568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b34cd61-679a-4efa-80e0-92b3f938ec07 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:31.191479 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b34cd61-679a-4efa-80e0-92b3f938ec07 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1203 microversion: 2.1 time: 0.540234 Oct 05 18:06:31.192076 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2597/5436] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:30 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1203 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:32.224515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2848a5cb-0f37-4bda-8969-6053ca6cbbdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:32.225833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2848a5cb-0f37-4bda-8969-6053ca6cbbdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:32.252754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2848a5cb-0f37-4bda-8969-6053ca6cbbdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:32.254906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2848a5cb-0f37-4bda-8969-6053ca6cbbdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:32.255652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2848a5cb-0f37-4bda-8969-6053ca6cbbdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:32.256885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2848a5cb-0f37-4bda-8969-6053ca6cbbdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:32.262920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2848a5cb-0f37-4bda-8969-6053ca6cbbdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:32.263697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2848a5cb-0f37-4bda-8969-6053ca6cbbdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:32.777665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2848a5cb-0f37-4bda-8969-6053ca6cbbdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:32.793112 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2848a5cb-0f37-4bda-8969-6053ca6cbbdc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1203 microversion: 2.1 time: 0.579700 Oct 05 18:06:32.799648 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2840/5437] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:32 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1203 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:33.821034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b4c07ded-3ee2-44a7-8171-012219f05386 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:33.827303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b4c07ded-3ee2-44a7-8171-012219f05386 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:33.850237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4c07ded-3ee2-44a7-8171-012219f05386 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:33.850779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4c07ded-3ee2-44a7-8171-012219f05386 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:33.851224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4c07ded-3ee2-44a7-8171-012219f05386 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:33.851955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4c07ded-3ee2-44a7-8171-012219f05386 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:33.852415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4c07ded-3ee2-44a7-8171-012219f05386 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:33.866143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4c07ded-3ee2-44a7-8171-012219f05386 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:34.593176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b4c07ded-3ee2-44a7-8171-012219f05386 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:34.605451 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b4c07ded-3ee2-44a7-8171-012219f05386 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1203 microversion: 2.1 time: 0.788456 Oct 05 18:06:34.606268 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2598/5438] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:33 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1203 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:35.633457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae1e6a87-d9b4-433d-a5b9-d88df86c44f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:35.634018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae1e6a87-d9b4-433d-a5b9-d88df86c44f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:35.647498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae1e6a87-d9b4-433d-a5b9-d88df86c44f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:35.650865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae1e6a87-d9b4-433d-a5b9-d88df86c44f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:35.652751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae1e6a87-d9b4-433d-a5b9-d88df86c44f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:35.654676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae1e6a87-d9b4-433d-a5b9-d88df86c44f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:35.656268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae1e6a87-d9b4-433d-a5b9-d88df86c44f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:35.656927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae1e6a87-d9b4-433d-a5b9-d88df86c44f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:35.909728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ae1e6a87-d9b4-433d-a5b9-d88df86c44f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:35.919888 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae1e6a87-d9b4-433d-a5b9-d88df86c44f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1203 microversion: 2.1 time: 0.292776 Oct 05 18:06:35.922130 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2841/5439] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:35 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1203 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:36.959278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1cc4744c-4ab4-4b83-b41a-7d825721b457 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:36.960664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1cc4744c-4ab4-4b83-b41a-7d825721b457 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:36.973921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cc4744c-4ab4-4b83-b41a-7d825721b457 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:36.974730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cc4744c-4ab4-4b83-b41a-7d825721b457 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:36.975338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cc4744c-4ab4-4b83-b41a-7d825721b457 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:36.976348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cc4744c-4ab4-4b83-b41a-7d825721b457 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:36.976761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cc4744c-4ab4-4b83-b41a-7d825721b457 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:36.977192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cc4744c-4ab4-4b83-b41a-7d825721b457 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:37.189124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1cc4744c-4ab4-4b83-b41a-7d825721b457 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:37.199708 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1cc4744c-4ab4-4b83-b41a-7d825721b457 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1203 microversion: 2.1 time: 0.249468 Oct 05 18:06:37.200696 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2599/5440] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:36 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1203 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:38.223914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7bde279-3439-4711-b86f-3a2efcb6692c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:38.224671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f7bde279-3439-4711-b86f-3a2efcb6692c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:38.240579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7bde279-3439-4711-b86f-3a2efcb6692c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:38.257104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7bde279-3439-4711-b86f-3a2efcb6692c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:38.267369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7bde279-3439-4711-b86f-3a2efcb6692c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:38.269257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7bde279-3439-4711-b86f-3a2efcb6692c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:38.270225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7bde279-3439-4711-b86f-3a2efcb6692c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:38.277159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7bde279-3439-4711-b86f-3a2efcb6692c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:38.405378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-345aed21-3d37-40e4-8a3c-360853a04d6b req-ff8d79b2-1a4a-409f-83e7-82986a48fe53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e149a2f9-cf84-45a8-b501-042db0064557", "name": "network-vif-plugged", "status": "completed", "tag": "40e6252d-8c5b-4778-a3fb-36af1192fa5b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:06:38.431123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-345aed21-3d37-40e4-8a3c-360853a04d6b req-ff8d79b2-1a4a-409f-83e7-82986a48fe53 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:38.433327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-345aed21-3d37-40e4-8a3c-360853a04d6b req-ff8d79b2-1a4a-409f-83e7-82986a48fe53 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:38.436223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-345aed21-3d37-40e4-8a3c-360853a04d6b req-ff8d79b2-1a4a-409f-83e7-82986a48fe53 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:38.476181 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-345aed21-3d37-40e4-8a3c-360853a04d6b req-ff8d79b2-1a4a-409f-83e7-82986a48fe53 service nova] Creating event network-vif-plugged:40e6252d-8c5b-4778-a3fb-36af1192fa5b for instance e149a2f9-cf84-45a8-b501-042db0064557 on n-h2-835595-3 Oct 05 18:06:38.492307 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-345aed21-3d37-40e4-8a3c-360853a04d6b req-ff8d79b2-1a4a-409f-83e7-82986a48fe53 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091249 Oct 05 18:06:38.493178 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2600/5441] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:06:38.612306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f7bde279-3439-4711-b86f-3a2efcb6692c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:38.627435 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f7bde279-3439-4711-b86f-3a2efcb6692c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1203 microversion: 2.1 time: 0.408592 Oct 05 18:06:38.628282 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2842/5442] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:38 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1203 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:39.655893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de05a382-63d4-40fa-a3e2-0f2e7e0d4002 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:39.656912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-de05a382-63d4-40fa-a3e2-0f2e7e0d4002 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:39.681545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05a382-63d4-40fa-a3e2-0f2e7e0d4002 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:39.682059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05a382-63d4-40fa-a3e2-0f2e7e0d4002 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:39.682535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05a382-63d4-40fa-a3e2-0f2e7e0d4002 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:39.683293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05a382-63d4-40fa-a3e2-0f2e7e0d4002 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:39.683769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05a382-63d4-40fa-a3e2-0f2e7e0d4002 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:39.684203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05a382-63d4-40fa-a3e2-0f2e7e0d4002 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:40.006341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-de05a382-63d4-40fa-a3e2-0f2e7e0d4002 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:40.019648 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de05a382-63d4-40fa-a3e2-0f2e7e0d4002 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1203 microversion: 2.1 time: 0.366400 Oct 05 18:06:40.020095 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2601/5443] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:39 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1203 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:41.047196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25f28b7c-e244-4041-a1d6-e4a60489c59b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:41.048055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25f28b7c-e244-4041-a1d6-e4a60489c59b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:41.061977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=26 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:06:41.063591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25f28b7c-e244-4041-a1d6-e4a60489c59b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:41.065374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25f28b7c-e244-4041-a1d6-e4a60489c59b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:41.080134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25f28b7c-e244-4041-a1d6-e4a60489c59b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:41.081239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25f28b7c-e244-4041-a1d6-e4a60489c59b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:41.081733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25f28b7c-e244-4041-a1d6-e4a60489c59b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:41.082181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25f28b7c-e244-4041-a1d6-e4a60489c59b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:41.374590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25f28b7c-e244-4041-a1d6-e4a60489c59b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:41.384748 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25f28b7c-e244-4041-a1d6-e4a60489c59b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1389 microversion: 2.1 time: 0.341425 Oct 05 18:06:41.385887 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2843/5444] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:41 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1389 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:41.413087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7923137e-9041-4b38-8369-f02b0ce5598e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:41.413927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7923137e-9041-4b38-8369-f02b0ce5598e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:41.432337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923137e-9041-4b38-8369-f02b0ce5598e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:41.433583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923137e-9041-4b38-8369-f02b0ce5598e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:41.436212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923137e-9041-4b38-8369-f02b0ce5598e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:41.437142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923137e-9041-4b38-8369-f02b0ce5598e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:41.443378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923137e-9041-4b38-8369-f02b0ce5598e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:41.444218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7923137e-9041-4b38-8369-f02b0ce5598e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:41.793329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7923137e-9041-4b38-8369-f02b0ce5598e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:41.840689 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7923137e-9041-4b38-8369-f02b0ce5598e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1389 microversion: 2.1 time: 0.431685 Oct 05 18:06:41.841490 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2602/5445] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:41 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1389 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:41.865761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2376403e-6b78-4f9a-aa4c-dc106f5f9feb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:41.866825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2376403e-6b78-4f9a-aa4c-dc106f5f9feb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:41.876878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2376403e-6b78-4f9a-aa4c-dc106f5f9feb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:41.878565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2376403e-6b78-4f9a-aa4c-dc106f5f9feb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:41.879224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2376403e-6b78-4f9a-aa4c-dc106f5f9feb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:41.880151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2376403e-6b78-4f9a-aa4c-dc106f5f9feb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:41.880817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2376403e-6b78-4f9a-aa4c-dc106f5f9feb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:41.881464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2376403e-6b78-4f9a-aa4c-dc106f5f9feb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:42.352267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2376403e-6b78-4f9a-aa4c-dc106f5f9feb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:42.390317 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2376403e-6b78-4f9a-aa4c-dc106f5f9feb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1389 microversion: 2.1 time: 0.508722 Oct 05 18:06:42.392428 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2844/5446] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:41 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1389 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:42.556522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f6a67cc1-d2c1-4fcb-a36e-68ed1715ad58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:42.557169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f6a67cc1-d2c1-4fcb-a36e-68ed1715ad58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:42.589243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a67cc1-d2c1-4fcb-a36e-68ed1715ad58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:42.593245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a67cc1-d2c1-4fcb-a36e-68ed1715ad58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:42.594792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a67cc1-d2c1-4fcb-a36e-68ed1715ad58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:42.597339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a67cc1-d2c1-4fcb-a36e-68ed1715ad58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:42.598564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a67cc1-d2c1-4fcb-a36e-68ed1715ad58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:42.600515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a67cc1-d2c1-4fcb-a36e-68ed1715ad58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:42.680632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f6a67cc1-d2c1-4fcb-a36e-68ed1715ad58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:06:42.843402 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f6a67cc1-d2c1-4fcb-a36e-68ed1715ad58 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 204 len: 0 microversion: 2.1 time: 0.292354 Oct 05 18:06:42.844901 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2603/5447] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:06:42 2022] DELETE /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:06:42.853296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c85bb9f-5015-4a1a-96d4-e9854391485e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:42.854113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c85bb9f-5015-4a1a-96d4-e9854391485e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:42.863296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c85bb9f-5015-4a1a-96d4-e9854391485e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:42.864534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c85bb9f-5015-4a1a-96d4-e9854391485e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:42.865440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c85bb9f-5015-4a1a-96d4-e9854391485e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:42.867455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c85bb9f-5015-4a1a-96d4-e9854391485e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:42.869018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c85bb9f-5015-4a1a-96d4-e9854391485e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:42.869955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c85bb9f-5015-4a1a-96d4-e9854391485e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:43.078541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9c85bb9f-5015-4a1a-96d4-e9854391485e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:43.093988 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c85bb9f-5015-4a1a-96d4-e9854391485e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1395 microversion: 2.1 time: 0.244498 Oct 05 18:06:43.095063 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2845/5448] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:42 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1395 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:44.118347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-98beeb22-c357-4077-a1a2-69286d763757 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:44.119649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-98beeb22-c357-4077-a1a2-69286d763757 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:44.127743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98beeb22-c357-4077-a1a2-69286d763757 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:44.128456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98beeb22-c357-4077-a1a2-69286d763757 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:44.129069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98beeb22-c357-4077-a1a2-69286d763757 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:44.129955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98beeb22-c357-4077-a1a2-69286d763757 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:44.130688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98beeb22-c357-4077-a1a2-69286d763757 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:44.131259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98beeb22-c357-4077-a1a2-69286d763757 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:44.335981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-98beeb22-c357-4077-a1a2-69286d763757 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:44.345194 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-98beeb22-c357-4077-a1a2-69286d763757 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1395 microversion: 2.1 time: 0.231490 Oct 05 18:06:44.345789 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2604/5449] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:44 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1395 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:45.165677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7546482c-aab4-416e-8f8e-ab97c6e8bc30 req-eeac5c6e-0b3e-4058-af04-5d6f440ff037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e149a2f9-cf84-45a8-b501-042db0064557", "name": "network-vif-deleted", "tag": "40e6252d-8c5b-4778-a3fb-36af1192fa5b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:06:45.192512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7546482c-aab4-416e-8f8e-ab97c6e8bc30 req-eeac5c6e-0b3e-4058-af04-5d6f440ff037 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:45.197090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7546482c-aab4-416e-8f8e-ab97c6e8bc30 req-eeac5c6e-0b3e-4058-af04-5d6f440ff037 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:45.197807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7546482c-aab4-416e-8f8e-ab97c6e8bc30 req-eeac5c6e-0b3e-4058-af04-5d6f440ff037 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:45.246708 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7546482c-aab4-416e-8f8e-ab97c6e8bc30 req-eeac5c6e-0b3e-4058-af04-5d6f440ff037 service nova] Creating event network-vif-deleted:40e6252d-8c5b-4778-a3fb-36af1192fa5b for instance e149a2f9-cf84-45a8-b501-042db0064557 on n-h2-835595-3 Oct 05 18:06:45.253759 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7546482c-aab4-416e-8f8e-ab97c6e8bc30 req-eeac5c6e-0b3e-4058-af04-5d6f440ff037 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091369 Oct 05 18:06:45.254985 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2846/5450] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:06:45.374550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ed1f82cf-108b-4d32-b466-d39a73ccc564 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:45.376158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ed1f82cf-108b-4d32-b466-d39a73ccc564 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:45.389108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f82cf-108b-4d32-b466-d39a73ccc564 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:45.389842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f82cf-108b-4d32-b466-d39a73ccc564 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:45.390617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f82cf-108b-4d32-b466-d39a73ccc564 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:45.391679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f82cf-108b-4d32-b466-d39a73ccc564 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:45.394344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f82cf-108b-4d32-b466-d39a73ccc564 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:45.394975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ed1f82cf-108b-4d32-b466-d39a73ccc564 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:45.569295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ed1f82cf-108b-4d32-b466-d39a73ccc564 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:45.585607 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ed1f82cf-108b-4d32-b466-d39a73ccc564 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1188 microversion: 2.1 time: 0.214320 Oct 05 18:06:45.598612 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2605/5451] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:45 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1188 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:46.611609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec835cd0-944c-4cc6-9f46-056d7f5c8588 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:46.613034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ec835cd0-944c-4cc6-9f46-056d7f5c8588 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:46.622433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec835cd0-944c-4cc6-9f46-056d7f5c8588 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:46.623134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec835cd0-944c-4cc6-9f46-056d7f5c8588 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:46.623913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec835cd0-944c-4cc6-9f46-056d7f5c8588 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:46.625275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec835cd0-944c-4cc6-9f46-056d7f5c8588 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:46.625928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec835cd0-944c-4cc6-9f46-056d7f5c8588 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:46.626600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec835cd0-944c-4cc6-9f46-056d7f5c8588 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:46.703666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ec835cd0-944c-4cc6-9f46-056d7f5c8588 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:46.719487 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ec835cd0-944c-4cc6-9f46-056d7f5c8588 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1188 microversion: 2.1 time: 0.112507 Oct 05 18:06:46.736806 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2847/5452] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:46 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1188 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:47.744605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-078cbc4a-7336-4d5e-8a09-15889513671c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:47.745201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-078cbc4a-7336-4d5e-8a09-15889513671c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:47.755186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-078cbc4a-7336-4d5e-8a09-15889513671c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:47.756518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-078cbc4a-7336-4d5e-8a09-15889513671c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:47.757839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-078cbc4a-7336-4d5e-8a09-15889513671c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:47.762727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-078cbc4a-7336-4d5e-8a09-15889513671c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:47.763669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-078cbc4a-7336-4d5e-8a09-15889513671c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:47.764794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-078cbc4a-7336-4d5e-8a09-15889513671c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:47.891658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-078cbc4a-7336-4d5e-8a09-15889513671c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:47.904722 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-078cbc4a-7336-4d5e-8a09-15889513671c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1188 microversion: 2.1 time: 0.163618 Oct 05 18:06:47.919279 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2606/5453] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:47 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1188 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:48.935088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3dff85e3-f66f-47f5-9795-ff66bdeca87a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:48.936390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3dff85e3-f66f-47f5-9795-ff66bdeca87a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:48.944593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dff85e3-f66f-47f5-9795-ff66bdeca87a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:48.945379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dff85e3-f66f-47f5-9795-ff66bdeca87a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:48.945800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dff85e3-f66f-47f5-9795-ff66bdeca87a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:48.946523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dff85e3-f66f-47f5-9795-ff66bdeca87a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:48.947159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dff85e3-f66f-47f5-9795-ff66bdeca87a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:48.947803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dff85e3-f66f-47f5-9795-ff66bdeca87a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:49.018057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3dff85e3-f66f-47f5-9795-ff66bdeca87a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:49.026743 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3dff85e3-f66f-47f5-9795-ff66bdeca87a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1188 microversion: 2.1 time: 0.099168 Oct 05 18:06:49.027704 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2848/5454] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:48 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1188 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:50.051078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5515be92-4b05-4c1b-aa81-11f25a9982cc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:50.051706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5515be92-4b05-4c1b-aa81-11f25a9982cc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:50.066159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5515be92-4b05-4c1b-aa81-11f25a9982cc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:50.067155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5515be92-4b05-4c1b-aa81-11f25a9982cc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:50.067665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5515be92-4b05-4c1b-aa81-11f25a9982cc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:50.068473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5515be92-4b05-4c1b-aa81-11f25a9982cc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:50.069164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5515be92-4b05-4c1b-aa81-11f25a9982cc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:50.069826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5515be92-4b05-4c1b-aa81-11f25a9982cc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:50.171312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5515be92-4b05-4c1b-aa81-11f25a9982cc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:06:50.188774 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5515be92-4b05-4c1b-aa81-11f25a9982cc tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 200 len: 1188 microversion: 2.1 time: 0.142426 Oct 05 18:06:50.191324 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2607/5455] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:50 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 1188 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:06:51.217330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:51.218909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:51.226524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:51.227323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:51.227984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:51.229178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:51.229842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:51.230496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:51.246983 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 HTTP/1.1 Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e149a2f9-cf84-45a8-b501-042db0064557'} Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:51.249241 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:51.253215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:51.253215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:51.253215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:51.253215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:06:51.253215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:06:51.253215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:51.253215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:51.255226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:06:51.256314 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ead29e6-7cc1-443e-9821-9ec635a8bd13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 404 len: 111 microversion: 2.1 time: 0.043225 Oct 05 18:06:51.257406 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2849/5456] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:51 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:06:58.791672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:58.792742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:58.798838 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:06:58.799846 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:06:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 (ip 10.222.0.70) !!! Oct 05 18:06:58.802971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:58.803704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:58.804380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:58.805234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:58.805818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:58.806396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:58.810643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:06:58.836766 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 HTTP/1.1 Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'e149a2f9-cf84-45a8-b501-042db0064557'} Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:06:58.844524 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:58.848570 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:06:58.849863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:06:58.850982 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e609c1e9-bcda-4f5d-b255-26c062f9d3c7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 404 len: 111 microversion: 2.1 time: 0.063383 Oct 05 18:06:58.854220 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2608/5457] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:06:58 2022] DELETE /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:06:58.859997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:06:58.861120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e149a2f9-cf84-45a8-b501-042db0064557] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:06:58.869602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:58.875986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:58.876608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:58.877549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:06:58.878148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:06:58.878745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:06:58.893378 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 HTTP/1.1 Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e149a2f9-cf84-45a8-b501-042db0064557'} Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:06:58.895177 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:58.899056 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:06:58.899056 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:06:58.899056 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:06:58.899056 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:06:58.899056 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:06:58.899056 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. Oct 05 18:06:58.899056 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:06:58.900186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance e149a2f9-cf84-45a8-b501-042db0064557 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:06:58.901180 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-454deda1-b952-4a37-9f3e-eebf70e9f74c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557" status: 404 len: 111 microversion: 2.1 time: 0.045206 Oct 05 18:06:58.908527 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2850/5458] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:06:58 2022] GET /compute/v2.1/servers/e149a2f9-cf84-45a8-b501-042db0064557 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:07:09.546658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-856cf8e3-e064-41c4-935a-dc62455c62a8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Action: 'create', calling method: .version_select at 0x7f77740b0160>, body: {"keypair": {"name": "tempest-keypair-1512616503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaMyDFpwozCP0X0njYHyp70kzdAeDQNreMoWBdV5EviUZM8flYPGJPG1CmhR17kZlvz7vsmk83jr4WkJLB0oTPu5ySDc7XAGrHlESo654IUN4XqTxJYdN8nU5W5YAYbcA=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:07:09.555478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:09.574179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-856cf8e3-e064-41c4-935a-dc62455c62a8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Getting quotas for project 74b54fc4fbe243c0ac614e4a707d7ccf. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:07:09.588587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-856cf8e3-e064-41c4-935a-dc62455c62a8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Getting quotas for user 7520f0c3cabe49368cb54fc3b87cf611 and project 74b54fc4fbe243c0ac614e4a707d7ccf. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:07:09.641558 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-856cf8e3-e064-41c4-935a-dc62455c62a8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.101248 Oct 05 18:07:09.650670 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2609/5459] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Oct 5 18:07:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 18:07:13.535553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1730178602", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5161abb2-db73-4ad0-b60b-c7064ce807ae"}, {"port": "9fe5e4fd-c9dd-4403-922d-1591ec931566", "tag": "port-1"}, {"port": "45895d7b-fe7f-4e0a-8318-08bc84a4c17f", "tag": "port-2"}, {"uuid": "d86b64a1-e88c-43d5-a92c-9fe87ec63679", "tag": "net-1"}, {"uuid": "d86b64a1-e88c-43d5-a92c-9fe87ec63679"}, {"uuid": "51bf0427-8f4f-420c-bb31-65652106ec2b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "51bf0427-8f4f-420c-bb31-65652106ec2b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "1068d86f-f075-47ef-9824-8ac2a748939f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f3a4d737-52fe-473f-a3f9-3fe380fcdc3e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f396c81b-0024-46c9-9e17-1911a90a1f98", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--580032826"}], "key_name": "tempest-keypair-1512616503", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:07:13.553428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=15 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:13.555243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=61 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:13.889603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] validate_networks() for [('5161abb2-db73-4ad0-b60b-c7064ce807ae', None, None, None, None, None), (None, None, '9fe5e4fd-c9dd-4403-922d-1591ec931566', None, None, None), (None, None, '45895d7b-fe7f-4e0a-8318-08bc84a4c17f', None, None, None), ('d86b64a1-e88c-43d5-a92c-9fe87ec63679', None, None, None, None, None), ('d86b64a1-e88c-43d5-a92c-9fe87ec63679', None, None, None, None, None), ('51bf0427-8f4f-420c-bb31-65652106ec2b', '10.2.2.100', None, None, None, None), ('51bf0427-8f4f-420c-bb31-65652106ec2b', '10.2.2.200', None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:07:16.437041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:07:16.437657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:07:16.438164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:07:16.438688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:07:16.439204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:07:16.454410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:16.454903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:16.455408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:16.456133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:16.456588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:16.457006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:16.480326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Getting quotas for project 74b54fc4fbe243c0ac614e4a707d7ccf. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:07:16.493214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Getting quotas for user 7520f0c3cabe49368cb54fc3b87cf611 and project 74b54fc4fbe243c0ac614e4a707d7ccf. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:07:16.719874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:07:16.723518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='1068d86f-f075-47ef-9824-8ac2a748939f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f3a4d737-52fe-473f-a3f9-3fe380fcdc3e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f396c81b-0024-46c9-9e17-1911a90a1f98',volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:07:17.224563 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7fe1ba97-4cab-4b3a-ae6f-b6ce6a947899 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 3.693141 Oct 05 18:07:17.225146 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2851/5460] 10.222.0.70 () {62 vars in 1189 bytes} [Wed Oct 5 18:07:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 3695 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 18:07:17.237012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41765b53-9541-4c03-b5d6-7ebcf3f0108c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:17.238506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-41765b53-9541-4c03-b5d6-7ebcf3f0108c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:17.521868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-41765b53-9541-4c03-b5d6-7ebcf3f0108c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:17.540282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-41765b53-9541-4c03-b5d6-7ebcf3f0108c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:17.542925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-41765b53-9541-4c03-b5d6-7ebcf3f0108c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:17.545648 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-41765b53-9541-4c03-b5d6-7ebcf3f0108c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1286 microversion: 2.42 time: 0.312176 Oct 05 18:07:17.547482 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2610/5461] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:17 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1286 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 18:07:18.573974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:18.574694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:18.607078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:18.608015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:18.608639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:18.609774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:18.610243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:18.612547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:18.719240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:18.731989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:18.734618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:18.735955 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-419b81c3-b2b5-46d1-a597-ff980dabe7ed tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1576 microversion: 2.42 time: 0.167658 Oct 05 18:07:18.736751 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2852/5462] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:18 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:19.782589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:19.783486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:19.793879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:19.797114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:19.798192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:19.798192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:19.805453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:19.806592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:19.807487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:19.986559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:19.997706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:20.004823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:20.010607 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a0472169-587b-4f5d-8065-d54df34ce9be tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1594 microversion: 2.42 time: 0.247452 Oct 05 18:07:20.011856 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2611/5463] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:19 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1594 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:21.044731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:21.046016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:21.055455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:21.055952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:21.056398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:21.057111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:21.057575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:21.058010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:21.508113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:21.530999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:21.533481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:21.535663 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2222a32b-ab09-42bc-998a-4cdf18406975 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1707 microversion: 2.42 time: 0.494939 Oct 05 18:07:21.563650 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2853/5464] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:21 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1707 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:22.575718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:22.576336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:22.588383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:22.591095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:22.592705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:22.593799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:22.596256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:22.596851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:22.885862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:22.966634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:22.972410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:22.974402 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-332de2f1-869d-451f-9af0-fd51cc22641e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1753 microversion: 2.42 time: 0.403462 Oct 05 18:07:23.001354 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2612/5465] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:22 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1753 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:24.028033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:24.028650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:24.045488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:24.046254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:24.046999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:24.047889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:24.048500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:24.049176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:24.390620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:24.409427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:24.411577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:24.412929 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c8c1d4a1-ee3c-4bed-aad9-a473055f06f1 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1799 microversion: 2.42 time: 0.389175 Oct 05 18:07:24.414087 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2854/5466] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:24 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1799 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:25.453282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:25.454040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:25.480772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:25.484212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:25.484890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:25.488051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:25.489031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:25.490910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:25.792227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:25.819762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:25.821215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:25.822436 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9b5dfa74-16d0-4487-94dd-cb166e6f10eb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1845 microversion: 2.42 time: 0.373216 Oct 05 18:07:25.847704 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2613/5467] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:25 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1845 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:26.872299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:26.876561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:26.890830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:26.892637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:26.895561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:26.896601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:26.897216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:26.898335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:26.899047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:26.899693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:27.020149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6301ba01-06a4-42ec-9118-82ac67fc4ad0 req-366b6d5b-0be5-4559-b1a9-c137b0067460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "tag": "3c0ca083-d78c-4982-a277-9ba89081d68a"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:07:27.041652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6301ba01-06a4-42ec-9118-82ac67fc4ad0 req-366b6d5b-0be5-4559-b1a9-c137b0067460 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:27.046013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6301ba01-06a4-42ec-9118-82ac67fc4ad0 req-366b6d5b-0be5-4559-b1a9-c137b0067460 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:27.050966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6301ba01-06a4-42ec-9118-82ac67fc4ad0 req-366b6d5b-0be5-4559-b1a9-c137b0067460 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:27.098685 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6301ba01-06a4-42ec-9118-82ac67fc4ad0 req-366b6d5b-0be5-4559-b1a9-c137b0067460 service nova] Creating event network-changed:3c0ca083-d78c-4982-a277-9ba89081d68a for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:07:27.105138 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6301ba01-06a4-42ec-9118-82ac67fc4ad0 req-366b6d5b-0be5-4559-b1a9-c137b0067460 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093371 Oct 05 18:07:27.106273 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2614/5468] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:07:27.568065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:27.585595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:27.592494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:27.595295 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-40b0bb7d-a780-4ed5-a368-208306fc03fe tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1845 microversion: 2.42 time: 0.729204 Oct 05 18:07:27.599724 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2855/5469] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:26 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1845 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:28.627772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:28.637928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:28.638722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:28.655868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:28.662069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:28.662748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:28.663655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:28.664289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:28.664864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:29.146737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-122771b1-d9a5-4adb-a564-8fa52a7c9f3b req-1a1176f5-5264-41db-b1fb-3fe67caa940e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "tag": "9fe5e4fd-c9dd-4403-922d-1591ec931566"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:07:29.179595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-122771b1-d9a5-4adb-a564-8fa52a7c9f3b req-1a1176f5-5264-41db-b1fb-3fe67caa940e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:29.187575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-122771b1-d9a5-4adb-a564-8fa52a7c9f3b req-1a1176f5-5264-41db-b1fb-3fe67caa940e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:29.189096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-122771b1-d9a5-4adb-a564-8fa52a7c9f3b req-1a1176f5-5264-41db-b1fb-3fe67caa940e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:29.220048 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-122771b1-d9a5-4adb-a564-8fa52a7c9f3b req-1a1176f5-5264-41db-b1fb-3fe67caa940e service nova] Creating event network-changed:9fe5e4fd-c9dd-4403-922d-1591ec931566 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:07:29.234900 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-122771b1-d9a5-4adb-a564-8fa52a7c9f3b req-1a1176f5-5264-41db-b1fb-3fe67caa940e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095049 Oct 05 18:07:29.270973 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2856/5470] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:07:29.479209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:29.496791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:29.502607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:29.503955 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8f20347f-59b1-44a5-becc-12d5e112c21b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1866 microversion: 2.42 time: 0.878613 Oct 05 18:07:29.506848 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2615/5471] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:28 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1866 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:30.538922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:30.540330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:30.555720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:30.556600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:30.558914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:30.570839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:30.571697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:30.572327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:31.123755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:31.140224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:31.142482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:31.145072 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78491c1a-b27a-4cf6-b75a-f29205c4429d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1887 microversion: 2.42 time: 0.611141 Oct 05 18:07:31.146256 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2857/5472] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:30 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1887 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:31.291582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-9bddae17-3297-429e-ba86-22d883f3f228 req-a4d1cfbb-1a19-49f4-a72f-e5991235bf87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "tag": "45895d7b-fe7f-4e0a-8318-08bc84a4c17f"}, {"name": "network-changed", "server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "tag": "a5cc2ce4-af89-4eba-aa9c-1328e1e6bf20"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:07:31.317157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9bddae17-3297-429e-ba86-22d883f3f228 req-a4d1cfbb-1a19-49f4-a72f-e5991235bf87 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:31.317883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9bddae17-3297-429e-ba86-22d883f3f228 req-a4d1cfbb-1a19-49f4-a72f-e5991235bf87 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:31.318522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9bddae17-3297-429e-ba86-22d883f3f228 req-a4d1cfbb-1a19-49f4-a72f-e5991235bf87 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:31.359028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9bddae17-3297-429e-ba86-22d883f3f228 req-a4d1cfbb-1a19-49f4-a72f-e5991235bf87 service nova] Creating event network-changed:45895d7b-fe7f-4e0a-8318-08bc84a4c17f for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:07:31.360151 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9bddae17-3297-429e-ba86-22d883f3f228 req-a4d1cfbb-1a19-49f4-a72f-e5991235bf87 service nova] Creating event network-changed:a5cc2ce4-af89-4eba-aa9c-1328e1e6bf20 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:07:31.382539 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-9bddae17-3297-429e-ba86-22d883f3f228 req-a4d1cfbb-1a19-49f4-a72f-e5991235bf87 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.100044 Oct 05 18:07:31.384530 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2616/5473] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:07:32.185981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:32.186657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:32.234051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:32.234583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:32.236383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:32.237661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:32.238562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:32.256052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:32.783692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:32.797548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:32.801131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:32.802642 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bac8c64a-3ff0-42be-be44-38ff5e4773bf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1887 microversion: 2.42 time: 0.631085 Oct 05 18:07:32.804808 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2858/5474] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:32 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1887 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:33.487720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-0b1b3914-4d96-4b75-b088-ce062bdf509c req-7d692ea8-0999-4e4a-b3b8-24facbe3a713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "tag": "edba4c90-72ee-4754-ae83-591d3bb78a74"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:07:33.502822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0b1b3914-4d96-4b75-b088-ce062bdf509c req-7d692ea8-0999-4e4a-b3b8-24facbe3a713 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:33.503634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0b1b3914-4d96-4b75-b088-ce062bdf509c req-7d692ea8-0999-4e4a-b3b8-24facbe3a713 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:33.504241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0b1b3914-4d96-4b75-b088-ce062bdf509c req-7d692ea8-0999-4e4a-b3b8-24facbe3a713 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:33.516334 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-0b1b3914-4d96-4b75-b088-ce062bdf509c req-7d692ea8-0999-4e4a-b3b8-24facbe3a713 service nova] Creating event network-changed:edba4c90-72ee-4754-ae83-591d3bb78a74 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:07:33.524527 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-0b1b3914-4d96-4b75-b088-ce062bdf509c req-7d692ea8-0999-4e4a-b3b8-24facbe3a713 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041736 Oct 05 18:07:33.525379 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2617/5475] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:07:33.829849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:33.831450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:33.855155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:33.855922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:33.856605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:33.858013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:33.867872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:33.868344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:34.699085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1724617283", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4c00ee66-d21c-4522-863b-a2b043c91de5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "adb1494a-27b0-43e0-8027-66e89e0c81ad"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:07:34.803032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:34.826660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:34.828196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:34.829431 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f681ce95-31b2-49ec-b62b-91042fa7f4bc tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1887 microversion: 2.42 time: 1.004324 Oct 05 18:07:34.837679 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2859/5476] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:33 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1887 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:34.870494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] validate_networks() for [('adb1494a-27b0-43e0-8027-66e89e0c81ad', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:07:35.627039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:07:35.627799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:07:35.628453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:07:35.629027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:07:35.629592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:07:35.638419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8b72863f-8ead-4317-831d-943c571a7af7 req-0aab6ada-7fa6-47bc-8c70-66f412d4454a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "tag": "4cfe7d81-9e85-4770-a0af-df6d26210a78"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:07:35.646135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:35.648679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:35.649147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:35.652850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:35.653483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:35.653933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:35.662327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8b72863f-8ead-4317-831d-943c571a7af7 req-0aab6ada-7fa6-47bc-8c70-66f412d4454a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:35.663720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8b72863f-8ead-4317-831d-943c571a7af7 req-0aab6ada-7fa6-47bc-8c70-66f412d4454a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:35.664349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8b72863f-8ead-4317-831d-943c571a7af7 req-0aab6ada-7fa6-47bc-8c70-66f412d4454a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:35.682688 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8b72863f-8ead-4317-831d-943c571a7af7 req-0aab6ada-7fa6-47bc-8c70-66f412d4454a service nova] Creating event network-changed:4cfe7d81-9e85-4770-a0af-df6d26210a78 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:07:35.690330 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8b72863f-8ead-4317-831d-943c571a7af7 req-0aab6ada-7fa6-47bc-8c70-66f412d4454a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055387 Oct 05 18:07:35.693155 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2860/5477] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:07:35.697243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:07:35.705028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for user 8a900e5bf82d462a9113d6e6461ea3a0 and project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:07:35.792344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:07:35.797434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c00ee66-d21c-4522-863b-a2b043c91de5',volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:07:35.870934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:35.872108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:35.883380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:35.884801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:35.888083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:35.889233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:35.890977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:35.893389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:36.076322 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8ee9e1d-eb0e-4b3a-b00d-232d42fe1f24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382352 Oct 05 18:07:36.078557 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2618/5478] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:07:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:07:36.089665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ba6ebbf-4523-4a58-ac5b-f04ae80580d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:36.091171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6ba6ebbf-4523-4a58-ac5b-f04ae80580d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:36.165000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6ba6ebbf-4523-4a58-ac5b-f04ae80580d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:36.176669 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6ba6ebbf-4523-4a58-ac5b-f04ae80580d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1071 microversion: 2.1 time: 0.090219 Oct 05 18:07:36.177774 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2619/5479] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:36 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1071 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:36.465803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:36.500876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:36.502623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:36.503929 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-37d382d6-ddd4-42a0-b16d-024f192c6805 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1887 microversion: 2.42 time: 0.637925 Oct 05 18:07:36.506087 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2861/5480] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:35 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1887 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:37.205326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9dc04021-09cb-4199-8a4d-d60f07c9f370 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:37.206150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9dc04021-09cb-4199-8a4d-d60f07c9f370 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:37.232337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc04021-09cb-4199-8a4d-d60f07c9f370 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:37.234545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc04021-09cb-4199-8a4d-d60f07c9f370 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:37.235099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc04021-09cb-4199-8a4d-d60f07c9f370 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:37.238085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc04021-09cb-4199-8a4d-d60f07c9f370 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:37.238949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc04021-09cb-4199-8a4d-d60f07c9f370 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:37.239560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9dc04021-09cb-4199-8a4d-d60f07c9f370 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:37.378825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9dc04021-09cb-4199-8a4d-d60f07c9f370 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:37.403553 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9dc04021-09cb-4199-8a4d-d60f07c9f370 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1169 microversion: 2.1 time: 0.203708 Oct 05 18:07:37.405317 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2620/5481] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:37 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1169 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:37.533987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:37.534501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:37.546010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:37.546537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:37.546971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:37.547672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:37.548125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:37.548546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:37.715810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c543e218-334c-4668-ae4e-09b4e7966e2b req-333e2985-6279-411f-a06c-313f2dbe8aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "tag": "4e60cc60-031e-46a1-8c43-08a6cacd74e1"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:07:37.742388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c543e218-334c-4668-ae4e-09b4e7966e2b req-333e2985-6279-411f-a06c-313f2dbe8aad service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:37.743010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c543e218-334c-4668-ae4e-09b4e7966e2b req-333e2985-6279-411f-a06c-313f2dbe8aad service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:37.743449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c543e218-334c-4668-ae4e-09b4e7966e2b req-333e2985-6279-411f-a06c-313f2dbe8aad service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:37.760165 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c543e218-334c-4668-ae4e-09b4e7966e2b req-333e2985-6279-411f-a06c-313f2dbe8aad service nova] Creating event network-changed:4e60cc60-031e-46a1-8c43-08a6cacd74e1 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:07:37.771665 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c543e218-334c-4668-ae4e-09b4e7966e2b req-333e2985-6279-411f-a06c-313f2dbe8aad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059647 Oct 05 18:07:37.777268 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2621/5482] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:07:38.318235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:38.335110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:38.339365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:38.341937 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92678406-dbca-4e42-a8c5-48d08f19de90 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1887 microversion: 2.42 time: 0.812701 Oct 05 18:07:38.345988 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2862/5483] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:37 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1887 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:38.434637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-712ebe42-686f-46b6-8299-a20b174a995a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:38.436170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-712ebe42-686f-46b6-8299-a20b174a995a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:38.450063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-712ebe42-686f-46b6-8299-a20b174a995a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:38.450993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-712ebe42-686f-46b6-8299-a20b174a995a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:38.453630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-712ebe42-686f-46b6-8299-a20b174a995a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:38.455014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-712ebe42-686f-46b6-8299-a20b174a995a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:38.456493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-712ebe42-686f-46b6-8299-a20b174a995a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:38.461344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-712ebe42-686f-46b6-8299-a20b174a995a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:38.595945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-712ebe42-686f-46b6-8299-a20b174a995a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:38.605126 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-712ebe42-686f-46b6-8299-a20b174a995a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1187 microversion: 2.1 time: 0.176234 Oct 05 18:07:38.605771 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2622/5484] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:38 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1187 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:39.377794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:39.379078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:39.390313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:39.391248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:39.391916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:39.393278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:39.394025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:39.394638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:39.631613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1c696e8c-03f7-4c12-ae72-523f04ae68d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:39.632972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1c696e8c-03f7-4c12-ae72-523f04ae68d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:39.636440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:39.651094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c696e8c-03f7-4c12-ae72-523f04ae68d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:39.670921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c696e8c-03f7-4c12-ae72-523f04ae68d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:39.671403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c696e8c-03f7-4c12-ae72-523f04ae68d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:39.672281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c696e8c-03f7-4c12-ae72-523f04ae68d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:39.672842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c696e8c-03f7-4c12-ae72-523f04ae68d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:39.673166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c696e8c-03f7-4c12-ae72-523f04ae68d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:39.823172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:39.838974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:39.843009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:39.848256 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aba39bcf-28ca-41da-a9c9-5ca97d215721 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1887 microversion: 2.42 time: 0.475137 Oct 05 18:07:39.849173 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2863/5485] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:39 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1887 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:39.939151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1c696e8c-03f7-4c12-ae72-523f04ae68d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:39.948574 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1c696e8c-03f7-4c12-ae72-523f04ae68d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1229 microversion: 2.1 time: 0.323170 Oct 05 18:07:39.962932 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2623/5486] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:39 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1229 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:40.884982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:40.886271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:40.903525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:40.904510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:40.905178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:40.906152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:40.906954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:40.907594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:40.973220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-07d7bc4a-a145-406f-a937-c94118ee36bf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:40.973911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-07d7bc4a-a145-406f-a937-c94118ee36bf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:40.991207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07d7bc4a-a145-406f-a937-c94118ee36bf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:40.991710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07d7bc4a-a145-406f-a937-c94118ee36bf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:40.992213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07d7bc4a-a145-406f-a937-c94118ee36bf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:40.993000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07d7bc4a-a145-406f-a937-c94118ee36bf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:40.993540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07d7bc4a-a145-406f-a937-c94118ee36bf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:40.994520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07d7bc4a-a145-406f-a937-c94118ee36bf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:41.754357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-07d7bc4a-a145-406f-a937-c94118ee36bf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:41.764556 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-07d7bc4a-a145-406f-a937-c94118ee36bf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1229 microversion: 2.1 time: 0.795287 Oct 05 18:07:41.767729 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2624/5487] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:40 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1229 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:07:41.792852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a0b3052b-8d2b-4246-b576-e1f3c8dbbb1f req-e8b8ffa8-13a2-47c8-84b2-a51f74b23364 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67f47820-e5fa-4cd2-b795-f02d28940230", "tag": "007d9e14-e4c8-4623-b8a2-d01d4029d998"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:07:41.812563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a0b3052b-8d2b-4246-b576-e1f3c8dbbb1f req-e8b8ffa8-13a2-47c8-84b2-a51f74b23364 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:41.815468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a0b3052b-8d2b-4246-b576-e1f3c8dbbb1f req-e8b8ffa8-13a2-47c8-84b2-a51f74b23364 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:41.816260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a0b3052b-8d2b-4246-b576-e1f3c8dbbb1f req-e8b8ffa8-13a2-47c8-84b2-a51f74b23364 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:41.829702 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a0b3052b-8d2b-4246-b576-e1f3c8dbbb1f req-e8b8ffa8-13a2-47c8-84b2-a51f74b23364 service nova] Creating event network-changed:007d9e14-e4c8-4623-b8a2-d01d4029d998 for instance 67f47820-e5fa-4cd2-b795-f02d28940230 on n-h2-835595-3 Oct 05 18:07:41.835007 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a0b3052b-8d2b-4246-b576-e1f3c8dbbb1f req-e8b8ffa8-13a2-47c8-84b2-a51f74b23364 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055212 Oct 05 18:07:41.836122 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2625/5488] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:07:41.858038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:41.869661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:41.872734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:41.900305 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d77a86c-a015-4b63-aaab-102b43b84ce5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1887 microversion: 2.42 time: 1.019497 Oct 05 18:07:41.903586 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2864/5489] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:40 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1887 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:42.806038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-18176b28-7ed2-4282-94cf-db31509ad816 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:42.807459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-18176b28-7ed2-4282-94cf-db31509ad816 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:42.822645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18176b28-7ed2-4282-94cf-db31509ad816 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:42.823721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18176b28-7ed2-4282-94cf-db31509ad816 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:42.824719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18176b28-7ed2-4282-94cf-db31509ad816 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:42.826683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18176b28-7ed2-4282-94cf-db31509ad816 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:42.827755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18176b28-7ed2-4282-94cf-db31509ad816 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:42.828767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18176b28-7ed2-4282-94cf-db31509ad816 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:42.945545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:42.946904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:42.958228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:42.963437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:42.964042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:42.969226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:42.970351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:42.972309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:43.149032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-18176b28-7ed2-4282-94cf-db31509ad816 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:43.157973 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-18176b28-7ed2-4282-94cf-db31509ad816 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1229 microversion: 2.1 time: 0.370085 Oct 05 18:07:43.159178 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2626/5490] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:42 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1229 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:43.820516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:43.871447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=77 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:43.877331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:43.879198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:43.880595 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c59cb81b-6eb4-47a8-ba25-eb7439c779e6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1887 microversion: 2.42 time: 0.943738 Oct 05 18:07:43.881800 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2865/5491] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:42 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1887 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:44.186704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-65171c38-0b3c-420b-a3d5-91a9052f8c4c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:44.188176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-65171c38-0b3c-420b-a3d5-91a9052f8c4c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:44.198266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65171c38-0b3c-420b-a3d5-91a9052f8c4c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:44.198818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65171c38-0b3c-420b-a3d5-91a9052f8c4c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:44.199275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65171c38-0b3c-420b-a3d5-91a9052f8c4c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:44.200140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65171c38-0b3c-420b-a3d5-91a9052f8c4c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:44.200599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65171c38-0b3c-420b-a3d5-91a9052f8c4c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:44.201027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-65171c38-0b3c-420b-a3d5-91a9052f8c4c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:44.356163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-65171c38-0b3c-420b-a3d5-91a9052f8c4c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:44.364353 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-65171c38-0b3c-420b-a3d5-91a9052f8c4c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1229 microversion: 2.1 time: 0.182203 Oct 05 18:07:44.364941 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2627/5492] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:44 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1229 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:44.916448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:44.917070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:44.920255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:44.932573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:44.933294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:44.933921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:44.934686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:44.936163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:44.936600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:45.125671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:45.135411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:45.136847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:45.138021 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88882739-c87e-4479-93ca-b0f3920ac833 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1887 microversion: 2.42 time: 0.227611 Oct 05 18:07:45.138621 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2866/5493] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:44 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1887 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:45.387522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48806a0b-6320-44ca-9e6f-d623fc7f7633 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:45.388130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48806a0b-6320-44ca-9e6f-d623fc7f7633 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:45.395991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48806a0b-6320-44ca-9e6f-d623fc7f7633 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:45.396525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48806a0b-6320-44ca-9e6f-d623fc7f7633 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:45.396966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48806a0b-6320-44ca-9e6f-d623fc7f7633 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:45.397682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48806a0b-6320-44ca-9e6f-d623fc7f7633 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:45.398143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48806a0b-6320-44ca-9e6f-d623fc7f7633 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:45.398926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48806a0b-6320-44ca-9e6f-d623fc7f7633 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:45.533645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-48806a0b-6320-44ca-9e6f-d623fc7f7633 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:45.541758 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48806a0b-6320-44ca-9e6f-d623fc7f7633 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1229 microversion: 2.1 time: 0.158262 Oct 05 18:07:45.542296 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2628/5494] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:45 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:46.163168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:46.163713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:46.176249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:46.176806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:46.177490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:46.178546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:46.179089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:46.179636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:46.448871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:46.458779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:46.460303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:46.461493 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-42cff4e2-a2c1-49f1-b2fe-6823d325d1c5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1887 microversion: 2.42 time: 0.302330 Oct 05 18:07:46.462062 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2867/5495] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:46 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1887 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:46.564673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9ad51b07-2da1-4f0d-b980-49bdad50c9cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:46.565916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9ad51b07-2da1-4f0d-b980-49bdad50c9cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:46.569137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:46.570007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:46.576024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ad51b07-2da1-4f0d-b980-49bdad50c9cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:46.576519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ad51b07-2da1-4f0d-b980-49bdad50c9cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:46.576944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ad51b07-2da1-4f0d-b980-49bdad50c9cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:46.591168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ad51b07-2da1-4f0d-b980-49bdad50c9cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:46.591646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ad51b07-2da1-4f0d-b980-49bdad50c9cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:46.592089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9ad51b07-2da1-4f0d-b980-49bdad50c9cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:46.735744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9ad51b07-2da1-4f0d-b980-49bdad50c9cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:46.752335 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9ad51b07-2da1-4f0d-b980-49bdad50c9cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1229 microversion: 2.1 time: 0.191539 Oct 05 18:07:46.752980 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2629/5496] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:46 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1229 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:47.487691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:47.488659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:47.496129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:47.496628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:47.497070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:47.497774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:47.498518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:47.498949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:47.690465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:47.704533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:47.706079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:47.707818 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b4c7317-c5b8-4deb-a883-19d022b8f272 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.224187 Oct 05 18:07:47.708912 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2868/5497] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:47 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:47.778023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7e91e55f-bdc9-4152-ae6a-a358dbba29ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:47.780600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7e91e55f-bdc9-4152-ae6a-a358dbba29ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:47.788599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e91e55f-bdc9-4152-ae6a-a358dbba29ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:47.789232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e91e55f-bdc9-4152-ae6a-a358dbba29ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:47.789782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e91e55f-bdc9-4152-ae6a-a358dbba29ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:47.790625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e91e55f-bdc9-4152-ae6a-a358dbba29ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:47.791181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e91e55f-bdc9-4152-ae6a-a358dbba29ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:47.791945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e91e55f-bdc9-4152-ae6a-a358dbba29ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:47.940847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7e91e55f-bdc9-4152-ae6a-a358dbba29ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:47.950321 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7e91e55f-bdc9-4152-ae6a-a358dbba29ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1229 microversion: 2.1 time: 0.177488 Oct 05 18:07:47.951538 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2630/5498] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:47 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1229 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:48.736404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:48.737359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:48.745535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:48.746161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:48.746734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:48.747559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:48.748252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:48.748779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:48.961437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:48.971665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:48.973105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:48.973236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-79feec3b-9f4b-4a82-92a0-457ec865f19d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:48.973851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-79feec3b-9f4b-4a82-92a0-457ec865f19d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:48.974453 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c047dfcc-cf75-4f24-a52f-b7f369a95a1c tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.242343 Oct 05 18:07:48.975026 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2869/5499] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:48 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:48.980847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79feec3b-9f4b-4a82-92a0-457ec865f19d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:48.981545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79feec3b-9f4b-4a82-92a0-457ec865f19d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:48.982141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79feec3b-9f4b-4a82-92a0-457ec865f19d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:48.983016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79feec3b-9f4b-4a82-92a0-457ec865f19d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:48.983625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79feec3b-9f4b-4a82-92a0-457ec865f19d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:48.984222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79feec3b-9f4b-4a82-92a0-457ec865f19d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:49.121756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-79feec3b-9f4b-4a82-92a0-457ec865f19d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:49.130614 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-79feec3b-9f4b-4a82-92a0-457ec865f19d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1229 microversion: 2.1 time: 0.161314 Oct 05 18:07:49.131209 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2631/5500] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:48 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1229 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:50.002075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:50.002912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:50.012667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:50.013178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:50.013597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:50.014697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:50.015175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:50.015862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:50.156801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-533b1550-8c41-4ea0-88cc-788cea02f915 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:50.158119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-533b1550-8c41-4ea0-88cc-788cea02f915 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:50.165714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-533b1550-8c41-4ea0-88cc-788cea02f915 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:50.166515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-533b1550-8c41-4ea0-88cc-788cea02f915 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:50.167239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-533b1550-8c41-4ea0-88cc-788cea02f915 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:50.167964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-533b1550-8c41-4ea0-88cc-788cea02f915 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:50.168648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-533b1550-8c41-4ea0-88cc-788cea02f915 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:50.169314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-533b1550-8c41-4ea0-88cc-788cea02f915 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:50.194664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:07:50.217692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:50.228840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:50.230404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:50.231583 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-07a11f86-b383-4567-b130-21ccf09c0daf tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.234125 Oct 05 18:07:50.232316 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2870/5501] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:49 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:50.329483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-533b1550-8c41-4ea0-88cc-788cea02f915 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:50.338167 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-533b1550-8c41-4ea0-88cc-788cea02f915 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.188865 Oct 05 18:07:50.338870 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2632/5502] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:50 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:07:51.260572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:51.261190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:51.279463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:51.279463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:51.279877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:51.280760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:51.281253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:51.281772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:51.367012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f9fc056-70e3-4920-97e8-5b94e198904e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:51.367653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0f9fc056-70e3-4920-97e8-5b94e198904e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:51.379783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f9fc056-70e3-4920-97e8-5b94e198904e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:51.383031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f9fc056-70e3-4920-97e8-5b94e198904e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:51.383540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f9fc056-70e3-4920-97e8-5b94e198904e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:51.384335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f9fc056-70e3-4920-97e8-5b94e198904e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:51.386954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f9fc056-70e3-4920-97e8-5b94e198904e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:51.387638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f9fc056-70e3-4920-97e8-5b94e198904e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:51.518901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:51.529862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:51.531619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:51.533096 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1239f2c0-5259-456a-ae37-ee38898996c3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.276443 Oct 05 18:07:51.534210 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2871/5503] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:51 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:51.552275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0f9fc056-70e3-4920-97e8-5b94e198904e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:51.560550 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f9fc056-70e3-4920-97e8-5b94e198904e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.202723 Oct 05 18:07:51.561366 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2633/5504] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:51 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:52.560264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:52.562250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:52.576157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:52.576924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:52.579352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:52.580625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:52.581234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:52.584462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:52.584880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b115282d-f693-441a-b19d-961042843022 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:52.585591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b115282d-f693-441a-b19d-961042843022 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:52.593746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b115282d-f693-441a-b19d-961042843022 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:52.594240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b115282d-f693-441a-b19d-961042843022 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:52.594800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b115282d-f693-441a-b19d-961042843022 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:52.595543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b115282d-f693-441a-b19d-961042843022 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:52.595999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b115282d-f693-441a-b19d-961042843022 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:52.596426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b115282d-f693-441a-b19d-961042843022 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:52.796165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b115282d-f693-441a-b19d-961042843022 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:52.805936 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b115282d-f693-441a-b19d-961042843022 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.225808 Oct 05 18:07:52.813150 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2634/5505] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:52 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:07:52.889511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:52.903775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:52.906710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:52.908134 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b39dd1d-5485-4315-8560-030d97a7764e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.352880 Oct 05 18:07:52.909180 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2872/5506] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:52 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:53.833337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-147e68d1-ab7f-45c7-830d-676212cefbda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:53.834547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-147e68d1-ab7f-45c7-830d-676212cefbda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:53.846206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147e68d1-ab7f-45c7-830d-676212cefbda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:53.847168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147e68d1-ab7f-45c7-830d-676212cefbda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:53.848612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147e68d1-ab7f-45c7-830d-676212cefbda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:53.849617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147e68d1-ab7f-45c7-830d-676212cefbda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:53.850559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147e68d1-ab7f-45c7-830d-676212cefbda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:53.851193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-147e68d1-ab7f-45c7-830d-676212cefbda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:53.933018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:53.933635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:53.946875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:53.948381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:53.951267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:53.952323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:53.955089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:53.955767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:54.067268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-147e68d1-ab7f-45c7-830d-676212cefbda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:54.087834 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-147e68d1-ab7f-45c7-830d-676212cefbda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.259234 Oct 05 18:07:54.100524 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2635/5507] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:53 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:54.212036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:54.232550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:54.233990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:54.235229 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76abc752-f89d-40bc-9d23-d820cd751f11 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.306120 Oct 05 18:07:54.235802 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2873/5508] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:53 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 18:07:55.113629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b672f8cf-d6e1-47e8-9837-4d8b73545eb5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:55.115353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b672f8cf-d6e1-47e8-9837-4d8b73545eb5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:55.123081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b672f8cf-d6e1-47e8-9837-4d8b73545eb5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:55.123678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b672f8cf-d6e1-47e8-9837-4d8b73545eb5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:55.124191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b672f8cf-d6e1-47e8-9837-4d8b73545eb5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:55.125110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b672f8cf-d6e1-47e8-9837-4d8b73545eb5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:55.126074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b672f8cf-d6e1-47e8-9837-4d8b73545eb5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:55.126584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b672f8cf-d6e1-47e8-9837-4d8b73545eb5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:55.262547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:55.263170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:55.276763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:55.277266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:55.277720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:55.281732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b672f8cf-d6e1-47e8-9837-4d8b73545eb5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:55.282258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:55.282733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:55.283253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:55.291343 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b672f8cf-d6e1-47e8-9837-4d8b73545eb5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.182571 Oct 05 18:07:55.291796 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2636/5509] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:55 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:55.503622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:55.514242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:55.515863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:55.517223 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-932db8b0-ba50-4bf8-b7ac-ed62443aa98d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.258776 Oct 05 18:07:55.517845 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2874/5510] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:55 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 18:07:56.315178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f93af30-c9f9-486a-be65-993b83c0acd6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:56.315792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0f93af30-c9f9-486a-be65-993b83c0acd6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:56.324952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f93af30-c9f9-486a-be65-993b83c0acd6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:56.325730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f93af30-c9f9-486a-be65-993b83c0acd6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:56.326468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f93af30-c9f9-486a-be65-993b83c0acd6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:56.327535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f93af30-c9f9-486a-be65-993b83c0acd6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:56.328229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f93af30-c9f9-486a-be65-993b83c0acd6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:56.328887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f93af30-c9f9-486a-be65-993b83c0acd6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:56.469408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0f93af30-c9f9-486a-be65-993b83c0acd6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:56.477585 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f93af30-c9f9-486a-be65-993b83c0acd6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.167036 Oct 05 18:07:56.478147 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2637/5511] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:56 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:56.544009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:56.544584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:56.551909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:56.552392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:56.552832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:56.553522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:56.553982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:56.554431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:56.587233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4a7a6266-acf1-498b-8775-d32444bcc36f tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:56.587700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4a7a6266-acf1-498b-8775-d32444bcc36f tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:56.593903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a7a6266-acf1-498b-8775-d32444bcc36f tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:56.594414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a7a6266-acf1-498b-8775-d32444bcc36f tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:56.594847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a7a6266-acf1-498b-8775-d32444bcc36f tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:56.595592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a7a6266-acf1-498b-8775-d32444bcc36f tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:56.596039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a7a6266-acf1-498b-8775-d32444bcc36f tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:56.596456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a7a6266-acf1-498b-8775-d32444bcc36f tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:56.678742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-4a7a6266-acf1-498b-8775-d32444bcc36f tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lazy-loading 'services' on Instance uuid 45e3f18f-be09-45f1-b0b9-8291c36c2a77 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:07:56.751689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:56.761589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:56.764142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:56.765405 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4a7a6266-acf1-498b-8775-d32444bcc36f tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77/os-volume_attachments/c143d3ab-c5b7-495d-9df6-d7e21f2a1512" status: 202 len: 0 microversion: 2.1 time: 0.181936 Oct 05 18:07:56.765549 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a3ce172f-5f3b-4404-a19c-e980ee67132b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.225455 Oct 05 18:07:56.766071 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2875/5512] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:56 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 18:07:56.769707 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2638/5513] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:07:56 2022] DELETE /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77/os-volume_attachments/c143d3ab-c5b7-495d-9df6-d7e21f2a1512 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 18:07:57.500383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-db49a338-71ae-4c29-a088-d2f169927ca9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:57.501333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-db49a338-71ae-4c29-a088-d2f169927ca9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:57.507573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db49a338-71ae-4c29-a088-d2f169927ca9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:57.508064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db49a338-71ae-4c29-a088-d2f169927ca9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:57.508499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db49a338-71ae-4c29-a088-d2f169927ca9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:57.509205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db49a338-71ae-4c29-a088-d2f169927ca9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:57.509744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db49a338-71ae-4c29-a088-d2f169927ca9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:57.510187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db49a338-71ae-4c29-a088-d2f169927ca9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:57.651874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-db49a338-71ae-4c29-a088-d2f169927ca9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:57.660561 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-db49a338-71ae-4c29-a088-d2f169927ca9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.164161 Oct 05 18:07:57.669226 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2876/5514] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:57 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:57.793958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:57.795565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:57.806602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:57.807131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:57.807733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:57.808597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:57.809231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:57.809994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:58.013503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:58.023693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:58.025123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:58.026386 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d0080d56-4000-4735-9aad-556c7d25e192 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.238116 Oct 05 18:07:58.026961 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2639/5515] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:57 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:58.684186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b5a0b2d-19bf-4153-b260-46b85d651807 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:58.684805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6b5a0b2d-19bf-4153-b260-46b85d651807 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:58.692192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b5a0b2d-19bf-4153-b260-46b85d651807 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:58.692877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b5a0b2d-19bf-4153-b260-46b85d651807 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:58.693390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b5a0b2d-19bf-4153-b260-46b85d651807 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:58.694167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b5a0b2d-19bf-4153-b260-46b85d651807 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:58.694988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b5a0b2d-19bf-4153-b260-46b85d651807 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:58.695489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b5a0b2d-19bf-4153-b260-46b85d651807 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:58.835442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6b5a0b2d-19bf-4153-b260-46b85d651807 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:58.856276 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b5a0b2d-19bf-4153-b260-46b85d651807 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.176003 Oct 05 18:07:58.856930 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2877/5516] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:58 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:07:59.053529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:59.054142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:59.061333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:59.062047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:59.062662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:59.063360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:59.063817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:59.064241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:59.256737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:59.266223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:59.267736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:07:59.268904 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f986bf74-a0bb-4f99-87c2-4edcf630c26b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.219545 Oct 05 18:07:59.269512 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2640/5517] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:07:59 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:07:59.880962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0fbc2105-23e6-4d49-8792-e9d58107c7e1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:07:59.881805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0fbc2105-23e6-4d49-8792-e9d58107c7e1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:07:59.889534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fbc2105-23e6-4d49-8792-e9d58107c7e1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:59.890026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fbc2105-23e6-4d49-8792-e9d58107c7e1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:59.890494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fbc2105-23e6-4d49-8792-e9d58107c7e1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:07:59.891193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fbc2105-23e6-4d49-8792-e9d58107c7e1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:07:59.891706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fbc2105-23e6-4d49-8792-e9d58107c7e1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:07:59.892162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fbc2105-23e6-4d49-8792-e9d58107c7e1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:00.069198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0fbc2105-23e6-4d49-8792-e9d58107c7e1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:00.080172 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0fbc2105-23e6-4d49-8792-e9d58107c7e1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.201794 Oct 05 18:08:00.087483 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2878/5518] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:07:59 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:00.295083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:00.295656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:00.303190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:00.303863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:00.304362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:00.305042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:00.305492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:00.305910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:00.489975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:00.499202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:00.500977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:00.502171 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e7c18d2d-4372-42ab-8c05-9f4760162e59 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.211245 Oct 05 18:08:00.502802 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2641/5519] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:00 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:01.104208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8b9491ed-f874-4071-9e59-4fc2067b7aeb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:01.105156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8b9491ed-f874-4071-9e59-4fc2067b7aeb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:01.112952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b9491ed-f874-4071-9e59-4fc2067b7aeb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:01.113589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b9491ed-f874-4071-9e59-4fc2067b7aeb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:01.114119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b9491ed-f874-4071-9e59-4fc2067b7aeb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:01.114986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b9491ed-f874-4071-9e59-4fc2067b7aeb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:01.115541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b9491ed-f874-4071-9e59-4fc2067b7aeb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:01.116198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b9491ed-f874-4071-9e59-4fc2067b7aeb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:01.269419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8b9491ed-f874-4071-9e59-4fc2067b7aeb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:01.277792 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8b9491ed-f874-4071-9e59-4fc2067b7aeb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.177581 Oct 05 18:08:01.278789 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2879/5520] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:01 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:01.528020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:01.528617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:01.536194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:01.536924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:01.537530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:01.538429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:01.539037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:01.539470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:01.706006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-fdfc35f2-6b83-4c52-8350-f10165cfbd92 req-851de924-7574-49ac-9337-d024657f79fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f47820-e5fa-4cd2-b795-f02d28940230", "name": "network-vif-plugged", "status": "completed", "tag": "007d9e14-e4c8-4623-b8a2-d01d4029d998"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:01.718389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fdfc35f2-6b83-4c52-8350-f10165cfbd92 req-851de924-7574-49ac-9337-d024657f79fe service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:01.719176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fdfc35f2-6b83-4c52-8350-f10165cfbd92 req-851de924-7574-49ac-9337-d024657f79fe service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:01.720470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fdfc35f2-6b83-4c52-8350-f10165cfbd92 req-851de924-7574-49ac-9337-d024657f79fe service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:01.733366 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-fdfc35f2-6b83-4c52-8350-f10165cfbd92 req-851de924-7574-49ac-9337-d024657f79fe service nova] Creating event network-vif-plugged:007d9e14-e4c8-4623-b8a2-d01d4029d998 for instance 67f47820-e5fa-4cd2-b795-f02d28940230 on n-h2-835595-3 Oct 05 18:08:01.739367 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-fdfc35f2-6b83-4c52-8350-f10165cfbd92 req-851de924-7574-49ac-9337-d024657f79fe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037968 Oct 05 18:08:01.740534 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2880/5521] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:08:01.807113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:01.816702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:01.818144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:01.819391 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e4b68d8e-664e-42a5-b594-08e5e60bbd19 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.295290 Oct 05 18:08:01.820181 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2642/5522] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:01 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:02.231611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d2b81404-73a6-47ef-889b-ade56afcb4ad tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:02.232058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d2b81404-73a6-47ef-889b-ade56afcb4ad tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:02.239733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2b81404-73a6-47ef-889b-ade56afcb4ad tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:02.240265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2b81404-73a6-47ef-889b-ade56afcb4ad tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:02.240701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2b81404-73a6-47ef-889b-ade56afcb4ad tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:02.241406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2b81404-73a6-47ef-889b-ade56afcb4ad tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:02.241870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2b81404-73a6-47ef-889b-ade56afcb4ad tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:02.242315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2b81404-73a6-47ef-889b-ade56afcb4ad tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:02.268567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d2b81404-73a6-47ef-889b-ade56afcb4ad tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:08:02.301041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea919a3d-b4bc-45a6-9e79-e068755ba8cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:02.301863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ea919a3d-b4bc-45a6-9e79-e068755ba8cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:02.309189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea919a3d-b4bc-45a6-9e79-e068755ba8cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:02.309770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea919a3d-b4bc-45a6-9e79-e068755ba8cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:02.310354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea919a3d-b4bc-45a6-9e79-e068755ba8cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:02.311174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea919a3d-b4bc-45a6-9e79-e068755ba8cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:02.311744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea919a3d-b4bc-45a6-9e79-e068755ba8cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:02.312301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea919a3d-b4bc-45a6-9e79-e068755ba8cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:02.317614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:02.357902 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d2b81404-73a6-47ef-889b-ade56afcb4ad tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "DELETE /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 204 len: 0 microversion: 2.1 time: 0.130278 Oct 05 18:08:02.358671 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2881/5523] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:08:02 2022] DELETE /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:08:02.367776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bbca23bc-4d0d-4807-844c-9ea5fe6e8aed tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:02.368476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bbca23bc-4d0d-4807-844c-9ea5fe6e8aed tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:02.374670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbca23bc-4d0d-4807-844c-9ea5fe6e8aed tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:02.375158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbca23bc-4d0d-4807-844c-9ea5fe6e8aed tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:02.375923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbca23bc-4d0d-4807-844c-9ea5fe6e8aed tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:02.376680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbca23bc-4d0d-4807-844c-9ea5fe6e8aed tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:02.377269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbca23bc-4d0d-4807-844c-9ea5fe6e8aed tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:02.377691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbca23bc-4d0d-4807-844c-9ea5fe6e8aed tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:02.463187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ea919a3d-b4bc-45a6-9e79-e068755ba8cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:02.471619 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ea919a3d-b4bc-45a6-9e79-e068755ba8cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.174615 Oct 05 18:08:02.472453 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2643/5524] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:02 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:02.537039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bbca23bc-4d0d-4807-844c-9ea5fe6e8aed tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:02.545257 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bbca23bc-4d0d-4807-844c-9ea5fe6e8aed tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1470 microversion: 2.1 time: 0.181934 Oct 05 18:08:02.545844 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2882/5525] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:02 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1470 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:02.845485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:02.846052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:02.853480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:02.854229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:02.854907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:02.856048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:02.856588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:02.857299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:03.059483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:03.070038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:03.071689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:03.072870 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-230ca6ad-252c-4adc-8a1e-ad9cdb14a135 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.231421 Oct 05 18:08:03.073568 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2644/5526] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:02 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:03.495130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c5c11598-b5b5-43e5-ab19-09a69955b6d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:03.495746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c5c11598-b5b5-43e5-ab19-09a69955b6d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:03.503734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5c11598-b5b5-43e5-ab19-09a69955b6d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:03.504252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5c11598-b5b5-43e5-ab19-09a69955b6d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:03.504694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5c11598-b5b5-43e5-ab19-09a69955b6d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:03.505398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5c11598-b5b5-43e5-ab19-09a69955b6d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:03.505851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5c11598-b5b5-43e5-ab19-09a69955b6d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:03.506301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5c11598-b5b5-43e5-ab19-09a69955b6d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:03.568766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-150a252a-94dd-4588-81b9-9de5a4f6cd7b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:03.569794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-150a252a-94dd-4588-81b9-9de5a4f6cd7b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:03.576030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-150a252a-94dd-4588-81b9-9de5a4f6cd7b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:03.576526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-150a252a-94dd-4588-81b9-9de5a4f6cd7b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:03.576961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-150a252a-94dd-4588-81b9-9de5a4f6cd7b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:03.577667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-150a252a-94dd-4588-81b9-9de5a4f6cd7b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:03.578116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-150a252a-94dd-4588-81b9-9de5a4f6cd7b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:03.578743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-150a252a-94dd-4588-81b9-9de5a4f6cd7b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:03.655384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c5c11598-b5b5-43e5-ab19-09a69955b6d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:03.664563 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c5c11598-b5b5-43e5-ab19-09a69955b6d8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1217 microversion: 2.1 time: 0.173478 Oct 05 18:08:03.673352 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2883/5527] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:03 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:03.735575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-150a252a-94dd-4588-81b9-9de5a4f6cd7b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:03.744082 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-150a252a-94dd-4588-81b9-9de5a4f6cd7b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1470 microversion: 2.1 time: 0.179347 Oct 05 18:08:03.744677 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2645/5528] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:03 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1470 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:04.099324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:04.100072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:04.109443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:04.109970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:04.110468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:04.111323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:04.112034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:04.112320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:04.315006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:04.325510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:04.327115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:04.328328 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4c4877d1-df29-4239-8449-6b179a567e93 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.233342 Oct 05 18:08:04.328966 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2884/5529] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:04 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:04.697509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8f69abb9-1c8e-4b7d-b426-fd69854a3aa2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:04.698229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8f69abb9-1c8e-4b7d-b426-fd69854a3aa2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:04.711868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f69abb9-1c8e-4b7d-b426-fd69854a3aa2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:04.712372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f69abb9-1c8e-4b7d-b426-fd69854a3aa2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:04.712813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f69abb9-1c8e-4b7d-b426-fd69854a3aa2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:04.713537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f69abb9-1c8e-4b7d-b426-fd69854a3aa2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:04.714011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f69abb9-1c8e-4b7d-b426-fd69854a3aa2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:04.714455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f69abb9-1c8e-4b7d-b426-fd69854a3aa2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:04.768041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4f39ea0b-b42f-4c7b-973b-8f9c0b0092e3 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:04.769394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4f39ea0b-b42f-4c7b-973b-8f9c0b0092e3 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:04.787079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f39ea0b-b42f-4c7b-973b-8f9c0b0092e3 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:04.787957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f39ea0b-b42f-4c7b-973b-8f9c0b0092e3 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:04.788519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f39ea0b-b42f-4c7b-973b-8f9c0b0092e3 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:04.789571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f39ea0b-b42f-4c7b-973b-8f9c0b0092e3 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:04.790127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f39ea0b-b42f-4c7b-973b-8f9c0b0092e3 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:04.790676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4f39ea0b-b42f-4c7b-973b-8f9c0b0092e3 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:04.920256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f69abb9-1c8e-4b7d-b426-fd69854a3aa2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:04.944903 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8f69abb9-1c8e-4b7d-b426-fd69854a3aa2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1404 microversion: 2.1 time: 0.251326 Oct 05 18:08:04.967209 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2646/5530] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:04 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1404 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:04.974020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8983a5a4-5681-401e-92f1-f29a746cc72d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:04.975248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8983a5a4-5681-401e-92f1-f29a746cc72d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:04.981631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8983a5a4-5681-401e-92f1-f29a746cc72d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:04.982475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8983a5a4-5681-401e-92f1-f29a746cc72d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:04.983253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8983a5a4-5681-401e-92f1-f29a746cc72d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:04.984131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8983a5a4-5681-401e-92f1-f29a746cc72d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:04.984930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8983a5a4-5681-401e-92f1-f29a746cc72d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:04.985511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8983a5a4-5681-401e-92f1-f29a746cc72d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:05.108616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4f39ea0b-b42f-4c7b-973b-8f9c0b0092e3 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a18ec64caf24ef184c0d8725197367c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a07ffeb0acb742c5b3504289ea57234f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:05.124699 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4f39ea0b-b42f-4c7b-973b-8f9c0b0092e3 tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 200 len: 1470 microversion: 2.1 time: 0.360231 Oct 05 18:08:05.126249 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2885/5531] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:04 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 1470 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:05.131071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3e13d27c-a0e5-44d3-bcee-76e4eb77ea02 req-3914c4e4-1d1a-4562-8bf9-4864f59c70d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45e3f18f-be09-45f1-b0b9-8291c36c2a77", "name": "network-vif-deleted", "tag": "08e21991-beaf-4a5d-b250-1959cbe6da12"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:05.147398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3e13d27c-a0e5-44d3-bcee-76e4eb77ea02 req-3914c4e4-1d1a-4562-8bf9-4864f59c70d9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:05.148142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3e13d27c-a0e5-44d3-bcee-76e4eb77ea02 req-3914c4e4-1d1a-4562-8bf9-4864f59c70d9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:05.148648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3e13d27c-a0e5-44d3-bcee-76e4eb77ea02 req-3914c4e4-1d1a-4562-8bf9-4864f59c70d9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:05.177855 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3e13d27c-a0e5-44d3-bcee-76e4eb77ea02 req-3914c4e4-1d1a-4562-8bf9-4864f59c70d9 service nova] Creating event network-vif-deleted:08e21991-beaf-4a5d-b250-1959cbe6da12 for instance 45e3f18f-be09-45f1-b0b9-8291c36c2a77 on n-h2-835595-3 Oct 05 18:08:05.194031 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3e13d27c-a0e5-44d3-bcee-76e4eb77ea02 req-3914c4e4-1d1a-4562-8bf9-4864f59c70d9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066364 Oct 05 18:08:05.197885 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2886/5532] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:08:05.200020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8983a5a4-5681-401e-92f1-f29a746cc72d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:05.208674 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8983a5a4-5681-401e-92f1-f29a746cc72d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1404 microversion: 2.1 time: 0.239127 Oct 05 18:08:05.210048 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2647/5533] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:04 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1404 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:08:05.233306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1607300633"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:05.236828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:05.244961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:05.245489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:05.245927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:05.246852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:05.247467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:05.248208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:05.357107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:05.357734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:05.366806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:05.367898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:05.368663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:05.369558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:05.370171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:05.370757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:05.396866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:05.409637 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.api [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Attempting to quiesce instance before volume snapshot. Oct 05 18:08:05.593824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:05.603802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:05.605246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:05.606830 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-03dd7130-0e7e-4048-84cf-15cc78ee9b6b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.255644 Oct 05 18:08:05.607145 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.api [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 05 18:08:05.623114 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2648/5534] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:05 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 18:08:05.716108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Creating snapshot from volume 4c00ee66-d21c-4522-863b-a2b043c91de5. {{(pid=128844) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 05 18:08:06.153407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:06.155123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] [instance: 45e3f18f-be09-45f1-b0b9-8291c36c2a77] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:06.165705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:06.166575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:06.187302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:06.189885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:06.192281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:06.192887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:06.244809 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] HTTP exception thrown: Instance 45e3f18f-be09-45f1-b0b9-8291c36c2a77 could not be found. Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Request method failure captured: Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 HTTP/1.1 Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcd-tMtlU91BlHTc7EYpj0NNrfQhIyCkD19D--g98_cAGGJb9vx3ab-oMUD3Qzfdz4RlzVlp8wGNvR2mgnvlMzfz-uL4uByQZ6JDeNLx3LpZDbvooKbuE5ZdfiXe8UkbWVw6t0jtsiXbZCdglygOA6FyvXiIqAUQt8qaJiN9Hb7nqcU Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: a07ffeb0acb742c5b3504289ea57234f Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-VolumesBackupsTest-185815004 Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/a07ffeb0acb742c5b3504289ea57234f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a07ffeb0acb742c5b3504289ea57234f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_a07ffeb0acb742c5b3504289ea57234f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/a07ffeb0acb742c5b3504289ea57234f"}]}] Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-VolumesBackupsTest-185815004 Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: a07ffeb0acb742c5b3504289ea57234f Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-VolumesBackupsTest-185815004 Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-VolumesBackupsTest-185815004-project Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 6a18ec64caf24ef184c0d8725197367c Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-VolumesBackupsTest-185815004-project Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 45e3f18f-be09-45f1-b0b9-8291c36c2a77 could not be found. Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '45e3f18f-be09-45f1-b0b9-8291c36c2a77'} Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45e3f18f-be09-45f1-b0b9-8291c36c2a77 could not be found. Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45e3f18f-be09-45f1-b0b9-8291c36c2a77 could not be found. Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:08:06.249311 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:08:06.254032 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:08:06.254032 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:08:06.254032 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:08:06.254032 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:08:06.254032 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:08:06.254032 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45e3f18f-be09-45f1-b0b9-8291c36c2a77 could not be found. Oct 05 18:08:06.254032 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:08:06.261763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] Returning 404 to user: Instance 45e3f18f-be09-45f1-b0b9-8291c36c2a77 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:08:06.270764 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8ffc8530-3894-4a66-b4be-0e7d5bdad95b tempest-VolumesBackupsTest-185815004 tempest-VolumesBackupsTest-185815004-project] 10.222.0.70 "GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77" status: 404 len: 111 microversion: 2.1 time: 0.115653 Oct 05 18:08:06.271727 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2649/5535] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:06 2022] GET /compute/v2.1/servers/45e3f18f-be09-45f1-b0b9-8291c36c2a77 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:08:06.635190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:06.638218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:06.650999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:06.651983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:06.653001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:06.653860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:06.654511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:06.655078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:07.027743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:07.040463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:07.042201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:07.044140 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8d0c5581-e29d-4f4f-a01f-0c9fe4cb3f55 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.412280 Oct 05 18:08:07.045148 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2650/5536] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:06 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 18:08:07.066555 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ee1f05f-4aa5-46c3-b2cd-af9e9064b271 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "POST /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230/action" status: 202 len: 0 microversion: 2.1 time: 1.837514 Oct 05 18:08:07.068096 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2887/5537] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:08:05 2022] POST /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230/action => generated 0 bytes in 1840 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 18:08:08.075491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:08.077942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:08.095340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:08.096340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:08.096977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:08.097912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:08.098632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:08.099837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:08.405538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:08.418097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:08.419643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:08.422061 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-28a6c972-e0a4-4b92-ab03-b55e5236b6c9 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.350357 Oct 05 18:08:08.423848 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2651/5538] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:08 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:09.308293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-997934604", "imageRef": "f6103e02-0f80-472d-b9f9-25550d094c4d", "flavorRef": "452", "networks": [{"uuid": "adb1494a-27b0-43e0-8027-66e89e0c81ad"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:09.368637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] validate_networks() for [('adb1494a-27b0-43e0-8027-66e89e0c81ad', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:08:09.455412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:09.456776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:09.471581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:09.473623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:09.474075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:09.474822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:09.475278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:09.478561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:09.793211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:09.807267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:09.809164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:09.810570 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cad4297e-71a7-4cf2-be4b-327785d8da25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.360158 Oct 05 18:08:09.811860 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2652/5539] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:09 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:09.819480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e08bb27c-d99d-4f4f-b73f-9983b9492aa7 req-068079bf-e75c-4156-8800-446ce2d40013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-plugged", "status": "completed", "tag": "45895d7b-fe7f-4e0a-8318-08bc84a4c17f"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:09.831849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=60 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:09.836837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e08bb27c-d99d-4f4f-b73f-9983b9492aa7 req-068079bf-e75c-4156-8800-446ce2d40013 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:09.837579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e08bb27c-d99d-4f4f-b73f-9983b9492aa7 req-068079bf-e75c-4156-8800-446ce2d40013 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:09.838184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e08bb27c-d99d-4f4f-b73f-9983b9492aa7 req-068079bf-e75c-4156-8800-446ce2d40013 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:09.858906 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e08bb27c-d99d-4f4f-b73f-9983b9492aa7 req-068079bf-e75c-4156-8800-446ce2d40013 service nova] Creating event network-vif-plugged:45895d7b-fe7f-4e0a-8318-08bc84a4c17f for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:08:09.867601 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e08bb27c-d99d-4f4f-b73f-9983b9492aa7 req-068079bf-e75c-4156-8800-446ce2d40013 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054092 Oct 05 18:08:09.868512 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2653/5540] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:08:09.958254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:08:09.958814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:08:09.959583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:08:09.960245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:08:09.961222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:08:09.975566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:09.976261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:09.977105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:09.978048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:09.979658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:09.980305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:10.015328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:08:10.025901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for user 8a900e5bf82d462a9113d6e6461ea3a0 and project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:08:10.042581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:08:10.045653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4b56ab4b-6f54-404e-a93a-70395e09b5de',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:08:10.214144 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ad25051-7cf8-4831-a587-4502b3ef9205 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911199 Oct 05 18:08:10.214876 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2888/5541] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:08:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:08:10.227170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4cdb7c2-30ff-4097-89a4-6a4861ebf9a7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:10.227873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e4cdb7c2-30ff-4097-89a4-6a4861ebf9a7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:10.299201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e4cdb7c2-30ff-4097-89a4-6a4861ebf9a7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:10.310023 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e4cdb7c2-30ff-4097-89a4-6a4861ebf9a7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1229 microversion: 2.1 time: 0.087490 Oct 05 18:08:10.315954 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2654/5542] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:10 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1229 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:10.846749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:10.848019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:10.867793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:10.870562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:10.871710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:10.874839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:10.876980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:10.879139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:11.231154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:11.243448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:11.246031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:11.247485 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-916c5cac-e3bd-4dd6-8c1a-e8c22f741047 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.413070 Oct 05 18:08:11.248568 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2889/5543] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:10 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:11.338917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d8acebce-d33c-4b55-8eb0-34578f93fa48 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:11.340170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d8acebce-d33c-4b55-8eb0-34578f93fa48 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:11.354563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8acebce-d33c-4b55-8eb0-34578f93fa48 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:11.355602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8acebce-d33c-4b55-8eb0-34578f93fa48 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:11.356355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8acebce-d33c-4b55-8eb0-34578f93fa48 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:11.357793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8acebce-d33c-4b55-8eb0-34578f93fa48 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:11.358838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8acebce-d33c-4b55-8eb0-34578f93fa48 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:11.359811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8acebce-d33c-4b55-8eb0-34578f93fa48 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:11.480666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d8acebce-d33c-4b55-8eb0-34578f93fa48 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:11.489907 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d8acebce-d33c-4b55-8eb0-34578f93fa48 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1281 microversion: 2.1 time: 0.155271 Oct 05 18:08:11.491073 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2655/5544] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:11 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1281 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:11.936474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-df3e7a9a-9888-4717-a82c-e9571f3c344d req-818c46f9-d4f3-42b0-bd96-a3d9eae13569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-plugged", "status": "completed", "tag": "3c0ca083-d78c-4982-a277-9ba89081d68a"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:11.960225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-df3e7a9a-9888-4717-a82c-e9571f3c344d req-818c46f9-d4f3-42b0-bd96-a3d9eae13569 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:11.960739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-df3e7a9a-9888-4717-a82c-e9571f3c344d req-818c46f9-d4f3-42b0-bd96-a3d9eae13569 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:11.961192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-df3e7a9a-9888-4717-a82c-e9571f3c344d req-818c46f9-d4f3-42b0-bd96-a3d9eae13569 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:11.986974 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-df3e7a9a-9888-4717-a82c-e9571f3c344d req-818c46f9-d4f3-42b0-bd96-a3d9eae13569 service nova] Creating event network-vif-plugged:3c0ca083-d78c-4982-a277-9ba89081d68a for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:08:11.994035 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-df3e7a9a-9888-4717-a82c-e9571f3c344d req-818c46f9-d4f3-42b0-bd96-a3d9eae13569 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060917 Oct 05 18:08:12.007533 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2890/5545] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:08:12.278371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:12.278904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:12.288009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:12.288499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:12.288930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:12.291238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:12.291721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:12.294238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:12.520624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf6ab434-ad44-4b0b-9514-d4159267c35e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:12.521790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bf6ab434-ad44-4b0b-9514-d4159267c35e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:12.554678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf6ab434-ad44-4b0b-9514-d4159267c35e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:12.555263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf6ab434-ad44-4b0b-9514-d4159267c35e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:12.556959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf6ab434-ad44-4b0b-9514-d4159267c35e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:12.557871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf6ab434-ad44-4b0b-9514-d4159267c35e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:12.560293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf6ab434-ad44-4b0b-9514-d4159267c35e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:12.564021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf6ab434-ad44-4b0b-9514-d4159267c35e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:12.654876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:12.668801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:12.671044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:12.673206 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bcd037e6-663c-4e54-8be3-ccb0d3b63796 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.402549 Oct 05 18:08:12.674834 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2656/5546] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:12 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:13.055127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bf6ab434-ad44-4b0b-9514-d4159267c35e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:13.070867 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf6ab434-ad44-4b0b-9514-d4159267c35e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1299 microversion: 2.1 time: 0.555324 Oct 05 18:08:13.073185 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2891/5547] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:12 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1299 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:13.703393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:13.707596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:13.719040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:13.720545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:13.721496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:13.723816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:13.724877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:13.725535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:14.065453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:14.082457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:14.086945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:14.092355 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-85e01e12-cb1c-41bf-b33d-2c57528da059 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.394059 Oct 05 18:08:14.095314 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2657/5548] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:13 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:14.103678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b6c522fe-73e0-4fe8-99d6-88834ee80a91 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:14.105994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b6c522fe-73e0-4fe8-99d6-88834ee80a91 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:14.121888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6c522fe-73e0-4fe8-99d6-88834ee80a91 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:14.122896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6c522fe-73e0-4fe8-99d6-88834ee80a91 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:14.123581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6c522fe-73e0-4fe8-99d6-88834ee80a91 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:14.124530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6c522fe-73e0-4fe8-99d6-88834ee80a91 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:14.125276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6c522fe-73e0-4fe8-99d6-88834ee80a91 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:14.126227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6c522fe-73e0-4fe8-99d6-88834ee80a91 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:14.252672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ecf91a9f-5d14-48e9-a924-ecc6b5acf54d req-bf9d079a-48e7-4aa6-8b02-117d64af3612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-plugged", "status": "completed", "tag": "9fe5e4fd-c9dd-4403-922d-1591ec931566"}, {"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-plugged", "status": "completed", "tag": "4cfe7d81-9e85-4770-a0af-df6d26210a78"}, {"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-plugged", "status": "completed", "tag": "4e60cc60-031e-46a1-8c43-08a6cacd74e1"}, {"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-plugged", "status": "completed", "tag": "a5cc2ce4-af89-4eba-aa9c-1328e1e6bf20"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:14.290316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ecf91a9f-5d14-48e9-a924-ecc6b5acf54d req-bf9d079a-48e7-4aa6-8b02-117d64af3612 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:14.291757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ecf91a9f-5d14-48e9-a924-ecc6b5acf54d req-bf9d079a-48e7-4aa6-8b02-117d64af3612 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:14.293984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ecf91a9f-5d14-48e9-a924-ecc6b5acf54d req-bf9d079a-48e7-4aa6-8b02-117d64af3612 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:14.323747 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ecf91a9f-5d14-48e9-a924-ecc6b5acf54d req-bf9d079a-48e7-4aa6-8b02-117d64af3612 service nova] Creating event network-vif-plugged:9fe5e4fd-c9dd-4403-922d-1591ec931566 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:08:14.327259 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ecf91a9f-5d14-48e9-a924-ecc6b5acf54d req-bf9d079a-48e7-4aa6-8b02-117d64af3612 service nova] Creating event network-vif-plugged:4cfe7d81-9e85-4770-a0af-df6d26210a78 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:08:14.329384 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ecf91a9f-5d14-48e9-a924-ecc6b5acf54d req-bf9d079a-48e7-4aa6-8b02-117d64af3612 service nova] Creating event network-vif-plugged:4e60cc60-031e-46a1-8c43-08a6cacd74e1 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:08:14.330359 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ecf91a9f-5d14-48e9-a924-ecc6b5acf54d req-bf9d079a-48e7-4aa6-8b02-117d64af3612 service nova] Creating event network-vif-plugged:a5cc2ce4-af89-4eba-aa9c-1328e1e6bf20 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:08:14.343559 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ecf91a9f-5d14-48e9-a924-ecc6b5acf54d req-bf9d079a-48e7-4aa6-8b02-117d64af3612 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.117985 Oct 05 18:08:14.346676 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2658/5549] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:08:14.520021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b6c522fe-73e0-4fe8-99d6-88834ee80a91 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:14.536986 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b6c522fe-73e0-4fe8-99d6-88834ee80a91 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.439436 Oct 05 18:08:14.540423 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2892/5550] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:14 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:14.866225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-9845f5c2-7ee9-421a-9224-2b0a54e5f59c req-5a450a6d-0ec2-4175-a22b-25e9c28d0a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1488bb89-d3fc-4352-8e5b-d2167376b29f", "tag": "e07e971d-862c-4f1f-8a86-06857658360b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:14.890606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9845f5c2-7ee9-421a-9224-2b0a54e5f59c req-5a450a6d-0ec2-4175-a22b-25e9c28d0a82 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:14.893664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9845f5c2-7ee9-421a-9224-2b0a54e5f59c req-5a450a6d-0ec2-4175-a22b-25e9c28d0a82 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:14.894107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9845f5c2-7ee9-421a-9224-2b0a54e5f59c req-5a450a6d-0ec2-4175-a22b-25e9c28d0a82 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:14.923768 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9845f5c2-7ee9-421a-9224-2b0a54e5f59c req-5a450a6d-0ec2-4175-a22b-25e9c28d0a82 service nova] Creating event network-changed:e07e971d-862c-4f1f-8a86-06857658360b for instance 1488bb89-d3fc-4352-8e5b-d2167376b29f on n-h2-835595-3 Oct 05 18:08:14.929103 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-9845f5c2-7ee9-421a-9224-2b0a54e5f59c req-5a450a6d-0ec2-4175-a22b-25e9c28d0a82 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071015 Oct 05 18:08:14.930194 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2659/5551] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:08:15.128134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:15.129676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:15.133851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:15.148832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:15.152159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:15.152656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:15.153424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:15.153981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:15.154421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:15.567144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-702291ca-0716-43d4-b894-72960628fe13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:15.568842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-702291ca-0716-43d4-b894-72960628fe13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:15.582759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:15.600744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702291ca-0716-43d4-b894-72960628fe13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:15.601564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702291ca-0716-43d4-b894-72960628fe13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:15.604678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702291ca-0716-43d4-b894-72960628fe13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:15.606540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702291ca-0716-43d4-b894-72960628fe13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:15.610392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702291ca-0716-43d4-b894-72960628fe13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:15.611094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702291ca-0716-43d4-b894-72960628fe13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:15.614185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:15.621360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:15.626016 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-11b894b1-d9b0-442c-a963-aeea7a9001c6 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.502421 Oct 05 18:08:15.628963 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2893/5552] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:15 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:15.861201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-702291ca-0716-43d4-b894-72960628fe13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:15.873246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-702291ca-0716-43d4-b894-72960628fe13 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.312397 Oct 05 18:08:15.875073 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2660/5553] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:15 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:16.401946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4f726ea9-a1b6-4eb3-9ee0-45260f6acb99 req-b846fc9b-0edf-4180-9762-a3664cfd9849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-plugged", "status": "completed", "tag": "edba4c90-72ee-4754-ae83-591d3bb78a74"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:16.415269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4f726ea9-a1b6-4eb3-9ee0-45260f6acb99 req-b846fc9b-0edf-4180-9762-a3664cfd9849 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:16.416265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4f726ea9-a1b6-4eb3-9ee0-45260f6acb99 req-b846fc9b-0edf-4180-9762-a3664cfd9849 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:16.416871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4f726ea9-a1b6-4eb3-9ee0-45260f6acb99 req-b846fc9b-0edf-4180-9762-a3664cfd9849 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:16.433097 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4f726ea9-a1b6-4eb3-9ee0-45260f6acb99 req-b846fc9b-0edf-4180-9762-a3664cfd9849 service nova] Creating event network-vif-plugged:edba4c90-72ee-4754-ae83-591d3bb78a74 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:08:16.439511 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4f726ea9-a1b6-4eb3-9ee0-45260f6acb99 req-b846fc9b-0edf-4180-9762-a3664cfd9849 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042914 Oct 05 18:08:16.440411 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2894/5554] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:08:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:08:16.658850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:16.659905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:16.671776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:16.672282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:16.672714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:16.673462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:16.673914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:16.674390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:16.877986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:16.890113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:16.892480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:16.893845 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-40581f15-33da-4c0c-9785-af895dd4de26 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.240420 Oct 05 18:08:16.894778 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2661/5555] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:16 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:16.899293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9dec9650-5887-46cf-b11b-99228989c1a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:16.900219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9dec9650-5887-46cf-b11b-99228989c1a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:16.911068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dec9650-5887-46cf-b11b-99228989c1a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:16.915279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dec9650-5887-46cf-b11b-99228989c1a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:16.916509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dec9650-5887-46cf-b11b-99228989c1a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:16.917457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dec9650-5887-46cf-b11b-99228989c1a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:16.918922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dec9650-5887-46cf-b11b-99228989c1a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:16.919592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9dec9650-5887-46cf-b11b-99228989c1a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:17.134272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9dec9650-5887-46cf-b11b-99228989c1a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:17.151298 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9dec9650-5887-46cf-b11b-99228989c1a5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.256151 Oct 05 18:08:17.154381 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2895/5556] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:16 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:17.927782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:17.928611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:17.942326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:17.943002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:17.943269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:17.944145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:17.944796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:17.945494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:18.181112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-db889f4a-a7c2-4b3f-af7f-20a484309d3d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:18.182351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-db889f4a-a7c2-4b3f-af7f-20a484309d3d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:18.197776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db889f4a-a7c2-4b3f-af7f-20a484309d3d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:18.198685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db889f4a-a7c2-4b3f-af7f-20a484309d3d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:18.200737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db889f4a-a7c2-4b3f-af7f-20a484309d3d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:18.201762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db889f4a-a7c2-4b3f-af7f-20a484309d3d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:18.203939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db889f4a-a7c2-4b3f-af7f-20a484309d3d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:18.206122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db889f4a-a7c2-4b3f-af7f-20a484309d3d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:18.284272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:18.338086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:18.342310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:18.345674 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa157c18-019f-4b11-8e4d-33dc915e28f2 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1875 microversion: 2.42 time: 0.425671 Oct 05 18:08:18.349122 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2662/5557] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:17 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1875 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:18.450776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-db889f4a-a7c2-4b3f-af7f-20a484309d3d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:18.465006 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-db889f4a-a7c2-4b3f-af7f-20a484309d3d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.289421 Oct 05 18:08:18.478374 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2896/5558] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:18 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:19.396688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:19.400608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:19.421165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:19.424158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:19.425111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:19.426129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:19.430334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:19.432989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:19.495163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b8c4f25-d6e6-4ed8-85e8-75a4a4d5c4a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:19.502069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6b8c4f25-d6e6-4ed8-85e8-75a4a4d5c4a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:19.512419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b8c4f25-d6e6-4ed8-85e8-75a4a4d5c4a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:19.513218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b8c4f25-d6e6-4ed8-85e8-75a4a4d5c4a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:19.518094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b8c4f25-d6e6-4ed8-85e8-75a4a4d5c4a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:19.519138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b8c4f25-d6e6-4ed8-85e8-75a4a4d5c4a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:19.522484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b8c4f25-d6e6-4ed8-85e8-75a4a4d5c4a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:19.523166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b8c4f25-d6e6-4ed8-85e8-75a4a4d5c4a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:19.734320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:19.747340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:19.749497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:19.752279 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cf91ccdd-de42-4476-8fa6-1d4ad24115a3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 2831 microversion: 2.42 time: 0.366606 Oct 05 18:08:19.762323 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2663/5559] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:08:19 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 2831 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:08:19.791159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5ea0748a-0491-4b7f-b566-ab57196d1d25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:19.792655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5ea0748a-0491-4b7f-b566-ab57196d1d25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:19.801670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea0748a-0491-4b7f-b566-ab57196d1d25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:19.802544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea0748a-0491-4b7f-b566-ab57196d1d25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:19.803229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea0748a-0491-4b7f-b566-ab57196d1d25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:19.804394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea0748a-0491-4b7f-b566-ab57196d1d25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:19.805167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea0748a-0491-4b7f-b566-ab57196d1d25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:19.805932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ea0748a-0491-4b7f-b566-ab57196d1d25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:19.813305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6b8c4f25-d6e6-4ed8-85e8-75a4a4d5c4a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:19.821511 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b8c4f25-d6e6-4ed8-85e8-75a4a4d5c4a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.330821 Oct 05 18:08:19.822098 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2897/5560] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:19 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:19.992247 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5ea0748a-0491-4b7f-b566-ab57196d1d25 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.207005 Oct 05 18:08:19.992867 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2664/5561] 10.222.0.70 () {60 vars in 1316 bytes} [Wed Oct 5 18:08:19 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c/os-interface => generated 1831 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 18:08:20.867394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c911f8e6-9b0d-4777-882d-a52d776dbf89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:20.868035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c911f8e6-9b0d-4777-882d-a52d776dbf89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:20.870248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:20.871550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:20.883919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c911f8e6-9b0d-4777-882d-a52d776dbf89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:20.884733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c911f8e6-9b0d-4777-882d-a52d776dbf89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:20.888526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c911f8e6-9b0d-4777-882d-a52d776dbf89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:20.889921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c911f8e6-9b0d-4777-882d-a52d776dbf89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:20.894004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c911f8e6-9b0d-4777-882d-a52d776dbf89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:20.895248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c911f8e6-9b0d-4777-882d-a52d776dbf89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:20.948779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:21.339932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c911f8e6-9b0d-4777-882d-a52d776dbf89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:21.352911 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c911f8e6-9b0d-4777-882d-a52d776dbf89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.489904 Oct 05 18:08:21.353945 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2898/5562] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:20 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:21.863482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:21.976597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e10d7cba-6fb8-4442-897c-93b185e4cfd2 req-ec5151da-04de-4521-b2ed-8fa4e38588ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "tag": "3c0ca083-d78c-4982-a277-9ba89081d68a"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:22.002256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e10d7cba-6fb8-4442-897c-93b185e4cfd2 req-ec5151da-04de-4521-b2ed-8fa4e38588ee service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:22.002778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e10d7cba-6fb8-4442-897c-93b185e4cfd2 req-ec5151da-04de-4521-b2ed-8fa4e38588ee service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:22.003220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e10d7cba-6fb8-4442-897c-93b185e4cfd2 req-ec5151da-04de-4521-b2ed-8fa4e38588ee service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:22.036041 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e10d7cba-6fb8-4442-897c-93b185e4cfd2 req-ec5151da-04de-4521-b2ed-8fa4e38588ee service nova] Creating event network-changed:3c0ca083-d78c-4982-a277-9ba89081d68a for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:08:22.064225 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e10d7cba-6fb8-4442-897c-93b185e4cfd2 req-ec5151da-04de-4521-b2ed-8fa4e38588ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201140 Oct 05 18:08:22.065838 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2665/5563] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:08:22.381445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3fa0c0a-3a0c-4a6f-8d06-417d2b7f2d6c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:22.382240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c3fa0c0a-3a0c-4a6f-8d06-417d2b7f2d6c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:22.394397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3fa0c0a-3a0c-4a6f-8d06-417d2b7f2d6c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:22.395609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3fa0c0a-3a0c-4a6f-8d06-417d2b7f2d6c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:22.396286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3fa0c0a-3a0c-4a6f-8d06-417d2b7f2d6c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:22.397254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3fa0c0a-3a0c-4a6f-8d06-417d2b7f2d6c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:22.397931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3fa0c0a-3a0c-4a6f-8d06-417d2b7f2d6c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:22.398617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3fa0c0a-3a0c-4a6f-8d06-417d2b7f2d6c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:22.674431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c3fa0c0a-3a0c-4a6f-8d06-417d2b7f2d6c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:22.683468 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3fa0c0a-3a0c-4a6f-8d06-417d2b7f2d6c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.306012 Oct 05 18:08:22.698404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2899/5564] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:22 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:23.708338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-830ac0b9-dce2-4b58-b289-7b0f44f9b097 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:23.709916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-830ac0b9-dce2-4b58-b289-7b0f44f9b097 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:23.717582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830ac0b9-dce2-4b58-b289-7b0f44f9b097 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:23.718087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830ac0b9-dce2-4b58-b289-7b0f44f9b097 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:23.718576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830ac0b9-dce2-4b58-b289-7b0f44f9b097 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:23.719542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830ac0b9-dce2-4b58-b289-7b0f44f9b097 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:23.720211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830ac0b9-dce2-4b58-b289-7b0f44f9b097 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:23.720643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-830ac0b9-dce2-4b58-b289-7b0f44f9b097 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:23.876726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-830ac0b9-dce2-4b58-b289-7b0f44f9b097 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:23.886930 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-830ac0b9-dce2-4b58-b289-7b0f44f9b097 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.182779 Oct 05 18:08:23.887523 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2666/5565] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:23 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:08:24.915749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ac5d4c9-199c-491d-a403-990f9e26095b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:24.916450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ac5d4c9-199c-491d-a403-990f9e26095b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:24.924647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ac5d4c9-199c-491d-a403-990f9e26095b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:24.925006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ac5d4c9-199c-491d-a403-990f9e26095b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:24.925619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ac5d4c9-199c-491d-a403-990f9e26095b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:24.926389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ac5d4c9-199c-491d-a403-990f9e26095b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:24.926862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ac5d4c9-199c-491d-a403-990f9e26095b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:24.927310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ac5d4c9-199c-491d-a403-990f9e26095b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:25.084921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ac5d4c9-199c-491d-a403-990f9e26095b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:25.093904 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ac5d4c9-199c-491d-a403-990f9e26095b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.182472 Oct 05 18:08:25.095475 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2900/5566] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:24 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:26.119562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bed0e2c5-db91-41de-a5f0-3799f88c627d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:26.120321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bed0e2c5-db91-41de-a5f0-3799f88c627d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:26.130025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bed0e2c5-db91-41de-a5f0-3799f88c627d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:26.131525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bed0e2c5-db91-41de-a5f0-3799f88c627d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:26.132163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bed0e2c5-db91-41de-a5f0-3799f88c627d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:26.133015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bed0e2c5-db91-41de-a5f0-3799f88c627d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:26.133720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bed0e2c5-db91-41de-a5f0-3799f88c627d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:26.134420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bed0e2c5-db91-41de-a5f0-3799f88c627d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:26.293971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bed0e2c5-db91-41de-a5f0-3799f88c627d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:26.309698 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bed0e2c5-db91-41de-a5f0-3799f88c627d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.195365 Oct 05 18:08:26.310461 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2667/5567] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:26 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:08:27.333324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24224405-5166-4b55-9608-a17203df07ba tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:27.333959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-24224405-5166-4b55-9608-a17203df07ba tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:27.346582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24224405-5166-4b55-9608-a17203df07ba tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:27.347155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24224405-5166-4b55-9608-a17203df07ba tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:27.347763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24224405-5166-4b55-9608-a17203df07ba tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:27.348535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24224405-5166-4b55-9608-a17203df07ba tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:27.349035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24224405-5166-4b55-9608-a17203df07ba tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:27.349467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24224405-5166-4b55-9608-a17203df07ba tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:27.524922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-24224405-5166-4b55-9608-a17203df07ba tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:27.534077 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-24224405-5166-4b55-9608-a17203df07ba tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.205131 Oct 05 18:08:27.535198 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2901/5568] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:27 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:28.558795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-105bd6aa-c585-4c31-ae93-98921bba21e2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:28.559406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-105bd6aa-c585-4c31-ae93-98921bba21e2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:28.568349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-105bd6aa-c585-4c31-ae93-98921bba21e2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:28.568981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-105bd6aa-c585-4c31-ae93-98921bba21e2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:28.569660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-105bd6aa-c585-4c31-ae93-98921bba21e2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:28.570643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-105bd6aa-c585-4c31-ae93-98921bba21e2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:28.571177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-105bd6aa-c585-4c31-ae93-98921bba21e2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:28.572803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-105bd6aa-c585-4c31-ae93-98921bba21e2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:28.735088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-105bd6aa-c585-4c31-ae93-98921bba21e2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:28.744899 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-105bd6aa-c585-4c31-ae93-98921bba21e2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.191207 Oct 05 18:08:28.746000 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2668/5569] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:28 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:08:29.770460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ede3c883-cd52-473e-98f5-d446fe218ba1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:29.772669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ede3c883-cd52-473e-98f5-d446fe218ba1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:29.782127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ede3c883-cd52-473e-98f5-d446fe218ba1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:29.784651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ede3c883-cd52-473e-98f5-d446fe218ba1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:29.785168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ede3c883-cd52-473e-98f5-d446fe218ba1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:29.786130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ede3c883-cd52-473e-98f5-d446fe218ba1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:29.786720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ede3c883-cd52-473e-98f5-d446fe218ba1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:29.787212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ede3c883-cd52-473e-98f5-d446fe218ba1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:29.969277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ede3c883-cd52-473e-98f5-d446fe218ba1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:29.981858 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ede3c883-cd52-473e-98f5-d446fe218ba1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.216791 Oct 05 18:08:29.983357 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2902/5570] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:29 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:31.084853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ee8dd61-d76d-4ec0-a261-e7639505f541 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:31.085560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ee8dd61-d76d-4ec0-a261-e7639505f541 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:31.101444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ee8dd61-d76d-4ec0-a261-e7639505f541 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:31.102648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ee8dd61-d76d-4ec0-a261-e7639505f541 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:31.104312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ee8dd61-d76d-4ec0-a261-e7639505f541 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:31.105103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ee8dd61-d76d-4ec0-a261-e7639505f541 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:31.105606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ee8dd61-d76d-4ec0-a261-e7639505f541 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:31.109060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ee8dd61-d76d-4ec0-a261-e7639505f541 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:31.135259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:31.301854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3ee8dd61-d76d-4ec0-a261-e7639505f541 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:31.316216 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ee8dd61-d76d-4ec0-a261-e7639505f541 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.313107 Oct 05 18:08:31.317551 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2669/5571] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:31 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:32.341691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a9e3036-f3c3-4cc3-860c-f7dd8f575eab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:32.343101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4a9e3036-f3c3-4cc3-860c-f7dd8f575eab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:32.351598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a9e3036-f3c3-4cc3-860c-f7dd8f575eab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:32.352107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a9e3036-f3c3-4cc3-860c-f7dd8f575eab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:32.352562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a9e3036-f3c3-4cc3-860c-f7dd8f575eab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:32.353285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a9e3036-f3c3-4cc3-860c-f7dd8f575eab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:32.353753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a9e3036-f3c3-4cc3-860c-f7dd8f575eab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:32.354192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a9e3036-f3c3-4cc3-860c-f7dd8f575eab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:32.526833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4a9e3036-f3c3-4cc3-860c-f7dd8f575eab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:32.541058 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4a9e3036-f3c3-4cc3-860c-f7dd8f575eab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1341 microversion: 2.1 time: 0.204598 Oct 05 18:08:32.541911 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2903/5572] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:32 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1341 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:33.574689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bb5457ab-b73b-487d-acb1-68e822757c90 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:33.575333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bb5457ab-b73b-487d-acb1-68e822757c90 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:33.588605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb5457ab-b73b-487d-acb1-68e822757c90 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:33.589038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb5457ab-b73b-487d-acb1-68e822757c90 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:33.589455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb5457ab-b73b-487d-acb1-68e822757c90 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:33.590162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb5457ab-b73b-487d-acb1-68e822757c90 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:33.590666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb5457ab-b73b-487d-acb1-68e822757c90 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:33.591500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bb5457ab-b73b-487d-acb1-68e822757c90 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:33.743557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bb5457ab-b73b-487d-acb1-68e822757c90 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:33.754533 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bb5457ab-b73b-487d-acb1-68e822757c90 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1375 microversion: 2.1 time: 0.184339 Oct 05 18:08:33.755807 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2670/5573] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:33 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:34.789669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c39f947-4d74-4549-931b-38fd45243c7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:34.790441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6c39f947-4d74-4549-931b-38fd45243c7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:34.801370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c39f947-4d74-4549-931b-38fd45243c7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:34.801908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c39f947-4d74-4549-931b-38fd45243c7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:34.802393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c39f947-4d74-4549-931b-38fd45243c7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:34.803330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c39f947-4d74-4549-931b-38fd45243c7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:34.803785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c39f947-4d74-4549-931b-38fd45243c7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:34.804229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c39f947-4d74-4549-931b-38fd45243c7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:34.992186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6c39f947-4d74-4549-931b-38fd45243c7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:35.003491 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6c39f947-4d74-4549-931b-38fd45243c7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1375 microversion: 2.1 time: 0.218109 Oct 05 18:08:35.005010 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2904/5574] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:34 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1375 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:36.032536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8a21e740-4b22-4452-8453-37b88121a6da tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:36.034309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8a21e740-4b22-4452-8453-37b88121a6da tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:36.042624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a21e740-4b22-4452-8453-37b88121a6da tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:36.043116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a21e740-4b22-4452-8453-37b88121a6da tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:36.043550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a21e740-4b22-4452-8453-37b88121a6da tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:36.044339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a21e740-4b22-4452-8453-37b88121a6da tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:36.045098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a21e740-4b22-4452-8453-37b88121a6da tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:36.045589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8a21e740-4b22-4452-8453-37b88121a6da tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:36.224234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8a21e740-4b22-4452-8453-37b88121a6da tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:36.233022 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8a21e740-4b22-4452-8453-37b88121a6da tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1375 microversion: 2.1 time: 0.205608 Oct 05 18:08:36.233611 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2671/5575] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:36 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1375 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:37.259249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4ec19521-26e9-4112-b96c-15d2449ee235 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:37.260022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4ec19521-26e9-4112-b96c-15d2449ee235 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:37.270705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ec19521-26e9-4112-b96c-15d2449ee235 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:37.271762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ec19521-26e9-4112-b96c-15d2449ee235 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:37.273041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ec19521-26e9-4112-b96c-15d2449ee235 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:37.273982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ec19521-26e9-4112-b96c-15d2449ee235 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:37.274777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ec19521-26e9-4112-b96c-15d2449ee235 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:37.275466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ec19521-26e9-4112-b96c-15d2449ee235 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:37.442147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4ec19521-26e9-4112-b96c-15d2449ee235 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:37.452035 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4ec19521-26e9-4112-b96c-15d2449ee235 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1375 microversion: 2.1 time: 0.198595 Oct 05 18:08:37.453300 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2905/5576] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:37 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:38.475398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0cb4be07-3953-4e43-9200-2d54e6cffb5a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:38.476337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0cb4be07-3953-4e43-9200-2d54e6cffb5a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:38.486084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb4be07-3953-4e43-9200-2d54e6cffb5a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:38.486640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb4be07-3953-4e43-9200-2d54e6cffb5a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:38.487278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb4be07-3953-4e43-9200-2d54e6cffb5a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:38.488115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb4be07-3953-4e43-9200-2d54e6cffb5a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:38.488758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb4be07-3953-4e43-9200-2d54e6cffb5a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:38.489178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb4be07-3953-4e43-9200-2d54e6cffb5a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:38.689849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0cb4be07-3953-4e43-9200-2d54e6cffb5a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:38.700007 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0cb4be07-3953-4e43-9200-2d54e6cffb5a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1375 microversion: 2.1 time: 0.228858 Oct 05 18:08:38.700709 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2672/5577] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:38 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1375 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:39.725845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c22ee3e9-8181-4dab-a832-f69521fbda7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:39.726741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c22ee3e9-8181-4dab-a832-f69521fbda7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:39.736148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22ee3e9-8181-4dab-a832-f69521fbda7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:39.737010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22ee3e9-8181-4dab-a832-f69521fbda7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:39.737607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22ee3e9-8181-4dab-a832-f69521fbda7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:39.738622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22ee3e9-8181-4dab-a832-f69521fbda7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:39.739376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22ee3e9-8181-4dab-a832-f69521fbda7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:39.739982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c22ee3e9-8181-4dab-a832-f69521fbda7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:39.937934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c22ee3e9-8181-4dab-a832-f69521fbda7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:39.949263 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c22ee3e9-8181-4dab-a832-f69521fbda7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1375 microversion: 2.1 time: 0.228468 Oct 05 18:08:39.950060 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2906/5578] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:39 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1375 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:40.974438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2de9e7d8-8e77-4adc-ab1d-7db0f6dd4eb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:40.975091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2de9e7d8-8e77-4adc-ab1d-7db0f6dd4eb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:40.978915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=42 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:40.984827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de9e7d8-8e77-4adc-ab1d-7db0f6dd4eb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:40.985615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de9e7d8-8e77-4adc-ab1d-7db0f6dd4eb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:40.986120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de9e7d8-8e77-4adc-ab1d-7db0f6dd4eb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:40.986819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de9e7d8-8e77-4adc-ab1d-7db0f6dd4eb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:40.987257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de9e7d8-8e77-4adc-ab1d-7db0f6dd4eb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:40.987706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de9e7d8-8e77-4adc-ab1d-7db0f6dd4eb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:41.148262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2de9e7d8-8e77-4adc-ab1d-7db0f6dd4eb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:41.156734 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2de9e7d8-8e77-4adc-ab1d-7db0f6dd4eb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1375 microversion: 2.1 time: 0.186496 Oct 05 18:08:41.157500 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2673/5579] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:40 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:42.182713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12c96fc4-3889-42a2-ae21-bc094ba09178 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:42.192496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12c96fc4-3889-42a2-ae21-bc094ba09178 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:42.203516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c96fc4-3889-42a2-ae21-bc094ba09178 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:42.204440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c96fc4-3889-42a2-ae21-bc094ba09178 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:42.205095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c96fc4-3889-42a2-ae21-bc094ba09178 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:42.206092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c96fc4-3889-42a2-ae21-bc094ba09178 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:42.206691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c96fc4-3889-42a2-ae21-bc094ba09178 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:42.207415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12c96fc4-3889-42a2-ae21-bc094ba09178 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:42.366983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-12c96fc4-3889-42a2-ae21-bc094ba09178 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:42.377798 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12c96fc4-3889-42a2-ae21-bc094ba09178 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1375 microversion: 2.1 time: 0.200227 Oct 05 18:08:42.378467 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2907/5580] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:42 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1375 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:43.405941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d09980a0-b924-4244-922d-ce985ae4cd24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:43.406585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d09980a0-b924-4244-922d-ce985ae4cd24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:43.420307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d09980a0-b924-4244-922d-ce985ae4cd24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:43.420944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d09980a0-b924-4244-922d-ce985ae4cd24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:43.421443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d09980a0-b924-4244-922d-ce985ae4cd24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:43.422221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d09980a0-b924-4244-922d-ce985ae4cd24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:43.422873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d09980a0-b924-4244-922d-ce985ae4cd24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:43.423397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d09980a0-b924-4244-922d-ce985ae4cd24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:43.594460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d09980a0-b924-4244-922d-ce985ae4cd24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:43.603497 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d09980a0-b924-4244-922d-ce985ae4cd24 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1375 microversion: 2.1 time: 0.202044 Oct 05 18:08:43.604728 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2674/5581] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:43 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1375 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:44.012820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a8d5e7c7-f74a-40b3-8b3b-7337892b9b44 req-04e64d50-cc2a-40ff-bad8-7694130ace03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1488bb89-d3fc-4352-8e5b-d2167376b29f", "name": "network-vif-plugged", "status": "completed", "tag": "e07e971d-862c-4f1f-8a86-06857658360b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:44.026615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a8d5e7c7-f74a-40b3-8b3b-7337892b9b44 req-04e64d50-cc2a-40ff-bad8-7694130ace03 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:44.027374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a8d5e7c7-f74a-40b3-8b3b-7337892b9b44 req-04e64d50-cc2a-40ff-bad8-7694130ace03 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:44.028091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a8d5e7c7-f74a-40b3-8b3b-7337892b9b44 req-04e64d50-cc2a-40ff-bad8-7694130ace03 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:44.044262 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a8d5e7c7-f74a-40b3-8b3b-7337892b9b44 req-04e64d50-cc2a-40ff-bad8-7694130ace03 service nova] Creating event network-vif-plugged:e07e971d-862c-4f1f-8a86-06857658360b for instance 1488bb89-d3fc-4352-8e5b-d2167376b29f on n-h2-835595-3 Oct 05 18:08:44.049871 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a8d5e7c7-f74a-40b3-8b3b-7337892b9b44 req-04e64d50-cc2a-40ff-bad8-7694130ace03 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172014 Oct 05 18:08:44.050709 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2908/5582] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:08:44.632254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c93b7dd6-98fa-4268-8a68-50180718df04 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:44.633666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c93b7dd6-98fa-4268-8a68-50180718df04 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:44.640991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c93b7dd6-98fa-4268-8a68-50180718df04 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:44.642040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c93b7dd6-98fa-4268-8a68-50180718df04 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:44.642654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c93b7dd6-98fa-4268-8a68-50180718df04 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:44.643993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c93b7dd6-98fa-4268-8a68-50180718df04 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:44.644211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c93b7dd6-98fa-4268-8a68-50180718df04 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:44.644910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c93b7dd6-98fa-4268-8a68-50180718df04 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:44.838049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c93b7dd6-98fa-4268-8a68-50180718df04 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:44.849636 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c93b7dd6-98fa-4268-8a68-50180718df04 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1375 microversion: 2.1 time: 0.224165 Oct 05 18:08:44.850575 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2675/5583] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:44 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1375 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:45.878892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c8b3277-e20d-4f77-ae8b-d9f9e3d442ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:45.879616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c8b3277-e20d-4f77-ae8b-d9f9e3d442ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:45.881615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=32 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:45.887079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c8b3277-e20d-4f77-ae8b-d9f9e3d442ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:45.887502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c8b3277-e20d-4f77-ae8b-d9f9e3d442ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:45.887934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c8b3277-e20d-4f77-ae8b-d9f9e3d442ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:45.888678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c8b3277-e20d-4f77-ae8b-d9f9e3d442ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:45.889146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c8b3277-e20d-4f77-ae8b-d9f9e3d442ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:45.889584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c8b3277-e20d-4f77-ae8b-d9f9e3d442ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:46.044988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9c8b3277-e20d-4f77-ae8b-d9f9e3d442ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:46.055166 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c8b3277-e20d-4f77-ae8b-d9f9e3d442ec tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1561 microversion: 2.1 time: 0.181711 Oct 05 18:08:46.055755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2909/5584] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:45 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:46.093371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b19b257-7420-41aa-9ba9-dcaa580a72f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:46.093973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b19b257-7420-41aa-9ba9-dcaa580a72f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:46.101525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b19b257-7420-41aa-9ba9-dcaa580a72f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:46.102147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b19b257-7420-41aa-9ba9-dcaa580a72f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:46.102595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b19b257-7420-41aa-9ba9-dcaa580a72f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:46.103296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b19b257-7420-41aa-9ba9-dcaa580a72f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:46.103771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b19b257-7420-41aa-9ba9-dcaa580a72f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:46.104285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b19b257-7420-41aa-9ba9-dcaa580a72f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:46.251827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8b19b257-7420-41aa-9ba9-dcaa580a72f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:46.261730 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b19b257-7420-41aa-9ba9-dcaa580a72f5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1561 microversion: 2.1 time: 0.185831 Oct 05 18:08:46.262511 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2676/5585] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:46 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:46.367315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c1065a3-777b-45c9-9112-3ec4a0bdcd28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:46.367834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c1065a3-777b-45c9-9112-3ec4a0bdcd28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:46.374403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1065a3-777b-45c9-9112-3ec4a0bdcd28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:46.374910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1065a3-777b-45c9-9112-3ec4a0bdcd28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:46.375369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1065a3-777b-45c9-9112-3ec4a0bdcd28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:46.376446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1065a3-777b-45c9-9112-3ec4a0bdcd28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:46.376913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1065a3-777b-45c9-9112-3ec4a0bdcd28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:46.377352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c1065a3-777b-45c9-9112-3ec4a0bdcd28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:46.404516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c1065a3-777b-45c9-9112-3ec4a0bdcd28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:08:46.489085 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0c1065a3-777b-45c9-9112-3ec4a0bdcd28 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 204 len: 0 microversion: 2.1 time: 0.125003 Oct 05 18:08:46.490079 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2910/5586] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:08:46 2022] DELETE /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:08:46.498984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2dce86f9-1bd9-4b2d-99a2-bc78c11e0124 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:46.499500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2dce86f9-1bd9-4b2d-99a2-bc78c11e0124 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:46.506069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dce86f9-1bd9-4b2d-99a2-bc78c11e0124 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:46.506597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dce86f9-1bd9-4b2d-99a2-bc78c11e0124 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:46.507272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dce86f9-1bd9-4b2d-99a2-bc78c11e0124 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:46.507987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dce86f9-1bd9-4b2d-99a2-bc78c11e0124 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:46.508431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dce86f9-1bd9-4b2d-99a2-bc78c11e0124 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:46.508849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2dce86f9-1bd9-4b2d-99a2-bc78c11e0124 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:46.655344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2dce86f9-1bd9-4b2d-99a2-bc78c11e0124 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:46.666099 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2dce86f9-1bd9-4b2d-99a2-bc78c11e0124 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1567 microversion: 2.1 time: 0.171324 Oct 05 18:08:46.666728 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2677/5587] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:46 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:47.692016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7519c9f8-1756-4742-9e31-8e680c700f45 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:47.692834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7519c9f8-1756-4742-9e31-8e680c700f45 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:47.701731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7519c9f8-1756-4742-9e31-8e680c700f45 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:47.702370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7519c9f8-1756-4742-9e31-8e680c700f45 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:47.702928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7519c9f8-1756-4742-9e31-8e680c700f45 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:47.703704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7519c9f8-1756-4742-9e31-8e680c700f45 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:47.704162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7519c9f8-1756-4742-9e31-8e680c700f45 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:47.704605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7519c9f8-1756-4742-9e31-8e680c700f45 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:47.888055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7519c9f8-1756-4742-9e31-8e680c700f45 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:47.896573 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7519c9f8-1756-4742-9e31-8e680c700f45 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1567 microversion: 2.1 time: 0.209207 Oct 05 18:08:47.897159 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2911/5588] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:47 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1567 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:48.669316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-981cc735-f7d0-442a-b703-cf8262449fd0 req-b5d2536e-3768-4cba-90ea-993a4d3b983c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1488bb89-d3fc-4352-8e5b-d2167376b29f", "name": "network-vif-deleted", "tag": "e07e971d-862c-4f1f-8a86-06857658360b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:48.683842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-981cc735-f7d0-442a-b703-cf8262449fd0 req-b5d2536e-3768-4cba-90ea-993a4d3b983c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:48.684638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-981cc735-f7d0-442a-b703-cf8262449fd0 req-b5d2536e-3768-4cba-90ea-993a4d3b983c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:48.685245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-981cc735-f7d0-442a-b703-cf8262449fd0 req-b5d2536e-3768-4cba-90ea-993a4d3b983c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:48.698675 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-981cc735-f7d0-442a-b703-cf8262449fd0 req-b5d2536e-3768-4cba-90ea-993a4d3b983c service nova] Creating event network-vif-deleted:e07e971d-862c-4f1f-8a86-06857658360b for instance 1488bb89-d3fc-4352-8e5b-d2167376b29f on n-h2-835595-3 Oct 05 18:08:48.705476 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-981cc735-f7d0-442a-b703-cf8262449fd0 req-b5d2536e-3768-4cba-90ea-993a4d3b983c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040858 Oct 05 18:08:48.707134 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2678/5589] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:08:48.923745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c93ff2ca-1733-4dff-b1c6-4e2bf758b6fd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:48.924983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c93ff2ca-1733-4dff-b1c6-4e2bf758b6fd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:48.932360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c93ff2ca-1733-4dff-b1c6-4e2bf758b6fd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:48.933137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c93ff2ca-1733-4dff-b1c6-4e2bf758b6fd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:48.933649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c93ff2ca-1733-4dff-b1c6-4e2bf758b6fd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:48.934467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c93ff2ca-1733-4dff-b1c6-4e2bf758b6fd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:48.935001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c93ff2ca-1733-4dff-b1c6-4e2bf758b6fd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:48.935503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c93ff2ca-1733-4dff-b1c6-4e2bf758b6fd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:49.007356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c93ff2ca-1733-4dff-b1c6-4e2bf758b6fd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:49.016025 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c93ff2ca-1733-4dff-b1c6-4e2bf758b6fd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1360 microversion: 2.1 time: 0.096288 Oct 05 18:08:49.016718 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2912/5590] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:48 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1360 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:50.041982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4eb1048e-63dc-46bd-b352-98dc3de069e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:50.042828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4eb1048e-63dc-46bd-b352-98dc3de069e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:50.052100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb1048e-63dc-46bd-b352-98dc3de069e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:50.052589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb1048e-63dc-46bd-b352-98dc3de069e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:50.053019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb1048e-63dc-46bd-b352-98dc3de069e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:50.054064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb1048e-63dc-46bd-b352-98dc3de069e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:50.054630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb1048e-63dc-46bd-b352-98dc3de069e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:50.055193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4eb1048e-63dc-46bd-b352-98dc3de069e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:50.137504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4eb1048e-63dc-46bd-b352-98dc3de069e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:50.146467 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4eb1048e-63dc-46bd-b352-98dc3de069e8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1360 microversion: 2.1 time: 0.111072 Oct 05 18:08:50.147471 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2679/5591] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:50 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1360 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:51.173852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5de8be66-0574-4053-9abc-bcb894d4401b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:51.175274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5de8be66-0574-4053-9abc-bcb894d4401b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:51.185285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5de8be66-0574-4053-9abc-bcb894d4401b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:51.186454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5de8be66-0574-4053-9abc-bcb894d4401b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:51.194623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5de8be66-0574-4053-9abc-bcb894d4401b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:51.196424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5de8be66-0574-4053-9abc-bcb894d4401b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:51.197510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5de8be66-0574-4053-9abc-bcb894d4401b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:51.198268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5de8be66-0574-4053-9abc-bcb894d4401b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:51.205244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:08:51.306533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5de8be66-0574-4053-9abc-bcb894d4401b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:51.316605 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5de8be66-0574-4053-9abc-bcb894d4401b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1360 microversion: 2.1 time: 0.147772 Oct 05 18:08:51.326388 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2913/5592] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:51 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:52.341079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1bbc2f33-46e5-482e-9db1-60eae74bbb2d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:52.341694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1bbc2f33-46e5-482e-9db1-60eae74bbb2d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:52.349198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bbc2f33-46e5-482e-9db1-60eae74bbb2d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:52.349713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bbc2f33-46e5-482e-9db1-60eae74bbb2d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:52.350217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bbc2f33-46e5-482e-9db1-60eae74bbb2d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:52.351099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bbc2f33-46e5-482e-9db1-60eae74bbb2d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:52.351584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bbc2f33-46e5-482e-9db1-60eae74bbb2d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:52.352014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1bbc2f33-46e5-482e-9db1-60eae74bbb2d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:52.435575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1bbc2f33-46e5-482e-9db1-60eae74bbb2d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:52.444422 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1bbc2f33-46e5-482e-9db1-60eae74bbb2d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1360 microversion: 2.1 time: 0.107724 Oct 05 18:08:52.445008 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2680/5593] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:52 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1360 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:53.468669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25986421-156f-45e2-b1e0-60e9fc5748f7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:53.469624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25986421-156f-45e2-b1e0-60e9fc5748f7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:53.478138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25986421-156f-45e2-b1e0-60e9fc5748f7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:53.478956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25986421-156f-45e2-b1e0-60e9fc5748f7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:53.479549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25986421-156f-45e2-b1e0-60e9fc5748f7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:53.480502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25986421-156f-45e2-b1e0-60e9fc5748f7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:53.481406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25986421-156f-45e2-b1e0-60e9fc5748f7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:53.481988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25986421-156f-45e2-b1e0-60e9fc5748f7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:53.561939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25986421-156f-45e2-b1e0-60e9fc5748f7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:53.572935 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25986421-156f-45e2-b1e0-60e9fc5748f7 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1360 microversion: 2.1 time: 0.109324 Oct 05 18:08:53.574597 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2914/5594] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:53 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1360 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:54.598504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d0442488-a173-4b49-9158-e249cb593ace tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:54.599258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d0442488-a173-4b49-9158-e249cb593ace tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:54.612770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0442488-a173-4b49-9158-e249cb593ace tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:54.613399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0442488-a173-4b49-9158-e249cb593ace tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:54.613952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0442488-a173-4b49-9158-e249cb593ace tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:54.616083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0442488-a173-4b49-9158-e249cb593ace tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:54.616647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0442488-a173-4b49-9158-e249cb593ace tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:54.618361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0442488-a173-4b49-9158-e249cb593ace tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:54.767207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d0442488-a173-4b49-9158-e249cb593ace tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:54.778339 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d0442488-a173-4b49-9158-e249cb593ace tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 200 len: 1360 microversion: 2.1 time: 0.183810 Oct 05 18:08:54.779790 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2681/5595] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:54 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 1360 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:08:55.826266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:55.827132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:55.834817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:55.835329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:55.835782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:55.836632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:55.837117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:55.837559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:55.851711 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f HTTP/1.1 Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '1488bb89-d3fc-4352-8e5b-d2167376b29f'} Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:08:55.853519 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:08:55.857462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:08:55.857462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:08:55.857462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:08:55.857462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:08:55.857462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:08:55.857462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:08:55.857462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:08:55.857462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:08:55.857462 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-68d3e41a-3d78-4f33-9504-3678d6c7edf4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 404 len: 111 microversion: 2.1 time: 0.033140 Oct 05 18:08:55.859304 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2915/5596] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:55 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:08:57.541682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-931c8af3-1df7-4d81-9dcf-837bb9579a17 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Action: 'create', calling method: .version_select at 0x7f77740bedc0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-188875906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWcaVek4KTA0Glk9Dr4Bn5DR+BE6WMOtmZDiyT4j2CNXGefxRp1eTxXrLdvvH9CYsixQE/+wVJjgbEn2+OgNtTQeJb6F38QGznshaLHaQO0rbacSAmG9OrUu2Rgl//GwA=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:57.558938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-931c8af3-1df7-4d81-9dcf-837bb9579a17 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Getting quotas for project 096a20a8118446e6bab089009b892f11. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:08:57.564960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-931c8af3-1df7-4d81-9dcf-837bb9579a17 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Getting quotas for user 6796ebfd63f842a9a1f3e0e98087cdd9 and project 096a20a8118446e6bab089009b892f11. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:08:57.591976 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-931c8af3-1df7-4d81-9dcf-837bb9579a17 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.054234 Oct 05 18:08:57.592680 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2682/5597] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:08:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:08:58.744405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1883292855", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0a3bbfee-29ac-4cfd-9960-c582b31b2664", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-188875906", "security_groups": [{"name": "tempest-secgroup-smoke-1332968963"}], "networks": [{"uuid": "8cc24d17-c904-4063-b180-bf3d6afca87b"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:08:58.877151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] validate_networks() for [('8cc24d17-c904-4063-b180-bf3d6afca87b', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:08:59.324064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:08:59.324498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:08:59.325016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:08:59.325436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:08:59.325860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:08:59.346222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:59.346998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:59.347788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:59.348692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:08:59.349268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:08:59.349807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:08:59.369209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Getting quotas for project 096a20a8118446e6bab089009b892f11. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:08:59.375659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Getting quotas for user 6796ebfd63f842a9a1f3e0e98087cdd9 and project 096a20a8118446e6bab089009b892f11. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:08:59.441378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:08:59.443796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0a3bbfee-29ac-4cfd-9960-c582b31b2664',volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:08:59.599131 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27d29ffd-440c-431f-b1af-fa003a40155d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.859183 Oct 05 18:08:59.600177 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2916/5598] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:08:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:08:59.611546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2449f89c-6224-419d-aec5-fbe39d18d398 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:08:59.612999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2449f89c-6224-419d-aec5-fbe39d18d398 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:08:59.675272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2449f89c-6224-419d-aec5-fbe39d18d398 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:08:59.684384 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2449f89c-6224-419d-aec5-fbe39d18d398 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1098 microversion: 2.1 time: 0.076847 Oct 05 18:08:59.685561 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2683/5599] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:08:59 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1098 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:00.708734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e0042356-7c9a-43b8-93ba-482b86e72154 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:00.709948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e0042356-7c9a-43b8-93ba-482b86e72154 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:00.716523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0042356-7c9a-43b8-93ba-482b86e72154 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:00.717183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0042356-7c9a-43b8-93ba-482b86e72154 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:00.717640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0042356-7c9a-43b8-93ba-482b86e72154 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:00.718470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0042356-7c9a-43b8-93ba-482b86e72154 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:00.718949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0042356-7c9a-43b8-93ba-482b86e72154 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:00.719416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0042356-7c9a-43b8-93ba-482b86e72154 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:00.785946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e0042356-7c9a-43b8-93ba-482b86e72154 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:00.794826 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e0042356-7c9a-43b8-93ba-482b86e72154 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1196 microversion: 2.1 time: 0.090774 Oct 05 18:09:00.808581 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2917/5600] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:00 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1196 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:01.818638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc53ba3a-1a3a-4770-8b82-31c1d5d75195 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:01.819831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cc53ba3a-1a3a-4770-8b82-31c1d5d75195 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:01.832732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc53ba3a-1a3a-4770-8b82-31c1d5d75195 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:01.833460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc53ba3a-1a3a-4770-8b82-31c1d5d75195 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:01.834072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc53ba3a-1a3a-4770-8b82-31c1d5d75195 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:01.835012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc53ba3a-1a3a-4770-8b82-31c1d5d75195 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:01.835761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc53ba3a-1a3a-4770-8b82-31c1d5d75195 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:01.836343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc53ba3a-1a3a-4770-8b82-31c1d5d75195 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:01.860704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=72 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:01.927844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cc53ba3a-1a3a-4770-8b82-31c1d5d75195 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:01.936572 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cc53ba3a-1a3a-4770-8b82-31c1d5d75195 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1214 microversion: 2.1 time: 0.121846 Oct 05 18:09:01.950841 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2684/5601] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:01 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1214 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:02.387779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-606d01aa-3b85-4125-99c5-9be73a6664a3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:02.389071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-606d01aa-3b85-4125-99c5-9be73a6664a3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:02.398941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-606d01aa-3b85-4125-99c5-9be73a6664a3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:02.399914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-606d01aa-3b85-4125-99c5-9be73a6664a3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:02.400531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-606d01aa-3b85-4125-99c5-9be73a6664a3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:02.402034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-606d01aa-3b85-4125-99c5-9be73a6664a3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:02.402993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-606d01aa-3b85-4125-99c5-9be73a6664a3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:02.403587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-606d01aa-3b85-4125-99c5-9be73a6664a3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:02.432729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-606d01aa-3b85-4125-99c5-9be73a6664a3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:09:02.558812 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-606d01aa-3b85-4125-99c5-9be73a6664a3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 204 len: 0 microversion: 2.1 time: 0.172100 Oct 05 18:09:02.560323 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2918/5602] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:09:02 2022] DELETE /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:09:02.569160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-98fc75bd-e93c-4305-8347-9664ed43a10e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:02.569811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-98fc75bd-e93c-4305-8347-9664ed43a10e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:02.580180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98fc75bd-e93c-4305-8347-9664ed43a10e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:02.580712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98fc75bd-e93c-4305-8347-9664ed43a10e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:02.581173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98fc75bd-e93c-4305-8347-9664ed43a10e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:02.589225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98fc75bd-e93c-4305-8347-9664ed43a10e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:02.589661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98fc75bd-e93c-4305-8347-9664ed43a10e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:02.590205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98fc75bd-e93c-4305-8347-9664ed43a10e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:02.766067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-98fc75bd-e93c-4305-8347-9664ed43a10e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:02.775061 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-98fc75bd-e93c-4305-8347-9664ed43a10e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1410 microversion: 2.1 time: 0.210263 Oct 05 18:09:02.775916 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2685/5603] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:02 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1410 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:02.965361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-95b4cb87-7dd3-4883-b916-2885b85389f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:02.966555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-95b4cb87-7dd3-4883-b916-2885b85389f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:02.975590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95b4cb87-7dd3-4883-b916-2885b85389f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:02.976273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95b4cb87-7dd3-4883-b916-2885b85389f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:02.976882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95b4cb87-7dd3-4883-b916-2885b85389f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:02.977779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95b4cb87-7dd3-4883-b916-2885b85389f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:02.978552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95b4cb87-7dd3-4883-b916-2885b85389f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:02.979145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-95b4cb87-7dd3-4883-b916-2885b85389f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:03.153192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-953e53b8-d1de-4632-ad78-553f0b80a0a5 req-8fa48f3c-01ba-4b77-a4ba-d3a3dcc37010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93cc214-bdd2-4af1-a443-1df08275c6d6", "tag": "7ae24528-1620-42f0-9ddc-20f97d06d5e5"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:03.165007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-953e53b8-d1de-4632-ad78-553f0b80a0a5 req-8fa48f3c-01ba-4b77-a4ba-d3a3dcc37010 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:03.166793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-953e53b8-d1de-4632-ad78-553f0b80a0a5 req-8fa48f3c-01ba-4b77-a4ba-d3a3dcc37010 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:03.167634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-953e53b8-d1de-4632-ad78-553f0b80a0a5 req-8fa48f3c-01ba-4b77-a4ba-d3a3dcc37010 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:03.184394 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-953e53b8-d1de-4632-ad78-553f0b80a0a5 req-8fa48f3c-01ba-4b77-a4ba-d3a3dcc37010 service nova] Creating event network-changed:7ae24528-1620-42f0-9ddc-20f97d06d5e5 for instance d93cc214-bdd2-4af1-a443-1df08275c6d6 on n-h2-835595-3 Oct 05 18:09:03.191027 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-953e53b8-d1de-4632-ad78-553f0b80a0a5 req-8fa48f3c-01ba-4b77-a4ba-d3a3dcc37010 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041421 Oct 05 18:09:03.191883 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2686/5604] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:09:03.227074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-95b4cb87-7dd3-4883-b916-2885b85389f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:03.237017 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-95b4cb87-7dd3-4883-b916-2885b85389f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1282 microversion: 2.1 time: 0.276639 Oct 05 18:09:03.245247 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2919/5605] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:02 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1282 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:03.800117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-450e4e4f-19b3-4054-bf98-a139c6ded80f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:03.801058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-450e4e4f-19b3-4054-bf98-a139c6ded80f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:03.807837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-450e4e4f-19b3-4054-bf98-a139c6ded80f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:03.808864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-450e4e4f-19b3-4054-bf98-a139c6ded80f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:03.809462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-450e4e4f-19b3-4054-bf98-a139c6ded80f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:03.810327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-450e4e4f-19b3-4054-bf98-a139c6ded80f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:03.810946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-450e4e4f-19b3-4054-bf98-a139c6ded80f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:03.811699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-450e4e4f-19b3-4054-bf98-a139c6ded80f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:03.989096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-450e4e4f-19b3-4054-bf98-a139c6ded80f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:04.005413 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-450e4e4f-19b3-4054-bf98-a139c6ded80f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1410 microversion: 2.1 time: 0.208538 Oct 05 18:09:04.021725 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2687/5606] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:03 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1410 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:04.262969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac050667-b29e-4d5b-af8f-a138575eecab tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:04.264265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac050667-b29e-4d5b-af8f-a138575eecab tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:04.302884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac050667-b29e-4d5b-af8f-a138575eecab tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:04.303587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac050667-b29e-4d5b-af8f-a138575eecab tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:04.304203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac050667-b29e-4d5b-af8f-a138575eecab tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:04.305101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac050667-b29e-4d5b-af8f-a138575eecab tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:04.305725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac050667-b29e-4d5b-af8f-a138575eecab tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:04.306354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac050667-b29e-4d5b-af8f-a138575eecab tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:05.003477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ac050667-b29e-4d5b-af8f-a138575eecab tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:05.030426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-250797be-cba1-436f-82dd-d8a7a1f86409 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:05.031266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-250797be-cba1-436f-82dd-d8a7a1f86409 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:05.052358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250797be-cba1-436f-82dd-d8a7a1f86409 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:05.054232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250797be-cba1-436f-82dd-d8a7a1f86409 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:05.055049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250797be-cba1-436f-82dd-d8a7a1f86409 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:05.058421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250797be-cba1-436f-82dd-d8a7a1f86409 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:05.059051 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac050667-b29e-4d5b-af8f-a138575eecab tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1282 microversion: 2.1 time: 0.799910 Oct 05 18:09:05.059638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250797be-cba1-436f-82dd-d8a7a1f86409 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:05.070388 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2920/5607] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:04 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1282 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:05.077982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250797be-cba1-436f-82dd-d8a7a1f86409 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:05.235559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-250797be-cba1-436f-82dd-d8a7a1f86409 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:05.249860 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-250797be-cba1-436f-82dd-d8a7a1f86409 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1410 microversion: 2.1 time: 0.222132 Oct 05 18:09:05.266877 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2688/5608] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:05 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1410 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:09:05.560380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a858a20e-f893-4a50-bc17-4f62ab9bbd20 req-099bded8-b2d5-424a-961f-1049a985577d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67f47820-e5fa-4cd2-b795-f02d28940230", "name": "network-vif-deleted", "tag": "007d9e14-e4c8-4623-b8a2-d01d4029d998"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:05.570756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a858a20e-f893-4a50-bc17-4f62ab9bbd20 req-099bded8-b2d5-424a-961f-1049a985577d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:05.571259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a858a20e-f893-4a50-bc17-4f62ab9bbd20 req-099bded8-b2d5-424a-961f-1049a985577d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:05.571797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a858a20e-f893-4a50-bc17-4f62ab9bbd20 req-099bded8-b2d5-424a-961f-1049a985577d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:05.583590 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a858a20e-f893-4a50-bc17-4f62ab9bbd20 req-099bded8-b2d5-424a-961f-1049a985577d service nova] Creating event network-vif-deleted:007d9e14-e4c8-4623-b8a2-d01d4029d998 for instance 67f47820-e5fa-4cd2-b795-f02d28940230 on n-h2-835595-3 Oct 05 18:09:05.588337 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a858a20e-f893-4a50-bc17-4f62ab9bbd20 req-099bded8-b2d5-424a-961f-1049a985577d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032043 Oct 05 18:09:05.588940 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2921/5609] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:09:05.890860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:05.891824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:05.902540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:05.905068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:05.905662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:05.906662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:05.907258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:05.908957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:06.091690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f308df75-f38f-4ef1-b575-59e7ae1bcf93 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:06.092659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f308df75-f38f-4ef1-b575-59e7ae1bcf93 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:06.099947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f308df75-f38f-4ef1-b575-59e7ae1bcf93 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:06.101342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f308df75-f38f-4ef1-b575-59e7ae1bcf93 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:06.102034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f308df75-f38f-4ef1-b575-59e7ae1bcf93 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:06.103077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f308df75-f38f-4ef1-b575-59e7ae1bcf93 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:06.103829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f308df75-f38f-4ef1-b575-59e7ae1bcf93 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:06.104457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f308df75-f38f-4ef1-b575-59e7ae1bcf93 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:06.156105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:06.173542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:06.175328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:06.176594 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5f829944-b650-4025-aaf8-aad8863396dd tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 2950 microversion: 2.42 time: 0.296576 Oct 05 18:09:06.179966 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2689/5610] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:09:05 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 2950 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:09:06.208511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b6259263-4fb3-4cac-a022-8e1e9e5b230f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:06.209186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b6259263-4fb3-4cac-a022-8e1e9e5b230f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:06.216086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6259263-4fb3-4cac-a022-8e1e9e5b230f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:06.216794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6259263-4fb3-4cac-a022-8e1e9e5b230f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:06.217389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6259263-4fb3-4cac-a022-8e1e9e5b230f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:06.218246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6259263-4fb3-4cac-a022-8e1e9e5b230f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:06.218883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6259263-4fb3-4cac-a022-8e1e9e5b230f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:06.219541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6259263-4fb3-4cac-a022-8e1e9e5b230f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:06.271241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f308df75-f38f-4ef1-b575-59e7ae1bcf93 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:06.295486 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f308df75-f38f-4ef1-b575-59e7ae1bcf93 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1282 microversion: 2.1 time: 0.213295 Oct 05 18:09:06.312221 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2922/5611] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:06 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1282 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:06.329984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b3c4318b-2ba9-43dc-a18b-0617f21b4494 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:06.332029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b3c4318b-2ba9-43dc-a18b-0617f21b4494 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:06.338922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3c4318b-2ba9-43dc-a18b-0617f21b4494 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:06.339438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3c4318b-2ba9-43dc-a18b-0617f21b4494 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:06.339896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3c4318b-2ba9-43dc-a18b-0617f21b4494 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:06.340624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3c4318b-2ba9-43dc-a18b-0617f21b4494 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:06.341799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3c4318b-2ba9-43dc-a18b-0617f21b4494 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:06.342252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b3c4318b-2ba9-43dc-a18b-0617f21b4494 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:06.386549 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b6259263-4fb3-4cac-a022-8e1e9e5b230f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.182511 Oct 05 18:09:06.387196 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2690/5612] 10.222.0.70 () {60 vars in 1316 bytes} [Wed Oct 5 18:09:06 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c/os-interface => generated 1831 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:09:06.419272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b3c4318b-2ba9-43dc-a18b-0617f21b4494 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:06.427809 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b3c4318b-2ba9-43dc-a18b-0617f21b4494 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1202 microversion: 2.1 time: 0.113542 Oct 05 18:09:06.428403 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2923/5613] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:06 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1202 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:07.326733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0ea8f6a-5461-4b74-8805-ab33d45ce1f3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:07.327908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e0ea8f6a-5461-4b74-8805-ab33d45ce1f3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:07.336770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ea8f6a-5461-4b74-8805-ab33d45ce1f3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:07.337398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ea8f6a-5461-4b74-8805-ab33d45ce1f3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:07.337981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ea8f6a-5461-4b74-8805-ab33d45ce1f3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:07.338900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ea8f6a-5461-4b74-8805-ab33d45ce1f3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:07.339510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ea8f6a-5461-4b74-8805-ab33d45ce1f3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:07.340226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0ea8f6a-5461-4b74-8805-ab33d45ce1f3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:07.454421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35bfbc3d-dd8c-4c1c-9448-04063268d7ad tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:07.455654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-35bfbc3d-dd8c-4c1c-9448-04063268d7ad tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:07.465608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35bfbc3d-dd8c-4c1c-9448-04063268d7ad tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:07.466354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35bfbc3d-dd8c-4c1c-9448-04063268d7ad tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:07.467115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35bfbc3d-dd8c-4c1c-9448-04063268d7ad tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:07.468893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35bfbc3d-dd8c-4c1c-9448-04063268d7ad tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:07.469665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35bfbc3d-dd8c-4c1c-9448-04063268d7ad tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:07.476077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-35bfbc3d-dd8c-4c1c-9448-04063268d7ad tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:07.517066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e0ea8f6a-5461-4b74-8805-ab33d45ce1f3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:07.529633 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e0ea8f6a-5461-4b74-8805-ab33d45ce1f3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1282 microversion: 2.1 time: 0.206877 Oct 05 18:09:07.530501 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2691/5614] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:07 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:07.588359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-35bfbc3d-dd8c-4c1c-9448-04063268d7ad tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:07.597195 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35bfbc3d-dd8c-4c1c-9448-04063268d7ad tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1202 microversion: 2.1 time: 0.149097 Oct 05 18:09:07.597777 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2924/5615] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:07 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:09:08.553541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2bdc776-69a0-4d09-aff0-043ed18e61a5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:08.554080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d2bdc776-69a0-4d09-aff0-043ed18e61a5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:08.561169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bdc776-69a0-4d09-aff0-043ed18e61a5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:08.561887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bdc776-69a0-4d09-aff0-043ed18e61a5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:08.562311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bdc776-69a0-4d09-aff0-043ed18e61a5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:08.563128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bdc776-69a0-4d09-aff0-043ed18e61a5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:08.563585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bdc776-69a0-4d09-aff0-043ed18e61a5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:08.564010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bdc776-69a0-4d09-aff0-043ed18e61a5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:08.624463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-17fc64c8-0af7-44d2-b05f-a5c2be7665e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:08.626731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-17fc64c8-0af7-44d2-b05f-a5c2be7665e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:08.635111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc64c8-0af7-44d2-b05f-a5c2be7665e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:08.635881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc64c8-0af7-44d2-b05f-a5c2be7665e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:08.636491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc64c8-0af7-44d2-b05f-a5c2be7665e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:08.637367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc64c8-0af7-44d2-b05f-a5c2be7665e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:08.638042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc64c8-0af7-44d2-b05f-a5c2be7665e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:08.638661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc64c8-0af7-44d2-b05f-a5c2be7665e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:08.726230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-17fc64c8-0af7-44d2-b05f-a5c2be7665e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:08.736144 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-17fc64c8-0af7-44d2-b05f-a5c2be7665e9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1202 microversion: 2.1 time: 0.118262 Oct 05 18:09:08.736843 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2925/5616] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:08 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1202 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:08.741150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d2bdc776-69a0-4d09-aff0-043ed18e61a5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:08.758913 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d2bdc776-69a0-4d09-aff0-043ed18e61a5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1270 microversion: 2.1 time: 0.209358 Oct 05 18:09:08.759938 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2692/5617] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:08 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1270 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:09.761742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dd2b9f27-6f67-4b80-8a49-5e61fb8127d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:09.763067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dd2b9f27-6f67-4b80-8a49-5e61fb8127d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:09.765310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:09.766270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:09.774474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd2b9f27-6f67-4b80-8a49-5e61fb8127d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:09.775225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd2b9f27-6f67-4b80-8a49-5e61fb8127d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:09.775832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd2b9f27-6f67-4b80-8a49-5e61fb8127d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:09.776734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd2b9f27-6f67-4b80-8a49-5e61fb8127d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:09.782489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43950477-66d4-49fb-bab4-80c39b656237 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:09.783881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-43950477-66d4-49fb-bab4-80c39b656237 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:09.788882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:09.789517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd2b9f27-6f67-4b80-8a49-5e61fb8127d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:09.790226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd2b9f27-6f67-4b80-8a49-5e61fb8127d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:09.806104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43950477-66d4-49fb-bab4-80c39b656237 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:09.806984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43950477-66d4-49fb-bab4-80c39b656237 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:09.811445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43950477-66d4-49fb-bab4-80c39b656237 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:09.811445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43950477-66d4-49fb-bab4-80c39b656237 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:09.811445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43950477-66d4-49fb-bab4-80c39b656237 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:09.811445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43950477-66d4-49fb-bab4-80c39b656237 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:09.867270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd2b9f27-6f67-4b80-8a49-5e61fb8127d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:09.876572 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dd2b9f27-6f67-4b80-8a49-5e61fb8127d0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1202 microversion: 2.1 time: 0.120518 Oct 05 18:09:09.877597 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2926/5618] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:09 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1202 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:09.980931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-43950477-66d4-49fb-bab4-80c39b656237 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:09.989245 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-43950477-66d4-49fb-bab4-80c39b656237 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1270 microversion: 2.1 time: 0.210731 Oct 05 18:09:09.990148 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2693/5619] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:09 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:10.900693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ef7adecb-1d01-4154-980e-0ee5222763f9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:10.901247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ef7adecb-1d01-4154-980e-0ee5222763f9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:10.916008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7adecb-1d01-4154-980e-0ee5222763f9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:10.916519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7adecb-1d01-4154-980e-0ee5222763f9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:10.916961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7adecb-1d01-4154-980e-0ee5222763f9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:10.917942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7adecb-1d01-4154-980e-0ee5222763f9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:10.918571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7adecb-1d01-4154-980e-0ee5222763f9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:10.919149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef7adecb-1d01-4154-980e-0ee5222763f9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:10.988628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ef7adecb-1d01-4154-980e-0ee5222763f9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:10.997169 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ef7adecb-1d01-4154-980e-0ee5222763f9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1202 microversion: 2.1 time: 0.101017 Oct 05 18:09:10.997854 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2927/5620] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:10 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1202 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:11.011486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c52e9884-5d00-4ab8-a7ca-7abfadf4f686 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:11.012771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c52e9884-5d00-4ab8-a7ca-7abfadf4f686 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:11.015876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:11.021975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c52e9884-5d00-4ab8-a7ca-7abfadf4f686 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:11.022574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c52e9884-5d00-4ab8-a7ca-7abfadf4f686 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:11.023077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c52e9884-5d00-4ab8-a7ca-7abfadf4f686 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:11.023873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c52e9884-5d00-4ab8-a7ca-7abfadf4f686 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:11.024399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c52e9884-5d00-4ab8-a7ca-7abfadf4f686 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:11.024893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c52e9884-5d00-4ab8-a7ca-7abfadf4f686 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:11.165354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c52e9884-5d00-4ab8-a7ca-7abfadf4f686 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:11.173854 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c52e9884-5d00-4ab8-a7ca-7abfadf4f686 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1270 microversion: 2.1 time: 0.166135 Oct 05 18:09:11.174472 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2694/5621] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:11 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1270 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:12.024618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:12.026757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:12.040072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:12.040888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:12.042246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:12.043315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:12.043972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:12.044707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:12.131839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:12.132329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:12.133200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:12.133679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lazy-loading 'fault' on Instance uuid 67f47820-e5fa-4cd2-b795-f02d28940230 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:09:12.196874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fead0d21-93ab-4367-8a7c-c5b09cb326b1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:12.198128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fead0d21-93ab-4367-8a7c-c5b09cb326b1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:12.205578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fead0d21-93ab-4367-8a7c-c5b09cb326b1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:12.206267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fead0d21-93ab-4367-8a7c-c5b09cb326b1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:12.206948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fead0d21-93ab-4367-8a7c-c5b09cb326b1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:12.207805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fead0d21-93ab-4367-8a7c-c5b09cb326b1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:12.208401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fead0d21-93ab-4367-8a7c-c5b09cb326b1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:12.208967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fead0d21-93ab-4367-8a7c-c5b09cb326b1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:12.224057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:12.233209 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84fa0630-343b-4c6d-935f-484957c928b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 200 len: 1161 microversion: 2.1 time: 0.213471 Oct 05 18:09:12.250446 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2928/5622] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:12 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 1161 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:12.393163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fead0d21-93ab-4367-8a7c-c5b09cb326b1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:12.402723 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fead0d21-93ab-4367-8a7c-c5b09cb326b1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1270 microversion: 2.1 time: 0.209644 Oct 05 18:09:12.405135 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2695/5623] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:12 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1270 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:13.257061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:13.257647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:13.265308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:13.265815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:13.266302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:13.267090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:13.267559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:13.267996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:13.282551 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 HTTP/1.1 Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '67f47820-e5fa-4cd2-b795-f02d28940230'} Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:13.284253 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:13.288036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:13.288036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:13.288036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:13.288036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:09:13.288036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:09:13.288036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:13.288036 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:13.288036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:09:13.288036 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-77ad6644-a6f6-4185-ab8f-e1f0bcd0525a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 404 len: 111 microversion: 2.1 time: 0.032789 Oct 05 18:09:13.288036 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2929/5624] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:13 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:09:13.427316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ce9e2329-32fd-4280-b075-b4aa410c548d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:13.427922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ce9e2329-32fd-4280-b075-b4aa410c548d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:13.435513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce9e2329-32fd-4280-b075-b4aa410c548d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:13.436040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce9e2329-32fd-4280-b075-b4aa410c548d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:13.436488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce9e2329-32fd-4280-b075-b4aa410c548d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:13.437234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce9e2329-32fd-4280-b075-b4aa410c548d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:13.437691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce9e2329-32fd-4280-b075-b4aa410c548d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:13.439346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce9e2329-32fd-4280-b075-b4aa410c548d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:13.597535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ce9e2329-32fd-4280-b075-b4aa410c548d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:13.605578 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ce9e2329-32fd-4280-b075-b4aa410c548d tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1270 microversion: 2.1 time: 0.182152 Oct 05 18:09:13.606163 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2696/5625] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:13 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1270 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:09:14.629159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ee635a14-c72b-4d8b-8dd2-098a6670a9f6 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:14.630482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ee635a14-c72b-4d8b-8dd2-098a6670a9f6 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:14.637800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee635a14-c72b-4d8b-8dd2-098a6670a9f6 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:14.638542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee635a14-c72b-4d8b-8dd2-098a6670a9f6 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:14.638996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee635a14-c72b-4d8b-8dd2-098a6670a9f6 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:14.639708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee635a14-c72b-4d8b-8dd2-098a6670a9f6 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:14.640301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee635a14-c72b-4d8b-8dd2-098a6670a9f6 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:14.640771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee635a14-c72b-4d8b-8dd2-098a6670a9f6 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:14.657008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:14.788310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ee635a14-c72b-4d8b-8dd2-098a6670a9f6 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:14.796865 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ee635a14-c72b-4d8b-8dd2-098a6670a9f6 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1270 microversion: 2.1 time: 0.172154 Oct 05 18:09:14.802630 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2930/5626] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:14 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:15.444696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:15.445209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:15.452787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:15.453789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:15.454083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:15.455068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:15.455654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:15.456880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:15.473766 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f HTTP/1.1 Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '1488bb89-d3fc-4352-8e5b-d2167376b29f'} Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:09:15.475738 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:09:15.480278 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9760917e-a5d6-4f7c-97e7-291f842dac6a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 404 len: 111 microversion: 2.1 time: 0.037750 Oct 05 18:09:15.481180 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2697/5627] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:09:15 2022] DELETE /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:09:15.488320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:15.488959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 1488bb89-d3fc-4352-8e5b-d2167376b29f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:15.495206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:15.495889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:15.496346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:15.497056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:15.497532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:15.497974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:15.522079 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f HTTP/1.1 Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '1488bb89-d3fc-4352-8e5b-d2167376b29f'} Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:15.524033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:15.528473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:15.528473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:15.528473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:15.528473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:09:15.528473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:09:15.528473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. Oct 05 18:09:15.528473 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:15.528473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance 1488bb89-d3fc-4352-8e5b-d2167376b29f could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:09:15.528473 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2db54b81-e0eb-46c0-a42e-b93d5dfc7e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f" status: 404 len: 111 microversion: 2.1 time: 0.041202 Oct 05 18:09:15.529494 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2931/5628] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:15 2022] GET /compute/v2.1/servers/1488bb89-d3fc-4352-8e5b-d2167376b29f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:09:15.819806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76cd4e4d-7d67-4415-aa4f-42a993ef5602 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:15.820691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-76cd4e4d-7d67-4415-aa4f-42a993ef5602 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:15.827732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76cd4e4d-7d67-4415-aa4f-42a993ef5602 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:15.828516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76cd4e4d-7d67-4415-aa4f-42a993ef5602 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:15.829119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76cd4e4d-7d67-4415-aa4f-42a993ef5602 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:15.830153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76cd4e4d-7d67-4415-aa4f-42a993ef5602 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:15.830847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76cd4e4d-7d67-4415-aa4f-42a993ef5602 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:15.831282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76cd4e4d-7d67-4415-aa4f-42a993ef5602 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:16.001774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:16.002388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:16.005574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:16.009693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-76cd4e4d-7d67-4415-aa4f-42a993ef5602 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:16.012008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:16.012710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:16.013311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:16.019772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:16.019934 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76cd4e4d-7d67-4415-aa4f-42a993ef5602 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1270 microversion: 2.1 time: 0.203832 Oct 05 18:09:16.020288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:16.020452 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2698/5629] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:15 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1270 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:16.021133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:16.038020 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 HTTP/1.1 Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '67f47820-e5fa-4cd2-b795-f02d28940230'} Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:09:16.040139 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:09:16.043825 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-431ddd20-b019-4918-98bd-c2ad59fd5943 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 404 len: 111 microversion: 2.1 time: 0.044997 Oct 05 18:09:16.046189 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2932/5630] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:09:15 2022] DELETE /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:09:16.051671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:16.052292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 67f47820-e5fa-4cd2-b795-f02d28940230] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:16.058617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:16.059106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:16.059568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:16.060428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:16.061055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:16.061479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:16.085255 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 HTTP/1.1 Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '67f47820-e5fa-4cd2-b795-f02d28940230'} Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:16.086849 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:16.091678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:16.091678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:16.091678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:16.091678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:09:16.091678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:09:16.091678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. Oct 05 18:09:16.091678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:16.091678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance 67f47820-e5fa-4cd2-b795-f02d28940230 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:09:16.091678 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-445503cb-161c-456f-ae30-a41c3236fae6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230" status: 404 len: 111 microversion: 2.1 time: 0.040675 Oct 05 18:09:16.092559 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2699/5631] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:16 2022] GET /compute/v2.1/servers/67f47820-e5fa-4cd2-b795-f02d28940230 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:09:16.167920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c5e3799a-3ce0-4232-a743-c2d4f5480f46 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Action: 'create', calling method: .version_select at 0x7f7774d12310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1735877736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnjwz/aegzxz/YzPGdHDiJH1q2ztarngErY0ei4CKJ4W8/oY/htNZD8+51CnEEVDJWP5AUFvhVL/YAVFCVrJya2lLig5Dyh5G1TygvAVVptboLjulI2Av86FLUR1q+UhA=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:16.187038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c5e3799a-3ce0-4232-a743-c2d4f5480f46 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:09:16.192541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c5e3799a-3ce0-4232-a743-c2d4f5480f46 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for user 8a900e5bf82d462a9113d6e6461ea3a0 and project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:09:16.218459 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c5e3799a-3ce0-4232-a743-c2d4f5480f46 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.054430 Oct 05 18:09:16.219248 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2933/5632] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:09:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:09:17.043872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-527505b9-c610-4775-b000-dc76de2eb888 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:17.045174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-527505b9-c610-4775-b000-dc76de2eb888 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:17.052637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527505b9-c610-4775-b000-dc76de2eb888 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:17.053353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527505b9-c610-4775-b000-dc76de2eb888 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:17.053942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527505b9-c610-4775-b000-dc76de2eb888 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:17.054836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527505b9-c610-4775-b000-dc76de2eb888 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:17.055446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527505b9-c610-4775-b000-dc76de2eb888 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:17.056013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-527505b9-c610-4775-b000-dc76de2eb888 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:17.198200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-527505b9-c610-4775-b000-dc76de2eb888 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:17.206693 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-527505b9-c610-4775-b000-dc76de2eb888 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1270 microversion: 2.1 time: 0.167486 Oct 05 18:09:17.207278 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2700/5633] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:17 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:17.988631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f8998bc6-cf63-4339-b529-3f699271de3b req-ec46bc93-c771-470c-8f0e-83c4fc60a1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93cc214-bdd2-4af1-a443-1df08275c6d6", "name": "network-vif-plugged", "status": "completed", "tag": "7ae24528-1620-42f0-9ddc-20f97d06d5e5"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:17.999101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f8998bc6-cf63-4339-b529-3f699271de3b req-ec46bc93-c771-470c-8f0e-83c4fc60a1cc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:18.000073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f8998bc6-cf63-4339-b529-3f699271de3b req-ec46bc93-c771-470c-8f0e-83c4fc60a1cc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:18.000696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f8998bc6-cf63-4339-b529-3f699271de3b req-ec46bc93-c771-470c-8f0e-83c4fc60a1cc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:18.014884 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f8998bc6-cf63-4339-b529-3f699271de3b req-ec46bc93-c771-470c-8f0e-83c4fc60a1cc service nova] Creating event network-vif-plugged:7ae24528-1620-42f0-9ddc-20f97d06d5e5 for instance d93cc214-bdd2-4af1-a443-1df08275c6d6 on n-h2-835595-3 Oct 05 18:09:18.021613 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f8998bc6-cf63-4339-b529-3f699271de3b req-ec46bc93-c771-470c-8f0e-83c4fc60a1cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037715 Oct 05 18:09:18.022404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2934/5634] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:09:18.229230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2c481fe-f906-408a-a704-79f12485bcb3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:18.229783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2c481fe-f906-408a-a704-79f12485bcb3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:18.237246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c481fe-f906-408a-a704-79f12485bcb3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:18.237729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c481fe-f906-408a-a704-79f12485bcb3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:18.238156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c481fe-f906-408a-a704-79f12485bcb3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:18.238884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c481fe-f906-408a-a704-79f12485bcb3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:18.239325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c481fe-f906-408a-a704-79f12485bcb3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:18.239926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c481fe-f906-408a-a704-79f12485bcb3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:18.390912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2c481fe-f906-408a-a704-79f12485bcb3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:18.399212 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c2c481fe-f906-408a-a704-79f12485bcb3 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1270 microversion: 2.1 time: 0.173994 Oct 05 18:09:18.400300 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2701/5635] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:18 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:19.423329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e8ba2872-5e2d-4e7f-acb1-335e5d6442a4 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:19.424053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e8ba2872-5e2d-4e7f-acb1-335e5d6442a4 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:19.430712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8ba2872-5e2d-4e7f-acb1-335e5d6442a4 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:19.431212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8ba2872-5e2d-4e7f-acb1-335e5d6442a4 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:19.431667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8ba2872-5e2d-4e7f-acb1-335e5d6442a4 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:19.432385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8ba2872-5e2d-4e7f-acb1-335e5d6442a4 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:19.432989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8ba2872-5e2d-4e7f-acb1-335e5d6442a4 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:19.433424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8ba2872-5e2d-4e7f-acb1-335e5d6442a4 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:19.584904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e8ba2872-5e2d-4e7f-acb1-335e5d6442a4 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:19.596492 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e8ba2872-5e2d-4e7f-acb1-335e5d6442a4 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1459 microversion: 2.1 time: 0.178606 Oct 05 18:09:19.597342 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2935/5636] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:19 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1459 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:19.620934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-33404529-a5f9-4068-acb0-0cd50d5081f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:19.621606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-33404529-a5f9-4068-acb0-0cd50d5081f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:19.637159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33404529-a5f9-4068-acb0-0cd50d5081f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:19.637701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33404529-a5f9-4068-acb0-0cd50d5081f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:19.638148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33404529-a5f9-4068-acb0-0cd50d5081f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:19.639104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33404529-a5f9-4068-acb0-0cd50d5081f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:19.639563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33404529-a5f9-4068-acb0-0cd50d5081f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:19.639992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33404529-a5f9-4068-acb0-0cd50d5081f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:19.825672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-33404529-a5f9-4068-acb0-0cd50d5081f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:19.834259 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-33404529-a5f9-4068-acb0-0cd50d5081f9 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1459 microversion: 2.1 time: 0.217289 Oct 05 18:09:19.835417 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2702/5637] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:19 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1459 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:21.778243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4c9a7929-39e2-44ec-9aa4-4d58254ea891 req-86ecad52-dbce-46c3-9005-dd9a40485048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93cc214-bdd2-4af1-a443-1df08275c6d6", "tag": "7ae24528-1620-42f0-9ddc-20f97d06d5e5"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:21.790253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4c9a7929-39e2-44ec-9aa4-4d58254ea891 req-86ecad52-dbce-46c3-9005-dd9a40485048 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:21.790804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4c9a7929-39e2-44ec-9aa4-4d58254ea891 req-86ecad52-dbce-46c3-9005-dd9a40485048 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:21.791250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4c9a7929-39e2-44ec-9aa4-4d58254ea891 req-86ecad52-dbce-46c3-9005-dd9a40485048 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:21.806178 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4c9a7929-39e2-44ec-9aa4-4d58254ea891 req-86ecad52-dbce-46c3-9005-dd9a40485048 service nova] Creating event network-changed:7ae24528-1620-42f0-9ddc-20f97d06d5e5 for instance d93cc214-bdd2-4af1-a443-1df08275c6d6 on n-h2-835595-3 Oct 05 18:09:21.821074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4c9a7929-39e2-44ec-9aa4-4d58254ea891 req-86ecad52-dbce-46c3-9005-dd9a40485048 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048386 Oct 05 18:09:21.824914 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2936/5638] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:09:23.266342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-da473bd0-8bc2-49ce-8ac6-458852ca1cbf req-1014e835-9972-42ac-979e-176bd091d9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93cc214-bdd2-4af1-a443-1df08275c6d6", "tag": "7ae24528-1620-42f0-9ddc-20f97d06d5e5"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:23.282395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-da473bd0-8bc2-49ce-8ac6-458852ca1cbf req-1014e835-9972-42ac-979e-176bd091d9b2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:23.283542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-da473bd0-8bc2-49ce-8ac6-458852ca1cbf req-1014e835-9972-42ac-979e-176bd091d9b2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:23.284571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-da473bd0-8bc2-49ce-8ac6-458852ca1cbf req-1014e835-9972-42ac-979e-176bd091d9b2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:23.289138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:23.303462 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-da473bd0-8bc2-49ce-8ac6-458852ca1cbf req-1014e835-9972-42ac-979e-176bd091d9b2 service nova] Creating event network-changed:7ae24528-1620-42f0-9ddc-20f97d06d5e5 for instance d93cc214-bdd2-4af1-a443-1df08275c6d6 on n-h2-835595-3 Oct 05 18:09:23.312967 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-da473bd0-8bc2-49ce-8ac6-458852ca1cbf req-1014e835-9972-42ac-979e-176bd091d9b2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127543 Oct 05 18:09:23.318469 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2703/5639] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:09:25.331058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-531e04fe-7bf6-43bf-87b9-4421cae8c414 req-1deaf90b-9c1b-476d-832b-7681da3f7c73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93cc214-bdd2-4af1-a443-1df08275c6d6", "tag": "7ae24528-1620-42f0-9ddc-20f97d06d5e5"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:25.347712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-531e04fe-7bf6-43bf-87b9-4421cae8c414 req-1deaf90b-9c1b-476d-832b-7681da3f7c73 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:25.348307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-531e04fe-7bf6-43bf-87b9-4421cae8c414 req-1deaf90b-9c1b-476d-832b-7681da3f7c73 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:25.348819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-531e04fe-7bf6-43bf-87b9-4421cae8c414 req-1deaf90b-9c1b-476d-832b-7681da3f7c73 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:25.363749 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-531e04fe-7bf6-43bf-87b9-4421cae8c414 req-1deaf90b-9c1b-476d-832b-7681da3f7c73 service nova] Creating event network-changed:7ae24528-1620-42f0-9ddc-20f97d06d5e5 for instance d93cc214-bdd2-4af1-a443-1df08275c6d6 on n-h2-835595-3 Oct 05 18:09:25.370039 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-531e04fe-7bf6-43bf-87b9-4421cae8c414 req-1deaf90b-9c1b-476d-832b-7681da3f7c73 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043202 Oct 05 18:09:25.370992 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2937/5640] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:09:28.731946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7e1eb366-25b8-43b6-80ea-b2d6a39c04e8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:28.732620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7e1eb366-25b8-43b6-80ea-b2d6a39c04e8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:28.739447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e1eb366-25b8-43b6-80ea-b2d6a39c04e8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:28.740212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e1eb366-25b8-43b6-80ea-b2d6a39c04e8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:28.740899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e1eb366-25b8-43b6-80ea-b2d6a39c04e8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:28.741632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e1eb366-25b8-43b6-80ea-b2d6a39c04e8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:28.742089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e1eb366-25b8-43b6-80ea-b2d6a39c04e8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:28.742589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7e1eb366-25b8-43b6-80ea-b2d6a39c04e8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:28.790550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7e1eb366-25b8-43b6-80ea-b2d6a39c04e8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:09:28.922240 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7e1eb366-25b8-43b6-80ea-b2d6a39c04e8 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 204 len: 0 microversion: 2.1 time: 0.304296 Oct 05 18:09:28.930296 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2704/5641] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:09:28 2022] DELETE /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:09:28.937709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0cab268d-8c4f-420f-9f9d-3eb0a0fcd4d3 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:28.938482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0cab268d-8c4f-420f-9f9d-3eb0a0fcd4d3 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:28.940820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:28.948875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab268d-8c4f-420f-9f9d-3eb0a0fcd4d3 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:28.949387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab268d-8c4f-420f-9f9d-3eb0a0fcd4d3 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:28.950020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab268d-8c4f-420f-9f9d-3eb0a0fcd4d3 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:28.950772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab268d-8c4f-420f-9f9d-3eb0a0fcd4d3 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:28.951434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab268d-8c4f-420f-9f9d-3eb0a0fcd4d3 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:28.951874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0cab268d-8c4f-420f-9f9d-3eb0a0fcd4d3 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:29.119717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0cab268d-8c4f-420f-9f9d-3eb0a0fcd4d3 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:29.133095 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0cab268d-8c4f-420f-9f9d-3eb0a0fcd4d3 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1731 microversion: 2.1 time: 0.197783 Oct 05 18:09:29.133982 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2938/5642] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:28 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:30.161270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-77864a45-d98e-4059-8f3e-f282ed0a7c53 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:30.162085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-77864a45-d98e-4059-8f3e-f282ed0a7c53 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:30.170769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77864a45-d98e-4059-8f3e-f282ed0a7c53 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:30.171275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77864a45-d98e-4059-8f3e-f282ed0a7c53 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:30.171830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77864a45-d98e-4059-8f3e-f282ed0a7c53 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:30.172686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77864a45-d98e-4059-8f3e-f282ed0a7c53 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:30.173146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77864a45-d98e-4059-8f3e-f282ed0a7c53 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:30.173656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77864a45-d98e-4059-8f3e-f282ed0a7c53 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:30.340646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-77864a45-d98e-4059-8f3e-f282ed0a7c53 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:30.349956 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-77864a45-d98e-4059-8f3e-f282ed0a7c53 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1731 microversion: 2.1 time: 0.196211 Oct 05 18:09:30.359999 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2705/5643] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:30 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:31.386550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a3e08b87-d50f-4778-8ef6-e18dbc0ec35c tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:31.388550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a3e08b87-d50f-4778-8ef6-e18dbc0ec35c tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:31.399009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e08b87-d50f-4778-8ef6-e18dbc0ec35c tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:31.399900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e08b87-d50f-4778-8ef6-e18dbc0ec35c tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:31.400609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e08b87-d50f-4778-8ef6-e18dbc0ec35c tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:31.401574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e08b87-d50f-4778-8ef6-e18dbc0ec35c tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:31.402366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e08b87-d50f-4778-8ef6-e18dbc0ec35c tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:31.402992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a3e08b87-d50f-4778-8ef6-e18dbc0ec35c tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:31.553454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-682430aa-b715-4775-a54e-1005ba0c65c3 req-c0596ecb-74f6-45a7-98ce-0a47e6cf9af2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fdba702-9493-4ecd-b235-130e14ded381", "name": "network-vif-deleted", "tag": "d9df39d1-abfc-4113-a208-43effcd9dbfc"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:31.603641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-682430aa-b715-4775-a54e-1005ba0c65c3 req-c0596ecb-74f6-45a7-98ce-0a47e6cf9af2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:31.608979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-682430aa-b715-4775-a54e-1005ba0c65c3 req-c0596ecb-74f6-45a7-98ce-0a47e6cf9af2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:31.609787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-682430aa-b715-4775-a54e-1005ba0c65c3 req-c0596ecb-74f6-45a7-98ce-0a47e6cf9af2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:31.654809 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-682430aa-b715-4775-a54e-1005ba0c65c3 req-c0596ecb-74f6-45a7-98ce-0a47e6cf9af2 service nova] Creating event network-vif-deleted:d9df39d1-abfc-4113-a208-43effcd9dbfc for instance 0fdba702-9493-4ecd-b235-130e14ded381 on n-h1-835595-3 Oct 05 18:09:31.672729 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-682430aa-b715-4775-a54e-1005ba0c65c3 req-c0596ecb-74f6-45a7-98ce-0a47e6cf9af2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123116 Oct 05 18:09:31.673697 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2706/5644] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:09:31.675009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a3e08b87-d50f-4778-8ef6-e18dbc0ec35c tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ea967494ce48eb9d82b39d97c942b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14572c4c5fab494c83daf6f61e3c521f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:31.694617 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a3e08b87-d50f-4778-8ef6-e18dbc0ec35c tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 200 len: 1664 microversion: 2.1 time: 0.314918 Oct 05 18:09:31.696882 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2939/5645] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:31 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 1664 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:32.723794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:32.725047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:32.736724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:32.737516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:32.738112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:32.739010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:32.739614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:32.740190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:32.755926 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] HTTP exception thrown: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Request method failure captured: Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 HTTP/1.1 Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPccZZ5k53_b77BUz3pnmCjWgJvUFyzVA393zd331iue04m692wqvnAXmghRRPaJe_QuNQ94-6nejpkMK1dzdy5xZ9JQuOz2r0ExCUriY-3J8CWxTduhPeOd_PtEhsSbOxoeLoVCU3wlT_9bnKsNiTEJcGS4nScEFXHNWOs0EftvaI74 Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 14572c4c5fab494c83daf6f61e3c521f Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestServerBasicOps-1121871614 Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14572c4c5fab494c83daf6f61e3c521f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14572c4c5fab494c83daf6f61e3c521f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14572c4c5fab494c83daf6f61e3c521f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14572c4c5fab494c83daf6f61e3c521f"}]}] Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestServerBasicOps-1121871614 Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 14572c4c5fab494c83daf6f61e3c521f Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestServerBasicOps-1121871614 Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestServerBasicOps-1121871614-project Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 82ea967494ce48eb9d82b39d97c942b8 Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestServerBasicOps-1121871614-project Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '0fdba702-9493-4ecd-b235-130e14ded381'} Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:32.757957 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:32.766536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:32.766536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:32.766536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:32.766536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:09:32.766536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:09:32.766536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:32.766536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:32.766536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Returning 404 to user: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:09:32.766536 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-faca1675-9935-4eca-b0c6-56940d026297 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 404 len: 111 microversion: 2.1 time: 0.040123 Oct 05 18:09:32.766536 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2707/5646] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:32 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:09:33.307138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:33.308712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:33.317271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:33.318516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:33.318977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:33.319722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:33.320196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:33.320637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:33.337619 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] HTTP exception thrown: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Request method failure captured: Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 HTTP/1.1 Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPccZZ5k53_b77BUz3pnmCjWgJvUFyzVA393zd331iue04m692wqvnAXmghRRPaJe_QuNQ94-6nejpkMK1dzdy5xZ9JQuOz2r0ExCUriY-3J8CWxTduhPeOd_PtEhsSbOxoeLoVCU3wlT_9bnKsNiTEJcGS4nScEFXHNWOs0EftvaI74 Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 14572c4c5fab494c83daf6f61e3c521f Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestServerBasicOps-1121871614 Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14572c4c5fab494c83daf6f61e3c521f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14572c4c5fab494c83daf6f61e3c521f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14572c4c5fab494c83daf6f61e3c521f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14572c4c5fab494c83daf6f61e3c521f"}]}] Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestServerBasicOps-1121871614 Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 14572c4c5fab494c83daf6f61e3c521f Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestServerBasicOps-1121871614 Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestServerBasicOps-1121871614-project Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 82ea967494ce48eb9d82b39d97c942b8 Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestServerBasicOps-1121871614-project Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '0fdba702-9493-4ecd-b235-130e14ded381'} Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:09:33.339558 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Returning 404 to user: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2736708-a1cd-453c-8a91-1e99dd5273d4 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 404 len: 111 microversion: 2.1 time: 0.041781 Oct 05 18:09:33.343157 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2940/5647] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:09:33 2022] DELETE /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:09:33.350455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:33.351190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] [instance: 0fdba702-9493-4ecd-b235-130e14ded381] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:33.359183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:33.359732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:33.360171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:33.360873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:33.361329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:33.361904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:33.380016 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] HTTP exception thrown: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Request method failure captured: Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 HTTP/1.1 Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPccZZ5k53_b77BUz3pnmCjWgJvUFyzVA393zd331iue04m692wqvnAXmghRRPaJe_QuNQ94-6nejpkMK1dzdy5xZ9JQuOz2r0ExCUriY-3J8CWxTduhPeOd_PtEhsSbOxoeLoVCU3wlT_9bnKsNiTEJcGS4nScEFXHNWOs0EftvaI74 Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 14572c4c5fab494c83daf6f61e3c521f Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestServerBasicOps-1121871614 Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/14572c4c5fab494c83daf6f61e3c521f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14572c4c5fab494c83daf6f61e3c521f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_14572c4c5fab494c83daf6f61e3c521f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/14572c4c5fab494c83daf6f61e3c521f"}]}] Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestServerBasicOps-1121871614 Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 14572c4c5fab494c83daf6f61e3c521f Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestServerBasicOps-1121871614 Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestServerBasicOps-1121871614-project Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 82ea967494ce48eb9d82b39d97c942b8 Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestServerBasicOps-1121871614-project Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '0fdba702-9493-4ecd-b235-130e14ded381'} Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:09:33.381575 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:33.386449 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:09:33.386449 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:09:33.386449 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:09:33.386449 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:09:33.386449 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:09:33.386449 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. Oct 05 18:09:33.386449 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:09:33.386449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Returning 404 to user: Instance 0fdba702-9493-4ecd-b235-130e14ded381 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:09:33.386449 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-43429a74-3fca-4289-93b8-696277c30cd1 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381" status: 404 len: 111 microversion: 2.1 time: 0.036889 Oct 05 18:09:33.386449 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2708/5648] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:33 2022] GET /compute/v2.1/servers/0fdba702-9493-4ecd-b235-130e14ded381 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:09:33.554509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f3ce02f7-6caf-4e4e-86a7-2a14a9c66044 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] Calling method '.version_select at 0x7f777403ed30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:33.607935 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f3ce02f7-6caf-4e4e-86a7-2a14a9c66044 tempest-TestServerBasicOps-1121871614 tempest-TestServerBasicOps-1121871614-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-265410653" status: 202 len: 0 microversion: 2.1 time: 0.057576 Oct 05 18:09:33.608555 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2941/5649] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 18:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-265410653 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:09:36.067848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1565780188", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1735877736", "security_groups": [{"name": "tempest-secgroup-smoke-477833963"}], "block_device_mapping_v2": [{"uuid": "c049b219-8aae-405f-970d-16b0f74e6a78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "adb1494a-27b0-43e0-8027-66e89e0c81ad"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:36.259444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] validate_networks() for [('adb1494a-27b0-43e0-8027-66e89e0c81ad', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:09:37.337294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:09:37.338557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:09:37.339355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:09:37.340180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:09:37.340929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:09:37.365110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:37.366755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:37.367423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:37.369102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:37.369795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:37.370759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:37.399877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:09:37.405548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for user 8a900e5bf82d462a9113d6e6461ea3a0 and project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:09:37.469865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:09:37.472476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c049b219-8aae-405f-970d-16b0f74e6a78',volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:09:37.663051 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-330203fc-2cda-4dd9-9fab-e34cfaf0ad2c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.599210 Oct 05 18:09:37.670466 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2709/5650] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:09:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:09:37.677245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b583764a-5a8a-4a02-beaa-482621afb6d6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:37.679314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b583764a-5a8a-4a02-beaa-482621afb6d6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:37.810187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b583764a-5a8a-4a02-beaa-482621afb6d6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:37.820002 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b583764a-5a8a-4a02-beaa-482621afb6d6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1095 microversion: 2.1 time: 0.147842 Oct 05 18:09:37.821182 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2942/5651] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:37 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1095 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:38.842757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4bca985a-1cf1-4634-bcde-6698d4309aa5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:38.844202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4bca985a-1cf1-4634-bcde-6698d4309aa5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:38.852550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bca985a-1cf1-4634-bcde-6698d4309aa5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:38.853051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bca985a-1cf1-4634-bcde-6698d4309aa5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:38.853576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bca985a-1cf1-4634-bcde-6698d4309aa5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:38.854360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bca985a-1cf1-4634-bcde-6698d4309aa5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:38.855034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bca985a-1cf1-4634-bcde-6698d4309aa5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:38.855825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4bca985a-1cf1-4634-bcde-6698d4309aa5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:38.942820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4bca985a-1cf1-4634-bcde-6698d4309aa5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:38.962883 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4bca985a-1cf1-4634-bcde-6698d4309aa5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1193 microversion: 2.1 time: 0.124354 Oct 05 18:09:38.963467 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2710/5652] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:38 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1193 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:39.989727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7b326426-f7d6-477b-8b73-fec8977e9b21 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:39.990575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7b326426-f7d6-477b-8b73-fec8977e9b21 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:39.999558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b326426-f7d6-477b-8b73-fec8977e9b21 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:40.000436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b326426-f7d6-477b-8b73-fec8977e9b21 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:40.001041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b326426-f7d6-477b-8b73-fec8977e9b21 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:40.002414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b326426-f7d6-477b-8b73-fec8977e9b21 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:40.003182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b326426-f7d6-477b-8b73-fec8977e9b21 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:40.003776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b326426-f7d6-477b-8b73-fec8977e9b21 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:40.097513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7b326426-f7d6-477b-8b73-fec8977e9b21 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:40.109009 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7b326426-f7d6-477b-8b73-fec8977e9b21 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1211 microversion: 2.1 time: 0.125213 Oct 05 18:09:40.110613 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2943/5653] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:39 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1211 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:41.140639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-01e53526-4d07-4a37-9f2d-88784c382a55 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:41.141548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-01e53526-4d07-4a37-9f2d-88784c382a55 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:41.144788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:41.162202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01e53526-4d07-4a37-9f2d-88784c382a55 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:41.163078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01e53526-4d07-4a37-9f2d-88784c382a55 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:41.163718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01e53526-4d07-4a37-9f2d-88784c382a55 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:41.167195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01e53526-4d07-4a37-9f2d-88784c382a55 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:41.167860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01e53526-4d07-4a37-9f2d-88784c382a55 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:41.168465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01e53526-4d07-4a37-9f2d-88784c382a55 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:41.479732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-01e53526-4d07-4a37-9f2d-88784c382a55 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:41.491014 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-01e53526-4d07-4a37-9f2d-88784c382a55 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1278 microversion: 2.1 time: 0.360885 Oct 05 18:09:41.491615 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2711/5654] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:41 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1278 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:42.113033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d5a9fa65-8f08-4313-8ea2-9ce57ec7c32d req-80e0ff46-b35d-463a-8ef2-936f4a9aa7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e579606a-2e51-481b-b60f-562dbaa11b33", "tag": "3b742e56-6dfc-405f-99ec-5eebad8a5d49"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:42.187539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d5a9fa65-8f08-4313-8ea2-9ce57ec7c32d req-80e0ff46-b35d-463a-8ef2-936f4a9aa7b8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:42.188053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d5a9fa65-8f08-4313-8ea2-9ce57ec7c32d req-80e0ff46-b35d-463a-8ef2-936f4a9aa7b8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:42.188573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d5a9fa65-8f08-4313-8ea2-9ce57ec7c32d req-80e0ff46-b35d-463a-8ef2-936f4a9aa7b8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:42.228249 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d5a9fa65-8f08-4313-8ea2-9ce57ec7c32d req-80e0ff46-b35d-463a-8ef2-936f4a9aa7b8 service nova] Creating event network-changed:3b742e56-6dfc-405f-99ec-5eebad8a5d49 for instance e579606a-2e51-481b-b60f-562dbaa11b33 on n-h1-835595-3 Oct 05 18:09:42.243330 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d5a9fa65-8f08-4313-8ea2-9ce57ec7c32d req-80e0ff46-b35d-463a-8ef2-936f4a9aa7b8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135309 Oct 05 18:09:42.245143 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2944/5655] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:09:42.517118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-57572dfe-4621-481d-97ce-1df19df0b65f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:42.517726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-57572dfe-4621-481d-97ce-1df19df0b65f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:42.537320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57572dfe-4621-481d-97ce-1df19df0b65f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:42.537824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57572dfe-4621-481d-97ce-1df19df0b65f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:42.538436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57572dfe-4621-481d-97ce-1df19df0b65f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:42.539168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57572dfe-4621-481d-97ce-1df19df0b65f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:42.539636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57572dfe-4621-481d-97ce-1df19df0b65f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:42.540058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57572dfe-4621-481d-97ce-1df19df0b65f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:42.891715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-57572dfe-4621-481d-97ce-1df19df0b65f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:42.901933 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-57572dfe-4621-481d-97ce-1df19df0b65f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1278 microversion: 2.1 time: 0.388600 Oct 05 18:09:42.905813 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2712/5656] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:42 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1278 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:43.939097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd93419d-45ea-4060-8d1b-33b50f4b697a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:43.940826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fd93419d-45ea-4060-8d1b-33b50f4b697a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:43.949137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd93419d-45ea-4060-8d1b-33b50f4b697a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:43.949723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd93419d-45ea-4060-8d1b-33b50f4b697a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:43.950427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd93419d-45ea-4060-8d1b-33b50f4b697a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:43.951478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd93419d-45ea-4060-8d1b-33b50f4b697a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:43.952417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd93419d-45ea-4060-8d1b-33b50f4b697a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:43.953050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd93419d-45ea-4060-8d1b-33b50f4b697a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:44.225681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd93419d-45ea-4060-8d1b-33b50f4b697a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:44.247257 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd93419d-45ea-4060-8d1b-33b50f4b697a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1278 microversion: 2.1 time: 0.312726 Oct 05 18:09:44.251790 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2945/5657] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:43 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1278 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:45.275168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a8281f10-11a2-4dcf-b250-608322fc7648 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:45.275940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a8281f10-11a2-4dcf-b250-608322fc7648 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:45.284177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8281f10-11a2-4dcf-b250-608322fc7648 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:45.284738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8281f10-11a2-4dcf-b250-608322fc7648 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:45.285625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8281f10-11a2-4dcf-b250-608322fc7648 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:45.286524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8281f10-11a2-4dcf-b250-608322fc7648 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:45.287067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8281f10-11a2-4dcf-b250-608322fc7648 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:45.287553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8281f10-11a2-4dcf-b250-608322fc7648 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:45.467246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a8281f10-11a2-4dcf-b250-608322fc7648 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:45.477265 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a8281f10-11a2-4dcf-b250-608322fc7648 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1278 microversion: 2.1 time: 0.206569 Oct 05 18:09:45.477912 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2713/5658] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:45 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1278 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:46.507632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-83ca072e-de1a-4cb0-8300-32bf7e082ddf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:46.508350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-83ca072e-de1a-4cb0-8300-32bf7e082ddf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:46.511104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:46.516749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca072e-de1a-4cb0-8300-32bf7e082ddf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:46.517253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca072e-de1a-4cb0-8300-32bf7e082ddf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:46.517666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca072e-de1a-4cb0-8300-32bf7e082ddf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:46.518569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca072e-de1a-4cb0-8300-32bf7e082ddf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:46.519192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca072e-de1a-4cb0-8300-32bf7e082ddf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:46.519805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca072e-de1a-4cb0-8300-32bf7e082ddf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:46.523387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=48 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:46.775094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-83ca072e-de1a-4cb0-8300-32bf7e082ddf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:46.783623 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-83ca072e-de1a-4cb0-8300-32bf7e082ddf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1266 microversion: 2.1 time: 0.280046 Oct 05 18:09:46.784551 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2946/5659] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:46 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:47.829770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:47.832446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:47.843894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-629e2bcf-0ecc-4891-955e-5b43957bcaaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:47.845628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-629e2bcf-0ecc-4891-955e-5b43957bcaaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:47.867541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-629e2bcf-0ecc-4891-955e-5b43957bcaaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:47.868770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-629e2bcf-0ecc-4891-955e-5b43957bcaaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:47.869380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-629e2bcf-0ecc-4891-955e-5b43957bcaaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:47.871318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-629e2bcf-0ecc-4891-955e-5b43957bcaaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:47.871956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-629e2bcf-0ecc-4891-955e-5b43957bcaaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:47.872951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-629e2bcf-0ecc-4891-955e-5b43957bcaaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:48.190790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-629e2bcf-0ecc-4891-955e-5b43957bcaaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:48.201593 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-629e2bcf-0ecc-4891-955e-5b43957bcaaf tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1266 microversion: 2.1 time: 0.386547 Oct 05 18:09:48.202692 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2714/5660] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:47 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1266 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:49.226992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24c3600c-6026-45da-a288-539bb2e5bb19 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:49.227610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-24c3600c-6026-45da-a288-539bb2e5bb19 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:49.236425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:49.238319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24c3600c-6026-45da-a288-539bb2e5bb19 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:49.239083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24c3600c-6026-45da-a288-539bb2e5bb19 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:49.239773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24c3600c-6026-45da-a288-539bb2e5bb19 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:49.241143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24c3600c-6026-45da-a288-539bb2e5bb19 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:49.241841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24c3600c-6026-45da-a288-539bb2e5bb19 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:49.242577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24c3600c-6026-45da-a288-539bb2e5bb19 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:49.420073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-24c3600c-6026-45da-a288-539bb2e5bb19 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:49.431798 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-24c3600c-6026-45da-a288-539bb2e5bb19 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1266 microversion: 2.1 time: 0.208606 Oct 05 18:09:49.432838 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2947/5661] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:49 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:50.464553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e90e181-05df-4cde-90b3-64c743357efd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:50.466242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e90e181-05df-4cde-90b3-64c743357efd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:50.477642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e90e181-05df-4cde-90b3-64c743357efd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:50.478548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e90e181-05df-4cde-90b3-64c743357efd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:50.479229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e90e181-05df-4cde-90b3-64c743357efd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:50.480049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e90e181-05df-4cde-90b3-64c743357efd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:50.480799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e90e181-05df-4cde-90b3-64c743357efd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:50.481235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e90e181-05df-4cde-90b3-64c743357efd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:51.072662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8e90e181-05df-4cde-90b3-64c743357efd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:51.084507 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8e90e181-05df-4cde-90b3-64c743357efd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1266 microversion: 2.1 time: 0.628380 Oct 05 18:09:51.087944 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2715/5662] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:50 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1266 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:52.113471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0bf2d7eb-851f-4f81-8865-f94d9ba0dea2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:52.114246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0bf2d7eb-851f-4f81-8865-f94d9ba0dea2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:52.123505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf2d7eb-851f-4f81-8865-f94d9ba0dea2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:52.124814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf2d7eb-851f-4f81-8865-f94d9ba0dea2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:52.125507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf2d7eb-851f-4f81-8865-f94d9ba0dea2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:52.127444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf2d7eb-851f-4f81-8865-f94d9ba0dea2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:52.128315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf2d7eb-851f-4f81-8865-f94d9ba0dea2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:52.129369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0bf2d7eb-851f-4f81-8865-f94d9ba0dea2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:52.353022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0bf2d7eb-851f-4f81-8865-f94d9ba0dea2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:52.362758 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0bf2d7eb-851f-4f81-8865-f94d9ba0dea2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1266 microversion: 2.1 time: 0.253530 Oct 05 18:09:52.364119 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2948/5663] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:52 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:53.387140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4302be21-f653-4346-b79f-7794f0bc264f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:53.388631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4302be21-f653-4346-b79f-7794f0bc264f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:53.405409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4302be21-f653-4346-b79f-7794f0bc264f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:53.405938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4302be21-f653-4346-b79f-7794f0bc264f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:53.412563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4302be21-f653-4346-b79f-7794f0bc264f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:53.413761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4302be21-f653-4346-b79f-7794f0bc264f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:53.415075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4302be21-f653-4346-b79f-7794f0bc264f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:53.417200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4302be21-f653-4346-b79f-7794f0bc264f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:53.425156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:09:53.667401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4302be21-f653-4346-b79f-7794f0bc264f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:53.682602 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4302be21-f653-4346-b79f-7794f0bc264f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1266 microversion: 2.1 time: 0.299085 Oct 05 18:09:53.683537 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2716/5664] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:53 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:54.709977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8814ec8a-ac9e-4477-ad64-c02b87738d89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:54.710533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8814ec8a-ac9e-4477-ad64-c02b87738d89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:54.728854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8814ec8a-ac9e-4477-ad64-c02b87738d89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:54.729366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8814ec8a-ac9e-4477-ad64-c02b87738d89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:54.729813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8814ec8a-ac9e-4477-ad64-c02b87738d89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:54.730587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8814ec8a-ac9e-4477-ad64-c02b87738d89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:54.731055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8814ec8a-ac9e-4477-ad64-c02b87738d89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:54.731491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8814ec8a-ac9e-4477-ad64-c02b87738d89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:55.041398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8814ec8a-ac9e-4477-ad64-c02b87738d89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:55.054329 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8814ec8a-ac9e-4477-ad64-c02b87738d89 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1266 microversion: 2.1 time: 0.348972 Oct 05 18:09:55.058136 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2949/5665] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:54 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1266 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:55.151131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a8ac27c5-3ea2-468d-ac4d-7036f5862698 req-0ce519d3-35cc-498c-8ff1-73104c88cf3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e579606a-2e51-481b-b60f-562dbaa11b33", "name": "network-vif-plugged", "status": "completed", "tag": "3b742e56-6dfc-405f-99ec-5eebad8a5d49"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:55.172869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a8ac27c5-3ea2-468d-ac4d-7036f5862698 req-0ce519d3-35cc-498c-8ff1-73104c88cf3b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:55.174768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a8ac27c5-3ea2-468d-ac4d-7036f5862698 req-0ce519d3-35cc-498c-8ff1-73104c88cf3b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:55.175248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a8ac27c5-3ea2-468d-ac4d-7036f5862698 req-0ce519d3-35cc-498c-8ff1-73104c88cf3b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:55.201505 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a8ac27c5-3ea2-468d-ac4d-7036f5862698 req-0ce519d3-35cc-498c-8ff1-73104c88cf3b service nova] Creating event network-vif-plugged:3b742e56-6dfc-405f-99ec-5eebad8a5d49 for instance e579606a-2e51-481b-b60f-562dbaa11b33 on n-h1-835595-3 Oct 05 18:09:55.208604 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a8ac27c5-3ea2-468d-ac4d-7036f5862698 req-0ce519d3-35cc-498c-8ff1-73104c88cf3b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061169 Oct 05 18:09:55.209790 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2717/5666] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:09:56.081386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02eb5806-50d1-43d7-b28a-ae2fcf8fb1c9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:56.084357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02eb5806-50d1-43d7-b28a-ae2fcf8fb1c9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:56.098329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02eb5806-50d1-43d7-b28a-ae2fcf8fb1c9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:56.099145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02eb5806-50d1-43d7-b28a-ae2fcf8fb1c9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:56.100457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02eb5806-50d1-43d7-b28a-ae2fcf8fb1c9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:56.102950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02eb5806-50d1-43d7-b28a-ae2fcf8fb1c9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:56.104816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02eb5806-50d1-43d7-b28a-ae2fcf8fb1c9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:56.105476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02eb5806-50d1-43d7-b28a-ae2fcf8fb1c9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:56.473703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-02eb5806-50d1-43d7-b28a-ae2fcf8fb1c9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:56.500100 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02eb5806-50d1-43d7-b28a-ae2fcf8fb1c9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1266 microversion: 2.1 time: 0.418547 Oct 05 18:09:56.503307 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2950/5667] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:56 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1266 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:57.529689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-68a6f6ec-1e6c-4eed-8d46-88c104e89788 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:57.531156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-68a6f6ec-1e6c-4eed-8d46-88c104e89788 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:57.550681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a6f6ec-1e6c-4eed-8d46-88c104e89788 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:57.551697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a6f6ec-1e6c-4eed-8d46-88c104e89788 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:57.552366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a6f6ec-1e6c-4eed-8d46-88c104e89788 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:57.554364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a6f6ec-1e6c-4eed-8d46-88c104e89788 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:57.555239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a6f6ec-1e6c-4eed-8d46-88c104e89788 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:57.557321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68a6f6ec-1e6c-4eed-8d46-88c104e89788 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:57.806643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-68a6f6ec-1e6c-4eed-8d46-88c104e89788 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:57.815958 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-68a6f6ec-1e6c-4eed-8d46-88c104e89788 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1452 microversion: 2.1 time: 0.292478 Oct 05 18:09:57.816538 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2718/5668] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:57 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1452 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:09:57.838926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-10787563-f67d-4115-b78c-f6a9b3cecedb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:57.840211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-10787563-f67d-4115-b78c-f6a9b3cecedb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:57.849521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10787563-f67d-4115-b78c-f6a9b3cecedb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:57.850211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10787563-f67d-4115-b78c-f6a9b3cecedb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:57.850874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10787563-f67d-4115-b78c-f6a9b3cecedb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:57.851972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10787563-f67d-4115-b78c-f6a9b3cecedb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:57.852599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10787563-f67d-4115-b78c-f6a9b3cecedb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:57.853231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10787563-f67d-4115-b78c-f6a9b3cecedb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:58.027053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-10787563-f67d-4115-b78c-f6a9b3cecedb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:09:58.037504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-10787563-f67d-4115-b78c-f6a9b3cecedb tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1452 microversion: 2.1 time: 0.202400 Oct 05 18:09:58.039070 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2951/5669] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:57 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:09:58.163594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f3bbcc3f-3cf3-4310-9d3c-cb2239dfc79a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:58.165450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3bbcc3f-3cf3-4310-9d3c-cb2239dfc79a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:58.165940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3bbcc3f-3cf3-4310-9d3c-cb2239dfc79a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:58.166418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3bbcc3f-3cf3-4310-9d3c-cb2239dfc79a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:58.167952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3bbcc3f-3cf3-4310-9d3c-cb2239dfc79a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:58.168414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3bbcc3f-3cf3-4310-9d3c-cb2239dfc79a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:58.169642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3bbcc3f-3cf3-4310-9d3c-cb2239dfc79a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:58.198089 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f3bbcc3f-3cf3-4310-9d3c-cb2239dfc79a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.240646 Oct 05 18:09:58.198813 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2719/5670] 10.222.0.70 () {58 vars in 1185 bytes} [Wed Oct 5 18:09:57 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:09:58.537659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-78051125", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "availability_zone": "nova:n-h1-835595-3", "networks": [{"uuid": "1113dbe7-ff4d-4107-aac1-6a3413b5b0b2"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:09:58.678675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] validate_networks() for [('1113dbe7-ff4d-4107-aac1-6a3413b5b0b2', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:09:59.539891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:09:59.540511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:09:59.540806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:09:59.541224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:09:59.541644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:09:59.566142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:59.566820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:59.567930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:59.568937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:09:59.569413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:09:59.569913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:09:59.617406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Getting quotas for project f3e2cf9e849842bd9b3f5cb2a2ba35cd. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:09:59.645529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Getting quotas for user 1dc268bd8c65426e87f28eca9a3c14dc and project f3e2cf9e849842bd9b3f5cb2a2ba35cd. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:09:59.670834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:09:59.677951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:09:59.752459 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-915299f8-e2cf-4875-b457-424f71dc9afc tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219224 Oct 05 18:09:59.753849 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2952/5671] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:09:59.766938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d0c4d758-2ed5-4cd2-9a7c-06bde413cce9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:09:59.768187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d0c4d758-2ed5-4cd2-9a7c-06bde413cce9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:09:59.918920 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d0c4d758-2ed5-4cd2-9a7c-06bde413cce9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1327 microversion: 2.1 time: 0.154936 Oct 05 18:09:59.921501 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2720/5672] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:09:59 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:00.167971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a78bf97-4149-4296-9505-95e78e2d0048 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:00.168816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3a78bf97-4149-4296-9505-95e78e2d0048 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:00.178227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-eac418c1-d7a8-40ae-b871-732910c5e1f2 req-ec08334b-cecc-4296-9901-87b2c619d49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d93cc214-bdd2-4af1-a443-1df08275c6d6", "tag": "7ae24528-1620-42f0-9ddc-20f97d06d5e5"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:10:00.193793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a78bf97-4149-4296-9505-95e78e2d0048 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:00.195037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a78bf97-4149-4296-9505-95e78e2d0048 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:00.195735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a78bf97-4149-4296-9505-95e78e2d0048 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:00.196737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a78bf97-4149-4296-9505-95e78e2d0048 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:00.197559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a78bf97-4149-4296-9505-95e78e2d0048 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:00.198169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a78bf97-4149-4296-9505-95e78e2d0048 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:00.204169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-eac418c1-d7a8-40ae-b871-732910c5e1f2 req-ec08334b-cecc-4296-9901-87b2c619d49a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:00.206709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-eac418c1-d7a8-40ae-b871-732910c5e1f2 req-ec08334b-cecc-4296-9901-87b2c619d49a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:00.207311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-eac418c1-d7a8-40ae-b871-732910c5e1f2 req-ec08334b-cecc-4296-9901-87b2c619d49a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:00.230867 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-eac418c1-d7a8-40ae-b871-732910c5e1f2 req-ec08334b-cecc-4296-9901-87b2c619d49a service nova] Creating event network-changed:7ae24528-1620-42f0-9ddc-20f97d06d5e5 for instance d93cc214-bdd2-4af1-a443-1df08275c6d6 on n-h2-835595-3 Oct 05 18:10:00.246086 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-eac418c1-d7a8-40ae-b871-732910c5e1f2 req-ec08334b-cecc-4296-9901-87b2c619d49a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072861 Oct 05 18:10:00.253019 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2721/5673] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:10:00.295436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3a78bf97-4149-4296-9505-95e78e2d0048 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:10:00.477656 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a78bf97-4149-4296-9505-95e78e2d0048 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "DELETE /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 204 len: 0 microversion: 2.1 time: 0.314166 Oct 05 18:10:00.482154 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2953/5674] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:10:00 2022] DELETE /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 18:10:00.489814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-037ad877-d988-4878-8f82-f6568abfccea tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:00.490774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-037ad877-d988-4878-8f82-f6568abfccea tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:00.507468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-037ad877-d988-4878-8f82-f6568abfccea tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:00.509539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-037ad877-d988-4878-8f82-f6568abfccea tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:00.510464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-037ad877-d988-4878-8f82-f6568abfccea tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:00.513221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-037ad877-d988-4878-8f82-f6568abfccea tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:00.513997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-037ad877-d988-4878-8f82-f6568abfccea tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:00.514869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-037ad877-d988-4878-8f82-f6568abfccea tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:00.872234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-037ad877-d988-4878-8f82-f6568abfccea tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:10:00.915632 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-037ad877-d988-4878-8f82-f6568abfccea tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1584 microversion: 2.1 time: 0.418207 Oct 05 18:10:00.917866 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2722/5675] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:00 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1584 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:10:00.955795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-225633d4-41c9-49a3-a76d-407372131b28 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:00.957328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-225633d4-41c9-49a3-a76d-407372131b28 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:00.965662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-225633d4-41c9-49a3-a76d-407372131b28 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:00.966139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-225633d4-41c9-49a3-a76d-407372131b28 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:00.970024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-225633d4-41c9-49a3-a76d-407372131b28 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:00.970868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-225633d4-41c9-49a3-a76d-407372131b28 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:00.971411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-225633d4-41c9-49a3-a76d-407372131b28 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:00.971834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-225633d4-41c9-49a3-a76d-407372131b28 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:01.195027 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-225633d4-41c9-49a3-a76d-407372131b28 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1336 microversion: 2.1 time: 0.239656 Oct 05 18:10:01.196792 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2954/5676] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:00 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1336 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:01.943303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7fb0cbd1-52a1-440b-8a99-286d2ba389b0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:01.943901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7fb0cbd1-52a1-440b-8a99-286d2ba389b0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:01.954376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fb0cbd1-52a1-440b-8a99-286d2ba389b0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:01.955043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fb0cbd1-52a1-440b-8a99-286d2ba389b0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:01.955500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fb0cbd1-52a1-440b-8a99-286d2ba389b0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:01.956229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fb0cbd1-52a1-440b-8a99-286d2ba389b0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:01.956675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fb0cbd1-52a1-440b-8a99-286d2ba389b0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:01.957320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fb0cbd1-52a1-440b-8a99-286d2ba389b0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:02.105632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7fb0cbd1-52a1-440b-8a99-286d2ba389b0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:10:02.113969 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7fb0cbd1-52a1-440b-8a99-286d2ba389b0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1584 microversion: 2.1 time: 0.174691 Oct 05 18:10:02.114602 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2723/5677] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:01 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1584 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:02.219461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae6d71ea-2afd-4b6c-9ce8-2c89bdb169af tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:02.220313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae6d71ea-2afd-4b6c-9ce8-2c89bdb169af tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:02.231673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae6d71ea-2afd-4b6c-9ce8-2c89bdb169af tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:02.232156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae6d71ea-2afd-4b6c-9ce8-2c89bdb169af tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:02.232614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae6d71ea-2afd-4b6c-9ce8-2c89bdb169af tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:02.233379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae6d71ea-2afd-4b6c-9ce8-2c89bdb169af tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:02.233852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae6d71ea-2afd-4b6c-9ce8-2c89bdb169af tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:02.234380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae6d71ea-2afd-4b6c-9ce8-2c89bdb169af tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:02.440021 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae6d71ea-2afd-4b6c-9ce8-2c89bdb169af tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1420 microversion: 2.1 time: 0.222342 Oct 05 18:10:02.442107 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2955/5678] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:02 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:02.925388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a614219f-0584-4a31-8965-88ffa44d8ba3 req-66e0d63c-5803-4c4f-af8f-eb6f946ae1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e579606a-2e51-481b-b60f-562dbaa11b33", "tag": "3b742e56-6dfc-405f-99ec-5eebad8a5d49"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:10:02.942407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a614219f-0584-4a31-8965-88ffa44d8ba3 req-66e0d63c-5803-4c4f-af8f-eb6f946ae1e4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:02.943062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a614219f-0584-4a31-8965-88ffa44d8ba3 req-66e0d63c-5803-4c4f-af8f-eb6f946ae1e4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:02.951757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a614219f-0584-4a31-8965-88ffa44d8ba3 req-66e0d63c-5803-4c4f-af8f-eb6f946ae1e4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:02.966663 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a614219f-0584-4a31-8965-88ffa44d8ba3 req-66e0d63c-5803-4c4f-af8f-eb6f946ae1e4 service nova] Creating event network-changed:3b742e56-6dfc-405f-99ec-5eebad8a5d49 for instance e579606a-2e51-481b-b60f-562dbaa11b33 on n-h1-835595-3 Oct 05 18:10:02.973348 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a614219f-0584-4a31-8965-88ffa44d8ba3 req-66e0d63c-5803-4c4f-af8f-eb6f946ae1e4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052223 Oct 05 18:10:02.974524 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2724/5679] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:10:03.189321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab725fc8-a34b-4248-b7cc-2c1752b902d1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:03.189321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ab725fc8-a34b-4248-b7cc-2c1752b902d1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:03.189321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab725fc8-a34b-4248-b7cc-2c1752b902d1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:03.189321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab725fc8-a34b-4248-b7cc-2c1752b902d1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:03.189321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab725fc8-a34b-4248-b7cc-2c1752b902d1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:03.189321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab725fc8-a34b-4248-b7cc-2c1752b902d1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:03.189321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab725fc8-a34b-4248-b7cc-2c1752b902d1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:03.189321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab725fc8-a34b-4248-b7cc-2c1752b902d1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:03.476060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-059f44f4-b604-40ee-9f41-ce355e1465a9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:03.477059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-059f44f4-b604-40ee-9f41-ce355e1465a9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:03.486647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059f44f4-b604-40ee-9f41-ce355e1465a9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:03.487370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059f44f4-b604-40ee-9f41-ce355e1465a9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:03.487966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059f44f4-b604-40ee-9f41-ce355e1465a9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:03.489515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059f44f4-b604-40ee-9f41-ce355e1465a9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:03.490215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059f44f4-b604-40ee-9f41-ce355e1465a9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:03.491028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-059f44f4-b604-40ee-9f41-ce355e1465a9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:03.597042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab725fc8-a34b-4248-b7cc-2c1752b902d1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:10:03.618685 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab725fc8-a34b-4248-b7cc-2c1752b902d1 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1465 microversion: 2.1 time: 0.477018 Oct 05 18:10:03.619352 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2956/5680] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:03 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1465 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:03.953747 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-059f44f4-b604-40ee-9f41-ce355e1465a9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1462 microversion: 2.1 time: 0.487899 Oct 05 18:10:03.965396 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2725/5681] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:03 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1462 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:10:04.644454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c7c0fb59-5e76-4c06-b06e-3368b1a6ddc5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:04.645147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c7c0fb59-5e76-4c06-b06e-3368b1a6ddc5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:04.659221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7c0fb59-5e76-4c06-b06e-3368b1a6ddc5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:04.660076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7c0fb59-5e76-4c06-b06e-3368b1a6ddc5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:04.660724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7c0fb59-5e76-4c06-b06e-3368b1a6ddc5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:04.667265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7c0fb59-5e76-4c06-b06e-3368b1a6ddc5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:04.668290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7c0fb59-5e76-4c06-b06e-3368b1a6ddc5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:04.668907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c7c0fb59-5e76-4c06-b06e-3368b1a6ddc5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:04.853616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c7c0fb59-5e76-4c06-b06e-3368b1a6ddc5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:10:04.882728 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c7c0fb59-5e76-4c06-b06e-3368b1a6ddc5 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1229 microversion: 2.1 time: 0.241104 Oct 05 18:10:04.887143 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2957/5682] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:04 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1229 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:04.978015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-84c51838-a15d-43a2-b22e-d78dfa764dcf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:04.978660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-84c51838-a15d-43a2-b22e-d78dfa764dcf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:04.991998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84c51838-a15d-43a2-b22e-d78dfa764dcf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:04.992498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84c51838-a15d-43a2-b22e-d78dfa764dcf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:04.992934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84c51838-a15d-43a2-b22e-d78dfa764dcf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:04.993667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84c51838-a15d-43a2-b22e-d78dfa764dcf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:04.997605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84c51838-a15d-43a2-b22e-d78dfa764dcf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:04.999108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84c51838-a15d-43a2-b22e-d78dfa764dcf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:05.037822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b7454b02-0fb3-4fd5-a8dc-e0e5b14e312b req-604bae2f-d7e7-4cc2-af9e-1671f12712f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d93cc214-bdd2-4af1-a443-1df08275c6d6", "name": "network-vif-deleted", "tag": "7ae24528-1620-42f0-9ddc-20f97d06d5e5"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:10:05.057926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b7454b02-0fb3-4fd5-a8dc-e0e5b14e312b req-604bae2f-d7e7-4cc2-af9e-1671f12712f7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:05.059845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b7454b02-0fb3-4fd5-a8dc-e0e5b14e312b req-604bae2f-d7e7-4cc2-af9e-1671f12712f7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:05.060305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b7454b02-0fb3-4fd5-a8dc-e0e5b14e312b req-604bae2f-d7e7-4cc2-af9e-1671f12712f7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:05.087770 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b7454b02-0fb3-4fd5-a8dc-e0e5b14e312b req-604bae2f-d7e7-4cc2-af9e-1671f12712f7 service nova] Creating event network-vif-deleted:7ae24528-1620-42f0-9ddc-20f97d06d5e5 for instance d93cc214-bdd2-4af1-a443-1df08275c6d6 on n-h2-835595-3 Oct 05 18:10:05.114321 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b7454b02-0fb3-4fd5-a8dc-e0e5b14e312b req-604bae2f-d7e7-4cc2-af9e-1671f12712f7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076140 Oct 05 18:10:05.117326 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2958/5683] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 05 18:10:05.284792 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-84c51838-a15d-43a2-b22e-d78dfa764dcf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1462 microversion: 2.1 time: 0.311131 Oct 05 18:10:05.285493 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2726/5684] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:04 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1462 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:05.932741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-289a3fee-e226-4e28-b1eb-75fb50f80d82 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:05.936200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-289a3fee-e226-4e28-b1eb-75fb50f80d82 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:05.947230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289a3fee-e226-4e28-b1eb-75fb50f80d82 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:05.948059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289a3fee-e226-4e28-b1eb-75fb50f80d82 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:05.948704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289a3fee-e226-4e28-b1eb-75fb50f80d82 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:05.949649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289a3fee-e226-4e28-b1eb-75fb50f80d82 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:05.950256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289a3fee-e226-4e28-b1eb-75fb50f80d82 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:05.951281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-289a3fee-e226-4e28-b1eb-75fb50f80d82 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:06.049638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-289a3fee-e226-4e28-b1eb-75fb50f80d82 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:10:06.058698 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-289a3fee-e226-4e28-b1eb-75fb50f80d82 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1229 microversion: 2.1 time: 0.141949 Oct 05 18:10:06.059906 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2959/5685] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:05 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1229 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:06.326201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4af414b3-31d7-40e7-84ec-c93408a46773 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:06.331572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4af414b3-31d7-40e7-84ec-c93408a46773 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:06.348426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4af414b3-31d7-40e7-84ec-c93408a46773 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:06.349206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4af414b3-31d7-40e7-84ec-c93408a46773 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:06.349662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4af414b3-31d7-40e7-84ec-c93408a46773 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:06.350453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4af414b3-31d7-40e7-84ec-c93408a46773 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:06.354836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4af414b3-31d7-40e7-84ec-c93408a46773 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:06.357867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4af414b3-31d7-40e7-84ec-c93408a46773 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:06.557520 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4af414b3-31d7-40e7-84ec-c93408a46773 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1462 microversion: 2.1 time: 0.252422 Oct 05 18:10:06.559482 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2727/5686] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:06 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1462 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:07.084008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b727f18-a163-4974-b623-889cb69cf311 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:07.086066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b727f18-a163-4974-b623-889cb69cf311 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:07.097130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b727f18-a163-4974-b623-889cb69cf311 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:07.097959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b727f18-a163-4974-b623-889cb69cf311 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:07.099454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b727f18-a163-4974-b623-889cb69cf311 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:07.101705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b727f18-a163-4974-b623-889cb69cf311 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:07.102951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b727f18-a163-4974-b623-889cb69cf311 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:07.104066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b727f18-a163-4974-b623-889cb69cf311 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:07.135163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1f5753dd-9d38-44b3-9b42-c52f69378063 req-80cbee28-f3b1-422e-93b7-b83bf11fea64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a778696d-4283-4e4f-9845-4043d3dfe279", "tag": "5a444190-7689-4ddd-92a4-be70d6d44cd9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:10:07.181429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1f5753dd-9d38-44b3-9b42-c52f69378063 req-80cbee28-f3b1-422e-93b7-b83bf11fea64 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:07.183507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1f5753dd-9d38-44b3-9b42-c52f69378063 req-80cbee28-f3b1-422e-93b7-b83bf11fea64 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:07.184314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1f5753dd-9d38-44b3-9b42-c52f69378063 req-80cbee28-f3b1-422e-93b7-b83bf11fea64 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:07.232286 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1f5753dd-9d38-44b3-9b42-c52f69378063 req-80cbee28-f3b1-422e-93b7-b83bf11fea64 service nova] Creating event network-changed:5a444190-7689-4ddd-92a4-be70d6d44cd9 for instance a778696d-4283-4e4f-9845-4043d3dfe279 on n-h1-835595-3 Oct 05 18:10:07.249937 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1f5753dd-9d38-44b3-9b42-c52f69378063 req-80cbee28-f3b1-422e-93b7-b83bf11fea64 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119340 Oct 05 18:10:07.251948 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2728/5687] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:10:07.308328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b727f18-a163-4974-b623-889cb69cf311 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:10:07.334455 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b727f18-a163-4974-b623-889cb69cf311 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1229 microversion: 2.1 time: 0.253029 Oct 05 18:10:07.337569 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2960/5688] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:07 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1229 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:07.585606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-14f4dfdc-a5b4-42ca-8993-472b73e2fc0b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:07.587997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-14f4dfdc-a5b4-42ca-8993-472b73e2fc0b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:07.617766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14f4dfdc-a5b4-42ca-8993-472b73e2fc0b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:07.618449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14f4dfdc-a5b4-42ca-8993-472b73e2fc0b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:07.623241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14f4dfdc-a5b4-42ca-8993-472b73e2fc0b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:07.631288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14f4dfdc-a5b4-42ca-8993-472b73e2fc0b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:07.631794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14f4dfdc-a5b4-42ca-8993-472b73e2fc0b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:07.635192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-14f4dfdc-a5b4-42ca-8993-472b73e2fc0b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:07.908835 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-14f4dfdc-a5b4-42ca-8993-472b73e2fc0b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1462 microversion: 2.1 time: 0.327829 Oct 05 18:10:07.914659 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2729/5689] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:07 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1462 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:08.364363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1bc195f3-b7f2-47ba-a8f8-aabc10433042 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:08.366133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1bc195f3-b7f2-47ba-a8f8-aabc10433042 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:08.389168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bc195f3-b7f2-47ba-a8f8-aabc10433042 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:08.390346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bc195f3-b7f2-47ba-a8f8-aabc10433042 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:08.391630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bc195f3-b7f2-47ba-a8f8-aabc10433042 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:08.395000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bc195f3-b7f2-47ba-a8f8-aabc10433042 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:08.399295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bc195f3-b7f2-47ba-a8f8-aabc10433042 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:08.399851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bc195f3-b7f2-47ba-a8f8-aabc10433042 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:08.612801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1bc195f3-b7f2-47ba-a8f8-aabc10433042 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:10:08.639068 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1bc195f3-b7f2-47ba-a8f8-aabc10433042 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1229 microversion: 2.1 time: 0.281735 Oct 05 18:10:08.642446 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2961/5690] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:08 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1229 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:08.944599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-769fc68e-07f9-4278-91fc-932f1fae8106 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:08.945259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-769fc68e-07f9-4278-91fc-932f1fae8106 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:08.947920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:08.957244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-769fc68e-07f9-4278-91fc-932f1fae8106 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:08.958031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-769fc68e-07f9-4278-91fc-932f1fae8106 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:08.958793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-769fc68e-07f9-4278-91fc-932f1fae8106 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:08.959935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-769fc68e-07f9-4278-91fc-932f1fae8106 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:08.960432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-769fc68e-07f9-4278-91fc-932f1fae8106 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:08.960868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-769fc68e-07f9-4278-91fc-932f1fae8106 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:09.048338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5f009284-17a9-42c5-978d-735d1b212ca9 req-8690d2fe-b9d7-4951-893a-d91231947d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a778696d-4283-4e4f-9845-4043d3dfe279", "name": "network-vif-plugged", "status": "completed", "tag": "5a444190-7689-4ddd-92a4-be70d6d44cd9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:10:09.067674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5f009284-17a9-42c5-978d-735d1b212ca9 req-8690d2fe-b9d7-4951-893a-d91231947d98 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:09.068987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5f009284-17a9-42c5-978d-735d1b212ca9 req-8690d2fe-b9d7-4951-893a-d91231947d98 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:09.069701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5f009284-17a9-42c5-978d-735d1b212ca9 req-8690d2fe-b9d7-4951-893a-d91231947d98 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:09.097628 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5f009284-17a9-42c5-978d-735d1b212ca9 req-8690d2fe-b9d7-4951-893a-d91231947d98 service nova] Creating event network-vif-plugged:5a444190-7689-4ddd-92a4-be70d6d44cd9 for instance a778696d-4283-4e4f-9845-4043d3dfe279 on n-h1-835595-3 Oct 05 18:10:09.103508 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5f009284-17a9-42c5-978d-735d1b212ca9 req-8690d2fe-b9d7-4951-893a-d91231947d98 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059554 Oct 05 18:10:09.104313 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2962/5691] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:10:09.203843 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-769fc68e-07f9-4278-91fc-932f1fae8106 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1462 microversion: 2.1 time: 0.263418 Oct 05 18:10:09.205228 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2730/5692] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:08 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1462 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:09.664833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:09.665928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:09.670350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f8e45929-79df-4179-a837-01e28c66940a tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:09.671191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f8e45929-79df-4179-a837-01e28c66940a tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:09.678718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8e45929-79df-4179-a837-01e28c66940a tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:09.679216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8e45929-79df-4179-a837-01e28c66940a tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:09.679665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8e45929-79df-4179-a837-01e28c66940a tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:09.680381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8e45929-79df-4179-a837-01e28c66940a tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:09.680845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8e45929-79df-4179-a837-01e28c66940a tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:09.681277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f8e45929-79df-4179-a837-01e28c66940a tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:09.699754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:09.757858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f8e45929-79df-4179-a837-01e28c66940a tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6796ebfd63f842a9a1f3e0e98087cdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096a20a8118446e6bab089009b892f11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:10:09.766791 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f8e45929-79df-4179-a837-01e28c66940a tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 200 len: 1229 microversion: 2.1 time: 0.103920 Oct 05 18:10:09.774327 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2963/5693] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:09 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:10.230884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8c15ae2-4a36-4435-956d-47470a8f62bf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:10.231780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8c15ae2-4a36-4435-956d-47470a8f62bf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:10.233542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:10.240053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8c15ae2-4a36-4435-956d-47470a8f62bf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:10.240688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8c15ae2-4a36-4435-956d-47470a8f62bf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:10.241151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8c15ae2-4a36-4435-956d-47470a8f62bf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:10.241928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8c15ae2-4a36-4435-956d-47470a8f62bf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:10.242495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8c15ae2-4a36-4435-956d-47470a8f62bf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:10.242991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8c15ae2-4a36-4435-956d-47470a8f62bf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:10.388236 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8c15ae2-4a36-4435-956d-47470a8f62bf tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1462 microversion: 2.1 time: 0.161689 Oct 05 18:10:10.389553 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2731/5694] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:10 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1462 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:10.790751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:10.791731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] [instance: d93cc214-bdd2-4af1-a443-1df08275c6d6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:10.799046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:10.799634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:10.800149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:10.800930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:10.801586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:10.802091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:10.816151 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] HTTP exception thrown: Instance d93cc214-bdd2-4af1-a443-1df08275c6d6 could not be found. Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Request method failure captured: Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 HTTP/1.1 Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPceKlEoBVq2Q7NNOH4uZcd__ofSTRTpijjxuMqmlzWhTiRmXg1qST6gqyjoRRYLikjgrHkDTwOUkwmhqR0ZOokYJ2P_MHt6GHQIyjXtxTrU4xafljFZ50PXI4PGc3LW9gYKJTlqOe4waoJ0RK6-2_urh7DE4fnATaRB7Evt8v0AwkUc Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 096a20a8118446e6bab089009b892f11 Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBackupRestore-605047302 Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/096a20a8118446e6bab089009b892f11"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/096a20a8118446e6bab089009b892f11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_096a20a8118446e6bab089009b892f11", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/096a20a8118446e6bab089009b892f11"}]}] Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBackupRestore-605047302 Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 096a20a8118446e6bab089009b892f11 Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBackupRestore-605047302 Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBackupRestore-605047302-project Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6796ebfd63f842a9a1f3e0e98087cdd9 Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBackupRestore-605047302-project Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance d93cc214-bdd2-4af1-a443-1df08275c6d6 could not be found. Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'd93cc214-bdd2-4af1-a443-1df08275c6d6'} Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d93cc214-bdd2-4af1-a443-1df08275c6d6 could not be found. Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d93cc214-bdd2-4af1-a443-1df08275c6d6 could not be found. Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:10:10.817868 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:10.822630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:10:10.822630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:10:10.822630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:10:10.822630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:10:10.822630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:10:10.822630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d93cc214-bdd2-4af1-a443-1df08275c6d6 could not be found. Oct 05 18:10:10.822630 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:10.822630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Returning 404 to user: Instance d93cc214-bdd2-4af1-a443-1df08275c6d6 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:10:10.822630 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d27ef340-919a-4ac1-ad0a-7a12679a15c0 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6" status: 404 len: 111 microversion: 2.1 time: 0.032918 Oct 05 18:10:10.822630 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2964/5695] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:10 2022] GET /compute/v2.1/servers/d93cc214-bdd2-4af1-a443-1df08275c6d6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:10:10.993192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-524d88a3-03d2-45db-a91f-2c652abe6f18 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] Calling method '.version_select at 0x7f77742e7550>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:11.024647 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-524d88a3-03d2-45db-a91f-2c652abe6f18 tempest-TestVolumeBackupRestore-605047302 tempest-TestVolumeBackupRestore-605047302-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-188875906" status: 202 len: 0 microversion: 2.1 time: 0.035629 Oct 05 18:10:11.025276 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2732/5696] 10.222.0.70 () {58 vars in 1266 bytes} [Wed Oct 5 18:10:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-188875906 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:10:11.420292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c65000aa-c0f8-4dd8-a49f-318a183067b7 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:11.421639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c65000aa-c0f8-4dd8-a49f-318a183067b7 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:11.439853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c65000aa-c0f8-4dd8-a49f-318a183067b7 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:11.440412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c65000aa-c0f8-4dd8-a49f-318a183067b7 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:11.441020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c65000aa-c0f8-4dd8-a49f-318a183067b7 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:11.441888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c65000aa-c0f8-4dd8-a49f-318a183067b7 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:11.442590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c65000aa-c0f8-4dd8-a49f-318a183067b7 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:11.443246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c65000aa-c0f8-4dd8-a49f-318a183067b7 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:11.610245 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c65000aa-c0f8-4dd8-a49f-318a183067b7 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1647 microversion: 2.1 time: 0.193611 Oct 05 18:10:11.610961 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2965/5697] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:11 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1647 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:11.636275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4161559-a2b6-4f34-b507-1358a6abf9c2 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:11.636895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4161559-a2b6-4f34-b507-1358a6abf9c2 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:11.644425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:11.646818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4161559-a2b6-4f34-b507-1358a6abf9c2 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:11.647173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4161559-a2b6-4f34-b507-1358a6abf9c2 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:11.647741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4161559-a2b6-4f34-b507-1358a6abf9c2 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:11.648308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4161559-a2b6-4f34-b507-1358a6abf9c2 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:11.648760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4161559-a2b6-4f34-b507-1358a6abf9c2 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:11.649359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4161559-a2b6-4f34-b507-1358a6abf9c2 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:11.793604 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4161559-a2b6-4f34-b507-1358a6abf9c2 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1647 microversion: 2.1 time: 0.163643 Oct 05 18:10:11.794418 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2733/5698] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:11 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1647 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:11.819739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5987c88f-5228-414f-939e-13ec978445d4 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:11.820982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5987c88f-5228-414f-939e-13ec978445d4 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:11.832285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5987c88f-5228-414f-939e-13ec978445d4 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:11.832807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5987c88f-5228-414f-939e-13ec978445d4 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:11.833307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5987c88f-5228-414f-939e-13ec978445d4 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:11.834787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5987c88f-5228-414f-939e-13ec978445d4 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:11.835384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5987c88f-5228-414f-939e-13ec978445d4 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:11.835682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5987c88f-5228-414f-939e-13ec978445d4 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:12.017349 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5987c88f-5228-414f-939e-13ec978445d4 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1647 microversion: 2.1 time: 0.199511 Oct 05 18:10:12.018381 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2966/5699] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:11 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1647 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:12.090593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-455926371", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "availability_zone": "nova:n-h2-835595-3", "networks": [{"uuid": "1113dbe7-ff4d-4107-aac1-6a3413b5b0b2"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:10:12.193938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] validate_networks() for [('1113dbe7-ff4d-4107-aac1-6a3413b5b0b2', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:10:12.800194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:10:12.800772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:10:12.801264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:10:12.802046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:10:12.802497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:10:12.812608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:12.813176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:12.813612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:12.814377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:12.814802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:12.815307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:12.838956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Getting quotas for project f3e2cf9e849842bd9b3f5cb2a2ba35cd. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:10:12.846207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Getting quotas for user 1dc268bd8c65426e87f28eca9a3c14dc and project f3e2cf9e849842bd9b3f5cb2a2ba35cd. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:10:12.863261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:10:12.866487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:10:12.946525 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-72d7da48-a18e-4153-ad23-4f2c21044817 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859428 Oct 05 18:10:12.961196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-542a90a4-a456-4aae-9bec-0297768ceaaa tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:12.971238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-542a90a4-a456-4aae-9bec-0297768ceaaa tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:12.981324 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2734/5700] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:10:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:10:13.108769 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-542a90a4-a456-4aae-9bec-0297768ceaaa tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1328 microversion: 2.1 time: 0.152222 Oct 05 18:10:13.109586 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2967/5701] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:12 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1328 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:14.140229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ddd0a04-dcc3-42ca-bc0b-efaff34aef27 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:14.140945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ddd0a04-dcc3-42ca-bc0b-efaff34aef27 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:14.170423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a04-dcc3-42ca-bc0b-efaff34aef27 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:14.171131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a04-dcc3-42ca-bc0b-efaff34aef27 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:14.171814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a04-dcc3-42ca-bc0b-efaff34aef27 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:14.173028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a04-dcc3-42ca-bc0b-efaff34aef27 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:14.173791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a04-dcc3-42ca-bc0b-efaff34aef27 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:14.174071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a04-dcc3-42ca-bc0b-efaff34aef27 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:14.347838 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ddd0a04-dcc3-42ca-bc0b-efaff34aef27 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1415 microversion: 2.1 time: 0.218040 Oct 05 18:10:14.348454 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2735/5702] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:14 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1415 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:15.375965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d76ece88-d09d-46d3-b602-4b4a95c20945 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:15.377762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d76ece88-d09d-46d3-b602-4b4a95c20945 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:15.399446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d76ece88-d09d-46d3-b602-4b4a95c20945 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:15.404232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d76ece88-d09d-46d3-b602-4b4a95c20945 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:15.405055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d76ece88-d09d-46d3-b602-4b4a95c20945 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:15.406179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d76ece88-d09d-46d3-b602-4b4a95c20945 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:15.415597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d76ece88-d09d-46d3-b602-4b4a95c20945 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:15.418253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d76ece88-d09d-46d3-b602-4b4a95c20945 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:15.640059 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d76ece88-d09d-46d3-b602-4b4a95c20945 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1421 microversion: 2.1 time: 0.270548 Oct 05 18:10:15.660885 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2968/5703] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:15 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1421 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:16.669133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bcc604c9-2261-4b65-abe5-e73df46a6e70 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:16.670826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bcc604c9-2261-4b65-abe5-e73df46a6e70 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:16.686632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcc604c9-2261-4b65-abe5-e73df46a6e70 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:16.689566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcc604c9-2261-4b65-abe5-e73df46a6e70 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:16.692186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcc604c9-2261-4b65-abe5-e73df46a6e70 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:16.699272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcc604c9-2261-4b65-abe5-e73df46a6e70 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:16.701215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcc604c9-2261-4b65-abe5-e73df46a6e70 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:16.703678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcc604c9-2261-4b65-abe5-e73df46a6e70 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:16.952354 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bcc604c9-2261-4b65-abe5-e73df46a6e70 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1463 microversion: 2.1 time: 0.287258 Oct 05 18:10:16.967984 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2736/5704] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:16 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:17.977451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a8941684-1ef9-4bee-bdd0-6b167668f372 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:17.978076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a8941684-1ef9-4bee-bdd0-6b167668f372 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:17.981253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:17.987460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8941684-1ef9-4bee-bdd0-6b167668f372 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:17.988148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8941684-1ef9-4bee-bdd0-6b167668f372 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:17.988680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8941684-1ef9-4bee-bdd0-6b167668f372 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:17.989599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8941684-1ef9-4bee-bdd0-6b167668f372 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:17.990075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8941684-1ef9-4bee-bdd0-6b167668f372 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:17.990546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8941684-1ef9-4bee-bdd0-6b167668f372 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:18.589244 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a8941684-1ef9-4bee-bdd0-6b167668f372 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1463 microversion: 2.1 time: 0.615540 Oct 05 18:10:18.590097 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2969/5705] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:17 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1463 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:18.975045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-16ed2a91-e7f2-4e4f-9b13-721312c8b3c0 req-c77ea5b5-45d6-49b4-abeb-6671014036c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b524a22-30b2-404a-ab37-3e561680a788", "tag": "201e6fda-2424-44cd-be9a-871e5b5f8e5d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:10:19.003923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-16ed2a91-e7f2-4e4f-9b13-721312c8b3c0 req-c77ea5b5-45d6-49b4-abeb-6671014036c3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:19.004403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-16ed2a91-e7f2-4e4f-9b13-721312c8b3c0 req-c77ea5b5-45d6-49b4-abeb-6671014036c3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:19.005148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-16ed2a91-e7f2-4e4f-9b13-721312c8b3c0 req-c77ea5b5-45d6-49b4-abeb-6671014036c3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:19.021751 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-16ed2a91-e7f2-4e4f-9b13-721312c8b3c0 req-c77ea5b5-45d6-49b4-abeb-6671014036c3 service nova] Creating event network-changed:201e6fda-2424-44cd-be9a-871e5b5f8e5d for instance 0b524a22-30b2-404a-ab37-3e561680a788 on n-h2-835595-3 Oct 05 18:10:19.027619 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-16ed2a91-e7f2-4e4f-9b13-721312c8b3c0 req-c77ea5b5-45d6-49b4-abeb-6671014036c3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062101 Oct 05 18:10:19.028258 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2737/5706] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:10:19.613645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e6d59d4b-1b1e-4d6d-94d6-7198ff4da3f9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:19.615280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e6d59d4b-1b1e-4d6d-94d6-7198ff4da3f9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:19.623160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d59d4b-1b1e-4d6d-94d6-7198ff4da3f9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:19.623754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d59d4b-1b1e-4d6d-94d6-7198ff4da3f9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:19.624273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d59d4b-1b1e-4d6d-94d6-7198ff4da3f9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:19.625515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d59d4b-1b1e-4d6d-94d6-7198ff4da3f9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:19.626394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d59d4b-1b1e-4d6d-94d6-7198ff4da3f9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:19.627282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6d59d4b-1b1e-4d6d-94d6-7198ff4da3f9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:20.164839 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e6d59d4b-1b1e-4d6d-94d6-7198ff4da3f9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1463 microversion: 2.1 time: 0.555377 Oct 05 18:10:20.165433 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2970/5707] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:19 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1463 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:21.188956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8d9e2c71-b98a-41cd-aa7c-dd4f41882b09 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:21.189674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8d9e2c71-b98a-41cd-aa7c-dd4f41882b09 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:21.206738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d9e2c71-b98a-41cd-aa7c-dd4f41882b09 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:21.207257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d9e2c71-b98a-41cd-aa7c-dd4f41882b09 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:21.207685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d9e2c71-b98a-41cd-aa7c-dd4f41882b09 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:21.208402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d9e2c71-b98a-41cd-aa7c-dd4f41882b09 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:21.208863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d9e2c71-b98a-41cd-aa7c-dd4f41882b09 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:21.209291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d9e2c71-b98a-41cd-aa7c-dd4f41882b09 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:21.531093 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8d9e2c71-b98a-41cd-aa7c-dd4f41882b09 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1463 microversion: 2.1 time: 0.346184 Oct 05 18:10:21.548944 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2738/5708] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:21 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1463 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:22.558827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5fce2ea7-dea4-4c49-94ed-0dce0e1196d9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:22.560216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5fce2ea7-dea4-4c49-94ed-0dce0e1196d9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:22.595512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fce2ea7-dea4-4c49-94ed-0dce0e1196d9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:22.597165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fce2ea7-dea4-4c49-94ed-0dce0e1196d9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:22.597621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fce2ea7-dea4-4c49-94ed-0dce0e1196d9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:22.599563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fce2ea7-dea4-4c49-94ed-0dce0e1196d9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:22.603497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fce2ea7-dea4-4c49-94ed-0dce0e1196d9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:22.606854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fce2ea7-dea4-4c49-94ed-0dce0e1196d9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:22.856657 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5fce2ea7-dea4-4c49-94ed-0dce0e1196d9 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1463 microversion: 2.1 time: 0.301465 Oct 05 18:10:22.857892 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2971/5709] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:22 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1463 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:23.884174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d9692273-a36d-4976-b82a-c4f76bac844d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:23.885297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d9692273-a36d-4976-b82a-c4f76bac844d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:23.888849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:23.889667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:23.896477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9692273-a36d-4976-b82a-c4f76bac844d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:23.897087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9692273-a36d-4976-b82a-c4f76bac844d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:23.897589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9692273-a36d-4976-b82a-c4f76bac844d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:23.898421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9692273-a36d-4976-b82a-c4f76bac844d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:23.898959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9692273-a36d-4976-b82a-c4f76bac844d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:23.899460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d9692273-a36d-4976-b82a-c4f76bac844d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:23.910148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:24.356184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d9692273-a36d-4976-b82a-c4f76bac844d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1463 microversion: 2.1 time: 0.475986 Oct 05 18:10:24.357062 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2739/5710] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:23 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1463 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:25.383718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f137774-d43d-4e9e-a5b4-40ef5d0bf040 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:25.385077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8f137774-d43d-4e9e-a5b4-40ef5d0bf040 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:25.390863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:10:25.394393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f137774-d43d-4e9e-a5b4-40ef5d0bf040 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:25.395203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f137774-d43d-4e9e-a5b4-40ef5d0bf040 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:25.396444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f137774-d43d-4e9e-a5b4-40ef5d0bf040 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:25.397660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f137774-d43d-4e9e-a5b4-40ef5d0bf040 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:25.398303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f137774-d43d-4e9e-a5b4-40ef5d0bf040 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:25.399164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f137774-d43d-4e9e-a5b4-40ef5d0bf040 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:25.567627 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f137774-d43d-4e9e-a5b4-40ef5d0bf040 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1463 microversion: 2.1 time: 0.187576 Oct 05 18:10:25.568611 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2972/5711] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:25 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1463 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:26.309979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a1c27663-77ca-4fcc-9341-dabb567de27e req-668dd0ba-5daa-457b-8b8a-af1965498926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b524a22-30b2-404a-ab37-3e561680a788", "name": "network-vif-plugged", "status": "completed", "tag": "201e6fda-2424-44cd-be9a-871e5b5f8e5d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:10:26.323861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a1c27663-77ca-4fcc-9341-dabb567de27e req-668dd0ba-5daa-457b-8b8a-af1965498926 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:26.324745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a1c27663-77ca-4fcc-9341-dabb567de27e req-668dd0ba-5daa-457b-8b8a-af1965498926 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:26.325402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a1c27663-77ca-4fcc-9341-dabb567de27e req-668dd0ba-5daa-457b-8b8a-af1965498926 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:26.345152 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a1c27663-77ca-4fcc-9341-dabb567de27e req-668dd0ba-5daa-457b-8b8a-af1965498926 service nova] Creating event network-vif-plugged:201e6fda-2424-44cd-be9a-871e5b5f8e5d for instance 0b524a22-30b2-404a-ab37-3e561680a788 on n-h2-835595-3 Oct 05 18:10:26.351352 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a1c27663-77ca-4fcc-9341-dabb567de27e req-668dd0ba-5daa-457b-8b8a-af1965498926 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045270 Oct 05 18:10:26.352668 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2740/5712] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:10:26.591262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b282bd7f-f04e-4868-bd85-de210b5acb03 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:26.592998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b282bd7f-f04e-4868-bd85-de210b5acb03 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:26.600387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b282bd7f-f04e-4868-bd85-de210b5acb03 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:26.601300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b282bd7f-f04e-4868-bd85-de210b5acb03 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:26.601759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b282bd7f-f04e-4868-bd85-de210b5acb03 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:26.602621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b282bd7f-f04e-4868-bd85-de210b5acb03 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:26.603148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b282bd7f-f04e-4868-bd85-de210b5acb03 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:26.603543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b282bd7f-f04e-4868-bd85-de210b5acb03 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:26.791417 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b282bd7f-f04e-4868-bd85-de210b5acb03 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1463 microversion: 2.1 time: 0.202118 Oct 05 18:10:26.792362 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2973/5713] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:26 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1463 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:27.818766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-554072ba-e5a6-492c-b04f-b7a4a66ccced tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:27.819580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-554072ba-e5a6-492c-b04f-b7a4a66ccced tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:27.826118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-554072ba-e5a6-492c-b04f-b7a4a66ccced tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:27.826646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-554072ba-e5a6-492c-b04f-b7a4a66ccced tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:27.827360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-554072ba-e5a6-492c-b04f-b7a4a66ccced tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:27.828174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-554072ba-e5a6-492c-b04f-b7a4a66ccced tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:27.828606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-554072ba-e5a6-492c-b04f-b7a4a66ccced tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:27.829035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-554072ba-e5a6-492c-b04f-b7a4a66ccced tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:28.001349 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-554072ba-e5a6-492c-b04f-b7a4a66ccced tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1649 microversion: 2.1 time: 0.187727 Oct 05 18:10:28.002398 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2741/5714] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:27 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1649 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:28.025421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b03a1263-722b-418d-be7e-5775cbb4df29 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:28.026206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b03a1263-722b-418d-be7e-5775cbb4df29 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:28.035585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03a1263-722b-418d-be7e-5775cbb4df29 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:28.036223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03a1263-722b-418d-be7e-5775cbb4df29 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:28.037373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03a1263-722b-418d-be7e-5775cbb4df29 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:28.037664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03a1263-722b-418d-be7e-5775cbb4df29 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:28.038644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03a1263-722b-418d-be7e-5775cbb4df29 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:28.039171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b03a1263-722b-418d-be7e-5775cbb4df29 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:28.238143 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b03a1263-722b-418d-be7e-5775cbb4df29 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1649 microversion: 2.1 time: 0.216994 Oct 05 18:10:28.239173 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2974/5715] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:28 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1649 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:10:28.263315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ace10ff1-5bf2-48e8-822e-7aa86fc46c64 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:28.264352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ace10ff1-5bf2-48e8-822e-7aa86fc46c64 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:28.272497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ace10ff1-5bf2-48e8-822e-7aa86fc46c64 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:28.273563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ace10ff1-5bf2-48e8-822e-7aa86fc46c64 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:28.274522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ace10ff1-5bf2-48e8-822e-7aa86fc46c64 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:28.284684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ace10ff1-5bf2-48e8-822e-7aa86fc46c64 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:28.285440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ace10ff1-5bf2-48e8-822e-7aa86fc46c64 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:28.286121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ace10ff1-5bf2-48e8-822e-7aa86fc46c64 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:28.465080 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ace10ff1-5bf2-48e8-822e-7aa86fc46c64 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1649 microversion: 2.1 time: 0.206351 Oct 05 18:10:28.466885 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2742/5716] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:28 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1649 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:28.490207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-16d8e526-d1ce-4d00-a885-c3561186585d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:28.491243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-16d8e526-d1ce-4d00-a885-c3561186585d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:28.498172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16d8e526-d1ce-4d00-a885-c3561186585d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:28.498726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16d8e526-d1ce-4d00-a885-c3561186585d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:28.499212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16d8e526-d1ce-4d00-a885-c3561186585d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:28.500041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16d8e526-d1ce-4d00-a885-c3561186585d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:28.500555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16d8e526-d1ce-4d00-a885-c3561186585d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:28.501362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16d8e526-d1ce-4d00-a885-c3561186585d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:28.529034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-16d8e526-d1ce-4d00-a885-c3561186585d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:10:28.640897 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-16d8e526-d1ce-4d00-a885-c3561186585d tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 204 len: 0 microversion: 2.1 time: 0.153446 Oct 05 18:10:28.645239 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2975/5717] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:10:28 2022] DELETE /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:10:28.651094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-82f0891c-db90-45d2-bf45-2b36a057d799 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:28.651751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-82f0891c-db90-45d2-bf45-2b36a057d799 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:28.659139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82f0891c-db90-45d2-bf45-2b36a057d799 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:28.659634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82f0891c-db90-45d2-bf45-2b36a057d799 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:28.660297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82f0891c-db90-45d2-bf45-2b36a057d799 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:28.661082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82f0891c-db90-45d2-bf45-2b36a057d799 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:28.661799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82f0891c-db90-45d2-bf45-2b36a057d799 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:28.662376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82f0891c-db90-45d2-bf45-2b36a057d799 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:28.813282 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-82f0891c-db90-45d2-bf45-2b36a057d799 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1655 microversion: 2.1 time: 0.166381 Oct 05 18:10:28.813890 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2743/5718] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:28 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1655 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:29.838367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a599d4e6-7e72-4c30-8bac-0a0b4aab2c5a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:29.839179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a599d4e6-7e72-4c30-8bac-0a0b4aab2c5a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:29.846997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a599d4e6-7e72-4c30-8bac-0a0b4aab2c5a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:29.847647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a599d4e6-7e72-4c30-8bac-0a0b4aab2c5a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:29.848236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a599d4e6-7e72-4c30-8bac-0a0b4aab2c5a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:29.848984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a599d4e6-7e72-4c30-8bac-0a0b4aab2c5a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:29.849453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a599d4e6-7e72-4c30-8bac-0a0b4aab2c5a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:29.849977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a599d4e6-7e72-4c30-8bac-0a0b4aab2c5a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:30.046434 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a599d4e6-7e72-4c30-8bac-0a0b4aab2c5a tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 200 len: 1655 microversion: 2.1 time: 0.212537 Oct 05 18:10:30.049188 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2976/5719] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:29 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 1655 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:30.460354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6c6d7416-0e4f-421b-b254-02ecdc042396 req-dd2b0f46-7f4c-4ae9-a610-f9dd13890c5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b524a22-30b2-404a-ab37-3e561680a788", "name": "network-vif-deleted", "tag": "201e6fda-2424-44cd-be9a-871e5b5f8e5d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:10:30.512528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6c6d7416-0e4f-421b-b254-02ecdc042396 req-dd2b0f46-7f4c-4ae9-a610-f9dd13890c5b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:30.513303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6c6d7416-0e4f-421b-b254-02ecdc042396 req-dd2b0f46-7f4c-4ae9-a610-f9dd13890c5b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:30.515006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6c6d7416-0e4f-421b-b254-02ecdc042396 req-dd2b0f46-7f4c-4ae9-a610-f9dd13890c5b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:30.547757 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6c6d7416-0e4f-421b-b254-02ecdc042396 req-dd2b0f46-7f4c-4ae9-a610-f9dd13890c5b service nova] Creating event network-vif-deleted:201e6fda-2424-44cd-be9a-871e5b5f8e5d for instance 0b524a22-30b2-404a-ab37-3e561680a788 on n-h2-835595-3 Oct 05 18:10:30.563117 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6c6d7416-0e4f-421b-b254-02ecdc042396 req-dd2b0f46-7f4c-4ae9-a610-f9dd13890c5b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111242 Oct 05 18:10:30.570216 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2744/5720] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:10:31.089715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:31.090991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: 0b524a22-30b2-404a-ab37-3e561680a788] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:31.099115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:31.099814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:31.100688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:31.101741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:31.102433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:31.103203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:31.125788 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] HTTP exception thrown: Instance 0b524a22-30b2-404a-ab37-3e561680a788 could not be found. Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Request method failure captured: Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 HTTP/1.1 Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPch1AZcqqjv4GWaZ_QQpBy-BuArBxrGJn3ABBceg3fAQH1j9NidVC43_vHIMqK26WRWXoZGREWDB9-UHUpNSi1a1LIclFSDabldPyGTROVJHgzD2Cqm6OvwCJp1vP-Em81ZUdW8r07LCdcohbxJCyh-e4C_8giNeB5vUqKGHc5SKabw Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f3e2cf9e849842bd9b3f5cb2a2ba35cd Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestServerMultinode-501645225 Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f3e2cf9e849842bd9b3f5cb2a2ba35cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3e2cf9e849842bd9b3f5cb2a2ba35cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f3e2cf9e849842bd9b3f5cb2a2ba35cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3e2cf9e849842bd9b3f5cb2a2ba35cd"}]}] Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestServerMultinode-501645225 Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f3e2cf9e849842bd9b3f5cb2a2ba35cd Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestServerMultinode-501645225 Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestServerMultinode-501645225-project-admin Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 1dc268bd8c65426e87f28eca9a3c14dc Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestServerMultinode-501645225-project-admin Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0b524a22-30b2-404a-ab37-3e561680a788 could not be found. Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '0b524a22-30b2-404a-ab37-3e561680a788'} Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b524a22-30b2-404a-ab37-3e561680a788 could not be found. Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b524a22-30b2-404a-ab37-3e561680a788 could not be found. Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:10:31.128462 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:31.133609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:10:31.133609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:10:31.133609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:10:31.133609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:10:31.133609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:10:31.133609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b524a22-30b2-404a-ab37-3e561680a788 could not be found. Oct 05 18:10:31.133609 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:31.133609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Returning 404 to user: Instance 0b524a22-30b2-404a-ab37-3e561680a788 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:10:31.133609 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c120ef32-4c24-4faf-9f46-7c8cf9ba25fd tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788" status: 404 len: 111 microversion: 2.1 time: 0.059085 Oct 05 18:10:31.133609 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2977/5721] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:31 2022] GET /compute/v2.1/servers/0b524a22-30b2-404a-ab37-3e561680a788 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:10:31.142664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-197a1679-d1ed-47eb-9895-be3bc790728b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:31.143632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-197a1679-d1ed-47eb-9895-be3bc790728b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:31.155287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197a1679-d1ed-47eb-9895-be3bc790728b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:31.156678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197a1679-d1ed-47eb-9895-be3bc790728b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:31.157192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197a1679-d1ed-47eb-9895-be3bc790728b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:31.158986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197a1679-d1ed-47eb-9895-be3bc790728b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:31.159683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197a1679-d1ed-47eb-9895-be3bc790728b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:31.159966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-197a1679-d1ed-47eb-9895-be3bc790728b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:31.195389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-197a1679-d1ed-47eb-9895-be3bc790728b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:10:31.301641 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-197a1679-d1ed-47eb-9895-be3bc790728b tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "DELETE /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 204 len: 0 microversion: 2.1 time: 0.163681 Oct 05 18:10:31.302789 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2745/5722] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:10:31 2022] DELETE /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:10:31.312886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48f74e26-e929-45b2-b7d2-072c4a060a84 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:31.313882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-48f74e26-e929-45b2-b7d2-072c4a060a84 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:31.321714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48f74e26-e929-45b2-b7d2-072c4a060a84 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:31.322516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48f74e26-e929-45b2-b7d2-072c4a060a84 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:31.323189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48f74e26-e929-45b2-b7d2-072c4a060a84 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:31.324791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48f74e26-e929-45b2-b7d2-072c4a060a84 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:31.325920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48f74e26-e929-45b2-b7d2-072c4a060a84 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:31.326705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48f74e26-e929-45b2-b7d2-072c4a060a84 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:31.504357 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48f74e26-e929-45b2-b7d2-072c4a060a84 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1653 microversion: 2.1 time: 0.197290 Oct 05 18:10:31.505323 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2978/5723] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:31 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1653 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:10:32.528957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-996ee583-16d9-4f32-baeb-4255426655b5 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:32.529665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-996ee583-16d9-4f32-baeb-4255426655b5 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:32.536925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-996ee583-16d9-4f32-baeb-4255426655b5 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:32.537414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-996ee583-16d9-4f32-baeb-4255426655b5 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:32.537901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-996ee583-16d9-4f32-baeb-4255426655b5 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:32.538627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-996ee583-16d9-4f32-baeb-4255426655b5 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:32.539071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-996ee583-16d9-4f32-baeb-4255426655b5 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:32.539498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-996ee583-16d9-4f32-baeb-4255426655b5 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:32.684237 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-996ee583-16d9-4f32-baeb-4255426655b5 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1653 microversion: 2.1 time: 0.159335 Oct 05 18:10:32.684833 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2746/5724] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:32 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1653 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:33.190175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-371fa5b9-fc35-46ee-85d3-cd19c11ee7a5 req-c180fec2-60ea-448d-93d8-6e40bd6911d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a778696d-4283-4e4f-9845-4043d3dfe279", "name": "network-vif-deleted", "tag": "5a444190-7689-4ddd-92a4-be70d6d44cd9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:10:33.203103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-371fa5b9-fc35-46ee-85d3-cd19c11ee7a5 req-c180fec2-60ea-448d-93d8-6e40bd6911d7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:33.203509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-371fa5b9-fc35-46ee-85d3-cd19c11ee7a5 req-c180fec2-60ea-448d-93d8-6e40bd6911d7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:33.203997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-371fa5b9-fc35-46ee-85d3-cd19c11ee7a5 req-c180fec2-60ea-448d-93d8-6e40bd6911d7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:33.229833 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-371fa5b9-fc35-46ee-85d3-cd19c11ee7a5 req-c180fec2-60ea-448d-93d8-6e40bd6911d7 service nova] Creating event network-vif-deleted:5a444190-7689-4ddd-92a4-be70d6d44cd9 for instance a778696d-4283-4e4f-9845-4043d3dfe279 on n-h1-835595-3 Oct 05 18:10:33.235961 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-371fa5b9-fc35-46ee-85d3-cd19c11ee7a5 req-c180fec2-60ea-448d-93d8-6e40bd6911d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049901 Oct 05 18:10:33.238158 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2979/5725] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:10:33.710993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:33.711613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:33.719687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:33.720256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:33.720823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:33.721610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:33.722191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:33.722732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:33.760088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:33.760737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:33.761540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:33.762229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lazy-loading 'fault' on Instance uuid a778696d-4283-4e4f-9845-4043d3dfe279 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:10:33.822341 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c37cb897-0d4a-4cca-8eb8-c9e9a6742b59 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 200 len: 1452 microversion: 2.1 time: 0.115388 Oct 05 18:10:33.822932 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2747/5726] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:33 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 1452 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:10:34.847354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:10:34.848290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] [instance: a778696d-4283-4e4f-9845-4043d3dfe279] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:10:34.856118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:34.856694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:34.857315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:34.858023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:10:34.858623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:10:34.859036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:10:34.875447 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] HTTP exception thrown: Instance a778696d-4283-4e4f-9845-4043d3dfe279 could not be found. Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Request method failure captured: Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 HTTP/1.1 Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPch1AZcqqjv4GWaZ_QQpBy-BuArBxrGJn3ABBceg3fAQH1j9NidVC43_vHIMqK26WRWXoZGREWDB9-UHUpNSi1a1LIclFSDabldPyGTROVJHgzD2Cqm6OvwCJp1vP-Em81ZUdW8r07LCdcohbxJCyh-e4C_8giNeB5vUqKGHc5SKabw Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f3e2cf9e849842bd9b3f5cb2a2ba35cd Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestServerMultinode-501645225 Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f3e2cf9e849842bd9b3f5cb2a2ba35cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3e2cf9e849842bd9b3f5cb2a2ba35cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f3e2cf9e849842bd9b3f5cb2a2ba35cd", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f3e2cf9e849842bd9b3f5cb2a2ba35cd"}]}] Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestServerMultinode-501645225 Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f3e2cf9e849842bd9b3f5cb2a2ba35cd Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestServerMultinode-501645225 Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestServerMultinode-501645225-project-admin Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 1dc268bd8c65426e87f28eca9a3c14dc Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestServerMultinode-501645225-project-admin Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance a778696d-4283-4e4f-9845-4043d3dfe279 could not be found. Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'a778696d-4283-4e4f-9845-4043d3dfe279'} Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a778696d-4283-4e4f-9845-4043d3dfe279 could not be found. Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a778696d-4283-4e4f-9845-4043d3dfe279 could not be found. Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:10:34.877439 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:34.881411 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:10:34.881411 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:10:34.881411 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:10:34.881411 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:10:34.881411 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:10:34.881411 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a778696d-4283-4e4f-9845-4043d3dfe279 could not be found. Oct 05 18:10:34.881411 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:10:34.881411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] Returning 404 to user: Instance a778696d-4283-4e4f-9845-4043d3dfe279 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:10:34.881411 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d3e7f713-b897-4c8a-ad97-5c3271c858d6 tempest-TestServerMultinode-501645225 tempest-TestServerMultinode-501645225-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279" status: 404 len: 111 microversion: 2.1 time: 0.037004 Oct 05 18:10:34.881411 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2980/5727] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:10:34 2022] GET /compute/v2.1/servers/a778696d-4283-4e4f-9845-4043d3dfe279 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:11:09.755298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-48938802-9e15-4451-8371-6ab2932fef1e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:09.755905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48938802-9e15-4451-8371-6ab2932fef1e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:09.759565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:11:09.760263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:11:09.763903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48938802-9e15-4451-8371-6ab2932fef1e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:09.764426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48938802-9e15-4451-8371-6ab2932fef1e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:09.764913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48938802-9e15-4451-8371-6ab2932fef1e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:09.765694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48938802-9e15-4451-8371-6ab2932fef1e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:09.766215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48938802-9e15-4451-8371-6ab2932fef1e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:09.766811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-48938802-9e15-4451-8371-6ab2932fef1e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:09.795949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-48938802-9e15-4451-8371-6ab2932fef1e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:11:09.895333 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-48938802-9e15-4451-8371-6ab2932fef1e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "DELETE /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 204 len: 0 microversion: 2.42 time: 0.143013 Oct 05 18:11:09.895938 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2748/5728] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 18:11:09 2022] DELETE /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 18:11:09.904511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:09.905269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:09.909516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:11:09.910425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:11:09.914194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:09.914768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:09.915261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:09.916012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:09.916651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:09.917090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:10.106317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:10.117017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:10.118514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:10.119766 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-29d5e781-d005-4989-9932-1c690aa4aa74 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 2956 microversion: 2.42 time: 0.219420 Oct 05 18:11:10.120381 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2981/5729] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:09 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 2956 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:11.150321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:11.151176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:11.159605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:11.160184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:11.160886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:11.161663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:11.162117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:11.162593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:11.359427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:11.368970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:11.370501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:11.371870 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8be20242-6436-45fd-a588-93c8cd0c8864 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 2956 microversion: 2.42 time: 0.225985 Oct 05 18:11:11.372511 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2749/5730] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:11 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 2956 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:12.402143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:12.404136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:12.413116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:12.413710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:12.414154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:12.415072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:12.415702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:12.416160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:12.983705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:12.993652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:12.995394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:12.996772 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ce3475fb-9934-4e17-a0d8-366133b43a13 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 2956 microversion: 2.42 time: 0.600125 Oct 05 18:11:12.997329 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2982/5731] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:12 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 2956 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:14.026331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:14.027674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:14.034926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:14.035454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:14.036038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:14.036746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:14.037402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:14.037837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:14.203846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:14.215111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:14.216760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:14.218130 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c7af2e2f-d05b-44ef-9df5-bbf135a2dacb tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 2914 microversion: 2.42 time: 0.196255 Oct 05 18:11:14.218845 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2750/5732] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:14 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 2914 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:14.456100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-281e1e17-46ef-4c71-9bce-51ffaf63a804 req-e79ff1c2-f9d5-45c1-aad4-bfca1b9d40fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-deleted", "tag": "edba4c90-72ee-4754-ae83-591d3bb78a74"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:11:14.466634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-281e1e17-46ef-4c71-9bce-51ffaf63a804 req-e79ff1c2-f9d5-45c1-aad4-bfca1b9d40fe service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:14.467397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-281e1e17-46ef-4c71-9bce-51ffaf63a804 req-e79ff1c2-f9d5-45c1-aad4-bfca1b9d40fe service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:14.467850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-281e1e17-46ef-4c71-9bce-51ffaf63a804 req-e79ff1c2-f9d5-45c1-aad4-bfca1b9d40fe service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:14.480648 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-281e1e17-46ef-4c71-9bce-51ffaf63a804 req-e79ff1c2-f9d5-45c1-aad4-bfca1b9d40fe service nova] Creating event network-vif-deleted:edba4c90-72ee-4754-ae83-591d3bb78a74 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:11:14.486466 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-281e1e17-46ef-4c71-9bce-51ffaf63a804 req-e79ff1c2-f9d5-45c1-aad4-bfca1b9d40fe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034009 Oct 05 18:11:14.487092 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2983/5733] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:11:15.246541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:15.247734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:15.255105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:15.266804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:15.267292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:15.268320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:15.268938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:15.269559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:15.523864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d8b35dcb-425d-43b0-8129-720265c49e26 req-9bf54e23-c9fe-480a-9173-0be17c7a2a79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-unplugged", "status": "completed", "tag": "4cfe7d81-9e85-4770-a0af-df6d26210a78"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:11:15.557168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d8b35dcb-425d-43b0-8129-720265c49e26 req-9bf54e23-c9fe-480a-9173-0be17c7a2a79 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:15.557770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d8b35dcb-425d-43b0-8129-720265c49e26 req-9bf54e23-c9fe-480a-9173-0be17c7a2a79 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:15.558334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d8b35dcb-425d-43b0-8129-720265c49e26 req-9bf54e23-c9fe-480a-9173-0be17c7a2a79 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:15.584123 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d8b35dcb-425d-43b0-8129-720265c49e26 req-9bf54e23-c9fe-480a-9173-0be17c7a2a79 service nova] Creating event network-vif-unplugged:4cfe7d81-9e85-4770-a0af-df6d26210a78 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:11:15.594587 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d8b35dcb-425d-43b0-8129-720265c49e26 req-9bf54e23-c9fe-480a-9173-0be17c7a2a79 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076473 Oct 05 18:11:15.602209 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2984/5734] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:11:15.615479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:15.631674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:15.633276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:15.634658 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7861d14c-5637-4093-ba37-7a3b047548f3 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 2709 microversion: 2.42 time: 0.392275 Oct 05 18:11:15.635238 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2751/5735] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:15 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 2709 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:16.508221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-010ec686-e315-4059-85d0-9bfd0fa15aaa req-9949dec5-8783-4338-9a4c-c0f0ade3a64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-deleted", "tag": "a5cc2ce4-af89-4eba-aa9c-1328e1e6bf20"}, {"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-deleted", "tag": "3c0ca083-d78c-4982-a277-9ba89081d68a"}, {"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-deleted", "tag": "4cfe7d81-9e85-4770-a0af-df6d26210a78"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:11:16.520235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-010ec686-e315-4059-85d0-9bfd0fa15aaa req-9949dec5-8783-4338-9a4c-c0f0ade3a64b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:16.521159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-010ec686-e315-4059-85d0-9bfd0fa15aaa req-9949dec5-8783-4338-9a4c-c0f0ade3a64b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:16.521858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-010ec686-e315-4059-85d0-9bfd0fa15aaa req-9949dec5-8783-4338-9a4c-c0f0ade3a64b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:16.537919 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-010ec686-e315-4059-85d0-9bfd0fa15aaa req-9949dec5-8783-4338-9a4c-c0f0ade3a64b service nova] Creating event network-vif-deleted:a5cc2ce4-af89-4eba-aa9c-1328e1e6bf20 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:11:16.539365 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-010ec686-e315-4059-85d0-9bfd0fa15aaa req-9949dec5-8783-4338-9a4c-c0f0ade3a64b service nova] Creating event network-vif-deleted:3c0ca083-d78c-4982-a277-9ba89081d68a for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:11:16.540110 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-010ec686-e315-4059-85d0-9bfd0fa15aaa req-9949dec5-8783-4338-9a4c-c0f0ade3a64b service nova] Creating event network-vif-deleted:4cfe7d81-9e85-4770-a0af-df6d26210a78 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:11:16.546339 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-010ec686-e315-4059-85d0-9bfd0fa15aaa req-9949dec5-8783-4338-9a4c-c0f0ade3a64b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042197 Oct 05 18:11:16.547843 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2985/5736] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:11:16.666361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:16.667281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:16.683029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:16.683827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:16.685008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:16.685959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:16.686862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:16.688512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:16.898683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:16.921464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:16.924424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:16.930471 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ffae4205-65e8-4d34-932a-474bea54fc78 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 2098 microversion: 2.42 time: 0.267841 Oct 05 18:11:16.931669 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2752/5737] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:16 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 2098 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:17.621337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7ea9ba26-d756-4592-9ef2-4078a81d8aad req-4763c6c9-93e1-4680-be83-77c179471c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-unplugged", "status": "completed", "tag": "4e60cc60-031e-46a1-8c43-08a6cacd74e1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:11:17.632288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7ea9ba26-d756-4592-9ef2-4078a81d8aad req-4763c6c9-93e1-4680-be83-77c179471c31 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:17.632781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7ea9ba26-d756-4592-9ef2-4078a81d8aad req-4763c6c9-93e1-4680-be83-77c179471c31 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:17.633222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7ea9ba26-d756-4592-9ef2-4078a81d8aad req-4763c6c9-93e1-4680-be83-77c179471c31 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:17.643784 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7ea9ba26-d756-4592-9ef2-4078a81d8aad req-4763c6c9-93e1-4680-be83-77c179471c31 service nova] Creating event network-vif-unplugged:4e60cc60-031e-46a1-8c43-08a6cacd74e1 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:11:17.648844 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7ea9ba26-d756-4592-9ef2-4078a81d8aad req-4763c6c9-93e1-4680-be83-77c179471c31 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032355 Oct 05 18:11:17.649372 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2986/5738] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:11:17.961610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:17.962329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:17.969614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:17.970615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:17.971210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:17.980847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:17.980847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:17.980847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:18.046520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:18.057111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:18.058804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:18.060151 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-38aa4e79-d8fe-48c0-a837-b3265de36b9f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.103044 Oct 05 18:11:18.060916 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2753/5739] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:17 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:18.570137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-50ed51a3-833d-42d7-a106-0325b01bedf6 req-5cbc309d-650e-4bb7-a15c-3f13b1e4b404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81dd9d23-3714-4c12-a0c6-4c376a1de86c", "name": "network-vif-deleted", "tag": "4e60cc60-031e-46a1-8c43-08a6cacd74e1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:11:18.580717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-50ed51a3-833d-42d7-a106-0325b01bedf6 req-5cbc309d-650e-4bb7-a15c-3f13b1e4b404 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:18.581235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-50ed51a3-833d-42d7-a106-0325b01bedf6 req-5cbc309d-650e-4bb7-a15c-3f13b1e4b404 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:18.581619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-50ed51a3-833d-42d7-a106-0325b01bedf6 req-5cbc309d-650e-4bb7-a15c-3f13b1e4b404 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:18.593035 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-50ed51a3-833d-42d7-a106-0325b01bedf6 req-5cbc309d-650e-4bb7-a15c-3f13b1e4b404 service nova] Creating event network-vif-deleted:4e60cc60-031e-46a1-8c43-08a6cacd74e1 for instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c on n-h1-835595-3 Oct 05 18:11:18.598240 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-50ed51a3-833d-42d7-a106-0325b01bedf6 req-5cbc309d-650e-4bb7-a15c-3f13b1e4b404 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032355 Oct 05 18:11:18.599515 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2987/5740] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:11:19.090345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:19.091124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:19.103991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:19.104571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:19.105120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:19.105933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:19.106517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:19.107042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:19.175799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:19.186301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:19.187902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:19.189868 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a1304381-ff06-4f7f-888f-a31847668ee0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.107058 Oct 05 18:11:19.190138 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2754/5741] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:19 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:20.217067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:20.217762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:20.225434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:20.225926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:20.226411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:20.227107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:20.227568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:20.228006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:20.293999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:20.303765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:20.305234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:20.306469 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-70151e86-c28c-4a9a-803b-8d7a866b807f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.093934 Oct 05 18:11:20.307081 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2988/5742] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:20 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:21.333593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:21.334346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:21.341703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:21.342195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:21.342660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:21.343362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:21.343820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:21.344254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:21.412845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:21.422516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:21.424022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:21.425223 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7cf7d324-6197-4186-93bd-e07049f51f6d tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.095849 Oct 05 18:11:21.425792 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2755/5743] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:21 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:22.452146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:22.452872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:22.460757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:22.461526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:22.461986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:22.462741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:22.463219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:22.463666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:22.532699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:22.542662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:22.544134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:22.545377 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7c9aed4a-7218-41ad-ac5c-69fbffc4dbe0 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.097382 Oct 05 18:11:22.545972 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2989/5744] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:22 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:23.576032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:23.576633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:23.583647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:23.584143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:23.584582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:23.585314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:23.585776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:23.586203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:23.653584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:23.663124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:23.664650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:23.665919 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f4e4ca46-46c1-45c5-a66f-62f6825d178f tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.094240 Oct 05 18:11:23.666788 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2756/5745] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:23 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:24.692784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:24.693347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:24.700719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:24.701219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:24.701663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:24.702400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:24.702867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:24.703299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:24.769695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:24.784204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:24.786104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:24.787389 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81e602ae-6b03-42f7-954e-e90bdd7988ec tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.098947 Oct 05 18:11:24.787979 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2990/5746] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:24 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:25.813517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:25.815082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:25.823531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:25.824347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:25.824795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:25.825507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:25.825979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:25.826433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:25.895007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:25.904631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:25.906094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:25.907346 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa2ba2a3-387b-4a81-9137-988692b02ff4 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.097879 Oct 05 18:11:25.907964 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2757/5747] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:25 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:26.934550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:26.935835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:26.943314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:26.943857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:26.944307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:26.945054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:26.945526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:26.945967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:27.011382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:27.021072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:27.022589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:27.023847 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f48b47a2-b22c-4c3e-9bd8-fa582b93bf54 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.093391 Oct 05 18:11:27.024428 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2991/5748] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:26 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:28.051814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:28.052432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:28.060085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:28.060592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:28.061001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:28.061737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:28.062232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:28.062756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:28.130234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:28.141012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:28.142473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:28.143836 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b3493f33-4766-4185-ac72-8f83c4e8d23a tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.096194 Oct 05 18:11:28.144623 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2758/5749] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:28 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:29.170026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:29.170630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:29.178038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:29.178602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:29.179055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:29.180970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:29.181505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:29.181954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:29.256063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:29.265640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:29.267146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:29.268378 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0573770c-9937-47a1-bdcf-e72286c29ca8 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.102832 Oct 05 18:11:29.268930 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2992/5750] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:29 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:30.295427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:30.296015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:30.303169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:30.303662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:30.304098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:30.304795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:30.305247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:30.305673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:30.373002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:30.384756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:30.386444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:30.387845 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b862f15c-a550-43ef-9d68-e5299863d6ca tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.096784 Oct 05 18:11:30.388916 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2759/5751] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:30 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:31.415162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:31.416746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:31.432237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:31.434317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:31.434972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:31.435885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:31.436538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:31.437174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:31.633921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:31.633921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:31.633921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:31.633921 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bdfbbade-d42f-4182-8121-ede15ddeac96 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.117529 Oct 05 18:11:31.633921 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2993/5752] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:31 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:32.555960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:32.556724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:32.564558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:32.565086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:32.565522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:32.566329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:32.566892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:32.567513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:32.637188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:32.648052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:32.649695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:32.650920 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c2d5fce6-ef31-4496-807b-51b8bbb88b08 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.099133 Oct 05 18:11:32.654490 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2760/5753] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:32 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:33.681742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:33.682617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:33.703568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:33.704353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:33.705212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:33.705926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:33.706426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:33.706852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:33.772906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:33.795563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:33.797246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7520f0c3cabe49368cb54fc3b87cf611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b54fc4fbe243c0ac614e4a707d7ccf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:11:33.798540 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b7f55f26-0783-4239-aa55-c05db846eb82 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 200 len: 1605 microversion: 2.42 time: 0.121080 Oct 05 18:11:33.799330 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2994/5754] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:33 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 1605 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:11:35.074315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:35.075135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:35.081406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:35.081895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:35.082406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:35.083121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:35.083585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:35.083988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:35.098365 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] HTTP exception thrown: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Request method failure captured: Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c HTTP/1.1 Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcehIGOpsJkVCCv3yxkFytdrcNTUhC_3TWeU8d9YXPgqCqf-WHKatpIEnPPaEXMHPfNna0K3SoazJ1Y5r61WcrnFS0soD7UFgTE7qpmYSnDgS9VJrHMMdhUrVrqB22O4AoO4YXfQ_GlmWuYV4h9JMSgk0TXLGaJw8cNSFVIbqEvl73Y Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.42 Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 74b54fc4fbe243c0ac614e4a707d7ccf Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-139345981 Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/74b54fc4fbe243c0ac614e4a707d7ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/74b54fc4fbe243c0ac614e4a707d7ccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_74b54fc4fbe243c0ac614e4a707d7ccf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/74b54fc4fbe243c0ac614e4a707d7ccf"}]}] Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TaggedBootDevicesTest_v242-139345981 Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 74b54fc4fbe243c0ac614e4a707d7ccf Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-139345981 Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TaggedBootDevicesTest_v242-139345981-project Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 7520f0c3cabe49368cb54fc3b87cf611 Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TaggedBootDevicesTest_v242-139345981-project Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '81dd9d23-3714-4c12-a0c6-4c376a1de86c'} Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:11:35.100079 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Returning 404 to user: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9c085096-680d-4b46-8591-184caac67e5e tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 404 len: 111 microversion: 2.42 time: 0.280513 Oct 05 18:11:35.108761 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2761/5755] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:34 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 111 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 05 18:11:35.113591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4ba957a1-2658-4ab5-8ea7-c0209323817b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '.version_select at 0x7f776c7034c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:35.136348 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4ba957a1-2658-4ab5-8ea7-c0209323817b tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512616503" status: 204 len: 0 microversion: 2.42 time: 0.027781 Oct 05 18:11:35.137612 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2995/5756] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 18:11:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1512616503 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 18:11:38.437529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:38.438524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:38.446573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:38.447224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:38.447906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:38.449765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:38.450473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:38.451468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:38.466331 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] HTTP exception thrown: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Request method failure captured: Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c HTTP/1.1 Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcehIGOpsJkVCCv3yxkFytdrcNTUhC_3TWeU8d9YXPgqCqf-WHKatpIEnPPaEXMHPfNna0K3SoazJ1Y5r61WcrnFS0soD7UFgTE7qpmYSnDgS9VJrHMMdhUrVrqB22O4AoO4YXfQ_GlmWuYV4h9JMSgk0TXLGaJw8cNSFVIbqEvl73Y Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.42 Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 74b54fc4fbe243c0ac614e4a707d7ccf Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-139345981 Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/74b54fc4fbe243c0ac614e4a707d7ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/74b54fc4fbe243c0ac614e4a707d7ccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_74b54fc4fbe243c0ac614e4a707d7ccf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/74b54fc4fbe243c0ac614e4a707d7ccf"}]}] Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TaggedBootDevicesTest_v242-139345981 Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 74b54fc4fbe243c0ac614e4a707d7ccf Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-139345981 Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TaggedBootDevicesTest_v242-139345981-project Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 7520f0c3cabe49368cb54fc3b87cf611 Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TaggedBootDevicesTest_v242-139345981-project Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '81dd9d23-3714-4c12-a0c6-4c376a1de86c'} Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:11:38.468371 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:11:38.473448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Returning 404 to user: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:11:38.474927 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-104f03c9-2197-4d30-9cb0-badfbde1a254 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "DELETE /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 404 len: 111 microversion: 2.42 time: 0.041334 Oct 05 18:11:38.475982 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2762/5757] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 18:11:38 2022] DELETE /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:11:38.485000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:11:38.485900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] [instance: 81dd9d23-3714-4c12-a0c6-4c376a1de86c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:11:38.493322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:38.493830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:38.494321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:38.495089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:11:38.495593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:11:38.496082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:11:38.517063 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] HTTP exception thrown: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Request method failure captured: Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c HTTP/1.1 Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcehIGOpsJkVCCv3yxkFytdrcNTUhC_3TWeU8d9YXPgqCqf-WHKatpIEnPPaEXMHPfNna0K3SoazJ1Y5r61WcrnFS0soD7UFgTE7qpmYSnDgS9VJrHMMdhUrVrqB22O4AoO4YXfQ_GlmWuYV4h9JMSgk0TXLGaJw8cNSFVIbqEvl73Y Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.42 Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 74b54fc4fbe243c0ac614e4a707d7ccf Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-139345981 Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/74b54fc4fbe243c0ac614e4a707d7ccf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/74b54fc4fbe243c0ac614e4a707d7ccf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_74b54fc4fbe243c0ac614e4a707d7ccf", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/74b54fc4fbe243c0ac614e4a707d7ccf"}]}] Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TaggedBootDevicesTest_v242-139345981 Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 74b54fc4fbe243c0ac614e4a707d7ccf Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-139345981 Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TaggedBootDevicesTest_v242-139345981-project Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 7520f0c3cabe49368cb54fc3b87cf611 Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TaggedBootDevicesTest_v242-139345981-project Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '81dd9d23-3714-4c12-a0c6-4c376a1de86c'} Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:11:38.518329 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] Returning 404 to user: Instance 81dd9d23-3714-4c12-a0c6-4c376a1de86c could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e6603a83-be7d-407b-859e-4c5d712798b5 tempest-TaggedBootDevicesTest_v242-139345981 tempest-TaggedBootDevicesTest_v242-139345981-project] 10.222.0.70 "GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c" status: 404 len: 111 microversion: 2.42 time: 0.040051 Oct 05 18:11:38.523870 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2996/5758] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:11:38 2022] GET /compute/v2.1/servers/81dd9d23-3714-4c12-a0c6-4c376a1de86c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:12:00.412735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ef278d9b-d58e-48f6-9531-75b4e3032044 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:00.413349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ef278d9b-d58e-48f6-9531-75b4e3032044 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:00.421924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:00.422667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:00.424122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef278d9b-d58e-48f6-9531-75b4e3032044 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:00.424625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef278d9b-d58e-48f6-9531-75b4e3032044 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:00.425134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef278d9b-d58e-48f6-9531-75b4e3032044 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:00.429122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef278d9b-d58e-48f6-9531-75b4e3032044 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:00.430896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef278d9b-d58e-48f6-9531-75b4e3032044 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:00.432194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef278d9b-d58e-48f6-9531-75b4e3032044 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:00.480078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ef278d9b-d58e-48f6-9531-75b4e3032044 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:12:00.586588 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ef278d9b-d58e-48f6-9531-75b4e3032044 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 204 len: 0 microversion: 2.1 time: 0.177113 Oct 05 18:12:00.588190 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2763/5759] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:12:00 2022] DELETE /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:12:00.597423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d5c1abd-677e-41e9-97e0-3235cd1a419a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:00.598017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9d5c1abd-677e-41e9-97e0-3235cd1a419a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:00.601710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:00.604552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=66 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:00.619797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5c1abd-677e-41e9-97e0-3235cd1a419a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:00.620806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5c1abd-677e-41e9-97e0-3235cd1a419a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:00.621747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5c1abd-677e-41e9-97e0-3235cd1a419a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:00.622771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5c1abd-677e-41e9-97e0-3235cd1a419a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:00.623607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5c1abd-677e-41e9-97e0-3235cd1a419a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:00.625022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d5c1abd-677e-41e9-97e0-3235cd1a419a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:00.790501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9d5c1abd-677e-41e9-97e0-3235cd1a419a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:00.800915 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9d5c1abd-677e-41e9-97e0-3235cd1a419a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1577 microversion: 2.1 time: 0.207909 Oct 05 18:12:00.801549 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2997/5760] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:00 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:01.826642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2b6c2469-7b5d-4edb-82ae-6d94305e715a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:01.828364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2b6c2469-7b5d-4edb-82ae-6d94305e715a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:01.844367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b6c2469-7b5d-4edb-82ae-6d94305e715a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:01.848035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b6c2469-7b5d-4edb-82ae-6d94305e715a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:01.851608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b6c2469-7b5d-4edb-82ae-6d94305e715a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:01.852760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b6c2469-7b5d-4edb-82ae-6d94305e715a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:01.856674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b6c2469-7b5d-4edb-82ae-6d94305e715a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:01.857566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2b6c2469-7b5d-4edb-82ae-6d94305e715a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:02.300672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2b6c2469-7b5d-4edb-82ae-6d94305e715a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:02.319481 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2b6c2469-7b5d-4edb-82ae-6d94305e715a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1577 microversion: 2.1 time: 0.497883 Oct 05 18:12:02.323984 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2764/5761] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:01 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1577 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:03.345355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f779782a-e5b5-46dc-a424-a74af708b5f0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:03.345993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f779782a-e5b5-46dc-a424-a74af708b5f0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:03.356972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f779782a-e5b5-46dc-a424-a74af708b5f0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:03.365147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f779782a-e5b5-46dc-a424-a74af708b5f0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:03.366015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f779782a-e5b5-46dc-a424-a74af708b5f0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:03.367501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f779782a-e5b5-46dc-a424-a74af708b5f0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:03.368292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f779782a-e5b5-46dc-a424-a74af708b5f0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:03.368927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f779782a-e5b5-46dc-a424-a74af708b5f0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:03.772661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f779782a-e5b5-46dc-a424-a74af708b5f0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:03.783571 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f779782a-e5b5-46dc-a424-a74af708b5f0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1510 microversion: 2.1 time: 0.442178 Oct 05 18:12:03.784189 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2998/5762] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:03 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1510 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:03.887947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c502e8a5-12ea-41b3-8246-20f282d45d61 req-2a517e1e-a6dd-4181-bfb2-555983cc5c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e579606a-2e51-481b-b60f-562dbaa11b33", "name": "network-vif-deleted", "tag": "3b742e56-6dfc-405f-99ec-5eebad8a5d49"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:03.920625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c502e8a5-12ea-41b3-8246-20f282d45d61 req-2a517e1e-a6dd-4181-bfb2-555983cc5c89 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:03.921149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c502e8a5-12ea-41b3-8246-20f282d45d61 req-2a517e1e-a6dd-4181-bfb2-555983cc5c89 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:03.921660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c502e8a5-12ea-41b3-8246-20f282d45d61 req-2a517e1e-a6dd-4181-bfb2-555983cc5c89 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:03.969954 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c502e8a5-12ea-41b3-8246-20f282d45d61 req-2a517e1e-a6dd-4181-bfb2-555983cc5c89 service nova] Creating event network-vif-deleted:3b742e56-6dfc-405f-99ec-5eebad8a5d49 for instance e579606a-2e51-481b-b60f-562dbaa11b33 on n-h1-835595-3 Oct 05 18:12:03.990123 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c502e8a5-12ea-41b3-8246-20f282d45d61 req-2a517e1e-a6dd-4181-bfb2-555983cc5c89 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105744 Oct 05 18:12:03.996715 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2765/5763] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:04.818973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12974e00-3211-4022-a177-9bdd65ca9d25 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:04.820383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12974e00-3211-4022-a177-9bdd65ca9d25 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:04.829657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12974e00-3211-4022-a177-9bdd65ca9d25 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:04.830672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12974e00-3211-4022-a177-9bdd65ca9d25 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:04.831954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12974e00-3211-4022-a177-9bdd65ca9d25 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:04.832946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12974e00-3211-4022-a177-9bdd65ca9d25 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:04.833637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12974e00-3211-4022-a177-9bdd65ca9d25 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:04.834300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12974e00-3211-4022-a177-9bdd65ca9d25 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:04.969354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-12974e00-3211-4022-a177-9bdd65ca9d25 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:04.989490 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12974e00-3211-4022-a177-9bdd65ca9d25 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1226 microversion: 2.1 time: 0.182316 Oct 05 18:12:04.991619 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 2999/5764] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:04 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1226 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:06.022347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9b424317-9572-4f79-8b0f-936efb01be4f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:06.025071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9b424317-9572-4f79-8b0f-936efb01be4f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:06.068384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b424317-9572-4f79-8b0f-936efb01be4f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:06.069438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b424317-9572-4f79-8b0f-936efb01be4f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:06.070633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b424317-9572-4f79-8b0f-936efb01be4f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:06.072703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b424317-9572-4f79-8b0f-936efb01be4f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:06.073623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b424317-9572-4f79-8b0f-936efb01be4f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:06.074298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9b424317-9572-4f79-8b0f-936efb01be4f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:06.188005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-76608060", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "58ab1e7f-1146-46c6-b1de-8019f372eafc"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:06.227918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9b424317-9572-4f79-8b0f-936efb01be4f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:06.236698 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9b424317-9572-4f79-8b0f-936efb01be4f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1226 microversion: 2.1 time: 0.220913 Oct 05 18:12:06.254130 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3000/5765] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:06 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1226 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:06.261493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] validate_networks() for [('58ab1e7f-1146-46c6-b1de-8019f372eafc', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:12:06.926095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:12:06.926812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:12:06.927930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:12:06.928761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:12:06.929556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:12:06.943118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:06.943884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:06.944522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:06.945578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:06.946656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:06.947396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:07.004935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Getting quotas for project 5eb98217631b42f19a475ee55b5ed122. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:12:07.024265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Getting quotas for user 4a1e8857fc674dc181ec575733c635b7 and project 5eb98217631b42f19a475ee55b5ed122. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:12:07.060161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:12:07.065466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:12:07.119420 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f21e2bb1-fdee-48bb-bf08-89c8484ef4a1 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.442458 Oct 05 18:12:07.120098 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2766/5766] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:12:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:12:07.132902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd457974-f648-4a49-b47b-e6b584603675 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:07.134474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fd457974-f648-4a49-b47b-e6b584603675 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:07.234318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd457974-f648-4a49-b47b-e6b584603675 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:07.242564 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd457974-f648-4a49-b47b-e6b584603675 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1223 microversion: 2.1 time: 0.113554 Oct 05 18:12:07.243082 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3001/5767] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:07 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:07.265063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a7a96408-8d24-4eca-a888-8f2f5565a787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:07.265855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a7a96408-8d24-4eca-a888-8f2f5565a787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:07.278479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a96408-8d24-4eca-a888-8f2f5565a787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:07.279030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a96408-8d24-4eca-a888-8f2f5565a787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:07.280218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a96408-8d24-4eca-a888-8f2f5565a787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:07.280950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a96408-8d24-4eca-a888-8f2f5565a787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:07.281414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a96408-8d24-4eca-a888-8f2f5565a787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:07.281842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7a96408-8d24-4eca-a888-8f2f5565a787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:07.358515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a7a96408-8d24-4eca-a888-8f2f5565a787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:07.367656 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a7a96408-8d24-4eca-a888-8f2f5565a787 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1226 microversion: 2.1 time: 0.107300 Oct 05 18:12:07.383286 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2767/5768] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:07 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:08.270297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f76af61c-26fb-4682-b450-642e0683a4c4 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:08.272426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f76af61c-26fb-4682-b450-642e0683a4c4 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:08.282867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f76af61c-26fb-4682-b450-642e0683a4c4 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:08.283740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f76af61c-26fb-4682-b450-642e0683a4c4 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:08.284467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f76af61c-26fb-4682-b450-642e0683a4c4 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:08.285425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f76af61c-26fb-4682-b450-642e0683a4c4 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:08.286329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f76af61c-26fb-4682-b450-642e0683a4c4 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:08.286973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f76af61c-26fb-4682-b450-642e0683a4c4 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:08.365452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f76af61c-26fb-4682-b450-642e0683a4c4 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:08.374954 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f76af61c-26fb-4682-b450-642e0683a4c4 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1275 microversion: 2.1 time: 0.109678 Oct 05 18:12:08.390307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-35d631ab-0d2e-4db4-92ae-ce393a0e4627 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:08.391469 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3002/5769] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:08 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1275 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:08.392306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-35d631ab-0d2e-4db4-92ae-ce393a0e4627 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:08.399577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35d631ab-0d2e-4db4-92ae-ce393a0e4627 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:08.405007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35d631ab-0d2e-4db4-92ae-ce393a0e4627 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:08.405854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35d631ab-0d2e-4db4-92ae-ce393a0e4627 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:08.407285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35d631ab-0d2e-4db4-92ae-ce393a0e4627 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:08.411241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35d631ab-0d2e-4db4-92ae-ce393a0e4627 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:08.411913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35d631ab-0d2e-4db4-92ae-ce393a0e4627 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:08.575457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-35d631ab-0d2e-4db4-92ae-ce393a0e4627 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:08.591182 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-35d631ab-0d2e-4db4-92ae-ce393a0e4627 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1226 microversion: 2.1 time: 0.204705 Oct 05 18:12:08.606382 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2768/5770] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:08 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1226 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:09.399265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86913628-8d11-4fe1-9892-df2b790e0cc9 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:09.399888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-86913628-8d11-4fe1-9892-df2b790e0cc9 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:09.415996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86913628-8d11-4fe1-9892-df2b790e0cc9 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:09.416680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86913628-8d11-4fe1-9892-df2b790e0cc9 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:09.417274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86913628-8d11-4fe1-9892-df2b790e0cc9 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:09.418089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86913628-8d11-4fe1-9892-df2b790e0cc9 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:09.418655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86913628-8d11-4fe1-9892-df2b790e0cc9 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:09.421264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86913628-8d11-4fe1-9892-df2b790e0cc9 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:09.615151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e75253e-2186-48dd-822f-e7f3ce1c94e0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:09.616311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e75253e-2186-48dd-822f-e7f3ce1c94e0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:09.635774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e75253e-2186-48dd-822f-e7f3ce1c94e0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:09.636538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e75253e-2186-48dd-822f-e7f3ce1c94e0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:09.637589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e75253e-2186-48dd-822f-e7f3ce1c94e0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:09.638351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e75253e-2186-48dd-822f-e7f3ce1c94e0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:09.638776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e75253e-2186-48dd-822f-e7f3ce1c94e0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:09.639196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e75253e-2186-48dd-822f-e7f3ce1c94e0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:09.749542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-86913628-8d11-4fe1-9892-df2b790e0cc9 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:09.759096 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-86913628-8d11-4fe1-9892-df2b790e0cc9 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1323 microversion: 2.1 time: 0.363687 Oct 05 18:12:09.774312 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3003/5771] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:09 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:09.794649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2e75253e-2186-48dd-822f-e7f3ce1c94e0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:09.812126 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e75253e-2186-48dd-822f-e7f3ce1c94e0 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 200 len: 1226 microversion: 2.1 time: 0.202467 Oct 05 18:12:09.813284 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2769/5772] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:09 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 1226 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:10.674391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-fbb4ee6f-fc88-4c30-b025-b995b3bdf6fb req-85b1863a-1c58-44d4-9071-c3a863440803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c", "tag": "4a049baf-30a4-45ba-a38f-1750e51c6b25"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:10.685115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fbb4ee6f-fc88-4c30-b025-b995b3bdf6fb req-85b1863a-1c58-44d4-9071-c3a863440803 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:10.685640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fbb4ee6f-fc88-4c30-b025-b995b3bdf6fb req-85b1863a-1c58-44d4-9071-c3a863440803 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:10.686067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fbb4ee6f-fc88-4c30-b025-b995b3bdf6fb req-85b1863a-1c58-44d4-9071-c3a863440803 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:10.785828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cadba895-35d7-4bab-b71b-f696899adc82 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:10.787121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cadba895-35d7-4bab-b71b-f696899adc82 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:10.806331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cadba895-35d7-4bab-b71b-f696899adc82 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:10.807221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cadba895-35d7-4bab-b71b-f696899adc82 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:10.807844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cadba895-35d7-4bab-b71b-f696899adc82 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:10.808741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cadba895-35d7-4bab-b71b-f696899adc82 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:10.813018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cadba895-35d7-4bab-b71b-f696899adc82 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:10.813969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cadba895-35d7-4bab-b71b-f696899adc82 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:11.044995 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-fbb4ee6f-fc88-4c30-b025-b995b3bdf6fb req-85b1863a-1c58-44d4-9071-c3a863440803 service nova] Creating event network-changed:4a049baf-30a4-45ba-a38f-1750e51c6b25 for instance bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c on n-h2-835595-3 Oct 05 18:12:11.050440 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-fbb4ee6f-fc88-4c30-b025-b995b3bdf6fb req-85b1863a-1c58-44d4-9071-c3a863440803 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.379821 Oct 05 18:12:11.051038 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3004/5773] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:11.056335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:11.057282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:11.064406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:11.064927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:11.065367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:11.066112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:11.066623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:11.067043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:11.081476 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 HTTP/1.1 Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e579606a-2e51-481b-b60f-562dbaa11b33'} Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:12:11.083489 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:11.088258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:11.088258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:12:11.088258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:12:11.088258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:12:11.088258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:12:11.088258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:12:11.088258 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:11.089514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:12:11.090578 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-05558625-8cda-4c6e-b273-4ade91d8366d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 404 len: 111 microversion: 2.1 time: 0.038265 Oct 05 18:12:11.100307 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3005/5774] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:11 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:12:11.201173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1316439223", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1735877736", "security_groups": [{"name": "tempest-secgroup-smoke-477833963"}], "block_device_mapping_v2": [{"uuid": "c049b219-8aae-405f-970d-16b0f74e6a78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "adb1494a-27b0-43e0-8027-66e89e0c81ad"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:11.332485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] validate_networks() for [('adb1494a-27b0-43e0-8027-66e89e0c81ad', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:12:11.378300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cadba895-35d7-4bab-b71b-f696899adc82 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:11.388229 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cadba895-35d7-4bab-b71b-f696899adc82 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1323 microversion: 2.1 time: 0.607557 Oct 05 18:12:11.396626 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2770/5775] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:10 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1323 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:12:11.810375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:12:11.811009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:12:11.811682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:12:11.812219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:12:11.812752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:12:11.822945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:11.823583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:11.824031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:11.825103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:11.825579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:11.826336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:11.844673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:12:11.850182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for user 8a900e5bf82d462a9113d6e6461ea3a0 and project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:12:11.934813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:12:11.937820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c049b219-8aae-405f-970d-16b0f74e6a78',volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:12:12.103051 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d9406091-b741-47b8-8a3d-0c9554b8f65c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.905772 Oct 05 18:12:12.104342 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3006/5776] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:12:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:12:12.115413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fee80eda-2f99-4e0a-9f1f-9e20c010e070 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:12.116039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fee80eda-2f99-4e0a-9f1f-9e20c010e070 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:12.251385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fee80eda-2f99-4e0a-9f1f-9e20c010e070 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:12.271859 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fee80eda-2f99-4e0a-9f1f-9e20c010e070 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1095 microversion: 2.1 time: 0.158736 Oct 05 18:12:12.275325 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2771/5777] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:12 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1095 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:12.413115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c35c05f9-b991-49c6-bc9c-8af2f1684d63 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:12.414109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c35c05f9-b991-49c6-bc9c-8af2f1684d63 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:12.427542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c35c05f9-b991-49c6-bc9c-8af2f1684d63 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:12.429829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c35c05f9-b991-49c6-bc9c-8af2f1684d63 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:12.435014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c35c05f9-b991-49c6-bc9c-8af2f1684d63 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:12.436817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c35c05f9-b991-49c6-bc9c-8af2f1684d63 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:12.438453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c35c05f9-b991-49c6-bc9c-8af2f1684d63 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:12.443382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c35c05f9-b991-49c6-bc9c-8af2f1684d63 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:12.770400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c35c05f9-b991-49c6-bc9c-8af2f1684d63 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:12.781185 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c35c05f9-b991-49c6-bc9c-8af2f1684d63 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1323 microversion: 2.1 time: 0.372783 Oct 05 18:12:12.794865 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3007/5778] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:12 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1323 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:13.298779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-89023cdf-2619-4d06-938f-ac1e49dc3657 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:13.299649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-89023cdf-2619-4d06-938f-ac1e49dc3657 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:13.308908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89023cdf-2619-4d06-938f-ac1e49dc3657 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:13.309586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89023cdf-2619-4d06-938f-ac1e49dc3657 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:13.310129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89023cdf-2619-4d06-938f-ac1e49dc3657 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:13.311074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89023cdf-2619-4d06-938f-ac1e49dc3657 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:13.311813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89023cdf-2619-4d06-938f-ac1e49dc3657 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:13.312471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89023cdf-2619-4d06-938f-ac1e49dc3657 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:13.382385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-89023cdf-2619-4d06-938f-ac1e49dc3657 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:13.395977 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-89023cdf-2619-4d06-938f-ac1e49dc3657 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1193 microversion: 2.1 time: 0.102978 Oct 05 18:12:13.397134 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2772/5779] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:13 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:13.805159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6d5d2aed-22cf-495e-9ce1-82bc11e948cd tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:13.805792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6d5d2aed-22cf-495e-9ce1-82bc11e948cd tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:13.825836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d5d2aed-22cf-495e-9ce1-82bc11e948cd tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:13.826395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d5d2aed-22cf-495e-9ce1-82bc11e948cd tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:13.827114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d5d2aed-22cf-495e-9ce1-82bc11e948cd tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:13.828023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d5d2aed-22cf-495e-9ce1-82bc11e948cd tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:13.829961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d5d2aed-22cf-495e-9ce1-82bc11e948cd tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:13.830641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d5d2aed-22cf-495e-9ce1-82bc11e948cd tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:14.419601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-38749039-62e2-4fae-b915-fc8a997c0a10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:14.420845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-38749039-62e2-4fae-b915-fc8a997c0a10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:14.434178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38749039-62e2-4fae-b915-fc8a997c0a10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:14.438331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38749039-62e2-4fae-b915-fc8a997c0a10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:14.439007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38749039-62e2-4fae-b915-fc8a997c0a10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:14.439650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38749039-62e2-4fae-b915-fc8a997c0a10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:14.440184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38749039-62e2-4fae-b915-fc8a997c0a10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:14.440613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-38749039-62e2-4fae-b915-fc8a997c0a10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:14.516700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6d5d2aed-22cf-495e-9ce1-82bc11e948cd tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:14.535398 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6d5d2aed-22cf-495e-9ce1-82bc11e948cd tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1323 microversion: 2.1 time: 0.734085 Oct 05 18:12:14.536036 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3008/5780] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:13 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1323 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:14.870679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-38749039-62e2-4fae-b915-fc8a997c0a10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:14.880052 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-38749039-62e2-4fae-b915-fc8a997c0a10 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1278 microversion: 2.1 time: 0.464531 Oct 05 18:12:14.880648 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2773/5781] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:14 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1278 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:15.558786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5c27c3a-14d0-435f-af5f-24896e0bae28 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:15.559527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5c27c3a-14d0-435f-af5f-24896e0bae28 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:15.573014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c27c3a-14d0-435f-af5f-24896e0bae28 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:15.573629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c27c3a-14d0-435f-af5f-24896e0bae28 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:15.574112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c27c3a-14d0-435f-af5f-24896e0bae28 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:15.579685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c27c3a-14d0-435f-af5f-24896e0bae28 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:15.580640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c27c3a-14d0-435f-af5f-24896e0bae28 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:15.583175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5c27c3a-14d0-435f-af5f-24896e0bae28 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:15.910623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bdc5ffa7-7490-40a7-9337-f09eb8478f35 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:15.911148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bdc5ffa7-7490-40a7-9337-f09eb8478f35 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:15.918565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdc5ffa7-7490-40a7-9337-f09eb8478f35 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:15.919075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdc5ffa7-7490-40a7-9337-f09eb8478f35 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:15.919515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdc5ffa7-7490-40a7-9337-f09eb8478f35 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:15.920227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdc5ffa7-7490-40a7-9337-f09eb8478f35 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:15.920685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdc5ffa7-7490-40a7-9337-f09eb8478f35 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:15.921113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bdc5ffa7-7490-40a7-9337-f09eb8478f35 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:15.942055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f5c27c3a-14d0-435f-af5f-24896e0bae28 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:15.954443 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5c27c3a-14d0-435f-af5f-24896e0bae28 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1323 microversion: 2.1 time: 0.399727 Oct 05 18:12:15.955859 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3009/5782] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:15 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1323 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:16.004758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-eaf58b8f-abcf-402b-948f-423381a5fd10 req-947e2f67-8b3c-4b4f-b89a-6f026a57dec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73029889-efdd-4945-a1cd-9d931be98e4b", "tag": "62fba8f6-9d08-4dc1-9ec0-c9ab8b5ecf0a"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:16.038598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-eaf58b8f-abcf-402b-948f-423381a5fd10 req-947e2f67-8b3c-4b4f-b89a-6f026a57dec8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:16.040478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-eaf58b8f-abcf-402b-948f-423381a5fd10 req-947e2f67-8b3c-4b4f-b89a-6f026a57dec8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:16.041861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-eaf58b8f-abcf-402b-948f-423381a5fd10 req-947e2f67-8b3c-4b4f-b89a-6f026a57dec8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:16.064521 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-eaf58b8f-abcf-402b-948f-423381a5fd10 req-947e2f67-8b3c-4b4f-b89a-6f026a57dec8 service nova] Creating event network-changed:62fba8f6-9d08-4dc1-9ec0-c9ab8b5ecf0a for instance 73029889-efdd-4945-a1cd-9d931be98e4b on n-h1-835595-3 Oct 05 18:12:16.071243 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-eaf58b8f-abcf-402b-948f-423381a5fd10 req-947e2f67-8b3c-4b4f-b89a-6f026a57dec8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070649 Oct 05 18:12:16.073113 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3010/5783] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:16.259303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bdc5ffa7-7490-40a7-9337-f09eb8478f35 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:16.270536 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bdc5ffa7-7490-40a7-9337-f09eb8478f35 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1278 microversion: 2.1 time: 0.366975 Oct 05 18:12:16.271390 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2774/5784] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:15 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1278 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:12:16.985927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-db919381-8df3-4cbc-9764-172595ad476e tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:16.987472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-db919381-8df3-4cbc-9764-172595ad476e tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:17.005496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db919381-8df3-4cbc-9764-172595ad476e tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:17.006457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db919381-8df3-4cbc-9764-172595ad476e tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:17.007155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db919381-8df3-4cbc-9764-172595ad476e tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:17.010521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db919381-8df3-4cbc-9764-172595ad476e tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:17.011413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db919381-8df3-4cbc-9764-172595ad476e tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:17.012411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db919381-8df3-4cbc-9764-172595ad476e tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:17.133757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b9c35497-584e-4cf5-8f1f-5df981133228 req-442f8bc4-66d3-49c6-8c3c-02e8d6ae0dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c", "name": "network-vif-plugged", "status": "completed", "tag": "4a049baf-30a4-45ba-a38f-1750e51c6b25"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:17.161686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:17.164270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b9c35497-584e-4cf5-8f1f-5df981133228 req-442f8bc4-66d3-49c6-8c3c-02e8d6ae0dc4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:17.165658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b9c35497-584e-4cf5-8f1f-5df981133228 req-442f8bc4-66d3-49c6-8c3c-02e8d6ae0dc4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:17.165658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b9c35497-584e-4cf5-8f1f-5df981133228 req-442f8bc4-66d3-49c6-8c3c-02e8d6ae0dc4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:17.187990 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b9c35497-584e-4cf5-8f1f-5df981133228 req-442f8bc4-66d3-49c6-8c3c-02e8d6ae0dc4 service nova] Creating event network-vif-plugged:4a049baf-30a4-45ba-a38f-1750e51c6b25 for instance bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c on n-h2-835595-3 Oct 05 18:12:17.201905 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b9c35497-584e-4cf5-8f1f-5df981133228 req-442f8bc4-66d3-49c6-8c3c-02e8d6ae0dc4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072752 Oct 05 18:12:17.203121 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2775/5785] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:12:17.294359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-be4fa645-ea25-4249-8760-1b3eca0d63ac tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:17.295275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-be4fa645-ea25-4249-8760-1b3eca0d63ac tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:17.308363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4fa645-ea25-4249-8760-1b3eca0d63ac tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:17.313969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4fa645-ea25-4249-8760-1b3eca0d63ac tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:17.314959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4fa645-ea25-4249-8760-1b3eca0d63ac tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:17.315962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4fa645-ea25-4249-8760-1b3eca0d63ac tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:17.319673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4fa645-ea25-4249-8760-1b3eca0d63ac tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:17.321192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be4fa645-ea25-4249-8760-1b3eca0d63ac tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:17.475081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-db919381-8df3-4cbc-9764-172595ad476e tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:17.487392 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-db919381-8df3-4cbc-9764-172595ad476e tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1323 microversion: 2.1 time: 0.511066 Oct 05 18:12:17.489849 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3011/5786] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:16 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1323 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:18.027969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cd08ef05-5ece-459c-a0d5-e721afaaf73e tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Action: 'create', calling method: .version_select at 0x7f776ff94790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-140577709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAh0b4WowxHRAU07URrTp+iZEtYvwX1pKpAAsEnH3qNQoYc7cNmGI47RvhJkdll8Er6WH304NKTjqP/2dCmavoZmiJsh+w8KoT4Q5KQQ7zTymHCk7Tnr/MvhDEO+SjXbaQ=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:18.059428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-cd08ef05-5ece-459c-a0d5-e721afaaf73e tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for project 2fe00cc2c3494b749a02868d27f89977. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:12:18.066232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-cd08ef05-5ece-459c-a0d5-e721afaaf73e tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for user 18188fb109574bf38443d2848a77bf69 and project 2fe00cc2c3494b749a02868d27f89977. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:12:18.072350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-be4fa645-ea25-4249-8760-1b3eca0d63ac tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:18.086106 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-be4fa645-ea25-4249-8760-1b3eca0d63ac tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1278 microversion: 2.1 time: 0.796221 Oct 05 18:12:18.087328 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2776/5787] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:17 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1278 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:18.110326 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cd08ef05-5ece-459c-a0d5-e721afaaf73e tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.086441 Oct 05 18:12:18.111103 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3012/5788] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:12:18 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:18.515262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-454dfdb8-c076-4383-bea4-63f9f9e791a7 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:18.515882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-454dfdb8-c076-4383-bea4-63f9f9e791a7 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:18.527934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-454dfdb8-c076-4383-bea4-63f9f9e791a7 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:18.528448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-454dfdb8-c076-4383-bea4-63f9f9e791a7 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:18.528899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-454dfdb8-c076-4383-bea4-63f9f9e791a7 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:18.530914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-454dfdb8-c076-4383-bea4-63f9f9e791a7 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:18.532541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-454dfdb8-c076-4383-bea4-63f9f9e791a7 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:18.533086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-454dfdb8-c076-4383-bea4-63f9f9e791a7 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:18.887120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-454dfdb8-c076-4383-bea4-63f9f9e791a7 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:18.900874 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-454dfdb8-c076-4383-bea4-63f9f9e791a7 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1323 microversion: 2.1 time: 0.390386 Oct 05 18:12:18.901934 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2777/5789] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:18 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1323 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:19.110909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5d3bab2-c583-4482-ab0d-e3e90d88b6c8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:19.111686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b5d3bab2-c583-4482-ab0d-e3e90d88b6c8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:19.120742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d3bab2-c583-4482-ab0d-e3e90d88b6c8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:19.121505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d3bab2-c583-4482-ab0d-e3e90d88b6c8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:19.121960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d3bab2-c583-4482-ab0d-e3e90d88b6c8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:19.122864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d3bab2-c583-4482-ab0d-e3e90d88b6c8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:19.123345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d3bab2-c583-4482-ab0d-e3e90d88b6c8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:19.123794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5d3bab2-c583-4482-ab0d-e3e90d88b6c8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:19.321131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b5d3bab2-c583-4482-ab0d-e3e90d88b6c8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:19.354584 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b5d3bab2-c583-4482-ab0d-e3e90d88b6c8 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1278 microversion: 2.1 time: 0.248458 Oct 05 18:12:19.367280 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3013/5790] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:19 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:19.438956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-906991455", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "2a2b8b79-6001-4381-9e5a-061e6c6a6672"}], "key_name": "tempest-TestNetworkBasicOps-140577709", "security_groups": [{"name": "tempest-secgroup-smoke-905036187"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:19.572418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] validate_networks() for [('2a2b8b79-6001-4381-9e5a-061e6c6a6672', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:12:19.936386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8524022-a47c-4423-aa8a-6c8e3d4aea02 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:19.937178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c8524022-a47c-4423-aa8a-6c8e3d4aea02 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:19.943999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8524022-a47c-4423-aa8a-6c8e3d4aea02 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:19.944777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8524022-a47c-4423-aa8a-6c8e3d4aea02 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:19.945484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8524022-a47c-4423-aa8a-6c8e3d4aea02 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:19.946419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8524022-a47c-4423-aa8a-6c8e3d4aea02 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:19.947143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8524022-a47c-4423-aa8a-6c8e3d4aea02 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:19.947811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8524022-a47c-4423-aa8a-6c8e3d4aea02 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:19.981855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:12:19.982321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:12:19.982821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:12:19.983235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:12:19.984178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:12:19.994429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:19.994929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:19.995371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:19.996305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:19.996924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:19.997359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:20.015802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for project 2fe00cc2c3494b749a02868d27f89977. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:12:20.021617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for user 18188fb109574bf38443d2848a77bf69 and project 2fe00cc2c3494b749a02868d27f89977. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:12:20.034539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:12:20.038266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:12:20.093291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8524022-a47c-4423-aa8a-6c8e3d4aea02 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:20.098596 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4b3f7e63-7d9b-4783-a54c-0910ad84635f tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.663712 Oct 05 18:12:20.099559 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2778/5791] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:12:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:12:20.111405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1acadb05-9165-4745-b98b-9a709d44daea tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:20.112279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1acadb05-9165-4745-b98b-9a709d44daea tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:20.115907 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c8524022-a47c-4423-aa8a-6c8e3d4aea02 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1521 microversion: 2.1 time: 0.185923 Oct 05 18:12:20.117129 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3014/5792] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:19 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:20.145794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:20.146593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:20.154886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:20.155837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:20.156467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:20.157369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:20.158009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:20.158660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:20.179607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1acadb05-9165-4745-b98b-9a709d44daea tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:20.187642 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1acadb05-9165-4745-b98b-9a709d44daea tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1247 microversion: 2.1 time: 0.080467 Oct 05 18:12:20.201550 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] HTTP exception thrown: Action 999 not found Oct 05 18:12:20.205643 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2779/5793] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:20 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1247 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Request method failure captured: Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c/os-instance-actions/999 HTTP/1.1 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcj1jVU_SivOfpSe2iw-Or9q6owY_YSxpkKgu2SDOQuLD6GxD0pBDPKRJ9l0K4mmBwWi-0qpOtlzaJI2iIpdZHhDnkB2DZSa98fQPrSISmYfF3ui8iPaMq5jxdqcblRoIyY7ujPxILpuzWwtzC31emPRhewKX4WdvaBrdPpWvztacg0 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 5eb98217631b42f19a475ee55b5ed122 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2084354200 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5eb98217631b42f19a475ee55b5ed122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5eb98217631b42f19a475ee55b5ed122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5eb98217631b42f19a475ee55b5ed122", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5eb98217631b42f19a475ee55b5ed122"}]}] Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2084354200 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 5eb98217631b42f19a475ee55b5ed122 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2084354200 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-InstanceActionsNegativeTestJSON-2084354200-project Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4a1e8857fc674dc181ec575733c635b7 Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2084354200-project Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: exception: Action 999 not found Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': 'bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c', 'id': '999'} Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 05 18:12:20.210016 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:20.220433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Returning 404 to user: Action 999 not found {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:12:20.220433 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a2cd5209-cc8e-4a50-813b-8894a7c8b587 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.071754 Oct 05 18:12:20.220433 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3015/5794] 10.222.0.70 () {58 vars in 1308 bytes} [Wed Oct 5 18:12:20 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c/os-instance-actions/999 => generated 66 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 18:12:20.222934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a26a3b99-3c24-4c58-9108-8e6adca54daf tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '.version_select at 0x7f7774d59d30>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:20.223663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a26a3b99-3c24-4c58-9108-8e6adca54daf tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: d34828ac-1fb7-4b46-aaa8-1035942f5019] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:20.229776 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-a26a3b99-3c24-4c58-9108-8e6adca54daf tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] HTTP exception thrown: Instance d34828ac-1fb7-4b46-aaa8-1035942f5019 could not be found. Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a26a3b99-3c24-4c58-9108-8e6adca54daf tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Request method failure captured: Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/d34828ac-1fb7-4b46-aaa8-1035942f5019/os-instance-actions HTTP/1.1 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcj1jVU_SivOfpSe2iw-Or9q6owY_YSxpkKgu2SDOQuLD6GxD0pBDPKRJ9l0K4mmBwWi-0qpOtlzaJI2iIpdZHhDnkB2DZSa98fQPrSISmYfF3ui8iPaMq5jxdqcblRoIyY7ujPxILpuzWwtzC31emPRhewKX4WdvaBrdPpWvztacg0 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 5eb98217631b42f19a475ee55b5ed122 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2084354200 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5eb98217631b42f19a475ee55b5ed122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5eb98217631b42f19a475ee55b5ed122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5eb98217631b42f19a475ee55b5ed122", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5eb98217631b42f19a475ee55b5ed122"}]}] Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2084354200 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 5eb98217631b42f19a475ee55b5ed122 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2084354200 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-InstanceActionsNegativeTestJSON-2084354200-project Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 4a1e8857fc674dc181ec575733c635b7 Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2084354200-project Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: method: Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance d34828ac-1fb7-4b46-aaa8-1035942f5019 could not be found. Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'server_id': 'd34828ac-1fb7-4b46-aaa8-1035942f5019'} Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d34828ac-1fb7-4b46-aaa8-1035942f5019 could not be found. Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:12:20.231817 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d34828ac-1fb7-4b46-aaa8-1035942f5019 could not be found. Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d34828ac-1fb7-4b46-aaa8-1035942f5019 could not be found. Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a26a3b99-3c24-4c58-9108-8e6adca54daf tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Returning 404 to user: Instance d34828ac-1fb7-4b46-aaa8-1035942f5019 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a26a3b99-3c24-4c58-9108-8e6adca54daf tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/d34828ac-1fb7-4b46-aaa8-1035942f5019/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.015105 Oct 05 18:12:20.237652 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2780/5795] 10.222.0.70 () {58 vars in 1296 bytes} [Wed Oct 5 18:12:20 2022] GET /compute/v2.1/servers/d34828ac-1fb7-4b46-aaa8-1035942f5019/os-instance-actions => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:12:20.245136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-16085ff5-1d69-44b5-929d-a70871edc014 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:20.245649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-16085ff5-1d69-44b5-929d-a70871edc014 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:20.253086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16085ff5-1d69-44b5-929d-a70871edc014 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:20.253671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16085ff5-1d69-44b5-929d-a70871edc014 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:20.254220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16085ff5-1d69-44b5-929d-a70871edc014 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:20.255060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16085ff5-1d69-44b5-929d-a70871edc014 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:20.255606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16085ff5-1d69-44b5-929d-a70871edc014 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:20.256056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16085ff5-1d69-44b5-929d-a70871edc014 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:20.287889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-16085ff5-1d69-44b5-929d-a70871edc014 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:12:20.338997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:20.384375 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-16085ff5-1d69-44b5-929d-a70871edc014 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "DELETE /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 204 len: 0 microversion: 2.1 time: 0.142593 Oct 05 18:12:20.385606 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3016/5796] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:12:20 2022] DELETE /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:12:20.393468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4ea5f1af-baeb-44dd-8a40-2c7c6adf7405 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:20.394491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4ea5f1af-baeb-44dd-8a40-2c7c6adf7405 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:20.399830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-902b08a6-d807-4619-be08-af202aec6925 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:20.401074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-902b08a6-d807-4619-be08-af202aec6925 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:20.405283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ea5f1af-baeb-44dd-8a40-2c7c6adf7405 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:20.405887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ea5f1af-baeb-44dd-8a40-2c7c6adf7405 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:20.406530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ea5f1af-baeb-44dd-8a40-2c7c6adf7405 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:20.407456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ea5f1af-baeb-44dd-8a40-2c7c6adf7405 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:20.408041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ea5f1af-baeb-44dd-8a40-2c7c6adf7405 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:20.408556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ea5f1af-baeb-44dd-8a40-2c7c6adf7405 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:20.427050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-902b08a6-d807-4619-be08-af202aec6925 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:20.430003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-902b08a6-d807-4619-be08-af202aec6925 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:20.432621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-902b08a6-d807-4619-be08-af202aec6925 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:20.434212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-902b08a6-d807-4619-be08-af202aec6925 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:20.435954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-902b08a6-d807-4619-be08-af202aec6925 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:20.439281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-902b08a6-d807-4619-be08-af202aec6925 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:20.697696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-902b08a6-d807-4619-be08-af202aec6925 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:20.703284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4ea5f1af-baeb-44dd-8a40-2c7c6adf7405 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:20.708673 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-902b08a6-d807-4619-be08-af202aec6925 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1527 microversion: 2.1 time: 0.317721 Oct 05 18:12:20.711734 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4ea5f1af-baeb-44dd-8a40-2c7c6adf7405 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1278 microversion: 2.1 time: 0.333263 Oct 05 18:12:20.712866 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2781/5797] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:20 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1278 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:20.718010 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3017/5798] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:20 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1527 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:12:21.211185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-af7b4888-c6bb-4a19-b082-52032c9472da tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:21.211937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-af7b4888-c6bb-4a19-b082-52032c9472da tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:21.218505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af7b4888-c6bb-4a19-b082-52032c9472da tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:21.219101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af7b4888-c6bb-4a19-b082-52032c9472da tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:21.219589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af7b4888-c6bb-4a19-b082-52032c9472da tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:21.220595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af7b4888-c6bb-4a19-b082-52032c9472da tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:21.221075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af7b4888-c6bb-4a19-b082-52032c9472da tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:21.221503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af7b4888-c6bb-4a19-b082-52032c9472da tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:21.286423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-af7b4888-c6bb-4a19-b082-52032c9472da tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:21.294380 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-af7b4888-c6bb-4a19-b082-52032c9472da tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1243 microversion: 2.1 time: 0.087238 Oct 05 18:12:21.294954 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2782/5799] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:21 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1243 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:21.734814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f08025a-6483-478f-85e3-1da0df691cab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:21.736250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f08025a-6483-478f-85e3-1da0df691cab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:21.741365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3dea8971-46b1-45cc-b014-924e16e3240a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:21.742355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3dea8971-46b1-45cc-b014-924e16e3240a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:21.745209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f08025a-6483-478f-85e3-1da0df691cab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:21.746297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f08025a-6483-478f-85e3-1da0df691cab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:21.747010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f08025a-6483-478f-85e3-1da0df691cab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:21.747983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f08025a-6483-478f-85e3-1da0df691cab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:21.748609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f08025a-6483-478f-85e3-1da0df691cab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:21.749384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f08025a-6483-478f-85e3-1da0df691cab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:21.750472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea8971-46b1-45cc-b014-924e16e3240a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:21.750985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea8971-46b1-45cc-b014-924e16e3240a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:21.751513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea8971-46b1-45cc-b014-924e16e3240a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:21.752880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea8971-46b1-45cc-b014-924e16e3240a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:21.753546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea8971-46b1-45cc-b014-924e16e3240a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:21.754127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dea8971-46b1-45cc-b014-924e16e3240a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:21.779867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:21.837406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:21.906049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3dea8971-46b1-45cc-b014-924e16e3240a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:21.915218 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3dea8971-46b1-45cc-b014-924e16e3240a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1527 microversion: 2.1 time: 0.178778 Oct 05 18:12:21.915814 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2783/5800] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:21 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1527 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:22.112838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f08025a-6483-478f-85e3-1da0df691cab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:22.121427 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f08025a-6483-478f-85e3-1da0df691cab tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1266 microversion: 2.1 time: 0.390558 Oct 05 18:12:22.122010 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3018/5801] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:21 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1266 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:22.317445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fcf30782-5bb2-4563-b088-d4cce88244c7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:22.318067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fcf30782-5bb2-4563-b088-d4cce88244c7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:22.324580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcf30782-5bb2-4563-b088-d4cce88244c7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:22.325077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcf30782-5bb2-4563-b088-d4cce88244c7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:22.325519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcf30782-5bb2-4563-b088-d4cce88244c7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:22.326224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcf30782-5bb2-4563-b088-d4cce88244c7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:22.326739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcf30782-5bb2-4563-b088-d4cce88244c7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:22.327168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcf30782-5bb2-4563-b088-d4cce88244c7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:22.390327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fcf30782-5bb2-4563-b088-d4cce88244c7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:22.398206 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fcf30782-5bb2-4563-b088-d4cce88244c7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1305 microversion: 2.1 time: 0.084994 Oct 05 18:12:22.398827 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2784/5802] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:22 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1305 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:22.728752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6a7cb200-e3c2-46cd-ae1e-39c75fa1351a req-2808f35f-339c-4444-930c-df0b9e12f6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c", "name": "network-vif-deleted", "tag": "4a049baf-30a4-45ba-a38f-1750e51c6b25"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:22.741179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6a7cb200-e3c2-46cd-ae1e-39c75fa1351a req-2808f35f-339c-4444-930c-df0b9e12f6c9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:22.741883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6a7cb200-e3c2-46cd-ae1e-39c75fa1351a req-2808f35f-339c-4444-930c-df0b9e12f6c9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:22.742118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6a7cb200-e3c2-46cd-ae1e-39c75fa1351a req-2808f35f-339c-4444-930c-df0b9e12f6c9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:22.761764 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6a7cb200-e3c2-46cd-ae1e-39c75fa1351a req-2808f35f-339c-4444-930c-df0b9e12f6c9 service nova] Creating event network-vif-deleted:4a049baf-30a4-45ba-a38f-1750e51c6b25 for instance bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c on n-h2-835595-3 Oct 05 18:12:22.768502 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6a7cb200-e3c2-46cd-ae1e-39c75fa1351a req-2808f35f-339c-4444-930c-df0b9e12f6c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043862 Oct 05 18:12:22.769128 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3019/5803] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:22.939073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:22.940663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:22.950752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:22.951274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:22.951763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:22.952793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:22.953422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:22.954610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:22.993096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:22.993593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:22.994044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:22.994549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lazy-loading 'fault' on Instance uuid bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:12:23.039356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1e8857fc674dc181ec575733c635b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb98217631b42f19a475ee55b5ed122', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:23.048686 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-88f116d2-b8a2-4828-8d7c-670cc9fa249a tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 200 len: 1313 microversion: 2.1 time: 0.113745 Oct 05 18:12:23.049377 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2785/5804] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:22 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 1313 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:23.148734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6772748d-edfc-4160-8138-6e367400095f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:23.149688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6772748d-edfc-4160-8138-6e367400095f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:23.157927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6772748d-edfc-4160-8138-6e367400095f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:23.158655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6772748d-edfc-4160-8138-6e367400095f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:23.159103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6772748d-edfc-4160-8138-6e367400095f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:23.160352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6772748d-edfc-4160-8138-6e367400095f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:23.160990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6772748d-edfc-4160-8138-6e367400095f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:23.161434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6772748d-edfc-4160-8138-6e367400095f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:23.385172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6772748d-edfc-4160-8138-6e367400095f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:23.393572 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6772748d-edfc-4160-8138-6e367400095f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1266 microversion: 2.1 time: 0.252119 Oct 05 18:12:23.394507 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3020/5805] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:23 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:23.421300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-08275694-b745-445a-8ee1-c6d2064b69ee tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:23.422017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-08275694-b745-445a-8ee1-c6d2064b69ee tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:23.428665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08275694-b745-445a-8ee1-c6d2064b69ee tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:23.429466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08275694-b745-445a-8ee1-c6d2064b69ee tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:23.429961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08275694-b745-445a-8ee1-c6d2064b69ee tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:23.430739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08275694-b745-445a-8ee1-c6d2064b69ee tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:23.431425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08275694-b745-445a-8ee1-c6d2064b69ee tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:23.432099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08275694-b745-445a-8ee1-c6d2064b69ee tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:23.579686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08275694-b745-445a-8ee1-c6d2064b69ee tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:23.588001 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-08275694-b745-445a-8ee1-c6d2064b69ee tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1372 microversion: 2.1 time: 0.170687 Oct 05 18:12:23.589067 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2786/5806] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:23 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1372 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:24.073029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:24.073724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] [instance: bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:24.081044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:24.081465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:24.081927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:24.082690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:24.083165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:24.083608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:24.098885 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] HTTP exception thrown: Instance bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c could not be found. Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Request method failure captured: Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c HTTP/1.1 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcj1jVU_SivOfpSe2iw-Or9q6owY_YSxpkKgu2SDOQuLD6GxD0pBDPKRJ9l0K4mmBwWi-0qpOtlzaJI2iIpdZHhDnkB2DZSa98fQPrSISmYfF3ui8iPaMq5jxdqcblRoIyY7ujPxILpuzWwtzC31emPRhewKX4WdvaBrdPpWvztacg0 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 5eb98217631b42f19a475ee55b5ed122 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-2084354200 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/5eb98217631b42f19a475ee55b5ed122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5eb98217631b42f19a475ee55b5ed122"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_5eb98217631b42f19a475ee55b5ed122", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/5eb98217631b42f19a475ee55b5ed122"}]}] Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-2084354200 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 5eb98217631b42f19a475ee55b5ed122 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-2084354200 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-InstanceActionsNegativeTestJSON-2084354200-project Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4a1e8857fc674dc181ec575733c635b7 Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-2084354200-project Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c could not be found. Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c'} Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c could not be found. Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c could not be found. Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:24.100623 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:12:24.105621 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:24.105621 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:24.105621 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:12:24.105621 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:12:24.105621 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:12:24.105621 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:12:24.105621 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c could not be found. Oct 05 18:12:24.105621 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:12:24.105621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] Returning 404 to user: Instance bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:12:24.105621 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f684c97-e3ec-4817-aeeb-8ab877c1d8e2 tempest-InstanceActionsNegativeTestJSON-2084354200 tempest-InstanceActionsNegativeTestJSON-2084354200-project] 10.222.0.70 "GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c" status: 404 len: 111 microversion: 2.1 time: 0.033289 Oct 05 18:12:24.106963 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3021/5807] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:24 2022] GET /compute/v2.1/servers/bf69fb6b-f0c9-4bd0-80e3-180fd6a23d2c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:12:24.421689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f3ec0295-c4ef-48da-a092-32475b066639 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:24.423067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f3ec0295-c4ef-48da-a092-32475b066639 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:24.435306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3ec0295-c4ef-48da-a092-32475b066639 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:24.436512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3ec0295-c4ef-48da-a092-32475b066639 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:24.437008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3ec0295-c4ef-48da-a092-32475b066639 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:24.438351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3ec0295-c4ef-48da-a092-32475b066639 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:24.438779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3ec0295-c4ef-48da-a092-32475b066639 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:24.439498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3ec0295-c4ef-48da-a092-32475b066639 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:24.612384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cfbe963b-b7b5-44b1-8c6b-230925e6e388 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:24.613189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cfbe963b-b7b5-44b1-8c6b-230925e6e388 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:24.619739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfbe963b-b7b5-44b1-8c6b-230925e6e388 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:24.620167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfbe963b-b7b5-44b1-8c6b-230925e6e388 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:24.620613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfbe963b-b7b5-44b1-8c6b-230925e6e388 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:24.621332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfbe963b-b7b5-44b1-8c6b-230925e6e388 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:24.621787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfbe963b-b7b5-44b1-8c6b-230925e6e388 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:24.622236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfbe963b-b7b5-44b1-8c6b-230925e6e388 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:24.681142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f3ec0295-c4ef-48da-a092-32475b066639 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:24.691099 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f3ec0295-c4ef-48da-a092-32475b066639 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1266 microversion: 2.1 time: 0.276366 Oct 05 18:12:24.694799 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2787/5808] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:24 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:24.774759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cfbe963b-b7b5-44b1-8c6b-230925e6e388 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:24.783173 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cfbe963b-b7b5-44b1-8c6b-230925e6e388 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1372 microversion: 2.1 time: 0.175418 Oct 05 18:12:24.786351 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3022/5809] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:24 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:24.787261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7b4353b9-b1b9-457f-a7e4-98a3da3ee88a req-c0a772cd-aadc-4f54-a026-580d9ade308b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8589be-25a4-4b08-be3f-4516460e4b6c", "tag": "5091b59c-29c6-4145-a3a3-9ee575ede053"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:24.797722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7b4353b9-b1b9-457f-a7e4-98a3da3ee88a req-c0a772cd-aadc-4f54-a026-580d9ade308b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:24.798531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7b4353b9-b1b9-457f-a7e4-98a3da3ee88a req-c0a772cd-aadc-4f54-a026-580d9ade308b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:24.798958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7b4353b9-b1b9-457f-a7e4-98a3da3ee88a req-c0a772cd-aadc-4f54-a026-580d9ade308b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:24.810589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7b4353b9-b1b9-457f-a7e4-98a3da3ee88a req-c0a772cd-aadc-4f54-a026-580d9ade308b service nova] Creating event network-changed:5091b59c-29c6-4145-a3a3-9ee575ede053 for instance df8589be-25a4-4b08-be3f-4516460e4b6c on n-h1-835595-3 Oct 05 18:12:24.815906 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7b4353b9-b1b9-457f-a7e4-98a3da3ee88a req-c0a772cd-aadc-4f54-a026-580d9ade308b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032712 Oct 05 18:12:24.816500 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2788/5810] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:25.717322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-801e1ec6-174f-4691-b2f9-881a430c0b41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:25.718827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-801e1ec6-174f-4691-b2f9-881a430c0b41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:25.727480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-801e1ec6-174f-4691-b2f9-881a430c0b41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:25.728344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-801e1ec6-174f-4691-b2f9-881a430c0b41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:25.729031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-801e1ec6-174f-4691-b2f9-881a430c0b41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:25.729977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-801e1ec6-174f-4691-b2f9-881a430c0b41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:25.730697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-801e1ec6-174f-4691-b2f9-881a430c0b41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:25.731364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-801e1ec6-174f-4691-b2f9-881a430c0b41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:25.806772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6667fcfc-fa0f-46f9-9e87-42782dadde22 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:25.808493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6667fcfc-fa0f-46f9-9e87-42782dadde22 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:25.826185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6667fcfc-fa0f-46f9-9e87-42782dadde22 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:25.827394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6667fcfc-fa0f-46f9-9e87-42782dadde22 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:25.828155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6667fcfc-fa0f-46f9-9e87-42782dadde22 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:25.829184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6667fcfc-fa0f-46f9-9e87-42782dadde22 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:25.829931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6667fcfc-fa0f-46f9-9e87-42782dadde22 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:25.830593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6667fcfc-fa0f-46f9-9e87-42782dadde22 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:25.958943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-801e1ec6-174f-4691-b2f9-881a430c0b41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:25.967106 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-801e1ec6-174f-4691-b2f9-881a430c0b41 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1266 microversion: 2.1 time: 0.253933 Oct 05 18:12:25.967950 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3023/5811] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:25 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:26.095152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6667fcfc-fa0f-46f9-9e87-42782dadde22 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:26.104956 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6667fcfc-fa0f-46f9-9e87-42782dadde22 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1372 microversion: 2.1 time: 0.302981 Oct 05 18:12:26.105756 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2789/5812] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:25 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1372 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:26.990740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5a93033-1c05-4953-a347-4b96e2dda522 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:26.991445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5a93033-1c05-4953-a347-4b96e2dda522 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:26.998994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5a93033-1c05-4953-a347-4b96e2dda522 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:26.999479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5a93033-1c05-4953-a347-4b96e2dda522 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:26.999933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5a93033-1c05-4953-a347-4b96e2dda522 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:27.000653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5a93033-1c05-4953-a347-4b96e2dda522 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:27.001168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5a93033-1c05-4953-a347-4b96e2dda522 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:27.001652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5a93033-1c05-4953-a347-4b96e2dda522 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:27.128863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4e5fe809-f84d-4e97-9561-b2652db3c9eb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:27.131214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4e5fe809-f84d-4e97-9561-b2652db3c9eb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:27.155505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e5fe809-f84d-4e97-9561-b2652db3c9eb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:27.156732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e5fe809-f84d-4e97-9561-b2652db3c9eb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:27.157830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e5fe809-f84d-4e97-9561-b2652db3c9eb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:27.160847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e5fe809-f84d-4e97-9561-b2652db3c9eb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:27.161906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e5fe809-f84d-4e97-9561-b2652db3c9eb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:27.163473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e5fe809-f84d-4e97-9561-b2652db3c9eb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:27.210580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5a93033-1c05-4953-a347-4b96e2dda522 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:27.222013 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5a93033-1c05-4953-a347-4b96e2dda522 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1266 microversion: 2.1 time: 0.235128 Oct 05 18:12:27.223145 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3024/5813] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:26 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:27.414374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4e5fe809-f84d-4e97-9561-b2652db3c9eb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:27.426564 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4e5fe809-f84d-4e97-9561-b2652db3c9eb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1372 microversion: 2.1 time: 0.303081 Oct 05 18:12:27.427180 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2790/5814] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:27 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1372 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:28.244475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7495573a-570d-483c-ad2d-d7246a9a0f86 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:28.245115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7495573a-570d-483c-ad2d-d7246a9a0f86 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:28.248002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=12 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:28.254129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7495573a-570d-483c-ad2d-d7246a9a0f86 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:28.254674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7495573a-570d-483c-ad2d-d7246a9a0f86 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:28.255136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7495573a-570d-483c-ad2d-d7246a9a0f86 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:28.255860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7495573a-570d-483c-ad2d-d7246a9a0f86 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:28.256342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7495573a-570d-483c-ad2d-d7246a9a0f86 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:28.256787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7495573a-570d-483c-ad2d-d7246a9a0f86 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:28.395816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7495573a-570d-483c-ad2d-d7246a9a0f86 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:28.403791 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7495573a-570d-483c-ad2d-d7246a9a0f86 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1266 microversion: 2.1 time: 0.163280 Oct 05 18:12:28.404368 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3025/5815] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:28 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:28.449278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f1b657d9-3f42-472d-89f8-885d20f119a2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:28.450030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1b657d9-3f42-472d-89f8-885d20f119a2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:28.454476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:28.458812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b657d9-3f42-472d-89f8-885d20f119a2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:28.459892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b657d9-3f42-472d-89f8-885d20f119a2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:28.460614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b657d9-3f42-472d-89f8-885d20f119a2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:28.461638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b657d9-3f42-472d-89f8-885d20f119a2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:28.462090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b657d9-3f42-472d-89f8-885d20f119a2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:28.462841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1b657d9-3f42-472d-89f8-885d20f119a2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:28.625555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1b657d9-3f42-472d-89f8-885d20f119a2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:28.633742 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f1b657d9-3f42-472d-89f8-885d20f119a2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1372 microversion: 2.1 time: 0.188556 Oct 05 18:12:28.634334 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2791/5816] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:28 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:29.429336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8daaef3c-75c8-4de6-a754-2e612974acda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:29.429942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8daaef3c-75c8-4de6-a754-2e612974acda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:29.437637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8daaef3c-75c8-4de6-a754-2e612974acda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:29.438075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8daaef3c-75c8-4de6-a754-2e612974acda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:29.438991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8daaef3c-75c8-4de6-a754-2e612974acda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:29.439729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8daaef3c-75c8-4de6-a754-2e612974acda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:29.440211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8daaef3c-75c8-4de6-a754-2e612974acda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:29.440654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8daaef3c-75c8-4de6-a754-2e612974acda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:29.613170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8daaef3c-75c8-4de6-a754-2e612974acda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:29.623260 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8daaef3c-75c8-4de6-a754-2e612974acda tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1266 microversion: 2.1 time: 0.199095 Oct 05 18:12:29.639858 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3026/5817] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:29 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:29.658271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-05b5b39f-3180-4a01-953a-56f4e70dd274 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:29.660631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-05b5b39f-3180-4a01-953a-56f4e70dd274 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:29.673245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b5b39f-3180-4a01-953a-56f4e70dd274 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:29.674182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b5b39f-3180-4a01-953a-56f4e70dd274 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:29.674909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b5b39f-3180-4a01-953a-56f4e70dd274 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:29.676432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b5b39f-3180-4a01-953a-56f4e70dd274 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:29.677263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b5b39f-3180-4a01-953a-56f4e70dd274 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:29.677974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05b5b39f-3180-4a01-953a-56f4e70dd274 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:29.978478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-97207e30-9bb8-4a06-a7a1-642762cdd6a7 req-390d436d-c1dc-45f7-942b-0e73ce8c8075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8589be-25a4-4b08-be3f-4516460e4b6c", "name": "network-vif-plugged", "status": "completed", "tag": "5091b59c-29c6-4145-a3a3-9ee575ede053"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:29.991216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-97207e30-9bb8-4a06-a7a1-642762cdd6a7 req-390d436d-c1dc-45f7-942b-0e73ce8c8075 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:29.991936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-97207e30-9bb8-4a06-a7a1-642762cdd6a7 req-390d436d-c1dc-45f7-942b-0e73ce8c8075 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:29.992560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-97207e30-9bb8-4a06-a7a1-642762cdd6a7 req-390d436d-c1dc-45f7-942b-0e73ce8c8075 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:30.008111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:30.014213 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-97207e30-9bb8-4a06-a7a1-642762cdd6a7 req-390d436d-c1dc-45f7-942b-0e73ce8c8075 service nova] Creating event network-vif-plugged:5091b59c-29c6-4145-a3a3-9ee575ede053 for instance df8589be-25a4-4b08-be3f-4516460e4b6c on n-h1-835595-3 Oct 05 18:12:30.020782 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-97207e30-9bb8-4a06-a7a1-642762cdd6a7 req-390d436d-c1dc-45f7-942b-0e73ce8c8075 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046949 Oct 05 18:12:30.021308 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3027/5818] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:30.168340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-05b5b39f-3180-4a01-953a-56f4e70dd274 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:30.181874 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-05b5b39f-3180-4a01-953a-56f4e70dd274 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1372 microversion: 2.1 time: 0.528887 Oct 05 18:12:30.194690 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2792/5819] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:29 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1372 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:30.647831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-28796753-8b76-4a2d-a109-7801ce0c8d20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:30.648563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-28796753-8b76-4a2d-a109-7801ce0c8d20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:30.663585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28796753-8b76-4a2d-a109-7801ce0c8d20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:30.664962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28796753-8b76-4a2d-a109-7801ce0c8d20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:30.666440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28796753-8b76-4a2d-a109-7801ce0c8d20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:30.668751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28796753-8b76-4a2d-a109-7801ce0c8d20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:30.671547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28796753-8b76-4a2d-a109-7801ce0c8d20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:30.672272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-28796753-8b76-4a2d-a109-7801ce0c8d20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:30.856579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-28796753-8b76-4a2d-a109-7801ce0c8d20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:30.866483 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-28796753-8b76-4a2d-a109-7801ce0c8d20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1266 microversion: 2.1 time: 0.223556 Oct 05 18:12:30.867283 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3028/5820] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:30 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:31.207903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47c4a578-e99b-4ccc-a3fa-5e79eea32b61 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:31.208541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-47c4a578-e99b-4ccc-a3fa-5e79eea32b61 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:31.211718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=16 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:31.237296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47c4a578-e99b-4ccc-a3fa-5e79eea32b61 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:31.238303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47c4a578-e99b-4ccc-a3fa-5e79eea32b61 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:31.238965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47c4a578-e99b-4ccc-a3fa-5e79eea32b61 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:31.240067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47c4a578-e99b-4ccc-a3fa-5e79eea32b61 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:31.240758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47c4a578-e99b-4ccc-a3fa-5e79eea32b61 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:31.241554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-47c4a578-e99b-4ccc-a3fa-5e79eea32b61 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:31.495058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-47c4a578-e99b-4ccc-a3fa-5e79eea32b61 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:31.523904 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47c4a578-e99b-4ccc-a3fa-5e79eea32b61 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1372 microversion: 2.1 time: 0.322956 Oct 05 18:12:31.526575 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2793/5821] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:31 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:31.890197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce1545d6-b785-49c6-8dc7-19ec52c8bcd5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:31.891644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ce1545d6-b785-49c6-8dc7-19ec52c8bcd5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:31.894940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:31.912682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1545d6-b785-49c6-8dc7-19ec52c8bcd5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:31.913397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1545d6-b785-49c6-8dc7-19ec52c8bcd5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:31.914358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1545d6-b785-49c6-8dc7-19ec52c8bcd5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:31.915310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1545d6-b785-49c6-8dc7-19ec52c8bcd5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:31.915937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1545d6-b785-49c6-8dc7-19ec52c8bcd5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:31.916551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce1545d6-b785-49c6-8dc7-19ec52c8bcd5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:32.109733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a97241ba-38fb-45b6-a08f-3b0c84ca8fbe req-776110bb-de10-47f3-b14a-e01155a9b5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73029889-efdd-4945-a1cd-9d931be98e4b", "name": "network-vif-plugged", "status": "completed", "tag": "62fba8f6-9d08-4dc1-9ec0-c9ab8b5ecf0a"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:32.133574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a97241ba-38fb-45b6-a08f-3b0c84ca8fbe req-776110bb-de10-47f3-b14a-e01155a9b5f5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:32.137015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a97241ba-38fb-45b6-a08f-3b0c84ca8fbe req-776110bb-de10-47f3-b14a-e01155a9b5f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:32.138759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a97241ba-38fb-45b6-a08f-3b0c84ca8fbe req-776110bb-de10-47f3-b14a-e01155a9b5f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:32.140705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ce1545d6-b785-49c6-8dc7-19ec52c8bcd5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:32.154725 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ce1545d6-b785-49c6-8dc7-19ec52c8bcd5 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1266 microversion: 2.1 time: 0.267818 Oct 05 18:12:32.178393 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a97241ba-38fb-45b6-a08f-3b0c84ca8fbe req-776110bb-de10-47f3-b14a-e01155a9b5f5 service nova] Creating event network-vif-plugged:62fba8f6-9d08-4dc1-9ec0-c9ab8b5ecf0a for instance 73029889-efdd-4945-a1cd-9d931be98e4b on n-h1-835595-3 Oct 05 18:12:32.179521 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3029/5822] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:31 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:32.185680 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a97241ba-38fb-45b6-a08f-3b0c84ca8fbe req-776110bb-de10-47f3-b14a-e01155a9b5f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091833 Oct 05 18:12:32.186797 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2794/5823] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:32.559035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb868cc1-31e6-4fcc-ba04-57b3b020d7e6 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:32.560000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb868cc1-31e6-4fcc-ba04-57b3b020d7e6 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:32.568420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb868cc1-31e6-4fcc-ba04-57b3b020d7e6 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:32.569240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb868cc1-31e6-4fcc-ba04-57b3b020d7e6 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:32.569912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb868cc1-31e6-4fcc-ba04-57b3b020d7e6 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:32.570935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb868cc1-31e6-4fcc-ba04-57b3b020d7e6 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:32.571538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb868cc1-31e6-4fcc-ba04-57b3b020d7e6 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:32.572455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb868cc1-31e6-4fcc-ba04-57b3b020d7e6 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:32.808123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fb868cc1-31e6-4fcc-ba04-57b3b020d7e6 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:32.816815 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb868cc1-31e6-4fcc-ba04-57b3b020d7e6 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1543 microversion: 2.1 time: 0.267526 Oct 05 18:12:32.830832 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3030/5824] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:32 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1543 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:32.842322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8824e47a-5775-40c8-b878-96c0674c1475 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:32.843682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8824e47a-5775-40c8-b878-96c0674c1475 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:32.852103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8824e47a-5775-40c8-b878-96c0674c1475 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:32.852845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8824e47a-5775-40c8-b878-96c0674c1475 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:32.853464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8824e47a-5775-40c8-b878-96c0674c1475 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:32.854958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8824e47a-5775-40c8-b878-96c0674c1475 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:32.855371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8824e47a-5775-40c8-b878-96c0674c1475 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:32.856873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8824e47a-5775-40c8-b878-96c0674c1475 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:33.039839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8824e47a-5775-40c8-b878-96c0674c1475 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:33.048411 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8824e47a-5775-40c8-b878-96c0674c1475 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1543 microversion: 2.1 time: 0.211657 Oct 05 18:12:33.049043 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2795/5825] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:32 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1543 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:12:33.180103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b42d07de-90fe-4dda-afce-40fa064fda3e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:33.180925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b42d07de-90fe-4dda-afce-40fa064fda3e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:33.189770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42d07de-90fe-4dda-afce-40fa064fda3e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:33.192630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42d07de-90fe-4dda-afce-40fa064fda3e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:33.196831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42d07de-90fe-4dda-afce-40fa064fda3e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:33.199371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42d07de-90fe-4dda-afce-40fa064fda3e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:33.199997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42d07de-90fe-4dda-afce-40fa064fda3e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:33.200561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42d07de-90fe-4dda-afce-40fa064fda3e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:33.429643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b42d07de-90fe-4dda-afce-40fa064fda3e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:33.474461 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b42d07de-90fe-4dda-afce-40fa064fda3e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1266 microversion: 2.1 time: 0.300316 Oct 05 18:12:33.496920 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3031/5826] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:33 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1266 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:34.265208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-397389509", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "16f17efc-9d97-4067-a300-10a3914986e7"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:34.321569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] validate_networks() for [('16f17efc-9d97-4067-a300-10a3914986e7', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:12:34.505632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e1c66a1d-e47b-48b7-b206-82d2fbe6511b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:34.506743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e1c66a1d-e47b-48b7-b206-82d2fbe6511b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:34.513986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c66a1d-e47b-48b7-b206-82d2fbe6511b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:34.514523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c66a1d-e47b-48b7-b206-82d2fbe6511b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:34.514972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c66a1d-e47b-48b7-b206-82d2fbe6511b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:34.515916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c66a1d-e47b-48b7-b206-82d2fbe6511b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:34.516637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c66a1d-e47b-48b7-b206-82d2fbe6511b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:34.517315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c66a1d-e47b-48b7-b206-82d2fbe6511b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:34.687808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e1c66a1d-e47b-48b7-b206-82d2fbe6511b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:34.701848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e1c66a1d-e47b-48b7-b206-82d2fbe6511b tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1452 microversion: 2.1 time: 0.200488 Oct 05 18:12:34.703663 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3032/5827] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:34 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1452 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:34.736572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23f7ccb5-0d80-46dc-a07c-2b71d33b48b3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:34.737466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-23f7ccb5-0d80-46dc-a07c-2b71d33b48b3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:34.744094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23f7ccb5-0d80-46dc-a07c-2b71d33b48b3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:34.744707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23f7ccb5-0d80-46dc-a07c-2b71d33b48b3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:34.745164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23f7ccb5-0d80-46dc-a07c-2b71d33b48b3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:34.746130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23f7ccb5-0d80-46dc-a07c-2b71d33b48b3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:34.746639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23f7ccb5-0d80-46dc-a07c-2b71d33b48b3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:34.747093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23f7ccb5-0d80-46dc-a07c-2b71d33b48b3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:34.886867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23f7ccb5-0d80-46dc-a07c-2b71d33b48b3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:34.899132 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-23f7ccb5-0d80-46dc-a07c-2b71d33b48b3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1452 microversion: 2.1 time: 0.174264 Oct 05 18:12:34.899731 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3033/5828] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:34 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:12:35.062886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:12:35.063343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:12:35.063815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:12:35.064216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:12:35.064802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:12:35.077348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:35.078073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:35.079540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:35.080714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:35.081398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:35.082273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:35.109124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:12:35.119917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for user 0c698ccb66ac443582a7e610591c6da6 and project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:12:35.136852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:12:35.139388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:12:35.249878 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6d93b5ee-9bff-4de7-bcfd-3efb3c504914 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.132722 Oct 05 18:12:35.253000 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2796/5829] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:12:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:12:35.264311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-04ec46d4-eec4-404d-9542-122b2300c09f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:35.265275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-04ec46d4-eec4-404d-9542-122b2300c09f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:35.333862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1be4b194-11dd-4866-9c42-2dd1478dd630 req-1db152bf-f4a1-4b63-b9ad-dea0478eb897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8589be-25a4-4b08-be3f-4516460e4b6c", "tag": "5091b59c-29c6-4145-a3a3-9ee575ede053"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:35.351227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1be4b194-11dd-4866-9c42-2dd1478dd630 req-1db152bf-f4a1-4b63-b9ad-dea0478eb897 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:35.351727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1be4b194-11dd-4866-9c42-2dd1478dd630 req-1db152bf-f4a1-4b63-b9ad-dea0478eb897 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:35.352150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1be4b194-11dd-4866-9c42-2dd1478dd630 req-1db152bf-f4a1-4b63-b9ad-dea0478eb897 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:35.363944 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1be4b194-11dd-4866-9c42-2dd1478dd630 req-1db152bf-f4a1-4b63-b9ad-dea0478eb897 service nova] Creating event network-changed:5091b59c-29c6-4145-a3a3-9ee575ede053 for instance df8589be-25a4-4b08-be3f-4516460e4b6c on n-h1-835595-3 Oct 05 18:12:35.369106 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1be4b194-11dd-4866-9c42-2dd1478dd630 req-1db152bf-f4a1-4b63-b9ad-dea0478eb897 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046052 Oct 05 18:12:35.374262 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2797/5830] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:12:35.528059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-04ec46d4-eec4-404d-9542-122b2300c09f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:35.542454 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-04ec46d4-eec4-404d-9542-122b2300c09f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1192 microversion: 2.1 time: 0.282746 Oct 05 18:12:35.543054 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3034/5831] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:35 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1192 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:36.579991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-751f27e6-b980-4a38-b978-e447fa15fa83 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:36.580705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-751f27e6-b980-4a38-b978-e447fa15fa83 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:36.587374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-751f27e6-b980-4a38-b978-e447fa15fa83 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:36.593839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-751f27e6-b980-4a38-b978-e447fa15fa83 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:36.595020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-751f27e6-b980-4a38-b978-e447fa15fa83 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:36.596025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-751f27e6-b980-4a38-b978-e447fa15fa83 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:36.596740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-751f27e6-b980-4a38-b978-e447fa15fa83 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:36.597388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-751f27e6-b980-4a38-b978-e447fa15fa83 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:36.721470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-751f27e6-b980-4a38-b978-e447fa15fa83 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:36.732681 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-751f27e6-b980-4a38-b978-e447fa15fa83 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1244 microversion: 2.1 time: 0.157848 Oct 05 18:12:36.734661 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2798/5832] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:36 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1244 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:37.757763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c86e655a-4c66-4163-9b19-58aafbe9611d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:37.758453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c86e655a-4c66-4163-9b19-58aafbe9611d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:37.766838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c86e655a-4c66-4163-9b19-58aafbe9611d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:37.767352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c86e655a-4c66-4163-9b19-58aafbe9611d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:37.767834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c86e655a-4c66-4163-9b19-58aafbe9611d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:37.768561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c86e655a-4c66-4163-9b19-58aafbe9611d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:37.769035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c86e655a-4c66-4163-9b19-58aafbe9611d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:37.769475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c86e655a-4c66-4163-9b19-58aafbe9611d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:37.858617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c86e655a-4c66-4163-9b19-58aafbe9611d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:37.867972 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c86e655a-4c66-4163-9b19-58aafbe9611d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1250 microversion: 2.1 time: 0.114753 Oct 05 18:12:37.868678 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3035/5833] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:37 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1250 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:38.589029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3e97b7c9-0aab-4eb9-bad0-ed318012b65a req-1248159c-30cb-4a32-9df4-0cdf1a7d6ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73029889-efdd-4945-a1cd-9d931be98e4b", "tag": "62fba8f6-9d08-4dc1-9ec0-c9ab8b5ecf0a"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:38.600195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3e97b7c9-0aab-4eb9-bad0-ed318012b65a req-1248159c-30cb-4a32-9df4-0cdf1a7d6ec6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:38.601060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3e97b7c9-0aab-4eb9-bad0-ed318012b65a req-1248159c-30cb-4a32-9df4-0cdf1a7d6ec6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:38.601719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3e97b7c9-0aab-4eb9-bad0-ed318012b65a req-1248159c-30cb-4a32-9df4-0cdf1a7d6ec6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:38.615540 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3e97b7c9-0aab-4eb9-bad0-ed318012b65a req-1248159c-30cb-4a32-9df4-0cdf1a7d6ec6 service nova] Creating event network-changed:62fba8f6-9d08-4dc1-9ec0-c9ab8b5ecf0a for instance 73029889-efdd-4945-a1cd-9d931be98e4b on n-h1-835595-3 Oct 05 18:12:38.621946 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3e97b7c9-0aab-4eb9-bad0-ed318012b65a req-1248159c-30cb-4a32-9df4-0cdf1a7d6ec6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036550 Oct 05 18:12:38.623113 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2799/5834] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:12:38.892764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02d17d39-1851-444d-abae-491d21c2960d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:38.893561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02d17d39-1851-444d-abae-491d21c2960d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:38.901804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d17d39-1851-444d-abae-491d21c2960d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:38.902528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d17d39-1851-444d-abae-491d21c2960d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:38.903216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d17d39-1851-444d-abae-491d21c2960d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:38.904128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d17d39-1851-444d-abae-491d21c2960d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:38.904742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d17d39-1851-444d-abae-491d21c2960d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:38.905274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02d17d39-1851-444d-abae-491d21c2960d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:38.910233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:39.462999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-02d17d39-1851-444d-abae-491d21c2960d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:39.472389 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02d17d39-1851-444d-abae-491d21c2960d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1292 microversion: 2.1 time: 0.583791 Oct 05 18:12:39.473236 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3036/5835] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:38 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1292 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:40.497577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c588d35e-fd37-4084-9b74-40a0bc2430ff tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:40.498327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c588d35e-fd37-4084-9b74-40a0bc2430ff tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:40.505328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c588d35e-fd37-4084-9b74-40a0bc2430ff tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:40.505814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c588d35e-fd37-4084-9b74-40a0bc2430ff tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:40.506254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c588d35e-fd37-4084-9b74-40a0bc2430ff tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:40.507003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c588d35e-fd37-4084-9b74-40a0bc2430ff tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:40.507450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c588d35e-fd37-4084-9b74-40a0bc2430ff tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:40.507910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c588d35e-fd37-4084-9b74-40a0bc2430ff tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:40.652526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c588d35e-fd37-4084-9b74-40a0bc2430ff tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:40.652922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7492fb47-6a23-42bc-b753-b2e73c920eae req-2c1df47f-3007-481e-85cd-cae7b9a4933a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f17b214-94c6-4ffa-b7f7-f456a8c89048", "tag": "ca944041-0e6f-4653-b464-a0e94de0a4ec"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:40.661191 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c588d35e-fd37-4084-9b74-40a0bc2430ff tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1292 microversion: 2.1 time: 0.169068 Oct 05 18:12:40.661809 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2800/5836] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:40 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1292 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:40.664446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7492fb47-6a23-42bc-b753-b2e73c920eae req-2c1df47f-3007-481e-85cd-cae7b9a4933a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:40.664980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7492fb47-6a23-42bc-b753-b2e73c920eae req-2c1df47f-3007-481e-85cd-cae7b9a4933a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:40.665458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7492fb47-6a23-42bc-b753-b2e73c920eae req-2c1df47f-3007-481e-85cd-cae7b9a4933a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:40.677471 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7492fb47-6a23-42bc-b753-b2e73c920eae req-2c1df47f-3007-481e-85cd-cae7b9a4933a service nova] Creating event network-changed:ca944041-0e6f-4653-b464-a0e94de0a4ec for instance 9f17b214-94c6-4ffa-b7f7-f456a8c89048 on n-h2-835595-3 Oct 05 18:12:40.682974 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7492fb47-6a23-42bc-b753-b2e73c920eae req-2c1df47f-3007-481e-85cd-cae7b9a4933a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039154 Oct 05 18:12:40.683556 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3037/5837] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:41.684848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3319ab72-7c48-4dac-a206-3a25e1e5c3bc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:41.685440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3319ab72-7c48-4dac-a206-3a25e1e5c3bc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:41.693612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3319ab72-7c48-4dac-a206-3a25e1e5c3bc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:41.694118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3319ab72-7c48-4dac-a206-3a25e1e5c3bc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:41.694595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3319ab72-7c48-4dac-a206-3a25e1e5c3bc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:41.695326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3319ab72-7c48-4dac-a206-3a25e1e5c3bc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:41.695801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3319ab72-7c48-4dac-a206-3a25e1e5c3bc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:41.696211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3319ab72-7c48-4dac-a206-3a25e1e5c3bc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:41.847242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3319ab72-7c48-4dac-a206-3a25e1e5c3bc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:41.855799 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3319ab72-7c48-4dac-a206-3a25e1e5c3bc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1292 microversion: 2.1 time: 0.175046 Oct 05 18:12:41.856476 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2801/5838] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:41 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1292 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:42.881934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-db4c88b0-5c36-4296-9485-b8c680e56e07 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:42.882647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-db4c88b0-5c36-4296-9485-b8c680e56e07 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:42.889329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4c88b0-5c36-4296-9485-b8c680e56e07 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:42.889804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4c88b0-5c36-4296-9485-b8c680e56e07 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:42.890411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4c88b0-5c36-4296-9485-b8c680e56e07 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:42.891229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4c88b0-5c36-4296-9485-b8c680e56e07 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:42.891680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4c88b0-5c36-4296-9485-b8c680e56e07 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:42.892226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db4c88b0-5c36-4296-9485-b8c680e56e07 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:43.049866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-db4c88b0-5c36-4296-9485-b8c680e56e07 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:43.060766 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-db4c88b0-5c36-4296-9485-b8c680e56e07 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1292 microversion: 2.1 time: 0.184991 Oct 05 18:12:43.061340 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3038/5839] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:42 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1292 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:44.084787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-628823b9-13f1-44d6-a8eb-25336e7d266b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:44.085427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-628823b9-13f1-44d6-a8eb-25336e7d266b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:44.092870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-628823b9-13f1-44d6-a8eb-25336e7d266b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:44.093247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-628823b9-13f1-44d6-a8eb-25336e7d266b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:44.093675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-628823b9-13f1-44d6-a8eb-25336e7d266b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:44.094672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-628823b9-13f1-44d6-a8eb-25336e7d266b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:44.095112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-628823b9-13f1-44d6-a8eb-25336e7d266b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:44.095580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-628823b9-13f1-44d6-a8eb-25336e7d266b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:44.241988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-628823b9-13f1-44d6-a8eb-25336e7d266b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:44.251217 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-628823b9-13f1-44d6-a8eb-25336e7d266b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1292 microversion: 2.1 time: 0.170796 Oct 05 18:12:44.251800 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2802/5840] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:44 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1292 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:44.879625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4e196f27-b9e9-4e51-8ca3-05ff5182f063 req-6561ab3f-9806-48c3-b740-333f279ac0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f17b214-94c6-4ffa-b7f7-f456a8c89048", "name": "network-vif-plugged", "status": "completed", "tag": "ca944041-0e6f-4653-b464-a0e94de0a4ec"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:44.891478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4e196f27-b9e9-4e51-8ca3-05ff5182f063 req-6561ab3f-9806-48c3-b740-333f279ac0a0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:44.892001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4e196f27-b9e9-4e51-8ca3-05ff5182f063 req-6561ab3f-9806-48c3-b740-333f279ac0a0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:44.892487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4e196f27-b9e9-4e51-8ca3-05ff5182f063 req-6561ab3f-9806-48c3-b740-333f279ac0a0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:44.910925 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4e196f27-b9e9-4e51-8ca3-05ff5182f063 req-6561ab3f-9806-48c3-b740-333f279ac0a0 service nova] Creating event network-vif-plugged:ca944041-0e6f-4653-b464-a0e94de0a4ec for instance 9f17b214-94c6-4ffa-b7f7-f456a8c89048 on n-h2-835595-3 Oct 05 18:12:44.916242 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4e196f27-b9e9-4e51-8ca3-05ff5182f063 req-6561ab3f-9806-48c3-b740-333f279ac0a0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040741 Oct 05 18:12:44.916937 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3039/5841] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:45.275423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ff417f11-e32f-4fe2-93ff-d902cab62be8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:45.276028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ff417f11-e32f-4fe2-93ff-d902cab62be8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:45.278891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:45.279599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:45.285689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff417f11-e32f-4fe2-93ff-d902cab62be8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:45.286184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff417f11-e32f-4fe2-93ff-d902cab62be8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:45.286649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff417f11-e32f-4fe2-93ff-d902cab62be8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:45.287353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff417f11-e32f-4fe2-93ff-d902cab62be8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:45.287811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff417f11-e32f-4fe2-93ff-d902cab62be8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:45.288241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff417f11-e32f-4fe2-93ff-d902cab62be8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:45.292536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:45.428201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ff417f11-e32f-4fe2-93ff-d902cab62be8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:45.436172 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ff417f11-e32f-4fe2-93ff-d902cab62be8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1292 microversion: 2.1 time: 0.164847 Oct 05 18:12:45.436756 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2803/5842] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:45 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1292 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:46.457494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:46.462606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f8265aa-d231-4236-9790-3fd605be3a66 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:46.463328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8f8265aa-d231-4236-9790-3fd605be3a66 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:46.470306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f8265aa-d231-4236-9790-3fd605be3a66 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:46.470845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f8265aa-d231-4236-9790-3fd605be3a66 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:46.471302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f8265aa-d231-4236-9790-3fd605be3a66 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:46.472014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f8265aa-d231-4236-9790-3fd605be3a66 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:46.472490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f8265aa-d231-4236-9790-3fd605be3a66 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:46.472934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f8265aa-d231-4236-9790-3fd605be3a66 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:46.612514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8f8265aa-d231-4236-9790-3fd605be3a66 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:46.624905 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f8265aa-d231-4236-9790-3fd605be3a66 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1472 microversion: 2.1 time: 0.168096 Oct 05 18:12:46.625605 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3040/5843] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:46 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1472 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:46.690822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-364507213", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:46.746336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] validate_networks() for [('16f17efc-9d97-4067-a300-10a3914986e7', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:12:47.474948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:12:47.475519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:12:47.476196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:12:47.476712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:12:47.477279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:12:47.490347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:47.491041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:47.491481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:47.492441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:47.493114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:47.493660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:47.511565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:12:47.516864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for user 0c698ccb66ac443582a7e610591c6da6 and project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:12:47.529993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:12:47.532350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: eb5f7fa2-f980-4a18-bb5b-cf819360e615] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:12:47.586725 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-63c2da5a-57d5-42b8-bfe7-9c764dab76f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900187 Oct 05 18:12:47.587512 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2804/5844] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:12:47.598894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-226579a8-861e-4235-a067-18d224b320c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:47.599455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-226579a8-861e-4235-a067-18d224b320c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: eb5f7fa2-f980-4a18-bb5b-cf819360e615] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:47.619021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-226579a8-861e-4235-a067-18d224b320c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: eb5f7fa2-f980-4a18-bb5b-cf819360e615] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:12:47.819162 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-226579a8-861e-4235-a067-18d224b320c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615" status: 204 len: 0 microversion: 2.1 time: 0.224117 Oct 05 18:12:47.819933 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3041/5845] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:12:47 2022] DELETE /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:12:47.830210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f42015e-a37b-43b4-ad9d-0335825eb354 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:47.830977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3f42015e-a37b-43b4-ad9d-0335825eb354 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: eb5f7fa2-f980-4a18-bb5b-cf819360e615] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:47.845773 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-3f42015e-a37b-43b4-ad9d-0335825eb354 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f42015e-a37b-43b4-ad9d-0335825eb354 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615 HTTP/1.1 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'eb5f7fa2-f980-4a18-bb5b-cf819360e615'} Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:12:47.868974 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f42015e-a37b-43b4-ad9d-0335825eb354 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:12:47.873965 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3f42015e-a37b-43b4-ad9d-0335825eb354 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615" status: 404 len: 111 microversion: 2.1 time: 0.046279 Oct 05 18:12:47.878437 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2805/5846] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:47 2022] GET /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:12:47.923930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-419800454", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "16f17efc-9d97-4067-a300-10a3914986e7"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:47.980700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] validate_networks() for [('16f17efc-9d97-4067-a300-10a3914986e7', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:12:48.366453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:12:48.366900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:12:48.367398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:12:48.367825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:12:48.368255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:12:48.378403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:48.378911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:48.379365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:48.380112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:48.380588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:48.381043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:48.398994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:12:48.404702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for user 0c698ccb66ac443582a7e610591c6da6 and project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:12:48.417544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:12:48.419994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:12:48.467187 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3dbb0c98-6e2f-4501-8132-697e85151322 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547566 Oct 05 18:12:48.473609 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3042/5847] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:12:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 18:12:48.479042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5e949417-90de-4fd3-acc2-ca5e1f928019 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:48.479704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5e949417-90de-4fd3-acc2-ca5e1f928019 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:48.534161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5e949417-90de-4fd3-acc2-ca5e1f928019 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:48.542144 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5e949417-90de-4fd3-acc2-ca5e1f928019 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1220 microversion: 2.1 time: 0.067110 Oct 05 18:12:48.543510 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2806/5848] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:48 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1220 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:49.566044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9f30b688-28d0-47fd-8839-e5eaea9f08c2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:49.566888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9f30b688-28d0-47fd-8839-e5eaea9f08c2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:49.574582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f30b688-28d0-47fd-8839-e5eaea9f08c2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:49.575220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f30b688-28d0-47fd-8839-e5eaea9f08c2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:49.575746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f30b688-28d0-47fd-8839-e5eaea9f08c2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:49.576858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f30b688-28d0-47fd-8839-e5eaea9f08c2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:49.577466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f30b688-28d0-47fd-8839-e5eaea9f08c2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:49.578012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f30b688-28d0-47fd-8839-e5eaea9f08c2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:49.652403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9f30b688-28d0-47fd-8839-e5eaea9f08c2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:49.662825 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9f30b688-28d0-47fd-8839-e5eaea9f08c2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1290 microversion: 2.1 time: 0.101092 Oct 05 18:12:49.663620 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3043/5849] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:49 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:50.687069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-98ac5e79-1163-489a-8e4a-d7daae6d02aa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:50.687639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-98ac5e79-1163-489a-8e4a-d7daae6d02aa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:50.695993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98ac5e79-1163-489a-8e4a-d7daae6d02aa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:50.696495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98ac5e79-1163-489a-8e4a-d7daae6d02aa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:50.696929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98ac5e79-1163-489a-8e4a-d7daae6d02aa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:50.698075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98ac5e79-1163-489a-8e4a-d7daae6d02aa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:50.698178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98ac5e79-1163-489a-8e4a-d7daae6d02aa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:50.698652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98ac5e79-1163-489a-8e4a-d7daae6d02aa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:50.833200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-98ac5e79-1163-489a-8e4a-d7daae6d02aa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:50.841541 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-98ac5e79-1163-489a-8e4a-d7daae6d02aa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1320 microversion: 2.1 time: 0.158829 Oct 05 18:12:50.842122 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2807/5850] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:50 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1320 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:50.941575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4034657d-8bed-489c-9d88-4bae6bfbeb5f req-0602ab05-3a24-4702-8f48-24c91b80e1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a482f1d2-7493-4e31-af1f-601ddb071cd0", "tag": "5a645760-7911-460c-96b5-66cab35e93a9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:50.954003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4034657d-8bed-489c-9d88-4bae6bfbeb5f req-0602ab05-3a24-4702-8f48-24c91b80e1b7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:50.954833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4034657d-8bed-489c-9d88-4bae6bfbeb5f req-0602ab05-3a24-4702-8f48-24c91b80e1b7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:50.955582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4034657d-8bed-489c-9d88-4bae6bfbeb5f req-0602ab05-3a24-4702-8f48-24c91b80e1b7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:50.968217 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4034657d-8bed-489c-9d88-4bae6bfbeb5f req-0602ab05-3a24-4702-8f48-24c91b80e1b7 service nova] Creating event network-changed:5a645760-7911-460c-96b5-66cab35e93a9 for instance a482f1d2-7493-4e31-af1f-601ddb071cd0 on n-h2-835595-3 Oct 05 18:12:50.973028 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4034657d-8bed-489c-9d88-4bae6bfbeb5f req-0602ab05-3a24-4702-8f48-24c91b80e1b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036028 Oct 05 18:12:50.973638 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3044/5851] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:51.865406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bc076b82-0c95-48c6-8b27-a9b9c94c4403 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:51.866054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bc076b82-0c95-48c6-8b27-a9b9c94c4403 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:51.873527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc076b82-0c95-48c6-8b27-a9b9c94c4403 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:51.874024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc076b82-0c95-48c6-8b27-a9b9c94c4403 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:51.874499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc076b82-0c95-48c6-8b27-a9b9c94c4403 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:51.875204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc076b82-0c95-48c6-8b27-a9b9c94c4403 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:51.875664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc076b82-0c95-48c6-8b27-a9b9c94c4403 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:51.876082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc076b82-0c95-48c6-8b27-a9b9c94c4403 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:52.014698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bc076b82-0c95-48c6-8b27-a9b9c94c4403 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:52.022910 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bc076b82-0c95-48c6-8b27-a9b9c94c4403 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1320 microversion: 2.1 time: 0.161553 Oct 05 18:12:52.023481 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2808/5852] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:51 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:53.047549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-deb063c1-35fb-4e7e-a35d-4a92500f762d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:53.048265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-deb063c1-35fb-4e7e-a35d-4a92500f762d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:53.055305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deb063c1-35fb-4e7e-a35d-4a92500f762d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:53.055804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deb063c1-35fb-4e7e-a35d-4a92500f762d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:53.056289 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deb063c1-35fb-4e7e-a35d-4a92500f762d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:53.056999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deb063c1-35fb-4e7e-a35d-4a92500f762d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:53.057499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deb063c1-35fb-4e7e-a35d-4a92500f762d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:53.057941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-deb063c1-35fb-4e7e-a35d-4a92500f762d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:53.209890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-deb063c1-35fb-4e7e-a35d-4a92500f762d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:53.221692 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-deb063c1-35fb-4e7e-a35d-4a92500f762d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1320 microversion: 2.1 time: 0.179348 Oct 05 18:12:53.222318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3045/5853] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:53 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1320 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:54.246571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-03b1821e-7e23-465a-b88f-dc2afc8d50ec tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:54.248651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-03b1821e-7e23-465a-b88f-dc2afc8d50ec tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:54.257375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03b1821e-7e23-465a-b88f-dc2afc8d50ec tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:54.257869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03b1821e-7e23-465a-b88f-dc2afc8d50ec tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:54.258359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03b1821e-7e23-465a-b88f-dc2afc8d50ec tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:54.259417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03b1821e-7e23-465a-b88f-dc2afc8d50ec tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:54.259993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03b1821e-7e23-465a-b88f-dc2afc8d50ec tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:54.260430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03b1821e-7e23-465a-b88f-dc2afc8d50ec tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:54.395168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-03b1821e-7e23-465a-b88f-dc2afc8d50ec tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:54.403482 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-03b1821e-7e23-465a-b88f-dc2afc8d50ec tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1320 microversion: 2.1 time: 0.162211 Oct 05 18:12:54.404097 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2809/5854] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:54 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:55.428161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-372670ec-2278-4a17-a9d0-51cfa5f0a682 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:55.429153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-372670ec-2278-4a17-a9d0-51cfa5f0a682 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:55.444624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-372670ec-2278-4a17-a9d0-51cfa5f0a682 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:55.445338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-372670ec-2278-4a17-a9d0-51cfa5f0a682 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:55.445982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-372670ec-2278-4a17-a9d0-51cfa5f0a682 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:55.447090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-372670ec-2278-4a17-a9d0-51cfa5f0a682 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:55.447567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-372670ec-2278-4a17-a9d0-51cfa5f0a682 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:55.448022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-372670ec-2278-4a17-a9d0-51cfa5f0a682 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:55.608551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-372670ec-2278-4a17-a9d0-51cfa5f0a682 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:55.619371 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-372670ec-2278-4a17-a9d0-51cfa5f0a682 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1320 microversion: 2.1 time: 0.196846 Oct 05 18:12:55.620130 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3046/5855] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:55 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:56.647618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00254158-216a-47eb-836b-f6c90e4e2a8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:56.648235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00254158-216a-47eb-836b-f6c90e4e2a8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:56.656438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00254158-216a-47eb-836b-f6c90e4e2a8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:56.656933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00254158-216a-47eb-836b-f6c90e4e2a8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:56.657371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00254158-216a-47eb-836b-f6c90e4e2a8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:56.658073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00254158-216a-47eb-836b-f6c90e4e2a8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:56.658577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00254158-216a-47eb-836b-f6c90e4e2a8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:56.659019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-00254158-216a-47eb-836b-f6c90e4e2a8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:56.805817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-00254158-216a-47eb-836b-f6c90e4e2a8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:56.815129 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00254158-216a-47eb-836b-f6c90e4e2a8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1320 microversion: 2.1 time: 0.172038 Oct 05 18:12:56.815983 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2810/5856] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:56 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:56.954901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8ae48391-0aa8-4573-9fb0-b4c7607103d0 req-25947778-3386-4933-aec4-50ec4e502981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a482f1d2-7493-4e31-af1f-601ddb071cd0", "name": "network-vif-plugged", "status": "completed", "tag": "5a645760-7911-460c-96b5-66cab35e93a9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:56.965513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8ae48391-0aa8-4573-9fb0-b4c7607103d0 req-25947778-3386-4933-aec4-50ec4e502981 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:56.966030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8ae48391-0aa8-4573-9fb0-b4c7607103d0 req-25947778-3386-4933-aec4-50ec4e502981 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:56.966509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8ae48391-0aa8-4573-9fb0-b4c7607103d0 req-25947778-3386-4933-aec4-50ec4e502981 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:56.978571 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8ae48391-0aa8-4573-9fb0-b4c7607103d0 req-25947778-3386-4933-aec4-50ec4e502981 service nova] Creating event network-vif-plugged:5a645760-7911-460c-96b5-66cab35e93a9 for instance a482f1d2-7493-4e31-af1f-601ddb071cd0 on n-h2-835595-3 Oct 05 18:12:56.983741 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8ae48391-0aa8-4573-9fb0-b4c7607103d0 req-25947778-3386-4933-aec4-50ec4e502981 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032716 Oct 05 18:12:56.984525 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3047/5857] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:12:57.737041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-881e30a2-0506-4146-8b61-f94ad0d3b425 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:12:57.739569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-881e30a2-0506-4146-8b61-f94ad0d3b425 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:57.741592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:57.748769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-881e30a2-0506-4146-8b61-f94ad0d3b425 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:57.749281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-881e30a2-0506-4146-8b61-f94ad0d3b425 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:57.749714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-881e30a2-0506-4146-8b61-f94ad0d3b425 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:57.750471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-881e30a2-0506-4146-8b61-f94ad0d3b425 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:57.750955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-881e30a2-0506-4146-8b61-f94ad0d3b425 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:57.751380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-881e30a2-0506-4146-8b61-f94ad0d3b425 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:57.810812 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-881e30a2-0506-4146-8b61-f94ad0d3b425 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "POST /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c/action" status: 200 len: 24554 microversion: 2.1 time: 0.078088 Oct 05 18:12:57.811460 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2811/5858] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:12:57 2022] POST /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c/action => generated 24554 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:12:57.839742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf12b499-230b-45a1-b33f-c0d4e7fddfb7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:57.840461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bf12b499-230b-45a1-b33f-c0d4e7fddfb7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:57.847118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf12b499-230b-45a1-b33f-c0d4e7fddfb7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:57.847715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf12b499-230b-45a1-b33f-c0d4e7fddfb7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:57.848162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf12b499-230b-45a1-b33f-c0d4e7fddfb7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:57.848867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf12b499-230b-45a1-b33f-c0d4e7fddfb7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:57.849333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf12b499-230b-45a1-b33f-c0d4e7fddfb7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:57.849765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf12b499-230b-45a1-b33f-c0d4e7fddfb7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:57.992792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bf12b499-230b-45a1-b33f-c0d4e7fddfb7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:58.003490 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf12b499-230b-45a1-b33f-c0d4e7fddfb7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1320 microversion: 2.1 time: 0.167765 Oct 05 18:12:58.004277 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3048/5859] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:57 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:59.029549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-099c0880-72f9-43d5-be3a-4e3e574afbfa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:59.030479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-099c0880-72f9-43d5-be3a-4e3e574afbfa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:59.034673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:59.035768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:59.041244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-099c0880-72f9-43d5-be3a-4e3e574afbfa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:59.041730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-099c0880-72f9-43d5-be3a-4e3e574afbfa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:59.042163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-099c0880-72f9-43d5-be3a-4e3e574afbfa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:59.042877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-099c0880-72f9-43d5-be3a-4e3e574afbfa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:59.043333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-099c0880-72f9-43d5-be3a-4e3e574afbfa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:59.043758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-099c0880-72f9-43d5-be3a-4e3e574afbfa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:59.190504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-099c0880-72f9-43d5-be3a-4e3e574afbfa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:59.199510 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-099c0880-72f9-43d5-be3a-4e3e574afbfa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1500 microversion: 2.1 time: 0.175031 Oct 05 18:12:59.200265 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2812/5860] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:59 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1500 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:59.224397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b989d867-94cc-461c-93a5-c17fb7c7db3d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:59.225002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b989d867-94cc-461c-93a5-c17fb7c7db3d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:59.227204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:59.227905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:12:59.234928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b989d867-94cc-461c-93a5-c17fb7c7db3d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:59.235573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b989d867-94cc-461c-93a5-c17fb7c7db3d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:59.236062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b989d867-94cc-461c-93a5-c17fb7c7db3d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:59.236790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b989d867-94cc-461c-93a5-c17fb7c7db3d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:59.237260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b989d867-94cc-461c-93a5-c17fb7c7db3d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:59.237707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b989d867-94cc-461c-93a5-c17fb7c7db3d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:59.672494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b989d867-94cc-461c-93a5-c17fb7c7db3d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:59.680697 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b989d867-94cc-461c-93a5-c17fb7c7db3d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1500 microversion: 2.1 time: 0.460554 Oct 05 18:12:59.681270 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3049/5861] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:59 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1500 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:12:59.708153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f1e08f1b-4612-41ba-b678-cef885530adf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:59.708645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1e08f1b-4612-41ba-b678-cef885530adf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:59.715939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e08f1b-4612-41ba-b678-cef885530adf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:59.716492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e08f1b-4612-41ba-b678-cef885530adf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:59.716922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e08f1b-4612-41ba-b678-cef885530adf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:59.717627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e08f1b-4612-41ba-b678-cef885530adf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:59.718077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e08f1b-4612-41ba-b678-cef885530adf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:59.718539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1e08f1b-4612-41ba-b678-cef885530adf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:59.744575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1e08f1b-4612-41ba-b678-cef885530adf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:12:59.823888 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f1e08f1b-4612-41ba-b678-cef885530adf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 204 len: 0 microversion: 2.1 time: 0.119704 Oct 05 18:12:59.824452 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2813/5862] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:12:59 2022] DELETE /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:12:59.832927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43744405-839e-4431-a0fd-8b92de19dc5e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:12:59.833584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-43744405-839e-4431-a0fd-8b92de19dc5e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:12:59.839695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43744405-839e-4431-a0fd-8b92de19dc5e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:59.840196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43744405-839e-4431-a0fd-8b92de19dc5e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:59.840666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43744405-839e-4431-a0fd-8b92de19dc5e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:59.841357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43744405-839e-4431-a0fd-8b92de19dc5e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:12:59.841831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43744405-839e-4431-a0fd-8b92de19dc5e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:12:59.842273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43744405-839e-4431-a0fd-8b92de19dc5e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:12:59.986925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-43744405-839e-4431-a0fd-8b92de19dc5e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:12:59.999075 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-43744405-839e-4431-a0fd-8b92de19dc5e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1506 microversion: 2.1 time: 0.169898 Oct 05 18:12:59.999851 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3050/5863] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:12:59 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:01.029536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ac984d1f-69fe-496e-bc18-6d8ff5f877c4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:01.030782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ac984d1f-69fe-496e-bc18-6d8ff5f877c4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:01.040067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac984d1f-69fe-496e-bc18-6d8ff5f877c4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:01.040552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac984d1f-69fe-496e-bc18-6d8ff5f877c4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:01.040982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac984d1f-69fe-496e-bc18-6d8ff5f877c4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:01.041670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac984d1f-69fe-496e-bc18-6d8ff5f877c4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:01.042120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac984d1f-69fe-496e-bc18-6d8ff5f877c4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:01.042572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac984d1f-69fe-496e-bc18-6d8ff5f877c4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:01.180512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ac984d1f-69fe-496e-bc18-6d8ff5f877c4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:01.188530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ac984d1f-69fe-496e-bc18-6d8ff5f877c4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1506 microversion: 2.1 time: 0.166529 Oct 05 18:13:01.189127 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2814/5864] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:01 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:01.918023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e30391e1-c2aa-4053-a390-de2128b82c83 req-97d8f1cd-ba28-4e4f-a3d1-1d657da6e4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a482f1d2-7493-4e31-af1f-601ddb071cd0", "name": "network-vif-deleted", "tag": "5a645760-7911-460c-96b5-66cab35e93a9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:01.935445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e30391e1-c2aa-4053-a390-de2128b82c83 req-97d8f1cd-ba28-4e4f-a3d1-1d657da6e4f3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:01.936331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e30391e1-c2aa-4053-a390-de2128b82c83 req-97d8f1cd-ba28-4e4f-a3d1-1d657da6e4f3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:01.936793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e30391e1-c2aa-4053-a390-de2128b82c83 req-97d8f1cd-ba28-4e4f-a3d1-1d657da6e4f3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:01.954012 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e30391e1-c2aa-4053-a390-de2128b82c83 req-97d8f1cd-ba28-4e4f-a3d1-1d657da6e4f3 service nova] Creating event network-vif-deleted:5a645760-7911-460c-96b5-66cab35e93a9 for instance a482f1d2-7493-4e31-af1f-601ddb071cd0 on n-h2-835595-3 Oct 05 18:13:01.959187 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e30391e1-c2aa-4053-a390-de2128b82c83 req-97d8f1cd-ba28-4e4f-a3d1-1d657da6e4f3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045437 Oct 05 18:13:01.960163 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3051/5865] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:02.216048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:02.217060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:02.227365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:02.227849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:02.228284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:02.228987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:02.229444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:02.229872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:02.262187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:02.262732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:02.263165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:02.263609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lazy-loading 'fault' on Instance uuid a482f1d2-7493-4e31-af1f-601ddb071cd0 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:13:02.304462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:02.312334 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e0f0d259-7818-43c3-aa86-b4ac934e9c1a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 200 len: 1310 microversion: 2.1 time: 0.103161 Oct 05 18:13:02.312905 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2815/5866] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:02 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 1310 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:03.338807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:03.339557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:03.341558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:03.347554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:03.348059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:03.348516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:03.349249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:03.349723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:03.350195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:03.366457 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 HTTP/1.1 Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'a482f1d2-7493-4e31-af1f-601ddb071cd0'} Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:03.368322 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:03.372918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:13:03.372918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:13:03.372918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:13:03.372918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:13:03.372918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:13:03.372918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:03.372918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:13:03.372918 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-357a4b5f-e5d8-4b06-b2e2-292b6bac0a1f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 404 len: 111 microversion: 2.1 time: 0.036815 Oct 05 18:13:03.372918 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3052/5867] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:03 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:13:03.383321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-397cbed9-b4f7-4e62-aef0-2d30a57a6ba3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'create', calling method: .version_select at 0x7f77795539d0>, body: {"keypair": {"name": "tempest-key-882204828", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV+grAqKk2ZJyEMt3eOxDoVAY0xBqozZLF60emAnXLH3cg3et+U5WMim4RAwud6Nnp4Og5Yu9DGuRn+j1i2MLVfu2E+CnKJLmJSXR2NENmiq39ilmpSkU0gH/qmHiaxKg=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:03.404300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-397cbed9-b4f7-4e62-aef0-2d30a57a6ba3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:13:03.410848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-397cbed9-b4f7-4e62-aef0-2d30a57a6ba3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for user 0c698ccb66ac443582a7e610591c6da6 and project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:13:03.439025 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-397cbed9-b4f7-4e62-aef0-2d30a57a6ba3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.059604 Oct 05 18:13:03.439649 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2816/5868] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:13:03 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:03.450849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-693ceff5-3e8e-45d6-a5bc-3dad6a2416ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '.version_select at 0x7f776c705f70>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:03.454900 n-d-835595-3 devstack@n-api.service[128844]: WARNING oslo_db.sqlalchemy.utils [None req-693ceff5-3e8e-45d6-a5bc-3dad6a2416ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 05 18:13:03.461016 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-693ceff5-3e8e-45d6-a5bc-3dad6a2416ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.014497 Oct 05 18:13:03.461533 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3053/5869] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 18:13:03 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:03.515224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1562363059", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "key_name": "tempest-key-882204828", "networks": [{"uuid": "16f17efc-9d97-4067-a300-10a3914986e7"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:03.571661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] validate_networks() for [('16f17efc-9d97-4067-a300-10a3914986e7', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:13:03.971565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:13:03.971990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:13:03.972467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:13:03.972906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:13:03.973323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:13:03.983134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:03.983659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:03.984097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:03.984823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:03.985275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:03.985699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:04.002843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:13:04.008691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for user 0c698ccb66ac443582a7e610591c6da6 and project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:13:04.022614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:13:04.024955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:13:04.073712 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-63a45066-87ca-4d24-8941-754aa7ddff13 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563216 Oct 05 18:13:04.074398 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2817/5870] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:13:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:13:04.086408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35033386-c47d-4bae-8244-e88c0eb0cbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:04.087051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-35033386-c47d-4bae-8244-e88c0eb0cbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:04.143861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-35033386-c47d-4bae-8244-e88c0eb0cbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:04.152980 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35033386-c47d-4bae-8244-e88c0eb0cbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1228 microversion: 2.1 time: 0.071059 Oct 05 18:13:04.153555 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3054/5871] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:04 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1228 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:05.176531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-62ae06ea-ac69-484f-84ad-902b61184556 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:05.177181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-62ae06ea-ac69-484f-84ad-902b61184556 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:05.185558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62ae06ea-ac69-484f-84ad-902b61184556 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:05.186063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62ae06ea-ac69-484f-84ad-902b61184556 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:05.186508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62ae06ea-ac69-484f-84ad-902b61184556 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:05.187389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62ae06ea-ac69-484f-84ad-902b61184556 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:05.188040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62ae06ea-ac69-484f-84ad-902b61184556 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:05.188436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62ae06ea-ac69-484f-84ad-902b61184556 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:05.259254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-62ae06ea-ac69-484f-84ad-902b61184556 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:05.267974 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-62ae06ea-ac69-484f-84ad-902b61184556 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1288 microversion: 2.1 time: 0.095355 Oct 05 18:13:05.269352 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2818/5872] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:05 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:06.292113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c4ab02b-e5b0-45da-b047-c2871eb42b82 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:06.292746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6c4ab02b-e5b0-45da-b047-c2871eb42b82 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:06.299891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c4ab02b-e5b0-45da-b047-c2871eb42b82 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:06.300397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c4ab02b-e5b0-45da-b047-c2871eb42b82 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:06.300871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c4ab02b-e5b0-45da-b047-c2871eb42b82 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:06.301675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c4ab02b-e5b0-45da-b047-c2871eb42b82 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:06.302148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c4ab02b-e5b0-45da-b047-c2871eb42b82 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:06.302685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c4ab02b-e5b0-45da-b047-c2871eb42b82 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:06.521833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6c4ab02b-e5b0-45da-b047-c2871eb42b82 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:06.530297 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6c4ab02b-e5b0-45da-b047-c2871eb42b82 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1328 microversion: 2.1 time: 0.242117 Oct 05 18:13:06.531110 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3055/5873] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:06 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1328 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:06.682448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-acb51ec8-773b-4472-84df-024027d8f4b4 req-b33659c7-4f46-4814-8e1e-29641deccb77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "025974d3-56f3-4351-9e21-8a862eeab80e", "tag": "e6d1fc8b-d2f0-4826-85f4-b5fe49b68e83"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:06.695288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-acb51ec8-773b-4472-84df-024027d8f4b4 req-b33659c7-4f46-4814-8e1e-29641deccb77 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:06.695753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-acb51ec8-773b-4472-84df-024027d8f4b4 req-b33659c7-4f46-4814-8e1e-29641deccb77 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:06.696527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-acb51ec8-773b-4472-84df-024027d8f4b4 req-b33659c7-4f46-4814-8e1e-29641deccb77 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:06.709946 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-acb51ec8-773b-4472-84df-024027d8f4b4 req-b33659c7-4f46-4814-8e1e-29641deccb77 service nova] Creating event network-changed:e6d1fc8b-d2f0-4826-85f4-b5fe49b68e83 for instance 025974d3-56f3-4351-9e21-8a862eeab80e on n-h2-835595-3 Oct 05 18:13:06.715371 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-acb51ec8-773b-4472-84df-024027d8f4b4 req-b33659c7-4f46-4814-8e1e-29641deccb77 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036826 Oct 05 18:13:06.716131 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2819/5874] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:07.555665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-60f6c13f-b4ac-4170-8ead-5c8d8c0a02c7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:07.556614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-60f6c13f-b4ac-4170-8ead-5c8d8c0a02c7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:07.567573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60f6c13f-b4ac-4170-8ead-5c8d8c0a02c7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:07.568297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60f6c13f-b4ac-4170-8ead-5c8d8c0a02c7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:07.568755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60f6c13f-b4ac-4170-8ead-5c8d8c0a02c7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:07.569450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60f6c13f-b4ac-4170-8ead-5c8d8c0a02c7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:07.569957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60f6c13f-b4ac-4170-8ead-5c8d8c0a02c7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:07.570433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-60f6c13f-b4ac-4170-8ead-5c8d8c0a02c7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:07.701625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-60f6c13f-b4ac-4170-8ead-5c8d8c0a02c7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:07.710023 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-60f6c13f-b4ac-4170-8ead-5c8d8c0a02c7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1328 microversion: 2.1 time: 0.160424 Oct 05 18:13:07.710645 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3056/5875] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:07 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1328 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:08.739968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f61b059-251c-440f-ab76-2fd2803ff557 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:08.740655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f61b059-251c-440f-ab76-2fd2803ff557 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:08.751641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f61b059-251c-440f-ab76-2fd2803ff557 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:08.751641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f61b059-251c-440f-ab76-2fd2803ff557 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:08.751641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f61b059-251c-440f-ab76-2fd2803ff557 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:08.751641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f61b059-251c-440f-ab76-2fd2803ff557 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:08.751641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f61b059-251c-440f-ab76-2fd2803ff557 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:08.751641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f61b059-251c-440f-ab76-2fd2803ff557 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:08.898506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4f61b059-251c-440f-ab76-2fd2803ff557 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:08.907081 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f61b059-251c-440f-ab76-2fd2803ff557 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1328 microversion: 2.1 time: 0.172487 Oct 05 18:13:08.907677 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2820/5876] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:08 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1328 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:09.930321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e71814ea-6acb-4c76-9a3c-af8c09fc286b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:09.931605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e71814ea-6acb-4c76-9a3c-af8c09fc286b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:09.938617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e71814ea-6acb-4c76-9a3c-af8c09fc286b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:09.939126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e71814ea-6acb-4c76-9a3c-af8c09fc286b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:09.939582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e71814ea-6acb-4c76-9a3c-af8c09fc286b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:09.941022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e71814ea-6acb-4c76-9a3c-af8c09fc286b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:09.941500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e71814ea-6acb-4c76-9a3c-af8c09fc286b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:09.941945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e71814ea-6acb-4c76-9a3c-af8c09fc286b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:09.944700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=79 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:10.127215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e71814ea-6acb-4c76-9a3c-af8c09fc286b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:10.135924 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e71814ea-6acb-4c76-9a3c-af8c09fc286b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1328 microversion: 2.1 time: 0.209886 Oct 05 18:13:10.136529 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3057/5877] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:09 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1328 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:10.947078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9c9cb7d-5436-4b20-bd00-8b576067ca49 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Action: 'create', calling method: .version_select at 0x7f77795531f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1143129745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCECfToDkeQLtIgIe0LFPtcA3stKccwZhkNIvgxjstvN5IDibVNJJUOXFXJNAO2kMjqAqFrepHvIJJOl6mzmxudfa/AlDDz0fIBhdkRH1eij/Z6A3gN3bSTaDAQZnj+cUw=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:10.966569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a9c9cb7d-5436-4b20-bd00-8b576067ca49 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for project 2fe00cc2c3494b749a02868d27f89977. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:13:10.973050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a9c9cb7d-5436-4b20-bd00-8b576067ca49 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for user 18188fb109574bf38443d2848a77bf69 and project 2fe00cc2c3494b749a02868d27f89977. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:13:11.002092 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a9c9cb7d-5436-4b20-bd00-8b576067ca49 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.059008 Oct 05 18:13:11.002931 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2821/5878] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:13:10 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:13:11.164721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25b5ce83-adfb-459f-bd58-20ae4f0ba433 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:11.167320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25b5ce83-adfb-459f-bd58-20ae4f0ba433 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:11.176009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b5ce83-adfb-459f-bd58-20ae4f0ba433 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:11.176972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b5ce83-adfb-459f-bd58-20ae4f0ba433 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:11.177632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b5ce83-adfb-459f-bd58-20ae4f0ba433 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:11.179101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b5ce83-adfb-459f-bd58-20ae4f0ba433 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:11.179848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b5ce83-adfb-459f-bd58-20ae4f0ba433 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:11.180510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b5ce83-adfb-459f-bd58-20ae4f0ba433 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:11.400223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25b5ce83-adfb-459f-bd58-20ae4f0ba433 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:11.417225 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25b5ce83-adfb-459f-bd58-20ae4f0ba433 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1328 microversion: 2.1 time: 0.254229 Oct 05 18:13:11.418011 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3058/5879] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:11 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1328 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:12.220364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-779155919", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "76ccdcdf-1c4d-4709-ae8d-1b4a3c0ae424"}], "key_name": "tempest-TestNetworkBasicOps-1143129745", "security_groups": [{"name": "tempest-secgroup-smoke-930107210"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:12.349462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] validate_networks() for [('76ccdcdf-1c4d-4709-ae8d-1b4a3c0ae424', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:13:12.441391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-34587f29-4cba-4af8-bfd5-ce8ee452f50a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:12.442068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-34587f29-4cba-4af8-bfd5-ce8ee452f50a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:12.450431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34587f29-4cba-4af8-bfd5-ce8ee452f50a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:12.451061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34587f29-4cba-4af8-bfd5-ce8ee452f50a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:12.451519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34587f29-4cba-4af8-bfd5-ce8ee452f50a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:12.452245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34587f29-4cba-4af8-bfd5-ce8ee452f50a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:12.452717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34587f29-4cba-4af8-bfd5-ce8ee452f50a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:12.453202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34587f29-4cba-4af8-bfd5-ce8ee452f50a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:12.615644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-34587f29-4cba-4af8-bfd5-ce8ee452f50a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:12.627933 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-34587f29-4cba-4af8-bfd5-ce8ee452f50a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1328 microversion: 2.1 time: 0.190457 Oct 05 18:13:12.628872 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3059/5880] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:12 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:12.768050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:13:12.768884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:13:12.769618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:13:12.770105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:13:12.770725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:13:12.783287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:12.784171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:12.784833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:12.785731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:12.786257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:12.786842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:12.808537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for project 2fe00cc2c3494b749a02868d27f89977. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:13:12.814884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for user 18188fb109574bf38443d2848a77bf69 and project 2fe00cc2c3494b749a02868d27f89977. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:13:12.829131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:13:12.831513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:13:12.889433 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-519a6e58-e789-4298-ab1b-c4c5637f76ed tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.672861 Oct 05 18:13:12.891025 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2822/5881] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:13:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:13:12.908100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-317e8f5c-8d71-4d8f-a770-99accb9499b0 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:12.910132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-317e8f5c-8d71-4d8f-a770-99accb9499b0 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:12.984921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-317e8f5c-8d71-4d8f-a770-99accb9499b0 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:12.994074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-317e8f5c-8d71-4d8f-a770-99accb9499b0 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1248 microversion: 2.1 time: 0.095834 Oct 05 18:13:12.994712 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3060/5882] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:12 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1248 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:13.079089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d0643cac-88e6-4fcc-8641-94cd168a51d1 req-077f2907-e24d-4e39-b3a6-20bf754bfc7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025974d3-56f3-4351-9e21-8a862eeab80e", "name": "network-vif-plugged", "status": "completed", "tag": "e6d1fc8b-d2f0-4826-85f4-b5fe49b68e83"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:13.092772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d0643cac-88e6-4fcc-8641-94cd168a51d1 req-077f2907-e24d-4e39-b3a6-20bf754bfc7a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:13.093614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d0643cac-88e6-4fcc-8641-94cd168a51d1 req-077f2907-e24d-4e39-b3a6-20bf754bfc7a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:13.094046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d0643cac-88e6-4fcc-8641-94cd168a51d1 req-077f2907-e24d-4e39-b3a6-20bf754bfc7a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:13.110250 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d0643cac-88e6-4fcc-8641-94cd168a51d1 req-077f2907-e24d-4e39-b3a6-20bf754bfc7a service nova] Creating event network-vif-plugged:e6d1fc8b-d2f0-4826-85f4-b5fe49b68e83 for instance 025974d3-56f3-4351-9e21-8a862eeab80e on n-h2-835595-3 Oct 05 18:13:13.118935 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d0643cac-88e6-4fcc-8641-94cd168a51d1 req-077f2907-e24d-4e39-b3a6-20bf754bfc7a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044643 Oct 05 18:13:13.122560 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2823/5883] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:13.653831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-088959ed-881f-43da-b043-4c2aa0e4d416 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:13.658743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-088959ed-881f-43da-b043-4c2aa0e4d416 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:13.669151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088959ed-881f-43da-b043-4c2aa0e4d416 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:13.669645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088959ed-881f-43da-b043-4c2aa0e4d416 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:13.670106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088959ed-881f-43da-b043-4c2aa0e4d416 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:13.670895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088959ed-881f-43da-b043-4c2aa0e4d416 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:13.672126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088959ed-881f-43da-b043-4c2aa0e4d416 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:13.672965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-088959ed-881f-43da-b043-4c2aa0e4d416 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:13.817609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-088959ed-881f-43da-b043-4c2aa0e4d416 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:13.825762 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-088959ed-881f-43da-b043-4c2aa0e4d416 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1328 microversion: 2.1 time: 0.178279 Oct 05 18:13:13.826375 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3061/5884] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:13 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1328 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:14.019355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3494d51e-7732-4c8b-9bd2-c6f848b46985 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:14.020227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3494d51e-7732-4c8b-9bd2-c6f848b46985 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:14.027598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3494d51e-7732-4c8b-9bd2-c6f848b46985 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:14.028082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3494d51e-7732-4c8b-9bd2-c6f848b46985 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:14.028549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3494d51e-7732-4c8b-9bd2-c6f848b46985 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:14.029255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3494d51e-7732-4c8b-9bd2-c6f848b46985 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:14.029694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3494d51e-7732-4c8b-9bd2-c6f848b46985 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:14.030127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3494d51e-7732-4c8b-9bd2-c6f848b46985 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:14.099298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3494d51e-7732-4c8b-9bd2-c6f848b46985 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:14.108220 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3494d51e-7732-4c8b-9bd2-c6f848b46985 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1308 microversion: 2.1 time: 0.094371 Oct 05 18:13:14.109333 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2824/5885] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:14 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:14.850558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-939bf57d-94d5-471d-97c0-1d00b61cd69b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:14.851449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-939bf57d-94d5-471d-97c0-1d00b61cd69b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:14.859600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939bf57d-94d5-471d-97c0-1d00b61cd69b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:14.860372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939bf57d-94d5-471d-97c0-1d00b61cd69b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:14.860777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939bf57d-94d5-471d-97c0-1d00b61cd69b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:14.861697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939bf57d-94d5-471d-97c0-1d00b61cd69b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:14.862177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939bf57d-94d5-471d-97c0-1d00b61cd69b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:14.864348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-939bf57d-94d5-471d-97c0-1d00b61cd69b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:15.133879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9fbb2f66-cbc7-4ca3-9181-c94af47c5835 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:15.134464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9fbb2f66-cbc7-4ca3-9181-c94af47c5835 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:15.141537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9fbb2f66-cbc7-4ca3-9181-c94af47c5835 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:15.142028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9fbb2f66-cbc7-4ca3-9181-c94af47c5835 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:15.142505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9fbb2f66-cbc7-4ca3-9181-c94af47c5835 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:15.143208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9fbb2f66-cbc7-4ca3-9181-c94af47c5835 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:15.143661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9fbb2f66-cbc7-4ca3-9181-c94af47c5835 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:15.144086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9fbb2f66-cbc7-4ca3-9181-c94af47c5835 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:15.163962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:15.199826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-939bf57d-94d5-471d-97c0-1d00b61cd69b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:15.213395 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-939bf57d-94d5-471d-97c0-1d00b61cd69b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1508 microversion: 2.1 time: 0.367794 Oct 05 18:13:15.217025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9fbb2f66-cbc7-4ca3-9181-c94af47c5835 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:15.220897 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3062/5886] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:14 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1508 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:15.235862 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9fbb2f66-cbc7-4ca3-9181-c94af47c5835 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1306 microversion: 2.1 time: 0.105863 Oct 05 18:13:15.236592 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2825/5887] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:15 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1306 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:15.242378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-de4c21dc-6841-4a7b-ba2f-82f3c98ef087 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:15.243064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-de4c21dc-6841-4a7b-ba2f-82f3c98ef087 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:15.249127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de4c21dc-6841-4a7b-ba2f-82f3c98ef087 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:15.249625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de4c21dc-6841-4a7b-ba2f-82f3c98ef087 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:15.250076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de4c21dc-6841-4a7b-ba2f-82f3c98ef087 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:15.250896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de4c21dc-6841-4a7b-ba2f-82f3c98ef087 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:15.251365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de4c21dc-6841-4a7b-ba2f-82f3c98ef087 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:15.251811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de4c21dc-6841-4a7b-ba2f-82f3c98ef087 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:15.542984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-de4c21dc-6841-4a7b-ba2f-82f3c98ef087 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:15.554466 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-de4c21dc-6841-4a7b-ba2f-82f3c98ef087 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1508 microversion: 2.1 time: 0.315359 Oct 05 18:13:15.555609 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3063/5888] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:15 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1508 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:15.581501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fb26ece1-e34e-4143-bb33-d208ec5a8880 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:15.582019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fb26ece1-e34e-4143-bb33-d208ec5a8880 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:15.588233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb26ece1-e34e-4143-bb33-d208ec5a8880 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:15.588725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb26ece1-e34e-4143-bb33-d208ec5a8880 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:15.589186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb26ece1-e34e-4143-bb33-d208ec5a8880 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:15.590252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb26ece1-e34e-4143-bb33-d208ec5a8880 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:15.590736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb26ece1-e34e-4143-bb33-d208ec5a8880 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:15.591146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb26ece1-e34e-4143-bb33-d208ec5a8880 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:15.618019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fb26ece1-e34e-4143-bb33-d208ec5a8880 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:13:15.724261 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fb26ece1-e34e-4143-bb33-d208ec5a8880 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 204 len: 0 microversion: 2.1 time: 0.146273 Oct 05 18:13:15.728180 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2826/5889] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:13:15 2022] DELETE /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:13:15.734713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92d97d8b-ad1b-48b2-8e8b-e80f79c1e1f4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:15.735416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92d97d8b-ad1b-48b2-8e8b-e80f79c1e1f4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:15.742399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92d97d8b-ad1b-48b2-8e8b-e80f79c1e1f4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:15.743376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92d97d8b-ad1b-48b2-8e8b-e80f79c1e1f4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:15.743904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92d97d8b-ad1b-48b2-8e8b-e80f79c1e1f4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:15.744699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92d97d8b-ad1b-48b2-8e8b-e80f79c1e1f4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:15.745316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92d97d8b-ad1b-48b2-8e8b-e80f79c1e1f4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:15.745821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92d97d8b-ad1b-48b2-8e8b-e80f79c1e1f4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:15.989354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92d97d8b-ad1b-48b2-8e8b-e80f79c1e1f4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:15.997601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92d97d8b-ad1b-48b2-8e8b-e80f79c1e1f4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1514 microversion: 2.1 time: 0.267544 Oct 05 18:13:15.998232 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3064/5890] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:15 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1514 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:16.261618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-03382deb-8752-47ee-a84c-181ef973b317 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:16.262262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-03382deb-8752-47ee-a84c-181ef973b317 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:16.269831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03382deb-8752-47ee-a84c-181ef973b317 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:16.270525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03382deb-8752-47ee-a84c-181ef973b317 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:16.271074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03382deb-8752-47ee-a84c-181ef973b317 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:16.271823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03382deb-8752-47ee-a84c-181ef973b317 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:16.272284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03382deb-8752-47ee-a84c-181ef973b317 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:16.272709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03382deb-8752-47ee-a84c-181ef973b317 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:16.435702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-03382deb-8752-47ee-a84c-181ef973b317 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:16.446632 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-03382deb-8752-47ee-a84c-181ef973b317 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1373 microversion: 2.1 time: 0.189737 Oct 05 18:13:16.447962 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2827/5891] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:16 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1373 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:13:16.626872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-88c63b26-0ecd-415a-9aba-e6644b823ff0 req-d62766b5-c4ab-4bae-aba9-f842d1fcedad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90da7228-8190-4bfa-b6f6-9edbce634c12", "tag": "219470e0-0df0-461a-a453-5e76e44e9518"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:16.638677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88c63b26-0ecd-415a-9aba-e6644b823ff0 req-d62766b5-c4ab-4bae-aba9-f842d1fcedad service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:16.639475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88c63b26-0ecd-415a-9aba-e6644b823ff0 req-d62766b5-c4ab-4bae-aba9-f842d1fcedad service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:16.640129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-88c63b26-0ecd-415a-9aba-e6644b823ff0 req-d62766b5-c4ab-4bae-aba9-f842d1fcedad service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:16.654342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-88c63b26-0ecd-415a-9aba-e6644b823ff0 req-d62766b5-c4ab-4bae-aba9-f842d1fcedad service nova] Creating event network-changed:219470e0-0df0-461a-a453-5e76e44e9518 for instance 90da7228-8190-4bfa-b6f6-9edbce634c12 on n-h1-835595-3 Oct 05 18:13:16.660480 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-88c63b26-0ecd-415a-9aba-e6644b823ff0 req-d62766b5-c4ab-4bae-aba9-f842d1fcedad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038047 Oct 05 18:13:16.661181 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3065/5892] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:17.022581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-571aebf8-8d7e-487a-a0e9-23ff2ce524e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:17.023520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-571aebf8-8d7e-487a-a0e9-23ff2ce524e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:17.030251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-571aebf8-8d7e-487a-a0e9-23ff2ce524e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:17.030931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-571aebf8-8d7e-487a-a0e9-23ff2ce524e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:17.031436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-571aebf8-8d7e-487a-a0e9-23ff2ce524e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:17.032862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-571aebf8-8d7e-487a-a0e9-23ff2ce524e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:17.033521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-571aebf8-8d7e-487a-a0e9-23ff2ce524e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:17.034056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-571aebf8-8d7e-487a-a0e9-23ff2ce524e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:17.236425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-571aebf8-8d7e-487a-a0e9-23ff2ce524e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:17.244535 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-571aebf8-8d7e-487a-a0e9-23ff2ce524e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 200 len: 1514 microversion: 2.1 time: 0.226776 Oct 05 18:13:17.245133 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2828/5893] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:17 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:17.473127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c2d3094-7e1c-408f-9351-d5967fffc4ab tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:17.473838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8c2d3094-7e1c-408f-9351-d5967fffc4ab tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:17.481800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c2d3094-7e1c-408f-9351-d5967fffc4ab tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:17.482378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c2d3094-7e1c-408f-9351-d5967fffc4ab tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:17.482914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c2d3094-7e1c-408f-9351-d5967fffc4ab tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:17.483659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c2d3094-7e1c-408f-9351-d5967fffc4ab tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:17.484096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c2d3094-7e1c-408f-9351-d5967fffc4ab tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:17.484537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c2d3094-7e1c-408f-9351-d5967fffc4ab tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:17.688948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8c2d3094-7e1c-408f-9351-d5967fffc4ab tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:17.697288 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8c2d3094-7e1c-408f-9351-d5967fffc4ab tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1373 microversion: 2.1 time: 0.229702 Oct 05 18:13:17.698209 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3066/5894] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:17 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1373 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:18.269139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:18.270257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:18.272809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:18.279027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:18.279655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:18.280100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:18.280825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:18.281279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:18.281893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:18.300464 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e HTTP/1.1 Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '025974d3-56f3-4351-9e21-8a862eeab80e'} Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:13:18.302215 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:18.307222 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:13:18.307222 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:13:18.307222 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:13:18.307222 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:13:18.307222 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:13:18.307222 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:13:18.308409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:13:18.309447 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9004a78e-7b4f-4704-9ce8-da8bbe5c2b2a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 404 len: 111 microversion: 2.1 time: 0.044445 Oct 05 18:13:18.310388 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2829/5895] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:18 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:13:18.318789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cdb755ca-d93a-4760-8196-ab4fee097823 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '.version_select at 0x7f77795694c0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:18.341851 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cdb755ca-d93a-4760-8196-ab4fee097823 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-key-882204828" status: 202 len: 0 microversion: 2.1 time: 0.027141 Oct 05 18:13:18.342873 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3067/5896] 10.222.0.70 () {58 vars in 1206 bytes} [Wed Oct 5 18:13:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-882204828 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 18:13:18.394044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-678806257", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "16f17efc-9d97-4067-a300-10a3914986e7"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:18.451476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] validate_networks() for [('16f17efc-9d97-4067-a300-10a3914986e7', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:13:18.685590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9a499b05-9834-4716-94f5-cae0ce2df0cb req-b68c5626-d5ac-4cc9-b499-b5eea4fa8882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "025974d3-56f3-4351-9e21-8a862eeab80e", "name": "network-vif-deleted", "tag": "e6d1fc8b-d2f0-4826-85f4-b5fe49b68e83"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:18.696210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9a499b05-9834-4716-94f5-cae0ce2df0cb req-b68c5626-d5ac-4cc9-b499-b5eea4fa8882 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:18.696689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9a499b05-9834-4716-94f5-cae0ce2df0cb req-b68c5626-d5ac-4cc9-b499-b5eea4fa8882 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:18.697137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9a499b05-9834-4716-94f5-cae0ce2df0cb req-b68c5626-d5ac-4cc9-b499-b5eea4fa8882 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:18.707823 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9a499b05-9834-4716-94f5-cae0ce2df0cb req-b68c5626-d5ac-4cc9-b499-b5eea4fa8882 service nova] Creating event network-vif-deleted:e6d1fc8b-d2f0-4826-85f4-b5fe49b68e83 for instance 025974d3-56f3-4351-9e21-8a862eeab80e on n-h2-835595-3 Oct 05 18:13:18.713417 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9a499b05-9834-4716-94f5-cae0ce2df0cb req-b68c5626-d5ac-4cc9-b499-b5eea4fa8882 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032366 Oct 05 18:13:18.714058 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3068/5897] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:13:18.721059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54f272ac-33d7-442a-90e3-385ba3b08419 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:18.721955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54f272ac-33d7-442a-90e3-385ba3b08419 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:18.729252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f272ac-33d7-442a-90e3-385ba3b08419 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:18.730044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f272ac-33d7-442a-90e3-385ba3b08419 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:18.730767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f272ac-33d7-442a-90e3-385ba3b08419 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:18.731858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f272ac-33d7-442a-90e3-385ba3b08419 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:18.732609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f272ac-33d7-442a-90e3-385ba3b08419 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:18.733296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-54f272ac-33d7-442a-90e3-385ba3b08419 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:18.841565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:13:18.841989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:13:18.842499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:13:18.842911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:13:18.843321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:13:18.852808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:18.853294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:18.853732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:18.854513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:18.854970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:18.855391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:18.868872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54f272ac-33d7-442a-90e3-385ba3b08419 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:18.873291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:13:18.876879 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54f272ac-33d7-442a-90e3-385ba3b08419 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1373 microversion: 2.1 time: 0.160648 Oct 05 18:13:18.877431 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3069/5898] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:18 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:13:18.878996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for user 0c698ccb66ac443582a7e610591c6da6 and project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:13:18.891451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:13:18.893727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:13:18.940888 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ca747c3e-060b-4eef-971b-667030363dd5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551206 Oct 05 18:13:18.941545 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2830/5899] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:13:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:13:18.952954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54a41c11-9142-4f2e-94a2-b5620fe933be tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:18.953579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54a41c11-9142-4f2e-94a2-b5620fe933be tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:19.010306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-54a41c11-9142-4f2e-94a2-b5620fe933be tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:19.017971 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54a41c11-9142-4f2e-94a2-b5620fe933be tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1208 microversion: 2.1 time: 0.068840 Oct 05 18:13:19.018969 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3070/5900] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:18 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1208 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:19.901421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d3cf4205-6356-4251-b9e2-1962fd396741 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:19.902825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d3cf4205-6356-4251-b9e2-1962fd396741 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:19.909329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3cf4205-6356-4251-b9e2-1962fd396741 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:19.909852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3cf4205-6356-4251-b9e2-1962fd396741 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:19.910308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3cf4205-6356-4251-b9e2-1962fd396741 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:19.911014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3cf4205-6356-4251-b9e2-1962fd396741 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:19.911497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3cf4205-6356-4251-b9e2-1962fd396741 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:19.911921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3cf4205-6356-4251-b9e2-1962fd396741 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:20.042468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dd625b51-0d03-49a8-9241-3524a0355a11 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:20.043773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dd625b51-0d03-49a8-9241-3524a0355a11 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:20.060523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d3cf4205-6356-4251-b9e2-1962fd396741 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:20.074615 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d3cf4205-6356-4251-b9e2-1962fd396741 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1373 microversion: 2.1 time: 0.175382 Oct 05 18:13:20.075427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd625b51-0d03-49a8-9241-3524a0355a11 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:20.076336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd625b51-0d03-49a8-9241-3524a0355a11 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:20.076810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd625b51-0d03-49a8-9241-3524a0355a11 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:20.077600 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2831/5901] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:19 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1373 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:20.077957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd625b51-0d03-49a8-9241-3524a0355a11 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:20.078552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd625b51-0d03-49a8-9241-3524a0355a11 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:20.079006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd625b51-0d03-49a8-9241-3524a0355a11 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:20.175394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd625b51-0d03-49a8-9241-3524a0355a11 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:20.184461 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dd625b51-0d03-49a8-9241-3524a0355a11 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1268 microversion: 2.1 time: 0.146358 Oct 05 18:13:20.185063 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3071/5902] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:20 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:13:21.098319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-759c5133-696d-4e85-8e85-99fa5d9f9f53 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:21.100093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-759c5133-696d-4e85-8e85-99fa5d9f9f53 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:21.106456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759c5133-696d-4e85-8e85-99fa5d9f9f53 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:21.107026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759c5133-696d-4e85-8e85-99fa5d9f9f53 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:21.107531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759c5133-696d-4e85-8e85-99fa5d9f9f53 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:21.108371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759c5133-696d-4e85-8e85-99fa5d9f9f53 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:21.108829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759c5133-696d-4e85-8e85-99fa5d9f9f53 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:21.109283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-759c5133-696d-4e85-8e85-99fa5d9f9f53 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:21.208866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6b34449b-cb7f-4c68-9589-2c72070f186d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:21.210181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6b34449b-cb7f-4c68-9589-2c72070f186d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:21.219785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b34449b-cb7f-4c68-9589-2c72070f186d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:21.220300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b34449b-cb7f-4c68-9589-2c72070f186d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:21.220755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b34449b-cb7f-4c68-9589-2c72070f186d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:21.221483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b34449b-cb7f-4c68-9589-2c72070f186d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:21.221957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b34449b-cb7f-4c68-9589-2c72070f186d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:21.222579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6b34449b-cb7f-4c68-9589-2c72070f186d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:21.253846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-759c5133-696d-4e85-8e85-99fa5d9f9f53 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:21.262383 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-759c5133-696d-4e85-8e85-99fa5d9f9f53 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1373 microversion: 2.1 time: 0.168946 Oct 05 18:13:21.262922 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2832/5903] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:21 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:21.414376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6b34449b-cb7f-4c68-9589-2c72070f186d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:21.424934 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6b34449b-cb7f-4c68-9589-2c72070f186d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1308 microversion: 2.1 time: 0.220129 Oct 05 18:13:21.425835 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3072/5904] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:21 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1308 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:21.558000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d3b728a6-9cfe-4c3b-ab9e-8801a7917675 req-09ee2728-aeb1-42f7-8b7b-c7f4096eedbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e15b02-96f0-4c39-8e38-e7163ba0f80a", "tag": "97123d96-fc64-433b-80cd-22965353c8e6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:21.569275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d3b728a6-9cfe-4c3b-ab9e-8801a7917675 req-09ee2728-aeb1-42f7-8b7b-c7f4096eedbf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:21.569804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d3b728a6-9cfe-4c3b-ab9e-8801a7917675 req-09ee2728-aeb1-42f7-8b7b-c7f4096eedbf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:21.570305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d3b728a6-9cfe-4c3b-ab9e-8801a7917675 req-09ee2728-aeb1-42f7-8b7b-c7f4096eedbf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:21.582473 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d3b728a6-9cfe-4c3b-ab9e-8801a7917675 req-09ee2728-aeb1-42f7-8b7b-c7f4096eedbf service nova] Creating event network-changed:97123d96-fc64-433b-80cd-22965353c8e6 for instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a on n-h2-835595-3 Oct 05 18:13:21.587643 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d3b728a6-9cfe-4c3b-ab9e-8801a7917675 req-09ee2728-aeb1-42f7-8b7b-c7f4096eedbf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033818 Oct 05 18:13:21.588862 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2833/5905] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:21.991736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-0de9b8b1-47e3-40db-9a94-3ba2a7c98a6b req-84c1476c-228f-4d1b-81b3-fdf43addb6a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90da7228-8190-4bfa-b6f6-9edbce634c12", "name": "network-vif-plugged", "status": "completed", "tag": "219470e0-0df0-461a-a453-5e76e44e9518"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:22.004927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0de9b8b1-47e3-40db-9a94-3ba2a7c98a6b req-84c1476c-228f-4d1b-81b3-fdf43addb6a4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:22.005441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0de9b8b1-47e3-40db-9a94-3ba2a7c98a6b req-84c1476c-228f-4d1b-81b3-fdf43addb6a4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:22.006073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0de9b8b1-47e3-40db-9a94-3ba2a7c98a6b req-84c1476c-228f-4d1b-81b3-fdf43addb6a4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:22.019148 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-0de9b8b1-47e3-40db-9a94-3ba2a7c98a6b req-84c1476c-228f-4d1b-81b3-fdf43addb6a4 service nova] Creating event network-vif-plugged:219470e0-0df0-461a-a453-5e76e44e9518 for instance 90da7228-8190-4bfa-b6f6-9edbce634c12 on n-h1-835595-3 Oct 05 18:13:22.025064 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-0de9b8b1-47e3-40db-9a94-3ba2a7c98a6b req-84c1476c-228f-4d1b-81b3-fdf43addb6a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037211 Oct 05 18:13:22.025864 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3073/5906] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:22.290926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8415010b-f185-4b5d-b49c-550f3bb52c7a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:22.291646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8415010b-f185-4b5d-b49c-550f3bb52c7a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:22.298268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8415010b-f185-4b5d-b49c-550f3bb52c7a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:22.298787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8415010b-f185-4b5d-b49c-550f3bb52c7a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:22.299226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8415010b-f185-4b5d-b49c-550f3bb52c7a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:22.299918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8415010b-f185-4b5d-b49c-550f3bb52c7a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:22.300374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8415010b-f185-4b5d-b49c-550f3bb52c7a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:22.300794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8415010b-f185-4b5d-b49c-550f3bb52c7a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:22.447304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8415010b-f185-4b5d-b49c-550f3bb52c7a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:22.449987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e38ad8ed-181a-493f-a7e1-41ed6d178513 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:22.451011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e38ad8ed-181a-493f-a7e1-41ed6d178513 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:22.456808 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8415010b-f185-4b5d-b49c-550f3bb52c7a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1373 microversion: 2.1 time: 0.173422 Oct 05 18:13:22.457610 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2834/5907] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:22 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:22.458641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38ad8ed-181a-493f-a7e1-41ed6d178513 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:22.459150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38ad8ed-181a-493f-a7e1-41ed6d178513 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:22.459823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38ad8ed-181a-493f-a7e1-41ed6d178513 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:22.460621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38ad8ed-181a-493f-a7e1-41ed6d178513 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:22.461099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38ad8ed-181a-493f-a7e1-41ed6d178513 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:22.461547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e38ad8ed-181a-493f-a7e1-41ed6d178513 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:22.597946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e38ad8ed-181a-493f-a7e1-41ed6d178513 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:22.607726 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e38ad8ed-181a-493f-a7e1-41ed6d178513 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1308 microversion: 2.1 time: 0.162518 Oct 05 18:13:22.608324 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3074/5908] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:22 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:23.479841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d274f6b4-0d58-43a9-9896-8416a036d991 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:23.480413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d274f6b4-0d58-43a9-9896-8416a036d991 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:23.487758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d274f6b4-0d58-43a9-9896-8416a036d991 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:23.488255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d274f6b4-0d58-43a9-9896-8416a036d991 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:23.488694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d274f6b4-0d58-43a9-9896-8416a036d991 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:23.489392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d274f6b4-0d58-43a9-9896-8416a036d991 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:23.490078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d274f6b4-0d58-43a9-9896-8416a036d991 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:23.490542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d274f6b4-0d58-43a9-9896-8416a036d991 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:23.631954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ca21a9df-40f8-415b-a8b3-60d59f4a8dc0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:23.632582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ca21a9df-40f8-415b-a8b3-60d59f4a8dc0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:23.634024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d274f6b4-0d58-43a9-9896-8416a036d991 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:23.640022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca21a9df-40f8-415b-a8b3-60d59f4a8dc0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:23.640584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca21a9df-40f8-415b-a8b3-60d59f4a8dc0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:23.641034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca21a9df-40f8-415b-a8b3-60d59f4a8dc0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:23.641756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca21a9df-40f8-415b-a8b3-60d59f4a8dc0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:23.642223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca21a9df-40f8-415b-a8b3-60d59f4a8dc0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:23.642684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca21a9df-40f8-415b-a8b3-60d59f4a8dc0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:23.645488 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d274f6b4-0d58-43a9-9896-8416a036d991 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1373 microversion: 2.1 time: 0.169822 Oct 05 18:13:23.646064 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2835/5909] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:23 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1373 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:23.777360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ca21a9df-40f8-415b-a8b3-60d59f4a8dc0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:23.785697 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ca21a9df-40f8-415b-a8b3-60d59f4a8dc0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1308 microversion: 2.1 time: 0.158152 Oct 05 18:13:23.786307 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3075/5910] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:23 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:24.669429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f6ad753-ee74-4ae7-a440-9ae09e032e66 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:24.670070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f6ad753-ee74-4ae7-a440-9ae09e032e66 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:24.677490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f6ad753-ee74-4ae7-a440-9ae09e032e66 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:24.677977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f6ad753-ee74-4ae7-a440-9ae09e032e66 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:24.678447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f6ad753-ee74-4ae7-a440-9ae09e032e66 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:24.679148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f6ad753-ee74-4ae7-a440-9ae09e032e66 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:24.679603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f6ad753-ee74-4ae7-a440-9ae09e032e66 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:24.680078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f6ad753-ee74-4ae7-a440-9ae09e032e66 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:24.809172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79dadf42-e8a5-4948-8da6-0dcc158a7959 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:24.809903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-79dadf42-e8a5-4948-8da6-0dcc158a7959 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:24.817545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79dadf42-e8a5-4948-8da6-0dcc158a7959 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:24.818149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79dadf42-e8a5-4948-8da6-0dcc158a7959 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:24.818621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79dadf42-e8a5-4948-8da6-0dcc158a7959 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:24.819315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79dadf42-e8a5-4948-8da6-0dcc158a7959 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:24.819791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79dadf42-e8a5-4948-8da6-0dcc158a7959 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:24.820237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79dadf42-e8a5-4948-8da6-0dcc158a7959 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:24.850965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4f6ad753-ee74-4ae7-a440-9ae09e032e66 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:24.860317 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f6ad753-ee74-4ae7-a440-9ae09e032e66 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1545 microversion: 2.1 time: 0.194839 Oct 05 18:13:24.861410 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2836/5911] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:24 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1545 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:24.885977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c356ac96-8d0e-4c16-ab75-3e779e6ff391 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:24.886647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c356ac96-8d0e-4c16-ab75-3e779e6ff391 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:24.894032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c356ac96-8d0e-4c16-ab75-3e779e6ff391 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:24.894994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c356ac96-8d0e-4c16-ab75-3e779e6ff391 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:24.895596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c356ac96-8d0e-4c16-ab75-3e779e6ff391 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:24.896752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c356ac96-8d0e-4c16-ab75-3e779e6ff391 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:24.897725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c356ac96-8d0e-4c16-ab75-3e779e6ff391 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:24.898453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c356ac96-8d0e-4c16-ab75-3e779e6ff391 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:24.974184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79dadf42-e8a5-4948-8da6-0dcc158a7959 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:24.984242 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79dadf42-e8a5-4948-8da6-0dcc158a7959 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1308 microversion: 2.1 time: 0.179090 Oct 05 18:13:24.985284 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3076/5912] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:24 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:13:25.055231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c356ac96-8d0e-4c16-ab75-3e779e6ff391 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:25.063817 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c356ac96-8d0e-4c16-ab75-3e779e6ff391 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1545 microversion: 2.1 time: 0.182548 Oct 05 18:13:25.064414 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2837/5913] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:24 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1545 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:26.009322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3e739571-d813-41ff-94a0-233a39b21261 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:26.009965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3e739571-d813-41ff-94a0-233a39b21261 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:26.019061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e739571-d813-41ff-94a0-233a39b21261 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:26.019660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e739571-d813-41ff-94a0-233a39b21261 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:26.020320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e739571-d813-41ff-94a0-233a39b21261 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:26.021458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e739571-d813-41ff-94a0-233a39b21261 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:26.022186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e739571-d813-41ff-94a0-233a39b21261 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:26.022739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e739571-d813-41ff-94a0-233a39b21261 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:26.160916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3e739571-d813-41ff-94a0-233a39b21261 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:26.172376 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3e739571-d813-41ff-94a0-233a39b21261 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1308 microversion: 2.1 time: 0.167691 Oct 05 18:13:26.172985 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3077/5914] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:26 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:27.129946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-8c0338e9-0ea7-4879-860c-1559db223f54 req-7303a7b6-b387-424a-93fe-6201dca6647a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e15b02-96f0-4c39-8e38-e7163ba0f80a", "name": "network-vif-plugged", "status": "completed", "tag": "97123d96-fc64-433b-80cd-22965353c8e6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:27.141296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8c0338e9-0ea7-4879-860c-1559db223f54 req-7303a7b6-b387-424a-93fe-6201dca6647a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:27.141885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8c0338e9-0ea7-4879-860c-1559db223f54 req-7303a7b6-b387-424a-93fe-6201dca6647a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:27.142457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8c0338e9-0ea7-4879-860c-1559db223f54 req-7303a7b6-b387-424a-93fe-6201dca6647a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:27.155269 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-8c0338e9-0ea7-4879-860c-1559db223f54 req-7303a7b6-b387-424a-93fe-6201dca6647a service nova] Creating event network-vif-plugged:97123d96-fc64-433b-80cd-22965353c8e6 for instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a on n-h2-835595-3 Oct 05 18:13:27.160475 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-8c0338e9-0ea7-4879-860c-1559db223f54 req-7303a7b6-b387-424a-93fe-6201dca6647a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036830 Oct 05 18:13:27.161526 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2838/5915] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:13:27.199714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1dc54f8-ce3f-4771-8afa-f91bb10bfd43 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:27.203087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f1dc54f8-ce3f-4771-8afa-f91bb10bfd43 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:27.213936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dc54f8-ce3f-4771-8afa-f91bb10bfd43 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:27.214486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dc54f8-ce3f-4771-8afa-f91bb10bfd43 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:27.214949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dc54f8-ce3f-4771-8afa-f91bb10bfd43 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:27.215680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dc54f8-ce3f-4771-8afa-f91bb10bfd43 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:27.216159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dc54f8-ce3f-4771-8afa-f91bb10bfd43 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:27.216607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1dc54f8-ce3f-4771-8afa-f91bb10bfd43 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:27.745971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f1dc54f8-ce3f-4771-8afa-f91bb10bfd43 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:27.749319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:27.756902 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f1dc54f8-ce3f-4771-8afa-f91bb10bfd43 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1308 microversion: 2.1 time: 0.564074 Oct 05 18:13:27.757498 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3078/5916] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:27 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1308 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:28.781447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-91da7227-830e-46ea-862b-d7e4d08d454e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:28.782157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-91da7227-830e-46ea-862b-d7e4d08d454e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:28.788933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91da7227-830e-46ea-862b-d7e4d08d454e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:28.789412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91da7227-830e-46ea-862b-d7e4d08d454e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:28.789823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91da7227-830e-46ea-862b-d7e4d08d454e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:28.790576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91da7227-830e-46ea-862b-d7e4d08d454e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:28.791025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91da7227-830e-46ea-862b-d7e4d08d454e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:28.791446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91da7227-830e-46ea-862b-d7e4d08d454e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:28.863646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:28.885681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=26 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:28.968608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-91da7227-830e-46ea-862b-d7e4d08d454e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:28.977106 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-91da7227-830e-46ea-862b-d7e4d08d454e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1308 microversion: 2.1 time: 0.200738 Oct 05 18:13:28.990817 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2839/5917] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:28 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:30.001582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49be2f96-f5bd-4c6a-a5ad-ed655db2b17d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:30.003982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-49be2f96-f5bd-4c6a-a5ad-ed655db2b17d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:30.007531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:30.013283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49be2f96-f5bd-4c6a-a5ad-ed655db2b17d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:30.013798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49be2f96-f5bd-4c6a-a5ad-ed655db2b17d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:30.014256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49be2f96-f5bd-4c6a-a5ad-ed655db2b17d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:30.015047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49be2f96-f5bd-4c6a-a5ad-ed655db2b17d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:30.015519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49be2f96-f5bd-4c6a-a5ad-ed655db2b17d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:30.015965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49be2f96-f5bd-4c6a-a5ad-ed655db2b17d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:30.154454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-49be2f96-f5bd-4c6a-a5ad-ed655db2b17d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:30.162932 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49be2f96-f5bd-4c6a-a5ad-ed655db2b17d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1489 microversion: 2.1 time: 0.165548 Oct 05 18:13:30.163543 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3079/5918] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:29 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1489 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:30.224837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-678806257", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "16f17efc-9d97-4067-a300-10a3914986e7"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:30.280561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] validate_networks() for [('16f17efc-9d97-4067-a300-10a3914986e7', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:13:31.052808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:13:31.053230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:13:31.053708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:13:31.054098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:13:31.054552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:13:31.063958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:31.064446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:31.064883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:31.065603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:31.066056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:31.066512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:31.083808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:13:31.089375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for user 0c698ccb66ac443582a7e610591c6da6 and project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:13:31.102098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:13:31.104470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:13:31.151899 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f8d50111-342a-4b34-92eb-9943a24105ae tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.931176 Oct 05 18:13:31.152845 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2840/5919] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:13:31.165253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7a435fdf-d0f3-4dde-86bb-f03971f8b380 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:31.166172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7a435fdf-d0f3-4dde-86bb-f03971f8b380 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:31.229370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7a435fdf-d0f3-4dde-86bb-f03971f8b380 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:31.236542 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7a435fdf-d0f3-4dde-86bb-f03971f8b380 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1208 microversion: 2.1 time: 0.076245 Oct 05 18:13:31.237125 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3080/5920] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:31 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1208 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:32.261558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-57ff64ae-079f-4089-bdb1-e70a70d1c6b3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:32.262993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-57ff64ae-079f-4089-bdb1-e70a70d1c6b3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:32.270140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57ff64ae-079f-4089-bdb1-e70a70d1c6b3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:32.270709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57ff64ae-079f-4089-bdb1-e70a70d1c6b3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:32.271153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57ff64ae-079f-4089-bdb1-e70a70d1c6b3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:32.272212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57ff64ae-079f-4089-bdb1-e70a70d1c6b3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:32.273651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57ff64ae-079f-4089-bdb1-e70a70d1c6b3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:32.274089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57ff64ae-079f-4089-bdb1-e70a70d1c6b3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:32.340357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-57ff64ae-079f-4089-bdb1-e70a70d1c6b3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:32.349628 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-57ff64ae-079f-4089-bdb1-e70a70d1c6b3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1268 microversion: 2.1 time: 0.093043 Oct 05 18:13:32.350453 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2841/5921] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:32 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1268 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:33.373390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6fd310f3-36ba-437b-b1e1-a5c504e770ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:33.374099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6fd310f3-36ba-437b-b1e1-a5c504e770ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:33.383193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6fd310f3-36ba-437b-b1e1-a5c504e770ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:33.383671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6fd310f3-36ba-437b-b1e1-a5c504e770ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:33.384124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6fd310f3-36ba-437b-b1e1-a5c504e770ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:33.384850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6fd310f3-36ba-437b-b1e1-a5c504e770ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:33.385324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6fd310f3-36ba-437b-b1e1-a5c504e770ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:33.385770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6fd310f3-36ba-437b-b1e1-a5c504e770ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:33.601705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6fd310f3-36ba-437b-b1e1-a5c504e770ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:33.610781 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6fd310f3-36ba-437b-b1e1-a5c504e770ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1308 microversion: 2.1 time: 0.241489 Oct 05 18:13:33.611388 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3081/5922] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:33 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:33.831324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-0fd27499-fd40-4fb0-9f35-417472c1529e req-77167cf0-3a28-4162-949f-6c8964f9409f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "814a5d79-472f-430a-baec-ef2eb87647db", "tag": "ed2d65db-d3e3-43d8-84f5-c11f61abc124"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:33.841211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0fd27499-fd40-4fb0-9f35-417472c1529e req-77167cf0-3a28-4162-949f-6c8964f9409f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:33.841693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0fd27499-fd40-4fb0-9f35-417472c1529e req-77167cf0-3a28-4162-949f-6c8964f9409f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:33.842116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0fd27499-fd40-4fb0-9f35-417472c1529e req-77167cf0-3a28-4162-949f-6c8964f9409f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:33.853916 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-0fd27499-fd40-4fb0-9f35-417472c1529e req-77167cf0-3a28-4162-949f-6c8964f9409f service nova] Creating event network-changed:ed2d65db-d3e3-43d8-84f5-c11f61abc124 for instance 814a5d79-472f-430a-baec-ef2eb87647db on n-h2-835595-3 Oct 05 18:13:33.859024 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-0fd27499-fd40-4fb0-9f35-417472c1529e req-77167cf0-3a28-4162-949f-6c8964f9409f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102862 Oct 05 18:13:33.859849 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2842/5923] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:34.639852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8fb2d246-fd05-43e1-8378-07432874371f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:34.640599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8fb2d246-fd05-43e1-8378-07432874371f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:34.643810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:34.650156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb2d246-fd05-43e1-8378-07432874371f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:34.650780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb2d246-fd05-43e1-8378-07432874371f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:34.651310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb2d246-fd05-43e1-8378-07432874371f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:34.652145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb2d246-fd05-43e1-8378-07432874371f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:34.652694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb2d246-fd05-43e1-8378-07432874371f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:34.653212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fb2d246-fd05-43e1-8378-07432874371f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:34.794639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8fb2d246-fd05-43e1-8378-07432874371f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:34.803009 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8fb2d246-fd05-43e1-8378-07432874371f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1308 microversion: 2.1 time: 0.169903 Oct 05 18:13:34.803592 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3082/5924] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:34 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1308 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:35.831052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58dbc2a6-3db2-4586-b3c8-458331ba6957 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:35.833952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-58dbc2a6-3db2-4586-b3c8-458331ba6957 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:35.845481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58dbc2a6-3db2-4586-b3c8-458331ba6957 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:35.845974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58dbc2a6-3db2-4586-b3c8-458331ba6957 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:35.846434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58dbc2a6-3db2-4586-b3c8-458331ba6957 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:35.847146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58dbc2a6-3db2-4586-b3c8-458331ba6957 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:35.847604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58dbc2a6-3db2-4586-b3c8-458331ba6957 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:35.848279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58dbc2a6-3db2-4586-b3c8-458331ba6957 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:35.982309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58dbc2a6-3db2-4586-b3c8-458331ba6957 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:35.990196 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-58dbc2a6-3db2-4586-b3c8-458331ba6957 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1308 microversion: 2.1 time: 0.167091 Oct 05 18:13:35.990801 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2843/5925] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:35 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:37.013391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b3a4512-f0a6-4c55-a494-b0aeb93cf4cd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:37.013957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b3a4512-f0a6-4c55-a494-b0aeb93cf4cd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:37.021381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b3a4512-f0a6-4c55-a494-b0aeb93cf4cd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:37.021886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b3a4512-f0a6-4c55-a494-b0aeb93cf4cd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:37.022361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b3a4512-f0a6-4c55-a494-b0aeb93cf4cd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:37.023074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b3a4512-f0a6-4c55-a494-b0aeb93cf4cd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:37.023541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b3a4512-f0a6-4c55-a494-b0aeb93cf4cd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:37.023981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b3a4512-f0a6-4c55-a494-b0aeb93cf4cd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:37.159878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b3a4512-f0a6-4c55-a494-b0aeb93cf4cd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:37.167760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b3a4512-f0a6-4c55-a494-b0aeb93cf4cd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1308 microversion: 2.1 time: 0.158478 Oct 05 18:13:37.168351 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3083/5926] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:37 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1308 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:38.190855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4ce0b77e-18fa-41ad-94d9-ccdc4bac630e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:38.191561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4ce0b77e-18fa-41ad-94d9-ccdc4bac630e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:38.199662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ce0b77e-18fa-41ad-94d9-ccdc4bac630e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:38.200234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ce0b77e-18fa-41ad-94d9-ccdc4bac630e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:38.200718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ce0b77e-18fa-41ad-94d9-ccdc4bac630e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:38.201470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ce0b77e-18fa-41ad-94d9-ccdc4bac630e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:38.201971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ce0b77e-18fa-41ad-94d9-ccdc4bac630e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:38.202477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ce0b77e-18fa-41ad-94d9-ccdc4bac630e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:38.224784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:38.344528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4ce0b77e-18fa-41ad-94d9-ccdc4bac630e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:38.357394 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4ce0b77e-18fa-41ad-94d9-ccdc4bac630e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1308 microversion: 2.1 time: 0.170797 Oct 05 18:13:38.358175 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2844/5927] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:38 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1308 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:39.383446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43f4baaf-4600-465c-ab94-601323a93222 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:39.384046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-43f4baaf-4600-465c-ab94-601323a93222 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:39.391306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43f4baaf-4600-465c-ab94-601323a93222 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:39.391682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b99333e8-252e-4845-831d-479c7afa4026 req-bc099e3d-d3f2-49a2-bf6e-5a8b6c50a2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814a5d79-472f-430a-baec-ef2eb87647db", "name": "network-vif-plugged", "status": "completed", "tag": "ed2d65db-d3e3-43d8-84f5-c11f61abc124"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:39.392157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43f4baaf-4600-465c-ab94-601323a93222 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:39.392267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43f4baaf-4600-465c-ab94-601323a93222 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:39.392998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43f4baaf-4600-465c-ab94-601323a93222 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:39.393473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43f4baaf-4600-465c-ab94-601323a93222 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:39.393916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43f4baaf-4600-465c-ab94-601323a93222 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:39.405278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b99333e8-252e-4845-831d-479c7afa4026 req-bc099e3d-d3f2-49a2-bf6e-5a8b6c50a2aa service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:39.406392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b99333e8-252e-4845-831d-479c7afa4026 req-bc099e3d-d3f2-49a2-bf6e-5a8b6c50a2aa service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:39.407010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b99333e8-252e-4845-831d-479c7afa4026 req-bc099e3d-d3f2-49a2-bf6e-5a8b6c50a2aa service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:39.421135 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b99333e8-252e-4845-831d-479c7afa4026 req-bc099e3d-d3f2-49a2-bf6e-5a8b6c50a2aa service nova] Creating event network-vif-plugged:ed2d65db-d3e3-43d8-84f5-c11f61abc124 for instance 814a5d79-472f-430a-baec-ef2eb87647db on n-h2-835595-3 Oct 05 18:13:39.426971 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b99333e8-252e-4845-831d-479c7afa4026 req-bc099e3d-d3f2-49a2-bf6e-5a8b6c50a2aa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039366 Oct 05 18:13:39.427648 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2845/5928] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:39.594968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-43f4baaf-4600-465c-ab94-601323a93222 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:39.603389 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-43f4baaf-4600-465c-ab94-601323a93222 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1308 microversion: 2.1 time: 0.224293 Oct 05 18:13:39.604072 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3084/5929] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:39 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1308 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:40.629001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2bb7349-aa79-4c81-89a4-2576db2d710a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:40.629817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d2bb7349-aa79-4c81-89a4-2576db2d710a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:40.637188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bb7349-aa79-4c81-89a4-2576db2d710a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:40.637692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bb7349-aa79-4c81-89a4-2576db2d710a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:40.638141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bb7349-aa79-4c81-89a4-2576db2d710a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:40.638901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bb7349-aa79-4c81-89a4-2576db2d710a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:40.639365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bb7349-aa79-4c81-89a4-2576db2d710a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:40.639791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2bb7349-aa79-4c81-89a4-2576db2d710a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:40.792204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d2bb7349-aa79-4c81-89a4-2576db2d710a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:40.800723 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d2bb7349-aa79-4c81-89a4-2576db2d710a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1308 microversion: 2.1 time: 0.177510 Oct 05 18:13:40.801314 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2846/5930] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:40 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1308 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:41.834563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d060c0d0-5549-484d-b7c5-1501e3a41286 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:41.835170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d060c0d0-5549-484d-b7c5-1501e3a41286 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:41.838739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:41.844565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d060c0d0-5549-484d-b7c5-1501e3a41286 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:41.845086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d060c0d0-5549-484d-b7c5-1501e3a41286 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:41.845542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d060c0d0-5549-484d-b7c5-1501e3a41286 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:41.846321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d060c0d0-5549-484d-b7c5-1501e3a41286 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:41.847190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d060c0d0-5549-484d-b7c5-1501e3a41286 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:41.847780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d060c0d0-5549-484d-b7c5-1501e3a41286 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:41.986186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d060c0d0-5549-484d-b7c5-1501e3a41286 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:41.994451 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d060c0d0-5549-484d-b7c5-1501e3a41286 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1488 microversion: 2.1 time: 0.164152 Oct 05 18:13:41.995008 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3085/5931] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:41 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1488 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:42.017181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3cc540d4-0d8c-4252-8ec6-41945dd9f92f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:42.017804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3cc540d4-0d8c-4252-8ec6-41945dd9f92f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:42.019915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:42.020601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:42.027927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc540d4-0d8c-4252-8ec6-41945dd9f92f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:42.028417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc540d4-0d8c-4252-8ec6-41945dd9f92f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:42.028852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc540d4-0d8c-4252-8ec6-41945dd9f92f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:42.029584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc540d4-0d8c-4252-8ec6-41945dd9f92f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:42.030045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc540d4-0d8c-4252-8ec6-41945dd9f92f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:42.030498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc540d4-0d8c-4252-8ec6-41945dd9f92f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:42.166107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3cc540d4-0d8c-4252-8ec6-41945dd9f92f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:42.174517 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3cc540d4-0d8c-4252-8ec6-41945dd9f92f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1489 microversion: 2.1 time: 0.161216 Oct 05 18:13:42.175088 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2847/5932] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:42 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1489 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:42.196713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-05fcf861-248d-40e4-8104-1bea239faa9e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:42.197372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-05fcf861-248d-40e4-8104-1bea239faa9e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:42.204048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05fcf861-248d-40e4-8104-1bea239faa9e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:42.204555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05fcf861-248d-40e4-8104-1bea239faa9e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:42.205013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05fcf861-248d-40e4-8104-1bea239faa9e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:42.205760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05fcf861-248d-40e4-8104-1bea239faa9e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:42.206235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05fcf861-248d-40e4-8104-1bea239faa9e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:42.206709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05fcf861-248d-40e4-8104-1bea239faa9e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:42.349797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-05fcf861-248d-40e4-8104-1bea239faa9e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:42.358098 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-05fcf861-248d-40e4-8104-1bea239faa9e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1488 microversion: 2.1 time: 0.165545 Oct 05 18:13:42.358717 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3086/5933] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:42 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1488 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:42.380903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7abaccfd-7553-4f03-a199-81d07ed39b8c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:42.381333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7abaccfd-7553-4f03-a199-81d07ed39b8c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:42.387800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7abaccfd-7553-4f03-a199-81d07ed39b8c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:42.388293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7abaccfd-7553-4f03-a199-81d07ed39b8c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:42.388734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7abaccfd-7553-4f03-a199-81d07ed39b8c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:42.389450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7abaccfd-7553-4f03-a199-81d07ed39b8c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:42.389883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7abaccfd-7553-4f03-a199-81d07ed39b8c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:42.390311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7abaccfd-7553-4f03-a199-81d07ed39b8c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:42.418174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7abaccfd-7553-4f03-a199-81d07ed39b8c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:13:42.501827 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7abaccfd-7553-4f03-a199-81d07ed39b8c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 204 len: 0 microversion: 2.1 time: 0.125115 Oct 05 18:13:42.502488 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2848/5934] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:13:42 2022] DELETE /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:13:42.512254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ee911d25-f557-4eb3-922c-78c062c3ca05 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:42.512967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ee911d25-f557-4eb3-922c-78c062c3ca05 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:42.519715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee911d25-f557-4eb3-922c-78c062c3ca05 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:42.520221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee911d25-f557-4eb3-922c-78c062c3ca05 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:42.520675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee911d25-f557-4eb3-922c-78c062c3ca05 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:42.521388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee911d25-f557-4eb3-922c-78c062c3ca05 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:42.521864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee911d25-f557-4eb3-922c-78c062c3ca05 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:42.522342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee911d25-f557-4eb3-922c-78c062c3ca05 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:42.657369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ee911d25-f557-4eb3-922c-78c062c3ca05 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:42.665852 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ee911d25-f557-4eb3-922c-78c062c3ca05 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1494 microversion: 2.1 time: 0.157623 Oct 05 18:13:42.666730 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3087/5935] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:42 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1494 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:43.694626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-01734f8b-e959-4e05-b0fe-b67c25060159 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:43.695803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-01734f8b-e959-4e05-b0fe-b67c25060159 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:43.707424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01734f8b-e959-4e05-b0fe-b67c25060159 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:43.708134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01734f8b-e959-4e05-b0fe-b67c25060159 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:43.708569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01734f8b-e959-4e05-b0fe-b67c25060159 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:43.709262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01734f8b-e959-4e05-b0fe-b67c25060159 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:43.709718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01734f8b-e959-4e05-b0fe-b67c25060159 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:43.710177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01734f8b-e959-4e05-b0fe-b67c25060159 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:43.856547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-01734f8b-e959-4e05-b0fe-b67c25060159 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:43.864671 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-01734f8b-e959-4e05-b0fe-b67c25060159 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1494 microversion: 2.1 time: 0.177468 Oct 05 18:13:43.865257 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2849/5936] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:43 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1494 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:44.421062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-76fa2f21-d62a-4214-9a81-7248b13884da req-cee4eaff-70ff-4739-8a43-9077f0b9bf4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "814a5d79-472f-430a-baec-ef2eb87647db", "name": "network-vif-deleted", "tag": "ed2d65db-d3e3-43d8-84f5-c11f61abc124"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:44.438623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-76fa2f21-d62a-4214-9a81-7248b13884da req-cee4eaff-70ff-4739-8a43-9077f0b9bf4a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:44.439177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-76fa2f21-d62a-4214-9a81-7248b13884da req-cee4eaff-70ff-4739-8a43-9077f0b9bf4a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:44.440065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-76fa2f21-d62a-4214-9a81-7248b13884da req-cee4eaff-70ff-4739-8a43-9077f0b9bf4a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:44.475040 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-76fa2f21-d62a-4214-9a81-7248b13884da req-cee4eaff-70ff-4739-8a43-9077f0b9bf4a service nova] Creating event network-vif-deleted:ed2d65db-d3e3-43d8-84f5-c11f61abc124 for instance 814a5d79-472f-430a-baec-ef2eb87647db on n-h2-835595-3 Oct 05 18:13:44.484562 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-76fa2f21-d62a-4214-9a81-7248b13884da req-cee4eaff-70ff-4739-8a43-9077f0b9bf4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071317 Oct 05 18:13:44.485551 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3088/5937] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:44.888905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:44.889452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:44.897053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:44.897550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:44.897988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:44.898722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:44.899182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:44.899604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:44.940797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:44.941567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:44.942012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:44.942498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lazy-loading 'fault' on Instance uuid 814a5d79-472f-430a-baec-ef2eb87647db {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:13:44.986651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:44.998391 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ef22cf7f-bf70-4167-b6aa-fd9c88a146f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 200 len: 1298 microversion: 2.1 time: 0.113491 Oct 05 18:13:44.999318 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2850/5938] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:44 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:46.035099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:46.036305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:46.052212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:46.052743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:46.053204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:46.053921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:46.054434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:46.054876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:46.069072 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db HTTP/1.1 Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '814a5d79-472f-430a-baec-ef2eb87647db'} Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:46.070700 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:46.076307 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:13:46.076307 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:13:46.076307 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:13:46.076307 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:13:46.076307 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:13:46.076307 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:46.076307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:13:46.076307 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5088b22f-b589-4cb2-a4f8-b6de1ae87ade tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 404 len: 111 microversion: 2.1 time: 0.046911 Oct 05 18:13:46.076307 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3089/5939] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:46 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:13:46.083033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dc9b1149-4477-4e26-8c8c-d8844885f984 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:46.083726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dc9b1149-4477-4e26-8c8c-d8844885f984 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:46.093282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc9b1149-4477-4e26-8c8c-d8844885f984 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:46.094079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc9b1149-4477-4e26-8c8c-d8844885f984 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:46.094910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc9b1149-4477-4e26-8c8c-d8844885f984 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:46.096010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc9b1149-4477-4e26-8c8c-d8844885f984 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:46.096761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc9b1149-4477-4e26-8c8c-d8844885f984 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:46.097409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dc9b1149-4477-4e26-8c8c-d8844885f984 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:46.129441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dc9b1149-4477-4e26-8c8c-d8844885f984 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:13:46.219103 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dc9b1149-4477-4e26-8c8c-d8844885f984 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 204 len: 0 microversion: 2.1 time: 0.140753 Oct 05 18:13:46.219938 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2851/5940] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:13:46 2022] DELETE /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:13:46.228250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ddf900ae-4009-434e-a341-384e6699d035 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:46.228885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ddf900ae-4009-434e-a341-384e6699d035 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:46.235063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf900ae-4009-434e-a341-384e6699d035 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:46.235603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf900ae-4009-434e-a341-384e6699d035 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:46.236036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf900ae-4009-434e-a341-384e6699d035 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:46.236744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf900ae-4009-434e-a341-384e6699d035 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:46.237210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf900ae-4009-434e-a341-384e6699d035 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:46.237652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf900ae-4009-434e-a341-384e6699d035 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:46.376083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ddf900ae-4009-434e-a341-384e6699d035 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:46.390258 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ddf900ae-4009-434e-a341-384e6699d035 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1495 microversion: 2.1 time: 0.165964 Oct 05 18:13:46.390877 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3090/5941] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:46 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1495 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:47.425966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d14cdc01-4439-434f-b4ef-fc2727a38ea0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:47.427215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d14cdc01-4439-434f-b4ef-fc2727a38ea0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:47.435112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d14cdc01-4439-434f-b4ef-fc2727a38ea0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:47.435597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d14cdc01-4439-434f-b4ef-fc2727a38ea0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:47.436033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d14cdc01-4439-434f-b4ef-fc2727a38ea0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:47.436725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d14cdc01-4439-434f-b4ef-fc2727a38ea0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:47.437186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d14cdc01-4439-434f-b4ef-fc2727a38ea0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:47.437611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d14cdc01-4439-434f-b4ef-fc2727a38ea0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:47.577243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d14cdc01-4439-434f-b4ef-fc2727a38ea0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:47.588947 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d14cdc01-4439-434f-b4ef-fc2727a38ea0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1495 microversion: 2.1 time: 0.170002 Oct 05 18:13:47.589751 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2852/5942] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:47 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1495 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:48.106614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-150cd6ce-12dc-4f1c-9fcf-e94acae13e11 req-3999e2de-f10b-4262-92fd-f3cdf87ab224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e15b02-96f0-4c39-8e38-e7163ba0f80a", "name": "network-vif-deleted", "tag": "97123d96-fc64-433b-80cd-22965353c8e6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:48.118590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-150cd6ce-12dc-4f1c-9fcf-e94acae13e11 req-3999e2de-f10b-4262-92fd-f3cdf87ab224 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:48.119207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-150cd6ce-12dc-4f1c-9fcf-e94acae13e11 req-3999e2de-f10b-4262-92fd-f3cdf87ab224 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:48.119929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-150cd6ce-12dc-4f1c-9fcf-e94acae13e11 req-3999e2de-f10b-4262-92fd-f3cdf87ab224 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:48.134819 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-150cd6ce-12dc-4f1c-9fcf-e94acae13e11 req-3999e2de-f10b-4262-92fd-f3cdf87ab224 service nova] Creating event network-vif-deleted:97123d96-fc64-433b-80cd-22965353c8e6 for instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a on n-h2-835595-3 Oct 05 18:13:48.142556 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-150cd6ce-12dc-4f1c-9fcf-e94acae13e11 req-3999e2de-f10b-4262-92fd-f3cdf87ab224 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041308 Oct 05 18:13:48.143483 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3091/5943] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:48.616751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:48.617363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:48.621317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:48.625237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:48.626007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:48.626474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:48.627196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:48.627636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:48.628662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:48.663725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:48.664266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:48.664701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:48.665144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lazy-loading 'fault' on Instance uuid c7e15b02-96f0-4c39-8e38-e7163ba0f80a {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:13:48.707462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:48.715475 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4cc4e24c-5d99-41ba-87d7-cf414db12398 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 200 len: 1298 microversion: 2.1 time: 0.102980 Oct 05 18:13:48.716065 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2853/5944] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:48 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:49.740234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:49.741115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:49.748458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:49.748990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:49.749444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:49.750156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:49.750657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:49.751094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:49.765246 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a HTTP/1.1 Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'c7e15b02-96f0-4c39-8e38-e7163ba0f80a'} Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:49.766978 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:49.771840 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:13:49.771840 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:13:49.771840 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:13:49.771840 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:13:49.771840 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:13:49.771840 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:49.771840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:13:49.771840 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8c1f9682-67a6-4995-b908-18b38110235e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 404 len: 111 microversion: 2.1 time: 0.032584 Oct 05 18:13:49.771840 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3092/5945] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:49 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:13:49.824837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-8833534", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "16f17efc-9d97-4067-a300-10a3914986e7"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:49.882728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] validate_networks() for [('16f17efc-9d97-4067-a300-10a3914986e7', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:13:50.559190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:13:50.559623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:13:50.560104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:13:50.560514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:13:50.560926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:13:50.570752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:50.571370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:50.571820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:50.572584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:50.573045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:50.573475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:50.591242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:13:50.596691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for user 0c698ccb66ac443582a7e610591c6da6 and project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:13:50.610133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:13:50.612671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:13:50.661002 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a3db87d-720e-425c-907f-caf35d724cc9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.840268 Oct 05 18:13:50.661669 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2854/5946] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:13:50.674980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23987fc8-b184-46d6-acc0-0dac443ae53b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:50.675909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-23987fc8-b184-46d6-acc0-0dac443ae53b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:50.686591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d814e506-6ec4-4654-bc5e-d280fe246026 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:50.687093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d814e506-6ec4-4654-bc5e-d280fe246026 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:50.708823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d814e506-6ec4-4654-bc5e-d280fe246026 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:50.709517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d814e506-6ec4-4654-bc5e-d280fe246026 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:50.710320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d814e506-6ec4-4654-bc5e-d280fe246026 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:50.711226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d814e506-6ec4-4654-bc5e-d280fe246026 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:50.712493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d814e506-6ec4-4654-bc5e-d280fe246026 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:50.713078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d814e506-6ec4-4654-bc5e-d280fe246026 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:50.740779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d814e506-6ec4-4654-bc5e-d280fe246026 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:13:50.752270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23987fc8-b184-46d6-acc0-0dac443ae53b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:50.761870 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-23987fc8-b184-46d6-acc0-0dac443ae53b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1206 microversion: 2.1 time: 0.091739 Oct 05 18:13:50.762752 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3093/5947] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:50 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1206 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:13:50.840171 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d814e506-6ec4-4654-bc5e-d280fe246026 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "DELETE /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 204 len: 0 microversion: 2.1 time: 0.160789 Oct 05 18:13:50.840964 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2855/5948] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:13:50 2022] DELETE /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:13:50.849776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3de0b733-8d78-4046-a2d4-f6c69ee64a0c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:50.850543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3de0b733-8d78-4046-a2d4-f6c69ee64a0c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:50.862736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de0b733-8d78-4046-a2d4-f6c69ee64a0c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:50.863238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de0b733-8d78-4046-a2d4-f6c69ee64a0c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:50.863680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de0b733-8d78-4046-a2d4-f6c69ee64a0c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:50.864486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de0b733-8d78-4046-a2d4-f6c69ee64a0c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:50.864950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de0b733-8d78-4046-a2d4-f6c69ee64a0c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:50.865409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3de0b733-8d78-4046-a2d4-f6c69ee64a0c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:51.014234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3de0b733-8d78-4046-a2d4-f6c69ee64a0c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:51.022966 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3de0b733-8d78-4046-a2d4-f6c69ee64a0c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1551 microversion: 2.1 time: 0.177547 Oct 05 18:13:51.023553 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3094/5949] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:50 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1551 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:13:51.786159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa43f5fe-767e-42e9-abac-930a9937d4d9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:51.787036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa43f5fe-767e-42e9-abac-930a9937d4d9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:51.794539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa43f5fe-767e-42e9-abac-930a9937d4d9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:51.795036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa43f5fe-767e-42e9-abac-930a9937d4d9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:51.795457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa43f5fe-767e-42e9-abac-930a9937d4d9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:51.796353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa43f5fe-767e-42e9-abac-930a9937d4d9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:51.796981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa43f5fe-767e-42e9-abac-930a9937d4d9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:51.797424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa43f5fe-767e-42e9-abac-930a9937d4d9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:51.898591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa43f5fe-767e-42e9-abac-930a9937d4d9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:51.915321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:51.919064 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa43f5fe-767e-42e9-abac-930a9937d4d9 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1276 microversion: 2.1 time: 0.136910 Oct 05 18:13:51.920486 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2856/5950] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:51 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:52.046830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f4e5e951-f59a-4b7b-b2a7-82e2633bcf6b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:52.047400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f4e5e951-f59a-4b7b-b2a7-82e2633bcf6b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:52.055632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4e5e951-f59a-4b7b-b2a7-82e2633bcf6b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:52.056142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4e5e951-f59a-4b7b-b2a7-82e2633bcf6b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:52.056597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4e5e951-f59a-4b7b-b2a7-82e2633bcf6b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:52.057318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4e5e951-f59a-4b7b-b2a7-82e2633bcf6b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:52.057796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4e5e951-f59a-4b7b-b2a7-82e2633bcf6b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:52.058242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4e5e951-f59a-4b7b-b2a7-82e2633bcf6b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:52.295579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f4e5e951-f59a-4b7b-b2a7-82e2633bcf6b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:52.304249 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f4e5e951-f59a-4b7b-b2a7-82e2633bcf6b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1551 microversion: 2.1 time: 0.261420 Oct 05 18:13:52.318535 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3095/5951] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:52 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1551 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:13:52.944978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d3633f4-836a-4aa1-8e22-093ea86a3267 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:52.945588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0d3633f4-836a-4aa1-8e22-093ea86a3267 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:52.951620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d3633f4-836a-4aa1-8e22-093ea86a3267 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:52.952163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d3633f4-836a-4aa1-8e22-093ea86a3267 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:52.952635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d3633f4-836a-4aa1-8e22-093ea86a3267 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:52.953271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d3633f4-836a-4aa1-8e22-093ea86a3267 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:52.953620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d3633f4-836a-4aa1-8e22-093ea86a3267 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:52.954034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d3633f4-836a-4aa1-8e22-093ea86a3267 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:53.035984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f9601523-075b-4cf6-aef9-4b7c4670ba98 req-c2c11612-4ea5-4389-a115-64c7c77a60fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90da7228-8190-4bfa-b6f6-9edbce634c12", "name": "network-vif-deleted", "tag": "219470e0-0df0-461a-a453-5e76e44e9518"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:53.053805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f9601523-075b-4cf6-aef9-4b7c4670ba98 req-c2c11612-4ea5-4389-a115-64c7c77a60fe service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:53.055031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f9601523-075b-4cf6-aef9-4b7c4670ba98 req-c2c11612-4ea5-4389-a115-64c7c77a60fe service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:53.055681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f9601523-075b-4cf6-aef9-4b7c4670ba98 req-c2c11612-4ea5-4389-a115-64c7c77a60fe service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:53.072006 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f9601523-075b-4cf6-aef9-4b7c4670ba98 req-c2c11612-4ea5-4389-a115-64c7c77a60fe service nova] Creating event network-vif-deleted:219470e0-0df0-461a-a453-5e76e44e9518 for instance 90da7228-8190-4bfa-b6f6-9edbce634c12 on n-h1-835595-3 Oct 05 18:13:53.077952 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f9601523-075b-4cf6-aef9-4b7c4670ba98 req-c2c11612-4ea5-4389-a115-64c7c77a60fe service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045600 Oct 05 18:13:53.084387 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3096/5952] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:53.105075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d3633f4-836a-4aa1-8e22-093ea86a3267 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:53.116729 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0d3633f4-836a-4aa1-8e22-093ea86a3267 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1306 microversion: 2.1 time: 0.177160 Oct 05 18:13:53.117505 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2857/5953] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:52 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1306 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:53.330053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:53.331133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:53.338254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:53.338792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:53.339451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:53.340215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:53.340689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:53.341302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:53.375586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:53.376818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:53.377330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:53.377813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lazy-loading 'fault' on Instance uuid 90da7228-8190-4bfa-b6f6-9edbce634c12 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:13:53.733052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:53.741727 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-234e0934-9436-4a2a-81bf-d53bba27165b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 200 len: 1338 microversion: 2.1 time: 0.416202 Oct 05 18:13:53.742348 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3097/5954] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:53 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 1338 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:54.140646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-79187faa-b87e-4662-a9c2-9cd443b3eab7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:54.141212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-79187faa-b87e-4662-a9c2-9cd443b3eab7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:54.148361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79187faa-b87e-4662-a9c2-9cd443b3eab7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:54.148848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79187faa-b87e-4662-a9c2-9cd443b3eab7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:54.150057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79187faa-b87e-4662-a9c2-9cd443b3eab7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:54.151010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79187faa-b87e-4662-a9c2-9cd443b3eab7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:54.151529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79187faa-b87e-4662-a9c2-9cd443b3eab7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:54.151894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-79187faa-b87e-4662-a9c2-9cd443b3eab7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:54.284218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-79187faa-b87e-4662-a9c2-9cd443b3eab7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:54.292312 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-79187faa-b87e-4662-a9c2-9cd443b3eab7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1306 microversion: 2.1 time: 0.155732 Oct 05 18:13:54.292880 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2858/5955] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:54 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1306 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:54.770189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:54.771509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 90da7228-8190-4bfa-b6f6-9edbce634c12] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:54.779994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:54.780501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:54.780975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:54.781692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:54.782180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:54.782631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:54.796632 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] HTTP exception thrown: Instance 90da7228-8190-4bfa-b6f6-9edbce634c12 could not be found. Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Request method failure captured: Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 HTTP/1.1 Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcj3lFaYm5WIRCkZZtTHwbtQ0ArQkLsF_zecEwMITdyIFY7RC2qTcP07Yx462zwUlojRTAvE_dzpr0g446mTlvwMmSKi6rwvFZ7f2Q9ZJoZSaaOXCMQWkLiFc_3UOE7asja2mTrexlcd9KChhrp-YGxle6aOoKzZBa8vtZeWRuUQ3JY Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 2fe00cc2c3494b749a02868d27f89977 Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestNetworkBasicOps-189615680 Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2fe00cc2c3494b749a02868d27f89977"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2fe00cc2c3494b749a02868d27f89977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2fe00cc2c3494b749a02868d27f89977", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2fe00cc2c3494b749a02868d27f89977"}]}] Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestNetworkBasicOps-189615680 Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 2fe00cc2c3494b749a02868d27f89977 Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestNetworkBasicOps-189615680 Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestNetworkBasicOps-189615680-project Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 18188fb109574bf38443d2848a77bf69 Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestNetworkBasicOps-189615680-project Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 90da7228-8190-4bfa-b6f6-9edbce634c12 could not be found. Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '90da7228-8190-4bfa-b6f6-9edbce634c12'} Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90da7228-8190-4bfa-b6f6-9edbce634c12 could not be found. Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90da7228-8190-4bfa-b6f6-9edbce634c12 could not be found. Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:13:54.798318 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:54.803202 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:13:54.803202 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:13:54.803202 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:13:54.803202 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:13:54.803202 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:13:54.803202 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90da7228-8190-4bfa-b6f6-9edbce634c12 could not be found. Oct 05 18:13:54.803202 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:13:54.803202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Returning 404 to user: Instance 90da7228-8190-4bfa-b6f6-9edbce634c12 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:13:54.803202 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-82e95a47-ca04-421e-8b6b-03eb7db03958 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12" status: 404 len: 111 microversion: 2.1 time: 0.036451 Oct 05 18:13:54.803202 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3098/5956] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:54 2022] GET /compute/v2.1/servers/90da7228-8190-4bfa-b6f6-9edbce634c12 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:13:54.975518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72c922c5-db82-4068-98c7-52e6395abf26 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '.version_select at 0x7f7779554700>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:54.997723 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-72c922c5-db82-4068-98c7-52e6395abf26 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1143129745" status: 202 len: 0 microversion: 2.1 time: 0.026261 Oct 05 18:13:54.998653 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2859/5957] 10.222.0.70 () {58 vars in 1257 bytes} [Wed Oct 5 18:13:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1143129745 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:13:55.133564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-627ffb18-01b5-4839-afda-5a2346a17293 req-8c76afc9-8d1d-4d11-a1f2-b8ef33b2f1ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20dd6bae-b54a-4b2a-ad75-6b2ce70ed109", "tag": "072c414d-4b28-472a-a4d3-d6c311bfef4d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:55.143401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-627ffb18-01b5-4839-afda-5a2346a17293 req-8c76afc9-8d1d-4d11-a1f2-b8ef33b2f1ff service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:55.144039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-627ffb18-01b5-4839-afda-5a2346a17293 req-8c76afc9-8d1d-4d11-a1f2-b8ef33b2f1ff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:55.144532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-627ffb18-01b5-4839-afda-5a2346a17293 req-8c76afc9-8d1d-4d11-a1f2-b8ef33b2f1ff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:55.156470 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-627ffb18-01b5-4839-afda-5a2346a17293 req-8c76afc9-8d1d-4d11-a1f2-b8ef33b2f1ff service nova] Creating event network-changed:072c414d-4b28-472a-a4d3-d6c311bfef4d for instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 on n-h2-835595-3 Oct 05 18:13:55.161537 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-627ffb18-01b5-4839-afda-5a2346a17293 req-8c76afc9-8d1d-4d11-a1f2-b8ef33b2f1ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031858 Oct 05 18:13:55.162318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3099/5958] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:55.316555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-42acc91c-4ad1-458a-b727-b77a72dff106 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:55.317084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-42acc91c-4ad1-458a-b727-b77a72dff106 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:55.324551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42acc91c-4ad1-458a-b727-b77a72dff106 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:55.325050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42acc91c-4ad1-458a-b727-b77a72dff106 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:55.325472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42acc91c-4ad1-458a-b727-b77a72dff106 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:55.326175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42acc91c-4ad1-458a-b727-b77a72dff106 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:55.326847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42acc91c-4ad1-458a-b727-b77a72dff106 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:55.327274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42acc91c-4ad1-458a-b727-b77a72dff106 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:55.496463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-42acc91c-4ad1-458a-b727-b77a72dff106 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:55.507784 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-42acc91c-4ad1-458a-b727-b77a72dff106 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1306 microversion: 2.1 time: 0.196222 Oct 05 18:13:55.508926 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2860/5959] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:55 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1306 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:13:56.534207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02cac5b8-1868-47b1-88c7-9d2beecd2a81 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:56.534951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02cac5b8-1868-47b1-88c7-9d2beecd2a81 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:56.543043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cac5b8-1868-47b1-88c7-9d2beecd2a81 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:56.543564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cac5b8-1868-47b1-88c7-9d2beecd2a81 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:56.544485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cac5b8-1868-47b1-88c7-9d2beecd2a81 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:56.545451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cac5b8-1868-47b1-88c7-9d2beecd2a81 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:56.546097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cac5b8-1868-47b1-88c7-9d2beecd2a81 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:56.546579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cac5b8-1868-47b1-88c7-9d2beecd2a81 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:56.681935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-02cac5b8-1868-47b1-88c7-9d2beecd2a81 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:56.690170 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02cac5b8-1868-47b1-88c7-9d2beecd2a81 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1306 microversion: 2.1 time: 0.161496 Oct 05 18:13:56.690984 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3100/5960] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:56 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1306 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:57.116529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2fc22312-b3cc-4fb5-aafd-9aa14fee3f2c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:57.117069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2fc22312-b3cc-4fb5-aafd-9aa14fee3f2c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:57.119208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ab055cb4-e4c1-483f-9e0d-ee7056d15185 req-ebd653fa-13ca-4708-8af6-3612489083de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8589be-25a4-4b08-be3f-4516460e4b6c", "tag": "5091b59c-29c6-4145-a3a3-9ee575ede053"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:57.128007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc22312-b3cc-4fb5-aafd-9aa14fee3f2c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:57.129561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ab055cb4-e4c1-483f-9e0d-ee7056d15185 req-ebd653fa-13ca-4708-8af6-3612489083de service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:57.130051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ab055cb4-e4c1-483f-9e0d-ee7056d15185 req-ebd653fa-13ca-4708-8af6-3612489083de service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:57.130467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc22312-b3cc-4fb5-aafd-9aa14fee3f2c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:57.130707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ab055cb4-e4c1-483f-9e0d-ee7056d15185 req-ebd653fa-13ca-4708-8af6-3612489083de service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:57.130939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc22312-b3cc-4fb5-aafd-9aa14fee3f2c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:57.131868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc22312-b3cc-4fb5-aafd-9aa14fee3f2c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:57.132329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc22312-b3cc-4fb5-aafd-9aa14fee3f2c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:57.137144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fc22312-b3cc-4fb5-aafd-9aa14fee3f2c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:57.143078 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ab055cb4-e4c1-483f-9e0d-ee7056d15185 req-ebd653fa-13ca-4708-8af6-3612489083de service nova] Creating event network-changed:5091b59c-29c6-4145-a3a3-9ee575ede053 for instance df8589be-25a4-4b08-be3f-4516460e4b6c on n-h1-835595-3 Oct 05 18:13:57.148885 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ab055cb4-e4c1-483f-9e0d-ee7056d15185 req-ebd653fa-13ca-4708-8af6-3612489083de service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033513 Oct 05 18:13:57.149809 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3101/5961] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:57.172232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2fc22312-b3cc-4fb5-aafd-9aa14fee3f2c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:13:57.294178 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2fc22312-b3cc-4fb5-aafd-9aa14fee3f2c tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "DELETE /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 204 len: 0 microversion: 2.1 time: 0.181463 Oct 05 18:13:57.295425 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2861/5962] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:13:57 2022] DELETE /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:13:57.308414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d3d76d49-9415-4f8d-bd9d-70bf1f00af0b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:57.309877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d3d76d49-9415-4f8d-bd9d-70bf1f00af0b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:57.318331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3d76d49-9415-4f8d-bd9d-70bf1f00af0b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:57.318943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3d76d49-9415-4f8d-bd9d-70bf1f00af0b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:57.320164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3d76d49-9415-4f8d-bd9d-70bf1f00af0b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:57.321114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3d76d49-9415-4f8d-bd9d-70bf1f00af0b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:57.321674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3d76d49-9415-4f8d-bd9d-70bf1f00af0b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:57.322702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3d76d49-9415-4f8d-bd9d-70bf1f00af0b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:57.350480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:13:57.479073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d3d76d49-9415-4f8d-bd9d-70bf1f00af0b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:57.488078 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d3d76d49-9415-4f8d-bd9d-70bf1f00af0b tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1667 microversion: 2.1 time: 0.188019 Oct 05 18:13:57.488604 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3102/5963] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:57 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1667 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:13:57.714304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-33d04aa5-0731-41bf-99ea-95edcb36e863 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:57.715363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-33d04aa5-0731-41bf-99ea-95edcb36e863 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:57.721261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33d04aa5-0731-41bf-99ea-95edcb36e863 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:57.721751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33d04aa5-0731-41bf-99ea-95edcb36e863 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:57.722189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33d04aa5-0731-41bf-99ea-95edcb36e863 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:57.722910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33d04aa5-0731-41bf-99ea-95edcb36e863 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:57.723369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33d04aa5-0731-41bf-99ea-95edcb36e863 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:57.723848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-33d04aa5-0731-41bf-99ea-95edcb36e863 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:57.859023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-33d04aa5-0731-41bf-99ea-95edcb36e863 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:57.867185 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-33d04aa5-0731-41bf-99ea-95edcb36e863 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1306 microversion: 2.1 time: 0.157468 Oct 05 18:13:57.869623 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2862/5964] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:57 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1306 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:58.513709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8258e11d-126a-4f40-ab2d-9295aed7a0e2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:58.514374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8258e11d-126a-4f40-ab2d-9295aed7a0e2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:58.521816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8258e11d-126a-4f40-ab2d-9295aed7a0e2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:58.522336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8258e11d-126a-4f40-ab2d-9295aed7a0e2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:58.522853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8258e11d-126a-4f40-ab2d-9295aed7a0e2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:58.523562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8258e11d-126a-4f40-ab2d-9295aed7a0e2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:58.524087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8258e11d-126a-4f40-ab2d-9295aed7a0e2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:58.524536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8258e11d-126a-4f40-ab2d-9295aed7a0e2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:58.754619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8258e11d-126a-4f40-ab2d-9295aed7a0e2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:58.763504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8258e11d-126a-4f40-ab2d-9295aed7a0e2 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1667 microversion: 2.1 time: 0.253802 Oct 05 18:13:58.764839 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3103/5965] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:58 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1667 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:58.896114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a89bea2-565a-4da4-b928-1bf8b65046ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:58.896682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0a89bea2-565a-4da4-b928-1bf8b65046ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:58.904786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a89bea2-565a-4da4-b928-1bf8b65046ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:58.905379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a89bea2-565a-4da4-b928-1bf8b65046ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:58.905815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a89bea2-565a-4da4-b928-1bf8b65046ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:58.906566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a89bea2-565a-4da4-b928-1bf8b65046ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:58.907026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a89bea2-565a-4da4-b928-1bf8b65046ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:58.907448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a89bea2-565a-4da4-b928-1bf8b65046ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:59.204630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0a89bea2-565a-4da4-b928-1bf8b65046ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:59.217180 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0a89bea2-565a-4da4-b928-1bf8b65046ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1306 microversion: 2.1 time: 0.325391 Oct 05 18:13:59.230467 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2863/5966] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:58 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1306 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:13:59.347878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e26695f0-23db-4b45-8b5b-d079bcfb5288 req-aeb8f5df-7f28-4923-ae3e-020d8e738f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20dd6bae-b54a-4b2a-ad75-6b2ce70ed109", "name": "network-vif-plugged", "status": "completed", "tag": "072c414d-4b28-472a-a4d3-d6c311bfef4d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:59.357960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e26695f0-23db-4b45-8b5b-d079bcfb5288 req-aeb8f5df-7f28-4923-ae3e-020d8e738f0f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:59.358495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e26695f0-23db-4b45-8b5b-d079bcfb5288 req-aeb8f5df-7f28-4923-ae3e-020d8e738f0f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:59.358941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e26695f0-23db-4b45-8b5b-d079bcfb5288 req-aeb8f5df-7f28-4923-ae3e-020d8e738f0f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:59.369968 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e26695f0-23db-4b45-8b5b-d079bcfb5288 req-aeb8f5df-7f28-4923-ae3e-020d8e738f0f service nova] Creating event network-vif-plugged:072c414d-4b28-472a-a4d3-d6c311bfef4d for instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 on n-h2-835595-3 Oct 05 18:13:59.374981 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e26695f0-23db-4b45-8b5b-d079bcfb5288 req-aeb8f5df-7f28-4923-ae3e-020d8e738f0f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102982 Oct 05 18:13:59.375825 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3104/5967] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:59.494374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-521747e4-43e4-4c63-ba4b-162ce3cafaca req-0a2acebe-4810-4157-81e5-ba9cf3417a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8589be-25a4-4b08-be3f-4516460e4b6c", "name": "network-vif-deleted", "tag": "5091b59c-29c6-4145-a3a3-9ee575ede053"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:13:59.505453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-521747e4-43e4-4c63-ba4b-162ce3cafaca req-0a2acebe-4810-4157-81e5-ba9cf3417a47 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:59.506098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-521747e4-43e4-4c63-ba4b-162ce3cafaca req-0a2acebe-4810-4157-81e5-ba9cf3417a47 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:59.506634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-521747e4-43e4-4c63-ba4b-162ce3cafaca req-0a2acebe-4810-4157-81e5-ba9cf3417a47 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:59.518548 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-521747e4-43e4-4c63-ba4b-162ce3cafaca req-0a2acebe-4810-4157-81e5-ba9cf3417a47 service nova] Creating event network-vif-deleted:5091b59c-29c6-4145-a3a3-9ee575ede053 for instance df8589be-25a4-4b08-be3f-4516460e4b6c on n-h1-835595-3 Oct 05 18:13:59.523624 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-521747e4-43e4-4c63-ba4b-162ce3cafaca req-0a2acebe-4810-4157-81e5-ba9cf3417a47 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033328 Oct 05 18:13:59.524660 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2864/5968] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:13:59.789970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:13:59.790775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:13:59.797606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:59.798107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:59.798595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:59.799319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:59.799784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:59.800405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:59.836881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:13:59.837383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:13:59.837817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:13:59.838306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lazy-loading 'fault' on Instance uuid df8589be-25a4-4b08-be3f-4516460e4b6c {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:13:59.883593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:13:59.893887 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-65bbe653-673c-4d56-b38b-3ae0d76afc38 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 200 len: 1337 microversion: 2.1 time: 0.109195 Oct 05 18:13:59.906314 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3105/5969] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:13:59 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 1337 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:00.243930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b7e44033-80e4-4dfc-8626-d7f6e62e19c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:00.244521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b7e44033-80e4-4dfc-8626-d7f6e62e19c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:00.252930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e44033-80e4-4dfc-8626-d7f6e62e19c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:00.253755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e44033-80e4-4dfc-8626-d7f6e62e19c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:00.254194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e44033-80e4-4dfc-8626-d7f6e62e19c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:00.255161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e44033-80e4-4dfc-8626-d7f6e62e19c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:00.255820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e44033-80e4-4dfc-8626-d7f6e62e19c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:00.256430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7e44033-80e4-4dfc-8626-d7f6e62e19c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:00.398209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7e44033-80e4-4dfc-8626-d7f6e62e19c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:00.407737 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b7e44033-80e4-4dfc-8626-d7f6e62e19c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1306 microversion: 2.1 time: 0.169843 Oct 05 18:14:00.408393 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2865/5970] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:00 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1306 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:00.923056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:00.924915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: df8589be-25a4-4b08-be3f-4516460e4b6c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:00.928158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:00.936050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:00.936551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:00.936997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:00.937728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:00.938191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:00.938669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:00.952842 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] HTTP exception thrown: Instance df8589be-25a4-4b08-be3f-4516460e4b6c could not be found. Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Request method failure captured: Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c HTTP/1.1 Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcj3lFaYm5WIRCkZZtTHwbtQ0ArQkLsF_zecEwMITdyIFY7RC2qTcP07Yx462zwUlojRTAvE_dzpr0g446mTlvwMmSKi6rwvFZ7f2Q9ZJoZSaaOXCMQWkLiFc_3UOE7asja2mTrexlcd9KChhrp-YGxle6aOoKzZBa8vtZeWRuUQ3JY Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 2fe00cc2c3494b749a02868d27f89977 Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestNetworkBasicOps-189615680 Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2fe00cc2c3494b749a02868d27f89977"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2fe00cc2c3494b749a02868d27f89977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2fe00cc2c3494b749a02868d27f89977", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2fe00cc2c3494b749a02868d27f89977"}]}] Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestNetworkBasicOps-189615680 Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 2fe00cc2c3494b749a02868d27f89977 Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestNetworkBasicOps-189615680 Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestNetworkBasicOps-189615680-project Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 18188fb109574bf38443d2848a77bf69 Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestNetworkBasicOps-189615680-project Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance df8589be-25a4-4b08-be3f-4516460e4b6c could not be found. Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'df8589be-25a4-4b08-be3f-4516460e4b6c'} Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8589be-25a4-4b08-be3f-4516460e4b6c could not be found. Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8589be-25a4-4b08-be3f-4516460e4b6c could not be found. Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:00.954624 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:00.959303 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:00.959303 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:00.959303 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:00.959303 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:00.959303 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:00.959303 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8589be-25a4-4b08-be3f-4516460e4b6c could not be found. Oct 05 18:14:00.959303 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:00.959303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Returning 404 to user: Instance df8589be-25a4-4b08-be3f-4516460e4b6c could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:00.959303 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c11adea1-7816-439f-b725-5f4445361332 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c" status: 404 len: 111 microversion: 2.1 time: 0.039725 Oct 05 18:14:00.959303 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3106/5971] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:00 2022] GET /compute/v2.1/servers/df8589be-25a4-4b08-be3f-4516460e4b6c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:01.122511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3cf753f6-c271-4a6e-a755-09eaba120da1 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '.version_select at 0x7f777458e940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:01.127779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:01.128945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:01.147042 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3cf753f6-c271-4a6e-a755-09eaba120da1 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-140577709" status: 202 len: 0 microversion: 2.1 time: 0.028972 Oct 05 18:14:01.147645 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2866/5972] 10.222.0.70 () {58 vars in 1254 bytes} [Wed Oct 5 18:14:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-140577709 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:14:01.433530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a502597-8654-4d31-a72c-76f9007a160c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:01.434271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3a502597-8654-4d31-a72c-76f9007a160c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:01.440621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a502597-8654-4d31-a72c-76f9007a160c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:01.441134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a502597-8654-4d31-a72c-76f9007a160c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:01.441596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a502597-8654-4d31-a72c-76f9007a160c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:01.442335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a502597-8654-4d31-a72c-76f9007a160c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:01.442820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a502597-8654-4d31-a72c-76f9007a160c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:01.443287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a502597-8654-4d31-a72c-76f9007a160c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:01.574629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3a502597-8654-4d31-a72c-76f9007a160c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:01.583386 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a502597-8654-4d31-a72c-76f9007a160c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1487 microversion: 2.1 time: 0.153955 Oct 05 18:14:01.588954 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3107/5973] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:01 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1487 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:01.609676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d2635a75-be96-4a81-b709-f58435a061bb tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:01.612437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d2635a75-be96-4a81-b709-f58435a061bb tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:01.619718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2635a75-be96-4a81-b709-f58435a061bb tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:01.620212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2635a75-be96-4a81-b709-f58435a061bb tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:01.620648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2635a75-be96-4a81-b709-f58435a061bb tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:01.621359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2635a75-be96-4a81-b709-f58435a061bb tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:01.621819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2635a75-be96-4a81-b709-f58435a061bb tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:01.622244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d2635a75-be96-4a81-b709-f58435a061bb tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:01.689433 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d2635a75-be96-4a81-b709-f58435a061bb tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "PUT /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1082 microversion: 2.1 time: 0.086036 Oct 05 18:14:01.690031 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2867/5974] 10.222.0.70 () {60 vars in 1256 bytes} [Wed Oct 5 18:14:01 2022] PUT /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1082 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:01.708631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-acaefa19-f2e6-46de-a573-cf91d389b37d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:01.709268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-acaefa19-f2e6-46de-a573-cf91d389b37d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:01.715664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaefa19-f2e6-46de-a573-cf91d389b37d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:01.716288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaefa19-f2e6-46de-a573-cf91d389b37d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:01.716806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaefa19-f2e6-46de-a573-cf91d389b37d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:01.717674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaefa19-f2e6-46de-a573-cf91d389b37d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:01.718148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaefa19-f2e6-46de-a573-cf91d389b37d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:01.718618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-acaefa19-f2e6-46de-a573-cf91d389b37d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:01.855606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-acaefa19-f2e6-46de-a573-cf91d389b37d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:01.864187 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-acaefa19-f2e6-46de-a573-cf91d389b37d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1508 microversion: 2.1 time: 0.159440 Oct 05 18:14:01.864699 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3108/5975] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:01 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:01.886965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b754a5cd-d282-4fc2-bbe8-fbcaa8fb189d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:01.887585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b754a5cd-d282-4fc2-bbe8-fbcaa8fb189d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:01.894412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b754a5cd-d282-4fc2-bbe8-fbcaa8fb189d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:01.894896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b754a5cd-d282-4fc2-bbe8-fbcaa8fb189d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:01.895331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b754a5cd-d282-4fc2-bbe8-fbcaa8fb189d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:01.896034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b754a5cd-d282-4fc2-bbe8-fbcaa8fb189d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:01.896494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b754a5cd-d282-4fc2-bbe8-fbcaa8fb189d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:01.896913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b754a5cd-d282-4fc2-bbe8-fbcaa8fb189d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:02.100826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b754a5cd-d282-4fc2-bbe8-fbcaa8fb189d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:02.108734 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b754a5cd-d282-4fc2-bbe8-fbcaa8fb189d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1508 microversion: 2.1 time: 0.226069 Oct 05 18:14:02.109277 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2868/5976] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:01 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1508 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:02.131555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-391f459c-8a84-40d1-97a0-30547d7ec20a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:02.132115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-391f459c-8a84-40d1-97a0-30547d7ec20a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:02.139662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-391f459c-8a84-40d1-97a0-30547d7ec20a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:02.140148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-391f459c-8a84-40d1-97a0-30547d7ec20a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:02.140728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-391f459c-8a84-40d1-97a0-30547d7ec20a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:02.141833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-391f459c-8a84-40d1-97a0-30547d7ec20a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:02.142399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-391f459c-8a84-40d1-97a0-30547d7ec20a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:02.142964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-391f459c-8a84-40d1-97a0-30547d7ec20a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:02.172339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-391f459c-8a84-40d1-97a0-30547d7ec20a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:14:02.284859 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-391f459c-8a84-40d1-97a0-30547d7ec20a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 204 len: 0 microversion: 2.1 time: 0.157393 Oct 05 18:14:02.285511 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3109/5977] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:14:02 2022] DELETE /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:14:02.294454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-434fea08-9f71-4588-b64a-32e53dd168dd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:02.295671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-434fea08-9f71-4588-b64a-32e53dd168dd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:02.302335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434fea08-9f71-4588-b64a-32e53dd168dd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:02.303067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434fea08-9f71-4588-b64a-32e53dd168dd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:02.303675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434fea08-9f71-4588-b64a-32e53dd168dd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:02.304621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434fea08-9f71-4588-b64a-32e53dd168dd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:02.305150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434fea08-9f71-4588-b64a-32e53dd168dd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:02.305545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434fea08-9f71-4588-b64a-32e53dd168dd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:02.529206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-434fea08-9f71-4588-b64a-32e53dd168dd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:02.537174 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-434fea08-9f71-4588-b64a-32e53dd168dd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1514 microversion: 2.1 time: 0.247123 Oct 05 18:14:02.537782 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2869/5978] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:02 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:14:03.560387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d839706d-13aa-4a26-8b56-2d17d6b77ef6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:03.561206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d839706d-13aa-4a26-8b56-2d17d6b77ef6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:03.568548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d839706d-13aa-4a26-8b56-2d17d6b77ef6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:03.569060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d839706d-13aa-4a26-8b56-2d17d6b77ef6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:03.569563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d839706d-13aa-4a26-8b56-2d17d6b77ef6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:03.570235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d839706d-13aa-4a26-8b56-2d17d6b77ef6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:03.571041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d839706d-13aa-4a26-8b56-2d17d6b77ef6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:03.571745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d839706d-13aa-4a26-8b56-2d17d6b77ef6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:03.776420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d839706d-13aa-4a26-8b56-2d17d6b77ef6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:03.784738 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d839706d-13aa-4a26-8b56-2d17d6b77ef6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1514 microversion: 2.1 time: 0.228793 Oct 05 18:14:03.785531 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3110/5979] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:03 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:04.262464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b4965311-f81d-400b-bf08-351357461d61 req-f7ed5da9-8559-4fb6-8f3c-501ed4b40124 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20dd6bae-b54a-4b2a-ad75-6b2ce70ed109", "name": "network-vif-deleted", "tag": "072c414d-4b28-472a-a4d3-d6c311bfef4d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:04.280019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b4965311-f81d-400b-bf08-351357461d61 req-f7ed5da9-8559-4fb6-8f3c-501ed4b40124 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:04.280889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b4965311-f81d-400b-bf08-351357461d61 req-f7ed5da9-8559-4fb6-8f3c-501ed4b40124 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:04.281805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b4965311-f81d-400b-bf08-351357461d61 req-f7ed5da9-8559-4fb6-8f3c-501ed4b40124 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:04.314554 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b4965311-f81d-400b-bf08-351357461d61 req-f7ed5da9-8559-4fb6-8f3c-501ed4b40124 service nova] Creating event network-vif-deleted:072c414d-4b28-472a-a4d3-d6c311bfef4d for instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 on n-h2-835595-3 Oct 05 18:14:04.322527 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b4965311-f81d-400b-bf08-351357461d61 req-f7ed5da9-8559-4fb6-8f3c-501ed4b40124 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066118 Oct 05 18:14:04.323791 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2870/5980] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:04.808103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:04.810516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:04.814716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:04.819118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:04.819818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:04.820706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:04.821901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:04.822598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:04.823383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:04.874726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:04.875669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:04.876164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:04.876907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lazy-loading 'fault' on Instance uuid 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:14:04.941929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:04.950855 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3e18a499-6262-4008-8dbe-d6f152053958 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 200 len: 1317 microversion: 2.1 time: 0.146754 Oct 05 18:14:04.964532 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3111/5981] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:04 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:05.975952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:05.976645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:05.984057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:05.984534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:05.984959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:05.985673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:05.986122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:05.986567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:06.000500 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 HTTP/1.1 Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '20dd6bae-b54a-4b2a-ad75-6b2ce70ed109'} Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:06.002270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:06.017458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:06.017458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:06.017458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:06.017458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:06.017458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:06.017458 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:06.017458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:06.017458 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-42b405fb-5847-4ae0-9a9f-166a17eccf0a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 404 len: 111 microversion: 2.1 time: 0.032140 Oct 05 18:14:06.017458 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2871/5982] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:05 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:06.056175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1341862838", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "16f17efc-9d97-4067-a300-10a3914986e7"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:06.112136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] validate_networks() for [('16f17efc-9d97-4067-a300-10a3914986e7', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:14:06.574169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:14:06.574862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:14:06.575686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:14:06.576151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:14:06.576586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:14:06.587814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:06.588421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:06.590553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:06.591666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:06.592487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:06.593172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:06.618977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:14:06.624760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Getting quotas for user 0c698ccb66ac443582a7e610591c6da6 and project f7f060cbf98644e5bdca0cc9ccea14a9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:14:06.639504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:14:06.642698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:14:06.697215 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6be6671a-fc01-4899-890e-2ebc1d8c0413 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.644659 Oct 05 18:14:06.698212 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3112/5983] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:14:06.708922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-752f780b-4eef-4bc2-9e30-0441a19e2475 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:06.709535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-752f780b-4eef-4bc2-9e30-0441a19e2475 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:06.826053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-752f780b-4eef-4bc2-9e30-0441a19e2475 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:06.837034 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-752f780b-4eef-4bc2-9e30-0441a19e2475 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1209 microversion: 2.1 time: 0.131870 Oct 05 18:14:06.837575 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2872/5984] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:06 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1209 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:07.864146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-753f28cd-c935-48e9-b4b6-dec4b3cedeb0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:07.865503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-753f28cd-c935-48e9-b4b6-dec4b3cedeb0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:07.877984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-753f28cd-c935-48e9-b4b6-dec4b3cedeb0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:07.878891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-753f28cd-c935-48e9-b4b6-dec4b3cedeb0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:07.883673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-753f28cd-c935-48e9-b4b6-dec4b3cedeb0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:07.884710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-753f28cd-c935-48e9-b4b6-dec4b3cedeb0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:07.885200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-753f28cd-c935-48e9-b4b6-dec4b3cedeb0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:07.885649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-753f28cd-c935-48e9-b4b6-dec4b3cedeb0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:08.000286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-753f28cd-c935-48e9-b4b6-dec4b3cedeb0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:08.015065 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-753f28cd-c935-48e9-b4b6-dec4b3cedeb0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1261 microversion: 2.1 time: 0.157801 Oct 05 18:14:08.016353 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3113/5985] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:07 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:09.054230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a503f329-f95b-4b16-973e-522445ccd1ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:09.056222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a503f329-f95b-4b16-973e-522445ccd1ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:09.067275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503f329-f95b-4b16-973e-522445ccd1ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:09.067855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503f329-f95b-4b16-973e-522445ccd1ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:09.068559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503f329-f95b-4b16-973e-522445ccd1ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:09.069277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503f329-f95b-4b16-973e-522445ccd1ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:09.069718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503f329-f95b-4b16-973e-522445ccd1ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:09.082036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a503f329-f95b-4b16-973e-522445ccd1ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:09.222184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a503f329-f95b-4b16-973e-522445ccd1ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:09.232474 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a503f329-f95b-4b16-973e-522445ccd1ca tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1267 microversion: 2.1 time: 0.185523 Oct 05 18:14:09.233787 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2873/5986] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:09 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:10.260871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d04bb29-fe25-4085-ab7c-9a8ab5ad512e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:10.262077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d04bb29-fe25-4085-ab7c-9a8ab5ad512e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:10.270862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d04bb29-fe25-4085-ab7c-9a8ab5ad512e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:10.271420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d04bb29-fe25-4085-ab7c-9a8ab5ad512e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:10.271915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d04bb29-fe25-4085-ab7c-9a8ab5ad512e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:10.272667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d04bb29-fe25-4085-ab7c-9a8ab5ad512e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:10.273235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d04bb29-fe25-4085-ab7c-9a8ab5ad512e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:10.281345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d04bb29-fe25-4085-ab7c-9a8ab5ad512e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:10.723543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d04bb29-fe25-4085-ab7c-9a8ab5ad512e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:10.736169 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d04bb29-fe25-4085-ab7c-9a8ab5ad512e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1309 microversion: 2.1 time: 0.479095 Oct 05 18:14:10.737557 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3114/5987] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:10 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1309 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:11.764940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9295dac1-e3c6-4969-a030-0d5d68c767ef tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:11.768456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9295dac1-e3c6-4969-a030-0d5d68c767ef tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:11.781272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9295dac1-e3c6-4969-a030-0d5d68c767ef tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:11.782147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9295dac1-e3c6-4969-a030-0d5d68c767ef tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:11.782865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9295dac1-e3c6-4969-a030-0d5d68c767ef tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:11.783803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9295dac1-e3c6-4969-a030-0d5d68c767ef tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:11.784475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9295dac1-e3c6-4969-a030-0d5d68c767ef tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:11.785111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9295dac1-e3c6-4969-a030-0d5d68c767ef tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:11.949019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9295dac1-e3c6-4969-a030-0d5d68c767ef tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:11.958565 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9295dac1-e3c6-4969-a030-0d5d68c767ef tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1309 microversion: 2.1 time: 0.198568 Oct 05 18:14:11.969383 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2874/5988] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:11 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1309 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:12.111942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-cbd645f7-6902-4ec2-9a2a-29e8dd083e32 req-c2ecb6f5-6e73-4973-a65f-0a5da76bfbed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62693fd4-02a4-4b04-a9fe-6de50b5b1014", "tag": "68b84380-c9bd-462c-a66d-13a488192c41"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:12.132919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cbd645f7-6902-4ec2-9a2a-29e8dd083e32 req-c2ecb6f5-6e73-4973-a65f-0a5da76bfbed service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:12.133899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cbd645f7-6902-4ec2-9a2a-29e8dd083e32 req-c2ecb6f5-6e73-4973-a65f-0a5da76bfbed service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:12.134701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cbd645f7-6902-4ec2-9a2a-29e8dd083e32 req-c2ecb6f5-6e73-4973-a65f-0a5da76bfbed service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:12.156732 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-cbd645f7-6902-4ec2-9a2a-29e8dd083e32 req-c2ecb6f5-6e73-4973-a65f-0a5da76bfbed service nova] Creating event network-changed:68b84380-c9bd-462c-a66d-13a488192c41 for instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 on n-h2-835595-3 Oct 05 18:14:12.164848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-cbd645f7-6902-4ec2-9a2a-29e8dd083e32 req-c2ecb6f5-6e73-4973-a65f-0a5da76bfbed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059373 Oct 05 18:14:12.166647 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3115/5989] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:12.728503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47869ef2-131a-41bd-9d82-4b922794eb60 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Action: 'create', calling method: .version_select at 0x7f77749a6e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1669104081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgBQ8927ff00iyNeWc2Lb8b4rFkw0PGGwymUzssWlwQqB98tredQh3BhWZcOqcsUlGIlrE3KnjHmNRY6v17eBclhtAGPPaHT/OZ4ye212MQSrZaDX8FUVo9Iut+negbMQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:12.763052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-47869ef2-131a-41bd-9d82-4b922794eb60 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for project 2fe00cc2c3494b749a02868d27f89977. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:14:12.777133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-47869ef2-131a-41bd-9d82-4b922794eb60 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for user 18188fb109574bf38443d2848a77bf69 and project 2fe00cc2c3494b749a02868d27f89977. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:14:12.841562 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47869ef2-131a-41bd-9d82-4b922794eb60 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.117904 Oct 05 18:14:12.842589 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2875/5990] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:14:12 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:12.982330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5a62ae6c-2434-46f5-a791-51ba2d0a4dcd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:12.983451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5a62ae6c-2434-46f5-a791-51ba2d0a4dcd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:12.993223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a62ae6c-2434-46f5-a791-51ba2d0a4dcd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:12.993859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a62ae6c-2434-46f5-a791-51ba2d0a4dcd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:12.994611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a62ae6c-2434-46f5-a791-51ba2d0a4dcd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:12.996147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a62ae6c-2434-46f5-a791-51ba2d0a4dcd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:12.996833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a62ae6c-2434-46f5-a791-51ba2d0a4dcd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:12.997527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5a62ae6c-2434-46f5-a791-51ba2d0a4dcd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:13.212023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5a62ae6c-2434-46f5-a791-51ba2d0a4dcd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:13.220893 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5a62ae6c-2434-46f5-a791-51ba2d0a4dcd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1309 microversion: 2.1 time: 0.243199 Oct 05 18:14:13.233786 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3116/5991] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:12 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1309 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:14.249936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7d875108-5c0e-45ca-b89d-6d7db261ca8d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:14.250551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7d875108-5c0e-45ca-b89d-6d7db261ca8d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:14.274207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d875108-5c0e-45ca-b89d-6d7db261ca8d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:14.275124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d875108-5c0e-45ca-b89d-6d7db261ca8d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:14.275885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d875108-5c0e-45ca-b89d-6d7db261ca8d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:14.276962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d875108-5c0e-45ca-b89d-6d7db261ca8d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:14.277749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d875108-5c0e-45ca-b89d-6d7db261ca8d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:14.278389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d875108-5c0e-45ca-b89d-6d7db261ca8d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:14.529596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-913190386", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "017139e6-e16c-42f2-a3ca-1931557f1587"}], "key_name": "tempest-TestNetworkBasicOps-1669104081", "security_groups": [{"name": "tempest-secgroup-smoke-1070336499"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:14.657302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d875108-5c0e-45ca-b89d-6d7db261ca8d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:14.669953 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7d875108-5c0e-45ca-b89d-6d7db261ca8d tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1309 microversion: 2.1 time: 0.424705 Oct 05 18:14:14.671227 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2876/5992] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:14 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1309 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:14.814173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] validate_networks() for [('017139e6-e16c-42f2-a3ca-1931557f1587', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:14:15.704526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fadf9bd2-42cf-408c-846a-568b9c61c4da tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:15.705175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fadf9bd2-42cf-408c-846a-568b9c61c4da tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:15.713869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fadf9bd2-42cf-408c-846a-568b9c61c4da tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:15.714377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fadf9bd2-42cf-408c-846a-568b9c61c4da tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:15.715057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fadf9bd2-42cf-408c-846a-568b9c61c4da tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:15.715834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fadf9bd2-42cf-408c-846a-568b9c61c4da tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:15.716312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fadf9bd2-42cf-408c-846a-568b9c61c4da tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:15.716777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fadf9bd2-42cf-408c-846a-568b9c61c4da tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:15.722131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:15.934568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fadf9bd2-42cf-408c-846a-568b9c61c4da tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:15.944886 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fadf9bd2-42cf-408c-846a-568b9c61c4da tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1309 microversion: 2.1 time: 0.244618 Oct 05 18:14:15.946474 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2877/5993] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:15 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1309 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:15.962269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:14:15.963126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:14:15.963991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:14:15.964438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:14:15.964875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:14:15.977030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:15.977828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:15.978315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:15.979199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:15.980018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:15.980443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:16.015203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for project 2fe00cc2c3494b749a02868d27f89977. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:14:16.021778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Getting quotas for user 18188fb109574bf38443d2848a77bf69 and project 2fe00cc2c3494b749a02868d27f89977. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:14:16.037342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:14:16.043143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:14:16.124286 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2478f0f6-d782-4cb8-9492-299f7a41a168 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.614704 Oct 05 18:14:16.125749 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3117/5994] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:14:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:14:16.138140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-42cb5a80-330a-40c3-998d-5ede8d87d403 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:16.139749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-42cb5a80-330a-40c3-998d-5ede8d87d403 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:16.256923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-42cb5a80-330a-40c3-998d-5ede8d87d403 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:16.265180 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-42cb5a80-330a-40c3-998d-5ede8d87d403 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1248 microversion: 2.1 time: 0.131232 Oct 05 18:14:16.266048 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2878/5995] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:16 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1248 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:16.973148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1532eae0-731f-477f-b4aa-d096851317e6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:16.974571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1532eae0-731f-477f-b4aa-d096851317e6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:16.984363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1532eae0-731f-477f-b4aa-d096851317e6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:16.985719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1532eae0-731f-477f-b4aa-d096851317e6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:16.986467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1532eae0-731f-477f-b4aa-d096851317e6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:16.987623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1532eae0-731f-477f-b4aa-d096851317e6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:16.988106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1532eae0-731f-477f-b4aa-d096851317e6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:16.988777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1532eae0-731f-477f-b4aa-d096851317e6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:17.164906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1532eae0-731f-477f-b4aa-d096851317e6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:17.174347 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1532eae0-731f-477f-b4aa-d096851317e6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1309 microversion: 2.1 time: 0.207999 Oct 05 18:14:17.175194 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3118/5996] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:16 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1309 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:17.289956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-02b4f521-e44e-40b5-abf3-f466ba96370a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:17.291447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-02b4f521-e44e-40b5-abf3-f466ba96370a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:17.301851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02b4f521-e44e-40b5-abf3-f466ba96370a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:17.302350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02b4f521-e44e-40b5-abf3-f466ba96370a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:17.303047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02b4f521-e44e-40b5-abf3-f466ba96370a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:17.304313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02b4f521-e44e-40b5-abf3-f466ba96370a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:17.305042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02b4f521-e44e-40b5-abf3-f466ba96370a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:17.305633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02b4f521-e44e-40b5-abf3-f466ba96370a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:17.391394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3fadf796-0a3c-4595-95e9-bd806f252b53 req-3051e20c-7c5d-47a9-85da-fb99e817555a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62693fd4-02a4-4b04-a9fe-6de50b5b1014", "name": "network-vif-plugged", "status": "completed", "tag": "68b84380-c9bd-462c-a66d-13a488192c41"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:17.434107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3fadf796-0a3c-4595-95e9-bd806f252b53 req-3051e20c-7c5d-47a9-85da-fb99e817555a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:17.434996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3fadf796-0a3c-4595-95e9-bd806f252b53 req-3051e20c-7c5d-47a9-85da-fb99e817555a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:17.435807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3fadf796-0a3c-4595-95e9-bd806f252b53 req-3051e20c-7c5d-47a9-85da-fb99e817555a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:17.462831 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3fadf796-0a3c-4595-95e9-bd806f252b53 req-3051e20c-7c5d-47a9-85da-fb99e817555a service nova] Creating event network-vif-plugged:68b84380-c9bd-462c-a66d-13a488192c41 for instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 on n-h2-835595-3 Oct 05 18:14:17.472120 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3fadf796-0a3c-4595-95e9-bd806f252b53 req-3051e20c-7c5d-47a9-85da-fb99e817555a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103088 Oct 05 18:14:17.473794 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3119/5997] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:17.509968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-02b4f521-e44e-40b5-abf3-f466ba96370a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:17.523481 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-02b4f521-e44e-40b5-abf3-f466ba96370a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1300 microversion: 2.1 time: 0.238026 Oct 05 18:14:17.538495 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2879/5998] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:17 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1300 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:18.201444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a66ef093-8d46-45fc-a593-2b11e18192fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:18.202833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a66ef093-8d46-45fc-a593-2b11e18192fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:18.210258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a66ef093-8d46-45fc-a593-2b11e18192fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:18.211166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a66ef093-8d46-45fc-a593-2b11e18192fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:18.211684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a66ef093-8d46-45fc-a593-2b11e18192fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:18.212630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a66ef093-8d46-45fc-a593-2b11e18192fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:18.213466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a66ef093-8d46-45fc-a593-2b11e18192fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:18.214120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a66ef093-8d46-45fc-a593-2b11e18192fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:18.369051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a66ef093-8d46-45fc-a593-2b11e18192fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:18.371068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:18.381831 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a66ef093-8d46-45fc-a593-2b11e18192fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1309 microversion: 2.1 time: 0.184503 Oct 05 18:14:18.394799 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3120/5999] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:18 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:18.548599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b24d2452-3216-4bc0-a2b8-891aac530067 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:18.549949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b24d2452-3216-4bc0-a2b8-891aac530067 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:18.553164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:18.564908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24d2452-3216-4bc0-a2b8-891aac530067 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:18.564908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24d2452-3216-4bc0-a2b8-891aac530067 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:18.565429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24d2452-3216-4bc0-a2b8-891aac530067 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:18.566716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24d2452-3216-4bc0-a2b8-891aac530067 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:18.567103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24d2452-3216-4bc0-a2b8-891aac530067 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:18.567311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b24d2452-3216-4bc0-a2b8-891aac530067 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:18.810811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b24d2452-3216-4bc0-a2b8-891aac530067 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:18.821478 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b24d2452-3216-4bc0-a2b8-891aac530067 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1374 microversion: 2.1 time: 0.277630 Oct 05 18:14:18.829888 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2880/6000] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:18 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1374 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:19.254467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3e16e382-ad1d-4874-8994-91e4ad60715d req-091f486f-06d5-41a3-9883-e48eda978880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a7a677-6544-4b74-9d6d-4be5230f1ddb", "tag": "e98fe020-aead-4814-98bb-1ae047123a6e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:19.271615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3e16e382-ad1d-4874-8994-91e4ad60715d req-091f486f-06d5-41a3-9883-e48eda978880 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.272413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3e16e382-ad1d-4874-8994-91e4ad60715d req-091f486f-06d5-41a3-9883-e48eda978880 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.272861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3e16e382-ad1d-4874-8994-91e4ad60715d req-091f486f-06d5-41a3-9883-e48eda978880 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.286017 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3e16e382-ad1d-4874-8994-91e4ad60715d req-091f486f-06d5-41a3-9883-e48eda978880 service nova] Creating event network-changed:e98fe020-aead-4814-98bb-1ae047123a6e for instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb on n-h1-835595-3 Oct 05 18:14:19.291791 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3e16e382-ad1d-4874-8994-91e4ad60715d req-091f486f-06d5-41a3-9883-e48eda978880 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041412 Oct 05 18:14:19.293025 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3121/6001] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:19.405741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-793d89b9-85b2-43eb-a92a-0c66dc3ae3e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:19.407037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-793d89b9-85b2-43eb-a92a-0c66dc3ae3e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:19.413887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-793d89b9-85b2-43eb-a92a-0c66dc3ae3e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.414782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-793d89b9-85b2-43eb-a92a-0c66dc3ae3e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.415542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-793d89b9-85b2-43eb-a92a-0c66dc3ae3e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.416471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-793d89b9-85b2-43eb-a92a-0c66dc3ae3e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.417090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-793d89b9-85b2-43eb-a92a-0c66dc3ae3e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.417758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-793d89b9-85b2-43eb-a92a-0c66dc3ae3e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.641971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-793d89b9-85b2-43eb-a92a-0c66dc3ae3e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:19.650142 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-793d89b9-85b2-43eb-a92a-0c66dc3ae3e0 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1489 microversion: 2.1 time: 0.248552 Oct 05 18:14:19.652841 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2881/6002] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:19 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1489 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:19.674571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-397f3cc1-c28b-4c5a-805f-797cdf9e5899 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2012977284"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:19.677195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-397f3cc1-c28b-4c5a-805f-797cdf9e5899 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:19.684964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-397f3cc1-c28b-4c5a-805f-797cdf9e5899 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.685496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-397f3cc1-c28b-4c5a-805f-797cdf9e5899 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.685961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-397f3cc1-c28b-4c5a-805f-797cdf9e5899 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.686865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-397f3cc1-c28b-4c5a-805f-797cdf9e5899 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.687526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-397f3cc1-c28b-4c5a-805f-797cdf9e5899 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.688027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-397f3cc1-c28b-4c5a-805f-797cdf9e5899 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.755714 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-397f3cc1-c28b-4c5a-805f-797cdf9e5899 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "PUT /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1074 microversion: 2.1 time: 0.085407 Oct 05 18:14:19.756515 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3122/6003] 10.222.0.70 () {60 vars in 1256 bytes} [Wed Oct 5 18:14:19 2022] PUT /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1074 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:19.775789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8ed680b4-8521-4695-bff0-67d49338f523 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:19.776975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8ed680b4-8521-4695-bff0-67d49338f523 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:19.783632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ed680b4-8521-4695-bff0-67d49338f523 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.784268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ed680b4-8521-4695-bff0-67d49338f523 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.784910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ed680b4-8521-4695-bff0-67d49338f523 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.785975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ed680b4-8521-4695-bff0-67d49338f523 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.787050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ed680b4-8521-4695-bff0-67d49338f523 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.787541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8ed680b4-8521-4695-bff0-67d49338f523 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.845258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bb45497d-0a91-4bba-9c26-d3d1f6bf550d tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:19.845813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bb45497d-0a91-4bba-9c26-d3d1f6bf550d tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:19.852490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb45497d-0a91-4bba-9c26-d3d1f6bf550d tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.852941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb45497d-0a91-4bba-9c26-d3d1f6bf550d tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.853392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb45497d-0a91-4bba-9c26-d3d1f6bf550d tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.854121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb45497d-0a91-4bba-9c26-d3d1f6bf550d tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.854632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb45497d-0a91-4bba-9c26-d3d1f6bf550d tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.855079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb45497d-0a91-4bba-9c26-d3d1f6bf550d tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.921502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8ed680b4-8521-4695-bff0-67d49338f523 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:19.930356 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8ed680b4-8521-4695-bff0-67d49338f523 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1500 microversion: 2.1 time: 0.159190 Oct 05 18:14:19.931122 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2882/6004] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:19 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1500 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:19.955480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72d7e0b2-430e-4b5e-b016-b036eedfb03f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:19.956126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-72d7e0b2-430e-4b5e-b016-b036eedfb03f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:19.962218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7e0b2-430e-4b5e-b016-b036eedfb03f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.962742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7e0b2-430e-4b5e-b016-b036eedfb03f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.963179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7e0b2-430e-4b5e-b016-b036eedfb03f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.963881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7e0b2-430e-4b5e-b016-b036eedfb03f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:19.964367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7e0b2-430e-4b5e-b016-b036eedfb03f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:19.964792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72d7e0b2-430e-4b5e-b016-b036eedfb03f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:19.997946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bb45497d-0a91-4bba-9c26-d3d1f6bf550d tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:20.006338 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bb45497d-0a91-4bba-9c26-d3d1f6bf550d tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1374 microversion: 2.1 time: 0.165276 Oct 05 18:14:20.006940 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3123/6005] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:19 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:20.098416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-72d7e0b2-430e-4b5e-b016-b036eedfb03f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:20.106649 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-72d7e0b2-430e-4b5e-b016-b036eedfb03f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1500 microversion: 2.1 time: 0.158268 Oct 05 18:14:20.107138 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2883/6006] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:19 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:14:20.129062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3f43e252-fe4a-4ac9-bac9-c856b66dbd4a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:20.135316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f43e252-fe4a-4ac9-bac9-c856b66dbd4a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:20.135812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f43e252-fe4a-4ac9-bac9-c856b66dbd4a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:20.136730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f43e252-fe4a-4ac9-bac9-c856b66dbd4a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:20.159748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3f43e252-fe4a-4ac9-bac9-c856b66dbd4a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Going to try to stop instance {{(pid=128844) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 18:14:20.207068 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3f43e252-fe4a-4ac9-bac9-c856b66dbd4a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "POST /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014/action" status: 202 len: 0 microversion: 2.1 time: 0.081555 Oct 05 18:14:20.207805 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3124/6007] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:14:20 2022] POST /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:14:20.216624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bf0f17bf-20fd-49e4-88c4-74022308ad8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:20.217318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bf0f17bf-20fd-49e4-88c4-74022308ad8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:20.223844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0f17bf-20fd-49e4-88c4-74022308ad8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:20.224608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0f17bf-20fd-49e4-88c4-74022308ad8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:20.225307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0f17bf-20fd-49e4-88c4-74022308ad8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:20.226028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0f17bf-20fd-49e4-88c4-74022308ad8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:20.226638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0f17bf-20fd-49e4-88c4-74022308ad8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:20.227073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0f17bf-20fd-49e4-88c4-74022308ad8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:20.262568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-118054813", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1735877736", "security_groups": [{"name": "tempest-secgroup-smoke-477833963"}], "block_device_mapping_v2": [{"uuid": "8349f4db-8ab7-4f86-a6c1-7086fb3bd810", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "adb1494a-27b0-43e0-8027-66e89e0c81ad"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:20.365892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bf0f17bf-20fd-49e4-88c4-74022308ad8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:20.373997 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bf0f17bf-20fd-49e4-88c4-74022308ad8b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.161534 Oct 05 18:14:20.374605 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2884/6008] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:20 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:20.385407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] validate_networks() for [('adb1494a-27b0-43e0-8027-66e89e0c81ad', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:14:20.769150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:14:20.769583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:14:20.770066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:14:20.770513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:14:20.770938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:14:20.780187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:20.780684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:20.781127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:20.781856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:20.782349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:20.782792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:20.799807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:14:20.805325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Getting quotas for user 8a900e5bf82d462a9113d6e6461ea3a0 and project cd19bdb239c247e7a345e8067ae4a1e0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:14:20.865181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:14:20.867529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8349f4db-8ab7-4f86-a6c1-7086fb3bd810',volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:14:21.009501 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c60900f2-1497-4595-bf80-768708add6fe tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.751626 Oct 05 18:14:21.010165 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3125/6009] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:14:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:14:21.021541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d5d9cfe-f0f3-4774-b3ce-cc6aa441c194 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:21.022138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6d5d9cfe-f0f3-4774-b3ce-cc6aa441c194 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:21.036020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-325dd028-79cb-4824-8035-c88b7fc8ebfd tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:21.036658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-325dd028-79cb-4824-8035-c88b7fc8ebfd tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:21.043484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd028-79cb-4824-8035-c88b7fc8ebfd tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:21.043988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd028-79cb-4824-8035-c88b7fc8ebfd tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:21.044439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd028-79cb-4824-8035-c88b7fc8ebfd tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:21.045154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd028-79cb-4824-8035-c88b7fc8ebfd tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:21.045805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd028-79cb-4824-8035-c88b7fc8ebfd tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:21.046243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd028-79cb-4824-8035-c88b7fc8ebfd tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:21.106878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d5d9cfe-f0f3-4774-b3ce-cc6aa441c194 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:21.117193 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6d5d9cfe-f0f3-4774-b3ce-cc6aa441c194 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1094 microversion: 2.1 time: 0.099002 Oct 05 18:14:21.118588 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2885/6010] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:21 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1094 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:14:21.198017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-325dd028-79cb-4824-8035-c88b7fc8ebfd tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:21.206201 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-325dd028-79cb-4824-8035-c88b7fc8ebfd tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1374 microversion: 2.1 time: 0.175163 Oct 05 18:14:21.206863 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3126/6011] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:21 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:21.399773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a91dc5d6-731e-4a71-b452-79d560a1bf7c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:21.399773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a91dc5d6-731e-4a71-b452-79d560a1bf7c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:21.407475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a91dc5d6-731e-4a71-b452-79d560a1bf7c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:21.407964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a91dc5d6-731e-4a71-b452-79d560a1bf7c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:21.408477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a91dc5d6-731e-4a71-b452-79d560a1bf7c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:21.409163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a91dc5d6-731e-4a71-b452-79d560a1bf7c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:21.409681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a91dc5d6-731e-4a71-b452-79d560a1bf7c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:21.410181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a91dc5d6-731e-4a71-b452-79d560a1bf7c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:21.547291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a91dc5d6-731e-4a71-b452-79d560a1bf7c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:21.556191 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a91dc5d6-731e-4a71-b452-79d560a1bf7c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.162755 Oct 05 18:14:21.556776 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2886/6012] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:21 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:22.141890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-64496b87-08e7-4f71-bfd1-f753850a01d4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:22.142904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-64496b87-08e7-4f71-bfd1-f753850a01d4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:22.151834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64496b87-08e7-4f71-bfd1-f753850a01d4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:22.152433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64496b87-08e7-4f71-bfd1-f753850a01d4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:22.152988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64496b87-08e7-4f71-bfd1-f753850a01d4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:22.153815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64496b87-08e7-4f71-bfd1-f753850a01d4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:22.154409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64496b87-08e7-4f71-bfd1-f753850a01d4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:22.154992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-64496b87-08e7-4f71-bfd1-f753850a01d4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:22.225783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-64496b87-08e7-4f71-bfd1-f753850a01d4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:22.229567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de132d75-2e45-4fb9-86bf-67ff05a5e727 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:22.231786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-de132d75-2e45-4fb9-86bf-67ff05a5e727 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:22.234583 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-64496b87-08e7-4f71-bfd1-f753850a01d4 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1210 microversion: 2.1 time: 0.097633 Oct 05 18:14:22.235681 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3127/6013] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:22 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:22.239699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de132d75-2e45-4fb9-86bf-67ff05a5e727 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:22.240194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de132d75-2e45-4fb9-86bf-67ff05a5e727 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:22.240811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de132d75-2e45-4fb9-86bf-67ff05a5e727 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:22.241720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de132d75-2e45-4fb9-86bf-67ff05a5e727 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:22.242230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de132d75-2e45-4fb9-86bf-67ff05a5e727 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:22.242673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de132d75-2e45-4fb9-86bf-67ff05a5e727 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:22.450743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-de132d75-2e45-4fb9-86bf-67ff05a5e727 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:22.459600 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de132d75-2e45-4fb9-86bf-67ff05a5e727 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1374 microversion: 2.1 time: 0.234174 Oct 05 18:14:22.476103 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2887/6014] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:22 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1374 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:22.584759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9f14d4c8-a45e-425b-803a-aebadad980ee tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:22.585643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9f14d4c8-a45e-425b-803a-aebadad980ee tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:22.593463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f14d4c8-a45e-425b-803a-aebadad980ee tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:22.594462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f14d4c8-a45e-425b-803a-aebadad980ee tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:22.595469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f14d4c8-a45e-425b-803a-aebadad980ee tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:22.596594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f14d4c8-a45e-425b-803a-aebadad980ee tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:22.597127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f14d4c8-a45e-425b-803a-aebadad980ee tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:22.597882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f14d4c8-a45e-425b-803a-aebadad980ee tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:22.738256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9f14d4c8-a45e-425b-803a-aebadad980ee tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:22.747860 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9f14d4c8-a45e-425b-803a-aebadad980ee tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.171522 Oct 05 18:14:22.749137 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3128/6015] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:22 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:23.263032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-75b89d35-3f0d-4f8e-9d91-0644110301f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:23.264654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-75b89d35-3f0d-4f8e-9d91-0644110301f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:23.272807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75b89d35-3f0d-4f8e-9d91-0644110301f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:23.273764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75b89d35-3f0d-4f8e-9d91-0644110301f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:23.274675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75b89d35-3f0d-4f8e-9d91-0644110301f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:23.275694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75b89d35-3f0d-4f8e-9d91-0644110301f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:23.276441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75b89d35-3f0d-4f8e-9d91-0644110301f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:23.277073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-75b89d35-3f0d-4f8e-9d91-0644110301f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:23.483256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-667dc7c7-3e13-4cd1-a717-67b951c521df tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:23.483861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-667dc7c7-3e13-4cd1-a717-67b951c521df tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:23.491766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-667dc7c7-3e13-4cd1-a717-67b951c521df tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:23.492636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-667dc7c7-3e13-4cd1-a717-67b951c521df tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:23.493059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-667dc7c7-3e13-4cd1-a717-67b951c521df tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:23.493977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-667dc7c7-3e13-4cd1-a717-67b951c521df tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:23.494827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-667dc7c7-3e13-4cd1-a717-67b951c521df tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:23.495287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-667dc7c7-3e13-4cd1-a717-67b951c521df tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:23.636296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-75b89d35-3f0d-4f8e-9d91-0644110301f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:23.638887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-667dc7c7-3e13-4cd1-a717-67b951c521df tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:23.645539 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-75b89d35-3f0d-4f8e-9d91-0644110301f6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1277 microversion: 2.1 time: 0.386692 Oct 05 18:14:23.647086 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2888/6016] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:23 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1277 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:23.647223 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-667dc7c7-3e13-4cd1-a717-67b951c521df tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1374 microversion: 2.1 time: 0.167670 Oct 05 18:14:23.650711 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3129/6017] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:23 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:14:23.772052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-83803c35-0909-4887-8057-9fed1187b9f3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:23.772824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-83803c35-0909-4887-8057-9fed1187b9f3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:23.779078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83803c35-0909-4887-8057-9fed1187b9f3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:23.779570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83803c35-0909-4887-8057-9fed1187b9f3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:23.780009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83803c35-0909-4887-8057-9fed1187b9f3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:23.780741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83803c35-0909-4887-8057-9fed1187b9f3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:23.781383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83803c35-0909-4887-8057-9fed1187b9f3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:23.781808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83803c35-0909-4887-8057-9fed1187b9f3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:23.993826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-83803c35-0909-4887-8057-9fed1187b9f3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:24.002678 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-83803c35-0909-4887-8057-9fed1187b9f3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.234757 Oct 05 18:14:24.003152 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2889/6018] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:23 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:24.213220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7112d6b7-4a25-4944-959f-6b459f4d5758 req-a5ab8404-a0f7-4072-8d29-e8627e53fbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149526b1-8830-4166-b3dc-38822df4d07d", "tag": "8a89dbba-8fa1-4ae8-b62f-c21e32f7c9c3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:24.236573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7112d6b7-4a25-4944-959f-6b459f4d5758 req-a5ab8404-a0f7-4072-8d29-e8627e53fbc6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:24.237301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7112d6b7-4a25-4944-959f-6b459f4d5758 req-a5ab8404-a0f7-4072-8d29-e8627e53fbc6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:24.238750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7112d6b7-4a25-4944-959f-6b459f4d5758 req-a5ab8404-a0f7-4072-8d29-e8627e53fbc6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:24.254302 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7112d6b7-4a25-4944-959f-6b459f4d5758 req-a5ab8404-a0f7-4072-8d29-e8627e53fbc6 service nova] Creating event network-changed:8a89dbba-8fa1-4ae8-b62f-c21e32f7c9c3 for instance 149526b1-8830-4166-b3dc-38822df4d07d on n-h1-835595-3 Oct 05 18:14:24.261602 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7112d6b7-4a25-4944-959f-6b459f4d5758 req-a5ab8404-a0f7-4072-8d29-e8627e53fbc6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137228 Oct 05 18:14:24.262868 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3130/6019] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:24.683367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aeb4f70f-986d-40cb-9562-0bebf2cbba79 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:24.684098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aeb4f70f-986d-40cb-9562-0bebf2cbba79 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:24.686765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5232dda3-1407-4ae8-9868-ddc2ccf9fdb1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:24.687590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5232dda3-1407-4ae8-9868-ddc2ccf9fdb1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:24.701773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5232dda3-1407-4ae8-9868-ddc2ccf9fdb1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:24.702291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5232dda3-1407-4ae8-9868-ddc2ccf9fdb1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:24.702918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5232dda3-1407-4ae8-9868-ddc2ccf9fdb1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:24.703634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5232dda3-1407-4ae8-9868-ddc2ccf9fdb1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:24.704092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5232dda3-1407-4ae8-9868-ddc2ccf9fdb1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:24.704520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5232dda3-1407-4ae8-9868-ddc2ccf9fdb1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:24.706975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb4f70f-986d-40cb-9562-0bebf2cbba79 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:24.707543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb4f70f-986d-40cb-9562-0bebf2cbba79 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:24.708121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb4f70f-986d-40cb-9562-0bebf2cbba79 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:24.708988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb4f70f-986d-40cb-9562-0bebf2cbba79 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:24.709461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb4f70f-986d-40cb-9562-0bebf2cbba79 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:24.709910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb4f70f-986d-40cb-9562-0bebf2cbba79 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:24.880453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aeb4f70f-986d-40cb-9562-0bebf2cbba79 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:24.889085 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aeb4f70f-986d-40cb-9562-0bebf2cbba79 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1374 microversion: 2.1 time: 0.221272 Oct 05 18:14:24.889659 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3131/6020] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:24 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1374 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:24.961350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5232dda3-1407-4ae8-9868-ddc2ccf9fdb1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:24.970122 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5232dda3-1407-4ae8-9868-ddc2ccf9fdb1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1277 microversion: 2.1 time: 0.304759 Oct 05 18:14:24.970726 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2890/6021] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:24 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1277 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:25.028507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ed2bfd7f-0c68-4de4-bc91-6496860d738b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:25.029212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ed2bfd7f-0c68-4de4-bc91-6496860d738b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:25.035750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed2bfd7f-0c68-4de4-bc91-6496860d738b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:25.036325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed2bfd7f-0c68-4de4-bc91-6496860d738b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:25.036839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed2bfd7f-0c68-4de4-bc91-6496860d738b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:25.037634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed2bfd7f-0c68-4de4-bc91-6496860d738b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:25.038168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed2bfd7f-0c68-4de4-bc91-6496860d738b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:25.038761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed2bfd7f-0c68-4de4-bc91-6496860d738b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:25.174143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ed2bfd7f-0c68-4de4-bc91-6496860d738b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:25.185283 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ed2bfd7f-0c68-4de4-bc91-6496860d738b tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.160679 Oct 05 18:14:25.196108 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3132/6022] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:25 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:25.914574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d976782b-444b-4776-9a39-2cbdc1838209 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:25.915303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d976782b-444b-4776-9a39-2cbdc1838209 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:25.922759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d976782b-444b-4776-9a39-2cbdc1838209 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:25.923248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d976782b-444b-4776-9a39-2cbdc1838209 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:25.923683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d976782b-444b-4776-9a39-2cbdc1838209 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:25.924377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d976782b-444b-4776-9a39-2cbdc1838209 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:25.924810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d976782b-444b-4776-9a39-2cbdc1838209 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:25.925415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d976782b-444b-4776-9a39-2cbdc1838209 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:25.993500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cfb9b632-1e20-43f7-8c1c-268e734c97a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:25.994547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cfb9b632-1e20-43f7-8c1c-268e734c97a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:26.001900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfb9b632-1e20-43f7-8c1c-268e734c97a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:26.002507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfb9b632-1e20-43f7-8c1c-268e734c97a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:26.002959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfb9b632-1e20-43f7-8c1c-268e734c97a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:26.004016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfb9b632-1e20-43f7-8c1c-268e734c97a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:26.004533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfb9b632-1e20-43f7-8c1c-268e734c97a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:26.005175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfb9b632-1e20-43f7-8c1c-268e734c97a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:26.085210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d976782b-444b-4776-9a39-2cbdc1838209 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:26.099959 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d976782b-444b-4776-9a39-2cbdc1838209 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1374 microversion: 2.1 time: 0.185708 Oct 05 18:14:26.118774 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2891/6023] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:25 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1374 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:26.181557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cfb9b632-1e20-43f7-8c1c-268e734c97a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:26.190502 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cfb9b632-1e20-43f7-8c1c-268e734c97a9 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1277 microversion: 2.1 time: 0.200803 Oct 05 18:14:26.191356 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3133/6024] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:25 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:26.210879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a675627f-a105-43c4-b415-f4f74bba04a4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:26.211504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a675627f-a105-43c4-b415-f4f74bba04a4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:26.218170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a675627f-a105-43c4-b415-f4f74bba04a4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:26.218697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a675627f-a105-43c4-b415-f4f74bba04a4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:26.219159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a675627f-a105-43c4-b415-f4f74bba04a4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:26.220261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a675627f-a105-43c4-b415-f4f74bba04a4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:26.220406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a675627f-a105-43c4-b415-f4f74bba04a4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:26.221191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a675627f-a105-43c4-b415-f4f74bba04a4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:26.232804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-1d13d61f-1f00-4a87-9f39-dc3de93b0975 req-42655e32-8dd6-4141-b034-1eb374c951fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a7a677-6544-4b74-9d6d-4be5230f1ddb", "name": "network-vif-plugged", "status": "completed", "tag": "e98fe020-aead-4814-98bb-1ae047123a6e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:26.248119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1d13d61f-1f00-4a87-9f39-dc3de93b0975 req-42655e32-8dd6-4141-b034-1eb374c951fc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:26.249076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1d13d61f-1f00-4a87-9f39-dc3de93b0975 req-42655e32-8dd6-4141-b034-1eb374c951fc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:26.249897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1d13d61f-1f00-4a87-9f39-dc3de93b0975 req-42655e32-8dd6-4141-b034-1eb374c951fc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:26.266327 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-1d13d61f-1f00-4a87-9f39-dc3de93b0975 req-42655e32-8dd6-4141-b034-1eb374c951fc service nova] Creating event network-vif-plugged:e98fe020-aead-4814-98bb-1ae047123a6e for instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb on n-h1-835595-3 Oct 05 18:14:26.275704 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-1d13d61f-1f00-4a87-9f39-dc3de93b0975 req-42655e32-8dd6-4141-b034-1eb374c951fc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048090 Oct 05 18:14:26.286787 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3134/6025] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:14:26.394456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a675627f-a105-43c4-b415-f4f74bba04a4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:26.403132 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a675627f-a105-43c4-b415-f4f74bba04a4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.196468 Oct 05 18:14:26.403709 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2892/6026] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:26 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:27.129791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bb15b227-ab02-44c9-914c-6fabe7809021 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:27.130581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bb15b227-ab02-44c9-914c-6fabe7809021 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:27.137278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb15b227-ab02-44c9-914c-6fabe7809021 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:27.137785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb15b227-ab02-44c9-914c-6fabe7809021 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:27.138238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb15b227-ab02-44c9-914c-6fabe7809021 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:27.139254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb15b227-ab02-44c9-914c-6fabe7809021 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:27.139753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb15b227-ab02-44c9-914c-6fabe7809021 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:27.140353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bb15b227-ab02-44c9-914c-6fabe7809021 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:27.216435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7aec5bca-82d9-40f2-b8ac-b320872901ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:27.217052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7aec5bca-82d9-40f2-b8ac-b320872901ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:27.225123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aec5bca-82d9-40f2-b8ac-b320872901ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:27.225677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aec5bca-82d9-40f2-b8ac-b320872901ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:27.226150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aec5bca-82d9-40f2-b8ac-b320872901ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:27.226965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aec5bca-82d9-40f2-b8ac-b320872901ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:27.227701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aec5bca-82d9-40f2-b8ac-b320872901ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:27.232318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7aec5bca-82d9-40f2-b8ac-b320872901ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:27.305113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bb15b227-ab02-44c9-914c-6fabe7809021 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:27.319598 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bb15b227-ab02-44c9-914c-6fabe7809021 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1374 microversion: 2.1 time: 0.197042 Oct 05 18:14:27.320693 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3135/6027] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:27 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1374 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:27.399207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7aec5bca-82d9-40f2-b8ac-b320872901ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:27.407332 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7aec5bca-82d9-40f2-b8ac-b320872901ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1277 microversion: 2.1 time: 0.195278 Oct 05 18:14:27.407920 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2893/6028] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:27 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:27.427910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-97064d0a-e72d-4eed-8c01-0d38f4790a37 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:27.428631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-97064d0a-e72d-4eed-8c01-0d38f4790a37 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:27.435875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97064d0a-e72d-4eed-8c01-0d38f4790a37 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:27.436461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97064d0a-e72d-4eed-8c01-0d38f4790a37 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:27.436973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97064d0a-e72d-4eed-8c01-0d38f4790a37 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:27.437776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97064d0a-e72d-4eed-8c01-0d38f4790a37 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:27.438369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97064d0a-e72d-4eed-8c01-0d38f4790a37 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:27.438369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97064d0a-e72d-4eed-8c01-0d38f4790a37 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:27.596349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-97064d0a-e72d-4eed-8c01-0d38f4790a37 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:27.608678 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-97064d0a-e72d-4eed-8c01-0d38f4790a37 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.184616 Oct 05 18:14:27.609348 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3136/6029] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:27 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:28.348058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4190361a-4048-442f-ad7d-16aa353065e7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:28.348681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4190361a-4048-442f-ad7d-16aa353065e7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:28.356509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4190361a-4048-442f-ad7d-16aa353065e7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:28.357007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4190361a-4048-442f-ad7d-16aa353065e7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:28.357438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4190361a-4048-442f-ad7d-16aa353065e7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:28.358133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4190361a-4048-442f-ad7d-16aa353065e7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:28.358632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4190361a-4048-442f-ad7d-16aa353065e7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:28.359112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4190361a-4048-442f-ad7d-16aa353065e7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:28.431417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-929c47c9-d263-4119-ac8f-ba77df2ff1b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:28.432146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-929c47c9-d263-4119-ac8f-ba77df2ff1b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:28.434981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:28.441288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929c47c9-d263-4119-ac8f-ba77df2ff1b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:28.441798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929c47c9-d263-4119-ac8f-ba77df2ff1b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:28.442234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929c47c9-d263-4119-ac8f-ba77df2ff1b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:28.442999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929c47c9-d263-4119-ac8f-ba77df2ff1b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:28.443474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929c47c9-d263-4119-ac8f-ba77df2ff1b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:28.443964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929c47c9-d263-4119-ac8f-ba77df2ff1b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:28.503075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4190361a-4048-442f-ad7d-16aa353065e7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:28.511993 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4190361a-4048-442f-ad7d-16aa353065e7 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1546 microversion: 2.1 time: 0.168438 Oct 05 18:14:28.512751 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2894/6030] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:28 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:28.534694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b474c32f-1656-4002-a939-df3a5666fca8 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:28.535417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b474c32f-1656-4002-a939-df3a5666fca8 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:28.541902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b474c32f-1656-4002-a939-df3a5666fca8 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:28.542426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b474c32f-1656-4002-a939-df3a5666fca8 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:28.542851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b474c32f-1656-4002-a939-df3a5666fca8 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:28.543612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b474c32f-1656-4002-a939-df3a5666fca8 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:28.544076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b474c32f-1656-4002-a939-df3a5666fca8 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:28.544530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b474c32f-1656-4002-a939-df3a5666fca8 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:28.596695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-929c47c9-d263-4119-ac8f-ba77df2ff1b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:28.606936 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-929c47c9-d263-4119-ac8f-ba77df2ff1b6 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1265 microversion: 2.1 time: 0.179455 Oct 05 18:14:28.607939 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3137/6031] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:28 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:28.637040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6017d374-be41-4e40-b066-54bf8f354de8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:28.638052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6017d374-be41-4e40-b066-54bf8f354de8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:28.647605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6017d374-be41-4e40-b066-54bf8f354de8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:28.648538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6017d374-be41-4e40-b066-54bf8f354de8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:28.649114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6017d374-be41-4e40-b066-54bf8f354de8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:28.650201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6017d374-be41-4e40-b066-54bf8f354de8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:28.650964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6017d374-be41-4e40-b066-54bf8f354de8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:28.651625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6017d374-be41-4e40-b066-54bf8f354de8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:28.674872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:28.696110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b474c32f-1656-4002-a939-df3a5666fca8 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:28.699678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:28.705268 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b474c32f-1656-4002-a939-df3a5666fca8 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1546 microversion: 2.1 time: 0.174543 Oct 05 18:14:28.705835 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2895/6032] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:28 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1546 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:14:28.808433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6017d374-be41-4e40-b066-54bf8f354de8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:28.817662 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6017d374-be41-4e40-b066-54bf8f354de8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.185874 Oct 05 18:14:28.818388 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3138/6033] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:28 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:14:29.632240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-817a2b4d-8278-408e-9ef2-d19fe59270cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:29.633183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-817a2b4d-8278-408e-9ef2-d19fe59270cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:29.640535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-817a2b4d-8278-408e-9ef2-d19fe59270cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:29.641179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-817a2b4d-8278-408e-9ef2-d19fe59270cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:29.641661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-817a2b4d-8278-408e-9ef2-d19fe59270cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:29.642393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-817a2b4d-8278-408e-9ef2-d19fe59270cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:29.642908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-817a2b4d-8278-408e-9ef2-d19fe59270cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:29.643340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-817a2b4d-8278-408e-9ef2-d19fe59270cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:29.841536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5dfd4148-11d7-4898-a455-dd9e87e758f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:29.842155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5dfd4148-11d7-4898-a455-dd9e87e758f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:29.849646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dfd4148-11d7-4898-a455-dd9e87e758f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:29.850150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dfd4148-11d7-4898-a455-dd9e87e758f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:29.850652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dfd4148-11d7-4898-a455-dd9e87e758f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:29.851404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dfd4148-11d7-4898-a455-dd9e87e758f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:29.851874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dfd4148-11d7-4898-a455-dd9e87e758f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:29.852327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5dfd4148-11d7-4898-a455-dd9e87e758f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:29.874155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-817a2b4d-8278-408e-9ef2-d19fe59270cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:29.884528 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-817a2b4d-8278-408e-9ef2-d19fe59270cd tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1265 microversion: 2.1 time: 0.256866 Oct 05 18:14:29.898304 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2896/6034] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:29 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:14:29.991368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5dfd4148-11d7-4898-a455-dd9e87e758f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:29.999938 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5dfd4148-11d7-4898-a455-dd9e87e758f5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.162332 Oct 05 18:14:30.000622 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3139/6035] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:29 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:30.498416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ce12ed1e-ffd3-4561-ad35-562df6d75a9e req-0fca432c-eb05-439a-826e-6cafacb5d7f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a7a677-6544-4b74-9d6d-4be5230f1ddb", "tag": "e98fe020-aead-4814-98bb-1ae047123a6e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:30.509667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ce12ed1e-ffd3-4561-ad35-562df6d75a9e req-0fca432c-eb05-439a-826e-6cafacb5d7f5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:30.510666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ce12ed1e-ffd3-4561-ad35-562df6d75a9e req-0fca432c-eb05-439a-826e-6cafacb5d7f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:30.511324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ce12ed1e-ffd3-4561-ad35-562df6d75a9e req-0fca432c-eb05-439a-826e-6cafacb5d7f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:30.523321 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ce12ed1e-ffd3-4561-ad35-562df6d75a9e req-0fca432c-eb05-439a-826e-6cafacb5d7f5 service nova] Creating event network-changed:e98fe020-aead-4814-98bb-1ae047123a6e for instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb on n-h1-835595-3 Oct 05 18:14:30.529626 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ce12ed1e-ffd3-4561-ad35-562df6d75a9e req-0fca432c-eb05-439a-826e-6cafacb5d7f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034485 Oct 05 18:14:30.530914 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2897/6036] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:30.915995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-67d7db0b-1d58-4db0-94fe-742085fbbef1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:30.917225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-67d7db0b-1d58-4db0-94fe-742085fbbef1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:30.920841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:30.932949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=18 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:30.940449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67d7db0b-1d58-4db0-94fe-742085fbbef1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:30.941288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67d7db0b-1d58-4db0-94fe-742085fbbef1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:30.942874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67d7db0b-1d58-4db0-94fe-742085fbbef1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:30.945219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67d7db0b-1d58-4db0-94fe-742085fbbef1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:30.945946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67d7db0b-1d58-4db0-94fe-742085fbbef1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:30.946601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-67d7db0b-1d58-4db0-94fe-742085fbbef1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:31.026756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9154c55d-24c7-4384-85b1-b4f8464aded7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:31.027482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9154c55d-24c7-4384-85b1-b4f8464aded7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:31.047661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9154c55d-24c7-4384-85b1-b4f8464aded7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:31.048722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9154c55d-24c7-4384-85b1-b4f8464aded7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:31.049326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9154c55d-24c7-4384-85b1-b4f8464aded7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:31.050237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9154c55d-24c7-4384-85b1-b4f8464aded7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:31.050877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9154c55d-24c7-4384-85b1-b4f8464aded7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:31.051492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9154c55d-24c7-4384-85b1-b4f8464aded7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:31.117156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:31.131945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-67d7db0b-1d58-4db0-94fe-742085fbbef1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:31.145386 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-67d7db0b-1d58-4db0-94fe-742085fbbef1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1265 microversion: 2.1 time: 0.235077 Oct 05 18:14:31.147264 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3140/6037] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:30 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:31.245150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9154c55d-24c7-4384-85b1-b4f8464aded7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:31.259473 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9154c55d-24c7-4384-85b1-b4f8464aded7 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.237810 Oct 05 18:14:31.260348 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2898/6038] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:31 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:14:32.169322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-824facdd-700a-4a97-85d8-9aca36b25195 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:32.169889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-824facdd-700a-4a97-85d8-9aca36b25195 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:32.178321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-824facdd-700a-4a97-85d8-9aca36b25195 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:32.178849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-824facdd-700a-4a97-85d8-9aca36b25195 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:32.179474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-824facdd-700a-4a97-85d8-9aca36b25195 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:32.180282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-824facdd-700a-4a97-85d8-9aca36b25195 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:32.180759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-824facdd-700a-4a97-85d8-9aca36b25195 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:32.181187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-824facdd-700a-4a97-85d8-9aca36b25195 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:32.285154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b2cef0bc-f59f-4f10-a5c6-ccf088d0f7f8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:32.285787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b2cef0bc-f59f-4f10-a5c6-ccf088d0f7f8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:32.293828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2cef0bc-f59f-4f10-a5c6-ccf088d0f7f8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:32.294551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2cef0bc-f59f-4f10-a5c6-ccf088d0f7f8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:32.295047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2cef0bc-f59f-4f10-a5c6-ccf088d0f7f8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:32.295825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2cef0bc-f59f-4f10-a5c6-ccf088d0f7f8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:32.296365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2cef0bc-f59f-4f10-a5c6-ccf088d0f7f8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:32.296854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2cef0bc-f59f-4f10-a5c6-ccf088d0f7f8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:32.442101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2cef0bc-f59f-4f10-a5c6-ccf088d0f7f8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:32.450793 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b2cef0bc-f59f-4f10-a5c6-ccf088d0f7f8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.169450 Oct 05 18:14:32.451402 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2899/6039] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:32 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:32.643684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-824facdd-700a-4a97-85d8-9aca36b25195 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:32.651859 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-824facdd-700a-4a97-85d8-9aca36b25195 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1265 microversion: 2.1 time: 0.487065 Oct 05 18:14:32.652450 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3141/6040] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:32 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1265 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:14:33.477993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-24e394b4-9e27-40ea-8501-ebccab403d32 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:33.478610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-24e394b4-9e27-40ea-8501-ebccab403d32 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:33.486014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24e394b4-9e27-40ea-8501-ebccab403d32 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:33.486582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24e394b4-9e27-40ea-8501-ebccab403d32 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:33.487185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24e394b4-9e27-40ea-8501-ebccab403d32 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:33.487665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24e394b4-9e27-40ea-8501-ebccab403d32 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:33.488158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24e394b4-9e27-40ea-8501-ebccab403d32 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:33.489635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-24e394b4-9e27-40ea-8501-ebccab403d32 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:33.621838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-24e394b4-9e27-40ea-8501-ebccab403d32 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:33.630409 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-24e394b4-9e27-40ea-8501-ebccab403d32 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.158343 Oct 05 18:14:33.630999 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2900/6041] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:33 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:33.674916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12661633-1c87-4803-85c9-a34b7daf673c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:33.675553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12661633-1c87-4803-85c9-a34b7daf673c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:33.683608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12661633-1c87-4803-85c9-a34b7daf673c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:33.684108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12661633-1c87-4803-85c9-a34b7daf673c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:33.684585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12661633-1c87-4803-85c9-a34b7daf673c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:33.685283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12661633-1c87-4803-85c9-a34b7daf673c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:33.685759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12661633-1c87-4803-85c9-a34b7daf673c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:33.686202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12661633-1c87-4803-85c9-a34b7daf673c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:33.829332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-12661633-1c87-4803-85c9-a34b7daf673c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:33.840274 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12661633-1c87-4803-85c9-a34b7daf673c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1265 microversion: 2.1 time: 0.169381 Oct 05 18:14:33.840899 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3142/6042] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:33 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:34.655304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-174ffb31-a2ab-4840-a9ca-6acc0cb93ce1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:34.655873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-174ffb31-a2ab-4840-a9ca-6acc0cb93ce1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:34.664728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-174ffb31-a2ab-4840-a9ca-6acc0cb93ce1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:34.665477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-174ffb31-a2ab-4840-a9ca-6acc0cb93ce1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:34.666079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-174ffb31-a2ab-4840-a9ca-6acc0cb93ce1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:34.667075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-174ffb31-a2ab-4840-a9ca-6acc0cb93ce1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:34.667677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-174ffb31-a2ab-4840-a9ca-6acc0cb93ce1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:34.668224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-174ffb31-a2ab-4840-a9ca-6acc0cb93ce1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:34.819817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-174ffb31-a2ab-4840-a9ca-6acc0cb93ce1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:34.829091 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-174ffb31-a2ab-4840-a9ca-6acc0cb93ce1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.178970 Oct 05 18:14:34.829691 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2901/6043] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:34 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:34.867004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43507692-cc8c-49d2-b439-437899af1e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:34.867922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-43507692-cc8c-49d2-b439-437899af1e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:34.879195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43507692-cc8c-49d2-b439-437899af1e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:34.879752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43507692-cc8c-49d2-b439-437899af1e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:34.880457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43507692-cc8c-49d2-b439-437899af1e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:34.881615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43507692-cc8c-49d2-b439-437899af1e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:34.882355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43507692-cc8c-49d2-b439-437899af1e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:34.883026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43507692-cc8c-49d2-b439-437899af1e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:35.022310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-43507692-cc8c-49d2-b439-437899af1e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:35.030765 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-43507692-cc8c-49d2-b439-437899af1e20 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1265 microversion: 2.1 time: 0.170207 Oct 05 18:14:35.031320 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3143/6044] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:34 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:35.852957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fe09b8b6-6d90-4640-8db7-871ab180803f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:35.853613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fe09b8b6-6d90-4640-8db7-871ab180803f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:35.861017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe09b8b6-6d90-4640-8db7-871ab180803f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:35.861509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe09b8b6-6d90-4640-8db7-871ab180803f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:35.861947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe09b8b6-6d90-4640-8db7-871ab180803f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:35.862692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe09b8b6-6d90-4640-8db7-871ab180803f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:35.863148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe09b8b6-6d90-4640-8db7-871ab180803f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:35.863563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe09b8b6-6d90-4640-8db7-871ab180803f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:35.997248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe09b8b6-6d90-4640-8db7-871ab180803f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:36.005793 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fe09b8b6-6d90-4640-8db7-871ab180803f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.156855 Oct 05 18:14:36.006372 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2902/6045] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:35 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:36.053528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a818fce4-d82c-4c57-957c-0dab5dc32086 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:36.054316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a818fce4-d82c-4c57-957c-0dab5dc32086 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:36.061764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a818fce4-d82c-4c57-957c-0dab5dc32086 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:36.062272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a818fce4-d82c-4c57-957c-0dab5dc32086 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:36.062757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a818fce4-d82c-4c57-957c-0dab5dc32086 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:36.063478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a818fce4-d82c-4c57-957c-0dab5dc32086 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:36.063955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a818fce4-d82c-4c57-957c-0dab5dc32086 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:36.064443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a818fce4-d82c-4c57-957c-0dab5dc32086 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:36.207798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a818fce4-d82c-4c57-957c-0dab5dc32086 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:36.216289 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a818fce4-d82c-4c57-957c-0dab5dc32086 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1265 microversion: 2.1 time: 0.166650 Oct 05 18:14:36.216901 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3144/6046] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:36 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:37.029261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-66d40af3-941e-40a2-88f3-5fd01a9cd4ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:37.029848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-66d40af3-941e-40a2-88f3-5fd01a9cd4ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:37.037205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66d40af3-941e-40a2-88f3-5fd01a9cd4ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:37.037700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66d40af3-941e-40a2-88f3-5fd01a9cd4ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:37.038138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66d40af3-941e-40a2-88f3-5fd01a9cd4ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:37.038901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66d40af3-941e-40a2-88f3-5fd01a9cd4ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:37.039361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66d40af3-941e-40a2-88f3-5fd01a9cd4ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:37.039770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66d40af3-941e-40a2-88f3-5fd01a9cd4ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:37.241189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5a74b67-66c8-4c6f-adee-0d043867cf64 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:37.241731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5a74b67-66c8-4c6f-adee-0d043867cf64 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:37.248849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a74b67-66c8-4c6f-adee-0d043867cf64 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:37.249403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a74b67-66c8-4c6f-adee-0d043867cf64 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:37.249829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a74b67-66c8-4c6f-adee-0d043867cf64 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:37.250616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a74b67-66c8-4c6f-adee-0d043867cf64 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:37.251094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a74b67-66c8-4c6f-adee-0d043867cf64 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:37.251534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5a74b67-66c8-4c6f-adee-0d043867cf64 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:37.399221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f5a74b67-66c8-4c6f-adee-0d043867cf64 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:37.407971 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5a74b67-66c8-4c6f-adee-0d043867cf64 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1265 microversion: 2.1 time: 0.172128 Oct 05 18:14:37.408540 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3145/6047] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:37 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:37.529225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66d40af3-941e-40a2-88f3-5fd01a9cd4ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:37.537468 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-66d40af3-941e-40a2-88f3-5fd01a9cd4ea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.512226 Oct 05 18:14:37.538104 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2903/6048] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:37 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:38.279828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-607c2231-1ad3-46f4-8e30-640d488d9f47 req-6f6f231c-faa9-4a1f-a41d-43eebdc49c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149526b1-8830-4166-b3dc-38822df4d07d", "name": "network-vif-plugged", "status": "completed", "tag": "8a89dbba-8fa1-4ae8-b62f-c21e32f7c9c3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:38.291747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-607c2231-1ad3-46f4-8e30-640d488d9f47 req-6f6f231c-faa9-4a1f-a41d-43eebdc49c18 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:38.292264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-607c2231-1ad3-46f4-8e30-640d488d9f47 req-6f6f231c-faa9-4a1f-a41d-43eebdc49c18 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:38.292711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-607c2231-1ad3-46f4-8e30-640d488d9f47 req-6f6f231c-faa9-4a1f-a41d-43eebdc49c18 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:38.304280 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-607c2231-1ad3-46f4-8e30-640d488d9f47 req-6f6f231c-faa9-4a1f-a41d-43eebdc49c18 service nova] Creating event network-vif-plugged:8a89dbba-8fa1-4ae8-b62f-c21e32f7c9c3 for instance 149526b1-8830-4166-b3dc-38822df4d07d on n-h1-835595-3 Oct 05 18:14:38.309538 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-607c2231-1ad3-46f4-8e30-640d488d9f47 req-6f6f231c-faa9-4a1f-a41d-43eebdc49c18 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033679 Oct 05 18:14:38.310316 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3146/6049] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:38.430709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa15beb5-15f3-4f36-8148-4a064b37e6ed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:38.431438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa15beb5-15f3-4f36-8148-4a064b37e6ed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:38.438734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa15beb5-15f3-4f36-8148-4a064b37e6ed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:38.439323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa15beb5-15f3-4f36-8148-4a064b37e6ed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:38.439824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa15beb5-15f3-4f36-8148-4a064b37e6ed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:38.440589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa15beb5-15f3-4f36-8148-4a064b37e6ed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:38.441112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa15beb5-15f3-4f36-8148-4a064b37e6ed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:38.441628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa15beb5-15f3-4f36-8148-4a064b37e6ed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:38.562024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1bd51793-28d5-4099-9d41-2f2aaf971366 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:38.562774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1bd51793-28d5-4099-9d41-2f2aaf971366 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:38.569545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bd51793-28d5-4099-9d41-2f2aaf971366 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:38.570052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bd51793-28d5-4099-9d41-2f2aaf971366 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:38.570545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bd51793-28d5-4099-9d41-2f2aaf971366 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:38.571254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bd51793-28d5-4099-9d41-2f2aaf971366 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:38.571728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bd51793-28d5-4099-9d41-2f2aaf971366 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:38.572172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1bd51793-28d5-4099-9d41-2f2aaf971366 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:38.576686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa15beb5-15f3-4f36-8148-4a064b37e6ed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:38.584809 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa15beb5-15f3-4f36-8148-4a064b37e6ed tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1265 microversion: 2.1 time: 0.157923 Oct 05 18:14:38.585400 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2904/6050] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:38 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:38.718309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1bd51793-28d5-4099-9d41-2f2aaf971366 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:38.726601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1bd51793-28d5-4099-9d41-2f2aaf971366 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.169148 Oct 05 18:14:38.727200 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3147/6051] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:38 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:39.611639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d7004f42-1217-4c6b-8147-d084162b9d7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:39.612317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d7004f42-1217-4c6b-8147-d084162b9d7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:39.621322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7004f42-1217-4c6b-8147-d084162b9d7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:39.621869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7004f42-1217-4c6b-8147-d084162b9d7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:39.622305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7004f42-1217-4c6b-8147-d084162b9d7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:39.623053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7004f42-1217-4c6b-8147-d084162b9d7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:39.623489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7004f42-1217-4c6b-8147-d084162b9d7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:39.623918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7004f42-1217-4c6b-8147-d084162b9d7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:39.749489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f348e8e-0736-491b-9555-f1b3100f8452 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:39.750313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2f348e8e-0736-491b-9555-f1b3100f8452 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:39.758118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f348e8e-0736-491b-9555-f1b3100f8452 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:39.758665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f348e8e-0736-491b-9555-f1b3100f8452 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:39.759115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f348e8e-0736-491b-9555-f1b3100f8452 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:39.759816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f348e8e-0736-491b-9555-f1b3100f8452 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:39.760285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f348e8e-0736-491b-9555-f1b3100f8452 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:39.760721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f348e8e-0736-491b-9555-f1b3100f8452 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:39.764603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d7004f42-1217-4c6b-8147-d084162b9d7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:39.772676 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d7004f42-1217-4c6b-8147-d084162b9d7a tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1451 microversion: 2.1 time: 0.167158 Oct 05 18:14:39.773359 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2905/6052] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:39 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:39.795529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f12bd266-9719-41ca-bf6c-f80c680b1fe3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:39.796239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f12bd266-9719-41ca-bf6c-f80c680b1fe3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:39.802862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f12bd266-9719-41ca-bf6c-f80c680b1fe3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:39.803580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f12bd266-9719-41ca-bf6c-f80c680b1fe3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:39.804028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f12bd266-9719-41ca-bf6c-f80c680b1fe3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:39.804749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f12bd266-9719-41ca-bf6c-f80c680b1fe3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:39.805208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f12bd266-9719-41ca-bf6c-f80c680b1fe3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:39.805636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f12bd266-9719-41ca-bf6c-f80c680b1fe3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:39.903771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f348e8e-0736-491b-9555-f1b3100f8452 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:39.915392 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f348e8e-0736-491b-9555-f1b3100f8452 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.169745 Oct 05 18:14:39.916461 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3148/6053] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:39 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:39.951981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f12bd266-9719-41ca-bf6c-f80c680b1fe3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:39.962075 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f12bd266-9719-41ca-bf6c-f80c680b1fe3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1451 microversion: 2.1 time: 0.170323 Oct 05 18:14:39.962937 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2906/6054] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:39 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:40.940744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0d821cfd-3ef1-4ea5-afc3-3a1c928ba3b5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:40.941346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0d821cfd-3ef1-4ea5-afc3-3a1c928ba3b5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:40.948783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d821cfd-3ef1-4ea5-afc3-3a1c928ba3b5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:40.949776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d821cfd-3ef1-4ea5-afc3-3a1c928ba3b5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:40.950231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d821cfd-3ef1-4ea5-afc3-3a1c928ba3b5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:40.951023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d821cfd-3ef1-4ea5-afc3-3a1c928ba3b5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:40.951501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d821cfd-3ef1-4ea5-afc3-3a1c928ba3b5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:40.951945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d821cfd-3ef1-4ea5-afc3-3a1c928ba3b5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:41.160745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0d821cfd-3ef1-4ea5-afc3-3a1c928ba3b5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:41.170420 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0d821cfd-3ef1-4ea5-afc3-3a1c928ba3b5 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.234068 Oct 05 18:14:41.171017 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3149/6055] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:40 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:41.756369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-64aa3f2d-e0f0-4130-853b-1d583399bb0c req-1aefe9b2-90c9-4a01-9872-cf20743381d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149526b1-8830-4166-b3dc-38822df4d07d", "tag": "8a89dbba-8fa1-4ae8-b62f-c21e32f7c9c3"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:41.767150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-64aa3f2d-e0f0-4130-853b-1d583399bb0c req-1aefe9b2-90c9-4a01-9872-cf20743381d1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:41.767700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-64aa3f2d-e0f0-4130-853b-1d583399bb0c req-1aefe9b2-90c9-4a01-9872-cf20743381d1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:41.768228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-64aa3f2d-e0f0-4130-853b-1d583399bb0c req-1aefe9b2-90c9-4a01-9872-cf20743381d1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:41.780202 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-64aa3f2d-e0f0-4130-853b-1d583399bb0c req-1aefe9b2-90c9-4a01-9872-cf20743381d1 service nova] Creating event network-changed:8a89dbba-8fa1-4ae8-b62f-c21e32f7c9c3 for instance 149526b1-8830-4166-b3dc-38822df4d07d on n-h1-835595-3 Oct 05 18:14:41.785306 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-64aa3f2d-e0f0-4130-853b-1d583399bb0c req-1aefe9b2-90c9-4a01-9872-cf20743381d1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033147 Oct 05 18:14:41.785943 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2907/6056] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:42.193405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21ee30df-559d-48ee-9ea0-a12dd381b538 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:42.194080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21ee30df-559d-48ee-9ea0-a12dd381b538 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:42.201872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ee30df-559d-48ee-9ea0-a12dd381b538 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:42.202622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ee30df-559d-48ee-9ea0-a12dd381b538 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:42.203305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ee30df-559d-48ee-9ea0-a12dd381b538 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:42.204030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ee30df-559d-48ee-9ea0-a12dd381b538 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:42.204666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ee30df-559d-48ee-9ea0-a12dd381b538 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:42.205271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ee30df-559d-48ee-9ea0-a12dd381b538 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:42.344131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21ee30df-559d-48ee-9ea0-a12dd381b538 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:42.352929 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21ee30df-559d-48ee-9ea0-a12dd381b538 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.163587 Oct 05 18:14:42.353548 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3150/6057] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:42 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:43.383101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-86d9a47e-2f6d-43fb-8508-774c0ee14cc6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:43.383753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-86d9a47e-2f6d-43fb-8508-774c0ee14cc6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:43.394147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86d9a47e-2f6d-43fb-8508-774c0ee14cc6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:43.394935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86d9a47e-2f6d-43fb-8508-774c0ee14cc6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:43.395585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86d9a47e-2f6d-43fb-8508-774c0ee14cc6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:43.396671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86d9a47e-2f6d-43fb-8508-774c0ee14cc6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:43.397320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86d9a47e-2f6d-43fb-8508-774c0ee14cc6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:43.397911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86d9a47e-2f6d-43fb-8508-774c0ee14cc6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:43.537399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86d9a47e-2f6d-43fb-8508-774c0ee14cc6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:43.548933 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-86d9a47e-2f6d-43fb-8508-774c0ee14cc6 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.174784 Oct 05 18:14:43.549757 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2908/6058] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:43 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:44.580043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a03813f-d7e4-457a-8ce1-3966423e35c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:44.581052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3a03813f-d7e4-457a-8ce1-3966423e35c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:44.592980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a03813f-d7e4-457a-8ce1-3966423e35c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:44.593695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a03813f-d7e4-457a-8ce1-3966423e35c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:44.594507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a03813f-d7e4-457a-8ce1-3966423e35c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:44.595730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a03813f-d7e4-457a-8ce1-3966423e35c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:44.596517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a03813f-d7e4-457a-8ce1-3966423e35c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:44.597269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a03813f-d7e4-457a-8ce1-3966423e35c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:44.758436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3a03813f-d7e4-457a-8ce1-3966423e35c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:44.766710 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a03813f-d7e4-457a-8ce1-3966423e35c8 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1510 microversion: 2.1 time: 0.193564 Oct 05 18:14:44.767315 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3151/6059] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:44 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:45.793550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-982a1cf0-6e17-41b8-8031-3570b83425fa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:45.794561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-982a1cf0-6e17-41b8-8031-3570b83425fa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:45.806178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-982a1cf0-6e17-41b8-8031-3570b83425fa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:45.807040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-982a1cf0-6e17-41b8-8031-3570b83425fa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:45.807759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-982a1cf0-6e17-41b8-8031-3570b83425fa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:45.808943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-982a1cf0-6e17-41b8-8031-3570b83425fa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:45.809399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-982a1cf0-6e17-41b8-8031-3570b83425fa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:45.809828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-982a1cf0-6e17-41b8-8031-3570b83425fa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:45.959534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-982a1cf0-6e17-41b8-8031-3570b83425fa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:45.967967 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-982a1cf0-6e17-41b8-8031-3570b83425fa tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1487 microversion: 2.1 time: 0.181234 Oct 05 18:14:45.968905 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2909/6060] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:45 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1487 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:45.991149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-31491d84-0fbf-4904-98e8-262b31b82f74 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-586531668"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:45.993709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-31491d84-0fbf-4904-98e8-262b31b82f74 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:46.000977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31491d84-0fbf-4904-98e8-262b31b82f74 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:46.001504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31491d84-0fbf-4904-98e8-262b31b82f74 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:46.001948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31491d84-0fbf-4904-98e8-262b31b82f74 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:46.002680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31491d84-0fbf-4904-98e8-262b31b82f74 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:46.003150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31491d84-0fbf-4904-98e8-262b31b82f74 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:46.003581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31491d84-0fbf-4904-98e8-262b31b82f74 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:46.078253 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-31491d84-0fbf-4904-98e8-262b31b82f74 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "PUT /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1059 microversion: 2.1 time: 0.090929 Oct 05 18:14:46.078868 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3152/6061] 10.222.0.70 () {60 vars in 1256 bytes} [Wed Oct 5 18:14:45 2022] PUT /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1059 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:46.097377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2d231ff0-31e8-408c-b2f6-3d3584ef79ab tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:46.097982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2d231ff0-31e8-408c-b2f6-3d3584ef79ab tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:46.104219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d231ff0-31e8-408c-b2f6-3d3584ef79ab tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:46.104696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d231ff0-31e8-408c-b2f6-3d3584ef79ab tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:46.105129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d231ff0-31e8-408c-b2f6-3d3584ef79ab tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:46.105887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d231ff0-31e8-408c-b2f6-3d3584ef79ab tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:46.106361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d231ff0-31e8-408c-b2f6-3d3584ef79ab tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:46.106780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d231ff0-31e8-408c-b2f6-3d3584ef79ab tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:46.238017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2d231ff0-31e8-408c-b2f6-3d3584ef79ab tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:46.248858 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2d231ff0-31e8-408c-b2f6-3d3584ef79ab tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1486 microversion: 2.1 time: 0.155412 Oct 05 18:14:46.249450 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2910/6062] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:46 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1486 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:14:46.271762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-854244e7-0fdf-4d38-9ded-628f01175680 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:46.272388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-854244e7-0fdf-4d38-9ded-628f01175680 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:46.279067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-854244e7-0fdf-4d38-9ded-628f01175680 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:46.279574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-854244e7-0fdf-4d38-9ded-628f01175680 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:46.280064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-854244e7-0fdf-4d38-9ded-628f01175680 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:46.280775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-854244e7-0fdf-4d38-9ded-628f01175680 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:46.281242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-854244e7-0fdf-4d38-9ded-628f01175680 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:46.281683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-854244e7-0fdf-4d38-9ded-628f01175680 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:46.420849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-854244e7-0fdf-4d38-9ded-628f01175680 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:46.429110 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-854244e7-0fdf-4d38-9ded-628f01175680 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1486 microversion: 2.1 time: 0.161362 Oct 05 18:14:46.429694 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3153/6063] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:46 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1486 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:46.451663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a34ed4b-dc67-4693-a4ef-becd191659db tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:46.452164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a34ed4b-dc67-4693-a4ef-becd191659db tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:46.458256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a34ed4b-dc67-4693-a4ef-becd191659db tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:46.458771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a34ed4b-dc67-4693-a4ef-becd191659db tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:46.459201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a34ed4b-dc67-4693-a4ef-becd191659db tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:46.459881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a34ed4b-dc67-4693-a4ef-becd191659db tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:46.460327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a34ed4b-dc67-4693-a4ef-becd191659db tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:46.460746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3a34ed4b-dc67-4693-a4ef-becd191659db tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:46.488062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a34ed4b-dc67-4693-a4ef-becd191659db tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:14:46.583580 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a34ed4b-dc67-4693-a4ef-becd191659db tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 204 len: 0 microversion: 2.1 time: 0.135212 Oct 05 18:14:46.584370 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2911/6064] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:14:46 2022] DELETE /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:14:46.594577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e28dfebe-7d44-4551-8b85-f2cf695bb3fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:46.595211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e28dfebe-7d44-4551-8b85-f2cf695bb3fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:46.601471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28dfebe-7d44-4551-8b85-f2cf695bb3fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:46.601982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28dfebe-7d44-4551-8b85-f2cf695bb3fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:46.602493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28dfebe-7d44-4551-8b85-f2cf695bb3fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:46.603198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28dfebe-7d44-4551-8b85-f2cf695bb3fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:46.603685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28dfebe-7d44-4551-8b85-f2cf695bb3fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:46.604132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e28dfebe-7d44-4551-8b85-f2cf695bb3fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:46.752108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e28dfebe-7d44-4551-8b85-f2cf695bb3fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:46.764286 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e28dfebe-7d44-4551-8b85-f2cf695bb3fd tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1492 microversion: 2.1 time: 0.173870 Oct 05 18:14:46.764888 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3154/6065] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:46 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1492 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:47.788112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-13da61cd-9cf7-4bf5-ba8b-cb6e57ca73d4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:47.788826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-13da61cd-9cf7-4bf5-ba8b-cb6e57ca73d4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:47.796485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13da61cd-9cf7-4bf5-ba8b-cb6e57ca73d4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:47.796976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13da61cd-9cf7-4bf5-ba8b-cb6e57ca73d4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:47.797411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13da61cd-9cf7-4bf5-ba8b-cb6e57ca73d4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:47.798128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13da61cd-9cf7-4bf5-ba8b-cb6e57ca73d4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:47.798617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13da61cd-9cf7-4bf5-ba8b-cb6e57ca73d4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:47.799041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13da61cd-9cf7-4bf5-ba8b-cb6e57ca73d4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:47.803333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:47.934950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-13da61cd-9cf7-4bf5-ba8b-cb6e57ca73d4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:47.942902 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-13da61cd-9cf7-4bf5-ba8b-cb6e57ca73d4 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 200 len: 1492 microversion: 2.1 time: 0.159186 Oct 05 18:14:47.943497 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2912/6066] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:47 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 1492 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:48.288438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6b0cda79-fa17-40c1-8fbf-9cc546059e29 req-589a3c75-7dfb-4ea6-9a9a-13d27e7bd950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62693fd4-02a4-4b04-a9fe-6de50b5b1014", "name": "network-vif-deleted", "tag": "68b84380-c9bd-462c-a66d-13a488192c41"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:48.315725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6b0cda79-fa17-40c1-8fbf-9cc546059e29 req-589a3c75-7dfb-4ea6-9a9a-13d27e7bd950 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:48.316821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6b0cda79-fa17-40c1-8fbf-9cc546059e29 req-589a3c75-7dfb-4ea6-9a9a-13d27e7bd950 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:48.317549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6b0cda79-fa17-40c1-8fbf-9cc546059e29 req-589a3c75-7dfb-4ea6-9a9a-13d27e7bd950 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:48.323011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:48.334406 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6b0cda79-fa17-40c1-8fbf-9cc546059e29 req-589a3c75-7dfb-4ea6-9a9a-13d27e7bd950 service nova] Creating event network-vif-deleted:68b84380-c9bd-462c-a66d-13a488192c41 for instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 on n-h2-835595-3 Oct 05 18:14:48.341356 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6b0cda79-fa17-40c1-8fbf-9cc546059e29 req-589a3c75-7dfb-4ea6-9a9a-13d27e7bd950 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057064 Oct 05 18:14:48.342994 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3155/6067] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:48.967423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:48.967975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:48.970779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:14:48.976301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:48.976770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:48.977208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:48.977901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:48.978388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:48.978820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:48.993489 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 HTTP/1.1 Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '62693fd4-02a4-4b04-a9fe-6de50b5b1014'} Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:48.995122 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:48.999896 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:48.999896 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:48.999896 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:48.999896 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:48.999896 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:48.999896 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:48.999896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:48.999896 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0b77befb-d74f-48cc-9634-4904ea6fdbc2 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 404 len: 111 microversion: 2.1 time: 0.033143 Oct 05 18:14:48.999896 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2913/6068] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:48 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.010940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.011547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.018534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.019038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.019497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.020201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.020677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.021120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.034976 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 HTTP/1.1 Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '62693fd4-02a4-4b04-a9fe-6de50b5b1014'} Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.036653 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c9404c8-7f5e-4f72-8998-dcd02b2656ce tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 404 len: 111 microversion: 2.1 time: 0.031651 Oct 05 18:14:49.041635 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3156/6069] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:14:49 2022] DELETE /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.046802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.047413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 62693fd4-02a4-4b04-a9fe-6de50b5b1014] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.053748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.054243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.054721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.055423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.055884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.056312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.070312 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 HTTP/1.1 Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '62693fd4-02a4-4b04-a9fe-6de50b5b1014'} Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.071895 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.077240 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.077240 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.077240 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.077240 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.077240 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. Oct 05 18:14:49.077240 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.077240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 62693fd4-02a4-4b04-a9fe-6de50b5b1014 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.077240 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ad5308b5-0356-43ce-9f84-25b931382e0f tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014" status: 404 len: 111 microversion: 2.1 time: 0.030504 Oct 05 18:14:49.077240 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2914/6070] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:49 2022] GET /compute/v2.1/servers/62693fd4-02a4-4b04-a9fe-6de50b5b1014 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.082080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.082632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.089102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.089608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.090064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.090821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.091295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.091717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.105591 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 HTTP/1.1 Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '20dd6bae-b54a-4b2a-ad75-6b2ce70ed109'} Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.107199 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-74ed8d64-7842-4dba-a8d1-9d0425ca0f6a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 404 len: 111 microversion: 2.1 time: 0.030681 Oct 05 18:14:49.112128 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3157/6071] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:14:49 2022] DELETE /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:14:49.118316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.118970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.125326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.125814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.126247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.126980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.127436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.127858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.142177 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 HTTP/1.1 Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '20dd6bae-b54a-4b2a-ad75-6b2ce70ed109'} Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.143731 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.148868 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.148868 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.148868 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.148868 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.148868 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. Oct 05 18:14:49.148868 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.148868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.148868 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9361cd25-995b-4d93-a621-6951f0ff8b0c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109" status: 404 len: 111 microversion: 2.1 time: 0.030664 Oct 05 18:14:49.148868 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2915/6072] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:49 2022] GET /compute/v2.1/servers/20dd6bae-b54a-4b2a-ad75-6b2ce70ed109 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.153824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.154376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.160575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.161080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.161539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.162249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.162757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.163200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.177253 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db HTTP/1.1 Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '814a5d79-472f-430a-baec-ef2eb87647db'} Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.178866 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-295d983d-fdb6-4d82-a3c1-0d750bcb693a tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 404 len: 111 microversion: 2.1 time: 0.030590 Oct 05 18:14:49.183437 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3158/6073] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:14:49 2022] DELETE /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.188936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.189561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 814a5d79-472f-430a-baec-ef2eb87647db] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.195714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.196198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.196637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.197325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.197788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.198213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.211935 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db HTTP/1.1 Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '814a5d79-472f-430a-baec-ef2eb87647db'} Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.213448 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.218686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.218686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.218686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.218686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.218686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. Oct 05 18:14:49.218686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.218686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 814a5d79-472f-430a-baec-ef2eb87647db could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.218686 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76b94b27-2160-449b-a3fd-35e195fd54c3 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db" status: 404 len: 111 microversion: 2.1 time: 0.029893 Oct 05 18:14:49.218686 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2916/6074] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:49 2022] GET /compute/v2.1/servers/814a5d79-472f-430a-baec-ef2eb87647db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.223607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.224124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.230374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.230879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.231333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.232031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.232493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.232931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.246906 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a HTTP/1.1 Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'c7e15b02-96f0-4c39-8e38-e7163ba0f80a'} Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.248408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ada57a7-b31f-425d-a1a8-ec63e3d1aabf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 404 len: 111 microversion: 2.1 time: 0.030141 Oct 05 18:14:49.252937 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3159/6075] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:14:49 2022] DELETE /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.261593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.262800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: c7e15b02-96f0-4c39-8e38-e7163ba0f80a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.272793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.273622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.274360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.275485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.276245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.276948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.291058 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a HTTP/1.1 Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'c7e15b02-96f0-4c39-8e38-e7163ba0f80a'} Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.292587 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.297533 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.297533 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.297533 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.297533 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.297533 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. Oct 05 18:14:49.297533 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.297533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance c7e15b02-96f0-4c39-8e38-e7163ba0f80a could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.297533 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5f5bd1a1-38ac-40b8-a58d-8e8f15ab088e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a" status: 404 len: 111 microversion: 2.1 time: 0.038559 Oct 05 18:14:49.297533 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2917/6076] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:49 2022] GET /compute/v2.1/servers/c7e15b02-96f0-4c39-8e38-e7163ba0f80a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.302725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.303233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.310324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.310819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.311267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.311962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.312432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.312869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.326608 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e HTTP/1.1 Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '025974d3-56f3-4351-9e21-8a862eeab80e'} Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.328158 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c947c6ec-d61d-47ec-bf4a-aafcb095a23c tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 404 len: 111 microversion: 2.1 time: 0.030865 Oct 05 18:14:49.333189 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3160/6077] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:14:49 2022] DELETE /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.338089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.338764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 025974d3-56f3-4351-9e21-8a862eeab80e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.345093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.345604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.346037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.346756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.347210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.347637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.363296 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e HTTP/1.1 Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '025974d3-56f3-4351-9e21-8a862eeab80e'} Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.364801 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.369912 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.369912 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.369912 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.369912 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.369912 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. Oct 05 18:14:49.369912 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.369912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 025974d3-56f3-4351-9e21-8a862eeab80e could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.369912 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4994b3fd-4e74-4f64-84d7-c4caf51f68cc tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e" status: 404 len: 111 microversion: 2.1 time: 0.032100 Oct 05 18:14:49.369912 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2918/6078] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:49 2022] GET /compute/v2.1/servers/025974d3-56f3-4351-9e21-8a862eeab80e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.375800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.376349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.382963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.383468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.383927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.384670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.385152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.385616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.399293 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 HTTP/1.1 Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'a482f1d2-7493-4e31-af1f-601ddb071cd0'} Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.400887 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-00c2ccb0-9200-457d-802d-70328595faaf tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 404 len: 111 microversion: 2.1 time: 0.031271 Oct 05 18:14:49.406010 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3161/6079] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:14:49 2022] DELETE /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.410859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.411481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: a482f1d2-7493-4e31-af1f-601ddb071cd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.417635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.418123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.418586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.419273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.419727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.420124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.434041 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 HTTP/1.1 Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a482f1d2-7493-4e31-af1f-601ddb071cd0'} Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.435608 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.440098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.440098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.440098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.440098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.440098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. Oct 05 18:14:49.440098 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.440098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance a482f1d2-7493-4e31-af1f-601ddb071cd0 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.440098 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f8cf9deb-19a8-40f6-b5e2-01314b39fbea tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0" status: 404 len: 111 microversion: 2.1 time: 0.030102 Oct 05 18:14:49.440098 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2919/6080] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:49 2022] GET /compute/v2.1/servers/a482f1d2-7493-4e31-af1f-601ddb071cd0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:14:49.445795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5743e658-b995-42f1-8b04-cff9ced99377 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.446315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5743e658-b995-42f1-8b04-cff9ced99377 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: eb5f7fa2-f980-4a18-bb5b-cf819360e615] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.452089 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5743e658-b995-42f1-8b04-cff9ced99377 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5743e658-b995-42f1-8b04-cff9ced99377 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615 HTTP/1.1 Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'eb5f7fa2-f980-4a18-bb5b-cf819360e615'} Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.453605 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.458969 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.458969 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.458969 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.458969 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.458969 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.458969 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:14:49.458969 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.458969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5743e658-b995-42f1-8b04-cff9ced99377 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.458969 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5743e658-b995-42f1-8b04-cff9ced99377 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615" status: 404 len: 111 microversion: 2.1 time: 0.013320 Oct 05 18:14:49.458969 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3162/6081] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:14:49 2022] DELETE /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.463685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f993f74f-8580-4cf7-82be-c506ee21b138 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.464300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f993f74f-8580-4cf7-82be-c506ee21b138 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: eb5f7fa2-f980-4a18-bb5b-cf819360e615] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.469974 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-f993f74f-8580-4cf7-82be-c506ee21b138 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f993f74f-8580-4cf7-82be-c506ee21b138 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615 HTTP/1.1 Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'eb5f7fa2-f980-4a18-bb5b-cf819360e615'} Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:49.471486 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:49.476656 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:49.476656 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:49.476656 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. Oct 05 18:14:49.476656 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:14:49.476656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f993f74f-8580-4cf7-82be-c506ee21b138 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance eb5f7fa2-f980-4a18-bb5b-cf819360e615 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:49.476656 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f993f74f-8580-4cf7-82be-c506ee21b138 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615" status: 404 len: 111 microversion: 2.1 time: 0.013132 Oct 05 18:14:49.476656 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2920/6082] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:49 2022] GET /compute/v2.1/servers/eb5f7fa2-f980-4a18-bb5b-cf819360e615 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:14:49.480948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-68a03ef0-2871-4cab-883a-69948f178be1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.481461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-68a03ef0-2871-4cab-883a-69948f178be1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.489824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a03ef0-2871-4cab-883a-69948f178be1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.490322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a03ef0-2871-4cab-883a-69948f178be1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.490812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a03ef0-2871-4cab-883a-69948f178be1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.491519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a03ef0-2871-4cab-883a-69948f178be1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.491992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a03ef0-2871-4cab-883a-69948f178be1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.492430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68a03ef0-2871-4cab-883a-69948f178be1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.517886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-68a03ef0-2871-4cab-883a-69948f178be1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:14:49.599277 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-68a03ef0-2871-4cab-883a-69948f178be1 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 204 len: 0 microversion: 2.1 time: 0.121777 Oct 05 18:14:49.599865 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3163/6083] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:14:49 2022] DELETE /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:14:49.609098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0e1071c9-a3b4-4fe3-8fd3-d9544df3627e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:49.609714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0e1071c9-a3b4-4fe3-8fd3-d9544df3627e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:49.617654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1071c9-a3b4-4fe3-8fd3-d9544df3627e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.618162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1071c9-a3b4-4fe3-8fd3-d9544df3627e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.618635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1071c9-a3b4-4fe3-8fd3-d9544df3627e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.619332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1071c9-a3b4-4fe3-8fd3-d9544df3627e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:49.619788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1071c9-a3b4-4fe3-8fd3-d9544df3627e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:49.620216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0e1071c9-a3b4-4fe3-8fd3-d9544df3627e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:49.764667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0e1071c9-a3b4-4fe3-8fd3-d9544df3627e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:49.773029 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0e1071c9-a3b4-4fe3-8fd3-d9544df3627e tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1478 microversion: 2.1 time: 0.168242 Oct 05 18:14:49.773540 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2921/6084] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:49 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1478 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:50.797409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d8e3fa6-ccfd-43ee-b61b-985df48fcc22 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:50.798246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d8e3fa6-ccfd-43ee-b61b-985df48fcc22 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:50.805874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d8e3fa6-ccfd-43ee-b61b-985df48fcc22 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:50.806414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d8e3fa6-ccfd-43ee-b61b-985df48fcc22 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:50.806912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d8e3fa6-ccfd-43ee-b61b-985df48fcc22 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:50.807703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d8e3fa6-ccfd-43ee-b61b-985df48fcc22 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:50.808277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d8e3fa6-ccfd-43ee-b61b-985df48fcc22 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:50.808849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d8e3fa6-ccfd-43ee-b61b-985df48fcc22 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:50.969353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d8e3fa6-ccfd-43ee-b61b-985df48fcc22 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c698ccb66ac443582a7e610591c6da6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f060cbf98644e5bdca0cc9ccea14a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:14:50.977620 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d8e3fa6-ccfd-43ee-b61b-985df48fcc22 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 200 len: 1478 microversion: 2.1 time: 0.185009 Oct 05 18:14:50.978222 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3164/6085] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:50 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 1478 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:14:51.454859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-90a3daef-754d-4691-a82f-b1b6458d2dfe req-50602ffc-48ee-4b82-ad2e-c5dbc3d2d2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f17b214-94c6-4ffa-b7f7-f456a8c89048", "name": "network-vif-deleted", "tag": "ca944041-0e6f-4653-b464-a0e94de0a4ec"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:51.466467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-90a3daef-754d-4691-a82f-b1b6458d2dfe req-50602ffc-48ee-4b82-ad2e-c5dbc3d2d2e8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:51.467249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-90a3daef-754d-4691-a82f-b1b6458d2dfe req-50602ffc-48ee-4b82-ad2e-c5dbc3d2d2e8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:51.467701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-90a3daef-754d-4691-a82f-b1b6458d2dfe req-50602ffc-48ee-4b82-ad2e-c5dbc3d2d2e8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:51.482224 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-90a3daef-754d-4691-a82f-b1b6458d2dfe req-50602ffc-48ee-4b82-ad2e-c5dbc3d2d2e8 service nova] Creating event network-vif-deleted:ca944041-0e6f-4653-b464-a0e94de0a4ec for instance 9f17b214-94c6-4ffa-b7f7-f456a8c89048 on n-h2-835595-3 Oct 05 18:14:51.487514 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-90a3daef-754d-4691-a82f-b1b6458d2dfe req-50602ffc-48ee-4b82-ad2e-c5dbc3d2d2e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036605 Oct 05 18:14:51.488175 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2922/6086] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:14:52.001256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:14:52.001817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] [instance: 9f17b214-94c6-4ffa-b7f7-f456a8c89048] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:52.009160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:52.009661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:52.010112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:52.010883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:52.011356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:52.011934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:52.025525 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] HTTP exception thrown: Instance 9f17b214-94c6-4ffa-b7f7-f456a8c89048 could not be found. Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Request method failure captured: Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 HTTP/1.1 Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPckRd4KZ0kKEP0F39gHpoCUhJk_7bn4m6wmS0f2gXJCJlVC-RRnJ7cy-IsUSJSdKlzuBslh85hgquqjf-zvRQP4xn4Dgdhf01D-1R4eJt7r0OLyn0Yd_ZzfNmEYK6KJIPunpaQUKCWbIEU2JjPbDtnC-mHuPOZxtij2LqVj2ND6or7M Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f7f060cbf98644e5bdca0cc9ccea14a9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f7f060cbf98644e5bdca0cc9ccea14a9"}]}] Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersTestJSON-861739930 Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f7f060cbf98644e5bdca0cc9ccea14a9 Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersTestJSON-861739930 Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersTestJSON-861739930-project Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0c698ccb66ac443582a7e610591c6da6 Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersTestJSON-861739930-project Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 9f17b214-94c6-4ffa-b7f7-f456a8c89048 could not be found. Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '9f17b214-94c6-4ffa-b7f7-f456a8c89048'} Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f17b214-94c6-4ffa-b7f7-f456a8c89048 could not be found. Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f17b214-94c6-4ffa-b7f7-f456a8c89048 could not be found. Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:52.027215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:14:52.032375 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:14:52.032375 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:14:52.032375 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:14:52.032375 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:14:52.032375 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f17b214-94c6-4ffa-b7f7-f456a8c89048 could not be found. Oct 05 18:14:52.032375 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:14:52.032375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] Returning 404 to user: Instance 9f17b214-94c6-4ffa-b7f7-f456a8c89048 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:14:52.032375 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92baa8a3-ac0f-4783-b44a-ae9037308f41 tempest-ServersTestJSON-861739930 tempest-ServersTestJSON-861739930-project] 10.222.0.70 "GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048" status: 404 len: 111 microversion: 2.1 time: 0.031645 Oct 05 18:14:52.032375 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3165/6087] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:14:51 2022] GET /compute/v2.1/servers/9f17b214-94c6-4ffa-b7f7-f456a8c89048 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:14:52.817270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e3c1afd1-1de3-46d5-a5a6-dfe188e975cb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:14:52.819832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e3c1afd1-1de3-46d5-a5a6-dfe188e975cb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:14:52.827681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3c1afd1-1de3-46d5-a5a6-dfe188e975cb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:52.828203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3c1afd1-1de3-46d5-a5a6-dfe188e975cb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:52.828642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3c1afd1-1de3-46d5-a5a6-dfe188e975cb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:52.829379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3c1afd1-1de3-46d5-a5a6-dfe188e975cb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:14:52.829822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3c1afd1-1de3-46d5-a5a6-dfe188e975cb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:14:52.830255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e3c1afd1-1de3-46d5-a5a6-dfe188e975cb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:14:52.885365 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e3c1afd1-1de3-46d5-a5a6-dfe188e975cb tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "POST /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb/action" status: 200 len: 24570 microversion: 2.1 time: 0.072773 Oct 05 18:14:52.886012 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2923/6088] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:14:52 2022] POST /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb/action => generated 24570 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:15:00.774542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1140401119", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:00.785046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:00.834825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] validate_networks() for [('12c0da33-b818-4d50-917d-991504341856', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:15:01.247286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:15:01.247705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:15:01.248215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:15:01.248637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:15:01.249064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:15:01.260699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:01.261404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:01.262093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:01.263249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:01.263912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:01.264437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:01.284039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Getting quotas for project f34e890dde99482b9e72343765245cc6. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:15:01.289813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Getting quotas for user 05a1488f79c44744b8ab28db3b54fb54 and project f34e890dde99482b9e72343765245cc6. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:15:01.306108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:15:01.308750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:15:01.356333 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-371c4fbf-3286-49b1-bc53-0c2dc6b7557f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732006 Oct 05 18:15:01.363376 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3166/6089] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:15:01.370319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-13ee6b97-33ab-4bb3-8f40-6a175fd105e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:01.371098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-13ee6b97-33ab-4bb3-8f40-6a175fd105e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:01.433616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-13ee6b97-33ab-4bb3-8f40-6a175fd105e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:01.441945 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-13ee6b97-33ab-4bb3-8f40-6a175fd105e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1217 microversion: 2.1 time: 0.076851 Oct 05 18:15:01.442964 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2924/6090] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:01 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:02.466793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-946c4ded-7e91-453a-8125-267f87b4c9cc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:02.468157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-946c4ded-7e91-453a-8125-267f87b4c9cc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:02.475849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-946c4ded-7e91-453a-8125-267f87b4c9cc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:02.476756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-946c4ded-7e91-453a-8125-267f87b4c9cc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:02.477432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-946c4ded-7e91-453a-8125-267f87b4c9cc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:02.478597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-946c4ded-7e91-453a-8125-267f87b4c9cc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:02.479299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-946c4ded-7e91-453a-8125-267f87b4c9cc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:02.479932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-946c4ded-7e91-453a-8125-267f87b4c9cc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:02.660780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-946c4ded-7e91-453a-8125-267f87b4c9cc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:02.670537 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-946c4ded-7e91-453a-8125-267f87b4c9cc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1277 microversion: 2.1 time: 0.208202 Oct 05 18:15:02.671140 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3167/6091] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:02 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:03.694046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e9abbb8f-8978-4e3f-a030-e126571c2de4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:03.695028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e9abbb8f-8978-4e3f-a030-e126571c2de4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:03.700005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=30 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:03.708033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9abbb8f-8978-4e3f-a030-e126571c2de4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:03.708530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9abbb8f-8978-4e3f-a030-e126571c2de4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:03.708959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9abbb8f-8978-4e3f-a030-e126571c2de4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:03.709838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9abbb8f-8978-4e3f-a030-e126571c2de4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:03.710352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9abbb8f-8978-4e3f-a030-e126571c2de4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:03.711192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9abbb8f-8978-4e3f-a030-e126571c2de4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:03.862067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e9abbb8f-8978-4e3f-a030-e126571c2de4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:03.874900 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e9abbb8f-8978-4e3f-a030-e126571c2de4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1317 microversion: 2.1 time: 0.184942 Oct 05 18:15:03.875721 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2925/6092] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:03 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:03.975263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dfe62af8-9fce-49f9-88ee-4cebca12f250 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:03.978386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dfe62af8-9fce-49f9-88ee-4cebca12f250 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:03.985764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe62af8-9fce-49f9-88ee-4cebca12f250 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:03.986272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe62af8-9fce-49f9-88ee-4cebca12f250 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:03.986782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe62af8-9fce-49f9-88ee-4cebca12f250 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:03.987507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe62af8-9fce-49f9-88ee-4cebca12f250 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:03.988185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe62af8-9fce-49f9-88ee-4cebca12f250 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:03.988639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dfe62af8-9fce-49f9-88ee-4cebca12f250 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:04.050592 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dfe62af8-9fce-49f9-88ee-4cebca12f250 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "POST /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb/action" status: 200 len: 32642 microversion: 2.1 time: 0.079156 Oct 05 18:15:04.052946 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3168/6093] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:03 2022] POST /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb/action => generated 32642 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:15:04.118410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4f19605c-4e74-4977-9bb7-4c5ca38dddaf req-e191374c-c8bb-45fa-a535-ceb07317c93b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a04f9c9-bdcf-4353-b6ae-627e1916d0a2", "tag": "65579d35-5481-4556-bba1-3cc32437cc90"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:04.146666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4f19605c-4e74-4977-9bb7-4c5ca38dddaf req-e191374c-c8bb-45fa-a535-ceb07317c93b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:04.151049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4f19605c-4e74-4977-9bb7-4c5ca38dddaf req-e191374c-c8bb-45fa-a535-ceb07317c93b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:04.151628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4f19605c-4e74-4977-9bb7-4c5ca38dddaf req-e191374c-c8bb-45fa-a535-ceb07317c93b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:04.177325 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4f19605c-4e74-4977-9bb7-4c5ca38dddaf req-e191374c-c8bb-45fa-a535-ceb07317c93b service nova] Creating event network-changed:65579d35-5481-4556-bba1-3cc32437cc90 for instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 on n-h2-835595-3 Oct 05 18:15:04.182848 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4f19605c-4e74-4977-9bb7-4c5ca38dddaf req-e191374c-c8bb-45fa-a535-ceb07317c93b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069671 Oct 05 18:15:04.183580 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2926/6094] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:15:04.899375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c813273b-f46c-43b4-bdfe-56ec3c9658c1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:04.900370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c813273b-f46c-43b4-bdfe-56ec3c9658c1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:04.907871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c813273b-f46c-43b4-bdfe-56ec3c9658c1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:04.908382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c813273b-f46c-43b4-bdfe-56ec3c9658c1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:04.908836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c813273b-f46c-43b4-bdfe-56ec3c9658c1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:04.909603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c813273b-f46c-43b4-bdfe-56ec3c9658c1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:04.910433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c813273b-f46c-43b4-bdfe-56ec3c9658c1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:04.910764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c813273b-f46c-43b4-bdfe-56ec3c9658c1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:05.052222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c813273b-f46c-43b4-bdfe-56ec3c9658c1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:05.062378 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c813273b-f46c-43b4-bdfe-56ec3c9658c1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1317 microversion: 2.1 time: 0.166595 Oct 05 18:15:05.062604 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3169/6095] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:04 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:05.481873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-af8f0aa9-3f0a-43ec-baa7-cf006c4b2e17 req-da859ee7-9d8f-427e-a3ea-7355e3482c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18a7a677-6544-4b74-9d6d-4be5230f1ddb", "tag": "e98fe020-aead-4814-98bb-1ae047123a6e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:05.485147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-57b0f523-10c1-4b36-b074-d7f752c4f222 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:05.486951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-57b0f523-10c1-4b36-b074-d7f752c4f222 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:05.501703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57b0f523-10c1-4b36-b074-d7f752c4f222 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:05.503040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57b0f523-10c1-4b36-b074-d7f752c4f222 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:05.505067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57b0f523-10c1-4b36-b074-d7f752c4f222 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:05.506000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57b0f523-10c1-4b36-b074-d7f752c4f222 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:05.507979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-af8f0aa9-3f0a-43ec-baa7-cf006c4b2e17 req-da859ee7-9d8f-427e-a3ea-7355e3482c50 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:05.508473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-af8f0aa9-3f0a-43ec-baa7-cf006c4b2e17 req-da859ee7-9d8f-427e-a3ea-7355e3482c50 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:05.508917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-af8f0aa9-3f0a-43ec-baa7-cf006c4b2e17 req-da859ee7-9d8f-427e-a3ea-7355e3482c50 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:05.510832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57b0f523-10c1-4b36-b074-d7f752c4f222 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:05.511282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57b0f523-10c1-4b36-b074-d7f752c4f222 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:05.536993 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-af8f0aa9-3f0a-43ec-baa7-cf006c4b2e17 req-da859ee7-9d8f-427e-a3ea-7355e3482c50 service nova] Creating event network-changed:e98fe020-aead-4814-98bb-1ae047123a6e for instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb on n-h1-835595-3 Oct 05 18:15:05.544448 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-af8f0aa9-3f0a-43ec-baa7-cf006c4b2e17 req-da859ee7-9d8f-427e-a3ea-7355e3482c50 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067255 Oct 05 18:15:05.550126 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3170/6096] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:15:05.557048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-57b0f523-10c1-4b36-b074-d7f752c4f222 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:15:05.674440 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-57b0f523-10c1-4b36-b074-d7f752c4f222 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "DELETE /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 204 len: 0 microversion: 2.1 time: 0.202872 Oct 05 18:15:05.678803 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2927/6097] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:15:05 2022] DELETE /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:15:05.685676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec68fc6c-747d-47e4-8244-54dc65458b77 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:05.686721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ec68fc6c-747d-47e4-8244-54dc65458b77 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:05.694309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec68fc6c-747d-47e4-8244-54dc65458b77 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:05.695170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec68fc6c-747d-47e4-8244-54dc65458b77 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:05.695794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec68fc6c-747d-47e4-8244-54dc65458b77 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:05.696758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec68fc6c-747d-47e4-8244-54dc65458b77 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:05.697469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec68fc6c-747d-47e4-8244-54dc65458b77 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:05.698256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec68fc6c-747d-47e4-8244-54dc65458b77 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:05.951183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ec68fc6c-747d-47e4-8244-54dc65458b77 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:05.962541 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ec68fc6c-747d-47e4-8244-54dc65458b77 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1671 microversion: 2.1 time: 0.281836 Oct 05 18:15:05.963710 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3171/6098] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:05 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1671 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:06.086375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa3c4f6e-d51c-4e8d-8562-fa399ca48b79 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:06.087814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fa3c4f6e-d51c-4e8d-8562-fa399ca48b79 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:06.095084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa3c4f6e-d51c-4e8d-8562-fa399ca48b79 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:06.095596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa3c4f6e-d51c-4e8d-8562-fa399ca48b79 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:06.096199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa3c4f6e-d51c-4e8d-8562-fa399ca48b79 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:06.096929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa3c4f6e-d51c-4e8d-8562-fa399ca48b79 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:06.097386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa3c4f6e-d51c-4e8d-8562-fa399ca48b79 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:06.097851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa3c4f6e-d51c-4e8d-8562-fa399ca48b79 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:06.243095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa3c4f6e-d51c-4e8d-8562-fa399ca48b79 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:06.251308 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa3c4f6e-d51c-4e8d-8562-fa399ca48b79 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1317 microversion: 2.1 time: 0.169681 Oct 05 18:15:06.251913 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2928/6099] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:06 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:06.988493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e8a948f7-bedc-45a0-8f19-e307359bd046 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:06.989272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e8a948f7-bedc-45a0-8f19-e307359bd046 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:06.996500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8a948f7-bedc-45a0-8f19-e307359bd046 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:06.996999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8a948f7-bedc-45a0-8f19-e307359bd046 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:06.997437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8a948f7-bedc-45a0-8f19-e307359bd046 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:06.998162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8a948f7-bedc-45a0-8f19-e307359bd046 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:06.998647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8a948f7-bedc-45a0-8f19-e307359bd046 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:06.999082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8a948f7-bedc-45a0-8f19-e307359bd046 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:07.189156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e8a948f7-bedc-45a0-8f19-e307359bd046 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:07.197158 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e8a948f7-bedc-45a0-8f19-e307359bd046 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1671 microversion: 2.1 time: 0.213503 Oct 05 18:15:07.197731 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3172/6100] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:06 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1671 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:07.275197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8f37420c-20bd-4963-9797-0c4b57363166 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:07.277530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8f37420c-20bd-4963-9797-0c4b57363166 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:07.285889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f37420c-20bd-4963-9797-0c4b57363166 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:07.286747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f37420c-20bd-4963-9797-0c4b57363166 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:07.287257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f37420c-20bd-4963-9797-0c4b57363166 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:07.288222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f37420c-20bd-4963-9797-0c4b57363166 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:07.288745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f37420c-20bd-4963-9797-0c4b57363166 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:07.289382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f37420c-20bd-4963-9797-0c4b57363166 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:07.434353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f37420c-20bd-4963-9797-0c4b57363166 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:07.444998 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8f37420c-20bd-4963-9797-0c4b57363166 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1317 microversion: 2.1 time: 0.173905 Oct 05 18:15:07.446115 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2929/6101] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:07 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:07.615325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-22dd7d79-6e66-4172-bee6-d0fb044c2932 req-21ea849b-25bf-404f-a876-eaf2472d8e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18a7a677-6544-4b74-9d6d-4be5230f1ddb", "name": "network-vif-deleted", "tag": "e98fe020-aead-4814-98bb-1ae047123a6e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:07.625704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-22dd7d79-6e66-4172-bee6-d0fb044c2932 req-21ea849b-25bf-404f-a876-eaf2472d8e00 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:07.626213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-22dd7d79-6e66-4172-bee6-d0fb044c2932 req-21ea849b-25bf-404f-a876-eaf2472d8e00 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:07.626699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-22dd7d79-6e66-4172-bee6-d0fb044c2932 req-21ea849b-25bf-404f-a876-eaf2472d8e00 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:07.640599 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-22dd7d79-6e66-4172-bee6-d0fb044c2932 req-21ea849b-25bf-404f-a876-eaf2472d8e00 service nova] Creating event network-vif-deleted:e98fe020-aead-4814-98bb-1ae047123a6e for instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb on n-h1-835595-3 Oct 05 18:15:07.645629 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-22dd7d79-6e66-4172-bee6-d0fb044c2932 req-21ea849b-25bf-404f-a876-eaf2472d8e00 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 Oct 05 18:15:07.646230 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3173/6102] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:15:08.220660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:08.221453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:08.228129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:08.228877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:08.229376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:08.230120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:08.230605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:08.231031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:08.265146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:08.265602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:08.266069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:08.266551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lazy-loading 'fault' on Instance uuid 18a7a677-6544-4b74-9d6d-4be5230f1ddb {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:15:08.308387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18188fb109574bf38443d2848a77bf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe00cc2c3494b749a02868d27f89977', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:08.317366 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e82cff54-5db8-4c41-9a39-429438b39db4 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 200 len: 1338 microversion: 2.1 time: 0.100483 Oct 05 18:15:08.317965 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2930/6103] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:08 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:08.471735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ddf895d8-d14a-4e6c-8aea-d4e2de6355c5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:08.472466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ddf895d8-d14a-4e6c-8aea-d4e2de6355c5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:08.479804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf895d8-d14a-4e6c-8aea-d4e2de6355c5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:08.480298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf895d8-d14a-4e6c-8aea-d4e2de6355c5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:08.480764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf895d8-d14a-4e6c-8aea-d4e2de6355c5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:08.481475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf895d8-d14a-4e6c-8aea-d4e2de6355c5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:08.481944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf895d8-d14a-4e6c-8aea-d4e2de6355c5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:08.482415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ddf895d8-d14a-4e6c-8aea-d4e2de6355c5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:08.621277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ddf895d8-d14a-4e6c-8aea-d4e2de6355c5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:08.630430 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ddf895d8-d14a-4e6c-8aea-d4e2de6355c5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1317 microversion: 2.1 time: 0.164426 Oct 05 18:15:08.631009 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3174/6104] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:08 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:09.341560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:09.342471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] [instance: 18a7a677-6544-4b74-9d6d-4be5230f1ddb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:09.350459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:09.350953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:09.351671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:09.352534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:09.352990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:09.353414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:09.367241 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] HTTP exception thrown: Instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb could not be found. Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Request method failure captured: Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb HTTP/1.1 Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcj3lFaYm5WIRCkZZtTHwbtQ0ArQkLsF_zecEwMITdyIFY7RC2qTcP07Yx462zwUlojRTAvE_dzpr0g446mTlvwMmSKi6rwvFZ7f2Q9ZJoZSaaOXCMQWkLiFc_3UOE7asja2mTrexlcd9KChhrp-YGxle6aOoKzZBa8vtZeWRuUQ3JY Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 2fe00cc2c3494b749a02868d27f89977 Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestNetworkBasicOps-189615680 Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2fe00cc2c3494b749a02868d27f89977"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2fe00cc2c3494b749a02868d27f89977"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2fe00cc2c3494b749a02868d27f89977", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2fe00cc2c3494b749a02868d27f89977"}]}] Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestNetworkBasicOps-189615680 Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 2fe00cc2c3494b749a02868d27f89977 Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestNetworkBasicOps-189615680 Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestNetworkBasicOps-189615680-project Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 18188fb109574bf38443d2848a77bf69 Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestNetworkBasicOps-189615680-project Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb could not be found. Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '18a7a677-6544-4b74-9d6d-4be5230f1ddb'} Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb could not be found. Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb could not be found. Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:09.368921 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:09.374053 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:09.374053 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:09.374053 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:09.374053 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:09.374053 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:09.374053 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb could not be found. Oct 05 18:15:09.374053 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:09.374053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Returning 404 to user: Instance 18a7a677-6544-4b74-9d6d-4be5230f1ddb could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:09.374053 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0cb1430b-2d37-47d9-b1bc-f7e19f932f4a tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb" status: 404 len: 111 microversion: 2.1 time: 0.033215 Oct 05 18:15:09.374053 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2931/6105] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:09 2022] GET /compute/v2.1/servers/18a7a677-6544-4b74-9d6d-4be5230f1ddb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:09.467523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-606d7880-a099-4e39-9fa5-08092cb88655 req-c268bba8-abd7-4f07-9eab-5caf66a344d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a04f9c9-bdcf-4353-b6ae-627e1916d0a2", "name": "network-vif-plugged", "status": "completed", "tag": "65579d35-5481-4556-bba1-3cc32437cc90"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:09.481441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-606d7880-a099-4e39-9fa5-08092cb88655 req-c268bba8-abd7-4f07-9eab-5caf66a344d7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:09.483548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-606d7880-a099-4e39-9fa5-08092cb88655 req-c268bba8-abd7-4f07-9eab-5caf66a344d7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:09.484290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-606d7880-a099-4e39-9fa5-08092cb88655 req-c268bba8-abd7-4f07-9eab-5caf66a344d7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:09.497244 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-606d7880-a099-4e39-9fa5-08092cb88655 req-c268bba8-abd7-4f07-9eab-5caf66a344d7 service nova] Creating event network-vif-plugged:65579d35-5481-4556-bba1-3cc32437cc90 for instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 on n-h2-835595-3 Oct 05 18:15:09.503264 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-606d7880-a099-4e39-9fa5-08092cb88655 req-c268bba8-abd7-4f07-9eab-5caf66a344d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040563 Oct 05 18:15:09.504606 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3175/6106] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:15:09.540464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-57e20f63-0323-49bf-a0ce-bffaef83c207 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] Calling method '.version_select at 0x7f7775cb6790>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:09.564082 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-57e20f63-0323-49bf-a0ce-bffaef83c207 tempest-TestNetworkBasicOps-189615680 tempest-TestNetworkBasicOps-189615680-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1669104081" status: 202 len: 0 microversion: 2.1 time: 0.027356 Oct 05 18:15:09.564768 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2932/6107] 10.222.0.70 () {58 vars in 1257 bytes} [Wed Oct 5 18:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1669104081 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:15:09.656491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1f6d9ff0-b9fe-4a5f-90a2-d487068ac3ea tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:09.657532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1f6d9ff0-b9fe-4a5f-90a2-d487068ac3ea tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:09.665325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6d9ff0-b9fe-4a5f-90a2-d487068ac3ea tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:09.665843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6d9ff0-b9fe-4a5f-90a2-d487068ac3ea tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:09.666542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6d9ff0-b9fe-4a5f-90a2-d487068ac3ea tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:09.667293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6d9ff0-b9fe-4a5f-90a2-d487068ac3ea tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:09.667758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6d9ff0-b9fe-4a5f-90a2-d487068ac3ea tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:09.668353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6d9ff0-b9fe-4a5f-90a2-d487068ac3ea tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:10.268464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1f6d9ff0-b9fe-4a5f-90a2-d487068ac3ea tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:10.276639 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1f6d9ff0-b9fe-4a5f-90a2-d487068ac3ea tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1317 microversion: 2.1 time: 0.625092 Oct 05 18:15:10.277229 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3176/6108] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:09 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1317 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:11.300691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4aadc865-d0f4-4f5e-af99-16bbc5731384 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:11.301933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4aadc865-d0f4-4f5e-af99-16bbc5731384 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:11.309485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4aadc865-d0f4-4f5e-af99-16bbc5731384 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:11.310313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4aadc865-d0f4-4f5e-af99-16bbc5731384 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:11.310825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4aadc865-d0f4-4f5e-af99-16bbc5731384 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:11.311725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4aadc865-d0f4-4f5e-af99-16bbc5731384 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:11.312253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4aadc865-d0f4-4f5e-af99-16bbc5731384 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:11.312761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4aadc865-d0f4-4f5e-af99-16bbc5731384 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:11.438586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:11.476193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4aadc865-d0f4-4f5e-af99-16bbc5731384 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:11.484888 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4aadc865-d0f4-4f5e-af99-16bbc5731384 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.189169 Oct 05 18:15:11.485546 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2933/6109] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:11 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:11.557797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1958789322", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:11.567430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:11.568149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:11.619169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] validate_networks() for [('12c0da33-b818-4d50-917d-991504341856', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:15:12.202436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:15:12.203080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:15:12.203659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:15:12.204146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:15:12.204641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:15:12.214360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:12.215284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:12.216025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:12.216999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:12.217733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:12.218741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:12.238154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Getting quotas for project f34e890dde99482b9e72343765245cc6. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:15:12.245072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Getting quotas for user 05a1488f79c44744b8ab28db3b54fb54 and project f34e890dde99482b9e72343765245cc6. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:15:12.260869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:15:12.263893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:15:12.320829 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d89614c-dced-4763-aacf-01a36ac54733 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767850 Oct 05 18:15:12.321862 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3177/6110] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:15:12.333509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cdddfc6e-a2da-4914-92b6-10a72316c39c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:12.335947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cdddfc6e-a2da-4914-92b6-10a72316c39c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:12.415755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cdddfc6e-a2da-4914-92b6-10a72316c39c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:12.425016 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cdddfc6e-a2da-4914-92b6-10a72316c39c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1217 microversion: 2.1 time: 0.095520 Oct 05 18:15:12.441239 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2934/6111] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:12 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:13.449533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-399f6ac4-4d75-4815-9b47-d7adad0e7e03 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:13.451000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-399f6ac4-4d75-4815-9b47-d7adad0e7e03 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:13.465679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-399f6ac4-4d75-4815-9b47-d7adad0e7e03 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:13.466478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-399f6ac4-4d75-4815-9b47-d7adad0e7e03 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:13.467148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-399f6ac4-4d75-4815-9b47-d7adad0e7e03 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:13.467918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-399f6ac4-4d75-4815-9b47-d7adad0e7e03 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:13.468398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-399f6ac4-4d75-4815-9b47-d7adad0e7e03 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:13.468852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-399f6ac4-4d75-4815-9b47-d7adad0e7e03 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:13.550989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-399f6ac4-4d75-4815-9b47-d7adad0e7e03 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:13.563582 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-399f6ac4-4d75-4815-9b47-d7adad0e7e03 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1269 microversion: 2.1 time: 0.117899 Oct 05 18:15:13.564929 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3178/6112] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:13 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1269 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:14.587180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2451cf5f-0be4-44fc-8181-c12a49d74ed2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:14.588682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2451cf5f-0be4-44fc-8181-c12a49d74ed2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:14.602159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2451cf5f-0be4-44fc-8181-c12a49d74ed2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:14.603073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2451cf5f-0be4-44fc-8181-c12a49d74ed2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:14.603908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2451cf5f-0be4-44fc-8181-c12a49d74ed2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:14.604851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2451cf5f-0be4-44fc-8181-c12a49d74ed2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:14.605564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2451cf5f-0be4-44fc-8181-c12a49d74ed2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:14.606236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2451cf5f-0be4-44fc-8181-c12a49d74ed2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:14.760293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2451cf5f-0be4-44fc-8181-c12a49d74ed2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:14.769476 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2451cf5f-0be4-44fc-8181-c12a49d74ed2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1317 microversion: 2.1 time: 0.186264 Oct 05 18:15:14.770760 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2935/6113] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:14 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:15.179758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c7f35d20-770c-4a06-a6c9-029b8613aad0 req-b673b655-f661-4b86-8765-45cba70673c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1905f8f-fbbf-4879-8cc5-0f5ea454019b", "tag": "229ff3ad-7c04-4f6d-b14c-84b1086c71a8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:15.197268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c7f35d20-770c-4a06-a6c9-029b8613aad0 req-b673b655-f661-4b86-8765-45cba70673c9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:15.197986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c7f35d20-770c-4a06-a6c9-029b8613aad0 req-b673b655-f661-4b86-8765-45cba70673c9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:15.198578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c7f35d20-770c-4a06-a6c9-029b8613aad0 req-b673b655-f661-4b86-8765-45cba70673c9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:15.214436 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c7f35d20-770c-4a06-a6c9-029b8613aad0 req-b673b655-f661-4b86-8765-45cba70673c9 service nova] Creating event network-changed:229ff3ad-7c04-4f6d-b14c-84b1086c71a8 for instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b on n-h1-835595-3 Oct 05 18:15:15.218208 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c7f35d20-770c-4a06-a6c9-029b8613aad0 req-b673b655-f661-4b86-8765-45cba70673c9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049906 Oct 05 18:15:15.219277 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3179/6114] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:15:15.793479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5fb485dc-7997-45ca-9acf-a6653afe63ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:15.794199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5fb485dc-7997-45ca-9acf-a6653afe63ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:15.801529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fb485dc-7997-45ca-9acf-a6653afe63ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:15.802115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fb485dc-7997-45ca-9acf-a6653afe63ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:15.802675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fb485dc-7997-45ca-9acf-a6653afe63ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:15.803474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fb485dc-7997-45ca-9acf-a6653afe63ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:15.803997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fb485dc-7997-45ca-9acf-a6653afe63ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:15.804501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5fb485dc-7997-45ca-9acf-a6653afe63ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:15.953436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5fb485dc-7997-45ca-9acf-a6653afe63ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:15.961313 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5fb485dc-7997-45ca-9acf-a6653afe63ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1317 microversion: 2.1 time: 0.172018 Oct 05 18:15:15.966317 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2936/6115] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:15 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:16.986155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4053b9cd-e6a3-427a-b9bd-48a2cee82f3c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:16.987030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4053b9cd-e6a3-427a-b9bd-48a2cee82f3c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:16.999973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4053b9cd-e6a3-427a-b9bd-48a2cee82f3c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:17.006566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4053b9cd-e6a3-427a-b9bd-48a2cee82f3c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:17.007615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4053b9cd-e6a3-427a-b9bd-48a2cee82f3c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:17.008772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4053b9cd-e6a3-427a-b9bd-48a2cee82f3c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:17.009470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4053b9cd-e6a3-427a-b9bd-48a2cee82f3c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:17.010096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4053b9cd-e6a3-427a-b9bd-48a2cee82f3c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:17.565240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4053b9cd-e6a3-427a-b9bd-48a2cee82f3c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:17.567888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:17.575105 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4053b9cd-e6a3-427a-b9bd-48a2cee82f3c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1317 microversion: 2.1 time: 0.594336 Oct 05 18:15:17.575771 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3180/6116] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:16 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:18.601179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-126dd8cf-af62-43e9-a7a1-6b06ca3dc783 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:18.601888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-126dd8cf-af62-43e9-a7a1-6b06ca3dc783 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:18.609448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-126dd8cf-af62-43e9-a7a1-6b06ca3dc783 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:18.610019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-126dd8cf-af62-43e9-a7a1-6b06ca3dc783 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:18.610594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-126dd8cf-af62-43e9-a7a1-6b06ca3dc783 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:18.611577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-126dd8cf-af62-43e9-a7a1-6b06ca3dc783 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:18.612107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-126dd8cf-af62-43e9-a7a1-6b06ca3dc783 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:18.612651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-126dd8cf-af62-43e9-a7a1-6b06ca3dc783 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:18.757308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-126dd8cf-af62-43e9-a7a1-6b06ca3dc783 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:18.765427 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-126dd8cf-af62-43e9-a7a1-6b06ca3dc783 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1317 microversion: 2.1 time: 0.169723 Oct 05 18:15:18.766060 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2937/6117] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:18 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:19.790251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-94ad1114-f66d-4277-b0bf-59f2d5ef0062 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:19.791007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-94ad1114-f66d-4277-b0bf-59f2d5ef0062 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:19.798820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ad1114-f66d-4277-b0bf-59f2d5ef0062 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:19.799313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ad1114-f66d-4277-b0bf-59f2d5ef0062 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:19.799761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ad1114-f66d-4277-b0bf-59f2d5ef0062 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:19.800476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ad1114-f66d-4277-b0bf-59f2d5ef0062 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:19.800932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ad1114-f66d-4277-b0bf-59f2d5ef0062 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:19.801369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ad1114-f66d-4277-b0bf-59f2d5ef0062 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:19.944329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-94ad1114-f66d-4277-b0bf-59f2d5ef0062 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:19.952365 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-94ad1114-f66d-4277-b0bf-59f2d5ef0062 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1317 microversion: 2.1 time: 0.167380 Oct 05 18:15:19.952952 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3181/6118] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:19 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:20.194461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b91dfbc5-0ead-4d49-b522-2f43422ae20e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Action: 'create', calling method: .version_select at 0x7f7775af15e0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-948182754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRj7GS/WfZCz/pjXqLllbk2yThxwpiybmBbUG8xljIzvSinKMbTWzstWLS1nzWRQFAjs0M6BHL2RtdauYqGc/csKU5WOu542YgHaIU3WbIYoXtg9zHQdbKWjXHnVvbBIw=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:20.200846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:20.214869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b91dfbc5-0ead-4d49-b522-2f43422ae20e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Getting quotas for project 81356660aaae46deb0c3107128256727. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:15:20.221566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b91dfbc5-0ead-4d49-b522-2f43422ae20e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Getting quotas for user e0627766a159459283ed2788f79b7b8e and project 81356660aaae46deb0c3107128256727. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:15:20.248128 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b91dfbc5-0ead-4d49-b522-2f43422ae20e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.228440 Oct 05 18:15:20.248760 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2938/6119] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:15:20 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:15:20.755077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f2c21fda-46ca-47b8-be68-573fd081c185 req-c4c38d8d-8978-4a95-935b-edf45ad91bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1905f8f-fbbf-4879-8cc5-0f5ea454019b", "name": "network-vif-plugged", "status": "completed", "tag": "229ff3ad-7c04-4f6d-b14c-84b1086c71a8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:20.765592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f2c21fda-46ca-47b8-be68-573fd081c185 req-c4c38d8d-8978-4a95-935b-edf45ad91bed service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:20.766302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f2c21fda-46ca-47b8-be68-573fd081c185 req-c4c38d8d-8978-4a95-935b-edf45ad91bed service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:20.766920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f2c21fda-46ca-47b8-be68-573fd081c185 req-c4c38d8d-8978-4a95-935b-edf45ad91bed service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:20.782944 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f2c21fda-46ca-47b8-be68-573fd081c185 req-c4c38d8d-8978-4a95-935b-edf45ad91bed service nova] Creating event network-vif-plugged:229ff3ad-7c04-4f6d-b14c-84b1086c71a8 for instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b on n-h1-835595-3 Oct 05 18:15:20.787781 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f2c21fda-46ca-47b8-be68-573fd081c185 req-c4c38d8d-8978-4a95-935b-edf45ad91bed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042598 Oct 05 18:15:20.788442 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3182/6120] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:15:20.975747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cb9f0bfe-f72a-4c5f-abfd-63fc8dbfb90f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:20.976384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cb9f0bfe-f72a-4c5f-abfd-63fc8dbfb90f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:20.983496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb9f0bfe-f72a-4c5f-abfd-63fc8dbfb90f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:20.984013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb9f0bfe-f72a-4c5f-abfd-63fc8dbfb90f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:20.984506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb9f0bfe-f72a-4c5f-abfd-63fc8dbfb90f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:20.985277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb9f0bfe-f72a-4c5f-abfd-63fc8dbfb90f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:20.985735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb9f0bfe-f72a-4c5f-abfd-63fc8dbfb90f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:20.986164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb9f0bfe-f72a-4c5f-abfd-63fc8dbfb90f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:21.531577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cb9f0bfe-f72a-4c5f-abfd-63fc8dbfb90f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:21.539944 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cb9f0bfe-f72a-4c5f-abfd-63fc8dbfb90f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1317 microversion: 2.1 time: 0.568775 Oct 05 18:15:21.540692 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2939/6121] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:20 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:22.562312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:22.564062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:22.567467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbfddb8f-ce99-4e77-8f73-9ddd0a472404 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:22.568222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dbfddb8f-ce99-4e77-8f73-9ddd0a472404 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:22.576036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbfddb8f-ce99-4e77-8f73-9ddd0a472404 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:22.576943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbfddb8f-ce99-4e77-8f73-9ddd0a472404 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:22.577607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbfddb8f-ce99-4e77-8f73-9ddd0a472404 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:22.578400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbfddb8f-ce99-4e77-8f73-9ddd0a472404 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:22.578890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbfddb8f-ce99-4e77-8f73-9ddd0a472404 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:22.579432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbfddb8f-ce99-4e77-8f73-9ddd0a472404 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:22.736330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dbfddb8f-ce99-4e77-8f73-9ddd0a472404 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:22.745725 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dbfddb8f-ce99-4e77-8f73-9ddd0a472404 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1506 microversion: 2.1 time: 0.186508 Oct 05 18:15:22.746790 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3183/6122] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:22 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:22.774087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b8c6e8e-2068-41bd-a61e-46e43eccbd64 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:22.775288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7b8c6e8e-2068-41bd-a61e-46e43eccbd64 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:22.784352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b8c6e8e-2068-41bd-a61e-46e43eccbd64 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:22.785103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b8c6e8e-2068-41bd-a61e-46e43eccbd64 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:22.786021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b8c6e8e-2068-41bd-a61e-46e43eccbd64 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:22.791606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b8c6e8e-2068-41bd-a61e-46e43eccbd64 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:22.792202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b8c6e8e-2068-41bd-a61e-46e43eccbd64 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:22.793095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b8c6e8e-2068-41bd-a61e-46e43eccbd64 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:22.826544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7b8c6e8e-2068-41bd-a61e-46e43eccbd64 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:15:22.920948 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7b8c6e8e-2068-41bd-a61e-46e43eccbd64 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 204 len: 0 microversion: 2.1 time: 0.152444 Oct 05 18:15:22.921624 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2940/6123] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:15:22 2022] DELETE /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:15:22.930402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-51978910-8974-498c-b9f2-789ebbd92087 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:22.931450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-51978910-8974-498c-b9f2-789ebbd92087 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:22.937958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51978910-8974-498c-b9f2-789ebbd92087 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:22.938491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51978910-8974-498c-b9f2-789ebbd92087 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:22.941164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51978910-8974-498c-b9f2-789ebbd92087 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:22.942084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51978910-8974-498c-b9f2-789ebbd92087 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:22.942665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51978910-8974-498c-b9f2-789ebbd92087 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:22.943106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51978910-8974-498c-b9f2-789ebbd92087 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:23.089140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-51978910-8974-498c-b9f2-789ebbd92087 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:23.098216 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-51978910-8974-498c-b9f2-789ebbd92087 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1512 microversion: 2.1 time: 0.171868 Oct 05 18:15:23.099012 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3184/6124] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:22 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1512 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:24.128963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-97e830ea-1299-40fb-9808-3689ec13f15e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:24.133285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-97e830ea-1299-40fb-9808-3689ec13f15e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:24.147642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97e830ea-1299-40fb-9808-3689ec13f15e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:24.148671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97e830ea-1299-40fb-9808-3689ec13f15e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:24.149327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97e830ea-1299-40fb-9808-3689ec13f15e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:24.158024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97e830ea-1299-40fb-9808-3689ec13f15e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:24.158573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97e830ea-1299-40fb-9808-3689ec13f15e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:24.160119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-97e830ea-1299-40fb-9808-3689ec13f15e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:24.345471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-97e830ea-1299-40fb-9808-3689ec13f15e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:24.357920 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-97e830ea-1299-40fb-9808-3689ec13f15e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1512 microversion: 2.1 time: 0.239592 Oct 05 18:15:24.359563 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2941/6125] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:24 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1512 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:25.385515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f4bfa960-bbca-4344-8b80-7e30ce848f15 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:25.387021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f4bfa960-bbca-4344-8b80-7e30ce848f15 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:25.398169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4bfa960-bbca-4344-8b80-7e30ce848f15 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:25.399172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4bfa960-bbca-4344-8b80-7e30ce848f15 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:25.400274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4bfa960-bbca-4344-8b80-7e30ce848f15 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:25.403235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4bfa960-bbca-4344-8b80-7e30ce848f15 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:25.404055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4bfa960-bbca-4344-8b80-7e30ce848f15 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:25.404778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f4bfa960-bbca-4344-8b80-7e30ce848f15 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:25.489362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-6fc869af-ccd5-4061-9566-f5416d16e001 req-2d06e7c7-61dc-4e13-a490-4ede6a0c3331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1905f8f-fbbf-4879-8cc5-0f5ea454019b", "name": "network-vif-deleted", "tag": "229ff3ad-7c04-4f6d-b14c-84b1086c71a8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:25.515106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6fc869af-ccd5-4061-9566-f5416d16e001 req-2d06e7c7-61dc-4e13-a490-4ede6a0c3331 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:25.515598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6fc869af-ccd5-4061-9566-f5416d16e001 req-2d06e7c7-61dc-4e13-a490-4ede6a0c3331 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:25.516032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-6fc869af-ccd5-4061-9566-f5416d16e001 req-2d06e7c7-61dc-4e13-a490-4ede6a0c3331 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:25.540082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:25.545151 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-6fc869af-ccd5-4061-9566-f5416d16e001 req-2d06e7c7-61dc-4e13-a490-4ede6a0c3331 service nova] Creating event network-vif-deleted:229ff3ad-7c04-4f6d-b14c-84b1086c71a8 for instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b on n-h1-835595-3 Oct 05 18:15:25.557942 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-6fc869af-ccd5-4061-9566-f5416d16e001 req-2d06e7c7-61dc-4e13-a490-4ede6a0c3331 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072248 Oct 05 18:15:25.561572 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2942/6126] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:15:25.578249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f4bfa960-bbca-4344-8b80-7e30ce848f15 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:25.588718 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f4bfa960-bbca-4344-8b80-7e30ce848f15 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 200 len: 1470 microversion: 2.1 time: 0.208317 Oct 05 18:15:25.589914 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3185/6127] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:25 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 1470 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:26.618408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:26.619283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:26.634790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:26.635345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:26.635792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:26.639026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:26.643039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:26.643609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:26.671568 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b HTTP/1.1 Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a1905f8f-fbbf-4879-8cc5-0f5ea454019b'} Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:26.673673 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:26.679084 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:26.679084 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:26.679084 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:26.679084 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:26.679084 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:26.679084 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:26.679084 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:26.681154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:26.682349 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-29150e99-b353-471f-8e73-f4324d2261a2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 404 len: 111 microversion: 2.1 time: 0.069566 Oct 05 18:15:26.683102 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2943/6128] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:26 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:26.692015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a9a2f562-393d-4bfa-a4b7-a8c17e364407 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:26.692649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a9a2f562-393d-4bfa-a4b7-a8c17e364407 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:26.704774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9a2f562-393d-4bfa-a4b7-a8c17e364407 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:26.705194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9a2f562-393d-4bfa-a4b7-a8c17e364407 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:26.706047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9a2f562-393d-4bfa-a4b7-a8c17e364407 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:26.708781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9a2f562-393d-4bfa-a4b7-a8c17e364407 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:26.709280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9a2f562-393d-4bfa-a4b7-a8c17e364407 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:26.709734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9a2f562-393d-4bfa-a4b7-a8c17e364407 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:26.740789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1357167370-access_point-2013308297", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "676466b3-b7e3-46e7-b4f3-fc5e98f78d4c"}], "key_name": "tempest-TestSecurityGroupsBasicOps-948182754", "security_groups": [{"name": "tempest-secgroup_access--1555221505"}, {"name": "tempest-secgroup_general--1324379698"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:26.977941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a9a2f562-393d-4bfa-a4b7-a8c17e364407 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:26.993928 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a9a2f562-393d-4bfa-a4b7-a8c17e364407 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.301690 Oct 05 18:15:27.008770 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3186/6129] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:26 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:27.019481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] validate_networks() for [('676466b3-b7e3-46e7-b4f3-fc5e98f78d4c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:15:27.134240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-45cb68b8-8424-4d25-a285-9bd73ad1fe8c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-45cb68b8-8424-4d25-a285-9bd73ad1fe8c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 163 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": 12345, "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 12345 Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:15:27.142886 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 05 18:15:27.148120 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:27.152902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-45cb68b8-8424-4d25-a285-9bd73ad1fe8c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:27.154151 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-45cb68b8-8424-4d25-a285-9bd73ad1fe8c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.024895 Oct 05 18:15:27.155438 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3187/6130] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:27 2022] POST /compute/v2.1/servers => generated 127 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:15:27.164464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4ad6dede-1036-4e05-bd39-77605d68c1bc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:27.165512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4ad6dede-1036-4e05-bd39-77605d68c1bc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:27.176184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ad6dede-1036-4e05-bd39-77605d68c1bc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:27.176821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ad6dede-1036-4e05-bd39-77605d68c1bc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:27.177546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ad6dede-1036-4e05-bd39-77605d68c1bc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:27.178525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ad6dede-1036-4e05-bd39-77605d68c1bc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:27.179230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ad6dede-1036-4e05-bd39-77605d68c1bc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:27.179888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ad6dede-1036-4e05-bd39-77605d68c1bc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:27.357063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4ad6dede-1036-4e05-bd39-77605d68c1bc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:27.366259 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4ad6dede-1036-4e05-bd39-77605d68c1bc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.206426 Oct 05 18:15:27.366986 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3188/6131] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:27 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:27.391632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bd2eb40f-cb8d-4d7e-bd11-71fb4b469b9e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:27.392577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bd2eb40f-cb8d-4d7e-bd11-71fb4b469b9e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:27.399480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd2eb40f-cb8d-4d7e-bd11-71fb4b469b9e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:27.400212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd2eb40f-cb8d-4d7e-bd11-71fb4b469b9e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:27.400871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd2eb40f-cb8d-4d7e-bd11-71fb4b469b9e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:27.401707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd2eb40f-cb8d-4d7e-bd11-71fb4b469b9e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:27.402236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd2eb40f-cb8d-4d7e-bd11-71fb4b469b9e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:27.402704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bd2eb40f-cb8d-4d7e-bd11-71fb4b469b9e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:27.500480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:15:27.501000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:15:27.501502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:15:27.501922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:15:27.502364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:15:27.515774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:27.516301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:27.516805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:27.517542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:27.518000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:27.518466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:27.536336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Getting quotas for project 81356660aaae46deb0c3107128256727. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:15:27.541883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Getting quotas for user e0627766a159459283ed2788f79b7b8e and project 81356660aaae46deb0c3107128256727. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:15:27.542038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bd2eb40f-cb8d-4d7e-bd11-71fb4b469b9e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:27.550052 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bd2eb40f-cb8d-4d7e-bd11-71fb4b469b9e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.162593 Oct 05 18:15:27.550940 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3189/6132] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:27 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:27.555538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:15:27.557614 n-d-835595-3 devstack@n-api.service[128843]: WARNING nova.utils [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1357167370-access_point-2013308297 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1357167370-ac Oct 05 18:15:27.558395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:15:27.609298 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1d19d057-e70e-4b50-a70b-006c3bfc1449 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.872417 Oct 05 18:15:27.616657 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2944/6133] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:26 2022] POST /compute/v2.1/servers => generated 458 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:15:27.622560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c001cd57-ec35-4d50-b4e6-3c3c4475d184 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:27.623694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c001cd57-ec35-4d50-b4e6-3c3c4475d184 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:27.694692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c001cd57-ec35-4d50-b4e6-3c3c4475d184 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:27.709081 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c001cd57-ec35-4d50-b4e6-3c3c4475d184 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1294 microversion: 2.1 time: 0.087677 Oct 05 18:15:27.710196 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3190/6134] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:27 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:28.744133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-92e654f8-ce87-4544-80ac-e3b48f8802a7 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:28.749207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-92e654f8-ce87-4544-80ac-e3b48f8802a7 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:28.773214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92e654f8-ce87-4544-80ac-e3b48f8802a7 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:28.773734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92e654f8-ce87-4544-80ac-e3b48f8802a7 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:28.774179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92e654f8-ce87-4544-80ac-e3b48f8802a7 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:28.775137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92e654f8-ce87-4544-80ac-e3b48f8802a7 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:28.775802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92e654f8-ce87-4544-80ac-e3b48f8802a7 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:28.783245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-92e654f8-ce87-4544-80ac-e3b48f8802a7 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:28.904658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-92e654f8-ce87-4544-80ac-e3b48f8802a7 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:28.913050 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-92e654f8-ce87-4544-80ac-e3b48f8802a7 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1346 microversion: 2.1 time: 0.184258 Oct 05 18:15:28.931734 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2945/6135] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:28 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1346 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:29.939752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-febf8359-0a00-42de-bc51-588b4b4175fa tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:29.941074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-febf8359-0a00-42de-bc51-588b4b4175fa tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:29.949494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-febf8359-0a00-42de-bc51-588b4b4175fa tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:29.950000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-febf8359-0a00-42de-bc51-588b4b4175fa tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:29.950501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-febf8359-0a00-42de-bc51-588b4b4175fa tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:29.951270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-febf8359-0a00-42de-bc51-588b4b4175fa tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:29.951973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-febf8359-0a00-42de-bc51-588b4b4175fa tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:29.952439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-febf8359-0a00-42de-bc51-588b4b4175fa tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:30.191135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-febf8359-0a00-42de-bc51-588b4b4175fa tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:30.200004 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-febf8359-0a00-42de-bc51-588b4b4175fa tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1472 microversion: 2.1 time: 0.266668 Oct 05 18:15:30.200599 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3191/6136] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:29 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1472 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:30.261999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b314dab0-19d2-4336-a231-cf0e38ed7ad0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-185880285", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c8553d53-9340-4edc-8e99-c8e3d6e52b90", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:30.325781 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-b314dab0-19d2-4336-a231-cf0e38ed7ad0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Block Device c8553d53-9340-4edc-8e99-c8e3d6e52b90 is not bootable. Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b314dab0-19d2-4336-a231-cf0e38ed7ad0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 357 Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-185880285", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c8553d53-9340-4edc-8e99-c8e3d6e52b90", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: exception: Block Device c8553d53-9340-4edc-8e99-c8e3d6e52b90 is not bootable. Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-185880285', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'c8553d53-9340-4edc-8e99-c8e3d6e52b90'}], 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device c8553d53-9340-4edc-8e99-c8e3d6e52b90 is not bootable. Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:30.335730 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device c8553d53-9340-4edc-8e99-c8e3d6e52b90 is not bootable. Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device c8553d53-9340-4edc-8e99-c8e3d6e52b90 is not bootable. Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b314dab0-19d2-4336-a231-cf0e38ed7ad0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Block Device c8553d53-9340-4edc-8e99-c8e3d6e52b90 is not bootable. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b314dab0-19d2-4336-a231-cf0e38ed7ad0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.079438 Oct 05 18:15:30.340582 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2946/6137] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:30 2022] POST /compute/v2.1/servers => generated 110 bytes in 81 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:15:30.346709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f0aee48-5091-456a-ab5a-5a77977fd285 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:30.347322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6f0aee48-5091-456a-ab5a-5a77977fd285 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:30.356751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f0aee48-5091-456a-ab5a-5a77977fd285 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:30.357266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f0aee48-5091-456a-ab5a-5a77977fd285 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:30.357775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f0aee48-5091-456a-ab5a-5a77977fd285 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:30.358605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f0aee48-5091-456a-ab5a-5a77977fd285 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:30.359631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f0aee48-5091-456a-ab5a-5a77977fd285 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:30.360109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f0aee48-5091-456a-ab5a-5a77977fd285 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:30.573404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6f0aee48-5091-456a-ab5a-5a77977fd285 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:30.582802 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6f0aee48-5091-456a-ab5a-5a77977fd285 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.240342 Oct 05 18:15:30.584006 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3192/6138] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:30 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:30.611661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-83df0412-5ee6-4cdb-ad95-8bebf187750c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:30.612387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-83df0412-5ee6-4cdb-ad95-8bebf187750c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:30.620177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83df0412-5ee6-4cdb-ad95-8bebf187750c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:30.620695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83df0412-5ee6-4cdb-ad95-8bebf187750c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:30.621262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83df0412-5ee6-4cdb-ad95-8bebf187750c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:30.622324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83df0412-5ee6-4cdb-ad95-8bebf187750c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:30.622859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83df0412-5ee6-4cdb-ad95-8bebf187750c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:30.623408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83df0412-5ee6-4cdb-ad95-8bebf187750c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:30.670629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-abcfb9a2-c131-4b5b-8f87-f8066efcb047 req-b9438fa0-a6ec-4a9e-8bb0-1c890e5b6da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41cb647d-f404-486a-9a12-dc535f360fbb", "tag": "fb9b6997-df7d-441d-810b-eeee0ee56ce3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:30.688877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-abcfb9a2-c131-4b5b-8f87-f8066efcb047 req-b9438fa0-a6ec-4a9e-8bb0-1c890e5b6da1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:30.699969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-abcfb9a2-c131-4b5b-8f87-f8066efcb047 req-b9438fa0-a6ec-4a9e-8bb0-1c890e5b6da1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:30.702156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-abcfb9a2-c131-4b5b-8f87-f8066efcb047 req-b9438fa0-a6ec-4a9e-8bb0-1c890e5b6da1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:30.735633 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-abcfb9a2-c131-4b5b-8f87-f8066efcb047 req-b9438fa0-a6ec-4a9e-8bb0-1c890e5b6da1 service nova] Creating event network-changed:fb9b6997-df7d-441d-810b-eeee0ee56ce3 for instance 41cb647d-f404-486a-9a12-dc535f360fbb on n-h2-835595-3 Oct 05 18:15:30.745051 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-abcfb9a2-c131-4b5b-8f87-f8066efcb047 req-b9438fa0-a6ec-4a9e-8bb0-1c890e5b6da1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078766 Oct 05 18:15:30.750769 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3193/6139] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:15:30.834199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-83df0412-5ee6-4cdb-ad95-8bebf187750c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:30.847297 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-83df0412-5ee6-4cdb-ad95-8bebf187750c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.240459 Oct 05 18:15:30.847910 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2947/6140] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:30 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:31.224446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cacff5f6-d324-4991-ac28-664b48314705 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:31.225889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cacff5f6-d324-4991-ac28-664b48314705 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:31.230428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:31.235146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cacff5f6-d324-4991-ac28-664b48314705 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:31.235957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cacff5f6-d324-4991-ac28-664b48314705 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:31.236464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cacff5f6-d324-4991-ac28-664b48314705 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:31.237313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cacff5f6-d324-4991-ac28-664b48314705 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:31.237782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cacff5f6-d324-4991-ac28-664b48314705 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:31.238225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cacff5f6-d324-4991-ac28-664b48314705 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:31.399152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cacff5f6-d324-4991-ac28-664b48314705 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:31.408280 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cacff5f6-d324-4991-ac28-664b48314705 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1472 microversion: 2.1 time: 0.188269 Oct 05 18:15:31.409260 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3194/6141] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:31 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:32.313114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1769f781-2175-4968-bd4a-ce0979abcb87 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-725897870", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "destination_type": "local"}, {"source_type": "volume", "uuid": "429c2f45-6cd6-4ba9-bb8c-b183b58e46b1", "destination_type": "invalid"}], "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1769f781-2175-4968-bd4a-ce0979abcb87 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 494 Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-725897870", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "destination_type": "local"}, {"source_type": "volume", "uuid": "429c2f45-6cd6-4ba9-bb8c-b183b58e46b1", "destination_type": "invalid"}], "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-725897870', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '429c2f45-6cd6-4ba9-bb8c-b183b58e46b1', 'destination_type': 'invalid'}], 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'invalid' Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:32.317693 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1769f781-2175-4968-bd4a-ce0979abcb87 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1769f781-2175-4968-bd4a-ce0979abcb87 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.010118 Oct 05 18:15:32.323161 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2948/6142] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:32 2022] POST /compute/v2.1/servers => generated 155 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:15:32.328913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7cef48e7-b9d5-43c6-a2a9-d1370790628b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:32.329707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7cef48e7-b9d5-43c6-a2a9-d1370790628b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:32.337408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cef48e7-b9d5-43c6-a2a9-d1370790628b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:32.337907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cef48e7-b9d5-43c6-a2a9-d1370790628b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:32.338413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cef48e7-b9d5-43c6-a2a9-d1370790628b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:32.339183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cef48e7-b9d5-43c6-a2a9-d1370790628b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:32.339656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cef48e7-b9d5-43c6-a2a9-d1370790628b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:32.340097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cef48e7-b9d5-43c6-a2a9-d1370790628b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:32.434301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-10fb9c14-ddda-4361-b4ba-ae2419ce8e34 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:32.435058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-10fb9c14-ddda-4361-b4ba-ae2419ce8e34 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:32.443625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10fb9c14-ddda-4361-b4ba-ae2419ce8e34 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:32.444237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10fb9c14-ddda-4361-b4ba-ae2419ce8e34 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:32.444702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10fb9c14-ddda-4361-b4ba-ae2419ce8e34 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:32.445431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10fb9c14-ddda-4361-b4ba-ae2419ce8e34 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:32.445891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10fb9c14-ddda-4361-b4ba-ae2419ce8e34 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:32.446413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10fb9c14-ddda-4361-b4ba-ae2419ce8e34 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:32.607802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-10fb9c14-ddda-4361-b4ba-ae2419ce8e34 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:32.616879 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-10fb9c14-ddda-4361-b4ba-ae2419ce8e34 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1472 microversion: 2.1 time: 0.187717 Oct 05 18:15:32.617485 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2949/6143] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:32 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1472 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:32.807234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7cef48e7-b9d5-43c6-a2a9-d1370790628b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:32.817270 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7cef48e7-b9d5-43c6-a2a9-d1370790628b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.492858 Oct 05 18:15:32.818086 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3195/6144] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:32 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:32.840880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca407a62-bd1f-43ee-acd4-32fd64b7e258 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:32.841557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ca407a62-bd1f-43ee-acd4-32fd64b7e258 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:32.848565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca407a62-bd1f-43ee-acd4-32fd64b7e258 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:32.849219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca407a62-bd1f-43ee-acd4-32fd64b7e258 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:32.849677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca407a62-bd1f-43ee-acd4-32fd64b7e258 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:32.850614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca407a62-bd1f-43ee-acd4-32fd64b7e258 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:32.851689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca407a62-bd1f-43ee-acd4-32fd64b7e258 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:32.852202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca407a62-bd1f-43ee-acd4-32fd64b7e258 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.022112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ca407a62-bd1f-43ee-acd4-32fd64b7e258 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:33.031859 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ca407a62-bd1f-43ee-acd4-32fd64b7e258 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.194789 Oct 05 18:15:33.032623 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2950/6145] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:32 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:33.100897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c3afa94-4be8-4c8f-b558-49ddb6c99b99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1897428569", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c3afa94-4be8-4c8f-b558-49ddb6c99b99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 492 Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1897428569", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1897428569', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.105681 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c3afa94-4be8-4c8f-b558-49ddb6c99b99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8c3afa94-4be8-4c8f-b558-49ddb6c99b99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.011120 Oct 05 18:15:33.110046 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3196/6146] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:33 2022] POST /compute/v2.1/servers => generated 624 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:15:33.116732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-08d9fbb2-e7fc-4c03-ba47-48b780a53a11 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:33.117423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-08d9fbb2-e7fc-4c03-ba47-48b780a53a11 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:33.124538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d9fbb2-e7fc-4c03-ba47-48b780a53a11 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:33.125131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d9fbb2-e7fc-4c03-ba47-48b780a53a11 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:33.125628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d9fbb2-e7fc-4c03-ba47-48b780a53a11 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.126520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d9fbb2-e7fc-4c03-ba47-48b780a53a11 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:33.127057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d9fbb2-e7fc-4c03-ba47-48b780a53a11 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:33.127482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d9fbb2-e7fc-4c03-ba47-48b780a53a11 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.289661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08d9fbb2-e7fc-4c03-ba47-48b780a53a11 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:33.303118 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-08d9fbb2-e7fc-4c03-ba47-48b780a53a11 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.190281 Oct 05 18:15:33.304077 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2951/6147] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:33 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:33.329679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b137590c-0fa4-44c2-b494-2f4bafae03cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:33.330218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b137590c-0fa4-44c2-b494-2f4bafae03cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:33.339038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b137590c-0fa4-44c2-b494-2f4bafae03cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:33.339660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b137590c-0fa4-44c2-b494-2f4bafae03cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:33.340139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b137590c-0fa4-44c2-b494-2f4bafae03cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.340937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b137590c-0fa4-44c2-b494-2f4bafae03cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:33.341568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b137590c-0fa4-44c2-b494-2f4bafae03cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:33.342087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b137590c-0fa4-44c2-b494-2f4bafae03cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.481340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b137590c-0fa4-44c2-b494-2f4bafae03cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:33.491736 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b137590c-0fa4-44c2-b494-2f4bafae03cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.166108 Oct 05 18:15:33.492343 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3197/6148] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:33 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:33.558354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-466aa4ec-44f0-4993-98ee-fe3109149375 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-466aa4ec-44f0-4993-98ee-fe3109149375 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 416 Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.562474 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-466aa4ec-44f0-4993-98ee-fe3109149375 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-466aa4ec-44f0-4993-98ee-fe3109149375 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.010318 Oct 05 18:15:33.567270 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2952/6149] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:33 2022] POST /compute/v2.1/servers => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 05 18:15:33.573716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e3f5c75e-29b2-49f1-a103-8a2e8aa22915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:33.574375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e3f5c75e-29b2-49f1-a103-8a2e8aa22915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:33.580889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3f5c75e-29b2-49f1-a103-8a2e8aa22915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:33.581336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3f5c75e-29b2-49f1-a103-8a2e8aa22915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:33.581908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3f5c75e-29b2-49f1-a103-8a2e8aa22915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.582684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3f5c75e-29b2-49f1-a103-8a2e8aa22915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:33.583122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3f5c75e-29b2-49f1-a103-8a2e8aa22915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:33.583557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3f5c75e-29b2-49f1-a103-8a2e8aa22915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.644603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c879801-e81e-4899-a964-8bbb1c7b7f28 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:33.645209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0c879801-e81e-4899-a964-8bbb1c7b7f28 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:33.652586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c879801-e81e-4899-a964-8bbb1c7b7f28 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:33.653106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c879801-e81e-4899-a964-8bbb1c7b7f28 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:33.653540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c879801-e81e-4899-a964-8bbb1c7b7f28 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.654264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c879801-e81e-4899-a964-8bbb1c7b7f28 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:33.654738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c879801-e81e-4899-a964-8bbb1c7b7f28 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:33.655158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c879801-e81e-4899-a964-8bbb1c7b7f28 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.724967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e3f5c75e-29b2-49f1-a103-8a2e8aa22915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:33.733852 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e3f5c75e-29b2-49f1-a103-8a2e8aa22915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.164207 Oct 05 18:15:33.734542 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3198/6150] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:33 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:33.757851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-19b5db5a-4c05-45c7-9f4d-1cd1b314e5ce tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:33.758700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-19b5db5a-4c05-45c7-9f4d-1cd1b314e5ce tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:33.765533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19b5db5a-4c05-45c7-9f4d-1cd1b314e5ce tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:33.766581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19b5db5a-4c05-45c7-9f4d-1cd1b314e5ce tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:33.766581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19b5db5a-4c05-45c7-9f4d-1cd1b314e5ce tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.767398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19b5db5a-4c05-45c7-9f4d-1cd1b314e5ce tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:33.767927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19b5db5a-4c05-45c7-9f4d-1cd1b314e5ce tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:33.768368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19b5db5a-4c05-45c7-9f4d-1cd1b314e5ce tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:33.806495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0c879801-e81e-4899-a964-8bbb1c7b7f28 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:33.814986 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c879801-e81e-4899-a964-8bbb1c7b7f28 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1472 microversion: 2.1 time: 0.175072 Oct 05 18:15:33.815910 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2953/6151] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:33 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:33.906680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-19b5db5a-4c05-45c7-9f4d-1cd1b314e5ce tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:33.915297 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-19b5db5a-4c05-45c7-9f4d-1cd1b314e5ce tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.161637 Oct 05 18:15:33.915937 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3199/6152] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:33 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:33.978676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9741577-1522-43a5-9575-b423da5cea6e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1866720967", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": -1, "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:33.990667 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-a9741577-1522-43a5-9575-b423da5cea6e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Flavor -1 could not be found. Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9741577-1522-43a5-9575-b423da5cea6e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 206 Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1866720967", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": -1, "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: exception: Flavor -1 could not be found. Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1866720967', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': -1, 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:33.997184 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9741577-1522-43a5-9575-b423da5cea6e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a9741577-1522-43a5-9575-b423da5cea6e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.024218 Oct 05 18:15:34.002035 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2954/6153] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:33 2022] POST /compute/v2.1/servers => generated 73 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 18:15:34.009133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e2c8b3b0-65d6-42da-9cbc-288e4ba8025e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:34.009767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e2c8b3b0-65d6-42da-9cbc-288e4ba8025e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:34.016405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2c8b3b0-65d6-42da-9cbc-288e4ba8025e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.016900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2c8b3b0-65d6-42da-9cbc-288e4ba8025e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.017326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2c8b3b0-65d6-42da-9cbc-288e4ba8025e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.018050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2c8b3b0-65d6-42da-9cbc-288e4ba8025e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.018622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2c8b3b0-65d6-42da-9cbc-288e4ba8025e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.019101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2c8b3b0-65d6-42da-9cbc-288e4ba8025e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.160300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e2c8b3b0-65d6-42da-9cbc-288e4ba8025e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:34.172756 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e2c8b3b0-65d6-42da-9cbc-288e4ba8025e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.167327 Oct 05 18:15:34.173657 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3200/6154] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:34 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:34.200402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bc9e33ef-8a95-4481-9c53-491c88d6cb33 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:34.202773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bc9e33ef-8a95-4481-9c53-491c88d6cb33 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:34.208939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9e33ef-8a95-4481-9c53-491c88d6cb33 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.209435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9e33ef-8a95-4481-9c53-491c88d6cb33 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.209872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9e33ef-8a95-4481-9c53-491c88d6cb33 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.210618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9e33ef-8a95-4481-9c53-491c88d6cb33 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.211056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9e33ef-8a95-4481-9c53-491c88d6cb33 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.211482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9e33ef-8a95-4481-9c53-491c88d6cb33 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.345714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bc9e33ef-8a95-4481-9c53-491c88d6cb33 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:34.356719 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bc9e33ef-8a95-4481-9c53-491c88d6cb33 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.160051 Oct 05 18:15:34.357426 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2955/6155] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:34 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:34.422459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-395f92fc-39a1-49db-9b0c-2b73845cd309 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2066517187", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-395f92fc-39a1-49db-9b0c-2b73845cd309 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 173 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2066517187", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2066517187', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi -1 Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:15:34.426539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-395f92fc-39a1-49db-9b0c-2b73845cd309 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-395f92fc-39a1-49db-9b0c-2b73845cd309 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010061 Oct 05 18:15:34.431761 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3201/6156] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:34 2022] POST /compute/v2.1/servers => generated 145 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:15:34.440393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cb6bf479-5f79-4cf7-97bb-50ede9e8bdc1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:34.441216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cb6bf479-5f79-4cf7-97bb-50ede9e8bdc1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:34.450198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6bf479-5f79-4cf7-97bb-50ede9e8bdc1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.450838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6bf479-5f79-4cf7-97bb-50ede9e8bdc1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.451322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6bf479-5f79-4cf7-97bb-50ede9e8bdc1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.452026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6bf479-5f79-4cf7-97bb-50ede9e8bdc1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.452488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6bf479-5f79-4cf7-97bb-50ede9e8bdc1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.452919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cb6bf479-5f79-4cf7-97bb-50ede9e8bdc1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.587506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cb6bf479-5f79-4cf7-97bb-50ede9e8bdc1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:34.595876 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cb6bf479-5f79-4cf7-97bb-50ede9e8bdc1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.160893 Oct 05 18:15:34.596454 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2956/6157] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:34 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:34.619994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0625fe17-e4a9-407b-8651-a2abfe6ed975 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:34.620652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0625fe17-e4a9-407b-8651-a2abfe6ed975 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:34.628848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0625fe17-e4a9-407b-8651-a2abfe6ed975 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.629682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0625fe17-e4a9-407b-8651-a2abfe6ed975 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.630144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0625fe17-e4a9-407b-8651-a2abfe6ed975 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.630915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0625fe17-e4a9-407b-8651-a2abfe6ed975 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.631382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0625fe17-e4a9-407b-8651-a2abfe6ed975 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.631840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0625fe17-e4a9-407b-8651-a2abfe6ed975 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.785422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0625fe17-e4a9-407b-8651-a2abfe6ed975 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:34.788946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:34.799008 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0625fe17-e4a9-407b-8651-a2abfe6ed975 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.183567 Oct 05 18:15:34.799937 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3202/6158] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:34 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:34.837070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b61a5b87-e245-4363-9bb4-ccecb7d5f3f2 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:34.837657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b61a5b87-e245-4363-9bb4-ccecb7d5f3f2 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:34.844687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b61a5b87-e245-4363-9bb4-ccecb7d5f3f2 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.845176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b61a5b87-e245-4363-9bb4-ccecb7d5f3f2 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.845633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b61a5b87-e245-4363-9bb4-ccecb7d5f3f2 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.846347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b61a5b87-e245-4363-9bb4-ccecb7d5f3f2 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.846836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b61a5b87-e245-4363-9bb4-ccecb7d5f3f2 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.847267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b61a5b87-e245-4363-9bb4-ccecb7d5f3f2 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.863388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b57e5af-70bb-4224-a715-3db3b41cb3a3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-780020807", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:34.868354 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5b57e5af-70bb-4224-a715-3db3b41cb3a3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b57e5af-70bb-4224-a715-3db3b41cb3a3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 215 Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-780020807", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-780020807', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.869918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b57e5af-70bb-4224-a715-3db3b41cb3a3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b57e5af-70bb-4224-a715-3db3b41cb3a3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.012265 Oct 05 18:15:34.874874 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3203/6159] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:34 2022] POST /compute/v2.1/servers => generated 123 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:15:34.880153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ffecd32-d7b3-4bb0-a2b9-8d57cbcfd9fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:34.880769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ffecd32-d7b3-4bb0-a2b9-8d57cbcfd9fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:34.888268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffecd32-d7b3-4bb0-a2b9-8d57cbcfd9fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.888758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffecd32-d7b3-4bb0-a2b9-8d57cbcfd9fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.889222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffecd32-d7b3-4bb0-a2b9-8d57cbcfd9fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:34.889935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffecd32-d7b3-4bb0-a2b9-8d57cbcfd9fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:34.890433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffecd32-d7b3-4bb0-a2b9-8d57cbcfd9fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:34.890869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ffecd32-d7b3-4bb0-a2b9-8d57cbcfd9fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:35.002315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b61a5b87-e245-4363-9bb4-ccecb7d5f3f2 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:35.010512 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b61a5b87-e245-4363-9bb4-ccecb7d5f3f2 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1472 microversion: 2.1 time: 0.177404 Oct 05 18:15:35.011129 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2957/6160] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:34 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1472 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:35.028079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9ffecd32-d7b3-4bb0-a2b9-8d57cbcfd9fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:35.036170 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ffecd32-d7b3-4bb0-a2b9-8d57cbcfd9fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.159997 Oct 05 18:15:35.036717 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3204/6161] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:34 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:35.059224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1a4ff2e0-5498-4d68-b89f-d93eebf0ffec tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:35.059845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1a4ff2e0-5498-4d68-b89f-d93eebf0ffec tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:35.066305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a4ff2e0-5498-4d68-b89f-d93eebf0ffec tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:35.066795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a4ff2e0-5498-4d68-b89f-d93eebf0ffec tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:35.067231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a4ff2e0-5498-4d68-b89f-d93eebf0ffec tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:35.067930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a4ff2e0-5498-4d68-b89f-d93eebf0ffec tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:35.068386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a4ff2e0-5498-4d68-b89f-d93eebf0ffec tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:35.068818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a4ff2e0-5498-4d68-b89f-d93eebf0ffec tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:35.208403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1a4ff2e0-5498-4d68-b89f-d93eebf0ffec tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:35.218906 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1a4ff2e0-5498-4d68-b89f-d93eebf0ffec tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.163589 Oct 05 18:15:35.219496 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2958/6162] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:35 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:35.288409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-01bf8bf3-7849-49b2-907d-c2efa9757ba0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-317113462", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "key_name": "tempest-key-1561240816", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:35.349509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-01bf8bf3-7849-49b2-907d-c2efa9757ba0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] validate_networks() for [('12c0da33-b818-4d50-917d-991504341856', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:15:35.539351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e2ca15d9-6352-4366-af9b-4e932db5340f req-74d2ff91-4774-41f6-bd5f-efc631c6c666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cb647d-f404-486a-9a12-dc535f360fbb", "name": "network-vif-plugged", "status": "completed", "tag": "fb9b6997-df7d-441d-810b-eeee0ee56ce3"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:35.550414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e2ca15d9-6352-4366-af9b-4e932db5340f req-74d2ff91-4774-41f6-bd5f-efc631c6c666 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:35.551267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e2ca15d9-6352-4366-af9b-4e932db5340f req-74d2ff91-4774-41f6-bd5f-efc631c6c666 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:35.551871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e2ca15d9-6352-4366-af9b-4e932db5340f req-74d2ff91-4774-41f6-bd5f-efc631c6c666 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:35.553597 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-01bf8bf3-7849-49b2-907d-c2efa9757ba0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Invalid key_name provided. Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-01bf8bf3-7849-49b2-907d-c2efa9757ba0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 246 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-317113462", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "key_name": "tempest-key-1561240816", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid key_name provided. Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-317113462', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'key_name': 'tempest-key-1561240816', 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1561240816 not found for user 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:35.555515 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-01bf8bf3-7849-49b2-907d-c2efa9757ba0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid key_name provided. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-01bf8bf3-7849-49b2-907d-c2efa9757ba0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.272699 Oct 05 18:15:35.564724 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3205/6163] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:35 2022] POST /compute/v2.1/servers => generated 70 bytes in 274 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 05 18:15:35.568598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-877e4b35-22cd-422d-8527-77992d23d23a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:35.569348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-877e4b35-22cd-422d-8527-77992d23d23a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:35.569806 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e2ca15d9-6352-4366-af9b-4e932db5340f req-74d2ff91-4774-41f6-bd5f-efc631c6c666 service nova] Creating event network-vif-plugged:fb9b6997-df7d-441d-810b-eeee0ee56ce3 for instance 41cb647d-f404-486a-9a12-dc535f360fbb on n-h2-835595-3 Oct 05 18:15:35.575787 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e2ca15d9-6352-4366-af9b-4e932db5340f req-74d2ff91-4774-41f6-bd5f-efc631c6c666 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040348 Oct 05 18:15:35.576200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-877e4b35-22cd-422d-8527-77992d23d23a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:35.576787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-877e4b35-22cd-422d-8527-77992d23d23a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:35.577360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-877e4b35-22cd-422d-8527-77992d23d23a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:35.577533 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2959/6164] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:15:35.578537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-877e4b35-22cd-422d-8527-77992d23d23a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:35.579016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-877e4b35-22cd-422d-8527-77992d23d23a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:35.579466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-877e4b35-22cd-422d-8527-77992d23d23a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:35.784602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-877e4b35-22cd-422d-8527-77992d23d23a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:35.793197 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-877e4b35-22cd-422d-8527-77992d23d23a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.231062 Oct 05 18:15:35.793801 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3206/6165] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:35 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:35.817129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d4db151d-6a20-4353-8d31-e96460227912 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:35.817826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d4db151d-6a20-4353-8d31-e96460227912 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:35.825153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4db151d-6a20-4353-8d31-e96460227912 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:35.825795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4db151d-6a20-4353-8d31-e96460227912 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:35.826308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4db151d-6a20-4353-8d31-e96460227912 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:35.827086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4db151d-6a20-4353-8d31-e96460227912 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:35.827676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4db151d-6a20-4353-8d31-e96460227912 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:35.828187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4db151d-6a20-4353-8d31-e96460227912 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:35.976463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d4db151d-6a20-4353-8d31-e96460227912 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:35.985173 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d4db151d-6a20-4353-8d31-e96460227912 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.172566 Oct 05 18:15:35.985721 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2960/6166] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:35 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:36.033615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9248dea3-32e1-45d3-ad58-a05778f7fbf0 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:36.034247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9248dea3-32e1-45d3-ad58-a05778f7fbf0 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:36.041202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9248dea3-32e1-45d3-ad58-a05778f7fbf0 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:36.041764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9248dea3-32e1-45d3-ad58-a05778f7fbf0 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:36.042176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9248dea3-32e1-45d3-ad58-a05778f7fbf0 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:36.043272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9248dea3-32e1-45d3-ad58-a05778f7fbf0 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:36.043607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9248dea3-32e1-45d3-ad58-a05778f7fbf0 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:36.044047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9248dea3-32e1-45d3-ad58-a05778f7fbf0 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:36.065099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47ccbc96-beec-4be6-ac37-b28e967d061a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1674215389", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:36.158454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.security_group_api [None req-47ccbc96-beec-4be6-ac37-b28e967d061a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Neutron security group does_not_exist not found {{(pid=128843) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 05 18:15:36.159046 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-47ccbc96-beec-4be6-ac37-b28e967d061a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47ccbc96-beec-4be6-ac37-b28e967d061a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 258 Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1674215389", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1674215389', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 05 18:15:36.197679 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.205076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-47ccbc96-beec-4be6-ac37-b28e967d061a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:36.209687 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-47ccbc96-beec-4be6-ac37-b28e967d061a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.138435 Oct 05 18:15:36.209687 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2961/6167] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:36 2022] POST /compute/v2.1/servers => generated 106 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:15:36.209687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e5976904-570c-4ceb-9910-0dc4610d5ff0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:36.209687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e5976904-570c-4ceb-9910-0dc4610d5ff0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:36.210613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9248dea3-32e1-45d3-ad58-a05778f7fbf0 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:36.216022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5976904-570c-4ceb-9910-0dc4610d5ff0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:36.216610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5976904-570c-4ceb-9910-0dc4610d5ff0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:36.217042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5976904-570c-4ceb-9910-0dc4610d5ff0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:36.217741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5976904-570c-4ceb-9910-0dc4610d5ff0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:36.218221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5976904-570c-4ceb-9910-0dc4610d5ff0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:36.218768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e5976904-570c-4ceb-9910-0dc4610d5ff0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:36.219234 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9248dea3-32e1-45d3-ad58-a05778f7fbf0 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1472 microversion: 2.1 time: 0.189840 Oct 05 18:15:36.219830 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3207/6168] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:36 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:36.364806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e5976904-570c-4ceb-9910-0dc4610d5ff0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:36.375630 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e5976904-570c-4ceb-9910-0dc4610d5ff0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.171043 Oct 05 18:15:36.376218 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2962/6169] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:36 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:36.399691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4c2ec2df-8128-450a-a0f9-b85b3154b0ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:36.400335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4c2ec2df-8128-450a-a0f9-b85b3154b0ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:36.407045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c2ec2df-8128-450a-a0f9-b85b3154b0ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:36.407547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c2ec2df-8128-450a-a0f9-b85b3154b0ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:36.407994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c2ec2df-8128-450a-a0f9-b85b3154b0ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:36.408704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c2ec2df-8128-450a-a0f9-b85b3154b0ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:36.409225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c2ec2df-8128-450a-a0f9-b85b3154b0ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:36.409635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c2ec2df-8128-450a-a0f9-b85b3154b0ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:36.557410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c2ec2df-8128-450a-a0f9-b85b3154b0ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:36.569036 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4c2ec2df-8128-450a-a0f9-b85b3154b0ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.173332 Oct 05 18:15:36.569674 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3208/6170] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:36 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:36.595157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d182101-1cc6-4ba1-ab3a-66c367d81886 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:36.595653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6d182101-1cc6-4ba1-ab3a-66c367d81886 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: dcc0e7ee-47e1-4803-9068-424cbc86515a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:36.602776 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-6d182101-1cc6-4ba1-ab3a-66c367d81886 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance dcc0e7ee-47e1-4803-9068-424cbc86515a could not be found. Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d182101-1cc6-4ba1-ab3a-66c367d81886 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/dcc0e7ee-47e1-4803-9068-424cbc86515a HTTP/1.1 Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance dcc0e7ee-47e1-4803-9068-424cbc86515a could not be found. Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'dcc0e7ee-47e1-4803-9068-424cbc86515a'} Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcc0e7ee-47e1-4803-9068-424cbc86515a could not be found. Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcc0e7ee-47e1-4803-9068-424cbc86515a could not be found. Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.604734 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcc0e7ee-47e1-4803-9068-424cbc86515a could not be found. Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d182101-1cc6-4ba1-ab3a-66c367d81886 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance dcc0e7ee-47e1-4803-9068-424cbc86515a could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6d182101-1cc6-4ba1-ab3a-66c367d81886 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "DELETE /compute/v2.1/servers/dcc0e7ee-47e1-4803-9068-424cbc86515a" status: 404 len: 111 microversion: 2.1 time: 0.016343 Oct 05 18:15:36.609690 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2963/6171] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:15:36 2022] DELETE /compute/v2.1/servers/dcc0e7ee-47e1-4803-9068-424cbc86515a => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:36.617156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a4a736ec-581f-4406-9486-28c37022f524 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:36.617946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a4a736ec-581f-4406-9486-28c37022f524 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:36.625428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a736ec-581f-4406-9486-28c37022f524 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:36.625856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a736ec-581f-4406-9486-28c37022f524 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:36.626309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a736ec-581f-4406-9486-28c37022f524 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:36.627837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a736ec-581f-4406-9486-28c37022f524 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:36.628444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a736ec-581f-4406-9486-28c37022f524 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:36.628992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a4a736ec-581f-4406-9486-28c37022f524 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:36.781008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a4a736ec-581f-4406-9486-28c37022f524 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:36.789450 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a4a736ec-581f-4406-9486-28c37022f524 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.178246 Oct 05 18:15:36.790026 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3209/6172] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:36 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:36.812495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-61fe2d48-eaaa-450c-acfe-559aa669a667 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:36.813105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-61fe2d48-eaaa-450c-acfe-559aa669a667 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:36.822191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fe2d48-eaaa-450c-acfe-559aa669a667 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:36.822859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fe2d48-eaaa-450c-acfe-559aa669a667 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:36.823056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fe2d48-eaaa-450c-acfe-559aa669a667 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:36.823731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fe2d48-eaaa-450c-acfe-559aa669a667 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:36.824215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fe2d48-eaaa-450c-acfe-559aa669a667 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:36.824640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61fe2d48-eaaa-450c-acfe-559aa669a667 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:36.967338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-61fe2d48-eaaa-450c-acfe-559aa669a667 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:36.975963 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-61fe2d48-eaaa-450c-acfe-559aa669a667 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.167333 Oct 05 18:15:36.976578 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2964/6173] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:36 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:36.998647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cd083638-cc5a-41f9-a055-f9acdbfd0c93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:36.999135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cd083638-cc5a-41f9-a055-f9acdbfd0c93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 18:15:36.999661 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-cd083638-cc5a-41f9-a055-f9acdbfd0c93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cd083638-cc5a-41f9-a055-f9acdbfd0c93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 9223372036854775808 could not be found. Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '9223372036854775808'} Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:37.001170 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:37.006004 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:37.006004 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:37.006004 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:37.006004 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 05 18:15:37.006004 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.006004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cd083638-cc5a-41f9-a055-f9acdbfd0c93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:37.006004 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cd083638-cc5a-41f9-a055-f9acdbfd0c93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008206 Oct 05 18:15:37.006004 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3210/6174] 10.222.0.70 () {58 vars in 1188 bytes} [Wed Oct 5 18:15:36 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 9 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 05 18:15:37.012212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d464dcd5-268b-47d8-ad94-474684f63989 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:37.012838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d464dcd5-268b-47d8-ad94-474684f63989 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:37.019989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d464dcd5-268b-47d8-ad94-474684f63989 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.020465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d464dcd5-268b-47d8-ad94-474684f63989 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.020924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d464dcd5-268b-47d8-ad94-474684f63989 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.021635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d464dcd5-268b-47d8-ad94-474684f63989 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.022093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d464dcd5-268b-47d8-ad94-474684f63989 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.022544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d464dcd5-268b-47d8-ad94-474684f63989 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.158777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d464dcd5-268b-47d8-ad94-474684f63989 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:37.166749 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d464dcd5-268b-47d8-ad94-474684f63989 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.158494 Oct 05 18:15:37.167333 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2965/6175] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:37 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:37.190796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6925190b-2e56-4752-89d8-080ac376cb7d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:37.191421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6925190b-2e56-4752-89d8-080ac376cb7d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:37.198611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6925190b-2e56-4752-89d8-080ac376cb7d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.199118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6925190b-2e56-4752-89d8-080ac376cb7d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.199572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6925190b-2e56-4752-89d8-080ac376cb7d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.200277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6925190b-2e56-4752-89d8-080ac376cb7d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.200817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6925190b-2e56-4752-89d8-080ac376cb7d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.201235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6925190b-2e56-4752-89d8-080ac376cb7d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.244193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f6a9354d-e5f1-43de-97d1-09817671dc02 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:37.244816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f6a9354d-e5f1-43de-97d1-09817671dc02 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:37.251094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a9354d-e5f1-43de-97d1-09817671dc02 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.251594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a9354d-e5f1-43de-97d1-09817671dc02 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.252033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a9354d-e5f1-43de-97d1-09817671dc02 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.252743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a9354d-e5f1-43de-97d1-09817671dc02 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.253245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a9354d-e5f1-43de-97d1-09817671dc02 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.253699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6a9354d-e5f1-43de-97d1-09817671dc02 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.333120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6925190b-2e56-4752-89d8-080ac376cb7d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:37.341509 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6925190b-2e56-4752-89d8-080ac376cb7d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.154960 Oct 05 18:15:37.342108 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3211/6176] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:37 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:37.364556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54e647a3-d28d-47d0-96d3-9ab692dbceaa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:37.365121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-54e647a3-d28d-47d0-96d3-9ab692dbceaa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Failed to fetch instance by id -1 {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 05 18:15:37.365754 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-54e647a3-d28d-47d0-96d3-9ab692dbceaa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance -1 could not be found. Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54e647a3-d28d-47d0-96d3-9ab692dbceaa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance -1 could not be found. Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '-1'} Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:37.367392 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:37.372674 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:37.372674 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:37.372674 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 05 18:15:37.372674 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.372674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-54e647a3-d28d-47d0-96d3-9ab692dbceaa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:37.372674 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-54e647a3-d28d-47d0-96d3-9ab692dbceaa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.010189 Oct 05 18:15:37.372674 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3212/6177] 10.222.0.70 () {58 vars in 1137 bytes} [Wed Oct 5 18:15:37 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 05 18:15:37.379942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a556726-bf73-4671-92b4-ac19cbe45d7c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:37.380678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4a556726-bf73-4671-92b4-ac19cbe45d7c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:37.388000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a556726-bf73-4671-92b4-ac19cbe45d7c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.388608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a556726-bf73-4671-92b4-ac19cbe45d7c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.389119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a556726-bf73-4671-92b4-ac19cbe45d7c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.389878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a556726-bf73-4671-92b4-ac19cbe45d7c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.390495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a556726-bf73-4671-92b4-ac19cbe45d7c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.390946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a556726-bf73-4671-92b4-ac19cbe45d7c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.402831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f6a9354d-e5f1-43de-97d1-09817671dc02 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:37.411292 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f6a9354d-e5f1-43de-97d1-09817671dc02 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1642 microversion: 2.1 time: 0.171213 Oct 05 18:15:37.411885 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2966/6178] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:37 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1642 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:37.434381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-13b6a439-630f-4bf9-b028-4b64be2b5258 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:37.435293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-13b6a439-630f-4bf9-b028-4b64be2b5258 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:37.441468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13b6a439-630f-4bf9-b028-4b64be2b5258 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.442034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13b6a439-630f-4bf9-b028-4b64be2b5258 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.442585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13b6a439-630f-4bf9-b028-4b64be2b5258 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.443356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13b6a439-630f-4bf9-b028-4b64be2b5258 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.443873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13b6a439-630f-4bf9-b028-4b64be2b5258 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.444358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-13b6a439-630f-4bf9-b028-4b64be2b5258 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.463960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=100 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:37.525939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4a556726-bf73-4671-92b4-ac19cbe45d7c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:37.526891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:37.534207 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4a556726-bf73-4671-92b4-ac19cbe45d7c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.158497 Oct 05 18:15:37.534829 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3213/6179] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:37 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:37.549075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=12 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:37.557655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a7d02a4d-81f0-4057-85cd-8ca4f7684fe8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:37.558248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a7d02a4d-81f0-4057-85cd-8ca4f7684fe8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:37.564560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7d02a4d-81f0-4057-85cd-8ca4f7684fe8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.565062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7d02a4d-81f0-4057-85cd-8ca4f7684fe8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.565509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7d02a4d-81f0-4057-85cd-8ca4f7684fe8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.566226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7d02a4d-81f0-4057-85cd-8ca4f7684fe8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.566731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7d02a4d-81f0-4057-85cd-8ca4f7684fe8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.567168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7d02a4d-81f0-4057-85cd-8ca4f7684fe8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.596619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-13b6a439-630f-4bf9-b028-4b64be2b5258 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:37.604766 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-13b6a439-630f-4bf9-b028-4b64be2b5258 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1642 microversion: 2.1 time: 0.174396 Oct 05 18:15:37.605357 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2967/6180] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:37 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1642 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:37.627160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a994844c-2135-4f8b-91ed-3453638bc293 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:37.627777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a994844c-2135-4f8b-91ed-3453638bc293 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:37.635224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a994844c-2135-4f8b-91ed-3453638bc293 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.636027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a994844c-2135-4f8b-91ed-3453638bc293 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.636737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a994844c-2135-4f8b-91ed-3453638bc293 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.637452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a994844c-2135-4f8b-91ed-3453638bc293 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.637926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a994844c-2135-4f8b-91ed-3453638bc293 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.638478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a994844c-2135-4f8b-91ed-3453638bc293 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.705104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:37.708979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7d02a4d-81f0-4057-85cd-8ca4f7684fe8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:37.717501 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a7d02a4d-81f0-4057-85cd-8ca4f7684fe8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.163844 Oct 05 18:15:37.718346 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3214/6181] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:37 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:37.740377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99299159-405a-497c-bf04-38c3f018f50c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:37.740939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99299159-405a-497c-bf04-38c3f018f50c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 9e68da05-0572-4f6f-888f-6bdf1c6264ba] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:37.746721 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-99299159-405a-497c-bf04-38c3f018f50c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 9e68da05-0572-4f6f-888f-6bdf1c6264ba could not be found. Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99299159-405a-497c-bf04-38c3f018f50c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/9e68da05-0572-4f6f-888f-6bdf1c6264ba/action HTTP/1.1 Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 19 Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: {"forceDelete": {}} Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 9e68da05-0572-4f6f-888f-6bdf1c6264ba could not be found. Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '9e68da05-0572-4f6f-888f-6bdf1c6264ba', 'body': {'forceDelete': {}}} Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e68da05-0572-4f6f-888f-6bdf1c6264ba could not be found. Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e68da05-0572-4f6f-888f-6bdf1c6264ba could not be found. Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:37.759666 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:37.764414 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:37.764414 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:37.764414 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e68da05-0572-4f6f-888f-6bdf1c6264ba could not be found. Oct 05 18:15:37.764414 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:37.764414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99299159-405a-497c-bf04-38c3f018f50c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 9e68da05-0572-4f6f-888f-6bdf1c6264ba could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:37.764414 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99299159-405a-497c-bf04-38c3f018f50c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/9e68da05-0572-4f6f-888f-6bdf1c6264ba/action" status: 404 len: 111 microversion: 2.1 time: 0.025130 Oct 05 18:15:37.764414 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3215/6182] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:37 2022] POST /compute/v2.1/servers/9e68da05-0572-4f6f-888f-6bdf1c6264ba/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:37.770496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-320204df-6f9f-4e76-97ae-cceed714bcca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:37.771198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-320204df-6f9f-4e76-97ae-cceed714bcca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:37.781006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-320204df-6f9f-4e76-97ae-cceed714bcca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.781795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-320204df-6f9f-4e76-97ae-cceed714bcca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.782371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-320204df-6f9f-4e76-97ae-cceed714bcca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.783075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-320204df-6f9f-4e76-97ae-cceed714bcca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.783549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-320204df-6f9f-4e76-97ae-cceed714bcca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.784017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-320204df-6f9f-4e76-97ae-cceed714bcca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.891025 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a994844c-2135-4f8b-91ed-3453638bc293 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1793 microversion: 2.1 time: 0.267467 Oct 05 18:15:37.902472 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2968/6183] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:37 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1793 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:37.921776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-320204df-6f9f-4e76-97ae-cceed714bcca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:37.930127 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-320204df-6f9f-4e76-97ae-cceed714bcca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.163596 Oct 05 18:15:37.930765 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3216/6184] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:37 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:37.953522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c7e483ef-f792-4188-a934-54d4e2f0d85d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:37.954231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c7e483ef-f792-4188-a934-54d4e2f0d85d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:37.960795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7e483ef-f792-4188-a934-54d4e2f0d85d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.961357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7e483ef-f792-4188-a934-54d4e2f0d85d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.961886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7e483ef-f792-4188-a934-54d4e2f0d85d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:37.962676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7e483ef-f792-4188-a934-54d4e2f0d85d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:37.963256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7e483ef-f792-4188-a934-54d4e2f0d85d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:37.963761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7e483ef-f792-4188-a934-54d4e2f0d85d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:38.202394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7e483ef-f792-4188-a934-54d4e2f0d85d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:38.210707 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c7e483ef-f792-4188-a934-54d4e2f0d85d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.261298 Oct 05 18:15:38.211284 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2969/6185] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:37 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:38.234177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-91dc2110-29e9-43f1-8ba3-90f31414a643 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:38.236645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-91dc2110-29e9-43f1-8ba3-90f31414a643 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 52f6b730-b183-48c4-bb9d-9637b840aa1a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:38.243640 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-91dc2110-29e9-43f1-8ba3-90f31414a643 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 52f6b730-b183-48c4-bb9d-9637b840aa1a could not be found. Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-91dc2110-29e9-43f1-8ba3-90f31414a643 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/52f6b730-b183-48c4-bb9d-9637b840aa1a/action HTTP/1.1 Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 39 Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: {"os-getConsoleOutput": {"length": 10}} Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 52f6b730-b183-48c4-bb9d-9637b840aa1a could not be found. Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '52f6b730-b183-48c4-bb9d-9637b840aa1a', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52f6b730-b183-48c4-bb9d-9637b840aa1a could not be found. Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52f6b730-b183-48c4-bb9d-9637b840aa1a could not be found. Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:38.251031 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:38.256775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:38.256775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:38.256775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:38.256775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:38.256775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52f6b730-b183-48c4-bb9d-9637b840aa1a could not be found. Oct 05 18:15:38.256775 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:38.256775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-91dc2110-29e9-43f1-8ba3-90f31414a643 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 52f6b730-b183-48c4-bb9d-9637b840aa1a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:38.256775 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-91dc2110-29e9-43f1-8ba3-90f31414a643 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/52f6b730-b183-48c4-bb9d-9637b840aa1a/action" status: 404 len: 111 microversion: 2.1 time: 0.022804 Oct 05 18:15:38.256775 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3217/6186] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:38 2022] POST /compute/v2.1/servers/52f6b730-b183-48c4-bb9d-9637b840aa1a/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:38.262675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dae9ef0e-dc44-41da-81f8-bccfed5f95d7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:38.263442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dae9ef0e-dc44-41da-81f8-bccfed5f95d7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:38.269989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dae9ef0e-dc44-41da-81f8-bccfed5f95d7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:38.270593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dae9ef0e-dc44-41da-81f8-bccfed5f95d7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:38.271044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dae9ef0e-dc44-41da-81f8-bccfed5f95d7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:38.271766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dae9ef0e-dc44-41da-81f8-bccfed5f95d7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:38.272309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dae9ef0e-dc44-41da-81f8-bccfed5f95d7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:38.272714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dae9ef0e-dc44-41da-81f8-bccfed5f95d7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:38.469952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dae9ef0e-dc44-41da-81f8-bccfed5f95d7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:38.478240 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dae9ef0e-dc44-41da-81f8-bccfed5f95d7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.219772 Oct 05 18:15:38.478936 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2970/6187] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:38 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:38.502310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7b84b85c-7da0-4405-bff4-9e3f7625b0e3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:38.503072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7b84b85c-7da0-4405-bff4-9e3f7625b0e3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:38.510970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b84b85c-7da0-4405-bff4-9e3f7625b0e3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:38.511485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b84b85c-7da0-4405-bff4-9e3f7625b0e3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:38.512398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b84b85c-7da0-4405-bff4-9e3f7625b0e3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:38.512921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b84b85c-7da0-4405-bff4-9e3f7625b0e3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:38.513315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b84b85c-7da0-4405-bff4-9e3f7625b0e3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:38.513760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b84b85c-7da0-4405-bff4-9e3f7625b0e3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:38.654954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7b84b85c-7da0-4405-bff4-9e3f7625b0e3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:38.663484 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7b84b85c-7da0-4405-bff4-9e3f7625b0e3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.165129 Oct 05 18:15:38.664105 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3218/6188] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:38 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:38.686048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9fa66432-fbf3-4a58-9538-57fb1ccc342d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:38.686696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9fa66432-fbf3-4a58-9538-57fb1ccc342d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 8eb48141-d811-454f-ad03-d68485348bd0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:38.692310 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9fa66432-fbf3-4a58-9538-57fb1ccc342d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 8eb48141-d811-454f-ad03-d68485348bd0 could not be found. Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9fa66432-fbf3-4a58-9538-57fb1ccc342d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/8eb48141-d811-454f-ad03-d68485348bd0 HTTP/1.1 Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 8eb48141-d811-454f-ad03-d68485348bd0 could not be found. Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '8eb48141-d811-454f-ad03-d68485348bd0'} Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8eb48141-d811-454f-ad03-d68485348bd0 could not be found. Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8eb48141-d811-454f-ad03-d68485348bd0 could not be found. Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:38.693825 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:38.699379 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:38.699379 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:38.699379 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:38.699379 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8eb48141-d811-454f-ad03-d68485348bd0 could not be found. Oct 05 18:15:38.699379 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:38.699379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9fa66432-fbf3-4a58-9538-57fb1ccc342d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 8eb48141-d811-454f-ad03-d68485348bd0 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:38.699379 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9fa66432-fbf3-4a58-9538-57fb1ccc342d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/8eb48141-d811-454f-ad03-d68485348bd0" status: 404 len: 111 microversion: 2.1 time: 0.013308 Oct 05 18:15:38.699379 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2971/6189] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:38 2022] GET /compute/v2.1/servers/8eb48141-d811-454f-ad03-d68485348bd0 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:38.704879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-05a14247-f2f1-4863-8f67-764fbfc856e6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:38.705524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-05a14247-f2f1-4863-8f67-764fbfc856e6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:38.712016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05a14247-f2f1-4863-8f67-764fbfc856e6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:38.712523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05a14247-f2f1-4863-8f67-764fbfc856e6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:38.713048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05a14247-f2f1-4863-8f67-764fbfc856e6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:38.714027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05a14247-f2f1-4863-8f67-764fbfc856e6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:38.714632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05a14247-f2f1-4863-8f67-764fbfc856e6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:38.715113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-05a14247-f2f1-4863-8f67-764fbfc856e6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:38.852472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-05a14247-f2f1-4863-8f67-764fbfc856e6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:38.860690 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-05a14247-f2f1-4863-8f67-764fbfc856e6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.160268 Oct 05 18:15:38.861560 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3219/6190] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:38 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:38.884341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3cc80867-3584-4570-8c36-4ab8e82c2864 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:38.884924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3cc80867-3584-4570-8c36-4ab8e82c2864 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:38.892628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc80867-3584-4570-8c36-4ab8e82c2864 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:38.893283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc80867-3584-4570-8c36-4ab8e82c2864 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:38.893542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc80867-3584-4570-8c36-4ab8e82c2864 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:38.894223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc80867-3584-4570-8c36-4ab8e82c2864 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:38.894704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc80867-3584-4570-8c36-4ab8e82c2864 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:38.895126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3cc80867-3584-4570-8c36-4ab8e82c2864 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:39.107489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3cc80867-3584-4570-8c36-4ab8e82c2864 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:39.115869 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3cc80867-3584-4570-8c36-4ab8e82c2864 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.235375 Oct 05 18:15:39.116533 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2972/6191] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:38 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:39.181182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-116acbcc-d61c-440a-9c85-0eb539cc16e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1768259611", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-116acbcc-d61c-440a-9c85-0eb539cc16e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 238 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1768259611", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1768259611', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.217222 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-116acbcc-d61c-440a-9c85-0eb539cc16e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-116acbcc-d61c-440a-9c85-0eb539cc16e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.042873 Oct 05 18:15:39.222422 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3220/6192] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:39 2022] POST /compute/v2.1/servers => generated 139 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:15:39.229643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a8d80f7-12fe-4f94-bba3-e59825a3ba55 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:39.230264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0a8d80f7-12fe-4f94-bba3-e59825a3ba55 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:39.236499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a8d80f7-12fe-4f94-bba3-e59825a3ba55 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:39.236978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a8d80f7-12fe-4f94-bba3-e59825a3ba55 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:39.237436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a8d80f7-12fe-4f94-bba3-e59825a3ba55 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:39.238138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a8d80f7-12fe-4f94-bba3-e59825a3ba55 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:39.238632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a8d80f7-12fe-4f94-bba3-e59825a3ba55 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:39.239064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a8d80f7-12fe-4f94-bba3-e59825a3ba55 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:39.486793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0a8d80f7-12fe-4f94-bba3-e59825a3ba55 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:39.495426 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0a8d80f7-12fe-4f94-bba3-e59825a3ba55 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.269660 Oct 05 18:15:39.496233 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2973/6193] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:39 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:39.519980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7cc44387-3029-4705-9031-3868187a31cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:39.520614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7cc44387-3029-4705-9031-3868187a31cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:39.528528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc44387-3029-4705-9031-3868187a31cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:39.529084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc44387-3029-4705-9031-3868187a31cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:39.529520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc44387-3029-4705-9031-3868187a31cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:39.530226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc44387-3029-4705-9031-3868187a31cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:39.530752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc44387-3029-4705-9031-3868187a31cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:39.531200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7cc44387-3029-4705-9031-3868187a31cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:39.668516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7cc44387-3029-4705-9031-3868187a31cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:39.677410 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7cc44387-3029-4705-9031-3868187a31cd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.161920 Oct 05 18:15:39.678096 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3221/6194] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:39 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:39.743031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b7b36e9-8e3f-4364-bc03-5df6a45fb92c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-920925611", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b7b36e9-8e3f-4364-bc03-5df6a45fb92c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 234 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-920925611", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-920925611', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.748698 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b7b36e9-8e3f-4364-bc03-5df6a45fb92c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7b7b36e9-8e3f-4364-bc03-5df6a45fb92c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.011323 Oct 05 18:15:39.754779 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2974/6195] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:39 2022] POST /compute/v2.1/servers => generated 133 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:15:39.761403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c4a5ecd-0bb2-4014-9ff7-5df8b68e0e25 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:39.762099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c4a5ecd-0bb2-4014-9ff7-5df8b68e0e25 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:39.768569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c4a5ecd-0bb2-4014-9ff7-5df8b68e0e25 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:39.769073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c4a5ecd-0bb2-4014-9ff7-5df8b68e0e25 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:39.769520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c4a5ecd-0bb2-4014-9ff7-5df8b68e0e25 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:39.770219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c4a5ecd-0bb2-4014-9ff7-5df8b68e0e25 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:39.770750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c4a5ecd-0bb2-4014-9ff7-5df8b68e0e25 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:39.771229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c4a5ecd-0bb2-4014-9ff7-5df8b68e0e25 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:39.911073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0c4a5ecd-0bb2-4014-9ff7-5df8b68e0e25 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:39.919400 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0c4a5ecd-0bb2-4014-9ff7-5df8b68e0e25 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.163919 Oct 05 18:15:39.920108 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3222/6196] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:39 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:39.943123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3eecdbbd-7639-4774-be55-c9c841bee139 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:39.943814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3eecdbbd-7639-4774-be55-c9c841bee139 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:39.948021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:39.954210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3eecdbbd-7639-4774-be55-c9c841bee139 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:39.954732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3eecdbbd-7639-4774-be55-c9c841bee139 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:39.955170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3eecdbbd-7639-4774-be55-c9c841bee139 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:39.956045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3eecdbbd-7639-4774-be55-c9c841bee139 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:39.956532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3eecdbbd-7639-4774-be55-c9c841bee139 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:39.956993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3eecdbbd-7639-4774-be55-c9c841bee139 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:40.280968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3eecdbbd-7639-4774-be55-c9c841bee139 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:40.289794 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3eecdbbd-7639-4774-be55-c9c841bee139 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.350679 Oct 05 18:15:40.302453 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2975/6197] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:39 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:40.306175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-49883022-a034-486e-bf23-5588b0eca479 req-2ea35889-112f-4a51-a2bc-958e6349bc39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41cb647d-f404-486a-9a12-dc535f360fbb", "tag": "fb9b6997-df7d-441d-810b-eeee0ee56ce3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:40.316174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5fd50a23-5274-4fcd-aa68-ec99c7e5978e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:40.316706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5fd50a23-5274-4fcd-aa68-ec99c7e5978e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a350cd46-1b66-4cea-8258-6b510516d263] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:40.323170 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-5fd50a23-5274-4fcd-aa68-ec99c7e5978e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance a350cd46-1b66-4cea-8258-6b510516d263 could not be found. Oct 05 18:15:40.323781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-49883022-a034-486e-bf23-5588b0eca479 req-2ea35889-112f-4a51-a2bc-958e6349bc39 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:40.324282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-49883022-a034-486e-bf23-5588b0eca479 req-2ea35889-112f-4a51-a2bc-958e6349bc39 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:40.324934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-49883022-a034-486e-bf23-5588b0eca479 req-2ea35889-112f-4a51-a2bc-958e6349bc39 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5fd50a23-5274-4fcd-aa68-ec99c7e5978e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/a350cd46-1b66-4cea-8258-6b510516d263/action HTTP/1.1 Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 13 Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: {"pause": {}} Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a350cd46-1b66-4cea-8258-6b510516d263 could not be found. Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a350cd46-1b66-4cea-8258-6b510516d263', 'body': {'pause': {}}} Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a350cd46-1b66-4cea-8258-6b510516d263 could not be found. Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a350cd46-1b66-4cea-8258-6b510516d263 could not be found. Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:40.328124 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:40.333606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:40.333606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:40.333606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a350cd46-1b66-4cea-8258-6b510516d263 could not be found. Oct 05 18:15:40.333606 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:40.334123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5fd50a23-5274-4fcd-aa68-ec99c7e5978e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance a350cd46-1b66-4cea-8258-6b510516d263 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:40.335619 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5fd50a23-5274-4fcd-aa68-ec99c7e5978e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/a350cd46-1b66-4cea-8258-6b510516d263/action" status: 404 len: 111 microversion: 2.1 time: 0.023013 Oct 05 18:15:40.337274 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2976/6198] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:40 2022] POST /compute/v2.1/servers/a350cd46-1b66-4cea-8258-6b510516d263/action => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:15:40.346834 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-49883022-a034-486e-bf23-5588b0eca479 req-2ea35889-112f-4a51-a2bc-958e6349bc39 service nova] Creating event network-changed:fb9b6997-df7d-441d-810b-eeee0ee56ce3 for instance 41cb647d-f404-486a-9a12-dc535f360fbb on n-h2-835595-3 Oct 05 18:15:40.348949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-30130ec9-7c92-4542-9710-2394bab665e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:40.349807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30130ec9-7c92-4542-9710-2394bab665e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:40.352061 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-49883022-a034-486e-bf23-5588b0eca479 req-2ea35889-112f-4a51-a2bc-958e6349bc39 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051763 Oct 05 18:15:40.353183 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3223/6199] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:15:40.359640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30130ec9-7c92-4542-9710-2394bab665e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:40.361962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30130ec9-7c92-4542-9710-2394bab665e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:40.362455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30130ec9-7c92-4542-9710-2394bab665e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:40.363183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30130ec9-7c92-4542-9710-2394bab665e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:40.363840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30130ec9-7c92-4542-9710-2394bab665e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:40.366200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30130ec9-7c92-4542-9710-2394bab665e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:40.532246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-30130ec9-7c92-4542-9710-2394bab665e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:40.542987 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-30130ec9-7c92-4542-9710-2394bab665e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.201893 Oct 05 18:15:40.543592 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2977/6200] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:40 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:40.568075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1728fbc6-0d64-4461-8d81-f103fe741216 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:40.568694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1728fbc6-0d64-4461-8d81-f103fe741216 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:40.575250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1728fbc6-0d64-4461-8d81-f103fe741216 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:40.576046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1728fbc6-0d64-4461-8d81-f103fe741216 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:40.576685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1728fbc6-0d64-4461-8d81-f103fe741216 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:40.577763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1728fbc6-0d64-4461-8d81-f103fe741216 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:40.578441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1728fbc6-0d64-4461-8d81-f103fe741216 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:40.581617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1728fbc6-0d64-4461-8d81-f103fe741216 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:40.817499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1728fbc6-0d64-4461-8d81-f103fe741216 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:40.826934 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1728fbc6-0d64-4461-8d81-f103fe741216 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.264304 Oct 05 18:15:40.835058 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3224/6201] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:40 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:40.849451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b6937497-0a8a-4107-8b85-3959b1c7c841 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:40.850140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b6937497-0a8a-4107-8b85-3959b1c7c841 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:40.856518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6937497-0a8a-4107-8b85-3959b1c7c841 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:40.857158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6937497-0a8a-4107-8b85-3959b1c7c841 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:40.857660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6937497-0a8a-4107-8b85-3959b1c7c841 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:40.858491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6937497-0a8a-4107-8b85-3959b1c7c841 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:40.859217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6937497-0a8a-4107-8b85-3959b1c7c841 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:40.859721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6937497-0a8a-4107-8b85-3959b1c7c841 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:40.951783 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b6937497-0a8a-4107-8b85-3959b1c7c841 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.106185 Oct 05 18:15:40.952821 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2978/6202] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:40 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:15:40.968673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ca004383-1af2-4a60-afe1-aa96b6c7ff99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:40.969462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ca004383-1af2-4a60-afe1-aa96b6c7ff99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:40.981357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca004383-1af2-4a60-afe1-aa96b6c7ff99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:40.982117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca004383-1af2-4a60-afe1-aa96b6c7ff99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:40.985376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca004383-1af2-4a60-afe1-aa96b6c7ff99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:40.986590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca004383-1af2-4a60-afe1-aa96b6c7ff99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:40.987179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca004383-1af2-4a60-afe1-aa96b6c7ff99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:40.987737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ca004383-1af2-4a60-afe1-aa96b6c7ff99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:41.161688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ca004383-1af2-4a60-afe1-aa96b6c7ff99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:41.171166 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ca004383-1af2-4a60-afe1-aa96b6c7ff99 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1510 microversion: 2.1 time: 0.212340 Oct 05 18:15:41.172288 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3225/6203] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:40 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:15:42.196191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3bb5c3e8-ce72-458b-83de-5b87cc12738d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:42.196898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3bb5c3e8-ce72-458b-83de-5b87cc12738d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:42.204203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bb5c3e8-ce72-458b-83de-5b87cc12738d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:42.204769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bb5c3e8-ce72-458b-83de-5b87cc12738d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:42.205209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bb5c3e8-ce72-458b-83de-5b87cc12738d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:42.205917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bb5c3e8-ce72-458b-83de-5b87cc12738d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:42.206407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bb5c3e8-ce72-458b-83de-5b87cc12738d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:42.206840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3bb5c3e8-ce72-458b-83de-5b87cc12738d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:42.349766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3bb5c3e8-ce72-458b-83de-5b87cc12738d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:42.360484 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3bb5c3e8-ce72-458b-83de-5b87cc12738d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1490 microversion: 2.1 time: 0.169643 Oct 05 18:15:42.361205 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2979/6204] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:42 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1490 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:42.383636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:42.384228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:42.391624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:42.392138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:42.392594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:42.393364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:42.393874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:42.394389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:42.421934 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Cannot 'pause' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state paused Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action HTTP/1.1 Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 13 Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: {"pause": {}} Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot 'pause' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state paused Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4a04f9c9-bdcf-4353-b6ae-627e1916d0a2', 'body': {'pause': {}}} Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 in vm_state paused. Cannot pause while the instance is in this state. Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state paused Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:42.423918 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:42.429067 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:42.429067 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:42.429067 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:42.429067 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state paused Oct 05 18:15:42.429067 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:42.429067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 409 to user: Cannot 'pause' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state paused {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:42.429067 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4a3762c9-7972-4788-ad4f-7ca95b7944e2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 409 len: 143 microversion: 2.1 time: 0.046288 Oct 05 18:15:42.429067 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3226/6205] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:42 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 143 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 18:15:42.435196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb4ac8bf-3fb3-40ec-8c89-a58e028166f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:42.435854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eb4ac8bf-3fb3-40ec-8c89-a58e028166f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:42.442517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb4ac8bf-3fb3-40ec-8c89-a58e028166f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:42.443065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb4ac8bf-3fb3-40ec-8c89-a58e028166f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:42.443677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb4ac8bf-3fb3-40ec-8c89-a58e028166f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:42.444414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb4ac8bf-3fb3-40ec-8c89-a58e028166f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:42.444889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb4ac8bf-3fb3-40ec-8c89-a58e028166f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:42.445317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb4ac8bf-3fb3-40ec-8c89-a58e028166f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:42.519390 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb4ac8bf-3fb3-40ec-8c89-a58e028166f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.088332 Oct 05 18:15:42.520402 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2980/6206] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:42 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 18:15:42.530737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7a03616e-22a8-4d24-be2e-32168ba01bfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:42.531924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7a03616e-22a8-4d24-be2e-32168ba01bfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:42.539757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a03616e-22a8-4d24-be2e-32168ba01bfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:42.540326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a03616e-22a8-4d24-be2e-32168ba01bfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:42.541010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a03616e-22a8-4d24-be2e-32168ba01bfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:42.541803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a03616e-22a8-4d24-be2e-32168ba01bfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:42.542483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a03616e-22a8-4d24-be2e-32168ba01bfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:42.542967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7a03616e-22a8-4d24-be2e-32168ba01bfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:42.559925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:42.679714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7a03616e-22a8-4d24-be2e-32168ba01bfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:42.688449 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7a03616e-22a8-4d24-be2e-32168ba01bfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1497 microversion: 2.1 time: 0.162207 Oct 05 18:15:42.689127 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3227/6207] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:42 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:43.717390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0f1a5abb-e46e-4653-a860-98c5ea83e0e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:43.718045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0f1a5abb-e46e-4653-a860-98c5ea83e0e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:43.725699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f1a5abb-e46e-4653-a860-98c5ea83e0e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:43.726186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f1a5abb-e46e-4653-a860-98c5ea83e0e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:43.726654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f1a5abb-e46e-4653-a860-98c5ea83e0e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:43.727352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f1a5abb-e46e-4653-a860-98c5ea83e0e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:43.727808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f1a5abb-e46e-4653-a860-98c5ea83e0e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:43.728231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0f1a5abb-e46e-4653-a860-98c5ea83e0e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:43.873399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0f1a5abb-e46e-4653-a860-98c5ea83e0e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:43.881834 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0f1a5abb-e46e-4653-a860-98c5ea83e0e4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.170564 Oct 05 18:15:43.882455 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2981/6208] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:43 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:43.906084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e861d62-a39f-444a-80a5-9d17e900fbbd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:43.906849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e861d62-a39f-444a-80a5-9d17e900fbbd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:43.914262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e861d62-a39f-444a-80a5-9d17e900fbbd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:43.914805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e861d62-a39f-444a-80a5-9d17e900fbbd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:43.915271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e861d62-a39f-444a-80a5-9d17e900fbbd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:43.916003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e861d62-a39f-444a-80a5-9d17e900fbbd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:43.916479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e861d62-a39f-444a-80a5-9d17e900fbbd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:43.916924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e861d62-a39f-444a-80a5-9d17e900fbbd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.056227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e861d62-a39f-444a-80a5-9d17e900fbbd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:44.067420 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e861d62-a39f-444a-80a5-9d17e900fbbd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.165002 Oct 05 18:15:44.068331 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3228/6209] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:43 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:44.094965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:44.098039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:44.106371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.107100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.107534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.108227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.108673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.109090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.122725 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b/action HTTP/1.1 Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 28 Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: {"reboot": {"type": "SOFT"}} Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a1905f8f-fbbf-4879-8cc5-0f5ea454019b', 'body': {'reboot': {'type': 'SOFT'}}} Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:44.124455 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0426ab41-1eff-4f60-94e5-46039b540c57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b/action" status: 404 len: 111 microversion: 2.1 time: 0.037071 Oct 05 18:15:44.129141 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2982/6210] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:44 2022] POST /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:15:44.135241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c97968bb-602d-4e68-8c31-3011ef43bc5c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:44.135897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c97968bb-602d-4e68-8c31-3011ef43bc5c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:44.142317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c97968bb-602d-4e68-8c31-3011ef43bc5c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.142913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c97968bb-602d-4e68-8c31-3011ef43bc5c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.143363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c97968bb-602d-4e68-8c31-3011ef43bc5c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.144064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c97968bb-602d-4e68-8c31-3011ef43bc5c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.144537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c97968bb-602d-4e68-8c31-3011ef43bc5c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.145001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c97968bb-602d-4e68-8c31-3011ef43bc5c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.277352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c97968bb-602d-4e68-8c31-3011ef43bc5c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:44.285931 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c97968bb-602d-4e68-8c31-3011ef43bc5c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.154700 Oct 05 18:15:44.286561 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3229/6211] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:44 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:44.311048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b6be9f85-de28-4354-9474-a886188ceb4a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:44.311669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b6be9f85-de28-4354-9474-a886188ceb4a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:44.318036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6be9f85-de28-4354-9474-a886188ceb4a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.318560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6be9f85-de28-4354-9474-a886188ceb4a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.319003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6be9f85-de28-4354-9474-a886188ceb4a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.319696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6be9f85-de28-4354-9474-a886188ceb4a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.320149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6be9f85-de28-4354-9474-a886188ceb4a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.320573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b6be9f85-de28-4354-9474-a886188ceb4a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.463542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b6be9f85-de28-4354-9474-a886188ceb4a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:44.473465 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b6be9f85-de28-4354-9474-a886188ceb4a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.166300 Oct 05 18:15:44.476038 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2983/6212] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:44 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:44.498328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43264878-8838-4956-8778-cfb4e8bd1a57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:44.500596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-43264878-8838-4956-8778-cfb4e8bd1a57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 3ee746a9-4afc-451b-b9f9-105e82d9e266] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:44.507087 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-43264878-8838-4956-8778-cfb4e8bd1a57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 3ee746a9-4afc-451b-b9f9-105e82d9e266 could not be found. Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43264878-8838-4956-8778-cfb4e8bd1a57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/3ee746a9-4afc-451b-b9f9-105e82d9e266/action HTTP/1.1 Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 28 Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: {"reboot": {"type": "SOFT"}} Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 3ee746a9-4afc-451b-b9f9-105e82d9e266 could not be found. Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '3ee746a9-4afc-451b-b9f9-105e82d9e266', 'body': {'reboot': {'type': 'SOFT'}}} Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ee746a9-4afc-451b-b9f9-105e82d9e266 could not be found. Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ee746a9-4afc-451b-b9f9-105e82d9e266 could not be found. Oct 05 18:15:44.508659 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ee746a9-4afc-451b-b9f9-105e82d9e266 could not be found. Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43264878-8838-4956-8778-cfb4e8bd1a57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 3ee746a9-4afc-451b-b9f9-105e82d9e266 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-43264878-8838-4956-8778-cfb4e8bd1a57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/3ee746a9-4afc-451b-b9f9-105e82d9e266/action" status: 404 len: 111 microversion: 2.1 time: 0.016088 Oct 05 18:15:44.513531 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3230/6213] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:44 2022] POST /compute/v2.1/servers/3ee746a9-4afc-451b-b9f9-105e82d9e266/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:44.518726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-893761e7-9fa7-4b20-92b7-4c5824c049f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:44.519350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-893761e7-9fa7-4b20-92b7-4c5824c049f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:44.525712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-893761e7-9fa7-4b20-92b7-4c5824c049f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.526125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-893761e7-9fa7-4b20-92b7-4c5824c049f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.526590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-893761e7-9fa7-4b20-92b7-4c5824c049f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.527285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-893761e7-9fa7-4b20-92b7-4c5824c049f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.527769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-893761e7-9fa7-4b20-92b7-4c5824c049f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.528191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-893761e7-9fa7-4b20-92b7-4c5824c049f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.666743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-893761e7-9fa7-4b20-92b7-4c5824c049f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:44.674769 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-893761e7-9fa7-4b20-92b7-4c5824c049f4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.159879 Oct 05 18:15:44.675340 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2984/6214] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:44 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:44.697873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-11804226-83ab-4ab3-995a-80a26782aadd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:44.698544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-11804226-83ab-4ab3-995a-80a26782aadd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:44.706175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11804226-83ab-4ab3-995a-80a26782aadd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.706712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11804226-83ab-4ab3-995a-80a26782aadd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.707171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11804226-83ab-4ab3-995a-80a26782aadd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.707883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11804226-83ab-4ab3-995a-80a26782aadd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.708359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11804226-83ab-4ab3-995a-80a26782aadd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.708803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11804226-83ab-4ab3-995a-80a26782aadd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.858646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11804226-83ab-4ab3-995a-80a26782aadd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:44.866748 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-11804226-83ab-4ab3-995a-80a26782aadd tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.172868 Oct 05 18:15:44.867414 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3231/6215] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:44 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:44.889913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:44.892752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:44.900177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.900657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.901094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.901798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.902242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.902699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.919288 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b/action HTTP/1.1 Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 65 Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a1905f8f-fbbf-4879-8cc5-0f5ea454019b', 'body': {'rebuild': {'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e'}}} Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 05 18:15:44.920980 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fcd7d08c-36fb-469d-9a70-0685f5c62b95 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b/action" status: 404 len: 111 microversion: 2.1 time: 0.036654 Oct 05 18:15:44.926538 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2985/6216] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:44 2022] POST /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:44.932509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f70e46d6-9438-4b90-9e37-744113f18921 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:44.933148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f70e46d6-9438-4b90-9e37-744113f18921 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:44.940649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f70e46d6-9438-4b90-9e37-744113f18921 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.941156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f70e46d6-9438-4b90-9e37-744113f18921 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.941612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f70e46d6-9438-4b90-9e37-744113f18921 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:44.942323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f70e46d6-9438-4b90-9e37-744113f18921 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:44.942827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f70e46d6-9438-4b90-9e37-744113f18921 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:44.943274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f70e46d6-9438-4b90-9e37-744113f18921 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:45.083943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f70e46d6-9438-4b90-9e37-744113f18921 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:45.092625 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f70e46d6-9438-4b90-9e37-744113f18921 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.164301 Oct 05 18:15:45.093211 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3232/6217] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:44 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:45.115555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-549500e7-aa15-4748-a758-197ca4a7e780 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:45.116178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-549500e7-aa15-4748-a758-197ca4a7e780 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:45.123384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549500e7-aa15-4748-a758-197ca4a7e780 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:45.127570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549500e7-aa15-4748-a758-197ca4a7e780 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:45.127570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549500e7-aa15-4748-a758-197ca4a7e780 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:45.127570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549500e7-aa15-4748-a758-197ca4a7e780 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:45.127570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549500e7-aa15-4748-a758-197ca4a7e780 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:45.127570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-549500e7-aa15-4748-a758-197ca4a7e780 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:45.147411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:45.268239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-549500e7-aa15-4748-a758-197ca4a7e780 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:45.276558 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-549500e7-aa15-4748-a758-197ca4a7e780 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.164914 Oct 05 18:15:45.277138 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2986/6218] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:45 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:45.299195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3405e113-6c60-4178-95ca-54f56351c25c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:45.302013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3405e113-6c60-4178-95ca-54f56351c25c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: fb3973cf-218d-467a-ac33-c6e8dc419cc5] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:45.308078 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-3405e113-6c60-4178-95ca-54f56351c25c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance fb3973cf-218d-467a-ac33-c6e8dc419cc5 could not be found. Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3405e113-6c60-4178-95ca-54f56351c25c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/fb3973cf-218d-467a-ac33-c6e8dc419cc5/action HTTP/1.1 Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 65 Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: {"rebuild": {"imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e"}} Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance fb3973cf-218d-467a-ac33-c6e8dc419cc5 could not be found. Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'fb3973cf-218d-467a-ac33-c6e8dc419cc5', 'body': {'rebuild': {'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e'}}} Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb3973cf-218d-467a-ac33-c6e8dc419cc5 could not be found. Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 05 18:15:45.309718 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb3973cf-218d-467a-ac33-c6e8dc419cc5 could not be found. Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb3973cf-218d-467a-ac33-c6e8dc419cc5 could not be found. Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3405e113-6c60-4178-95ca-54f56351c25c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance fb3973cf-218d-467a-ac33-c6e8dc419cc5 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3405e113-6c60-4178-95ca-54f56351c25c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/fb3973cf-218d-467a-ac33-c6e8dc419cc5/action" status: 404 len: 111 microversion: 2.1 time: 0.016178 Oct 05 18:15:45.315361 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3233/6219] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:45 2022] POST /compute/v2.1/servers/fb3973cf-218d-467a-ac33-c6e8dc419cc5/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:45.322707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-21bb02ae-4407-4fe5-86e1-670594efea0f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:45.323331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-21bb02ae-4407-4fe5-86e1-670594efea0f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:45.329980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bb02ae-4407-4fe5-86e1-670594efea0f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:45.330572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bb02ae-4407-4fe5-86e1-670594efea0f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:45.331020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bb02ae-4407-4fe5-86e1-670594efea0f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:45.331789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bb02ae-4407-4fe5-86e1-670594efea0f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:45.332182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bb02ae-4407-4fe5-86e1-670594efea0f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:45.332610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21bb02ae-4407-4fe5-86e1-670594efea0f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:45.474629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-21bb02ae-4407-4fe5-86e1-670594efea0f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:45.484152 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-21bb02ae-4407-4fe5-86e1-670594efea0f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.165498 Oct 05 18:15:45.484744 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2987/6220] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:45 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:45.507830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8be4fe9e-d388-4374-acd4-373e2c96aea5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:45.508635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8be4fe9e-d388-4374-acd4-373e2c96aea5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:45.516272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be4fe9e-d388-4374-acd4-373e2c96aea5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:45.517034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be4fe9e-d388-4374-acd4-373e2c96aea5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:45.517560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be4fe9e-d388-4374-acd4-373e2c96aea5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:45.518331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be4fe9e-d388-4374-acd4-373e2c96aea5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:45.518816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be4fe9e-d388-4374-acd4-373e2c96aea5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:45.519265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8be4fe9e-d388-4374-acd4-373e2c96aea5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:45.655904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8be4fe9e-d388-4374-acd4-373e2c96aea5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:45.664076 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8be4fe9e-d388-4374-acd4-373e2c96aea5 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.160831 Oct 05 18:15:45.664666 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3234/6221] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:45 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:45.689393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d06bcec9-6b24-4171-b114-13419cbdc094 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:45.690159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d06bcec9-6b24-4171-b114-13419cbdc094 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 46e23f1f-8bfa-4004-966c-d508fead41c4] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:45.698441 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-d06bcec9-6b24-4171-b114-13419cbdc094 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 46e23f1f-8bfa-4004-966c-d508fead41c4 could not be found. Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d06bcec9-6b24-4171-b114-13419cbdc094 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/46e23f1f-8bfa-4004-966c-d508fead41c4/action HTTP/1.1 Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 15 Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: {"restore": {}} Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 46e23f1f-8bfa-4004-966c-d508fead41c4 could not be found. Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '46e23f1f-8bfa-4004-966c-d508fead41c4', 'body': {'restore': {}}} Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46e23f1f-8bfa-4004-966c-d508fead41c4 could not be found. Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46e23f1f-8bfa-4004-966c-d508fead41c4 could not be found. Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:45.701025 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:45.706374 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:45.706374 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:45.706374 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46e23f1f-8bfa-4004-966c-d508fead41c4 could not be found. Oct 05 18:15:45.706374 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:45.706374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d06bcec9-6b24-4171-b114-13419cbdc094 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 46e23f1f-8bfa-4004-966c-d508fead41c4 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:45.706374 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d06bcec9-6b24-4171-b114-13419cbdc094 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/46e23f1f-8bfa-4004-966c-d508fead41c4/action" status: 404 len: 111 microversion: 2.1 time: 0.019464 Oct 05 18:15:45.706374 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2988/6222] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:45 2022] POST /compute/v2.1/servers/46e23f1f-8bfa-4004-966c-d508fead41c4/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:45.713724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d06846ee-d9ab-48ba-9404-79b4f871b7b7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:45.714652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d06846ee-d9ab-48ba-9404-79b4f871b7b7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:45.723809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d06846ee-d9ab-48ba-9404-79b4f871b7b7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:45.724538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d06846ee-d9ab-48ba-9404-79b4f871b7b7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:45.725161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d06846ee-d9ab-48ba-9404-79b4f871b7b7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:45.726192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d06846ee-d9ab-48ba-9404-79b4f871b7b7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:45.726698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d06846ee-d9ab-48ba-9404-79b4f871b7b7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:45.727142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d06846ee-d9ab-48ba-9404-79b4f871b7b7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:45.877142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d06846ee-d9ab-48ba-9404-79b4f871b7b7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:45.886029 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d06846ee-d9ab-48ba-9404-79b4f871b7b7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.178649 Oct 05 18:15:45.886624 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3235/6223] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:45 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:45.908860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f3fd59c5-01a9-4f3a-8f74-29db43c05eb1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:45.909498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f3fd59c5-01a9-4f3a-8f74-29db43c05eb1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:45.917517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3fd59c5-01a9-4f3a-8f74-29db43c05eb1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:45.918001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3fd59c5-01a9-4f3a-8f74-29db43c05eb1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:45.918465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3fd59c5-01a9-4f3a-8f74-29db43c05eb1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:45.919154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3fd59c5-01a9-4f3a-8f74-29db43c05eb1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:45.919606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3fd59c5-01a9-4f3a-8f74-29db43c05eb1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:45.920052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3fd59c5-01a9-4f3a-8f74-29db43c05eb1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.050672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f3fd59c5-01a9-4f3a-8f74-29db43c05eb1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:46.058857 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f3fd59c5-01a9-4f3a-8f74-29db43c05eb1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.153865 Oct 05 18:15:46.059447 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2989/6224] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:45 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:46.082754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:46.083305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:46.090334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.090837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.091327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.092029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.092528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.092960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.116949 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Cannot 'restore' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action HTTP/1.1 Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 15 Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: {"restore": {}} Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot 'restore' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4a04f9c9-bdcf-4353-b6ae-627e1916d0a2', 'body': {'restore': {}}} Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 in vm_state active. Cannot restore while the instance is in this state. Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:46.118525 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:46.123814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:46.123814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:46.123814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:46.123814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:15:46.123814 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.123814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 409 to user: Cannot 'restore' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:46.123814 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d080e94-6916-4093-8d5c-c1968a881617 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 409 len: 145 microversion: 2.1 time: 0.041481 Oct 05 18:15:46.123814 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3236/6225] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:46 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 145 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 18:15:46.129852 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7d4ecbe9-a215-410d-9871-727980eb8e68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:46.130507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7d4ecbe9-a215-410d-9871-727980eb8e68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:46.136674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d4ecbe9-a215-410d-9871-727980eb8e68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.137160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d4ecbe9-a215-410d-9871-727980eb8e68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.137619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d4ecbe9-a215-410d-9871-727980eb8e68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.138367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d4ecbe9-a215-410d-9871-727980eb8e68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.138826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d4ecbe9-a215-410d-9871-727980eb8e68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.139254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d4ecbe9-a215-410d-9871-727980eb8e68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.278267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d4ecbe9-a215-410d-9871-727980eb8e68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:46.287028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7d4ecbe9-a215-410d-9871-727980eb8e68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.161448 Oct 05 18:15:46.287609 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2990/6226] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:46 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:46.309936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-825acec7-811a-4748-9b23-6d1506e754da tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:46.310605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-825acec7-811a-4748-9b23-6d1506e754da tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:46.317107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-825acec7-811a-4748-9b23-6d1506e754da tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.317601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-825acec7-811a-4748-9b23-6d1506e754da tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.318054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-825acec7-811a-4748-9b23-6d1506e754da tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.318812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-825acec7-811a-4748-9b23-6d1506e754da tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.319277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-825acec7-811a-4748-9b23-6d1506e754da tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.319710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-825acec7-811a-4748-9b23-6d1506e754da tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.454794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-825acec7-811a-4748-9b23-6d1506e754da tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:46.462771 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-825acec7-811a-4748-9b23-6d1506e754da tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.156919 Oct 05 18:15:46.463375 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3237/6227] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:46 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:46.485031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27e12a28-dae5-4690-a451-21e981d9d0ff tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:46.485567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-27e12a28-dae5-4690-a451-21e981d9d0ff tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 719c3bc7-d036-4d57-8da5-8a04949521d0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:46.491463 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-27e12a28-dae5-4690-a451-21e981d9d0ff tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 719c3bc7-d036-4d57-8da5-8a04949521d0 could not be found. Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27e12a28-dae5-4690-a451-21e981d9d0ff tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/719c3bc7-d036-4d57-8da5-8a04949521d0/action HTTP/1.1 Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 14 Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: {"resume": {}} Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 719c3bc7-d036-4d57-8da5-8a04949521d0 could not be found. Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '719c3bc7-d036-4d57-8da5-8a04949521d0', 'body': {'resume': {}}} Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 719c3bc7-d036-4d57-8da5-8a04949521d0 could not be found. Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 719c3bc7-d036-4d57-8da5-8a04949521d0 could not be found. Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:46.500370 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:46.506021 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:46.506021 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:46.506021 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 719c3bc7-d036-4d57-8da5-8a04949521d0 could not be found. Oct 05 18:15:46.506021 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.506021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27e12a28-dae5-4690-a451-21e981d9d0ff tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 719c3bc7-d036-4d57-8da5-8a04949521d0 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:46.506021 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-27e12a28-dae5-4690-a451-21e981d9d0ff tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/719c3bc7-d036-4d57-8da5-8a04949521d0/action" status: 404 len: 111 microversion: 2.1 time: 0.020838 Oct 05 18:15:46.506021 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2991/6228] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:46 2022] POST /compute/v2.1/servers/719c3bc7-d036-4d57-8da5-8a04949521d0/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:46.510601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5844d803-e29d-497a-a92a-c50637cbc82a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:46.511243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5844d803-e29d-497a-a92a-c50637cbc82a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:46.517472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d803-e29d-497a-a92a-c50637cbc82a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.517959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d803-e29d-497a-a92a-c50637cbc82a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.518425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d803-e29d-497a-a92a-c50637cbc82a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.519133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d803-e29d-497a-a92a-c50637cbc82a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.519596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d803-e29d-497a-a92a-c50637cbc82a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.520010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5844d803-e29d-497a-a92a-c50637cbc82a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.652750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5844d803-e29d-497a-a92a-c50637cbc82a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:46.660875 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5844d803-e29d-497a-a92a-c50637cbc82a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.154131 Oct 05 18:15:46.661458 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3238/6229] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:46 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:46.683820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3dd43ab9-83bc-481f-988c-f7766ce7a47d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:46.684428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3dd43ab9-83bc-481f-988c-f7766ce7a47d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:46.691886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dd43ab9-83bc-481f-988c-f7766ce7a47d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.692371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dd43ab9-83bc-481f-988c-f7766ce7a47d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.692804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dd43ab9-83bc-481f-988c-f7766ce7a47d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.693490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dd43ab9-83bc-481f-988c-f7766ce7a47d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.693938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dd43ab9-83bc-481f-988c-f7766ce7a47d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.694391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dd43ab9-83bc-481f-988c-f7766ce7a47d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.836681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3dd43ab9-83bc-481f-988c-f7766ce7a47d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:46.844725 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3dd43ab9-83bc-481f-988c-f7766ce7a47d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.164910 Oct 05 18:15:46.845318 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2992/6230] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:46 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:46.866905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:46.867462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:46.873939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.874476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.874932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.875666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.876146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.876608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.901117 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Cannot 'resume' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action HTTP/1.1 Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 14 Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: {"resume": {}} Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: exception: Cannot 'resume' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4a04f9c9-bdcf-4353-b6ae-627e1916d0a2', 'body': {'resume': {}}} Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 in vm_state active. Cannot resume while the instance is in this state. Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:46.902815 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.908402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:46.908402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:46.908402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:46.908402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:46.908402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:46.908402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:15:46.908402 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:46.908402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 409 to user: Cannot 'resume' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:46.908402 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b9de427f-fcd9-4717-87c5-cdf20d806bb9 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 409 len: 144 microversion: 2.1 time: 0.041548 Oct 05 18:15:46.908402 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3239/6231] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:46 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 144 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 18:15:46.913987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6353613a-8856-41ad-9abc-0e231dc958f3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:46.914789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6353613a-8856-41ad-9abc-0e231dc958f3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:46.924314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6353613a-8856-41ad-9abc-0e231dc958f3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.924794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6353613a-8856-41ad-9abc-0e231dc958f3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.925223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6353613a-8856-41ad-9abc-0e231dc958f3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:46.925924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6353613a-8856-41ad-9abc-0e231dc958f3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:46.926399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6353613a-8856-41ad-9abc-0e231dc958f3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:46.926821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6353613a-8856-41ad-9abc-0e231dc958f3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:47.077340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6353613a-8856-41ad-9abc-0e231dc958f3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:47.085757 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6353613a-8856-41ad-9abc-0e231dc958f3 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.176415 Oct 05 18:15:47.086726 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2993/6232] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:46 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:47.116257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21cccfba-ec80-4bb8-9f2b-b8f2c96a4f26 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:47.117026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21cccfba-ec80-4bb8-9f2b-b8f2c96a4f26 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:47.125991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21cccfba-ec80-4bb8-9f2b-b8f2c96a4f26 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:47.126797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21cccfba-ec80-4bb8-9f2b-b8f2c96a4f26 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:47.127448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21cccfba-ec80-4bb8-9f2b-b8f2c96a4f26 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:47.128506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21cccfba-ec80-4bb8-9f2b-b8f2c96a4f26 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:47.128987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21cccfba-ec80-4bb8-9f2b-b8f2c96a4f26 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:47.129751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21cccfba-ec80-4bb8-9f2b-b8f2c96a4f26 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:47.301763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21cccfba-ec80-4bb8-9f2b-b8f2c96a4f26 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:47.310707 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21cccfba-ec80-4bb8-9f2b-b8f2c96a4f26 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.199902 Oct 05 18:15:47.311285 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3240/6233] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:47 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:47.375758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-60eeeffc-42fb-4a15-a845-a8455197c5c2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-60eeeffc-42fb-4a15-a845-a8455197c5c2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 160 Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": "", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "12c0da33-b818-4d50-917d-991504341856"}]}} Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'body': {'server': {'name': '', 'imageRef': '0510c978-5936-46d4-9cc7-8d23f52ed26e', 'flavorRef': '452', 'networks': [{'uuid': '12c0da33-b818-4d50-917d-991504341856'}]}}} Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi '' Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:15:47.379776 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-60eeeffc-42fb-4a15-a845-a8455197c5c2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-60eeeffc-42fb-4a15-a845-a8455197c5c2 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.009650 Oct 05 18:15:47.385336 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2994/6234] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:15:47 2022] POST /compute/v2.1/servers => generated 108 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:15:47.390254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2249ad18-5157-4656-a461-815198617c68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:47.390916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2249ad18-5157-4656-a461-815198617c68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:47.397572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2249ad18-5157-4656-a461-815198617c68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:47.398083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2249ad18-5157-4656-a461-815198617c68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:47.398573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2249ad18-5157-4656-a461-815198617c68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:47.399279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2249ad18-5157-4656-a461-815198617c68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:47.399748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2249ad18-5157-4656-a461-815198617c68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:47.400186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2249ad18-5157-4656-a461-815198617c68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:47.542328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2249ad18-5157-4656-a461-815198617c68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:47.550597 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2249ad18-5157-4656-a461-815198617c68 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.164332 Oct 05 18:15:47.551143 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3241/6235] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:47 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:47.574002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a4d1129f-7857-458c-bbe9-0f7ca4dc8967 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:47.574660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a4d1129f-7857-458c-bbe9-0f7ca4dc8967 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:47.581782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4d1129f-7857-458c-bbe9-0f7ca4dc8967 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:47.582267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4d1129f-7857-458c-bbe9-0f7ca4dc8967 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:47.582729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4d1129f-7857-458c-bbe9-0f7ca4dc8967 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:47.583423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4d1129f-7857-458c-bbe9-0f7ca4dc8967 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:47.583878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4d1129f-7857-458c-bbe9-0f7ca4dc8967 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:47.584300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a4d1129f-7857-458c-bbe9-0f7ca4dc8967 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:47.714801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a4d1129f-7857-458c-bbe9-0f7ca4dc8967 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:47.723225 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a4d1129f-7857-458c-bbe9-0f7ca4dc8967 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.153377 Oct 05 18:15:47.723806 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2995/6236] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:47 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:47.749140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d57fd75a-ebb3-4a82-bfa0-01cee8049f44 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:47.749942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d57fd75a-ebb3-4a82-bfa0-01cee8049f44 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4bcb5af6-4008-4ab6-a362-c8c93c9c678b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:47.760102 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d57fd75a-ebb3-4a82-bfa0-01cee8049f44 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 4bcb5af6-4008-4ab6-a362-c8c93c9c678b could not be found. Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d57fd75a-ebb3-4a82-bfa0-01cee8049f44 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/4bcb5af6-4008-4ab6-a362-c8c93c9c678b/action HTTP/1.1 Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 14 Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: {"shelve": {}} Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 4bcb5af6-4008-4ab6-a362-c8c93c9c678b could not be found. Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4bcb5af6-4008-4ab6-a362-c8c93c9c678b', 'body': {'shelve': {}}} Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bcb5af6-4008-4ab6-a362-c8c93c9c678b could not be found. Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bcb5af6-4008-4ab6-a362-c8c93c9c678b could not be found. Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:15:47.763350 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:15:47.768545 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:15:47.768545 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:15:47.768545 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bcb5af6-4008-4ab6-a362-c8c93c9c678b could not be found. Oct 05 18:15:47.768545 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:15:47.768545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d57fd75a-ebb3-4a82-bfa0-01cee8049f44 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 4bcb5af6-4008-4ab6-a362-c8c93c9c678b could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:15:47.768545 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d57fd75a-ebb3-4a82-bfa0-01cee8049f44 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4bcb5af6-4008-4ab6-a362-c8c93c9c678b/action" status: 404 len: 111 microversion: 2.1 time: 0.022873 Oct 05 18:15:47.768545 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3242/6237] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:47 2022] POST /compute/v2.1/servers/4bcb5af6-4008-4ab6-a362-c8c93c9c678b/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:15:47.773782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8a8717a-f0bf-4cf2-92bd-eb97c41dc04c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:47.774424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8a8717a-f0bf-4cf2-92bd-eb97c41dc04c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:47.780798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8a8717a-f0bf-4cf2-92bd-eb97c41dc04c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:47.781291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8a8717a-f0bf-4cf2-92bd-eb97c41dc04c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:47.781723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8a8717a-f0bf-4cf2-92bd-eb97c41dc04c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:47.782448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8a8717a-f0bf-4cf2-92bd-eb97c41dc04c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:47.782915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8a8717a-f0bf-4cf2-92bd-eb97c41dc04c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:47.783324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8a8717a-f0bf-4cf2-92bd-eb97c41dc04c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:47.917479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c8a8717a-f0bf-4cf2-92bd-eb97c41dc04c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:47.926521 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8a8717a-f0bf-4cf2-92bd-eb97c41dc04c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.156675 Oct 05 18:15:47.927145 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2996/6238] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:47 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:47.949855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae879494-c2e1-4af3-b007-876fa9549957 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:47.950628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae879494-c2e1-4af3-b007-876fa9549957 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:47.956905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae879494-c2e1-4af3-b007-876fa9549957 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:47.957411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae879494-c2e1-4af3-b007-876fa9549957 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:47.957864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae879494-c2e1-4af3-b007-876fa9549957 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:47.958609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae879494-c2e1-4af3-b007-876fa9549957 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:47.959083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae879494-c2e1-4af3-b007-876fa9549957 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:47.959521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae879494-c2e1-4af3-b007-876fa9549957 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:48.106787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ae879494-c2e1-4af3-b007-876fa9549957 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:48.115035 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae879494-c2e1-4af3-b007-876fa9549957 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.169313 Oct 05 18:15:48.115582 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3243/6239] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:47 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:48.140345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de05d4f7-3887-4355-a6c8-9f6e4b061067 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:15:48.141086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-de05d4f7-3887-4355-a6c8-9f6e4b061067 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:48.150572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05d4f7-3887-4355-a6c8-9f6e4b061067 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:48.151293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05d4f7-3887-4355-a6c8-9f6e4b061067 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:48.151931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05d4f7-3887-4355-a6c8-9f6e4b061067 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:48.152935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05d4f7-3887-4355-a6c8-9f6e4b061067 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:48.153711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05d4f7-3887-4355-a6c8-9f6e4b061067 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:48.154150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de05d4f7-3887-4355-a6c8-9f6e4b061067 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:48.177890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-de05d4f7-3887-4355-a6c8-9f6e4b061067 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lazy-loading 'flavor' on Instance uuid 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:15:48.371660 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de05d4f7-3887-4355-a6c8-9f6e4b061067 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.237718 Oct 05 18:15:48.372284 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2997/6240] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:15:48 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:15:48.381068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3cd007ea-4eef-4d0b-84b5-42ac536d16ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:48.381702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3cd007ea-4eef-4d0b-84b5-42ac536d16ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:48.389318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3cd007ea-4eef-4d0b-84b5-42ac536d16ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:48.389983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3cd007ea-4eef-4d0b-84b5-42ac536d16ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:48.390582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3cd007ea-4eef-4d0b-84b5-42ac536d16ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:48.391369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3cd007ea-4eef-4d0b-84b5-42ac536d16ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:48.391835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3cd007ea-4eef-4d0b-84b5-42ac536d16ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:48.392278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3cd007ea-4eef-4d0b-84b5-42ac536d16ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:48.533906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3cd007ea-4eef-4d0b-84b5-42ac536d16ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:48.542017 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3cd007ea-4eef-4d0b-84b5-42ac536d16ca tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.165295 Oct 05 18:15:48.542628 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3244/6241] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:48 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:49.571862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2d73d2bc-f408-4f71-86b6-9c09d19d7ff1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:49.573019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2d73d2bc-f408-4f71-86b6-9c09d19d7ff1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:49.584163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d73d2bc-f408-4f71-86b6-9c09d19d7ff1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:49.584953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d73d2bc-f408-4f71-86b6-9c09d19d7ff1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:49.585711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d73d2bc-f408-4f71-86b6-9c09d19d7ff1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:49.586918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d73d2bc-f408-4f71-86b6-9c09d19d7ff1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:49.587663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d73d2bc-f408-4f71-86b6-9c09d19d7ff1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:49.588399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2d73d2bc-f408-4f71-86b6-9c09d19d7ff1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:49.728113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2d73d2bc-f408-4f71-86b6-9c09d19d7ff1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:49.739933 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2d73d2bc-f408-4f71-86b6-9c09d19d7ff1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.176523 Oct 05 18:15:49.740785 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2998/6242] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:49 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:50.769301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-395e516f-1ebd-4880-ae64-2d4933129c06 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:50.770116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-395e516f-1ebd-4880-ae64-2d4933129c06 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:50.779966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-395e516f-1ebd-4880-ae64-2d4933129c06 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:50.780625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-395e516f-1ebd-4880-ae64-2d4933129c06 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:50.781238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-395e516f-1ebd-4880-ae64-2d4933129c06 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:50.782193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-395e516f-1ebd-4880-ae64-2d4933129c06 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:50.782863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-395e516f-1ebd-4880-ae64-2d4933129c06 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:50.783459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-395e516f-1ebd-4880-ae64-2d4933129c06 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:50.926670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-395e516f-1ebd-4880-ae64-2d4933129c06 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:50.934892 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-395e516f-1ebd-4880-ae64-2d4933129c06 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.170962 Oct 05 18:15:50.935477 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3245/6243] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:50 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:51.959462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3e07d879-f810-48d7-aef3-c9dae850eb57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:51.960076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3e07d879-f810-48d7-aef3-c9dae850eb57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:51.967233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e07d879-f810-48d7-aef3-c9dae850eb57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:51.967797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e07d879-f810-48d7-aef3-c9dae850eb57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:51.968237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e07d879-f810-48d7-aef3-c9dae850eb57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:51.968943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e07d879-f810-48d7-aef3-c9dae850eb57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:51.969401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e07d879-f810-48d7-aef3-c9dae850eb57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:51.969830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e07d879-f810-48d7-aef3-c9dae850eb57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:52.099356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3e07d879-f810-48d7-aef3-c9dae850eb57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:52.107796 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3e07d879-f810-48d7-aef3-c9dae850eb57 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.152532 Oct 05 18:15:52.108352 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 2999/6244] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:51 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:53.141114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b74625b8-89af-493d-8109-bd690afc417e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:53.141729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b74625b8-89af-493d-8109-bd690afc417e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:53.149385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b74625b8-89af-493d-8109-bd690afc417e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:53.149891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b74625b8-89af-493d-8109-bd690afc417e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:53.150377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b74625b8-89af-493d-8109-bd690afc417e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:53.151094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b74625b8-89af-493d-8109-bd690afc417e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:53.151566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b74625b8-89af-493d-8109-bd690afc417e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:53.152009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b74625b8-89af-493d-8109-bd690afc417e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:53.294792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b74625b8-89af-493d-8109-bd690afc417e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:53.307744 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b74625b8-89af-493d-8109-bd690afc417e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.173917 Oct 05 18:15:53.308588 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3246/6245] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:53 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:54.335622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c378de6-f48a-4712-ad5f-1e966c60058c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:54.336594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0c378de6-f48a-4712-ad5f-1e966c60058c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:54.347204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c378de6-f48a-4712-ad5f-1e966c60058c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:54.347789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c378de6-f48a-4712-ad5f-1e966c60058c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:54.348131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c378de6-f48a-4712-ad5f-1e966c60058c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:54.348834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c378de6-f48a-4712-ad5f-1e966c60058c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:54.349294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c378de6-f48a-4712-ad5f-1e966c60058c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:54.349722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0c378de6-f48a-4712-ad5f-1e966c60058c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:54.493195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0c378de6-f48a-4712-ad5f-1e966c60058c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:54.504005 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c378de6-f48a-4712-ad5f-1e966c60058c tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.175113 Oct 05 18:15:54.504906 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3000/6246] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:54 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:55.528200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-51afcfb1-78e9-4fae-900d-73385ccb4d58 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:55.528873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-51afcfb1-78e9-4fae-900d-73385ccb4d58 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:55.537759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51afcfb1-78e9-4fae-900d-73385ccb4d58 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:55.538595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51afcfb1-78e9-4fae-900d-73385ccb4d58 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:55.539260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51afcfb1-78e9-4fae-900d-73385ccb4d58 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:55.540420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51afcfb1-78e9-4fae-900d-73385ccb4d58 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:55.541158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51afcfb1-78e9-4fae-900d-73385ccb4d58 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:55.541847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51afcfb1-78e9-4fae-900d-73385ccb4d58 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:55.680104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-51afcfb1-78e9-4fae-900d-73385ccb4d58 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:55.682413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:15:55.689553 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-51afcfb1-78e9-4fae-900d-73385ccb4d58 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.165424 Oct 05 18:15:55.690140 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3247/6247] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:55 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:56.717715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-19eeeb9c-0142-4646-bd66-03e32665ac39 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:56.718781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-19eeeb9c-0142-4646-bd66-03e32665ac39 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:56.726948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eeeb9c-0142-4646-bd66-03e32665ac39 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:56.727436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eeeb9c-0142-4646-bd66-03e32665ac39 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:56.727870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eeeb9c-0142-4646-bd66-03e32665ac39 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:56.728561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eeeb9c-0142-4646-bd66-03e32665ac39 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:56.729014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eeeb9c-0142-4646-bd66-03e32665ac39 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:56.729439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eeeb9c-0142-4646-bd66-03e32665ac39 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:56.874058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-19eeeb9c-0142-4646-bd66-03e32665ac39 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:56.883314 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-19eeeb9c-0142-4646-bd66-03e32665ac39 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.172323 Oct 05 18:15:56.883933 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3001/6248] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:56 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:57.918058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-65cddff3-9980-40cd-9e65-b8a73eb46dc0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:57.919066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-65cddff3-9980-40cd-9e65-b8a73eb46dc0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:57.926988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65cddff3-9980-40cd-9e65-b8a73eb46dc0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:57.927499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65cddff3-9980-40cd-9e65-b8a73eb46dc0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:57.927958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65cddff3-9980-40cd-9e65-b8a73eb46dc0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:57.928684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65cddff3-9980-40cd-9e65-b8a73eb46dc0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:57.929158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65cddff3-9980-40cd-9e65-b8a73eb46dc0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:57.929607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65cddff3-9980-40cd-9e65-b8a73eb46dc0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:58.069986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65cddff3-9980-40cd-9e65-b8a73eb46dc0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:58.077832 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-65cddff3-9980-40cd-9e65-b8a73eb46dc0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.174224 Oct 05 18:15:58.078434 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3248/6249] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:57 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:15:59.105352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-46802f7d-655c-47a7-8eda-9001b3e79624 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:15:59.106037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-46802f7d-655c-47a7-8eda-9001b3e79624 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:15:59.116689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46802f7d-655c-47a7-8eda-9001b3e79624 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:59.117325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46802f7d-655c-47a7-8eda-9001b3e79624 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:59.117904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46802f7d-655c-47a7-8eda-9001b3e79624 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:59.119076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46802f7d-655c-47a7-8eda-9001b3e79624 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:15:59.119723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46802f7d-655c-47a7-8eda-9001b3e79624 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:15:59.120311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46802f7d-655c-47a7-8eda-9001b3e79624 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:15:59.265165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-46802f7d-655c-47a7-8eda-9001b3e79624 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:15:59.273742 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-46802f7d-655c-47a7-8eda-9001b3e79624 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1532 microversion: 2.1 time: 0.173725 Oct 05 18:15:59.274317 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3002/6250] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:15:59 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1532 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:00.301556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-243eb170-19ae-4ca2-bd36-4ecd0bdd169a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:00.302623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-243eb170-19ae-4ca2-bd36-4ecd0bdd169a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:00.307010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:00.315917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-243eb170-19ae-4ca2-bd36-4ecd0bdd169a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:00.316752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-243eb170-19ae-4ca2-bd36-4ecd0bdd169a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:00.317511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-243eb170-19ae-4ca2-bd36-4ecd0bdd169a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:00.318767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-243eb170-19ae-4ca2-bd36-4ecd0bdd169a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:00.319563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-243eb170-19ae-4ca2-bd36-4ecd0bdd169a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:00.320317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-243eb170-19ae-4ca2-bd36-4ecd0bdd169a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:00.464575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-243eb170-19ae-4ca2-bd36-4ecd0bdd169a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:00.472615 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-243eb170-19ae-4ca2-bd36-4ecd0bdd169a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1532 microversion: 2.1 time: 0.177996 Oct 05 18:16:00.473186 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3249/6251] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:00 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1532 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:01.496373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ffb6ce27-5b95-4f6a-930e-7450effcbad7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:01.497019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ffb6ce27-5b95-4f6a-930e-7450effcbad7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:01.505475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffb6ce27-5b95-4f6a-930e-7450effcbad7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:01.505981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffb6ce27-5b95-4f6a-930e-7450effcbad7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:01.506632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffb6ce27-5b95-4f6a-930e-7450effcbad7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:01.507172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffb6ce27-5b95-4f6a-930e-7450effcbad7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:01.507648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffb6ce27-5b95-4f6a-930e-7450effcbad7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:01.508075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffb6ce27-5b95-4f6a-930e-7450effcbad7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:01.650913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ffb6ce27-5b95-4f6a-930e-7450effcbad7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:01.660132 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ffb6ce27-5b95-4f6a-930e-7450effcbad7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1527 microversion: 2.1 time: 0.167978 Oct 05 18:16:01.674999 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3003/6252] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:01 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1527 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:02.685258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ced6fe1a-0a63-4b1e-8bad-8dccbfb579ad tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:02.686023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ced6fe1a-0a63-4b1e-8bad-8dccbfb579ad tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:02.693591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced6fe1a-0a63-4b1e-8bad-8dccbfb579ad tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:02.694428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced6fe1a-0a63-4b1e-8bad-8dccbfb579ad tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:02.694876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced6fe1a-0a63-4b1e-8bad-8dccbfb579ad tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:02.695799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced6fe1a-0a63-4b1e-8bad-8dccbfb579ad tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:02.696605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced6fe1a-0a63-4b1e-8bad-8dccbfb579ad tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:02.697057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced6fe1a-0a63-4b1e-8bad-8dccbfb579ad tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:02.857191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ced6fe1a-0a63-4b1e-8bad-8dccbfb579ad tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:02.865573 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ced6fe1a-0a63-4b1e-8bad-8dccbfb579ad tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1527 microversion: 2.1 time: 0.184739 Oct 05 18:16:02.876573 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3250/6253] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:02 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1527 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:03.681780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7ba66fb6-75ec-4f73-bfa6-b6846782bcaa req-8d2ccd11-1ed5-4e58-94be-19385b62620a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a04f9c9-bdcf-4353-b6ae-627e1916d0a2", "name": "network-vif-plugged", "status": "completed", "tag": "65579d35-5481-4556-bba1-3cc32437cc90"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:03.693803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7ba66fb6-75ec-4f73-bfa6-b6846782bcaa req-8d2ccd11-1ed5-4e58-94be-19385b62620a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:03.694310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7ba66fb6-75ec-4f73-bfa6-b6846782bcaa req-8d2ccd11-1ed5-4e58-94be-19385b62620a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:03.694744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7ba66fb6-75ec-4f73-bfa6-b6846782bcaa req-8d2ccd11-1ed5-4e58-94be-19385b62620a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:03.706118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:03.715215 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7ba66fb6-75ec-4f73-bfa6-b6846782bcaa req-8d2ccd11-1ed5-4e58-94be-19385b62620a service nova] Creating event network-vif-plugged:65579d35-5481-4556-bba1-3cc32437cc90 for instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 on n-h2-835595-3 Oct 05 18:16:03.722422 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7ba66fb6-75ec-4f73-bfa6-b6846782bcaa req-8d2ccd11-1ed5-4e58-94be-19385b62620a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044197 Oct 05 18:16:03.723350 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3004/6254] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:16:03.889059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6d42c404-d297-49ee-b7b4-9fbb29416048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:03.890592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6d42c404-d297-49ee-b7b4-9fbb29416048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:03.900634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d42c404-d297-49ee-b7b4-9fbb29416048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:03.901499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d42c404-d297-49ee-b7b4-9fbb29416048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:03.902007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d42c404-d297-49ee-b7b4-9fbb29416048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:03.902778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d42c404-d297-49ee-b7b4-9fbb29416048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:03.903502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d42c404-d297-49ee-b7b4-9fbb29416048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:03.904190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d42c404-d297-49ee-b7b4-9fbb29416048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:04.053283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6d42c404-d297-49ee-b7b4-9fbb29416048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:04.062203 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6d42c404-d297-49ee-b7b4-9fbb29416048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1527 microversion: 2.1 time: 0.176881 Oct 05 18:16:04.066204 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3251/6255] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:03 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1527 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:05.090709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e81f0a17-ec83-47d6-8d08-acfc34488366 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:05.091302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e81f0a17-ec83-47d6-8d08-acfc34488366 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:05.098532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81f0a17-ec83-47d6-8d08-acfc34488366 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:05.099239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81f0a17-ec83-47d6-8d08-acfc34488366 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:05.099882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81f0a17-ec83-47d6-8d08-acfc34488366 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:05.100643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81f0a17-ec83-47d6-8d08-acfc34488366 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:05.101265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81f0a17-ec83-47d6-8d08-acfc34488366 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:05.101869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81f0a17-ec83-47d6-8d08-acfc34488366 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:05.254326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e81f0a17-ec83-47d6-8d08-acfc34488366 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:05.264894 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e81f0a17-ec83-47d6-8d08-acfc34488366 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1527 microversion: 2.1 time: 0.179526 Oct 05 18:16:05.265967 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3005/6256] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:05 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1527 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:06.289231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-32fcec95-1ed8-42a4-9450-f5c56235fc4f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:06.290303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-32fcec95-1ed8-42a4-9450-f5c56235fc4f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:06.300060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32fcec95-1ed8-42a4-9450-f5c56235fc4f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:06.300900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32fcec95-1ed8-42a4-9450-f5c56235fc4f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:06.301583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32fcec95-1ed8-42a4-9450-f5c56235fc4f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:06.302469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32fcec95-1ed8-42a4-9450-f5c56235fc4f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:06.303022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32fcec95-1ed8-42a4-9450-f5c56235fc4f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:06.303721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-32fcec95-1ed8-42a4-9450-f5c56235fc4f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:06.455467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-32fcec95-1ed8-42a4-9450-f5c56235fc4f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:06.467962 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-32fcec95-1ed8-42a4-9450-f5c56235fc4f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1527 microversion: 2.1 time: 0.182534 Oct 05 18:16:06.468846 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3252/6257] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:06 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1527 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:07.491713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b5527ad-ec4c-477b-97de-85ae0b4fbb4e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:07.493117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b5527ad-ec4c-477b-97de-85ae0b4fbb4e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:07.501389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5527ad-ec4c-477b-97de-85ae0b4fbb4e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:07.502154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5527ad-ec4c-477b-97de-85ae0b4fbb4e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:07.502635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5527ad-ec4c-477b-97de-85ae0b4fbb4e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:07.503364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5527ad-ec4c-477b-97de-85ae0b4fbb4e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:07.503845 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5527ad-ec4c-477b-97de-85ae0b4fbb4e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:07.504272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b5527ad-ec4c-477b-97de-85ae0b4fbb4e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:07.665359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b5527ad-ec4c-477b-97de-85ae0b4fbb4e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:07.673907 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b5527ad-ec4c-477b-97de-85ae0b4fbb4e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1527 microversion: 2.1 time: 0.186181 Oct 05 18:16:07.674509 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3006/6258] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:07 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1527 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:08.698933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-62633a1f-f6e6-472b-aa88-dfe8f01bc34d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:08.699549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-62633a1f-f6e6-472b-aa88-dfe8f01bc34d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:08.706581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62633a1f-f6e6-472b-aa88-dfe8f01bc34d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:08.707396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62633a1f-f6e6-472b-aa88-dfe8f01bc34d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:08.708036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62633a1f-f6e6-472b-aa88-dfe8f01bc34d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:08.708863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62633a1f-f6e6-472b-aa88-dfe8f01bc34d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:08.709269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62633a1f-f6e6-472b-aa88-dfe8f01bc34d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:08.709714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-62633a1f-f6e6-472b-aa88-dfe8f01bc34d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:08.861674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-62633a1f-f6e6-472b-aa88-dfe8f01bc34d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:08.871547 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-62633a1f-f6e6-472b-aa88-dfe8f01bc34d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1527 microversion: 2.1 time: 0.177331 Oct 05 18:16:08.873506 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3253/6259] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:08 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1527 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:09.897848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-162b6696-e8b4-4fb3-97ca-da3f605c92a8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:09.898526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-162b6696-e8b4-4fb3-97ca-da3f605c92a8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:09.912949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-162b6696-e8b4-4fb3-97ca-da3f605c92a8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:09.913458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-162b6696-e8b4-4fb3-97ca-da3f605c92a8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:09.913861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-162b6696-e8b4-4fb3-97ca-da3f605c92a8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:09.914642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-162b6696-e8b4-4fb3-97ca-da3f605c92a8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:09.915160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-162b6696-e8b4-4fb3-97ca-da3f605c92a8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:09.915625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-162b6696-e8b4-4fb3-97ca-da3f605c92a8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:10.057931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-162b6696-e8b4-4fb3-97ca-da3f605c92a8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:10.083668 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-162b6696-e8b4-4fb3-97ca-da3f605c92a8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1527 microversion: 2.1 time: 0.187719 Oct 05 18:16:10.086427 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3007/6260] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:09 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1527 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:11.120119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ced74ac7-fbc7-4303-ba3d-abb1c26b33d0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:11.121072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ced74ac7-fbc7-4303-ba3d-abb1c26b33d0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:11.131469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced74ac7-fbc7-4303-ba3d-abb1c26b33d0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:11.131974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced74ac7-fbc7-4303-ba3d-abb1c26b33d0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:11.132425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced74ac7-fbc7-4303-ba3d-abb1c26b33d0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:11.133175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced74ac7-fbc7-4303-ba3d-abb1c26b33d0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:11.133662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced74ac7-fbc7-4303-ba3d-abb1c26b33d0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:11.134104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ced74ac7-fbc7-4303-ba3d-abb1c26b33d0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:11.268447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ced74ac7-fbc7-4303-ba3d-abb1c26b33d0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:11.276943 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ced74ac7-fbc7-4303-ba3d-abb1c26b33d0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1527 microversion: 2.1 time: 0.164476 Oct 05 18:16:11.277562 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3254/6261] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:11 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1527 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:12.300279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8d33d158-d87d-4b7b-abd0-70e9d170e884 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:12.300979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8d33d158-d87d-4b7b-abd0-70e9d170e884 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:12.304031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=64 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:12.309954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d33d158-d87d-4b7b-abd0-70e9d170e884 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:12.310617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d33d158-d87d-4b7b-abd0-70e9d170e884 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:12.311090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d33d158-d87d-4b7b-abd0-70e9d170e884 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:12.311838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d33d158-d87d-4b7b-abd0-70e9d170e884 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:12.312266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d33d158-d87d-4b7b-abd0-70e9d170e884 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:12.312693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d33d158-d87d-4b7b-abd0-70e9d170e884 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:12.452958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d33d158-d87d-4b7b-abd0-70e9d170e884 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:12.464630 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8d33d158-d87d-4b7b-abd0-70e9d170e884 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1509 microversion: 2.1 time: 0.168017 Oct 05 18:16:12.465415 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3008/6262] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:12 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:13.491891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-740ec1ce-9d0e-41d6-bfe3-19727714b48b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:13.492597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-740ec1ce-9d0e-41d6-bfe3-19727714b48b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:13.500774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-740ec1ce-9d0e-41d6-bfe3-19727714b48b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:13.501354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-740ec1ce-9d0e-41d6-bfe3-19727714b48b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:13.501856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-740ec1ce-9d0e-41d6-bfe3-19727714b48b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:13.502674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-740ec1ce-9d0e-41d6-bfe3-19727714b48b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:13.503198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-740ec1ce-9d0e-41d6-bfe3-19727714b48b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:13.503686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-740ec1ce-9d0e-41d6-bfe3-19727714b48b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:13.642878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-740ec1ce-9d0e-41d6-bfe3-19727714b48b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:13.651367 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-740ec1ce-9d0e-41d6-bfe3-19727714b48b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1509 microversion: 2.1 time: 0.163910 Oct 05 18:16:13.651970 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3255/6263] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:13 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:14.677442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d6722010-cace-4611-9ce7-fca7b2bb298f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:14.678088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d6722010-cace-4611-9ce7-fca7b2bb298f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:14.688572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6722010-cace-4611-9ce7-fca7b2bb298f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:14.689235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6722010-cace-4611-9ce7-fca7b2bb298f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:14.689794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6722010-cace-4611-9ce7-fca7b2bb298f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:14.690686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6722010-cace-4611-9ce7-fca7b2bb298f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:14.691150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6722010-cace-4611-9ce7-fca7b2bb298f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:14.691579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d6722010-cace-4611-9ce7-fca7b2bb298f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:14.830964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d6722010-cace-4611-9ce7-fca7b2bb298f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:14.839100 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d6722010-cace-4611-9ce7-fca7b2bb298f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1452 microversion: 2.1 time: 0.167804 Oct 05 18:16:14.839699 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3009/6264] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:14 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:14.862160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-75903db2-15db-4c05-857a-243774ea6a28 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:14.862927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-75903db2-15db-4c05-857a-243774ea6a28 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:14.870097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75903db2-15db-4c05-857a-243774ea6a28 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:14.870634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75903db2-15db-4c05-857a-243774ea6a28 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:14.871123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75903db2-15db-4c05-857a-243774ea6a28 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:14.871832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75903db2-15db-4c05-857a-243774ea6a28 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:14.872336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75903db2-15db-4c05-857a-243774ea6a28 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:14.872773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-75903db2-15db-4c05-857a-243774ea6a28 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:15.016096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-75903db2-15db-4c05-857a-243774ea6a28 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:15.024931 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-75903db2-15db-4c05-857a-243774ea6a28 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1452 microversion: 2.1 time: 0.166782 Oct 05 18:16:15.025445 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3256/6265] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:14 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:15.075670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:15.076214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:15.082519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:15.083035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:15.083474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:15.084175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:15.084631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:15.085080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:15.109258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lazy-loading 'flavor' on Instance uuid 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:16:15.121628 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Cannot 'shelve' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state shelved_offloaded Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action HTTP/1.1 Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 14 Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: {"shelve": {}} Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: exception: Cannot 'shelve' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state shelved_offloaded Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4a04f9c9-bdcf-4353-b6ae-627e1916d0a2', 'body': {'shelve': {}}} Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 18:16:15.123625 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state shelved_offloaded Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state shelved_offloaded Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 409 to user: Cannot 'shelve' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state shelved_offloaded {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c5e7a5a4-62f3-468f-862c-b35f33dd20e0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 409 len: 155 microversion: 2.1 time: 0.053525 Oct 05 18:16:15.128719 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3010/6266] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:15 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 155 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 18:16:15.134889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8057d89a-8ae6-4b0f-953e-f0cd14cd7e88 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:15.135543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8057d89a-8ae6-4b0f-953e-f0cd14cd7e88 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:15.142416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8057d89a-8ae6-4b0f-953e-f0cd14cd7e88 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:15.142924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8057d89a-8ae6-4b0f-953e-f0cd14cd7e88 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:15.143473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8057d89a-8ae6-4b0f-953e-f0cd14cd7e88 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:15.144188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8057d89a-8ae6-4b0f-953e-f0cd14cd7e88 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:15.144662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8057d89a-8ae6-4b0f-953e-f0cd14cd7e88 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:15.145104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8057d89a-8ae6-4b0f-953e-f0cd14cd7e88 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:15.188342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8057d89a-8ae6-4b0f-953e-f0cd14cd7e88 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128844) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 18:16:15.262782 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8057d89a-8ae6-4b0f-953e-f0cd14cd7e88 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.131952 Oct 05 18:16:15.263398 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3257/6267] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:15 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 18:16:15.272932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f2ba054a-2eb0-40c4-b1b9-6b4a5a2d6cfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:15.273689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f2ba054a-2eb0-40c4-b1b9-6b4a5a2d6cfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:15.280447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2ba054a-2eb0-40c4-b1b9-6b4a5a2d6cfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:15.280937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2ba054a-2eb0-40c4-b1b9-6b4a5a2d6cfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:15.281373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2ba054a-2eb0-40c4-b1b9-6b4a5a2d6cfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:15.282263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2ba054a-2eb0-40c4-b1b9-6b4a5a2d6cfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:15.282759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2ba054a-2eb0-40c4-b1b9-6b4a5a2d6cfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:15.283212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2ba054a-2eb0-40c4-b1b9-6b4a5a2d6cfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:15.418873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f2ba054a-2eb0-40c4-b1b9-6b4a5a2d6cfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:15.427078 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f2ba054a-2eb0-40c4-b1b9-6b4a5a2d6cfa tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1460 microversion: 2.1 time: 0.158803 Oct 05 18:16:15.427656 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3011/6268] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:15 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:15.683612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e5faa048-d39d-4dce-aff8-a30c1ff2d965 req-d8c6b265-24e5-4021-90ee-961712ca45ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a04f9c9-bdcf-4353-b6ae-627e1916d0a2", "name": "network-vif-unplugged", "status": "completed", "tag": "65579d35-5481-4556-bba1-3cc32437cc90"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:15.693441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e5faa048-d39d-4dce-aff8-a30c1ff2d965 req-d8c6b265-24e5-4021-90ee-961712ca45ca service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:15.693938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e5faa048-d39d-4dce-aff8-a30c1ff2d965 req-d8c6b265-24e5-4021-90ee-961712ca45ca service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:15.694444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e5faa048-d39d-4dce-aff8-a30c1ff2d965 req-d8c6b265-24e5-4021-90ee-961712ca45ca service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:15.711067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.server_external_events [req-e5faa048-d39d-4dce-aff8-a30c1ff2d965 req-d8c6b265-24e5-4021-90ee-961712ca45ca service nova] Unable to find a host for instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2. Dropping event network-vif-unplugged {{(pid=128844) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 18:16:15.712026 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e5faa048-d39d-4dce-aff8-a30c1ff2d965 req-d8c6b265-24e5-4021-90ee-961712ca45ca service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032429 Oct 05 18:16:15.712821 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3258/6269] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 05 18:16:16.453619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6e6fcbf-e713-4408-8d7d-b77a3700a618 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:16.454655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c6e6fcbf-e713-4408-8d7d-b77a3700a618 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:16.466629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6e6fcbf-e713-4408-8d7d-b77a3700a618 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:16.467440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6e6fcbf-e713-4408-8d7d-b77a3700a618 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:16.468164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6e6fcbf-e713-4408-8d7d-b77a3700a618 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:16.469380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6e6fcbf-e713-4408-8d7d-b77a3700a618 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:16.470133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6e6fcbf-e713-4408-8d7d-b77a3700a618 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:16.470890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6e6fcbf-e713-4408-8d7d-b77a3700a618 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:16.620862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c6e6fcbf-e713-4408-8d7d-b77a3700a618 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:16.629057 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c6e6fcbf-e713-4408-8d7d-b77a3700a618 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.182065 Oct 05 18:16:16.630154 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3012/6270] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:16 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:17.654370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5450171-c123-4fc0-8d2b-b97b82d6ead8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:17.656436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b5450171-c123-4fc0-8d2b-b97b82d6ead8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:17.665926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5450171-c123-4fc0-8d2b-b97b82d6ead8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:17.673712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5450171-c123-4fc0-8d2b-b97b82d6ead8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:17.674241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5450171-c123-4fc0-8d2b-b97b82d6ead8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:17.675086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5450171-c123-4fc0-8d2b-b97b82d6ead8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:17.675578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5450171-c123-4fc0-8d2b-b97b82d6ead8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:17.676089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5450171-c123-4fc0-8d2b-b97b82d6ead8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:17.824200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b5450171-c123-4fc0-8d2b-b97b82d6ead8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:17.834242 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b5450171-c123-4fc0-8d2b-b97b82d6ead8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.184790 Oct 05 18:16:17.834933 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3259/6271] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:17 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:18.857747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-631878ab-42c2-40b4-850c-327eac865dd4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:18.858506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-631878ab-42c2-40b4-850c-327eac865dd4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:18.865941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-631878ab-42c2-40b4-850c-327eac865dd4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:18.866588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-631878ab-42c2-40b4-850c-327eac865dd4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:18.867099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-631878ab-42c2-40b4-850c-327eac865dd4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:18.867866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-631878ab-42c2-40b4-850c-327eac865dd4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:18.868393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-631878ab-42c2-40b4-850c-327eac865dd4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:18.868907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-631878ab-42c2-40b4-850c-327eac865dd4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:19.118542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-631878ab-42c2-40b4-850c-327eac865dd4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:19.132522 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-631878ab-42c2-40b4-850c-327eac865dd4 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.278560 Oct 05 18:16:19.134083 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3013/6272] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:18 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:20.156869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-257cddd9-aec8-4c96-b53a-42f12cf2039e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:20.157635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-257cddd9-aec8-4c96-b53a-42f12cf2039e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:20.166053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257cddd9-aec8-4c96-b53a-42f12cf2039e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:20.166590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257cddd9-aec8-4c96-b53a-42f12cf2039e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:20.167049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257cddd9-aec8-4c96-b53a-42f12cf2039e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:20.167779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257cddd9-aec8-4c96-b53a-42f12cf2039e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:20.168256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257cddd9-aec8-4c96-b53a-42f12cf2039e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:20.173298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-257cddd9-aec8-4c96-b53a-42f12cf2039e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:20.489578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-257cddd9-aec8-4c96-b53a-42f12cf2039e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:20.514384 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-257cddd9-aec8-4c96-b53a-42f12cf2039e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.361614 Oct 05 18:16:20.525952 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3260/6273] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:20 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:20.590233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-37b0977e-7d49-48af-9cb3-96b0f4d8fdb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:20.595695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-06ebd698-1d91-4659-b6e5-2a89ff439dea req-b21666ca-46c9-4087-a59e-72f753f725f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149526b1-8830-4166-b3dc-38822df4d07d", "tag": "8a89dbba-8fa1-4ae8-b62f-c21e32f7c9c3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:20.599018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-37b0977e-7d49-48af-9cb3-96b0f4d8fdb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:20.613932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37b0977e-7d49-48af-9cb3-96b0f4d8fdb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:20.616729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37b0977e-7d49-48af-9cb3-96b0f4d8fdb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:20.617229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37b0977e-7d49-48af-9cb3-96b0f4d8fdb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:20.617987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37b0977e-7d49-48af-9cb3-96b0f4d8fdb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:20.619598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-06ebd698-1d91-4659-b6e5-2a89ff439dea req-b21666ca-46c9-4087-a59e-72f753f725f7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:20.620353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-06ebd698-1d91-4659-b6e5-2a89ff439dea req-b21666ca-46c9-4087-a59e-72f753f725f7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:20.621056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-06ebd698-1d91-4659-b6e5-2a89ff439dea req-b21666ca-46c9-4087-a59e-72f753f725f7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:20.622453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37b0977e-7d49-48af-9cb3-96b0f4d8fdb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:20.623032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37b0977e-7d49-48af-9cb3-96b0f4d8fdb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:20.653203 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-06ebd698-1d91-4659-b6e5-2a89ff439dea req-b21666ca-46c9-4087-a59e-72f753f725f7 service nova] Creating event network-changed:8a89dbba-8fa1-4ae8-b62f-c21e32f7c9c3 for instance 149526b1-8830-4166-b3dc-38822df4d07d on n-h1-835595-3 Oct 05 18:16:20.676559 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-06ebd698-1d91-4659-b6e5-2a89ff439dea req-b21666ca-46c9-4087-a59e-72f753f725f7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084634 Oct 05 18:16:20.677340 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3261/6274] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:16:20.694179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-37b0977e-7d49-48af-9cb3-96b0f4d8fdb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:16:20.892537 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-37b0977e-7d49-48af-9cb3-96b0f4d8fdb3 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 204 len: 0 microversion: 2.1 time: 0.305825 Oct 05 18:16:20.896392 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3014/6275] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:16:20 2022] DELETE /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:16:20.903767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-11094b5c-72b6-4231-8273-2c1beb5a51ae tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:20.905053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-11094b5c-72b6-4231-8273-2c1beb5a51ae tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:20.922696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11094b5c-72b6-4231-8273-2c1beb5a51ae tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:20.925708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11094b5c-72b6-4231-8273-2c1beb5a51ae tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:20.926584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11094b5c-72b6-4231-8273-2c1beb5a51ae tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:20.932476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11094b5c-72b6-4231-8273-2c1beb5a51ae tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:20.934110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11094b5c-72b6-4231-8273-2c1beb5a51ae tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:20.939986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-11094b5c-72b6-4231-8273-2c1beb5a51ae tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:21.194684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-11094b5c-72b6-4231-8273-2c1beb5a51ae tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:21.209062 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-11094b5c-72b6-4231-8273-2c1beb5a51ae tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1576 microversion: 2.1 time: 0.310552 Oct 05 18:16:21.224100 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3262/6276] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:20 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1576 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:21.553249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f4877f11-74da-43d7-aa12-ae945b25e00a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:21.553987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f4877f11-74da-43d7-aa12-ae945b25e00a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:21.569941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4877f11-74da-43d7-aa12-ae945b25e00a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:21.570474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4877f11-74da-43d7-aa12-ae945b25e00a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:21.570915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4877f11-74da-43d7-aa12-ae945b25e00a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:21.571642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4877f11-74da-43d7-aa12-ae945b25e00a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:21.572095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4877f11-74da-43d7-aa12-ae945b25e00a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:21.572520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4877f11-74da-43d7-aa12-ae945b25e00a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:22.034105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f4877f11-74da-43d7-aa12-ae945b25e00a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:22.049906 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f4877f11-74da-43d7-aa12-ae945b25e00a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.497104 Oct 05 18:16:22.051975 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3015/6277] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:21 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:22.236222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab5359de-8647-440e-ad44-d584f9a34189 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:22.237929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ab5359de-8647-440e-ad44-d584f9a34189 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:22.252307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab5359de-8647-440e-ad44-d584f9a34189 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:22.253213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab5359de-8647-440e-ad44-d584f9a34189 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:22.258382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab5359de-8647-440e-ad44-d584f9a34189 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:22.259680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab5359de-8647-440e-ad44-d584f9a34189 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:22.260337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab5359de-8647-440e-ad44-d584f9a34189 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:22.260941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab5359de-8647-440e-ad44-d584f9a34189 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:22.569682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab5359de-8647-440e-ad44-d584f9a34189 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:22.582332 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab5359de-8647-440e-ad44-d584f9a34189 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1576 microversion: 2.1 time: 0.350399 Oct 05 18:16:22.583274 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3263/6278] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:22 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1576 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:23.102412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f6d61f5c-3ddc-4bd9-ab3e-1daa348b3d61 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:23.102412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f6d61f5c-3ddc-4bd9-ab3e-1daa348b3d61 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:23.109503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6d61f5c-3ddc-4bd9-ab3e-1daa348b3d61 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:23.110021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6d61f5c-3ddc-4bd9-ab3e-1daa348b3d61 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:23.110518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6d61f5c-3ddc-4bd9-ab3e-1daa348b3d61 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:23.115064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6d61f5c-3ddc-4bd9-ab3e-1daa348b3d61 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:23.115578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6d61f5c-3ddc-4bd9-ab3e-1daa348b3d61 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:23.116142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6d61f5c-3ddc-4bd9-ab3e-1daa348b3d61 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:23.610871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0610f4e9-b23a-4ced-8f4f-9a7ac4429854 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:23.611559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0610f4e9-b23a-4ced-8f4f-9a7ac4429854 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:23.624421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0610f4e9-b23a-4ced-8f4f-9a7ac4429854 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:23.624776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0610f4e9-b23a-4ced-8f4f-9a7ac4429854 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:23.625229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0610f4e9-b23a-4ced-8f4f-9a7ac4429854 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:23.625957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0610f4e9-b23a-4ced-8f4f-9a7ac4429854 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:23.626460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0610f4e9-b23a-4ced-8f4f-9a7ac4429854 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:23.626896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0610f4e9-b23a-4ced-8f4f-9a7ac4429854 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:23.943413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f6d61f5c-3ddc-4bd9-ab3e-1daa348b3d61 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:23.952745 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f6d61f5c-3ddc-4bd9-ab3e-1daa348b3d61 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.866470 Oct 05 18:16:23.953341 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3016/6279] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:23 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:23.983569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0610f4e9-b23a-4ced-8f4f-9a7ac4429854 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:23.988288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:24.006696 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0610f4e9-b23a-4ced-8f4f-9a7ac4429854 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1457 microversion: 2.1 time: 0.397924 Oct 05 18:16:24.008897 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3264/6280] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:23 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1457 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:24.568835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4a4eda40-2ff5-4882-aa1c-0a9344d97597 req-b02411bc-e667-4fcb-8b72-de65e7788434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149526b1-8830-4166-b3dc-38822df4d07d", "name": "network-vif-deleted", "tag": "8a89dbba-8fa1-4ae8-b62f-c21e32f7c9c3"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:24.595072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4a4eda40-2ff5-4882-aa1c-0a9344d97597 req-b02411bc-e667-4fcb-8b72-de65e7788434 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:24.595569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4a4eda40-2ff5-4882-aa1c-0a9344d97597 req-b02411bc-e667-4fcb-8b72-de65e7788434 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:24.596010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4a4eda40-2ff5-4882-aa1c-0a9344d97597 req-b02411bc-e667-4fcb-8b72-de65e7788434 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:24.633834 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4a4eda40-2ff5-4882-aa1c-0a9344d97597 req-b02411bc-e667-4fcb-8b72-de65e7788434 service nova] Creating event network-vif-deleted:8a89dbba-8fa1-4ae8-b62f-c21e32f7c9c3 for instance 149526b1-8830-4166-b3dc-38822df4d07d on n-h1-835595-3 Oct 05 18:16:24.643743 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4a4eda40-2ff5-4882-aa1c-0a9344d97597 req-b02411bc-e667-4fcb-8b72-de65e7788434 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078555 Oct 05 18:16:24.645884 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3017/6281] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:16:24.978018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-89bfcd35-7206-492b-99b9-c134906d3079 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:24.980266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-89bfcd35-7206-492b-99b9-c134906d3079 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:25.004001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89bfcd35-7206-492b-99b9-c134906d3079 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:25.004832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89bfcd35-7206-492b-99b9-c134906d3079 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:25.010109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89bfcd35-7206-492b-99b9-c134906d3079 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:25.011332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89bfcd35-7206-492b-99b9-c134906d3079 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:25.017430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89bfcd35-7206-492b-99b9-c134906d3079 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:25.018333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89bfcd35-7206-492b-99b9-c134906d3079 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:25.032084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-831db19a-d710-41da-b4a1-84a0b55af55d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:25.033294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-831db19a-d710-41da-b4a1-84a0b55af55d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:25.051163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-831db19a-d710-41da-b4a1-84a0b55af55d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:25.056790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-831db19a-d710-41da-b4a1-84a0b55af55d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:25.057482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-831db19a-d710-41da-b4a1-84a0b55af55d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:25.059899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-831db19a-d710-41da-b4a1-84a0b55af55d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:25.067038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-831db19a-d710-41da-b4a1-84a0b55af55d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:25.070205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-831db19a-d710-41da-b4a1-84a0b55af55d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:25.390060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-831db19a-d710-41da-b4a1-84a0b55af55d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:25.405496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-89bfcd35-7206-492b-99b9-c134906d3079 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:25.420575 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-89bfcd35-7206-492b-99b9-c134906d3079 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.446608 Oct 05 18:16:25.425316 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3265/6282] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:24 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:25.427614 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-831db19a-d710-41da-b4a1-84a0b55af55d tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1225 microversion: 2.1 time: 0.400460 Oct 05 18:16:25.436998 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3018/6283] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:25 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1225 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:26.453699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e7b0aab8-b46a-4193-b30f-44939cc32cf2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:26.454372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8b41ead3-1619-4221-be3d-f7ed68250641 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:26.454771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e7b0aab8-b46a-4193-b30f-44939cc32cf2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:26.454871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8b41ead3-1619-4221-be3d-f7ed68250641 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:26.470824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7b0aab8-b46a-4193-b30f-44939cc32cf2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:26.471448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7b0aab8-b46a-4193-b30f-44939cc32cf2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:26.473195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b41ead3-1619-4221-be3d-f7ed68250641 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:26.473866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7b0aab8-b46a-4193-b30f-44939cc32cf2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:26.476029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7b0aab8-b46a-4193-b30f-44939cc32cf2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:26.476912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7b0aab8-b46a-4193-b30f-44939cc32cf2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:26.477707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e7b0aab8-b46a-4193-b30f-44939cc32cf2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:26.478235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b41ead3-1619-4221-be3d-f7ed68250641 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:26.479665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b41ead3-1619-4221-be3d-f7ed68250641 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:26.481340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b41ead3-1619-4221-be3d-f7ed68250641 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:26.483677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b41ead3-1619-4221-be3d-f7ed68250641 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:26.485743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b41ead3-1619-4221-be3d-f7ed68250641 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:26.675793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e7b0aab8-b46a-4193-b30f-44939cc32cf2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:26.685983 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e7b0aab8-b46a-4193-b30f-44939cc32cf2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1225 microversion: 2.1 time: 0.236223 Oct 05 18:16:26.688713 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3019/6284] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:26 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1225 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:26.751805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8b41ead3-1619-4221-be3d-f7ed68250641 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:26.760889 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8b41ead3-1619-4221-be3d-f7ed68250641 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.320003 Oct 05 18:16:26.780962 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3266/6285] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:26 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:27.620323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-911659448", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "7cecb848-b7df-40ab-b01f-c1fce71f5c38"}], "key_name": "tempest-TestSecurityGroupsBasicOps-948182754", "security_groups": []}, "os:scheduler_hints": {"different_host": ["41cb647d-f404-486a-9a12-dc535f360fbb"]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:27.683730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] validate_networks() for [('7cecb848-b7df-40ab-b01f-c1fce71f5c38', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:16:27.709785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-336cfe82-df86-412b-97af-e9d7113d6671 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:27.711154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-336cfe82-df86-412b-97af-e9d7113d6671 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:27.720497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-336cfe82-df86-412b-97af-e9d7113d6671 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:27.721370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-336cfe82-df86-412b-97af-e9d7113d6671 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:27.722064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-336cfe82-df86-412b-97af-e9d7113d6671 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:27.723049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-336cfe82-df86-412b-97af-e9d7113d6671 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:27.723717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-336cfe82-df86-412b-97af-e9d7113d6671 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:27.724343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-336cfe82-df86-412b-97af-e9d7113d6671 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:27.819844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-336cfe82-df86-412b-97af-e9d7113d6671 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:27.829217 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-336cfe82-df86-412b-97af-e9d7113d6671 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1225 microversion: 2.1 time: 0.123323 Oct 05 18:16:27.844536 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3267/6286] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:27 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1225 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:27.849205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-71d0b72a-f4a2-4893-85e3-472e8d5796be tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:27.850415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-71d0b72a-f4a2-4893-85e3-472e8d5796be tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:27.857219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d0b72a-f4a2-4893-85e3-472e8d5796be tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:27.857853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d0b72a-f4a2-4893-85e3-472e8d5796be tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:27.858451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d0b72a-f4a2-4893-85e3-472e8d5796be tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:27.859592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d0b72a-f4a2-4893-85e3-472e8d5796be tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:27.860174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d0b72a-f4a2-4893-85e3-472e8d5796be tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:27.860919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71d0b72a-f4a2-4893-85e3-472e8d5796be tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:28.026755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-71d0b72a-f4a2-4893-85e3-472e8d5796be tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:28.036942 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-71d0b72a-f4a2-4893-85e3-472e8d5796be tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.197186 Oct 05 18:16:28.039028 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3268/6287] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:27 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:28.185532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:16:28.186263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:16:28.187005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:16:28.187487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:16:28.187978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:16:28.197566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:28.198160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:28.198818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:28.199584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:28.200080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:28.200573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:28.218859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Getting quotas for project 81356660aaae46deb0c3107128256727. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:16:28.224538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Getting quotas for user e0627766a159459283ed2788f79b7b8e and project 81356660aaae46deb0c3107128256727. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:16:28.237844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:16:28.240353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:16:28.290846 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b1776407-4d42-4d30-ad34-073e7ea5ec5e tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.674178 Oct 05 18:16:28.298140 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3020/6288] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:16:27 2022] POST /compute/v2.1/servers => generated 361 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:16:28.304352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-821f91ca-f622-4446-b988-326955c152b3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:28.305404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-821f91ca-f622-4446-b988-326955c152b3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:28.383742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-821f91ca-f622-4446-b988-326955c152b3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:28.394820 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-821f91ca-f622-4446-b988-326955c152b3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1240 microversion: 2.1 time: 0.093919 Oct 05 18:16:28.396491 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3269/6289] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:28 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:28.852637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d861039b-7625-4a1f-8c1a-c669eee88bce tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:28.854031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d861039b-7625-4a1f-8c1a-c669eee88bce tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:28.863724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d861039b-7625-4a1f-8c1a-c669eee88bce tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:28.865485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d861039b-7625-4a1f-8c1a-c669eee88bce tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:28.866478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d861039b-7625-4a1f-8c1a-c669eee88bce tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:28.867441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d861039b-7625-4a1f-8c1a-c669eee88bce tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:28.868223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d861039b-7625-4a1f-8c1a-c669eee88bce tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:28.869033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d861039b-7625-4a1f-8c1a-c669eee88bce tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:28.875765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:28.971745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d861039b-7625-4a1f-8c1a-c669eee88bce tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:28.985099 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d861039b-7625-4a1f-8c1a-c669eee88bce tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1225 microversion: 2.1 time: 0.136924 Oct 05 18:16:28.985820 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3021/6290] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:28 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:29.061415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92fee6c6-4e24-4ba1-888f-53293126d245 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:29.062051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92fee6c6-4e24-4ba1-888f-53293126d245 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:29.072198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92fee6c6-4e24-4ba1-888f-53293126d245 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:29.072723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92fee6c6-4e24-4ba1-888f-53293126d245 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:29.073196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92fee6c6-4e24-4ba1-888f-53293126d245 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:29.075808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92fee6c6-4e24-4ba1-888f-53293126d245 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:29.078901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92fee6c6-4e24-4ba1-888f-53293126d245 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:29.079554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92fee6c6-4e24-4ba1-888f-53293126d245 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:29.241440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92fee6c6-4e24-4ba1-888f-53293126d245 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:29.251267 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92fee6c6-4e24-4ba1-888f-53293126d245 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.193791 Oct 05 18:16:29.252167 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3270/6291] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:29 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:29.418801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-83198b72-57e0-4fea-9b3a-ac33f4168daf tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:29.419345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-83198b72-57e0-4fea-9b3a-ac33f4168daf tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:29.425701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83198b72-57e0-4fea-9b3a-ac33f4168daf tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:29.426192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83198b72-57e0-4fea-9b3a-ac33f4168daf tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:29.426654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83198b72-57e0-4fea-9b3a-ac33f4168daf tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:29.427348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83198b72-57e0-4fea-9b3a-ac33f4168daf tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:29.427792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83198b72-57e0-4fea-9b3a-ac33f4168daf tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:29.428205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83198b72-57e0-4fea-9b3a-ac33f4168daf tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:29.565608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-83198b72-57e0-4fea-9b3a-ac33f4168daf tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:29.576469 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-83198b72-57e0-4fea-9b3a-ac33f4168daf tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1292 microversion: 2.1 time: 0.161258 Oct 05 18:16:29.590307 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3022/6292] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:29 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1292 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:30.012801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-34274fa8-355a-47cf-a7da-75e72e843668 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:30.015110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-34274fa8-355a-47cf-a7da-75e72e843668 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:30.025829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34274fa8-355a-47cf-a7da-75e72e843668 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:30.027047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34274fa8-355a-47cf-a7da-75e72e843668 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:30.028005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34274fa8-355a-47cf-a7da-75e72e843668 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:30.029800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34274fa8-355a-47cf-a7da-75e72e843668 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:30.030905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34274fa8-355a-47cf-a7da-75e72e843668 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:30.032517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-34274fa8-355a-47cf-a7da-75e72e843668 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:30.111915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-34274fa8-355a-47cf-a7da-75e72e843668 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:30.126163 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-34274fa8-355a-47cf-a7da-75e72e843668 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1225 microversion: 2.1 time: 0.119275 Oct 05 18:16:30.141841 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3271/6293] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:30 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1225 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:30.276207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-99143ea4-6449-4c53-a074-b37432359bac tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:30.276831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-99143ea4-6449-4c53-a074-b37432359bac tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:30.290818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99143ea4-6449-4c53-a074-b37432359bac tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:30.291432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99143ea4-6449-4c53-a074-b37432359bac tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:30.295724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99143ea4-6449-4c53-a074-b37432359bac tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:30.296056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99143ea4-6449-4c53-a074-b37432359bac tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:30.296420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99143ea4-6449-4c53-a074-b37432359bac tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:30.296859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99143ea4-6449-4c53-a074-b37432359bac tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:30.523391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-99143ea4-6449-4c53-a074-b37432359bac tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:30.534541 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-99143ea4-6449-4c53-a074-b37432359bac tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.260552 Oct 05 18:16:30.535168 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3023/6294] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:30 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:30.607388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a7397c06-34d9-46e9-bb41-401a594edbb5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:30.610177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a7397c06-34d9-46e9-bb41-401a594edbb5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:30.617494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:30.634267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7397c06-34d9-46e9-bb41-401a594edbb5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:30.648151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7397c06-34d9-46e9-bb41-401a594edbb5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:30.648624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7397c06-34d9-46e9-bb41-401a594edbb5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:30.659244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7397c06-34d9-46e9-bb41-401a594edbb5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:30.662058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7397c06-34d9-46e9-bb41-401a594edbb5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:30.666094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a7397c06-34d9-46e9-bb41-401a594edbb5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:30.839820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a7397c06-34d9-46e9-bb41-401a594edbb5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:30.849240 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a7397c06-34d9-46e9-bb41-401a594edbb5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1298 microversion: 2.1 time: 0.249951 Oct 05 18:16:30.860758 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3272/6295] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:30 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1298 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:31.149286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:31.150202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:31.156864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:31.157456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:31.158100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:31.159022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:31.159332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:31.159892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:31.197806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:31.198431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:31.198873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:31.199416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lazy-loading 'fault' on Instance uuid 149526b1-8830-4166-b3dc-38822df4d07d {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:16:31.278991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:31.291348 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9f677615-adc5-411c-b8e3-f6f7bc04ab56 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 200 len: 1230 microversion: 2.1 time: 0.145966 Oct 05 18:16:31.292361 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3024/6296] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:31 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 1230 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:31.541830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3a695cb5-bbb3-4102-b2ca-ffd3d2d23d6e req-c15fe96f-08d6-4857-8a61-a9f7a93a8d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9f00261-589b-4563-984e-3139828f8081", "tag": "c88b1632-d065-41cf-b105-844518e2d124"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:31.557463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3a695cb5-bbb3-4102-b2ca-ffd3d2d23d6e req-c15fe96f-08d6-4857-8a61-a9f7a93a8d7f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:31.558123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3a695cb5-bbb3-4102-b2ca-ffd3d2d23d6e req-c15fe96f-08d6-4857-8a61-a9f7a93a8d7f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:31.558812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3a695cb5-bbb3-4102-b2ca-ffd3d2d23d6e req-c15fe96f-08d6-4857-8a61-a9f7a93a8d7f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:31.566084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a2d19568-5f79-48ec-b91f-9ae99e11ff14 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:31.567330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a2d19568-5f79-48ec-b91f-9ae99e11ff14 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:31.572304 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3a695cb5-bbb3-4102-b2ca-ffd3d2d23d6e req-c15fe96f-08d6-4857-8a61-a9f7a93a8d7f service nova] Creating event network-changed:c88b1632-d065-41cf-b105-844518e2d124 for instance a9f00261-589b-4563-984e-3139828f8081 on n-h1-835595-3 Oct 05 18:16:31.577939 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3a695cb5-bbb3-4102-b2ca-ffd3d2d23d6e req-c15fe96f-08d6-4857-8a61-a9f7a93a8d7f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039933 Oct 05 18:16:31.578148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2d19568-5f79-48ec-b91f-9ae99e11ff14 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:31.578982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2d19568-5f79-48ec-b91f-9ae99e11ff14 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:31.579415 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3273/6297] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:16:31.579736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2d19568-5f79-48ec-b91f-9ae99e11ff14 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:31.580563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2d19568-5f79-48ec-b91f-9ae99e11ff14 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:31.581202 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2d19568-5f79-48ec-b91f-9ae99e11ff14 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:31.581779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2d19568-5f79-48ec-b91f-9ae99e11ff14 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:31.851739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a2d19568-5f79-48ec-b91f-9ae99e11ff14 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:31.855560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-888ed35b-4155-4253-ba1a-1177408442e6 req-ac940ecb-cb5f-4cdf-8e53-b064fd42f6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a04f9c9-bdcf-4353-b6ae-627e1916d0a2", "name": "network-vif-plugged", "status": "completed", "tag": "65579d35-5481-4556-bba1-3cc32437cc90"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:31.861857 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a2d19568-5f79-48ec-b91f-9ae99e11ff14 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.305456 Oct 05 18:16:31.870174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-888ed35b-4155-4253-ba1a-1177408442e6 req-ac940ecb-cb5f-4cdf-8e53-b064fd42f6b7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:31.871806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-888ed35b-4155-4253-ba1a-1177408442e6 req-ac940ecb-cb5f-4cdf-8e53-b064fd42f6b7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:31.872463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-888ed35b-4155-4253-ba1a-1177408442e6 req-ac940ecb-cb5f-4cdf-8e53-b064fd42f6b7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:31.872614 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3025/6298] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:31 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:31.884958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4b4f692-416d-4482-b823-35a94ad229f3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:31.885582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4b4f692-416d-4482-b823-35a94ad229f3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:31.888946 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-888ed35b-4155-4253-ba1a-1177408442e6 req-ac940ecb-cb5f-4cdf-8e53-b064fd42f6b7 service nova] Creating event network-vif-plugged:65579d35-5481-4556-bba1-3cc32437cc90 for instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 on n-h2-835595-3 Oct 05 18:16:31.894005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b4f692-416d-4482-b823-35a94ad229f3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:31.894585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b4f692-416d-4482-b823-35a94ad229f3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:31.895031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b4f692-416d-4482-b823-35a94ad229f3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:31.895345 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-888ed35b-4155-4253-ba1a-1177408442e6 req-ac940ecb-cb5f-4cdf-8e53-b064fd42f6b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045844 Oct 05 18:16:31.895746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b4f692-416d-4482-b823-35a94ad229f3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:31.896020 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3274/6299] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:16:31.896186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b4f692-416d-4482-b823-35a94ad229f3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:31.896611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4b4f692-416d-4482-b823-35a94ad229f3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:32.021679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c4b4f692-416d-4482-b823-35a94ad229f3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:32.029797 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4b4f692-416d-4482-b823-35a94ad229f3 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1298 microversion: 2.1 time: 0.150041 Oct 05 18:16:32.030427 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3026/6300] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:31 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:32.319905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:32.321139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 149526b1-8830-4166-b3dc-38822df4d07d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:32.332043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:32.332540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:32.332989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:32.333712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:32.334181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:32.334654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:32.348917 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance 149526b1-8830-4166-b3dc-38822df4d07d could not be found. Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d HTTP/1.1 Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 149526b1-8830-4166-b3dc-38822df4d07d could not be found. Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '149526b1-8830-4166-b3dc-38822df4d07d'} Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149526b1-8830-4166-b3dc-38822df4d07d could not be found. Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149526b1-8830-4166-b3dc-38822df4d07d could not be found. Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:32.350628 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:32.356271 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:32.356271 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:32.356271 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:32.356271 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:32.356271 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:32.356271 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149526b1-8830-4166-b3dc-38822df4d07d could not be found. Oct 05 18:16:32.356271 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:32.356271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance 149526b1-8830-4166-b3dc-38822df4d07d could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:32.356271 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ef31289-61d0-46f2-b3c5-c181e328df53 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d" status: 404 len: 111 microversion: 2.1 time: 0.039647 Oct 05 18:16:32.356271 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3275/6301] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:32 2022] GET /compute/v2.1/servers/149526b1-8830-4166-b3dc-38822df4d07d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:32.886183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ce855b0-eed9-4e7d-8e6d-36ceb2fa67f1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:32.886886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7ce855b0-eed9-4e7d-8e6d-36ceb2fa67f1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:32.894371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce855b0-eed9-4e7d-8e6d-36ceb2fa67f1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:32.894837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce855b0-eed9-4e7d-8e6d-36ceb2fa67f1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:32.895524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce855b0-eed9-4e7d-8e6d-36ceb2fa67f1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:32.896220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce855b0-eed9-4e7d-8e6d-36ceb2fa67f1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:32.896679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce855b0-eed9-4e7d-8e6d-36ceb2fa67f1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:32.897106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ce855b0-eed9-4e7d-8e6d-36ceb2fa67f1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:33.060062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-844c2699-5ee1-4dff-aa87-06ecfbd5c6ba tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:33.062171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-844c2699-5ee1-4dff-aa87-06ecfbd5c6ba tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:33.076954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-844c2699-5ee1-4dff-aa87-06ecfbd5c6ba tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:33.077491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-844c2699-5ee1-4dff-aa87-06ecfbd5c6ba tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:33.077951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-844c2699-5ee1-4dff-aa87-06ecfbd5c6ba tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:33.078709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-844c2699-5ee1-4dff-aa87-06ecfbd5c6ba tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:33.079357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-844c2699-5ee1-4dff-aa87-06ecfbd5c6ba tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:33.079494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7ce855b0-eed9-4e7d-8e6d-36ceb2fa67f1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:33.080282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-844c2699-5ee1-4dff-aa87-06ecfbd5c6ba tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:33.108631 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ce855b0-eed9-4e7d-8e6d-36ceb2fa67f1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1518 microversion: 2.1 time: 0.226548 Oct 05 18:16:33.109441 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3027/6302] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:32 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1518 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:33.194208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-844c2699-5ee1-4dff-aa87-06ecfbd5c6ba tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:33.204713 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-844c2699-5ee1-4dff-aa87-06ecfbd5c6ba tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1298 microversion: 2.1 time: 0.148575 Oct 05 18:16:33.206231 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3276/6303] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:33 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:34.134141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6cb40028-6a72-4b2b-9389-59b0eeaca8e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:34.135203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6cb40028-6a72-4b2b-9389-59b0eeaca8e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:34.142840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cb40028-6a72-4b2b-9389-59b0eeaca8e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.143253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cb40028-6a72-4b2b-9389-59b0eeaca8e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.143665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cb40028-6a72-4b2b-9389-59b0eeaca8e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.144374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cb40028-6a72-4b2b-9389-59b0eeaca8e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.144821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cb40028-6a72-4b2b-9389-59b0eeaca8e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.145238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cb40028-6a72-4b2b-9389-59b0eeaca8e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.231217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e9e5090-1149-4541-8920-658cc9096cfb tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:34.233103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5e9e5090-1149-4541-8920-658cc9096cfb tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:34.246226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e9e5090-1149-4541-8920-658cc9096cfb tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.246996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e9e5090-1149-4541-8920-658cc9096cfb tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.247611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e9e5090-1149-4541-8920-658cc9096cfb tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.248505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e9e5090-1149-4541-8920-658cc9096cfb tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.249236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e9e5090-1149-4541-8920-658cc9096cfb tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.249828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5e9e5090-1149-4541-8920-658cc9096cfb tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.292547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6cb40028-6a72-4b2b-9389-59b0eeaca8e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:34.300843 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6cb40028-6a72-4b2b-9389-59b0eeaca8e1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.171552 Oct 05 18:16:34.301434 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3028/6304] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:34 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:34.324117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-07a1f344-8b9b-4756-bca7-12b50f747237 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:34.324979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-07a1f344-8b9b-4756-bca7-12b50f747237 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:34.331310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07a1f344-8b9b-4756-bca7-12b50f747237 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.331808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07a1f344-8b9b-4756-bca7-12b50f747237 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.332246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07a1f344-8b9b-4756-bca7-12b50f747237 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.332954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07a1f344-8b9b-4756-bca7-12b50f747237 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.333607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07a1f344-8b9b-4756-bca7-12b50f747237 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.334038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07a1f344-8b9b-4756-bca7-12b50f747237 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.354844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5e9e5090-1149-4541-8920-658cc9096cfb tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:34.368887 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e9e5090-1149-4541-8920-658cc9096cfb tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1298 microversion: 2.1 time: 0.143719 Oct 05 18:16:34.372925 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3277/6305] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:34 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:34.485418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-07a1f344-8b9b-4756-bca7-12b50f747237 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:34.494085 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-07a1f344-8b9b-4756-bca7-12b50f747237 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.173752 Oct 05 18:16:34.494752 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3029/6306] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:34 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:34.522498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9cc4851-f16f-4faf-9a2d-01beb3f3df94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:34.523116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9cc4851-f16f-4faf-9a2d-01beb3f3df94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:34.529284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9cc4851-f16f-4faf-9a2d-01beb3f3df94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.529758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9cc4851-f16f-4faf-9a2d-01beb3f3df94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.530419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9cc4851-f16f-4faf-9a2d-01beb3f3df94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.531330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9cc4851-f16f-4faf-9a2d-01beb3f3df94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.531803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9cc4851-f16f-4faf-9a2d-01beb3f3df94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.532210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9cc4851-f16f-4faf-9a2d-01beb3f3df94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.667046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9cc4851-f16f-4faf-9a2d-01beb3f3df94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:34.676009 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9cc4851-f16f-4faf-9a2d-01beb3f3df94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.157466 Oct 05 18:16:34.676802 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3278/6307] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:34 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:34.698445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e529829a-9fdb-4c6f-a8dc-165c8afdb35f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:34.704823 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e529829a-9fdb-4c6f-a8dc-165c8afdb35f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 98b79803-8c3a-42dd-86ac-04760ec5ca23 has no mapping to a cell. Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e529829a-9fdb-4c6f-a8dc-165c8afdb35f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/98b79803-8c3a-42dd-86ac-04760ec5ca23/action HTTP/1.1 Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 15 Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: {"os-stop": {}} Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 98b79803-8c3a-42dd-86ac-04760ec5ca23 has no mapping to a cell. Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '98b79803-8c3a-42dd-86ac-04760ec5ca23', 'body': {'os-stop': {}}} Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 98b79803-8c3a-42dd-86ac-04760ec5ca23 has no mapping to a cell. Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:34.761500 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b79803-8c3a-42dd-86ac-04760ec5ca23 has no mapping to a cell. Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b79803-8c3a-42dd-86ac-04760ec5ca23 has no mapping to a cell. Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e529829a-9fdb-4c6f-a8dc-165c8afdb35f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 98b79803-8c3a-42dd-86ac-04760ec5ca23 has no mapping to a cell. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e529829a-9fdb-4c6f-a8dc-165c8afdb35f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/98b79803-8c3a-42dd-86ac-04760ec5ca23/action" status: 404 len: 117 microversion: 2.1 time: 0.068789 Oct 05 18:16:34.771070 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3030/6308] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:34 2022] POST /compute/v2.1/servers/98b79803-8c3a-42dd-86ac-04760ec5ca23/action => generated 117 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:34.778426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a478fef4-d1db-4c6f-955d-967a6cb3878e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:34.779137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a478fef4-d1db-4c6f-955d-967a6cb3878e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:34.785539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a478fef4-d1db-4c6f-955d-967a6cb3878e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.786125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a478fef4-d1db-4c6f-955d-967a6cb3878e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.787007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a478fef4-d1db-4c6f-955d-967a6cb3878e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.787480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a478fef4-d1db-4c6f-955d-967a6cb3878e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.788027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a478fef4-d1db-4c6f-955d-967a6cb3878e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.788573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a478fef4-d1db-4c6f-955d-967a6cb3878e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.946914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a478fef4-d1db-4c6f-955d-967a6cb3878e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:34.956299 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a478fef4-d1db-4c6f-955d-967a6cb3878e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.181830 Oct 05 18:16:34.956978 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3279/6309] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:34 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:34.980254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6fa29656-bbda-4b96-ab32-9e802bd2918e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:34.980864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6fa29656-bbda-4b96-ab32-9e802bd2918e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:34.991185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fa29656-bbda-4b96-ab32-9e802bd2918e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.991717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fa29656-bbda-4b96-ab32-9e802bd2918e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.992162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fa29656-bbda-4b96-ab32-9e802bd2918e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:34.992875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fa29656-bbda-4b96-ab32-9e802bd2918e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:34.993334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fa29656-bbda-4b96-ab32-9e802bd2918e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:34.993766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fa29656-bbda-4b96-ab32-9e802bd2918e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.136612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6fa29656-bbda-4b96-ab32-9e802bd2918e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:35.147095 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6fa29656-bbda-4b96-ab32-9e802bd2918e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.170352 Oct 05 18:16:35.148201 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3031/6310] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:34 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:35.172329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42688bc1-dc94-4794-b3c5-0e167a789149 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:35.172811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-42688bc1-dc94-4794-b3c5-0e167a789149 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 5284493d-a70d-4de0-85b2-22c6997e6096] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:35.180074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-42688bc1-dc94-4794-b3c5-0e167a789149 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 5284493d-a70d-4de0-85b2-22c6997e6096 could not be found. Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42688bc1-dc94-4794-b3c5-0e167a789149 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/5284493d-a70d-4de0-85b2-22c6997e6096/action HTTP/1.1 Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 15 Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: {"suspend": {}} Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 5284493d-a70d-4de0-85b2-22c6997e6096 could not be found. Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '5284493d-a70d-4de0-85b2-22c6997e6096', 'body': {'suspend': {}}} Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5284493d-a70d-4de0-85b2-22c6997e6096 could not be found. Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5284493d-a70d-4de0-85b2-22c6997e6096 could not be found. Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:35.181915 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:35.186888 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:35.186888 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:35.186888 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5284493d-a70d-4de0-85b2-22c6997e6096 could not be found. Oct 05 18:16:35.186888 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:35.186888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42688bc1-dc94-4794-b3c5-0e167a789149 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 5284493d-a70d-4de0-85b2-22c6997e6096 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:35.186888 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-42688bc1-dc94-4794-b3c5-0e167a789149 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/5284493d-a70d-4de0-85b2-22c6997e6096/action" status: 404 len: 111 microversion: 2.1 time: 0.015892 Oct 05 18:16:35.186888 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3280/6311] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:35 2022] POST /compute/v2.1/servers/5284493d-a70d-4de0-85b2-22c6997e6096/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:35.192833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-28048fee-8ab1-4aed-b9a0-a6589709d086 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:35.193693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-28048fee-8ab1-4aed-b9a0-a6589709d086 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:35.200950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28048fee-8ab1-4aed-b9a0-a6589709d086 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:35.201524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28048fee-8ab1-4aed-b9a0-a6589709d086 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:35.202039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28048fee-8ab1-4aed-b9a0-a6589709d086 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.202874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28048fee-8ab1-4aed-b9a0-a6589709d086 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:35.203331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28048fee-8ab1-4aed-b9a0-a6589709d086 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:35.203831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-28048fee-8ab1-4aed-b9a0-a6589709d086 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.345884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-28048fee-8ab1-4aed-b9a0-a6589709d086 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:35.354770 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-28048fee-8ab1-4aed-b9a0-a6589709d086 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.165317 Oct 05 18:16:35.355746 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3032/6312] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:35 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:35.381362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36444249-1a56-48c4-b6d8-3b831fb81915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:35.382056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-36444249-1a56-48c4-b6d8-3b831fb81915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:35.390491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36444249-1a56-48c4-b6d8-3b831fb81915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:35.390990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36444249-1a56-48c4-b6d8-3b831fb81915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:35.391440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36444249-1a56-48c4-b6d8-3b831fb81915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.392548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36444249-1a56-48c4-b6d8-3b831fb81915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:35.393032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36444249-1a56-48c4-b6d8-3b831fb81915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:35.393471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36444249-1a56-48c4-b6d8-3b831fb81915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.397722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-37cf28a5-9ede-41e3-b7da-363c0655b13d tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:35.398577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-37cf28a5-9ede-41e3-b7da-363c0655b13d tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:35.404978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37cf28a5-9ede-41e3-b7da-363c0655b13d tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:35.405568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37cf28a5-9ede-41e3-b7da-363c0655b13d tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:35.406181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37cf28a5-9ede-41e3-b7da-363c0655b13d tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.406978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37cf28a5-9ede-41e3-b7da-363c0655b13d tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:35.407489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37cf28a5-9ede-41e3-b7da-363c0655b13d tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:35.407983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37cf28a5-9ede-41e3-b7da-363c0655b13d tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.503842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-37cf28a5-9ede-41e3-b7da-363c0655b13d tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:35.512801 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-37cf28a5-9ede-41e3-b7da-363c0655b13d tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1298 microversion: 2.1 time: 0.119667 Oct 05 18:16:35.513701 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3033/6313] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:35 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:35.542346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-36444249-1a56-48c4-b6d8-3b831fb81915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:35.551299 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-36444249-1a56-48c4-b6d8-3b831fb81915 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.174317 Oct 05 18:16:35.551882 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3281/6314] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:35 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:35.575125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7adfa03c-d21d-497b-a9c8-aa30b892f901 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:35.575658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7adfa03c-d21d-497b-a9c8-aa30b892f901 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:35.581831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7adfa03c-d21d-497b-a9c8-aa30b892f901 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:35.582349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7adfa03c-d21d-497b-a9c8-aa30b892f901 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:35.582780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7adfa03c-d21d-497b-a9c8-aa30b892f901 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.583464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7adfa03c-d21d-497b-a9c8-aa30b892f901 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:35.583908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7adfa03c-d21d-497b-a9c8-aa30b892f901 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:35.584323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7adfa03c-d21d-497b-a9c8-aa30b892f901 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.607842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-7adfa03c-d21d-497b-a9c8-aa30b892f901 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lazy-loading 'flavor' on Instance uuid 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:16:35.681898 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7adfa03c-d21d-497b-a9c8-aa30b892f901 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.110536 Oct 05 18:16:35.683013 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3034/6315] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:35 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:16:35.691650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e1c53b59-bd70-468f-9a99-ec2d0e4e304b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:35.692985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e1c53b59-bd70-468f-9a99-ec2d0e4e304b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:35.700803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c53b59-bd70-468f-9a99-ec2d0e4e304b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:35.701610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c53b59-bd70-468f-9a99-ec2d0e4e304b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:35.702179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c53b59-bd70-468f-9a99-ec2d0e4e304b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.703161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c53b59-bd70-468f-9a99-ec2d0e4e304b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:35.703734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c53b59-bd70-468f-9a99-ec2d0e4e304b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:35.704268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e1c53b59-bd70-468f-9a99-ec2d0e4e304b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:35.863089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e1c53b59-bd70-468f-9a99-ec2d0e4e304b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:35.871661 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e1c53b59-bd70-468f-9a99-ec2d0e4e304b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1513 microversion: 2.1 time: 0.184578 Oct 05 18:16:35.872400 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3282/6316] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:35 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:36.536787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c109f15a-12c7-4d25-ab55-41185e9721b5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:36.537619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c109f15a-12c7-4d25-ab55-41185e9721b5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:36.544254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c109f15a-12c7-4d25-ab55-41185e9721b5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:36.544834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c109f15a-12c7-4d25-ab55-41185e9721b5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:36.545343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c109f15a-12c7-4d25-ab55-41185e9721b5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:36.546115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c109f15a-12c7-4d25-ab55-41185e9721b5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:36.546673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c109f15a-12c7-4d25-ab55-41185e9721b5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:36.547170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c109f15a-12c7-4d25-ab55-41185e9721b5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:36.636212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c109f15a-12c7-4d25-ab55-41185e9721b5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:36.644474 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c109f15a-12c7-4d25-ab55-41185e9721b5 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1298 microversion: 2.1 time: 0.113146 Oct 05 18:16:36.645144 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3035/6317] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:36 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:36.899608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b1a19dfc-081a-4299-92c8-c57c6a7554e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:36.900241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b1a19dfc-081a-4299-92c8-c57c6a7554e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:36.914447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d1af040b-20a9-46f5-8eb1-738a18b70c68 req-cf8b29de-b81a-4e99-aedd-6e19402c6c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f00261-589b-4563-984e-3139828f8081", "name": "network-vif-plugged", "status": "completed", "tag": "c88b1632-d065-41cf-b105-844518e2d124"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:36.918755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1a19dfc-081a-4299-92c8-c57c6a7554e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:36.919268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1a19dfc-081a-4299-92c8-c57c6a7554e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:36.919722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1a19dfc-081a-4299-92c8-c57c6a7554e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:36.920446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1a19dfc-081a-4299-92c8-c57c6a7554e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:36.920915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1a19dfc-081a-4299-92c8-c57c6a7554e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:36.921356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b1a19dfc-081a-4299-92c8-c57c6a7554e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:36.929021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d1af040b-20a9-46f5-8eb1-738a18b70c68 req-cf8b29de-b81a-4e99-aedd-6e19402c6c54 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:36.929509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d1af040b-20a9-46f5-8eb1-738a18b70c68 req-cf8b29de-b81a-4e99-aedd-6e19402c6c54 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:36.929949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d1af040b-20a9-46f5-8eb1-738a18b70c68 req-cf8b29de-b81a-4e99-aedd-6e19402c6c54 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:36.946510 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d1af040b-20a9-46f5-8eb1-738a18b70c68 req-cf8b29de-b81a-4e99-aedd-6e19402c6c54 service nova] Creating event network-vif-plugged:c88b1632-d065-41cf-b105-844518e2d124 for instance a9f00261-589b-4563-984e-3139828f8081 on n-h1-835595-3 Oct 05 18:16:36.953039 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d1af040b-20a9-46f5-8eb1-738a18b70c68 req-cf8b29de-b81a-4e99-aedd-6e19402c6c54 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042783 Oct 05 18:16:36.954125 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3036/6318] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:16:37.105063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b1a19dfc-081a-4299-92c8-c57c6a7554e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:37.113877 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b1a19dfc-081a-4299-92c8-c57c6a7554e7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1496 microversion: 2.1 time: 0.220841 Oct 05 18:16:37.114651 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3283/6319] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:36 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1496 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:37.138357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:37.139084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:37.146190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:37.146720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:37.147222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:37.147999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:37.148542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:37.149036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:37.171141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:37.179346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lazy-loading 'flavor' on Instance uuid 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:16:37.193456 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Cannot 'suspend' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state suspended Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action HTTP/1.1 Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 15 Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: {"suspend": {}} Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: exception: Cannot 'suspend' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state suspended Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4a04f9c9-bdcf-4353-b6ae-627e1916d0a2', 'body': {'suspend': {}}} Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 05 18:16:37.195444 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state suspended Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state suspended Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 409 to user: Cannot 'suspend' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state suspended {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-89d0be56-609f-45ac-97bc-60d34168805e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 409 len: 148 microversion: 2.1 time: 0.063503 Oct 05 18:16:37.200755 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3037/6320] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:37 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 148 bytes in 65 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 18:16:37.208115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f880bd2-05b0-4084-b06f-072b446b16b1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:37.208798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f880bd2-05b0-4084-b06f-072b446b16b1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:37.215756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f880bd2-05b0-4084-b06f-072b446b16b1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:37.216255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f880bd2-05b0-4084-b06f-072b446b16b1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:37.216701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f880bd2-05b0-4084-b06f-072b446b16b1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:37.217447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f880bd2-05b0-4084-b06f-072b446b16b1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:37.218053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f880bd2-05b0-4084-b06f-072b446b16b1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:37.218508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f880bd2-05b0-4084-b06f-072b446b16b1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:37.267894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:37.290602 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f880bd2-05b0-4084-b06f-072b446b16b1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 202 len: 0 microversion: 2.1 time: 0.086686 Oct 05 18:16:37.291266 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3284/6321] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:37 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:16:37.300396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7dd98c2f-375a-4e2c-87ab-a9df928add3a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:37.301049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7dd98c2f-375a-4e2c-87ab-a9df928add3a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:37.307997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dd98c2f-375a-4e2c-87ab-a9df928add3a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:37.308540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dd98c2f-375a-4e2c-87ab-a9df928add3a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:37.309066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dd98c2f-375a-4e2c-87ab-a9df928add3a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:37.309805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dd98c2f-375a-4e2c-87ab-a9df928add3a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:37.310260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dd98c2f-375a-4e2c-87ab-a9df928add3a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:37.310711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7dd98c2f-375a-4e2c-87ab-a9df928add3a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:37.453304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7dd98c2f-375a-4e2c-87ab-a9df928add3a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:37.461523 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7dd98c2f-375a-4e2c-87ab-a9df928add3a tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1502 microversion: 2.1 time: 0.165321 Oct 05 18:16:37.462310 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3038/6322] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:37 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:37.668842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-976e7722-98a4-487b-8faa-f46a582bcf14 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:37.669662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-976e7722-98a4-487b-8faa-f46a582bcf14 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:37.677809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-976e7722-98a4-487b-8faa-f46a582bcf14 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:37.678522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-976e7722-98a4-487b-8faa-f46a582bcf14 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:37.679038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-976e7722-98a4-487b-8faa-f46a582bcf14 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:37.679765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-976e7722-98a4-487b-8faa-f46a582bcf14 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:37.680241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-976e7722-98a4-487b-8faa-f46a582bcf14 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:37.680658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-976e7722-98a4-487b-8faa-f46a582bcf14 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:37.783567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-976e7722-98a4-487b-8faa-f46a582bcf14 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:37.792466 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-976e7722-98a4-487b-8faa-f46a582bcf14 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1298 microversion: 2.1 time: 0.127923 Oct 05 18:16:37.793403 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3285/6323] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:37 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1298 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:38.486856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58b5bff3-dbb5-4a5d-8ecf-b97da3cf034b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:38.487698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-58b5bff3-dbb5-4a5d-8ecf-b97da3cf034b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:38.491332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:38.491966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:38.499363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58b5bff3-dbb5-4a5d-8ecf-b97da3cf034b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.499763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58b5bff3-dbb5-4a5d-8ecf-b97da3cf034b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.501502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58b5bff3-dbb5-4a5d-8ecf-b97da3cf034b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:38.502324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58b5bff3-dbb5-4a5d-8ecf-b97da3cf034b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.502819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58b5bff3-dbb5-4a5d-8ecf-b97da3cf034b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.503824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58b5bff3-dbb5-4a5d-8ecf-b97da3cf034b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:38.653689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58b5bff3-dbb5-4a5d-8ecf-b97da3cf034b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:38.662137 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-58b5bff3-dbb5-4a5d-8ecf-b97da3cf034b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1502 microversion: 2.1 time: 0.180496 Oct 05 18:16:38.663078 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3039/6324] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:38 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1502 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:38.816563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ab7c353-3faf-42b1-84c6-7c9654fbd3ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:38.817282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ab7c353-3faf-42b1-84c6-7c9654fbd3ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:38.817572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-deb7db2a-514c-4867-89ef-d5770cc45356 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:38.818231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-deb7db2a-514c-4867-89ef-d5770cc45356 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:38.823786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:38.824675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-deb7db2a-514c-4867-89ef-d5770cc45356 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.825209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-deb7db2a-514c-4867-89ef-d5770cc45356 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.825678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab7c353-3faf-42b1-84c6-7c9654fbd3ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.826127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-deb7db2a-514c-4867-89ef-d5770cc45356 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:38.826434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab7c353-3faf-42b1-84c6-7c9654fbd3ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.826991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab7c353-3faf-42b1-84c6-7c9654fbd3ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:38.827135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-deb7db2a-514c-4867-89ef-d5770cc45356 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.827437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-deb7db2a-514c-4867-89ef-d5770cc45356 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.827898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-deb7db2a-514c-4867-89ef-d5770cc45356 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:38.828085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab7c353-3faf-42b1-84c6-7c9654fbd3ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.828631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab7c353-3faf-42b1-84c6-7c9654fbd3ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.829158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ab7c353-3faf-42b1-84c6-7c9654fbd3ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:38.856208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ab7c353-3faf-42b1-84c6-7c9654fbd3ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:16:38.919903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-deb7db2a-514c-4867-89ef-d5770cc45356 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:38.928538 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-deb7db2a-514c-4867-89ef-d5770cc45356 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1470 microversion: 2.1 time: 0.116318 Oct 05 18:16:38.929511 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3040/6325] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:38 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1470 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:38.934136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f0759f5e-156b-47e5-b06a-eaeb8964f866 req-8ec945e5-b3ab-4949-a5ee-9c277c57470a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73029889-efdd-4945-a1cd-9d931be98e4b", "tag": "62fba8f6-9d08-4dc1-9ec0-c9ab8b5ecf0a"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:38.945097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f0759f5e-156b-47e5-b06a-eaeb8964f866 req-8ec945e5-b3ab-4949-a5ee-9c277c57470a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.945598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f0759f5e-156b-47e5-b06a-eaeb8964f866 req-8ec945e5-b3ab-4949-a5ee-9c277c57470a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.946401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f0759f5e-156b-47e5-b06a-eaeb8964f866 req-8ec945e5-b3ab-4949-a5ee-9c277c57470a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:38.960415 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f0759f5e-156b-47e5-b06a-eaeb8964f866 req-8ec945e5-b3ab-4949-a5ee-9c277c57470a service nova] Creating event network-changed:62fba8f6-9d08-4dc1-9ec0-c9ab8b5ecf0a for instance 73029889-efdd-4945-a1cd-9d931be98e4b on n-h1-835595-3 Oct 05 18:16:38.965978 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f0759f5e-156b-47e5-b06a-eaeb8964f866 req-8ec945e5-b3ab-4949-a5ee-9c277c57470a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035169 Oct 05 18:16:38.967021 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3041/6326] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:16:38.968042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ab7c353-3faf-42b1-84c6-7c9654fbd3ee tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 204 len: 0 microversion: 2.1 time: 0.155441 Oct 05 18:16:38.968766 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3286/6327] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:16:38 2022] DELETE /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 18:16:38.972843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-401c53bd-d6ac-4ccf-b329-a72f07cba3ce tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:38.973729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-401c53bd-d6ac-4ccf-b329-a72f07cba3ce tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:38.979386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8913bee8-bb6c-4416-acaf-939cc3a1944e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:38.980333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8913bee8-bb6c-4416-acaf-939cc3a1944e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:38.980690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-401c53bd-d6ac-4ccf-b329-a72f07cba3ce tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.981304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-401c53bd-d6ac-4ccf-b329-a72f07cba3ce tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.981826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-401c53bd-d6ac-4ccf-b329-a72f07cba3ce tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:38.982662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-401c53bd-d6ac-4ccf-b329-a72f07cba3ce tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.983218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-401c53bd-d6ac-4ccf-b329-a72f07cba3ce tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.983742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-401c53bd-d6ac-4ccf-b329-a72f07cba3ce tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:38.988181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8913bee8-bb6c-4416-acaf-939cc3a1944e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.988905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8913bee8-bb6c-4416-acaf-939cc3a1944e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.990176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8913bee8-bb6c-4416-acaf-939cc3a1944e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:38.991292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8913bee8-bb6c-4416-acaf-939cc3a1944e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:38.992277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8913bee8-bb6c-4416-acaf-939cc3a1944e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:38.992660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8913bee8-bb6c-4416-acaf-939cc3a1944e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.069598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-401c53bd-d6ac-4ccf-b329-a72f07cba3ce tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:39.078778 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-401c53bd-d6ac-4ccf-b329-a72f07cba3ce tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1470 microversion: 2.1 time: 0.110622 Oct 05 18:16:39.079664 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3042/6328] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:38 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1470 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:39.101771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eee13010-95a9-4395-9f9f-311c019d5225 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:39.102494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eee13010-95a9-4395-9f9f-311c019d5225 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:39.108742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eee13010-95a9-4395-9f9f-311c019d5225 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.109235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eee13010-95a9-4395-9f9f-311c019d5225 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.109671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eee13010-95a9-4395-9f9f-311c019d5225 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.110395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eee13010-95a9-4395-9f9f-311c019d5225 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.110850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eee13010-95a9-4395-9f9f-311c019d5225 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.111336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eee13010-95a9-4395-9f9f-311c019d5225 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.145533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8913bee8-bb6c-4416-acaf-939cc3a1944e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:39.153780 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8913bee8-bb6c-4416-acaf-939cc3a1944e tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1577 microversion: 2.1 time: 0.179924 Oct 05 18:16:39.154700 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3287/6329] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:38 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1577 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:39.208771 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eee13010-95a9-4395-9f9f-311c019d5225 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1621 microversion: 2.1 time: 0.111106 Oct 05 18:16:39.209480 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3043/6330] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:39 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1621 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:39.230769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b54fbaf5-14df-4e28-a847-ce45c9ca57e5 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:39.231525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b54fbaf5-14df-4e28-a847-ce45c9ca57e5 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:39.237538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b54fbaf5-14df-4e28-a847-ce45c9ca57e5 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.238037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b54fbaf5-14df-4e28-a847-ce45c9ca57e5 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.238527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b54fbaf5-14df-4e28-a847-ce45c9ca57e5 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.239237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b54fbaf5-14df-4e28-a847-ce45c9ca57e5 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.239698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b54fbaf5-14df-4e28-a847-ce45c9ca57e5 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.240131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b54fbaf5-14df-4e28-a847-ce45c9ca57e5 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.373809 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b54fbaf5-14df-4e28-a847-ce45c9ca57e5 tempest-TestSecurityGroupsBasicOps-1051408681 tempest-TestSecurityGroupsBasicOps-1051408681-project-admin] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1911 microversion: 2.1 time: 0.146694 Oct 05 18:16:39.374495 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3288/6331] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:39 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1911 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:39.439237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23f46a60-1c5c-412f-81a4-6aa9382b6e63 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:39.439745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23f46a60-1c5c-412f-81a4-6aa9382b6e63 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:39.446013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f46a60-1c5c-412f-81a4-6aa9382b6e63 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.446539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f46a60-1c5c-412f-81a4-6aa9382b6e63 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.446980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f46a60-1c5c-412f-81a4-6aa9382b6e63 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.447683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f46a60-1c5c-412f-81a4-6aa9382b6e63 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.448149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f46a60-1c5c-412f-81a4-6aa9382b6e63 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.448578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23f46a60-1c5c-412f-81a4-6aa9382b6e63 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.476711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23f46a60-1c5c-412f-81a4-6aa9382b6e63 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:16:39.555237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:39.565661 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23f46a60-1c5c-412f-81a4-6aa9382b6e63 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 204 len: 0 microversion: 2.1 time: 0.130056 Oct 05 18:16:39.566381 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3044/6332] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:16:39 2022] DELETE /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:16:39.575099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-848f6877-c70a-4176-a0bd-19f80377099b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:39.575721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-848f6877-c70a-4176-a0bd-19f80377099b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:39.581969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-848f6877-c70a-4176-a0bd-19f80377099b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.582506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-848f6877-c70a-4176-a0bd-19f80377099b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.582966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-848f6877-c70a-4176-a0bd-19f80377099b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.583650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-848f6877-c70a-4176-a0bd-19f80377099b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.584139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-848f6877-c70a-4176-a0bd-19f80377099b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.584570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-848f6877-c70a-4176-a0bd-19f80377099b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.671427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-848f6877-c70a-4176-a0bd-19f80377099b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:39.679888 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-848f6877-c70a-4176-a0bd-19f80377099b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1476 microversion: 2.1 time: 0.108590 Oct 05 18:16:39.680484 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3289/6333] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:39 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1476 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:39.692403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c674dd50-70da-445f-984b-62592c51037f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:39.693356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c674dd50-70da-445f-984b-62592c51037f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:39.700356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c674dd50-70da-445f-984b-62592c51037f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.700829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c674dd50-70da-445f-984b-62592c51037f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.701261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c674dd50-70da-445f-984b-62592c51037f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.701938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c674dd50-70da-445f-984b-62592c51037f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.702424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c674dd50-70da-445f-984b-62592c51037f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.703030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c674dd50-70da-445f-984b-62592c51037f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.839364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c674dd50-70da-445f-984b-62592c51037f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:39.847510 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c674dd50-70da-445f-984b-62592c51037f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.159619 Oct 05 18:16:39.848073 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3045/6334] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:39 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:39.872838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5baed046-2505-48b4-9881-fe416b183f16 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:39.873701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5baed046-2505-48b4-9881-fe416b183f16 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:39.884551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5baed046-2505-48b4-9881-fe416b183f16 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.885300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5baed046-2505-48b4-9881-fe416b183f16 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.885891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5baed046-2505-48b4-9881-fe416b183f16 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:39.887035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5baed046-2505-48b4-9881-fe416b183f16 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:39.887697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5baed046-2505-48b4-9881-fe416b183f16 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:39.888195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5baed046-2505-48b4-9881-fe416b183f16 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.025812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5baed046-2505-48b4-9881-fe416b183f16 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:40.034021 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5baed046-2505-48b4-9881-fe416b183f16 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.166988 Oct 05 18:16:40.034671 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3290/6335] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:39 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:40.056523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2489634d-48a7-486b-aa1e-df287b0d49fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:40.057012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2489634d-48a7-486b-aa1e-df287b0d49fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4e691ca5-1fcd-4410-a0a6-92be1b9ae05f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:40.062676 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-2489634d-48a7-486b-aa1e-df287b0d49fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 4e691ca5-1fcd-4410-a0a6-92be1b9ae05f could not be found. Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2489634d-48a7-486b-aa1e-df287b0d49fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/4e691ca5-1fcd-4410-a0a6-92be1b9ae05f/action HTTP/1.1 Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 15 Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: {"unpause": {}} Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 4e691ca5-1fcd-4410-a0a6-92be1b9ae05f could not be found. Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4e691ca5-1fcd-4410-a0a6-92be1b9ae05f', 'body': {'unpause': {}}} Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e691ca5-1fcd-4410-a0a6-92be1b9ae05f could not be found. Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e691ca5-1fcd-4410-a0a6-92be1b9ae05f could not be found. Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:40.064282 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:40.069930 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:40.069930 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:40.069930 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e691ca5-1fcd-4410-a0a6-92be1b9ae05f could not be found. Oct 05 18:16:40.069930 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.069930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2489634d-48a7-486b-aa1e-df287b0d49fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 4e691ca5-1fcd-4410-a0a6-92be1b9ae05f could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:40.069930 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2489634d-48a7-486b-aa1e-df287b0d49fc tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4e691ca5-1fcd-4410-a0a6-92be1b9ae05f/action" status: 404 len: 111 microversion: 2.1 time: 0.013380 Oct 05 18:16:40.069930 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3046/6336] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:40 2022] POST /compute/v2.1/servers/4e691ca5-1fcd-4410-a0a6-92be1b9ae05f/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:40.074310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-359f2b97-26bd-499c-881d-ced6a3ee17ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:40.074982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-359f2b97-26bd-499c-881d-ced6a3ee17ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:40.081373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-359f2b97-26bd-499c-881d-ced6a3ee17ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.081880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-359f2b97-26bd-499c-881d-ced6a3ee17ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.082359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-359f2b97-26bd-499c-881d-ced6a3ee17ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.083070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-359f2b97-26bd-499c-881d-ced6a3ee17ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.083548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-359f2b97-26bd-499c-881d-ced6a3ee17ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.083989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-359f2b97-26bd-499c-881d-ced6a3ee17ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.177944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9b7e1df-a9f9-4957-9413-a90462183741 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:40.178595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f9b7e1df-a9f9-4957-9413-a90462183741 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:40.185406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9b7e1df-a9f9-4957-9413-a90462183741 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.185899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9b7e1df-a9f9-4957-9413-a90462183741 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.186329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9b7e1df-a9f9-4957-9413-a90462183741 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.187062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9b7e1df-a9f9-4957-9413-a90462183741 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.187514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9b7e1df-a9f9-4957-9413-a90462183741 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.187941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9b7e1df-a9f9-4957-9413-a90462183741 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.220408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-359f2b97-26bd-499c-881d-ced6a3ee17ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:40.228897 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-359f2b97-26bd-499c-881d-ced6a3ee17ab tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.158419 Oct 05 18:16:40.229485 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3291/6337] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:40 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:40.252167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-04ba706a-77b0-41f4-bb89-f732d11b4cdf tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:40.252775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-04ba706a-77b0-41f4-bb89-f732d11b4cdf tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:40.259422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04ba706a-77b0-41f4-bb89-f732d11b4cdf tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.259956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04ba706a-77b0-41f4-bb89-f732d11b4cdf tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.260404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04ba706a-77b0-41f4-bb89-f732d11b4cdf tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.261115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04ba706a-77b0-41f4-bb89-f732d11b4cdf tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.261614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04ba706a-77b0-41f4-bb89-f732d11b4cdf tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.262076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-04ba706a-77b0-41f4-bb89-f732d11b4cdf tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.324640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f9b7e1df-a9f9-4957-9413-a90462183741 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:40.333203 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f9b7e1df-a9f9-4957-9413-a90462183741 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1577 microversion: 2.1 time: 0.159527 Oct 05 18:16:40.333760 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3047/6338] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:40 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:40.403004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-04ba706a-77b0-41f4-bb89-f732d11b4cdf tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:40.411331 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-04ba706a-77b0-41f4-bb89-f732d11b4cdf tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.163043 Oct 05 18:16:40.411886 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3292/6339] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:40 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:40.433381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:40.433908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:40.440177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.440815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.441249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.441937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.442434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.442855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.471293 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Cannot 'unpause' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action HTTP/1.1 Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 15 Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: {"unpause": {}} Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: exception: Cannot 'unpause' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4a04f9c9-bdcf-4353-b6ae-627e1916d0a2', 'body': {'unpause': {}}} Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 in vm_state active. Cannot unpause while the instance is in this state. Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:40.473678 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:40.478426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:40.478426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:40.478426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:40.478426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:16:40.478426 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.478426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 409 to user: Cannot 'unpause' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:40.478426 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d75b006d-5fdb-463f-bd6e-33f1cfcf1503 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 409 len: 145 microversion: 2.1 time: 0.045813 Oct 05 18:16:40.478426 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3048/6340] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:40 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 145 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 05 18:16:40.486324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b24b3a8-9326-4da7-97bc-3030af814eb6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:40.487283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5b24b3a8-9326-4da7-97bc-3030af814eb6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:40.493533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b24b3a8-9326-4da7-97bc-3030af814eb6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.494040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b24b3a8-9326-4da7-97bc-3030af814eb6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.494602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b24b3a8-9326-4da7-97bc-3030af814eb6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.496219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b24b3a8-9326-4da7-97bc-3030af814eb6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.496219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b24b3a8-9326-4da7-97bc-3030af814eb6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.496219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b24b3a8-9326-4da7-97bc-3030af814eb6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.628766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5b24b3a8-9326-4da7-97bc-3030af814eb6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:40.637474 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b24b3a8-9326-4da7-97bc-3030af814eb6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.157161 Oct 05 18:16:40.638062 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3293/6341] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:40 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:40.662923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9003f3a4-abb8-4e4c-b977-46df64be5e94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:40.663577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9003f3a4-abb8-4e4c-b977-46df64be5e94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:40.674323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9003f3a4-abb8-4e4c-b977-46df64be5e94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.675072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9003f3a4-abb8-4e4c-b977-46df64be5e94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.675513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9003f3a4-abb8-4e4c-b977-46df64be5e94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.676242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9003f3a4-abb8-4e4c-b977-46df64be5e94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.676729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9003f3a4-abb8-4e4c-b977-46df64be5e94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.677157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9003f3a4-abb8-4e4c-b977-46df64be5e94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.703362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f3264c1a-1878-4da5-a200-8ab16c1590e8 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:40.704074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f3264c1a-1878-4da5-a200-8ab16c1590e8 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:40.710717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3264c1a-1878-4da5-a200-8ab16c1590e8 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.711291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3264c1a-1878-4da5-a200-8ab16c1590e8 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.711801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3264c1a-1878-4da5-a200-8ab16c1590e8 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.712582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3264c1a-1878-4da5-a200-8ab16c1590e8 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.713116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3264c1a-1878-4da5-a200-8ab16c1590e8 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.713620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3264c1a-1878-4da5-a200-8ab16c1590e8 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.796171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f3264c1a-1878-4da5-a200-8ab16c1590e8 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:40.805595 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f3264c1a-1878-4da5-a200-8ab16c1590e8 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1476 microversion: 2.1 time: 0.105337 Oct 05 18:16:40.806185 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3294/6342] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:40 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1476 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:40.813050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9003f3a4-abb8-4e4c-b977-46df64be5e94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:40.821186 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9003f3a4-abb8-4e4c-b977-46df64be5e94 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.164329 Oct 05 18:16:40.821760 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3049/6343] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:40 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:40.843754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6da195c7-b8d0-452f-9388-5113ddac6b12 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:40.844308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6da195c7-b8d0-452f-9388-5113ddac6b12 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: d4baab22-dad6-4b68-a0ff-ee6930097334] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:40.850094 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-6da195c7-b8d0-452f-9388-5113ddac6b12 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance d4baab22-dad6-4b68-a0ff-ee6930097334 could not be found. Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6da195c7-b8d0-452f-9388-5113ddac6b12 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/d4baab22-dad6-4b68-a0ff-ee6930097334/action HTTP/1.1 Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 18 Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: {"unshelve": null} Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance d4baab22-dad6-4b68-a0ff-ee6930097334 could not be found. Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'd4baab22-dad6-4b68-a0ff-ee6930097334', 'body': {'unshelve': None}} Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4baab22-dad6-4b68-a0ff-ee6930097334 could not be found. Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4baab22-dad6-4b68-a0ff-ee6930097334 could not be found. Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.851800 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4baab22-dad6-4b68-a0ff-ee6930097334 could not be found. Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6da195c7-b8d0-452f-9388-5113ddac6b12 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance d4baab22-dad6-4b68-a0ff-ee6930097334 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6da195c7-b8d0-452f-9388-5113ddac6b12 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/d4baab22-dad6-4b68-a0ff-ee6930097334/action" status: 404 len: 111 microversion: 2.1 time: 0.013554 Oct 05 18:16:40.856811 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3295/6344] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:40 2022] POST /compute/v2.1/servers/d4baab22-dad6-4b68-a0ff-ee6930097334/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:40.863741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4b31cfd2-2014-4cba-914c-0b0a98c6a501 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:40.864739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b31cfd2-2014-4cba-914c-0b0a98c6a501 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:40.874719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b31cfd2-2014-4cba-914c-0b0a98c6a501 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.875502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b31cfd2-2014-4cba-914c-0b0a98c6a501 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.876229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b31cfd2-2014-4cba-914c-0b0a98c6a501 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:40.877378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b31cfd2-2014-4cba-914c-0b0a98c6a501 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:40.878166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b31cfd2-2014-4cba-914c-0b0a98c6a501 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:40.878677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b31cfd2-2014-4cba-914c-0b0a98c6a501 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.015304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4b31cfd2-2014-4cba-914c-0b0a98c6a501 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:41.026892 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4b31cfd2-2014-4cba-914c-0b0a98c6a501 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.168892 Oct 05 18:16:41.027717 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3050/6345] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:40 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:41.050689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4ed57f22-dcc8-4005-977c-0dc597a2aebe tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:41.051285 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4ed57f22-dcc8-4005-977c-0dc597a2aebe tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:41.059438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ed57f22-dcc8-4005-977c-0dc597a2aebe tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.059932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ed57f22-dcc8-4005-977c-0dc597a2aebe tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.060403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ed57f22-dcc8-4005-977c-0dc597a2aebe tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.061123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ed57f22-dcc8-4005-977c-0dc597a2aebe tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.061595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ed57f22-dcc8-4005-977c-0dc597a2aebe tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.062035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4ed57f22-dcc8-4005-977c-0dc597a2aebe tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.197636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4ed57f22-dcc8-4005-977c-0dc597a2aebe tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:41.211244 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4ed57f22-dcc8-4005-977c-0dc597a2aebe tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.164675 Oct 05 18:16:41.211799 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3296/6346] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:41 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:41.233501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:41.234099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:41.240473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.240981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.241407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.242089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.242575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.242991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.279713 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Cannot 'unshelve' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action HTTP/1.1 Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 18 Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: {"unshelve": null} Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: exception: Cannot 'unshelve' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4a04f9c9-bdcf-4353-b6ae-627e1916d0a2', 'body': {'unshelve': None}} Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 in vm_state active. Cannot unshelve while the instance is in this state. Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 05 18:16:41.281578 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 409 to user: Cannot 'unshelve' instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 while it is in vm_state active {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e03028a4-69e7-4053-8ad6-e49dc568da93 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action" status: 409 len: 146 microversion: 2.1 time: 0.053614 Oct 05 18:16:41.288273 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3051/6347] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:16:41 2022] POST /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2/action => generated 146 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 05 18:16:41.296048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e0b09bbf-fc8e-430b-86c9-c124cfda1243 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:41.296944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e0b09bbf-fc8e-430b-86c9-c124cfda1243 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:41.304941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0b09bbf-fc8e-430b-86c9-c124cfda1243 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.305452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0b09bbf-fc8e-430b-86c9-c124cfda1243 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.305883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0b09bbf-fc8e-430b-86c9-c124cfda1243 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.306656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0b09bbf-fc8e-430b-86c9-c124cfda1243 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.307103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0b09bbf-fc8e-430b-86c9-c124cfda1243 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.307570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e0b09bbf-fc8e-430b-86c9-c124cfda1243 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.357250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-78f0d24c-7b46-422b-8c0b-326f3123a44c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:41.357956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-78f0d24c-7b46-422b-8c0b-326f3123a44c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:41.364368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f0d24c-7b46-422b-8c0b-326f3123a44c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.364854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f0d24c-7b46-422b-8c0b-326f3123a44c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.365283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f0d24c-7b46-422b-8c0b-326f3123a44c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.365979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f0d24c-7b46-422b-8c0b-326f3123a44c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.366459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f0d24c-7b46-422b-8c0b-326f3123a44c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.366879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78f0d24c-7b46-422b-8c0b-326f3123a44c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.520636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e0b09bbf-fc8e-430b-86c9-c124cfda1243 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:41.532521 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e0b09bbf-fc8e-430b-86c9-c124cfda1243 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.242709 Oct 05 18:16:41.533395 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3297/6348] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:41 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:41.556966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b179177-dbfa-4daa-be28-a9afacbc10e8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:41.557587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b179177-dbfa-4daa-be28-a9afacbc10e8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:41.564642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b179177-dbfa-4daa-be28-a9afacbc10e8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.565201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b179177-dbfa-4daa-be28-a9afacbc10e8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.565642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b179177-dbfa-4daa-be28-a9afacbc10e8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.566401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b179177-dbfa-4daa-be28-a9afacbc10e8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.566871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b179177-dbfa-4daa-be28-a9afacbc10e8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.567294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b179177-dbfa-4daa-be28-a9afacbc10e8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.782003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b179177-dbfa-4daa-be28-a9afacbc10e8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:41.791612 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b179177-dbfa-4daa-be28-a9afacbc10e8 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.238155 Oct 05 18:16:41.791612 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3298/6349] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:41 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:41.813615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-37f08b93-b0b6-424d-bf69-b0b054e3eb5b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-408295032_updated"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:41.816343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-37f08b93-b0b6-424d-bf69-b0b054e3eb5b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 0204426f-28c7-4eb4-8fad-6a87f75641ea] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:41.823863 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-37f08b93-b0b6-424d-bf69-b0b054e3eb5b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 0204426f-28c7-4eb4-8fad-6a87f75641ea could not be found. Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-37f08b93-b0b6-424d-bf69-b0b054e3eb5b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/servers/0204426f-28c7-4eb4-8fad-6a87f75641ea HTTP/1.1 Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 80 Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-408295032_updated"}} Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0204426f-28c7-4eb4-8fad-6a87f75641ea could not be found. Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '0204426f-28c7-4eb4-8fad-6a87f75641ea', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-408295032_updated'}}} Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0204426f-28c7-4eb4-8fad-6a87f75641ea could not be found. Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 05 18:16:41.824181 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0204426f-28c7-4eb4-8fad-6a87f75641ea could not be found. Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0204426f-28c7-4eb4-8fad-6a87f75641ea could not be found. Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-37f08b93-b0b6-424d-bf69-b0b054e3eb5b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 0204426f-28c7-4eb4-8fad-6a87f75641ea could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-37f08b93-b0b6-424d-bf69-b0b054e3eb5b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "PUT /compute/v2.1/servers/0204426f-28c7-4eb4-8fad-6a87f75641ea" status: 404 len: 111 microversion: 2.1 time: 0.016103 Oct 05 18:16:41.828847 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3299/6350] 10.222.0.70 () {60 vars in 1256 bytes} [Wed Oct 5 18:16:41 2022] PUT /compute/v2.1/servers/0204426f-28c7-4eb4-8fad-6a87f75641ea => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:41.834386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b18f7586-f19a-43a5-b197-a4788255665b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:41.835021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b18f7586-f19a-43a5-b197-a4788255665b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:41.843300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b18f7586-f19a-43a5-b197-a4788255665b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.843847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b18f7586-f19a-43a5-b197-a4788255665b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.844345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b18f7586-f19a-43a5-b197-a4788255665b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.845075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b18f7586-f19a-43a5-b197-a4788255665b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.845546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b18f7586-f19a-43a5-b197-a4788255665b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.846019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b18f7586-f19a-43a5-b197-a4788255665b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.954866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b18f7586-f19a-43a5-b197-a4788255665b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:41.963596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-78f0d24c-7b46-422b-8c0b-326f3123a44c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:41.965547 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b18f7586-f19a-43a5-b197-a4788255665b tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 200 len: 1476 microversion: 2.1 time: 0.134807 Oct 05 18:16:41.966153 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3300/6351] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:41 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 1476 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:41.970954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2809ed3e-63b4-4702-ae9a-8a23f2b8e678 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:41.971576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2809ed3e-63b4-4702-ae9a-8a23f2b8e678 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:41.972148 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-78f0d24c-7b46-422b-8c0b-326f3123a44c tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1577 microversion: 2.1 time: 0.618887 Oct 05 18:16:41.978412 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3052/6352] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:41 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1577 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:41.984586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2809ed3e-63b4-4702-ae9a-8a23f2b8e678 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.985107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2809ed3e-63b4-4702-ae9a-8a23f2b8e678 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.985595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2809ed3e-63b4-4702-ae9a-8a23f2b8e678 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:41.986322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2809ed3e-63b4-4702-ae9a-8a23f2b8e678 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:41.986814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2809ed3e-63b4-4702-ae9a-8a23f2b8e678 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:41.987319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2809ed3e-63b4-4702-ae9a-8a23f2b8e678 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:42.009274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a5228089-9a6e-4841-83f0-046c0e534d60 req-60c90cd5-70e4-4999-bd73-719d3a249a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9f00261-589b-4563-984e-3139828f8081", "name": "network-vif-deleted", "tag": "c88b1632-d065-41cf-b105-844518e2d124"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:42.015932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:42.028320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a5228089-9a6e-4841-83f0-046c0e534d60 req-60c90cd5-70e4-4999-bd73-719d3a249a41 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:42.029107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a5228089-9a6e-4841-83f0-046c0e534d60 req-60c90cd5-70e4-4999-bd73-719d3a249a41 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:42.029742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a5228089-9a6e-4841-83f0-046c0e534d60 req-60c90cd5-70e4-4999-bd73-719d3a249a41 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:42.047220 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a5228089-9a6e-4841-83f0-046c0e534d60 req-60c90cd5-70e4-4999-bd73-719d3a249a41 service nova] Creating event network-vif-deleted:c88b1632-d065-41cf-b105-844518e2d124 for instance a9f00261-589b-4563-984e-3139828f8081 on n-h1-835595-3 Oct 05 18:16:42.059226 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a5228089-9a6e-4841-83f0-046c0e534d60 req-60c90cd5-70e4-4999-bd73-719d3a249a41 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054127 Oct 05 18:16:42.059983 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3053/6353] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:16:42.183640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2809ed3e-63b4-4702-ae9a-8a23f2b8e678 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:42.192879 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2809ed3e-63b4-4702-ae9a-8a23f2b8e678 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.225578 Oct 05 18:16:42.193473 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3301/6354] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:41 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:42.219310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f1caed21-67a9-4d76-8336-f63693f9a91f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:42.220016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1caed21-67a9-4d76-8336-f63693f9a91f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:42.228816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1caed21-67a9-4d76-8336-f63693f9a91f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:42.229395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1caed21-67a9-4d76-8336-f63693f9a91f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:42.229972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1caed21-67a9-4d76-8336-f63693f9a91f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:42.231199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1caed21-67a9-4d76-8336-f63693f9a91f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:42.231335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1caed21-67a9-4d76-8336-f63693f9a91f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:42.231745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1caed21-67a9-4d76-8336-f63693f9a91f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:42.434638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1caed21-67a9-4d76-8336-f63693f9a91f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:42.442971 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f1caed21-67a9-4d76-8336-f63693f9a91f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.227932 Oct 05 18:16:42.443903 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3054/6355] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:42 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:42.466397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30a212ad-2cac-41fc-8027-26597515115e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30a212ad-2cac-41fc-8027-26597515115e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: request: PUT /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 HTTP/1.1 Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 280 Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4a04f9c9-bdcf-4353-b6ae-627e1916d0a2', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.470636 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 05 18:16:42.475159 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.478121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30a212ad-2cac-41fc-8027-26597515115e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:42.479741 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-30a212ad-2cac-41fc-8027-26597515115e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "PUT /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 400 len: 619 microversion: 2.1 time: 0.017836 Oct 05 18:16:42.480469 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3302/6356] 10.222.0.70 () {60 vars in 1257 bytes} [Wed Oct 5 18:16:42 2022] PUT /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 619 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:16:42.488994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-80d1e373-4080-4dd9-b59a-9a37894cc52d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:42.489678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-80d1e373-4080-4dd9-b59a-9a37894cc52d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:42.495826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d1e373-4080-4dd9-b59a-9a37894cc52d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:42.496320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d1e373-4080-4dd9-b59a-9a37894cc52d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:42.496752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d1e373-4080-4dd9-b59a-9a37894cc52d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:42.497445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d1e373-4080-4dd9-b59a-9a37894cc52d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:42.497889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d1e373-4080-4dd9-b59a-9a37894cc52d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:42.498324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-80d1e373-4080-4dd9-b59a-9a37894cc52d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:42.521849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:42.610099 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6defd1c1-1fca-4c7f-a38d-9236a268dcae req-384368bb-9ac9-469f-b164-b61d0410fcc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73029889-efdd-4945-a1cd-9d931be98e4b", "name": "network-vif-deleted", "tag": "62fba8f6-9d08-4dc1-9ec0-c9ab8b5ecf0a"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:42.624000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6defd1c1-1fca-4c7f-a38d-9236a268dcae req-384368bb-9ac9-469f-b164-b61d0410fcc0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:42.624526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6defd1c1-1fca-4c7f-a38d-9236a268dcae req-384368bb-9ac9-469f-b164-b61d0410fcc0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:42.624942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6defd1c1-1fca-4c7f-a38d-9236a268dcae req-384368bb-9ac9-469f-b164-b61d0410fcc0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:42.639688 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6defd1c1-1fca-4c7f-a38d-9236a268dcae req-384368bb-9ac9-469f-b164-b61d0410fcc0 service nova] Creating event network-vif-deleted:62fba8f6-9d08-4dc1-9ec0-c9ab8b5ecf0a for instance 73029889-efdd-4945-a1cd-9d931be98e4b on n-h1-835595-3 Oct 05 18:16:42.645162 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6defd1c1-1fca-4c7f-a38d-9236a268dcae req-384368bb-9ac9-469f-b164-b61d0410fcc0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040714 Oct 05 18:16:42.646386 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3303/6357] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:16:42.684361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-80d1e373-4080-4dd9-b59a-9a37894cc52d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:42.692794 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-80d1e373-4080-4dd9-b59a-9a37894cc52d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.207983 Oct 05 18:16:42.693381 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3055/6358] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:42 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:42.716887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e6d23c2-37cb-4f2d-872b-9f81265b2ed1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:42.717609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e6d23c2-37cb-4f2d-872b-9f81265b2ed1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:42.724335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6d23c2-37cb-4f2d-872b-9f81265b2ed1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:42.724876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6d23c2-37cb-4f2d-872b-9f81265b2ed1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:42.725330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6d23c2-37cb-4f2d-872b-9f81265b2ed1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:42.726053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6d23c2-37cb-4f2d-872b-9f81265b2ed1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:42.726560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6d23c2-37cb-4f2d-872b-9f81265b2ed1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:42.727001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6d23c2-37cb-4f2d-872b-9f81265b2ed1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:42.866055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4e6d23c2-37cb-4f2d-872b-9f81265b2ed1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:42.875314 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e6d23c2-37cb-4f2d-872b-9f81265b2ed1 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.162708 Oct 05 18:16:42.876017 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3304/6359] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:42 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:42.898619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ae60850-0a64-45a9-a9a5-d5e611cd06b6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ae60850-0a64-45a9-a9a5-d5e611cd06b6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: request: PUT /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 HTTP/1.1 Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 24 Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: {"server": {"name": ""}} Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4a04f9c9-bdcf-4353-b6ae-627e1916d0a2', 'body': {'server': {'name': ''}}} Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi '' Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:16:42.902666 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ae60850-0a64-45a9-a9a5-d5e611cd06b6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:42.907324 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ae60850-0a64-45a9-a9a5-d5e611cd06b6 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "PUT /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 400 len: 108 microversion: 2.1 time: 0.010224 Oct 05 18:16:42.909960 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3056/6360] 10.222.0.70 () {60 vars in 1256 bytes} [Wed Oct 5 18:16:42 2022] PUT /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 108 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:16:42.914367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-493dc00f-715f-4dec-bbeb-6a03672faf81 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:42.914851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-493dc00f-715f-4dec-bbeb-6a03672faf81 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:42.921725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-493dc00f-715f-4dec-bbeb-6a03672faf81 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:42.922235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-493dc00f-715f-4dec-bbeb-6a03672faf81 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:42.922732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-493dc00f-715f-4dec-bbeb-6a03672faf81 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:42.927060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-493dc00f-715f-4dec-bbeb-6a03672faf81 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:42.927760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-493dc00f-715f-4dec-bbeb-6a03672faf81 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:42.928387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-493dc00f-715f-4dec-bbeb-6a03672faf81 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:43.009718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:43.011046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: a9f00261-589b-4563-984e-3139828f8081] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:43.023091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:43.023759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:43.024203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:43.024908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:43.025364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:43.025789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:43.049905 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] HTTP exception thrown: Instance a9f00261-589b-4563-984e-3139828f8081 could not be found. Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Request method failure captured: Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 HTTP/1.1 Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcm2C8Kxy65pEnifwpQ_CtB-uV-4u9_p-HtIAWQ3-U3VDa5zIFo6l-k4UGAjAXOKLvEkhy63oQxipacnr44vEaZhrb_jmWj6ejmoM2szj2tpLoG4EV3W0orcmJxGhlZs0qKxbaaiZO3J-4-6BlI2ZSVFjM_-T1FF6pTzhunyBr-rkFY Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 81356660aaae46deb0c3107128256727 Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1357167370 Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81356660aaae46deb0c3107128256727"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81356660aaae46deb0c3107128256727"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81356660aaae46deb0c3107128256727", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81356660aaae46deb0c3107128256727"}]}] Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1357167370 Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 81356660aaae46deb0c3107128256727 Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1357167370 Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestSecurityGroupsBasicOps-1357167370-project Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: e0627766a159459283ed2788f79b7b8e Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1357167370-project Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a9f00261-589b-4563-984e-3139828f8081 could not be found. Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a9f00261-589b-4563-984e-3139828f8081'} Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9f00261-589b-4563-984e-3139828f8081 could not be found. Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9f00261-589b-4563-984e-3139828f8081 could not be found. Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:43.051534 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9f00261-589b-4563-984e-3139828f8081 could not be found. Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Returning 404 to user: Instance a9f00261-589b-4563-984e-3139828f8081 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ed7f8f8-e45a-43c7-b465-1ea186fc3ea4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081" status: 404 len: 111 microversion: 2.1 time: 0.048248 Oct 05 18:16:43.057561 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3057/6361] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:43 2022] GET /compute/v2.1/servers/a9f00261-589b-4563-984e-3139828f8081 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:16:43.059518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-adc4eee2-39e3-4e5b-a53b-6ab78770c7b2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:43.059518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-adc4eee2-39e3-4e5b-a53b-6ab78770c7b2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:43.065188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adc4eee2-39e3-4e5b-a53b-6ab78770c7b2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:43.065965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adc4eee2-39e3-4e5b-a53b-6ab78770c7b2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:43.066577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adc4eee2-39e3-4e5b-a53b-6ab78770c7b2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:43.067553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adc4eee2-39e3-4e5b-a53b-6ab78770c7b2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:43.068203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adc4eee2-39e3-4e5b-a53b-6ab78770c7b2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:43.068793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adc4eee2-39e3-4e5b-a53b-6ab78770c7b2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:43.091949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-493dc00f-715f-4dec-bbeb-6a03672faf81 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:43.101389 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-493dc00f-715f-4dec-bbeb-6a03672faf81 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1505 microversion: 2.1 time: 0.191307 Oct 05 18:16:43.111826 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3305/6362] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:42 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1505 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:43.158208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-adc4eee2-39e3-4e5b-a53b-6ab78770c7b2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:43.173350 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-adc4eee2-39e3-4e5b-a53b-6ab78770c7b2 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1226 microversion: 2.1 time: 0.118643 Oct 05 18:16:43.173950 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3058/6363] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:43 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:44.197430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aada51c9-d3a6-4228-9ed4-264f25464d7f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:44.198075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aada51c9-d3a6-4228-9ed4-264f25464d7f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:44.205539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aada51c9-d3a6-4228-9ed4-264f25464d7f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:44.206387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aada51c9-d3a6-4228-9ed4-264f25464d7f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:44.207039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aada51c9-d3a6-4228-9ed4-264f25464d7f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:44.208132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aada51c9-d3a6-4228-9ed4-264f25464d7f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:44.208777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aada51c9-d3a6-4228-9ed4-264f25464d7f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:44.209387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aada51c9-d3a6-4228-9ed4-264f25464d7f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:44.309237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aada51c9-d3a6-4228-9ed4-264f25464d7f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:44.333476 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aada51c9-d3a6-4228-9ed4-264f25464d7f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1226 microversion: 2.1 time: 0.140863 Oct 05 18:16:44.335477 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3306/6364] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:44 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1226 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:45.362072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-104c49de-ce23-4253-bebd-b2ec14b244b1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:45.365290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-104c49de-ce23-4253-bebd-b2ec14b244b1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:45.383397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104c49de-ce23-4253-bebd-b2ec14b244b1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:45.384492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104c49de-ce23-4253-bebd-b2ec14b244b1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:45.385717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104c49de-ce23-4253-bebd-b2ec14b244b1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:45.386642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104c49de-ce23-4253-bebd-b2ec14b244b1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:45.387858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104c49de-ce23-4253-bebd-b2ec14b244b1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:45.388441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-104c49de-ce23-4253-bebd-b2ec14b244b1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:45.538496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-104c49de-ce23-4253-bebd-b2ec14b244b1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:45.551483 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-104c49de-ce23-4253-bebd-b2ec14b244b1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1226 microversion: 2.1 time: 0.194925 Oct 05 18:16:45.555804 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3059/6365] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:45 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1226 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:46.580059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3c27fac-784e-45d0-adf4-1bb514957f1f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:46.580766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c3c27fac-784e-45d0-adf4-1bb514957f1f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:46.612388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3c27fac-784e-45d0-adf4-1bb514957f1f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:46.615319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3c27fac-784e-45d0-adf4-1bb514957f1f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:46.615811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3c27fac-784e-45d0-adf4-1bb514957f1f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:46.616590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3c27fac-784e-45d0-adf4-1bb514957f1f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:46.617074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3c27fac-784e-45d0-adf4-1bb514957f1f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:46.617510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3c27fac-784e-45d0-adf4-1bb514957f1f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:46.759434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c3c27fac-784e-45d0-adf4-1bb514957f1f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:46.786022 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3c27fac-784e-45d0-adf4-1bb514957f1f tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1226 microversion: 2.1 time: 0.210737 Oct 05 18:16:46.787184 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3307/6366] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:46 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1226 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:47.812466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:47.813071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:47.821934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:47.822735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:47.824689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:47.826196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:47.826809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:47.827636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:47.872187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:47.872688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:47.873126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:47.873789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lazy-loading 'fault' on Instance uuid 73029889-efdd-4945-a1cd-9d931be98e4b {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:16:47.940313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a900e5bf82d462a9113d6e6461ea3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd19bdb239c247e7a345e8067ae4a1e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:47.948487 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-810b7651-a394-489a-9dbe-b3c6f387d020 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 200 len: 1231 microversion: 2.1 time: 0.139925 Oct 05 18:16:47.949073 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3060/6367] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:47 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 1231 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:48.738533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-859337af-7f3a-4011-8aff-d4f631b0b2b6 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:48.739637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-859337af-7f3a-4011-8aff-d4f631b0b2b6 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:48.744142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5a8c984a-6e6f-48a1-a7cf-0c3f02f0f636 req-860aacae-4b1f-4206-b2cd-a7b89619d6b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41cb647d-f404-486a-9a12-dc535f360fbb", "tag": "fb9b6997-df7d-441d-810b-eeee0ee56ce3"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:48.752476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-859337af-7f3a-4011-8aff-d4f631b0b2b6 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.753043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-859337af-7f3a-4011-8aff-d4f631b0b2b6 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.753659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-859337af-7f3a-4011-8aff-d4f631b0b2b6 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:48.755395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-859337af-7f3a-4011-8aff-d4f631b0b2b6 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.756027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-859337af-7f3a-4011-8aff-d4f631b0b2b6 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.756774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-859337af-7f3a-4011-8aff-d4f631b0b2b6 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:48.766271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5a8c984a-6e6f-48a1-a7cf-0c3f02f0f636 req-860aacae-4b1f-4206-b2cd-a7b89619d6b1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.766801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5a8c984a-6e6f-48a1-a7cf-0c3f02f0f636 req-860aacae-4b1f-4206-b2cd-a7b89619d6b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.767225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5a8c984a-6e6f-48a1-a7cf-0c3f02f0f636 req-860aacae-4b1f-4206-b2cd-a7b89619d6b1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:48.789125 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5a8c984a-6e6f-48a1-a7cf-0c3f02f0f636 req-860aacae-4b1f-4206-b2cd-a7b89619d6b1 service nova] Creating event network-changed:fb9b6997-df7d-441d-810b-eeee0ee56ce3 for instance 41cb647d-f404-486a-9a12-dc535f360fbb on n-h2-835595-3 Oct 05 18:16:48.789645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-859337af-7f3a-4011-8aff-d4f631b0b2b6 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:16:48.794837 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5a8c984a-6e6f-48a1-a7cf-0c3f02f0f636 req-860aacae-4b1f-4206-b2cd-a7b89619d6b1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056370 Oct 05 18:16:48.795719 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3061/6368] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:16:48.802116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:48.802932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:48.810636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.811368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.811974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:48.812847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.813925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.815100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:48.832981 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b HTTP/1.1 Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a1905f8f-fbbf-4879-8cc5-0f5ea454019b'} Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:48.834998 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:16:48.840211 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:48.841911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:48.843776 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bd685496-3bef-4fb9-8fa2-dfebc70c571e tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 404 len: 111 microversion: 2.1 time: 0.046527 Oct 05 18:16:48.847200 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3062/6369] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:16:48 2022] DELETE /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:48.864188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:48.865711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: a1905f8f-fbbf-4879-8cc5-0f5ea454019b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:48.873578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.874441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.875045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:48.876108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.876868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.877459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:48.906529 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-859337af-7f3a-4011-8aff-d4f631b0b2b6 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "DELETE /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 204 len: 0 microversion: 2.1 time: 0.172273 Oct 05 18:16:48.907632 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3308/6370] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:16:48 2022] DELETE /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:16:48.908067 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b HTTP/1.1 Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a1905f8f-fbbf-4879-8cc5-0f5ea454019b'} Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:48.909977 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:48.917309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:48.917309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:48.917309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:48.917309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:48.917309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:48.917309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. Oct 05 18:16:48.917309 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:48.917309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance a1905f8f-fbbf-4879-8cc5-0f5ea454019b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:48.917309 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-64ae254b-6994-40b9-8187-f259120ec048 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b" status: 404 len: 111 microversion: 2.1 time: 0.060241 Oct 05 18:16:48.917309 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3063/6371] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:48 2022] GET /compute/v2.1/servers/a1905f8f-fbbf-4879-8cc5-0f5ea454019b => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:16:48.927592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7e0c1b1e-f0aa-4058-8042-2e5a860c8c52 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:48.928796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7e0c1b1e-f0aa-4058-8042-2e5a860c8c52 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:48.934963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-30de831e-933e-4113-b415-30724fd3de90 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:48.935513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30de831e-933e-4113-b415-30724fd3de90 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:48.938492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e0c1b1e-f0aa-4058-8042-2e5a860c8c52 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.939596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e0c1b1e-f0aa-4058-8042-2e5a860c8c52 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.940412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e0c1b1e-f0aa-4058-8042-2e5a860c8c52 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:48.941527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e0c1b1e-f0aa-4058-8042-2e5a860c8c52 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.943719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e0c1b1e-f0aa-4058-8042-2e5a860c8c52 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.944557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7e0c1b1e-f0aa-4058-8042-2e5a860c8c52 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:48.947943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30de831e-933e-4113-b415-30724fd3de90 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.950720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30de831e-933e-4113-b415-30724fd3de90 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.951213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30de831e-933e-4113-b415-30724fd3de90 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:48.951977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30de831e-933e-4113-b415-30724fd3de90 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:48.952483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30de831e-933e-4113-b415-30724fd3de90 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:48.952920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30de831e-933e-4113-b415-30724fd3de90 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:49.012520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30de831e-933e-4113-b415-30724fd3de90 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:16:49.144178 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-30de831e-933e-4113-b415-30724fd3de90 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 204 len: 0 microversion: 2.1 time: 0.220132 Oct 05 18:16:49.147691 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3064/6372] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:16:48 2022] DELETE /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:16:49.151480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7e0c1b1e-f0aa-4058-8042-2e5a860c8c52 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:49.152333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:49.153037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: 73029889-efdd-4945-a1cd-9d931be98e4b] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:49.160246 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7e0c1b1e-f0aa-4058-8042-2e5a860c8c52 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1766 microversion: 2.1 time: 0.240045 Oct 05 18:16:49.161215 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3309/6373] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:48 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1766 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:49.161488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:49.162032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:49.162622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:49.163344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:49.163800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:49.164223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:49.165795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30082569-4b27-4f61-a751-4963419fab3b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:49.166535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-30082569-4b27-4f61-a751-4963419fab3b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:49.172767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30082569-4b27-4f61-a751-4963419fab3b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:49.173286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30082569-4b27-4f61-a751-4963419fab3b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:49.173744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30082569-4b27-4f61-a751-4963419fab3b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:49.174506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30082569-4b27-4f61-a751-4963419fab3b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:49.175055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30082569-4b27-4f61-a751-4963419fab3b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:49.175557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30082569-4b27-4f61-a751-4963419fab3b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:49.182415 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance 73029889-efdd-4945-a1cd-9d931be98e4b could not be found. Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b HTTP/1.1 Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 73029889-efdd-4945-a1cd-9d931be98e4b could not be found. Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '73029889-efdd-4945-a1cd-9d931be98e4b'} Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73029889-efdd-4945-a1cd-9d931be98e4b could not be found. Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73029889-efdd-4945-a1cd-9d931be98e4b could not be found. Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:49.184259 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.189604 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:49.189604 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:49.189604 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:49.189604 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:49.189604 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:49.189604 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73029889-efdd-4945-a1cd-9d931be98e4b could not be found. Oct 05 18:16:49.189604 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.189604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance 73029889-efdd-4945-a1cd-9d931be98e4b could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:49.189604 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-44e4b49a-3ff7-49eb-9082-2aae62e596f1 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b" status: 404 len: 111 microversion: 2.1 time: 0.039150 Oct 05 18:16:49.189604 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3065/6374] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:49 2022] GET /compute/v2.1/servers/73029889-efdd-4945-a1cd-9d931be98e4b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:49.340379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-30082569-4b27-4f61-a751-4963419fab3b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:49.349087 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-30082569-4b27-4f61-a751-4963419fab3b tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.186618 Oct 05 18:16:49.350011 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3310/6375] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:49 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:49.696448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:49.700457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:49.707416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:49.707930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:49.708375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:49.709077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:49.709525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:49.709947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:49.724936 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 HTTP/1.1 Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'e579606a-2e51-481b-b60f-562dbaa11b33'} Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:49.726677 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d8fbbfa5-6faa-46cd-bccf-5c4b54179005 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 404 len: 111 microversion: 2.1 time: 0.035758 Oct 05 18:16:49.732246 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3066/6376] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:16:49 2022] DELETE /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:49.739465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:49.740090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] [instance: e579606a-2e51-481b-b60f-562dbaa11b33] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:49.747079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:49.747569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:49.748017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:49.748707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:49.749165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:49.749592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:49.766763 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] HTTP exception thrown: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Request method failure captured: Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 HTTP/1.1 Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcbjXnIWej1KMm7fYc7Gnz0-P1OuumM2_OiKPkjLFadN6wJtsUU3mPRgvOmTGx9H2LTFBWXx9gEXdLEj5pz1CQ1NGW-w1pHh24cF_1GetZ3D85hFcSE_meBPLzbgBEEEM7WVtPjSq2tADK3ICDbvYzUOPy3peECUVB24sMHdDE43nPE Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_cd19bdb239c247e7a345e8067ae4a1e0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/cd19bdb239c247e7a345e8067ae4a1e0"}]}] Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: cd19bdb239c247e7a345e8067ae4a1e0 Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestVolumeBootPattern-1627461036 Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 8a900e5bf82d462a9113d6e6461ea3a0 Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestVolumeBootPattern-1627461036-project Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e579606a-2e51-481b-b60f-562dbaa11b33'} Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:49.768557 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.773812 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:49.773812 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:49.773812 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:49.773812 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:49.773812 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:49.773812 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. Oct 05 18:16:49.773812 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:49.773812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Returning 404 to user: Instance e579606a-2e51-481b-b60f-562dbaa11b33 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:49.773812 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2aa1046a-12db-4e14-9c2b-32ac826a8cde tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33" status: 404 len: 111 microversion: 2.1 time: 0.035152 Oct 05 18:16:49.773812 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3311/6377] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:49 2022] GET /compute/v2.1/servers/e579606a-2e51-481b-b60f-562dbaa11b33 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:50.187483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c437935a-8328-4e4f-9c8b-6e325234066f tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:50.188050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c437935a-8328-4e4f-9c8b-6e325234066f tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:50.195494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c437935a-8328-4e4f-9c8b-6e325234066f tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:50.195988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c437935a-8328-4e4f-9c8b-6e325234066f tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:50.196426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c437935a-8328-4e4f-9c8b-6e325234066f tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:50.197138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c437935a-8328-4e4f-9c8b-6e325234066f tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:50.197595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c437935a-8328-4e4f-9c8b-6e325234066f tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:50.198027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c437935a-8328-4e4f-9c8b-6e325234066f tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:50.345585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c437935a-8328-4e4f-9c8b-6e325234066f tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:50.353746 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c437935a-8328-4e4f-9c8b-6e325234066f tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1766 microversion: 2.1 time: 0.170358 Oct 05 18:16:50.354489 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3067/6378] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:50 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1766 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:50.371723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce0ed977-db2b-4832-9014-6bef128227f0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:50.372814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ce0ed977-db2b-4832-9014-6bef128227f0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:50.380247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce0ed977-db2b-4832-9014-6bef128227f0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:50.380750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce0ed977-db2b-4832-9014-6bef128227f0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:50.381202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce0ed977-db2b-4832-9014-6bef128227f0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:50.381927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce0ed977-db2b-4832-9014-6bef128227f0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:50.382457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce0ed977-db2b-4832-9014-6bef128227f0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:50.382896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce0ed977-db2b-4832-9014-6bef128227f0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:50.518781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ce0ed977-db2b-4832-9014-6bef128227f0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:50.526939 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ce0ed977-db2b-4832-9014-6bef128227f0 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.159222 Oct 05 18:16:50.527534 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3312/6379] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:50 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:51.378605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9541b14f-1eb2-47d0-9d06-7882ab11f3d4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:51.379476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9541b14f-1eb2-47d0-9d06-7882ab11f3d4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:51.388867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9541b14f-1eb2-47d0-9d06-7882ab11f3d4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:51.389443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9541b14f-1eb2-47d0-9d06-7882ab11f3d4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:51.390170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9541b14f-1eb2-47d0-9d06-7882ab11f3d4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:51.392963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9541b14f-1eb2-47d0-9d06-7882ab11f3d4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:51.393616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9541b14f-1eb2-47d0-9d06-7882ab11f3d4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:51.394165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9541b14f-1eb2-47d0-9d06-7882ab11f3d4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:51.549222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fc3cf589-58a9-4455-afeb-8467bd964da7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:51.550077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fc3cf589-58a9-4455-afeb-8467bd964da7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:51.557497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3cf589-58a9-4455-afeb-8467bd964da7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:51.558083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3cf589-58a9-4455-afeb-8467bd964da7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:51.558611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3cf589-58a9-4455-afeb-8467bd964da7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:51.559574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3cf589-58a9-4455-afeb-8467bd964da7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:51.560257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3cf589-58a9-4455-afeb-8467bd964da7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:51.560901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc3cf589-58a9-4455-afeb-8467bd964da7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:51.585063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9541b14f-1eb2-47d0-9d06-7882ab11f3d4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:51.597381 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9541b14f-1eb2-47d0-9d06-7882ab11f3d4 tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1766 microversion: 2.1 time: 0.222960 Oct 05 18:16:51.598512 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3068/6380] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:51 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1766 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:52.027192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fc3cf589-58a9-4455-afeb-8467bd964da7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:52.036456 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fc3cf589-58a9-4455-afeb-8467bd964da7 tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1511 microversion: 2.1 time: 0.491219 Oct 05 18:16:52.037379 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3313/6381] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:51 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1511 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:16:52.622266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d58d8560-5460-4dab-95d0-8f56236a86ff tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:52.623006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d58d8560-5460-4dab-95d0-8f56236a86ff tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:52.632861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c20be0d9-d118-4b72-8132-55dedb437cf2 req-0521ac03-2528-40e3-aa34-a58ba6c43e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cb647d-f404-486a-9a12-dc535f360fbb", "name": "network-vif-deleted", "tag": "fb9b6997-df7d-441d-810b-eeee0ee56ce3"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:52.647718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d58d8560-5460-4dab-95d0-8f56236a86ff tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:52.654481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d58d8560-5460-4dab-95d0-8f56236a86ff tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:52.655015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d58d8560-5460-4dab-95d0-8f56236a86ff tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:52.661323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c20be0d9-d118-4b72-8132-55dedb437cf2 req-0521ac03-2528-40e3-aa34-a58ba6c43e27 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:52.661846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c20be0d9-d118-4b72-8132-55dedb437cf2 req-0521ac03-2528-40e3-aa34-a58ba6c43e27 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:52.662303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c20be0d9-d118-4b72-8132-55dedb437cf2 req-0521ac03-2528-40e3-aa34-a58ba6c43e27 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:52.663343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d58d8560-5460-4dab-95d0-8f56236a86ff tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:52.670442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d58d8560-5460-4dab-95d0-8f56236a86ff tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:52.671313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d58d8560-5460-4dab-95d0-8f56236a86ff tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:52.698719 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c20be0d9-d118-4b72-8132-55dedb437cf2 req-0521ac03-2528-40e3-aa34-a58ba6c43e27 service nova] Creating event network-vif-deleted:fb9b6997-df7d-441d-810b-eeee0ee56ce3 for instance 41cb647d-f404-486a-9a12-dc535f360fbb on n-h2-835595-3 Oct 05 18:16:52.708042 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c20be0d9-d118-4b72-8132-55dedb437cf2 req-0521ac03-2528-40e3-aa34-a58ba6c43e27 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079426 Oct 05 18:16:52.709265 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3314/6382] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:16:52.778627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d58d8560-5460-4dab-95d0-8f56236a86ff tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0627766a159459283ed2788f79b7b8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81356660aaae46deb0c3107128256727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:52.792557 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d58d8560-5460-4dab-95d0-8f56236a86ff tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 200 len: 1379 microversion: 2.1 time: 0.174646 Oct 05 18:16:52.807518 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3069/6383] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:52 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 1379 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:53.069464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:53.070254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:53.077339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:53.078390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:53.079038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:53.079945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:53.080584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:53.081254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:53.159408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:53.160218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:53.160985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:53.161649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lazy-loading 'fault' on Instance uuid 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:16:53.230764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05a1488f79c44744b8ab28db3b54fb54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f34e890dde99482b9e72343765245cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:16:53.238927 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-36976c75-efbf-4379-b707-e3793ea3214f tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 200 len: 1307 microversion: 2.1 time: 0.182600 Oct 05 18:16:53.239846 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3315/6384] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:53 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 1307 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:16:53.300382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-415bc923-77a9-40be-80ed-04d4eb0b6311 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] Calling method '.version_select at 0x7f777586b5e0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:53.335457 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-415bc923-77a9-40be-80ed-04d4eb0b6311 tempest-TestVolumeBootPattern-1627461036 tempest-TestVolumeBootPattern-1627461036-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1735877736" status: 202 len: 0 microversion: 2.1 time: 0.039061 Oct 05 18:16:53.336831 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3070/6385] 10.222.0.70 () {58 vars in 1263 bytes} [Wed Oct 5 18:16:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1735877736 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:16:53.817202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:53.818074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] [instance: 41cb647d-f404-486a-9a12-dc535f360fbb] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:53.821032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:16:53.828358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:53.828951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:53.829490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:53.830541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:53.831187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:53.831706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:53.847730 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] HTTP exception thrown: Instance 41cb647d-f404-486a-9a12-dc535f360fbb could not be found. Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Request method failure captured: Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb HTTP/1.1 Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcm2C8Kxy65pEnifwpQ_CtB-uV-4u9_p-HtIAWQ3-U3VDa5zIFo6l-k4UGAjAXOKLvEkhy63oQxipacnr44vEaZhrb_jmWj6ejmoM2szj2tpLoG4EV3W0orcmJxGhlZs0qKxbaaiZO3J-4-6BlI2ZSVFjM_-T1FF6pTzhunyBr-rkFY Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 81356660aaae46deb0c3107128256727 Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1357167370 Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/81356660aaae46deb0c3107128256727"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81356660aaae46deb0c3107128256727"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_81356660aaae46deb0c3107128256727", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/81356660aaae46deb0c3107128256727"}]}] Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1357167370 Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 81356660aaae46deb0c3107128256727 Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1357167370 Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestSecurityGroupsBasicOps-1357167370-project Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: e0627766a159459283ed2788f79b7b8e Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1357167370-project Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 41cb647d-f404-486a-9a12-dc535f360fbb could not be found. Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '41cb647d-f404-486a-9a12-dc535f360fbb'} Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41cb647d-f404-486a-9a12-dc535f360fbb could not be found. Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41cb647d-f404-486a-9a12-dc535f360fbb could not be found. Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:53.849828 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:53.854447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:53.854447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:53.854447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:53.854447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:53.854447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:53.854447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:53.854447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41cb647d-f404-486a-9a12-dc535f360fbb could not be found. Oct 05 18:16:53.854447 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:16:53.854447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Returning 404 to user: Instance 41cb647d-f404-486a-9a12-dc535f360fbb could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:53.855764 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-605f9aea-1ecb-4576-9db4-09f9ff708fca tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb" status: 404 len: 111 microversion: 2.1 time: 0.042746 Oct 05 18:16:53.859232 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3316/6386] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:53 2022] GET /compute/v2.1/servers/41cb647d-f404-486a-9a12-dc535f360fbb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:54.261594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:54.263043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] [instance: 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:16:54.271562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:54.272312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:54.272937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:54.273850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:54.274513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:54.275095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:54.289566 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] HTTP exception thrown: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 could not be found. Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Request method failure captured: Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 HTTP/1.1 Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcmkUg8wNe8AQ236_98A4MjfKNhTi2X6KKFAEBtSUurpsyKrQkljBYP3kcwKl2PO__HdPCArhF96mgiHenYRLakwYOO0-TCCQF6nCWr-Nd8xilqSpQqgKYkYZwUq5HVh4tg_PB5UG-Fg6J9dHYl6ajt0qi2Mwi1C4mjq95fruZGxT7E Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/f34e890dde99482b9e72343765245cc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_f34e890dde99482b9e72343765245cc6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/f34e890dde99482b9e72343765245cc6"}]}] Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: f34e890dde99482b9e72343765245cc6 Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1835088604 Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 05a1488f79c44744b8ab28db3b54fb54 Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-1835088604-project Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 could not be found. Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4a04f9c9-bdcf-4353-b6ae-627e1916d0a2'} Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 could not be found. Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 could not be found. Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:16:54.291070 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:54.296387 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:16:54.296387 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:16:54.296387 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:16:54.296387 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:16:54.296387 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:16:54.296387 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 could not be found. Oct 05 18:16:54.296387 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:16:54.296387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] Returning 404 to user: Instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:16:54.296387 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-72b47321-3783-4c4d-8db7-c210260d001d tempest-ServersNegativeTestJSON-1835088604 tempest-ServersNegativeTestJSON-1835088604-project] 10.222.0.70 "GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2" status: 404 len: 111 microversion: 2.1 time: 0.034894 Oct 05 18:16:54.296387 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3071/6387] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:16:54 2022] GET /compute/v2.1/servers/4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:16:54.739512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-cfd36d88-de08-4a0f-abf7-13adeffa0b02 req-f8497895-1003-430f-be56-0272ac674d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a04f9c9-bdcf-4353-b6ae-627e1916d0a2", "name": "network-vif-deleted", "tag": "65579d35-5481-4556-bba1-3cc32437cc90"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:16:54.751393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cfd36d88-de08-4a0f-abf7-13adeffa0b02 req-f8497895-1003-430f-be56-0272ac674d43 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:16:54.752273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cfd36d88-de08-4a0f-abf7-13adeffa0b02 req-f8497895-1003-430f-be56-0272ac674d43 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:16:54.752999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cfd36d88-de08-4a0f-abf7-13adeffa0b02 req-f8497895-1003-430f-be56-0272ac674d43 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:16:54.769402 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-cfd36d88-de08-4a0f-abf7-13adeffa0b02 req-f8497895-1003-430f-be56-0272ac674d43 service nova] Creating event network-vif-deleted:65579d35-5481-4556-bba1-3cc32437cc90 for instance 4a04f9c9-bdcf-4353-b6ae-627e1916d0a2 on n-h2-835595-3 Oct 05 18:16:54.777041 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-cfd36d88-de08-4a0f-abf7-13adeffa0b02 req-f8497895-1003-430f-be56-0272ac674d43 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041893 Oct 05 18:16:54.778445 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3317/6388] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:16:59.484693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-68127651-43db-4e66-89fc-cf0e7289398c tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] Calling method '.version_select at 0x7f777495f3a0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:16:59.509493 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-68127651-43db-4e66-89fc-cf0e7289398c tempest-TestSecurityGroupsBasicOps-1357167370 tempest-TestSecurityGroupsBasicOps-1357167370-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-948182754" status: 202 len: 0 microversion: 2.1 time: 0.029876 Oct 05 18:16:59.510612 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3072/6389] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 18:16:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-948182754 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 18:17:07.635713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:07.637127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:07.766512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d9ad0a97-cb86-4f9c-aa28-e34fa306c400 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Action: 'create', calling method: .version_select at 0x7f77747cfe50>, body: {"keypair": {"name": "tempest-keypair-140523625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFCUvebQwJS08/LNu5NP1YRpUoiKVx4S5sWqQTgZa5B1pSaXrD+hClGMFbIWZDwEWBcd0FVZB6n44q/tzFWFZb5+7IK9rDtiy3G000Gd7o3agJHRFZaDpbwGMgccmCIfg=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:17:07.782890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-d9ad0a97-cb86-4f9c-aa28-e34fa306c400 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Getting quotas for project fa7742f2d110463e89cf009ef444ee34. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:17:07.788753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-d9ad0a97-cb86-4f9c-aa28-e34fa306c400 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Getting quotas for user cdda1e58d0a54d4ca1cd772c61c9cbb8 and project fa7742f2d110463e89cf009ef444ee34. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:17:07.817740 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d9ad0a97-cb86-4f9c-aa28-e34fa306c400 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.184540 Oct 05 18:17:07.818374 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3318/6390] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Oct 5 18:17:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 18:17:09.114475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:09.120855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1331001079", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4627fb29-f5f2-4006-8127-af30c1d228f4"}], "security_groups": [{"name": "tempest-securitygroup--259310791"}], "key_name": "tempest-keypair-140523625", "user_data": "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:17:09.234248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] validate_networks() for [('4627fb29-f5f2-4006-8127-af30c1d228f4', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:17:09.732488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:17:09.732981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:17:09.733451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:17:09.733858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:17:09.734260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:17:09.736343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:09.745968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:09.746509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:09.746954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:09.747672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:09.748133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:09.748557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:09.767791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Getting quotas for project fa7742f2d110463e89cf009ef444ee34. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:17:09.773250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Getting quotas for user cdda1e58d0a54d4ca1cd772c61c9cbb8 and project fa7742f2d110463e89cf009ef444ee34. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:17:09.787395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:17:09.789751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:17:09.837846 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3e345f1e-1ce2-46b8-a40b-ef9370d350d2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.725787 Oct 05 18:17:09.844615 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3073/6391] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 18:17:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 18:17:09.856412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-50febb9d-b936-4b2d-92b7-1f3359cd2506 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:09.857451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-50febb9d-b936-4b2d-92b7-1f3359cd2506 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:09.932843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-50febb9d-b936-4b2d-92b7-1f3359cd2506 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:09.940504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-50febb9d-b936-4b2d-92b7-1f3359cd2506 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:09.941953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-50febb9d-b936-4b2d-92b7-1f3359cd2506 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:09.943136 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-50febb9d-b936-4b2d-92b7-1f3359cd2506 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1281 microversion: 2.20 time: 0.094281 Oct 05 18:17:09.943874 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3319/6392] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:17:09 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:17:10.970197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:10.970838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:10.986160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:10.986677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:10.987209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:10.987921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:10.988371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:10.988794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:11.073050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:11.085831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:11.087858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:11.089029 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d194a7b6-2e2b-4c77-92d7-29702199f7f9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1351 microversion: 2.20 time: 0.124370 Oct 05 18:17:11.104448 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3074/6393] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:17:10 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1351 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:17:12.114844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:12.115587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:12.123864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:12.124480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:12.125002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:12.125723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:12.126196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:12.126662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:12.314813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:12.323966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:12.325416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:12.326605 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d2d37b9a-8716-43b5-ab32-5bd6cda6467e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1406 microversion: 2.20 time: 0.215959 Oct 05 18:17:12.327191 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3320/6394] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:17:12 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:17:12.465485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-05f1ff44-7222-491c-ba21-8d1aa33f1f40 req-7dbab3b8-b600-45aa-8386-94047a038a60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6817caff-47c9-4b2d-84b7-a9dae8857506", "tag": "61e315c5-bd2c-461a-91ae-295c62027458"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:17:12.476193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-05f1ff44-7222-491c-ba21-8d1aa33f1f40 req-7dbab3b8-b600-45aa-8386-94047a038a60 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:12.476823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-05f1ff44-7222-491c-ba21-8d1aa33f1f40 req-7dbab3b8-b600-45aa-8386-94047a038a60 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:12.477527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-05f1ff44-7222-491c-ba21-8d1aa33f1f40 req-7dbab3b8-b600-45aa-8386-94047a038a60 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:12.490442 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-05f1ff44-7222-491c-ba21-8d1aa33f1f40 req-7dbab3b8-b600-45aa-8386-94047a038a60 service nova] Creating event network-changed:61e315c5-bd2c-461a-91ae-295c62027458 for instance 6817caff-47c9-4b2d-84b7-a9dae8857506 on n-h2-835595-3 Oct 05 18:17:12.495557 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-05f1ff44-7222-491c-ba21-8d1aa33f1f40 req-7dbab3b8-b600-45aa-8386-94047a038a60 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035131 Oct 05 18:17:12.496576 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3075/6395] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:17:13.354869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:13.355697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:13.364665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:13.365204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:13.365659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:13.366415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:13.366899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:13.367356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:13.511865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:13.522677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:13.524176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:13.525582 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a471ba62-c338-4c9c-992a-bf59a714a79e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1406 microversion: 2.20 time: 0.175966 Oct 05 18:17:13.526393 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3321/6396] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:17:13 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:17:14.559287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:14.560429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:14.569073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:14.569562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:14.569996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:14.570727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:14.571187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:14.571613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:14.707982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:14.716518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:14.717972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:14.719144 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-289ff587-d678-4fcd-970d-3cefe074b4d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1406 microversion: 2.20 time: 0.168531 Oct 05 18:17:14.719691 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3076/6397] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:17:14 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:17:15.743908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:15.744515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:15.752163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:15.752773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:15.753231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:15.753957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:15.754466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:15.754910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:15.960612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:15.969000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:15.970576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:15.971883 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-65f5a91f-4628-47b3-8e14-2b5971ad5915 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1406 microversion: 2.20 time: 0.232064 Oct 05 18:17:15.972543 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3322/6398] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:17:15 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:17:16.996603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:16.997160 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:17.004633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:17.005573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:17.006019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:17.006754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:17.007214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:17.007671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:17.213489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:17.222485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:17.223950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:17.225485 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9e1bfa77-d36f-42e5-92a4-fc8352fb007c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1406 microversion: 2.20 time: 0.232903 Oct 05 18:17:17.226046 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3077/6399] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:17:16 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:17:18.067415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6aedad78-2061-4cfc-adb1-4249f82b5d0a req-6e143462-9b25-447e-8a20-125a0e60254c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6817caff-47c9-4b2d-84b7-a9dae8857506", "name": "network-vif-plugged", "status": "completed", "tag": "61e315c5-bd2c-461a-91ae-295c62027458"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:17:18.081759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6aedad78-2061-4cfc-adb1-4249f82b5d0a req-6e143462-9b25-447e-8a20-125a0e60254c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:18.082308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6aedad78-2061-4cfc-adb1-4249f82b5d0a req-6e143462-9b25-447e-8a20-125a0e60254c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:18.082769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6aedad78-2061-4cfc-adb1-4249f82b5d0a req-6e143462-9b25-447e-8a20-125a0e60254c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:18.094167 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6aedad78-2061-4cfc-adb1-4249f82b5d0a req-6e143462-9b25-447e-8a20-125a0e60254c service nova] Creating event network-vif-plugged:61e315c5-bd2c-461a-91ae-295c62027458 for instance 6817caff-47c9-4b2d-84b7-a9dae8857506 on n-h2-835595-3 Oct 05 18:17:18.099602 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6aedad78-2061-4cfc-adb1-4249f82b5d0a req-6e143462-9b25-447e-8a20-125a0e60254c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045308 Oct 05 18:17:18.100372 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3323/6400] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:17:18.249308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:18.249887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:18.258174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:18.259061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:18.259500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:18.260230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:18.260676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:18.261103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:18.405081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:18.413677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:18.415145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:18.416262 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6f847038-f8c3-4867-89d3-1e4b79337e1c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1406 microversion: 2.20 time: 0.170995 Oct 05 18:17:18.416832 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3078/6401] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:17:18 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:17:19.447581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:19.448808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:19.457999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:19.458537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:19.458983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:19.459680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:19.460169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:19.460600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:19.613521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:19.627039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:19.629026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:19.630551 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9bbffb4f-d254-47f1-b09e-cfb39907f7b2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1598 microversion: 2.20 time: 0.191216 Oct 05 18:17:19.631118 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3324/6402] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:17:19 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1598 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:17:19.658254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-787d88f9-844e-466b-a313-d6eb4b74aa2a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:19.658882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-787d88f9-844e-466b-a313-d6eb4b74aa2a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:19.666167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d88f9-844e-466b-a313-d6eb4b74aa2a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:19.666694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d88f9-844e-466b-a313-d6eb4b74aa2a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:19.667130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d88f9-844e-466b-a313-d6eb4b74aa2a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:19.667831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d88f9-844e-466b-a313-d6eb4b74aa2a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:19.668290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d88f9-844e-466b-a313-d6eb4b74aa2a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:19.668711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-787d88f9-844e-466b-a313-d6eb4b74aa2a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:19.747163 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-787d88f9-844e-466b-a313-d6eb4b74aa2a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095325 Oct 05 18:17:19.747889 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3079/6403] 10.222.0.70 () {60 vars in 1316 bytes} [Wed Oct 5 18:17:19 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:17:21.095672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a35e9b1e-2d0f-4598-b208-6cec8e66328a req-b401e36a-61b2-411a-b5d5-dddb3f781a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6817caff-47c9-4b2d-84b7-a9dae8857506", "tag": "61e315c5-bd2c-461a-91ae-295c62027458"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:17:21.100718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:21.107469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a35e9b1e-2d0f-4598-b208-6cec8e66328a req-b401e36a-61b2-411a-b5d5-dddb3f781a1f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:21.108058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a35e9b1e-2d0f-4598-b208-6cec8e66328a req-b401e36a-61b2-411a-b5d5-dddb3f781a1f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:21.108548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a35e9b1e-2d0f-4598-b208-6cec8e66328a req-b401e36a-61b2-411a-b5d5-dddb3f781a1f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:21.119772 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a35e9b1e-2d0f-4598-b208-6cec8e66328a req-b401e36a-61b2-411a-b5d5-dddb3f781a1f service nova] Creating event network-changed:61e315c5-bd2c-461a-91ae-295c62027458 for instance 6817caff-47c9-4b2d-84b7-a9dae8857506 on n-h2-835595-3 Oct 05 18:17:21.124689 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a35e9b1e-2d0f-4598-b208-6cec8e66328a req-b401e36a-61b2-411a-b5d5-dddb3f781a1f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032766 Oct 05 18:17:21.125658 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3325/6404] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:17:57.313499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:57.314545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:57.316824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:57.317504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=32 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:57.322013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-11947a9d-6a89-4b62-9580-bb30055a33f4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:57.322696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-11947a9d-6a89-4b62-9580-bb30055a33f4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:57.331331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11947a9d-6a89-4b62-9580-bb30055a33f4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:57.331856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11947a9d-6a89-4b62-9580-bb30055a33f4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:57.332295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11947a9d-6a89-4b62-9580-bb30055a33f4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:57.332991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11947a9d-6a89-4b62-9580-bb30055a33f4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:57.333446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11947a9d-6a89-4b62-9580-bb30055a33f4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:57.333869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-11947a9d-6a89-4b62-9580-bb30055a33f4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:57.358781 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-11947a9d-6a89-4b62-9580-bb30055a33f4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/ips" status: 200 len: 152 microversion: 2.20 time: 0.045980 Oct 05 18:17:57.359357 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3080/6405] 10.222.0.70 () {60 vars in 1289 bytes} [Wed Oct 5 18:17:57 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:17:59.197375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:59.198123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=28 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:17:59.202874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9aa1724d-0258-42f7-aaae-3de4288d6bef tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:17:59.203509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9aa1724d-0258-42f7-aaae-3de4288d6bef tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:59.210820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa1724d-0258-42f7-aaae-3de4288d6bef tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:59.211319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa1724d-0258-42f7-aaae-3de4288d6bef tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:59.211763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa1724d-0258-42f7-aaae-3de4288d6bef tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:59.212475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa1724d-0258-42f7-aaae-3de4288d6bef tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:59.212940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa1724d-0258-42f7-aaae-3de4288d6bef tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:59.213377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9aa1724d-0258-42f7-aaae-3de4288d6bef tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:59.238586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-9aa1724d-0258-42f7-aaae-3de4288d6bef tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lazy-loading 'flavor' on Instance uuid 6817caff-47c9-4b2d-84b7-a9dae8857506 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:17:59.449482 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9aa1724d-0258-42f7-aaae-3de4288d6bef tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "POST /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/action" status: 202 len: 0 microversion: 2.20 time: 0.253926 Oct 05 18:17:59.449962 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3326/6406] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 18:17:59 2022] POST /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:17:59.458347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:17:59.458995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:17:59.466210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:59.466731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:59.467180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:59.468273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:17:59.468702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:17:59.469139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:17:59.610244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:59.619041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:59.620472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:17:59.621645 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-86aa4e75-fbd3-40e1-804a-6a64817aaec0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.167249 Oct 05 18:17:59.622210 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3081/6407] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:17:59 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:00.650305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:00.651007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:00.658727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:00.659225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:00.659685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:00.660379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:00.660852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:00.661288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:00.808081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:00.816926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:00.818410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:00.819622 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-715c13c1-5826-4521-bb2c-d983ef283949 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.174598 Oct 05 18:18:00.820212 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3327/6408] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:00 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:01.855546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:01.856129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:01.863351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:01.863834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:01.864270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:01.865001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:01.865456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:01.865875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:02.000327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:02.013745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:02.015724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:02.017111 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6d1a5507-ac09-4d35-a6bf-883a66b7e50c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.165602 Oct 05 18:18:02.017843 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3082/6409] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:01 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:03.047619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:03.048689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:03.060523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:03.061358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:03.062123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:03.063434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:03.064230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:03.066202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:03.205516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:03.214190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:03.215722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:03.216894 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dc672d38-3e0c-4464-a2eb-1817e8ebe413 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.176314 Oct 05 18:18:03.217471 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3328/6410] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:03 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:04.243502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:04.244211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:04.251642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:04.252132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:04.252571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:04.253333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:04.253859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:04.254306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:04.395436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:04.403935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:04.405377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:04.406595 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa374b0e-a95e-416b-8f56-a27797134148 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.167262 Oct 05 18:18:04.407173 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3083/6411] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:04 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:05.435777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:05.436348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:05.445001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:05.445509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:05.445960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:05.446761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:05.447235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:05.447676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:05.590593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:05.601891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:05.603390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:05.604592 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0836bfc-0e9a-4702-a1e5-8b0449ae7a70 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.175229 Oct 05 18:18:05.605161 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3329/6412] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:05 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:06.631486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:06.632090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:06.639495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:06.639978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:06.640403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:06.641088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:06.641538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:06.641960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:06.782397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:06.791049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:06.792533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:06.793723 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5dda8b46-367d-4a31-b14e-62618e1ee8a7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.166543 Oct 05 18:18:06.794390 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3084/6413] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:06 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:07.823660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:07.824665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:07.834241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:07.834770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:07.835222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:07.835932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:07.836399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:07.836833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:07.982718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:07.991193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:07.992681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:07.993868 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b94b3b2-8b86-48b5-9dfc-9e8dcff2dd89 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.177475 Oct 05 18:18:07.994476 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3330/6414] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:07 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:09.023312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:09.024272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:09.035639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:09.036120 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:09.036557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:09.037254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:09.037707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:09.038132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:09.171439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:09.180083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:09.181526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:09.182741 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23056580-082f-479d-9334-2daba1c2fb09 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.166010 Oct 05 18:18:09.183314 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3085/6415] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:09 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:10.213390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:10.213999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:10.224065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:10.224736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:10.225356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:10.226340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:10.227153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:10.227612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:10.377501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:10.390351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:10.392598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:10.394317 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8b7fdeaf-aea6-4d1f-93b0-8bae9b8718a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.187493 Oct 05 18:18:10.394889 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3331/6416] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:10 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:11.423643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:11.424686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:11.436395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:11.437188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:11.437900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:11.439068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:11.439813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:11.440507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:11.581132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:11.589646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:11.591099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:11.592272 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c3804e99-743f-402c-83ba-f8fb74d3063b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.175247 Oct 05 18:18:11.592844 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3086/6417] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:11 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:12.622417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:12.624165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:12.634926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:12.635771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:12.636526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:12.637707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:12.638576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:12.639400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:12.781999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:12.790533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:12.791994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:12.793188 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4c3bf8e9-67b3-4262-998a-d7a052569034 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.177686 Oct 05 18:18:12.793765 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3332/6418] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:12 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:13.822888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:13.823836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:13.834092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:13.834612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:13.835024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:13.835744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:13.836197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:13.836623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:13.974892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:13.987788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:13.989230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:13.990466 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-86375bcb-c924-44af-a14e-3369f78c69ec tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.174207 Oct 05 18:18:13.991031 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3087/6419] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:13 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:15.020362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:15.021415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:15.033490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:15.034346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:15.035104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:15.035836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:15.036298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:15.036740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:15.185658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:15.195379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:15.196872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:15.198083 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-29796f5e-2d9a-418c-921d-19cd5c4b2c9f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1744 microversion: 2.20 time: 0.184511 Oct 05 18:18:15.198694 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3333/6420] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:15 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1744 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:16.224203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:16.224817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:16.232112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:16.232605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:16.233045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:16.233748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:16.234208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:16.234668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:16.370449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:16.379217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:16.380911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:16.382099 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2145a45d-f5f2-48de-9196-97809c762ae8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1744 microversion: 2.20 time: 0.161931 Oct 05 18:18:16.382711 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3088/6421] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:16 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:17.407630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:17.408357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:17.421658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:17.422415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:17.423107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:17.423839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:17.424318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:17.424761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:17.582314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:17.592027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:17.593808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:17.595202 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6db06b6e-d499-4325-9365-3498de6ecebe tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1739 microversion: 2.20 time: 0.191691 Oct 05 18:18:17.595974 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3334/6422] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:17 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:18.312262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-389108b5-336b-4a59-9908-f5644c83d8d5 req-ae7dcdc3-6b38-4099-8bb2-6b6062f47605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6817caff-47c9-4b2d-84b7-a9dae8857506", "name": "network-vif-plugged", "status": "completed", "tag": "61e315c5-bd2c-461a-91ae-295c62027458"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:18:18.324154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-389108b5-336b-4a59-9908-f5644c83d8d5 req-ae7dcdc3-6b38-4099-8bb2-6b6062f47605 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:18.325412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-389108b5-336b-4a59-9908-f5644c83d8d5 req-ae7dcdc3-6b38-4099-8bb2-6b6062f47605 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:18.325960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-389108b5-336b-4a59-9908-f5644c83d8d5 req-ae7dcdc3-6b38-4099-8bb2-6b6062f47605 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:18.338707 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-389108b5-336b-4a59-9908-f5644c83d8d5 req-ae7dcdc3-6b38-4099-8bb2-6b6062f47605 service nova] Creating event network-vif-plugged:61e315c5-bd2c-461a-91ae-295c62027458 for instance 6817caff-47c9-4b2d-84b7-a9dae8857506 on n-h2-835595-3 Oct 05 18:18:18.344526 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-389108b5-336b-4a59-9908-f5644c83d8d5 req-ae7dcdc3-6b38-4099-8bb2-6b6062f47605 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035909 Oct 05 18:18:18.345529 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3089/6423] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:18:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:18:18.621533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:18.622177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:18.643255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:18.643825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:18.644292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:18.648903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:18.649574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:18.650034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:18.796225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:18.806940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:18.808393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:18.809596 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-efa4a18a-3bc8-4faa-8dc5-0807cb3dbdbd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1739 microversion: 2.20 time: 0.192371 Oct 05 18:18:18.810367 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3335/6424] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:18 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:19.839098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:19.839798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:19.846729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:19.847208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:19.847681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:19.848421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:19.848870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:19.849309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:20.041829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:20.053531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:20.055124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:20.056389 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-20679e6e-6453-414d-847f-d137f957a13e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1739 microversion: 2.20 time: 0.222690 Oct 05 18:18:20.070827 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3090/6425] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:19 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:21.088038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:21.088901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:21.096714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:21.097413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:21.097874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:21.098608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:21.099401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:21.101833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:21.255923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:21.266393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:21.267874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:21.269499 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a46ecffa-aae2-409d-afed-0a797035135f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1739 microversion: 2.20 time: 0.186911 Oct 05 18:18:21.285205 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3336/6426] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:21 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:22.297850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:22.298532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:22.306337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:22.306831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:22.307272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:22.308052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:22.308507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:22.308932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:22.492305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:22.501242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:22.502728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:22.504098 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b610e138-a450-4ef9-9551-ac94d1db8d2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1739 microversion: 2.20 time: 0.210513 Oct 05 18:18:22.510382 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3091/6427] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:22 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:23.530773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:23.531540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:23.539558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:23.540077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:23.540536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:23.541317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:23.541801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:23.542257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:23.692621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:23.704453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:23.706144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:23.707506 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-83f37427-6755-46d5-b14f-ee8cc5175ea3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1739 microversion: 2.20 time: 0.180861 Oct 05 18:18:23.708336 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3337/6428] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:23 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:24.737252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:24.737906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:24.745179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:24.745663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:24.746151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:24.746893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:24.747368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:24.747794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:24.908874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:24.918627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:24.920157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:24.921432 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-626c4fed-e5c8-4fce-9fb0-7725d7337c71 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1739 microversion: 2.20 time: 0.189837 Oct 05 18:18:24.922002 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3092/6429] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:24 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:25.950832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:25.951466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:25.959956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:25.960461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:25.960910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:25.961630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:25.962103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:25.962582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:26.111269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:26.120158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:26.121623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:26.122847 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0978533d-62bb-4ebb-96f2-658416b7b821 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1739 microversion: 2.20 time: 0.177899 Oct 05 18:18:26.123418 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3338/6430] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:25 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:27.148986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:27.149614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:27.156757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:27.157248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:27.157685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:27.158424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:27.158883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:27.159355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:27.306684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:27.317525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:27.319290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:27.321009 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f2d3b532-9673-4c3c-bec2-7a1824eb5bd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1721 microversion: 2.20 time: 0.176142 Oct 05 18:18:27.321760 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3093/6431] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:27 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:28.347506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:28.348136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:28.355554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:28.356058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:28.356483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:28.357224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:28.357695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:28.358135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:28.498213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:28.507164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:28.508629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:28.509899 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79c82c92-a402-4701-b0d3-1c360f0e0267 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1721 microversion: 2.20 time: 0.166515 Oct 05 18:18:28.516213 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3339/6432] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:28 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:29.539024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:29.539850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:29.543525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=29 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:18:29.550601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:29.551089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:29.551524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:29.552217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:29.552668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:29.553088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:29.555876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=79 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:18:29.688478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:29.697046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:29.698500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:29.699696 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3dfd20cc-5b5f-4977-81c9-5102b2bf18a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1664 microversion: 2.20 time: 0.166102 Oct 05 18:18:29.700235 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3094/6433] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:29 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:29.725270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0833af3f-56bc-40b1-92a3-99a3ab3a43a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46f76fe7-08f3-4236-8c56-9fe93b2bd4e4"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:18:29.727764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0833af3f-56bc-40b1-92a3-99a3ab3a43a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:29.730662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=29 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:18:29.736038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0833af3f-56bc-40b1-92a3-99a3ab3a43a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:29.736540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0833af3f-56bc-40b1-92a3-99a3ab3a43a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:29.736986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0833af3f-56bc-40b1-92a3-99a3ab3a43a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:29.737755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0833af3f-56bc-40b1-92a3-99a3ab3a43a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:29.738219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0833af3f-56bc-40b1-92a3-99a3ab3a43a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:29.738681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0833af3f-56bc-40b1-92a3-99a3ab3a43a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:29.743328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:18:30.045529 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0833af3f-56bc-40b1-92a3-99a3ab3a43a8 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "POST /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.324266 Oct 05 18:18:30.046100 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3340/6434] 10.222.0.70 () {62 vars in 1364 bytes} [Wed Oct 5 18:18:29 2022] POST /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments => generated 188 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:18:30.175608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-06aba65b-e800-4472-9fcd-62cd40c13de2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:18:30.176206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-06aba65b-e800-4472-9fcd-62cd40c13de2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:30.182362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06aba65b-e800-4472-9fcd-62cd40c13de2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:30.182842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06aba65b-e800-4472-9fcd-62cd40c13de2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:30.183278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06aba65b-e800-4472-9fcd-62cd40c13de2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:30.183949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06aba65b-e800-4472-9fcd-62cd40c13de2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:30.184397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06aba65b-e800-4472-9fcd-62cd40c13de2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:30.184813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06aba65b-e800-4472-9fcd-62cd40c13de2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:30.214055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-06aba65b-e800-4472-9fcd-62cd40c13de2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128843) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 18:18:30.286324 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-06aba65b-e800-4472-9fcd-62cd40c13de2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "POST /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/action" status: 202 len: 0 microversion: 2.20 time: 0.114823 Oct 05 18:18:30.287484 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3095/6435] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 18:18:30 2022] POST /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:18:30.295520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:30.296198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:30.303687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:30.304189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:30.304631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:30.305349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:30.305804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:30.306237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:30.337036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ec328618-5f50-4c4e-b5d8-ea0d64a4a328 req-ede60755-01e4-4904-b3fa-56a6a211a751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6817caff-47c9-4b2d-84b7-a9dae8857506", "name": "network-vif-unplugged", "status": "completed", "tag": "61e315c5-bd2c-461a-91ae-295c62027458"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:18:30.348030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ec328618-5f50-4c4e-b5d8-ea0d64a4a328 req-ede60755-01e4-4904-b3fa-56a6a211a751 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:30.348725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ec328618-5f50-4c4e-b5d8-ea0d64a4a328 req-ede60755-01e4-4904-b3fa-56a6a211a751 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:30.350338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ec328618-5f50-4c4e-b5d8-ea0d64a4a328 req-ede60755-01e4-4904-b3fa-56a6a211a751 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:30.370085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.compute.server_external_events [req-ec328618-5f50-4c4e-b5d8-ea0d64a4a328 req-ede60755-01e4-4904-b3fa-56a6a211a751 service nova] Unable to find a host for instance 6817caff-47c9-4b2d-84b7-a9dae8857506. Dropping event network-vif-unplugged {{(pid=128843) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 18:18:30.371789 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ec328618-5f50-4c4e-b5d8-ea0d64a4a328 req-ede60755-01e4-4904-b3fa-56a6a211a751 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038775 Oct 05 18:18:30.372952 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3096/6436] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 05 18:18:30.458554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:30.468465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:30.470138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:30.471706 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd34b98d-5f8d-42f7-91dc-5c1ce0f1cd66 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1750 microversion: 2.20 time: 0.180099 Oct 05 18:18:30.472701 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3341/6437] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:30 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:31.496799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:31.497419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:31.504751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:31.505278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:31.506026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:31.506762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:31.507216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:31.507640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:31.664004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:31.673834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:31.675520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:31.676828 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6d5d5472-94f0-436d-9edc-4820229a26d4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1752 microversion: 2.20 time: 0.184282 Oct 05 18:18:31.677462 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3097/6438] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:31 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:32.703436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:32.704072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:32.711981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:32.712493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:32.712949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:32.713678 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:32.714152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:32.714621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:32.853920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:32.863443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:32.864946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:32.866171 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-17b299b2-fd7e-4997-bd49-95836f02a457 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1752 microversion: 2.20 time: 0.166837 Oct 05 18:18:32.866755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3342/6439] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:32 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:33.892443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:33.893082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:33.900491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:33.900930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:33.901422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:33.902131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:33.902628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:33.903064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:34.039781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:34.048846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:34.050435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:34.051609 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fad7aadf-e4c8-4e5b-a7f3-0a2c60602427 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1752 microversion: 2.20 time: 0.163278 Oct 05 18:18:34.052213 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3098/6440] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:33 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:35.077257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:35.077891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:35.086393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:35.086926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:35.087380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:35.088108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:35.088581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:35.089032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:35.229210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:35.239124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:35.240604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:35.241796 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-008779e4-2f4a-496c-9bfb-6b16c9d76ffa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1752 microversion: 2.20 time: 0.168555 Oct 05 18:18:35.242385 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3343/6441] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:35 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:36.267699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:36.268262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:36.275479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:36.275957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:36.276383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:36.277156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:36.277625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:36.278061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:36.413959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:36.423342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:36.424885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:36.426058 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e809ef26-8ae8-4fd6-b162-b1cc079e6b37 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.162287 Oct 05 18:18:36.426673 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3099/6442] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:36 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:37.464291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:37.465364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:37.474132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:37.474670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:37.475129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:37.475847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:37.476321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:37.476719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:37.609824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:37.618788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:37.620237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:37.621430 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e8fd6709-51a0-4434-9af8-06376bcd4167 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.163921 Oct 05 18:18:37.622034 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3344/6443] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:37 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:37.758646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-9aa48372-f78f-45e0-9d3b-cd62490acee1 req-d1f015ca-6f21-4acb-bf66-a56e4dacc824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6817caff-47c9-4b2d-84b7-a9dae8857506", "tag": "61e315c5-bd2c-461a-91ae-295c62027458"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:18:37.768867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9aa48372-f78f-45e0-9d3b-cd62490acee1 req-d1f015ca-6f21-4acb-bf66-a56e4dacc824 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:37.769343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9aa48372-f78f-45e0-9d3b-cd62490acee1 req-d1f015ca-6f21-4acb-bf66-a56e4dacc824 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:37.769775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9aa48372-f78f-45e0-9d3b-cd62490acee1 req-d1f015ca-6f21-4acb-bf66-a56e4dacc824 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:37.781376 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9aa48372-f78f-45e0-9d3b-cd62490acee1 req-d1f015ca-6f21-4acb-bf66-a56e4dacc824 service nova] Creating event network-changed:61e315c5-bd2c-461a-91ae-295c62027458 for instance 6817caff-47c9-4b2d-84b7-a9dae8857506 on n-h1-835595-3 Oct 05 18:18:37.787815 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-9aa48372-f78f-45e0-9d3b-cd62490acee1 req-d1f015ca-6f21-4acb-bf66-a56e4dacc824 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034219 Oct 05 18:18:37.787815 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3100/6444] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:18:38.647915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:38.648441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:38.659606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:38.660597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:38.661586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:38.663008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:38.664348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:38.665825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:38.906746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:38.917909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:38.919959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:38.921713 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1eadd16c-05af-4e8a-bb3f-ce39de98e8c9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.278413 Oct 05 18:18:38.922737 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3345/6445] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:38 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:39.954245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:39.954965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:39.961476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:39.961967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:39.962432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:39.963122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:39.963582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:39.964005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:40.114727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:40.124134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:40.125650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:40.126886 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4b17bfff-5df8-4de4-9260-bd43ba1885df tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.177983 Oct 05 18:18:40.135582 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3101/6446] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:39 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:41.152570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:41.153955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:41.161831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:41.162471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:41.162992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:41.163846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:41.164323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:41.164838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:41.317903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:41.327465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:41.328916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:41.330149 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aec76b8e-cb94-4c78-a013-6aa7bc927355 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.181486 Oct 05 18:18:41.330755 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3346/6447] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:41 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:42.356477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:42.357147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:42.364618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:42.365096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:42.365530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:42.366231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:42.366707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:42.367126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:42.510341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:42.519134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:42.520628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:42.521805 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b2c3899e-1f02-46ca-99ae-91674ba2f935 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.169404 Oct 05 18:18:42.522472 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3102/6448] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:42 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:43.548564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:43.550113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:43.557952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:43.558751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:43.559395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:43.560460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:43.561126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:43.561742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:43.709740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:43.712694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:43.714166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:43.715436 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b8b4cece-506a-4031-a8eb-a74630fd9ad6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.170925 Oct 05 18:18:43.726238 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3347/6449] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:43 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:44.744569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:44.745238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:44.752543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:44.753243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:44.753783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:44.754649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:44.755168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:44.755946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:44.911129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:44.920576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:44.922132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:44.923774 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b11d5297-7d68-4e9a-9555-fd495db75aa4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.182788 Oct 05 18:18:44.924021 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3103/6450] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:44 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:45.950175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:45.951418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:45.958858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:45.959360 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:45.959815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:45.960525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:45.961015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:45.961436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:46.095089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:46.108098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:46.110163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:46.112060 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-201320c2-487f-4eab-a1ba-c2da7884cd4d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.165765 Oct 05 18:18:46.112791 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3348/6451] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:45 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:47.138072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:47.138725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:47.146000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:47.146520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:47.146956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:47.147645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:47.149205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:47.149205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:47.333891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:47.346784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:47.348248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:47.349420 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5bce67d6-f96f-4ea1-9408-487c8d1d6f42 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.215422 Oct 05 18:18:47.349966 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3104/6452] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:47 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:48.379037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:48.380327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:48.385985 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:18:48.386390 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:18:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 (ip 10.222.0.70) !!! Oct 05 18:18:48.396035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:48.396534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:48.396987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:48.397700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:48.398163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:48.398629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:48.532374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:48.545128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:48.547168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:48.548907 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5b3de79d-f0b4-44c9-895f-6e9d4efdb33a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.176325 Oct 05 18:18:48.549839 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3349/6453] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:48 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:49.578494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:49.579441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:49.591985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:49.592782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:49.593500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:49.594705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:49.595462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:49.596165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:49.736844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:49.749871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:49.752021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:49.753459 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c5c25214-d418-4cef-8ecf-232ff824beac tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.181587 Oct 05 18:18:49.754033 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3105/6454] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:49 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:50.793257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:50.794740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:50.803753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:50.804255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:50.804703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:50.805415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:50.805883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:50.806307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:50.941176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:50.950051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:50.951573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:50.952760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e06d1dbe-4cf0-47b1-89e2-7a291dbf5489 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.166283 Oct 05 18:18:50.953321 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3350/6455] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:50 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:51.982733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:51.983742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:51.995316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:51.996129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:51.996861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:51.998010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:51.998816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:51.999543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:52.133288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:52.142143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:52.143717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:52.144885 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-659bcc5d-8e75-4fe1-b48c-7f92b464ae2c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.168978 Oct 05 18:18:52.145497 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3106/6456] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:51 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:53.170677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:53.171290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:53.178712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:53.179220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:53.179669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:53.180381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:53.180856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:53.181297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:53.321181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:53.330528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:53.331966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:53.333151 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1fa421ee-94a9-4abe-8cd5-22bfab9c00c6 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.166617 Oct 05 18:18:53.333698 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3351/6457] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:53 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:54.362970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:54.363593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:54.372252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:54.372739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:54.373173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:54.373873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:54.374488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:54.375072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:54.512480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:54.523240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:54.524673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:54.525849 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1812200a-18f2-4428-8961-66d5dd526e34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.169548 Oct 05 18:18:54.526449 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3107/6458] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:54 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:55.552121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:55.552757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:55.560214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:55.560752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:55.561207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:55.561923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:55.562430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:55.562874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:55.699613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:55.708425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:55.709881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:55.711114 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2c8a0aa4-a8e2-4cee-9596-2c985ca84bb2 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.163488 Oct 05 18:18:55.711691 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3352/6459] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:55 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:56.741368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:56.742390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:56.753960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:56.754815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:56.755533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:56.757008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:56.757757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:56.758501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:56.903064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:56.914390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:56.916786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:56.918602 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-461bc565-6ece-46b1-b7c7-dcfe64e53932 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.183716 Oct 05 18:18:56.919459 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3108/6460] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:56 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:57.578961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-cd9d8101-ad5f-4ce8-acbb-e9eb1c4c1e2b req-52b284ac-42f4-4f70-87cd-541a313dea07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6817caff-47c9-4b2d-84b7-a9dae8857506", "name": "network-vif-plugged", "status": "completed", "tag": "61e315c5-bd2c-461a-91ae-295c62027458"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:18:57.590350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cd9d8101-ad5f-4ce8-acbb-e9eb1c4c1e2b req-52b284ac-42f4-4f70-87cd-541a313dea07 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:57.591459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cd9d8101-ad5f-4ce8-acbb-e9eb1c4c1e2b req-52b284ac-42f4-4f70-87cd-541a313dea07 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:57.591920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cd9d8101-ad5f-4ce8-acbb-e9eb1c4c1e2b req-52b284ac-42f4-4f70-87cd-541a313dea07 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:57.604169 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-cd9d8101-ad5f-4ce8-acbb-e9eb1c4c1e2b req-52b284ac-42f4-4f70-87cd-541a313dea07 service nova] Creating event network-vif-plugged:61e315c5-bd2c-461a-91ae-295c62027458 for instance 6817caff-47c9-4b2d-84b7-a9dae8857506 on n-h1-835595-3 Oct 05 18:18:57.609722 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-cd9d8101-ad5f-4ce8-acbb-e9eb1c4c1e2b req-52b284ac-42f4-4f70-87cd-541a313dea07 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034733 Oct 05 18:18:57.610571 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3353/6461] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:18:57.946104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:57.946703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:57.954048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:57.954564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:57.954991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:57.955676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:57.956124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:57.956571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:58.096936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:58.107004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:58.108463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:58.109652 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-752f54b6-0d51-49b0-9bad-fea970230696 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.167575 Oct 05 18:18:58.110228 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3109/6462] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:57 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:18:59.135267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:18:59.135961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:18:59.144288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:59.144824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:59.145264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:59.145969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:18:59.146460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:18:59.146893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:18:59.285379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:59.287846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:18:59.295821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:59.297287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:18:59.298510 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8c7159e2-ac5b-4d65-afc7-734ee906be49 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1808 microversion: 2.20 time: 0.167911 Oct 05 18:18:59.299300 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3354/6463] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:18:59 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:00.327643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:00.328685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:00.332227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:19:00.337894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:00.338412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:00.338854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:00.339573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:00.340027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:00.340452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:00.344101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:19:00.482170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:00.491206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:00.492642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:00.493822 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4b84a446-f47d-45ef-9e61-cb4cfa8df919 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1795 microversion: 2.20 time: 0.172991 Oct 05 18:19:00.494425 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3110/6464] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:00 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1795 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:29.269642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-17d452ce-5376-4608-9e34-c6424243e845 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:29.270327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-17d452ce-5376-4608-9e34-c6424243e845 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:29.272173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=29 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:19:29.278199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17d452ce-5376-4608-9e34-c6424243e845 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:29.278726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17d452ce-5376-4608-9e34-c6424243e845 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:29.279175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17d452ce-5376-4608-9e34-c6424243e845 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:29.279885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17d452ce-5376-4608-9e34-c6424243e845 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:29.280358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17d452ce-5376-4608-9e34-c6424243e845 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:29.280800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17d452ce-5376-4608-9e34-c6424243e845 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:29.312430 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-17d452ce-5376-4608-9e34-c6424243e845 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments/46f76fe7-08f3-4236-8c56-9fe93b2bd4e4" status: 200 len: 194 microversion: 2.20 time: 0.047880 Oct 05 18:19:29.313001 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3355/6465] 10.222.0.70 () {60 vars in 1454 bytes} [Wed Oct 5 18:19:29 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments/46f76fe7-08f3-4236-8c56-9fe93b2bd4e4 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:19:29.387493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5ce1b676-0bd2-49c0-b463-e452c27660ce tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:29.388247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5ce1b676-0bd2-49c0-b463-e452c27660ce tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:29.391588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:19:29.392530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=5 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:19:29.400510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ce1b676-0bd2-49c0-b463-e452c27660ce tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:29.401227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ce1b676-0bd2-49c0-b463-e452c27660ce tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:29.401868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ce1b676-0bd2-49c0-b463-e452c27660ce tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:29.403002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ce1b676-0bd2-49c0-b463-e452c27660ce tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:29.403708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ce1b676-0bd2-49c0-b463-e452c27660ce tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:29.404372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5ce1b676-0bd2-49c0-b463-e452c27660ce tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:29.489571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-5ce1b676-0bd2-49c0-b463-e452c27660ce tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lazy-loading 'services' on Instance uuid 6817caff-47c9-4b2d-84b7-a9dae8857506 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:19:29.569184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5ce1b676-0bd2-49c0-b463-e452c27660ce tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments/46f76fe7-08f3-4236-8c56-9fe93b2bd4e4" status: 202 len: 0 microversion: 2.20 time: 0.188666 Oct 05 18:19:29.569802 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3111/6466] 10.222.0.70 () {60 vars in 1457 bytes} [Wed Oct 5 18:19:29 2022] DELETE /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments/46f76fe7-08f3-4236-8c56-9fe93b2bd4e4 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:19:29.578637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-66f825cf-41be-4d02-9de2-928824248c53 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:29.581224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-66f825cf-41be-4d02-9de2-928824248c53 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:29.587946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66f825cf-41be-4d02-9de2-928824248c53 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:29.588459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66f825cf-41be-4d02-9de2-928824248c53 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:29.589073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66f825cf-41be-4d02-9de2-928824248c53 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:29.589799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66f825cf-41be-4d02-9de2-928824248c53 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:29.590313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66f825cf-41be-4d02-9de2-928824248c53 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:29.590772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-66f825cf-41be-4d02-9de2-928824248c53 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:29.622324 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-66f825cf-41be-4d02-9de2-928824248c53 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047746 Oct 05 18:19:29.622908 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3356/6467] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 18:19:29 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:19:30.638980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-434bb8d7-1a47-4025-86be-3a8fc9705280 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:30.641501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-434bb8d7-1a47-4025-86be-3a8fc9705280 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:30.648461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434bb8d7-1a47-4025-86be-3a8fc9705280 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:30.648950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434bb8d7-1a47-4025-86be-3a8fc9705280 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:30.649382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434bb8d7-1a47-4025-86be-3a8fc9705280 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:30.650100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434bb8d7-1a47-4025-86be-3a8fc9705280 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:30.650584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434bb8d7-1a47-4025-86be-3a8fc9705280 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:30.651179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-434bb8d7-1a47-4025-86be-3a8fc9705280 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:30.683698 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-434bb8d7-1a47-4025-86be-3a8fc9705280 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050381 Oct 05 18:19:30.684269 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3112/6468] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 18:19:30 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:19:31.696975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c969a2f8-9175-4964-bcd1-139d9340a612 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:31.699404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c969a2f8-9175-4964-bcd1-139d9340a612 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:31.707011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c969a2f8-9175-4964-bcd1-139d9340a612 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:31.707509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c969a2f8-9175-4964-bcd1-139d9340a612 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:31.708092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c969a2f8-9175-4964-bcd1-139d9340a612 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:31.708806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c969a2f8-9175-4964-bcd1-139d9340a612 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:31.709305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c969a2f8-9175-4964-bcd1-139d9340a612 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:31.709716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c969a2f8-9175-4964-bcd1-139d9340a612 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:31.740843 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c969a2f8-9175-4964-bcd1-139d9340a612 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047976 Oct 05 18:19:31.741414 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3357/6469] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 18:19:31 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:19:32.753758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-31934c39-bdad-4d77-8637-13664130f74e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:32.756332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-31934c39-bdad-4d77-8637-13664130f74e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:32.763582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31934c39-bdad-4d77-8637-13664130f74e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:32.764061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31934c39-bdad-4d77-8637-13664130f74e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:32.764487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31934c39-bdad-4d77-8637-13664130f74e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:32.765176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31934c39-bdad-4d77-8637-13664130f74e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:32.765623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31934c39-bdad-4d77-8637-13664130f74e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:32.766038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31934c39-bdad-4d77-8637-13664130f74e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:32.796833 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-31934c39-bdad-4d77-8637-13664130f74e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047220 Oct 05 18:19:32.797395 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3113/6470] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 18:19:32 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:19:33.810058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b442989a-298b-415c-b3ec-42b654e51baa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:33.812353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b442989a-298b-415c-b3ec-42b654e51baa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:33.819840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b442989a-298b-415c-b3ec-42b654e51baa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:33.820338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b442989a-298b-415c-b3ec-42b654e51baa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:33.820782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b442989a-298b-415c-b3ec-42b654e51baa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:33.821482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b442989a-298b-415c-b3ec-42b654e51baa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:33.821944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b442989a-298b-415c-b3ec-42b654e51baa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:33.822404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b442989a-298b-415c-b3ec-42b654e51baa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:33.853978 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b442989a-298b-415c-b3ec-42b654e51baa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048022 Oct 05 18:19:33.854586 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3358/6471] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 18:19:33 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:19:34.870854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e5b1605-9be7-4572-9606-efee79d2dc36 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:34.874352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e5b1605-9be7-4572-9606-efee79d2dc36 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:34.885378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5b1605-9be7-4572-9606-efee79d2dc36 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:34.886045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5b1605-9be7-4572-9606-efee79d2dc36 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:34.886767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5b1605-9be7-4572-9606-efee79d2dc36 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:34.887795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5b1605-9be7-4572-9606-efee79d2dc36 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:34.888407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5b1605-9be7-4572-9606-efee79d2dc36 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:34.889055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5b1605-9be7-4572-9606-efee79d2dc36 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:34.920596 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8e5b1605-9be7-4572-9606-efee79d2dc36 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.056322 Oct 05 18:19:34.921155 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3114/6472] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 18:19:34 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:19:34.985347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-019e1382-6375-461d-8f2f-9de7ba71af0f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:34.985936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-019e1382-6375-461d-8f2f-9de7ba71af0f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:35.001864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019e1382-6375-461d-8f2f-9de7ba71af0f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:35.002551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019e1382-6375-461d-8f2f-9de7ba71af0f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:35.003187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019e1382-6375-461d-8f2f-9de7ba71af0f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:35.004150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019e1382-6375-461d-8f2f-9de7ba71af0f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:35.005066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019e1382-6375-461d-8f2f-9de7ba71af0f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:35.005711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-019e1382-6375-461d-8f2f-9de7ba71af0f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:35.037633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-019e1382-6375-461d-8f2f-9de7ba71af0f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:19:35.122011 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-019e1382-6375-461d-8f2f-9de7ba71af0f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 204 len: 0 microversion: 2.20 time: 0.140267 Oct 05 18:19:35.122632 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3359/6473] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 18:19:34 2022] DELETE /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 05 18:19:35.133291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:35.133898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:35.142978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:35.143461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:35.143899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:35.144612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:35.145065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:35.145489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:35.296130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:35.310724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:35.313239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:35.315037 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-596b6ab4-fa08-40a8-97fa-cab80939e53e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.187807 Oct 05 18:19:35.315604 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3115/6474] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:35 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:36.340777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:36.341508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:36.348885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:36.349386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:36.349839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:36.350581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:36.351050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:36.351494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:36.493445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:36.502450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:36.503913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:36.505109 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0474ba17-bb9d-47a2-a171-fdd2399bf061 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1723 microversion: 2.20 time: 0.168828 Oct 05 18:19:36.505691 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3360/6475] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:36 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:37.535762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:37.536396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:37.543970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:37.544488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:37.544943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:37.545663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:37.546133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:37.546608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:37.592346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5a470875-6f34-406f-ad06-22954e19469e req-3345767a-d3bc-44b3-a0ff-af239c5f0a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6817caff-47c9-4b2d-84b7-a9dae8857506", "name": "network-vif-deleted", "tag": "61e315c5-bd2c-461a-91ae-295c62027458"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:19:37.616643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5a470875-6f34-406f-ad06-22954e19469e req-3345767a-d3bc-44b3-a0ff-af239c5f0a9b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:37.621306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5a470875-6f34-406f-ad06-22954e19469e req-3345767a-d3bc-44b3-a0ff-af239c5f0a9b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:37.622033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5a470875-6f34-406f-ad06-22954e19469e req-3345767a-d3bc-44b3-a0ff-af239c5f0a9b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:37.636818 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5a470875-6f34-406f-ad06-22954e19469e req-3345767a-d3bc-44b3-a0ff-af239c5f0a9b service nova] Creating event network-vif-deleted:61e315c5-bd2c-461a-91ae-295c62027458 for instance 6817caff-47c9-4b2d-84b7-a9dae8857506 on n-h1-835595-3 Oct 05 18:19:37.645161 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5a470875-6f34-406f-ad06-22954e19469e req-3345767a-d3bc-44b3-a0ff-af239c5f0a9b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159432 Oct 05 18:19:37.645997 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3116/6476] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:19:37.649321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:37.662553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:37.667859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:37.669477 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-009d2bd4-f0ce-4aa3-8880-8c4b6cec1c3e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 200 len: 1366 microversion: 2.20 time: 0.137885 Oct 05 18:19:37.670758 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3361/6477] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:37 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 05 18:19:38.696508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:38.697197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:38.704201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:38.704590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:38.705061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:38.705780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:38.706233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:38.706812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:38.721640 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] HTTP exception thrown: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Request method failure captured: Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 HTTP/1.1 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcoj6Ta5ucgNXAjq0rmO7X39CSxo3AvndkjzGSAx3H7PaC5W9isPrrstb3_qYkhaxqF1WJYN5toFgPEQefj9D__sDjlmbWr4PxS6_SpJ_Cy2UXywsTQlcyFCf6cU2JKUXODJdSaqsjxIpAzUvPXGf0tlZHElY6WNGve0jBS8Oh7jIwA Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fa7742f2d110463e89cf009ef444ee34", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}] Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cdda1e58d0a54d4ca1cd772c61c9cbb8 Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '6817caff-47c9-4b2d-84b7-a9dae8857506'} Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:19:38.723362 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Returning 404 to user: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b646ceda-07c7-4001-b901-22223c35c56c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 404 len: 111 microversion: 2.20 time: 0.033584 Oct 05 18:19:38.730501 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3117/6478] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:38 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:19:38.733997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-35385a6f-e9e4-4cbf-9daf-99a033527930 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '.version_select at 0x7f777410dd30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:38.759662 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-35385a6f-e9e4-4cbf-9daf-99a033527930 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-140523625" status: 204 len: 0 microversion: 2.20 time: 0.029084 Oct 05 18:19:38.760263 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3362/6479] 10.222.0.70 () {60 vars in 1259 bytes} [Wed Oct 5 18:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-140523625 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 18:19:39.415125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ac75192c-fd07-4647-a225-0ff6c6d7cb61 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Action: 'create', calling method: .version_select at 0x7f7774354940>, body: {"keypair": {"name": "tempest-keypair-1357672023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCaPJTOpQKyd1Zpnw2PwRjK5u2oWh3x17Fd4izGQFq7hDaWRA7fsJkdYDGLzHEV2KVRhoJTpTR+wLk7J09e6axwnofVG/nxy4HgyawIVjlYzb/leC0g/zlKAf6N18e4CQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:19:39.433544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-ac75192c-fd07-4647-a225-0ff6c6d7cb61 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Getting quotas for project fa7742f2d110463e89cf009ef444ee34. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:19:39.439321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-ac75192c-fd07-4647-a225-0ff6c6d7cb61 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Getting quotas for user cdda1e58d0a54d4ca1cd772c61c9cbb8 and project fa7742f2d110463e89cf009ef444ee34. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:19:39.466238 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ac75192c-fd07-4647-a225-0ff6c6d7cb61 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.057299 Oct 05 18:19:39.466893 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3118/6480] 10.222.0.70 () {62 vars in 1200 bytes} [Wed Oct 5 18:19:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 05 18:19:41.067780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1169528685", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4627fb29-f5f2-4006-8127-af30c1d228f4"}], "security_groups": [{"name": "tempest-securitygroup--745852559"}], "key_name": "tempest-keypair-1357672023", "user_data": "}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:19:41.179355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] validate_networks() for [('4627fb29-f5f2-4006-8127-af30c1d228f4', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:19:41.684463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:19:41.684909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:19:41.685399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:19:41.685825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:19:41.686271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:19:41.695655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:41.696162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:41.696620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:41.697479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:41.697952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:41.698422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:41.716350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Getting quotas for project fa7742f2d110463e89cf009ef444ee34. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:19:41.721885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Getting quotas for user cdda1e58d0a54d4ca1cd772c61c9cbb8 and project fa7742f2d110463e89cf009ef444ee34. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:19:41.735332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:19:41.737782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:19:41.797574 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c6f63da4-5731-431f-b3fd-73f9dba0ac54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.734470 Oct 05 18:19:41.798425 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3363/6481] 10.222.0.70 () {62 vars in 1188 bytes} [Wed Oct 5 18:19:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 05 18:19:41.813247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9e8fc6e-151c-494e-affb-4b458986c198 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:41.814270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b9e8fc6e-151c-494e-affb-4b458986c198 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:41.871751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9e8fc6e-151c-494e-affb-4b458986c198 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:41.879188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9e8fc6e-151c-494e-affb-4b458986c198 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:41.880613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9e8fc6e-151c-494e-affb-4b458986c198 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:41.882067 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9e8fc6e-151c-494e-affb-4b458986c198 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1282 microversion: 2.20 time: 0.074891 Oct 05 18:19:41.882660 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3119/6482] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:41 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:42.907807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:42.908509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:42.915554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:42.916048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:42.916493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:42.917200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:42.917663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:42.918070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:43.026503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:43.035158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:43.036628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:43.037764 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-665ccc55-b5a5-4d66-96d1-0668cfc873cc tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1334 microversion: 2.20 time: 0.134850 Oct 05 18:19:43.038351 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3364/6483] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:42 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1334 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:44.062538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:44.063221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:44.070584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:44.071079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:44.071522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:44.072232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:44.072690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:44.073095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:44.206001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:44.214617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:44.216071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:44.217209 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-08a1b009-6cb9-47ba-9bb6-a76ce824592c tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1407 microversion: 2.20 time: 0.158887 Oct 05 18:19:44.217778 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3120/6484] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:44 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:44.491159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8db0218f-cfdc-4059-9c82-876cc5292ada req-5512d134-0767-4086-aead-8f0cccb4375f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1", "tag": "2266782d-5156-4216-aed1-bf6de579a9ae"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:19:44.502313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8db0218f-cfdc-4059-9c82-876cc5292ada req-5512d134-0767-4086-aead-8f0cccb4375f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:44.502817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8db0218f-cfdc-4059-9c82-876cc5292ada req-5512d134-0767-4086-aead-8f0cccb4375f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:44.503262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8db0218f-cfdc-4059-9c82-876cc5292ada req-5512d134-0767-4086-aead-8f0cccb4375f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:44.515373 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8db0218f-cfdc-4059-9c82-876cc5292ada req-5512d134-0767-4086-aead-8f0cccb4375f service nova] Creating event network-changed:2266782d-5156-4216-aed1-bf6de579a9ae for instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 on n-h2-835595-3 Oct 05 18:19:44.520387 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8db0218f-cfdc-4059-9c82-876cc5292ada req-5512d134-0767-4086-aead-8f0cccb4375f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105318 Oct 05 18:19:44.521160 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3365/6485] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:19:45.243060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:45.243708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:45.252087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:45.252573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:45.253015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:45.253714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:45.254200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:45.254662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:45.391136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:45.399763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:45.401297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:45.402496 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d02cb2ef-6f30-4d94-a282-014e95152394 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1407 microversion: 2.20 time: 0.163925 Oct 05 18:19:45.403079 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3121/6486] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:45 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:46.427925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:46.428531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:46.435859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:46.436351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:46.436767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:46.437469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:46.437932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:46.438394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:46.586353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:46.595356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:46.596861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:46.598001 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-be1ee1e1-15b2-4282-9d34-512757ad1baf tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1407 microversion: 2.20 time: 0.174750 Oct 05 18:19:46.598615 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3366/6487] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:46 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:47.626802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:47.627893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:47.639857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:47.640694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:47.641365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:47.642636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:47.643093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:47.643490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:47.782303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:47.790870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:47.792331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:47.793462 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-39b4d50a-30dd-4e57-bc20-5a6d8a3d46af tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1407 microversion: 2.20 time: 0.173303 Oct 05 18:19:47.794044 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3122/6488] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:47 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:48.770902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-33cf93b7-54fb-463b-a16f-22293ee93ff5 req-898edbed-9ea7-40ab-88de-09f10949eef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1", "name": "network-vif-plugged", "status": "completed", "tag": "2266782d-5156-4216-aed1-bf6de579a9ae"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:19:48.780989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-33cf93b7-54fb-463b-a16f-22293ee93ff5 req-898edbed-9ea7-40ab-88de-09f10949eef8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:48.781490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-33cf93b7-54fb-463b-a16f-22293ee93ff5 req-898edbed-9ea7-40ab-88de-09f10949eef8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:48.781938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-33cf93b7-54fb-463b-a16f-22293ee93ff5 req-898edbed-9ea7-40ab-88de-09f10949eef8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:48.793206 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-33cf93b7-54fb-463b-a16f-22293ee93ff5 req-898edbed-9ea7-40ab-88de-09f10949eef8 service nova] Creating event network-vif-plugged:2266782d-5156-4216-aed1-bf6de579a9ae for instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 on n-h2-835595-3 Oct 05 18:19:48.798073 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-33cf93b7-54fb-463b-a16f-22293ee93ff5 req-898edbed-9ea7-40ab-88de-09f10949eef8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099670 Oct 05 18:19:48.798791 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3367/6489] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:19:48.818582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:48.819228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:48.826403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:48.826902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:48.827342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:48.828043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:48.828500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:48.828932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:48.971520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:48.980147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:48.981568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:48.982707 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fe3a4bb6-d450-41eb-89b2-c520ad62a862 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1407 microversion: 2.20 time: 0.168295 Oct 05 18:19:48.983277 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3123/6490] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:48 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:50.018449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:50.019171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:50.025910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:50.026446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:50.026900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:50.027606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:50.028077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:50.028516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:50.171651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:50.180573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:50.182034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:50.183222 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-79e5c4b5-e5c6-43a7-a080-fc90657c92a4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1407 microversion: 2.20 time: 0.172420 Oct 05 18:19:50.183772 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3368/6491] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:50 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:51.211436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:51.212135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:51.222478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:51.222968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:51.223402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:51.224103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:51.224559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:51.224985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:51.371422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:51.380092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:51.381912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:19:51.383114 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4da48f49-dd81-4d11-93c1-142f93c0f470 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1599 microversion: 2.20 time: 0.177875 Oct 05 18:19:51.383670 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3124/6492] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:19:51 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:19:51.407860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d4ae770a-f4cd-4ad9-afb7-9851d0b8081f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:19:51.408405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d4ae770a-f4cd-4ad9-afb7-9851d0b8081f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:19:51.415655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4ae770a-f4cd-4ad9-afb7-9851d0b8081f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:51.416155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4ae770a-f4cd-4ad9-afb7-9851d0b8081f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:51.416607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4ae770a-f4cd-4ad9-afb7-9851d0b8081f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:51.417314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4ae770a-f4cd-4ad9-afb7-9851d0b8081f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:51.417783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4ae770a-f4cd-4ad9-afb7-9851d0b8081f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:51.418222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4ae770a-f4cd-4ad9-afb7-9851d0b8081f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:51.496554 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d4ae770a-f4cd-4ad9-afb7-9851d0b8081f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092561 Oct 05 18:19:51.497173 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3369/6493] 10.222.0.70 () {60 vars in 1316 bytes} [Wed Oct 5 18:19:51 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:19:52.478292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-27206bbe-24f3-403d-a1c1-18a86c95fd72 req-05738ff4-086d-4283-a454-2c10c58eab17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1", "tag": "2266782d-5156-4216-aed1-bf6de579a9ae"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:19:52.483374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:19:52.489815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-27206bbe-24f3-403d-a1c1-18a86c95fd72 req-05738ff4-086d-4283-a454-2c10c58eab17 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:19:52.490330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-27206bbe-24f3-403d-a1c1-18a86c95fd72 req-05738ff4-086d-4283-a454-2c10c58eab17 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:19:52.490794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-27206bbe-24f3-403d-a1c1-18a86c95fd72 req-05738ff4-086d-4283-a454-2c10c58eab17 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:19:52.502776 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-27206bbe-24f3-403d-a1c1-18a86c95fd72 req-05738ff4-086d-4283-a454-2c10c58eab17 service nova] Creating event network-changed:2266782d-5156-4216-aed1-bf6de579a9ae for instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 on n-h2-835595-3 Oct 05 18:19:52.508333 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-27206bbe-24f3-403d-a1c1-18a86c95fd72 req-05738ff4-086d-4283-a454-2c10c58eab17 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033976 Oct 05 18:19:52.508957 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3125/6494] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:20:28.721087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:20:28.722260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:20:28.724432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:20:28.725407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:20:28.730629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8b4d11fd-3900-463f-a71f-a437b0355623 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:28.731139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8b4d11fd-3900-463f-a71f-a437b0355623 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:28.739881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b4d11fd-3900-463f-a71f-a437b0355623 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:28.740440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b4d11fd-3900-463f-a71f-a437b0355623 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:28.740958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b4d11fd-3900-463f-a71f-a437b0355623 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:28.741697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b4d11fd-3900-463f-a71f-a437b0355623 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:28.742273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b4d11fd-3900-463f-a71f-a437b0355623 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:28.742734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b4d11fd-3900-463f-a71f-a437b0355623 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:28.770215 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8b4d11fd-3900-463f-a71f-a437b0355623 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/ips" status: 200 len: 151 microversion: 2.20 time: 0.050576 Oct 05 18:20:28.771318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3370/6495] 10.222.0.70 () {60 vars in 1289 bytes} [Wed Oct 5 18:20:28 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/ips => generated 151 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:20:30.568932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:20:30.569714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:20:30.574811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3def80b6-7704-4085-83ab-08e7aaebf4d9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:20:30.575441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3def80b6-7704-4085-83ab-08e7aaebf4d9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:30.583927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3def80b6-7704-4085-83ab-08e7aaebf4d9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:30.584420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3def80b6-7704-4085-83ab-08e7aaebf4d9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:30.584879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3def80b6-7704-4085-83ab-08e7aaebf4d9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:30.585580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3def80b6-7704-4085-83ab-08e7aaebf4d9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:30.586038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3def80b6-7704-4085-83ab-08e7aaebf4d9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:30.586494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3def80b6-7704-4085-83ab-08e7aaebf4d9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:30.610687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-3def80b6-7704-4085-83ab-08e7aaebf4d9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lazy-loading 'flavor' on Instance uuid b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:20:30.805747 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3def80b6-7704-4085-83ab-08e7aaebf4d9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "POST /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/action" status: 202 len: 0 microversion: 2.20 time: 0.238767 Oct 05 18:20:30.806386 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3126/6496] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 18:20:30 2022] POST /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:20:30.815616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:30.816302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:30.824499 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:30.825101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:30.825670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:30.827064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:30.827545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:30.827984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:30.970324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:30.979222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:30.980680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:30.981883 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae06084a-53e6-4241-851e-b88e376192a9 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.170591 Oct 05 18:20:30.982475 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3371/6497] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:30 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:32.012292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:32.013250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:32.022411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:32.022899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:32.023336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:32.024035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:32.024496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:32.024923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:32.159659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:32.168323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:32.169751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:32.170973 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d23f491-acf6-4b11-9517-8e58d0a47d83 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.166345 Oct 05 18:20:32.171547 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3127/6498] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:32 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:33.199207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:33.199843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:33.208951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:33.209517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:33.210024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:33.211128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:33.211818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:33.212439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:33.346361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:33.354854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:33.356297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:33.357475 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ba3b8700-352b-4fcd-9ee7-9b1837dce8da tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.164597 Oct 05 18:20:33.358041 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3372/6499] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:33 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:34.385095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:34.385835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:34.395063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:34.395551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:34.395982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:34.396676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:34.397132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:34.397559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:34.537431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:34.550155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:34.552455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:34.554107 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-19eecdd1-62cd-4a5f-abcd-286e67d58fd1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.174520 Oct 05 18:20:34.554957 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3128/6500] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:34 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:35.585590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:35.586293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:35.597050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:35.598108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:35.598735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:35.599745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:35.600416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:35.601015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:35.748025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:35.757112 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:35.758686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:35.759891 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25cc5063-c775-456b-b0f9-06149f407ccb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.179128 Oct 05 18:20:35.760456 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3373/6501] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:35 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:36.791888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:36.792905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:36.804436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:36.805276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:36.806039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:36.808533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:36.808533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:36.809226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:36.944218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:36.952470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:36.953915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:36.955107 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-acfcebda-5697-45f0-be1d-5af399671959 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.169882 Oct 05 18:20:36.955668 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3129/6502] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:36 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:37.980747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:37.981387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:37.988713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:37.989222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:37.989674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:37.990419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:37.990895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:37.991336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:38.131354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:38.140528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:38.141998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:38.143377 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f1d05dd-cece-4ac4-aca6-dfcc38f44c0a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.166639 Oct 05 18:20:38.143908 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3374/6503] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:37 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:39.169659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:39.170269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:39.178232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:39.178751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:39.179183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:39.179872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:39.180321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:39.180735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:39.327447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:39.339508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:39.341705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:39.343534 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0d1ad382-a93c-4951-b014-5a516904eeaa tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.177877 Oct 05 18:20:39.344351 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3130/6504] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:39 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:40.377189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:40.378313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:40.390583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:40.391431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:40.392219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:40.393125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:40.393604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:40.394047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:40.528616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:40.537174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:40.538673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:40.539866 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-31199416-de01-49dc-accf-fb386aaee94f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.169645 Oct 05 18:20:40.540446 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3375/6505] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:40 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:41.569503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:41.570459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:41.581403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:41.581887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:41.582328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:41.583038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:41.583487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:41.583907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:41.745520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:41.758958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:41.761169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:41.763019 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8e5ac20a-75e3-432b-b498-8edbfdba3710 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1744 microversion: 2.20 time: 0.199798 Oct 05 18:20:41.763754 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3131/6506] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:41 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1744 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:42.791423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:42.792216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:42.800620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:42.801212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:42.801746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:42.802623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:42.803180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:42.803696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:42.948770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:42.959123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:42.960960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:42.964486 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-776595cf-c3d0-48a4-8a09-eaf324b9a4e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1744 microversion: 2.20 time: 0.177835 Oct 05 18:20:42.965567 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3376/6507] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:42 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:43.989673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:43.991174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:44.001069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:44.001554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:44.001980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:44.002848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:44.003470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:44.004082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:44.160957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:44.169250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:44.170700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:44.172144 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-58c52662-7c0f-47fe-9a0d-463b849de011 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1739 microversion: 2.20 time: 0.186588 Oct 05 18:20:44.173204 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3132/6508] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:43 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:44.982879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e32cd466-ca0d-4d2f-82a0-bf55aec4ec04 req-11286216-78e3-491b-b33f-c9662fd82876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1", "name": "network-vif-plugged", "status": "completed", "tag": "2266782d-5156-4216-aed1-bf6de579a9ae"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:20:45.004681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e32cd466-ca0d-4d2f-82a0-bf55aec4ec04 req-11286216-78e3-491b-b33f-c9662fd82876 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:45.006199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e32cd466-ca0d-4d2f-82a0-bf55aec4ec04 req-11286216-78e3-491b-b33f-c9662fd82876 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:45.007313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e32cd466-ca0d-4d2f-82a0-bf55aec4ec04 req-11286216-78e3-491b-b33f-c9662fd82876 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:45.021274 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e32cd466-ca0d-4d2f-82a0-bf55aec4ec04 req-11286216-78e3-491b-b33f-c9662fd82876 service nova] Creating event network-vif-plugged:2266782d-5156-4216-aed1-bf6de579a9ae for instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 on n-h2-835595-3 Oct 05 18:20:45.028517 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e32cd466-ca0d-4d2f-82a0-bf55aec4ec04 req-11286216-78e3-491b-b33f-c9662fd82876 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050558 Oct 05 18:20:45.029905 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3377/6509] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:20:45.201300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:45.202836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:45.211989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:45.212550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:45.213180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:45.214099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:45.214561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:45.215002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:45.369729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:45.378830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:45.380304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:45.381496 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7bd40faf-f61c-4787-a88f-5c861eea5230 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1739 microversion: 2.20 time: 0.184922 Oct 05 18:20:45.382725 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3133/6510] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:45 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:46.408254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:46.408945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:46.415789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:46.416506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:46.417162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:46.420284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:46.420757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:46.421218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:46.568766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:46.578461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:46.580330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:46.581652 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-81b3935c-7f4d-44a5-b2a1-4c8afa0d9131 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1739 microversion: 2.20 time: 0.178895 Oct 05 18:20:46.582324 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3378/6511] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:46 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:47.607124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:47.608547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:47.616042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:47.616531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:47.616962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:47.617637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:47.618089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:47.618542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:47.781339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:47.792219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:47.793645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:47.795205 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-08d4d65e-13ab-41f8-8f3f-a176697b2db0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1739 microversion: 2.20 time: 0.191975 Oct 05 18:20:47.796109 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3134/6512] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:47 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:48.822392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:48.823659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:48.833139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:48.834018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:48.834485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:48.835207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:48.835905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:48.836681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:48.994616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:49.003664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:49.006526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:49.008504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b68d3eb9-7662-44f4-b32c-af4cc28458db tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1739 microversion: 2.20 time: 0.191401 Oct 05 18:20:49.009077 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3379/6513] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:48 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:50.033297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:50.034919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:50.042599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:50.043316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:50.043805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:50.044586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:50.045260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:50.045902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:50.194320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:50.203393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:50.205256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:50.206869 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0d7f68a0-4487-4b76-b881-cded9a09983d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1739 microversion: 2.20 time: 0.177643 Oct 05 18:20:50.216171 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3135/6514] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:50 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:51.232905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:51.234259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:51.242236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:51.242800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:51.243257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:51.243994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:51.244479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:51.244924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:51.413704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:51.422351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:51.423904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:51.425097 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88c52054-92e6-419c-83db-ec1232197896 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1739 microversion: 2.20 time: 0.196363 Oct 05 18:20:51.425665 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3380/6515] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:51 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:52.454608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:52.455693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:52.469474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:52.470305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:52.470925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:52.471624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:52.472075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:52.472505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:52.609716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:52.622026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:52.624221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:52.626007 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-857b93d5-83c4-4002-8d44-7428f0fa6121 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1739 microversion: 2.20 time: 0.177860 Oct 05 18:20:52.626934 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3136/6516] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:52 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:53.656030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:53.656923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:53.668593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:53.669439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:53.670189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:53.671452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:53.672290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:53.672988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:53.818074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:53.829489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:53.831229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:53.832465 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5d3031d-5478-4047-9772-c37c13bf19a0 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1721 microversion: 2.20 time: 0.183215 Oct 05 18:20:53.833052 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3381/6517] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:53 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1721 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:54.858946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:54.859584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:54.871280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:54.871987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:54.872320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:54.873045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:54.873496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:54.873930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:55.012827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:55.025346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:55.027556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:55.029348 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b26cc206-3bbb-4a2a-a179-cbd9d09a649b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1724 microversion: 2.20 time: 0.174116 Oct 05 18:20:55.030026 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3137/6518] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:54 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:55.057059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90349125-7c17-4ce0-963e-5a3699469d34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "767b4f64-2357-442e-a494-e14f8133240f"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:20:55.059726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90349125-7c17-4ce0-963e-5a3699469d34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:55.069057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90349125-7c17-4ce0-963e-5a3699469d34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:55.069756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90349125-7c17-4ce0-963e-5a3699469d34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:55.070385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90349125-7c17-4ce0-963e-5a3699469d34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:55.071412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90349125-7c17-4ce0-963e-5a3699469d34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:55.072096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90349125-7c17-4ce0-963e-5a3699469d34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:55.072655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90349125-7c17-4ce0-963e-5a3699469d34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:55.357744 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90349125-7c17-4ce0-963e-5a3699469d34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "POST /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307140 Oct 05 18:20:55.358493 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3382/6519] 10.222.0.70 () {62 vars in 1364 bytes} [Wed Oct 5 18:20:55 2022] POST /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 05 18:20:55.487666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-34563666-d967-42f2-a761-5614f50bb1d5 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:55.488157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-34563666-d967-42f2-a761-5614f50bb1d5 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:55.494305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34563666-d967-42f2-a761-5614f50bb1d5 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:55.494804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34563666-d967-42f2-a761-5614f50bb1d5 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:55.495234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34563666-d967-42f2-a761-5614f50bb1d5 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:55.495913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34563666-d967-42f2-a761-5614f50bb1d5 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:55.496361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34563666-d967-42f2-a761-5614f50bb1d5 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:55.496843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34563666-d967-42f2-a761-5614f50bb1d5 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:55.706473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:20:55.727596 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-34563666-d967-42f2-a761-5614f50bb1d5 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/os-volume_attachments/767b4f64-2357-442e-a494-e14f8133240f" status: 202 len: 0 microversion: 2.20 time: 0.244033 Oct 05 18:20:55.728208 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3138/6520] 10.222.0.70 () {60 vars in 1457 bytes} [Wed Oct 5 18:20:55 2022] DELETE /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/os-volume_attachments/767b4f64-2357-442e-a494-e14f8133240f => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:20:55.789408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e8b1514-507e-4960-bcf3-58ffe65dbf52 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:20:55.790049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e8b1514-507e-4960-bcf3-58ffe65dbf52 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:55.796677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8b1514-507e-4960-bcf3-58ffe65dbf52 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:55.797182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8b1514-507e-4960-bcf3-58ffe65dbf52 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:55.797633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8b1514-507e-4960-bcf3-58ffe65dbf52 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:55.798369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8b1514-507e-4960-bcf3-58ffe65dbf52 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:55.798919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8b1514-507e-4960-bcf3-58ffe65dbf52 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:55.799364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e8b1514-507e-4960-bcf3-58ffe65dbf52 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:55.829716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e8b1514-507e-4960-bcf3-58ffe65dbf52 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128844) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 18:20:55.889547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:20:55.905012 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e8b1514-507e-4960-bcf3-58ffe65dbf52 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "POST /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/action" status: 202 len: 0 microversion: 2.20 time: 0.119585 Oct 05 18:20:55.905808 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3383/6521] 10.222.0.70 () {62 vars in 1319 bytes} [Wed Oct 5 18:20:55 2022] POST /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:20:55.914065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:55.914717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:55.922590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:55.923081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:55.923557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:55.924261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:55.924713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:55.925138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:56.064716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:56.073613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:56.075154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:56.076328 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f6abfac8-3a6a-4fd7-a728-09b201aac887 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1672 microversion: 2.20 time: 0.166383 Oct 05 18:20:56.076939 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3139/6522] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:55 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1672 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:56.990383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-279dbfb9-45b0-4a26-851f-9109f88dce92 req-862fe50b-13ed-4aba-ae36-3167b58bf7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1", "name": "network-vif-unplugged", "status": "completed", "tag": "2266782d-5156-4216-aed1-bf6de579a9ae"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:20:57.001952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-279dbfb9-45b0-4a26-851f-9109f88dce92 req-862fe50b-13ed-4aba-ae36-3167b58bf7d1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:57.002493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-279dbfb9-45b0-4a26-851f-9109f88dce92 req-862fe50b-13ed-4aba-ae36-3167b58bf7d1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:57.002946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-279dbfb9-45b0-4a26-851f-9109f88dce92 req-862fe50b-13ed-4aba-ae36-3167b58bf7d1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:57.014200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.server_external_events [req-279dbfb9-45b0-4a26-851f-9109f88dce92 req-862fe50b-13ed-4aba-ae36-3167b58bf7d1 service nova] Unable to find a host for instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1. Dropping event network-vif-unplugged {{(pid=128844) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 18:20:57.015166 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-279dbfb9-45b0-4a26-851f-9109f88dce92 req-862fe50b-13ed-4aba-ae36-3167b58bf7d1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029745 Oct 05 18:20:57.015752 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3384/6523] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 18:20:57.113243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:57.114728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:57.122571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:57.123042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:57.123475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:57.124193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:57.124651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:57.125244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:57.283348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:57.291661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:57.293165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:57.294449 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b7de7a20-4f5c-4233-b4bb-d4783b76f6ff tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1672 microversion: 2.20 time: 0.185071 Oct 05 18:20:57.295112 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3140/6524] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:57 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:58.323261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:58.324384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:58.333786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:58.334312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:58.334785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:58.335506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:58.335980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:58.336424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:58.473390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:58.482031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:58.483510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:58.484683 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c58186cb-0ec8-4fc7-987f-f387ffb21f7f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1672 microversion: 2.20 time: 0.168215 Oct 05 18:20:58.485252 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3385/6525] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:58 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:20:59.510858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:20:59.511448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:20:59.518531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:59.519061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:59.519499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:59.520212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:20:59.520673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:20:59.521103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:20:59.798933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:59.807669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:59.809099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:20:59.810308 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-516a83eb-f95d-4594-9d23-be9d97ffa16a tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.303938 Oct 05 18:20:59.810934 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3141/6526] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:20:59 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:00.088557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ebc1cbdf-e079-41ad-8913-40f976be728f req-7ce014d7-7890-4c67-a424-ecb0482a8507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1", "tag": "2266782d-5156-4216-aed1-bf6de579a9ae"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:21:00.100549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ebc1cbdf-e079-41ad-8913-40f976be728f req-7ce014d7-7890-4c67-a424-ecb0482a8507 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:00.101164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ebc1cbdf-e079-41ad-8913-40f976be728f req-7ce014d7-7890-4c67-a424-ecb0482a8507 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:00.101687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ebc1cbdf-e079-41ad-8913-40f976be728f req-7ce014d7-7890-4c67-a424-ecb0482a8507 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:00.113532 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ebc1cbdf-e079-41ad-8913-40f976be728f req-7ce014d7-7890-4c67-a424-ecb0482a8507 service nova] Creating event network-changed:2266782d-5156-4216-aed1-bf6de579a9ae for instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 on n-h1-835595-3 Oct 05 18:21:00.119051 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ebc1cbdf-e079-41ad-8913-40f976be728f req-7ce014d7-7890-4c67-a424-ecb0482a8507 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034275 Oct 05 18:21:00.120006 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3386/6527] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:21:00.836290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:00.836839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:00.839376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=33 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:21:00.844975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:00.845560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:00.845991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:00.846717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:00.847161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:00.847565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:01.006670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:01.015656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:01.017224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:01.018722 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-921b5624-fe4b-4f60-b433-5898726bdcc7 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.186379 Oct 05 18:21:01.019294 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3142/6528] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:00 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:02.046003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:02.046755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:02.049855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:21:02.056190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:02.056698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:02.057150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:02.057874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:02.058367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:02.058810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:02.213900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:02.222668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:02.224142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:02.225363 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f1ffa1c-3a9b-4dac-b5e6-fabd3770b83b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.183699 Oct 05 18:21:02.226335 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3387/6529] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:02 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:03.250847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:03.251558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:03.259081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:03.259576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:03.260015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:03.260724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:03.261186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:03.261616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:03.407883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:03.419114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:03.420563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:03.421764 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4c41441e-a476-4880-9156-6bb10a1b6692 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.174939 Oct 05 18:21:03.422556 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3143/6530] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:03 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:04.448276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:04.449788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:04.457174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:04.457701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:04.458127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:04.458869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:04.459517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:04.459954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:04.598734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:04.607743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:04.609322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:04.610634 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7940fd06-8f80-4012-a604-0e7b11973f54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.166479 Oct 05 18:21:04.611339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3388/6531] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:04 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:05.636475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:05.638811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:05.646828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:05.647325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:05.647799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:05.648511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:05.649149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:05.649584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:05.791093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:05.801147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:05.802612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:05.803835 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa55478d-8090-4b41-8329-f349d19132fd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.171874 Oct 05 18:21:05.804593 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3144/6532] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:05 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:06.829256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:06.829917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:06.837248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:06.837748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:06.838197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:06.838944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:06.839415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:06.839860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:06.992453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:07.015136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:07.016813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:07.018373 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6569f7ee-35be-412c-9b47-d15ff93f789b tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.193105 Oct 05 18:21:07.019223 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3389/6533] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:06 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:08.048415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:08.048415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:08.053821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:08.054822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:08.054822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:08.055855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:08.056397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:08.056913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:08.203628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:08.220689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:08.222167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:08.223444 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f1ac3789-6879-4900-be92-35a14eadb296 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.183309 Oct 05 18:21:08.236859 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3145/6534] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:08 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:09.253281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:09.254023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:09.262861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:09.263474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:09.264011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:09.264909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:09.265447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:09.266019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:09.403546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:09.411893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:09.413404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:09.414625 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63e2c583-77a8-4aa7-8baf-d7309050ef34 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.166715 Oct 05 18:21:09.415243 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3390/6535] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:09 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:10.442268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:10.442922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:10.450408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:10.450872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:10.451319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:10.451990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:10.452435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:10.452854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:10.595400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:10.604230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:10.605659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:10.606856 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2ff2ef31-ae0a-485d-abf6-5fd38e6e9366 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.169408 Oct 05 18:21:10.607421 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3146/6536] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:10 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:11.635208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:11.636181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:11.645549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:11.646055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:11.646554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:11.647266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:11.647739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:11.648181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:11.787066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:11.795430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:11.796896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:11.798093 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b52a7dd3-5d73-42af-bb9f-bc6105c85b54 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.169615 Oct 05 18:21:11.798753 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3391/6537] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:11 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:12.832894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:12.833519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:12.840654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:12.841145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:12.841583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:12.842309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:12.842779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:12.843208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:12.983092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:12.995068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:12.997226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:12.999053 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1af8adda-e186-4f9f-b33e-528b5849f481 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.169801 Oct 05 18:21:12.999863 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3147/6538] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:12 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:14.025459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:14.026078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:14.033302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:14.033788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:14.034242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:14.034957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:14.035423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:14.035853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:14.174993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:14.183510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:14.185333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:14.186631 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4faeb854-1959-4ffc-9df8-d5caf709c3e4 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.165190 Oct 05 18:21:14.187185 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3392/6539] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:14 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:14.246455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d261809e-1d6e-42b1-b644-8e7e3e9398a5 req-8bdf391a-848c-427d-9793-b8d1dbbea203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1", "name": "network-vif-plugged", "status": "completed", "tag": "2266782d-5156-4216-aed1-bf6de579a9ae"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:21:14.258351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d261809e-1d6e-42b1-b644-8e7e3e9398a5 req-8bdf391a-848c-427d-9793-b8d1dbbea203 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:14.258787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d261809e-1d6e-42b1-b644-8e7e3e9398a5 req-8bdf391a-848c-427d-9793-b8d1dbbea203 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:14.259940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d261809e-1d6e-42b1-b644-8e7e3e9398a5 req-8bdf391a-848c-427d-9793-b8d1dbbea203 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:14.271737 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d261809e-1d6e-42b1-b644-8e7e3e9398a5 req-8bdf391a-848c-427d-9793-b8d1dbbea203 service nova] Creating event network-vif-plugged:2266782d-5156-4216-aed1-bf6de579a9ae for instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 on n-h1-835595-3 Oct 05 18:21:14.277400 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d261809e-1d6e-42b1-b644-8e7e3e9398a5 req-8bdf391a-848c-427d-9793-b8d1dbbea203 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034726 Oct 05 18:21:14.278371 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3148/6540] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:21:15.217926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:15.218918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:15.227002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:15.227504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:15.227953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:15.228671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:15.229144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:15.229584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:15.364179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:15.377065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:15.379385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:15.381188 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d14a248-2bbe-4c8e-aa48-777d02c7ba8f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1730 microversion: 2.20 time: 0.169556 Oct 05 18:21:15.382860 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3393/6541] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:15 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:16.411657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:16.412323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:16.419151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:16.419568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:16.419999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:16.420682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:16.421135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:16.421551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:16.568739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:16.581108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:16.583212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:16.584984 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8ac7bfe-ac2c-4a1f-b367-b2f68ab6f37f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1717 microversion: 2.20 time: 0.179518 Oct 05 18:21:16.585730 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3149/6542] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:16 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1717 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:48.439852 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ae72357b-5709-49f8-aedb-d52bd8a53356 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:48.442081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ae72357b-5709-49f8-aedb-d52bd8a53356 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:48.444329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=13 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:21:48.444997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=52 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:21:48.451820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae72357b-5709-49f8-aedb-d52bd8a53356 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:48.452321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae72357b-5709-49f8-aedb-d52bd8a53356 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:48.452770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae72357b-5709-49f8-aedb-d52bd8a53356 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:48.453473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae72357b-5709-49f8-aedb-d52bd8a53356 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:48.454066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae72357b-5709-49f8-aedb-d52bd8a53356 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:48.454533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ae72357b-5709-49f8-aedb-d52bd8a53356 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:48.484213 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ae72357b-5709-49f8-aedb-d52bd8a53356 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048617 Oct 05 18:21:48.484771 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3394/6543] 10.222.0.70 () {60 vars in 1343 bytes} [Wed Oct 5 18:21:48 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:21:48.558199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9671e68e-3266-4a7d-ba9a-f0c05d288c16 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:48.558755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9671e68e-3266-4a7d-ba9a-f0c05d288c16 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:48.561211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=15 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:21:48.561876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:21:48.571031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9671e68e-3266-4a7d-ba9a-f0c05d288c16 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:48.572000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9671e68e-3266-4a7d-ba9a-f0c05d288c16 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:48.572775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9671e68e-3266-4a7d-ba9a-f0c05d288c16 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:48.573936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9671e68e-3266-4a7d-ba9a-f0c05d288c16 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:48.574734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9671e68e-3266-4a7d-ba9a-f0c05d288c16 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:48.575429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9671e68e-3266-4a7d-ba9a-f0c05d288c16 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:48.603303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9671e68e-3266-4a7d-ba9a-f0c05d288c16 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:21:48.691876 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9671e68e-3266-4a7d-ba9a-f0c05d288c16 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 204 len: 0 microversion: 2.20 time: 0.137298 Oct 05 18:21:48.692442 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3150/6544] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 18:21:48 2022] DELETE /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 18:21:48.701201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:48.701808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:48.707946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:48.708467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:48.709001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:48.709644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:48.710109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:48.710580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:48.847994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:48.856524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:48.857988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:48.859257 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-275143aa-c470-4c64-a3d6-f0b2a2a2a27f tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.162169 Oct 05 18:21:48.859827 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3395/6545] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:48 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:49.886112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:49.886867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:49.894452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:49.894972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:49.895408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:49.896107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:49.896556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:49.896968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:50.084936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:50.093779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:50.095377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:50.096560 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7d9becf7-e64f-4136-99e0-da851c980fcb tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1723 microversion: 2.20 time: 0.215229 Oct 05 18:21:50.097133 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3151/6546] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:49 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:50.877664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3a3fb9d1-84ac-4555-897b-ba6f71887fcb req-7294e4eb-2c01-426a-b1fa-5b51acc28de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1", "name": "network-vif-deleted", "tag": "2266782d-5156-4216-aed1-bf6de579a9ae"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:21:50.888921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3a3fb9d1-84ac-4555-897b-ba6f71887fcb req-7294e4eb-2c01-426a-b1fa-5b51acc28de0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:50.889408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3a3fb9d1-84ac-4555-897b-ba6f71887fcb req-7294e4eb-2c01-426a-b1fa-5b51acc28de0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:50.889853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3a3fb9d1-84ac-4555-897b-ba6f71887fcb req-7294e4eb-2c01-426a-b1fa-5b51acc28de0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:50.903679 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3a3fb9d1-84ac-4555-897b-ba6f71887fcb req-7294e4eb-2c01-426a-b1fa-5b51acc28de0 service nova] Creating event network-vif-deleted:2266782d-5156-4216-aed1-bf6de579a9ae for instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 on n-h1-835595-3 Oct 05 18:21:50.910057 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3a3fb9d1-84ac-4555-897b-ba6f71887fcb req-7294e4eb-2c01-426a-b1fa-5b51acc28de0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035679 Oct 05 18:21:50.910345 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3396/6547] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:21:51.123187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:51.123934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:51.131482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:51.132035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:51.132837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:51.133603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:51.134420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:51.134665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:51.165689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:51.166170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:51.166644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:51.167090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lazy-loading 'fault' on Instance uuid b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:21:51.208040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:51.216555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:51.217994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cdda1e58d0a54d4ca1cd772c61c9cbb8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa7742f2d110463e89cf009ef444ee34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:21:51.219179 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5294c82c-b86f-403d-b059-4d2098a7568d tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 200 len: 1372 microversion: 2.20 time: 0.100097 Oct 05 18:21:51.219810 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3152/6548] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:51 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 05 18:21:52.248192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:52.248978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:52.257495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:52.258154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:52.258767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:52.259659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:52.260295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:52.260850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:52.275809 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] HTTP exception thrown: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Request method failure captured: Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 HTTP/1.1 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcoj6Ta5ucgNXAjq0rmO7X39CSxo3AvndkjzGSAx3H7PaC5W9isPrrstb3_qYkhaxqF1WJYN5toFgPEQefj9D__sDjlmbWr4PxS6_SpJ_Cy2UXywsTQlcyFCf6cU2JKUXODJdSaqsjxIpAzUvPXGf0tlZHElY6WNGve0jBS8Oh7jIwA Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fa7742f2d110463e89cf009ef444ee34", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}] Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: cdda1e58d0a54d4ca1cd772c61c9cbb8 Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1'} Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:52.277448 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Returning 404 to user: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0e56649a-3004-4e7e-b4e8-f5d2733de3e1 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 404 len: 111 microversion: 2.20 time: 0.037382 Oct 05 18:21:52.283143 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3397/6549] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:52 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:21:52.287974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e9d71d0b-e19f-47d3-ab9c-4a441ac83c21 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '.version_select at 0x7f77742ee940>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:52.308376 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e9d71d0b-e19f-47d3-ab9c-4a441ac83c21 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357672023" status: 204 len: 0 microversion: 2.20 time: 0.024421 Oct 05 18:21:52.308934 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3153/6550] 10.222.0.70 () {60 vars in 1262 bytes} [Wed Oct 5 18:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357672023 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 05 18:21:55.161730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:55.162350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:55.169614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:55.170113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:55.170604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:55.171315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:55.171785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:55.172227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:55.186330 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] HTTP exception thrown: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Request method failure captured: Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 HTTP/1.1 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcoj6Ta5ucgNXAjq0rmO7X39CSxo3AvndkjzGSAx3H7PaC5W9isPrrstb3_qYkhaxqF1WJYN5toFgPEQefj9D__sDjlmbWr4PxS6_SpJ_Cy2UXywsTQlcyFCf6cU2JKUXODJdSaqsjxIpAzUvPXGf0tlZHElY6WNGve0jBS8Oh7jIwA Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fa7742f2d110463e89cf009ef444ee34", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}] Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: cdda1e58d0a54d4ca1cd772c61c9cbb8 Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1'} Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:21:55.187961 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Returning 404 to user: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-157d5361-f137-4458-ab7e-81bfcc6beb0e tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "DELETE /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 404 len: 111 microversion: 2.20 time: 0.031698 Oct 05 18:21:55.192885 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3398/6551] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 18:21:55 2022] DELETE /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:21:55.199571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:55.200175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:55.207089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:55.207575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:55.208006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:55.208729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:55.209177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:55.209598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:55.224350 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] HTTP exception thrown: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Request method failure captured: Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 HTTP/1.1 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcoj6Ta5ucgNXAjq0rmO7X39CSxo3AvndkjzGSAx3H7PaC5W9isPrrstb3_qYkhaxqF1WJYN5toFgPEQefj9D__sDjlmbWr4PxS6_SpJ_Cy2UXywsTQlcyFCf6cU2JKUXODJdSaqsjxIpAzUvPXGf0tlZHElY6WNGve0jBS8Oh7jIwA Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fa7742f2d110463e89cf009ef444ee34", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}] Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cdda1e58d0a54d4ca1cd772c61c9cbb8 Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1'} Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:21:55.226045 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Returning 404 to user: Instance b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5c2c0598-c048-4b91-9938-daa6b16b12d3 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1" status: 404 len: 111 microversion: 2.20 time: 0.033112 Oct 05 18:21:55.232942 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3154/6552] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:55 2022] GET /compute/v2.1/servers/b78b4cb4-17b2-4fed-8b05-c14ebc8ff7c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:21:58.487827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:58.488477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:58.495864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:58.496456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:58.496983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:58.497775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:58.498344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:58.498866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:58.513188 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] HTTP exception thrown: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Request method failure captured: Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 HTTP/1.1 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPcoj6Ta5ucgNXAjq0rmO7X39CSxo3AvndkjzGSAx3H7PaC5W9isPrrstb3_qYkhaxqF1WJYN5toFgPEQefj9D__sDjlmbWr4PxS6_SpJ_Cy2UXywsTQlcyFCf6cU2JKUXODJdSaqsjxIpAzUvPXGf0tlZHElY6WNGve0jBS8Oh7jIwA Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fa7742f2d110463e89cf009ef444ee34", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}] Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: cdda1e58d0a54d4ca1cd772c61c9cbb8 Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '6817caff-47c9-4b2d-84b7-a9dae8857506'} Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:21:58.514827 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Returning 404 to user: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3223c0da-813a-45d9-8134-bac19c517918 tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 404 len: 111 microversion: 2.20 time: 0.032552 Oct 05 18:21:58.519581 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3399/6553] 10.222.0.70 () {60 vars in 1280 bytes} [Wed Oct 5 18:21:58 2022] DELETE /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:21:58.525015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:21:58.525626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] [instance: 6817caff-47c9-4b2d-84b7-a9dae8857506] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:21:58.532567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:58.533047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:58.533483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:58.534171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:21:58.534655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:21:58.535079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:21:58.548493 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] HTTP exception thrown: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Request method failure captured: Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 HTTP/1.1 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPcoj6Ta5ucgNXAjq0rmO7X39CSxo3AvndkjzGSAx3H7PaC5W9isPrrstb3_qYkhaxqF1WJYN5toFgPEQefj9D__sDjlmbWr4PxS6_SpJ_Cy2UXywsTQlcyFCf6cU2JKUXODJdSaqsjxIpAzUvPXGf0tlZHElY6WNGve0jBS8Oh7jIwA Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Openstack-Nova-Api-Version: 2.20 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fa7742f2d110463e89cf009ef444ee34", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fa7742f2d110463e89cf009ef444ee34"}]}] Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fa7742f2d110463e89cf009ef444ee34 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-645300880 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cdda1e58d0a54d4ca1cd772c61c9cbb8 Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-645300880-project Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '6817caff-47c9-4b2d-84b7-a9dae8857506'} Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:21:58.550013 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] Returning 404 to user: Instance 6817caff-47c9-4b2d-84b7-a9dae8857506 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9a0da221-8d3b-4cca-aa14-9224fe96d0bd tempest-AttachVolumeShelveTestJSON-645300880 tempest-AttachVolumeShelveTestJSON-645300880-project] 10.222.0.70 "GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506" status: 404 len: 111 microversion: 2.20 time: 0.030417 Oct 05 18:21:58.555566 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3155/6554] 10.222.0.70 () {60 vars in 1277 bytes} [Wed Oct 5 18:21:58 2022] GET /compute/v2.1/servers/6817caff-47c9-4b2d-84b7-a9dae8857506 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:22:07.469094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b1165ca-ddf4-4444-937e-473138955d9b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: .version_select at 0x7f7779465310>, body: {"keypair": {"name": "tempest-keypair-2145591794", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLPsgo/AQE4Y5kqOKzB2k9HMvHkVyi8ag1oSQCOSUIEN/DLKFekH3894bJ9hDsLNDVefmNOtfGLg+T60jOvsmXDRw7QdXQrlvwXS/QFGSiZWFj5COwyDH/oCqBDUmE6sA=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:22:07.486399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-3b1165ca-ddf4-4444-937e-473138955d9b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for project 182080e008ca451c81350a9cad4d970e. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:22:07.492920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-3b1165ca-ddf4-4444-937e-473138955d9b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for user dcf412de18ab4d64aff7c7514bf0eaba and project 182080e008ca451c81350a9cad4d970e. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:22:07.508742 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3b1165ca-ddf4-4444-937e-473138955d9b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [6a13e436-ee33-426c-b4c8-8f7d5ba6e4d5] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 18:22:08.504846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=20 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:22:08.516296 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [None req-3b1165ca-ddf4-4444-937e-473138955d9b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [6a13e436-ee33-426c-b4c8-8f7d5ba6e4d5] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 59104. Oct 05 18:22:08.533688 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b1165ca-ddf4-4444-937e-473138955d9b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.235492 Oct 05 18:22:08.534333 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3400/6555] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:22:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:22:09.854863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-7126700", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "417dd8ea-4fbe-437f-bb37-c563f90ec1cc"}], "security_groups": [{"name": "tempest-securitygroup--344073188"}], "key_name": "tempest-keypair-2145591794", "user_data": "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:22:09.864689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:22:09.865536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:22:09.970057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] validate_networks() for [('417dd8ea-4fbe-437f-bb37-c563f90ec1cc', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:22:10.410109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:22:10.410569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:22:10.411052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:22:10.411455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:22:10.411864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:22:10.421329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:10.421813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:10.422296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:10.423057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:10.423497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:10.423922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:10.440670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for project 182080e008ca451c81350a9cad4d970e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:22:10.445891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for user dcf412de18ab4d64aff7c7514bf0eaba and project 182080e008ca451c81350a9cad4d970e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:22:10.462254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:22:10.464644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:22:10.513499 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-624cd95a-6e77-4732-acbc-b29ecb8dea33 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.663123 Oct 05 18:22:10.520265 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3156/6556] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:22:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:22:10.527351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eebf75fa-3e02-46f4-ac20-bb85f0a7cdf2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:10.539422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eebf75fa-3e02-46f4-ac20-bb85f0a7cdf2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:10.599083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eebf75fa-3e02-46f4-ac20-bb85f0a7cdf2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:22:10.608260 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eebf75fa-3e02-46f4-ac20-bb85f0a7cdf2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1239 microversion: 2.1 time: 0.086560 Oct 05 18:22:10.609493 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3401/6557] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:22:10 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1239 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:22:11.636938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a089ca9e-beaa-456b-97a6-d5fce80b05da tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:11.637614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a089ca9e-beaa-456b-97a6-d5fce80b05da tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:11.646074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a089ca9e-beaa-456b-97a6-d5fce80b05da tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:11.646671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a089ca9e-beaa-456b-97a6-d5fce80b05da tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:11.647108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a089ca9e-beaa-456b-97a6-d5fce80b05da tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:11.647792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a089ca9e-beaa-456b-97a6-d5fce80b05da tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:11.648244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a089ca9e-beaa-456b-97a6-d5fce80b05da tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:11.648661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a089ca9e-beaa-456b-97a6-d5fce80b05da tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:11.719724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a089ca9e-beaa-456b-97a6-d5fce80b05da tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:22:11.728655 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a089ca9e-beaa-456b-97a6-d5fce80b05da tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1291 microversion: 2.1 time: 0.100090 Oct 05 18:22:11.729238 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3157/6558] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:22:11 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1291 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:22:12.752422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f746ca9c-0998-4141-9bf5-8951134e5fef tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:12.752977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f746ca9c-0998-4141-9bf5-8951134e5fef tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:12.760820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f746ca9c-0998-4141-9bf5-8951134e5fef tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:12.761692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f746ca9c-0998-4141-9bf5-8951134e5fef tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:12.762036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f746ca9c-0998-4141-9bf5-8951134e5fef tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:12.762937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f746ca9c-0998-4141-9bf5-8951134e5fef tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:12.763464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f746ca9c-0998-4141-9bf5-8951134e5fef tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:12.763924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f746ca9c-0998-4141-9bf5-8951134e5fef tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:12.960176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f746ca9c-0998-4141-9bf5-8951134e5fef tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:22:12.969869 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f746ca9c-0998-4141-9bf5-8951134e5fef tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1364 microversion: 2.1 time: 0.221467 Oct 05 18:22:12.975263 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3402/6559] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:22:12 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:22:13.332941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-cb7966e7-d42e-4495-9b88-38a9512bf695 req-f32d919e-7c4f-4150-ac19-a1cee963d9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618f8f8a-ba51-4638-b718-bf770b266f27", "tag": "f54ab38e-33ac-4401-9130-1c95e4df860e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:22:13.352578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-cb7966e7-d42e-4495-9b88-38a9512bf695 req-f32d919e-7c4f-4150-ac19-a1cee963d9cc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:13.353063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-cb7966e7-d42e-4495-9b88-38a9512bf695 req-f32d919e-7c4f-4150-ac19-a1cee963d9cc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:13.353522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-cb7966e7-d42e-4495-9b88-38a9512bf695 req-f32d919e-7c4f-4150-ac19-a1cee963d9cc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:13.365724 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-cb7966e7-d42e-4495-9b88-38a9512bf695 req-f32d919e-7c4f-4150-ac19-a1cee963d9cc service nova] Creating event network-changed:f54ab38e-33ac-4401-9130-1c95e4df860e for instance 618f8f8a-ba51-4638-b718-bf770b266f27 on n-h2-835595-3 Oct 05 18:22:13.370740 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-cb7966e7-d42e-4495-9b88-38a9512bf695 req-f32d919e-7c4f-4150-ac19-a1cee963d9cc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042322 Oct 05 18:22:13.371332 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3158/6560] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:22:14.001551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-89c3d0b0-4e85-4c03-a5d6-79324495f1df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:14.002612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-89c3d0b0-4e85-4c03-a5d6-79324495f1df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:14.014708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89c3d0b0-4e85-4c03-a5d6-79324495f1df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:14.015531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89c3d0b0-4e85-4c03-a5d6-79324495f1df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:14.016369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89c3d0b0-4e85-4c03-a5d6-79324495f1df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:14.017079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89c3d0b0-4e85-4c03-a5d6-79324495f1df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:14.017546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89c3d0b0-4e85-4c03-a5d6-79324495f1df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:14.017978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-89c3d0b0-4e85-4c03-a5d6-79324495f1df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:14.158435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-89c3d0b0-4e85-4c03-a5d6-79324495f1df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:22:14.166731 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-89c3d0b0-4e85-4c03-a5d6-79324495f1df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1364 microversion: 2.1 time: 0.171913 Oct 05 18:22:14.167340 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3403/6561] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:22:13 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:22:15.191457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-49b588da-8d07-4864-83e8-0ec1134b5b98 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:15.192191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-49b588da-8d07-4864-83e8-0ec1134b5b98 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:15.198960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b588da-8d07-4864-83e8-0ec1134b5b98 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:15.199444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b588da-8d07-4864-83e8-0ec1134b5b98 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:15.199883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b588da-8d07-4864-83e8-0ec1134b5b98 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:15.200579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b588da-8d07-4864-83e8-0ec1134b5b98 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:15.201036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b588da-8d07-4864-83e8-0ec1134b5b98 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:15.201458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b588da-8d07-4864-83e8-0ec1134b5b98 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:15.341579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-49b588da-8d07-4864-83e8-0ec1134b5b98 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:22:15.353848 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-49b588da-8d07-4864-83e8-0ec1134b5b98 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1364 microversion: 2.1 time: 0.167390 Oct 05 18:22:15.354831 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3159/6562] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:22:15 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:22:16.383055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-17e88628-2fea-4bf2-a2df-34bb4e9f0559 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:16.384135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-17e88628-2fea-4bf2-a2df-34bb4e9f0559 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:16.394564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17e88628-2fea-4bf2-a2df-34bb4e9f0559 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:16.395079 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17e88628-2fea-4bf2-a2df-34bb4e9f0559 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:16.395531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17e88628-2fea-4bf2-a2df-34bb4e9f0559 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:16.396249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17e88628-2fea-4bf2-a2df-34bb4e9f0559 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:16.396726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17e88628-2fea-4bf2-a2df-34bb4e9f0559 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:16.397168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17e88628-2fea-4bf2-a2df-34bb4e9f0559 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:16.592232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-17e88628-2fea-4bf2-a2df-34bb4e9f0559 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:22:16.600471 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-17e88628-2fea-4bf2-a2df-34bb4e9f0559 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1364 microversion: 2.1 time: 0.224505 Oct 05 18:22:16.601051 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3404/6563] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:22:16 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:22:17.627558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4dfa897d-bcd1-4c00-bf85-9f5984b53398 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:17.628594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4dfa897d-bcd1-4c00-bf85-9f5984b53398 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:17.641426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4dfa897d-bcd1-4c00-bf85-9f5984b53398 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:17.641924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4dfa897d-bcd1-4c00-bf85-9f5984b53398 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:17.642394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4dfa897d-bcd1-4c00-bf85-9f5984b53398 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:17.643079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4dfa897d-bcd1-4c00-bf85-9f5984b53398 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:17.643540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4dfa897d-bcd1-4c00-bf85-9f5984b53398 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:17.643968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4dfa897d-bcd1-4c00-bf85-9f5984b53398 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:17.837351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4dfa897d-bcd1-4c00-bf85-9f5984b53398 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:22:17.845090 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4dfa897d-bcd1-4c00-bf85-9f5984b53398 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1364 microversion: 2.1 time: 0.224353 Oct 05 18:22:17.845662 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3160/6564] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:22:17 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:22:18.873640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-966a480f-2fff-4131-a95b-34bb639a2795 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:18.874565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-966a480f-2fff-4131-a95b-34bb639a2795 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:18.877774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:22:18.883683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-966a480f-2fff-4131-a95b-34bb639a2795 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:18.884179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-966a480f-2fff-4131-a95b-34bb639a2795 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:18.884629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-966a480f-2fff-4131-a95b-34bb639a2795 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:18.885335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-966a480f-2fff-4131-a95b-34bb639a2795 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:18.885799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-966a480f-2fff-4131-a95b-34bb639a2795 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:18.886234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-966a480f-2fff-4131-a95b-34bb639a2795 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:19.024716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-966a480f-2fff-4131-a95b-34bb639a2795 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:22:19.032882 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-966a480f-2fff-4131-a95b-34bb639a2795 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1364 microversion: 2.1 time: 0.166390 Oct 05 18:22:19.033429 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3405/6565] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:22:18 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:22:19.359947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4a2a03a1-08e4-4ce2-bb9e-8dc9c71bef81 req-353479b9-a7a1-4d4c-93a4-77fc5814f2db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618f8f8a-ba51-4638-b718-bf770b266f27", "name": "network-vif-plugged", "status": "completed", "tag": "f54ab38e-33ac-4401-9130-1c95e4df860e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:22:19.371035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4a2a03a1-08e4-4ce2-bb9e-8dc9c71bef81 req-353479b9-a7a1-4d4c-93a4-77fc5814f2db service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:19.371516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4a2a03a1-08e4-4ce2-bb9e-8dc9c71bef81 req-353479b9-a7a1-4d4c-93a4-77fc5814f2db service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:19.371947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4a2a03a1-08e4-4ce2-bb9e-8dc9c71bef81 req-353479b9-a7a1-4d4c-93a4-77fc5814f2db service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:19.383588 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4a2a03a1-08e4-4ce2-bb9e-8dc9c71bef81 req-353479b9-a7a1-4d4c-93a4-77fc5814f2db service nova] Creating event network-vif-plugged:f54ab38e-33ac-4401-9130-1c95e4df860e for instance 618f8f8a-ba51-4638-b718-bf770b266f27 on n-h2-835595-3 Oct 05 18:22:19.388629 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4a2a03a1-08e4-4ce2-bb9e-8dc9c71bef81 req-353479b9-a7a1-4d4c-93a4-77fc5814f2db service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032617 Oct 05 18:22:19.389407 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3161/6566] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:22:20.064456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d1050d5-9f16-408e-b26e-8b38f7fad263 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:20.065525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d1050d5-9f16-408e-b26e-8b38f7fad263 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:20.077224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d1050d5-9f16-408e-b26e-8b38f7fad263 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:20.078074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d1050d5-9f16-408e-b26e-8b38f7fad263 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:20.078862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d1050d5-9f16-408e-b26e-8b38f7fad263 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:20.079575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d1050d5-9f16-408e-b26e-8b38f7fad263 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:20.080042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d1050d5-9f16-408e-b26e-8b38f7fad263 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:20.080478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d1050d5-9f16-408e-b26e-8b38f7fad263 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:20.226851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d1050d5-9f16-408e-b26e-8b38f7fad263 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:22:20.237699 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d1050d5-9f16-408e-b26e-8b38f7fad263 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1364 microversion: 2.1 time: 0.179630 Oct 05 18:22:20.238397 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3406/6567] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:22:20 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:22:21.259706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:22:21.260505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:22:21.264616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0451d7ef-c97d-4107-bb87-82d08a34eff9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:21.265379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0451d7ef-c97d-4107-bb87-82d08a34eff9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:21.272736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0451d7ef-c97d-4107-bb87-82d08a34eff9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:21.273227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0451d7ef-c97d-4107-bb87-82d08a34eff9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:21.273680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0451d7ef-c97d-4107-bb87-82d08a34eff9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:21.274393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0451d7ef-c97d-4107-bb87-82d08a34eff9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:21.274856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0451d7ef-c97d-4107-bb87-82d08a34eff9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:21.275299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0451d7ef-c97d-4107-bb87-82d08a34eff9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:21.415352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0451d7ef-c97d-4107-bb87-82d08a34eff9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:22:21.423330 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0451d7ef-c97d-4107-bb87-82d08a34eff9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1555 microversion: 2.1 time: 0.165821 Oct 05 18:22:21.423908 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3162/6568] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:22:21 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:22:21.448877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82882b38-2cd1-458f-b57e-71b5f6ee1a3a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:21.449409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-82882b38-2cd1-458f-b57e-71b5f6ee1a3a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:21.451900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:22:21.458634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82882b38-2cd1-458f-b57e-71b5f6ee1a3a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:21.459134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82882b38-2cd1-458f-b57e-71b5f6ee1a3a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:21.459603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82882b38-2cd1-458f-b57e-71b5f6ee1a3a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:21.460318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82882b38-2cd1-458f-b57e-71b5f6ee1a3a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:21.460769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82882b38-2cd1-458f-b57e-71b5f6ee1a3a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:21.461207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82882b38-2cd1-458f-b57e-71b5f6ee1a3a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:21.552652 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-82882b38-2cd1-458f-b57e-71b5f6ee1a3a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110333 Oct 05 18:22:21.553544 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3407/6569] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 18:22:21 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:22:22.531698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-766ed58f-0448-4449-9d6e-a874a789117e req-eb89419b-e98f-4410-a525-aed72aaa5b94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618f8f8a-ba51-4638-b718-bf770b266f27", "tag": "f54ab38e-33ac-4401-9130-1c95e4df860e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:22:22.541934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-766ed58f-0448-4449-9d6e-a874a789117e req-eb89419b-e98f-4410-a525-aed72aaa5b94 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:22.542452 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-766ed58f-0448-4449-9d6e-a874a789117e req-eb89419b-e98f-4410-a525-aed72aaa5b94 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:22.542859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-766ed58f-0448-4449-9d6e-a874a789117e req-eb89419b-e98f-4410-a525-aed72aaa5b94 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:22.559469 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-766ed58f-0448-4449-9d6e-a874a789117e req-eb89419b-e98f-4410-a525-aed72aaa5b94 service nova] Creating event network-changed:f54ab38e-33ac-4401-9130-1c95e4df860e for instance 618f8f8a-ba51-4638-b718-bf770b266f27 on n-h2-835595-3 Oct 05 18:22:22.563172 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-766ed58f-0448-4449-9d6e-a874a789117e req-eb89419b-e98f-4410-a525-aed72aaa5b94 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035407 Oct 05 18:22:22.563827 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3163/6570] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:22:58.867892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=5 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:22:58.868952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=34 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:22:58.874718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d073df20-b4ce-4012-a451-b6a76dbcf769 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:22:58.875523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d073df20-b4ce-4012-a451-b6a76dbcf769 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:22:58.884850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d073df20-b4ce-4012-a451-b6a76dbcf769 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:58.885614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d073df20-b4ce-4012-a451-b6a76dbcf769 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:58.886221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d073df20-b4ce-4012-a451-b6a76dbcf769 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:58.887184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d073df20-b4ce-4012-a451-b6a76dbcf769 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:22:58.887839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d073df20-b4ce-4012-a451-b6a76dbcf769 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:22:58.888419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d073df20-b4ce-4012-a451-b6a76dbcf769 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:22:58.915721 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d073df20-b4ce-4012-a451-b6a76dbcf769 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/ips" status: 200 len: 150 microversion: 2.1 time: 0.051038 Oct 05 18:22:58.916313 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3408/6571] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 18:22:58 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/ips => generated 150 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:23:00.307173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:23:00.307927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=32 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:23:00.312282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5115f974-d05f-42af-8b56-a98326a7b166 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "943fd556-d7d9-4d13-b96e-8b83dfea9e76"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:23:00.314787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5115f974-d05f-42af-8b56-a98326a7b166 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:00.322030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5115f974-d05f-42af-8b56-a98326a7b166 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:00.322592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5115f974-d05f-42af-8b56-a98326a7b166 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:00.323031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5115f974-d05f-42af-8b56-a98326a7b166 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:00.323719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5115f974-d05f-42af-8b56-a98326a7b166 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:00.324171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5115f974-d05f-42af-8b56-a98326a7b166 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:00.324588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5115f974-d05f-42af-8b56-a98326a7b166 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:00.584849 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5115f974-d05f-42af-8b56-a98326a7b166 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279735 Oct 05 18:23:00.585486 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3164/6572] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:23:00 2022] POST /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:23:11.366619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-69e3055e-265d-41b0-afc9-6d8f183a8385 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: .version_select at 0x7f776c6da0d0>, body: {"keypair": {"name": "tempest-keypair-1315304105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxGExEvevgGpNMRDa4T4LI7gFEvsBxyo21lo7Tcm90knxSKzs0EhRbg9AOF9anIuk04Sb7Rg+6mHDnvlV+9NlbYt5N7LnLwpYcksAiIJvljJXlt6y1RL6G0+QEDeORRAw=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:23:11.372190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:23:11.372866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:23:11.385540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-69e3055e-265d-41b0-afc9-6d8f183a8385 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for project 182080e008ca451c81350a9cad4d970e. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:23:11.390920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-69e3055e-265d-41b0-afc9-6d8f183a8385 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for user dcf412de18ab4d64aff7c7514bf0eaba and project 182080e008ca451c81350a9cad4d970e. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:23:11.419631 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-69e3055e-265d-41b0-afc9-6d8f183a8385 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057292 Oct 05 18:23:11.420243 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3409/6573] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:23:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:23:12.746934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:23:12.747813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:23:12.752541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-702785188", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "417dd8ea-4fbe-437f-bb37-c563f90ec1cc"}], "security_groups": [{"name": "tempest-securitygroup--1008439339"}], "key_name": "tempest-keypair-1315304105", "user_data": "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:23:12.861454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] validate_networks() for [('417dd8ea-4fbe-437f-bb37-c563f90ec1cc', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:23:13.259208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:23:13.259667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:23:13.260146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:23:13.260555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:23:13.260967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:23:13.270708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:13.271191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:13.271628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:13.272367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:13.272865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:13.273286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:13.291244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for project 182080e008ca451c81350a9cad4d970e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:23:13.296789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for user dcf412de18ab4d64aff7c7514bf0eaba and project 182080e008ca451c81350a9cad4d970e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:23:13.309660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:23:13.312149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:23:13.366618 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-03320f1d-f697-4863-8305-5ca11db713e9 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.621577 Oct 05 18:23:13.367259 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3165/6574] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:23:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:23:13.379871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c08878da-8e61-4e69-a990-56565c616996 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:13.380527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c08878da-8e61-4e69-a990-56565c616996 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:13.438601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c08878da-8e61-4e69-a990-56565c616996 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:13.446432 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c08878da-8e61-4e69-a990-56565c616996 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1241 microversion: 2.1 time: 0.071521 Oct 05 18:23:13.447063 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3410/6575] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:13 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:14.472037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-232d8d51-224f-49ec-9571-97fde2fdc6a8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:14.472692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-232d8d51-224f-49ec-9571-97fde2fdc6a8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:14.531081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-232d8d51-224f-49ec-9571-97fde2fdc6a8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:14.538727 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-232d8d51-224f-49ec-9571-97fde2fdc6a8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1241 microversion: 2.1 time: 0.072972 Oct 05 18:23:14.539291 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3166/6576] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:14 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:15.563254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b24da1d7-9332-416b-b784-601cd918cb52 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:15.564034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b24da1d7-9332-416b-b784-601cd918cb52 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:15.620866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b24da1d7-9332-416b-b784-601cd918cb52 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:15.628584 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b24da1d7-9332-416b-b784-601cd918cb52 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1241 microversion: 2.1 time: 0.070371 Oct 05 18:23:15.629171 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3411/6577] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:15 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:16.652755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8f83e765-fdd3-403b-9c09-950b49c0e1c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:16.653462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8f83e765-fdd3-403b-9c09-950b49c0e1c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:16.661266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f83e765-fdd3-403b-9c09-950b49c0e1c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:16.661847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f83e765-fdd3-403b-9c09-950b49c0e1c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:16.662390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f83e765-fdd3-403b-9c09-950b49c0e1c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:16.663100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f83e765-fdd3-403b-9c09-950b49c0e1c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:16.663549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f83e765-fdd3-403b-9c09-950b49c0e1c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:16.663952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8f83e765-fdd3-403b-9c09-950b49c0e1c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:16.740692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8f83e765-fdd3-403b-9c09-950b49c0e1c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:16.748797 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8f83e765-fdd3-403b-9c09-950b49c0e1c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1299 microversion: 2.1 time: 0.100030 Oct 05 18:23:16.749463 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3167/6578] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:16 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:17.773104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7221a999-f69a-457b-8698-4a7f9c44ff10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:17.773907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7221a999-f69a-457b-8698-4a7f9c44ff10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:17.782307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7221a999-f69a-457b-8698-4a7f9c44ff10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:17.782816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7221a999-f69a-457b-8698-4a7f9c44ff10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:17.783270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7221a999-f69a-457b-8698-4a7f9c44ff10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:17.784034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7221a999-f69a-457b-8698-4a7f9c44ff10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:17.784516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7221a999-f69a-457b-8698-4a7f9c44ff10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:17.784960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7221a999-f69a-457b-8698-4a7f9c44ff10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:17.936101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7221a999-f69a-457b-8698-4a7f9c44ff10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:17.944673 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7221a999-f69a-457b-8698-4a7f9c44ff10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1367 microversion: 2.1 time: 0.175478 Oct 05 18:23:17.945250 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3412/6579] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:17 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:18.184697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-672e8296-8abd-4a66-ba6a-61661fce90e8 req-c8d9325d-c0f6-4326-a1ac-fdf985292b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929043f1-ecb1-41ba-8204-9942de6351f6", "tag": "1422fdbe-6701-4c3b-a635-a0678d71d5fb"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:23:18.196104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-672e8296-8abd-4a66-ba6a-61661fce90e8 req-c8d9325d-c0f6-4326-a1ac-fdf985292b87 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:18.196667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-672e8296-8abd-4a66-ba6a-61661fce90e8 req-c8d9325d-c0f6-4326-a1ac-fdf985292b87 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:18.197538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-672e8296-8abd-4a66-ba6a-61661fce90e8 req-c8d9325d-c0f6-4326-a1ac-fdf985292b87 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:18.209088 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-672e8296-8abd-4a66-ba6a-61661fce90e8 req-c8d9325d-c0f6-4326-a1ac-fdf985292b87 service nova] Creating event network-changed:1422fdbe-6701-4c3b-a635-a0678d71d5fb for instance 929043f1-ecb1-41ba-8204-9942de6351f6 on n-h1-835595-3 Oct 05 18:23:18.214094 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-672e8296-8abd-4a66-ba6a-61661fce90e8 req-c8d9325d-c0f6-4326-a1ac-fdf985292b87 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033503 Oct 05 18:23:18.214764 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3168/6580] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:23:18.967910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8523c8bf-1e5e-4b17-a4a8-45e76d2f4d10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:18.968531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8523c8bf-1e5e-4b17-a4a8-45e76d2f4d10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:18.975959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8523c8bf-1e5e-4b17-a4a8-45e76d2f4d10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:18.976459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8523c8bf-1e5e-4b17-a4a8-45e76d2f4d10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:18.976909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8523c8bf-1e5e-4b17-a4a8-45e76d2f4d10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:18.977615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8523c8bf-1e5e-4b17-a4a8-45e76d2f4d10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:18.978084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8523c8bf-1e5e-4b17-a4a8-45e76d2f4d10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:18.978553 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8523c8bf-1e5e-4b17-a4a8-45e76d2f4d10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:19.115783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8523c8bf-1e5e-4b17-a4a8-45e76d2f4d10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:19.124399 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8523c8bf-1e5e-4b17-a4a8-45e76d2f4d10 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1367 microversion: 2.1 time: 0.160517 Oct 05 18:23:19.124984 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3413/6581] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:18 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:20.152441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-614cb134-0e49-4fa8-825a-96bb352e8d7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:20.153200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-614cb134-0e49-4fa8-825a-96bb352e8d7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:20.161059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-614cb134-0e49-4fa8-825a-96bb352e8d7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:20.161541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-614cb134-0e49-4fa8-825a-96bb352e8d7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:20.161969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-614cb134-0e49-4fa8-825a-96bb352e8d7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:20.162691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-614cb134-0e49-4fa8-825a-96bb352e8d7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:20.163139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-614cb134-0e49-4fa8-825a-96bb352e8d7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:20.163559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-614cb134-0e49-4fa8-825a-96bb352e8d7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:20.296260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-614cb134-0e49-4fa8-825a-96bb352e8d7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:20.304038 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-614cb134-0e49-4fa8-825a-96bb352e8d7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1367 microversion: 2.1 time: 0.159134 Oct 05 18:23:20.304612 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3169/6582] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:20 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:21.327301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2e3d5514-e482-4596-8a5f-93845be80241 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:21.327913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2e3d5514-e482-4596-8a5f-93845be80241 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:21.335314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e3d5514-e482-4596-8a5f-93845be80241 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:21.335824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e3d5514-e482-4596-8a5f-93845be80241 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:21.336261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e3d5514-e482-4596-8a5f-93845be80241 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:21.336971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e3d5514-e482-4596-8a5f-93845be80241 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:21.337442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e3d5514-e482-4596-8a5f-93845be80241 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:21.337885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e3d5514-e482-4596-8a5f-93845be80241 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:21.478504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2e3d5514-e482-4596-8a5f-93845be80241 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:21.487883 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2e3d5514-e482-4596-8a5f-93845be80241 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1367 microversion: 2.1 time: 0.164587 Oct 05 18:23:21.488585 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3414/6583] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:21 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:22.515269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6029cf84-4857-4df5-a455-b4b18a3950ea tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:22.516354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6029cf84-4857-4df5-a455-b4b18a3950ea tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:22.527768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6029cf84-4857-4df5-a455-b4b18a3950ea tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:22.528585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6029cf84-4857-4df5-a455-b4b18a3950ea tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:22.529311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6029cf84-4857-4df5-a455-b4b18a3950ea tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:22.530513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6029cf84-4857-4df5-a455-b4b18a3950ea tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:22.531306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6029cf84-4857-4df5-a455-b4b18a3950ea tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:22.531874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6029cf84-4857-4df5-a455-b4b18a3950ea tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:22.671589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6029cf84-4857-4df5-a455-b4b18a3950ea tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:22.679663 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6029cf84-4857-4df5-a455-b4b18a3950ea tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1367 microversion: 2.1 time: 0.171419 Oct 05 18:23:22.680246 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3170/6584] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:22 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:22.906406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4b23ad21-b044-4fef-92af-7e014a6c3fad req-3b928c25-fc24-40ee-93b0-0b396cd8842a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929043f1-ecb1-41ba-8204-9942de6351f6", "name": "network-vif-plugged", "status": "completed", "tag": "1422fdbe-6701-4c3b-a635-a0678d71d5fb"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:23:22.917160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4b23ad21-b044-4fef-92af-7e014a6c3fad req-3b928c25-fc24-40ee-93b0-0b396cd8842a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:22.917724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4b23ad21-b044-4fef-92af-7e014a6c3fad req-3b928c25-fc24-40ee-93b0-0b396cd8842a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:22.918218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4b23ad21-b044-4fef-92af-7e014a6c3fad req-3b928c25-fc24-40ee-93b0-0b396cd8842a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:22.929931 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4b23ad21-b044-4fef-92af-7e014a6c3fad req-3b928c25-fc24-40ee-93b0-0b396cd8842a service nova] Creating event network-vif-plugged:1422fdbe-6701-4c3b-a635-a0678d71d5fb for instance 929043f1-ecb1-41ba-8204-9942de6351f6 on n-h1-835595-3 Oct 05 18:23:22.935261 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4b23ad21-b044-4fef-92af-7e014a6c3fad req-3b928c25-fc24-40ee-93b0-0b396cd8842a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032871 Oct 05 18:23:22.935866 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3415/6585] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:23:23.708163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dde6ed24-c35a-4ca6-8a98-204fdcb588a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:23.708899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dde6ed24-c35a-4ca6-8a98-204fdcb588a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:23.711387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:23:23.719284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dde6ed24-c35a-4ca6-8a98-204fdcb588a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:23.719891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dde6ed24-c35a-4ca6-8a98-204fdcb588a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:23.720436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dde6ed24-c35a-4ca6-8a98-204fdcb588a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:23.721300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dde6ed24-c35a-4ca6-8a98-204fdcb588a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:23.721869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dde6ed24-c35a-4ca6-8a98-204fdcb588a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:23.722411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dde6ed24-c35a-4ca6-8a98-204fdcb588a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:23.865257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dde6ed24-c35a-4ca6-8a98-204fdcb588a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:23.877549 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dde6ed24-c35a-4ca6-8a98-204fdcb588a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1367 microversion: 2.1 time: 0.174421 Oct 05 18:23:23.878475 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3171/6586] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:23 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:24.905725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c046c33d-8160-43b7-91dd-2489477eb5bb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:24.906703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c046c33d-8160-43b7-91dd-2489477eb5bb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:24.914436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c046c33d-8160-43b7-91dd-2489477eb5bb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:24.915005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c046c33d-8160-43b7-91dd-2489477eb5bb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:24.915518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c046c33d-8160-43b7-91dd-2489477eb5bb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:24.916229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c046c33d-8160-43b7-91dd-2489477eb5bb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:24.916721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c046c33d-8160-43b7-91dd-2489477eb5bb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:24.917156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c046c33d-8160-43b7-91dd-2489477eb5bb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:25.115680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c046c33d-8160-43b7-91dd-2489477eb5bb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:23:25.123758 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c046c33d-8160-43b7-91dd-2489477eb5bb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1557 microversion: 2.1 time: 0.222322 Oct 05 18:23:25.124342 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3416/6587] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:23:24 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1557 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:23:25.146522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d478a1a-f46d-450b-ae32-cd3bb8dc9504 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:23:25.147156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4d478a1a-f46d-450b-ae32-cd3bb8dc9504 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:23:25.148870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:23:25.155245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d478a1a-f46d-450b-ae32-cd3bb8dc9504 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:25.155743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d478a1a-f46d-450b-ae32-cd3bb8dc9504 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:25.156176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d478a1a-f46d-450b-ae32-cd3bb8dc9504 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:25.156871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d478a1a-f46d-450b-ae32-cd3bb8dc9504 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:25.157328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d478a1a-f46d-450b-ae32-cd3bb8dc9504 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:25.157753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d478a1a-f46d-450b-ae32-cd3bb8dc9504 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:25.238015 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4d478a1a-f46d-450b-ae32-cd3bb8dc9504 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095404 Oct 05 18:23:25.245774 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3172/6588] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 18:23:25 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:23:26.243106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-7c0e9532-9db8-4bcc-9da2-5a86bed20fee req-7f422a82-7b86-4a75-8d4d-4b56e1eea0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "929043f1-ecb1-41ba-8204-9942de6351f6", "tag": "1422fdbe-6701-4c3b-a635-a0678d71d5fb"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:23:26.248187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:23:26.255231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7c0e9532-9db8-4bcc-9da2-5a86bed20fee req-7f422a82-7b86-4a75-8d4d-4b56e1eea0b3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:23:26.255805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7c0e9532-9db8-4bcc-9da2-5a86bed20fee req-7f422a82-7b86-4a75-8d4d-4b56e1eea0b3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:23:26.256317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-7c0e9532-9db8-4bcc-9da2-5a86bed20fee req-7f422a82-7b86-4a75-8d4d-4b56e1eea0b3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:23:26.268799 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-7c0e9532-9db8-4bcc-9da2-5a86bed20fee req-7f422a82-7b86-4a75-8d4d-4b56e1eea0b3 service nova] Creating event network-changed:1422fdbe-6701-4c3b-a635-a0678d71d5fb for instance 929043f1-ecb1-41ba-8204-9942de6351f6 on n-h1-835595-3 Oct 05 18:23:26.275067 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-7c0e9532-9db8-4bcc-9da2-5a86bed20fee req-7f422a82-7b86-4a75-8d4d-4b56e1eea0b3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035620 Oct 05 18:23:26.276064 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3417/6589] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:01.225137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:24:01.226911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=32 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:24:01.227826 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:24:01.228046 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:24:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6/ips (ip 10.222.0.70) !!! Oct 05 18:24:01.238068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9a19e82-ab6f-48ca-a284-39e99ce97812 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:01.238848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f9a19e82-ab6f-48ca-a284-39e99ce97812 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:01.251629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9a19e82-ab6f-48ca-a284-39e99ce97812 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:01.252356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9a19e82-ab6f-48ca-a284-39e99ce97812 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:01.253006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9a19e82-ab6f-48ca-a284-39e99ce97812 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:01.254054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9a19e82-ab6f-48ca-a284-39e99ce97812 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:01.254790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9a19e82-ab6f-48ca-a284-39e99ce97812 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:01.255427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9a19e82-ab6f-48ca-a284-39e99ce97812 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:01.288501 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f9a19e82-ab6f-48ca-a284-39e99ce97812 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6/ips" status: 200 len: 149 microversion: 2.1 time: 0.066905 Oct 05 18:24:01.289083 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3173/6590] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 18:24:01 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6/ips => generated 149 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:01.303491 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "943fd556-d7d9-4d13-b96e-8b83dfea9e76"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:24:01.305991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:01.308815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:24:01.309972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=28 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:24:01.311663 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:24:01.311906 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:24:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6/os-volume_attachments (ip 10.222.0.70) !!! Oct 05 18:24:01.328198 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:01.329114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:01.329648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:01.330388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:01.330863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:01.331307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:01.417718 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Invalid volume: volume 943fd556-d7d9-4d13-b96e-8b83dfea9e76 is already attached to instances: 618f8f8a-ba51-4638-b718-bf770b266f27 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6/os-volume_attachments HTTP/1.1 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 74 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: {"volumeAttachment": {"volumeId": "943fd556-d7d9-4d13-b96e-8b83dfea9e76"}} Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: exception: Invalid volume: volume 943fd556-d7d9-4d13-b96e-8b83dfea9e76 is already attached to instances: 618f8f8a-ba51-4638-b718-bf770b266f27 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': '929043f1-ecb1-41ba-8204-9942de6351f6', 'body': {'volumeAttachment': {'volumeId': '943fd556-d7d9-4d13-b96e-8b83dfea9e76'}}} Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 943fd556-d7d9-4d13-b96e-8b83dfea9e76 is already attached to instances: 618f8f8a-ba51-4638-b718-bf770b266f27 Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:24:01.419565 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 943fd556-d7d9-4d13-b96e-8b83dfea9e76 is already attached to instances: 618f8f8a-ba51-4638-b718-bf770b266f27 Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 943fd556-d7d9-4d13-b96e-8b83dfea9e76 is already attached to instances: 618f8f8a-ba51-4638-b718-bf770b266f27 Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 400 to user: Invalid volume: volume 943fd556-d7d9-4d13-b96e-8b83dfea9e76 is already attached to instances: 618f8f8a-ba51-4638-b718-bf770b266f27 {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b323447f-14ab-4e15-9efc-0178a46a398b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122096 Oct 05 18:24:01.425261 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3418/6591] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:24:01 2022] POST /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6/os-volume_attachments => generated 174 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:24:01.430033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-437af99c-c185-493f-9064-3762bf596920 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:01.430572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-437af99c-c185-493f-9064-3762bf596920 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:01.436709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-437af99c-c185-493f-9064-3762bf596920 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:01.437210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-437af99c-c185-493f-9064-3762bf596920 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:01.437648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-437af99c-c185-493f-9064-3762bf596920 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:01.438509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-437af99c-c185-493f-9064-3762bf596920 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:01.438975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-437af99c-c185-493f-9064-3762bf596920 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:01.439403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-437af99c-c185-493f-9064-3762bf596920 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:01.464805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-437af99c-c185-493f-9064-3762bf596920 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:24:01.545785 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-437af99c-c185-493f-9064-3762bf596920 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 204 len: 0 microversion: 2.1 time: 0.119384 Oct 05 18:24:01.546633 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3174/6592] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:24:01 2022] DELETE /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:24:01.554808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-45ce0ba0-444f-4964-a5aa-a3782e8a64a0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:01.555458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-45ce0ba0-444f-4964-a5aa-a3782e8a64a0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:01.561778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45ce0ba0-444f-4964-a5aa-a3782e8a64a0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:01.562305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45ce0ba0-444f-4964-a5aa-a3782e8a64a0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:01.562756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45ce0ba0-444f-4964-a5aa-a3782e8a64a0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:01.563611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45ce0ba0-444f-4964-a5aa-a3782e8a64a0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:01.564123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45ce0ba0-444f-4964-a5aa-a3782e8a64a0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:01.564569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45ce0ba0-444f-4964-a5aa-a3782e8a64a0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:01.713571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-45ce0ba0-444f-4964-a5aa-a3782e8a64a0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:01.723497 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-45ce0ba0-444f-4964-a5aa-a3782e8a64a0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1681 microversion: 2.1 time: 0.172620 Oct 05 18:24:01.724082 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3419/6593] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:01 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:02.750267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-90476ab7-9e1f-4841-97ac-8b950f130613 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:02.751146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-90476ab7-9e1f-4841-97ac-8b950f130613 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:02.759847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90476ab7-9e1f-4841-97ac-8b950f130613 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:02.760429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90476ab7-9e1f-4841-97ac-8b950f130613 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:02.760921 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90476ab7-9e1f-4841-97ac-8b950f130613 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:02.761736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90476ab7-9e1f-4841-97ac-8b950f130613 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:02.762272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90476ab7-9e1f-4841-97ac-8b950f130613 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:02.762793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-90476ab7-9e1f-4841-97ac-8b950f130613 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:02.931682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-90476ab7-9e1f-4841-97ac-8b950f130613 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:02.947630 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-90476ab7-9e1f-4841-97ac-8b950f130613 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1681 microversion: 2.1 time: 0.202183 Oct 05 18:24:02.949147 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3175/6594] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:02 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:03.746155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-20393b4e-8002-4aa8-8f57-eaa04626be31 req-5cbcbaef-55a3-4be9-b13c-d82b510cfe2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "929043f1-ecb1-41ba-8204-9942de6351f6", "name": "network-vif-deleted", "tag": "1422fdbe-6701-4c3b-a635-a0678d71d5fb"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:24:03.759315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-20393b4e-8002-4aa8-8f57-eaa04626be31 req-5cbcbaef-55a3-4be9-b13c-d82b510cfe2e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:03.759805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-20393b4e-8002-4aa8-8f57-eaa04626be31 req-5cbcbaef-55a3-4be9-b13c-d82b510cfe2e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:03.760611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-20393b4e-8002-4aa8-8f57-eaa04626be31 req-5cbcbaef-55a3-4be9-b13c-d82b510cfe2e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:03.776161 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-20393b4e-8002-4aa8-8f57-eaa04626be31 req-5cbcbaef-55a3-4be9-b13c-d82b510cfe2e service nova] Creating event network-vif-deleted:1422fdbe-6701-4c3b-a635-a0678d71d5fb for instance 929043f1-ecb1-41ba-8204-9942de6351f6 on n-h1-835595-3 Oct 05 18:24:03.781221 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-20393b4e-8002-4aa8-8f57-eaa04626be31 req-5cbcbaef-55a3-4be9-b13c-d82b510cfe2e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039298 Oct 05 18:24:03.785863 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3420/6595] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:03.973161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:03.974040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:03.981424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:03.981994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:03.982537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:03.983340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:03.984331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:03.984499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:04.018196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:04.018718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:04.019147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:04.019587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lazy-loading 'fault' on Instance uuid 929043f1-ecb1-41ba-8204-9942de6351f6 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:24:04.061111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:04.069255 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3910d6d9-c6b4-43a3-86ab-1c7f5f6673fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 200 len: 1331 microversion: 2.1 time: 0.100090 Oct 05 18:24:04.069916 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3176/6596] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:03 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:05.097874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:05.099197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:05.110911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:05.111416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:05.111870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:05.112579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:05.113054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:05.113496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:05.127586 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 HTTP/1.1 Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '929043f1-ecb1-41ba-8204-9942de6351f6'} Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:24:05.129224 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:05.137208 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:24:05.137208 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:24:05.137208 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:24:05.137208 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:24:05.137208 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:24:05.137208 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:24:05.137208 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:05.137208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:24:05.137208 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2b30cc5-f0c5-479f-afd0-28952bb7b22e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 404 len: 111 microversion: 2.1 time: 0.039940 Oct 05 18:24:05.137208 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3421/6597] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:05 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:24:05.140219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b38ce92-748a-402b-8d82-c629a503b9dc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '.version_select at 0x7f776ff9b1f0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:05.166254 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b38ce92-748a-402b-8d82-c629a503b9dc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315304105" status: 202 len: 0 microversion: 2.1 time: 0.029860 Oct 05 18:24:05.166944 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3177/6598] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 18:24:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315304105 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:24:05.870743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-94ba4e1d-0853-4e8e-91ff-057b35b781fb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:05.871261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-94ba4e1d-0853-4e8e-91ff-057b35b781fb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:05.877706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ba4e1d-0853-4e8e-91ff-057b35b781fb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:05.878205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ba4e1d-0853-4e8e-91ff-057b35b781fb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:05.878684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ba4e1d-0853-4e8e-91ff-057b35b781fb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:05.879389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ba4e1d-0853-4e8e-91ff-057b35b781fb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:05.879858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ba4e1d-0853-4e8e-91ff-057b35b781fb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:05.880297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-94ba4e1d-0853-4e8e-91ff-057b35b781fb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:05.964896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-94ba4e1d-0853-4e8e-91ff-057b35b781fb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lazy-loading 'services' on Instance uuid 618f8f8a-ba51-4638-b718-bf770b266f27 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:24:06.047066 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-94ba4e1d-0853-4e8e-91ff-057b35b781fb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments/943fd556-d7d9-4d13-b96e-8b83dfea9e76" status: 202 len: 0 microversion: 2.1 time: 0.180259 Oct 05 18:24:06.047692 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3422/6599] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:24:05 2022] DELETE /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments/943fd556-d7d9-4d13-b96e-8b83dfea9e76 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:24:06.056992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c10ad1e5-17ca-4219-bc1a-8996fa544f76 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:06.059335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c10ad1e5-17ca-4219-bc1a-8996fa544f76 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:06.066711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c10ad1e5-17ca-4219-bc1a-8996fa544f76 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:06.067448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c10ad1e5-17ca-4219-bc1a-8996fa544f76 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:06.068423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c10ad1e5-17ca-4219-bc1a-8996fa544f76 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:06.069279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c10ad1e5-17ca-4219-bc1a-8996fa544f76 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:06.069988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c10ad1e5-17ca-4219-bc1a-8996fa544f76 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:06.070457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c10ad1e5-17ca-4219-bc1a-8996fa544f76 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:06.103110 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c10ad1e5-17ca-4219-bc1a-8996fa544f76 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050945 Oct 05 18:24:06.103675 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3178/6600] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:24:06 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:07.117896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-467aedc6-1090-49e8-92d9-57dc2a8b39cd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:07.120309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-467aedc6-1090-49e8-92d9-57dc2a8b39cd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:07.127206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-467aedc6-1090-49e8-92d9-57dc2a8b39cd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:07.127706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-467aedc6-1090-49e8-92d9-57dc2a8b39cd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:07.128154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-467aedc6-1090-49e8-92d9-57dc2a8b39cd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:07.128867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-467aedc6-1090-49e8-92d9-57dc2a8b39cd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:07.129338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-467aedc6-1090-49e8-92d9-57dc2a8b39cd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:07.129779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-467aedc6-1090-49e8-92d9-57dc2a8b39cd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:07.160978 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-467aedc6-1090-49e8-92d9-57dc2a8b39cd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048470 Oct 05 18:24:07.161544 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3423/6601] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:24:07 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:08.173703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-432eaf4d-ee4e-42e4-b7aa-cd34d1aa477d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:08.176026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-432eaf4d-ee4e-42e4-b7aa-cd34d1aa477d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:08.183317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-432eaf4d-ee4e-42e4-b7aa-cd34d1aa477d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:08.183799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-432eaf4d-ee4e-42e4-b7aa-cd34d1aa477d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:08.184231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-432eaf4d-ee4e-42e4-b7aa-cd34d1aa477d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:08.184930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-432eaf4d-ee4e-42e4-b7aa-cd34d1aa477d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:08.185379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-432eaf4d-ee4e-42e4-b7aa-cd34d1aa477d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:08.185796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-432eaf4d-ee4e-42e4-b7aa-cd34d1aa477d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:08.219783 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-432eaf4d-ee4e-42e4-b7aa-cd34d1aa477d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050411 Oct 05 18:24:08.220357 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3179/6602] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:24:08 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:09.233656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0d362272-9372-45ba-8088-506062eadb17 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:09.236132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0d362272-9372-45ba-8088-506062eadb17 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:09.243070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d362272-9372-45ba-8088-506062eadb17 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:09.243575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d362272-9372-45ba-8088-506062eadb17 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:09.244029 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d362272-9372-45ba-8088-506062eadb17 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:09.244738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d362272-9372-45ba-8088-506062eadb17 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:09.245205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d362272-9372-45ba-8088-506062eadb17 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:09.245644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0d362272-9372-45ba-8088-506062eadb17 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:09.276546 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0d362272-9372-45ba-8088-506062eadb17 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047533 Oct 05 18:24:09.277112 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3424/6603] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:24:09 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:10.289430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea7c23c5-6c4c-48f7-9cc5-610457214334 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:10.291805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ea7c23c5-6c4c-48f7-9cc5-610457214334 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:10.299255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea7c23c5-6c4c-48f7-9cc5-610457214334 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:10.299823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea7c23c5-6c4c-48f7-9cc5-610457214334 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:10.300271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea7c23c5-6c4c-48f7-9cc5-610457214334 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:10.300967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea7c23c5-6c4c-48f7-9cc5-610457214334 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:10.301403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea7c23c5-6c4c-48f7-9cc5-610457214334 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:10.301842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea7c23c5-6c4c-48f7-9cc5-610457214334 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:10.335314 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ea7c23c5-6c4c-48f7-9cc5-610457214334 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049864 Oct 05 18:24:10.335885 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3180/6604] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:24:10 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:11.352034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ffcfa9c5-c5bc-44fd-9c11-fbe9521b8b79 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:11.355919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ffcfa9c5-c5bc-44fd-9c11-fbe9521b8b79 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:11.367727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffcfa9c5-c5bc-44fd-9c11-fbe9521b8b79 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:11.368564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffcfa9c5-c5bc-44fd-9c11-fbe9521b8b79 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:11.369304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffcfa9c5-c5bc-44fd-9c11-fbe9521b8b79 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:11.370538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffcfa9c5-c5bc-44fd-9c11-fbe9521b8b79 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:11.371313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffcfa9c5-c5bc-44fd-9c11-fbe9521b8b79 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:11.372054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffcfa9c5-c5bc-44fd-9c11-fbe9521b8b79 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:11.403661 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ffcfa9c5-c5bc-44fd-9c11-fbe9521b8b79 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058576 Oct 05 18:24:11.404218 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3425/6605] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:24:11 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 18:24:11.470684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-39ba6c50-3a4d-4e55-8a55-99ed847791d4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:11.471193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-39ba6c50-3a4d-4e55-8a55-99ed847791d4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:11.478611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39ba6c50-3a4d-4e55-8a55-99ed847791d4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:11.479074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39ba6c50-3a4d-4e55-8a55-99ed847791d4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:11.479763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39ba6c50-3a4d-4e55-8a55-99ed847791d4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:11.480447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39ba6c50-3a4d-4e55-8a55-99ed847791d4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:11.480905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39ba6c50-3a4d-4e55-8a55-99ed847791d4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:11.481459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-39ba6c50-3a4d-4e55-8a55-99ed847791d4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:11.508053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-39ba6c50-3a4d-4e55-8a55-99ed847791d4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:24:11.589955 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-39ba6c50-3a4d-4e55-8a55-99ed847791d4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 204 len: 0 microversion: 2.1 time: 0.124351 Oct 05 18:24:11.590869 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3181/6606] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:24:11 2022] DELETE /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:24:11.603138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0429170c-4df3-4afe-ada9-c472040e5882 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:11.603958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0429170c-4df3-4afe-ada9-c472040e5882 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:11.612147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0429170c-4df3-4afe-ada9-c472040e5882 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:11.612645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0429170c-4df3-4afe-ada9-c472040e5882 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:11.613086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0429170c-4df3-4afe-ada9-c472040e5882 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:11.613780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0429170c-4df3-4afe-ada9-c472040e5882 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:11.614245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0429170c-4df3-4afe-ada9-c472040e5882 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:11.614702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0429170c-4df3-4afe-ada9-c472040e5882 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:11.754021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0429170c-4df3-4afe-ada9-c472040e5882 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:11.767000 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0429170c-4df3-4afe-ada9-c472040e5882 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1679 microversion: 2.1 time: 0.170186 Oct 05 18:24:11.767597 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3426/6607] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:11 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:12.795643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5159299f-7527-4836-b847-feac6d2cb582 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:12.797690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5159299f-7527-4836-b847-feac6d2cb582 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:12.809624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5159299f-7527-4836-b847-feac6d2cb582 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:12.810499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5159299f-7527-4836-b847-feac6d2cb582 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:12.811239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5159299f-7527-4836-b847-feac6d2cb582 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:12.812430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5159299f-7527-4836-b847-feac6d2cb582 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:12.813257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5159299f-7527-4836-b847-feac6d2cb582 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:12.813685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5159299f-7527-4836-b847-feac6d2cb582 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:12.951638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5159299f-7527-4836-b847-feac6d2cb582 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:12.959913 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5159299f-7527-4836-b847-feac6d2cb582 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1679 microversion: 2.1 time: 0.171566 Oct 05 18:24:12.960487 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3182/6608] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:12 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:13.983917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ed727073-1c72-4676-a1f6-904c23a8a514 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:13.985107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ed727073-1c72-4676-a1f6-904c23a8a514 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:13.992037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed727073-1c72-4676-a1f6-904c23a8a514 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:13.992537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed727073-1c72-4676-a1f6-904c23a8a514 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:13.992986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed727073-1c72-4676-a1f6-904c23a8a514 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:13.993707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed727073-1c72-4676-a1f6-904c23a8a514 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:13.994183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed727073-1c72-4676-a1f6-904c23a8a514 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:13.994637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ed727073-1c72-4676-a1f6-904c23a8a514 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:14.079975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ed727073-1c72-4676-a1f6-904c23a8a514 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:14.088582 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ed727073-1c72-4676-a1f6-904c23a8a514 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 200 len: 1612 microversion: 2.1 time: 0.108615 Oct 05 18:24:14.089150 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3427/6609] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:13 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 1612 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:14.122194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b6858d04-f0c8-4b49-8aa2-2b83f8d88b53 req-34462d92-04d9-4322-8eee-6718cff77b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618f8f8a-ba51-4638-b718-bf770b266f27", "name": "network-vif-deleted", "tag": "f54ab38e-33ac-4401-9130-1c95e4df860e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:24:14.133793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b6858d04-f0c8-4b49-8aa2-2b83f8d88b53 req-34462d92-04d9-4322-8eee-6718cff77b53 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:14.134494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b6858d04-f0c8-4b49-8aa2-2b83f8d88b53 req-34462d92-04d9-4322-8eee-6718cff77b53 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:14.134931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b6858d04-f0c8-4b49-8aa2-2b83f8d88b53 req-34462d92-04d9-4322-8eee-6718cff77b53 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:14.147955 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b6858d04-f0c8-4b49-8aa2-2b83f8d88b53 req-34462d92-04d9-4322-8eee-6718cff77b53 service nova] Creating event network-vif-deleted:f54ab38e-33ac-4401-9130-1c95e4df860e for instance 618f8f8a-ba51-4638-b718-bf770b266f27 on n-h2-835595-3 Oct 05 18:24:14.153432 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b6858d04-f0c8-4b49-8aa2-2b83f8d88b53 req-34462d92-04d9-4322-8eee-6718cff77b53 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034897 Oct 05 18:24:14.157225 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3183/6610] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:15.113414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:15.114073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:15.121658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:15.122062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:15.122605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:15.123288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:15.123790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:15.124231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:15.139161 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 HTTP/1.1 Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '618f8f8a-ba51-4638-b718-bf770b266f27'} Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:24:15.140910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:15.146871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:24:15.146871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:24:15.146871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:24:15.146871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:24:15.146871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:24:15.146871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:24:15.146871 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:24:15.146871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:24:15.146871 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25b2474f-97ec-4aaf-8e71-70d153937680 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 404 len: 111 microversion: 2.1 time: 0.033090 Oct 05 18:24:15.146871 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3428/6611] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:15 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:24:15.152820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-342b7378-7c05-476f-8bce-408fd5cd534e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '.version_select at 0x7f777403b790>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:15.174548 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-342b7378-7c05-476f-8bce-408fd5cd534e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145591794" status: 202 len: 0 microversion: 2.1 time: 0.026761 Oct 05 18:24:15.175117 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3184/6612] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 18:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2145591794 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:24:15.808608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbbb0a54-b96b-4b44-942c-f8b8187ba0a6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: .version_select at 0x7f77751169d0>, body: {"keypair": {"name": "tempest-keypair-2021090474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiQMtZdMoj8+Ivga/Q88rieQd284NbnNSfwtTskQHPXNwMzqXkkDaMI6xduwTBOU1jqe0a3ILOO+CTZcWlM4R3nxoX9VWrDI2C7qfUXR0APQImmbN5BqO4YS7+sL8+vcA=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:24:15.824920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-dbbb0a54-b96b-4b44-942c-f8b8187ba0a6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for project 182080e008ca451c81350a9cad4d970e. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:24:15.832933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-dbbb0a54-b96b-4b44-942c-f8b8187ba0a6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for user dcf412de18ab4d64aff7c7514bf0eaba and project 182080e008ca451c81350a9cad4d970e. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:24:15.858454 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dbbb0a54-b96b-4b44-942c-f8b8187ba0a6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053764 Oct 05 18:24:15.859105 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3429/6613] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:24:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:17.435350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-573516402", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "417dd8ea-4fbe-437f-bb37-c563f90ec1cc"}], "security_groups": [{"name": "tempest-securitygroup--928946486"}], "key_name": "tempest-keypair-2021090474", "user_data": "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:24:17.544782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] validate_networks() for [('417dd8ea-4fbe-437f-bb37-c563f90ec1cc', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:24:17.928141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:24:17.928594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:24:17.929072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:24:17.929487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:24:17.929903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:24:17.939377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:17.939863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:17.940306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:17.941064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:17.941519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:17.941942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:17.959837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for project 182080e008ca451c81350a9cad4d970e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:24:17.965535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for user dcf412de18ab4d64aff7c7514bf0eaba and project 182080e008ca451c81350a9cad4d970e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:24:17.980101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:24:17.982632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:24:18.031974 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-143e4c54-4dd8-4060-94c3-bef55fc05e30 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.604535 Oct 05 18:24:18.032930 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3185/6614] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:24:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:24:18.047994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a30d87d3-b506-49c4-850f-55342245c9b5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:18.048815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a30d87d3-b506-49c4-850f-55342245c9b5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:18.103922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a30d87d3-b506-49c4-850f-55342245c9b5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:18.111789 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a30d87d3-b506-49c4-850f-55342245c9b5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1241 microversion: 2.1 time: 0.071270 Oct 05 18:24:18.112344 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3430/6615] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:18 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:19.137993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-49121728-1aa7-4383-acf3-bdf57ab018d3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:19.138643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-49121728-1aa7-4383-acf3-bdf57ab018d3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:19.146335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49121728-1aa7-4383-acf3-bdf57ab018d3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:19.147082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49121728-1aa7-4383-acf3-bdf57ab018d3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:19.147878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49121728-1aa7-4383-acf3-bdf57ab018d3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:19.148270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49121728-1aa7-4383-acf3-bdf57ab018d3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:19.148780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49121728-1aa7-4383-acf3-bdf57ab018d3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:19.149128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49121728-1aa7-4383-acf3-bdf57ab018d3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:19.216087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-49121728-1aa7-4383-acf3-bdf57ab018d3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:19.224063 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-49121728-1aa7-4383-acf3-bdf57ab018d3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1311 microversion: 2.1 time: 0.091736 Oct 05 18:24:19.224652 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3186/6616] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:19 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:20.248061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6620ee00-6ac5-4904-a694-49464dbafd3e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:20.248689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6620ee00-6ac5-4904-a694-49464dbafd3e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:20.257466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6620ee00-6ac5-4904-a694-49464dbafd3e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:20.257972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6620ee00-6ac5-4904-a694-49464dbafd3e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:20.258790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6620ee00-6ac5-4904-a694-49464dbafd3e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:20.259545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6620ee00-6ac5-4904-a694-49464dbafd3e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:20.259981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6620ee00-6ac5-4904-a694-49464dbafd3e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:20.260428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6620ee00-6ac5-4904-a694-49464dbafd3e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:20.461435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6620ee00-6ac5-4904-a694-49464dbafd3e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:20.469558 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6620ee00-6ac5-4904-a694-49464dbafd3e tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1366 microversion: 2.1 time: 0.225481 Oct 05 18:24:20.470149 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3431/6617] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:20 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:20.556017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f17ed588-6706-439e-86df-330b9b8cb951 req-fbbd7e81-90dc-437c-920f-36b4d71a9d06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2e5c73-96e0-44a1-a750-c9e98ecebf0d", "tag": "91b29620-ada6-46d7-b9b6-a639545a379f"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:24:20.567621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f17ed588-6706-439e-86df-330b9b8cb951 req-fbbd7e81-90dc-437c-920f-36b4d71a9d06 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:20.568113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f17ed588-6706-439e-86df-330b9b8cb951 req-fbbd7e81-90dc-437c-920f-36b4d71a9d06 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:20.568530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f17ed588-6706-439e-86df-330b9b8cb951 req-fbbd7e81-90dc-437c-920f-36b4d71a9d06 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:20.583515 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f17ed588-6706-439e-86df-330b9b8cb951 req-fbbd7e81-90dc-437c-920f-36b4d71a9d06 service nova] Creating event network-changed:91b29620-ada6-46d7-b9b6-a639545a379f for instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d on n-h2-835595-3 Oct 05 18:24:20.588624 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f17ed588-6706-439e-86df-330b9b8cb951 req-fbbd7e81-90dc-437c-920f-36b4d71a9d06 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036263 Oct 05 18:24:20.589306 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3187/6618] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:24:21.495954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-48bacf6d-2df2-4875-9b64-5e57fbeee3f6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:21.496968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-48bacf6d-2df2-4875-9b64-5e57fbeee3f6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:21.509051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48bacf6d-2df2-4875-9b64-5e57fbeee3f6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:21.509854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48bacf6d-2df2-4875-9b64-5e57fbeee3f6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:21.510890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48bacf6d-2df2-4875-9b64-5e57fbeee3f6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:21.511770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48bacf6d-2df2-4875-9b64-5e57fbeee3f6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:21.512502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48bacf6d-2df2-4875-9b64-5e57fbeee3f6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:21.513157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-48bacf6d-2df2-4875-9b64-5e57fbeee3f6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:21.664645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-48bacf6d-2df2-4875-9b64-5e57fbeee3f6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:21.672831 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-48bacf6d-2df2-4875-9b64-5e57fbeee3f6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1366 microversion: 2.1 time: 0.184369 Oct 05 18:24:21.673415 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3432/6619] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:21 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:22.697463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-18243bd6-387a-4074-becc-fde14065fbf1 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:22.698143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-18243bd6-387a-4074-becc-fde14065fbf1 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:22.705019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18243bd6-387a-4074-becc-fde14065fbf1 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:22.705522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18243bd6-387a-4074-becc-fde14065fbf1 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:22.705929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18243bd6-387a-4074-becc-fde14065fbf1 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:22.706705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18243bd6-387a-4074-becc-fde14065fbf1 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:22.707164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18243bd6-387a-4074-becc-fde14065fbf1 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:22.707587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-18243bd6-387a-4074-becc-fde14065fbf1 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:22.850489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-18243bd6-387a-4074-becc-fde14065fbf1 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:22.859213 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-18243bd6-387a-4074-becc-fde14065fbf1 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1366 microversion: 2.1 time: 0.167073 Oct 05 18:24:22.859861 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3188/6620] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:22 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:23.882510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5c0e7816-8ca2-40fd-8337-d3b79218c553 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:23.883192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5c0e7816-8ca2-40fd-8337-d3b79218c553 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:23.890963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c0e7816-8ca2-40fd-8337-d3b79218c553 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:23.891448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c0e7816-8ca2-40fd-8337-d3b79218c553 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:23.891891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c0e7816-8ca2-40fd-8337-d3b79218c553 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:23.892638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c0e7816-8ca2-40fd-8337-d3b79218c553 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:23.893110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c0e7816-8ca2-40fd-8337-d3b79218c553 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:23.893543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5c0e7816-8ca2-40fd-8337-d3b79218c553 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:24.028735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5c0e7816-8ca2-40fd-8337-d3b79218c553 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:24.036654 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5c0e7816-8ca2-40fd-8337-d3b79218c553 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1366 microversion: 2.1 time: 0.158226 Oct 05 18:24:24.037239 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3433/6621] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:23 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:25.059790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2732687e-0ba2-4c1f-ba21-9e85c4c3d3a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:25.060410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2732687e-0ba2-4c1f-ba21-9e85c4c3d3a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:25.067698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2732687e-0ba2-4c1f-ba21-9e85c4c3d3a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:25.068181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2732687e-0ba2-4c1f-ba21-9e85c4c3d3a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:25.068623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2732687e-0ba2-4c1f-ba21-9e85c4c3d3a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:25.069317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2732687e-0ba2-4c1f-ba21-9e85c4c3d3a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:25.069765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2732687e-0ba2-4c1f-ba21-9e85c4c3d3a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:25.070218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2732687e-0ba2-4c1f-ba21-9e85c4c3d3a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:25.199816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2732687e-0ba2-4c1f-ba21-9e85c4c3d3a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:25.209790 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2732687e-0ba2-4c1f-ba21-9e85c4c3d3a2 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1366 microversion: 2.1 time: 0.153610 Oct 05 18:24:25.213215 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3189/6622] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:25 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:25.912086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6c864d87-93c1-41cf-8a8b-f06c2100da8c req-4c0e2214-fec1-4b59-9c2d-ad811d473f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2e5c73-96e0-44a1-a750-c9e98ecebf0d", "name": "network-vif-plugged", "status": "completed", "tag": "91b29620-ada6-46d7-b9b6-a639545a379f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:24:25.926959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6c864d87-93c1-41cf-8a8b-f06c2100da8c req-4c0e2214-fec1-4b59-9c2d-ad811d473f18 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:25.927463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6c864d87-93c1-41cf-8a8b-f06c2100da8c req-4c0e2214-fec1-4b59-9c2d-ad811d473f18 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:25.928125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6c864d87-93c1-41cf-8a8b-f06c2100da8c req-4c0e2214-fec1-4b59-9c2d-ad811d473f18 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:25.939938 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6c864d87-93c1-41cf-8a8b-f06c2100da8c req-4c0e2214-fec1-4b59-9c2d-ad811d473f18 service nova] Creating event network-vif-plugged:91b29620-ada6-46d7-b9b6-a639545a379f for instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d on n-h2-835595-3 Oct 05 18:24:25.944991 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6c864d87-93c1-41cf-8a8b-f06c2100da8c req-4c0e2214-fec1-4b59-9c2d-ad811d473f18 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036865 Oct 05 18:24:25.945599 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3434/6623] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:26.244644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2f5abff7-fede-4bc6-bd04-fb1426897532 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:26.245309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2f5abff7-fede-4bc6-bd04-fb1426897532 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:26.252719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f5abff7-fede-4bc6-bd04-fb1426897532 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:26.253236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f5abff7-fede-4bc6-bd04-fb1426897532 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:26.253723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f5abff7-fede-4bc6-bd04-fb1426897532 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:26.254519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f5abff7-fede-4bc6-bd04-fb1426897532 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:26.255324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f5abff7-fede-4bc6-bd04-fb1426897532 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:26.255570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2f5abff7-fede-4bc6-bd04-fb1426897532 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:26.260308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:24:26.390172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2f5abff7-fede-4bc6-bd04-fb1426897532 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:26.398060 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2f5abff7-fede-4bc6-bd04-fb1426897532 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1366 microversion: 2.1 time: 0.157366 Oct 05 18:24:26.398672 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3190/6624] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:26 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:27.425450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d593539e-1f30-4059-a37d-a8c22ad8f4fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:27.426162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d593539e-1f30-4059-a37d-a8c22ad8f4fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:27.432869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d593539e-1f30-4059-a37d-a8c22ad8f4fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:27.433405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d593539e-1f30-4059-a37d-a8c22ad8f4fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:27.433868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d593539e-1f30-4059-a37d-a8c22ad8f4fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:27.434579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d593539e-1f30-4059-a37d-a8c22ad8f4fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:27.435048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d593539e-1f30-4059-a37d-a8c22ad8f4fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:27.435484 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d593539e-1f30-4059-a37d-a8c22ad8f4fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:27.576778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d593539e-1f30-4059-a37d-a8c22ad8f4fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:24:27.584814 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d593539e-1f30-4059-a37d-a8c22ad8f4fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1556 microversion: 2.1 time: 0.166129 Oct 05 18:24:27.585395 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3435/6625] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:24:27 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:24:27.616547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5eb6420-542c-4f44-9849-5fd6290416fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:24:27.617097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5eb6420-542c-4f44-9849-5fd6290416fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:24:27.624429 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5eb6420-542c-4f44-9849-5fd6290416fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:27.624916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5eb6420-542c-4f44-9849-5fd6290416fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:27.625416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5eb6420-542c-4f44-9849-5fd6290416fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:27.626111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5eb6420-542c-4f44-9849-5fd6290416fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:27.626600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5eb6420-542c-4f44-9849-5fd6290416fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:27.627031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5eb6420-542c-4f44-9849-5fd6290416fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:27.707530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c5eb6420-542c-4f44-9849-5fd6290416fe tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094798 Oct 05 18:24:27.708374 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3191/6626] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 18:24:27 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:24:28.717083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a79a29a1-b21a-4b64-9f69-d294d1796375 req-d28af70b-21b8-4727-b956-3389f5d4d953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2e5c73-96e0-44a1-a750-c9e98ecebf0d", "tag": "91b29620-ada6-46d7-b9b6-a639545a379f"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:24:28.722049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:24:28.728795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a79a29a1-b21a-4b64-9f69-d294d1796375 req-d28af70b-21b8-4727-b956-3389f5d4d953 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:24:28.729263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a79a29a1-b21a-4b64-9f69-d294d1796375 req-d28af70b-21b8-4727-b956-3389f5d4d953 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:24:28.729703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a79a29a1-b21a-4b64-9f69-d294d1796375 req-d28af70b-21b8-4727-b956-3389f5d4d953 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:24:28.741067 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a79a29a1-b21a-4b64-9f69-d294d1796375 req-d28af70b-21b8-4727-b956-3389f5d4d953 service nova] Creating event network-changed:91b29620-ada6-46d7-b9b6-a639545a379f for instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d on n-h2-835595-3 Oct 05 18:24:28.746158 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a79a29a1-b21a-4b64-9f69-d294d1796375 req-d28af70b-21b8-4727-b956-3389f5d4d953 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032813 Oct 05 18:24:28.746794 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3436/6627] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:04.749466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:04.750789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:04.753676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:04.754536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:04.759499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e829dcdf-e7a2-4f30-adfb-1fce8ac151ba tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:04.760081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e829dcdf-e7a2-4f30-adfb-1fce8ac151ba tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:04.768908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e829dcdf-e7a2-4f30-adfb-1fce8ac151ba tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:04.769419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e829dcdf-e7a2-4f30-adfb-1fce8ac151ba tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:04.769914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e829dcdf-e7a2-4f30-adfb-1fce8ac151ba tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:04.770642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e829dcdf-e7a2-4f30-adfb-1fce8ac151ba tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:04.771101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e829dcdf-e7a2-4f30-adfb-1fce8ac151ba tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:04.771528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e829dcdf-e7a2-4f30-adfb-1fce8ac151ba tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:04.797233 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e829dcdf-e7a2-4f30-adfb-1fce8ac151ba tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/ips" status: 200 len: 149 microversion: 2.1 time: 0.049352 Oct 05 18:25:04.797827 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3192/6628] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 18:25:04 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:06.143816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:06.144635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:06.149166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e7a196f8-154d-45cb-b659-2be4a46a483f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04627626-3e66-4e54-b2be-9a659d6b01b9"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:25:06.151733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e7a196f8-154d-45cb-b659-2be4a46a483f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:06.160710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7a196f8-154d-45cb-b659-2be4a46a483f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:06.161473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7a196f8-154d-45cb-b659-2be4a46a483f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:06.161926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7a196f8-154d-45cb-b659-2be4a46a483f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:06.162681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7a196f8-154d-45cb-b659-2be4a46a483f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:06.163136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7a196f8-154d-45cb-b659-2be4a46a483f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:06.163572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e7a196f8-154d-45cb-b659-2be4a46a483f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:06.432940 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e7a196f8-154d-45cb-b659-2be4a46a483f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291116 Oct 05 18:25:06.433609 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3437/6629] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:25:06 2022] POST /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:17.209514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04627626-3e66-4e54-b2be-9a659d6b01b9"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:25:17.212021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:17.215200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:17.220537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:17.221019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:17.221458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:17.222161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:17.222657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:17.223114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:17.302917 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Invalid volume: volume 04627626-3e66-4e54-b2be-9a659d6b01b9 is already attached to instances: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments HTTP/1.1 Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 74 Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: {"volumeAttachment": {"volumeId": "04627626-3e66-4e54-b2be-9a659d6b01b9"}} Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid volume: volume 04627626-3e66-4e54-b2be-9a659d6b01b9 is already attached to instances: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'server_id': 'aa2e5c73-96e0-44a1-a750-c9e98ecebf0d', 'body': {'volumeAttachment': {'volumeId': '04627626-3e66-4e54-b2be-9a659d6b01b9'}}} Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 04627626-3e66-4e54-b2be-9a659d6b01b9 is already attached to instances: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:25:17.304684 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 04627626-3e66-4e54-b2be-9a659d6b01b9 is already attached to instances: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 04627626-3e66-4e54-b2be-9a659d6b01b9 is already attached to instances: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 400 to user: Invalid volume: volume 04627626-3e66-4e54-b2be-9a659d6b01b9 is already attached to instances: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-433d4fa4-6650-4e71-b7c9-6a24c335b1ca tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100903 Oct 05 18:25:17.309692 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3193/6630] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:25:17 2022] POST /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:25:17.379345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:17.380146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:17.384736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-199f73b9-abed-44a8-8995-016054cdc5ae tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:17.385332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-199f73b9-abed-44a8-8995-016054cdc5ae tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:17.392688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-199f73b9-abed-44a8-8995-016054cdc5ae tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:17.393185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-199f73b9-abed-44a8-8995-016054cdc5ae tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:17.393638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-199f73b9-abed-44a8-8995-016054cdc5ae tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:17.394486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-199f73b9-abed-44a8-8995-016054cdc5ae tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:17.395049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-199f73b9-abed-44a8-8995-016054cdc5ae tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:17.395483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-199f73b9-abed-44a8-8995-016054cdc5ae tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:17.482385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-199f73b9-abed-44a8-8995-016054cdc5ae tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lazy-loading 'services' on Instance uuid aa2e5c73-96e0-44a1-a750-c9e98ecebf0d {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:25:17.576250 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-199f73b9-abed-44a8-8995-016054cdc5ae tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments/04627626-3e66-4e54-b2be-9a659d6b01b9" status: 202 len: 0 microversion: 2.1 time: 0.198749 Oct 05 18:25:17.576856 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3438/6631] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:25:17 2022] DELETE /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments/04627626-3e66-4e54-b2be-9a659d6b01b9 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:25:17.586832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-40ca9528-aca0-43af-84c2-34e0fa6a008d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:17.589179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-40ca9528-aca0-43af-84c2-34e0fa6a008d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:17.596717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ca9528-aca0-43af-84c2-34e0fa6a008d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:17.597217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ca9528-aca0-43af-84c2-34e0fa6a008d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:17.597655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ca9528-aca0-43af-84c2-34e0fa6a008d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:17.598468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ca9528-aca0-43af-84c2-34e0fa6a008d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:17.598953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ca9528-aca0-43af-84c2-34e0fa6a008d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:17.599337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40ca9528-aca0-43af-84c2-34e0fa6a008d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:17.630252 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-40ca9528-aca0-43af-84c2-34e0fa6a008d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047515 Oct 05 18:25:17.630834 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3194/6632] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:25:17 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:18.645203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-afc2faa0-f674-445c-983a-89f4ddfa255d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:18.647741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-afc2faa0-f674-445c-983a-89f4ddfa255d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:18.654622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc2faa0-f674-445c-983a-89f4ddfa255d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:18.655121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc2faa0-f674-445c-983a-89f4ddfa255d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:18.655565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc2faa0-f674-445c-983a-89f4ddfa255d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:18.656255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc2faa0-f674-445c-983a-89f4ddfa255d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:18.656727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc2faa0-f674-445c-983a-89f4ddfa255d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:18.657148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc2faa0-f674-445c-983a-89f4ddfa255d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:18.688803 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-afc2faa0-f674-445c-983a-89f4ddfa255d tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048838 Oct 05 18:25:18.689672 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3439/6633] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:25:18 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:19.703521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-01dd66ca-856f-4178-99a0-cb99e4cbddd7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:19.705743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-01dd66ca-856f-4178-99a0-cb99e4cbddd7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:19.713145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01dd66ca-856f-4178-99a0-cb99e4cbddd7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:19.713632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01dd66ca-856f-4178-99a0-cb99e4cbddd7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:19.714071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01dd66ca-856f-4178-99a0-cb99e4cbddd7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:19.714805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01dd66ca-856f-4178-99a0-cb99e4cbddd7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:19.715259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01dd66ca-856f-4178-99a0-cb99e4cbddd7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:19.715683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01dd66ca-856f-4178-99a0-cb99e4cbddd7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:19.749289 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-01dd66ca-856f-4178-99a0-cb99e4cbddd7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050023 Oct 05 18:25:19.749873 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3195/6634] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:25:19 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:20.766105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-db06d73f-c372-4eb8-8d36-5f72ef15eec0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:20.768358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-db06d73f-c372-4eb8-8d36-5f72ef15eec0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:20.776033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db06d73f-c372-4eb8-8d36-5f72ef15eec0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:20.776538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db06d73f-c372-4eb8-8d36-5f72ef15eec0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:20.776990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db06d73f-c372-4eb8-8d36-5f72ef15eec0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:20.777707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db06d73f-c372-4eb8-8d36-5f72ef15eec0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:20.778195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db06d73f-c372-4eb8-8d36-5f72ef15eec0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:20.778651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-db06d73f-c372-4eb8-8d36-5f72ef15eec0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:20.809819 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-db06d73f-c372-4eb8-8d36-5f72ef15eec0 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048866 Oct 05 18:25:20.810423 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3440/6635] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:25:20 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:21.823007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2fae8a14-bfda-4abc-a6d2-c67b91435100 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:21.825246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2fae8a14-bfda-4abc-a6d2-c67b91435100 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:21.832615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fae8a14-bfda-4abc-a6d2-c67b91435100 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:21.833149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fae8a14-bfda-4abc-a6d2-c67b91435100 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:21.833632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fae8a14-bfda-4abc-a6d2-c67b91435100 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:21.834371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fae8a14-bfda-4abc-a6d2-c67b91435100 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:21.834823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fae8a14-bfda-4abc-a6d2-c67b91435100 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:21.835250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2fae8a14-bfda-4abc-a6d2-c67b91435100 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:21.866544 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2fae8a14-bfda-4abc-a6d2-c67b91435100 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047647 Oct 05 18:25:21.867123 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3196/6636] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:25:21 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:22.884276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-438f8238-9a40-46dd-8538-3ebcc91e3346 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:22.887192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-438f8238-9a40-46dd-8538-3ebcc91e3346 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:22.897688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438f8238-9a40-46dd-8538-3ebcc91e3346 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:22.898329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438f8238-9a40-46dd-8538-3ebcc91e3346 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:22.898937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438f8238-9a40-46dd-8538-3ebcc91e3346 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:22.899961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438f8238-9a40-46dd-8538-3ebcc91e3346 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:22.900549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438f8238-9a40-46dd-8538-3ebcc91e3346 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:22.901153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-438f8238-9a40-46dd-8538-3ebcc91e3346 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:22.933086 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-438f8238-9a40-46dd-8538-3ebcc91e3346 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056224 Oct 05 18:25:22.933686 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3441/6637] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:25:22 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 18:25:22.998006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa59b36c-439b-4dd2-b5b9-0db36e4ff6c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:22.998581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fa59b36c-439b-4dd2-b5b9-0db36e4ff6c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:23.005856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa59b36c-439b-4dd2-b5b9-0db36e4ff6c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:23.006369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa59b36c-439b-4dd2-b5b9-0db36e4ff6c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:23.006811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa59b36c-439b-4dd2-b5b9-0db36e4ff6c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:23.007513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa59b36c-439b-4dd2-b5b9-0db36e4ff6c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:23.007967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa59b36c-439b-4dd2-b5b9-0db36e4ff6c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:23.008398 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa59b36c-439b-4dd2-b5b9-0db36e4ff6c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:23.035003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fa59b36c-439b-4dd2-b5b9-0db36e4ff6c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:25:23.114860 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa59b36c-439b-4dd2-b5b9-0db36e4ff6c4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 204 len: 0 microversion: 2.1 time: 0.120458 Oct 05 18:25:23.115455 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3197/6638] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:25:22 2022] DELETE /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:25:23.123918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc8a85de-c7ec-48ab-a485-f3fe32354edd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:23.124593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc8a85de-c7ec-48ab-a485-f3fe32354edd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:23.130958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8a85de-c7ec-48ab-a485-f3fe32354edd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:23.131430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8a85de-c7ec-48ab-a485-f3fe32354edd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:23.131879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8a85de-c7ec-48ab-a485-f3fe32354edd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:23.132584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8a85de-c7ec-48ab-a485-f3fe32354edd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:23.133104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8a85de-c7ec-48ab-a485-f3fe32354edd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:23.133487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc8a85de-c7ec-48ab-a485-f3fe32354edd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:23.274324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc8a85de-c7ec-48ab-a485-f3fe32354edd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:23.283606 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc8a85de-c7ec-48ab-a485-f3fe32354edd tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1680 microversion: 2.1 time: 0.163669 Oct 05 18:25:23.284203 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3442/6639] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:23 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:24.313327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a0232076-c651-49bb-8810-9d0287d27e67 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:24.314605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a0232076-c651-49bb-8810-9d0287d27e67 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:24.323066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0232076-c651-49bb-8810-9d0287d27e67 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:24.323741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0232076-c651-49bb-8810-9d0287d27e67 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:24.324173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0232076-c651-49bb-8810-9d0287d27e67 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:24.324880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0232076-c651-49bb-8810-9d0287d27e67 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:24.325330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0232076-c651-49bb-8810-9d0287d27e67 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:24.325734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a0232076-c651-49bb-8810-9d0287d27e67 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:24.475325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a0232076-c651-49bb-8810-9d0287d27e67 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:24.485102 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a0232076-c651-49bb-8810-9d0287d27e67 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1680 microversion: 2.1 time: 0.179449 Oct 05 18:25:24.485677 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3198/6640] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:24 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1680 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:25.509371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c962831-9996-41bf-8f8c-42b73b956745 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:25.510010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8c962831-9996-41bf-8f8c-42b73b956745 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:25.517772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c962831-9996-41bf-8f8c-42b73b956745 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:25.518378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c962831-9996-41bf-8f8c-42b73b956745 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:25.518744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c962831-9996-41bf-8f8c-42b73b956745 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:25.519623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c962831-9996-41bf-8f8c-42b73b956745 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:25.520189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c962831-9996-41bf-8f8c-42b73b956745 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:25.520873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c962831-9996-41bf-8f8c-42b73b956745 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:25.590966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8c962831-9996-41bf-8f8c-42b73b956745 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:25.603046 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8c962831-9996-41bf-8f8c-42b73b956745 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 200 len: 1613 microversion: 2.1 time: 0.097098 Oct 05 18:25:25.603046 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3443/6641] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:25 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:25.737835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3f89fc47-c2c6-4b15-9ef4-48741a8ee58d req-6d564069-22c9-4a3c-ae2f-a8340973a6cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2e5c73-96e0-44a1-a750-c9e98ecebf0d", "name": "network-vif-deleted", "tag": "91b29620-ada6-46d7-b9b6-a639545a379f"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:25:25.753883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3f89fc47-c2c6-4b15-9ef4-48741a8ee58d req-6d564069-22c9-4a3c-ae2f-a8340973a6cb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:25.755067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3f89fc47-c2c6-4b15-9ef4-48741a8ee58d req-6d564069-22c9-4a3c-ae2f-a8340973a6cb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:25.755737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3f89fc47-c2c6-4b15-9ef4-48741a8ee58d req-6d564069-22c9-4a3c-ae2f-a8340973a6cb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:25.770397 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3f89fc47-c2c6-4b15-9ef4-48741a8ee58d req-6d564069-22c9-4a3c-ae2f-a8340973a6cb service nova] Creating event network-vif-deleted:91b29620-ada6-46d7-b9b6-a639545a379f for instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d on n-h2-835595-3 Oct 05 18:25:25.777178 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3f89fc47-c2c6-4b15-9ef4-48741a8ee58d req-6d564069-22c9-4a3c-ae2f-a8340973a6cb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120632 Oct 05 18:25:25.778367 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3199/6642] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:26.629307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:26.630081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:26.637876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:26.638412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:26.638860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:26.639587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:26.640054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:26.640487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:26.654557 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d HTTP/1.1 Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'aa2e5c73-96e0-44a1-a750-c9e98ecebf0d'} Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:25:26.656276 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:25:26.661909 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:25:26.661909 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:25:26.661909 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:25:26.661909 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:25:26.661909 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:25:26.661909 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:25:26.661909 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:25:26.661909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:25:26.661909 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd983ec1-51da-422f-83e2-82631194f7c5 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 404 len: 111 microversion: 2.1 time: 0.032389 Oct 05 18:25:26.661909 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3444/6643] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:26 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:25:26.668486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-35509c5e-7da7-42e1-86a3-4af5d89f81ab tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '.version_select at 0x7f776ff9b0d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:26.692125 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-35509c5e-7da7-42e1-86a3-4af5d89f81ab tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021090474" status: 202 len: 0 microversion: 2.1 time: 0.027850 Oct 05 18:25:26.694313 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3200/6644] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 18:25:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021090474 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:25:27.354320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f9a9b28-062c-46be-bb89-4781452c4c77 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: .version_select at 0x7f7776aef820>, body: {"keypair": {"name": "tempest-keypair-213345284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHPRfVhDGk0rxQfFOSlfe3h4iLr6J7CRUEdf4FV9+Kwas34+2iV+mAavJUBzVPmVPJoKHwW7pr2MSzupZzhPBFI7yZ1hqoDlPTdaK+m+cMQSZQgjot89DejJy3/BxxzTCw=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:25:27.370916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-2f9a9b28-062c-46be-bb89-4781452c4c77 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for project 182080e008ca451c81350a9cad4d970e. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:25:27.376131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-2f9a9b28-062c-46be-bb89-4781452c4c77 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for user dcf412de18ab4d64aff7c7514bf0eaba and project 182080e008ca451c81350a9cad4d970e. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:25:27.403798 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f9a9b28-062c-46be-bb89-4781452c4c77 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053579 Oct 05 18:25:27.404424 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3445/6645] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:25:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:28.715732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2114105911", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "417dd8ea-4fbe-437f-bb37-c563f90ec1cc"}], "security_groups": [{"name": "tempest-securitygroup--805248407"}], "key_name": "tempest-keypair-213345284", "user_data": "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:25:28.826036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] validate_networks() for [('417dd8ea-4fbe-437f-bb37-c563f90ec1cc', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:25:29.232976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:25:29.233399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:25:29.233900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:25:29.234324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:25:29.234871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:25:29.244972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:29.245454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:29.245886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:29.246667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:29.247111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:29.247526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:29.266787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for project 182080e008ca451c81350a9cad4d970e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:25:29.272208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Getting quotas for user dcf412de18ab4d64aff7c7514bf0eaba and project 182080e008ca451c81350a9cad4d970e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:25:29.286060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:25:29.288639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:25:29.341445 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a578814b-e7d2-4d27-a582-e6b83d664287 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.631548 Oct 05 18:25:29.342202 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3201/6646] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:25:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:25:29.354872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5aad2a40-0665-4e47-8390-d10581b7be60 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:29.355599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5aad2a40-0665-4e47-8390-d10581b7be60 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:29.411646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5aad2a40-0665-4e47-8390-d10581b7be60 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:29.420478 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5aad2a40-0665-4e47-8390-d10581b7be60 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1241 microversion: 2.1 time: 0.070446 Oct 05 18:25:29.421066 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3446/6647] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:29 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:30.449030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0bafb033-eb6e-4f04-b0e4-85edaa4794df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:30.449733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0bafb033-eb6e-4f04-b0e4-85edaa4794df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:30.474153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bafb033-eb6e-4f04-b0e4-85edaa4794df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:30.475051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bafb033-eb6e-4f04-b0e4-85edaa4794df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:30.476093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bafb033-eb6e-4f04-b0e4-85edaa4794df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:30.477490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bafb033-eb6e-4f04-b0e4-85edaa4794df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:30.478797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bafb033-eb6e-4f04-b0e4-85edaa4794df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:30.479798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0bafb033-eb6e-4f04-b0e4-85edaa4794df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:30.562785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0bafb033-eb6e-4f04-b0e4-85edaa4794df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:30.570799 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0bafb033-eb6e-4f04-b0e4-85edaa4794df tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1311 microversion: 2.1 time: 0.130024 Oct 05 18:25:30.571619 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3202/6648] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:30 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1311 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:25:31.594982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-96714005-32cb-45a6-9d47-45504a97100f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:31.596028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-96714005-32cb-45a6-9d47-45504a97100f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:31.603756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96714005-32cb-45a6-9d47-45504a97100f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:31.604590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96714005-32cb-45a6-9d47-45504a97100f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:31.605118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96714005-32cb-45a6-9d47-45504a97100f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:31.606055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96714005-32cb-45a6-9d47-45504a97100f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:31.606626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96714005-32cb-45a6-9d47-45504a97100f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:31.607196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-96714005-32cb-45a6-9d47-45504a97100f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:31.814847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-96714005-32cb-45a6-9d47-45504a97100f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:31.823287 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-96714005-32cb-45a6-9d47-45504a97100f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1366 microversion: 2.1 time: 0.232802 Oct 05 18:25:31.823906 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3447/6649] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:31 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:31.916757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-df5d4ced-5381-4738-b126-1de004006aa5 req-90b40cb8-96ce-4dc6-a6ef-328b519397a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e7f53b-3ac1-4414-a6b3-0bc967fd146d", "tag": "b31bf10c-9d05-4a2b-8c40-06f171ee1d20"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:25:31.928813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-df5d4ced-5381-4738-b126-1de004006aa5 req-90b40cb8-96ce-4dc6-a6ef-328b519397a8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:31.929576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-df5d4ced-5381-4738-b126-1de004006aa5 req-90b40cb8-96ce-4dc6-a6ef-328b519397a8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:31.930194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-df5d4ced-5381-4738-b126-1de004006aa5 req-90b40cb8-96ce-4dc6-a6ef-328b519397a8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:31.944954 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-df5d4ced-5381-4738-b126-1de004006aa5 req-90b40cb8-96ce-4dc6-a6ef-328b519397a8 service nova] Creating event network-changed:b31bf10c-9d05-4a2b-8c40-06f171ee1d20 for instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d on n-h2-835595-3 Oct 05 18:25:31.950494 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-df5d4ced-5381-4738-b126-1de004006aa5 req-90b40cb8-96ce-4dc6-a6ef-328b519397a8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037651 Oct 05 18:25:31.951452 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3203/6650] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:32.850974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f026d21e-eb18-47aa-9023-d9170ba5733b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:32.851998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f026d21e-eb18-47aa-9023-d9170ba5733b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:32.863942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f026d21e-eb18-47aa-9023-d9170ba5733b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:32.864754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f026d21e-eb18-47aa-9023-d9170ba5733b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:32.865214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f026d21e-eb18-47aa-9023-d9170ba5733b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:32.865932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f026d21e-eb18-47aa-9023-d9170ba5733b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:32.866451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f026d21e-eb18-47aa-9023-d9170ba5733b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:32.866918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f026d21e-eb18-47aa-9023-d9170ba5733b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:33.001469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f026d21e-eb18-47aa-9023-d9170ba5733b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:33.009983 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f026d21e-eb18-47aa-9023-d9170ba5733b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1366 microversion: 2.1 time: 0.165666 Oct 05 18:25:33.010612 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3448/6651] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:32 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:34.034975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8e69617a-0b7f-4e1c-ad39-6804ed1ede4b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:34.035841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8e69617a-0b7f-4e1c-ad39-6804ed1ede4b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:34.042723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e69617a-0b7f-4e1c-ad39-6804ed1ede4b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:34.043213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e69617a-0b7f-4e1c-ad39-6804ed1ede4b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:34.043650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e69617a-0b7f-4e1c-ad39-6804ed1ede4b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:34.044339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e69617a-0b7f-4e1c-ad39-6804ed1ede4b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:34.044790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e69617a-0b7f-4e1c-ad39-6804ed1ede4b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:34.045209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8e69617a-0b7f-4e1c-ad39-6804ed1ede4b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:34.191926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8e69617a-0b7f-4e1c-ad39-6804ed1ede4b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:34.200159 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8e69617a-0b7f-4e1c-ad39-6804ed1ede4b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1366 microversion: 2.1 time: 0.170861 Oct 05 18:25:34.200739 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3204/6652] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:34 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:35.227670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8316e8b7-c494-46cf-8c1b-31323af1ab0b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:35.228670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8316e8b7-c494-46cf-8c1b-31323af1ab0b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:35.240084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8316e8b7-c494-46cf-8c1b-31323af1ab0b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:35.240596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8316e8b7-c494-46cf-8c1b-31323af1ab0b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:35.241044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8316e8b7-c494-46cf-8c1b-31323af1ab0b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:35.241775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8316e8b7-c494-46cf-8c1b-31323af1ab0b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:35.242256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8316e8b7-c494-46cf-8c1b-31323af1ab0b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:35.242729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8316e8b7-c494-46cf-8c1b-31323af1ab0b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:35.379066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8316e8b7-c494-46cf-8c1b-31323af1ab0b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:35.388434 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8316e8b7-c494-46cf-8c1b-31323af1ab0b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1366 microversion: 2.1 time: 0.167657 Oct 05 18:25:35.389036 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3449/6653] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:35 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:36.411821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b980baa-c703-49fa-b67a-80c02b57e0f8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:36.412450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7b980baa-c703-49fa-b67a-80c02b57e0f8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:36.421653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b980baa-c703-49fa-b67a-80c02b57e0f8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:36.422671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b980baa-c703-49fa-b67a-80c02b57e0f8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:36.423483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b980baa-c703-49fa-b67a-80c02b57e0f8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:36.424477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b980baa-c703-49fa-b67a-80c02b57e0f8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:36.425000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b980baa-c703-49fa-b67a-80c02b57e0f8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:36.425607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b980baa-c703-49fa-b67a-80c02b57e0f8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:36.561895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7b980baa-c703-49fa-b67a-80c02b57e0f8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:36.570621 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7b980baa-c703-49fa-b67a-80c02b57e0f8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1366 microversion: 2.1 time: 0.163254 Oct 05 18:25:36.571368 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3205/6654] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:36 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:37.594617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3d96ca8c-a11e-47eb-b4a2-d23ac2762538 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:37.595296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3d96ca8c-a11e-47eb-b4a2-d23ac2762538 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:37.602527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d96ca8c-a11e-47eb-b4a2-d23ac2762538 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:37.603032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d96ca8c-a11e-47eb-b4a2-d23ac2762538 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:37.603487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d96ca8c-a11e-47eb-b4a2-d23ac2762538 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:37.604199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d96ca8c-a11e-47eb-b4a2-d23ac2762538 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:37.604780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d96ca8c-a11e-47eb-b4a2-d23ac2762538 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:37.605226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3d96ca8c-a11e-47eb-b4a2-d23ac2762538 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:37.745710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3d96ca8c-a11e-47eb-b4a2-d23ac2762538 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:37.754132 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3d96ca8c-a11e-47eb-b4a2-d23ac2762538 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1366 microversion: 2.1 time: 0.163697 Oct 05 18:25:37.754742 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3450/6655] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:37 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:38.294569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5204449e-80f1-49be-96a0-266aeedeebbd req-eeec1869-e4d1-4ebb-af42-d66521d20a42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e7f53b-3ac1-4414-a6b3-0bc967fd146d", "name": "network-vif-plugged", "status": "completed", "tag": "b31bf10c-9d05-4a2b-8c40-06f171ee1d20"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:25:38.304203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5204449e-80f1-49be-96a0-266aeedeebbd req-eeec1869-e4d1-4ebb-af42-d66521d20a42 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:38.304682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5204449e-80f1-49be-96a0-266aeedeebbd req-eeec1869-e4d1-4ebb-af42-d66521d20a42 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:38.305109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5204449e-80f1-49be-96a0-266aeedeebbd req-eeec1869-e4d1-4ebb-af42-d66521d20a42 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:38.315961 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5204449e-80f1-49be-96a0-266aeedeebbd req-eeec1869-e4d1-4ebb-af42-d66521d20a42 service nova] Creating event network-vif-plugged:b31bf10c-9d05-4a2b-8c40-06f171ee1d20 for instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d on n-h2-835595-3 Oct 05 18:25:38.321009 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5204449e-80f1-49be-96a0-266aeedeebbd req-eeec1869-e4d1-4ebb-af42-d66521d20a42 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102015 Oct 05 18:25:38.321586 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3206/6656] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:38.777426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3656e529-43ff-4c0d-920f-7f5df5940dfb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:38.778048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3656e529-43ff-4c0d-920f-7f5df5940dfb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:38.784801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3656e529-43ff-4c0d-920f-7f5df5940dfb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:38.785300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3656e529-43ff-4c0d-920f-7f5df5940dfb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:38.785750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3656e529-43ff-4c0d-920f-7f5df5940dfb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:38.786505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3656e529-43ff-4c0d-920f-7f5df5940dfb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:38.786978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3656e529-43ff-4c0d-920f-7f5df5940dfb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:38.787416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3656e529-43ff-4c0d-920f-7f5df5940dfb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:38.925391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3656e529-43ff-4c0d-920f-7f5df5940dfb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:38.933468 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3656e529-43ff-4c0d-920f-7f5df5940dfb tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1366 microversion: 2.1 time: 0.160145 Oct 05 18:25:38.934057 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3451/6657] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:38 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:39.955729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:39.956512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:39.961375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bc9ea06d-c5c1-41e2-bd6e-869ff92a832b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:39.962077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bc9ea06d-c5c1-41e2-bd6e-869ff92a832b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:39.969439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9ea06d-c5c1-41e2-bd6e-869ff92a832b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:39.969960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9ea06d-c5c1-41e2-bd6e-869ff92a832b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:39.970461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9ea06d-c5c1-41e2-bd6e-869ff92a832b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:39.971144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9ea06d-c5c1-41e2-bd6e-869ff92a832b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:39.971602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9ea06d-c5c1-41e2-bd6e-869ff92a832b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:39.972027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc9ea06d-c5c1-41e2-bd6e-869ff92a832b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:40.115432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bc9ea06d-c5c1-41e2-bd6e-869ff92a832b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:25:40.123915 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bc9ea06d-c5c1-41e2-bd6e-869ff92a832b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1556 microversion: 2.1 time: 0.170472 Oct 05 18:25:40.124503 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3207/6658] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:25:39 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1556 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:25:40.148525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f839f0c9-3041-4f3e-ac83-784bdb739e7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:25:40.149080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f839f0c9-3041-4f3e-ac83-784bdb739e7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:25:40.151043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:25:40.157242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f839f0c9-3041-4f3e-ac83-784bdb739e7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:40.157738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f839f0c9-3041-4f3e-ac83-784bdb739e7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:40.158182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f839f0c9-3041-4f3e-ac83-784bdb739e7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:40.158917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f839f0c9-3041-4f3e-ac83-784bdb739e7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:40.159382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f839f0c9-3041-4f3e-ac83-784bdb739e7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:40.159816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f839f0c9-3041-4f3e-ac83-784bdb739e7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:40.239395 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f839f0c9-3041-4f3e-ac83-784bdb739e7c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096697 Oct 05 18:25:40.240046 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3452/6659] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 18:25:40 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:25:41.538993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-07222c30-9ada-43a9-9a0e-0da895deb1c2 req-142c40c2-eac4-4b83-b058-03ff8ac298d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78e7f53b-3ac1-4414-a6b3-0bc967fd146d", "tag": "b31bf10c-9d05-4a2b-8c40-06f171ee1d20"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:25:41.550524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-07222c30-9ada-43a9-9a0e-0da895deb1c2 req-142c40c2-eac4-4b83-b058-03ff8ac298d2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:25:41.551010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-07222c30-9ada-43a9-9a0e-0da895deb1c2 req-142c40c2-eac4-4b83-b058-03ff8ac298d2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:25:41.551444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-07222c30-9ada-43a9-9a0e-0da895deb1c2 req-142c40c2-eac4-4b83-b058-03ff8ac298d2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:25:41.563421 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-07222c30-9ada-43a9-9a0e-0da895deb1c2 req-142c40c2-eac4-4b83-b058-03ff8ac298d2 service nova] Creating event network-changed:b31bf10c-9d05-4a2b-8c40-06f171ee1d20 for instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d on n-h2-835595-3 Oct 05 18:25:41.568566 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-07222c30-9ada-43a9-9a0e-0da895deb1c2 req-142c40c2-eac4-4b83-b058-03ff8ac298d2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033350 Oct 05 18:25:41.569186 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3208/6660] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:26:12.863421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:26:12.864967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:26:12.870798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d533c9b6-9936-44a8-930f-c121b182ade3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:12.871301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d533c9b6-9936-44a8-930f-c121b182ade3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:12.878859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d533c9b6-9936-44a8-930f-c121b182ade3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:12.879354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d533c9b6-9936-44a8-930f-c121b182ade3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:12.879786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d533c9b6-9936-44a8-930f-c121b182ade3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:12.880478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d533c9b6-9936-44a8-930f-c121b182ade3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:12.880940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d533c9b6-9936-44a8-930f-c121b182ade3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:12.881374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d533c9b6-9936-44a8-930f-c121b182ade3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:12.906662 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d533c9b6-9936-44a8-930f-c121b182ade3 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/ips" status: 200 len: 148 microversion: 2.1 time: 0.047533 Oct 05 18:26:12.907250 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3453/6661] 10.222.0.70 () {58 vars in 1248 bytes} [Wed Oct 5 18:26:12 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:26:14.271606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-da912394-d064-4792-9472-c8a656577c6a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80efa3f9-2965-4904-8259-afef8c059cc9"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:26:14.274048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-da912394-d064-4792-9472-c8a656577c6a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:14.276442 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:26:14.277126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:26:14.283629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da912394-d064-4792-9472-c8a656577c6a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:14.284139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da912394-d064-4792-9472-c8a656577c6a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:14.284574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da912394-d064-4792-9472-c8a656577c6a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:14.285265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da912394-d064-4792-9472-c8a656577c6a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:14.285716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da912394-d064-4792-9472-c8a656577c6a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:14.286136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-da912394-d064-4792-9472-c8a656577c6a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:14.548109 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-da912394-d064-4792-9472-c8a656577c6a tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "POST /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280943 Oct 05 18:26:14.548722 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3209/6662] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:26:14 2022] POST /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:26:25.423018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb172c76-03cc-4ffa-83c2-88792476e4ac tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:25.423805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eb172c76-03cc-4ffa-83c2-88792476e4ac tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:25.426457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:26:25.427131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:26:25.433354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb172c76-03cc-4ffa-83c2-88792476e4ac tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:25.433776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb172c76-03cc-4ffa-83c2-88792476e4ac tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:25.434223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb172c76-03cc-4ffa-83c2-88792476e4ac tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:25.434962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb172c76-03cc-4ffa-83c2-88792476e4ac tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:25.435436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb172c76-03cc-4ffa-83c2-88792476e4ac tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:25.435874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eb172c76-03cc-4ffa-83c2-88792476e4ac tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:25.526707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-eb172c76-03cc-4ffa-83c2-88792476e4ac tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lazy-loading 'services' on Instance uuid 78e7f53b-3ac1-4414-a6b3-0bc967fd146d {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:26:25.605146 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb172c76-03cc-4ffa-83c2-88792476e4ac tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments/80efa3f9-2965-4904-8259-afef8c059cc9" status: 202 len: 0 microversion: 2.1 time: 0.186021 Oct 05 18:26:25.605748 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3454/6663] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:26:25 2022] DELETE /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments/80efa3f9-2965-4904-8259-afef8c059cc9 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:26:25.613735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:26:25.614601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:26:25.619504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2522d5f8-2cd1-474a-9935-e9cdb3092f72 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:25.621902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2522d5f8-2cd1-474a-9935-e9cdb3092f72 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:25.631655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2522d5f8-2cd1-474a-9935-e9cdb3092f72 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:25.632147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2522d5f8-2cd1-474a-9935-e9cdb3092f72 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:25.632584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2522d5f8-2cd1-474a-9935-e9cdb3092f72 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:25.633276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2522d5f8-2cd1-474a-9935-e9cdb3092f72 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:25.633725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2522d5f8-2cd1-474a-9935-e9cdb3092f72 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:25.635124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2522d5f8-2cd1-474a-9935-e9cdb3092f72 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:25.671122 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2522d5f8-2cd1-474a-9935-e9cdb3092f72 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060219 Oct 05 18:26:25.671726 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3210/6664] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:26:25 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:26:26.686113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-71593753-fcef-45b8-a44b-c1488e447f0c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:26.690418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-71593753-fcef-45b8-a44b-c1488e447f0c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:26.696362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71593753-fcef-45b8-a44b-c1488e447f0c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:26.696873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71593753-fcef-45b8-a44b-c1488e447f0c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:26.697326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71593753-fcef-45b8-a44b-c1488e447f0c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:26.698058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71593753-fcef-45b8-a44b-c1488e447f0c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:26.698664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71593753-fcef-45b8-a44b-c1488e447f0c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:26.699128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-71593753-fcef-45b8-a44b-c1488e447f0c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:26.731145 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-71593753-fcef-45b8-a44b-c1488e447f0c tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050400 Oct 05 18:26:26.731719 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3455/6665] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:26:26 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:26:27.743316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d7faece3-c933-4256-b532-931f2c15b38b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:27.745598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d7faece3-c933-4256-b532-931f2c15b38b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:27.752690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7faece3-c933-4256-b532-931f2c15b38b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:27.753194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7faece3-c933-4256-b532-931f2c15b38b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:27.753634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7faece3-c933-4256-b532-931f2c15b38b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:27.754361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7faece3-c933-4256-b532-931f2c15b38b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:27.754825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7faece3-c933-4256-b532-931f2c15b38b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:27.755240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7faece3-c933-4256-b532-931f2c15b38b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:27.788160 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d7faece3-c933-4256-b532-931f2c15b38b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048780 Oct 05 18:26:27.788747 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3211/6666] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:26:27 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:26:28.801237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-afc3181d-68d5-42e0-8183-55ebe001b7b6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:28.803465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-afc3181d-68d5-42e0-8183-55ebe001b7b6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:28.810973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc3181d-68d5-42e0-8183-55ebe001b7b6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:28.811474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc3181d-68d5-42e0-8183-55ebe001b7b6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:28.811926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc3181d-68d5-42e0-8183-55ebe001b7b6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:28.812619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc3181d-68d5-42e0-8183-55ebe001b7b6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:28.813085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc3181d-68d5-42e0-8183-55ebe001b7b6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:28.813523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-afc3181d-68d5-42e0-8183-55ebe001b7b6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:28.844487 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-afc3181d-68d5-42e0-8183-55ebe001b7b6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047288 Oct 05 18:26:28.845056 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3456/6667] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:26:28 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:26:29.856793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-71957aa1-290c-4308-a405-acaa01904683 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:29.859042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-71957aa1-290c-4308-a405-acaa01904683 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:29.866100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71957aa1-290c-4308-a405-acaa01904683 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:29.866618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71957aa1-290c-4308-a405-acaa01904683 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:29.867313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71957aa1-290c-4308-a405-acaa01904683 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:29.868024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71957aa1-290c-4308-a405-acaa01904683 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:29.868467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71957aa1-290c-4308-a405-acaa01904683 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:29.868895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-71957aa1-290c-4308-a405-acaa01904683 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:29.900026 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-71957aa1-290c-4308-a405-acaa01904683 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047331 Oct 05 18:26:29.900603 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3212/6668] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:26:29 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:26:30.913597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f6dd6596-20b4-4c32-ace9-f40fdeed84f4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:30.915376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f6dd6596-20b4-4c32-ace9-f40fdeed84f4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:30.923643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6dd6596-20b4-4c32-ace9-f40fdeed84f4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:30.923878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6dd6596-20b4-4c32-ace9-f40fdeed84f4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:30.924317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6dd6596-20b4-4c32-ace9-f40fdeed84f4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:30.924987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6dd6596-20b4-4c32-ace9-f40fdeed84f4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:30.925452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6dd6596-20b4-4c32-ace9-f40fdeed84f4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:30.925890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f6dd6596-20b4-4c32-ace9-f40fdeed84f4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:30.960666 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f6dd6596-20b4-4c32-ace9-f40fdeed84f4 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051556 Oct 05 18:26:30.961550 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3457/6669] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:26:30 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 18:26:31.028208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8db9c5ca-6e8a-400e-a31b-7a081ff35375 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:31.028776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8db9c5ca-6e8a-400e-a31b-7a081ff35375 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:31.035501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8db9c5ca-6e8a-400e-a31b-7a081ff35375 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:31.035978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8db9c5ca-6e8a-400e-a31b-7a081ff35375 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:31.036410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8db9c5ca-6e8a-400e-a31b-7a081ff35375 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:31.037093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8db9c5ca-6e8a-400e-a31b-7a081ff35375 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:31.037541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8db9c5ca-6e8a-400e-a31b-7a081ff35375 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:31.037958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8db9c5ca-6e8a-400e-a31b-7a081ff35375 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:31.063507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8db9c5ca-6e8a-400e-a31b-7a081ff35375 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:26:31.145920 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8db9c5ca-6e8a-400e-a31b-7a081ff35375 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 204 len: 0 microversion: 2.1 time: 0.121606 Oct 05 18:26:31.146721 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3213/6670] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:26:31 2022] DELETE /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:26:31.155592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c0cc90b-838f-46db-a250-f876b2c663c8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:31.156229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c0cc90b-838f-46db-a250-f876b2c663c8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:31.162691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c0cc90b-838f-46db-a250-f876b2c663c8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:31.163296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c0cc90b-838f-46db-a250-f876b2c663c8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:31.163702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c0cc90b-838f-46db-a250-f876b2c663c8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:31.164460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c0cc90b-838f-46db-a250-f876b2c663c8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:31.164935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c0cc90b-838f-46db-a250-f876b2c663c8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:31.165396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c0cc90b-838f-46db-a250-f876b2c663c8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:31.307848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0c0cc90b-838f-46db-a250-f876b2c663c8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:26:31.316460 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0c0cc90b-838f-46db-a250-f876b2c663c8 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1679 microversion: 2.1 time: 0.165034 Oct 05 18:26:31.317050 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3458/6671] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:26:31 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:26:32.343701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-624f1b6f-6243-4001-ab85-77cfbc2be569 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:32.344583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-624f1b6f-6243-4001-ab85-77cfbc2be569 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:32.353449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624f1b6f-6243-4001-ab85-77cfbc2be569 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:32.354056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624f1b6f-6243-4001-ab85-77cfbc2be569 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:32.354644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624f1b6f-6243-4001-ab85-77cfbc2be569 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:32.355553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624f1b6f-6243-4001-ab85-77cfbc2be569 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:32.356129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624f1b6f-6243-4001-ab85-77cfbc2be569 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:32.356666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-624f1b6f-6243-4001-ab85-77cfbc2be569 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:32.499885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-624f1b6f-6243-4001-ab85-77cfbc2be569 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:26:32.508064 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-624f1b6f-6243-4001-ab85-77cfbc2be569 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1679 microversion: 2.1 time: 0.170530 Oct 05 18:26:32.508665 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3214/6672] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:26:32 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:26:33.531663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-82d23f3a-8de1-443c-96bc-85455c17f844 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:33.532389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-82d23f3a-8de1-443c-96bc-85455c17f844 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:33.536196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-dcd75fb3-6ed8-4901-89d6-13918af0026d req-5ebd2ee9-2ab7-47a6-bc10-ea7e432ec2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78e7f53b-3ac1-4414-a6b3-0bc967fd146d", "name": "network-vif-deleted", "tag": "b31bf10c-9d05-4a2b-8c40-06f171ee1d20"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:26:33.539698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82d23f3a-8de1-443c-96bc-85455c17f844 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:33.540140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82d23f3a-8de1-443c-96bc-85455c17f844 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:33.540590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82d23f3a-8de1-443c-96bc-85455c17f844 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:33.541283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82d23f3a-8de1-443c-96bc-85455c17f844 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:33.541752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82d23f3a-8de1-443c-96bc-85455c17f844 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:33.542325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82d23f3a-8de1-443c-96bc-85455c17f844 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:33.572352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dcd75fb3-6ed8-4901-89d6-13918af0026d req-5ebd2ee9-2ab7-47a6-bc10-ea7e432ec2a3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:33.572983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dcd75fb3-6ed8-4901-89d6-13918af0026d req-5ebd2ee9-2ab7-47a6-bc10-ea7e432ec2a3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:33.573405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dcd75fb3-6ed8-4901-89d6-13918af0026d req-5ebd2ee9-2ab7-47a6-bc10-ea7e432ec2a3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:33.599518 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-dcd75fb3-6ed8-4901-89d6-13918af0026d req-5ebd2ee9-2ab7-47a6-bc10-ea7e432ec2a3 service nova] Creating event network-vif-deleted:b31bf10c-9d05-4a2b-8c40-06f171ee1d20 for instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d on n-h2-835595-3 Oct 05 18:26:33.605385 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-dcd75fb3-6ed8-4901-89d6-13918af0026d req-5ebd2ee9-2ab7-47a6-bc10-ea7e432ec2a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077891 Oct 05 18:26:33.607045 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3459/6673] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:26:33.619011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-82d23f3a-8de1-443c-96bc-85455c17f844 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcf412de18ab4d64aff7c7514bf0eaba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '182080e008ca451c81350a9cad4d970e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:26:33.629688 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-82d23f3a-8de1-443c-96bc-85455c17f844 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 200 len: 1612 microversion: 2.1 time: 0.101799 Oct 05 18:26:33.638949 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3215/6674] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:26:33 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 1612 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:26:34.658667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:34.659493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:34.667283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:34.667869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:34.668396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:34.669221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:34.669797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:34.670315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:34.686133 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d HTTP/1.1 Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '78e7f53b-3ac1-4414-a6b3-0bc967fd146d'} Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:34.687749 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:34.693881 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:34.693881 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:34.693881 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:34.693881 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:26:34.693881 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:26:34.693881 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:34.693881 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:34.693881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:26:34.693881 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78021794-92d5-452b-9d61-c86ec7894c83 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 404 len: 111 microversion: 2.1 time: 0.037013 Oct 05 18:26:34.693881 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3460/6675] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:26:34 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:26:34.698133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-33de2358-7956-40eb-a518-8d4f5621a3e6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '.version_select at 0x7f777963fee0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:34.722927 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-33de2358-7956-40eb-a518-8d4f5621a3e6 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-213345284" status: 202 len: 0 microversion: 2.1 time: 0.028698 Oct 05 18:26:34.723514 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3216/6676] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 18:26:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-213345284 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:26:38.653296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:38.653857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:38.663396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:38.664034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:38.664664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:38.665639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:38.666334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:38.666922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:38.681480 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d HTTP/1.1 Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '78e7f53b-3ac1-4414-a6b3-0bc967fd146d'} Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:26:38.683114 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-47bd215f-eb54-40c4-9469-3389770ff12f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 404 len: 111 microversion: 2.1 time: 0.037924 Oct 05 18:26:38.687932 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3461/6677] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:26:38 2022] DELETE /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:26:38.695383 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:38.696031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 78e7f53b-3ac1-4414-a6b3-0bc967fd146d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:38.706558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:38.707054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:38.707583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:38.708295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:38.708752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:38.709174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:38.724415 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d HTTP/1.1 Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '78e7f53b-3ac1-4414-a6b3-0bc967fd146d'} Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:38.726238 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:38.733198 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:38.733198 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:38.733198 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:38.733198 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:26:38.733198 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:26:38.733198 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. Oct 05 18:26:38.733198 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:38.733198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance 78e7f53b-3ac1-4414-a6b3-0bc967fd146d could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:26:38.733198 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ac46b163-772f-4096-a050-844b74615ff7 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d" status: 404 len: 111 microversion: 2.1 time: 0.037782 Oct 05 18:26:38.733198 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3217/6678] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:26:38 2022] GET /compute/v2.1/servers/78e7f53b-3ac1-4414-a6b3-0bc967fd146d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:26:42.000226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:42.000804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:42.007843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:42.008340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:42.008783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:42.009787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:42.010308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:42.010737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:42.025288 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d HTTP/1.1 Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'aa2e5c73-96e0-44a1-a750-c9e98ecebf0d'} Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:26:42.026986 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4aeb64a5-4dc0-4016-ab96-1a66864e6881 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 404 len: 111 microversion: 2.1 time: 0.032380 Oct 05 18:26:42.032102 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3462/6679] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:26:41 2022] DELETE /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:26:42.037232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:42.037880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: aa2e5c73-96e0-44a1-a750-c9e98ecebf0d] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:42.045199 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:42.045710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:42.046152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:42.046905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:42.047361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:42.047787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:42.062691 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d HTTP/1.1 Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'aa2e5c73-96e0-44a1-a750-c9e98ecebf0d'} Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:42.064260 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.070380 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.070380 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:42.070380 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:42.070380 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:26:42.070380 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:26:42.070380 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. Oct 05 18:26:42.070380 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.070380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance aa2e5c73-96e0-44a1-a750-c9e98ecebf0d could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:26:42.070380 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a1df6e69-5ed7-4bf5-99c6-38d35dbb6f06 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d" status: 404 len: 111 microversion: 2.1 time: 0.032389 Oct 05 18:26:42.070380 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3218/6680] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:26:42 2022] GET /compute/v2.1/servers/aa2e5c73-96e0-44a1-a750-c9e98ecebf0d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:26:42.076351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:42.076987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:42.084187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:42.084792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:42.085319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:42.086128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:42.086732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:42.087260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:42.102691 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 HTTP/1.1 Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '929043f1-ecb1-41ba-8204-9942de6351f6'} Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:26:42.104376 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02b42462-3c92-42f7-a7c3-e2ce41d88e70 tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 404 len: 111 microversion: 2.1 time: 0.034611 Oct 05 18:26:42.109747 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3463/6681] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:26:42 2022] DELETE /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 18:26:42.115254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:42.115880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 929043f1-ecb1-41ba-8204-9942de6351f6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:42.122663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:42.123162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:42.123570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:42.124278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:42.124735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:42.125161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:42.140164 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 HTTP/1.1 Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '929043f1-ecb1-41ba-8204-9942de6351f6'} Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:42.141718 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.147097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:42.147097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:42.147097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:42.147097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:26:42.147097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:26:42.147097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. Oct 05 18:26:42.147097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:42.147097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance 929043f1-ecb1-41ba-8204-9942de6351f6 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:26:42.147097 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9b55ef49-d3cb-4bca-bbf1-d3ade919857b tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6" status: 404 len: 111 microversion: 2.1 time: 0.031872 Oct 05 18:26:42.147097 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3219/6682] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:26:42 2022] GET /compute/v2.1/servers/929043f1-ecb1-41ba-8204-9942de6351f6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:26:45.404785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:45.405420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:45.412520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:45.413026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:45.413480 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:45.414187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:45.414698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:45.415137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:45.429241 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 HTTP/1.1 Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '618f8f8a-ba51-4638-b718-bf770b266f27'} Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:26:45.431015 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-081e50a8-2028-4aba-874d-f77f842be00f tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "DELETE /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 404 len: 111 microversion: 2.1 time: 0.031633 Oct 05 18:26:45.435742 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3464/6683] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:26:45 2022] DELETE /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:26:45.441225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:26:45.441860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] [instance: 618f8f8a-ba51-4638-b718-bf770b266f27] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:26:45.449139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:45.449634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:45.450064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:45.450803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:26:45.451256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:26:45.451676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:26:45.465508 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] HTTP exception thrown: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Request method failure captured: Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 HTTP/1.1 Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPctPUVcmvRtDhtKKE3_QHbnqNQ-e91dfRnFZbtL0R-2VARaYuzdbCNTU0wt3SNTKh46v8l7rI86_V7zAy_XqOKHBV3joRcK2FC0VBU3A9TJAIjer8TNLBxBR-EbgLDu8173thNMUOrt0ZaId0to7v81z4tG6fgojkJW16f9LIA81PC0 Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/182080e008ca451c81350a9cad4d970e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_182080e008ca451c81350a9cad4d970e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/182080e008ca451c81350a9cad4d970e"}]}] Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 182080e008ca451c81350a9cad4d970e Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2035148223 Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: dcf412de18ab4d64aff7c7514bf0eaba Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-AttachVolumeNegativeTest-2035148223-project Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '618f8f8a-ba51-4638-b718-bf770b266f27'} Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:26:45.467083 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:45.472063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:26:45.472063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:26:45.472063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:26:45.472063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:26:45.472063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:26:45.472063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. Oct 05 18:26:45.472063 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:26:45.472063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] Returning 404 to user: Instance 618f8f8a-ba51-4638-b718-bf770b266f27 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:26:45.472063 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cc59718c-eb45-4728-9958-e0aedcfb30fc tempest-AttachVolumeNegativeTest-2035148223 tempest-AttachVolumeNegativeTest-2035148223-project] 10.222.0.70 "GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27" status: 404 len: 111 microversion: 2.1 time: 0.031167 Oct 05 18:26:45.472063 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3220/6684] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:26:45 2022] GET /compute/v2.1/servers/618f8f8a-ba51-4638-b718-bf770b266f27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:27:31.374691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=22 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:27:31.376160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:27:31.516023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] Calling method '.version_select at 0x7f776c68caf0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:27:31.517959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:27:31.518515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:27:31.519005 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:27:31.533614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:27:31.534115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:27:31.534677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:27:31.544502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:27:31.544995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:27:31.545443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:27:31.551317 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a28b99f1-4ab0-4807-943f-6789abead5d6 tempest-PortsAdminExtendedAttrsTestJSON-1245028377 tempest-PortsAdminExtendedAttrsTestJSON-1245028377-project-admin] 10.222.0.70 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.182002 Oct 05 18:27:31.551863 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3465/6685] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 18:27:31 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:30:23.103751 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3358724b-f52c-4a69-8c22-3305520f8c1e] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 18:30:23.104709 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1744094-4a20-4501-8b29-640f444f590e] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 18:30:23.105245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:30:23.106155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:30:23.106838 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:30:23.107049 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:30:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.70) !!! Oct 05 18:30:23.108508 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 18:30:23.108621 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:30:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.70) !!! Oct 05 18:30:23.109737 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 18:30:23.109845 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:30:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.70) !!! Oct 05 18:30:23.291232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1639790979", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "cd449acc-ee62-4a09-a50c-5c818c861777"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:30:23.489896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] validate_networks() for [('cd449acc-ee62-4a09-a50c-5c818c861777', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:30:24.022741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:30:24.023182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:30:24.023707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:30:24.024123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:30:24.024552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:30:24.035115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:24.035578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:24.036011 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:24.036734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:24.037182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:24.037607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:24.054936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Getting quotas for project d146717104e14babaea61e9caaa8dc2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:30:24.060573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Getting quotas for user caaf813434a8453fabcd6f09cbc25e48 and project d146717104e14babaea61e9caaa8dc2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:30:24.073712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:30:24.076099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:30:24.132641 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4ca7be08-68ad-4607-8838-f2189b2173a5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.031172 Oct 05 18:30:24.139592 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3221/6686] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:30:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:30:24.142935 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e95dc271-cddc-4501-83b4-4d8d4789eaf1] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 18:30:24.144104 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d9585d8e-c85f-4e0e-8626-ea6a3c823e4e] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 18:30:24.144606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:30:24.145348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:30:24.146471 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:30:24.146647 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:30:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f (ip 10.222.0.70) !!! Oct 05 18:30:24.148092 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:30:24.148250 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:30:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f (ip 10.222.0.70) !!! Oct 05 18:30:24.150483 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 18:30:24.150595 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:30:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f (ip 10.222.0.70) !!! Oct 05 18:30:24.156790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-daef15d2-f629-46d5-a02c-61cae74d6bc6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:24.157447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-daef15d2-f629-46d5-a02c-61cae74d6bc6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:24.352996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-daef15d2-f629-46d5-a02c-61cae74d6bc6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:24.360079 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-daef15d2-f629-46d5-a02c-61cae74d6bc6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1215 microversion: 2.1 time: 0.219157 Oct 05 18:30:24.360815 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3466/6687] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:24 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:25.386628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-634481fd-e296-4dae-a4aa-5846a08c6960 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:25.388012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-634481fd-e296-4dae-a4aa-5846a08c6960 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:25.391360 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] [3358724b-f52c-4a69-8c22-3305520f8c1e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 33704. Oct 05 18:30:25.394493 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1744094-4a20-4501-8b29-640f444f590e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 33706. Oct 05 18:30:25.400878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634481fd-e296-4dae-a4aa-5846a08c6960 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:25.401362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634481fd-e296-4dae-a4aa-5846a08c6960 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:25.401801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634481fd-e296-4dae-a4aa-5846a08c6960 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:25.402552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634481fd-e296-4dae-a4aa-5846a08c6960 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:25.403005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634481fd-e296-4dae-a4aa-5846a08c6960 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:25.403422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-634481fd-e296-4dae-a4aa-5846a08c6960 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:25.471013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-634481fd-e296-4dae-a4aa-5846a08c6960 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:25.479475 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-634481fd-e296-4dae-a4aa-5846a08c6960 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1267 microversion: 2.1 time: 0.099662 Oct 05 18:30:25.480067 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3222/6688] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:25 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:26.502836 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c72d8c7c-9b91-41f5-b9cf-51f740804905 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:26.503769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c72d8c7c-9b91-41f5-b9cf-51f740804905 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:26.513735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c72d8c7c-9b91-41f5-b9cf-51f740804905 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:26.514246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c72d8c7c-9b91-41f5-b9cf-51f740804905 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:26.514720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c72d8c7c-9b91-41f5-b9cf-51f740804905 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:26.515439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c72d8c7c-9b91-41f5-b9cf-51f740804905 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:26.516149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c72d8c7c-9b91-41f5-b9cf-51f740804905 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:26.516590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c72d8c7c-9b91-41f5-b9cf-51f740804905 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:26.534531 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] [d9585d8e-c85f-4e0e-8626-ea6a3c823e4e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 33744. Oct 05 18:30:26.535260 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] [e95dc271-cddc-4501-83b4-4d8d4789eaf1] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 33742. Oct 05 18:30:26.731106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c72d8c7c-9b91-41f5-b9cf-51f740804905 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:26.739014 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c72d8c7c-9b91-41f5-b9cf-51f740804905 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1315 microversion: 2.1 time: 0.240354 Oct 05 18:30:26.739602 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3467/6689] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:26 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:27.063672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-bbc204d0-a5fe-41a4-aa97-26d6c8e5e89f req-91bddbd2-73dc-46a7-b01f-1b16ef271cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aaac36d5-689e-4322-a51b-6ceda640978f", "tag": "484a071f-225e-486a-bd3c-3376dc1927ca"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:30:27.074019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bbc204d0-a5fe-41a4-aa97-26d6c8e5e89f req-91bddbd2-73dc-46a7-b01f-1b16ef271cc3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:27.074774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bbc204d0-a5fe-41a4-aa97-26d6c8e5e89f req-91bddbd2-73dc-46a7-b01f-1b16ef271cc3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:27.075439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bbc204d0-a5fe-41a4-aa97-26d6c8e5e89f req-91bddbd2-73dc-46a7-b01f-1b16ef271cc3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:27.087702 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-bbc204d0-a5fe-41a4-aa97-26d6c8e5e89f req-91bddbd2-73dc-46a7-b01f-1b16ef271cc3 service nova] Creating event network-changed:484a071f-225e-486a-bd3c-3376dc1927ca for instance aaac36d5-689e-4322-a51b-6ceda640978f on n-h2-835595-3 Oct 05 18:30:27.094011 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-bbc204d0-a5fe-41a4-aa97-26d6c8e5e89f req-91bddbd2-73dc-46a7-b01f-1b16ef271cc3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089096 Oct 05 18:30:27.094970 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3223/6690] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:30:27.763307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6111b120-0145-410f-bd44-746536b42389 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:27.764121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6111b120-0145-410f-bd44-746536b42389 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:27.771191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6111b120-0145-410f-bd44-746536b42389 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:27.771697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6111b120-0145-410f-bd44-746536b42389 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:27.772144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6111b120-0145-410f-bd44-746536b42389 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:27.772858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6111b120-0145-410f-bd44-746536b42389 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:27.773323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6111b120-0145-410f-bd44-746536b42389 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:27.773887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6111b120-0145-410f-bd44-746536b42389 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:27.905054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6111b120-0145-410f-bd44-746536b42389 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:27.913371 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6111b120-0145-410f-bd44-746536b42389 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1315 microversion: 2.1 time: 0.154531 Oct 05 18:30:27.913979 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3468/6691] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:27 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:28.937948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bac9c7dd-dd58-47c2-87b7-6a81bcdd030f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:28.938687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bac9c7dd-dd58-47c2-87b7-6a81bcdd030f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:28.945050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac9c7dd-dd58-47c2-87b7-6a81bcdd030f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:28.945518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac9c7dd-dd58-47c2-87b7-6a81bcdd030f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:28.945961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac9c7dd-dd58-47c2-87b7-6a81bcdd030f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:28.946790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac9c7dd-dd58-47c2-87b7-6a81bcdd030f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:28.947249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac9c7dd-dd58-47c2-87b7-6a81bcdd030f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:28.947680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bac9c7dd-dd58-47c2-87b7-6a81bcdd030f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:29.081386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bac9c7dd-dd58-47c2-87b7-6a81bcdd030f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:29.089519 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bac9c7dd-dd58-47c2-87b7-6a81bcdd030f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1315 microversion: 2.1 time: 0.156763 Oct 05 18:30:29.090149 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3224/6692] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:28 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:30.115220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3a630508-fcb3-4abc-a7eb-d0139b6a091e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:30.116101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3a630508-fcb3-4abc-a7eb-d0139b6a091e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:30.125785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a630508-fcb3-4abc-a7eb-d0139b6a091e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:30.126509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a630508-fcb3-4abc-a7eb-d0139b6a091e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:30.127122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a630508-fcb3-4abc-a7eb-d0139b6a091e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:30.128068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a630508-fcb3-4abc-a7eb-d0139b6a091e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:30.128702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a630508-fcb3-4abc-a7eb-d0139b6a091e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:30.129298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3a630508-fcb3-4abc-a7eb-d0139b6a091e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:30.266467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3a630508-fcb3-4abc-a7eb-d0139b6a091e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:30.278991 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3a630508-fcb3-4abc-a7eb-d0139b6a091e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1315 microversion: 2.1 time: 0.169041 Oct 05 18:30:30.279828 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3469/6693] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:30 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:31.305294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f4b699f4-ba0e-4540-9000-e5921fce388e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:31.306039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f4b699f4-ba0e-4540-9000-e5921fce388e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:31.313292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b699f4-ba0e-4540-9000-e5921fce388e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:31.313952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b699f4-ba0e-4540-9000-e5921fce388e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:31.314445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b699f4-ba0e-4540-9000-e5921fce388e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:31.315231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b699f4-ba0e-4540-9000-e5921fce388e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:31.315664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b699f4-ba0e-4540-9000-e5921fce388e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:31.316103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f4b699f4-ba0e-4540-9000-e5921fce388e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:31.733773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f4b699f4-ba0e-4540-9000-e5921fce388e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:31.741682 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f4b699f4-ba0e-4540-9000-e5921fce388e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1315 microversion: 2.1 time: 0.440520 Oct 05 18:30:31.742266 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3225/6694] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:31 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:32.769460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82bcc357-8245-4051-9f6f-4f1dfc0a7ba5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:32.770621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-82bcc357-8245-4051-9f6f-4f1dfc0a7ba5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:32.779372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82bcc357-8245-4051-9f6f-4f1dfc0a7ba5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:32.779878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82bcc357-8245-4051-9f6f-4f1dfc0a7ba5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:32.780331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82bcc357-8245-4051-9f6f-4f1dfc0a7ba5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:32.781042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82bcc357-8245-4051-9f6f-4f1dfc0a7ba5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:32.781511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82bcc357-8245-4051-9f6f-4f1dfc0a7ba5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:32.781951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82bcc357-8245-4051-9f6f-4f1dfc0a7ba5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:32.918921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-82bcc357-8245-4051-9f6f-4f1dfc0a7ba5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:32.927244 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-82bcc357-8245-4051-9f6f-4f1dfc0a7ba5 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1315 microversion: 2.1 time: 0.164491 Oct 05 18:30:32.927848 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3470/6695] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:32 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:33.618515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7a149a78-cf1f-4abf-9b7e-748a21880b98 req-5672a474-d74b-4156-b871-8364d70b0c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac36d5-689e-4322-a51b-6ceda640978f", "name": "network-vif-plugged", "status": "completed", "tag": "484a071f-225e-486a-bd3c-3376dc1927ca"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:30:33.628129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7a149a78-cf1f-4abf-9b7e-748a21880b98 req-5672a474-d74b-4156-b871-8364d70b0c4a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:33.628601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7a149a78-cf1f-4abf-9b7e-748a21880b98 req-5672a474-d74b-4156-b871-8364d70b0c4a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:33.629028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7a149a78-cf1f-4abf-9b7e-748a21880b98 req-5672a474-d74b-4156-b871-8364d70b0c4a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:33.640400 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7a149a78-cf1f-4abf-9b7e-748a21880b98 req-5672a474-d74b-4156-b871-8364d70b0c4a service nova] Creating event network-vif-plugged:484a071f-225e-486a-bd3c-3376dc1927ca for instance aaac36d5-689e-4322-a51b-6ceda640978f on n-h2-835595-3 Oct 05 18:30:33.645674 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7a149a78-cf1f-4abf-9b7e-748a21880b98 req-5672a474-d74b-4156-b871-8364d70b0c4a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080830 Oct 05 18:30:33.646272 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3226/6696] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:30:33.951215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab0fabbd-4402-4419-bfc9-ba7169ebdd68 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:33.951853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ab0fabbd-4402-4419-bfc9-ba7169ebdd68 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:33.959365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0fabbd-4402-4419-bfc9-ba7169ebdd68 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:33.959884 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0fabbd-4402-4419-bfc9-ba7169ebdd68 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:33.960335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0fabbd-4402-4419-bfc9-ba7169ebdd68 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:33.961057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0fabbd-4402-4419-bfc9-ba7169ebdd68 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:33.961536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0fabbd-4402-4419-bfc9-ba7169ebdd68 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:33.961979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab0fabbd-4402-4419-bfc9-ba7169ebdd68 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:34.107591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab0fabbd-4402-4419-bfc9-ba7169ebdd68 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:34.119573 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab0fabbd-4402-4419-bfc9-ba7169ebdd68 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1315 microversion: 2.1 time: 0.172203 Oct 05 18:30:34.120341 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3471/6697] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:33 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:35.144679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:30:35.145482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:30:35.150504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-961af1bd-490c-42ad-ba1c-54c02ae12e5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:35.151737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-961af1bd-490c-42ad-ba1c-54c02ae12e5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:35.161881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-961af1bd-490c-42ad-ba1c-54c02ae12e5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:35.162578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-961af1bd-490c-42ad-ba1c-54c02ae12e5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:35.163193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-961af1bd-490c-42ad-ba1c-54c02ae12e5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:35.164125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-961af1bd-490c-42ad-ba1c-54c02ae12e5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:35.164547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-961af1bd-490c-42ad-ba1c-54c02ae12e5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:35.165138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-961af1bd-490c-42ad-ba1c-54c02ae12e5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:35.300350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-961af1bd-490c-42ad-ba1c-54c02ae12e5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:35.308397 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-961af1bd-490c-42ad-ba1c-54c02ae12e5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1503 microversion: 2.1 time: 0.164698 Oct 05 18:30:35.308964 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3227/6698] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:35 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:35.330858 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25c8ccbc-3ad5-4773-9542-624588d65455 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:35.331574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25c8ccbc-3ad5-4773-9542-624588d65455 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:35.333551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:30:35.340402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25c8ccbc-3ad5-4773-9542-624588d65455 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:35.340905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25c8ccbc-3ad5-4773-9542-624588d65455 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:35.341356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25c8ccbc-3ad5-4773-9542-624588d65455 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:35.342065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25c8ccbc-3ad5-4773-9542-624588d65455 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:35.342565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25c8ccbc-3ad5-4773-9542-624588d65455 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:35.343027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25c8ccbc-3ad5-4773-9542-624588d65455 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:35.482451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-25c8ccbc-3ad5-4773-9542-624588d65455 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:35.490649 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25c8ccbc-3ad5-4773-9542-624588d65455 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1503 microversion: 2.1 time: 0.163807 Oct 05 18:30:35.491236 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3472/6699] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:35 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:35.513566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a465b9aa-be80-499d-8d32-94d152ac01b6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:30:35.514105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a465b9aa-be80-499d-8d32-94d152ac01b6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:35.520613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a465b9aa-be80-499d-8d32-94d152ac01b6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:35.521109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a465b9aa-be80-499d-8d32-94d152ac01b6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:35.521546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a465b9aa-be80-499d-8d32-94d152ac01b6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:35.522238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a465b9aa-be80-499d-8d32-94d152ac01b6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:35.522740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a465b9aa-be80-499d-8d32-94d152ac01b6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:35.523165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a465b9aa-be80-499d-8d32-94d152ac01b6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:35.548167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-a465b9aa-be80-499d-8d32-94d152ac01b6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lazy-loading 'flavor' on Instance uuid aaac36d5-689e-4322-a51b-6ceda640978f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:30:35.625415 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a465b9aa-be80-499d-8d32-94d152ac01b6 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "POST /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f/action" status: 202 len: 0 microversion: 2.1 time: 0.115964 Oct 05 18:30:35.626495 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3228/6700] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:30:35 2022] POST /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:30:35.634670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d77236e-1b60-4c87-aaaa-03262f08eb4d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:35.635301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d77236e-1b60-4c87-aaaa-03262f08eb4d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:35.641571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d77236e-1b60-4c87-aaaa-03262f08eb4d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:35.642077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d77236e-1b60-4c87-aaaa-03262f08eb4d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:35.642565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d77236e-1b60-4c87-aaaa-03262f08eb4d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:35.643281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d77236e-1b60-4c87-aaaa-03262f08eb4d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:35.643779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d77236e-1b60-4c87-aaaa-03262f08eb4d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:35.644248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d77236e-1b60-4c87-aaaa-03262f08eb4d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:35.780587 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d77236e-1b60-4c87-aaaa-03262f08eb4d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:35.788587 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d77236e-1b60-4c87-aaaa-03262f08eb4d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1511 microversion: 2.1 time: 0.157845 Oct 05 18:30:35.789177 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3473/6701] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:35 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:36.817337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53c8cd2e-7299-4596-a4a0-aa1356cbcf50 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:36.818485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-53c8cd2e-7299-4596-a4a0-aa1356cbcf50 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:36.830536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c8cd2e-7299-4596-a4a0-aa1356cbcf50 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:36.831346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c8cd2e-7299-4596-a4a0-aa1356cbcf50 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:36.832067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c8cd2e-7299-4596-a4a0-aa1356cbcf50 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:36.833205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c8cd2e-7299-4596-a4a0-aa1356cbcf50 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:36.833950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c8cd2e-7299-4596-a4a0-aa1356cbcf50 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:36.834707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53c8cd2e-7299-4596-a4a0-aa1356cbcf50 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:36.976610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-53c8cd2e-7299-4596-a4a0-aa1356cbcf50 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:36.984883 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53c8cd2e-7299-4596-a4a0-aa1356cbcf50 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1494 microversion: 2.1 time: 0.174738 Oct 05 18:30:36.985431 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3229/6702] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:36 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1494 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:37.007488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59f48217-b9f9-493d-b262-b7fff529ce48 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:30:37.008042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-59f48217-b9f9-493d-b262-b7fff529ce48 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:37.017629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59f48217-b9f9-493d-b262-b7fff529ce48 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:37.018141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59f48217-b9f9-493d-b262-b7fff529ce48 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:37.018628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59f48217-b9f9-493d-b262-b7fff529ce48 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:37.019355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59f48217-b9f9-493d-b262-b7fff529ce48 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:37.019830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59f48217-b9f9-493d-b262-b7fff529ce48 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:37.020272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59f48217-b9f9-493d-b262-b7fff529ce48 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:37.099288 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-59f48217-b9f9-493d-b262-b7fff529ce48 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "POST /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f/action" status: 202 len: 0 microversion: 2.1 time: 0.095322 Oct 05 18:30:37.099834 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3474/6703] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:30:37 2022] POST /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:30:37.116873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b654f78-2de0-42ef-a1da-4f5cd616a9cf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:37.118241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b654f78-2de0-42ef-a1da-4f5cd616a9cf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:37.133016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b654f78-2de0-42ef-a1da-4f5cd616a9cf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:37.133546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b654f78-2de0-42ef-a1da-4f5cd616a9cf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:37.133977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b654f78-2de0-42ef-a1da-4f5cd616a9cf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:37.134779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b654f78-2de0-42ef-a1da-4f5cd616a9cf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:37.135248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b654f78-2de0-42ef-a1da-4f5cd616a9cf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:37.140021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b654f78-2de0-42ef-a1da-4f5cd616a9cf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:37.273506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8b654f78-2de0-42ef-a1da-4f5cd616a9cf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:37.281741 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b654f78-2de0-42ef-a1da-4f5cd616a9cf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1500 microversion: 2.1 time: 0.173685 Oct 05 18:30:37.282339 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3230/6704] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:37 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1500 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:38.307214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-602e497f-e276-47d3-975e-afc98cb44bf2 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:38.307958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-602e497f-e276-47d3-975e-afc98cb44bf2 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:38.315647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-602e497f-e276-47d3-975e-afc98cb44bf2 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:38.316380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-602e497f-e276-47d3-975e-afc98cb44bf2 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:38.316831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-602e497f-e276-47d3-975e-afc98cb44bf2 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:38.317818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-602e497f-e276-47d3-975e-afc98cb44bf2 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:38.318306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-602e497f-e276-47d3-975e-afc98cb44bf2 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:38.318924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-602e497f-e276-47d3-975e-afc98cb44bf2 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:38.456141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-602e497f-e276-47d3-975e-afc98cb44bf2 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:38.464064 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-602e497f-e276-47d3-975e-afc98cb44bf2 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1503 microversion: 2.1 time: 0.162667 Oct 05 18:30:38.464640 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3475/6705] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:38 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:38.486699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f81a3d8e-f7dd-447e-97c4-c1ed8cc8bf05 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:30:38.487265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f81a3d8e-f7dd-447e-97c4-c1ed8cc8bf05 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:38.494407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81a3d8e-f7dd-447e-97c4-c1ed8cc8bf05 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:38.494907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81a3d8e-f7dd-447e-97c4-c1ed8cc8bf05 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:38.495344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81a3d8e-f7dd-447e-97c4-c1ed8cc8bf05 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:38.496040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81a3d8e-f7dd-447e-97c4-c1ed8cc8bf05 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:38.496565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81a3d8e-f7dd-447e-97c4-c1ed8cc8bf05 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:38.496999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f81a3d8e-f7dd-447e-97c4-c1ed8cc8bf05 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:38.520106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-f81a3d8e-f7dd-447e-97c4-c1ed8cc8bf05 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lazy-loading 'flavor' on Instance uuid aaac36d5-689e-4322-a51b-6ceda640978f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:30:38.593926 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f81a3d8e-f7dd-447e-97c4-c1ed8cc8bf05 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "POST /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f/action" status: 202 len: 0 microversion: 2.1 time: 0.110966 Oct 05 18:30:38.594506 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3231/6706] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:30:38 2022] POST /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:30:38.603550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0fb20575-8b2a-4ad0-af53-8f420621234d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:38.604174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0fb20575-8b2a-4ad0-af53-8f420621234d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:38.610820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fb20575-8b2a-4ad0-af53-8f420621234d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:38.611542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fb20575-8b2a-4ad0-af53-8f420621234d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:38.612035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fb20575-8b2a-4ad0-af53-8f420621234d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:38.612840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fb20575-8b2a-4ad0-af53-8f420621234d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:38.613448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fb20575-8b2a-4ad0-af53-8f420621234d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:38.614001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0fb20575-8b2a-4ad0-af53-8f420621234d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:38.756290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0fb20575-8b2a-4ad0-af53-8f420621234d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:38.766575 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0fb20575-8b2a-4ad0-af53-8f420621234d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1511 microversion: 2.1 time: 0.167106 Oct 05 18:30:38.767165 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3476/6707] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:38 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:39.795955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca6cc931-ea0a-4ee4-b532-0d884c0b434d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:39.797086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ca6cc931-ea0a-4ee4-b532-0d884c0b434d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:39.807931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca6cc931-ea0a-4ee4-b532-0d884c0b434d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:39.808745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca6cc931-ea0a-4ee4-b532-0d884c0b434d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:39.809475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca6cc931-ea0a-4ee4-b532-0d884c0b434d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:39.810677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca6cc931-ea0a-4ee4-b532-0d884c0b434d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:39.811393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca6cc931-ea0a-4ee4-b532-0d884c0b434d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:39.811816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca6cc931-ea0a-4ee4-b532-0d884c0b434d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:39.945957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ca6cc931-ea0a-4ee4-b532-0d884c0b434d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:39.954157 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ca6cc931-ea0a-4ee4-b532-0d884c0b434d tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1494 microversion: 2.1 time: 0.166704 Oct 05 18:30:39.954775 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3232/6708] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:39 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1494 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:39.979250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2661a79c-d937-4fc1-8f6b-d613942283c4 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:30:39.979812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2661a79c-d937-4fc1-8f6b-d613942283c4 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:39.987759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2661a79c-d937-4fc1-8f6b-d613942283c4 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:39.988257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2661a79c-d937-4fc1-8f6b-d613942283c4 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:39.988702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2661a79c-d937-4fc1-8f6b-d613942283c4 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:39.989396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2661a79c-d937-4fc1-8f6b-d613942283c4 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:39.989898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2661a79c-d937-4fc1-8f6b-d613942283c4 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:39.990319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2661a79c-d937-4fc1-8f6b-d613942283c4 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:40.064863 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2661a79c-d937-4fc1-8f6b-d613942283c4 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "POST /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f/action" status: 202 len: 0 microversion: 2.1 time: 0.090251 Oct 05 18:30:40.068404 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3477/6709] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:30:39 2022] POST /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:30:40.073849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-95a5706e-53a3-4a65-b28d-a9fb5c045aaf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:40.074513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-95a5706e-53a3-4a65-b28d-a9fb5c045aaf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:40.080714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a5706e-53a3-4a65-b28d-a9fb5c045aaf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:40.081196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a5706e-53a3-4a65-b28d-a9fb5c045aaf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:40.081626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a5706e-53a3-4a65-b28d-a9fb5c045aaf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:40.082349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a5706e-53a3-4a65-b28d-a9fb5c045aaf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:40.082836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a5706e-53a3-4a65-b28d-a9fb5c045aaf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:40.083220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a5706e-53a3-4a65-b28d-a9fb5c045aaf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:40.214436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-95a5706e-53a3-4a65-b28d-a9fb5c045aaf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:40.222555 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-95a5706e-53a3-4a65-b28d-a9fb5c045aaf tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1500 microversion: 2.1 time: 0.152607 Oct 05 18:30:40.223133 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3233/6710] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:40 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:41.249819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e93306bd-8e59-40f1-a707-aa2dcc338c6f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:41.251069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e93306bd-8e59-40f1-a707-aa2dcc338c6f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:41.262345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e93306bd-8e59-40f1-a707-aa2dcc338c6f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:41.262832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e93306bd-8e59-40f1-a707-aa2dcc338c6f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:41.263309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e93306bd-8e59-40f1-a707-aa2dcc338c6f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:41.264039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e93306bd-8e59-40f1-a707-aa2dcc338c6f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:41.264503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e93306bd-8e59-40f1-a707-aa2dcc338c6f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:41.264934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e93306bd-8e59-40f1-a707-aa2dcc338c6f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:41.403063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e93306bd-8e59-40f1-a707-aa2dcc338c6f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:41.411495 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e93306bd-8e59-40f1-a707-aa2dcc338c6f tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1500 microversion: 2.1 time: 0.169741 Oct 05 18:30:41.412079 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3478/6711] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:41 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:42.439043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-77bc43d1-d3a5-4c80-acf0-c6d29189379e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:42.440168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-77bc43d1-d3a5-4c80-acf0-c6d29189379e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:42.451941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77bc43d1-d3a5-4c80-acf0-c6d29189379e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:42.452495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77bc43d1-d3a5-4c80-acf0-c6d29189379e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:42.452973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77bc43d1-d3a5-4c80-acf0-c6d29189379e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:42.453689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77bc43d1-d3a5-4c80-acf0-c6d29189379e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:42.454148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77bc43d1-d3a5-4c80-acf0-c6d29189379e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:42.454616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77bc43d1-d3a5-4c80-acf0-c6d29189379e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:42.599035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-77bc43d1-d3a5-4c80-acf0-c6d29189379e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:42.607425 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-77bc43d1-d3a5-4c80-acf0-c6d29189379e tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1503 microversion: 2.1 time: 0.175021 Oct 05 18:30:42.608074 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3234/6712] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:42 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:42.639425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56680730-59cb-452d-b605-c90c7e19db5c tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:42.640064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56680730-59cb-452d-b605-c90c7e19db5c tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:42.647593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56680730-59cb-452d-b605-c90c7e19db5c tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:42.648100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56680730-59cb-452d-b605-c90c7e19db5c tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:42.648555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56680730-59cb-452d-b605-c90c7e19db5c tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:42.649278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56680730-59cb-452d-b605-c90c7e19db5c tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:42.649753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56680730-59cb-452d-b605-c90c7e19db5c tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:42.650221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56680730-59cb-452d-b605-c90c7e19db5c tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:42.677377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56680730-59cb-452d-b605-c90c7e19db5c tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:30:42.733428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:30:42.763755 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56680730-59cb-452d-b605-c90c7e19db5c tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "DELETE /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 204 len: 0 microversion: 2.1 time: 0.128284 Oct 05 18:30:42.764759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3479/6713] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:30:42 2022] DELETE /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:30:42.773151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25cef969-2ff7-4e5b-ae44-717fd9d17f5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:42.773773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-25cef969-2ff7-4e5b-ae44-717fd9d17f5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:42.780084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25cef969-2ff7-4e5b-ae44-717fd9d17f5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:42.780569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25cef969-2ff7-4e5b-ae44-717fd9d17f5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:42.781001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25cef969-2ff7-4e5b-ae44-717fd9d17f5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:42.781971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25cef969-2ff7-4e5b-ae44-717fd9d17f5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:42.782493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25cef969-2ff7-4e5b-ae44-717fd9d17f5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:42.782915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25cef969-2ff7-4e5b-ae44-717fd9d17f5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:42.920144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-25cef969-2ff7-4e5b-ae44-717fd9d17f5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:42.928174 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-25cef969-2ff7-4e5b-ae44-717fd9d17f5a tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1509 microversion: 2.1 time: 0.158947 Oct 05 18:30:42.928730 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3235/6714] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:42 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:43.952451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b42ba0b9-f680-4540-8d43-f708b2c254aa tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:43.953288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b42ba0b9-f680-4540-8d43-f708b2c254aa tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:43.960617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42ba0b9-f680-4540-8d43-f708b2c254aa tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:43.961118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42ba0b9-f680-4540-8d43-f708b2c254aa tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:43.961573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42ba0b9-f680-4540-8d43-f708b2c254aa tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:43.962272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42ba0b9-f680-4540-8d43-f708b2c254aa tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:43.962771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42ba0b9-f680-4540-8d43-f708b2c254aa tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:43.963209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b42ba0b9-f680-4540-8d43-f708b2c254aa tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:44.102613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b42ba0b9-f680-4540-8d43-f708b2c254aa tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:44.110676 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b42ba0b9-f680-4540-8d43-f708b2c254aa tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1509 microversion: 2.1 time: 0.162649 Oct 05 18:30:44.111263 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3480/6715] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:43 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:30:45.103781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-74dcee96-e8b5-4d7a-9760-48d5bcf1714c req-8f0a0e68-adcb-4467-8354-517cba4391ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aaac36d5-689e-4322-a51b-6ceda640978f", "name": "network-vif-deleted", "tag": "484a071f-225e-486a-bd3c-3376dc1927ca"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:30:45.117117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-74dcee96-e8b5-4d7a-9760-48d5bcf1714c req-8f0a0e68-adcb-4467-8354-517cba4391ec service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:45.117621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-74dcee96-e8b5-4d7a-9760-48d5bcf1714c req-8f0a0e68-adcb-4467-8354-517cba4391ec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:45.118035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-74dcee96-e8b5-4d7a-9760-48d5bcf1714c req-8f0a0e68-adcb-4467-8354-517cba4391ec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:45.122063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:30:45.131285 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-74dcee96-e8b5-4d7a-9760-48d5bcf1714c req-8f0a0e68-adcb-4467-8354-517cba4391ec service nova] Creating event network-vif-deleted:484a071f-225e-486a-bd3c-3376dc1927ca for instance aaac36d5-689e-4322-a51b-6ceda640978f on n-h2-835595-3 Oct 05 18:30:45.137495 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-74dcee96-e8b5-4d7a-9760-48d5bcf1714c req-8f0a0e68-adcb-4467-8354-517cba4391ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036639 Oct 05 18:30:45.138254 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3236/6716] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:30:45.142925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-17fc7ee7-2ef1-49a3-b574-be3011afe2c7 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:45.144115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-17fc7ee7-2ef1-49a3-b574-be3011afe2c7 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:45.151115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc7ee7-2ef1-49a3-b574-be3011afe2c7 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:45.151585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc7ee7-2ef1-49a3-b574-be3011afe2c7 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:45.152025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc7ee7-2ef1-49a3-b574-be3011afe2c7 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:45.152734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc7ee7-2ef1-49a3-b574-be3011afe2c7 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:45.153203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc7ee7-2ef1-49a3-b574-be3011afe2c7 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:45.153808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17fc7ee7-2ef1-49a3-b574-be3011afe2c7 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:45.228127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-17fc7ee7-2ef1-49a3-b574-be3011afe2c7 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'caaf813434a8453fabcd6f09cbc25e48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd146717104e14babaea61e9caaa8dc2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:30:45.236528 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-17fc7ee7-2ef1-49a3-b574-be3011afe2c7 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 200 len: 1300 microversion: 2.1 time: 0.098233 Oct 05 18:30:45.237144 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3481/6717] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:45 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:30:46.265262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:30:46.265830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] [instance: aaac36d5-689e-4322-a51b-6ceda640978f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:30:46.275020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:46.275509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:46.275953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:46.276661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:30:46.277122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:30:46.277552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:30:46.291960 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] HTTP exception thrown: Instance aaac36d5-689e-4322-a51b-6ceda640978f could not be found. Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Request method failure captured: Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f HTTP/1.1 Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc09DThEds_dHNeoKenH8CyIgGp4q6uE6siKCHMO3epFqnXheaa-6YekSuNUI14jaN14WP3f8vlBk5neBluI6Lpv2ZKFWL9MaVm6Tk6-euvGiWN6w2mydioMtIM4bsNjTByWHH0IzoQ1Xct2JfbcmUb0tGTIjDHxaTGZtqjTO0dUxj8 Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: d146717104e14babaea61e9caaa8dc2e Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestServerAdvancedOps-781980491 Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/d146717104e14babaea61e9caaa8dc2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d146717104e14babaea61e9caaa8dc2e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_d146717104e14babaea61e9caaa8dc2e", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/d146717104e14babaea61e9caaa8dc2e"}]}] Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestServerAdvancedOps-781980491 Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: d146717104e14babaea61e9caaa8dc2e Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestServerAdvancedOps-781980491 Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestServerAdvancedOps-781980491-project Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: caaf813434a8453fabcd6f09cbc25e48 Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestServerAdvancedOps-781980491-project Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance aaac36d5-689e-4322-a51b-6ceda640978f could not be found. Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'aaac36d5-689e-4322-a51b-6ceda640978f'} Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaac36d5-689e-4322-a51b-6ceda640978f could not be found. Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaac36d5-689e-4322-a51b-6ceda640978f could not be found. Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:30:46.293620 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:30:46.298048 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:30:46.298048 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:30:46.298048 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:30:46.298048 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:30:46.298048 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:30:46.298048 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaac36d5-689e-4322-a51b-6ceda640978f could not be found. Oct 05 18:30:46.298048 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:30:46.298048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] Returning 404 to user: Instance aaac36d5-689e-4322-a51b-6ceda640978f could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:30:46.298048 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3f2e662d-d9f2-4764-9677-15231e53afb8 tempest-TestServerAdvancedOps-781980491 tempest-TestServerAdvancedOps-781980491-project] 10.222.0.70 "GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f" status: 404 len: 111 microversion: 2.1 time: 0.037223 Oct 05 18:30:46.298048 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3237/6718] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:30:46 2022] GET /compute/v2.1/servers/aaac36d5-689e-4322-a51b-6ceda640978f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:31:09.305495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:09.306255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=12 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:09.426318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-545760640", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:09.482926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] validate_networks() for None {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:31:09.676427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:31:09.677011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:31:09.677685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:31:09.678254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:31:09.678835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:31:09.695118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:09.695631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:09.696091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:09.696970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:09.697426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:09.697881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:09.723705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Getting quotas for project 02766a98c2e847d59cf62fb819de378f. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:31:09.729103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Getting quotas for user 0806411c60fd462eb4a56a3da05a365b and project 02766a98c2e847d59cf62fb819de378f. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:31:09.742032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:31:09.744429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:31:09.791551 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-83ca48fc-e2a1-494b-a02c-8d4f34a34b69 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491254 Oct 05 18:31:09.792571 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3482/6719] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:31:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:31:09.805976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ccff3991-32b4-48f8-af5e-ea12b31f826f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:09.806941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ccff3991-32b4-48f8-af5e-ea12b31f826f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:09.809753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:09.865285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ccff3991-32b4-48f8-af5e-ea12b31f826f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:09.874776 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ccff3991-32b4-48f8-af5e-ea12b31f826f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1221 microversion: 2.1 time: 0.073272 Oct 05 18:31:09.875349 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3238/6720] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:09 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1221 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:10.899565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-102f5396-663e-4274-aba3-6d6dff10ec90 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:10.900094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-102f5396-663e-4274-aba3-6d6dff10ec90 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:10.906719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-102f5396-663e-4274-aba3-6d6dff10ec90 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:10.907258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-102f5396-663e-4274-aba3-6d6dff10ec90 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:10.907711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-102f5396-663e-4274-aba3-6d6dff10ec90 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:10.908476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-102f5396-663e-4274-aba3-6d6dff10ec90 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:10.908941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-102f5396-663e-4274-aba3-6d6dff10ec90 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:10.909376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-102f5396-663e-4274-aba3-6d6dff10ec90 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:10.998248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-102f5396-663e-4274-aba3-6d6dff10ec90 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:11.006877 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-102f5396-663e-4274-aba3-6d6dff10ec90 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1273 microversion: 2.1 time: 0.112306 Oct 05 18:31:11.012870 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3483/6721] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:10 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:12.032065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c69ffdf8-68df-45b1-892c-e474ca35ab4f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:12.032717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c69ffdf8-68df-45b1-892c-e474ca35ab4f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:12.043420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c69ffdf8-68df-45b1-892c-e474ca35ab4f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:12.043903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c69ffdf8-68df-45b1-892c-e474ca35ab4f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:12.044403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c69ffdf8-68df-45b1-892c-e474ca35ab4f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:12.045083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c69ffdf8-68df-45b1-892c-e474ca35ab4f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:12.046012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c69ffdf8-68df-45b1-892c-e474ca35ab4f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:12.046012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c69ffdf8-68df-45b1-892c-e474ca35ab4f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:12.181657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c69ffdf8-68df-45b1-892c-e474ca35ab4f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:12.190409 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c69ffdf8-68df-45b1-892c-e474ca35ab4f tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1321 microversion: 2.1 time: 0.162722 Oct 05 18:31:12.191061 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3239/6722] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:12 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:12.477412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-030f8f5a-a873-4489-991d-e20d559dad1b req-a51be0f8-c72d-4180-90aa-b0c47d339bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6804e7ad-8340-467d-a71d-a835b1fe04d3", "tag": "c24a4fc4-176b-4070-8536-f9cc7a325659"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:12.490586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-030f8f5a-a873-4489-991d-e20d559dad1b req-a51be0f8-c72d-4180-90aa-b0c47d339bdf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:12.491077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-030f8f5a-a873-4489-991d-e20d559dad1b req-a51be0f8-c72d-4180-90aa-b0c47d339bdf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:12.491520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-030f8f5a-a873-4489-991d-e20d559dad1b req-a51be0f8-c72d-4180-90aa-b0c47d339bdf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:12.504714 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-030f8f5a-a873-4489-991d-e20d559dad1b req-a51be0f8-c72d-4180-90aa-b0c47d339bdf service nova] Creating event network-changed:c24a4fc4-176b-4070-8536-f9cc7a325659 for instance 6804e7ad-8340-467d-a71d-a835b1fe04d3 on n-h2-835595-3 Oct 05 18:31:12.509879 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-030f8f5a-a873-4489-991d-e20d559dad1b req-a51be0f8-c72d-4180-90aa-b0c47d339bdf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038032 Oct 05 18:31:12.510736 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3484/6723] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:31:13.217590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-46d16feb-2a55-466b-ad91-af89bdc121c9 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:13.218688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-46d16feb-2a55-466b-ad91-af89bdc121c9 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:13.230438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d16feb-2a55-466b-ad91-af89bdc121c9 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:13.231246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d16feb-2a55-466b-ad91-af89bdc121c9 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:13.231969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d16feb-2a55-466b-ad91-af89bdc121c9 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:13.233123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d16feb-2a55-466b-ad91-af89bdc121c9 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:13.233881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d16feb-2a55-466b-ad91-af89bdc121c9 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:13.234654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-46d16feb-2a55-466b-ad91-af89bdc121c9 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:13.382325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-46d16feb-2a55-466b-ad91-af89bdc121c9 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:13.396496 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-46d16feb-2a55-466b-ad91-af89bdc121c9 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1321 microversion: 2.1 time: 0.185039 Oct 05 18:31:13.397421 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3240/6724] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:13 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:14.427568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b1c9b6b-a03d-4d6b-9300-b16f1043c825 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:14.428731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1b1c9b6b-a03d-4d6b-9300-b16f1043c825 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:14.439453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b1c9b6b-a03d-4d6b-9300-b16f1043c825 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:14.439950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b1c9b6b-a03d-4d6b-9300-b16f1043c825 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:14.440511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b1c9b6b-a03d-4d6b-9300-b16f1043c825 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:14.441253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b1c9b6b-a03d-4d6b-9300-b16f1043c825 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:14.441707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b1c9b6b-a03d-4d6b-9300-b16f1043c825 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:14.442124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1b1c9b6b-a03d-4d6b-9300-b16f1043c825 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:14.575513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1b1c9b6b-a03d-4d6b-9300-b16f1043c825 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:14.583562 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b1c9b6b-a03d-4d6b-9300-b16f1043c825 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1321 microversion: 2.1 time: 0.164520 Oct 05 18:31:14.584150 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3485/6725] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:14 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:15.610534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a56b424a-7a29-49b4-8abe-a9ec1699cb72 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:15.611613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a56b424a-7a29-49b4-8abe-a9ec1699cb72 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:15.623277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a56b424a-7a29-49b4-8abe-a9ec1699cb72 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:15.624089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a56b424a-7a29-49b4-8abe-a9ec1699cb72 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:15.624816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a56b424a-7a29-49b4-8abe-a9ec1699cb72 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:15.625963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a56b424a-7a29-49b4-8abe-a9ec1699cb72 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:15.626859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a56b424a-7a29-49b4-8abe-a9ec1699cb72 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:15.627267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a56b424a-7a29-49b4-8abe-a9ec1699cb72 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:15.768587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a56b424a-7a29-49b4-8abe-a9ec1699cb72 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:15.776479 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a56b424a-7a29-49b4-8abe-a9ec1699cb72 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1321 microversion: 2.1 time: 0.172515 Oct 05 18:31:15.777060 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3241/6726] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:15 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:16.802856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d854758-ac91-4cbe-98e5-a7b55d91304e tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:16.803605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d854758-ac91-4cbe-98e5-a7b55d91304e tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:16.812868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d854758-ac91-4cbe-98e5-a7b55d91304e tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:16.813494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d854758-ac91-4cbe-98e5-a7b55d91304e tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:16.814058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d854758-ac91-4cbe-98e5-a7b55d91304e tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:16.815001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d854758-ac91-4cbe-98e5-a7b55d91304e tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:16.815609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d854758-ac91-4cbe-98e5-a7b55d91304e tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:16.816164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d854758-ac91-4cbe-98e5-a7b55d91304e tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:16.962379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d854758-ac91-4cbe-98e5-a7b55d91304e tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:16.970747 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d854758-ac91-4cbe-98e5-a7b55d91304e tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1321 microversion: 2.1 time: 0.173783 Oct 05 18:31:16.971325 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3486/6727] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:16 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:17.913434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c318139e-c8eb-4ffa-8e32-1b5c43c3d894 req-0fd9a99e-b9f9-4a2d-863a-a08dc6b90850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6804e7ad-8340-467d-a71d-a835b1fe04d3", "name": "network-vif-plugged", "status": "completed", "tag": "c24a4fc4-176b-4070-8536-f9cc7a325659"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:17.925953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c318139e-c8eb-4ffa-8e32-1b5c43c3d894 req-0fd9a99e-b9f9-4a2d-863a-a08dc6b90850 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:17.928000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c318139e-c8eb-4ffa-8e32-1b5c43c3d894 req-0fd9a99e-b9f9-4a2d-863a-a08dc6b90850 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:17.928000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c318139e-c8eb-4ffa-8e32-1b5c43c3d894 req-0fd9a99e-b9f9-4a2d-863a-a08dc6b90850 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:17.939308 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c318139e-c8eb-4ffa-8e32-1b5c43c3d894 req-0fd9a99e-b9f9-4a2d-863a-a08dc6b90850 service nova] Creating event network-vif-plugged:c24a4fc4-176b-4070-8536-f9cc7a325659 for instance 6804e7ad-8340-467d-a71d-a835b1fe04d3 on n-h2-835595-3 Oct 05 18:31:17.944560 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c318139e-c8eb-4ffa-8e32-1b5c43c3d894 req-0fd9a99e-b9f9-4a2d-863a-a08dc6b90850 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034901 Oct 05 18:31:17.945425 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3242/6728] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:31:17.993743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47de0c22-48c5-480f-b983-a96d3e5ce6ce tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:17.995131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-47de0c22-48c5-480f-b983-a96d3e5ce6ce tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:18.002647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47de0c22-48c5-480f-b983-a96d3e5ce6ce tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:18.003160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47de0c22-48c5-480f-b983-a96d3e5ce6ce tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:18.003594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47de0c22-48c5-480f-b983-a96d3e5ce6ce tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:18.004304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47de0c22-48c5-480f-b983-a96d3e5ce6ce tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:18.004767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47de0c22-48c5-480f-b983-a96d3e5ce6ce tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:18.005202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47de0c22-48c5-480f-b983-a96d3e5ce6ce tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:18.179825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-47de0c22-48c5-480f-b983-a96d3e5ce6ce tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:18.191557 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-47de0c22-48c5-480f-b983-a96d3e5ce6ce tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1321 microversion: 2.1 time: 0.202197 Oct 05 18:31:18.192124 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3487/6729] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:17 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:19.218085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-40a14799-3c3b-498d-b130-4e72cddc5b18 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:19.218755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-40a14799-3c3b-498d-b130-4e72cddc5b18 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:19.229357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40a14799-3c3b-498d-b130-4e72cddc5b18 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:19.229975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40a14799-3c3b-498d-b130-4e72cddc5b18 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:19.230607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40a14799-3c3b-498d-b130-4e72cddc5b18 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:19.231654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40a14799-3c3b-498d-b130-4e72cddc5b18 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:19.232299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40a14799-3c3b-498d-b130-4e72cddc5b18 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:19.232916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-40a14799-3c3b-498d-b130-4e72cddc5b18 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:19.369817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-40a14799-3c3b-498d-b130-4e72cddc5b18 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:19.378406 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-40a14799-3c3b-498d-b130-4e72cddc5b18 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1471 microversion: 2.1 time: 0.167076 Oct 05 18:31:19.379009 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3243/6730] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:19 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:19.457214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-702819ab-e62d-4a0b-a3b8-88ba8cd16915 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Calling method '.version_select at 0x7f776c604820>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:19.535798 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-702819ab-e62d-4a0b-a3b8-88ba8cd16915 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/912e16db4e3146728c41e9b06d11ffc5" status: 200 len: 371 microversion: 2.1 time: 0.136045 Oct 05 18:31:19.536371 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3488/6731] 10.222.0.70 () {58 vars in 1242 bytes} [Wed Oct 5 18:31:19 2022] GET /compute/v2.1/os-quota-sets/912e16db4e3146728c41e9b06d11ffc5 => generated 371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:31:19.548748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d732a3b3-9548-44c3-bfdb-ddf975ca26d2 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-821039769", "id": 1963499722, "os-flavor-access:is_public": "True"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:19.569739 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d732a3b3-9548-44c3-bfdb-ddf975ca26d2 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.024812 Oct 05 18:31:19.570295 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3244/6732] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:31:19 2022] POST /compute/v2.1/flavors => generated 437 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:31:19.582649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1963499722"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:19.585017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:19.591201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:19.591704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:19.592157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:19.592866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:19.593336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:19.593772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:19.711649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:19.812637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cc0d2d53bb3247a6a9d43d985e045ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e16db4e3146728c41e9b06d11ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:19.822514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-821039769 {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 18:31:19.832605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:19.833130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:19.833583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:19.834323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:19.834815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:19.835251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:19.857659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Getting quotas for project 02766a98c2e847d59cf62fb819de378f. Resources: {'cores', 'ram'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:31:19.862911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Getting quotas for user 0806411c60fd462eb4a56a3da05a365b and project 02766a98c2e847d59cf62fb819de378f. Resources: {'cores', 'ram'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:31:19.875535 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.api [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] ram quota exceeded for 912e16db4e3146728c41e9b06d11ffc5, tried to resize instance. Oct 05 18:31:19.876090 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Request method failure captured: Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3/action HTTP/1.1 Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 39 Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc1tbkf2B9qbcKzrrV4S-UYUQeJuaiggo9cwBEJSC8pjehaNjDP2k4aw9hkPpR8nRCOKJG0eztEG_DEf50-gImSYQoqDqZgkGJg22EwJXrD6Wj7SRFPZUijBxHEZVj0Az-erSOdPI_H7L_MnZzBGxBxZa7mjg7XiLJRo4IvUrxjSLkw Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 912e16db4e3146728c41e9b06d11ffc5 Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-270814506 Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,admin,member Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,admin,member Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/912e16db4e3146728c41e9b06d11ffc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/912e16db4e3146728c41e9b06d11ffc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_912e16db4e3146728c41e9b06d11ffc5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/912e16db4e3146728c41e9b06d11ffc5"}]}] Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersAdminNegativeTestJSON-270814506 Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 912e16db4e3146728c41e9b06d11ffc5 Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-270814506 Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersAdminNegativeTestJSON-270814506-project-admin Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: cc0d2d53bb3247a6a9d43d985e045ae6 Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersAdminNegativeTestJSON-270814506-project-admin Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: {"resize": {"flavorRef": "1963499722"}} Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '6804e7ad-8340-467d-a71d-a835b1fe04d3', 'body': {'resize': {'flavorRef': '1963499722'}}} Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:31:19.878189 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b4a58fff-b040-4d22-b75d-4b9dee74ba01 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3/action" status: 403 len: 118 microversion: 2.1 time: 0.301092 Oct 05 18:31:19.882527 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3489/6733] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:31:19 2022] POST /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3/action => generated 118 bytes in 302 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:31:19.891131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-244c797b-61d4-48af-b3d8-1b89e41f6ad8 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:19.894752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:19.912807 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-244c797b-61d4-48af-b3d8-1b89e41f6ad8 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/1963499722" status: 202 len: 0 microversion: 2.1 time: 0.027334 Oct 05 18:31:19.913802 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3245/6734] 10.222.0.70 () {58 vars in 1161 bytes} [Wed Oct 5 18:31:19 2022] DELETE /compute/v2.1/flavors/1963499722 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:31:19.923419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d203f905-c6af-4931-91b0-371b58a7aecc tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:19.944261 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d203f905-c6af-4931-91b0-371b58a7aecc tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024625 Oct 05 18:31:19.944843 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3490/6735] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 18:31:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:19.965300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5b25a961-d9f4-48f9-a0fa-ff7dfc108164 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Calling method '.version_select at 0x7f77794c6040>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:20.044069 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5b25a961-d9f4-48f9-a0fa-ff7dfc108164 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] 10.222.0.70 "GET /compute/v2.1/os-quota-sets/912e16db4e3146728c41e9b06d11ffc5" status: 200 len: 371 microversion: 2.1 time: 0.082573 Oct 05 18:31:20.044654 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3246/6736] 10.222.0.70 () {58 vars in 1242 bytes} [Wed Oct 5 18:31:19 2022] GET /compute/v2.1/os-quota-sets/912e16db4e3146728c41e9b06d11ffc5 => generated 371 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:31:20.056777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5bdfe5cd-fba7-41f9-ae20-3a2ccfe08857 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1619201575", "id": 675687194, "os-flavor-access:is_public": "True"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:20.077866 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5bdfe5cd-fba7-41f9-ae20-3a2ccfe08857 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] 10.222.0.70 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.024914 Oct 05 18:31:20.078501 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3491/6737] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:31:20 2022] POST /compute/v2.1/flavors => generated 434 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:31:20.091063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "675687194"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:20.093450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:20.099881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:20.100370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:20.100814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:20.101536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:20.101995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:20.102465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:20.196590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'cc0d2d53bb3247a6a9d43d985e045ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '912e16db4e3146728c41e9b06d11ffc5', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:20.205651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1619201575 {{(pid=128843) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 18:31:20.216041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:20.216717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:20.217324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:20.218438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:20.218990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:20.220494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:20.246668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Getting quotas for project 02766a98c2e847d59cf62fb819de378f. Resources: {'cores', 'ram'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:31:20.251742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Getting quotas for user 0806411c60fd462eb4a56a3da05a365b and project 02766a98c2e847d59cf62fb819de378f. Resources: {'cores', 'ram'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:31:20.265901 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.compute.api [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] cores quota exceeded for 912e16db4e3146728c41e9b06d11ffc5, tried to resize instance. Oct 05 18:31:20.266476 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Request method failure captured: Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3/action HTTP/1.1 Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 38 Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc1tbkf2B9qbcKzrrV4S-UYUQeJuaiggo9cwBEJSC8pjehaNjDP2k4aw9hkPpR8nRCOKJG0eztEG_DEf50-gImSYQoqDqZgkGJg22EwJXrD6Wj7SRFPZUijBxHEZVj0Az-erSOdPI_H7L_MnZzBGxBxZa7mjg7XiLJRo4IvUrxjSLkw Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 912e16db4e3146728c41e9b06d11ffc5 Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-270814506 Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,admin,member Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,admin,member Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/912e16db4e3146728c41e9b06d11ffc5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/912e16db4e3146728c41e9b06d11ffc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_912e16db4e3146728c41e9b06d11ffc5", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/912e16db4e3146728c41e9b06d11ffc5"}]}] Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersAdminNegativeTestJSON-270814506 Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 912e16db4e3146728c41e9b06d11ffc5 Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-270814506 Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersAdminNegativeTestJSON-270814506-project-admin Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: cc0d2d53bb3247a6a9d43d985e045ae6 Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersAdminNegativeTestJSON-270814506-project-admin Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: {"resize": {"flavorRef": "675687194"}} Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '6804e7ad-8340-467d-a71d-a835b1fe04d3', 'body': {'resize': {'flavorRef': '675687194'}}} Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:31:20.268563 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-476832fa-d939-49d1-837e-209ab103257e tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] 10.222.0.70 "POST /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3/action" status: 403 len: 113 microversion: 2.1 time: 0.183053 Oct 05 18:31:20.272813 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3247/6738] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:31:20 2022] POST /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3/action => generated 113 bytes in 184 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:31:20.278987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47b61ef0-6d5d-4d28-b225-cc7ccc21f99c tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:20.298809 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-47b61ef0-6d5d-4d28-b225-cc7ccc21f99c tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] 10.222.0.70 "DELETE /compute/v2.1/flavors/675687194" status: 202 len: 0 microversion: 2.1 time: 0.023614 Oct 05 18:31:20.299531 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3492/6739] 10.222.0.70 () {58 vars in 1158 bytes} [Wed Oct 5 18:31:20 2022] DELETE /compute/v2.1/flavors/675687194 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:31:20.307634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b25ee9e9-0430-4685-b25f-5660b1fa3ca8 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:20.327497 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b25ee9e9-0430-4685-b25f-5660b1fa3ca8 tempest-ServersAdminNegativeTestJSON-270814506 tempest-ServersAdminNegativeTestJSON-270814506-project-admin] 10.222.0.70 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023584 Oct 05 18:31:20.328042 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3248/6740] 10.222.0.70 () {58 vars in 1146 bytes} [Wed Oct 5 18:31:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:20.349755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-40b965f9-ff52-4ff7-87fb-10ef43310148 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:20.350373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-40b965f9-ff52-4ff7-87fb-10ef43310148 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:20.356886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b965f9-ff52-4ff7-87fb-10ef43310148 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:20.357444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b965f9-ff52-4ff7-87fb-10ef43310148 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:20.357977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b965f9-ff52-4ff7-87fb-10ef43310148 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:20.358757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b965f9-ff52-4ff7-87fb-10ef43310148 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:20.359236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b965f9-ff52-4ff7-87fb-10ef43310148 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:20.359700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-40b965f9-ff52-4ff7-87fb-10ef43310148 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:20.385331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-40b965f9-ff52-4ff7-87fb-10ef43310148 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:31:20.465711 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-40b965f9-ff52-4ff7-87fb-10ef43310148 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 204 len: 0 microversion: 2.1 time: 0.119875 Oct 05 18:31:20.466655 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3493/6741] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:31:20 2022] DELETE /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:31:20.474953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-98bbeeb1-e0af-489e-b2e4-4837737c997c tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:20.475583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-98bbeeb1-e0af-489e-b2e4-4837737c997c tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:20.484570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98bbeeb1-e0af-489e-b2e4-4837737c997c tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:20.485053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98bbeeb1-e0af-489e-b2e4-4837737c997c tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:20.485479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98bbeeb1-e0af-489e-b2e4-4837737c997c tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:20.486250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98bbeeb1-e0af-489e-b2e4-4837737c997c tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:20.486772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98bbeeb1-e0af-489e-b2e4-4837737c997c tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:20.487195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-98bbeeb1-e0af-489e-b2e4-4837737c997c tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:20.629335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-98bbeeb1-e0af-489e-b2e4-4837737c997c tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:20.639302 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-98bbeeb1-e0af-489e-b2e4-4837737c997c tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1477 microversion: 2.1 time: 0.168241 Oct 05 18:31:20.640011 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3249/6742] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:20 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:21.668382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-90edce02-f777-482a-ac88-a1d45b688382 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:21.669615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-90edce02-f777-482a-ac88-a1d45b688382 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:21.681215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90edce02-f777-482a-ac88-a1d45b688382 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:21.682057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90edce02-f777-482a-ac88-a1d45b688382 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:21.682961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90edce02-f777-482a-ac88-a1d45b688382 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:21.684110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90edce02-f777-482a-ac88-a1d45b688382 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:21.684881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90edce02-f777-482a-ac88-a1d45b688382 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:21.685601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-90edce02-f777-482a-ac88-a1d45b688382 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:21.923307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-90edce02-f777-482a-ac88-a1d45b688382 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0806411c60fd462eb4a56a3da05a365b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02766a98c2e847d59cf62fb819de378f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:21.932510 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-90edce02-f777-482a-ac88-a1d45b688382 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 200 len: 1477 microversion: 2.1 time: 0.271175 Oct 05 18:31:21.933377 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3494/6743] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:21 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:22.278340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b21a8324-d739-4e7f-838c-1f68ecbf4d99 req-08cec276-46dc-44db-b6ca-fd1f713038a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6804e7ad-8340-467d-a71d-a835b1fe04d3", "name": "network-vif-deleted", "tag": "c24a4fc4-176b-4070-8536-f9cc7a325659"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:22.305039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b21a8324-d739-4e7f-838c-1f68ecbf4d99 req-08cec276-46dc-44db-b6ca-fd1f713038a2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:22.305524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b21a8324-d739-4e7f-838c-1f68ecbf4d99 req-08cec276-46dc-44db-b6ca-fd1f713038a2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:22.305957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b21a8324-d739-4e7f-838c-1f68ecbf4d99 req-08cec276-46dc-44db-b6ca-fd1f713038a2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:22.317918 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b21a8324-d739-4e7f-838c-1f68ecbf4d99 req-08cec276-46dc-44db-b6ca-fd1f713038a2 service nova] Creating event network-vif-deleted:c24a4fc4-176b-4070-8536-f9cc7a325659 for instance 6804e7ad-8340-467d-a71d-a835b1fe04d3 on n-h2-835595-3 Oct 05 18:31:22.324097 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b21a8324-d739-4e7f-838c-1f68ecbf4d99 req-08cec276-46dc-44db-b6ca-fd1f713038a2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050364 Oct 05 18:31:22.324925 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3250/6744] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:31:22.956398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:22.957028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] [instance: 6804e7ad-8340-467d-a71d-a835b1fe04d3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:22.964549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:22.965054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:22.965508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:22.966222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:22.966729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:22.967172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:22.981062 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] HTTP exception thrown: Instance 6804e7ad-8340-467d-a71d-a835b1fe04d3 could not be found. Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Request method failure captured: Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 HTTP/1.1 Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc1sI4urGKYj8E1abxSenqyo5ndk5Q7YBcH2v_bjjD0LWWsCpuHmzNl2YdJzSD6BdWoK-UJpVqGy-uxbWEYqaKhorNWgTg6tc40QO97erdC4stBq0e6cDvNqlBUEDRxKQmd1FmYBY8_3AHVxahVGqY8qPXof7YxRtD5vC_Tvn3eMhbw Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 02766a98c2e847d59cf62fb819de378f Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-184774186 Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/02766a98c2e847d59cf62fb819de378f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02766a98c2e847d59cf62fb819de378f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_02766a98c2e847d59cf62fb819de378f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/02766a98c2e847d59cf62fb819de378f"}]}] Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersAdminNegativeTestJSON-184774186 Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 02766a98c2e847d59cf62fb819de378f Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-184774186 Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersAdminNegativeTestJSON-184774186-project Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 0806411c60fd462eb4a56a3da05a365b Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersAdminNegativeTestJSON-184774186-project Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 6804e7ad-8340-467d-a71d-a835b1fe04d3 could not be found. Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '6804e7ad-8340-467d-a71d-a835b1fe04d3'} Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6804e7ad-8340-467d-a71d-a835b1fe04d3 could not be found. Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6804e7ad-8340-467d-a71d-a835b1fe04d3 could not be found. Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:22.982795 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6804e7ad-8340-467d-a71d-a835b1fe04d3 could not be found. Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] Returning 404 to user: Instance 6804e7ad-8340-467d-a71d-a835b1fe04d3 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f7f9348c-01d1-42d9-aee2-23b1c2e54b73 tempest-ServersAdminNegativeTestJSON-184774186 tempest-ServersAdminNegativeTestJSON-184774186-project] 10.222.0.70 "GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3" status: 404 len: 111 microversion: 2.1 time: 0.032186 Oct 05 18:31:22.990215 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3495/6745] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:22 2022] GET /compute/v2.1/servers/6804e7ad-8340-467d-a71d-a835b1fe04d3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:31:29.381176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1550092475", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "8fa78108-9303-4850-a07b-c323010d275c"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:29.440236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] validate_networks() for [('8fa78108-9303-4850-a07b-c323010d275c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:31:29.824683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:31:29.825110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:31:29.825585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:31:29.826017 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:31:29.826473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:31:29.836336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:29.837369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:29.837369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:29.838057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:29.838552 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:29.838988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:29.857543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Getting quotas for project e1717be68b21433db904be87d3abcaa6. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:31:29.863079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Getting quotas for user 4750d49509b440eeb83ee69d3c980e5f and project e1717be68b21433db904be87d3abcaa6. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:31:29.876206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:31:29.878801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:31:29.930593 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5e5ab17f-36b5-4a6e-a412-d8bf3068d3f4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.683001 Oct 05 18:31:29.931253 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3251/6746] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:31:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:31:29.942718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3b4cc39e-7f75-4ee7-9a65-7c42fc8712ed tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:29.943343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3b4cc39e-7f75-4ee7-9a65-7c42fc8712ed tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:29.945431 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:29.946236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:30.006236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3b4cc39e-7f75-4ee7-9a65-7c42fc8712ed tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:30.014302 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3b4cc39e-7f75-4ee7-9a65-7c42fc8712ed tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1215 microversion: 2.1 time: 0.075818 Oct 05 18:31:30.014880 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3496/6747] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:29 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:31.039875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b566fd9c-f10f-436c-935b-19b88e5c0785 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:31.040643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b566fd9c-f10f-436c-935b-19b88e5c0785 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:31.047975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b566fd9c-f10f-436c-935b-19b88e5c0785 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:31.048525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b566fd9c-f10f-436c-935b-19b88e5c0785 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:31.048958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b566fd9c-f10f-436c-935b-19b88e5c0785 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:31.049827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b566fd9c-f10f-436c-935b-19b88e5c0785 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:31.050471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b566fd9c-f10f-436c-935b-19b88e5c0785 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:31.050896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b566fd9c-f10f-436c-935b-19b88e5c0785 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:31.126798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b566fd9c-f10f-436c-935b-19b88e5c0785 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:31.136021 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b566fd9c-f10f-436c-935b-19b88e5c0785 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1275 microversion: 2.1 time: 0.101797 Oct 05 18:31:31.150316 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3252/6748] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:31 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:32.160475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ee773e3a-0d6e-4448-8d92-78ee10ca53f3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:32.161146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ee773e3a-0d6e-4448-8d92-78ee10ca53f3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:32.169383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee773e3a-0d6e-4448-8d92-78ee10ca53f3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:32.169912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee773e3a-0d6e-4448-8d92-78ee10ca53f3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:32.170359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee773e3a-0d6e-4448-8d92-78ee10ca53f3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:32.171314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee773e3a-0d6e-4448-8d92-78ee10ca53f3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:32.171789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee773e3a-0d6e-4448-8d92-78ee10ca53f3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:32.172232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ee773e3a-0d6e-4448-8d92-78ee10ca53f3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:32.255629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ee773e3a-0d6e-4448-8d92-78ee10ca53f3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:32.264634 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ee773e3a-0d6e-4448-8d92-78ee10ca53f3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1273 microversion: 2.1 time: 0.108234 Oct 05 18:31:32.265276 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3497/6749] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:32 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1273 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:33.170744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-84a821c3-3340-4b4e-9b4d-5883c3c72a2c req-6009aa2b-25f1-4718-9784-29e4c79c8f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f950f590-0e9c-4d9f-8432-b56daab669ac", "tag": "c26f2eff-c820-4a5d-8a76-484d23d876d6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:33.184449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-84a821c3-3340-4b4e-9b4d-5883c3c72a2c req-6009aa2b-25f1-4718-9784-29e4c79c8f15 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:33.184944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-84a821c3-3340-4b4e-9b4d-5883c3c72a2c req-6009aa2b-25f1-4718-9784-29e4c79c8f15 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:33.185372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-84a821c3-3340-4b4e-9b4d-5883c3c72a2c req-6009aa2b-25f1-4718-9784-29e4c79c8f15 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:33.198469 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-84a821c3-3340-4b4e-9b4d-5883c3c72a2c req-6009aa2b-25f1-4718-9784-29e4c79c8f15 service nova] Creating event network-changed:c26f2eff-c820-4a5d-8a76-484d23d876d6 for instance f950f590-0e9c-4d9f-8432-b56daab669ac on n-h2-835595-3 Oct 05 18:31:33.204671 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-84a821c3-3340-4b4e-9b4d-5883c3c72a2c req-6009aa2b-25f1-4718-9784-29e4c79c8f15 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038949 Oct 05 18:31:33.205445 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3253/6750] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:31:33.288622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-349ebdad-3191-4f4b-a068-b10b85693b91 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:33.289443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-349ebdad-3191-4f4b-a068-b10b85693b91 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:33.297145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-349ebdad-3191-4f4b-a068-b10b85693b91 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:33.297830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-349ebdad-3191-4f4b-a068-b10b85693b91 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:33.298470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-349ebdad-3191-4f4b-a068-b10b85693b91 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:33.299312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-349ebdad-3191-4f4b-a068-b10b85693b91 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:33.299890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-349ebdad-3191-4f4b-a068-b10b85693b91 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:33.300439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-349ebdad-3191-4f4b-a068-b10b85693b91 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:33.531886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-349ebdad-3191-4f4b-a068-b10b85693b91 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:33.544040 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-349ebdad-3191-4f4b-a068-b10b85693b91 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1315 microversion: 2.1 time: 0.259202 Oct 05 18:31:33.544553 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3498/6751] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:33 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:34.567492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a1959a72-26c9-4b6b-95d2-ab702ead7d93 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:34.568131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a1959a72-26c9-4b6b-95d2-ab702ead7d93 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:34.575300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1959a72-26c9-4b6b-95d2-ab702ead7d93 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:34.575798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1959a72-26c9-4b6b-95d2-ab702ead7d93 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:34.576227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1959a72-26c9-4b6b-95d2-ab702ead7d93 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:34.576893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1959a72-26c9-4b6b-95d2-ab702ead7d93 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:34.577372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1959a72-26c9-4b6b-95d2-ab702ead7d93 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:34.577784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1959a72-26c9-4b6b-95d2-ab702ead7d93 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:34.717618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a1959a72-26c9-4b6b-95d2-ab702ead7d93 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:34.725826 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a1959a72-26c9-4b6b-95d2-ab702ead7d93 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1315 microversion: 2.1 time: 0.162866 Oct 05 18:31:34.726436 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3254/6752] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:34 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:35.753390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cf1a152f-7a31-4aac-b266-e6ced686bb3b tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:35.754302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cf1a152f-7a31-4aac-b266-e6ced686bb3b tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:35.767298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1a152f-7a31-4aac-b266-e6ced686bb3b tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:35.767828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1a152f-7a31-4aac-b266-e6ced686bb3b tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:35.768299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1a152f-7a31-4aac-b266-e6ced686bb3b tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:35.769076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1a152f-7a31-4aac-b266-e6ced686bb3b tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:35.769552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1a152f-7a31-4aac-b266-e6ced686bb3b tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:35.770116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cf1a152f-7a31-4aac-b266-e6ced686bb3b tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:35.921016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cf1a152f-7a31-4aac-b266-e6ced686bb3b tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:35.930043 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cf1a152f-7a31-4aac-b266-e6ced686bb3b tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1315 microversion: 2.1 time: 0.183335 Oct 05 18:31:35.930888 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3499/6753] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:35 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:36.953687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1a297a32-5720-46b5-9fa9-12a02d7d1062 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:36.954320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1a297a32-5720-46b5-9fa9-12a02d7d1062 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:36.961685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a297a32-5720-46b5-9fa9-12a02d7d1062 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:36.962248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a297a32-5720-46b5-9fa9-12a02d7d1062 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:36.962837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a297a32-5720-46b5-9fa9-12a02d7d1062 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:36.963557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a297a32-5720-46b5-9fa9-12a02d7d1062 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:36.964010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a297a32-5720-46b5-9fa9-12a02d7d1062 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:36.964515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1a297a32-5720-46b5-9fa9-12a02d7d1062 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:37.101894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1a297a32-5720-46b5-9fa9-12a02d7d1062 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:37.110613 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1a297a32-5720-46b5-9fa9-12a02d7d1062 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1315 microversion: 2.1 time: 0.161038 Oct 05 18:31:37.111198 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3255/6754] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:36 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:37.965716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-1ecbd629-3356-4909-965d-c054869d4987 req-9dd9d38b-3b91-446e-9c4e-5755b67b6780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f950f590-0e9c-4d9f-8432-b56daab669ac", "name": "network-vif-plugged", "status": "completed", "tag": "c26f2eff-c820-4a5d-8a76-484d23d876d6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:37.977776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1ecbd629-3356-4909-965d-c054869d4987 req-9dd9d38b-3b91-446e-9c4e-5755b67b6780 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:37.978288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1ecbd629-3356-4909-965d-c054869d4987 req-9dd9d38b-3b91-446e-9c4e-5755b67b6780 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:37.978736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1ecbd629-3356-4909-965d-c054869d4987 req-9dd9d38b-3b91-446e-9c4e-5755b67b6780 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:37.990318 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-1ecbd629-3356-4909-965d-c054869d4987 req-9dd9d38b-3b91-446e-9c4e-5755b67b6780 service nova] Creating event network-vif-plugged:c26f2eff-c820-4a5d-8a76-484d23d876d6 for instance f950f590-0e9c-4d9f-8432-b56daab669ac on n-h2-835595-3 Oct 05 18:31:37.995755 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-1ecbd629-3356-4909-965d-c054869d4987 req-9dd9d38b-3b91-446e-9c4e-5755b67b6780 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034073 Oct 05 18:31:37.996622 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3500/6755] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:31:38.134459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6a40506-721f-4c3b-9220-03ae252a7351 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:38.135185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c6a40506-721f-4c3b-9220-03ae252a7351 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:38.142669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6a40506-721f-4c3b-9220-03ae252a7351 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:38.143154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6a40506-721f-4c3b-9220-03ae252a7351 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:38.143582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6a40506-721f-4c3b-9220-03ae252a7351 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:38.144315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6a40506-721f-4c3b-9220-03ae252a7351 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:38.144778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6a40506-721f-4c3b-9220-03ae252a7351 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:38.145198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6a40506-721f-4c3b-9220-03ae252a7351 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:38.283492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c6a40506-721f-4c3b-9220-03ae252a7351 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:38.291535 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c6a40506-721f-4c3b-9220-03ae252a7351 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1315 microversion: 2.1 time: 0.161519 Oct 05 18:31:38.292107 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3256/6756] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:38 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:39.316763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0afd706f-a36e-4b17-8222-5afcd20c2659 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:39.317475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0afd706f-a36e-4b17-8222-5afcd20c2659 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:39.319608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:39.326506 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0afd706f-a36e-4b17-8222-5afcd20c2659 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:39.327040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0afd706f-a36e-4b17-8222-5afcd20c2659 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:39.327515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0afd706f-a36e-4b17-8222-5afcd20c2659 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:39.328262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0afd706f-a36e-4b17-8222-5afcd20c2659 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:39.328758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0afd706f-a36e-4b17-8222-5afcd20c2659 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:39.329212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0afd706f-a36e-4b17-8222-5afcd20c2659 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:39.336554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:39.478055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0afd706f-a36e-4b17-8222-5afcd20c2659 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:39.486864 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0afd706f-a36e-4b17-8222-5afcd20c2659 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1503 microversion: 2.1 time: 0.175677 Oct 05 18:31:39.487486 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3501/6757] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:39 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:39.512412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:31:39.515616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:39.525853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:39.526523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:39.527105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:39.527926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:39.528522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:39.529108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:39.608315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:39.614041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Old instance type m1.heat2, new instance type m1.heat {{(pid=128843) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 18:31:39.620940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:31:39.621353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:31:39.621830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:31:39.622230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:31:39.622663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:31:39.748008 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d0118548-5a6d-4e00-953b-82cff643b0cb tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "POST /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac/action" status: 202 len: 0 microversion: 2.1 time: 0.241746 Oct 05 18:31:39.748633 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3257/6758] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:31:39 2022] POST /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 18:31:39.757067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-83e731f1-7fd3-464e-a93a-07e18dafb319 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:39.758701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-83e731f1-7fd3-464e-a93a-07e18dafb319 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:39.765293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83e731f1-7fd3-464e-a93a-07e18dafb319 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:39.766143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83e731f1-7fd3-464e-a93a-07e18dafb319 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:39.766255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83e731f1-7fd3-464e-a93a-07e18dafb319 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:39.766969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83e731f1-7fd3-464e-a93a-07e18dafb319 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:39.767440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83e731f1-7fd3-464e-a93a-07e18dafb319 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:39.767874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-83e731f1-7fd3-464e-a93a-07e18dafb319 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:39.942131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-83e731f1-7fd3-464e-a93a-07e18dafb319 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:39.950711 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-83e731f1-7fd3-464e-a93a-07e18dafb319 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1512 microversion: 2.1 time: 0.197494 Oct 05 18:31:39.951518 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3502/6759] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:39 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1512 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:40.970582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=5 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:40.971379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:40.977049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e580ba54-c4b2-4b8c-80df-cec643d28173 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:40.977750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e580ba54-c4b2-4b8c-80df-cec643d28173 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:40.983132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:40.988883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e580ba54-c4b2-4b8c-80df-cec643d28173 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:40.989458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e580ba54-c4b2-4b8c-80df-cec643d28173 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:40.989970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e580ba54-c4b2-4b8c-80df-cec643d28173 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:40.990842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e580ba54-c4b2-4b8c-80df-cec643d28173 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:40.991291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e580ba54-c4b2-4b8c-80df-cec643d28173 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:40.991722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e580ba54-c4b2-4b8c-80df-cec643d28173 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:40.996437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:41.135507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e580ba54-c4b2-4b8c-80df-cec643d28173 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:41.144196 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e580ba54-c4b2-4b8c-80df-cec643d28173 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1512 microversion: 2.1 time: 0.174536 Oct 05 18:31:41.144799 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3258/6760] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:40 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:42.170661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-10160bec-6cca-4783-847c-7bdf7d402fc0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:42.171715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-10160bec-6cca-4783-847c-7bdf7d402fc0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:42.174799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:31:42.184043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10160bec-6cca-4783-847c-7bdf7d402fc0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:42.184541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10160bec-6cca-4783-847c-7bdf7d402fc0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:42.184990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10160bec-6cca-4783-847c-7bdf7d402fc0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:42.185696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10160bec-6cca-4783-847c-7bdf7d402fc0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:42.186167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10160bec-6cca-4783-847c-7bdf7d402fc0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:42.186661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10160bec-6cca-4783-847c-7bdf7d402fc0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:42.599848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-10160bec-6cca-4783-847c-7bdf7d402fc0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:42.608288 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-10160bec-6cca-4783-847c-7bdf7d402fc0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.444258 Oct 05 18:31:42.608873 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3503/6761] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:42 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:43.640685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ba59baa2-dd72-4517-97ba-ef32776c59da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:43.641284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ba59baa2-dd72-4517-97ba-ef32776c59da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:43.648637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba59baa2-dd72-4517-97ba-ef32776c59da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:43.649131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba59baa2-dd72-4517-97ba-ef32776c59da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:43.649570 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba59baa2-dd72-4517-97ba-ef32776c59da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:43.650270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba59baa2-dd72-4517-97ba-ef32776c59da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:43.650761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba59baa2-dd72-4517-97ba-ef32776c59da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:43.651193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ba59baa2-dd72-4517-97ba-ef32776c59da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:43.803235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ba59baa2-dd72-4517-97ba-ef32776c59da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:43.811623 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ba59baa2-dd72-4517-97ba-ef32776c59da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.175296 Oct 05 18:31:43.812889 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3259/6762] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:43 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:44.839690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99593d74-2b31-43dd-ae75-f41ed666d5ee tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:44.840677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99593d74-2b31-43dd-ae75-f41ed666d5ee tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:44.852479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99593d74-2b31-43dd-ae75-f41ed666d5ee tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:44.853297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99593d74-2b31-43dd-ae75-f41ed666d5ee tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:44.854042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99593d74-2b31-43dd-ae75-f41ed666d5ee tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:44.855288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99593d74-2b31-43dd-ae75-f41ed666d5ee tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:44.855926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99593d74-2b31-43dd-ae75-f41ed666d5ee tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:44.856392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99593d74-2b31-43dd-ae75-f41ed666d5ee tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:44.997178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99593d74-2b31-43dd-ae75-f41ed666d5ee tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:45.006011 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99593d74-2b31-43dd-ae75-f41ed666d5ee tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.172949 Oct 05 18:31:45.006657 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3504/6763] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:44 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:46.030675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3f3870ef-1029-48a3-a425-7273ade367c7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:46.031278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3f3870ef-1029-48a3-a425-7273ade367c7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:46.039191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f3870ef-1029-48a3-a425-7273ade367c7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:46.039686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f3870ef-1029-48a3-a425-7273ade367c7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:46.040107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f3870ef-1029-48a3-a425-7273ade367c7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:46.040821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f3870ef-1029-48a3-a425-7273ade367c7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:46.041266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f3870ef-1029-48a3-a425-7273ade367c7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:46.041676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3f3870ef-1029-48a3-a425-7273ade367c7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:46.185524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3f3870ef-1029-48a3-a425-7273ade367c7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:46.197317 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3f3870ef-1029-48a3-a425-7273ade367c7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.170750 Oct 05 18:31:46.198145 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3260/6764] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:46 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:47.226071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6da26de9-3340-41e5-ac7a-9fc6cb8eceb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:47.227043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6da26de9-3340-41e5-ac7a-9fc6cb8eceb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:47.243646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6da26de9-3340-41e5-ac7a-9fc6cb8eceb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:47.244512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6da26de9-3340-41e5-ac7a-9fc6cb8eceb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:47.245264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6da26de9-3340-41e5-ac7a-9fc6cb8eceb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:47.246547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6da26de9-3340-41e5-ac7a-9fc6cb8eceb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:47.247291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6da26de9-3340-41e5-ac7a-9fc6cb8eceb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:47.248020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6da26de9-3340-41e5-ac7a-9fc6cb8eceb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:47.394803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6da26de9-3340-41e5-ac7a-9fc6cb8eceb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:47.403456 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6da26de9-3340-41e5-ac7a-9fc6cb8eceb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.184379 Oct 05 18:31:47.404085 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3505/6765] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:47 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:48.429444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b231444-8f06-4fad-9d33-5893b6b004a8 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:48.430159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b231444-8f06-4fad-9d33-5893b6b004a8 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:48.439696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b231444-8f06-4fad-9d33-5893b6b004a8 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:48.440343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b231444-8f06-4fad-9d33-5893b6b004a8 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:48.440922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b231444-8f06-4fad-9d33-5893b6b004a8 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:48.441832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b231444-8f06-4fad-9d33-5893b6b004a8 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:48.442477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b231444-8f06-4fad-9d33-5893b6b004a8 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:48.443047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b231444-8f06-4fad-9d33-5893b6b004a8 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:48.584407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3b231444-8f06-4fad-9d33-5893b6b004a8 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:48.592786 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b231444-8f06-4fad-9d33-5893b6b004a8 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.168731 Oct 05 18:31:48.593366 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3261/6766] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:48 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:49.621280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8ada21aa-4197-41cd-a35d-d966d4a032a5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:49.622359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8ada21aa-4197-41cd-a35d-d966d4a032a5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:49.633011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ada21aa-4197-41cd-a35d-d966d4a032a5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:49.633526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ada21aa-4197-41cd-a35d-d966d4a032a5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:49.633953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ada21aa-4197-41cd-a35d-d966d4a032a5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:49.634699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ada21aa-4197-41cd-a35d-d966d4a032a5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:49.635164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ada21aa-4197-41cd-a35d-d966d4a032a5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:49.635599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8ada21aa-4197-41cd-a35d-d966d4a032a5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:49.777382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8ada21aa-4197-41cd-a35d-d966d4a032a5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:49.785832 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8ada21aa-4197-41cd-a35d-d966d4a032a5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.171510 Oct 05 18:31:49.786418 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3506/6767] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:49 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:50.811940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-02e0c6db-20a0-4711-9f26-68ed6de902a0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:50.812554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-02e0c6db-20a0-4711-9f26-68ed6de902a0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:50.819680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02e0c6db-20a0-4711-9f26-68ed6de902a0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:50.820169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02e0c6db-20a0-4711-9f26-68ed6de902a0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:50.820610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02e0c6db-20a0-4711-9f26-68ed6de902a0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:50.821303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02e0c6db-20a0-4711-9f26-68ed6de902a0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:50.821800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02e0c6db-20a0-4711-9f26-68ed6de902a0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:50.822225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02e0c6db-20a0-4711-9f26-68ed6de902a0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:50.962137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-02e0c6db-20a0-4711-9f26-68ed6de902a0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:50.970335 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-02e0c6db-20a0-4711-9f26-68ed6de902a0 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.162453 Oct 05 18:31:50.970914 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3262/6768] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:50 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:52.006475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-69c8d548-6e74-499f-bac5-dda4ffb09079 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:52.007573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-69c8d548-6e74-499f-bac5-dda4ffb09079 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:52.018501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c8d548-6e74-499f-bac5-dda4ffb09079 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:52.018996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c8d548-6e74-499f-bac5-dda4ffb09079 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:52.019430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c8d548-6e74-499f-bac5-dda4ffb09079 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:52.020215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c8d548-6e74-499f-bac5-dda4ffb09079 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:52.020708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c8d548-6e74-499f-bac5-dda4ffb09079 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:52.021147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-69c8d548-6e74-499f-bac5-dda4ffb09079 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:52.164928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-69c8d548-6e74-499f-bac5-dda4ffb09079 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:52.173837 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-69c8d548-6e74-499f-bac5-dda4ffb09079 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.174487 Oct 05 18:31:52.174504 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3507/6769] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:51 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:53.201750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a7c3fcaa-becc-4565-a205-62176cd311da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:53.202634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a7c3fcaa-becc-4565-a205-62176cd311da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:53.214985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7c3fcaa-becc-4565-a205-62176cd311da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:53.215877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7c3fcaa-becc-4565-a205-62176cd311da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:53.216621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7c3fcaa-becc-4565-a205-62176cd311da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:53.217851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7c3fcaa-becc-4565-a205-62176cd311da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:53.218716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7c3fcaa-becc-4565-a205-62176cd311da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:53.219579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7c3fcaa-becc-4565-a205-62176cd311da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:53.358008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a7c3fcaa-becc-4565-a205-62176cd311da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:53.370191 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a7c3fcaa-becc-4565-a205-62176cd311da tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.174905 Oct 05 18:31:53.371021 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3263/6770] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:53 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:54.400196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27d30f6a-2213-4d2a-b813-c94a28ebf209 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:54.401251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-27d30f6a-2213-4d2a-b813-c94a28ebf209 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:54.413053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d30f6a-2213-4d2a-b813-c94a28ebf209 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:54.413891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d30f6a-2213-4d2a-b813-c94a28ebf209 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:54.414718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d30f6a-2213-4d2a-b813-c94a28ebf209 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:54.415913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d30f6a-2213-4d2a-b813-c94a28ebf209 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:54.416714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d30f6a-2213-4d2a-b813-c94a28ebf209 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:54.417458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27d30f6a-2213-4d2a-b813-c94a28ebf209 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:54.555831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-27d30f6a-2213-4d2a-b813-c94a28ebf209 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:54.564166 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27d30f6a-2213-4d2a-b813-c94a28ebf209 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.170492 Oct 05 18:31:54.568979 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3508/6771] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:54 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:55.599064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-be2bd440-105e-41dd-92bb-d805ed0cb770 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:55.599672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-be2bd440-105e-41dd-92bb-d805ed0cb770 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:55.607597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be2bd440-105e-41dd-92bb-d805ed0cb770 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:55.608086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be2bd440-105e-41dd-92bb-d805ed0cb770 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:55.608546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be2bd440-105e-41dd-92bb-d805ed0cb770 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:55.609227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be2bd440-105e-41dd-92bb-d805ed0cb770 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:55.609688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be2bd440-105e-41dd-92bb-d805ed0cb770 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:55.610121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be2bd440-105e-41dd-92bb-d805ed0cb770 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:55.767848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-be2bd440-105e-41dd-92bb-d805ed0cb770 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:55.776032 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-be2bd440-105e-41dd-92bb-d805ed0cb770 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.181904 Oct 05 18:31:55.776620 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3264/6772] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:55 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:56.803894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-109c1cbd-a910-42df-9620-5671079fcd37 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:56.804924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-109c1cbd-a910-42df-9620-5671079fcd37 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:56.815568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-109c1cbd-a910-42df-9620-5671079fcd37 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:56.816071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-109c1cbd-a910-42df-9620-5671079fcd37 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:56.816528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-109c1cbd-a910-42df-9620-5671079fcd37 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:56.817274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-109c1cbd-a910-42df-9620-5671079fcd37 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:56.817753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-109c1cbd-a910-42df-9620-5671079fcd37 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:56.818230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-109c1cbd-a910-42df-9620-5671079fcd37 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:56.953578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-109c1cbd-a910-42df-9620-5671079fcd37 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:56.961607 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-109c1cbd-a910-42df-9620-5671079fcd37 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.164665 Oct 05 18:31:56.962203 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3509/6773] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:56 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:57.990111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-20396ae7-8fd3-4bff-9881-0aedb1300114 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:57.990719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-20396ae7-8fd3-4bff-9881-0aedb1300114 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:57.998102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20396ae7-8fd3-4bff-9881-0aedb1300114 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:57.998622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20396ae7-8fd3-4bff-9881-0aedb1300114 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:57.999054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20396ae7-8fd3-4bff-9881-0aedb1300114 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:57.999769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20396ae7-8fd3-4bff-9881-0aedb1300114 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:58.000224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20396ae7-8fd3-4bff-9881-0aedb1300114 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:58.000646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20396ae7-8fd3-4bff-9881-0aedb1300114 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:58.131067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-20396ae7-8fd3-4bff-9881-0aedb1300114 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:58.139550 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-20396ae7-8fd3-4bff-9881-0aedb1300114 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.154233 Oct 05 18:31:58.140166 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3265/6774] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:57 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:31:59.164692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d744645d-416a-4a01-b954-4b14bc8b905c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:31:59.165540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d744645d-416a-4a01-b954-4b14bc8b905c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:31:59.174726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d744645d-416a-4a01-b954-4b14bc8b905c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:59.175376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d744645d-416a-4a01-b954-4b14bc8b905c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:59.175945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d744645d-416a-4a01-b954-4b14bc8b905c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:59.176849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d744645d-416a-4a01-b954-4b14bc8b905c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:31:59.177493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d744645d-416a-4a01-b954-4b14bc8b905c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:31:59.178069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d744645d-416a-4a01-b954-4b14bc8b905c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:31:59.322706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d744645d-416a-4a01-b954-4b14bc8b905c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:31:59.330668 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d744645d-416a-4a01-b954-4b14bc8b905c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.171042 Oct 05 18:31:59.331274 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3510/6775] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:31:59 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:00.357477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f1c42511-9b1a-463e-ae4a-50efd6ba02bd tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:00.358564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f1c42511-9b1a-463e-ae4a-50efd6ba02bd tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:00.367485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1c42511-9b1a-463e-ae4a-50efd6ba02bd tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:00.367976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1c42511-9b1a-463e-ae4a-50efd6ba02bd tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:00.368420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1c42511-9b1a-463e-ae4a-50efd6ba02bd tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:00.369128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1c42511-9b1a-463e-ae4a-50efd6ba02bd tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:00.369598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1c42511-9b1a-463e-ae4a-50efd6ba02bd tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:00.370028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f1c42511-9b1a-463e-ae4a-50efd6ba02bd tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:00.504476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f1c42511-9b1a-463e-ae4a-50efd6ba02bd tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:00.512841 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f1c42511-9b1a-463e-ae4a-50efd6ba02bd tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.161968 Oct 05 18:32:00.513402 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3266/6776] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:00 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:01.541698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49f98bbd-d1ec-403d-a960-0211664d96c4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:01.542873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-49f98bbd-d1ec-403d-a960-0211664d96c4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:01.554672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f98bbd-d1ec-403d-a960-0211664d96c4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:01.555512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f98bbd-d1ec-403d-a960-0211664d96c4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:01.556264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f98bbd-d1ec-403d-a960-0211664d96c4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:01.557436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f98bbd-d1ec-403d-a960-0211664d96c4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:01.558225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f98bbd-d1ec-403d-a960-0211664d96c4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:01.559050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49f98bbd-d1ec-403d-a960-0211664d96c4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:01.693786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-49f98bbd-d1ec-403d-a960-0211664d96c4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:01.702073 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49f98bbd-d1ec-403d-a960-0211664d96c4 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.167506 Oct 05 18:32:01.702858 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3511/6777] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:01 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:02.730236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f7e807ca-8a91-4c00-867f-b55e92fbbc05 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:02.730865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f7e807ca-8a91-4c00-867f-b55e92fbbc05 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:02.740611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7e807ca-8a91-4c00-867f-b55e92fbbc05 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:02.741099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7e807ca-8a91-4c00-867f-b55e92fbbc05 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:02.741531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7e807ca-8a91-4c00-867f-b55e92fbbc05 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:02.742221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7e807ca-8a91-4c00-867f-b55e92fbbc05 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:02.742712 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7e807ca-8a91-4c00-867f-b55e92fbbc05 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:02.743132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7e807ca-8a91-4c00-867f-b55e92fbbc05 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:02.885301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f7e807ca-8a91-4c00-867f-b55e92fbbc05 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:02.893850 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f7e807ca-8a91-4c00-867f-b55e92fbbc05 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.170115 Oct 05 18:32:02.894517 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3267/6778] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:02 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:03.917535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-521487c5-565b-4151-afe2-127b425fb550 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:03.918171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-521487c5-565b-4151-afe2-127b425fb550 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:03.925665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-521487c5-565b-4151-afe2-127b425fb550 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:03.926177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-521487c5-565b-4151-afe2-127b425fb550 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:03.926667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-521487c5-565b-4151-afe2-127b425fb550 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:03.927383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-521487c5-565b-4151-afe2-127b425fb550 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:03.927857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-521487c5-565b-4151-afe2-127b425fb550 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:03.928299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-521487c5-565b-4151-afe2-127b425fb550 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:04.066348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-521487c5-565b-4151-afe2-127b425fb550 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:04.079636 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-521487c5-565b-4151-afe2-127b425fb550 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.165968 Oct 05 18:32:04.080517 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3512/6779] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:03 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:05.107691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d236c9c6-9e7e-4605-b237-fcbcd70e6b1a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:05.108668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d236c9c6-9e7e-4605-b237-fcbcd70e6b1a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:05.121548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d236c9c6-9e7e-4605-b237-fcbcd70e6b1a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:05.122159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d236c9c6-9e7e-4605-b237-fcbcd70e6b1a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:05.123092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d236c9c6-9e7e-4605-b237-fcbcd70e6b1a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:05.124104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d236c9c6-9e7e-4605-b237-fcbcd70e6b1a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:05.124874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d236c9c6-9e7e-4605-b237-fcbcd70e6b1a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:05.125597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d236c9c6-9e7e-4605-b237-fcbcd70e6b1a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:05.255129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d236c9c6-9e7e-4605-b237-fcbcd70e6b1a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:05.263559 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d236c9c6-9e7e-4605-b237-fcbcd70e6b1a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.162494 Oct 05 18:32:05.264147 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3268/6780] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:05 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:06.287250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02cddb28-6b48-4a92-92d1-3d5a87621a28 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:06.288508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02cddb28-6b48-4a92-92d1-3d5a87621a28 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:06.296455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cddb28-6b48-4a92-92d1-3d5a87621a28 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:06.296968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cddb28-6b48-4a92-92d1-3d5a87621a28 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:06.297425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cddb28-6b48-4a92-92d1-3d5a87621a28 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:06.298156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cddb28-6b48-4a92-92d1-3d5a87621a28 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:06.298673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cddb28-6b48-4a92-92d1-3d5a87621a28 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:06.299121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02cddb28-6b48-4a92-92d1-3d5a87621a28 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:06.453228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-02cddb28-6b48-4a92-92d1-3d5a87621a28 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:06.461641 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02cddb28-6b48-4a92-92d1-3d5a87621a28 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.178521 Oct 05 18:32:06.462155 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3513/6781] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:06 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:07.488729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bc78e3a4-6532-4c2d-be9d-e824ff3cf386 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:07.489644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bc78e3a4-6532-4c2d-be9d-e824ff3cf386 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:07.500720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc78e3a4-6532-4c2d-be9d-e824ff3cf386 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:07.501484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc78e3a4-6532-4c2d-be9d-e824ff3cf386 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:07.502156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc78e3a4-6532-4c2d-be9d-e824ff3cf386 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:07.503336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc78e3a4-6532-4c2d-be9d-e824ff3cf386 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:07.503837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc78e3a4-6532-4c2d-be9d-e824ff3cf386 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:07.504265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc78e3a4-6532-4c2d-be9d-e824ff3cf386 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:07.644298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bc78e3a4-6532-4c2d-be9d-e824ff3cf386 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:07.656148 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bc78e3a4-6532-4c2d-be9d-e824ff3cf386 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.173576 Oct 05 18:32:07.656952 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3269/6782] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:07 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:08.684191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aafab3df-2883-430c-b7c9-45c4768e55a9 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:08.685240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aafab3df-2883-430c-b7c9-45c4768e55a9 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:08.696876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aafab3df-2883-430c-b7c9-45c4768e55a9 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:08.697720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aafab3df-2883-430c-b7c9-45c4768e55a9 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:08.698533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aafab3df-2883-430c-b7c9-45c4768e55a9 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:08.699717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aafab3df-2883-430c-b7c9-45c4768e55a9 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:08.700516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aafab3df-2883-430c-b7c9-45c4768e55a9 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:08.701260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aafab3df-2883-430c-b7c9-45c4768e55a9 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:08.840459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aafab3df-2883-430c-b7c9-45c4768e55a9 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:08.848833 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aafab3df-2883-430c-b7c9-45c4768e55a9 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1517 microversion: 2.1 time: 0.171411 Oct 05 18:32:08.849411 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3514/6783] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:08 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1517 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:09.810173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-80ddc147-89b0-43f6-9913-2d351734540a req-b8cb763a-2fac-4b23-b943-a9ce3ac38226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f950f590-0e9c-4d9f-8432-b56daab669ac", "name": "network-vif-unplugged", "status": "completed", "tag": "c26f2eff-c820-4a5d-8a76-484d23d876d6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:32:09.824565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-80ddc147-89b0-43f6-9913-2d351734540a req-b8cb763a-2fac-4b23-b943-a9ce3ac38226 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:09.824975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-80ddc147-89b0-43f6-9913-2d351734540a req-b8cb763a-2fac-4b23-b943-a9ce3ac38226 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:09.826040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-80ddc147-89b0-43f6-9913-2d351734540a req-b8cb763a-2fac-4b23-b943-a9ce3ac38226 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:09.838314 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-80ddc147-89b0-43f6-9913-2d351734540a req-b8cb763a-2fac-4b23-b943-a9ce3ac38226 service nova] Creating event network-vif-unplugged:c26f2eff-c820-4a5d-8a76-484d23d876d6 for instance f950f590-0e9c-4d9f-8432-b56daab669ac on n-h1-835595-3 Oct 05 18:32:09.844064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-80ddc147-89b0-43f6-9913-2d351734540a req-b8cb763a-2fac-4b23-b943-a9ce3ac38226 service nova] Instance f950f590-0e9c-4d9f-8432-b56daab669ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:32:09.855748 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-80ddc147-89b0-43f6-9913-2d351734540a req-b8cb763a-2fac-4b23-b943-a9ce3ac38226 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100583 Oct 05 18:32:09.856369 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3270/6784] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:32:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:32:09.874500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-edfb2ba6-b158-4cc6-81a3-4c3d4bf83682 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:09.875418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-edfb2ba6-b158-4cc6-81a3-4c3d4bf83682 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:09.878252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=28 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:09.884033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-edfb2ba6-b158-4cc6-81a3-4c3d4bf83682 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:09.884551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-edfb2ba6-b158-4cc6-81a3-4c3d4bf83682 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:09.885263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-edfb2ba6-b158-4cc6-81a3-4c3d4bf83682 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:09.885990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-edfb2ba6-b158-4cc6-81a3-4c3d4bf83682 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:09.886508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-edfb2ba6-b158-4cc6-81a3-4c3d4bf83682 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:09.886974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-edfb2ba6-b158-4cc6-81a3-4c3d4bf83682 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:09.891584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=84 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:10.041686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-edfb2ba6-b158-4cc6-81a3-4c3d4bf83682 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:10.050230 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-edfb2ba6-b158-4cc6-81a3-4c3d4bf83682 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1516 microversion: 2.1 time: 0.181594 Oct 05 18:32:10.051129 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3515/6785] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:09 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:11.078784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6e78eeea-c9f7-4425-8d98-f9bc6e8ec87c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:11.079959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6e78eeea-c9f7-4425-8d98-f9bc6e8ec87c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:11.084391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=26 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:11.093565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e78eeea-c9f7-4425-8d98-f9bc6e8ec87c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:11.094389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e78eeea-c9f7-4425-8d98-f9bc6e8ec87c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:11.095154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e78eeea-c9f7-4425-8d98-f9bc6e8ec87c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:11.096274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e78eeea-c9f7-4425-8d98-f9bc6e8ec87c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:11.097073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e78eeea-c9f7-4425-8d98-f9bc6e8ec87c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:11.097794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6e78eeea-c9f7-4425-8d98-f9bc6e8ec87c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:11.100758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=76 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:11.241064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6e78eeea-c9f7-4425-8d98-f9bc6e8ec87c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:11.249162 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6e78eeea-c9f7-4425-8d98-f9bc6e8ec87c tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1514 microversion: 2.1 time: 0.177817 Oct 05 18:32:11.249752 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3271/6786] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:11 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:11.884774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-873a12f9-f98d-458e-8544-d5709441bf55 req-22a05b92-b102-4938-a4a0-b910a9f8dcf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f950f590-0e9c-4d9f-8432-b56daab669ac", "tag": "c26f2eff-c820-4a5d-8a76-484d23d876d6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:32:11.898440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-873a12f9-f98d-458e-8544-d5709441bf55 req-22a05b92-b102-4938-a4a0-b910a9f8dcf3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:11.898948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-873a12f9-f98d-458e-8544-d5709441bf55 req-22a05b92-b102-4938-a4a0-b910a9f8dcf3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:11.899401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-873a12f9-f98d-458e-8544-d5709441bf55 req-22a05b92-b102-4938-a4a0-b910a9f8dcf3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:11.911821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-873a12f9-f98d-458e-8544-d5709441bf55 req-22a05b92-b102-4938-a4a0-b910a9f8dcf3 service nova] Creating event network-changed:c26f2eff-c820-4a5d-8a76-484d23d876d6 for instance f950f590-0e9c-4d9f-8432-b56daab669ac on n-h1-835595-3 Oct 05 18:32:11.917604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-873a12f9-f98d-458e-8544-d5709441bf55 req-22a05b92-b102-4938-a4a0-b910a9f8dcf3 service nova] Instance f950f590-0e9c-4d9f-8432-b56daab669ac is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:32:11.930527 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-873a12f9-f98d-458e-8544-d5709441bf55 req-22a05b92-b102-4938-a4a0-b910a9f8dcf3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049904 Oct 05 18:32:11.931547 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3516/6787] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:32:12.272803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-55b2c05f-4ef8-4f20-b81a-c8b3496cc1f5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:12.274062 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-55b2c05f-4ef8-4f20-b81a-c8b3496cc1f5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:12.281386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55b2c05f-4ef8-4f20-b81a-c8b3496cc1f5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:12.282006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55b2c05f-4ef8-4f20-b81a-c8b3496cc1f5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:12.282690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55b2c05f-4ef8-4f20-b81a-c8b3496cc1f5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:12.283510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55b2c05f-4ef8-4f20-b81a-c8b3496cc1f5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:12.283980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55b2c05f-4ef8-4f20-b81a-c8b3496cc1f5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:12.284685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-55b2c05f-4ef8-4f20-b81a-c8b3496cc1f5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:12.529484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-55b2c05f-4ef8-4f20-b81a-c8b3496cc1f5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:12.537820 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-55b2c05f-4ef8-4f20-b81a-c8b3496cc1f5 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1511 microversion: 2.1 time: 0.269052 Oct 05 18:32:12.538528 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3272/6788] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:12 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:12.561911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:12.562549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:12.569171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:12.569670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:12.570087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:12.570864 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:12.571346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:12.571813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:12.597929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:32:12.657601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.compute.api [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Found an unconfirmed migration during delete, id: 16, status: finished Oct 05 18:32:14.120446 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8a444fe5-b417-4be8-bbd6-f2c254ec8b99 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 204 len: 0 microversion: 2.1 time: 1.562587 Oct 05 18:32:14.121270 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3517/6789] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:32:12 2022] DELETE /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 0 bytes in 1565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:32:14.130252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6fc24cbe-85d5-4ee8-921d-f214088e239a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:14.130900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6fc24cbe-85d5-4ee8-921d-f214088e239a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:14.138468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fc24cbe-85d5-4ee8-921d-f214088e239a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:14.138960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fc24cbe-85d5-4ee8-921d-f214088e239a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:14.139392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fc24cbe-85d5-4ee8-921d-f214088e239a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:14.140087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fc24cbe-85d5-4ee8-921d-f214088e239a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:14.140543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fc24cbe-85d5-4ee8-921d-f214088e239a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:14.140968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6fc24cbe-85d5-4ee8-921d-f214088e239a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:14.275269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6fc24cbe-85d5-4ee8-921d-f214088e239a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:14.288077 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6fc24cbe-85d5-4ee8-921d-f214088e239a tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1503 microversion: 2.1 time: 0.162364 Oct 05 18:32:14.288669 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3273/6790] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:14 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:15.313089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e19f190-9203-4cd9-aac2-b985e04431e3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:15.313866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e19f190-9203-4cd9-aac2-b985e04431e3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:15.321791 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e19f190-9203-4cd9-aac2-b985e04431e3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:15.322384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e19f190-9203-4cd9-aac2-b985e04431e3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:15.322874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e19f190-9203-4cd9-aac2-b985e04431e3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:15.323658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e19f190-9203-4cd9-aac2-b985e04431e3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:15.324179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e19f190-9203-4cd9-aac2-b985e04431e3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:15.324665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e19f190-9203-4cd9-aac2-b985e04431e3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:15.460122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e19f190-9203-4cd9-aac2-b985e04431e3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4750d49509b440eeb83ee69d3c980e5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1717be68b21433db904be87d3abcaa6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:15.469772 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e19f190-9203-4cd9-aac2-b985e04431e3 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 200 len: 1503 microversion: 2.1 time: 0.161411 Oct 05 18:32:15.470412 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3518/6791] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:15 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:15.555669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3cf493cf-ee53-4332-8e29-d8a6484e9ae7 req-3c7f9a53-af85-4089-8c0b-d494b2a020e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f950f590-0e9c-4d9f-8432-b56daab669ac", "name": "network-vif-plugged", "status": "completed", "tag": "c26f2eff-c820-4a5d-8a76-484d23d876d6"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:32:15.566969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3cf493cf-ee53-4332-8e29-d8a6484e9ae7 req-3c7f9a53-af85-4089-8c0b-d494b2a020e8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:15.567534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3cf493cf-ee53-4332-8e29-d8a6484e9ae7 req-3c7f9a53-af85-4089-8c0b-d494b2a020e8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:15.568259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3cf493cf-ee53-4332-8e29-d8a6484e9ae7 req-3c7f9a53-af85-4089-8c0b-d494b2a020e8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:15.583193 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3cf493cf-ee53-4332-8e29-d8a6484e9ae7 req-3c7f9a53-af85-4089-8c0b-d494b2a020e8 service nova] Creating event network-vif-plugged:c26f2eff-c820-4a5d-8a76-484d23d876d6 for instance f950f590-0e9c-4d9f-8432-b56daab669ac on n-h1-835595-3 Oct 05 18:32:15.588493 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3cf493cf-ee53-4332-8e29-d8a6484e9ae7 req-3c7f9a53-af85-4089-8c0b-d494b2a020e8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037031 Oct 05 18:32:15.589288 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3274/6792] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:32:15.865643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-b7f98c26-8449-4115-97d6-95492987e798 req-290e7dee-225b-4520-9c5a-a15552f40ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f950f590-0e9c-4d9f-8432-b56daab669ac", "name": "network-vif-deleted", "tag": "c26f2eff-c820-4a5d-8a76-484d23d876d6"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:32:15.876486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b7f98c26-8449-4115-97d6-95492987e798 req-290e7dee-225b-4520-9c5a-a15552f40ca5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:15.876979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b7f98c26-8449-4115-97d6-95492987e798 req-290e7dee-225b-4520-9c5a-a15552f40ca5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:15.877649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-b7f98c26-8449-4115-97d6-95492987e798 req-290e7dee-225b-4520-9c5a-a15552f40ca5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:15.891467 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-b7f98c26-8449-4115-97d6-95492987e798 req-290e7dee-225b-4520-9c5a-a15552f40ca5 service nova] Creating event network-vif-deleted:c26f2eff-c820-4a5d-8a76-484d23d876d6 for instance f950f590-0e9c-4d9f-8432-b56daab669ac on n-h1-835595-3 Oct 05 18:32:15.897811 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-b7f98c26-8449-4115-97d6-95492987e798 req-290e7dee-225b-4520-9c5a-a15552f40ca5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036386 Oct 05 18:32:15.898468 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3519/6793] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:32:16.498547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:16.499596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:16.508653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:16.509147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:16.509595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:16.510318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:16.510792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:16.511223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:16.525203 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] HTTP exception thrown: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Request method failure captured: Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac HTTP/1.1 Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc2BlkeLHdIoCwMxJ05Htuw1vBMHQaJk0MuiOul3qz1o7Z2cjOgvja8cQtxwCmoCYxk9aimNwlSxT5YiT0ShRMTkbkf62wZvqxbX5DJJo5qmk0ISX4FODfGzK2ACrkA78ITfhQ5do9UyXBsH4SgkgM1fEGuGH1I5irFvvV8w3al6IqU Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: e1717be68b21433db904be87d3abcaa6 Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1560368940 Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1717be68b21433db904be87d3abcaa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1717be68b21433db904be87d3abcaa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1717be68b21433db904be87d3abcaa6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1717be68b21433db904be87d3abcaa6"}]}] Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1560368940 Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: e1717be68b21433db904be87d3abcaa6 Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1560368940 Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1560368940-project Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 4750d49509b440eeb83ee69d3c980e5f Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1560368940-project Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'f950f590-0e9c-4d9f-8432-b56daab669ac'} Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:32:16.526889 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.531326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:32:16.531326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:32:16.531326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:32:16.531326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:32:16.531326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:32:16.531326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.531326 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.531326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Returning 404 to user: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:32:16.531326 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de1544a6-f3cd-4320-a0a4-0bd18508bc82 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 404 len: 111 microversion: 2.1 time: 0.037231 Oct 05 18:32:16.531326 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3275/6794] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:16 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:32:16.542657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:16.543261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:16.549865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:16.550401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:16.550854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:16.551569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:16.552045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:16.552519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:16.566082 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] HTTP exception thrown: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Request method failure captured: Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac HTTP/1.1 Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc2BlkeLHdIoCwMxJ05Htuw1vBMHQaJk0MuiOul3qz1o7Z2cjOgvja8cQtxwCmoCYxk9aimNwlSxT5YiT0ShRMTkbkf62wZvqxbX5DJJo5qmk0ISX4FODfGzK2ACrkA78ITfhQ5do9UyXBsH4SgkgM1fEGuGH1I5irFvvV8w3al6IqU Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: e1717be68b21433db904be87d3abcaa6 Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-DeleteServersTestJSON-1560368940 Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1717be68b21433db904be87d3abcaa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1717be68b21433db904be87d3abcaa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1717be68b21433db904be87d3abcaa6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1717be68b21433db904be87d3abcaa6"}]}] Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-DeleteServersTestJSON-1560368940 Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: e1717be68b21433db904be87d3abcaa6 Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1560368940 Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-DeleteServersTestJSON-1560368940-project Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 4750d49509b440eeb83ee69d3c980e5f Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-DeleteServersTestJSON-1560368940-project Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'f950f590-0e9c-4d9f-8432-b56daab669ac'} Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:32:16.567783 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Returning 404 to user: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1fb6e4f3-c458-4556-99e1-0c9dd582dcb7 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 404 len: 111 microversion: 2.1 time: 0.032013 Oct 05 18:32:16.571938 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3520/6795] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:32:16 2022] DELETE /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:32:16.580831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:16.581586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] [instance: f950f590-0e9c-4d9f-8432-b56daab669ac] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:16.591990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:16.592738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:16.593305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:16.594241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:16.594934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:16.595576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:16.610944 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] HTTP exception thrown: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Request method failure captured: Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac HTTP/1.1 Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc2BlkeLHdIoCwMxJ05Htuw1vBMHQaJk0MuiOul3qz1o7Z2cjOgvja8cQtxwCmoCYxk9aimNwlSxT5YiT0ShRMTkbkf62wZvqxbX5DJJo5qmk0ISX4FODfGzK2ACrkA78ITfhQ5do9UyXBsH4SgkgM1fEGuGH1I5irFvvV8w3al6IqU Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: e1717be68b21433db904be87d3abcaa6 Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-DeleteServersTestJSON-1560368940 Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/e1717be68b21433db904be87d3abcaa6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1717be68b21433db904be87d3abcaa6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_e1717be68b21433db904be87d3abcaa6", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/e1717be68b21433db904be87d3abcaa6"}]}] Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-DeleteServersTestJSON-1560368940 Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: e1717be68b21433db904be87d3abcaa6 Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1560368940 Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-DeleteServersTestJSON-1560368940-project Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 4750d49509b440eeb83ee69d3c980e5f Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-DeleteServersTestJSON-1560368940-project Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'f950f590-0e9c-4d9f-8432-b56daab669ac'} Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:32:16.612512 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.616882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:32:16.616882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:32:16.616882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:32:16.616882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:32:16.616882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:32:16.616882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. Oct 05 18:32:16.616882 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:32:16.616882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] Returning 404 to user: Instance f950f590-0e9c-4d9f-8432-b56daab669ac could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:32:16.616882 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23d5e431-1c49-4265-ae35-3a02ee48a218 tempest-DeleteServersTestJSON-1560368940 tempest-DeleteServersTestJSON-1560368940-project] 10.222.0.70 "GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac" status: 404 len: 111 microversion: 2.1 time: 0.039576 Oct 05 18:32:16.616882 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3276/6796] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:16 2022] GET /compute/v2.1/servers/f950f590-0e9c-4d9f-8432-b56daab669ac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:32:25.529167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1207202255", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "000a390f-8803-4fe7-9ff3-d570ba91a406"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:32:25.588335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] validate_networks() for [('000a390f-8803-4fe7-9ff3-d570ba91a406', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:32:26.016390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:32:26.016868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:32:26.017444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:32:26.017904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:32:26.018365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:32:26.027987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:26.028500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:26.028955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:26.029708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:26.030184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:26.030713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:26.048630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Getting quotas for project 311f087409944324bf0d57064e44739c. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:32:26.054228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Getting quotas for user e0bd522579774bc8b7fad12638223a18 and project 311f087409944324bf0d57064e44739c. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:32:26.067561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:32:26.070303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:32:26.121033 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-59b44f2e-e0e8-4cf1-8ba8-eb62f648d7c0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726957 Oct 05 18:32:26.128290 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3521/6797] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:32:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:32:26.133759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d345ed4e-9b41-4b48-83f5-a022369c1f3c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:26.134395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d345ed4e-9b41-4b48-83f5-a022369c1f3c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:26.198654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d345ed4e-9b41-4b48-83f5-a022369c1f3c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:26.207847 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d345ed4e-9b41-4b48-83f5-a022369c1f3c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1218 microversion: 2.1 time: 0.078230 Oct 05 18:32:26.208579 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3277/6798] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:26 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:27.234638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ba60c91-60c8-44c7-8ee9-4fc33f8f6bf9 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:27.235355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3ba60c91-60c8-44c7-8ee9-4fc33f8f6bf9 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:27.247421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ba60c91-60c8-44c7-8ee9-4fc33f8f6bf9 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:27.247955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ba60c91-60c8-44c7-8ee9-4fc33f8f6bf9 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:27.248631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ba60c91-60c8-44c7-8ee9-4fc33f8f6bf9 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:27.249548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ba60c91-60c8-44c7-8ee9-4fc33f8f6bf9 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:27.250089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ba60c91-60c8-44c7-8ee9-4fc33f8f6bf9 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:27.250748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ba60c91-60c8-44c7-8ee9-4fc33f8f6bf9 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:27.341918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3ba60c91-60c8-44c7-8ee9-4fc33f8f6bf9 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:27.362678 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ba60c91-60c8-44c7-8ee9-4fc33f8f6bf9 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1278 microversion: 2.1 time: 0.133109 Oct 05 18:32:27.363889 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3522/6799] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:27 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1278 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:28.388057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d3f447cd-aadc-4631-bddd-e26ccebe153a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:28.388893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d3f447cd-aadc-4631-bddd-e26ccebe153a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:28.392145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=23 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:28.399247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3f447cd-aadc-4631-bddd-e26ccebe153a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:28.399746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3f447cd-aadc-4631-bddd-e26ccebe153a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:28.400180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3f447cd-aadc-4631-bddd-e26ccebe153a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:28.400910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3f447cd-aadc-4631-bddd-e26ccebe153a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:28.401344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3f447cd-aadc-4631-bddd-e26ccebe153a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:28.401765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3f447cd-aadc-4631-bddd-e26ccebe153a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:28.624369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d3f447cd-aadc-4631-bddd-e26ccebe153a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:28.633999 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d3f447cd-aadc-4631-bddd-e26ccebe153a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1318 microversion: 2.1 time: 0.250788 Oct 05 18:32:28.634623 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3278/6800] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:28 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:29.016821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a88beb3a-bc80-4137-98f3-7273262ab7ca req-78c232b3-4a80-42a8-9356-6b3a18b9a6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8850676-5444-49a8-a717-59204fe4cdf1", "tag": "4cb15067-636a-4de4-ae3e-48bb226c31ee"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:32:29.031057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a88beb3a-bc80-4137-98f3-7273262ab7ca req-78c232b3-4a80-42a8-9356-6b3a18b9a6ee service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:29.033308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a88beb3a-bc80-4137-98f3-7273262ab7ca req-78c232b3-4a80-42a8-9356-6b3a18b9a6ee service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:29.034426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a88beb3a-bc80-4137-98f3-7273262ab7ca req-78c232b3-4a80-42a8-9356-6b3a18b9a6ee service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:29.047101 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a88beb3a-bc80-4137-98f3-7273262ab7ca req-78c232b3-4a80-42a8-9356-6b3a18b9a6ee service nova] Creating event network-changed:4cb15067-636a-4de4-ae3e-48bb226c31ee for instance f8850676-5444-49a8-a717-59204fe4cdf1 on n-h1-835595-3 Oct 05 18:32:29.052653 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a88beb3a-bc80-4137-98f3-7273262ab7ca req-78c232b3-4a80-42a8-9356-6b3a18b9a6ee service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046305 Oct 05 18:32:29.053372 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3523/6801] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:32:29.658558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d52f7442-7fbe-4477-8c99-93f6305d06dc tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:29.659173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d52f7442-7fbe-4477-8c99-93f6305d06dc tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:29.666425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d52f7442-7fbe-4477-8c99-93f6305d06dc tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:29.666920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d52f7442-7fbe-4477-8c99-93f6305d06dc tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:29.667352 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d52f7442-7fbe-4477-8c99-93f6305d06dc tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:29.668071 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d52f7442-7fbe-4477-8c99-93f6305d06dc tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:29.668531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d52f7442-7fbe-4477-8c99-93f6305d06dc tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:29.668953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d52f7442-7fbe-4477-8c99-93f6305d06dc tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:29.808380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d52f7442-7fbe-4477-8c99-93f6305d06dc tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:29.816576 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d52f7442-7fbe-4477-8c99-93f6305d06dc tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1318 microversion: 2.1 time: 0.162006 Oct 05 18:32:29.817183 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3279/6802] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:29 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:30.841719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-45032cd0-7641-4b48-9726-1b4ecc3b56b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:30.842560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-45032cd0-7641-4b48-9726-1b4ecc3b56b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:30.849120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45032cd0-7641-4b48-9726-1b4ecc3b56b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:30.849694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45032cd0-7641-4b48-9726-1b4ecc3b56b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:30.850190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45032cd0-7641-4b48-9726-1b4ecc3b56b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:30.850897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45032cd0-7641-4b48-9726-1b4ecc3b56b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:30.851363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45032cd0-7641-4b48-9726-1b4ecc3b56b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:30.851799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-45032cd0-7641-4b48-9726-1b4ecc3b56b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:31.005021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-45032cd0-7641-4b48-9726-1b4ecc3b56b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:31.013870 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-45032cd0-7641-4b48-9726-1b4ecc3b56b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1318 microversion: 2.1 time: 0.177206 Oct 05 18:32:31.014586 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3524/6803] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:30 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:32.037496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3b867f5c-a5f6-46e3-9782-be3bff2ca561 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:32.038097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3b867f5c-a5f6-46e3-9782-be3bff2ca561 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:32.045185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b867f5c-a5f6-46e3-9782-be3bff2ca561 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:32.045682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b867f5c-a5f6-46e3-9782-be3bff2ca561 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:32.046122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b867f5c-a5f6-46e3-9782-be3bff2ca561 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:32.046870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b867f5c-a5f6-46e3-9782-be3bff2ca561 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:32.047336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b867f5c-a5f6-46e3-9782-be3bff2ca561 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:32.047764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3b867f5c-a5f6-46e3-9782-be3bff2ca561 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:32.182685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3b867f5c-a5f6-46e3-9782-be3bff2ca561 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:32.190383 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3b867f5c-a5f6-46e3-9782-be3bff2ca561 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1318 microversion: 2.1 time: 0.156993 Oct 05 18:32:32.190951 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3280/6804] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:32 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:33.217118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-03fe0838-6794-4806-ac13-0a8cf483fefd tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:33.218166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-03fe0838-6794-4806-ac13-0a8cf483fefd tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:33.227895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03fe0838-6794-4806-ac13-0a8cf483fefd tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:33.228410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03fe0838-6794-4806-ac13-0a8cf483fefd tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:33.228870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03fe0838-6794-4806-ac13-0a8cf483fefd tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:33.229596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03fe0838-6794-4806-ac13-0a8cf483fefd tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:33.230076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03fe0838-6794-4806-ac13-0a8cf483fefd tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:33.230560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03fe0838-6794-4806-ac13-0a8cf483fefd tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:33.368659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-03fe0838-6794-4806-ac13-0a8cf483fefd tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:33.376593 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-03fe0838-6794-4806-ac13-0a8cf483fefd tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1318 microversion: 2.1 time: 0.166146 Oct 05 18:32:33.377184 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3525/6805] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:33 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:33.566436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-9cb93f63-ede2-454b-b63f-da578888c353 req-901aff10-e8bf-4b96-bbb1-032808854a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8850676-5444-49a8-a717-59204fe4cdf1", "name": "network-vif-plugged", "status": "completed", "tag": "4cb15067-636a-4de4-ae3e-48bb226c31ee"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:32:33.577807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9cb93f63-ede2-454b-b63f-da578888c353 req-901aff10-e8bf-4b96-bbb1-032808854a70 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:33.578306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9cb93f63-ede2-454b-b63f-da578888c353 req-901aff10-e8bf-4b96-bbb1-032808854a70 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:33.578768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9cb93f63-ede2-454b-b63f-da578888c353 req-901aff10-e8bf-4b96-bbb1-032808854a70 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:33.590369 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9cb93f63-ede2-454b-b63f-da578888c353 req-901aff10-e8bf-4b96-bbb1-032808854a70 service nova] Creating event network-vif-plugged:4cb15067-636a-4de4-ae3e-48bb226c31ee for instance f8850676-5444-49a8-a717-59204fe4cdf1 on n-h1-835595-3 Oct 05 18:32:33.595764 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-9cb93f63-ede2-454b-b63f-da578888c353 req-901aff10-e8bf-4b96-bbb1-032808854a70 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033151 Oct 05 18:32:33.596450 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3281/6806] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:32:34.404753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92c627c7-b98f-4b35-9815-b332fd42043f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:34.405738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92c627c7-b98f-4b35-9815-b332fd42043f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:34.417733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c627c7-b98f-4b35-9815-b332fd42043f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:34.418608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c627c7-b98f-4b35-9815-b332fd42043f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:34.419370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c627c7-b98f-4b35-9815-b332fd42043f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:34.420554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c627c7-b98f-4b35-9815-b332fd42043f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:34.421344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c627c7-b98f-4b35-9815-b332fd42043f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:34.422075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c627c7-b98f-4b35-9815-b332fd42043f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:34.565465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92c627c7-b98f-4b35-9815-b332fd42043f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:34.573811 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92c627c7-b98f-4b35-9815-b332fd42043f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1318 microversion: 2.1 time: 0.175822 Oct 05 18:32:34.574424 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3526/6807] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:34 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:35.601976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-68fa5f18-a4da-404f-bdc8-30bdc987d242 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:35.602981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-68fa5f18-a4da-404f-bdc8-30bdc987d242 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:35.610084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68fa5f18-a4da-404f-bdc8-30bdc987d242 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:35.610598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68fa5f18-a4da-404f-bdc8-30bdc987d242 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:35.611031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68fa5f18-a4da-404f-bdc8-30bdc987d242 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:35.611710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68fa5f18-a4da-404f-bdc8-30bdc987d242 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:35.612184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68fa5f18-a4da-404f-bdc8-30bdc987d242 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:35.612604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68fa5f18-a4da-404f-bdc8-30bdc987d242 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:35.749449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-68fa5f18-a4da-404f-bdc8-30bdc987d242 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:35.757702 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-68fa5f18-a4da-404f-bdc8-30bdc987d242 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1509 microversion: 2.1 time: 0.162701 Oct 05 18:32:35.758254 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3282/6808] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:35 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:35.786781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e47a7539-2cda-4af4-93f6-275755225a7a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:35.787420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e47a7539-2cda-4af4-93f6-275755225a7a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:35.794750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e47a7539-2cda-4af4-93f6-275755225a7a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:35.795272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e47a7539-2cda-4af4-93f6-275755225a7a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:35.795728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e47a7539-2cda-4af4-93f6-275755225a7a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:35.796450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e47a7539-2cda-4af4-93f6-275755225a7a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:35.796928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e47a7539-2cda-4af4-93f6-275755225a7a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:35.797375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e47a7539-2cda-4af4-93f6-275755225a7a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:35.940722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e47a7539-2cda-4af4-93f6-275755225a7a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:35.951194 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e47a7539-2cda-4af4-93f6-275755225a7a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1509 microversion: 2.1 time: 0.170349 Oct 05 18:32:35.951952 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3527/6809] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:35 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:35.976178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-37d4ae5b-6028-4de2-8c97-78e387676045 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:32:35.978766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-37d4ae5b-6028-4de2-8c97-78e387676045 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:35.985247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37d4ae5b-6028-4de2-8c97-78e387676045 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:35.985745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37d4ae5b-6028-4de2-8c97-78e387676045 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:35.986153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37d4ae5b-6028-4de2-8c97-78e387676045 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:35.987058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37d4ae5b-6028-4de2-8c97-78e387676045 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:35.987690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37d4ae5b-6028-4de2-8c97-78e387676045 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:35.988137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37d4ae5b-6028-4de2-8c97-78e387676045 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:36.058465 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-37d4ae5b-6028-4de2-8c97-78e387676045 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "PUT /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1081 microversion: 2.1 time: 0.086186 Oct 05 18:32:36.059118 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3283/6810] 10.222.0.70 () {60 vars in 1256 bytes} [Wed Oct 5 18:32:35 2022] PUT /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1081 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:36.079514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-990a3fe1-1c42-4ffc-bfcb-5506e7f72244 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:36.080142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-990a3fe1-1c42-4ffc-bfcb-5506e7f72244 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:36.082393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:36.083253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:36.089576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-990a3fe1-1c42-4ffc-bfcb-5506e7f72244 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:36.090085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-990a3fe1-1c42-4ffc-bfcb-5506e7f72244 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:36.090574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-990a3fe1-1c42-4ffc-bfcb-5506e7f72244 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:36.091301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-990a3fe1-1c42-4ffc-bfcb-5506e7f72244 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:36.091778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-990a3fe1-1c42-4ffc-bfcb-5506e7f72244 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:36.092224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-990a3fe1-1c42-4ffc-bfcb-5506e7f72244 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:36.225494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-990a3fe1-1c42-4ffc-bfcb-5506e7f72244 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:36.233957 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-990a3fe1-1c42-4ffc-bfcb-5506e7f72244 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1507 microversion: 2.1 time: 0.159992 Oct 05 18:32:36.234579 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3528/6811] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:36 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:36.256205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b03bbf23-d30e-4ae5-8d52-e19cc1696766 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:36.256660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b03bbf23-d30e-4ae5-8d52-e19cc1696766 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:36.258733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:36.264515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b03bbf23-d30e-4ae5-8d52-e19cc1696766 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:36.265005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b03bbf23-d30e-4ae5-8d52-e19cc1696766 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:36.265440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b03bbf23-d30e-4ae5-8d52-e19cc1696766 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:36.266142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b03bbf23-d30e-4ae5-8d52-e19cc1696766 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:36.266876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b03bbf23-d30e-4ae5-8d52-e19cc1696766 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:36.267362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b03bbf23-d30e-4ae5-8d52-e19cc1696766 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:36.397751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b03bbf23-d30e-4ae5-8d52-e19cc1696766 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:36.406311 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b03bbf23-d30e-4ae5-8d52-e19cc1696766 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1507 microversion: 2.1 time: 0.154346 Oct 05 18:32:36.406915 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3284/6812] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:36 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:36.428892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:32:36.431169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:36.437622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:36.438128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:36.438629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:36.439336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:36.439809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:36.440249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:36.478834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:36.484490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Old instance type m1.heat2, new instance type m1.heat {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 18:32:36.491248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:32:36.491677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:32:36.492160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:32:36.492578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:32:36.492999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:32:36.560237 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-68525f6a-0501-48e2-8c1c-2d093a4f54c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "POST /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1/action" status: 202 len: 0 microversion: 2.1 time: 0.135464 Oct 05 18:32:36.561168 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3529/6813] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:32:36 2022] POST /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:32:36.570485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-68e6b434-7e07-4506-a9b9-07ebc6faa5d6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:36.571099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-68e6b434-7e07-4506-a9b9-07ebc6faa5d6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:36.577328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e6b434-7e07-4506-a9b9-07ebc6faa5d6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:36.577984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e6b434-7e07-4506-a9b9-07ebc6faa5d6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:36.578582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e6b434-7e07-4506-a9b9-07ebc6faa5d6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:36.579355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e6b434-7e07-4506-a9b9-07ebc6faa5d6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:36.579843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e6b434-7e07-4506-a9b9-07ebc6faa5d6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:36.580269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-68e6b434-7e07-4506-a9b9-07ebc6faa5d6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:36.717295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-68e6b434-7e07-4506-a9b9-07ebc6faa5d6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:36.725201 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-68e6b434-7e07-4506-a9b9-07ebc6faa5d6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1518 microversion: 2.1 time: 0.159117 Oct 05 18:32:36.726125 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3285/6814] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:36 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:37.750438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-72478cff-13d8-497c-8995-221d38996de7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:37.751137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-72478cff-13d8-497c-8995-221d38996de7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:37.758942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72478cff-13d8-497c-8995-221d38996de7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:37.759437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72478cff-13d8-497c-8995-221d38996de7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:37.759888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72478cff-13d8-497c-8995-221d38996de7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:37.760612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72478cff-13d8-497c-8995-221d38996de7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:37.761083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72478cff-13d8-497c-8995-221d38996de7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:37.761526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-72478cff-13d8-497c-8995-221d38996de7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:37.894999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-72478cff-13d8-497c-8995-221d38996de7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:37.903019 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-72478cff-13d8-497c-8995-221d38996de7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1518 microversion: 2.1 time: 0.158078 Oct 05 18:32:37.903589 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3530/6815] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:37 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:38.929584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f62b7ad9-331d-49dc-87f5-87baccc8278b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:38.930848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f62b7ad9-331d-49dc-87f5-87baccc8278b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:38.938302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f62b7ad9-331d-49dc-87f5-87baccc8278b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:38.938805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f62b7ad9-331d-49dc-87f5-87baccc8278b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:38.939242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f62b7ad9-331d-49dc-87f5-87baccc8278b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:38.939950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f62b7ad9-331d-49dc-87f5-87baccc8278b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:38.940401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f62b7ad9-331d-49dc-87f5-87baccc8278b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:38.940831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f62b7ad9-331d-49dc-87f5-87baccc8278b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:39.072473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f62b7ad9-331d-49dc-87f5-87baccc8278b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:39.080761 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f62b7ad9-331d-49dc-87f5-87baccc8278b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.156761 Oct 05 18:32:39.081352 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3286/6816] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:38 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:40.107859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6ef69d60-edbc-4b43-b316-0502b494c1c2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:40.108867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6ef69d60-edbc-4b43-b316-0502b494c1c2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:40.114930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:40.122410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ef69d60-edbc-4b43-b316-0502b494c1c2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:40.123226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ef69d60-edbc-4b43-b316-0502b494c1c2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:40.123981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ef69d60-edbc-4b43-b316-0502b494c1c2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:40.125188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ef69d60-edbc-4b43-b316-0502b494c1c2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:40.126007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ef69d60-edbc-4b43-b316-0502b494c1c2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:40.126775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6ef69d60-edbc-4b43-b316-0502b494c1c2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:40.131780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:40.275743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6ef69d60-edbc-4b43-b316-0502b494c1c2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:40.284321 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6ef69d60-edbc-4b43-b316-0502b494c1c2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.183082 Oct 05 18:32:40.284919 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3531/6817] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:40 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:41.309647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2365b2cd-2f54-4b76-b276-439c17aa8657 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:41.310411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2365b2cd-2f54-4b76-b276-439c17aa8657 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:41.313568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=34 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:41.320007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2365b2cd-2f54-4b76-b276-439c17aa8657 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:41.320586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2365b2cd-2f54-4b76-b276-439c17aa8657 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:41.321109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2365b2cd-2f54-4b76-b276-439c17aa8657 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:41.321933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2365b2cd-2f54-4b76-b276-439c17aa8657 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:41.322515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2365b2cd-2f54-4b76-b276-439c17aa8657 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:41.323026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2365b2cd-2f54-4b76-b276-439c17aa8657 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:41.466380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2365b2cd-2f54-4b76-b276-439c17aa8657 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:41.477467 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2365b2cd-2f54-4b76-b276-439c17aa8657 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.172614 Oct 05 18:32:41.478041 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3287/6818] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:41 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:42.504892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f1b422bc-0481-4c8c-b3bc-6d8cabec3344 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:42.505811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f1b422bc-0481-4c8c-b3bc-6d8cabec3344 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:42.514048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b422bc-0481-4c8c-b3bc-6d8cabec3344 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:42.514629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b422bc-0481-4c8c-b3bc-6d8cabec3344 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:42.515123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b422bc-0481-4c8c-b3bc-6d8cabec3344 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:42.515902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b422bc-0481-4c8c-b3bc-6d8cabec3344 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:42.516425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b422bc-0481-4c8c-b3bc-6d8cabec3344 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:42.516931 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f1b422bc-0481-4c8c-b3bc-6d8cabec3344 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:42.653384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f1b422bc-0481-4c8c-b3bc-6d8cabec3344 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:42.665634 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f1b422bc-0481-4c8c-b3bc-6d8cabec3344 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.167084 Oct 05 18:32:42.666520 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3532/6819] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:42 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:43.692972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a573a95c-c0d8-4c85-9fe7-2d65ac60442f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:43.693612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a573a95c-c0d8-4c85-9fe7-2d65ac60442f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:43.703872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a573a95c-c0d8-4c85-9fe7-2d65ac60442f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:43.704501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a573a95c-c0d8-4c85-9fe7-2d65ac60442f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:43.705107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a573a95c-c0d8-4c85-9fe7-2d65ac60442f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:43.706171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a573a95c-c0d8-4c85-9fe7-2d65ac60442f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:43.706826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a573a95c-c0d8-4c85-9fe7-2d65ac60442f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:43.707368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a573a95c-c0d8-4c85-9fe7-2d65ac60442f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:43.843687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a573a95c-c0d8-4c85-9fe7-2d65ac60442f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:43.852016 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a573a95c-c0d8-4c85-9fe7-2d65ac60442f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.164968 Oct 05 18:32:43.852613 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3288/6820] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:43 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:44.878996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-957c8073-76fc-4be0-8667-057aeebb6b02 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:44.879860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-957c8073-76fc-4be0-8667-057aeebb6b02 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:44.891803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-957c8073-76fc-4be0-8667-057aeebb6b02 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:44.892648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-957c8073-76fc-4be0-8667-057aeebb6b02 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:44.893400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-957c8073-76fc-4be0-8667-057aeebb6b02 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:44.894648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-957c8073-76fc-4be0-8667-057aeebb6b02 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:44.895440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-957c8073-76fc-4be0-8667-057aeebb6b02 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:44.896178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-957c8073-76fc-4be0-8667-057aeebb6b02 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:45.035667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-957c8073-76fc-4be0-8667-057aeebb6b02 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:45.043987 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-957c8073-76fc-4be0-8667-057aeebb6b02 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.171782 Oct 05 18:32:45.044543 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3533/6821] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:44 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:46.069810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1931e43c-2d2e-4234-8d7a-0843270e801c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:46.070400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1931e43c-2d2e-4234-8d7a-0843270e801c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:46.077753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1931e43c-2d2e-4234-8d7a-0843270e801c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:46.078241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1931e43c-2d2e-4234-8d7a-0843270e801c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:46.078700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1931e43c-2d2e-4234-8d7a-0843270e801c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:46.079401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1931e43c-2d2e-4234-8d7a-0843270e801c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:46.079856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1931e43c-2d2e-4234-8d7a-0843270e801c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:46.080291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1931e43c-2d2e-4234-8d7a-0843270e801c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:46.220697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1931e43c-2d2e-4234-8d7a-0843270e801c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:46.228888 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1931e43c-2d2e-4234-8d7a-0843270e801c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.164718 Oct 05 18:32:46.229468 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3289/6822] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:46 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:47.256588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d346fde4-fdaa-478a-94d9-5a38b0062859 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:47.257218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d346fde4-fdaa-478a-94d9-5a38b0062859 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:47.265062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d346fde4-fdaa-478a-94d9-5a38b0062859 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:47.265570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d346fde4-fdaa-478a-94d9-5a38b0062859 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:47.266028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d346fde4-fdaa-478a-94d9-5a38b0062859 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:47.266789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d346fde4-fdaa-478a-94d9-5a38b0062859 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:47.267266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d346fde4-fdaa-478a-94d9-5a38b0062859 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:47.267717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d346fde4-fdaa-478a-94d9-5a38b0062859 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:47.406645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d346fde4-fdaa-478a-94d9-5a38b0062859 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:47.419739 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d346fde4-fdaa-478a-94d9-5a38b0062859 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.166865 Oct 05 18:32:47.420543 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3534/6823] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:47 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:48.450514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b7cf7540-dd2c-4541-a5ab-d342584cc3e2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:48.451506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b7cf7540-dd2c-4541-a5ab-d342584cc3e2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:48.463593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7cf7540-dd2c-4541-a5ab-d342584cc3e2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:48.464395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7cf7540-dd2c-4541-a5ab-d342584cc3e2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:48.465114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7cf7540-dd2c-4541-a5ab-d342584cc3e2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:48.466247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7cf7540-dd2c-4541-a5ab-d342584cc3e2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:48.467036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7cf7540-dd2c-4541-a5ab-d342584cc3e2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:48.467741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b7cf7540-dd2c-4541-a5ab-d342584cc3e2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:48.608007 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b7cf7540-dd2c-4541-a5ab-d342584cc3e2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:48.616582 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b7cf7540-dd2c-4541-a5ab-d342584cc3e2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.172452 Oct 05 18:32:48.617164 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3290/6824] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:48 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:49.644211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d1cd9da-830d-4a52-9ab3-dad2a87cf26a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:49.645221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d1cd9da-830d-4a52-9ab3-dad2a87cf26a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:49.653270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1cd9da-830d-4a52-9ab3-dad2a87cf26a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:49.653766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1cd9da-830d-4a52-9ab3-dad2a87cf26a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:49.654218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1cd9da-830d-4a52-9ab3-dad2a87cf26a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:49.654956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1cd9da-830d-4a52-9ab3-dad2a87cf26a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:49.655418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1cd9da-830d-4a52-9ab3-dad2a87cf26a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:49.655856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d1cd9da-830d-4a52-9ab3-dad2a87cf26a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:49.793874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d1cd9da-830d-4a52-9ab3-dad2a87cf26a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:49.806411 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d1cd9da-830d-4a52-9ab3-dad2a87cf26a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.168824 Oct 05 18:32:49.807094 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3535/6825] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:49 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:50.839291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4e67f708-f716-48b3-906c-adc6566373c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:50.839878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4e67f708-f716-48b3-906c-adc6566373c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:50.847344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e67f708-f716-48b3-906c-adc6566373c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:50.847839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e67f708-f716-48b3-906c-adc6566373c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:50.848276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e67f708-f716-48b3-906c-adc6566373c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:50.848995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e67f708-f716-48b3-906c-adc6566373c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:50.849457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e67f708-f716-48b3-906c-adc6566373c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:50.849890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4e67f708-f716-48b3-906c-adc6566373c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:50.989756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4e67f708-f716-48b3-906c-adc6566373c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:50.998540 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4e67f708-f716-48b3-906c-adc6566373c1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.166870 Oct 05 18:32:50.999117 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3291/6826] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:50 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:52.033437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-458863a7-0507-4e6d-9c40-42cc2ec65ea1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:52.034513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-458863a7-0507-4e6d-9c40-42cc2ec65ea1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:52.047829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-458863a7-0507-4e6d-9c40-42cc2ec65ea1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:52.048342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-458863a7-0507-4e6d-9c40-42cc2ec65ea1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:52.048805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-458863a7-0507-4e6d-9c40-42cc2ec65ea1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:52.049531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-458863a7-0507-4e6d-9c40-42cc2ec65ea1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:52.050008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-458863a7-0507-4e6d-9c40-42cc2ec65ea1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:52.050478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-458863a7-0507-4e6d-9c40-42cc2ec65ea1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:52.196972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-458863a7-0507-4e6d-9c40-42cc2ec65ea1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:52.205361 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-458863a7-0507-4e6d-9c40-42cc2ec65ea1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.185550 Oct 05 18:32:52.205944 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3536/6827] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:52 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:53.229474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-41aae063-870a-4bb3-98a2-e21adf5bda17 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:53.230069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-41aae063-870a-4bb3-98a2-e21adf5bda17 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:53.237686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41aae063-870a-4bb3-98a2-e21adf5bda17 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:53.238237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41aae063-870a-4bb3-98a2-e21adf5bda17 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:53.238714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41aae063-870a-4bb3-98a2-e21adf5bda17 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:53.239417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41aae063-870a-4bb3-98a2-e21adf5bda17 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:53.239873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41aae063-870a-4bb3-98a2-e21adf5bda17 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:53.240305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-41aae063-870a-4bb3-98a2-e21adf5bda17 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:53.378372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-41aae063-870a-4bb3-98a2-e21adf5bda17 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:53.386594 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-41aae063-870a-4bb3-98a2-e21adf5bda17 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.161138 Oct 05 18:32:53.387170 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3292/6828] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:53 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:54.414523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4fe6289e-ff0d-4262-9853-0d3436edd1ad tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:54.415549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4fe6289e-ff0d-4262-9853-0d3436edd1ad tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:54.427008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fe6289e-ff0d-4262-9853-0d3436edd1ad tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:54.427547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fe6289e-ff0d-4262-9853-0d3436edd1ad tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:54.428003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fe6289e-ff0d-4262-9853-0d3436edd1ad tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:54.428723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fe6289e-ff0d-4262-9853-0d3436edd1ad tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:54.429195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fe6289e-ff0d-4262-9853-0d3436edd1ad tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:54.429638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fe6289e-ff0d-4262-9853-0d3436edd1ad tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:54.565297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4fe6289e-ff0d-4262-9853-0d3436edd1ad tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:54.573726 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4fe6289e-ff0d-4262-9853-0d3436edd1ad tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.165885 Oct 05 18:32:54.574355 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3537/6829] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:54 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:55.603212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bf0c3ff1-7632-44b1-ac91-74b6dec5d096 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:55.604237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bf0c3ff1-7632-44b1-ac91-74b6dec5d096 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:55.614637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0c3ff1-7632-44b1-ac91-74b6dec5d096 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:55.615147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0c3ff1-7632-44b1-ac91-74b6dec5d096 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:55.615592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0c3ff1-7632-44b1-ac91-74b6dec5d096 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:55.616291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0c3ff1-7632-44b1-ac91-74b6dec5d096 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:55.616745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0c3ff1-7632-44b1-ac91-74b6dec5d096 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:55.617180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bf0c3ff1-7632-44b1-ac91-74b6dec5d096 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:55.750554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bf0c3ff1-7632-44b1-ac91-74b6dec5d096 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:55.758951 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bf0c3ff1-7632-44b1-ac91-74b6dec5d096 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.162839 Oct 05 18:32:55.759538 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3293/6830] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:55 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:56.795742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a02cf4cb-fc82-40c3-b8c5-bd075c8250af tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:56.796787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a02cf4cb-fc82-40c3-b8c5-bd075c8250af tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:56.807600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a02cf4cb-fc82-40c3-b8c5-bd075c8250af tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:56.808438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a02cf4cb-fc82-40c3-b8c5-bd075c8250af tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:56.809197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a02cf4cb-fc82-40c3-b8c5-bd075c8250af tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:56.810429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a02cf4cb-fc82-40c3-b8c5-bd075c8250af tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:56.811214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a02cf4cb-fc82-40c3-b8c5-bd075c8250af tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:56.811956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a02cf4cb-fc82-40c3-b8c5-bd075c8250af tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:56.954704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a02cf4cb-fc82-40c3-b8c5-bd075c8250af tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:56.962749 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a02cf4cb-fc82-40c3-b8c5-bd075c8250af tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.173787 Oct 05 18:32:56.963337 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3538/6831] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:56 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:57.987596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ef407f6f-33e5-4e43-89f8-b8f8bd37d839 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:57.988198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ef407f6f-33e5-4e43-89f8-b8f8bd37d839 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:57.998408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef407f6f-33e5-4e43-89f8-b8f8bd37d839 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:57.998897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef407f6f-33e5-4e43-89f8-b8f8bd37d839 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:57.999329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef407f6f-33e5-4e43-89f8-b8f8bd37d839 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:58.000020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef407f6f-33e5-4e43-89f8-b8f8bd37d839 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:58.000549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef407f6f-33e5-4e43-89f8-b8f8bd37d839 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:58.000987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef407f6f-33e5-4e43-89f8-b8f8bd37d839 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:58.019787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:32:58.140328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ef407f6f-33e5-4e43-89f8-b8f8bd37d839 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:58.148625 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ef407f6f-33e5-4e43-89f8-b8f8bd37d839 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.165358 Oct 05 18:32:58.149206 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3294/6832] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:57 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:32:59.177688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fe0ef0d2-65ec-4f6c-8e48-9c7817c3247c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:32:59.178251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fe0ef0d2-65ec-4f6c-8e48-9c7817c3247c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:32:59.185663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe0ef0d2-65ec-4f6c-8e48-9c7817c3247c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:59.186165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe0ef0d2-65ec-4f6c-8e48-9c7817c3247c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:59.186659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe0ef0d2-65ec-4f6c-8e48-9c7817c3247c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:59.187373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe0ef0d2-65ec-4f6c-8e48-9c7817c3247c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:32:59.187844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe0ef0d2-65ec-4f6c-8e48-9c7817c3247c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:32:59.188284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe0ef0d2-65ec-4f6c-8e48-9c7817c3247c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:32:59.328161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fe0ef0d2-65ec-4f6c-8e48-9c7817c3247c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:32:59.336178 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fe0ef0d2-65ec-4f6c-8e48-9c7817c3247c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.163850 Oct 05 18:32:59.336785 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3539/6833] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:32:59 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:00.363763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-07db5c31-0050-4558-a242-953ae094c747 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:00.364783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-07db5c31-0050-4558-a242-953ae094c747 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:00.379623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07db5c31-0050-4558-a242-953ae094c747 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:00.380093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07db5c31-0050-4558-a242-953ae094c747 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:00.380556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07db5c31-0050-4558-a242-953ae094c747 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:00.381261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07db5c31-0050-4558-a242-953ae094c747 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:00.381717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07db5c31-0050-4558-a242-953ae094c747 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:00.382139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-07db5c31-0050-4558-a242-953ae094c747 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:00.521802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-07db5c31-0050-4558-a242-953ae094c747 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:00.529765 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-07db5c31-0050-4558-a242-953ae094c747 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.172715 Oct 05 18:33:00.530343 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3295/6834] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:00 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:01.557564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88663389-5567-45c6-9224-262629f42eae tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:01.558373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88663389-5567-45c6-9224-262629f42eae tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:01.569918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88663389-5567-45c6-9224-262629f42eae tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:01.570163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88663389-5567-45c6-9224-262629f42eae tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:01.570802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88663389-5567-45c6-9224-262629f42eae tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:01.571810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88663389-5567-45c6-9224-262629f42eae tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:01.572438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88663389-5567-45c6-9224-262629f42eae tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:01.573040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88663389-5567-45c6-9224-262629f42eae tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:01.706685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88663389-5567-45c6-9224-262629f42eae tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:01.715111 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88663389-5567-45c6-9224-262629f42eae tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.164058 Oct 05 18:33:01.715695 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3540/6835] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:01 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:02.751057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-987b9255-772d-4487-9520-c20792bc9d1b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:02.752055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-987b9255-772d-4487-9520-c20792bc9d1b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:02.759693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987b9255-772d-4487-9520-c20792bc9d1b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:02.760185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987b9255-772d-4487-9520-c20792bc9d1b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:02.760610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987b9255-772d-4487-9520-c20792bc9d1b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:02.761300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987b9255-772d-4487-9520-c20792bc9d1b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:02.761748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987b9255-772d-4487-9520-c20792bc9d1b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:02.762176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987b9255-772d-4487-9520-c20792bc9d1b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:02.901652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-987b9255-772d-4487-9520-c20792bc9d1b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:02.909945 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-987b9255-772d-4487-9520-c20792bc9d1b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.165416 Oct 05 18:33:02.910578 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3296/6836] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:02 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:03.933411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6c98fbd-2b8e-4cdb-83c1-d37d6b9f8889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:03.934082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c6c98fbd-2b8e-4cdb-83c1-d37d6b9f8889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:03.941648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c98fbd-2b8e-4cdb-83c1-d37d6b9f8889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:03.942159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c98fbd-2b8e-4cdb-83c1-d37d6b9f8889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:03.942660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c98fbd-2b8e-4cdb-83c1-d37d6b9f8889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:03.943382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c98fbd-2b8e-4cdb-83c1-d37d6b9f8889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:03.943862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c98fbd-2b8e-4cdb-83c1-d37d6b9f8889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:03.944308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6c98fbd-2b8e-4cdb-83c1-d37d6b9f8889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:04.081854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c6c98fbd-2b8e-4cdb-83c1-d37d6b9f8889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:04.090195 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c6c98fbd-2b8e-4cdb-83c1-d37d6b9f8889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.160847 Oct 05 18:33:04.090834 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3541/6837] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:03 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:05.114309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f289a498-d7db-46ab-97f2-b1e8a06e3892 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:05.115127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f289a498-d7db-46ab-97f2-b1e8a06e3892 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:05.122591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f289a498-d7db-46ab-97f2-b1e8a06e3892 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:05.123231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f289a498-d7db-46ab-97f2-b1e8a06e3892 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:05.123521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f289a498-d7db-46ab-97f2-b1e8a06e3892 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:05.124506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f289a498-d7db-46ab-97f2-b1e8a06e3892 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:05.124971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f289a498-d7db-46ab-97f2-b1e8a06e3892 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:05.125405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f289a498-d7db-46ab-97f2-b1e8a06e3892 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:05.272794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f289a498-d7db-46ab-97f2-b1e8a06e3892 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:05.280840 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f289a498-d7db-46ab-97f2-b1e8a06e3892 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1523 microversion: 2.1 time: 0.171044 Oct 05 18:33:05.281445 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3297/6838] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:05 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:05.717565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-14275127-df30-4a67-986d-9117b39ba824 req-cd26deeb-6136-449a-a36a-345fd123f914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8850676-5444-49a8-a717-59204fe4cdf1", "name": "network-vif-unplugged", "status": "completed", "tag": "4cb15067-636a-4de4-ae3e-48bb226c31ee"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:05.728225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-14275127-df30-4a67-986d-9117b39ba824 req-cd26deeb-6136-449a-a36a-345fd123f914 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:05.728891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-14275127-df30-4a67-986d-9117b39ba824 req-cd26deeb-6136-449a-a36a-345fd123f914 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:05.729353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-14275127-df30-4a67-986d-9117b39ba824 req-cd26deeb-6136-449a-a36a-345fd123f914 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:05.742189 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-14275127-df30-4a67-986d-9117b39ba824 req-cd26deeb-6136-449a-a36a-345fd123f914 service nova] Creating event network-vif-unplugged:4cb15067-636a-4de4-ae3e-48bb226c31ee for instance f8850676-5444-49a8-a717-59204fe4cdf1 on n-h2-835595-3 Oct 05 18:33:05.747648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-14275127-df30-4a67-986d-9117b39ba824 req-cd26deeb-6136-449a-a36a-345fd123f914 service nova] Instance f8850676-5444-49a8-a717-59204fe4cdf1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:33:05.758859 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-14275127-df30-4a67-986d-9117b39ba824 req-cd26deeb-6136-449a-a36a-345fd123f914 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045512 Oct 05 18:33:05.759765 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3542/6839] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:33:06.305243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6cad7329-dd0c-4da2-ad6d-3dd8969c3d2c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:06.305859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6cad7329-dd0c-4da2-ad6d-3dd8969c3d2c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:06.312818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cad7329-dd0c-4da2-ad6d-3dd8969c3d2c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:06.313316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cad7329-dd0c-4da2-ad6d-3dd8969c3d2c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:06.313746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cad7329-dd0c-4da2-ad6d-3dd8969c3d2c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:06.314495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cad7329-dd0c-4da2-ad6d-3dd8969c3d2c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:06.314943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cad7329-dd0c-4da2-ad6d-3dd8969c3d2c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:06.315358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6cad7329-dd0c-4da2-ad6d-3dd8969c3d2c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:06.448331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6cad7329-dd0c-4da2-ad6d-3dd8969c3d2c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:06.456497 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6cad7329-dd0c-4da2-ad6d-3dd8969c3d2c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1522 microversion: 2.1 time: 0.155196 Oct 05 18:33:06.470302 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3298/6840] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:06 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:07.485925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5432aa0c-834e-44b7-97b0-1965e06e2666 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:07.487027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5432aa0c-834e-44b7-97b0-1965e06e2666 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:07.495655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5432aa0c-834e-44b7-97b0-1965e06e2666 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:07.496258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5432aa0c-834e-44b7-97b0-1965e06e2666 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:07.496710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5432aa0c-834e-44b7-97b0-1965e06e2666 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:07.497433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5432aa0c-834e-44b7-97b0-1965e06e2666 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:07.497913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5432aa0c-834e-44b7-97b0-1965e06e2666 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:07.498388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5432aa0c-834e-44b7-97b0-1965e06e2666 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:07.633602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5432aa0c-834e-44b7-97b0-1965e06e2666 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:07.642037 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5432aa0c-834e-44b7-97b0-1965e06e2666 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1520 microversion: 2.1 time: 0.163427 Oct 05 18:33:07.642681 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3543/6841] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:07 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:07.779826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-bf045188-7ebe-4b65-ac6f-4419aee5101e req-dd0c3cee-9786-400b-8e12-54cf977fa64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8850676-5444-49a8-a717-59204fe4cdf1", "tag": "4cb15067-636a-4de4-ae3e-48bb226c31ee"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:07.793283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bf045188-7ebe-4b65-ac6f-4419aee5101e req-dd0c3cee-9786-400b-8e12-54cf977fa64f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:07.793782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bf045188-7ebe-4b65-ac6f-4419aee5101e req-dd0c3cee-9786-400b-8e12-54cf977fa64f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:07.794226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bf045188-7ebe-4b65-ac6f-4419aee5101e req-dd0c3cee-9786-400b-8e12-54cf977fa64f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:07.806266 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-bf045188-7ebe-4b65-ac6f-4419aee5101e req-dd0c3cee-9786-400b-8e12-54cf977fa64f service nova] Creating event network-changed:4cb15067-636a-4de4-ae3e-48bb226c31ee for instance f8850676-5444-49a8-a717-59204fe4cdf1 on n-h2-835595-3 Oct 05 18:33:07.811989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-bf045188-7ebe-4b65-ac6f-4419aee5101e req-dd0c3cee-9786-400b-8e12-54cf977fa64f service nova] Instance f8850676-5444-49a8-a717-59204fe4cdf1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:33:07.823599 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-bf045188-7ebe-4b65-ac6f-4419aee5101e req-dd0c3cee-9786-400b-8e12-54cf977fa64f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050122 Oct 05 18:33:07.824218 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3299/6842] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:33:08.669870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ff2f57ce-353d-4447-be16-1f77a0e75427 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:08.670803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ff2f57ce-353d-4447-be16-1f77a0e75427 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:08.683401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff2f57ce-353d-4447-be16-1f77a0e75427 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:08.684234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff2f57ce-353d-4447-be16-1f77a0e75427 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:08.684974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff2f57ce-353d-4447-be16-1f77a0e75427 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:08.686133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff2f57ce-353d-4447-be16-1f77a0e75427 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:08.686975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff2f57ce-353d-4447-be16-1f77a0e75427 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:08.687705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ff2f57ce-353d-4447-be16-1f77a0e75427 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:08.835546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ff2f57ce-353d-4447-be16-1f77a0e75427 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:08.844137 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ff2f57ce-353d-4447-be16-1f77a0e75427 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1517 microversion: 2.1 time: 0.180985 Oct 05 18:33:08.844727 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3544/6843] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:08 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:08.868084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-42b114cf-32bf-444d-ba44-34a76e8a6fb6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:08.868672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-42b114cf-32bf-444d-ba44-34a76e8a6fb6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:08.875055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b114cf-32bf-444d-ba44-34a76e8a6fb6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:08.875546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b114cf-32bf-444d-ba44-34a76e8a6fb6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:08.875979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b114cf-32bf-444d-ba44-34a76e8a6fb6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:08.876675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b114cf-32bf-444d-ba44-34a76e8a6fb6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:08.877126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b114cf-32bf-444d-ba44-34a76e8a6fb6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:08.877547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42b114cf-32bf-444d-ba44-34a76e8a6fb6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:08.939655 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-42b114cf-32bf-444d-ba44-34a76e8a6fb6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "POST /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1/action" status: 204 len: 0 microversion: 2.1 time: 0.076467 Oct 05 18:33:08.940251 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3300/6844] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:33:08 2022] POST /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1/action => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:33:08.949243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-29e989dd-62d2-426b-94fd-525d1834a485 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:08.949993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-29e989dd-62d2-426b-94fd-525d1834a485 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:08.956468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e989dd-62d2-426b-94fd-525d1834a485 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:08.957145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e989dd-62d2-426b-94fd-525d1834a485 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:08.957672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e989dd-62d2-426b-94fd-525d1834a485 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:08.958596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e989dd-62d2-426b-94fd-525d1834a485 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:08.959147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e989dd-62d2-426b-94fd-525d1834a485 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:08.959594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-29e989dd-62d2-426b-94fd-525d1834a485 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:09.446101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-29e989dd-62d2-426b-94fd-525d1834a485 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:09.454175 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-29e989dd-62d2-426b-94fd-525d1834a485 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1517 microversion: 2.1 time: 0.509561 Oct 05 18:33:09.454810 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3545/6845] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:08 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1517 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:10.479103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ffdb2c4e-14d5-40bd-90d1-6ee4f6b18bf7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:10.479829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ffdb2c4e-14d5-40bd-90d1-6ee4f6b18bf7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:10.486610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffdb2c4e-14d5-40bd-90d1-6ee4f6b18bf7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:10.487102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffdb2c4e-14d5-40bd-90d1-6ee4f6b18bf7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:10.487554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffdb2c4e-14d5-40bd-90d1-6ee4f6b18bf7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:10.488340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffdb2c4e-14d5-40bd-90d1-6ee4f6b18bf7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:10.488770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffdb2c4e-14d5-40bd-90d1-6ee4f6b18bf7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:10.489201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffdb2c4e-14d5-40bd-90d1-6ee4f6b18bf7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:10.633300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ffdb2c4e-14d5-40bd-90d1-6ee4f6b18bf7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:10.641674 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ffdb2c4e-14d5-40bd-90d1-6ee4f6b18bf7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1509 microversion: 2.1 time: 0.168035 Oct 05 18:33:10.642261 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3301/6846] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:10 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:10.664372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d35586a4-f4f4-496b-acd5-3929293c0567 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:10.664910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d35586a4-f4f4-496b-acd5-3929293c0567 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:10.667766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=30 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:10.673300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d35586a4-f4f4-496b-acd5-3929293c0567 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:10.673797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d35586a4-f4f4-496b-acd5-3929293c0567 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:10.674244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d35586a4-f4f4-496b-acd5-3929293c0567 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:10.674964 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d35586a4-f4f4-496b-acd5-3929293c0567 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:10.676154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d35586a4-f4f4-496b-acd5-3929293c0567 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:10.676595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d35586a4-f4f4-496b-acd5-3929293c0567 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:10.681875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=88 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:10.808752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d35586a4-f4f4-496b-acd5-3929293c0567 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:10.816780 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d35586a4-f4f4-496b-acd5-3929293c0567 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1509 microversion: 2.1 time: 0.156452 Oct 05 18:33:10.817361 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3546/6847] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:10 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:10.844804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5fe94ea8-de73-4667-b24a-c6e749dde272 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Action: 'create', calling method: .version_select at 0x7f7774d6e790>, body: {"keypair": {"name": "tempest-keypair-1299698844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3aGS/OCaqRoZI59QhJeX2PqZJ/X5lHK+mzothEmtdFA9f4KQ+j8PTKOmk+JwEx+aCFmXg6e4nOLwA3/qh2FrOFKyjjVem8Eph9QwjQ9Lpl9UVT1soik00zztwoLIeo8A=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:10.862589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-5fe94ea8-de73-4667-b24a-c6e749dde272 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Getting quotas for project 311f087409944324bf0d57064e44739c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:33:10.868123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-5fe94ea8-de73-4667-b24a-c6e749dde272 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Getting quotas for user e0bd522579774bc8b7fad12638223a18 and project 311f087409944324bf0d57064e44739c. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:33:10.904605 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5fe94ea8-de73-4667-b24a-c6e749dde272 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066163 Oct 05 18:33:10.905219 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3302/6848] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:33:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:33:12.134722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-317ad8a5-6b35-4c69-86be-ab76c05890b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:12.135351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-317ad8a5-6b35-4c69-86be-ab76c05890b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:12.142743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317ad8a5-6b35-4c69-86be-ab76c05890b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:12.143308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317ad8a5-6b35-4c69-86be-ab76c05890b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:12.143800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317ad8a5-6b35-4c69-86be-ab76c05890b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:12.144547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317ad8a5-6b35-4c69-86be-ab76c05890b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:12.145043 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317ad8a5-6b35-4c69-86be-ab76c05890b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:12.145497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-317ad8a5-6b35-4c69-86be-ab76c05890b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:12.279648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-317ad8a5-6b35-4c69-86be-ab76c05890b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:12.287786 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-317ad8a5-6b35-4c69-86be-ab76c05890b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 200 len: 1509 microversion: 2.1 time: 0.157088 Oct 05 18:33:12.288562 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3547/6849] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:12 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:12.311809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c3ad40a9-9976-4b37-b6f3-29b11deaee29 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:12.312375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3ad40a9-9976-4b37-b6f3-29b11deaee29 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:12.314474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:12.325022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3ad40a9-9976-4b37-b6f3-29b11deaee29 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:12.325527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3ad40a9-9976-4b37-b6f3-29b11deaee29 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:12.325975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3ad40a9-9976-4b37-b6f3-29b11deaee29 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:12.326721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3ad40a9-9976-4b37-b6f3-29b11deaee29 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:12.327185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3ad40a9-9976-4b37-b6f3-29b11deaee29 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:12.327617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3ad40a9-9976-4b37-b6f3-29b11deaee29 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:12.341545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ca2c68bd-fbdb-41f6-9023-b22d29894a3f req-c6a83363-1674-44b3-a925-bda31b1ff106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8850676-5444-49a8-a717-59204fe4cdf1", "name": "network-vif-plugged", "status": "completed", "tag": "4cb15067-636a-4de4-ae3e-48bb226c31ee"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:12.352853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ca2c68bd-fbdb-41f6-9023-b22d29894a3f req-c6a83363-1674-44b3-a925-bda31b1ff106 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:12.353361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ca2c68bd-fbdb-41f6-9023-b22d29894a3f req-c6a83363-1674-44b3-a925-bda31b1ff106 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:12.353813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ca2c68bd-fbdb-41f6-9023-b22d29894a3f req-c6a83363-1674-44b3-a925-bda31b1ff106 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:12.354874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3ad40a9-9976-4b37-b6f3-29b11deaee29 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:33:12.370994 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ca2c68bd-fbdb-41f6-9023-b22d29894a3f req-c6a83363-1674-44b3-a925-bda31b1ff106 service nova] Creating event network-vif-plugged:4cb15067-636a-4de4-ae3e-48bb226c31ee for instance f8850676-5444-49a8-a717-59204fe4cdf1 on n-h2-835595-3 Oct 05 18:33:12.376417 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ca2c68bd-fbdb-41f6-9023-b22d29894a3f req-c6a83363-1674-44b3-a925-bda31b1ff106 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038545 Oct 05 18:33:12.377030 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3548/6850] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:33:12.440625 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c3ad40a9-9976-4b37-b6f3-29b11deaee29 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 204 len: 0 microversion: 2.1 time: 0.133399 Oct 05 18:33:12.441367 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3303/6851] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:33:12 2022] DELETE /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 05 18:33:12.499250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1297543843", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "000a390f-8803-4fe7-9ff3-d570ba91a406"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:12.557447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] validate_networks() for [('000a390f-8803-4fe7-9ff3-d570ba91a406', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:33:12.965153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:33:12.965595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:33:12.966068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:33:12.966527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:33:12.966949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:33:12.976793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:12.977257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:12.977707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:12.978476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:12.978949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:12.979387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:12.996448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Getting quotas for project 311f087409944324bf0d57064e44739c. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:33:13.001697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Getting quotas for user e0bd522579774bc8b7fad12638223a18 and project 311f087409944324bf0d57064e44739c. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:33:13.014422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:33:13.016784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:33:13.063416 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-13ef75d0-5832-40af-8bbd-03e2d02f970d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.568856 Oct 05 18:33:13.064083 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3549/6852] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:33:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:33:13.076035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8c1e3756-8e9f-43b5-84a7-64ca3198bc39 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:13.076709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8c1e3756-8e9f-43b5-84a7-64ca3198bc39 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:13.131102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c1e3756-8e9f-43b5-84a7-64ca3198bc39 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:13.138612 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8c1e3756-8e9f-43b5-84a7-64ca3198bc39 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1218 microversion: 2.1 time: 0.066871 Oct 05 18:33:13.139171 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3304/6853] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:13 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:14.164932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1536e4c5-b359-4bbb-8509-6d944ba705ef tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:14.165579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1536e4c5-b359-4bbb-8509-6d944ba705ef tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:14.173202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1536e4c5-b359-4bbb-8509-6d944ba705ef tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:14.173727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1536e4c5-b359-4bbb-8509-6d944ba705ef tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:14.174179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1536e4c5-b359-4bbb-8509-6d944ba705ef tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:14.174935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1536e4c5-b359-4bbb-8509-6d944ba705ef tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:14.175605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1536e4c5-b359-4bbb-8509-6d944ba705ef tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:14.176411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1536e4c5-b359-4bbb-8509-6d944ba705ef tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:14.283427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1536e4c5-b359-4bbb-8509-6d944ba705ef tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:14.284087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-664f3fa4-2a92-4d2b-b0b3-35adad8b57a8 req-3c266fe7-30ae-4678-a281-b63b337eb5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8850676-5444-49a8-a717-59204fe4cdf1", "name": "network-vif-deleted", "tag": "4cb15067-636a-4de4-ae3e-48bb226c31ee"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:14.291807 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1536e4c5-b359-4bbb-8509-6d944ba705ef tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1278 microversion: 2.1 time: 0.132102 Oct 05 18:33:14.306500 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3550/6854] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:14 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1278 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:14.311291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-664f3fa4-2a92-4d2b-b0b3-35adad8b57a8 req-3c266fe7-30ae-4678-a281-b63b337eb5f4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:14.311790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-664f3fa4-2a92-4d2b-b0b3-35adad8b57a8 req-3c266fe7-30ae-4678-a281-b63b337eb5f4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:14.312227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-664f3fa4-2a92-4d2b-b0b3-35adad8b57a8 req-3c266fe7-30ae-4678-a281-b63b337eb5f4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:14.325121 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-664f3fa4-2a92-4d2b-b0b3-35adad8b57a8 req-3c266fe7-30ae-4678-a281-b63b337eb5f4 service nova] Creating event network-vif-deleted:4cb15067-636a-4de4-ae3e-48bb226c31ee for instance f8850676-5444-49a8-a717-59204fe4cdf1 on n-h2-835595-3 Oct 05 18:33:14.331495 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-664f3fa4-2a92-4d2b-b0b3-35adad8b57a8 req-3c266fe7-30ae-4678-a281-b63b337eb5f4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051409 Oct 05 18:33:14.333911 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3305/6855] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:33:15.317548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a5d2a4a9-49f7-48a7-a583-1ecae09fbeab tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:15.317961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a5d2a4a9-49f7-48a7-a583-1ecae09fbeab tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:15.325205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d2a4a9-49f7-48a7-a583-1ecae09fbeab tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:15.325725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d2a4a9-49f7-48a7-a583-1ecae09fbeab tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:15.326179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d2a4a9-49f7-48a7-a583-1ecae09fbeab tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:15.326941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d2a4a9-49f7-48a7-a583-1ecae09fbeab tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:15.327438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d2a4a9-49f7-48a7-a583-1ecae09fbeab tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:15.327909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a5d2a4a9-49f7-48a7-a583-1ecae09fbeab tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:15.463420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a5d2a4a9-49f7-48a7-a583-1ecae09fbeab tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:15.471434 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a5d2a4a9-49f7-48a7-a583-1ecae09fbeab tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1318 microversion: 2.1 time: 0.158756 Oct 05 18:33:15.472023 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3551/6856] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:15 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:15.893095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-757ade7a-5382-4a90-bf26-bc643485a4cf req-d1ec05b9-6cf5-497f-a7cb-0f9cc23364f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "509a6281-aef0-4d5c-8a0e-49ab836aeeb6", "tag": "46307b6d-d0ef-49db-bd78-7f49767a0528"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:15.913489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-757ade7a-5382-4a90-bf26-bc643485a4cf req-d1ec05b9-6cf5-497f-a7cb-0f9cc23364f0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:15.913941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-757ade7a-5382-4a90-bf26-bc643485a4cf req-d1ec05b9-6cf5-497f-a7cb-0f9cc23364f0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:15.914418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-757ade7a-5382-4a90-bf26-bc643485a4cf req-d1ec05b9-6cf5-497f-a7cb-0f9cc23364f0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:15.927398 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-757ade7a-5382-4a90-bf26-bc643485a4cf req-d1ec05b9-6cf5-497f-a7cb-0f9cc23364f0 service nova] Creating event network-changed:46307b6d-d0ef-49db-bd78-7f49767a0528 for instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 on n-h2-835595-3 Oct 05 18:33:15.933273 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-757ade7a-5382-4a90-bf26-bc643485a4cf req-d1ec05b9-6cf5-497f-a7cb-0f9cc23364f0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045352 Oct 05 18:33:15.933793 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3306/6857] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:33:16.499526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fd27b839-679c-4449-8f8f-ee4c908716da tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:16.500459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fd27b839-679c-4449-8f8f-ee4c908716da tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:16.512023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd27b839-679c-4449-8f8f-ee4c908716da tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:16.513272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd27b839-679c-4449-8f8f-ee4c908716da tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:16.514017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd27b839-679c-4449-8f8f-ee4c908716da tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:16.515239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd27b839-679c-4449-8f8f-ee4c908716da tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:16.516026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd27b839-679c-4449-8f8f-ee4c908716da tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:16.516857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fd27b839-679c-4449-8f8f-ee4c908716da tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:16.649955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fd27b839-679c-4449-8f8f-ee4c908716da tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:16.657793 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fd27b839-679c-4449-8f8f-ee4c908716da tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1318 microversion: 2.1 time: 0.165198 Oct 05 18:33:16.658395 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3552/6858] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:16 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:17.687218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d7fc9aee-c87c-4130-a343-fbb72ca52b68 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:17.688369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d7fc9aee-c87c-4130-a343-fbb72ca52b68 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:17.696310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7fc9aee-c87c-4130-a343-fbb72ca52b68 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:17.696801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7fc9aee-c87c-4130-a343-fbb72ca52b68 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:17.697242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7fc9aee-c87c-4130-a343-fbb72ca52b68 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:17.697943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7fc9aee-c87c-4130-a343-fbb72ca52b68 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:17.698453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7fc9aee-c87c-4130-a343-fbb72ca52b68 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:17.698886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7fc9aee-c87c-4130-a343-fbb72ca52b68 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:17.833024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d7fc9aee-c87c-4130-a343-fbb72ca52b68 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:17.841288 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d7fc9aee-c87c-4130-a343-fbb72ca52b68 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1318 microversion: 2.1 time: 0.162695 Oct 05 18:33:17.842311 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3307/6859] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:17 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:18.866273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f91a0005-be9d-4f04-9290-14f73cdbec3a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:18.866912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f91a0005-be9d-4f04-9290-14f73cdbec3a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:18.874494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a0005-be9d-4f04-9290-14f73cdbec3a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:18.875010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a0005-be9d-4f04-9290-14f73cdbec3a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:18.875462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a0005-be9d-4f04-9290-14f73cdbec3a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:18.876176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a0005-be9d-4f04-9290-14f73cdbec3a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:18.876652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a0005-be9d-4f04-9290-14f73cdbec3a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:18.877091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f91a0005-be9d-4f04-9290-14f73cdbec3a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:19.014892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f91a0005-be9d-4f04-9290-14f73cdbec3a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:19.026572 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f91a0005-be9d-4f04-9290-14f73cdbec3a tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1318 microversion: 2.1 time: 0.164951 Oct 05 18:33:19.027351 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3553/6860] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:18 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:20.053285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0995b712-a22e-4726-aad1-2213ef701a0c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:20.054321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0995b712-a22e-4726-aad1-2213ef701a0c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:20.065899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0995b712-a22e-4726-aad1-2213ef701a0c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:20.066762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0995b712-a22e-4726-aad1-2213ef701a0c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:20.067531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0995b712-a22e-4726-aad1-2213ef701a0c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:20.068580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0995b712-a22e-4726-aad1-2213ef701a0c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:20.069039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0995b712-a22e-4726-aad1-2213ef701a0c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:20.069460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0995b712-a22e-4726-aad1-2213ef701a0c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:20.208952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0995b712-a22e-4726-aad1-2213ef701a0c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:20.217446 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0995b712-a22e-4726-aad1-2213ef701a0c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1318 microversion: 2.1 time: 0.170755 Oct 05 18:33:20.225150 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3308/6861] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:20 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:20.385003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9355afff-4706-47d1-bdd5-656adab55415 req-cf0ef45a-fb1d-48a3-9ae4-dada1758c4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509a6281-aef0-4d5c-8a0e-49ab836aeeb6", "name": "network-vif-plugged", "status": "completed", "tag": "46307b6d-d0ef-49db-bd78-7f49767a0528"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:20.396700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9355afff-4706-47d1-bdd5-656adab55415 req-cf0ef45a-fb1d-48a3-9ae4-dada1758c4e7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:20.397340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9355afff-4706-47d1-bdd5-656adab55415 req-cf0ef45a-fb1d-48a3-9ae4-dada1758c4e7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:20.397785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9355afff-4706-47d1-bdd5-656adab55415 req-cf0ef45a-fb1d-48a3-9ae4-dada1758c4e7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:20.409443 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9355afff-4706-47d1-bdd5-656adab55415 req-cf0ef45a-fb1d-48a3-9ae4-dada1758c4e7 service nova] Creating event network-vif-plugged:46307b6d-d0ef-49db-bd78-7f49767a0528 for instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 on n-h2-835595-3 Oct 05 18:33:20.414622 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9355afff-4706-47d1-bdd5-656adab55415 req-cf0ef45a-fb1d-48a3-9ae4-dada1758c4e7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033570 Oct 05 18:33:20.415266 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3554/6862] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:33:21.244886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-74dbabf5-23a2-44cc-8ded-bff98b027d13 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:21.245899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-74dbabf5-23a2-44cc-8ded-bff98b027d13 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:21.257636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74dbabf5-23a2-44cc-8ded-bff98b027d13 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:21.258095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74dbabf5-23a2-44cc-8ded-bff98b027d13 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:21.258862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74dbabf5-23a2-44cc-8ded-bff98b027d13 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:21.259814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74dbabf5-23a2-44cc-8ded-bff98b027d13 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:21.260440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74dbabf5-23a2-44cc-8ded-bff98b027d13 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:21.260982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-74dbabf5-23a2-44cc-8ded-bff98b027d13 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:21.399663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-74dbabf5-23a2-44cc-8ded-bff98b027d13 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:21.407679 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-74dbabf5-23a2-44cc-8ded-bff98b027d13 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1318 microversion: 2.1 time: 0.169430 Oct 05 18:33:21.408264 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3309/6863] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:21 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:22.432976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9f1f8e97-ace3-459f-9942-cabe66b164e6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:22.433734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9f1f8e97-ace3-459f-9942-cabe66b164e6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:22.440448 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f1f8e97-ace3-459f-9942-cabe66b164e6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:22.440945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f1f8e97-ace3-459f-9942-cabe66b164e6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:22.441390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f1f8e97-ace3-459f-9942-cabe66b164e6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:22.442093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f1f8e97-ace3-459f-9942-cabe66b164e6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:22.442573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f1f8e97-ace3-459f-9942-cabe66b164e6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:22.443086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9f1f8e97-ace3-459f-9942-cabe66b164e6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:22.588363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9f1f8e97-ace3-459f-9942-cabe66b164e6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:22.600369 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9f1f8e97-ace3-459f-9942-cabe66b164e6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1509 microversion: 2.1 time: 0.172484 Oct 05 18:33:22.601211 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3555/6864] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:22 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:22.628060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-62a1473e-df9a-43b7-8f85-96b1c940f3e3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:22.628635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-62a1473e-df9a-43b7-8f85-96b1c940f3e3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:22.640505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62a1473e-df9a-43b7-8f85-96b1c940f3e3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:22.640999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62a1473e-df9a-43b7-8f85-96b1c940f3e3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:22.641450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62a1473e-df9a-43b7-8f85-96b1c940f3e3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:22.642892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62a1473e-df9a-43b7-8f85-96b1c940f3e3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:22.642892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62a1473e-df9a-43b7-8f85-96b1c940f3e3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:22.643143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-62a1473e-df9a-43b7-8f85-96b1c940f3e3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:22.791994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-62a1473e-df9a-43b7-8f85-96b1c940f3e3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:22.804288 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-62a1473e-df9a-43b7-8f85-96b1c940f3e3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1509 microversion: 2.1 time: 0.180037 Oct 05 18:33:22.805013 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3310/6865] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:22 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:22.832245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:22.834667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:22.840989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:22.841494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:22.841959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:22.842710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:22.843187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:22.843633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:22.872320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:22.877986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Old instance type m1.heat2, new instance type m1.heat {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 18:33:22.884735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:33:22.885206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:33:22.885703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:33:22.886151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:33:22.886606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:33:22.959566 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-26c21643-f9f1-4b6d-84de-d681b403e04e tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "POST /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6/action" status: 202 len: 0 microversion: 2.1 time: 0.131311 Oct 05 18:33:22.960182 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3556/6866] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:33:22 2022] POST /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:33:22.968774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e81bc8fb-cba4-478a-8d42-6df6eca38764 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:22.969385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e81bc8fb-cba4-478a-8d42-6df6eca38764 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:22.975490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81bc8fb-cba4-478a-8d42-6df6eca38764 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:22.975979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81bc8fb-cba4-478a-8d42-6df6eca38764 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:22.976411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81bc8fb-cba4-478a-8d42-6df6eca38764 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:22.977112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81bc8fb-cba4-478a-8d42-6df6eca38764 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:22.977562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81bc8fb-cba4-478a-8d42-6df6eca38764 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:22.977981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e81bc8fb-cba4-478a-8d42-6df6eca38764 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:23.110656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e81bc8fb-cba4-478a-8d42-6df6eca38764 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:23.120153 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e81bc8fb-cba4-478a-8d42-6df6eca38764 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1516 microversion: 2.1 time: 0.155360 Oct 05 18:33:23.120724 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3311/6867] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:22 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:24.143200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:24.145086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:24.151529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8d0f8494-9014-4d3f-961b-a418838e384f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:24.152171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8d0f8494-9014-4d3f-961b-a418838e384f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:24.160094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d0f8494-9014-4d3f-961b-a418838e384f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:24.160531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d0f8494-9014-4d3f-961b-a418838e384f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:24.160983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d0f8494-9014-4d3f-961b-a418838e384f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:24.161692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d0f8494-9014-4d3f-961b-a418838e384f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:24.162194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d0f8494-9014-4d3f-961b-a418838e384f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:24.162666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8d0f8494-9014-4d3f-961b-a418838e384f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:24.303787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8d0f8494-9014-4d3f-961b-a418838e384f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:24.312932 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8d0f8494-9014-4d3f-961b-a418838e384f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1516 microversion: 2.1 time: 0.171461 Oct 05 18:33:24.313530 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3557/6868] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:24 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:25.341185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4fabfa8c-bc1d-41a4-9619-7153c4e47bf6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:25.342144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4fabfa8c-bc1d-41a4-9619-7153c4e47bf6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:25.345558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:25.354264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fabfa8c-bc1d-41a4-9619-7153c4e47bf6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:25.355056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fabfa8c-bc1d-41a4-9619-7153c4e47bf6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:25.355744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fabfa8c-bc1d-41a4-9619-7153c4e47bf6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:25.356804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fabfa8c-bc1d-41a4-9619-7153c4e47bf6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:25.357521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fabfa8c-bc1d-41a4-9619-7153c4e47bf6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:25.358188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4fabfa8c-bc1d-41a4-9619-7153c4e47bf6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:25.362586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:25.499740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4fabfa8c-bc1d-41a4-9619-7153c4e47bf6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:25.507905 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4fabfa8c-bc1d-41a4-9619-7153c4e47bf6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.172733 Oct 05 18:33:25.508498 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3312/6869] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:25 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:26.536867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d32d84fe-0d05-4db3-9099-3aa9f32ec5b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:26.537865 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d32d84fe-0d05-4db3-9099-3aa9f32ec5b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:26.545534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d32d84fe-0d05-4db3-9099-3aa9f32ec5b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:26.546041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d32d84fe-0d05-4db3-9099-3aa9f32ec5b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:26.546545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d32d84fe-0d05-4db3-9099-3aa9f32ec5b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:26.547263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d32d84fe-0d05-4db3-9099-3aa9f32ec5b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:26.547739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d32d84fe-0d05-4db3-9099-3aa9f32ec5b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:26.548185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d32d84fe-0d05-4db3-9099-3aa9f32ec5b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:26.679022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d32d84fe-0d05-4db3-9099-3aa9f32ec5b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:26.691129 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d32d84fe-0d05-4db3-9099-3aa9f32ec5b8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.161252 Oct 05 18:33:26.691912 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3558/6870] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:26 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:27.721418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fc8df5e2-5342-4abb-87f0-468f5e3bc434 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:27.722491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fc8df5e2-5342-4abb-87f0-468f5e3bc434 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:27.734101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8df5e2-5342-4abb-87f0-468f5e3bc434 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:27.734967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8df5e2-5342-4abb-87f0-468f5e3bc434 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:27.735700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8df5e2-5342-4abb-87f0-468f5e3bc434 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:27.736849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8df5e2-5342-4abb-87f0-468f5e3bc434 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:27.737621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8df5e2-5342-4abb-87f0-468f5e3bc434 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:27.738357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fc8df5e2-5342-4abb-87f0-468f5e3bc434 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:27.879401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fc8df5e2-5342-4abb-87f0-468f5e3bc434 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:27.887444 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fc8df5e2-5342-4abb-87f0-468f5e3bc434 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.172694 Oct 05 18:33:27.888381 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3313/6871] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:27 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:28.911698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f00030a9-4529-4491-9adc-5ab06d682b47 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:28.912403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f00030a9-4529-4491-9adc-5ab06d682b47 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:28.920372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f00030a9-4529-4491-9adc-5ab06d682b47 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:28.920876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f00030a9-4529-4491-9adc-5ab06d682b47 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:28.921326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f00030a9-4529-4491-9adc-5ab06d682b47 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:28.922071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f00030a9-4529-4491-9adc-5ab06d682b47 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:28.922613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f00030a9-4529-4491-9adc-5ab06d682b47 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:28.923060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f00030a9-4529-4491-9adc-5ab06d682b47 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:29.063702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f00030a9-4529-4491-9adc-5ab06d682b47 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:29.075406 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f00030a9-4529-4491-9adc-5ab06d682b47 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.167429 Oct 05 18:33:29.076130 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3559/6872] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:28 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:30.103675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-efd06f75-d066-4998-b1a4-6301d884fdc7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:30.104716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-efd06f75-d066-4998-b1a4-6301d884fdc7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:30.112028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd06f75-d066-4998-b1a4-6301d884fdc7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:30.112515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd06f75-d066-4998-b1a4-6301d884fdc7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:30.112958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd06f75-d066-4998-b1a4-6301d884fdc7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:30.113662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd06f75-d066-4998-b1a4-6301d884fdc7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:30.114118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd06f75-d066-4998-b1a4-6301d884fdc7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:30.114950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-efd06f75-d066-4998-b1a4-6301d884fdc7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:30.248826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-efd06f75-d066-4998-b1a4-6301d884fdc7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:30.260948 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-efd06f75-d066-4998-b1a4-6301d884fdc7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.163951 Oct 05 18:33:30.261536 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3314/6873] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:30 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:31.285101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-791d0534-d52d-4f85-8889-9a798c7c8746 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:31.285711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-791d0534-d52d-4f85-8889-9a798c7c8746 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:31.293251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791d0534-d52d-4f85-8889-9a798c7c8746 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:31.293780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791d0534-d52d-4f85-8889-9a798c7c8746 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:31.294474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791d0534-d52d-4f85-8889-9a798c7c8746 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:31.295245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791d0534-d52d-4f85-8889-9a798c7c8746 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:31.295721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791d0534-d52d-4f85-8889-9a798c7c8746 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:31.296167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-791d0534-d52d-4f85-8889-9a798c7c8746 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:31.429831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-791d0534-d52d-4f85-8889-9a798c7c8746 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:31.438045 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-791d0534-d52d-4f85-8889-9a798c7c8746 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.157039 Oct 05 18:33:31.438882 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3560/6874] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:31 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:32.468652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-34159e34-8697-4a12-8607-bd45c9ae46aa tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:32.469581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-34159e34-8697-4a12-8607-bd45c9ae46aa tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:32.480859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34159e34-8697-4a12-8607-bd45c9ae46aa tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:32.481580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34159e34-8697-4a12-8607-bd45c9ae46aa tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:32.482023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34159e34-8697-4a12-8607-bd45c9ae46aa tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:32.482809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34159e34-8697-4a12-8607-bd45c9ae46aa tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:32.483300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34159e34-8697-4a12-8607-bd45c9ae46aa tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:32.483725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34159e34-8697-4a12-8607-bd45c9ae46aa tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:32.630945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-34159e34-8697-4a12-8607-bd45c9ae46aa tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:32.639510 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-34159e34-8697-4a12-8607-bd45c9ae46aa tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.180520 Oct 05 18:33:32.640088 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3315/6875] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:32 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:33.667674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7dffde07-cb5e-4373-9af0-6f13eca42c81 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:33.668689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7dffde07-cb5e-4373-9af0-6f13eca42c81 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:33.680405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7dffde07-cb5e-4373-9af0-6f13eca42c81 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:33.681242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7dffde07-cb5e-4373-9af0-6f13eca42c81 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:33.681989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7dffde07-cb5e-4373-9af0-6f13eca42c81 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:33.683199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7dffde07-cb5e-4373-9af0-6f13eca42c81 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:33.684013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7dffde07-cb5e-4373-9af0-6f13eca42c81 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:33.684661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7dffde07-cb5e-4373-9af0-6f13eca42c81 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:33.834963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7dffde07-cb5e-4373-9af0-6f13eca42c81 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:33.851991 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7dffde07-cb5e-4373-9af0-6f13eca42c81 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.190362 Oct 05 18:33:33.853188 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3561/6876] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:33 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:34.878767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-287ec6ac-40f2-4fe2-ad7e-43d6b52e8f67 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:34.879375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-287ec6ac-40f2-4fe2-ad7e-43d6b52e8f67 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:34.888542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-287ec6ac-40f2-4fe2-ad7e-43d6b52e8f67 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:34.889088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-287ec6ac-40f2-4fe2-ad7e-43d6b52e8f67 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:34.889564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-287ec6ac-40f2-4fe2-ad7e-43d6b52e8f67 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:34.890330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-287ec6ac-40f2-4fe2-ad7e-43d6b52e8f67 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:34.890830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-287ec6ac-40f2-4fe2-ad7e-43d6b52e8f67 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:34.891282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-287ec6ac-40f2-4fe2-ad7e-43d6b52e8f67 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:35.029249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-287ec6ac-40f2-4fe2-ad7e-43d6b52e8f67 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:35.037885 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-287ec6ac-40f2-4fe2-ad7e-43d6b52e8f67 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.164272 Oct 05 18:33:35.038512 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3316/6877] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:34 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:36.065928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1f6ed098-121a-4c41-8ed4-e39909c75278 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:36.067056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1f6ed098-121a-4c41-8ed4-e39909c75278 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:36.078541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6ed098-121a-4c41-8ed4-e39909c75278 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:36.079041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6ed098-121a-4c41-8ed4-e39909c75278 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:36.079472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6ed098-121a-4c41-8ed4-e39909c75278 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:36.080236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6ed098-121a-4c41-8ed4-e39909c75278 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:36.080752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6ed098-121a-4c41-8ed4-e39909c75278 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:36.081196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f6ed098-121a-4c41-8ed4-e39909c75278 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:36.219338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1f6ed098-121a-4c41-8ed4-e39909c75278 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:36.227531 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1f6ed098-121a-4c41-8ed4-e39909c75278 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.168819 Oct 05 18:33:36.228114 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3562/6878] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:36 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:37.251278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6173da0a-5fa1-494f-bec8-8a9e94a5aa7b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:37.251789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6173da0a-5fa1-494f-bec8-8a9e94a5aa7b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:37.259055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6173da0a-5fa1-494f-bec8-8a9e94a5aa7b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:37.259551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6173da0a-5fa1-494f-bec8-8a9e94a5aa7b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:37.260002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6173da0a-5fa1-494f-bec8-8a9e94a5aa7b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:37.260708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6173da0a-5fa1-494f-bec8-8a9e94a5aa7b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:37.261172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6173da0a-5fa1-494f-bec8-8a9e94a5aa7b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:37.261598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6173da0a-5fa1-494f-bec8-8a9e94a5aa7b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:37.400617 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6173da0a-5fa1-494f-bec8-8a9e94a5aa7b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:37.408694 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6173da0a-5fa1-494f-bec8-8a9e94a5aa7b tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.161653 Oct 05 18:33:37.409284 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3317/6879] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:37 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:38.436237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5510c48-7bae-41cc-b034-0c19fbf67ca2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:38.437296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d5510c48-7bae-41cc-b034-0c19fbf67ca2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:38.449693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5510c48-7bae-41cc-b034-0c19fbf67ca2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:38.450590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5510c48-7bae-41cc-b034-0c19fbf67ca2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:38.451346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5510c48-7bae-41cc-b034-0c19fbf67ca2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:38.452333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5510c48-7bae-41cc-b034-0c19fbf67ca2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:38.452809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5510c48-7bae-41cc-b034-0c19fbf67ca2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:38.453249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5510c48-7bae-41cc-b034-0c19fbf67ca2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:38.468833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:38.604094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d5510c48-7bae-41cc-b034-0c19fbf67ca2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:38.612568 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d5510c48-7bae-41cc-b034-0c19fbf67ca2 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.183037 Oct 05 18:33:38.613159 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3563/6880] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:38 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:39.641024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f0a38de4-6202-41fb-bef9-ec3f841f6656 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:39.642064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f0a38de4-6202-41fb-bef9-ec3f841f6656 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:39.653615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a38de4-6202-41fb-bef9-ec3f841f6656 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:39.654483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a38de4-6202-41fb-bef9-ec3f841f6656 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:39.655081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a38de4-6202-41fb-bef9-ec3f841f6656 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:39.655783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a38de4-6202-41fb-bef9-ec3f841f6656 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:39.656240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a38de4-6202-41fb-bef9-ec3f841f6656 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:39.656678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f0a38de4-6202-41fb-bef9-ec3f841f6656 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:39.796094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f0a38de4-6202-41fb-bef9-ec3f841f6656 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:39.804649 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f0a38de4-6202-41fb-bef9-ec3f841f6656 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.170739 Oct 05 18:33:39.805235 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3318/6881] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:39 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:40.839231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2567cfec-1132-40f2-ac47-4ab37be9a54d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:40.840201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2567cfec-1132-40f2-ac47-4ab37be9a54d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:40.844539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:40.854023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2567cfec-1132-40f2-ac47-4ab37be9a54d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:40.854907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2567cfec-1132-40f2-ac47-4ab37be9a54d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:40.855654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2567cfec-1132-40f2-ac47-4ab37be9a54d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:40.856803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2567cfec-1132-40f2-ac47-4ab37be9a54d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:40.857630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2567cfec-1132-40f2-ac47-4ab37be9a54d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:40.858238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2567cfec-1132-40f2-ac47-4ab37be9a54d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:40.997534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2567cfec-1132-40f2-ac47-4ab37be9a54d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:41.005965 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2567cfec-1132-40f2-ac47-4ab37be9a54d tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.173332 Oct 05 18:33:41.006555 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3564/6882] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:40 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:42.033557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b3d57598-2a19-4743-869c-301dbae10ef3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:42.034632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3d57598-2a19-4743-869c-301dbae10ef3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:42.046025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3d57598-2a19-4743-869c-301dbae10ef3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:42.046559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3d57598-2a19-4743-869c-301dbae10ef3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:42.046998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3d57598-2a19-4743-869c-301dbae10ef3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:42.047701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3d57598-2a19-4743-869c-301dbae10ef3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:42.048165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3d57598-2a19-4743-869c-301dbae10ef3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:42.048588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3d57598-2a19-4743-869c-301dbae10ef3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:42.200035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3d57598-2a19-4743-869c-301dbae10ef3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:42.208124 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b3d57598-2a19-4743-869c-301dbae10ef3 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.181251 Oct 05 18:33:42.208713 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3319/6883] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:42 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:43.235077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92c02e09-78a4-4ce7-b390-445b6bdb9ca0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:43.236152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92c02e09-78a4-4ce7-b390-445b6bdb9ca0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:43.247634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c02e09-78a4-4ce7-b390-445b6bdb9ca0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:43.248481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c02e09-78a4-4ce7-b390-445b6bdb9ca0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:43.249173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c02e09-78a4-4ce7-b390-445b6bdb9ca0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:43.249875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c02e09-78a4-4ce7-b390-445b6bdb9ca0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:43.250338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c02e09-78a4-4ce7-b390-445b6bdb9ca0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:43.250805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92c02e09-78a4-4ce7-b390-445b6bdb9ca0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:43.384644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92c02e09-78a4-4ce7-b390-445b6bdb9ca0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:43.393248 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92c02e09-78a4-4ce7-b390-445b6bdb9ca0 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.164831 Oct 05 18:33:43.393825 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3565/6884] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:43 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:44.417377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-34322608-7cc4-4a01-88fb-44d2bc8800c7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:44.418037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-34322608-7cc4-4a01-88fb-44d2bc8800c7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:44.422943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:44.430540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34322608-7cc4-4a01-88fb-44d2bc8800c7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:44.431036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34322608-7cc4-4a01-88fb-44d2bc8800c7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:44.431475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34322608-7cc4-4a01-88fb-44d2bc8800c7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:44.432180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34322608-7cc4-4a01-88fb-44d2bc8800c7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:44.432650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34322608-7cc4-4a01-88fb-44d2bc8800c7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:44.433830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34322608-7cc4-4a01-88fb-44d2bc8800c7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:44.578787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-34322608-7cc4-4a01-88fb-44d2bc8800c7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:44.587601 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-34322608-7cc4-4a01-88fb-44d2bc8800c7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.174487 Oct 05 18:33:44.588203 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3320/6885] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:44 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:45.615862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a1d6e4a-acbe-4fb4-9cad-c9695ecf42a7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:45.616888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2a1d6e4a-acbe-4fb4-9cad-c9695ecf42a7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:45.627298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a1d6e4a-acbe-4fb4-9cad-c9695ecf42a7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:45.627794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a1d6e4a-acbe-4fb4-9cad-c9695ecf42a7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:45.628241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a1d6e4a-acbe-4fb4-9cad-c9695ecf42a7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:45.628944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a1d6e4a-acbe-4fb4-9cad-c9695ecf42a7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:45.629405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a1d6e4a-acbe-4fb4-9cad-c9695ecf42a7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:45.629844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a1d6e4a-acbe-4fb4-9cad-c9695ecf42a7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:45.773534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2a1d6e4a-acbe-4fb4-9cad-c9695ecf42a7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:45.786040 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2a1d6e4a-acbe-4fb4-9cad-c9695ecf42a7 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.176585 Oct 05 18:33:45.786913 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3566/6886] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:45 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:46.817435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69d3c96c-d172-4036-b7aa-65d483505889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:46.819110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-69d3c96c-d172-4036-b7aa-65d483505889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:46.830780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69d3c96c-d172-4036-b7aa-65d483505889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:46.831243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69d3c96c-d172-4036-b7aa-65d483505889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:46.831678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69d3c96c-d172-4036-b7aa-65d483505889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:46.832379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69d3c96c-d172-4036-b7aa-65d483505889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:46.832835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69d3c96c-d172-4036-b7aa-65d483505889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:46.833268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69d3c96c-d172-4036-b7aa-65d483505889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:46.970082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-69d3c96c-d172-4036-b7aa-65d483505889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:46.978124 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69d3c96c-d172-4036-b7aa-65d483505889 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.167423 Oct 05 18:33:46.978709 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3321/6887] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:46 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:48.005450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2a994df-3e18-44d7-ba73-f14932a67cde tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:48.006457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b2a994df-3e18-44d7-ba73-f14932a67cde tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:48.010517 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:33:48.010837 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:33:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 (ip 10.222.0.70) !!! Oct 05 18:33:48.021073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a994df-3e18-44d7-ba73-f14932a67cde tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:48.021578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a994df-3e18-44d7-ba73-f14932a67cde tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:48.022034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a994df-3e18-44d7-ba73-f14932a67cde tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:48.022784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a994df-3e18-44d7-ba73-f14932a67cde tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:48.023256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a994df-3e18-44d7-ba73-f14932a67cde tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:48.023715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a994df-3e18-44d7-ba73-f14932a67cde tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:48.182747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b2a994df-3e18-44d7-ba73-f14932a67cde tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:48.193466 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2a994df-3e18-44d7-ba73-f14932a67cde tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.194531 Oct 05 18:33:48.194604 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3567/6888] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:47 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:49.221546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd74ff4c-2ec3-48e4-a900-f79c131632ea tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:49.222127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd74ff4c-2ec3-48e4-a900-f79c131632ea tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:49.229675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd74ff4c-2ec3-48e4-a900-f79c131632ea tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:49.230162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd74ff4c-2ec3-48e4-a900-f79c131632ea tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:49.230622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd74ff4c-2ec3-48e4-a900-f79c131632ea tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:49.231311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd74ff4c-2ec3-48e4-a900-f79c131632ea tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:49.231761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd74ff4c-2ec3-48e4-a900-f79c131632ea tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:49.232181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd74ff4c-2ec3-48e4-a900-f79c131632ea tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:49.378946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fd74ff4c-2ec3-48e4-a900-f79c131632ea tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:49.391260 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fd74ff4c-2ec3-48e4-a900-f79c131632ea tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.174269 Oct 05 18:33:49.392075 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3322/6889] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:49 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:50.420241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a9283a1c-0cbf-4b7c-a194-ae523b873e9c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:50.420883 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a9283a1c-0cbf-4b7c-a194-ae523b873e9c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:50.428247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9283a1c-0cbf-4b7c-a194-ae523b873e9c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:50.428756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9283a1c-0cbf-4b7c-a194-ae523b873e9c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:50.429224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9283a1c-0cbf-4b7c-a194-ae523b873e9c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:50.430016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9283a1c-0cbf-4b7c-a194-ae523b873e9c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:50.430426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9283a1c-0cbf-4b7c-a194-ae523b873e9c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:50.430848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a9283a1c-0cbf-4b7c-a194-ae523b873e9c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:50.566566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a9283a1c-0cbf-4b7c-a194-ae523b873e9c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:50.572841 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a9283a1c-0cbf-4b7c-a194-ae523b873e9c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.156744 Oct 05 18:33:50.577259 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3568/6890] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:50 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:51.597005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6daecda6-87e9-4452-bc5e-0fc9c8df2762 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:51.598074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6daecda6-87e9-4452-bc5e-0fc9c8df2762 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:51.606066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6daecda6-87e9-4452-bc5e-0fc9c8df2762 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:51.606597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6daecda6-87e9-4452-bc5e-0fc9c8df2762 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:51.607038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6daecda6-87e9-4452-bc5e-0fc9c8df2762 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:51.607918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6daecda6-87e9-4452-bc5e-0fc9c8df2762 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:51.608373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6daecda6-87e9-4452-bc5e-0fc9c8df2762 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:51.608821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6daecda6-87e9-4452-bc5e-0fc9c8df2762 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:51.749574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6daecda6-87e9-4452-bc5e-0fc9c8df2762 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:51.757814 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6daecda6-87e9-4452-bc5e-0fc9c8df2762 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1521 microversion: 2.1 time: 0.165536 Oct 05 18:33:51.758438 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3323/6891] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:51 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:52.201965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-295f0d96-00e8-41d8-8d0c-e19fb2b6e182 req-f917fc60-57fc-44f5-82c2-1548cf8df56b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509a6281-aef0-4d5c-8a0e-49ab836aeeb6", "name": "network-vif-unplugged", "status": "completed", "tag": "46307b6d-d0ef-49db-bd78-7f49767a0528"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:52.213168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-295f0d96-00e8-41d8-8d0c-e19fb2b6e182 req-f917fc60-57fc-44f5-82c2-1548cf8df56b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:52.213703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-295f0d96-00e8-41d8-8d0c-e19fb2b6e182 req-f917fc60-57fc-44f5-82c2-1548cf8df56b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:52.214312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-295f0d96-00e8-41d8-8d0c-e19fb2b6e182 req-f917fc60-57fc-44f5-82c2-1548cf8df56b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:52.227803 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-295f0d96-00e8-41d8-8d0c-e19fb2b6e182 req-f917fc60-57fc-44f5-82c2-1548cf8df56b service nova] Creating event network-vif-unplugged:46307b6d-d0ef-49db-bd78-7f49767a0528 for instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 on n-h1-835595-3 Oct 05 18:33:52.233556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-295f0d96-00e8-41d8-8d0c-e19fb2b6e182 req-f917fc60-57fc-44f5-82c2-1548cf8df56b service nova] Instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:33:52.245122 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-295f0d96-00e8-41d8-8d0c-e19fb2b6e182 req-f917fc60-57fc-44f5-82c2-1548cf8df56b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047622 Oct 05 18:33:52.245716 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3569/6892] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:33:52.781234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64a47bba-4d13-443f-bb97-193180cfdb41 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:52.781842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-64a47bba-4d13-443f-bb97-193180cfdb41 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:52.789217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64a47bba-4d13-443f-bb97-193180cfdb41 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:52.789702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64a47bba-4d13-443f-bb97-193180cfdb41 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:52.790139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64a47bba-4d13-443f-bb97-193180cfdb41 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:52.790878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64a47bba-4d13-443f-bb97-193180cfdb41 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:52.791335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64a47bba-4d13-443f-bb97-193180cfdb41 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:52.791762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64a47bba-4d13-443f-bb97-193180cfdb41 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:53.030055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-64a47bba-4d13-443f-bb97-193180cfdb41 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:53.039067 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-64a47bba-4d13-443f-bb97-193180cfdb41 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1520 microversion: 2.1 time: 0.261532 Oct 05 18:33:53.039698 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3324/6893] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:52 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:54.067302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f609122-9fa9-4975-98cd-014643b2a240 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:54.068027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8f609122-9fa9-4975-98cd-014643b2a240 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:54.077561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f609122-9fa9-4975-98cd-014643b2a240 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:54.078247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f609122-9fa9-4975-98cd-014643b2a240 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:54.078800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f609122-9fa9-4975-98cd-014643b2a240 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:54.079496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f609122-9fa9-4975-98cd-014643b2a240 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:54.079980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f609122-9fa9-4975-98cd-014643b2a240 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:54.080413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f609122-9fa9-4975-98cd-014643b2a240 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:54.245017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8f609122-9fa9-4975-98cd-014643b2a240 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:54.253659 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f609122-9fa9-4975-98cd-014643b2a240 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1518 microversion: 2.1 time: 0.193979 Oct 05 18:33:54.254259 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3570/6894] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:54 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:54.267001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7dc46286-1789-486a-a574-9d784cbb474b req-92273756-8b2e-467a-9b44-16049cad9e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "509a6281-aef0-4d5c-8a0e-49ab836aeeb6", "tag": "46307b6d-d0ef-49db-bd78-7f49767a0528"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:54.277435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7dc46286-1789-486a-a574-9d784cbb474b req-92273756-8b2e-467a-9b44-16049cad9e5b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:54.277922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7dc46286-1789-486a-a574-9d784cbb474b req-92273756-8b2e-467a-9b44-16049cad9e5b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:54.278365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7dc46286-1789-486a-a574-9d784cbb474b req-92273756-8b2e-467a-9b44-16049cad9e5b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:54.290562 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7dc46286-1789-486a-a574-9d784cbb474b req-92273756-8b2e-467a-9b44-16049cad9e5b service nova] Creating event network-changed:46307b6d-d0ef-49db-bd78-7f49767a0528 for instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 on n-h1-835595-3 Oct 05 18:33:54.297633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-7dc46286-1789-486a-a574-9d784cbb474b req-92273756-8b2e-467a-9b44-16049cad9e5b service nova] Instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:33:54.308924 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7dc46286-1789-486a-a574-9d784cbb474b req-92273756-8b2e-467a-9b44-16049cad9e5b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046377 Oct 05 18:33:54.309539 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3325/6895] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:33:55.277653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e3adf482-8d51-4053-82c2-cd4c8708fdb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:55.278419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e3adf482-8d51-4053-82c2-cd4c8708fdb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:55.286353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3adf482-8d51-4053-82c2-cd4c8708fdb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:55.286890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3adf482-8d51-4053-82c2-cd4c8708fdb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:55.287373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3adf482-8d51-4053-82c2-cd4c8708fdb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:55.288162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3adf482-8d51-4053-82c2-cd4c8708fdb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:55.288640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3adf482-8d51-4053-82c2-cd4c8708fdb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:55.289086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3adf482-8d51-4053-82c2-cd4c8708fdb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:55.422475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e3adf482-8d51-4053-82c2-cd4c8708fdb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:55.431347 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e3adf482-8d51-4053-82c2-cd4c8708fdb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1515 microversion: 2.1 time: 0.157795 Oct 05 18:33:55.431855 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3571/6896] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:55 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:55.456347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-133cd6e2-ac67-4282-aaa6-4db67030756c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:55.457299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-133cd6e2-ac67-4282-aaa6-4db67030756c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:55.464614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-133cd6e2-ac67-4282-aaa6-4db67030756c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:55.465128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-133cd6e2-ac67-4282-aaa6-4db67030756c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:55.465569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-133cd6e2-ac67-4282-aaa6-4db67030756c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:55.466267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-133cd6e2-ac67-4282-aaa6-4db67030756c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:55.466929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-133cd6e2-ac67-4282-aaa6-4db67030756c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:55.467614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-133cd6e2-ac67-4282-aaa6-4db67030756c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:55.472446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=82 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:33:55.534019 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-133cd6e2-ac67-4282-aaa6-4db67030756c tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "POST /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6/action" status: 204 len: 0 microversion: 2.1 time: 0.083594 Oct 05 18:33:55.534720 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3326/6897] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:33:55 2022] POST /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:33:55.545188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e9f6e3f-53b2-42c3-9aee-300f237ffb7f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:55.545823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e9f6e3f-53b2-42c3-9aee-300f237ffb7f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:55.552827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9f6e3f-53b2-42c3-9aee-300f237ffb7f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:55.553400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9f6e3f-53b2-42c3-9aee-300f237ffb7f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:55.553889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9f6e3f-53b2-42c3-9aee-300f237ffb7f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:55.554666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9f6e3f-53b2-42c3-9aee-300f237ffb7f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:55.555140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9f6e3f-53b2-42c3-9aee-300f237ffb7f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:55.556354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9f6e3f-53b2-42c3-9aee-300f237ffb7f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:55.694893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4e9f6e3f-53b2-42c3-9aee-300f237ffb7f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:55.703497 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e9f6e3f-53b2-42c3-9aee-300f237ffb7f tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1515 microversion: 2.1 time: 0.162475 Oct 05 18:33:55.704318 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3572/6898] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:55 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:56.727750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa97eba2-6166-4d44-b0e3-6b76e51b42cb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:56.728455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fa97eba2-6166-4d44-b0e3-6b76e51b42cb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:56.734949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa97eba2-6166-4d44-b0e3-6b76e51b42cb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:56.735438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa97eba2-6166-4d44-b0e3-6b76e51b42cb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:56.735875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa97eba2-6166-4d44-b0e3-6b76e51b42cb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:56.736571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa97eba2-6166-4d44-b0e3-6b76e51b42cb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:56.737020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa97eba2-6166-4d44-b0e3-6b76e51b42cb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:56.737444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fa97eba2-6166-4d44-b0e3-6b76e51b42cb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:56.878117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fa97eba2-6166-4d44-b0e3-6b76e51b42cb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:56.886730 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa97eba2-6166-4d44-b0e3-6b76e51b42cb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1507 microversion: 2.1 time: 0.164171 Oct 05 18:33:56.887329 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3327/6899] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:56 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:56.910434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76caefe2-5a5a-4353-b419-0096674aaeeb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:56.910814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-76caefe2-5a5a-4353-b419-0096674aaeeb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:56.917032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76caefe2-5a5a-4353-b419-0096674aaeeb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:56.917539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76caefe2-5a5a-4353-b419-0096674aaeeb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:56.917975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76caefe2-5a5a-4353-b419-0096674aaeeb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:56.918719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76caefe2-5a5a-4353-b419-0096674aaeeb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:56.919193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76caefe2-5a5a-4353-b419-0096674aaeeb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:56.919631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76caefe2-5a5a-4353-b419-0096674aaeeb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:57.051802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76caefe2-5a5a-4353-b419-0096674aaeeb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:57.063826 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76caefe2-5a5a-4353-b419-0096674aaeeb tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1507 microversion: 2.1 time: 0.157745 Oct 05 18:33:57.064600 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3573/6900] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:56 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:57.090237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-95a036e6-6792-4565-94db-dd0204698e84 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:57.090911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-95a036e6-6792-4565-94db-dd0204698e84 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:57.097455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a036e6-6792-4565-94db-dd0204698e84 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:57.097955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a036e6-6792-4565-94db-dd0204698e84 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:57.098434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a036e6-6792-4565-94db-dd0204698e84 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:57.099137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a036e6-6792-4565-94db-dd0204698e84 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:57.099599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a036e6-6792-4565-94db-dd0204698e84 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:57.100031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95a036e6-6792-4565-94db-dd0204698e84 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:57.237275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-95a036e6-6792-4565-94db-dd0204698e84 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:57.249359 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-95a036e6-6792-4565-94db-dd0204698e84 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1507 microversion: 2.1 time: 0.162689 Oct 05 18:33:57.250124 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3328/6901] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:57 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:57.277665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7b25bed8-9823-4623-838a-a23496d930d4 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:57.278209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7b25bed8-9823-4623-838a-a23496d930d4 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:57.284426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b25bed8-9823-4623-838a-a23496d930d4 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:57.284918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b25bed8-9823-4623-838a-a23496d930d4 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:57.285366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b25bed8-9823-4623-838a-a23496d930d4 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:57.286065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b25bed8-9823-4623-838a-a23496d930d4 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:57.286567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b25bed8-9823-4623-838a-a23496d930d4 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:57.286997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7b25bed8-9823-4623-838a-a23496d930d4 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:57.312247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7b25bed8-9823-4623-838a-a23496d930d4 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:33:57.392348 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7b25bed8-9823-4623-838a-a23496d930d4 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 204 len: 0 microversion: 2.1 time: 0.118405 Oct 05 18:33:57.393137 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3574/6902] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:33:57 2022] DELETE /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:33:57.409217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:57.409744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:57.417612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:57.418090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:57.418558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:57.419253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:57.419711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:57.420140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:57.445897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:33:57.492830 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.compute.api [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Instance is already in deleting state, ignoring this request Oct 05 18:33:57.494070 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1cdbe4d1-9938-43f5-997a-9aef833d8955 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 204 len: 0 microversion: 2.1 time: 0.088637 Oct 05 18:33:57.494968 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3329/6903] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:33:57 2022] DELETE /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:33:57.505687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-196a9471-a350-4305-ab99-1ac18969a4f5 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:57.506344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-196a9471-a350-4305-ab99-1ac18969a4f5 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:57.512779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-196a9471-a350-4305-ab99-1ac18969a4f5 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:57.513631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-196a9471-a350-4305-ab99-1ac18969a4f5 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:57.514088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-196a9471-a350-4305-ab99-1ac18969a4f5 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:57.514845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-196a9471-a350-4305-ab99-1ac18969a4f5 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:57.515320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-196a9471-a350-4305-ab99-1ac18969a4f5 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:57.515761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-196a9471-a350-4305-ab99-1ac18969a4f5 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:57.652647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-196a9471-a350-4305-ab99-1ac18969a4f5 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:57.660637 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-196a9471-a350-4305-ab99-1ac18969a4f5 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1513 microversion: 2.1 time: 0.159389 Oct 05 18:33:57.661227 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3575/6904] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:57 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:58.017498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-25b6cc25-6c1e-4c05-a7e9-86aef8108c9c req-31a38092-064a-4824-a5ea-2fc3eb1cd8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509a6281-aef0-4d5c-8a0e-49ab836aeeb6", "name": "network-vif-plugged", "status": "completed", "tag": "46307b6d-d0ef-49db-bd78-7f49767a0528"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:58.027748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-25b6cc25-6c1e-4c05-a7e9-86aef8108c9c req-31a38092-064a-4824-a5ea-2fc3eb1cd8c2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:58.028427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-25b6cc25-6c1e-4c05-a7e9-86aef8108c9c req-31a38092-064a-4824-a5ea-2fc3eb1cd8c2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:58.028853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-25b6cc25-6c1e-4c05-a7e9-86aef8108c9c req-31a38092-064a-4824-a5ea-2fc3eb1cd8c2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:58.043051 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-25b6cc25-6c1e-4c05-a7e9-86aef8108c9c req-31a38092-064a-4824-a5ea-2fc3eb1cd8c2 service nova] Creating event network-vif-plugged:46307b6d-d0ef-49db-bd78-7f49767a0528 for instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 on n-h1-835595-3 Oct 05 18:33:58.048184 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-25b6cc25-6c1e-4c05-a7e9-86aef8108c9c req-31a38092-064a-4824-a5ea-2fc3eb1cd8c2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034870 Oct 05 18:33:58.048766 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3330/6905] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:33:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:33:58.688237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f3a46f16-93c4-4fbe-94d1-3a8720137ff6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:58.688237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f3a46f16-93c4-4fbe-94d1-3a8720137ff6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:58.696805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a46f16-93c4-4fbe-94d1-3a8720137ff6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:58.697537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a46f16-93c4-4fbe-94d1-3a8720137ff6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:58.698063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a46f16-93c4-4fbe-94d1-3a8720137ff6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:58.698897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a46f16-93c4-4fbe-94d1-3a8720137ff6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:58.699439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a46f16-93c4-4fbe-94d1-3a8720137ff6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:58.699874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f3a46f16-93c4-4fbe-94d1-3a8720137ff6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:58.841776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f3a46f16-93c4-4fbe-94d1-3a8720137ff6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0bd522579774bc8b7fad12638223a18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '311f087409944324bf0d57064e44739c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:33:58.849821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f3a46f16-93c4-4fbe-94d1-3a8720137ff6 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 200 len: 1513 microversion: 2.1 time: 0.168579 Oct 05 18:33:58.850440 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3576/6906] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:58 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:33:59.175242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c1adabfa-86cc-4d59-99a4-36c5ab61cc2c req-7e06192a-19d2-44fb-8bfd-52f7f38d1103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "509a6281-aef0-4d5c-8a0e-49ab836aeeb6", "name": "network-vif-deleted", "tag": "46307b6d-d0ef-49db-bd78-7f49767a0528"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:33:59.185698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c1adabfa-86cc-4d59-99a4-36c5ab61cc2c req-7e06192a-19d2-44fb-8bfd-52f7f38d1103 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:59.186385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c1adabfa-86cc-4d59-99a4-36c5ab61cc2c req-7e06192a-19d2-44fb-8bfd-52f7f38d1103 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:59.186656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c1adabfa-86cc-4d59-99a4-36c5ab61cc2c req-7e06192a-19d2-44fb-8bfd-52f7f38d1103 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:59.217227 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c1adabfa-86cc-4d59-99a4-36c5ab61cc2c req-7e06192a-19d2-44fb-8bfd-52f7f38d1103 service nova] Creating event network-vif-deleted:46307b6d-d0ef-49db-bd78-7f49767a0528 for instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 on n-h1-835595-3 Oct 05 18:33:59.223247 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c1adabfa-86cc-4d59-99a4-36c5ab61cc2c req-7e06192a-19d2-44fb-8bfd-52f7f38d1103 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052858 Oct 05 18:33:59.223961 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3331/6907] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:33:59.877172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:59.878209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: 509a6281-aef0-4d5c-8a0e-49ab836aeeb6] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:33:59.890195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:59.891252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:59.891718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:59.892449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:33:59.892921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:33:59.893366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:33:59.907364 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] HTTP exception thrown: Instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 could not be found. Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Request method failure captured: Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 HTTP/1.1 Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc25eVZ_0fVgqYMJFvKgkG9XMo_Gzk0lu5J_ytF-8IeLSS0nIIJwgVEUl3ZbVB0rfryARIAOUxEIZ3E8d3jPetyttHxH2lze55uLHBKLLxdywqAzTHgLzicdte24ATOW_XMBco7AsFxqpAnhzN8Qb34puc19-gjPcEAOsQ0tSrJ28Wc Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 311f087409944324bf0d57064e44739c Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerDiskConfigTestJSON-478161186 Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/311f087409944324bf0d57064e44739c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/311f087409944324bf0d57064e44739c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_311f087409944324bf0d57064e44739c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/311f087409944324bf0d57064e44739c"}]}] Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerDiskConfigTestJSON-478161186 Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 311f087409944324bf0d57064e44739c Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-478161186 Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerDiskConfigTestJSON-478161186-project Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: e0bd522579774bc8b7fad12638223a18 Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerDiskConfigTestJSON-478161186-project Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 could not be found. Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '509a6281-aef0-4d5c-8a0e-49ab836aeeb6'} Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 could not be found. Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 could not be found. Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:33:59.909591 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:33:59.914310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:33:59.914310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:33:59.914310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:33:59.914310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:33:59.914310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:33:59.914310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 could not be found. Oct 05 18:33:59.914310 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:33:59.914310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Returning 404 to user: Instance 509a6281-aef0-4d5c-8a0e-49ab836aeeb6 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:33:59.914310 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2eace09c-1c64-4490-9cf9-663463837dec tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6" status: 404 len: 111 microversion: 2.1 time: 0.040163 Oct 05 18:33:59.914310 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3577/6908] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:33:59 2022] GET /compute/v2.1/servers/509a6281-aef0-4d5c-8a0e-49ab836aeeb6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:33:59.920801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51c4f799-3aec-4aca-acb2-a2e2e2a3e199 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '.version_select at 0x7f777966bc10>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:33:59.945326 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51c4f799-3aec-4aca-acb2-a2e2e2a3e199 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299698844" status: 202 len: 0 microversion: 2.1 time: 0.028723 Oct 05 18:33:59.945898 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3332/6909] 10.222.0.70 () {58 vars in 1221 bytes} [Wed Oct 5 18:33:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1299698844 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:34:00.589186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:00.589713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:00.596279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:00.596785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:00.597240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:00.597959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:00.598466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:00.598917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:00.612814 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] HTTP exception thrown: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Request method failure captured: Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 HTTP/1.1 Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc25eVZ_0fVgqYMJFvKgkG9XMo_Gzk0lu5J_ytF-8IeLSS0nIIJwgVEUl3ZbVB0rfryARIAOUxEIZ3E8d3jPetyttHxH2lze55uLHBKLLxdywqAzTHgLzicdte24ATOW_XMBco7AsFxqpAnhzN8Qb34puc19-gjPcEAOsQ0tSrJ28Wc Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 311f087409944324bf0d57064e44739c Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerDiskConfigTestJSON-478161186 Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/311f087409944324bf0d57064e44739c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/311f087409944324bf0d57064e44739c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_311f087409944324bf0d57064e44739c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/311f087409944324bf0d57064e44739c"}]}] Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerDiskConfigTestJSON-478161186 Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 311f087409944324bf0d57064e44739c Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-478161186 Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerDiskConfigTestJSON-478161186-project Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: e0bd522579774bc8b7fad12638223a18 Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerDiskConfigTestJSON-478161186-project Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'f8850676-5444-49a8-a717-59204fe4cdf1'} Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:34:00.614408 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Returning 404 to user: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b11ebdcc-6463-4677-bbaf-8c4e14252ea8 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "DELETE /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 404 len: 111 microversion: 2.1 time: 0.030785 Oct 05 18:34:00.618531 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3578/6910] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:34:00 2022] DELETE /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:34:00.625251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:00.626020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] [instance: f8850676-5444-49a8-a717-59204fe4cdf1] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:00.632916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:00.633405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:00.633844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:00.634574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:00.635029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:00.635447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:00.649499 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] HTTP exception thrown: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Request method failure captured: Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 HTTP/1.1 Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc25eVZ_0fVgqYMJFvKgkG9XMo_Gzk0lu5J_ytF-8IeLSS0nIIJwgVEUl3ZbVB0rfryARIAOUxEIZ3E8d3jPetyttHxH2lze55uLHBKLLxdywqAzTHgLzicdte24ATOW_XMBco7AsFxqpAnhzN8Qb34puc19-gjPcEAOsQ0tSrJ28Wc Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 311f087409944324bf0d57064e44739c Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerDiskConfigTestJSON-478161186 Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/311f087409944324bf0d57064e44739c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/311f087409944324bf0d57064e44739c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_311f087409944324bf0d57064e44739c", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/311f087409944324bf0d57064e44739c"}]}] Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerDiskConfigTestJSON-478161186 Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 311f087409944324bf0d57064e44739c Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-478161186 Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerDiskConfigTestJSON-478161186-project Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: e0bd522579774bc8b7fad12638223a18 Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerDiskConfigTestJSON-478161186-project Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'f8850676-5444-49a8-a717-59204fe4cdf1'} Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:34:00.651220 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:34:00.655686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:34:00.655686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:34:00.655686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:34:00.655686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:34:00.655686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:34:00.655686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. Oct 05 18:34:00.655686 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:34:00.655686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] Returning 404 to user: Instance f8850676-5444-49a8-a717-59204fe4cdf1 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:34:00.655686 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e4103b67-6af6-495a-a686-12de36335eb1 tempest-ServerDiskConfigTestJSON-478161186 tempest-ServerDiskConfigTestJSON-478161186-project] 10.222.0.70 "GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1" status: 404 len: 111 microversion: 2.1 time: 0.032248 Oct 05 18:34:00.655686 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3333/6911] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:00 2022] GET /compute/v2.1/servers/f8850676-5444-49a8-a717-59204fe4cdf1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:34:09.231129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fc318c11-283a-47e8-b1fc-57500443235b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'create', calling method: .version_select at 0x7f77746cf280>, body: {"keypair": {"name": "tempest-keypair-307237400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPEE/14SGSMxmMbKOnMy3kg99CFKRKMces2bNLDg2ydj1zjPlgBA02XXThT4jDOL0lYomyDwEX/xTypRaN+Pj07DpVI4kjWF/1VeUJKV+7qiY6IPyCg8uyAk39c15MSFg=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:34:09.248997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-fc318c11-283a-47e8-b1fc-57500443235b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:34:09.255185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-fc318c11-283a-47e8-b1fc-57500443235b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for user 654ce2fda5024f6783ef6e2faf2f6617 and project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:34:09.290005 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fc318c11-283a-47e8-b1fc-57500443235b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181754 Oct 05 18:34:09.291147 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3579/6912] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:34:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:34:10.576604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2123087474", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d10090ce-6507-4a6c-8839-056a2634ec6b"}], "security_groups": [{"name": "tempest-securitygroup--981366362"}], "key_name": "tempest-keypair-307237400", "user_data": "}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:34:10.640163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:10.682684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] validate_networks() for [('d10090ce-6507-4a6c-8839-056a2634ec6b', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:34:11.413883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:34:11.414680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:34:11.415287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:34:11.415777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:34:11.416197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:34:11.425490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:11.425982 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:11.426456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:11.427189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:11.427641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:11.428066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:11.445112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:34:11.449957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for user 654ce2fda5024f6783ef6e2faf2f6617 and project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:34:11.463337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:34:11.465468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:34:11.515292 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1b4d42d9-ad74-43de-9445-a8d4b049571d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.942974 Oct 05 18:34:11.515980 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3334/6913] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:34:10 2022] POST /compute/v2.1/servers => generated 408 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:34:11.526055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:11.531274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-65e41d93-87eb-4de7-934a-d2d4cef2cb57 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:11.531912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-65e41d93-87eb-4de7-934a-d2d4cef2cb57 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:11.536294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:11.611351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-65e41d93-87eb-4de7-934a-d2d4cef2cb57 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:11.620136 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-65e41d93-87eb-4de7-934a-d2d4cef2cb57 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1238 microversion: 2.1 time: 0.095634 Oct 05 18:34:11.621025 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3580/6914] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:11 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:12.645474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-73a54f12-b389-445d-94e7-e88356d7b1da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:12.646090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-73a54f12-b389-445d-94e7-e88356d7b1da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:12.652533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a54f12-b389-445d-94e7-e88356d7b1da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:12.658223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a54f12-b389-445d-94e7-e88356d7b1da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:12.658994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a54f12-b389-445d-94e7-e88356d7b1da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:12.659781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a54f12-b389-445d-94e7-e88356d7b1da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:12.660463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a54f12-b389-445d-94e7-e88356d7b1da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:12.660969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-73a54f12-b389-445d-94e7-e88356d7b1da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:12.736374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-73a54f12-b389-445d-94e7-e88356d7b1da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:12.744467 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-73a54f12-b389-445d-94e7-e88356d7b1da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1308 microversion: 2.1 time: 0.103829 Oct 05 18:34:12.745050 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3335/6915] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:12 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:13.768082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-98fd922c-e0a9-464c-ba09-99c4e343157d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:13.768829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-98fd922c-e0a9-464c-ba09-99c4e343157d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:13.776880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98fd922c-e0a9-464c-ba09-99c4e343157d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:13.777494 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98fd922c-e0a9-464c-ba09-99c4e343157d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:13.778021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98fd922c-e0a9-464c-ba09-99c4e343157d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:13.779153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98fd922c-e0a9-464c-ba09-99c4e343157d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:13.779706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98fd922c-e0a9-464c-ba09-99c4e343157d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:13.780222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-98fd922c-e0a9-464c-ba09-99c4e343157d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:13.917245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-98fd922c-e0a9-464c-ba09-99c4e343157d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:13.925870 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-98fd922c-e0a9-464c-ba09-99c4e343157d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1363 microversion: 2.1 time: 0.161873 Oct 05 18:34:13.926657 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3581/6916] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:13 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:14.097636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-187b7e51-7121-4c4d-9ad4-758bc6600baa req-a5e927c8-c189-4b0a-ad82-a30d7bc6cc72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece1c79d-3bf5-499a-befa-00e691e79a10", "tag": "3d30e414-a0d6-4099-ad2b-c5d739d3e7a9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:34:14.109168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-187b7e51-7121-4c4d-9ad4-758bc6600baa req-a5e927c8-c189-4b0a-ad82-a30d7bc6cc72 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:14.109679 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-187b7e51-7121-4c4d-9ad4-758bc6600baa req-a5e927c8-c189-4b0a-ad82-a30d7bc6cc72 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:14.110108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-187b7e51-7121-4c4d-9ad4-758bc6600baa req-a5e927c8-c189-4b0a-ad82-a30d7bc6cc72 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:14.140816 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-187b7e51-7121-4c4d-9ad4-758bc6600baa req-a5e927c8-c189-4b0a-ad82-a30d7bc6cc72 service nova] Creating event network-changed:3d30e414-a0d6-4099-ad2b-c5d739d3e7a9 for instance ece1c79d-3bf5-499a-befa-00e691e79a10 on n-h1-835595-3 Oct 05 18:34:14.146273 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-187b7e51-7121-4c4d-9ad4-758bc6600baa req-a5e927c8-c189-4b0a-ad82-a30d7bc6cc72 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052594 Oct 05 18:34:14.147372 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3336/6917] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:34:14.949328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2a51b2ad-6b04-4863-9308-f11b4bea4d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:14.949933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2a51b2ad-6b04-4863-9308-f11b4bea4d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:14.957606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a51b2ad-6b04-4863-9308-f11b4bea4d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:14.958106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a51b2ad-6b04-4863-9308-f11b4bea4d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:14.958618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a51b2ad-6b04-4863-9308-f11b4bea4d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:14.959329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a51b2ad-6b04-4863-9308-f11b4bea4d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:14.959800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a51b2ad-6b04-4863-9308-f11b4bea4d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:14.960237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2a51b2ad-6b04-4863-9308-f11b4bea4d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:15.102408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2a51b2ad-6b04-4863-9308-f11b4bea4d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:15.111011 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2a51b2ad-6b04-4863-9308-f11b4bea4d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1363 microversion: 2.1 time: 0.165685 Oct 05 18:34:15.111584 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3582/6918] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:14 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:16.135752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f5f34e68-30cf-4de7-96ef-efb2cf43948f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:16.136481 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f5f34e68-30cf-4de7-96ef-efb2cf43948f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:16.139048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:16.144581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5f34e68-30cf-4de7-96ef-efb2cf43948f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:16.145077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5f34e68-30cf-4de7-96ef-efb2cf43948f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:16.145513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5f34e68-30cf-4de7-96ef-efb2cf43948f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:16.146518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5f34e68-30cf-4de7-96ef-efb2cf43948f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:16.146974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5f34e68-30cf-4de7-96ef-efb2cf43948f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:16.147399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5f34e68-30cf-4de7-96ef-efb2cf43948f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:16.289222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f5f34e68-30cf-4de7-96ef-efb2cf43948f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:16.297659 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f5f34e68-30cf-4de7-96ef-efb2cf43948f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1363 microversion: 2.1 time: 0.168092 Oct 05 18:34:16.298215 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3337/6919] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:16 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:17.325060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-06157a0f-1e38-4a45-99e1-f62a02e8a8c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:17.326155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-06157a0f-1e38-4a45-99e1-f62a02e8a8c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:17.335144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06157a0f-1e38-4a45-99e1-f62a02e8a8c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:17.335697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06157a0f-1e38-4a45-99e1-f62a02e8a8c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:17.336286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06157a0f-1e38-4a45-99e1-f62a02e8a8c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:17.337100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06157a0f-1e38-4a45-99e1-f62a02e8a8c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:17.337572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06157a0f-1e38-4a45-99e1-f62a02e8a8c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:17.338015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-06157a0f-1e38-4a45-99e1-f62a02e8a8c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:17.469803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-06157a0f-1e38-4a45-99e1-f62a02e8a8c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:17.481452 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-06157a0f-1e38-4a45-99e1-f62a02e8a8c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1363 microversion: 2.1 time: 0.163054 Oct 05 18:34:17.482194 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3583/6920] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:17 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:18.129532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-54d3c0ab-b84c-432f-9c48-551c9f69f015 req-a9f0f540-9c16-489a-b586-c0e3963b145f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1c79d-3bf5-499a-befa-00e691e79a10", "name": "network-vif-plugged", "status": "completed", "tag": "3d30e414-a0d6-4099-ad2b-c5d739d3e7a9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:34:18.141205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-54d3c0ab-b84c-432f-9c48-551c9f69f015 req-a9f0f540-9c16-489a-b586-c0e3963b145f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:18.141668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-54d3c0ab-b84c-432f-9c48-551c9f69f015 req-a9f0f540-9c16-489a-b586-c0e3963b145f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:18.142092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-54d3c0ab-b84c-432f-9c48-551c9f69f015 req-a9f0f540-9c16-489a-b586-c0e3963b145f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:18.153550 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-54d3c0ab-b84c-432f-9c48-551c9f69f015 req-a9f0f540-9c16-489a-b586-c0e3963b145f service nova] Creating event network-vif-plugged:3d30e414-a0d6-4099-ad2b-c5d739d3e7a9 for instance ece1c79d-3bf5-499a-befa-00e691e79a10 on n-h1-835595-3 Oct 05 18:34:18.158761 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-54d3c0ab-b84c-432f-9c48-551c9f69f015 req-a9f0f540-9c16-489a-b586-c0e3963b145f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032950 Oct 05 18:34:18.159403 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3338/6921] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:34:18.505086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43d19a21-ab59-494e-92ee-a069398b386d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:18.505747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-43d19a21-ab59-494e-92ee-a069398b386d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:18.513622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d19a21-ab59-494e-92ee-a069398b386d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:18.514132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d19a21-ab59-494e-92ee-a069398b386d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:18.514622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d19a21-ab59-494e-92ee-a069398b386d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:18.515350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d19a21-ab59-494e-92ee-a069398b386d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:18.515834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d19a21-ab59-494e-92ee-a069398b386d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:18.516280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43d19a21-ab59-494e-92ee-a069398b386d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:18.651626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-43d19a21-ab59-494e-92ee-a069398b386d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:18.661256 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-43d19a21-ab59-494e-92ee-a069398b386d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1363 microversion: 2.1 time: 0.160276 Oct 05 18:34:18.661936 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3584/6922] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:18 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:19.699882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-25323dc7-7a1c-49c9-b569-b4ac25ffb462 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:19.701046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-25323dc7-7a1c-49c9-b569-b4ac25ffb462 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:19.708775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25323dc7-7a1c-49c9-b569-b4ac25ffb462 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:19.709265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25323dc7-7a1c-49c9-b569-b4ac25ffb462 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:19.709701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25323dc7-7a1c-49c9-b569-b4ac25ffb462 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:19.710438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25323dc7-7a1c-49c9-b569-b4ac25ffb462 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:19.710900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25323dc7-7a1c-49c9-b569-b4ac25ffb462 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:19.711330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-25323dc7-7a1c-49c9-b569-b4ac25ffb462 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:19.844861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-25323dc7-7a1c-49c9-b569-b4ac25ffb462 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:19.852751 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-25323dc7-7a1c-49c9-b569-b4ac25ffb462 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1550 microversion: 2.1 time: 0.161594 Oct 05 18:34:19.853356 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3339/6923] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:19 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:19.875474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0477c638-fe0e-4c01-a291-512475fc2feb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:19.875976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0477c638-fe0e-4c01-a291-512475fc2feb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:19.883563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0477c638-fe0e-4c01-a291-512475fc2feb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:19.884073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0477c638-fe0e-4c01-a291-512475fc2feb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:19.884525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0477c638-fe0e-4c01-a291-512475fc2feb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:19.885246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0477c638-fe0e-4c01-a291-512475fc2feb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:19.885718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0477c638-fe0e-4c01-a291-512475fc2feb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:19.886160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0477c638-fe0e-4c01-a291-512475fc2feb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:19.974382 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0477c638-fe0e-4c01-a291-512475fc2feb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102820 Oct 05 18:34:19.975033 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3585/6924] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 18:34:19 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:34:20.966952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-de91e431-af60-4328-a1d6-01ebc76ae98d req-6af2bfad-3483-4278-a68d-b4e904510eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece1c79d-3bf5-499a-befa-00e691e79a10", "tag": "3d30e414-a0d6-4099-ad2b-c5d739d3e7a9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:34:20.977414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-de91e431-af60-4328-a1d6-01ebc76ae98d req-6af2bfad-3483-4278-a68d-b4e904510eeb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:20.977891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-de91e431-af60-4328-a1d6-01ebc76ae98d req-6af2bfad-3483-4278-a68d-b4e904510eeb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:20.978390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-de91e431-af60-4328-a1d6-01ebc76ae98d req-6af2bfad-3483-4278-a68d-b4e904510eeb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:20.989846 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-de91e431-af60-4328-a1d6-01ebc76ae98d req-6af2bfad-3483-4278-a68d-b4e904510eeb service nova] Creating event network-changed:3d30e414-a0d6-4099-ad2b-c5d739d3e7a9 for instance ece1c79d-3bf5-499a-befa-00e691e79a10 on n-h1-835595-3 Oct 05 18:34:20.995182 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-de91e431-af60-4328-a1d6-01ebc76ae98d req-6af2bfad-3483-4278-a68d-b4e904510eeb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032009 Oct 05 18:34:20.996193 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3340/6925] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:34:56.732488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:56.734132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=13 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:56.735323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=28 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:56.741779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ab3cfc27-08b8-4add-8483-84a0f7ecb830 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:56.742879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ab3cfc27-08b8-4add-8483-84a0f7ecb830 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:56.754742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3cfc27-08b8-4add-8483-84a0f7ecb830 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:56.755379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3cfc27-08b8-4add-8483-84a0f7ecb830 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:56.756830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3cfc27-08b8-4add-8483-84a0f7ecb830 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:56.758960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3cfc27-08b8-4add-8483-84a0f7ecb830 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:56.760479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3cfc27-08b8-4add-8483-84a0f7ecb830 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:56.760938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ab3cfc27-08b8-4add-8483-84a0f7ecb830 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:57.245815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ab3cfc27-08b8-4add-8483-84a0f7ecb830 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:57.254428 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ab3cfc27-08b8-4add-8483-84a0f7ecb830 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1667 microversion: 2.1 time: 0.525226 Oct 05 18:34:57.255042 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3586/6926] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:56 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1667 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:57.278648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8d23dddf-e94d-4765-9f32-e9f1291150d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:57.279348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8d23dddf-e94d-4765-9f32-e9f1291150d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:57.281672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:57.282333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:57.283104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=7 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:57.283721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=26 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:34:57.290145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d23dddf-e94d-4765-9f32-e9f1291150d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:57.290646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d23dddf-e94d-4765-9f32-e9f1291150d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:57.291081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d23dddf-e94d-4765-9f32-e9f1291150d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:57.291765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d23dddf-e94d-4765-9f32-e9f1291150d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:57.292213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d23dddf-e94d-4765-9f32-e9f1291150d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:57.292627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8d23dddf-e94d-4765-9f32-e9f1291150d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:57.428959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8d23dddf-e94d-4765-9f32-e9f1291150d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:57.441513 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8d23dddf-e94d-4765-9f32-e9f1291150d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1667 microversion: 2.1 time: 0.166826 Oct 05 18:34:57.442361 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3341/6927] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:57 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1667 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:57.465036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ad1a4087-53af-440d-8e70-bcc47e736c4a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:57.465681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ad1a4087-53af-440d-8e70-bcc47e736c4a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:57.472293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad1a4087-53af-440d-8e70-bcc47e736c4a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:57.472728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad1a4087-53af-440d-8e70-bcc47e736c4a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:57.473179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad1a4087-53af-440d-8e70-bcc47e736c4a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:57.473882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad1a4087-53af-440d-8e70-bcc47e736c4a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:57.474386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad1a4087-53af-440d-8e70-bcc47e736c4a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:57.474819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ad1a4087-53af-440d-8e70-bcc47e736c4a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:57.615107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ad1a4087-53af-440d-8e70-bcc47e736c4a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:57.627454 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ad1a4087-53af-440d-8e70-bcc47e736c4a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1667 microversion: 2.1 time: 0.166158 Oct 05 18:34:57.628319 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3587/6928] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:57 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1667 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:57.650577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:34:57.652916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:57.659603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:57.660090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:57.660520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:57.661205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:57.661655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:57.662074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:57.691667 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:57.698941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Old instance type m1.heat2, new instance type m1.heat {{(pid=128843) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 18:34:57.708244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:34:57.708669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:34:57.709146 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:34:57.709553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:34:57.709964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:34:57.776539 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-375863bc-6849-494d-8b8c-0283e6a7cfdd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10/action" status: 202 len: 0 microversion: 2.1 time: 0.129927 Oct 05 18:34:57.777174 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3342/6929] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:34:57 2022] POST /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:34:57.785824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ef40fadb-c9fc-49e6-a9ef-d215bd09a6df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:57.786561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ef40fadb-c9fc-49e6-a9ef-d215bd09a6df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:57.794003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef40fadb-c9fc-49e6-a9ef-d215bd09a6df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:57.794748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef40fadb-c9fc-49e6-a9ef-d215bd09a6df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:57.795204 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef40fadb-c9fc-49e6-a9ef-d215bd09a6df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:57.795930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef40fadb-c9fc-49e6-a9ef-d215bd09a6df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:57.796403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef40fadb-c9fc-49e6-a9ef-d215bd09a6df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:57.796830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef40fadb-c9fc-49e6-a9ef-d215bd09a6df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:57.956422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ef40fadb-c9fc-49e6-a9ef-d215bd09a6df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:57.964844 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ef40fadb-c9fc-49e6-a9ef-d215bd09a6df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1676 microversion: 2.1 time: 0.183130 Oct 05 18:34:57.965442 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3588/6930] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:57 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1676 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:34:58.989728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1c8fe72-1fb2-4a72-93e4-de898b8b94c7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:34:58.991069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c1c8fe72-1fb2-4a72-93e4-de898b8b94c7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:34:58.998322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c8fe72-1fb2-4a72-93e4-de898b8b94c7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:58.998834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c8fe72-1fb2-4a72-93e4-de898b8b94c7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:58.999264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c8fe72-1fb2-4a72-93e4-de898b8b94c7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:58.999935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c8fe72-1fb2-4a72-93e4-de898b8b94c7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:34:59.000384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c8fe72-1fb2-4a72-93e4-de898b8b94c7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:34:59.000798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c8fe72-1fb2-4a72-93e4-de898b8b94c7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:34:59.221813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c1c8fe72-1fb2-4a72-93e4-de898b8b94c7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:34:59.230198 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c1c8fe72-1fb2-4a72-93e4-de898b8b94c7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1676 microversion: 2.1 time: 0.245777 Oct 05 18:34:59.230795 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3343/6931] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:34:58 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:00.259065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84d84ce3-865e-44e9-9b0d-2882d65b8dd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:00.259929 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-84d84ce3-865e-44e9-9b0d-2882d65b8dd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:00.270972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d84ce3-865e-44e9-9b0d-2882d65b8dd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:00.271498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d84ce3-865e-44e9-9b0d-2882d65b8dd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:00.271945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d84ce3-865e-44e9-9b0d-2882d65b8dd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:00.272651 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d84ce3-865e-44e9-9b0d-2882d65b8dd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:00.273121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d84ce3-865e-44e9-9b0d-2882d65b8dd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:00.273559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84d84ce3-865e-44e9-9b0d-2882d65b8dd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:00.416412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-84d84ce3-865e-44e9-9b0d-2882d65b8dd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:00.424504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84d84ce3-865e-44e9-9b0d-2882d65b8dd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1681 microversion: 2.1 time: 0.172306 Oct 05 18:35:00.425096 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3589/6932] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:00 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:01.451687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1f7fba0e-9244-4076-9331-6cd197857e7d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:01.452652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1f7fba0e-9244-4076-9331-6cd197857e7d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:01.461544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f7fba0e-9244-4076-9331-6cd197857e7d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:01.462028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f7fba0e-9244-4076-9331-6cd197857e7d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:01.462492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f7fba0e-9244-4076-9331-6cd197857e7d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:01.463178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f7fba0e-9244-4076-9331-6cd197857e7d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:01.463684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f7fba0e-9244-4076-9331-6cd197857e7d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:01.464112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f7fba0e-9244-4076-9331-6cd197857e7d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:01.609003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1f7fba0e-9244-4076-9331-6cd197857e7d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:01.617300 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1f7fba0e-9244-4076-9331-6cd197857e7d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1681 microversion: 2.1 time: 0.172257 Oct 05 18:35:01.617910 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3344/6933] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:01 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:02.645824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5f4072fd-237f-4c12-9642-d0172bf3556a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:02.647102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5f4072fd-237f-4c12-9642-d0172bf3556a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:02.658819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4072fd-237f-4c12-9642-d0172bf3556a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:02.659747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4072fd-237f-4c12-9642-d0172bf3556a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:02.660209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4072fd-237f-4c12-9642-d0172bf3556a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:02.660933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4072fd-237f-4c12-9642-d0172bf3556a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:02.661414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4072fd-237f-4c12-9642-d0172bf3556a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:02.661872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5f4072fd-237f-4c12-9642-d0172bf3556a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:02.803299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5f4072fd-237f-4c12-9642-d0172bf3556a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:02.814258 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5f4072fd-237f-4c12-9642-d0172bf3556a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1681 microversion: 2.1 time: 0.175657 Oct 05 18:35:02.814907 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3590/6934] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:02 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:03.842097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a2cf5d17-a6a6-4b07-b69d-2202f0cfb2ad tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:03.843019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a2cf5d17-a6a6-4b07-b69d-2202f0cfb2ad tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:03.852141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2cf5d17-a6a6-4b07-b69d-2202f0cfb2ad tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:03.852637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2cf5d17-a6a6-4b07-b69d-2202f0cfb2ad tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:03.853085 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2cf5d17-a6a6-4b07-b69d-2202f0cfb2ad tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:03.853791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2cf5d17-a6a6-4b07-b69d-2202f0cfb2ad tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:03.854250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2cf5d17-a6a6-4b07-b69d-2202f0cfb2ad tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:03.854714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2cf5d17-a6a6-4b07-b69d-2202f0cfb2ad tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:04.000848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a2cf5d17-a6a6-4b07-b69d-2202f0cfb2ad tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:04.009260 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a2cf5d17-a6a6-4b07-b69d-2202f0cfb2ad tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1681 microversion: 2.1 time: 0.173993 Oct 05 18:35:04.009844 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3345/6935] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:03 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:05.036695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3f7d16ba-c6c7-4623-a947-15bdbede386b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:05.037739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3f7d16ba-c6c7-4623-a947-15bdbede386b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:05.049430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7d16ba-c6c7-4623-a947-15bdbede386b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:05.050259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7d16ba-c6c7-4623-a947-15bdbede386b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:05.050990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7d16ba-c6c7-4623-a947-15bdbede386b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:05.051696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7d16ba-c6c7-4623-a947-15bdbede386b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:05.052170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7d16ba-c6c7-4623-a947-15bdbede386b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:05.052605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3f7d16ba-c6c7-4623-a947-15bdbede386b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:05.190996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3f7d16ba-c6c7-4623-a947-15bdbede386b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:05.199705 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3f7d16ba-c6c7-4623-a947-15bdbede386b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1681 microversion: 2.1 time: 0.169714 Oct 05 18:35:05.200314 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3591/6936] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:05 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:06.227111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eb66564d-8a49-4494-8b09-fdd09d5b4b3c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:06.227775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eb66564d-8a49-4494-8b09-fdd09d5b4b3c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:06.236567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb66564d-8a49-4494-8b09-fdd09d5b4b3c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:06.237210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb66564d-8a49-4494-8b09-fdd09d5b4b3c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:06.237779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb66564d-8a49-4494-8b09-fdd09d5b4b3c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:06.238655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb66564d-8a49-4494-8b09-fdd09d5b4b3c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:06.239227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb66564d-8a49-4494-8b09-fdd09d5b4b3c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:06.239760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eb66564d-8a49-4494-8b09-fdd09d5b4b3c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:06.379753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eb66564d-8a49-4494-8b09-fdd09d5b4b3c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:06.387920 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eb66564d-8a49-4494-8b09-fdd09d5b4b3c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1681 microversion: 2.1 time: 0.166589 Oct 05 18:35:06.388819 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3346/6937] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:06 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:07.414390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59b9e239-0ea0-4e65-891b-ee1b010e1fae tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:07.415165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-59b9e239-0ea0-4e65-891b-ee1b010e1fae tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:07.424588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b9e239-0ea0-4e65-891b-ee1b010e1fae tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:07.425170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b9e239-0ea0-4e65-891b-ee1b010e1fae tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:07.425828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b9e239-0ea0-4e65-891b-ee1b010e1fae tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:07.426583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b9e239-0ea0-4e65-891b-ee1b010e1fae tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:07.427056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b9e239-0ea0-4e65-891b-ee1b010e1fae tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:07.427498 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59b9e239-0ea0-4e65-891b-ee1b010e1fae tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:07.561301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-59b9e239-0ea0-4e65-891b-ee1b010e1fae tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:07.569795 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-59b9e239-0ea0-4e65-891b-ee1b010e1fae tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1681 microversion: 2.1 time: 0.160969 Oct 05 18:35:07.570378 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3592/6938] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:07 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:08.597373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e639724b-f66c-4a56-a6ba-22c663ad8402 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:08.598210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e639724b-f66c-4a56-a6ba-22c663ad8402 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:08.610446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e639724b-f66c-4a56-a6ba-22c663ad8402 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:08.611269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e639724b-f66c-4a56-a6ba-22c663ad8402 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:08.611997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e639724b-f66c-4a56-a6ba-22c663ad8402 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:08.613344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e639724b-f66c-4a56-a6ba-22c663ad8402 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:08.613809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e639724b-f66c-4a56-a6ba-22c663ad8402 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:08.614237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e639724b-f66c-4a56-a6ba-22c663ad8402 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:08.757335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e639724b-f66c-4a56-a6ba-22c663ad8402 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:08.766005 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e639724b-f66c-4a56-a6ba-22c663ad8402 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1681 microversion: 2.1 time: 0.175550 Oct 05 18:35:08.766617 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3347/6939] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:08 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:09.790402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-328e85c5-8639-4aa2-bd9a-238fc3532c09 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:09.791101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-328e85c5-8639-4aa2-bd9a-238fc3532c09 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:09.798429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-328e85c5-8639-4aa2-bd9a-238fc3532c09 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:09.798925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-328e85c5-8639-4aa2-bd9a-238fc3532c09 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:09.799425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-328e85c5-8639-4aa2-bd9a-238fc3532c09 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:09.800135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-328e85c5-8639-4aa2-bd9a-238fc3532c09 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:09.800620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-328e85c5-8639-4aa2-bd9a-238fc3532c09 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:09.801080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-328e85c5-8639-4aa2-bd9a-238fc3532c09 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:09.941008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-328e85c5-8639-4aa2-bd9a-238fc3532c09 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:09.949484 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-328e85c5-8639-4aa2-bd9a-238fc3532c09 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1681 microversion: 2.1 time: 0.163087 Oct 05 18:35:09.950032 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3593/6940] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:09 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:10.975340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c45d127e-9da7-4fa7-af4b-466b5d1d4ab7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:10.976162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c45d127e-9da7-4fa7-af4b-466b5d1d4ab7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:10.985643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c45d127e-9da7-4fa7-af4b-466b5d1d4ab7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:10.986311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c45d127e-9da7-4fa7-af4b-466b5d1d4ab7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:10.986896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c45d127e-9da7-4fa7-af4b-466b5d1d4ab7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:10.987880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c45d127e-9da7-4fa7-af4b-466b5d1d4ab7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:10.988491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c45d127e-9da7-4fa7-af4b-466b5d1d4ab7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:10.988914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c45d127e-9da7-4fa7-af4b-466b5d1d4ab7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:11.129642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c45d127e-9da7-4fa7-af4b-466b5d1d4ab7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:11.138202 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c45d127e-9da7-4fa7-af4b-466b5d1d4ab7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1681 microversion: 2.1 time: 0.168339 Oct 05 18:35:11.139219 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3348/6941] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:10 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:12.013224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d69a9b9f-67c8-4c57-a189-31d8c73bc829 req-de6a1f74-c5c5-4d5e-b9ee-01531f7d5199 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1c79d-3bf5-499a-befa-00e691e79a10", "name": "network-vif-unplugged", "status": "completed", "tag": "3d30e414-a0d6-4099-ad2b-c5d739d3e7a9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:35:12.025147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d69a9b9f-67c8-4c57-a189-31d8c73bc829 req-de6a1f74-c5c5-4d5e-b9ee-01531f7d5199 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:12.025637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d69a9b9f-67c8-4c57-a189-31d8c73bc829 req-de6a1f74-c5c5-4d5e-b9ee-01531f7d5199 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:12.026145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d69a9b9f-67c8-4c57-a189-31d8c73bc829 req-de6a1f74-c5c5-4d5e-b9ee-01531f7d5199 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:12.039387 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d69a9b9f-67c8-4c57-a189-31d8c73bc829 req-de6a1f74-c5c5-4d5e-b9ee-01531f7d5199 service nova] Creating event network-vif-unplugged:3d30e414-a0d6-4099-ad2b-c5d739d3e7a9 for instance ece1c79d-3bf5-499a-befa-00e691e79a10 on n-h2-835595-3 Oct 05 18:35:12.045718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-d69a9b9f-67c8-4c57-a189-31d8c73bc829 req-de6a1f74-c5c5-4d5e-b9ee-01531f7d5199 service nova] Instance ece1c79d-3bf5-499a-befa-00e691e79a10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:35:12.058067 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d69a9b9f-67c8-4c57-a189-31d8c73bc829 req-de6a1f74-c5c5-4d5e-b9ee-01531f7d5199 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048854 Oct 05 18:35:12.058972 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3594/6942] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:35:12.162204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-50462118-af46-46d5-afea-3d1c5b39aa6d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:12.162848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-50462118-af46-46d5-afea-3d1c5b39aa6d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:12.170106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50462118-af46-46d5-afea-3d1c5b39aa6d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:12.170672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50462118-af46-46d5-afea-3d1c5b39aa6d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:12.171112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50462118-af46-46d5-afea-3d1c5b39aa6d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:12.171806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50462118-af46-46d5-afea-3d1c5b39aa6d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:12.172328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50462118-af46-46d5-afea-3d1c5b39aa6d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:12.172750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50462118-af46-46d5-afea-3d1c5b39aa6d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:12.381325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50462118-af46-46d5-afea-3d1c5b39aa6d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:12.389974 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-50462118-af46-46d5-afea-3d1c5b39aa6d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1680 microversion: 2.1 time: 0.231914 Oct 05 18:35:12.390579 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3349/6943] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:12 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1680 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:13.418354 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b0c76e15-5c55-444d-adce-a4891f29c12f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:13.419065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b0c76e15-5c55-444d-adce-a4891f29c12f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:13.429409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0c76e15-5c55-444d-adce-a4891f29c12f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:13.429919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0c76e15-5c55-444d-adce-a4891f29c12f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:13.430407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0c76e15-5c55-444d-adce-a4891f29c12f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:13.431151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0c76e15-5c55-444d-adce-a4891f29c12f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:13.431626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0c76e15-5c55-444d-adce-a4891f29c12f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:13.432062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b0c76e15-5c55-444d-adce-a4891f29c12f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:13.577436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b0c76e15-5c55-444d-adce-a4891f29c12f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:13.589709 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b0c76e15-5c55-444d-adce-a4891f29c12f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1678 microversion: 2.1 time: 0.177184 Oct 05 18:35:13.590694 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3595/6944] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:13 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:14.099785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3211b6fb-2d83-4f22-a9dd-3d025f2c8195 req-98519bda-b77c-42ef-ae4a-498138eaa5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ece1c79d-3bf5-499a-befa-00e691e79a10", "tag": "3d30e414-a0d6-4099-ad2b-c5d739d3e7a9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:35:14.116831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3211b6fb-2d83-4f22-a9dd-3d025f2c8195 req-98519bda-b77c-42ef-ae4a-498138eaa5c1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:14.117922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3211b6fb-2d83-4f22-a9dd-3d025f2c8195 req-98519bda-b77c-42ef-ae4a-498138eaa5c1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:14.118395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3211b6fb-2d83-4f22-a9dd-3d025f2c8195 req-98519bda-b77c-42ef-ae4a-498138eaa5c1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:14.130841 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3211b6fb-2d83-4f22-a9dd-3d025f2c8195 req-98519bda-b77c-42ef-ae4a-498138eaa5c1 service nova] Creating event network-changed:3d30e414-a0d6-4099-ad2b-c5d739d3e7a9 for instance ece1c79d-3bf5-499a-befa-00e691e79a10 on n-h2-835595-3 Oct 05 18:35:14.136401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-3211b6fb-2d83-4f22-a9dd-3d025f2c8195 req-98519bda-b77c-42ef-ae4a-498138eaa5c1 service nova] Instance ece1c79d-3bf5-499a-befa-00e691e79a10 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:35:14.147949 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3211b6fb-2d83-4f22-a9dd-3d025f2c8195 req-98519bda-b77c-42ef-ae4a-498138eaa5c1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054593 Oct 05 18:35:14.148537 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3350/6945] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:35:14.617237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56df9582-598b-4585-b0ce-7faa5b803984 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:14.618607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56df9582-598b-4585-b0ce-7faa5b803984 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:14.625784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56df9582-598b-4585-b0ce-7faa5b803984 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:14.626307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56df9582-598b-4585-b0ce-7faa5b803984 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:14.626770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56df9582-598b-4585-b0ce-7faa5b803984 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:14.627681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56df9582-598b-4585-b0ce-7faa5b803984 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:14.628157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56df9582-598b-4585-b0ce-7faa5b803984 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:14.628600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56df9582-598b-4585-b0ce-7faa5b803984 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:14.773961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-56df9582-598b-4585-b0ce-7faa5b803984 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:14.785654 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56df9582-598b-4585-b0ce-7faa5b803984 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1678 microversion: 2.1 time: 0.172448 Oct 05 18:35:14.786270 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3596/6946] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:14 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:15.816355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-20bb623c-b8cc-4ad1-b6c8-a128ad88955b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:15.817521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-20bb623c-b8cc-4ad1-b6c8-a128ad88955b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:15.825574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20bb623c-b8cc-4ad1-b6c8-a128ad88955b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:15.826059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20bb623c-b8cc-4ad1-b6c8-a128ad88955b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:15.826545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20bb623c-b8cc-4ad1-b6c8-a128ad88955b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:15.827246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20bb623c-b8cc-4ad1-b6c8-a128ad88955b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:15.827705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20bb623c-b8cc-4ad1-b6c8-a128ad88955b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:15.828133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20bb623c-b8cc-4ad1-b6c8-a128ad88955b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:15.962477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-20bb623c-b8cc-4ad1-b6c8-a128ad88955b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:15.970611 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-20bb623c-b8cc-4ad1-b6c8-a128ad88955b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1675 microversion: 2.1 time: 0.162968 Oct 05 18:35:15.971205 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3351/6947] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:15 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:15.993896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf5e2d75-d0ac-482f-8b52-46d636a4b786 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:35:15.994542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bf5e2d75-d0ac-482f-8b52-46d636a4b786 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:16.002304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf5e2d75-d0ac-482f-8b52-46d636a4b786 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:16.002881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf5e2d75-d0ac-482f-8b52-46d636a4b786 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:16.003340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf5e2d75-d0ac-482f-8b52-46d636a4b786 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:16.004070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf5e2d75-d0ac-482f-8b52-46d636a4b786 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:16.004575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf5e2d75-d0ac-482f-8b52-46d636a4b786 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:16.005195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf5e2d75-d0ac-482f-8b52-46d636a4b786 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:16.068007 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf5e2d75-d0ac-482f-8b52-46d636a4b786 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10/action" status: 204 len: 0 microversion: 2.1 time: 0.077809 Oct 05 18:35:16.068743 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3597/6948] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:35:15 2022] POST /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:35:16.081315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-42f90dcb-9f6d-4924-b776-8ff0004622da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:16.082092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-42f90dcb-9f6d-4924-b776-8ff0004622da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:16.089342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42f90dcb-9f6d-4924-b776-8ff0004622da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:16.089833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42f90dcb-9f6d-4924-b776-8ff0004622da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:16.090301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42f90dcb-9f6d-4924-b776-8ff0004622da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:16.091204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42f90dcb-9f6d-4924-b776-8ff0004622da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:16.091662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42f90dcb-9f6d-4924-b776-8ff0004622da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:16.092090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-42f90dcb-9f6d-4924-b776-8ff0004622da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:16.309719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-42f90dcb-9f6d-4924-b776-8ff0004622da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:16.320607 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-42f90dcb-9f6d-4924-b776-8ff0004622da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1675 microversion: 2.1 time: 0.244966 Oct 05 18:35:16.337551 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3352/6949] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:16 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1675 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:17.346586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d9a43d37-d08f-495c-b7a0-4f1d47d037db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:17.347309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d9a43d37-d08f-495c-b7a0-4f1d47d037db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:17.354677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a43d37-d08f-495c-b7a0-4f1d47d037db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:17.355184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a43d37-d08f-495c-b7a0-4f1d47d037db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:17.355670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a43d37-d08f-495c-b7a0-4f1d47d037db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:17.356391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a43d37-d08f-495c-b7a0-4f1d47d037db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:17.356876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a43d37-d08f-495c-b7a0-4f1d47d037db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:17.357324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a43d37-d08f-495c-b7a0-4f1d47d037db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:17.499471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d9a43d37-d08f-495c-b7a0-4f1d47d037db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:17.509276 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d9a43d37-d08f-495c-b7a0-4f1d47d037db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1667 microversion: 2.1 time: 0.167019 Oct 05 18:35:17.510826 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3598/6950] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:17 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1667 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:17.535812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cfd61dfb-820f-4b05-a86d-17d63670d2e8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:17.536436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cfd61dfb-820f-4b05-a86d-17d63670d2e8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:17.543798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd61dfb-820f-4b05-a86d-17d63670d2e8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:17.544532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd61dfb-820f-4b05-a86d-17d63670d2e8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:17.544971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd61dfb-820f-4b05-a86d-17d63670d2e8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:17.545677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd61dfb-820f-4b05-a86d-17d63670d2e8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:17.546136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd61dfb-820f-4b05-a86d-17d63670d2e8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:17.547109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd61dfb-820f-4b05-a86d-17d63670d2e8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:17.695622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cfd61dfb-820f-4b05-a86d-17d63670d2e8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:17.704236 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cfd61dfb-820f-4b05-a86d-17d63670d2e8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1667 microversion: 2.1 time: 0.174269 Oct 05 18:35:17.704831 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3353/6951] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:17 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1667 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:17.729071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-53ac5292-a7ff-4a7a-a6af-2a0854664cd0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:17.729699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-53ac5292-a7ff-4a7a-a6af-2a0854664cd0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:17.736233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53ac5292-a7ff-4a7a-a6af-2a0854664cd0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:17.736743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53ac5292-a7ff-4a7a-a6af-2a0854664cd0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:17.737197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53ac5292-a7ff-4a7a-a6af-2a0854664cd0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:17.737914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53ac5292-a7ff-4a7a-a6af-2a0854664cd0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:17.738423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53ac5292-a7ff-4a7a-a6af-2a0854664cd0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:17.738866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-53ac5292-a7ff-4a7a-a6af-2a0854664cd0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:17.880625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-53ac5292-a7ff-4a7a-a6af-2a0854664cd0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:17.889414 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-53ac5292-a7ff-4a7a-a6af-2a0854664cd0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1667 microversion: 2.1 time: 0.163909 Oct 05 18:35:17.889925 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3599/6952] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:17 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1667 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:17.913916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9be24578-4c80-453a-9c0d-bed4482305da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:17.914703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9be24578-4c80-453a-9c0d-bed4482305da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:17.921389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9be24578-4c80-453a-9c0d-bed4482305da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:17.921880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9be24578-4c80-453a-9c0d-bed4482305da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:17.922343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9be24578-4c80-453a-9c0d-bed4482305da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:17.923056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9be24578-4c80-453a-9c0d-bed4482305da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:17.923531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9be24578-4c80-453a-9c0d-bed4482305da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:17.923955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9be24578-4c80-453a-9c0d-bed4482305da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:17.949796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9be24578-4c80-453a-9c0d-bed4482305da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:35:18.004020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:35:18.034929 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9be24578-4c80-453a-9c0d-bed4482305da tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 204 len: 0 microversion: 2.1 time: 0.126239 Oct 05 18:35:18.035537 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3354/6953] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:35:17 2022] DELETE /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:35:18.044092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ce19e4ca-7f1b-4323-90e5-c0487dd0cb0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:18.044726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ce19e4ca-7f1b-4323-90e5-c0487dd0cb0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:18.050877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce19e4ca-7f1b-4323-90e5-c0487dd0cb0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:18.051380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce19e4ca-7f1b-4323-90e5-c0487dd0cb0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:18.051833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce19e4ca-7f1b-4323-90e5-c0487dd0cb0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:18.052545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce19e4ca-7f1b-4323-90e5-c0487dd0cb0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:18.053018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce19e4ca-7f1b-4323-90e5-c0487dd0cb0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:18.053456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ce19e4ca-7f1b-4323-90e5-c0487dd0cb0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:18.184673 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ce19e4ca-7f1b-4323-90e5-c0487dd0cb0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:18.192911 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ce19e4ca-7f1b-4323-90e5-c0487dd0cb0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1673 microversion: 2.1 time: 0.152947 Oct 05 18:35:18.193466 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3600/6954] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:18 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:19.045619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-fb1a77e1-b81d-4b6d-afce-464e351db73c req-e872a5a8-f887-451d-8271-703e1aa34297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1c79d-3bf5-499a-befa-00e691e79a10", "name": "network-vif-plugged", "status": "completed", "tag": "3d30e414-a0d6-4099-ad2b-c5d739d3e7a9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:35:19.060530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fb1a77e1-b81d-4b6d-afce-464e351db73c req-e872a5a8-f887-451d-8271-703e1aa34297 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:19.061406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fb1a77e1-b81d-4b6d-afce-464e351db73c req-e872a5a8-f887-451d-8271-703e1aa34297 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:19.061942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fb1a77e1-b81d-4b6d-afce-464e351db73c req-e872a5a8-f887-451d-8271-703e1aa34297 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:19.074194 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-fb1a77e1-b81d-4b6d-afce-464e351db73c req-e872a5a8-f887-451d-8271-703e1aa34297 service nova] Creating event network-vif-plugged:3d30e414-a0d6-4099-ad2b-c5d739d3e7a9 for instance ece1c79d-3bf5-499a-befa-00e691e79a10 on n-h2-835595-3 Oct 05 18:35:19.079751 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-fb1a77e1-b81d-4b6d-afce-464e351db73c req-e872a5a8-f887-451d-8271-703e1aa34297 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038382 Oct 05 18:35:19.080744 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3355/6955] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:35:19.217077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6c43460f-82de-4a64-a536-dcbd3420a9fe tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:19.217653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6c43460f-82de-4a64-a536-dcbd3420a9fe tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:19.225332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c43460f-82de-4a64-a536-dcbd3420a9fe tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:19.225833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c43460f-82de-4a64-a536-dcbd3420a9fe tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:19.226311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c43460f-82de-4a64-a536-dcbd3420a9fe tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:19.227026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c43460f-82de-4a64-a536-dcbd3420a9fe tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:19.227474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c43460f-82de-4a64-a536-dcbd3420a9fe tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:19.227939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6c43460f-82de-4a64-a536-dcbd3420a9fe tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:19.366171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6c43460f-82de-4a64-a536-dcbd3420a9fe tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:19.368692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:35:19.377916 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6c43460f-82de-4a64-a536-dcbd3420a9fe tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1673 microversion: 2.1 time: 0.165042 Oct 05 18:35:19.378577 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3601/6956] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:19 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:20.294643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-0d6de4f0-864d-4a1f-85a7-416d1f2bcd73 req-0416c97d-8b03-4df8-9d06-5b2519f9fda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece1c79d-3bf5-499a-befa-00e691e79a10", "name": "network-vif-deleted", "tag": "3d30e414-a0d6-4099-ad2b-c5d739d3e7a9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:35:20.307685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0d6de4f0-864d-4a1f-85a7-416d1f2bcd73 req-0416c97d-8b03-4df8-9d06-5b2519f9fda8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:20.308490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0d6de4f0-864d-4a1f-85a7-416d1f2bcd73 req-0416c97d-8b03-4df8-9d06-5b2519f9fda8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:20.310061 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0d6de4f0-864d-4a1f-85a7-416d1f2bcd73 req-0416c97d-8b03-4df8-9d06-5b2519f9fda8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:20.321089 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-0d6de4f0-864d-4a1f-85a7-416d1f2bcd73 req-0416c97d-8b03-4df8-9d06-5b2519f9fda8 service nova] Creating event network-vif-deleted:3d30e414-a0d6-4099-ad2b-c5d739d3e7a9 for instance ece1c79d-3bf5-499a-befa-00e691e79a10 on n-h2-835595-3 Oct 05 18:35:20.327435 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-0d6de4f0-864d-4a1f-85a7-416d1f2bcd73 req-0416c97d-8b03-4df8-9d06-5b2519f9fda8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038489 Oct 05 18:35:20.328072 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3356/6957] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:35:20.401902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:20.402563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:20.410263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:20.410808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:20.411240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:20.412632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:20.413104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:20.413810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:20.453763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:20.454267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:20.454776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:20.455238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lazy-loading 'fault' on Instance uuid ece1c79d-3bf5-499a-befa-00e691e79a10 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:35:20.499479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:20.507953 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-55d53ea5-0e51-409e-a7d2-005725a4ad6e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 200 len: 1328 microversion: 2.1 time: 0.110405 Oct 05 18:35:20.508713 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3602/6958] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:20 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:21.539722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:21.540878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:21.551524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:21.552394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:21.553111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:21.554246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:21.555149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:21.555926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:21.569613 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 HTTP/1.1 Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'ece1c79d-3bf5-499a-befa-00e691e79a10'} Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:35:21.571382 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:35:21.575526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:35:21.575526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:35:21.575526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:35:21.575526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:35:21.575526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:35:21.575526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:35:21.575526 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:35:21.575526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:35:21.575526 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fd47ee19-7b6b-41cb-b38d-5b5ec5fa6447 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 404 len: 111 microversion: 2.1 time: 0.042591 Oct 05 18:35:21.575526 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3357/6959] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:21 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:35:21.587042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:21.587804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:21.598388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:21.599155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:21.599797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:21.600747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:21.601225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:21.601671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:21.619346 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 HTTP/1.1 Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'ece1c79d-3bf5-499a-befa-00e691e79a10'} Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:35:21.621958 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:35:21.625752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:35:21.625752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:35:21.625752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:35:21.625752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:35:21.625752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:35:21.625752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:35:21.625752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:35:21.625752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:35:21.625752 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e872d78b-f284-4e3f-bcf0-f99138d0faa8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 404 len: 111 microversion: 2.1 time: 0.041917 Oct 05 18:35:21.625752 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3603/6960] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:21 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:35:21.676836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2128526443", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "d10090ce-6507-4a6c-8839-056a2634ec6b"}], "security_groups": [{"name": "tempest-securitygroup--981366362"}], "key_name": "tempest-keypair-307237400", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:35:21.784153 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] validate_networks() for [('d10090ce-6507-4a6c-8839-056a2634ec6b', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:35:22.172786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:35:22.173362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:35:22.173951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:35:22.174523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:35:22.175117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:35:22.185978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:22.186513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:22.186949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:22.187677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:22.188135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:22.188561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:22.205684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:35:22.210980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for user 654ce2fda5024f6783ef6e2faf2f6617 and project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:35:22.223775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:35:22.226168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:35:22.276381 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0b96d15d-a74f-4919-bfdb-d3850fa389f6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.603454 Oct 05 18:35:22.277037 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3358/6961] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:35:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:35:22.289092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8bd5de5-799a-4ecb-a850-58b38b80711d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:22.289710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c8bd5de5-799a-4ecb-a850-58b38b80711d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:22.348033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8bd5de5-799a-4ecb-a850-58b38b80711d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:22.355221 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c8bd5de5-799a-4ecb-a850-58b38b80711d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1238 microversion: 2.1 time: 0.070257 Oct 05 18:35:22.355797 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3604/6962] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:22 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:23.381067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-66f994e9-7275-411c-b2f9-2431a0db5953 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:23.381753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-66f994e9-7275-411c-b2f9-2431a0db5953 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:23.390264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66f994e9-7275-411c-b2f9-2431a0db5953 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:23.390883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66f994e9-7275-411c-b2f9-2431a0db5953 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:23.391451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66f994e9-7275-411c-b2f9-2431a0db5953 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:23.392314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66f994e9-7275-411c-b2f9-2431a0db5953 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:23.392870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66f994e9-7275-411c-b2f9-2431a0db5953 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:23.393397 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-66f994e9-7275-411c-b2f9-2431a0db5953 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:23.533876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-66f994e9-7275-411c-b2f9-2431a0db5953 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:23.542322 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-66f994e9-7275-411c-b2f9-2431a0db5953 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1308 microversion: 2.1 time: 0.166158 Oct 05 18:35:23.543413 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3359/6963] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:23 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:24.566425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eca1a206-4c23-4c54-a79f-9a1794d26dbb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:24.567193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eca1a206-4c23-4c54-a79f-9a1794d26dbb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:24.576060 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eca1a206-4c23-4c54-a79f-9a1794d26dbb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:24.576947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eca1a206-4c23-4c54-a79f-9a1794d26dbb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:24.577394 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eca1a206-4c23-4c54-a79f-9a1794d26dbb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:24.578417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eca1a206-4c23-4c54-a79f-9a1794d26dbb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:24.578930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eca1a206-4c23-4c54-a79f-9a1794d26dbb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:24.579375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eca1a206-4c23-4c54-a79f-9a1794d26dbb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:24.771863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eca1a206-4c23-4c54-a79f-9a1794d26dbb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:24.780186 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eca1a206-4c23-4c54-a79f-9a1794d26dbb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1363 microversion: 2.1 time: 0.217835 Oct 05 18:35:24.781331 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3605/6964] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:24 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:24.794676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-26f057af-01bc-453b-a63c-52f71c0ffe77 req-4bded448-b57f-4625-a54a-b7496885fce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fb7467-7aa1-4f4c-92a0-d1264daaf888", "tag": "2bf66549-0e58-4b0c-81ac-a245d68a9539"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:35:24.817654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-26f057af-01bc-453b-a63c-52f71c0ffe77 req-4bded448-b57f-4625-a54a-b7496885fce2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:24.818527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-26f057af-01bc-453b-a63c-52f71c0ffe77 req-4bded448-b57f-4625-a54a-b7496885fce2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:24.819294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-26f057af-01bc-453b-a63c-52f71c0ffe77 req-4bded448-b57f-4625-a54a-b7496885fce2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:24.843663 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-26f057af-01bc-453b-a63c-52f71c0ffe77 req-4bded448-b57f-4625-a54a-b7496885fce2 service nova] Creating event network-changed:2bf66549-0e58-4b0c-81ac-a245d68a9539 for instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 on n-h2-835595-3 Oct 05 18:35:24.848874 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-26f057af-01bc-453b-a63c-52f71c0ffe77 req-4bded448-b57f-4625-a54a-b7496885fce2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074411 Oct 05 18:35:24.849496 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3360/6965] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:35:25.808970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d1e2386c-4031-49f3-b88b-894535f1219c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:25.809644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d1e2386c-4031-49f3-b88b-894535f1219c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:25.818679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1e2386c-4031-49f3-b88b-894535f1219c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:25.819315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1e2386c-4031-49f3-b88b-894535f1219c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:25.819895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1e2386c-4031-49f3-b88b-894535f1219c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:25.820789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1e2386c-4031-49f3-b88b-894535f1219c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:25.821387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1e2386c-4031-49f3-b88b-894535f1219c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:25.821945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1e2386c-4031-49f3-b88b-894535f1219c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:25.959631 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d1e2386c-4031-49f3-b88b-894535f1219c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:25.967864 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d1e2386c-4031-49f3-b88b-894535f1219c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1363 microversion: 2.1 time: 0.165599 Oct 05 18:35:25.968451 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3606/6966] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:25 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:26.992196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ffd94ff8-02c8-4c0e-a235-24cbabfba83a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:26.993341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ffd94ff8-02c8-4c0e-a235-24cbabfba83a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:27.005950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd94ff8-02c8-4c0e-a235-24cbabfba83a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:27.006474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd94ff8-02c8-4c0e-a235-24cbabfba83a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:27.006909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd94ff8-02c8-4c0e-a235-24cbabfba83a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:27.007613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd94ff8-02c8-4c0e-a235-24cbabfba83a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:27.008063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd94ff8-02c8-4c0e-a235-24cbabfba83a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:27.008483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ffd94ff8-02c8-4c0e-a235-24cbabfba83a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:27.164045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ffd94ff8-02c8-4c0e-a235-24cbabfba83a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:27.172292 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ffd94ff8-02c8-4c0e-a235-24cbabfba83a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1363 microversion: 2.1 time: 0.184399 Oct 05 18:35:27.172873 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3361/6967] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:26 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:28.196622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8fdfad1d-8ca6-4038-8132-60292015f43f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:28.197286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8fdfad1d-8ca6-4038-8132-60292015f43f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:28.199713 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:35:28.199875 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:35:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 (ip 10.222.0.70) !!! Oct 05 18:35:28.201435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=47 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:35:28.209152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fdfad1d-8ca6-4038-8132-60292015f43f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:28.209661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fdfad1d-8ca6-4038-8132-60292015f43f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:28.210118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fdfad1d-8ca6-4038-8132-60292015f43f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:28.210863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fdfad1d-8ca6-4038-8132-60292015f43f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:28.211342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fdfad1d-8ca6-4038-8132-60292015f43f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:28.211784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8fdfad1d-8ca6-4038-8132-60292015f43f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:28.348071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8fdfad1d-8ca6-4038-8132-60292015f43f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:28.356304 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8fdfad1d-8ca6-4038-8132-60292015f43f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1363 microversion: 2.1 time: 0.164175 Oct 05 18:35:28.356884 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3607/6968] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:28 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:29.380431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-daaa99ff-7c65-495c-9329-859ce3831839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:29.380991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-daaa99ff-7c65-495c-9329-859ce3831839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:29.384016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:35:29.390824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa99ff-7c65-495c-9329-859ce3831839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:29.391335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa99ff-7c65-495c-9329-859ce3831839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:29.391861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa99ff-7c65-495c-9329-859ce3831839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:29.392811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa99ff-7c65-495c-9329-859ce3831839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:29.393261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa99ff-7c65-495c-9329-859ce3831839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:29.393675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-daaa99ff-7c65-495c-9329-859ce3831839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:29.544578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-daaa99ff-7c65-495c-9329-859ce3831839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:29.552605 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-daaa99ff-7c65-495c-9329-859ce3831839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1363 microversion: 2.1 time: 0.176418 Oct 05 18:35:29.553158 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3362/6969] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:29 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:30.576810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-727f2c09-deab-4d22-a0c0-b2c2e9f6b5ee tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:30.577415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-727f2c09-deab-4d22-a0c0-b2c2e9f6b5ee tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:30.584918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-727f2c09-deab-4d22-a0c0-b2c2e9f6b5ee tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:30.585433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-727f2c09-deab-4d22-a0c0-b2c2e9f6b5ee tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:30.585888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-727f2c09-deab-4d22-a0c0-b2c2e9f6b5ee tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:30.586643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-727f2c09-deab-4d22-a0c0-b2c2e9f6b5ee tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:30.587119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-727f2c09-deab-4d22-a0c0-b2c2e9f6b5ee tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:30.587562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-727f2c09-deab-4d22-a0c0-b2c2e9f6b5ee tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:30.723615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-727f2c09-deab-4d22-a0c0-b2c2e9f6b5ee tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:30.731898 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-727f2c09-deab-4d22-a0c0-b2c2e9f6b5ee tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1363 microversion: 2.1 time: 0.159332 Oct 05 18:35:30.732452 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3608/6970] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:30 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:31.053179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-fe574b99-7e24-40a9-a697-d54a43b91962 req-d72f3f41-1746-4fc9-85f8-535b1f80eaeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fb7467-7aa1-4f4c-92a0-d1264daaf888", "name": "network-vif-plugged", "status": "completed", "tag": "2bf66549-0e58-4b0c-81ac-a245d68a9539"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:35:31.068674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fe574b99-7e24-40a9-a697-d54a43b91962 req-d72f3f41-1746-4fc9-85f8-535b1f80eaeb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:31.069161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fe574b99-7e24-40a9-a697-d54a43b91962 req-d72f3f41-1746-4fc9-85f8-535b1f80eaeb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:31.069593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-fe574b99-7e24-40a9-a697-d54a43b91962 req-d72f3f41-1746-4fc9-85f8-535b1f80eaeb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:31.081228 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-fe574b99-7e24-40a9-a697-d54a43b91962 req-d72f3f41-1746-4fc9-85f8-535b1f80eaeb service nova] Creating event network-vif-plugged:2bf66549-0e58-4b0c-81ac-a245d68a9539 for instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 on n-h2-835595-3 Oct 05 18:35:31.087224 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-fe574b99-7e24-40a9-a697-d54a43b91962 req-d72f3f41-1746-4fc9-85f8-535b1f80eaeb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037279 Oct 05 18:35:31.087823 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3363/6971] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:35:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:35:31.758183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4bcc35ad-02f4-4469-a9e7-b5db4637d21a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:31.759129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4bcc35ad-02f4-4469-a9e7-b5db4637d21a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:31.769712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bcc35ad-02f4-4469-a9e7-b5db4637d21a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:31.770489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bcc35ad-02f4-4469-a9e7-b5db4637d21a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:31.771142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bcc35ad-02f4-4469-a9e7-b5db4637d21a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:31.772143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bcc35ad-02f4-4469-a9e7-b5db4637d21a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:31.772828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bcc35ad-02f4-4469-a9e7-b5db4637d21a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:31.773477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4bcc35ad-02f4-4469-a9e7-b5db4637d21a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:31.913526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4bcc35ad-02f4-4469-a9e7-b5db4637d21a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:31.921721 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4bcc35ad-02f4-4469-a9e7-b5db4637d21a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1363 microversion: 2.1 time: 0.169273 Oct 05 18:35:31.922287 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3609/6972] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:31 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:32.946876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4c63648e-68cd-44cb-bf95-06b404c1d38e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:32.947538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4c63648e-68cd-44cb-bf95-06b404c1d38e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:32.950508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:35:32.951186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:35:32.957430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c63648e-68cd-44cb-bf95-06b404c1d38e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:32.957926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c63648e-68cd-44cb-bf95-06b404c1d38e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:32.958402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c63648e-68cd-44cb-bf95-06b404c1d38e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:32.959099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c63648e-68cd-44cb-bf95-06b404c1d38e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:32.959543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c63648e-68cd-44cb-bf95-06b404c1d38e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:32.959972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4c63648e-68cd-44cb-bf95-06b404c1d38e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:33.097518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4c63648e-68cd-44cb-bf95-06b404c1d38e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:35:33.106112 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4c63648e-68cd-44cb-bf95-06b404c1d38e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1549 microversion: 2.1 time: 0.163697 Oct 05 18:35:33.106731 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3364/6973] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:35:32 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:35:33.129220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-234430b9-502f-4eb7-b106-e0a1f37b3fa9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:35:33.129750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-234430b9-502f-4eb7-b106-e0a1f37b3fa9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:35:33.131679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:35:33.138373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234430b9-502f-4eb7-b106-e0a1f37b3fa9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:33.139192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234430b9-502f-4eb7-b106-e0a1f37b3fa9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:33.139649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234430b9-502f-4eb7-b106-e0a1f37b3fa9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:33.140364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234430b9-502f-4eb7-b106-e0a1f37b3fa9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:33.140838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234430b9-502f-4eb7-b106-e0a1f37b3fa9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:33.141283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-234430b9-502f-4eb7-b106-e0a1f37b3fa9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:33.227030 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-234430b9-502f-4eb7-b106-e0a1f37b3fa9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101352 Oct 05 18:35:33.227818 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3610/6974] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 18:35:33 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:35:34.265833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-90820c90-b46d-4a06-84a3-d0376b4684d2 req-a8197de0-08dd-4049-a936-e9b5b7eb95d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fb7467-7aa1-4f4c-92a0-d1264daaf888", "tag": "2bf66549-0e58-4b0c-81ac-a245d68a9539"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:35:34.297750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-90820c90-b46d-4a06-84a3-d0376b4684d2 req-a8197de0-08dd-4049-a936-e9b5b7eb95d0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:35:34.298228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-90820c90-b46d-4a06-84a3-d0376b4684d2 req-a8197de0-08dd-4049-a936-e9b5b7eb95d0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:35:34.298678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-90820c90-b46d-4a06-84a3-d0376b4684d2 req-a8197de0-08dd-4049-a936-e9b5b7eb95d0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:35:34.311167 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-90820c90-b46d-4a06-84a3-d0376b4684d2 req-a8197de0-08dd-4049-a936-e9b5b7eb95d0 service nova] Creating event network-changed:2bf66549-0e58-4b0c-81ac-a245d68a9539 for instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 on n-h2-835595-3 Oct 05 18:35:34.316750 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-90820c90-b46d-4a06-84a3-d0376b4684d2 req-a8197de0-08dd-4049-a936-e9b5b7eb95d0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113852 Oct 05 18:35:34.317352 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3365/6975] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:36:07.368362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=7 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:36:07.369229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=45 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:36:07.373425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bbfb2657-c5fb-41a2-abe5-d36bd760a864 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:07.380809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbfb2657-c5fb-41a2-abe5-d36bd760a864 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:07.381316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbfb2657-c5fb-41a2-abe5-d36bd760a864 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:07.381810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bbfb2657-c5fb-41a2-abe5-d36bd760a864 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:07.405768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bbfb2657-c5fb-41a2-abe5-d36bd760a864 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Going to try to stop instance {{(pid=128844) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 18:36:07.456026 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bbfb2657-c5fb-41a2-abe5-d36bd760a864 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888/action" status: 202 len: 0 microversion: 2.1 time: 0.089454 Oct 05 18:36:07.456639 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3611/6976] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:36:07 2022] POST /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:36:07.466157 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d7414374-1b7d-448f-bc59-8a1576676bc6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:07.466977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d7414374-1b7d-448f-bc59-8a1576676bc6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:07.469438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=7 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:36:07.470079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=38 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:36:07.476064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7414374-1b7d-448f-bc59-8a1576676bc6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:07.476594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7414374-1b7d-448f-bc59-8a1576676bc6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:07.477003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7414374-1b7d-448f-bc59-8a1576676bc6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:07.477760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7414374-1b7d-448f-bc59-8a1576676bc6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:07.478239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7414374-1b7d-448f-bc59-8a1576676bc6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:07.478698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d7414374-1b7d-448f-bc59-8a1576676bc6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:07.615894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d7414374-1b7d-448f-bc59-8a1576676bc6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:07.624813 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d7414374-1b7d-448f-bc59-8a1576676bc6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.163113 Oct 05 18:36:07.625396 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3366/6977] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:07 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:08.655158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5fdffda6-3d7a-43b3-81a0-16ff13bf2bfd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:08.655937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5fdffda6-3d7a-43b3-81a0-16ff13bf2bfd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:08.663205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fdffda6-3d7a-43b3-81a0-16ff13bf2bfd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:08.663779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fdffda6-3d7a-43b3-81a0-16ff13bf2bfd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:08.664281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fdffda6-3d7a-43b3-81a0-16ff13bf2bfd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:08.665075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fdffda6-3d7a-43b3-81a0-16ff13bf2bfd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:08.665603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fdffda6-3d7a-43b3-81a0-16ff13bf2bfd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:08.666101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fdffda6-3d7a-43b3-81a0-16ff13bf2bfd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:08.807371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5fdffda6-3d7a-43b3-81a0-16ff13bf2bfd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:08.816529 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5fdffda6-3d7a-43b3-81a0-16ff13bf2bfd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.170126 Oct 05 18:36:08.817143 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3612/6978] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:08 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:09.843892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c74287d9-4078-491e-928a-1ae79230b1f8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:09.844691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c74287d9-4078-491e-928a-1ae79230b1f8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:09.853003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c74287d9-4078-491e-928a-1ae79230b1f8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:09.853548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c74287d9-4078-491e-928a-1ae79230b1f8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:09.854032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c74287d9-4078-491e-928a-1ae79230b1f8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:09.854838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c74287d9-4078-491e-928a-1ae79230b1f8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:09.855349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c74287d9-4078-491e-928a-1ae79230b1f8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:09.855819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c74287d9-4078-491e-928a-1ae79230b1f8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:09.998575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c74287d9-4078-491e-928a-1ae79230b1f8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:10.006683 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c74287d9-4078-491e-928a-1ae79230b1f8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.169434 Oct 05 18:36:10.007275 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3367/6979] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:09 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:11.035045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-97881752-d5fd-4746-8138-296158cbd0d6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:11.036088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-97881752-d5fd-4746-8138-296158cbd0d6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:11.047790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97881752-d5fd-4746-8138-296158cbd0d6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:11.048299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97881752-d5fd-4746-8138-296158cbd0d6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:11.048759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97881752-d5fd-4746-8138-296158cbd0d6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:11.049474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97881752-d5fd-4746-8138-296158cbd0d6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:11.049955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97881752-d5fd-4746-8138-296158cbd0d6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:11.050426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-97881752-d5fd-4746-8138-296158cbd0d6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:11.191119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-97881752-d5fd-4746-8138-296158cbd0d6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:11.199724 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-97881752-d5fd-4746-8138-296158cbd0d6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.171396 Oct 05 18:36:11.200329 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3613/6980] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:11 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:12.226719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9eb7a84-87de-47a6-a070-3177c2124d8f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:12.227786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b9eb7a84-87de-47a6-a070-3177c2124d8f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:12.239533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9eb7a84-87de-47a6-a070-3177c2124d8f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:12.240668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9eb7a84-87de-47a6-a070-3177c2124d8f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:12.241719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9eb7a84-87de-47a6-a070-3177c2124d8f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:12.242928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9eb7a84-87de-47a6-a070-3177c2124d8f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:12.243755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9eb7a84-87de-47a6-a070-3177c2124d8f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:12.244574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b9eb7a84-87de-47a6-a070-3177c2124d8f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:12.385266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b9eb7a84-87de-47a6-a070-3177c2124d8f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:12.396321 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9eb7a84-87de-47a6-a070-3177c2124d8f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.176453 Oct 05 18:36:12.396908 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3368/6981] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:12 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:13.424076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d518782-92c7-405e-a731-1e4ff8691645 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:13.424851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9d518782-92c7-405e-a731-1e4ff8691645 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:13.433758 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d518782-92c7-405e-a731-1e4ff8691645 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:13.434415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d518782-92c7-405e-a731-1e4ff8691645 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:13.434976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d518782-92c7-405e-a731-1e4ff8691645 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:13.435848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d518782-92c7-405e-a731-1e4ff8691645 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:13.436432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d518782-92c7-405e-a731-1e4ff8691645 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:13.436973 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d518782-92c7-405e-a731-1e4ff8691645 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:13.576200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9d518782-92c7-405e-a731-1e4ff8691645 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:13.588134 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9d518782-92c7-405e-a731-1e4ff8691645 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.170625 Oct 05 18:36:13.588976 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3614/6982] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:13 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:14.613891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-82569c79-3241-4d6d-aea2-c7337339d3e0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:14.614549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-82569c79-3241-4d6d-aea2-c7337339d3e0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:14.621461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82569c79-3241-4d6d-aea2-c7337339d3e0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:14.621943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82569c79-3241-4d6d-aea2-c7337339d3e0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:14.622407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82569c79-3241-4d6d-aea2-c7337339d3e0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:14.623094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82569c79-3241-4d6d-aea2-c7337339d3e0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:14.623544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82569c79-3241-4d6d-aea2-c7337339d3e0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:14.623963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82569c79-3241-4d6d-aea2-c7337339d3e0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:14.766642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-82569c79-3241-4d6d-aea2-c7337339d3e0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:14.775009 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-82569c79-3241-4d6d-aea2-c7337339d3e0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.165111 Oct 05 18:36:14.775586 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3369/6983] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:14 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:15.802055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-20cc10ae-4b0a-4f53-a624-aee96bc486d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:15.803105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-20cc10ae-4b0a-4f53-a624-aee96bc486d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:15.814713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cc10ae-4b0a-4f53-a624-aee96bc486d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:15.815224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cc10ae-4b0a-4f53-a624-aee96bc486d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:15.815679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cc10ae-4b0a-4f53-a624-aee96bc486d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:15.816400 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cc10ae-4b0a-4f53-a624-aee96bc486d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:15.816899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cc10ae-4b0a-4f53-a624-aee96bc486d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:15.817349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20cc10ae-4b0a-4f53-a624-aee96bc486d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:15.960416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-20cc10ae-4b0a-4f53-a624-aee96bc486d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:15.968859 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-20cc10ae-4b0a-4f53-a624-aee96bc486d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.173524 Oct 05 18:36:15.969449 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3615/6984] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:15 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:16.999175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-31eaf018-3768-4345-9ed7-ea512c898ad9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:17.000203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-31eaf018-3768-4345-9ed7-ea512c898ad9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:17.012256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31eaf018-3768-4345-9ed7-ea512c898ad9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:17.013266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31eaf018-3768-4345-9ed7-ea512c898ad9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:17.013896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31eaf018-3768-4345-9ed7-ea512c898ad9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:17.015697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31eaf018-3768-4345-9ed7-ea512c898ad9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:17.016522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31eaf018-3768-4345-9ed7-ea512c898ad9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:17.017218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-31eaf018-3768-4345-9ed7-ea512c898ad9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:17.159495 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-31eaf018-3768-4345-9ed7-ea512c898ad9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:17.167834 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-31eaf018-3768-4345-9ed7-ea512c898ad9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.175339 Oct 05 18:36:17.168353 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3370/6985] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:16 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:18.195385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a8770bcf-bd8a-45c9-ae29-ee0835bf70f4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:18.196344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a8770bcf-bd8a-45c9-ae29-ee0835bf70f4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:18.208234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8770bcf-bd8a-45c9-ae29-ee0835bf70f4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:18.209088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8770bcf-bd8a-45c9-ae29-ee0835bf70f4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:18.209837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8770bcf-bd8a-45c9-ae29-ee0835bf70f4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:18.211120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8770bcf-bd8a-45c9-ae29-ee0835bf70f4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:18.211874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8770bcf-bd8a-45c9-ae29-ee0835bf70f4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:18.212611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a8770bcf-bd8a-45c9-ae29-ee0835bf70f4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:18.355709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a8770bcf-bd8a-45c9-ae29-ee0835bf70f4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:18.364087 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a8770bcf-bd8a-45c9-ae29-ee0835bf70f4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1653 microversion: 2.1 time: 0.175614 Oct 05 18:36:18.364676 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3616/6986] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:18 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1653 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:18.386958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:18.389656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:18.397116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:18.397603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:18.398037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:18.398763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:18.399211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:18.399634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:18.428863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:18.434415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Old instance type m1.heat2, new instance type m1.heat {{(pid=128843) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 18:36:18.441046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:36:18.441465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:36:18.441936 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:36:18.442371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:36:18.442779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:36:18.517951 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ccf07b0f-5f53-424f-bb94-b7563f8d5900 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888/action" status: 202 len: 0 microversion: 2.1 time: 0.134979 Oct 05 18:36:18.518648 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3371/6987] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:36:18 2022] POST /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:36:18.527105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87b5a85b-e884-4691-ab30-3e4d48fe19ec tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:18.527891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-87b5a85b-e884-4691-ab30-3e4d48fe19ec tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:18.534111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87b5a85b-e884-4691-ab30-3e4d48fe19ec tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:18.534658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87b5a85b-e884-4691-ab30-3e4d48fe19ec tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:18.535102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87b5a85b-e884-4691-ab30-3e4d48fe19ec tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:18.535799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87b5a85b-e884-4691-ab30-3e4d48fe19ec tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:18.536270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87b5a85b-e884-4691-ab30-3e4d48fe19ec tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:18.536697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87b5a85b-e884-4691-ab30-3e4d48fe19ec tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:18.692933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-87b5a85b-e884-4691-ab30-3e4d48fe19ec tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:18.701014 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87b5a85b-e884-4691-ab30-3e4d48fe19ec tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.178011 Oct 05 18:36:18.701699 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3617/6988] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:18 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:36:19.730864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0461a738-fc21-47af-8166-77ef81724da0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:19.731772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0461a738-fc21-47af-8166-77ef81724da0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:19.743421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0461a738-fc21-47af-8166-77ef81724da0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:19.744229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0461a738-fc21-47af-8166-77ef81724da0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:19.744962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0461a738-fc21-47af-8166-77ef81724da0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:19.746103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0461a738-fc21-47af-8166-77ef81724da0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:19.746923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0461a738-fc21-47af-8166-77ef81724da0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:19.747647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0461a738-fc21-47af-8166-77ef81724da0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:19.899115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0461a738-fc21-47af-8166-77ef81724da0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:19.907792 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0461a738-fc21-47af-8166-77ef81724da0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1676 microversion: 2.1 time: 0.185074 Oct 05 18:36:19.908396 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3372/6989] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:19 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1676 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:20.931352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e5b3f58b-5870-4bc0-8f81-e67e33f9ad5d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:20.931994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e5b3f58b-5870-4bc0-8f81-e67e33f9ad5d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:20.939998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5b3f58b-5870-4bc0-8f81-e67e33f9ad5d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:20.940534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5b3f58b-5870-4bc0-8f81-e67e33f9ad5d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:20.941011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5b3f58b-5870-4bc0-8f81-e67e33f9ad5d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:20.941748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5b3f58b-5870-4bc0-8f81-e67e33f9ad5d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:20.942300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5b3f58b-5870-4bc0-8f81-e67e33f9ad5d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:20.942776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e5b3f58b-5870-4bc0-8f81-e67e33f9ad5d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:21.081898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e5b3f58b-5870-4bc0-8f81-e67e33f9ad5d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:21.090321 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e5b3f58b-5870-4bc0-8f81-e67e33f9ad5d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1681 microversion: 2.1 time: 0.163226 Oct 05 18:36:21.090939 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3618/6990] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:20 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:22.114445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1c131063-1c8f-4a06-95a4-53679c366562 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:22.115069 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1c131063-1c8f-4a06-95a4-53679c366562 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:22.122361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c131063-1c8f-4a06-95a4-53679c366562 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:22.122881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c131063-1c8f-4a06-95a4-53679c366562 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:22.123321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c131063-1c8f-4a06-95a4-53679c366562 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:22.124024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c131063-1c8f-4a06-95a4-53679c366562 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:22.124482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c131063-1c8f-4a06-95a4-53679c366562 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:22.124913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c131063-1c8f-4a06-95a4-53679c366562 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:22.262337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1c131063-1c8f-4a06-95a4-53679c366562 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:22.270706 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1c131063-1c8f-4a06-95a4-53679c366562 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1681 microversion: 2.1 time: 0.160452 Oct 05 18:36:22.271289 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3373/6991] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:22 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:22.789784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-0da892ba-a0f7-412e-b9e9-d6ffa62de938 req-86bde133-2343-45bb-8f28-f8393dfa2b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fb7467-7aa1-4f4c-92a0-d1264daaf888", "name": "network-vif-unplugged", "status": "completed", "tag": "2bf66549-0e58-4b0c-81ac-a245d68a9539"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:22.802318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0da892ba-a0f7-412e-b9e9-d6ffa62de938 req-86bde133-2343-45bb-8f28-f8393dfa2b4b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:22.803225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0da892ba-a0f7-412e-b9e9-d6ffa62de938 req-86bde133-2343-45bb-8f28-f8393dfa2b4b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:22.804315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-0da892ba-a0f7-412e-b9e9-d6ffa62de938 req-86bde133-2343-45bb-8f28-f8393dfa2b4b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:22.829531 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-0da892ba-a0f7-412e-b9e9-d6ffa62de938 req-86bde133-2343-45bb-8f28-f8393dfa2b4b service nova] Creating event network-vif-unplugged:2bf66549-0e58-4b0c-81ac-a245d68a9539 for instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 on n-h1-835595-3 Oct 05 18:36:22.839878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-0da892ba-a0f7-412e-b9e9-d6ffa62de938 req-86bde133-2343-45bb-8f28-f8393dfa2b4b service nova] Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:36:22.860565 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-0da892ba-a0f7-412e-b9e9-d6ffa62de938 req-86bde133-2343-45bb-8f28-f8393dfa2b4b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075152 Oct 05 18:36:22.861634 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3619/6992] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:36:23.295857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f2f0be6c-df74-41e0-a8de-f745d274976d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:23.296467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f2f0be6c-df74-41e0-a8de-f745d274976d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:23.303524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2f0be6c-df74-41e0-a8de-f745d274976d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:23.304016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2f0be6c-df74-41e0-a8de-f745d274976d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:23.304456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2f0be6c-df74-41e0-a8de-f745d274976d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:23.305295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2f0be6c-df74-41e0-a8de-f745d274976d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:23.305969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2f0be6c-df74-41e0-a8de-f745d274976d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:23.306539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f2f0be6c-df74-41e0-a8de-f745d274976d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:23.535034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f2f0be6c-df74-41e0-a8de-f745d274976d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:23.543243 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f2f0be6c-df74-41e0-a8de-f745d274976d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1680 microversion: 2.1 time: 0.252562 Oct 05 18:36:23.543795 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3374/6993] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:23 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1680 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:24.573646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-61f7462f-a7c2-4bd6-b631-b02c307f2636 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:24.574868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-61f7462f-a7c2-4bd6-b631-b02c307f2636 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:24.583950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61f7462f-a7c2-4bd6-b631-b02c307f2636 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:24.584456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61f7462f-a7c2-4bd6-b631-b02c307f2636 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:24.584910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61f7462f-a7c2-4bd6-b631-b02c307f2636 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:24.585623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61f7462f-a7c2-4bd6-b631-b02c307f2636 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:24.586109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61f7462f-a7c2-4bd6-b631-b02c307f2636 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:24.586575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-61f7462f-a7c2-4bd6-b631-b02c307f2636 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:24.724108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-61f7462f-a7c2-4bd6-b631-b02c307f2636 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:24.732249 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-61f7462f-a7c2-4bd6-b631-b02c307f2636 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1678 microversion: 2.1 time: 0.167432 Oct 05 18:36:24.732842 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3620/6994] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:24 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:24.908389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f81f04a3-eba1-4bc1-bfab-e5dc2526f0aa req-ecaa1703-cb32-4a03-8ae7-9e1cc3e0d0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99fb7467-7aa1-4f4c-92a0-d1264daaf888", "tag": "2bf66549-0e58-4b0c-81ac-a245d68a9539"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:24.919052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f81f04a3-eba1-4bc1-bfab-e5dc2526f0aa req-ecaa1703-cb32-4a03-8ae7-9e1cc3e0d0e2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:24.919533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f81f04a3-eba1-4bc1-bfab-e5dc2526f0aa req-ecaa1703-cb32-4a03-8ae7-9e1cc3e0d0e2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:24.919968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f81f04a3-eba1-4bc1-bfab-e5dc2526f0aa req-ecaa1703-cb32-4a03-8ae7-9e1cc3e0d0e2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:24.932109 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f81f04a3-eba1-4bc1-bfab-e5dc2526f0aa req-ecaa1703-cb32-4a03-8ae7-9e1cc3e0d0e2 service nova] Creating event network-changed:2bf66549-0e58-4b0c-81ac-a245d68a9539 for instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 on n-h1-835595-3 Oct 05 18:36:24.938028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-f81f04a3-eba1-4bc1-bfab-e5dc2526f0aa req-ecaa1703-cb32-4a03-8ae7-9e1cc3e0d0e2 service nova] Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:36:24.951333 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f81f04a3-eba1-4bc1-bfab-e5dc2526f0aa req-ecaa1703-cb32-4a03-8ae7-9e1cc3e0d0e2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049428 Oct 05 18:36:24.951963 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3375/6995] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:36:25.756895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2e73b44b-731c-4216-a011-49a546e7a8d0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:25.757453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2e73b44b-731c-4216-a011-49a546e7a8d0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:25.765206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e73b44b-731c-4216-a011-49a546e7a8d0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:25.765725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e73b44b-731c-4216-a011-49a546e7a8d0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:25.766184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e73b44b-731c-4216-a011-49a546e7a8d0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:25.766949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e73b44b-731c-4216-a011-49a546e7a8d0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:25.767429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e73b44b-731c-4216-a011-49a546e7a8d0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:25.767877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2e73b44b-731c-4216-a011-49a546e7a8d0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:25.907714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2e73b44b-731c-4216-a011-49a546e7a8d0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:25.916079 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2e73b44b-731c-4216-a011-49a546e7a8d0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1674 microversion: 2.1 time: 0.163504 Oct 05 18:36:25.916666 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3621/6996] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:25 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:25.940460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6874f9c5-9319-49fe-94fe-a67e5cd3c0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:25.941056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6874f9c5-9319-49fe-94fe-a67e5cd3c0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:25.947873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6874f9c5-9319-49fe-94fe-a67e5cd3c0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:25.948611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6874f9c5-9319-49fe-94fe-a67e5cd3c0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:25.949044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6874f9c5-9319-49fe-94fe-a67e5cd3c0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:25.949736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6874f9c5-9319-49fe-94fe-a67e5cd3c0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:25.950164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6874f9c5-9319-49fe-94fe-a67e5cd3c0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:25.950609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6874f9c5-9319-49fe-94fe-a67e5cd3c0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:26.015640 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6874f9c5-9319-49fe-94fe-a67e5cd3c0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888/action" status: 204 len: 0 microversion: 2.1 time: 0.080173 Oct 05 18:36:26.016309 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3376/6997] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:36:25 2022] POST /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:36:26.024844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f51d8e2b-bba8-44e4-afd2-7bb671c71511 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:26.025590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f51d8e2b-bba8-44e4-afd2-7bb671c71511 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:26.031879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f51d8e2b-bba8-44e4-afd2-7bb671c71511 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:26.032470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f51d8e2b-bba8-44e4-afd2-7bb671c71511 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:26.032997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f51d8e2b-bba8-44e4-afd2-7bb671c71511 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:26.033770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f51d8e2b-bba8-44e4-afd2-7bb671c71511 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:26.034272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f51d8e2b-bba8-44e4-afd2-7bb671c71511 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:26.034720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f51d8e2b-bba8-44e4-afd2-7bb671c71511 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:26.168290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f51d8e2b-bba8-44e4-afd2-7bb671c71511 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:26.176467 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f51d8e2b-bba8-44e4-afd2-7bb671c71511 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1674 microversion: 2.1 time: 0.155651 Oct 05 18:36:26.177075 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3622/6998] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:26 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:27.201336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f7bf519-e20a-4087-9dbe-8bcd3e5eb101 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:27.202066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5f7bf519-e20a-4087-9dbe-8bcd3e5eb101 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:27.208298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f7bf519-e20a-4087-9dbe-8bcd3e5eb101 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:27.208796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f7bf519-e20a-4087-9dbe-8bcd3e5eb101 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:27.209213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f7bf519-e20a-4087-9dbe-8bcd3e5eb101 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:27.209905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f7bf519-e20a-4087-9dbe-8bcd3e5eb101 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:27.210391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f7bf519-e20a-4087-9dbe-8bcd3e5eb101 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:27.210828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f7bf519-e20a-4087-9dbe-8bcd3e5eb101 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:27.345948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5f7bf519-e20a-4087-9dbe-8bcd3e5eb101 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:27.354293 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5f7bf519-e20a-4087-9dbe-8bcd3e5eb101 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1653 microversion: 2.1 time: 0.158187 Oct 05 18:36:27.354882 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3377/6999] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:27 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1653 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:27.378789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eba179e4-7e42-493b-99fb-60943f055bda tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:27.379570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eba179e4-7e42-493b-99fb-60943f055bda tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:27.386089 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba179e4-7e42-493b-99fb-60943f055bda tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:27.386665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba179e4-7e42-493b-99fb-60943f055bda tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:27.387114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba179e4-7e42-493b-99fb-60943f055bda tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:27.387819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba179e4-7e42-493b-99fb-60943f055bda tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:27.388284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba179e4-7e42-493b-99fb-60943f055bda tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:27.388718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-eba179e4-7e42-493b-99fb-60943f055bda tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:27.527164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eba179e4-7e42-493b-99fb-60943f055bda tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:27.539566 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eba179e4-7e42-493b-99fb-60943f055bda tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1653 microversion: 2.1 time: 0.164467 Oct 05 18:36:27.540375 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3623/7000] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:27 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1653 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:27.566051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8afe30e3-7aa3-47df-8a16-5b4ea2b1dce5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:27.572515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8afe30e3-7aa3-47df-8a16-5b4ea2b1dce5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:27.573032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8afe30e3-7aa3-47df-8a16-5b4ea2b1dce5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:27.573453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8afe30e3-7aa3-47df-8a16-5b4ea2b1dce5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:27.596103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8afe30e3-7aa3-47df-8a16-5b4ea2b1dce5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Going to try to start instance {{(pid=128843) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 18:36:27.648342 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8afe30e3-7aa3-47df-8a16-5b4ea2b1dce5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888/action" status: 202 len: 0 microversion: 2.1 time: 0.086120 Oct 05 18:36:27.648963 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3378/7001] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:36:27 2022] POST /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:36:27.658512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-efa2cfb1-f90c-4d85-a6ca-4ab08c60fed6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:27.659150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-efa2cfb1-f90c-4d85-a6ca-4ab08c60fed6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:27.666313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa2cfb1-f90c-4d85-a6ca-4ab08c60fed6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:27.666825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa2cfb1-f90c-4d85-a6ca-4ab08c60fed6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:27.667280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa2cfb1-f90c-4d85-a6ca-4ab08c60fed6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:27.668009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa2cfb1-f90c-4d85-a6ca-4ab08c60fed6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:27.668706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa2cfb1-f90c-4d85-a6ca-4ab08c60fed6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:27.669252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efa2cfb1-f90c-4d85-a6ca-4ab08c60fed6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:27.811805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-efa2cfb1-f90c-4d85-a6ca-4ab08c60fed6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:27.820223 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-efa2cfb1-f90c-4d85-a6ca-4ab08c60fed6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1662 microversion: 2.1 time: 0.165803 Oct 05 18:36:27.820811 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3624/7002] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:27 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1662 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:28.788828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-194aa86d-3bde-412b-8741-cea5a5d51a41 req-f041ec2c-8a51-4198-a7f0-a5cb7ef47dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fb7467-7aa1-4f4c-92a0-d1264daaf888", "name": "network-vif-plugged", "status": "completed", "tag": "2bf66549-0e58-4b0c-81ac-a245d68a9539"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:28.800387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-194aa86d-3bde-412b-8741-cea5a5d51a41 req-f041ec2c-8a51-4198-a7f0-a5cb7ef47dad service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:28.801651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-194aa86d-3bde-412b-8741-cea5a5d51a41 req-f041ec2c-8a51-4198-a7f0-a5cb7ef47dad service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:28.802521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-194aa86d-3bde-412b-8741-cea5a5d51a41 req-f041ec2c-8a51-4198-a7f0-a5cb7ef47dad service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:28.825283 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-194aa86d-3bde-412b-8741-cea5a5d51a41 req-f041ec2c-8a51-4198-a7f0-a5cb7ef47dad service nova] Creating event network-vif-plugged:2bf66549-0e58-4b0c-81ac-a245d68a9539 for instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 on n-h1-835595-3 Oct 05 18:36:28.830468 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-194aa86d-3bde-412b-8741-cea5a5d51a41 req-f041ec2c-8a51-4198-a7f0-a5cb7ef47dad service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102712 Oct 05 18:36:28.831430 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3379/7003] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:36:28.843449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26b944fe-443a-4672-b67e-daed7e691d3f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:28.844367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-26b944fe-443a-4672-b67e-daed7e691d3f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:28.851692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26b944fe-443a-4672-b67e-daed7e691d3f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:28.852196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26b944fe-443a-4672-b67e-daed7e691d3f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:28.852648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26b944fe-443a-4672-b67e-daed7e691d3f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:28.853367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26b944fe-443a-4672-b67e-daed7e691d3f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:28.853877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26b944fe-443a-4672-b67e-daed7e691d3f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:28.854336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26b944fe-443a-4672-b67e-daed7e691d3f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:28.992149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-26b944fe-443a-4672-b67e-daed7e691d3f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:29.003621 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-26b944fe-443a-4672-b67e-daed7e691d3f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1666 microversion: 2.1 time: 0.164041 Oct 05 18:36:29.004439 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3625/7004] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:28 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:29.027534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d00d2656-1d3e-45f4-848a-536263d5e0f9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:29.028129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d00d2656-1d3e-45f4-848a-536263d5e0f9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:29.034828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d00d2656-1d3e-45f4-848a-536263d5e0f9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:29.035313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d00d2656-1d3e-45f4-848a-536263d5e0f9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:29.035777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d00d2656-1d3e-45f4-848a-536263d5e0f9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:29.036765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d00d2656-1d3e-45f4-848a-536263d5e0f9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:29.037253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d00d2656-1d3e-45f4-848a-536263d5e0f9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:29.037662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d00d2656-1d3e-45f4-848a-536263d5e0f9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:29.040603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:36:29.068278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d00d2656-1d3e-45f4-848a-536263d5e0f9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:36:29.153144 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d00d2656-1d3e-45f4-848a-536263d5e0f9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "DELETE /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 204 len: 0 microversion: 2.1 time: 0.129628 Oct 05 18:36:29.154090 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3380/7005] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:36:29 2022] DELETE /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:36:29.162748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e2321b5a-9dbb-4e2a-ad26-786cdef2cf58 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:29.163593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e2321b5a-9dbb-4e2a-ad26-786cdef2cf58 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:29.170214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2321b5a-9dbb-4e2a-ad26-786cdef2cf58 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:29.170866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2321b5a-9dbb-4e2a-ad26-786cdef2cf58 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:29.171414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2321b5a-9dbb-4e2a-ad26-786cdef2cf58 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:29.172298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2321b5a-9dbb-4e2a-ad26-786cdef2cf58 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:29.172854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2321b5a-9dbb-4e2a-ad26-786cdef2cf58 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:29.173369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2321b5a-9dbb-4e2a-ad26-786cdef2cf58 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:29.312472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e2321b5a-9dbb-4e2a-ad26-786cdef2cf58 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:29.316300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:36:29.322230 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e2321b5a-9dbb-4e2a-ad26-786cdef2cf58 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1672 microversion: 2.1 time: 0.163767 Oct 05 18:36:29.322914 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3626/7006] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:29 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:30.350298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0c9cd14-6cb4-4ef2-8928-63d387ff199d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:30.351588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e0c9cd14-6cb4-4ef2-8928-63d387ff199d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:30.363207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0c9cd14-6cb4-4ef2-8928-63d387ff199d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:30.363934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0c9cd14-6cb4-4ef2-8928-63d387ff199d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:30.364392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0c9cd14-6cb4-4ef2-8928-63d387ff199d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:30.365068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0c9cd14-6cb4-4ef2-8928-63d387ff199d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:30.365524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0c9cd14-6cb4-4ef2-8928-63d387ff199d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:30.365947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0c9cd14-6cb4-4ef2-8928-63d387ff199d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:30.518646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e0c9cd14-6cb4-4ef2-8928-63d387ff199d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:30.527204 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e0c9cd14-6cb4-4ef2-8928-63d387ff199d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1672 microversion: 2.1 time: 0.184084 Oct 05 18:36:30.527895 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3381/7007] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:30 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:31.552072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-411b49e1-8dca-433f-a56c-7400cce4e646 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:31.553786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-411b49e1-8dca-433f-a56c-7400cce4e646 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:31.564772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-411b49e1-8dca-433f-a56c-7400cce4e646 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:31.565440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-411b49e1-8dca-433f-a56c-7400cce4e646 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:31.565993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-411b49e1-8dca-433f-a56c-7400cce4e646 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:31.567037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-411b49e1-8dca-433f-a56c-7400cce4e646 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:31.567637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-411b49e1-8dca-433f-a56c-7400cce4e646 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:31.568191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-411b49e1-8dca-433f-a56c-7400cce4e646 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:31.643934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-411b49e1-8dca-433f-a56c-7400cce4e646 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:31.653735 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-411b49e1-8dca-433f-a56c-7400cce4e646 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 200 len: 1605 microversion: 2.1 time: 0.106675 Oct 05 18:36:31.671537 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3627/7008] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:31 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 1605 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:31.723304 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3f5294fe-a1b3-4d1e-ac97-7dad07b19337 req-94f292e6-f313-4a3b-8281-12260b8af9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99fb7467-7aa1-4f4c-92a0-d1264daaf888", "name": "network-vif-deleted", "tag": "2bf66549-0e58-4b0c-81ac-a245d68a9539"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:31.734546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3f5294fe-a1b3-4d1e-ac97-7dad07b19337 req-94f292e6-f313-4a3b-8281-12260b8af9ed service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:31.735031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3f5294fe-a1b3-4d1e-ac97-7dad07b19337 req-94f292e6-f313-4a3b-8281-12260b8af9ed service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:31.735469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3f5294fe-a1b3-4d1e-ac97-7dad07b19337 req-94f292e6-f313-4a3b-8281-12260b8af9ed service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:31.747692 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3f5294fe-a1b3-4d1e-ac97-7dad07b19337 req-94f292e6-f313-4a3b-8281-12260b8af9ed service nova] Creating event network-vif-deleted:2bf66549-0e58-4b0c-81ac-a245d68a9539 for instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 on n-h1-835595-3 Oct 05 18:36:31.753222 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3f5294fe-a1b3-4d1e-ac97-7dad07b19337 req-94f292e6-f313-4a3b-8281-12260b8af9ed service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033757 Oct 05 18:36:31.754009 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3382/7009] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:36:32.677408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:32.678077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:32.685355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:32.685870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:32.686352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:32.687087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:32.687569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:32.688015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:32.703928 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 HTTP/1.1 Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '99fb7467-7aa1-4f4c-92a0-d1264daaf888'} Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:36:32.705640 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:36:32.713899 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:36:32.713899 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:36:32.713899 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:36:32.713899 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:36:32.713899 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:36:32.713899 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:36:32.713899 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:36:32.713899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:36:32.713899 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf8799e2-d599-44eb-affe-000aa99aeeba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 404 len: 111 microversion: 2.1 time: 0.033859 Oct 05 18:36:32.713899 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3628/7010] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:32 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:36:32.725458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:32.726298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:32.732861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:32.733348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:32.733777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:32.734494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:32.734946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:32.735500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:32.750048 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 HTTP/1.1 Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '99fb7467-7aa1-4f4c-92a0-d1264daaf888'} Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:36:32.752132 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:36:32.756543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:36:32.756543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:36:32.756543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:36:32.756543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:36:32.756543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:36:32.756543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:36:32.756543 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:36:32.756543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:36:32.756543 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-973cd2a5-8e00-4f4d-9275-fb63941bab8d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 404 len: 111 microversion: 2.1 time: 0.032763 Oct 05 18:36:32.756543 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3383/7011] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:32 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:36:32.804532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-71026255", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "d10090ce-6507-4a6c-8839-056a2634ec6b"}], "security_groups": [{"name": "tempest-securitygroup--981366362"}], "key_name": "tempest-keypair-307237400", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:32.911438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] validate_networks() for [('d10090ce-6507-4a6c-8839-056a2634ec6b', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:36:33.353069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:36:33.353808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:36:33.354715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:36:33.355433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:36:33.356202 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:36:33.368733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:33.369243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:33.369701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:33.370495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:33.370975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:33.371421 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:33.390368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:36:33.396206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for user 654ce2fda5024f6783ef6e2faf2f6617 and project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:36:33.409128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:36:33.411530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:36:33.470655 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6d6c99ec-9caa-49bf-833f-e67ba394f655 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.670253 Oct 05 18:36:33.471337 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3629/7012] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:36:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:36:33.483206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3a50e18f-09f8-4443-ab1f-3638868cbcac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:33.483820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3a50e18f-09f8-4443-ab1f-3638868cbcac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:33.542903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3a50e18f-09f8-4443-ab1f-3638868cbcac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:33.550326 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3a50e18f-09f8-4443-ab1f-3638868cbcac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1236 microversion: 2.1 time: 0.071371 Oct 05 18:36:33.551053 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3384/7013] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:33 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:34.574588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-396be288-1461-4047-a7ba-c0f79e176938 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:34.575230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-396be288-1461-4047-a7ba-c0f79e176938 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:34.582648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-396be288-1461-4047-a7ba-c0f79e176938 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:34.583186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-396be288-1461-4047-a7ba-c0f79e176938 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:34.583867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-396be288-1461-4047-a7ba-c0f79e176938 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:34.584580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-396be288-1461-4047-a7ba-c0f79e176938 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:34.585219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-396be288-1461-4047-a7ba-c0f79e176938 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:34.585825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-396be288-1461-4047-a7ba-c0f79e176938 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:34.656938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-396be288-1461-4047-a7ba-c0f79e176938 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:34.665367 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-396be288-1461-4047-a7ba-c0f79e176938 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1288 microversion: 2.1 time: 0.095767 Oct 05 18:36:34.665938 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3630/7014] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:34 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:35.690872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e53c88ae-7c94-445e-92bf-8249b0dbfea7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:35.691475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e53c88ae-7c94-445e-92bf-8249b0dbfea7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:35.699306 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e53c88ae-7c94-445e-92bf-8249b0dbfea7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:35.699800 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e53c88ae-7c94-445e-92bf-8249b0dbfea7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:35.700243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e53c88ae-7c94-445e-92bf-8249b0dbfea7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:35.700941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e53c88ae-7c94-445e-92bf-8249b0dbfea7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:35.701384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e53c88ae-7c94-445e-92bf-8249b0dbfea7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:35.701809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e53c88ae-7c94-445e-92bf-8249b0dbfea7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:35.924554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e53c88ae-7c94-445e-92bf-8249b0dbfea7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:35.934326 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e53c88ae-7c94-445e-92bf-8249b0dbfea7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1361 microversion: 2.1 time: 0.247185 Oct 05 18:36:35.935027 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3385/7015] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:35 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1361 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:36.161952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6e77d896-8371-409e-907c-76ff7eb5cc8b req-8773d726-ee8c-4f6e-a68e-ed86b1e73ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba983e6-32ac-448e-bbe7-f55042b3cc5a", "tag": "9cb7d5e0-bb2b-43b1-ac60-042b8b784169"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:36.173603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6e77d896-8371-409e-907c-76ff7eb5cc8b req-8773d726-ee8c-4f6e-a68e-ed86b1e73ace service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:36.174105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6e77d896-8371-409e-907c-76ff7eb5cc8b req-8773d726-ee8c-4f6e-a68e-ed86b1e73ace service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:36.174596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6e77d896-8371-409e-907c-76ff7eb5cc8b req-8773d726-ee8c-4f6e-a68e-ed86b1e73ace service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:36.186426 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6e77d896-8371-409e-907c-76ff7eb5cc8b req-8773d726-ee8c-4f6e-a68e-ed86b1e73ace service nova] Creating event network-changed:9cb7d5e0-bb2b-43b1-ac60-042b8b784169 for instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a on n-h2-835595-3 Oct 05 18:36:36.191664 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6e77d896-8371-409e-907c-76ff7eb5cc8b req-8773d726-ee8c-4f6e-a68e-ed86b1e73ace service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033774 Oct 05 18:36:36.192277 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3631/7016] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:36:36.958472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5025f03a-1a63-489d-b9d2-2c97cf393724 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:36.959179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5025f03a-1a63-489d-b9d2-2c97cf393724 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:36.966792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5025f03a-1a63-489d-b9d2-2c97cf393724 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:36.967361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5025f03a-1a63-489d-b9d2-2c97cf393724 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:36.967808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5025f03a-1a63-489d-b9d2-2c97cf393724 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:36.968516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5025f03a-1a63-489d-b9d2-2c97cf393724 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:36.968955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5025f03a-1a63-489d-b9d2-2c97cf393724 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:36.969418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5025f03a-1a63-489d-b9d2-2c97cf393724 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:37.102931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5025f03a-1a63-489d-b9d2-2c97cf393724 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:37.110995 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5025f03a-1a63-489d-b9d2-2c97cf393724 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1361 microversion: 2.1 time: 0.156980 Oct 05 18:36:37.111577 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3386/7017] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:36 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:38.135922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86eeb4f2-7985-4f0a-b09a-ca4d5fd6a3a8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:38.136634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-86eeb4f2-7985-4f0a-b09a-ca4d5fd6a3a8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:38.138761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:36:38.145336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86eeb4f2-7985-4f0a-b09a-ca4d5fd6a3a8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:38.145878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86eeb4f2-7985-4f0a-b09a-ca4d5fd6a3a8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:38.146368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86eeb4f2-7985-4f0a-b09a-ca4d5fd6a3a8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:38.147073 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86eeb4f2-7985-4f0a-b09a-ca4d5fd6a3a8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:38.147543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86eeb4f2-7985-4f0a-b09a-ca4d5fd6a3a8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:38.147983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86eeb4f2-7985-4f0a-b09a-ca4d5fd6a3a8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:38.300002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-86eeb4f2-7985-4f0a-b09a-ca4d5fd6a3a8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:38.308417 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-86eeb4f2-7985-4f0a-b09a-ca4d5fd6a3a8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1361 microversion: 2.1 time: 0.177811 Oct 05 18:36:38.309140 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3632/7018] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:38 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:39.333192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1db6a3d0-61a9-476e-93c0-c22acb7054b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:39.333834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1db6a3d0-61a9-476e-93c0-c22acb7054b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:39.336873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:36:39.342320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1db6a3d0-61a9-476e-93c0-c22acb7054b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:39.342809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1db6a3d0-61a9-476e-93c0-c22acb7054b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:39.343244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1db6a3d0-61a9-476e-93c0-c22acb7054b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:39.343947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1db6a3d0-61a9-476e-93c0-c22acb7054b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:39.344404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1db6a3d0-61a9-476e-93c0-c22acb7054b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:39.344830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1db6a3d0-61a9-476e-93c0-c22acb7054b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:39.476600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1db6a3d0-61a9-476e-93c0-c22acb7054b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:39.484554 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1db6a3d0-61a9-476e-93c0-c22acb7054b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1361 microversion: 2.1 time: 0.155490 Oct 05 18:36:39.485145 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3387/7019] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:39 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:40.512724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-76959ae3-8783-42ed-a385-6ac41a7086ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:40.513788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-76959ae3-8783-42ed-a385-6ac41a7086ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:40.526066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76959ae3-8783-42ed-a385-6ac41a7086ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:40.526969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76959ae3-8783-42ed-a385-6ac41a7086ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:40.527772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76959ae3-8783-42ed-a385-6ac41a7086ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:40.528921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76959ae3-8783-42ed-a385-6ac41a7086ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:40.529719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76959ae3-8783-42ed-a385-6ac41a7086ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:40.530512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-76959ae3-8783-42ed-a385-6ac41a7086ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:40.667305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-76959ae3-8783-42ed-a385-6ac41a7086ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:40.678912 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-76959ae3-8783-42ed-a385-6ac41a7086ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1361 microversion: 2.1 time: 0.172559 Oct 05 18:36:40.679713 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3633/7020] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:40 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:41.383386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4418da91-7acf-493d-92ca-d8966fabca24 req-be42936e-e8ea-4750-af66-999c68a45a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba983e6-32ac-448e-bbe7-f55042b3cc5a", "name": "network-vif-plugged", "status": "completed", "tag": "9cb7d5e0-bb2b-43b1-ac60-042b8b784169"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:41.394671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4418da91-7acf-493d-92ca-d8966fabca24 req-be42936e-e8ea-4750-af66-999c68a45a5c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:41.395152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4418da91-7acf-493d-92ca-d8966fabca24 req-be42936e-e8ea-4750-af66-999c68a45a5c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:41.395583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4418da91-7acf-493d-92ca-d8966fabca24 req-be42936e-e8ea-4750-af66-999c68a45a5c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:41.412036 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4418da91-7acf-493d-92ca-d8966fabca24 req-be42936e-e8ea-4750-af66-999c68a45a5c service nova] Creating event network-vif-plugged:9cb7d5e0-bb2b-43b1-ac60-042b8b784169 for instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a on n-h2-835595-3 Oct 05 18:36:41.417462 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4418da91-7acf-493d-92ca-d8966fabca24 req-be42936e-e8ea-4750-af66-999c68a45a5c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038273 Oct 05 18:36:41.418090 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3388/7021] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:36:41.709840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c46ed96-2e17-445a-9911-dd36e5066aaa tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:41.710483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c46ed96-2e17-445a-9911-dd36e5066aaa tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:41.717927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c46ed96-2e17-445a-9911-dd36e5066aaa tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:41.718470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c46ed96-2e17-445a-9911-dd36e5066aaa tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:41.718922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c46ed96-2e17-445a-9911-dd36e5066aaa tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:41.719645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c46ed96-2e17-445a-9911-dd36e5066aaa tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:41.720124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c46ed96-2e17-445a-9911-dd36e5066aaa tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:41.720571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c46ed96-2e17-445a-9911-dd36e5066aaa tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:41.854628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0c46ed96-2e17-445a-9911-dd36e5066aaa tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:41.862834 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0c46ed96-2e17-445a-9911-dd36e5066aaa tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1361 microversion: 2.1 time: 0.158871 Oct 05 18:36:41.863467 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3634/7022] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:41 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:42.891992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-be99b465-5422-48cd-8d79-4bfb33141925 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:42.893159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-be99b465-5422-48cd-8d79-4bfb33141925 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:42.905201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be99b465-5422-48cd-8d79-4bfb33141925 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:42.906015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be99b465-5422-48cd-8d79-4bfb33141925 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:42.906809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be99b465-5422-48cd-8d79-4bfb33141925 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:42.907971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be99b465-5422-48cd-8d79-4bfb33141925 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:42.908736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be99b465-5422-48cd-8d79-4bfb33141925 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:42.909448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-be99b465-5422-48cd-8d79-4bfb33141925 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:43.045417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-be99b465-5422-48cd-8d79-4bfb33141925 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:36:43.053922 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-be99b465-5422-48cd-8d79-4bfb33141925 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1548 microversion: 2.1 time: 0.169712 Oct 05 18:36:43.054559 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3389/7023] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:36:42 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:36:43.077606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2f8edac6-f154-4f92-b981-24dd94b5519a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:36:43.078134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2f8edac6-f154-4f92-b981-24dd94b5519a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:36:43.085370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f8edac6-f154-4f92-b981-24dd94b5519a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:43.085878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f8edac6-f154-4f92-b981-24dd94b5519a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:43.086359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f8edac6-f154-4f92-b981-24dd94b5519a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:43.087072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f8edac6-f154-4f92-b981-24dd94b5519a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:43.087544 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f8edac6-f154-4f92-b981-24dd94b5519a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:43.087983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2f8edac6-f154-4f92-b981-24dd94b5519a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:43.180502 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2f8edac6-f154-4f92-b981-24dd94b5519a tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106471 Oct 05 18:36:43.181480 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3635/7024] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 18:36:43 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:36:44.175918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-847dd0f3-2842-4728-a186-3b3f3071658e req-b92cfb53-4909-4e28-84b0-7c1be3a2ad0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba983e6-32ac-448e-bbe7-f55042b3cc5a", "tag": "9cb7d5e0-bb2b-43b1-ac60-042b8b784169"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:36:44.181093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:36:44.187621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-847dd0f3-2842-4728-a186-3b3f3071658e req-b92cfb53-4909-4e28-84b0-7c1be3a2ad0d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:36:44.188227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-847dd0f3-2842-4728-a186-3b3f3071658e req-b92cfb53-4909-4e28-84b0-7c1be3a2ad0d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:36:44.188710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-847dd0f3-2842-4728-a186-3b3f3071658e req-b92cfb53-4909-4e28-84b0-7c1be3a2ad0d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:36:44.199972 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-847dd0f3-2842-4728-a186-3b3f3071658e req-b92cfb53-4909-4e28-84b0-7c1be3a2ad0d service nova] Creating event network-changed:9cb7d5e0-bb2b-43b1-ac60-042b8b784169 for instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a on n-h2-835595-3 Oct 05 18:36:44.204923 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-847dd0f3-2842-4728-a186-3b3f3071658e req-b92cfb53-4909-4e28-84b0-7c1be3a2ad0d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032854 Oct 05 18:36:44.205536 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3390/7025] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:17.406233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:17.407122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:17.409066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=7 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:17.409748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=40 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:17.410822 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:37:17.410992 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:37:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a/action (ip 10.222.0.70) !!! Oct 05 18:37:17.416688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:17.419084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:17.433396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:17.433901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:17.434391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:17.435097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:17.435596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:17.436035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:17.464819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:17.470856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Old instance type m1.heat2, new instance type m1.heat {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 18:37:17.477798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:37:17.478243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:37:17.478779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:37:17.479206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:37:17.479635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:37:17.556841 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8196154b-f2b9-4b20-8e38-ae32cac71cd9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a/action" status: 202 len: 0 microversion: 2.1 time: 0.151184 Oct 05 18:37:17.557719 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3636/7026] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:37:17 2022] POST /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:37:17.564217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=7 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:17.565190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:17.566350 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:37:17.566473 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:37:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a (ip 10.222.0.70) !!! Oct 05 18:37:17.571421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0a4bf8f5-3b25-4c86-ac05-c90d579ea5d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:17.572117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0a4bf8f5-3b25-4c86-ac05-c90d579ea5d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:17.582952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a4bf8f5-3b25-4c86-ac05-c90d579ea5d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:17.583824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a4bf8f5-3b25-4c86-ac05-c90d579ea5d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:17.584278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a4bf8f5-3b25-4c86-ac05-c90d579ea5d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:17.585118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a4bf8f5-3b25-4c86-ac05-c90d579ea5d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:17.585620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a4bf8f5-3b25-4c86-ac05-c90d579ea5d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:17.586050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0a4bf8f5-3b25-4c86-ac05-c90d579ea5d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:17.721464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0a4bf8f5-3b25-4c86-ac05-c90d579ea5d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:17.729603 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0a4bf8f5-3b25-4c86-ac05-c90d579ea5d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1674 microversion: 2.1 time: 0.167615 Oct 05 18:37:17.730186 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3391/7027] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:17 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:18.754044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b122ea5d-874c-469b-87f9-7de7ce590a44 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:18.754817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b122ea5d-874c-469b-87f9-7de7ce590a44 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:18.760879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b122ea5d-874c-469b-87f9-7de7ce590a44 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:18.761376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b122ea5d-874c-469b-87f9-7de7ce590a44 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:18.761824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b122ea5d-874c-469b-87f9-7de7ce590a44 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:18.762556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b122ea5d-874c-469b-87f9-7de7ce590a44 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:18.763025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b122ea5d-874c-469b-87f9-7de7ce590a44 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:18.763457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b122ea5d-874c-469b-87f9-7de7ce590a44 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:18.901597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b122ea5d-874c-469b-87f9-7de7ce590a44 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:18.910255 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b122ea5d-874c-469b-87f9-7de7ce590a44 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1674 microversion: 2.1 time: 0.160805 Oct 05 18:37:18.910961 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3637/7028] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:18 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:19.933762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c35ecd2b-a3ba-46a8-a16d-a34f4657f3dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:19.934379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c35ecd2b-a3ba-46a8-a16d-a34f4657f3dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:19.941286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c35ecd2b-a3ba-46a8-a16d-a34f4657f3dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:19.941803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c35ecd2b-a3ba-46a8-a16d-a34f4657f3dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:19.942241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c35ecd2b-a3ba-46a8-a16d-a34f4657f3dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:19.942975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c35ecd2b-a3ba-46a8-a16d-a34f4657f3dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:19.943708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c35ecd2b-a3ba-46a8-a16d-a34f4657f3dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:19.944144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c35ecd2b-a3ba-46a8-a16d-a34f4657f3dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:20.108761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c35ecd2b-a3ba-46a8-a16d-a34f4657f3dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:20.117589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c35ecd2b-a3ba-46a8-a16d-a34f4657f3dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1674 microversion: 2.1 time: 0.188001 Oct 05 18:37:20.118152 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3392/7029] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:19 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:21.145917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d5cecce-03a7-4a73-81f5-1c2b6249965f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:21.146994 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d5cecce-03a7-4a73-81f5-1c2b6249965f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:21.158528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d5cecce-03a7-4a73-81f5-1c2b6249965f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:21.159389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d5cecce-03a7-4a73-81f5-1c2b6249965f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:21.160135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d5cecce-03a7-4a73-81f5-1c2b6249965f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:21.161071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d5cecce-03a7-4a73-81f5-1c2b6249965f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:21.161550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d5cecce-03a7-4a73-81f5-1c2b6249965f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:21.161999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d5cecce-03a7-4a73-81f5-1c2b6249965f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:21.301540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d5cecce-03a7-4a73-81f5-1c2b6249965f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:21.310048 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d5cecce-03a7-4a73-81f5-1c2b6249965f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1679 microversion: 2.1 time: 0.171402 Oct 05 18:37:21.310709 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3638/7030] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:21 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:22.336132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0283e2b9-3e1a-4974-bf40-2ed58014d44f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:22.336744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0283e2b9-3e1a-4974-bf40-2ed58014d44f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:22.344006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283e2b9-3e1a-4974-bf40-2ed58014d44f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:22.344493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283e2b9-3e1a-4974-bf40-2ed58014d44f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:22.344926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283e2b9-3e1a-4974-bf40-2ed58014d44f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:22.345616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283e2b9-3e1a-4974-bf40-2ed58014d44f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:22.346070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283e2b9-3e1a-4974-bf40-2ed58014d44f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:22.346533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0283e2b9-3e1a-4974-bf40-2ed58014d44f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:22.479746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0283e2b9-3e1a-4974-bf40-2ed58014d44f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:22.487995 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0283e2b9-3e1a-4974-bf40-2ed58014d44f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1679 microversion: 2.1 time: 0.156330 Oct 05 18:37:22.488588 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3393/7031] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:22 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:23.515405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-41d48a72-b75c-4569-9f75-91350117dc35 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:23.516417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-41d48a72-b75c-4569-9f75-91350117dc35 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:23.528105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41d48a72-b75c-4569-9f75-91350117dc35 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:23.528939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41d48a72-b75c-4569-9f75-91350117dc35 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:23.529680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41d48a72-b75c-4569-9f75-91350117dc35 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:23.530906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41d48a72-b75c-4569-9f75-91350117dc35 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:23.531686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41d48a72-b75c-4569-9f75-91350117dc35 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:23.532417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-41d48a72-b75c-4569-9f75-91350117dc35 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:23.670581 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-41d48a72-b75c-4569-9f75-91350117dc35 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:23.678912 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-41d48a72-b75c-4569-9f75-91350117dc35 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1679 microversion: 2.1 time: 0.170616 Oct 05 18:37:23.679509 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3639/7032] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:23 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:24.707283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5a6e4625-6147-4d51-8c5a-846801b7cf52 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:24.708340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5a6e4625-6147-4d51-8c5a-846801b7cf52 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:24.719104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a6e4625-6147-4d51-8c5a-846801b7cf52 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:24.719912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a6e4625-6147-4d51-8c5a-846801b7cf52 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:24.720644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a6e4625-6147-4d51-8c5a-846801b7cf52 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:24.721781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a6e4625-6147-4d51-8c5a-846801b7cf52 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:24.722619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a6e4625-6147-4d51-8c5a-846801b7cf52 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:24.723291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a6e4625-6147-4d51-8c5a-846801b7cf52 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:24.876884 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5a6e4625-6147-4d51-8c5a-846801b7cf52 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:24.885414 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5a6e4625-6147-4d51-8c5a-846801b7cf52 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1679 microversion: 2.1 time: 0.184903 Oct 05 18:37:24.885996 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3394/7033] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:24 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:25.913908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b92f6bff-bb87-4336-9d63-d080e8c0cdc8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:25.914561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b92f6bff-bb87-4336-9d63-d080e8c0cdc8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:25.925919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b92f6bff-bb87-4336-9d63-d080e8c0cdc8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:25.926576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b92f6bff-bb87-4336-9d63-d080e8c0cdc8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:25.927046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b92f6bff-bb87-4336-9d63-d080e8c0cdc8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:25.927757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b92f6bff-bb87-4336-9d63-d080e8c0cdc8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:25.928222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b92f6bff-bb87-4336-9d63-d080e8c0cdc8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:25.928663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b92f6bff-bb87-4336-9d63-d080e8c0cdc8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:26.073455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b92f6bff-bb87-4336-9d63-d080e8c0cdc8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:26.081803 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b92f6bff-bb87-4336-9d63-d080e8c0cdc8 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1679 microversion: 2.1 time: 0.175305 Oct 05 18:37:26.082456 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3640/7034] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:25 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:27.105371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a12ab766-62f7-44bc-a776-622f35137d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:27.105977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a12ab766-62f7-44bc-a776-622f35137d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:27.113298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12ab766-62f7-44bc-a776-622f35137d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:27.113767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12ab766-62f7-44bc-a776-622f35137d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:27.114198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12ab766-62f7-44bc-a776-622f35137d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:27.114916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12ab766-62f7-44bc-a776-622f35137d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:27.115368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12ab766-62f7-44bc-a776-622f35137d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:27.115790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a12ab766-62f7-44bc-a776-622f35137d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:27.258714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a12ab766-62f7-44bc-a776-622f35137d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:27.266980 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a12ab766-62f7-44bc-a776-622f35137d7b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1679 microversion: 2.1 time: 0.165628 Oct 05 18:37:27.267586 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3395/7035] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:27 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:28.295776 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d6164f2b-3292-4f93-aacf-6105c0d50531 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:28.296802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d6164f2b-3292-4f93-aacf-6105c0d50531 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:28.305164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6164f2b-3292-4f93-aacf-6105c0d50531 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:28.305691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6164f2b-3292-4f93-aacf-6105c0d50531 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:28.306134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6164f2b-3292-4f93-aacf-6105c0d50531 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:28.306868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6164f2b-3292-4f93-aacf-6105c0d50531 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:28.307332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6164f2b-3292-4f93-aacf-6105c0d50531 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:28.307768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6164f2b-3292-4f93-aacf-6105c0d50531 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:28.442596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d6164f2b-3292-4f93-aacf-6105c0d50531 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:28.450576 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d6164f2b-3292-4f93-aacf-6105c0d50531 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1679 microversion: 2.1 time: 0.162286 Oct 05 18:37:28.451134 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3641/7036] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:28 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:29.478738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-82e6cf45-9838-4b4a-a4cd-d8a812efbd14 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:29.479793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-82e6cf45-9838-4b4a-a4cd-d8a812efbd14 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:29.491715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82e6cf45-9838-4b4a-a4cd-d8a812efbd14 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:29.492512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82e6cf45-9838-4b4a-a4cd-d8a812efbd14 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:29.493274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82e6cf45-9838-4b4a-a4cd-d8a812efbd14 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:29.494615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82e6cf45-9838-4b4a-a4cd-d8a812efbd14 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:29.495381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82e6cf45-9838-4b4a-a4cd-d8a812efbd14 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:29.496129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82e6cf45-9838-4b4a-a4cd-d8a812efbd14 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:29.641826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-82e6cf45-9838-4b4a-a4cd-d8a812efbd14 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:29.650004 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-82e6cf45-9838-4b4a-a4cd-d8a812efbd14 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1679 microversion: 2.1 time: 0.178026 Oct 05 18:37:29.650625 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3396/7037] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:29 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:30.673311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-992dd0b3-c274-4ff2-837e-3c25cf4b795d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:30.673899 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-992dd0b3-c274-4ff2-837e-3c25cf4b795d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:30.683915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-992dd0b3-c274-4ff2-837e-3c25cf4b795d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:30.684442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-992dd0b3-c274-4ff2-837e-3c25cf4b795d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:30.684901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-992dd0b3-c274-4ff2-837e-3c25cf4b795d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:30.685727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-992dd0b3-c274-4ff2-837e-3c25cf4b795d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:30.686209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-992dd0b3-c274-4ff2-837e-3c25cf4b795d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:30.686677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-992dd0b3-c274-4ff2-837e-3c25cf4b795d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:30.825795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-992dd0b3-c274-4ff2-837e-3c25cf4b795d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:30.834041 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-992dd0b3-c274-4ff2-837e-3c25cf4b795d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1679 microversion: 2.1 time: 0.165049 Oct 05 18:37:30.834657 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3642/7038] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:30 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:31.858545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9a7fc3ac-17d9-42e5-92e7-68e9f65b1d67 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:31.859112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9a7fc3ac-17d9-42e5-92e7-68e9f65b1d67 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:31.866193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a7fc3ac-17d9-42e5-92e7-68e9f65b1d67 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:31.866651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a7fc3ac-17d9-42e5-92e7-68e9f65b1d67 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:31.867089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a7fc3ac-17d9-42e5-92e7-68e9f65b1d67 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:31.867785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a7fc3ac-17d9-42e5-92e7-68e9f65b1d67 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:31.868223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a7fc3ac-17d9-42e5-92e7-68e9f65b1d67 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:31.868651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a7fc3ac-17d9-42e5-92e7-68e9f65b1d67 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:32.082089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9a7fc3ac-17d9-42e5-92e7-68e9f65b1d67 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:32.090174 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9a7fc3ac-17d9-42e5-92e7-68e9f65b1d67 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1678 microversion: 2.1 time: 0.236564 Oct 05 18:37:32.090770 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3397/7039] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:31 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1678 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:32.439519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-359ca06c-9332-4c9b-be6b-71c76be79dff req-c4b0eb95-5bd7-4ca0-a475-bf6e83a6afdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba983e6-32ac-448e-bbe7-f55042b3cc5a", "name": "network-vif-unplugged", "status": "completed", "tag": "9cb7d5e0-bb2b-43b1-ac60-042b8b784169"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:32.449430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-359ca06c-9332-4c9b-be6b-71c76be79dff req-c4b0eb95-5bd7-4ca0-a475-bf6e83a6afdf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:32.449998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-359ca06c-9332-4c9b-be6b-71c76be79dff req-c4b0eb95-5bd7-4ca0-a475-bf6e83a6afdf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:32.450534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-359ca06c-9332-4c9b-be6b-71c76be79dff req-c4b0eb95-5bd7-4ca0-a475-bf6e83a6afdf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:32.462538 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-359ca06c-9332-4c9b-be6b-71c76be79dff req-c4b0eb95-5bd7-4ca0-a475-bf6e83a6afdf service nova] Creating event network-vif-unplugged:9cb7d5e0-bb2b-43b1-ac60-042b8b784169 for instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a on n-h1-835595-3 Oct 05 18:37:32.468013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-359ca06c-9332-4c9b-be6b-71c76be79dff req-c4b0eb95-5bd7-4ca0-a475-bf6e83a6afdf service nova] Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:37:32.479611 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-359ca06c-9332-4c9b-be6b-71c76be79dff req-c4b0eb95-5bd7-4ca0-a475-bf6e83a6afdf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.109650 Oct 05 18:37:32.480601 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3643/7040] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:33.118168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76b9badc-cacf-4b9a-bef5-787563964a78 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:33.118912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-76b9badc-cacf-4b9a-bef5-787563964a78 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:33.127511 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b9badc-cacf-4b9a-bef5-787563964a78 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:33.128238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b9badc-cacf-4b9a-bef5-787563964a78 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:33.128858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b9badc-cacf-4b9a-bef5-787563964a78 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:33.129621 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b9badc-cacf-4b9a-bef5-787563964a78 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:33.130073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b9badc-cacf-4b9a-bef5-787563964a78 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:33.130522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76b9badc-cacf-4b9a-bef5-787563964a78 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:33.338676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-76b9badc-cacf-4b9a-bef5-787563964a78 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:33.346774 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76b9badc-cacf-4b9a-bef5-787563964a78 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1678 microversion: 2.1 time: 0.233101 Oct 05 18:37:33.347615 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3398/7041] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:33 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1678 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:34.372015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6d9e799e-b8f5-4969-a69e-06cd1de16a21 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:34.372737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6d9e799e-b8f5-4969-a69e-06cd1de16a21 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:34.379401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d9e799e-b8f5-4969-a69e-06cd1de16a21 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:34.379945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d9e799e-b8f5-4969-a69e-06cd1de16a21 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:34.380397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d9e799e-b8f5-4969-a69e-06cd1de16a21 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:34.381116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d9e799e-b8f5-4969-a69e-06cd1de16a21 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:34.381996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d9e799e-b8f5-4969-a69e-06cd1de16a21 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:34.382485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6d9e799e-b8f5-4969-a69e-06cd1de16a21 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:34.495134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-88116335-8ee7-4ca5-b40f-50eab5896b89 req-4aae9142-7337-48ed-a6db-a18f51a3c671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba983e6-32ac-448e-bbe7-f55042b3cc5a", "tag": "9cb7d5e0-bb2b-43b1-ac60-042b8b784169"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:34.505613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-88116335-8ee7-4ca5-b40f-50eab5896b89 req-4aae9142-7337-48ed-a6db-a18f51a3c671 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:34.506213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-88116335-8ee7-4ca5-b40f-50eab5896b89 req-4aae9142-7337-48ed-a6db-a18f51a3c671 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:34.506665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-88116335-8ee7-4ca5-b40f-50eab5896b89 req-4aae9142-7337-48ed-a6db-a18f51a3c671 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:34.518036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6d9e799e-b8f5-4969-a69e-06cd1de16a21 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:34.518998 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-88116335-8ee7-4ca5-b40f-50eab5896b89 req-4aae9142-7337-48ed-a6db-a18f51a3c671 service nova] Creating event network-changed:9cb7d5e0-bb2b-43b1-ac60-042b8b784169 for instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a on n-h1-835595-3 Oct 05 18:37:34.524818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-88116335-8ee7-4ca5-b40f-50eab5896b89 req-4aae9142-7337-48ed-a6db-a18f51a3c671 service nova] Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:37:34.526144 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6d9e799e-b8f5-4969-a69e-06cd1de16a21 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1676 microversion: 2.1 time: 0.159414 Oct 05 18:37:34.526742 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3644/7042] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:34 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:34.536676 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-88116335-8ee7-4ca5-b40f-50eab5896b89 req-4aae9142-7337-48ed-a6db-a18f51a3c671 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044898 Oct 05 18:37:34.537449 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3399/7043] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:35.550508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-402636a8-899f-4c07-9fb4-fe953d8079dd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:35.551318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-402636a8-899f-4c07-9fb4-fe953d8079dd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:35.558467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402636a8-899f-4c07-9fb4-fe953d8079dd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:35.558983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402636a8-899f-4c07-9fb4-fe953d8079dd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:35.559442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402636a8-899f-4c07-9fb4-fe953d8079dd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:35.560182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402636a8-899f-4c07-9fb4-fe953d8079dd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:35.560644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402636a8-899f-4c07-9fb4-fe953d8079dd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:35.561092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402636a8-899f-4c07-9fb4-fe953d8079dd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:35.701468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-402636a8-899f-4c07-9fb4-fe953d8079dd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:35.709668 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-402636a8-899f-4c07-9fb4-fe953d8079dd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1673 microversion: 2.1 time: 0.163232 Oct 05 18:37:35.710249 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3645/7044] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:35 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:35.739794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:35.740341 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:35.747831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:35.748322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:35.748764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:35.749469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:35.749926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:35.750370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:35.788300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:35.788780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:35.789214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:35.789935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:35.790414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:35.790846 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:35.811885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:37:35.817223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for user 654ce2fda5024f6783ef6e2faf2f6617 and project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:37:35.928238 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-26370f3a-fbb7-4fe6-afd5-fddcc40f238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a/action" status: 202 len: 0 microversion: 2.1 time: 0.192935 Oct 05 18:37:35.928855 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3400/7045] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:37:35 2022] POST /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:37:35.937301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0be74bf1-ad46-4c5d-9e79-94ba5579eaa7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:35.937935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0be74bf1-ad46-4c5d-9e79-94ba5579eaa7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:35.944241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0be74bf1-ad46-4c5d-9e79-94ba5579eaa7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:35.944752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0be74bf1-ad46-4c5d-9e79-94ba5579eaa7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:35.945175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0be74bf1-ad46-4c5d-9e79-94ba5579eaa7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:35.945900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0be74bf1-ad46-4c5d-9e79-94ba5579eaa7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:35.946466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0be74bf1-ad46-4c5d-9e79-94ba5579eaa7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:35.946993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0be74bf1-ad46-4c5d-9e79-94ba5579eaa7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:36.078311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0be74bf1-ad46-4c5d-9e79-94ba5579eaa7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:36.086814 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0be74bf1-ad46-4c5d-9e79-94ba5579eaa7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1672 microversion: 2.1 time: 0.153547 Oct 05 18:37:36.087416 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3646/7046] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:35 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:37.105614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c5419cf5-5d40-48ca-a1b8-523f9fb6e541 req-938376e1-bfc4-4390-863b-47313953b372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba983e6-32ac-448e-bbe7-f55042b3cc5a", "name": "network-vif-plugged", "status": "completed", "tag": "9cb7d5e0-bb2b-43b1-ac60-042b8b784169"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:37.111528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ffc25aa-c31a-4f93-a941-dcccce569251 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:37.112532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ffc25aa-c31a-4f93-a941-dcccce569251 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:37.117311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c5419cf5-5d40-48ca-a1b8-523f9fb6e541 req-938376e1-bfc4-4390-863b-47313953b372 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:37.117802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c5419cf5-5d40-48ca-a1b8-523f9fb6e541 req-938376e1-bfc4-4390-863b-47313953b372 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:37.118230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c5419cf5-5d40-48ca-a1b8-523f9fb6e541 req-938376e1-bfc4-4390-863b-47313953b372 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:37.121669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ffc25aa-c31a-4f93-a941-dcccce569251 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:37.122337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ffc25aa-c31a-4f93-a941-dcccce569251 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:37.122974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ffc25aa-c31a-4f93-a941-dcccce569251 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:37.123697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ffc25aa-c31a-4f93-a941-dcccce569251 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:37.124167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ffc25aa-c31a-4f93-a941-dcccce569251 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:37.124607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ffc25aa-c31a-4f93-a941-dcccce569251 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:37.130097 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c5419cf5-5d40-48ca-a1b8-523f9fb6e541 req-938376e1-bfc4-4390-863b-47313953b372 service nova] Creating event network-vif-plugged:9cb7d5e0-bb2b-43b1-ac60-042b8b784169 for instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a on n-h1-835595-3 Oct 05 18:37:37.135976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-c5419cf5-5d40-48ca-a1b8-523f9fb6e541 req-938376e1-bfc4-4390-863b-47313953b372 service nova] Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:37:37.150244 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c5419cf5-5d40-48ca-a1b8-523f9fb6e541 req-938376e1-bfc4-4390-863b-47313953b372 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050891 Oct 05 18:37:37.151367 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3401/7047] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:37.257816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ffc25aa-c31a-4f93-a941-dcccce569251 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:37.266870 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ffc25aa-c31a-4f93-a941-dcccce569251 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1672 microversion: 2.1 time: 0.160337 Oct 05 18:37:37.267459 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3647/7048] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:37 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:38.293614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-21d99cd0-cdd2-40a0-8af9-38bb6082bf76 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:38.294460 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-21d99cd0-cdd2-40a0-8af9-38bb6082bf76 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:38.300785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21d99cd0-cdd2-40a0-8af9-38bb6082bf76 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:38.301270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21d99cd0-cdd2-40a0-8af9-38bb6082bf76 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:38.301718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21d99cd0-cdd2-40a0-8af9-38bb6082bf76 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:38.302433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21d99cd0-cdd2-40a0-8af9-38bb6082bf76 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:38.302883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21d99cd0-cdd2-40a0-8af9-38bb6082bf76 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:38.303300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21d99cd0-cdd2-40a0-8af9-38bb6082bf76 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:38.444210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-21d99cd0-cdd2-40a0-8af9-38bb6082bf76 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:38.452628 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-21d99cd0-cdd2-40a0-8af9-38bb6082bf76 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1672 microversion: 2.1 time: 0.165336 Oct 05 18:37:38.453238 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3402/7049] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:38 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:38.963031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-98c40dd1-bc93-46eb-b17c-46ea0c436c7f req-45eecbaa-449e-4fd8-8e47-5c41dbcc6d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba983e6-32ac-448e-bbe7-f55042b3cc5a", "name": "network-vif-unplugged", "status": "completed", "tag": "9cb7d5e0-bb2b-43b1-ac60-042b8b784169"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:38.975724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-98c40dd1-bc93-46eb-b17c-46ea0c436c7f req-45eecbaa-449e-4fd8-8e47-5c41dbcc6d2f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:38.976177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-98c40dd1-bc93-46eb-b17c-46ea0c436c7f req-45eecbaa-449e-4fd8-8e47-5c41dbcc6d2f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:38.976627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-98c40dd1-bc93-46eb-b17c-46ea0c436c7f req-45eecbaa-449e-4fd8-8e47-5c41dbcc6d2f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:38.989282 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-98c40dd1-bc93-46eb-b17c-46ea0c436c7f req-45eecbaa-449e-4fd8-8e47-5c41dbcc6d2f service nova] Creating event network-vif-unplugged:9cb7d5e0-bb2b-43b1-ac60-042b8b784169 for instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a on n-h2-835595-3 Oct 05 18:37:38.995130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-98c40dd1-bc93-46eb-b17c-46ea0c436c7f req-45eecbaa-449e-4fd8-8e47-5c41dbcc6d2f service nova] Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:37:39.006851 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-98c40dd1-bc93-46eb-b17c-46ea0c436c7f req-45eecbaa-449e-4fd8-8e47-5c41dbcc6d2f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047833 Oct 05 18:37:39.007478 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3648/7050] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:39.476219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b2ac04fd-d309-4cb0-a244-2b5895f6976e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:39.476755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b2ac04fd-d309-4cb0-a244-2b5895f6976e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:39.484247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2ac04fd-d309-4cb0-a244-2b5895f6976e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:39.484738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2ac04fd-d309-4cb0-a244-2b5895f6976e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:39.485174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2ac04fd-d309-4cb0-a244-2b5895f6976e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:39.485872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2ac04fd-d309-4cb0-a244-2b5895f6976e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:39.486332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2ac04fd-d309-4cb0-a244-2b5895f6976e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:39.486791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b2ac04fd-d309-4cb0-a244-2b5895f6976e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:39.695975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b2ac04fd-d309-4cb0-a244-2b5895f6976e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:39.704281 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b2ac04fd-d309-4cb0-a244-2b5895f6976e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1672 microversion: 2.1 time: 0.232098 Oct 05 18:37:39.704840 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3403/7051] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:39 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1672 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:40.734638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-17af3e8e-3c05-41fc-acae-f336baca7b1f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:40.735810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-17af3e8e-3c05-41fc-acae-f336baca7b1f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:40.747163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17af3e8e-3c05-41fc-acae-f336baca7b1f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:40.747982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17af3e8e-3c05-41fc-acae-f336baca7b1f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:40.748722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17af3e8e-3c05-41fc-acae-f336baca7b1f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:40.750511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17af3e8e-3c05-41fc-acae-f336baca7b1f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:40.751308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17af3e8e-3c05-41fc-acae-f336baca7b1f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:40.752038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17af3e8e-3c05-41fc-acae-f336baca7b1f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:40.909905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-17af3e8e-3c05-41fc-acae-f336baca7b1f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:40.918052 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-17af3e8e-3c05-41fc-acae-f336baca7b1f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1672 microversion: 2.1 time: 0.192106 Oct 05 18:37:40.918684 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3649/7052] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:40 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:41.022825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b000b718-6248-4fcd-a041-b9381031643d req-96fc258d-76ca-4f12-8189-52f5690f675a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba983e6-32ac-448e-bbe7-f55042b3cc5a", "tag": "9cb7d5e0-bb2b-43b1-ac60-042b8b784169"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:41.033434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b000b718-6248-4fcd-a041-b9381031643d req-96fc258d-76ca-4f12-8189-52f5690f675a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:41.033916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b000b718-6248-4fcd-a041-b9381031643d req-96fc258d-76ca-4f12-8189-52f5690f675a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:41.034381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b000b718-6248-4fcd-a041-b9381031643d req-96fc258d-76ca-4f12-8189-52f5690f675a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:41.046319 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b000b718-6248-4fcd-a041-b9381031643d req-96fc258d-76ca-4f12-8189-52f5690f675a service nova] Creating event network-changed:9cb7d5e0-bb2b-43b1-ac60-042b8b784169 for instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a on n-h2-835595-3 Oct 05 18:37:41.052081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-b000b718-6248-4fcd-a041-b9381031643d req-96fc258d-76ca-4f12-8189-52f5690f675a service nova] Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:37:41.064019 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b000b718-6248-4fcd-a041-b9381031643d req-96fc258d-76ca-4f12-8189-52f5690f675a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045051 Oct 05 18:37:41.064638 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3404/7053] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:41.941664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d30096c-7a76-4c79-8057-48f023ed4268 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:41.942414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d30096c-7a76-4c79-8057-48f023ed4268 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:41.950196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d30096c-7a76-4c79-8057-48f023ed4268 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:41.950753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d30096c-7a76-4c79-8057-48f023ed4268 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:41.951190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d30096c-7a76-4c79-8057-48f023ed4268 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:41.951934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d30096c-7a76-4c79-8057-48f023ed4268 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:41.952409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d30096c-7a76-4c79-8057-48f023ed4268 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:41.952855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d30096c-7a76-4c79-8057-48f023ed4268 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:42.099551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d30096c-7a76-4c79-8057-48f023ed4268 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:42.108650 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d30096c-7a76-4c79-8057-48f023ed4268 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1665 microversion: 2.1 time: 0.170975 Oct 05 18:37:42.109728 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3650/7054] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:41 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:42.133526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5346404a-f870-4334-aad9-b1bd79ec2b10 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:42.134230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5346404a-f870-4334-aad9-b1bd79ec2b10 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:42.140848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5346404a-f870-4334-aad9-b1bd79ec2b10 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:42.141328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5346404a-f870-4334-aad9-b1bd79ec2b10 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:42.142177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5346404a-f870-4334-aad9-b1bd79ec2b10 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:42.142905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5346404a-f870-4334-aad9-b1bd79ec2b10 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:42.143356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5346404a-f870-4334-aad9-b1bd79ec2b10 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:42.143774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5346404a-f870-4334-aad9-b1bd79ec2b10 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:42.163109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:42.393399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5346404a-f870-4334-aad9-b1bd79ec2b10 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:42.401770 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5346404a-f870-4334-aad9-b1bd79ec2b10 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1665 microversion: 2.1 time: 0.273468 Oct 05 18:37:42.402394 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3405/7055] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:42 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1665 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:42.426058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c512a716-ccb7-40c9-ad3e-fc8c1a379839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:42.426691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c512a716-ccb7-40c9-ad3e-fc8c1a379839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:42.433083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c512a716-ccb7-40c9-ad3e-fc8c1a379839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:42.433590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c512a716-ccb7-40c9-ad3e-fc8c1a379839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:42.434122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c512a716-ccb7-40c9-ad3e-fc8c1a379839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:42.434896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c512a716-ccb7-40c9-ad3e-fc8c1a379839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:42.435365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c512a716-ccb7-40c9-ad3e-fc8c1a379839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:42.435811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c512a716-ccb7-40c9-ad3e-fc8c1a379839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:42.571501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c512a716-ccb7-40c9-ad3e-fc8c1a379839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:42.575194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:42.580582 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c512a716-ccb7-40c9-ad3e-fc8c1a379839 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1665 microversion: 2.1 time: 0.158575 Oct 05 18:37:42.581164 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3651/7056] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:42 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:42.602878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27315efc-a42b-45f9-b01a-c8ec8334ea01 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:42.603374 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-27315efc-a42b-45f9-b01a-c8ec8334ea01 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:42.609741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27315efc-a42b-45f9-b01a-c8ec8334ea01 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:42.610227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27315efc-a42b-45f9-b01a-c8ec8334ea01 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:42.610682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27315efc-a42b-45f9-b01a-c8ec8334ea01 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:42.611367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27315efc-a42b-45f9-b01a-c8ec8334ea01 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:42.611816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27315efc-a42b-45f9-b01a-c8ec8334ea01 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:42.612235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27315efc-a42b-45f9-b01a-c8ec8334ea01 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:42.642165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-27315efc-a42b-45f9-b01a-c8ec8334ea01 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:37:42.721111 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-27315efc-a42b-45f9-b01a-c8ec8334ea01 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 204 len: 0 microversion: 2.1 time: 0.121703 Oct 05 18:37:42.721731 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3406/7057] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:37:42 2022] DELETE /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:37:42.730383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-51d77de7-becb-43e3-825d-5285b3115022 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:42.731023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-51d77de7-becb-43e3-825d-5285b3115022 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:42.738765 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51d77de7-becb-43e3-825d-5285b3115022 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:42.739274 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51d77de7-becb-43e3-825d-5285b3115022 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:42.739729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51d77de7-becb-43e3-825d-5285b3115022 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:42.740442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51d77de7-becb-43e3-825d-5285b3115022 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:42.740922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51d77de7-becb-43e3-825d-5285b3115022 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:42.741353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51d77de7-becb-43e3-825d-5285b3115022 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:42.871911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-51d77de7-becb-43e3-825d-5285b3115022 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:42.880271 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-51d77de7-becb-43e3-825d-5285b3115022 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1671 microversion: 2.1 time: 0.153879 Oct 05 18:37:42.880852 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3652/7058] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:42 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:43.711861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4e5121a8-a6fd-46f3-bf49-8e1a3a419923 req-8fa464be-ed52-49fc-9b94-7c45e0c1cd97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba983e6-32ac-448e-bbe7-f55042b3cc5a", "name": "network-vif-plugged", "status": "completed", "tag": "9cb7d5e0-bb2b-43b1-ac60-042b8b784169"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:43.724028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4e5121a8-a6fd-46f3-bf49-8e1a3a419923 req-8fa464be-ed52-49fc-9b94-7c45e0c1cd97 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:43.724740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4e5121a8-a6fd-46f3-bf49-8e1a3a419923 req-8fa464be-ed52-49fc-9b94-7c45e0c1cd97 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:43.726561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4e5121a8-a6fd-46f3-bf49-8e1a3a419923 req-8fa464be-ed52-49fc-9b94-7c45e0c1cd97 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:43.736018 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4e5121a8-a6fd-46f3-bf49-8e1a3a419923 req-8fa464be-ed52-49fc-9b94-7c45e0c1cd97 service nova] Creating event network-vif-plugged:9cb7d5e0-bb2b-43b1-ac60-042b8b784169 for instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a on n-h2-835595-3 Oct 05 18:37:43.740965 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4e5121a8-a6fd-46f3-bf49-8e1a3a419923 req-8fa464be-ed52-49fc-9b94-7c45e0c1cd97 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Oct 05 18:37:43.741569 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3407/7059] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:43.916068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-122de153-a700-4686-82b1-ad58b73c74b1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:43.917064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-122de153-a700-4686-82b1-ad58b73c74b1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:43.927870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-122de153-a700-4686-82b1-ad58b73c74b1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:43.928383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-122de153-a700-4686-82b1-ad58b73c74b1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:43.928840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-122de153-a700-4686-82b1-ad58b73c74b1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:43.929549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-122de153-a700-4686-82b1-ad58b73c74b1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:43.930023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-122de153-a700-4686-82b1-ad58b73c74b1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:43.930501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-122de153-a700-4686-82b1-ad58b73c74b1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:44.070211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-122de153-a700-4686-82b1-ad58b73c74b1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:44.078677 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-122de153-a700-4686-82b1-ad58b73c74b1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1671 microversion: 2.1 time: 0.169929 Oct 05 18:37:44.079312 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3653/7060] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:43 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:44.868154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-46de6b0d-e3f4-4e24-b8ae-1b4943764141 req-0a9572d2-db79-4227-84ad-bece14cabb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba983e6-32ac-448e-bbe7-f55042b3cc5a", "name": "network-vif-deleted", "tag": "9cb7d5e0-bb2b-43b1-ac60-042b8b784169"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:44.884465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-46de6b0d-e3f4-4e24-b8ae-1b4943764141 req-0a9572d2-db79-4227-84ad-bece14cabb8b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:44.885076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-46de6b0d-e3f4-4e24-b8ae-1b4943764141 req-0a9572d2-db79-4227-84ad-bece14cabb8b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:44.885575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-46de6b0d-e3f4-4e24-b8ae-1b4943764141 req-0a9572d2-db79-4227-84ad-bece14cabb8b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:44.899385 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-46de6b0d-e3f4-4e24-b8ae-1b4943764141 req-0a9572d2-db79-4227-84ad-bece14cabb8b service nova] Creating event network-vif-deleted:9cb7d5e0-bb2b-43b1-ac60-042b8b784169 for instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a on n-h2-835595-3 Oct 05 18:37:44.904667 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-46de6b0d-e3f4-4e24-b8ae-1b4943764141 req-0a9572d2-db79-4227-84ad-bece14cabb8b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045283 Oct 05 18:37:44.905606 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3408/7061] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:37:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:45.102713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:45.103985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:45.110989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:45.111504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:45.111955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:45.112740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:45.113314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:45.113759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:45.146158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:45.146690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:45.147149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:45.147613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lazy-loading 'fault' on Instance uuid 2ba983e6-32ac-448e-bbe7-f55042b3cc5a {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:37:45.191522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:45.200128 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-839ed9db-804f-4865-9cc2-fda16022beac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 200 len: 1326 microversion: 2.1 time: 0.101394 Oct 05 18:37:45.200721 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3654/7062] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:45 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 1326 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:46.221901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:46.229249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:46.230196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:46.239285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:46.239771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:46.240208 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:46.240910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:46.241381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:46.241797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:46.255622 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a HTTP/1.1 Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '2ba983e6-32ac-448e-bbe7-f55042b3cc5a'} Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:37:46.257274 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:37:46.261589 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:37:46.261589 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:37:46.261589 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:37:46.261589 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:37:46.261589 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:37:46.261589 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:37:46.261589 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:37:46.261589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:37:46.261589 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a358dc87-bf9c-4160-ad15-3d360d35f332 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 404 len: 111 microversion: 2.1 time: 0.038516 Oct 05 18:37:46.261589 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3409/7063] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:46 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:37:46.275253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:46.275889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:46.283036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:46.283546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:46.284276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:46.285177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:46.286094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:46.286657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:46.301311 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a HTTP/1.1 Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '2ba983e6-32ac-448e-bbe7-f55042b3cc5a'} Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:37:46.303057 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:37:46.307804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:37:46.307804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:37:46.307804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:37:46.307804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:37:46.307804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:37:46.307804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:37:46.307804 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:37:46.307804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:37:46.307804 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ef5da0e-c903-4a2e-953c-029c6fe75df0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 404 len: 111 microversion: 2.1 time: 0.033283 Oct 05 18:37:46.312799 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3655/7064] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:46 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:37:46.355707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1781001905", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "d10090ce-6507-4a6c-8839-056a2634ec6b"}], "security_groups": [{"name": "tempest-securitygroup--981366362"}], "key_name": "tempest-keypair-307237400", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:46.468969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] validate_networks() for [('d10090ce-6507-4a6c-8839-056a2634ec6b', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:37:46.920399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:37:46.920806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:37:46.921295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:37:46.921696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:37:46.922102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:37:46.931634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:46.932121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:46.932557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:46.933282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:46.933733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:46.934186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:46.951375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:37:46.956849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for user 654ce2fda5024f6783ef6e2faf2f6617 and project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:37:46.969895 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:37:46.972273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:37:47.022043 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51cef5c2-0413-4d7d-bfa0-c6362f632b0e tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.670361 Oct 05 18:37:47.022796 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3410/7065] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:37:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:37:47.034114 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-53373477-c2bf-4330-a239-ca042e373af2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:47.034775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-53373477-c2bf-4330-a239-ca042e373af2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:47.088503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-53373477-c2bf-4330-a239-ca042e373af2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:47.095684 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-53373477-c2bf-4330-a239-ca042e373af2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1238 microversion: 2.1 time: 0.065470 Oct 05 18:37:47.096501 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3656/7066] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:47 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1238 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:48.120129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ce0bbabd-3c90-417c-9880-e401eb8e8461 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:48.120746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ce0bbabd-3c90-417c-9880-e401eb8e8461 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:48.122683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:48.129211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce0bbabd-3c90-417c-9880-e401eb8e8461 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:48.129708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce0bbabd-3c90-417c-9880-e401eb8e8461 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:48.130137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce0bbabd-3c90-417c-9880-e401eb8e8461 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:48.130871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce0bbabd-3c90-417c-9880-e401eb8e8461 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:48.131308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce0bbabd-3c90-417c-9880-e401eb8e8461 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:48.131927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ce0bbabd-3c90-417c-9880-e401eb8e8461 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:48.231125 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ce0bbabd-3c90-417c-9880-e401eb8e8461 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:48.241289 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ce0bbabd-3c90-417c-9880-e401eb8e8461 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1298 microversion: 2.1 time: 0.125934 Oct 05 18:37:48.242095 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3411/7067] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:48 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:49.266376 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c8635173-6809-4070-b050-716a4479b5db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:49.267034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c8635173-6809-4070-b050-716a4479b5db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:49.271210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=51 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:37:49.276871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8635173-6809-4070-b050-716a4479b5db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:49.277413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8635173-6809-4070-b050-716a4479b5db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:49.277867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8635173-6809-4070-b050-716a4479b5db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:49.278632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8635173-6809-4070-b050-716a4479b5db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:49.279276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8635173-6809-4070-b050-716a4479b5db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:49.279724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c8635173-6809-4070-b050-716a4479b5db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:49.416312 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c8635173-6809-4070-b050-716a4479b5db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:49.427827 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c8635173-6809-4070-b050-716a4479b5db tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1363 microversion: 2.1 time: 0.166121 Oct 05 18:37:49.428772 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3657/7068] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:49 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:49.650777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-398682e9-4043-4dc9-b167-51d3432edf9b req-3c93237b-4f00-4d31-ab6f-c1e13f7e99c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f13d93e-f6d9-427b-8299-669a811dc1f3", "tag": "91a57acf-b3b8-4b54-8851-f8ca5d44a733"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:49.664630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-398682e9-4043-4dc9-b167-51d3432edf9b req-3c93237b-4f00-4d31-ab6f-c1e13f7e99c8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:49.665248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-398682e9-4043-4dc9-b167-51d3432edf9b req-3c93237b-4f00-4d31-ab6f-c1e13f7e99c8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:49.665695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-398682e9-4043-4dc9-b167-51d3432edf9b req-3c93237b-4f00-4d31-ab6f-c1e13f7e99c8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:49.678828 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-398682e9-4043-4dc9-b167-51d3432edf9b req-3c93237b-4f00-4d31-ab6f-c1e13f7e99c8 service nova] Creating event network-changed:91a57acf-b3b8-4b54-8851-f8ca5d44a733 for instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 on n-h2-835595-3 Oct 05 18:37:49.683526 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-398682e9-4043-4dc9-b167-51d3432edf9b req-3c93237b-4f00-4d31-ab6f-c1e13f7e99c8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037541 Oct 05 18:37:49.684137 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3412/7069] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:37:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:50.455775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a95391b9-3ab5-4571-b616-1af1760d69cb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:50.456797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a95391b9-3ab5-4571-b616-1af1760d69cb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:50.468384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a95391b9-3ab5-4571-b616-1af1760d69cb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:50.469201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a95391b9-3ab5-4571-b616-1af1760d69cb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:50.469947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a95391b9-3ab5-4571-b616-1af1760d69cb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:50.471156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a95391b9-3ab5-4571-b616-1af1760d69cb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:50.471941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a95391b9-3ab5-4571-b616-1af1760d69cb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:50.472731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a95391b9-3ab5-4571-b616-1af1760d69cb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:50.607692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a95391b9-3ab5-4571-b616-1af1760d69cb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:50.616016 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a95391b9-3ab5-4571-b616-1af1760d69cb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1363 microversion: 2.1 time: 0.166998 Oct 05 18:37:50.616598 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3658/7070] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:50 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:51.640641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-503a3281-4a08-4f8f-b4fd-6986ab2475f2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:51.641351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-503a3281-4a08-4f8f-b4fd-6986ab2475f2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:51.648081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-503a3281-4a08-4f8f-b4fd-6986ab2475f2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:51.648626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-503a3281-4a08-4f8f-b4fd-6986ab2475f2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:51.649070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-503a3281-4a08-4f8f-b4fd-6986ab2475f2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:51.649774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-503a3281-4a08-4f8f-b4fd-6986ab2475f2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:51.650233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-503a3281-4a08-4f8f-b4fd-6986ab2475f2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:51.650680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-503a3281-4a08-4f8f-b4fd-6986ab2475f2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:51.785231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-503a3281-4a08-4f8f-b4fd-6986ab2475f2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:51.793193 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-503a3281-4a08-4f8f-b4fd-6986ab2475f2 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1363 microversion: 2.1 time: 0.158145 Oct 05 18:37:51.793984 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3413/7071] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:51 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:52.820649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6414d2a9-5c5e-4988-bbe4-3985853fdd3d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:52.821675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6414d2a9-5c5e-4988-bbe4-3985853fdd3d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:52.833209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6414d2a9-5c5e-4988-bbe4-3985853fdd3d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:52.833719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6414d2a9-5c5e-4988-bbe4-3985853fdd3d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:52.834176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6414d2a9-5c5e-4988-bbe4-3985853fdd3d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:52.834953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6414d2a9-5c5e-4988-bbe4-3985853fdd3d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:52.835434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6414d2a9-5c5e-4988-bbe4-3985853fdd3d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:52.835882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6414d2a9-5c5e-4988-bbe4-3985853fdd3d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:52.966615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6414d2a9-5c5e-4988-bbe4-3985853fdd3d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:52.974660 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6414d2a9-5c5e-4988-bbe4-3985853fdd3d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1363 microversion: 2.1 time: 0.160761 Oct 05 18:37:52.975238 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3659/7072] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:52 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:53.764369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-680c3ea1-4b68-4c8f-9232-d145b911f06b req-46818968-43dc-4fac-8bd7-c9ea40f059e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f13d93e-f6d9-427b-8299-669a811dc1f3", "name": "network-vif-plugged", "status": "completed", "tag": "91a57acf-b3b8-4b54-8851-f8ca5d44a733"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:53.776045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-680c3ea1-4b68-4c8f-9232-d145b911f06b req-46818968-43dc-4fac-8bd7-c9ea40f059e9 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:53.776532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-680c3ea1-4b68-4c8f-9232-d145b911f06b req-46818968-43dc-4fac-8bd7-c9ea40f059e9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:53.776966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-680c3ea1-4b68-4c8f-9232-d145b911f06b req-46818968-43dc-4fac-8bd7-c9ea40f059e9 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:53.789813 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-680c3ea1-4b68-4c8f-9232-d145b911f06b req-46818968-43dc-4fac-8bd7-c9ea40f059e9 service nova] Creating event network-vif-plugged:91a57acf-b3b8-4b54-8851-f8ca5d44a733 for instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 on n-h2-835595-3 Oct 05 18:37:53.795035 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-680c3ea1-4b68-4c8f-9232-d145b911f06b req-46818968-43dc-4fac-8bd7-c9ea40f059e9 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034570 Oct 05 18:37:53.795697 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3414/7073] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:37:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:53.998616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0e82a054-df7c-41df-8453-bf5191a05fdf tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:53.999247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0e82a054-df7c-41df-8453-bf5191a05fdf tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:54.006777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e82a054-df7c-41df-8453-bf5191a05fdf tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:54.007278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e82a054-df7c-41df-8453-bf5191a05fdf tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:54.007729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e82a054-df7c-41df-8453-bf5191a05fdf tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:54.008446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e82a054-df7c-41df-8453-bf5191a05fdf tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:54.009231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e82a054-df7c-41df-8453-bf5191a05fdf tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:54.009675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0e82a054-df7c-41df-8453-bf5191a05fdf tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:54.147199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0e82a054-df7c-41df-8453-bf5191a05fdf tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:54.155266 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0e82a054-df7c-41df-8453-bf5191a05fdf tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1363 microversion: 2.1 time: 0.161492 Oct 05 18:37:54.155846 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3660/7074] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:53 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:55.182246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5178c199-ced4-47af-b146-7938b1a5f1a0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:55.183027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5178c199-ced4-47af-b146-7938b1a5f1a0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:55.189409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5178c199-ced4-47af-b146-7938b1a5f1a0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:55.189978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5178c199-ced4-47af-b146-7938b1a5f1a0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:55.190453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5178c199-ced4-47af-b146-7938b1a5f1a0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:55.191156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5178c199-ced4-47af-b146-7938b1a5f1a0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:55.191855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5178c199-ced4-47af-b146-7938b1a5f1a0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:55.192424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5178c199-ced4-47af-b146-7938b1a5f1a0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:55.331331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5178c199-ced4-47af-b146-7938b1a5f1a0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:37:55.339879 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5178c199-ced4-47af-b146-7938b1a5f1a0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1549 microversion: 2.1 time: 0.163032 Oct 05 18:37:55.340478 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3415/7075] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:37:55 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:37:55.363148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b2a70cdc-3a65-4f37-a3d6-9ff08eac2eac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:37:55.363725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b2a70cdc-3a65-4f37-a3d6-9ff08eac2eac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:37:55.370914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a70cdc-3a65-4f37-a3d6-9ff08eac2eac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:55.371418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a70cdc-3a65-4f37-a3d6-9ff08eac2eac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:55.371878 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a70cdc-3a65-4f37-a3d6-9ff08eac2eac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:55.372595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a70cdc-3a65-4f37-a3d6-9ff08eac2eac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:55.373075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a70cdc-3a65-4f37-a3d6-9ff08eac2eac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:55.373518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b2a70cdc-3a65-4f37-a3d6-9ff08eac2eac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:55.464515 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b2a70cdc-3a65-4f37-a3d6-9ff08eac2eac tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104977 Oct 05 18:37:55.465456 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3661/7076] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 18:37:55 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:37:56.895142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-bbc59914-a8a3-497c-b8a7-777ab88c0441 req-68424d30-5acb-408d-b305-3f44625ff81b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f13d93e-f6d9-427b-8299-669a811dc1f3", "tag": "91a57acf-b3b8-4b54-8851-f8ca5d44a733"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:37:56.906799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bbc59914-a8a3-497c-b8a7-777ab88c0441 req-68424d30-5acb-408d-b305-3f44625ff81b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:37:56.907774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bbc59914-a8a3-497c-b8a7-777ab88c0441 req-68424d30-5acb-408d-b305-3f44625ff81b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:37:56.908251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-bbc59914-a8a3-497c-b8a7-777ab88c0441 req-68424d30-5acb-408d-b305-3f44625ff81b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:37:56.920061 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-bbc59914-a8a3-497c-b8a7-777ab88c0441 req-68424d30-5acb-408d-b305-3f44625ff81b service nova] Creating event network-changed:91a57acf-b3b8-4b54-8851-f8ca5d44a733 for instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 on n-h2-835595-3 Oct 05 18:37:56.926112 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-bbc59914-a8a3-497c-b8a7-777ab88c0441 req-68424d30-5acb-408d-b305-3f44625ff81b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034627 Oct 05 18:37:56.926958 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3416/7077] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:38:31.389367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:31.390686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=9 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:31.391374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=50 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:31.395569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-10fcf06a-f3a8-4253-b8f8-f8cef09deda1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:31.396438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-10fcf06a-f3a8-4253-b8f8-f8cef09deda1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:31.403998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10fcf06a-f3a8-4253-b8f8-f8cef09deda1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:31.404502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10fcf06a-f3a8-4253-b8f8-f8cef09deda1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:31.404954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10fcf06a-f3a8-4253-b8f8-f8cef09deda1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:31.405764 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10fcf06a-f3a8-4253-b8f8-f8cef09deda1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:31.406402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10fcf06a-f3a8-4253-b8f8-f8cef09deda1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:31.406840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-10fcf06a-f3a8-4253-b8f8-f8cef09deda1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:31.544338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-10fcf06a-f3a8-4253-b8f8-f8cef09deda1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:31.552193 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-10fcf06a-f3a8-4253-b8f8-f8cef09deda1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1666 microversion: 2.1 time: 0.164924 Oct 05 18:38:31.552785 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3662/7078] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:31 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1666 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:31.572044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:31.573272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:31.575219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=11 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:31.575919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:31.580948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a279782e-a6d0-4d67-afe7-6d70dd26c9eb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b9eb7d8-44f1-4db3-93d4-cef3992a14ea"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:38:31.583543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a279782e-a6d0-4d67-afe7-6d70dd26c9eb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:31.593426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a279782e-a6d0-4d67-afe7-6d70dd26c9eb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:31.593934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a279782e-a6d0-4d67-afe7-6d70dd26c9eb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:31.594409 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a279782e-a6d0-4d67-afe7-6d70dd26c9eb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:31.595128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a279782e-a6d0-4d67-afe7-6d70dd26c9eb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:31.595589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a279782e-a6d0-4d67-afe7-6d70dd26c9eb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:31.596013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a279782e-a6d0-4d67-afe7-6d70dd26c9eb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:31.857483 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a279782e-a6d0-4d67-afe7-6d70dd26c9eb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286141 Oct 05 18:38:31.858108 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3417/7079] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:38:31 2022] POST /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:38:42.645066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:38:42.647414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:42.650234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:42.650996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:42.657217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:42.657718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:42.658174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:42.658912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:42.659390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:42.659828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:42.689667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:42.695241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Old instance type m1.heat2, new instance type m1.heat {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 18:38:42.702704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:38:42.703143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:38:42.703628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:38:42.704047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:38:42.704471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:38:42.781260 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f2044c2e-0559-4550-8cb0-1b163f4ec373 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/action" status: 202 len: 0 microversion: 2.1 time: 0.140185 Oct 05 18:38:42.781888 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3663/7080] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:38:42 2022] POST /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:38:42.788346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:42.789557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:38:42.796130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-93af0827-738e-42de-ba6d-dbee5a5fe2fc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:42.796847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-93af0827-738e-42de-ba6d-dbee5a5fe2fc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:42.804818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93af0827-738e-42de-ba6d-dbee5a5fe2fc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:42.805389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93af0827-738e-42de-ba6d-dbee5a5fe2fc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:42.805872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93af0827-738e-42de-ba6d-dbee5a5fe2fc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:42.806739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93af0827-738e-42de-ba6d-dbee5a5fe2fc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:42.807250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93af0827-738e-42de-ba6d-dbee5a5fe2fc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:42.807668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-93af0827-738e-42de-ba6d-dbee5a5fe2fc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:42.965326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-93af0827-738e-42de-ba6d-dbee5a5fe2fc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:42.974118 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-93af0827-738e-42de-ba6d-dbee5a5fe2fc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1721 microversion: 2.1 time: 0.187656 Oct 05 18:38:42.974729 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3418/7081] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:42 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:44.000262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3576bca0-8572-413f-944d-5f2d8e5870b9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:44.000850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3576bca0-8572-413f-944d-5f2d8e5870b9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:44.008782 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3576bca0-8572-413f-944d-5f2d8e5870b9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:44.009310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3576bca0-8572-413f-944d-5f2d8e5870b9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:44.009781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3576bca0-8572-413f-944d-5f2d8e5870b9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:44.010537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3576bca0-8572-413f-944d-5f2d8e5870b9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:44.011025 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3576bca0-8572-413f-944d-5f2d8e5870b9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:44.012338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3576bca0-8572-413f-944d-5f2d8e5870b9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:44.151171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3576bca0-8572-413f-944d-5f2d8e5870b9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:44.159855 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3576bca0-8572-413f-944d-5f2d8e5870b9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1721 microversion: 2.1 time: 0.165656 Oct 05 18:38:44.160536 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3664/7082] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:43 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:45.185603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5023732f-e272-4cd6-a569-bb0dc530f0b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:45.186159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5023732f-e272-4cd6-a569-bb0dc530f0b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:45.196584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5023732f-e272-4cd6-a569-bb0dc530f0b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:45.197185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5023732f-e272-4cd6-a569-bb0dc530f0b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:45.197773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5023732f-e272-4cd6-a569-bb0dc530f0b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:45.198504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5023732f-e272-4cd6-a569-bb0dc530f0b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:45.199102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5023732f-e272-4cd6-a569-bb0dc530f0b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:45.199664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5023732f-e272-4cd6-a569-bb0dc530f0b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:45.340059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5023732f-e272-4cd6-a569-bb0dc530f0b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:45.348518 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5023732f-e272-4cd6-a569-bb0dc530f0b0 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.168140 Oct 05 18:38:45.349085 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3419/7083] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:45 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:46.372520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fa92c3fd-e844-4790-80c8-27ab22629b11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:46.373133 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fa92c3fd-e844-4790-80c8-27ab22629b11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:46.380825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa92c3fd-e844-4790-80c8-27ab22629b11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:46.381328 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa92c3fd-e844-4790-80c8-27ab22629b11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:46.381779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa92c3fd-e844-4790-80c8-27ab22629b11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:46.382582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa92c3fd-e844-4790-80c8-27ab22629b11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:46.383055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa92c3fd-e844-4790-80c8-27ab22629b11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:46.383496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa92c3fd-e844-4790-80c8-27ab22629b11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:46.533380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fa92c3fd-e844-4790-80c8-27ab22629b11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:46.546335 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fa92c3fd-e844-4790-80c8-27ab22629b11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.177808 Oct 05 18:38:46.547163 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3665/7084] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:46 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:47.575045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-439cf26d-04d2-466f-ab4a-3edc5e092147 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:47.575620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-439cf26d-04d2-466f-ab4a-3edc5e092147 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:47.583360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-439cf26d-04d2-466f-ab4a-3edc5e092147 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:47.583844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-439cf26d-04d2-466f-ab4a-3edc5e092147 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:47.584271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-439cf26d-04d2-466f-ab4a-3edc5e092147 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:47.584960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-439cf26d-04d2-466f-ab4a-3edc5e092147 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:47.585405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-439cf26d-04d2-466f-ab4a-3edc5e092147 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:47.585831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-439cf26d-04d2-466f-ab4a-3edc5e092147 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:48.058874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-439cf26d-04d2-466f-ab4a-3edc5e092147 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:48.067338 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-439cf26d-04d2-466f-ab4a-3edc5e092147 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.497227 Oct 05 18:38:48.067956 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3420/7085] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:47 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:49.093189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4fb817d7-86df-476c-8e08-01332c6c9170 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:49.093950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4fb817d7-86df-476c-8e08-01332c6c9170 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:49.103065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fb817d7-86df-476c-8e08-01332c6c9170 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:49.103547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fb817d7-86df-476c-8e08-01332c6c9170 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:49.104006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fb817d7-86df-476c-8e08-01332c6c9170 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:49.104775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fb817d7-86df-476c-8e08-01332c6c9170 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:49.105259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fb817d7-86df-476c-8e08-01332c6c9170 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:49.105701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4fb817d7-86df-476c-8e08-01332c6c9170 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:49.242134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4fb817d7-86df-476c-8e08-01332c6c9170 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:49.255921 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4fb817d7-86df-476c-8e08-01332c6c9170 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.167448 Oct 05 18:38:49.256734 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3666/7086] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:49 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:50.285419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7c5ff39d-4ea4-4655-82b1-f9b848c682a1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:50.286510 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7c5ff39d-4ea4-4655-82b1-f9b848c682a1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:50.298108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c5ff39d-4ea4-4655-82b1-f9b848c682a1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:50.298960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c5ff39d-4ea4-4655-82b1-f9b848c682a1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:50.299689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c5ff39d-4ea4-4655-82b1-f9b848c682a1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:50.300831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c5ff39d-4ea4-4655-82b1-f9b848c682a1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:50.301590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c5ff39d-4ea4-4655-82b1-f9b848c682a1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:50.302335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7c5ff39d-4ea4-4655-82b1-f9b848c682a1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:50.447214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7c5ff39d-4ea4-4655-82b1-f9b848c682a1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:50.460334 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7c5ff39d-4ea4-4655-82b1-f9b848c682a1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.181286 Oct 05 18:38:50.461143 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3421/7087] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:50 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:51.485144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-03381428-f4da-4707-86d5-e76aabcb4ecb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:51.485742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-03381428-f4da-4707-86d5-e76aabcb4ecb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:51.493162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03381428-f4da-4707-86d5-e76aabcb4ecb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:51.493657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03381428-f4da-4707-86d5-e76aabcb4ecb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:51.494139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03381428-f4da-4707-86d5-e76aabcb4ecb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:51.494966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03381428-f4da-4707-86d5-e76aabcb4ecb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:51.495438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03381428-f4da-4707-86d5-e76aabcb4ecb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:51.495875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03381428-f4da-4707-86d5-e76aabcb4ecb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:51.639911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-03381428-f4da-4707-86d5-e76aabcb4ecb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:51.648837 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-03381428-f4da-4707-86d5-e76aabcb4ecb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.167984 Oct 05 18:38:51.649417 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3667/7088] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:51 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:52.675900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-83b5360a-bfa6-466a-bb10-d35d5863a1bb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:52.676539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-83b5360a-bfa6-466a-bb10-d35d5863a1bb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:52.684190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83b5360a-bfa6-466a-bb10-d35d5863a1bb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:52.684684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83b5360a-bfa6-466a-bb10-d35d5863a1bb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:52.685123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83b5360a-bfa6-466a-bb10-d35d5863a1bb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:52.685828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83b5360a-bfa6-466a-bb10-d35d5863a1bb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:52.686390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83b5360a-bfa6-466a-bb10-d35d5863a1bb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:52.686752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-83b5360a-bfa6-466a-bb10-d35d5863a1bb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:52.831769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-83b5360a-bfa6-466a-bb10-d35d5863a1bb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:52.844623 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-83b5360a-bfa6-466a-bb10-d35d5863a1bb tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.172899 Oct 05 18:38:52.845400 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3422/7089] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:52 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:53.873845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bfa93dfe-53ac-479b-9af3-b784141351c5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:53.874732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bfa93dfe-53ac-479b-9af3-b784141351c5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:53.883789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfa93dfe-53ac-479b-9af3-b784141351c5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:53.884532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfa93dfe-53ac-479b-9af3-b784141351c5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:53.885138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfa93dfe-53ac-479b-9af3-b784141351c5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:53.886090 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfa93dfe-53ac-479b-9af3-b784141351c5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:53.886757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfa93dfe-53ac-479b-9af3-b784141351c5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:53.887361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bfa93dfe-53ac-479b-9af3-b784141351c5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:54.028333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bfa93dfe-53ac-479b-9af3-b784141351c5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:54.037156 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bfa93dfe-53ac-479b-9af3-b784141351c5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.168976 Oct 05 18:38:54.037756 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3668/7090] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:53 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:55.065218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2089e14b-0b59-4563-9c6f-513a50d114df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:55.066193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2089e14b-0b59-4563-9c6f-513a50d114df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:55.075774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2089e14b-0b59-4563-9c6f-513a50d114df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:55.076258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2089e14b-0b59-4563-9c6f-513a50d114df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:55.076686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2089e14b-0b59-4563-9c6f-513a50d114df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:55.077386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2089e14b-0b59-4563-9c6f-513a50d114df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:55.077837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2089e14b-0b59-4563-9c6f-513a50d114df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:55.078255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2089e14b-0b59-4563-9c6f-513a50d114df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:55.211232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2089e14b-0b59-4563-9c6f-513a50d114df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:55.220209 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2089e14b-0b59-4563-9c6f-513a50d114df tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.161559 Oct 05 18:38:55.220850 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3423/7091] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:55 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:56.247817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dd4bc99c-09c8-472d-bf41-716e0811eb91 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:56.248473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dd4bc99c-09c8-472d-bf41-716e0811eb91 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:56.257193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd4bc99c-09c8-472d-bf41-716e0811eb91 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:56.257788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd4bc99c-09c8-472d-bf41-716e0811eb91 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:56.258336 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd4bc99c-09c8-472d-bf41-716e0811eb91 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:56.259237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd4bc99c-09c8-472d-bf41-716e0811eb91 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:56.259794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd4bc99c-09c8-472d-bf41-716e0811eb91 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:56.260316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd4bc99c-09c8-472d-bf41-716e0811eb91 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:56.403786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd4bc99c-09c8-472d-bf41-716e0811eb91 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:56.412597 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dd4bc99c-09c8-472d-bf41-716e0811eb91 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.171238 Oct 05 18:38:56.413172 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3669/7092] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:56 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:57.439259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e8670ef2-94b3-4538-bbac-07d7b1579874 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:57.440134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e8670ef2-94b3-4538-bbac-07d7b1579874 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:57.450925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8670ef2-94b3-4538-bbac-07d7b1579874 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:57.451406 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8670ef2-94b3-4538-bbac-07d7b1579874 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:57.451831 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8670ef2-94b3-4538-bbac-07d7b1579874 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:57.452554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8670ef2-94b3-4538-bbac-07d7b1579874 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:57.453002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8670ef2-94b3-4538-bbac-07d7b1579874 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:57.453534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8670ef2-94b3-4538-bbac-07d7b1579874 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:57.598583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e8670ef2-94b3-4538-bbac-07d7b1579874 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:57.607240 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e8670ef2-94b3-4538-bbac-07d7b1579874 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.173156 Oct 05 18:38:57.607721 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3424/7093] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:57 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:58.635777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7fbf4bca-9c1e-4b28-9cd6-59fa42b01acd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:58.636719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7fbf4bca-9c1e-4b28-9cd6-59fa42b01acd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:58.648710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbf4bca-9c1e-4b28-9cd6-59fa42b01acd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:58.649540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbf4bca-9c1e-4b28-9cd6-59fa42b01acd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:58.650318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbf4bca-9c1e-4b28-9cd6-59fa42b01acd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:58.651517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbf4bca-9c1e-4b28-9cd6-59fa42b01acd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:58.652317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbf4bca-9c1e-4b28-9cd6-59fa42b01acd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:58.653008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbf4bca-9c1e-4b28-9cd6-59fa42b01acd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:58.795585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7fbf4bca-9c1e-4b28-9cd6-59fa42b01acd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:58.804314 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7fbf4bca-9c1e-4b28-9cd6-59fa42b01acd tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.175559 Oct 05 18:38:58.804878 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3670/7094] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:58 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:38:59.836578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fb473536-982c-47f3-9dab-df60b998a4c6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:38:59.837646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fb473536-982c-47f3-9dab-df60b998a4c6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:38:59.846362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb473536-982c-47f3-9dab-df60b998a4c6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:59.846853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb473536-982c-47f3-9dab-df60b998a4c6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:59.847292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb473536-982c-47f3-9dab-df60b998a4c6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:59.848006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb473536-982c-47f3-9dab-df60b998a4c6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:38:59.848456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb473536-982c-47f3-9dab-df60b998a4c6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:38:59.848889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb473536-982c-47f3-9dab-df60b998a4c6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:38:59.982210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fb473536-982c-47f3-9dab-df60b998a4c6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:38:59.990716 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fb473536-982c-47f3-9dab-df60b998a4c6 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.160914 Oct 05 18:38:59.991287 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3425/7095] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:38:59 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:01.019338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-476b05ce-7a70-433c-852e-89c001889909 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:01.020442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-476b05ce-7a70-433c-852e-89c001889909 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:01.032346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476b05ce-7a70-433c-852e-89c001889909 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:01.033175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476b05ce-7a70-433c-852e-89c001889909 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:01.033930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476b05ce-7a70-433c-852e-89c001889909 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:01.035188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476b05ce-7a70-433c-852e-89c001889909 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:01.036053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476b05ce-7a70-433c-852e-89c001889909 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:01.036785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-476b05ce-7a70-433c-852e-89c001889909 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:01.176640 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-476b05ce-7a70-433c-852e-89c001889909 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:01.185238 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-476b05ce-7a70-433c-852e-89c001889909 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.173411 Oct 05 18:39:01.185822 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3671/7096] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:01 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:02.209197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1ec9003-0b92-4f56-a561-16b58cca9f11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:02.209809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c1ec9003-0b92-4f56-a561-16b58cca9f11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:02.217313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1ec9003-0b92-4f56-a561-16b58cca9f11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:02.217808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1ec9003-0b92-4f56-a561-16b58cca9f11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:02.218249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1ec9003-0b92-4f56-a561-16b58cca9f11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:02.218988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1ec9003-0b92-4f56-a561-16b58cca9f11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:02.219450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1ec9003-0b92-4f56-a561-16b58cca9f11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:02.219880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1ec9003-0b92-4f56-a561-16b58cca9f11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:02.351646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c1ec9003-0b92-4f56-a561-16b58cca9f11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:02.360446 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c1ec9003-0b92-4f56-a561-16b58cca9f11 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.155374 Oct 05 18:39:02.361028 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3426/7097] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:02 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:03.384725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1a51d0b3-dd9f-44fc-83ca-d18e424b93e1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:03.385326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1a51d0b3-dd9f-44fc-83ca-d18e424b93e1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:03.393324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a51d0b3-dd9f-44fc-83ca-d18e424b93e1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:03.393834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a51d0b3-dd9f-44fc-83ca-d18e424b93e1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:03.394308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a51d0b3-dd9f-44fc-83ca-d18e424b93e1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:03.395080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a51d0b3-dd9f-44fc-83ca-d18e424b93e1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:03.395527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a51d0b3-dd9f-44fc-83ca-d18e424b93e1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:03.395972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1a51d0b3-dd9f-44fc-83ca-d18e424b93e1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:03.537380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1a51d0b3-dd9f-44fc-83ca-d18e424b93e1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:03.547143 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1a51d0b3-dd9f-44fc-83ca-d18e424b93e1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1726 microversion: 2.1 time: 0.166505 Oct 05 18:39:03.547781 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3672/7098] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:03 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:04.383685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-7f150c6f-8d51-4518-bccf-ad36924a7cbf req-4a97e29f-d6f2-41a2-970d-38c96b5a326b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f13d93e-f6d9-427b-8299-669a811dc1f3", "name": "network-vif-unplugged", "status": "completed", "tag": "91a57acf-b3b8-4b54-8851-f8ca5d44a733"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:39:04.399960 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7f150c6f-8d51-4518-bccf-ad36924a7cbf req-4a97e29f-d6f2-41a2-970d-38c96b5a326b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:04.400449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7f150c6f-8d51-4518-bccf-ad36924a7cbf req-4a97e29f-d6f2-41a2-970d-38c96b5a326b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:04.400878 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-7f150c6f-8d51-4518-bccf-ad36924a7cbf req-4a97e29f-d6f2-41a2-970d-38c96b5a326b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:04.414084 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-7f150c6f-8d51-4518-bccf-ad36924a7cbf req-4a97e29f-d6f2-41a2-970d-38c96b5a326b service nova] Creating event network-vif-unplugged:91a57acf-b3b8-4b54-8851-f8ca5d44a733 for instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 on n-h1-835595-3 Oct 05 18:39:04.419975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [req-7f150c6f-8d51-4518-bccf-ad36924a7cbf req-4a97e29f-d6f2-41a2-970d-38c96b5a326b service nova] Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128843) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:39:04.431825 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-7f150c6f-8d51-4518-bccf-ad36924a7cbf req-4a97e29f-d6f2-41a2-970d-38c96b5a326b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051876 Oct 05 18:39:04.432453 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3427/7099] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:39:04.571805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-19a0b20b-1d98-4726-a852-df5b04605de7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:04.572401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-19a0b20b-1d98-4726-a852-df5b04605de7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:04.579901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a0b20b-1d98-4726-a852-df5b04605de7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:04.580406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a0b20b-1d98-4726-a852-df5b04605de7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:04.580913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a0b20b-1d98-4726-a852-df5b04605de7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:04.581632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a0b20b-1d98-4726-a852-df5b04605de7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:04.582116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a0b20b-1d98-4726-a852-df5b04605de7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:04.582590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a0b20b-1d98-4726-a852-df5b04605de7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:04.721078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-19a0b20b-1d98-4726-a852-df5b04605de7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:04.729581 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-19a0b20b-1d98-4726-a852-df5b04605de7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1725 microversion: 2.1 time: 0.161810 Oct 05 18:39:04.734186 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3673/7100] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:04 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:05.755088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3dc90e31-1f0c-4b3e-b00e-fca7c003f34d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:05.756586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3dc90e31-1f0c-4b3e-b00e-fca7c003f34d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:05.763489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc90e31-1f0c-4b3e-b00e-fca7c003f34d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:05.763991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc90e31-1f0c-4b3e-b00e-fca7c003f34d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:05.764433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc90e31-1f0c-4b3e-b00e-fca7c003f34d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:05.765143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc90e31-1f0c-4b3e-b00e-fca7c003f34d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:05.765931 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc90e31-1f0c-4b3e-b00e-fca7c003f34d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:05.766382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3dc90e31-1f0c-4b3e-b00e-fca7c003f34d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:05.904588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3dc90e31-1f0c-4b3e-b00e-fca7c003f34d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:05.913494 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3dc90e31-1f0c-4b3e-b00e-fca7c003f34d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1723 microversion: 2.1 time: 0.163920 Oct 05 18:39:05.914119 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3428/7101] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:05 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:06.451737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-09c34c07-909c-47f3-a5f6-ed7988d8aaab req-f0d11517-3211-44e0-9770-5dc138179b92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f13d93e-f6d9-427b-8299-669a811dc1f3", "tag": "91a57acf-b3b8-4b54-8851-f8ca5d44a733"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:39:06.462700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-09c34c07-909c-47f3-a5f6-ed7988d8aaab req-f0d11517-3211-44e0-9770-5dc138179b92 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:06.463201 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-09c34c07-909c-47f3-a5f6-ed7988d8aaab req-f0d11517-3211-44e0-9770-5dc138179b92 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:06.463666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-09c34c07-909c-47f3-a5f6-ed7988d8aaab req-f0d11517-3211-44e0-9770-5dc138179b92 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:06.477680 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-09c34c07-909c-47f3-a5f6-ed7988d8aaab req-f0d11517-3211-44e0-9770-5dc138179b92 service nova] Creating event network-changed:91a57acf-b3b8-4b54-8851-f8ca5d44a733 for instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 on n-h1-835595-3 Oct 05 18:39:06.483910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-09c34c07-909c-47f3-a5f6-ed7988d8aaab req-f0d11517-3211-44e0-9770-5dc138179b92 service nova] Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:39:06.497867 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-09c34c07-909c-47f3-a5f6-ed7988d8aaab req-f0d11517-3211-44e0-9770-5dc138179b92 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050896 Oct 05 18:39:06.498748 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3674/7102] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:39:06.937544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b3d83ee-a002-48c0-bb85-9190de25a0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:06.938263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7b3d83ee-a002-48c0-bb85-9190de25a0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:06.946236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b3d83ee-a002-48c0-bb85-9190de25a0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:06.946770 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b3d83ee-a002-48c0-bb85-9190de25a0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:06.947209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b3d83ee-a002-48c0-bb85-9190de25a0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:06.948084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b3d83ee-a002-48c0-bb85-9190de25a0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:06.948715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b3d83ee-a002-48c0-bb85-9190de25a0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:06.949491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b3d83ee-a002-48c0-bb85-9190de25a0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:07.294449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7b3d83ee-a002-48c0-bb85-9190de25a0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:07.303653 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7b3d83ee-a002-48c0-bb85-9190de25a0a5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1723 microversion: 2.1 time: 0.370308 Oct 05 18:39:07.304214 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3429/7103] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:06 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1723 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:39:08.330234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bde9c184-a7af-4f6e-8a97-d5aff010d592 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:08.330984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bde9c184-a7af-4f6e-8a97-d5aff010d592 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:08.337687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bde9c184-a7af-4f6e-8a97-d5aff010d592 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:08.338186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bde9c184-a7af-4f6e-8a97-d5aff010d592 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:08.338662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bde9c184-a7af-4f6e-8a97-d5aff010d592 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:08.339375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bde9c184-a7af-4f6e-8a97-d5aff010d592 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:08.339845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bde9c184-a7af-4f6e-8a97-d5aff010d592 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:08.340368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bde9c184-a7af-4f6e-8a97-d5aff010d592 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:08.481078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bde9c184-a7af-4f6e-8a97-d5aff010d592 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:08.490160 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bde9c184-a7af-4f6e-8a97-d5aff010d592 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1723 microversion: 2.1 time: 0.165065 Oct 05 18:39:08.490800 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3675/7104] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:08 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:09.562899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9044f65b-4cd5-4237-a3ab-08b3256256a3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:09.563513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9044f65b-4cd5-4237-a3ab-08b3256256a3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:09.569702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9044f65b-4cd5-4237-a3ab-08b3256256a3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:09.570099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9044f65b-4cd5-4237-a3ab-08b3256256a3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:09.570571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9044f65b-4cd5-4237-a3ab-08b3256256a3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:09.571261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9044f65b-4cd5-4237-a3ab-08b3256256a3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:09.571709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9044f65b-4cd5-4237-a3ab-08b3256256a3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:09.572131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9044f65b-4cd5-4237-a3ab-08b3256256a3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:09.708066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9044f65b-4cd5-4237-a3ab-08b3256256a3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:09.716778 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9044f65b-4cd5-4237-a3ab-08b3256256a3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1723 microversion: 2.1 time: 0.207429 Oct 05 18:39:09.717395 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3430/7105] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:09 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:10.744503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21ed5162-b65f-4e67-a88f-b8cb1f0620ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:10.745528 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21ed5162-b65f-4e67-a88f-b8cb1f0620ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:10.757078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ed5162-b65f-4e67-a88f-b8cb1f0620ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:10.757895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ed5162-b65f-4e67-a88f-b8cb1f0620ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:10.758697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ed5162-b65f-4e67-a88f-b8cb1f0620ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:10.759856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ed5162-b65f-4e67-a88f-b8cb1f0620ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:10.760636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ed5162-b65f-4e67-a88f-b8cb1f0620ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:10.761402 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21ed5162-b65f-4e67-a88f-b8cb1f0620ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:10.907901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21ed5162-b65f-4e67-a88f-b8cb1f0620ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:10.920088 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21ed5162-b65f-4e67-a88f-b8cb1f0620ce tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1723 microversion: 2.1 time: 0.182249 Oct 05 18:39:10.920723 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3676/7106] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:10 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:11.943907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3873f854-1d24-4876-8628-beaf4182238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:11.944561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3873f854-1d24-4876-8628-beaf4182238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:11.951874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3873f854-1d24-4876-8628-beaf4182238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:11.952369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3873f854-1d24-4876-8628-beaf4182238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:11.952807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3873f854-1d24-4876-8628-beaf4182238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:11.953508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3873f854-1d24-4876-8628-beaf4182238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:11.953965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3873f854-1d24-4876-8628-beaf4182238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:11.954430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3873f854-1d24-4876-8628-beaf4182238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:12.089965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3873f854-1d24-4876-8628-beaf4182238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:12.098967 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3873f854-1d24-4876-8628-beaf4182238b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1723 microversion: 2.1 time: 0.159102 Oct 05 18:39:12.099517 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3431/7107] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:11 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:13.126890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-07aefaea-58b7-4eb0-a49a-e4ca89d6f610 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:13.127993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-07aefaea-58b7-4eb0-a49a-e4ca89d6f610 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:13.132511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=33 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:39:13.139916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07aefaea-58b7-4eb0-a49a-e4ca89d6f610 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:13.140746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07aefaea-58b7-4eb0-a49a-e4ca89d6f610 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:13.141207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07aefaea-58b7-4eb0-a49a-e4ca89d6f610 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:13.141954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07aefaea-58b7-4eb0-a49a-e4ca89d6f610 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:13.142458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07aefaea-58b7-4eb0-a49a-e4ca89d6f610 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:13.142921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07aefaea-58b7-4eb0-a49a-e4ca89d6f610 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:13.145699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:39:13.283122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-07aefaea-58b7-4eb0-a49a-e4ca89d6f610 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:13.291844 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-07aefaea-58b7-4eb0-a49a-e4ca89d6f610 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1723 microversion: 2.1 time: 0.171669 Oct 05 18:39:13.292412 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3677/7108] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:13 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:14.319859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-30318968-a323-4572-80f4-4c94ffd497d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:14.320891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30318968-a323-4572-80f4-4c94ffd497d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:14.325332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=29 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:39:14.336453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30318968-a323-4572-80f4-4c94ffd497d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:14.337268 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30318968-a323-4572-80f4-4c94ffd497d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:14.338006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30318968-a323-4572-80f4-4c94ffd497d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:14.339281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30318968-a323-4572-80f4-4c94ffd497d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:14.340118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30318968-a323-4572-80f4-4c94ffd497d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:14.340546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30318968-a323-4572-80f4-4c94ffd497d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:14.343222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=83 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:39:14.479784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-30318968-a323-4572-80f4-4c94ffd497d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:14.488797 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-30318968-a323-4572-80f4-4c94ffd497d9 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1723 microversion: 2.1 time: 0.175608 Oct 05 18:39:14.489389 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3432/7109] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:14 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:15.517021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-00d29de2-e269-49fe-8bde-d1e4c7d6d626 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:15.518045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-00d29de2-e269-49fe-8bde-d1e4c7d6d626 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:15.529244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00d29de2-e269-49fe-8bde-d1e4c7d6d626 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:15.529748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00d29de2-e269-49fe-8bde-d1e4c7d6d626 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:15.530196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00d29de2-e269-49fe-8bde-d1e4c7d6d626 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:15.530939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00d29de2-e269-49fe-8bde-d1e4c7d6d626 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:15.531408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00d29de2-e269-49fe-8bde-d1e4c7d6d626 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:15.531849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-00d29de2-e269-49fe-8bde-d1e4c7d6d626 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:15.675159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-00d29de2-e269-49fe-8bde-d1e4c7d6d626 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:15.685238 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-00d29de2-e269-49fe-8bde-d1e4c7d6d626 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1723 microversion: 2.1 time: 0.175237 Oct 05 18:39:15.685808 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3678/7110] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:15 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:16.712993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3570fe99-231b-49c3-bcad-46219e875c85 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:16.713998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3570fe99-231b-49c3-bcad-46219e875c85 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:16.725468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3570fe99-231b-49c3-bcad-46219e875c85 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:16.726264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3570fe99-231b-49c3-bcad-46219e875c85 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:16.727046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3570fe99-231b-49c3-bcad-46219e875c85 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:16.728163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3570fe99-231b-49c3-bcad-46219e875c85 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:16.728883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3570fe99-231b-49c3-bcad-46219e875c85 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:16.729626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3570fe99-231b-49c3-bcad-46219e875c85 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:16.871601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3570fe99-231b-49c3-bcad-46219e875c85 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:16.880601 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3570fe99-231b-49c3-bcad-46219e875c85 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1723 microversion: 2.1 time: 0.174230 Oct 05 18:39:16.881184 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3433/7111] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:16 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:17.904875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1044c7fa-5a22-436d-9dd2-b0ef3d843819 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:17.905500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1044c7fa-5a22-436d-9dd2-b0ef3d843819 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:17.912934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1044c7fa-5a22-436d-9dd2-b0ef3d843819 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:17.913423 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1044c7fa-5a22-436d-9dd2-b0ef3d843819 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:17.913888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1044c7fa-5a22-436d-9dd2-b0ef3d843819 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:17.914619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1044c7fa-5a22-436d-9dd2-b0ef3d843819 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:17.915084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1044c7fa-5a22-436d-9dd2-b0ef3d843819 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:17.915521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1044c7fa-5a22-436d-9dd2-b0ef3d843819 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:18.051644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1044c7fa-5a22-436d-9dd2-b0ef3d843819 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:18.060514 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1044c7fa-5a22-436d-9dd2-b0ef3d843819 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1720 microversion: 2.1 time: 0.159790 Oct 05 18:39:18.061102 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3679/7112] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:17 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:18.083431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:39:18.083969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:18.092403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:18.092897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:18.093368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:18.094060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:18.094563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:18.094988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:18.133716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:18.134204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:18.134675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:18.135377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:18.135865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:18.136275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:18.157290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:39:18.162645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Getting quotas for user 654ce2fda5024f6783ef6e2faf2f6617 and project 7e8c4de8a6d646418e3b78ed8372de22. Resources: {'cores', 'ram'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:39:18.267001 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a3030461-712d-4312-acde-e57e787e9062 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "POST /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/action" status: 202 len: 0 microversion: 2.1 time: 0.187322 Oct 05 18:39:18.267628 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3434/7113] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:39:18 2022] POST /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 18:39:18.277013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dc145ef8-6ae7-4f20-a55c-ae97f831b11f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:18.277646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dc145ef8-6ae7-4f20-a55c-ae97f831b11f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:18.284284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc145ef8-6ae7-4f20-a55c-ae97f831b11f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:18.284610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc145ef8-6ae7-4f20-a55c-ae97f831b11f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:18.285302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc145ef8-6ae7-4f20-a55c-ae97f831b11f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:18.286150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc145ef8-6ae7-4f20-a55c-ae97f831b11f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:18.286745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc145ef8-6ae7-4f20-a55c-ae97f831b11f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:18.287271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dc145ef8-6ae7-4f20-a55c-ae97f831b11f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:18.421751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dc145ef8-6ae7-4f20-a55c-ae97f831b11f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:18.430921 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dc145ef8-6ae7-4f20-a55c-ae97f831b11f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.158690 Oct 05 18:39:18.431516 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3680/7114] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:18 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:19.459369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4287b53f-76d2-4b72-9990-0d35321b6096 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:19.460211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4287b53f-76d2-4b72-9990-0d35321b6096 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:19.469159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4287b53f-76d2-4b72-9990-0d35321b6096 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:19.469651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4287b53f-76d2-4b72-9990-0d35321b6096 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:19.470092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4287b53f-76d2-4b72-9990-0d35321b6096 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:19.470842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4287b53f-76d2-4b72-9990-0d35321b6096 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:19.471300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4287b53f-76d2-4b72-9990-0d35321b6096 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:19.471732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4287b53f-76d2-4b72-9990-0d35321b6096 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:19.616296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4287b53f-76d2-4b72-9990-0d35321b6096 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:19.625064 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4287b53f-76d2-4b72-9990-0d35321b6096 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.173940 Oct 05 18:39:19.625692 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3435/7115] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:19 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:19.717355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-cac2ddff-1d53-4a68-b508-d772e52f1aba req-76358be9-9c50-4111-9b8d-27ea809a2916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f13d93e-f6d9-427b-8299-669a811dc1f3", "name": "network-vif-plugged", "status": "completed", "tag": "91a57acf-b3b8-4b54-8851-f8ca5d44a733"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:39:19.729335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cac2ddff-1d53-4a68-b508-d772e52f1aba req-76358be9-9c50-4111-9b8d-27ea809a2916 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:19.729842 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cac2ddff-1d53-4a68-b508-d772e52f1aba req-76358be9-9c50-4111-9b8d-27ea809a2916 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:19.730365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-cac2ddff-1d53-4a68-b508-d772e52f1aba req-76358be9-9c50-4111-9b8d-27ea809a2916 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:19.742911 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-cac2ddff-1d53-4a68-b508-d772e52f1aba req-76358be9-9c50-4111-9b8d-27ea809a2916 service nova] Creating event network-vif-plugged:91a57acf-b3b8-4b54-8851-f8ca5d44a733 for instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 on n-h1-835595-3 Oct 05 18:39:19.748518 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-cac2ddff-1d53-4a68-b508-d772e52f1aba req-76358be9-9c50-4111-9b8d-27ea809a2916 service nova] Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:39:19.759695 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-cac2ddff-1d53-4a68-b508-d772e52f1aba req-76358be9-9c50-4111-9b8d-27ea809a2916 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046565 Oct 05 18:39:19.760309 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3681/7116] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:39:20.649006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f7f58834-cf0c-46d8-9849-778fa0b80146 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:20.650267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f7f58834-cf0c-46d8-9849-778fa0b80146 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:20.657558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7f58834-cf0c-46d8-9849-778fa0b80146 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:20.658053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7f58834-cf0c-46d8-9849-778fa0b80146 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:20.658549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7f58834-cf0c-46d8-9849-778fa0b80146 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:20.659249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7f58834-cf0c-46d8-9849-778fa0b80146 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:20.659761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7f58834-cf0c-46d8-9849-778fa0b80146 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:20.660237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f7f58834-cf0c-46d8-9849-778fa0b80146 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:20.797090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f7f58834-cf0c-46d8-9849-778fa0b80146 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:20.805972 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f7f58834-cf0c-46d8-9849-778fa0b80146 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.160866 Oct 05 18:39:20.806638 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3436/7117] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:20 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:21.831406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a1887b1d-3fb9-4e31-9f87-77736a469f9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:21.832126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a1887b1d-3fb9-4e31-9f87-77736a469f9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:21.838698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1887b1d-3fb9-4e31-9f87-77736a469f9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:21.839209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1887b1d-3fb9-4e31-9f87-77736a469f9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:21.839667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1887b1d-3fb9-4e31-9f87-77736a469f9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:21.840479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1887b1d-3fb9-4e31-9f87-77736a469f9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:21.840953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1887b1d-3fb9-4e31-9f87-77736a469f9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:21.841410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a1887b1d-3fb9-4e31-9f87-77736a469f9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:21.976004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a1887b1d-3fb9-4e31-9f87-77736a469f9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:21.984760 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a1887b1d-3fb9-4e31-9f87-77736a469f9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.158730 Oct 05 18:39:21.985352 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3682/7118] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:21 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:23.010439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-190904a6-d2ad-48dd-b449-abcc5a4cee05 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:23.011241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-190904a6-d2ad-48dd-b449-abcc5a4cee05 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:23.018924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-190904a6-d2ad-48dd-b449-abcc5a4cee05 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:23.019686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-190904a6-d2ad-48dd-b449-abcc5a4cee05 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:23.020129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-190904a6-d2ad-48dd-b449-abcc5a4cee05 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:23.020857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-190904a6-d2ad-48dd-b449-abcc5a4cee05 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:23.021305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-190904a6-d2ad-48dd-b449-abcc5a4cee05 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:23.021735 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-190904a6-d2ad-48dd-b449-abcc5a4cee05 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:23.231311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-190904a6-d2ad-48dd-b449-abcc5a4cee05 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:23.240272 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-190904a6-d2ad-48dd-b449-abcc5a4cee05 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.235150 Oct 05 18:39:23.240863 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3437/7119] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:23 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:23.521619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-5ddd8b0d-afae-4cbb-8ee3-0352d19deefd req-ec4e4fd2-ab22-47b0-ac7d-432abba10d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f13d93e-f6d9-427b-8299-669a811dc1f3", "name": "network-vif-unplugged", "status": "completed", "tag": "91a57acf-b3b8-4b54-8851-f8ca5d44a733"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:39:23.532356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ddd8b0d-afae-4cbb-8ee3-0352d19deefd req-ec4e4fd2-ab22-47b0-ac7d-432abba10d9a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:23.532652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ddd8b0d-afae-4cbb-8ee3-0352d19deefd req-ec4e4fd2-ab22-47b0-ac7d-432abba10d9a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:23.533083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-5ddd8b0d-afae-4cbb-8ee3-0352d19deefd req-ec4e4fd2-ab22-47b0-ac7d-432abba10d9a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:23.548584 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-5ddd8b0d-afae-4cbb-8ee3-0352d19deefd req-ec4e4fd2-ab22-47b0-ac7d-432abba10d9a service nova] Creating event network-vif-unplugged:91a57acf-b3b8-4b54-8851-f8ca5d44a733 for instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 on n-h2-835595-3 Oct 05 18:39:23.554378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-5ddd8b0d-afae-4cbb-8ee3-0352d19deefd req-ec4e4fd2-ab22-47b0-ac7d-432abba10d9a service nova] Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:39:23.565535 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-5ddd8b0d-afae-4cbb-8ee3-0352d19deefd req-ec4e4fd2-ab22-47b0-ac7d-432abba10d9a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047703 Oct 05 18:39:23.566366 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3683/7120] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:39:24.264742 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-702bb8b8-faf3-4e03-9782-687f47b2ddf5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:24.265348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-702bb8b8-faf3-4e03-9782-687f47b2ddf5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:24.272407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702bb8b8-faf3-4e03-9782-687f47b2ddf5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:24.272943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702bb8b8-faf3-4e03-9782-687f47b2ddf5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:24.273388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702bb8b8-faf3-4e03-9782-687f47b2ddf5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:24.274102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702bb8b8-faf3-4e03-9782-687f47b2ddf5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:24.274598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702bb8b8-faf3-4e03-9782-687f47b2ddf5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:24.275029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-702bb8b8-faf3-4e03-9782-687f47b2ddf5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:24.555211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-702bb8b8-faf3-4e03-9782-687f47b2ddf5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:24.564072 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-702bb8b8-faf3-4e03-9782-687f47b2ddf5 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.303730 Oct 05 18:39:24.564638 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3438/7121] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:24 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:25.581562 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-11b254e5-929e-4ff7-9e27-877b24cd2f75 req-d86c1be4-1b73-4a6b-b64b-264ae1d8acfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f13d93e-f6d9-427b-8299-669a811dc1f3", "tag": "91a57acf-b3b8-4b54-8851-f8ca5d44a733"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:39:25.588286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c82fbcea-a3a5-480d-89a5-ef76314b933f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:25.589033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c82fbcea-a3a5-480d-89a5-ef76314b933f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:25.593165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-11b254e5-929e-4ff7-9e27-877b24cd2f75 req-d86c1be4-1b73-4a6b-b64b-264ae1d8acfa service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:25.593719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-11b254e5-929e-4ff7-9e27-877b24cd2f75 req-d86c1be4-1b73-4a6b-b64b-264ae1d8acfa service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:25.594209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-11b254e5-929e-4ff7-9e27-877b24cd2f75 req-d86c1be4-1b73-4a6b-b64b-264ae1d8acfa service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:25.596314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c82fbcea-a3a5-480d-89a5-ef76314b933f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:25.596882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c82fbcea-a3a5-480d-89a5-ef76314b933f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:25.597340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c82fbcea-a3a5-480d-89a5-ef76314b933f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:25.598051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c82fbcea-a3a5-480d-89a5-ef76314b933f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:25.598540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c82fbcea-a3a5-480d-89a5-ef76314b933f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:25.598969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c82fbcea-a3a5-480d-89a5-ef76314b933f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:25.607816 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-11b254e5-929e-4ff7-9e27-877b24cd2f75 req-d86c1be4-1b73-4a6b-b64b-264ae1d8acfa service nova] Creating event network-changed:91a57acf-b3b8-4b54-8851-f8ca5d44a733 for instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 on n-h2-835595-3 Oct 05 18:39:25.614173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-11b254e5-929e-4ff7-9e27-877b24cd2f75 req-d86c1be4-1b73-4a6b-b64b-264ae1d8acfa service nova] Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:39:25.627420 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-11b254e5-929e-4ff7-9e27-877b24cd2f75 req-d86c1be4-1b73-4a6b-b64b-264ae1d8acfa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050829 Oct 05 18:39:25.628401 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3684/7122] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:39:25.912084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c82fbcea-a3a5-480d-89a5-ef76314b933f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:25.921646 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c82fbcea-a3a5-480d-89a5-ef76314b933f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.337498 Oct 05 18:39:25.937794 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3439/7123] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:25 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:26.946170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d4334779-7b56-45d0-aa2b-b3bd13112c90 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:26.946959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d4334779-7b56-45d0-aa2b-b3bd13112c90 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:26.953970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4334779-7b56-45d0-aa2b-b3bd13112c90 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:26.954524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4334779-7b56-45d0-aa2b-b3bd13112c90 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:26.954998 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4334779-7b56-45d0-aa2b-b3bd13112c90 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:26.955679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4334779-7b56-45d0-aa2b-b3bd13112c90 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:26.956146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4334779-7b56-45d0-aa2b-b3bd13112c90 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:26.956567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d4334779-7b56-45d0-aa2b-b3bd13112c90 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:27.099762 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d4334779-7b56-45d0-aa2b-b3bd13112c90 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:27.108893 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d4334779-7b56-45d0-aa2b-b3bd13112c90 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.167200 Oct 05 18:39:27.109475 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3685/7124] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:26 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:28.132880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1c0ab1b5-a1e8-4b04-9d34-4bd495034df4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:28.133490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1c0ab1b5-a1e8-4b04-9d34-4bd495034df4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:28.141322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c0ab1b5-a1e8-4b04-9d34-4bd495034df4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:28.141812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c0ab1b5-a1e8-4b04-9d34-4bd495034df4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:28.142240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c0ab1b5-a1e8-4b04-9d34-4bd495034df4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:28.143039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c0ab1b5-a1e8-4b04-9d34-4bd495034df4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:28.143528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c0ab1b5-a1e8-4b04-9d34-4bd495034df4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:28.143965 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1c0ab1b5-a1e8-4b04-9d34-4bd495034df4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:28.146736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:39:28.278740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1c0ab1b5-a1e8-4b04-9d34-4bd495034df4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:28.289265 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1c0ab1b5-a1e8-4b04-9d34-4bd495034df4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.160343 Oct 05 18:39:28.289862 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3440/7125] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:28 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:29.315457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fa706733-38f2-4fda-afb2-97465b3a6883 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:29.316095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fa706733-38f2-4fda-afb2-97465b3a6883 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:29.325710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa706733-38f2-4fda-afb2-97465b3a6883 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:29.326236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa706733-38f2-4fda-afb2-97465b3a6883 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:29.326789 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa706733-38f2-4fda-afb2-97465b3a6883 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:29.327512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa706733-38f2-4fda-afb2-97465b3a6883 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:29.327987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa706733-38f2-4fda-afb2-97465b3a6883 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:29.328430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa706733-38f2-4fda-afb2-97465b3a6883 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:29.471942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fa706733-38f2-4fda-afb2-97465b3a6883 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:29.481017 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fa706733-38f2-4fda-afb2-97465b3a6883 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.171356 Oct 05 18:39:29.481625 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3686/7126] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:29 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:30.504871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-70043086-5867-4077-badb-7bc8be721bf3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:30.505520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-70043086-5867-4077-badb-7bc8be721bf3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:30.513187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70043086-5867-4077-badb-7bc8be721bf3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:30.513672 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70043086-5867-4077-badb-7bc8be721bf3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:30.514107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70043086-5867-4077-badb-7bc8be721bf3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:30.514837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70043086-5867-4077-badb-7bc8be721bf3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:30.515293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70043086-5867-4077-badb-7bc8be721bf3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:30.516042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-70043086-5867-4077-badb-7bc8be721bf3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:30.656267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-70043086-5867-4077-badb-7bc8be721bf3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:30.664748 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-70043086-5867-4077-badb-7bc8be721bf3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.163904 Oct 05 18:39:30.665324 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3441/7127] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:30 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:31.688727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5aa3f5a-bb9d-48c1-ae21-e549f5ed0391 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:31.689364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5aa3f5a-bb9d-48c1-ae21-e549f5ed0391 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:31.696573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa3f5a-bb9d-48c1-ae21-e549f5ed0391 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:31.697076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa3f5a-bb9d-48c1-ae21-e549f5ed0391 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:31.697530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa3f5a-bb9d-48c1-ae21-e549f5ed0391 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:31.698246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa3f5a-bb9d-48c1-ae21-e549f5ed0391 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:31.698756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa3f5a-bb9d-48c1-ae21-e549f5ed0391 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:31.699245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5aa3f5a-bb9d-48c1-ae21-e549f5ed0391 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:31.835408 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f5aa3f5a-bb9d-48c1-ae21-e549f5ed0391 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:31.848312 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5aa3f5a-bb9d-48c1-ae21-e549f5ed0391 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.163648 Oct 05 18:39:31.849022 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3687/7128] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:31 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:32.879110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd474fa7-cac6-4b18-bbed-3a14dd4d44a7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:32.879795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bd474fa7-cac6-4b18-bbed-3a14dd4d44a7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:32.891261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd474fa7-cac6-4b18-bbed-3a14dd4d44a7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:32.891864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd474fa7-cac6-4b18-bbed-3a14dd4d44a7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:32.892486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd474fa7-cac6-4b18-bbed-3a14dd4d44a7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:32.893555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd474fa7-cac6-4b18-bbed-3a14dd4d44a7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:32.894144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd474fa7-cac6-4b18-bbed-3a14dd4d44a7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:32.894762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd474fa7-cac6-4b18-bbed-3a14dd4d44a7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:33.028251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bd474fa7-cac6-4b18-bbed-3a14dd4d44a7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:33.036720 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bd474fa7-cac6-4b18-bbed-3a14dd4d44a7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.164352 Oct 05 18:39:33.037306 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3442/7129] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:32 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:34.063793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86a695cb-7424-46e9-8224-67b7952071e7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:34.064746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-86a695cb-7424-46e9-8224-67b7952071e7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:34.074755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86a695cb-7424-46e9-8224-67b7952071e7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:34.075264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86a695cb-7424-46e9-8224-67b7952071e7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:34.075722 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86a695cb-7424-46e9-8224-67b7952071e7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:34.076437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86a695cb-7424-46e9-8224-67b7952071e7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:34.076909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86a695cb-7424-46e9-8224-67b7952071e7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:34.077359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86a695cb-7424-46e9-8224-67b7952071e7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:34.216303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-86a695cb-7424-46e9-8224-67b7952071e7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:34.225084 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-86a695cb-7424-46e9-8224-67b7952071e7 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.167672 Oct 05 18:39:34.225645 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3688/7130] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:34 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:35.253361 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de1a0b20-2b77-4083-bdd9-491647028c56 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:35.254247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-de1a0b20-2b77-4083-bdd9-491647028c56 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:35.266419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1a0b20-2b77-4083-bdd9-491647028c56 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:35.267291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1a0b20-2b77-4083-bdd9-491647028c56 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:35.268016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1a0b20-2b77-4083-bdd9-491647028c56 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:35.269210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1a0b20-2b77-4083-bdd9-491647028c56 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:35.270113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1a0b20-2b77-4083-bdd9-491647028c56 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:35.271036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de1a0b20-2b77-4083-bdd9-491647028c56 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:35.414611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-de1a0b20-2b77-4083-bdd9-491647028c56 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:35.424597 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de1a0b20-2b77-4083-bdd9-491647028c56 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.178028 Oct 05 18:39:35.425188 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3443/7131] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:35 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:36.450664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63e91495-d6e9-4f73-a7e6-fb3ddbd86845 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:36.451342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63e91495-d6e9-4f73-a7e6-fb3ddbd86845 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:36.459530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e91495-d6e9-4f73-a7e6-fb3ddbd86845 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:36.460045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e91495-d6e9-4f73-a7e6-fb3ddbd86845 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:36.460508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e91495-d6e9-4f73-a7e6-fb3ddbd86845 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:36.461252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e91495-d6e9-4f73-a7e6-fb3ddbd86845 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:36.461712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e91495-d6e9-4f73-a7e6-fb3ddbd86845 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:36.462173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63e91495-d6e9-4f73-a7e6-fb3ddbd86845 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:36.609009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63e91495-d6e9-4f73-a7e6-fb3ddbd86845 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:36.617683 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63e91495-d6e9-4f73-a7e6-fb3ddbd86845 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1719 microversion: 2.1 time: 0.171081 Oct 05 18:39:36.618312 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3689/7132] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:36 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:37.645768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-eadf98f0-b1c0-4af1-90e0-3e40bb595080 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:37.646683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-eadf98f0-b1c0-4af1-90e0-3e40bb595080 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:37.656111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eadf98f0-b1c0-4af1-90e0-3e40bb595080 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:37.656593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eadf98f0-b1c0-4af1-90e0-3e40bb595080 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:37.657022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eadf98f0-b1c0-4af1-90e0-3e40bb595080 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:37.657707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eadf98f0-b1c0-4af1-90e0-3e40bb595080 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:37.658155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eadf98f0-b1c0-4af1-90e0-3e40bb595080 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:37.658607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-eadf98f0-b1c0-4af1-90e0-3e40bb595080 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:37.796935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-eadf98f0-b1c0-4af1-90e0-3e40bb595080 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:37.810536 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-eadf98f0-b1c0-4af1-90e0-3e40bb595080 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1712 microversion: 2.1 time: 0.171513 Oct 05 18:39:37.811328 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3444/7133] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:37 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1712 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:37.833453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-46d3da2a-9952-462c-86a6-54d219e9e0d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:37.834127 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-46d3da2a-9952-462c-86a6-54d219e9e0d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:37.841300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46d3da2a-9952-462c-86a6-54d219e9e0d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:37.841826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46d3da2a-9952-462c-86a6-54d219e9e0d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:37.842301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46d3da2a-9952-462c-86a6-54d219e9e0d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:37.843082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46d3da2a-9952-462c-86a6-54d219e9e0d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:37.843556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46d3da2a-9952-462c-86a6-54d219e9e0d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:37.843999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-46d3da2a-9952-462c-86a6-54d219e9e0d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:37.987309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-46d3da2a-9952-462c-86a6-54d219e9e0d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:37.996161 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-46d3da2a-9952-462c-86a6-54d219e9e0d1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1712 microversion: 2.1 time: 0.166704 Oct 05 18:39:37.996749 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3690/7134] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:37 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1712 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:38.019019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6c4bded7-9c8f-4a61-aa2e-827c42af833f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:38.019624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6c4bded7-9c8f-4a61-aa2e-827c42af833f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:38.026161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c4bded7-9c8f-4a61-aa2e-827c42af833f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:38.026677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c4bded7-9c8f-4a61-aa2e-827c42af833f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:38.027215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c4bded7-9c8f-4a61-aa2e-827c42af833f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:38.027898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c4bded7-9c8f-4a61-aa2e-827c42af833f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:38.028347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c4bded7-9c8f-4a61-aa2e-827c42af833f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:38.028773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6c4bded7-9c8f-4a61-aa2e-827c42af833f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:38.158143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6c4bded7-9c8f-4a61-aa2e-827c42af833f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:38.160665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:39:38.168036 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6c4bded7-9c8f-4a61-aa2e-827c42af833f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1712 microversion: 2.1 time: 0.153184 Oct 05 18:39:38.168629 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3445/7135] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:38 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1712 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:38.190378 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f116c484-c323-4e5c-8285-52c952df31d4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:38.190879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f116c484-c323-4e5c-8285-52c952df31d4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:38.196958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f116c484-c323-4e5c-8285-52c952df31d4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:38.197463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f116c484-c323-4e5c-8285-52c952df31d4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:38.197910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f116c484-c323-4e5c-8285-52c952df31d4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:38.198641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f116c484-c323-4e5c-8285-52c952df31d4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:38.199164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f116c484-c323-4e5c-8285-52c952df31d4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:38.199602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f116c484-c323-4e5c-8285-52c952df31d4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:38.224930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f116c484-c323-4e5c-8285-52c952df31d4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:39:38.305887 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f116c484-c323-4e5c-8285-52c952df31d4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 204 len: 0 microversion: 2.1 time: 0.119215 Oct 05 18:39:38.306909 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3691/7136] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:39:38 2022] DELETE /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:39:38.316818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0b569ae8-a951-476e-a842-392c885e89c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:38.317436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0b569ae8-a951-476e-a842-392c885e89c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:38.324147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b569ae8-a951-476e-a842-392c885e89c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:38.324682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b569ae8-a951-476e-a842-392c885e89c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:38.325336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b569ae8-a951-476e-a842-392c885e89c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:38.326253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b569ae8-a951-476e-a842-392c885e89c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:38.326746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b569ae8-a951-476e-a842-392c885e89c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:38.327186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0b569ae8-a951-476e-a842-392c885e89c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:38.468487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0b569ae8-a951-476e-a842-392c885e89c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:38.477043 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0b569ae8-a951-476e-a842-392c885e89c1 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1718 microversion: 2.1 time: 0.165518 Oct 05 18:39:38.477626 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3446/7137] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:38 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:39.506388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e2f09874-aca3-495e-b54b-5b48c21d7217 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:39.507563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e2f09874-aca3-495e-b54b-5b48c21d7217 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:39.519550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f09874-aca3-495e-b54b-5b48c21d7217 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:39.520371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f09874-aca3-495e-b54b-5b48c21d7217 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:39.521109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f09874-aca3-495e-b54b-5b48c21d7217 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:39.522321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f09874-aca3-495e-b54b-5b48c21d7217 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:39.523094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f09874-aca3-495e-b54b-5b48c21d7217 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:39.523820 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2f09874-aca3-495e-b54b-5b48c21d7217 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:39.667694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e2f09874-aca3-495e-b54b-5b48c21d7217 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:39.676833 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e2f09874-aca3-495e-b54b-5b48c21d7217 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1718 microversion: 2.1 time: 0.177782 Oct 05 18:39:39.677530 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3692/7138] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:39 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1718 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:40.338901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1adc2d04-6754-4115-8c0e-7d3dec3100d8 req-95349610-77d5-4d71-9a91-fe8ad860c6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f13d93e-f6d9-427b-8299-669a811dc1f3", "name": "network-vif-plugged", "status": "completed", "tag": "91a57acf-b3b8-4b54-8851-f8ca5d44a733"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:39:40.351281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1adc2d04-6754-4115-8c0e-7d3dec3100d8 req-95349610-77d5-4d71-9a91-fe8ad860c6e6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:40.351775 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1adc2d04-6754-4115-8c0e-7d3dec3100d8 req-95349610-77d5-4d71-9a91-fe8ad860c6e6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:40.352414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1adc2d04-6754-4115-8c0e-7d3dec3100d8 req-95349610-77d5-4d71-9a91-fe8ad860c6e6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:40.365076 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1adc2d04-6754-4115-8c0e-7d3dec3100d8 req-95349610-77d5-4d71-9a91-fe8ad860c6e6 service nova] Creating event network-vif-plugged:91a57acf-b3b8-4b54-8851-f8ca5d44a733 for instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 on n-h2-835595-3 Oct 05 18:39:40.370452 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1adc2d04-6754-4115-8c0e-7d3dec3100d8 req-95349610-77d5-4d71-9a91-fe8ad860c6e6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035947 Oct 05 18:39:40.371486 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3447/7139] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:39:40.701010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86c22881-fe4a-42de-9e99-92a333788ab4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:40.701571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-86c22881-fe4a-42de-9e99-92a333788ab4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:40.708579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86c22881-fe4a-42de-9e99-92a333788ab4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:40.709076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86c22881-fe4a-42de-9e99-92a333788ab4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:40.709523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86c22881-fe4a-42de-9e99-92a333788ab4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:40.710224 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86c22881-fe4a-42de-9e99-92a333788ab4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:40.710711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86c22881-fe4a-42de-9e99-92a333788ab4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:40.711142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86c22881-fe4a-42de-9e99-92a333788ab4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:40.713877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:39:40.780601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-86c22881-fe4a-42de-9e99-92a333788ab4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:40.789842 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-86c22881-fe4a-42de-9e99-92a333788ab4 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1651 microversion: 2.1 time: 0.092837 Oct 05 18:39:40.790564 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3693/7140] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:40 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1651 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:40.825066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-8675b618-61ee-44a0-97fd-765b2f329dd5 req-6d010d0d-349d-460e-b6e7-e5313b9e9e7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f13d93e-f6d9-427b-8299-669a811dc1f3", "name": "network-vif-deleted", "tag": "91a57acf-b3b8-4b54-8851-f8ca5d44a733"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:39:40.836168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8675b618-61ee-44a0-97fd-765b2f329dd5 req-6d010d0d-349d-460e-b6e7-e5313b9e9e7a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:40.836962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8675b618-61ee-44a0-97fd-765b2f329dd5 req-6d010d0d-349d-460e-b6e7-e5313b9e9e7a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:40.837238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-8675b618-61ee-44a0-97fd-765b2f329dd5 req-6d010d0d-349d-460e-b6e7-e5313b9e9e7a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:40.849819 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-8675b618-61ee-44a0-97fd-765b2f329dd5 req-6d010d0d-349d-460e-b6e7-e5313b9e9e7a service nova] Creating event network-vif-deleted:91a57acf-b3b8-4b54-8851-f8ca5d44a733 for instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 on n-h2-835595-3 Oct 05 18:39:40.854698 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-8675b618-61ee-44a0-97fd-765b2f329dd5 req-6d010d0d-349d-460e-b6e7-e5313b9e9e7a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034373 Oct 05 18:39:40.855397 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3448/7141] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:39:41.813698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3aa92041-3272-4ba7-8eea-ff80eae6d78b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:41.815037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3aa92041-3272-4ba7-8eea-ff80eae6d78b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:41.822196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3aa92041-3272-4ba7-8eea-ff80eae6d78b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:41.822736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3aa92041-3272-4ba7-8eea-ff80eae6d78b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:41.823190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3aa92041-3272-4ba7-8eea-ff80eae6d78b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:41.823918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3aa92041-3272-4ba7-8eea-ff80eae6d78b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:41.824382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3aa92041-3272-4ba7-8eea-ff80eae6d78b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:41.825051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3aa92041-3272-4ba7-8eea-ff80eae6d78b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:41.893352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3aa92041-3272-4ba7-8eea-ff80eae6d78b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:41.902763 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3aa92041-3272-4ba7-8eea-ff80eae6d78b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1369 microversion: 2.1 time: 0.093102 Oct 05 18:39:41.903609 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3694/7142] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:41 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:42.927219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1ed698ef-64d5-430e-8150-ab575757e74c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:42.928084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1ed698ef-64d5-430e-8150-ab575757e74c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:42.934631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed698ef-64d5-430e-8150-ab575757e74c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:42.935129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed698ef-64d5-430e-8150-ab575757e74c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:42.935569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed698ef-64d5-430e-8150-ab575757e74c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:42.936275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed698ef-64d5-430e-8150-ab575757e74c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:42.936763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed698ef-64d5-430e-8150-ab575757e74c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:42.937194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1ed698ef-64d5-430e-8150-ab575757e74c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:43.006739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1ed698ef-64d5-430e-8150-ab575757e74c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:43.015914 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1ed698ef-64d5-430e-8150-ab575757e74c tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1369 microversion: 2.1 time: 0.093886 Oct 05 18:39:43.016499 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3449/7143] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:42 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:44.039390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c02677f-2fea-41d6-99b8-00013bc9086d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:44.040015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8c02677f-2fea-41d6-99b8-00013bc9086d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:44.043509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:39:44.049443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c02677f-2fea-41d6-99b8-00013bc9086d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:44.049952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c02677f-2fea-41d6-99b8-00013bc9086d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:44.050433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c02677f-2fea-41d6-99b8-00013bc9086d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:44.051155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c02677f-2fea-41d6-99b8-00013bc9086d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:44.051627 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c02677f-2fea-41d6-99b8-00013bc9086d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:44.052065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c02677f-2fea-41d6-99b8-00013bc9086d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:44.118463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8c02677f-2fea-41d6-99b8-00013bc9086d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:44.127183 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8c02677f-2fea-41d6-99b8-00013bc9086d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1369 microversion: 2.1 time: 0.091927 Oct 05 18:39:44.127771 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3695/7144] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:44 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:45.155848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:45.156726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:45.161155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:39:45.169826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:45.170342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:45.170855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:45.171557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:45.172014 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:45.172446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:45.215428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:45.215926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:45.216390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:45.216838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lazy-loading 'fault' on Instance uuid 4f13d93e-f6d9-427b-8299-669a811dc1f3 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:39:45.262569 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '654ce2fda5024f6783ef6e2faf2f6617', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7e8c4de8a6d646418e3b78ed8372de22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:39:45.272040 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6808a863-ea47-41de-a2b5-f73cf9ad40f3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 200 len: 1374 microversion: 2.1 time: 0.122910 Oct 05 18:39:45.272644 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3450/7145] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:45 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 1374 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:39:46.299838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:46.300955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:46.311302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:46.311806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:46.312255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:46.312970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:46.313438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:46.313877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:46.331232 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 HTTP/1.1 Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4f13d93e-f6d9-427b-8299-669a811dc1f3'} Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:46.333033 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:46.338453 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:46.338453 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:46.338453 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:46.338453 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:39:46.338453 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:39:46.338453 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:46.338453 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:46.338453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:39:46.338453 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a463d318-4fad-4184-9a60-fce14c22e1b3 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 404 len: 111 microversion: 2.1 time: 0.041483 Oct 05 18:39:46.338453 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3696/7146] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:46 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:39:46.399162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:46.402382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:46.409656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:46.410135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:46.410588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:46.411267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:46.411713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:46.412129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:46.424831 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/os-volume_attachments HTTP/1.1 Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'server_id': '4f13d93e-f6d9-427b-8299-669a811dc1f3'} Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:39:46.426536 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a489d42e-d6e0-4869-9ba3-afc951a21f06 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035554 Oct 05 18:39:46.431076 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3451/7147] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:39:46 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:39:49.759256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:49.759769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:49.767978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.768487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.768934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.769652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.770126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.770602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.785782 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 HTTP/1.1 Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '4f13d93e-f6d9-427b-8299-669a811dc1f3'} Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:39:49.787427 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-42f205c4-0c08-4c1a-beba-00666c80e152 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 404 len: 111 microversion: 2.1 time: 0.033610 Oct 05 18:39:49.791203 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3697/7148] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:39:49 2022] DELETE /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:39:49.799277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:49.799797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 4f13d93e-f6d9-427b-8299-669a811dc1f3] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:49.806661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.807492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.807941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.808656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.809113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.809571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.825508 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 HTTP/1.1 Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4f13d93e-f6d9-427b-8299-669a811dc1f3'} Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.828131 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.833814 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.833814 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.833814 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.833814 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:39:49.833814 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:39:49.833814 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. Oct 05 18:39:49.833814 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.833814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 4f13d93e-f6d9-427b-8299-669a811dc1f3 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:39:49.833814 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c2c0ba2d-e64d-4eeb-8b5f-19a96045e4dc tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3" status: 404 len: 111 microversion: 2.1 time: 0.035355 Oct 05 18:39:49.833814 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3452/7149] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:49 2022] GET /compute/v2.1/servers/4f13d93e-f6d9-427b-8299-669a811dc1f3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:39:49.841409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:49.841933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:49.849501 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.850022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.850508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.851250 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.851724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.852355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.873383 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a HTTP/1.1 Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '2ba983e6-32ac-448e-bbe7-f55042b3cc5a'} Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:39:49.875080 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d6226944-721d-438c-b212-50c3fe396b64 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "DELETE /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 404 len: 111 microversion: 2.1 time: 0.039434 Oct 05 18:39:49.879848 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3698/7150] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:39:49 2022] DELETE /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:39:49.885515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:49.886872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 2ba983e6-32ac-448e-bbe7-f55042b3cc5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:49.893872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.894573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.895016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.895731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.896192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.896625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.911940 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a HTTP/1.1 Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '2ba983e6-32ac-448e-bbe7-f55042b3cc5a'} Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.913502 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.920989 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.920989 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.920989 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.920989 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:39:49.920989 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:39:49.920989 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. Oct 05 18:39:49.920989 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.920989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 2ba983e6-32ac-448e-bbe7-f55042b3cc5a could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:39:49.920989 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-06af4d8e-e868-41a5-bdd9-dd0f87390c9f tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a" status: 404 len: 111 microversion: 2.1 time: 0.033505 Oct 05 18:39:49.920989 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3453/7151] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:49 2022] GET /compute/v2.1/servers/2ba983e6-32ac-448e-bbe7-f55042b3cc5a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:39:49.924053 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:49.924584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:49.931351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.931857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.932415 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.933036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.933509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.933950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.948544 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 HTTP/1.1 Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '99fb7467-7aa1-4f4c-92a0-d1264daaf888'} Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:39:49.950246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8af09020-0576-462d-8737-b28900561422 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "DELETE /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 404 len: 111 microversion: 2.1 time: 0.031655 Oct 05 18:39:49.957478 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3699/7152] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:39:49 2022] DELETE /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:39:49.960627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:49.961182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: 99fb7467-7aa1-4f4c-92a0-d1264daaf888] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:49.967242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.967730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.968166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.968859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:49.969316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:49.969747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:49.983987 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 HTTP/1.1 Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '99fb7467-7aa1-4f4c-92a0-d1264daaf888'} Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:49.985531 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.992804 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:49.992804 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:49.992804 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:49.992804 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:39:49.992804 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:39:49.992804 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. Oct 05 18:39:49.992804 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:49.992804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance 99fb7467-7aa1-4f4c-92a0-d1264daaf888 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:39:49.992804 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cfd120ea-a67d-4cfa-a6b7-5dfd93d5e66b tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888" status: 404 len: 111 microversion: 2.1 time: 0.030446 Oct 05 18:39:49.992804 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3454/7153] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:49 2022] GET /compute/v2.1/servers/99fb7467-7aa1-4f4c-92a0-d1264daaf888 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:39:49.995873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:49.996387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:50.003031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:50.003525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:50.003977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:50.004680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:50.005147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:50.005590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:50.019970 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 HTTP/1.1 Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'ece1c79d-3bf5-499a-befa-00e691e79a10'} Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:39:50.021588 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2183f7df-6b2a-4075-a08b-3113b9ed0e1d tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "DELETE /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 404 len: 111 microversion: 2.1 time: 0.031122 Oct 05 18:39:50.028910 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3700/7154] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:39:49 2022] DELETE /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:39:50.033484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:50.034152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] [instance: ece1c79d-3bf5-499a-befa-00e691e79a10] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:39:50.040438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:50.040918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:50.041353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:50.042048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:50.042532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:50.042957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:50.056918 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] HTTP exception thrown: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Request method failure captured: Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 HTTP/1.1 Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc4hfemTDTsRxhk8ltwDPv4ZCwMyNDSZLU2KBmjwDo4DRcFChpvQ89VMIr2Wsb7gO7gO_evK6OT05fnnDrwyOoG-pF2tfYhkdvr5rMdiXoplWQJBLdL85IeyVI2ojyV0z8r74TbwKLAWsNjPmC3I3IGxlTMif4Z9u2G7bQlZ20d-kAE Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7e8c4de8a6d646418e3b78ed8372de22", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7e8c4de8a6d646418e3b78ed8372de22"}]}] Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7e8c4de8a6d646418e3b78ed8372de22 Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServerActionsTestJSON-1159900073 Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 654ce2fda5024f6783ef6e2faf2f6617 Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServerActionsTestJSON-1159900073-project Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'ece1c79d-3bf5-499a-befa-00e691e79a10'} Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:39:50.058507 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:50.062832 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:39:50.062832 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:39:50.062832 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:39:50.062832 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:39:50.062832 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:39:50.062832 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. Oct 05 18:39:50.062832 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:39:50.062832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Returning 404 to user: Instance ece1c79d-3bf5-499a-befa-00e691e79a10 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:39:50.062832 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-250b721e-ed2f-4488-be1f-abe1aa4c0cba tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10" status: 404 len: 111 microversion: 2.1 time: 0.031220 Oct 05 18:39:50.062832 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3455/7155] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:39:50 2022] GET /compute/v2.1/servers/ece1c79d-3bf5-499a-befa-00e691e79a10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:39:50.069095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84ce331a-fe63-435e-8a5c-695e44ee5721 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] Calling method '.version_select at 0x7f777960ab80>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:39:50.094982 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84ce331a-fe63-435e-8a5c-695e44ee5721 tempest-ServerActionsTestJSON-1159900073 tempest-ServerActionsTestJSON-1159900073-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-307237400" status: 202 len: 0 microversion: 2.1 time: 0.029348 Oct 05 18:39:50.095710 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3701/7156] 10.222.0.70 () {58 vars in 1218 bytes} [Wed Oct 5 18:39:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-307237400 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:39:59.426623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-527877019", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "6f963377-7bf5-42d7-8931-80c24610ae71"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:39:59.486267 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] validate_networks() for [('6f963377-7bf5-42d7-8931-80c24610ae71', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:39:59.899287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:39:59.899709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:39:59.900203 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:39:59.900612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:39:59.901094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:39:59.914655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:59.915149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:59.915611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:59.916321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:39:59.916778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:39:59.917200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:39:59.935641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Getting quotas for project fefd61c694d0453cbd4ea3ea1cc7a14f. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:39:59.941609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Getting quotas for user be7e6292d95841f9a3a79b8471d3f23c and project fefd61c694d0453cbd4ea3ea1cc7a14f. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:39:59.955394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:39:59.957900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:40:00.006388 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3ec930d7-77a8-47d4-9a53-67c1f6f02f15 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.732287 Oct 05 18:40:00.007058 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3456/7157] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:39:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:40:00.016932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=27 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:00.021130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-68a68ab7-9f5d-42f8-990d-49207eabfada tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:00.021785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-68a68ab7-9f5d-42f8-990d-49207eabfada tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:00.093495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-68a68ab7-9f5d-42f8-990d-49207eabfada tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:00.101178 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-68a68ab7-9f5d-42f8-990d-49207eabfada tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1216 microversion: 2.1 time: 0.086470 Oct 05 18:40:00.102195 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3702/7158] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:00 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1216 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:01.125595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c71a8879-ea6d-43f4-bac3-7e6c3522ac71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:01.126897 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c71a8879-ea6d-43f4-bac3-7e6c3522ac71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:01.133757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c71a8879-ea6d-43f4-bac3-7e6c3522ac71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:01.134678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c71a8879-ea6d-43f4-bac3-7e6c3522ac71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:01.135436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c71a8879-ea6d-43f4-bac3-7e6c3522ac71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:01.136444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c71a8879-ea6d-43f4-bac3-7e6c3522ac71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:01.137150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c71a8879-ea6d-43f4-bac3-7e6c3522ac71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:01.138850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c71a8879-ea6d-43f4-bac3-7e6c3522ac71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:01.244700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c71a8879-ea6d-43f4-bac3-7e6c3522ac71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:01.254476 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c71a8879-ea6d-43f4-bac3-7e6c3522ac71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1286 microversion: 2.1 time: 0.133657 Oct 05 18:40:01.255301 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3457/7159] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:01 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:02.279888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5082f61-aa02-49de-bc49-716545620f5e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:02.280493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b5082f61-aa02-49de-bc49-716545620f5e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:02.287717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5082f61-aa02-49de-bc49-716545620f5e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:02.288259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5082f61-aa02-49de-bc49-716545620f5e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:02.288692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5082f61-aa02-49de-bc49-716545620f5e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:02.289412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5082f61-aa02-49de-bc49-716545620f5e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:02.290128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5082f61-aa02-49de-bc49-716545620f5e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:02.290774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5082f61-aa02-49de-bc49-716545620f5e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:02.440193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b5082f61-aa02-49de-bc49-716545620f5e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:02.450321 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b5082f61-aa02-49de-bc49-716545620f5e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1316 microversion: 2.1 time: 0.174427 Oct 05 18:40:02.452043 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3703/7160] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:02 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:02.575375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-70d9a58b-90bf-41e7-b9aa-33ad32a6ad12 req-fc8a7c61-24d7-4841-9136-5b147dc40ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13b51e6e-3226-4851-88ec-6bf09a091c6a", "tag": "c081cd70-1414-4f98-baa5-68dc29ee652a"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:02.593789 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-70d9a58b-90bf-41e7-b9aa-33ad32a6ad12 req-fc8a7c61-24d7-4841-9136-5b147dc40ccd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:02.595044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-70d9a58b-90bf-41e7-b9aa-33ad32a6ad12 req-fc8a7c61-24d7-4841-9136-5b147dc40ccd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:02.595701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-70d9a58b-90bf-41e7-b9aa-33ad32a6ad12 req-fc8a7c61-24d7-4841-9136-5b147dc40ccd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:02.611917 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-70d9a58b-90bf-41e7-b9aa-33ad32a6ad12 req-fc8a7c61-24d7-4841-9136-5b147dc40ccd service nova] Creating event network-changed:c081cd70-1414-4f98-baa5-68dc29ee652a for instance 13b51e6e-3226-4851-88ec-6bf09a091c6a on n-h2-835595-3 Oct 05 18:40:02.617066 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-70d9a58b-90bf-41e7-b9aa-33ad32a6ad12 req-fc8a7c61-24d7-4841-9136-5b147dc40ccd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048707 Oct 05 18:40:02.618038 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3458/7161] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:40:03.474833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ceeeca9e-ce1c-448c-b729-f16b00e34b2e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:03.475469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ceeeca9e-ce1c-448c-b729-f16b00e34b2e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:03.482724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ceeeca9e-ce1c-448c-b729-f16b00e34b2e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:03.483242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ceeeca9e-ce1c-448c-b729-f16b00e34b2e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:03.483695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ceeeca9e-ce1c-448c-b729-f16b00e34b2e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:03.484443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ceeeca9e-ce1c-448c-b729-f16b00e34b2e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:03.484918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ceeeca9e-ce1c-448c-b729-f16b00e34b2e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:03.485363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ceeeca9e-ce1c-448c-b729-f16b00e34b2e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:03.620880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ceeeca9e-ce1c-448c-b729-f16b00e34b2e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:03.629038 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ceeeca9e-ce1c-448c-b729-f16b00e34b2e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1316 microversion: 2.1 time: 0.158365 Oct 05 18:40:03.629616 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3704/7162] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:03 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:04.654587 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-22d189e5-3acb-4a4f-85a1-fcb0346b2f00 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:04.655859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-22d189e5-3acb-4a4f-85a1-fcb0346b2f00 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:04.662766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22d189e5-3acb-4a4f-85a1-fcb0346b2f00 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:04.663277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22d189e5-3acb-4a4f-85a1-fcb0346b2f00 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:04.663715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22d189e5-3acb-4a4f-85a1-fcb0346b2f00 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:04.664431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22d189e5-3acb-4a4f-85a1-fcb0346b2f00 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:04.664891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22d189e5-3acb-4a4f-85a1-fcb0346b2f00 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:04.665318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22d189e5-3acb-4a4f-85a1-fcb0346b2f00 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:04.800635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-22d189e5-3acb-4a4f-85a1-fcb0346b2f00 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:04.809148 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-22d189e5-3acb-4a4f-85a1-fcb0346b2f00 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1316 microversion: 2.1 time: 0.159904 Oct 05 18:40:04.809735 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3459/7163] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:04 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:05.832733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e4476af5-060f-4562-a9a5-c768419a3378 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:05.833352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e4476af5-060f-4562-a9a5-c768419a3378 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:05.841844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4476af5-060f-4562-a9a5-c768419a3378 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:05.842399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4476af5-060f-4562-a9a5-c768419a3378 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:05.842849 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4476af5-060f-4562-a9a5-c768419a3378 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:05.843557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4476af5-060f-4562-a9a5-c768419a3378 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:05.844026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4476af5-060f-4562-a9a5-c768419a3378 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:05.844457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4476af5-060f-4562-a9a5-c768419a3378 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:05.978521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e4476af5-060f-4562-a9a5-c768419a3378 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:05.987257 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e4476af5-060f-4562-a9a5-c768419a3378 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1316 microversion: 2.1 time: 0.159296 Oct 05 18:40:05.987839 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3705/7164] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:05 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:07.010993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-22ab7343-f984-443a-a3ae-b25c303f8142 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:07.011635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-22ab7343-f984-443a-a3ae-b25c303f8142 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:07.019412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab7343-f984-443a-a3ae-b25c303f8142 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:07.019888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab7343-f984-443a-a3ae-b25c303f8142 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:07.020371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab7343-f984-443a-a3ae-b25c303f8142 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:07.021121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab7343-f984-443a-a3ae-b25c303f8142 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:07.021576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab7343-f984-443a-a3ae-b25c303f8142 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:07.021998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-22ab7343-f984-443a-a3ae-b25c303f8142 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:07.155847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-22ab7343-f984-443a-a3ae-b25c303f8142 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:07.164097 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-22ab7343-f984-443a-a3ae-b25c303f8142 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1316 microversion: 2.1 time: 0.157262 Oct 05 18:40:07.164677 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3460/7165] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:07 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:08.192174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0acc69fc-fd22-414d-b163-7b2c22ecc624 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:08.192748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0acc69fc-fd22-414d-b163-7b2c22ecc624 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:08.203152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0acc69fc-fd22-414d-b163-7b2c22ecc624 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:08.203805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0acc69fc-fd22-414d-b163-7b2c22ecc624 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:08.204420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0acc69fc-fd22-414d-b163-7b2c22ecc624 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:08.205464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0acc69fc-fd22-414d-b163-7b2c22ecc624 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:08.206049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0acc69fc-fd22-414d-b163-7b2c22ecc624 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:08.206647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0acc69fc-fd22-414d-b163-7b2c22ecc624 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:08.352335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0acc69fc-fd22-414d-b163-7b2c22ecc624 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:08.361301 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0acc69fc-fd22-414d-b163-7b2c22ecc624 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1316 microversion: 2.1 time: 0.175877 Oct 05 18:40:08.361850 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3706/7166] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:08 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:08.518485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-5a7ba811-348c-439e-9f31-32ccc85f49bb req-64770939-64cf-40c1-8e0f-984a97402e7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b51e6e-3226-4851-88ec-6bf09a091c6a", "name": "network-vif-plugged", "status": "completed", "tag": "c081cd70-1414-4f98-baa5-68dc29ee652a"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:08.530724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5a7ba811-348c-439e-9f31-32ccc85f49bb req-64770939-64cf-40c1-8e0f-984a97402e7e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:08.531209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5a7ba811-348c-439e-9f31-32ccc85f49bb req-64770939-64cf-40c1-8e0f-984a97402e7e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:08.531881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-5a7ba811-348c-439e-9f31-32ccc85f49bb req-64770939-64cf-40c1-8e0f-984a97402e7e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:08.535988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=58 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:08.544434 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-5a7ba811-348c-439e-9f31-32ccc85f49bb req-64770939-64cf-40c1-8e0f-984a97402e7e service nova] Creating event network-vif-plugged:c081cd70-1414-4f98-baa5-68dc29ee652a for instance 13b51e6e-3226-4851-88ec-6bf09a091c6a on n-h2-835595-3 Oct 05 18:40:08.549596 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-5a7ba811-348c-439e-9f31-32ccc85f49bb req-64770939-64cf-40c1-8e0f-984a97402e7e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035447 Oct 05 18:40:08.550455 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3461/7167] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:40:09.384407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-88b576b7-8ead-4b57-a0f2-8e787e6775d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:09.385044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-88b576b7-8ead-4b57-a0f2-8e787e6775d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:09.392805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b576b7-8ead-4b57-a0f2-8e787e6775d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:09.393317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b576b7-8ead-4b57-a0f2-8e787e6775d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:09.393773 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b576b7-8ead-4b57-a0f2-8e787e6775d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:09.394605 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b576b7-8ead-4b57-a0f2-8e787e6775d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:09.395085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b576b7-8ead-4b57-a0f2-8e787e6775d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:09.395643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-88b576b7-8ead-4b57-a0f2-8e787e6775d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:09.536120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-88b576b7-8ead-4b57-a0f2-8e787e6775d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:09.548012 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-88b576b7-8ead-4b57-a0f2-8e787e6775d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1316 microversion: 2.1 time: 0.167273 Oct 05 18:40:09.548808 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3707/7168] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:09 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:10.580798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-69487ff2-ddcb-4959-8de7-a43646218f71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:10.581954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-69487ff2-ddcb-4959-8de7-a43646218f71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:10.586370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:10.587496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:10.598476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69487ff2-ddcb-4959-8de7-a43646218f71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:10.599224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69487ff2-ddcb-4959-8de7-a43646218f71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:10.599855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69487ff2-ddcb-4959-8de7-a43646218f71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:10.600894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69487ff2-ddcb-4959-8de7-a43646218f71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:10.601453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69487ff2-ddcb-4959-8de7-a43646218f71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:10.602073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-69487ff2-ddcb-4959-8de7-a43646218f71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:10.750670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-69487ff2-ddcb-4959-8de7-a43646218f71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:10.758807 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-69487ff2-ddcb-4959-8de7-a43646218f71 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1504 microversion: 2.1 time: 0.185756 Oct 05 18:40:10.759382 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3462/7169] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:10 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:10.820237 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1498236482", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "6f963377-7bf5-42d7-8931-80c24610ae71"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:10.828922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:10.880361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] validate_networks() for [('6f963377-7bf5-42d7-8931-80c24610ae71', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:40:11.269227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:40:11.269672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:40:11.270245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:40:11.270711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:40:11.271144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:40:11.281080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:11.281585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:11.282036 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:11.282824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:11.283304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:11.283744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:11.301677 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Getting quotas for project fefd61c694d0453cbd4ea3ea1cc7a14f. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:40:11.307263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Getting quotas for user be7e6292d95841f9a3a79b8471d3f23c and project fefd61c694d0453cbd4ea3ea1cc7a14f. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:40:11.320306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:40:11.322707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:40:11.373816 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2851b74a-d561-4f40-badd-c9734165650b tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557559 Oct 05 18:40:11.380461 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3708/7170] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:40:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:40:11.386082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-22f8a406-b1c6-45ca-a362-a091542ff8d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:11.386722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-22f8a406-b1c6-45ca-a362-a091542ff8d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:11.445262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-22f8a406-b1c6-45ca-a362-a091542ff8d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:11.453044 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-22f8a406-b1c6-45ca-a362-a091542ff8d3 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 200 len: 1217 microversion: 2.1 time: 0.070905 Oct 05 18:40:11.453637 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3463/7171] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:11 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:12.476986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-feef522d-4ebc-413b-8f23-945be976eb27 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:12.477660 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-feef522d-4ebc-413b-8f23-945be976eb27 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:12.485208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feef522d-4ebc-413b-8f23-945be976eb27 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:12.485717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feef522d-4ebc-413b-8f23-945be976eb27 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:12.486166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feef522d-4ebc-413b-8f23-945be976eb27 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:12.487067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feef522d-4ebc-413b-8f23-945be976eb27 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:12.487541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feef522d-4ebc-413b-8f23-945be976eb27 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:12.488095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-feef522d-4ebc-413b-8f23-945be976eb27 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:12.555951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-feef522d-4ebc-413b-8f23-945be976eb27 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:12.564007 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-feef522d-4ebc-413b-8f23-945be976eb27 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 200 len: 1287 microversion: 2.1 time: 0.091979 Oct 05 18:40:12.564594 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3709/7172] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:12 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 1287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:13.587436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4296e57f-a036-4afd-9324-5549d62b6e36 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:13.588169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4296e57f-a036-4afd-9324-5549d62b6e36 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:13.596556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4296e57f-a036-4afd-9324-5549d62b6e36 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:13.597338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4296e57f-a036-4afd-9324-5549d62b6e36 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:13.597777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4296e57f-a036-4afd-9324-5549d62b6e36 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:13.598655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4296e57f-a036-4afd-9324-5549d62b6e36 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:13.599107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4296e57f-a036-4afd-9324-5549d62b6e36 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:13.599526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4296e57f-a036-4afd-9324-5549d62b6e36 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:13.807682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4296e57f-a036-4afd-9324-5549d62b6e36 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:13.816334 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4296e57f-a036-4afd-9324-5549d62b6e36 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 200 len: 1317 microversion: 2.1 time: 0.232884 Oct 05 18:40:13.816965 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3464/7173] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:13 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:13.898096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-59c71b37-7cee-4650-b42c-b22055b442fd req-e9f8ad77-9679-473a-8e9f-41689241b542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a753cc11-af6e-4f88-9322-403bf657db71", "tag": "6a3f96e2-4b83-4054-b8df-e290b5f0cdef"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:13.910728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-59c71b37-7cee-4650-b42c-b22055b442fd req-e9f8ad77-9679-473a-8e9f-41689241b542 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:13.910728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-59c71b37-7cee-4650-b42c-b22055b442fd req-e9f8ad77-9679-473a-8e9f-41689241b542 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:13.911293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-59c71b37-7cee-4650-b42c-b22055b442fd req-e9f8ad77-9679-473a-8e9f-41689241b542 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:13.935730 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-59c71b37-7cee-4650-b42c-b22055b442fd req-e9f8ad77-9679-473a-8e9f-41689241b542 service nova] Creating event network-changed:6a3f96e2-4b83-4054-b8df-e290b5f0cdef for instance a753cc11-af6e-4f88-9322-403bf657db71 on n-h1-835595-3 Oct 05 18:40:13.941162 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-59c71b37-7cee-4650-b42c-b22055b442fd req-e9f8ad77-9679-473a-8e9f-41689241b542 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046841 Oct 05 18:40:13.941940 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3710/7174] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:40:14.843586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8368ff85-a486-40e8-a1a0-0e6be647c21e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:14.844400 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8368ff85-a486-40e8-a1a0-0e6be647c21e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:14.853001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8368ff85-a486-40e8-a1a0-0e6be647c21e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:14.853579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8368ff85-a486-40e8-a1a0-0e6be647c21e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:14.854090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8368ff85-a486-40e8-a1a0-0e6be647c21e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:14.854958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8368ff85-a486-40e8-a1a0-0e6be647c21e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:14.855490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8368ff85-a486-40e8-a1a0-0e6be647c21e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:14.855974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8368ff85-a486-40e8-a1a0-0e6be647c21e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:14.997964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8368ff85-a486-40e8-a1a0-0e6be647c21e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:15.006187 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8368ff85-a486-40e8-a1a0-0e6be647c21e tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 200 len: 1317 microversion: 2.1 time: 0.168722 Oct 05 18:40:15.006820 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3465/7175] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:14 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:16.031525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1828f835-6d43-4449-977e-1335c6f30e22 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:16.032153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1828f835-6d43-4449-977e-1335c6f30e22 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:16.034158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:16.040455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1828f835-6d43-4449-977e-1335c6f30e22 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:16.041104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1828f835-6d43-4449-977e-1335c6f30e22 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:16.041550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1828f835-6d43-4449-977e-1335c6f30e22 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:16.042264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1828f835-6d43-4449-977e-1335c6f30e22 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:16.042759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1828f835-6d43-4449-977e-1335c6f30e22 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:16.043189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1828f835-6d43-4449-977e-1335c6f30e22 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:16.182542 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1828f835-6d43-4449-977e-1335c6f30e22 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:16.192035 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1828f835-6d43-4449-977e-1335c6f30e22 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 200 len: 1317 microversion: 2.1 time: 0.165847 Oct 05 18:40:16.192627 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3711/7176] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:16 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:17.219847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e0bcca03-af78-490b-a8d8-17acc20ff670 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:17.220724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e0bcca03-af78-490b-a8d8-17acc20ff670 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:17.224942 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:17.234780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0bcca03-af78-490b-a8d8-17acc20ff670 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:17.235590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0bcca03-af78-490b-a8d8-17acc20ff670 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:17.236366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0bcca03-af78-490b-a8d8-17acc20ff670 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:17.237561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0bcca03-af78-490b-a8d8-17acc20ff670 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:17.238359 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0bcca03-af78-490b-a8d8-17acc20ff670 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:17.239068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e0bcca03-af78-490b-a8d8-17acc20ff670 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:17.394952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e0bcca03-af78-490b-a8d8-17acc20ff670 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:17.403259 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e0bcca03-af78-490b-a8d8-17acc20ff670 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 200 len: 1317 microversion: 2.1 time: 0.190460 Oct 05 18:40:17.403833 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3466/7177] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:17 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:17.946324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-66749259-6cc8-4c9d-be3b-1ddd6bee6e4b req-e2cb7f5e-30f6-436b-bdbe-4d953ff2e6a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a753cc11-af6e-4f88-9322-403bf657db71", "name": "network-vif-plugged", "status": "completed", "tag": "6a3f96e2-4b83-4054-b8df-e290b5f0cdef"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:17.958730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-66749259-6cc8-4c9d-be3b-1ddd6bee6e4b req-e2cb7f5e-30f6-436b-bdbe-4d953ff2e6a3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:17.959240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-66749259-6cc8-4c9d-be3b-1ddd6bee6e4b req-e2cb7f5e-30f6-436b-bdbe-4d953ff2e6a3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:17.960039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-66749259-6cc8-4c9d-be3b-1ddd6bee6e4b req-e2cb7f5e-30f6-436b-bdbe-4d953ff2e6a3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:17.971906 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-66749259-6cc8-4c9d-be3b-1ddd6bee6e4b req-e2cb7f5e-30f6-436b-bdbe-4d953ff2e6a3 service nova] Creating event network-vif-plugged:6a3f96e2-4b83-4054-b8df-e290b5f0cdef for instance a753cc11-af6e-4f88-9322-403bf657db71 on n-h1-835595-3 Oct 05 18:40:17.977235 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-66749259-6cc8-4c9d-be3b-1ddd6bee6e4b req-e2cb7f5e-30f6-436b-bdbe-4d953ff2e6a3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034747 Oct 05 18:40:17.977841 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3712/7178] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:40:18.430991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a5fe07cf-9891-4474-af0c-c2f12c7b91db tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:18.431879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a5fe07cf-9891-4474-af0c-c2f12c7b91db tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:18.441032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5fe07cf-9891-4474-af0c-c2f12c7b91db tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:18.441523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5fe07cf-9891-4474-af0c-c2f12c7b91db tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:18.441970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5fe07cf-9891-4474-af0c-c2f12c7b91db tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:18.442705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5fe07cf-9891-4474-af0c-c2f12c7b91db tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:18.443152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5fe07cf-9891-4474-af0c-c2f12c7b91db tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:18.443578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a5fe07cf-9891-4474-af0c-c2f12c7b91db tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:18.585866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a5fe07cf-9891-4474-af0c-c2f12c7b91db tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:18.594089 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a5fe07cf-9891-4474-af0c-c2f12c7b91db tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 200 len: 1317 microversion: 2.1 time: 0.169878 Oct 05 18:40:18.594718 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3467/7179] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:18 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:19.623815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-23cf2b0f-4531-4624-b71f-11c4be942b19 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:19.624988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-23cf2b0f-4531-4624-b71f-11c4be942b19 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:19.636070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cf2b0f-4531-4624-b71f-11c4be942b19 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:19.636897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cf2b0f-4531-4624-b71f-11c4be942b19 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:19.637645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cf2b0f-4531-4624-b71f-11c4be942b19 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:19.638863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cf2b0f-4531-4624-b71f-11c4be942b19 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:19.639653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cf2b0f-4531-4624-b71f-11c4be942b19 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:19.640383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-23cf2b0f-4531-4624-b71f-11c4be942b19 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:20.124636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-23cf2b0f-4531-4624-b71f-11c4be942b19 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:20.132845 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-23cf2b0f-4531-4624-b71f-11c4be942b19 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 200 len: 1506 microversion: 2.1 time: 0.517843 Oct 05 18:40:20.133428 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3713/7180] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:19 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 1506 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:20.155722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fd2a26bb-ac3a-4b50-894b-b3ad23da1c26 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:20.156253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd2a26bb-ac3a-4b50-894b-b3ad23da1c26 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:20.163772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd2a26bb-ac3a-4b50-894b-b3ad23da1c26 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:20.164197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd2a26bb-ac3a-4b50-894b-b3ad23da1c26 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:20.164637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd2a26bb-ac3a-4b50-894b-b3ad23da1c26 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:20.165334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd2a26bb-ac3a-4b50-894b-b3ad23da1c26 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:20.165792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd2a26bb-ac3a-4b50-894b-b3ad23da1c26 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:20.166225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fd2a26bb-ac3a-4b50-894b-b3ad23da1c26 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:20.192110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fd2a26bb-ac3a-4b50-894b-b3ad23da1c26 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:40:20.277981 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fd2a26bb-ac3a-4b50-894b-b3ad23da1c26 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 204 len: 0 microversion: 2.1 time: 0.125573 Oct 05 18:40:20.278955 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3468/7181] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:40:20 2022] DELETE /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:40:20.289554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ef8269fa-9338-4d0a-ab6d-06ff47618d21 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:20.290159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ef8269fa-9338-4d0a-ab6d-06ff47618d21 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:20.297649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef8269fa-9338-4d0a-ab6d-06ff47618d21 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:20.298153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef8269fa-9338-4d0a-ab6d-06ff47618d21 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:20.298638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef8269fa-9338-4d0a-ab6d-06ff47618d21 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:20.299350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef8269fa-9338-4d0a-ab6d-06ff47618d21 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:20.299818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef8269fa-9338-4d0a-ab6d-06ff47618d21 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:20.300259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ef8269fa-9338-4d0a-ab6d-06ff47618d21 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:20.434727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ef8269fa-9338-4d0a-ab6d-06ff47618d21 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:20.442739 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ef8269fa-9338-4d0a-ab6d-06ff47618d21 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 200 len: 1512 microversion: 2.1 time: 0.159352 Oct 05 18:40:20.443303 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3714/7182] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:20 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:21.469807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-987494f5-feb1-43c2-80ce-955a682e9b67 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:21.470568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-987494f5-feb1-43c2-80ce-955a682e9b67 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:21.473425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:21.479075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987494f5-feb1-43c2-80ce-955a682e9b67 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:21.479565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987494f5-feb1-43c2-80ce-955a682e9b67 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:21.479998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987494f5-feb1-43c2-80ce-955a682e9b67 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:21.480686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987494f5-feb1-43c2-80ce-955a682e9b67 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:21.481145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987494f5-feb1-43c2-80ce-955a682e9b67 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:21.481566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-987494f5-feb1-43c2-80ce-955a682e9b67 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:21.693547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-987494f5-feb1-43c2-80ce-955a682e9b67 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:21.701823 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-987494f5-feb1-43c2-80ce-955a682e9b67 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 200 len: 1512 microversion: 2.1 time: 0.238945 Oct 05 18:40:21.702489 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3469/7183] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:21 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 1512 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:22.083582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e9bc9808-0a39-4b7f-a23a-17e624432b87 req-52c6dc51-7975-480c-8245-5139df1fb9bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a753cc11-af6e-4f88-9322-403bf657db71", "name": "network-vif-deleted", "tag": "6a3f96e2-4b83-4054-b8df-e290b5f0cdef"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:22.095381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:22.096606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:22.099397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e9bc9808-0a39-4b7f-a23a-17e624432b87 req-52c6dc51-7975-480c-8245-5139df1fb9bf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:22.100180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e9bc9808-0a39-4b7f-a23a-17e624432b87 req-52c6dc51-7975-480c-8245-5139df1fb9bf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:22.100908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e9bc9808-0a39-4b7f-a23a-17e624432b87 req-52c6dc51-7975-480c-8245-5139df1fb9bf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:22.115981 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e9bc9808-0a39-4b7f-a23a-17e624432b87 req-52c6dc51-7975-480c-8245-5139df1fb9bf service nova] Creating event network-vif-deleted:6a3f96e2-4b83-4054-b8df-e290b5f0cdef for instance a753cc11-af6e-4f88-9322-403bf657db71 on n-h1-835595-3 Oct 05 18:40:22.121913 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e9bc9808-0a39-4b7f-a23a-17e624432b87 req-52c6dc51-7975-480c-8245-5139df1fb9bf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042114 Oct 05 18:40:22.123483 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3715/7184] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:40:22.729269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:22.730309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:22.739419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:22.739886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:22.740329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:22.741025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:22.741484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:22.741911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:22.755709 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] HTTP exception thrown: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Request method failure captured: Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 HTTP/1.1 Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc9_9IoJHpu-BDLuclUdOsu4aBpUnc94S5FdJ19HPh68SXWhCrweAAvlRpYgOKfplQHW9iOeb3ucPETXlpj7uYXyWX50AD6_FULvPLkH_OLbINtokMHCaVSbykriupZn90n0CwYTppFEdmhttWDUnyIb_C3FtH1meMzJFkQGXXCq8F4 Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fefd61c694d0453cbd4ea3ea1cc7a14f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}] Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: be7e6292d95841f9a3a79b8471d3f23c Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a753cc11-af6e-4f88-9322-403bf657db71'} Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:22.757339 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:22.762097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:22.762097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:22.762097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:22.762097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:40:22.762097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:40:22.762097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:22.762097 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:22.762097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Returning 404 to user: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:40:22.762097 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f9bc1e3a-de94-47f7-8684-6c2c1df8e553 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 404 len: 111 microversion: 2.1 time: 0.036197 Oct 05 18:40:22.762097 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3470/7185] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:22 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:40:22.769326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cd9fbf49-48da-42ff-a1e3-99ecee151269 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:22.770039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cd9fbf49-48da-42ff-a1e3-99ecee151269 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:22.776407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9fbf49-48da-42ff-a1e3-99ecee151269 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:22.776900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9fbf49-48da-42ff-a1e3-99ecee151269 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:22.777348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9fbf49-48da-42ff-a1e3-99ecee151269 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:22.778050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9fbf49-48da-42ff-a1e3-99ecee151269 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:22.778624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9fbf49-48da-42ff-a1e3-99ecee151269 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:22.779054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cd9fbf49-48da-42ff-a1e3-99ecee151269 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:22.915515 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cd9fbf49-48da-42ff-a1e3-99ecee151269 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:22.925704 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cd9fbf49-48da-42ff-a1e3-99ecee151269 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1504 microversion: 2.1 time: 0.161138 Oct 05 18:40:22.926257 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3716/7186] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:22 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:22.948364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00551082-2f2a-40df-be91-21aebfb23e62 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:22.950728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-00551082-2f2a-40df-be91-21aebfb23e62 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 9971c41a-50a2-437a-b3d4-a15d84f1dffc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:22.956638 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-00551082-2f2a-40df-be91-21aebfb23e62 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] HTTP exception thrown: Instance 9971c41a-50a2-437a-b3d4-a15d84f1dffc could not be found. Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00551082-2f2a-40df-be91-21aebfb23e62 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Request method failure captured: Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/9971c41a-50a2-437a-b3d4-a15d84f1dffc/action HTTP/1.1 Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 32 Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc9_9IoJHpu-BDLuclUdOsu4aBpUnc94S5FdJ19HPh68SXWhCrweAAvlRpYgOKfplQHW9iOeb3ucPETXlpj7uYXyWX50AD6_FULvPLkH_OLbINtokMHCaVSbykriupZn90n0CwYTppFEdmhttWDUnyIb_C3FtH1meMzJFkQGXXCq8F4 Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fefd61c694d0453cbd4ea3ea1cc7a14f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}] Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: be7e6292d95841f9a3a79b8471d3f23c Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: {"resize": {"flavorRef": "452"}} Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 9971c41a-50a2-437a-b3d4-a15d84f1dffc could not be found. Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '9971c41a-50a2-437a-b3d4-a15d84f1dffc', 'body': {'resize': {'flavorRef': '452'}}} Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9971c41a-50a2-437a-b3d4-a15d84f1dffc could not be found. Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:40:22.958206 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9971c41a-50a2-437a-b3d4-a15d84f1dffc could not be found. Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9971c41a-50a2-437a-b3d4-a15d84f1dffc could not be found. Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-00551082-2f2a-40df-be91-21aebfb23e62 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Returning 404 to user: Instance 9971c41a-50a2-437a-b3d4-a15d84f1dffc could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-00551082-2f2a-40df-be91-21aebfb23e62 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "POST /compute/v2.1/servers/9971c41a-50a2-437a-b3d4-a15d84f1dffc/action" status: 404 len: 111 microversion: 2.1 time: 0.015578 Oct 05 18:40:22.962729 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3471/7187] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:40:22 2022] POST /compute/v2.1/servers/9971c41a-50a2-437a-b3d4-a15d84f1dffc/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:40:22.968972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fa619ab7-c7e1-4b14-9bc4-2b9b3d82e885 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:22.969712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fa619ab7-c7e1-4b14-9bc4-2b9b3d82e885 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:22.976232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa619ab7-c7e1-4b14-9bc4-2b9b3d82e885 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:22.976730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa619ab7-c7e1-4b14-9bc4-2b9b3d82e885 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:22.977177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa619ab7-c7e1-4b14-9bc4-2b9b3d82e885 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:22.977880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa619ab7-c7e1-4b14-9bc4-2b9b3d82e885 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:22.978413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa619ab7-c7e1-4b14-9bc4-2b9b3d82e885 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:22.978934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fa619ab7-c7e1-4b14-9bc4-2b9b3d82e885 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:23.122253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fa619ab7-c7e1-4b14-9bc4-2b9b3d82e885 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:23.130398 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fa619ab7-c7e1-4b14-9bc4-2b9b3d82e885 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1504 microversion: 2.1 time: 0.165469 Oct 05 18:40:23.130978 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3717/7188] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:22 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:23.153408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-26f1ba43-0624-4698-838c-386e4d2e09b6 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:23.154022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-26f1ba43-0624-4698-838c-386e4d2e09b6 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:23.161026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26f1ba43-0624-4698-838c-386e4d2e09b6 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:23.161517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26f1ba43-0624-4698-838c-386e4d2e09b6 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:23.161953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26f1ba43-0624-4698-838c-386e4d2e09b6 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:23.162677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26f1ba43-0624-4698-838c-386e4d2e09b6 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:23.163130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26f1ba43-0624-4698-838c-386e4d2e09b6 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:23.163554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26f1ba43-0624-4698-838c-386e4d2e09b6 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:23.365473 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-26f1ba43-0624-4698-838c-386e4d2e09b6 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:23.373488 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-26f1ba43-0624-4698-838c-386e4d2e09b6 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1504 microversion: 2.1 time: 0.223968 Oct 05 18:40:23.374085 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3472/7189] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:23 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:23.396401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "199a63ec-b115-41f7-84d0-045cccc1ace9"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:23.398743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:23.405219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:23.405729 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:23.406182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:23.406987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:23.407540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:23.407811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:23.437040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:23.442175 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] HTTP exception thrown: Flavor 199a63ec-b115-41f7-84d0-045cccc1ace9 could not be found. Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Request method failure captured: Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: request: POST /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a/action HTTP/1.1 Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 65 Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc9_9IoJHpu-BDLuclUdOsu4aBpUnc94S5FdJ19HPh68SXWhCrweAAvlRpYgOKfplQHW9iOeb3ucPETXlpj7uYXyWX50AD6_FULvPLkH_OLbINtokMHCaVSbykriupZn90n0CwYTppFEdmhttWDUnyIb_C3FtH1meMzJFkQGXXCq8F4 Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fefd61c694d0453cbd4ea3ea1cc7a14f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}] Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: be7e6292d95841f9a3a79b8471d3f23c Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: {"resize": {"flavorRef": "199a63ec-b115-41f7-84d0-045cccc1ace9"}} Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: exception: Flavor 199a63ec-b115-41f7-84d0-045cccc1ace9 could not be found. Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '13b51e6e-3226-4851-88ec-6bf09a091c6a', 'body': {'resize': {'flavorRef': '199a63ec-b115-41f7-84d0-045cccc1ace9'}}} Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:40:23.444150 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 199a63ec-b115-41f7-84d0-045cccc1ace9 could not be found. Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 199a63ec-b115-41f7-84d0-045cccc1ace9 could not be found. Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 199a63ec-b115-41f7-84d0-045cccc1ace9 could not be found. Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Returning 400 to user: Flavor 199a63ec-b115-41f7-84d0-045cccc1ace9 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4a5d8387-22c9-4255-81ee-4144da50c1ee tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "POST /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a/action" status: 400 len: 107 microversion: 2.1 time: 0.053353 Oct 05 18:40:23.448111 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3718/7190] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:40:23 2022] POST /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a/action => generated 107 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:40:23.455316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cfc69330-e8fc-47ae-9aeb-03165c6f53d9 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:23.455927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cfc69330-e8fc-47ae-9aeb-03165c6f53d9 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:23.462305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfc69330-e8fc-47ae-9aeb-03165c6f53d9 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:23.462803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfc69330-e8fc-47ae-9aeb-03165c6f53d9 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:23.463238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfc69330-e8fc-47ae-9aeb-03165c6f53d9 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:23.463925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfc69330-e8fc-47ae-9aeb-03165c6f53d9 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:23.464378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfc69330-e8fc-47ae-9aeb-03165c6f53d9 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:23.464798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cfc69330-e8fc-47ae-9aeb-03165c6f53d9 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:23.605573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cfc69330-e8fc-47ae-9aeb-03165c6f53d9 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:23.615031 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cfc69330-e8fc-47ae-9aeb-03165c6f53d9 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1504 microversion: 2.1 time: 0.163582 Oct 05 18:40:23.615558 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3473/7191] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:23 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:23.639986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1fd4d3ee-0a3e-4ecd-9e57-ca201d3bc846 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:23.640583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1fd4d3ee-0a3e-4ecd-9e57-ca201d3bc846 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:23.647897 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fd4d3ee-0a3e-4ecd-9e57-ca201d3bc846 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:23.648392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fd4d3ee-0a3e-4ecd-9e57-ca201d3bc846 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:23.648846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fd4d3ee-0a3e-4ecd-9e57-ca201d3bc846 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:23.649583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fd4d3ee-0a3e-4ecd-9e57-ca201d3bc846 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:23.650047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fd4d3ee-0a3e-4ecd-9e57-ca201d3bc846 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:23.650537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1fd4d3ee-0a3e-4ecd-9e57-ca201d3bc846 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:23.850912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1fd4d3ee-0a3e-4ecd-9e57-ca201d3bc846 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:23.862053 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1fd4d3ee-0a3e-4ecd-9e57-ca201d3bc846 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1504 microversion: 2.1 time: 0.226630 Oct 05 18:40:23.862648 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3719/7192] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:23 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1504 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:23.884784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-99d52fb9-f31e-4bfc-b1a8-5fe5da939428 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-99d52fb9-f31e-4bfc-b1a8-5fe5da939428 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Request method failure captured: Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: request: POST /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a/action HTTP/1.1 Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 29 Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc9_9IoJHpu-BDLuclUdOsu4aBpUnc94S5FdJ19HPh68SXWhCrweAAvlRpYgOKfplQHW9iOeb3ucPETXlpj7uYXyWX50AD6_FULvPLkH_OLbINtokMHCaVSbykriupZn90n0CwYTppFEdmhttWDUnyIb_C3FtH1meMzJFkQGXXCq8F4 Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fefd61c694d0453cbd4ea3ea1cc7a14f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}] Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: be7e6292d95841f9a3a79b8471d3f23c Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: {"resize": {"flavorRef": ""}} Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '13b51e6e-3226-4851-88ec-6bf09a091c6a', 'body': {'resize': {'flavorRef': ''}}} Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise error Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi '' Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.888347 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-99d52fb9-f31e-4bfc-b1a8-5fe5da939428 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-99d52fb9-f31e-4bfc-b1a8-5fe5da939428 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "POST /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a/action" status: 400 len: 113 microversion: 2.1 time: 0.009063 Oct 05 18:40:23.893676 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3474/7193] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:40:23 2022] POST /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 05 18:40:23.898661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-402b3831-5eb4-4e06-bcfb-21a3aabcb32a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:23.899297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-402b3831-5eb4-4e06-bcfb-21a3aabcb32a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:23.905446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402b3831-5eb4-4e06-bcfb-21a3aabcb32a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:23.905942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402b3831-5eb4-4e06-bcfb-21a3aabcb32a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:23.906433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402b3831-5eb4-4e06-bcfb-21a3aabcb32a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:23.907175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402b3831-5eb4-4e06-bcfb-21a3aabcb32a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:23.907633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402b3831-5eb4-4e06-bcfb-21a3aabcb32a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:23.908065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-402b3831-5eb4-4e06-bcfb-21a3aabcb32a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:24.054122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-402b3831-5eb4-4e06-bcfb-21a3aabcb32a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:24.062122 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-402b3831-5eb4-4e06-bcfb-21a3aabcb32a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1504 microversion: 2.1 time: 0.167233 Oct 05 18:40:24.062740 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3720/7194] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:23 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:24.091805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:24.092435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:24.100643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:24.101129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:24.101598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:24.102300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:24.102762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:24.103185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:24.116751 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] HTTP exception thrown: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Request method failure captured: Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: request: DELETE /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 HTTP/1.1 Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPc9_9IoJHpu-BDLuclUdOsu4aBpUnc94S5FdJ19HPh68SXWhCrweAAvlRpYgOKfplQHW9iOeb3ucPETXlpj7uYXyWX50AD6_FULvPLkH_OLbINtokMHCaVSbykriupZn90n0CwYTppFEdmhttWDUnyIb_C3FtH1meMzJFkQGXXCq8F4 Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fefd61c694d0453cbd4ea3ea1cc7a14f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}] Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: be7e6292d95841f9a3a79b8471d3f23c Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': 'a753cc11-af6e-4f88-9322-403bf657db71'} Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:40:24.118318 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Returning 404 to user: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7bac2ad9-5715-4aec-8111-73c9bcc6db56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "DELETE /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 404 len: 111 microversion: 2.1 time: 0.035420 Oct 05 18:40:24.122152 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3475/7195] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:40:24 2022] DELETE /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:40:24.129419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:24.130052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: a753cc11-af6e-4f88-9322-403bf657db71] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:24.137479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:24.137917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:24.138409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:24.139123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:24.139602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:24.140041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:24.154673 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] HTTP exception thrown: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Request method failure captured: Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 HTTP/1.1 Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc9_9IoJHpu-BDLuclUdOsu4aBpUnc94S5FdJ19HPh68SXWhCrweAAvlRpYgOKfplQHW9iOeb3ucPETXlpj7uYXyWX50AD6_FULvPLkH_OLbINtokMHCaVSbykriupZn90n0CwYTppFEdmhttWDUnyIb_C3FtH1meMzJFkQGXXCq8F4 Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fefd61c694d0453cbd4ea3ea1cc7a14f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}] Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: be7e6292d95841f9a3a79b8471d3f23c Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'a753cc11-af6e-4f88-9322-403bf657db71'} Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:24.156272 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:24.160837 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:24.160837 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:24.160837 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:24.160837 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:40:24.160837 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:40:24.160837 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. Oct 05 18:40:24.160837 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:24.160837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Returning 404 to user: Instance a753cc11-af6e-4f88-9322-403bf657db71 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:40:24.160837 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1be02055-5150-4d27-bda9-c19d904aa632 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71" status: 404 len: 111 microversion: 2.1 time: 0.033126 Oct 05 18:40:24.160837 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3721/7196] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:24 2022] GET /compute/v2.1/servers/a753cc11-af6e-4f88-9322-403bf657db71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:40:24.170244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-26346047-6283-4976-b3aa-5ba33d393c56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:24.170763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-26346047-6283-4976-b3aa-5ba33d393c56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:24.177410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26346047-6283-4976-b3aa-5ba33d393c56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:24.177894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26346047-6283-4976-b3aa-5ba33d393c56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:24.178333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26346047-6283-4976-b3aa-5ba33d393c56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:24.179050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26346047-6283-4976-b3aa-5ba33d393c56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:24.179501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26346047-6283-4976-b3aa-5ba33d393c56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:24.179928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-26346047-6283-4976-b3aa-5ba33d393c56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:24.206166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-26346047-6283-4976-b3aa-5ba33d393c56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:40:24.295253 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-26346047-6283-4976-b3aa-5ba33d393c56 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "DELETE /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 204 len: 0 microversion: 2.1 time: 0.129050 Oct 05 18:40:24.296345 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3476/7197] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:40:24 2022] DELETE /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:40:24.304783 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fc2fef37-d476-4138-a0e9-374da4d602aa tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:24.305419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fc2fef37-d476-4138-a0e9-374da4d602aa tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:24.311493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc2fef37-d476-4138-a0e9-374da4d602aa tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:24.312020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc2fef37-d476-4138-a0e9-374da4d602aa tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:24.312439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc2fef37-d476-4138-a0e9-374da4d602aa tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:24.313211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc2fef37-d476-4138-a0e9-374da4d602aa tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:24.313716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc2fef37-d476-4138-a0e9-374da4d602aa tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:24.314160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fc2fef37-d476-4138-a0e9-374da4d602aa tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:24.453275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-fc2fef37-d476-4138-a0e9-374da4d602aa tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:24.461832 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fc2fef37-d476-4138-a0e9-374da4d602aa tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1510 microversion: 2.1 time: 0.161115 Oct 05 18:40:24.462557 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3722/7198] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:24 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:25.488094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c66d8e42-3546-4c82-aab9-92c200a29e03 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:25.488988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c66d8e42-3546-4c82-aab9-92c200a29e03 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:25.497033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c66d8e42-3546-4c82-aab9-92c200a29e03 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:25.497622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c66d8e42-3546-4c82-aab9-92c200a29e03 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:25.498087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c66d8e42-3546-4c82-aab9-92c200a29e03 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:25.498886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c66d8e42-3546-4c82-aab9-92c200a29e03 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:25.499367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c66d8e42-3546-4c82-aab9-92c200a29e03 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:25.499807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c66d8e42-3546-4c82-aab9-92c200a29e03 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:25.643910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c66d8e42-3546-4c82-aab9-92c200a29e03 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:25.656757 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c66d8e42-3546-4c82-aab9-92c200a29e03 tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1510 microversion: 2.1 time: 0.174011 Oct 05 18:40:25.657466 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3477/7199] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:25 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:26.171055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e5a38352-5f7e-4bbe-8758-4f2a46895ebf req-aea44243-08e5-439f-840b-8af48dbb805b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13b51e6e-3226-4851-88ec-6bf09a091c6a", "name": "network-vif-deleted", "tag": "c081cd70-1414-4f98-baa5-68dc29ee652a"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:26.182985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e5a38352-5f7e-4bbe-8758-4f2a46895ebf req-aea44243-08e5-439f-840b-8af48dbb805b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:26.183642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e5a38352-5f7e-4bbe-8758-4f2a46895ebf req-aea44243-08e5-439f-840b-8af48dbb805b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:26.184182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e5a38352-5f7e-4bbe-8758-4f2a46895ebf req-aea44243-08e5-439f-840b-8af48dbb805b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:26.188601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=100 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:26.198433 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e5a38352-5f7e-4bbe-8758-4f2a46895ebf req-aea44243-08e5-439f-840b-8af48dbb805b service nova] Creating event network-vif-deleted:c081cd70-1414-4f98-baa5-68dc29ee652a for instance 13b51e6e-3226-4851-88ec-6bf09a091c6a on n-h2-835595-3 Oct 05 18:40:26.204326 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e5a38352-5f7e-4bbe-8758-4f2a46895ebf req-aea44243-08e5-439f-840b-8af48dbb805b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037044 Oct 05 18:40:26.204986 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3723/7200] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:40:26.680507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:26.681116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:26.688344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:26.688832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:26.689255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:26.689946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:26.690432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:26.690855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:26.725334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:26.725996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:26.726538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:26.727052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lazy-loading 'fault' on Instance uuid 13b51e6e-3226-4851-88ec-6bf09a091c6a {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:40:26.770781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be7e6292d95841f9a3a79b8471d3f23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fefd61c694d0453cbd4ea3ea1cc7a14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:26.778040 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-12ca9234-671f-437e-bef8-f7977954590f tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 200 len: 1306 microversion: 2.1 time: 0.101531 Oct 05 18:40:26.778658 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3478/7201] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:26 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:40:27.808111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:27.809295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] [instance: 13b51e6e-3226-4851-88ec-6bf09a091c6a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:27.817926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:27.818459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:27.818912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:27.819621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:27.820074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:27.820559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:27.839940 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] HTTP exception thrown: Instance 13b51e6e-3226-4851-88ec-6bf09a091c6a could not be found. Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Request method failure captured: Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a HTTP/1.1 Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc9_9IoJHpu-BDLuclUdOsu4aBpUnc94S5FdJ19HPh68SXWhCrweAAvlRpYgOKfplQHW9iOeb3ucPETXlpj7uYXyWX50AD6_FULvPLkH_OLbINtokMHCaVSbykriupZn90n0CwYTppFEdmhttWDUnyIb_C3FtH1meMzJFkQGXXCq8F4 Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_fefd61c694d0453cbd4ea3ea1cc7a14f", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/fefd61c694d0453cbd4ea3ea1cc7a14f"}]}] Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: fefd61c694d0453cbd4ea3ea1cc7a14f Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2073131393 Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: be7e6292d95841f9a3a79b8471d3f23c Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-ServersNegativeTestJSON-2073131393-project Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 13b51e6e-3226-4851-88ec-6bf09a091c6a could not be found. Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '13b51e6e-3226-4851-88ec-6bf09a091c6a'} Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13b51e6e-3226-4851-88ec-6bf09a091c6a could not be found. Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13b51e6e-3226-4851-88ec-6bf09a091c6a could not be found. Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:40:27.841745 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:27.846608 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:40:27.846608 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:40:27.846608 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:40:27.846608 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:40:27.846608 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:40:27.846608 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13b51e6e-3226-4851-88ec-6bf09a091c6a could not be found. Oct 05 18:40:27.846608 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:40:27.846608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] Returning 404 to user: Instance 13b51e6e-3226-4851-88ec-6bf09a091c6a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:40:27.846608 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c46e8b2-bf1b-418f-ab23-a03b64bc8b1a tempest-ServersNegativeTestJSON-2073131393 tempest-ServersNegativeTestJSON-2073131393-project] 10.222.0.70 "GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a" status: 404 len: 111 microversion: 2.1 time: 0.044074 Oct 05 18:40:27.846608 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3724/7202] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:27 2022] GET /compute/v2.1/servers/13b51e6e-3226-4851-88ec-6bf09a091c6a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:40:58.517557 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:58.518379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:58.519771 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:40:58.520230 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:40:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.70) !!! Oct 05 18:40:58.698457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-68e11334-4b1b-4198-91ce-c320adfd36e5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Action: 'create', calling method: .version_select at 0x7f77745cc670>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1432159235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMS4W89CCcdb6RF2YTqAu8GI9GRd7+N1Swt3bi7PzKmAAsCYZQqmCDz/pdliPEMmFlin3IukVYaPohfBoVsjmjCTd+FONsVXdPiaoG3cKSOPemg4F05vamwM1C6FRVuHzw=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:58.714491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-68e11334-4b1b-4198-91ce-c320adfd36e5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:40:58.719939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-68e11334-4b1b-4198-91ce-c320adfd36e5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for user 6b4b7fc3f9504801a75eaccb919b100f and project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:40:58.753066 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-68e11334-4b1b-4198-91ce-c320adfd36e5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.241463 Oct 05 18:40:58.753771 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3479/7203] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:40:58 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:40:58.808828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-248887018", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1432159235", "networks": [{"uuid": "f4ae09fa-bef4-4240-be7f-663445c4e0b1"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:40:58.818495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=29 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:58.819232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:40:58.870220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] validate_networks() for [('f4ae09fa-bef4-4240-be7f-663445c4e0b1', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:40:59.619685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:40:59.620279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:40:59.620780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:40:59.621242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:40:59.622054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:40:59.631890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:59.632399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:59.632999 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:59.633751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:40:59.634222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:40:59.634699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:40:59.654691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:40:59.661207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for user 6b4b7fc3f9504801a75eaccb919b100f and project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:40:59.676050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:40:59.678718 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:40:59.732744 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-82dba770-5772-4ef1-a688-cd52a56e7d17 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928062 Oct 05 18:40:59.739463 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3725/7204] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:40:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:40:59.746266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bf13a172-85d8-4949-8adc-3441b232de28 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:40:59.747098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bf13a172-85d8-4949-8adc-3441b232de28 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:40:59.820144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bf13a172-85d8-4949-8adc-3441b232de28 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:40:59.829917 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bf13a172-85d8-4949-8adc-3441b232de28 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1262 microversion: 2.1 time: 0.088874 Oct 05 18:40:59.831012 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3480/7205] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:40:59 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1262 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:00.856004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-43e51489-ae83-4ce3-801e-8344cb9f6819 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:00.856872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-43e51489-ae83-4ce3-801e-8344cb9f6819 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:00.866361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43e51489-ae83-4ce3-801e-8344cb9f6819 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:00.867324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43e51489-ae83-4ce3-801e-8344cb9f6819 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:00.868049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43e51489-ae83-4ce3-801e-8344cb9f6819 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:00.868940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43e51489-ae83-4ce3-801e-8344cb9f6819 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:00.869746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43e51489-ae83-4ce3-801e-8344cb9f6819 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:00.871052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-43e51489-ae83-4ce3-801e-8344cb9f6819 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:00.956226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-43e51489-ae83-4ce3-801e-8344cb9f6819 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:00.964571 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-43e51489-ae83-4ce3-801e-8344cb9f6819 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1322 microversion: 2.1 time: 0.115727 Oct 05 18:41:00.965397 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3726/7206] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:00 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1322 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:01.989241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c79e9f87-6625-42d1-84c3-eaf7e51f3276 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:01.989964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c79e9f87-6625-42d1-84c3-eaf7e51f3276 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:01.997379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c79e9f87-6625-42d1-84c3-eaf7e51f3276 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:01.998127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c79e9f87-6625-42d1-84c3-eaf7e51f3276 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:01.998623 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c79e9f87-6625-42d1-84c3-eaf7e51f3276 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:01.999328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c79e9f87-6625-42d1-84c3-eaf7e51f3276 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:02.000010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c79e9f87-6625-42d1-84c3-eaf7e51f3276 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:02.000471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c79e9f87-6625-42d1-84c3-eaf7e51f3276 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:02.224898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c79e9f87-6625-42d1-84c3-eaf7e51f3276 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:02.234796 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c79e9f87-6625-42d1-84c3-eaf7e51f3276 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1362 microversion: 2.1 time: 0.249545 Oct 05 18:41:02.235640 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3481/7207] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:01 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:02.548304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6d35e2a7-1c48-4708-a2d7-4ea11396c1fa req-e7017a3d-da28-45d8-acae-dad7ded179c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e551296-1103-4753-80c7-28f71b031f9e", "tag": "b4e138b6-2538-4ef4-ac3c-4ee0b3c3c0f2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:41:02.570918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6d35e2a7-1c48-4708-a2d7-4ea11396c1fa req-e7017a3d-da28-45d8-acae-dad7ded179c1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:02.572596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6d35e2a7-1c48-4708-a2d7-4ea11396c1fa req-e7017a3d-da28-45d8-acae-dad7ded179c1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:02.573284 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6d35e2a7-1c48-4708-a2d7-4ea11396c1fa req-e7017a3d-da28-45d8-acae-dad7ded179c1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:02.590185 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6d35e2a7-1c48-4708-a2d7-4ea11396c1fa req-e7017a3d-da28-45d8-acae-dad7ded179c1 service nova] Creating event network-changed:b4e138b6-2538-4ef4-ac3c-4ee0b3c3c0f2 for instance 0e551296-1103-4753-80c7-28f71b031f9e on n-h2-835595-3 Oct 05 18:41:02.596347 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6d35e2a7-1c48-4708-a2d7-4ea11396c1fa req-e7017a3d-da28-45d8-acae-dad7ded179c1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051718 Oct 05 18:41:02.597678 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3727/7208] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:03.267546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f6c93d8e-aa95-4f87-a060-a1039a4edd6d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:03.268611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f6c93d8e-aa95-4f87-a060-a1039a4edd6d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:03.280222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c93d8e-aa95-4f87-a060-a1039a4edd6d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:03.281035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c93d8e-aa95-4f87-a060-a1039a4edd6d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:03.281677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c93d8e-aa95-4f87-a060-a1039a4edd6d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:03.282386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c93d8e-aa95-4f87-a060-a1039a4edd6d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:03.282871 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c93d8e-aa95-4f87-a060-a1039a4edd6d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:03.283291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f6c93d8e-aa95-4f87-a060-a1039a4edd6d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:03.418953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f6c93d8e-aa95-4f87-a060-a1039a4edd6d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:03.427600 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f6c93d8e-aa95-4f87-a060-a1039a4edd6d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1362 microversion: 2.1 time: 0.166985 Oct 05 18:41:03.428074 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3482/7209] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:03 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:04.453683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e48b9baf-6a2d-4d12-975f-ff5651536c66 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:04.454436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e48b9baf-6a2d-4d12-975f-ff5651536c66 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:04.462008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b9baf-6a2d-4d12-975f-ff5651536c66 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:04.462559 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b9baf-6a2d-4d12-975f-ff5651536c66 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:04.463015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b9baf-6a2d-4d12-975f-ff5651536c66 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:04.463735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b9baf-6a2d-4d12-975f-ff5651536c66 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:04.464210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b9baf-6a2d-4d12-975f-ff5651536c66 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:04.464635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e48b9baf-6a2d-4d12-975f-ff5651536c66 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:04.602493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e48b9baf-6a2d-4d12-975f-ff5651536c66 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:04.611018 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e48b9baf-6a2d-4d12-975f-ff5651536c66 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1362 microversion: 2.1 time: 0.163381 Oct 05 18:41:04.611577 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3728/7210] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:04 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:05.638879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-714878cc-b9c4-4e53-aa2f-4ba611ec9584 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:05.639485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-714878cc-b9c4-4e53-aa2f-4ba611ec9584 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:05.646983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-714878cc-b9c4-4e53-aa2f-4ba611ec9584 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:05.647467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-714878cc-b9c4-4e53-aa2f-4ba611ec9584 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:05.647919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-714878cc-b9c4-4e53-aa2f-4ba611ec9584 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:05.648574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-714878cc-b9c4-4e53-aa2f-4ba611ec9584 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:05.649025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-714878cc-b9c4-4e53-aa2f-4ba611ec9584 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:05.649441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-714878cc-b9c4-4e53-aa2f-4ba611ec9584 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:05.794700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-714878cc-b9c4-4e53-aa2f-4ba611ec9584 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:05.802670 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-714878cc-b9c4-4e53-aa2f-4ba611ec9584 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1362 microversion: 2.1 time: 0.167717 Oct 05 18:41:05.803364 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3483/7211] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:05 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:06.826086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f844ad3b-6845-44fa-95a9-5d436cbde386 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:06.826824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f844ad3b-6845-44fa-95a9-5d436cbde386 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:06.834163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f844ad3b-6845-44fa-95a9-5d436cbde386 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:06.834777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f844ad3b-6845-44fa-95a9-5d436cbde386 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:06.835270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f844ad3b-6845-44fa-95a9-5d436cbde386 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:06.836232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f844ad3b-6845-44fa-95a9-5d436cbde386 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:06.836682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f844ad3b-6845-44fa-95a9-5d436cbde386 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:06.837126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f844ad3b-6845-44fa-95a9-5d436cbde386 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:06.863305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-eba51aa7-b572-46ef-b0de-dfe0db19a055 req-501ee9eb-fc8a-449e-a2f1-20dafbff45ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e551296-1103-4753-80c7-28f71b031f9e", "name": "network-vif-plugged", "status": "completed", "tag": "b4e138b6-2538-4ef4-ac3c-4ee0b3c3c0f2"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:41:06.877046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-eba51aa7-b572-46ef-b0de-dfe0db19a055 req-501ee9eb-fc8a-449e-a2f1-20dafbff45ff service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:06.877629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-eba51aa7-b572-46ef-b0de-dfe0db19a055 req-501ee9eb-fc8a-449e-a2f1-20dafbff45ff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:06.878378 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-eba51aa7-b572-46ef-b0de-dfe0db19a055 req-501ee9eb-fc8a-449e-a2f1-20dafbff45ff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:06.890843 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-eba51aa7-b572-46ef-b0de-dfe0db19a055 req-501ee9eb-fc8a-449e-a2f1-20dafbff45ff service nova] Creating event network-vif-plugged:b4e138b6-2538-4ef4-ac3c-4ee0b3c3c0f2 for instance 0e551296-1103-4753-80c7-28f71b031f9e on n-h2-835595-3 Oct 05 18:41:06.896723 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-eba51aa7-b572-46ef-b0de-dfe0db19a055 req-501ee9eb-fc8a-449e-a2f1-20dafbff45ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038084 Oct 05 18:41:06.898428 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3484/7212] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:41:06.991647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f844ad3b-6845-44fa-95a9-5d436cbde386 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:07.001104 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f844ad3b-6845-44fa-95a9-5d436cbde386 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1362 microversion: 2.1 time: 0.178742 Oct 05 18:41:07.002774 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3729/7213] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:06 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:08.027785 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3348782e-b1b7-4e5c-b722-18c773446530 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:08.028649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3348782e-b1b7-4e5c-b722-18c773446530 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:08.036260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3348782e-b1b7-4e5c-b722-18c773446530 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:08.036738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3348782e-b1b7-4e5c-b722-18c773446530 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:08.037174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3348782e-b1b7-4e5c-b722-18c773446530 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:08.037859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3348782e-b1b7-4e5c-b722-18c773446530 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:08.038317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3348782e-b1b7-4e5c-b722-18c773446530 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:08.038755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3348782e-b1b7-4e5c-b722-18c773446530 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:08.187768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3348782e-b1b7-4e5c-b722-18c773446530 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:08.196202 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3348782e-b1b7-4e5c-b722-18c773446530 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1362 microversion: 2.1 time: 0.172738 Oct 05 18:41:08.196790 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3485/7214] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:08 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:09.222311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0147d41f-bc2e-4a68-9356-48d31d8fe06f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:09.222957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0147d41f-bc2e-4a68-9356-48d31d8fe06f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:09.230475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0147d41f-bc2e-4a68-9356-48d31d8fe06f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:09.230983 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0147d41f-bc2e-4a68-9356-48d31d8fe06f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:09.231434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0147d41f-bc2e-4a68-9356-48d31d8fe06f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:09.232152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0147d41f-bc2e-4a68-9356-48d31d8fe06f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:09.232639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0147d41f-bc2e-4a68-9356-48d31d8fe06f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:09.233083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0147d41f-bc2e-4a68-9356-48d31d8fe06f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:09.372217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0147d41f-bc2e-4a68-9356-48d31d8fe06f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:09.381440 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0147d41f-bc2e-4a68-9356-48d31d8fe06f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1554 microversion: 2.1 time: 0.164215 Oct 05 18:41:09.382024 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3730/7215] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:09 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:09.404693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a9433796-84f1-4575-bfa3-eb8ccbeeaef2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:09.405280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a9433796-84f1-4575-bfa3-eb8ccbeeaef2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:09.412747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9433796-84f1-4575-bfa3-eb8ccbeeaef2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:09.413228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9433796-84f1-4575-bfa3-eb8ccbeeaef2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:09.413660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9433796-84f1-4575-bfa3-eb8ccbeeaef2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:09.414388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9433796-84f1-4575-bfa3-eb8ccbeeaef2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:09.414842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9433796-84f1-4575-bfa3-eb8ccbeeaef2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:09.415261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a9433796-84f1-4575-bfa3-eb8ccbeeaef2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:09.550642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a9433796-84f1-4575-bfa3-eb8ccbeeaef2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:09.562774 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a9433796-84f1-4575-bfa3-eb8ccbeeaef2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1554 microversion: 2.1 time: 0.161614 Oct 05 18:41:09.563631 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3486/7216] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:09 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:11.246564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1da48951-dde7-4bf3-9cdb-c90449523c07 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6ad24e2-f7c9-4b52-8486-521529ed4e33"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:41:11.249058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1da48951-dde7-4bf3-9cdb-c90449523c07 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:11.251176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:11.251877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:11.258803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da48951-dde7-4bf3-9cdb-c90449523c07 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:11.259309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da48951-dde7-4bf3-9cdb-c90449523c07 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:11.259761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da48951-dde7-4bf3-9cdb-c90449523c07 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:11.260475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da48951-dde7-4bf3-9cdb-c90449523c07 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:11.260948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da48951-dde7-4bf3-9cdb-c90449523c07 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:11.261390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da48951-dde7-4bf3-9cdb-c90449523c07 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:11.514904 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1da48951-dde7-4bf3-9cdb-c90449523c07 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "POST /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272000 Oct 05 18:41:11.515567 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3731/7217] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:41:11 2022] POST /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:22.315458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c2381c9d-2f1f-4b9d-bb73-b0b8f4cbd838 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:22.315999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c2381c9d-2f1f-4b9d-bb73-b0b8f4cbd838 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:22.317941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:22.319592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:22.320342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=32 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:22.326584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2381c9d-2f1f-4b9d-bb73-b0b8f4cbd838 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:22.327026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2381c9d-2f1f-4b9d-bb73-b0b8f4cbd838 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:22.327463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2381c9d-2f1f-4b9d-bb73-b0b8f4cbd838 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:22.328248 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2381c9d-2f1f-4b9d-bb73-b0b8f4cbd838 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:22.328708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2381c9d-2f1f-4b9d-bb73-b0b8f4cbd838 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:22.329135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c2381c9d-2f1f-4b9d-bb73-b0b8f4cbd838 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:22.410228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-c2381c9d-2f1f-4b9d-bb73-b0b8f4cbd838 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lazy-loading 'services' on Instance uuid 0e551296-1103-4753-80c7-28f71b031f9e {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:41:22.486660 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c2381c9d-2f1f-4b9d-bb73-b0b8f4cbd838 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments/f6ad24e2-f7c9-4b52-8486-521529ed4e33" status: 202 len: 0 microversion: 2.1 time: 0.174999 Oct 05 18:41:22.487272 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3487/7218] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:41:22 2022] DELETE /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments/f6ad24e2-f7c9-4b52-8486-521529ed4e33 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:41:22.497398 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fcd53801-4e8b-4221-ae30-d45867d4ea37 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:22.500469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fcd53801-4e8b-4221-ae30-d45867d4ea37 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:22.503932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:22.504810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:22.514984 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd53801-4e8b-4221-ae30-d45867d4ea37 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:22.515471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd53801-4e8b-4221-ae30-d45867d4ea37 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:22.515958 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd53801-4e8b-4221-ae30-d45867d4ea37 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:22.516976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd53801-4e8b-4221-ae30-d45867d4ea37 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:22.517445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd53801-4e8b-4221-ae30-d45867d4ea37 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:22.517877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fcd53801-4e8b-4221-ae30-d45867d4ea37 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:22.551085 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fcd53801-4e8b-4221-ae30-d45867d4ea37 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057965 Oct 05 18:41:22.551863 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3732/7219] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:41:22 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:23.565765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-95f1cd97-1ef3-4917-9236-172bc9b35dd2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:23.568223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-95f1cd97-1ef3-4917-9236-172bc9b35dd2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:23.575433 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95f1cd97-1ef3-4917-9236-172bc9b35dd2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:23.575934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95f1cd97-1ef3-4917-9236-172bc9b35dd2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:23.576367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95f1cd97-1ef3-4917-9236-172bc9b35dd2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:23.577082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95f1cd97-1ef3-4917-9236-172bc9b35dd2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:23.577537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95f1cd97-1ef3-4917-9236-172bc9b35dd2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:23.577935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-95f1cd97-1ef3-4917-9236-172bc9b35dd2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:23.614727 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-95f1cd97-1ef3-4917-9236-172bc9b35dd2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054119 Oct 05 18:41:23.615313 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3488/7220] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:41:23 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:24.627971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0614224b-3b7a-4d41-af92-df1bd5062d22 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:24.630186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0614224b-3b7a-4d41-af92-df1bd5062d22 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:24.637586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0614224b-3b7a-4d41-af92-df1bd5062d22 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:24.638085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0614224b-3b7a-4d41-af92-df1bd5062d22 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:24.638564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0614224b-3b7a-4d41-af92-df1bd5062d22 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:24.639272 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0614224b-3b7a-4d41-af92-df1bd5062d22 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:24.639741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0614224b-3b7a-4d41-af92-df1bd5062d22 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:24.640180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0614224b-3b7a-4d41-af92-df1bd5062d22 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:24.671750 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0614224b-3b7a-4d41-af92-df1bd5062d22 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048166 Oct 05 18:41:24.672633 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3733/7221] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:41:24 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:25.685251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ae6a40fc-dfc1-445b-872d-72cb73fbef85 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:25.687419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ae6a40fc-dfc1-445b-872d-72cb73fbef85 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:25.694610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae6a40fc-dfc1-445b-872d-72cb73fbef85 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:25.695102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae6a40fc-dfc1-445b-872d-72cb73fbef85 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:25.695542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae6a40fc-dfc1-445b-872d-72cb73fbef85 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:25.696240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae6a40fc-dfc1-445b-872d-72cb73fbef85 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:25.696692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae6a40fc-dfc1-445b-872d-72cb73fbef85 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:25.697119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ae6a40fc-dfc1-445b-872d-72cb73fbef85 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:25.727930 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ae6a40fc-dfc1-445b-872d-72cb73fbef85 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046975 Oct 05 18:41:25.728773 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3489/7222] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:41:25 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:26.741353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2103fca2-8df4-499e-849f-79603df84b49 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:26.752236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2103fca2-8df4-499e-849f-79603df84b49 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:26.759131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2103fca2-8df4-499e-849f-79603df84b49 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:26.759760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2103fca2-8df4-499e-849f-79603df84b49 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:26.760208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2103fca2-8df4-499e-849f-79603df84b49 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:26.761352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2103fca2-8df4-499e-849f-79603df84b49 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:26.761833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2103fca2-8df4-499e-849f-79603df84b49 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:26.762315 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2103fca2-8df4-499e-849f-79603df84b49 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:26.794221 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2103fca2-8df4-499e-849f-79603df84b49 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057160 Oct 05 18:41:26.794807 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3734/7223] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:41:26 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:27.811558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7ac29ec1-c01c-4840-a216-a11df024177f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:27.814392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7ac29ec1-c01c-4840-a216-a11df024177f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:27.822258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ac29ec1-c01c-4840-a216-a11df024177f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:27.822906 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ac29ec1-c01c-4840-a216-a11df024177f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:27.823392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ac29ec1-c01c-4840-a216-a11df024177f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:27.824159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ac29ec1-c01c-4840-a216-a11df024177f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:27.824668 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ac29ec1-c01c-4840-a216-a11df024177f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:27.825136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7ac29ec1-c01c-4840-a216-a11df024177f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:27.857436 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7ac29ec1-c01c-4840-a216-a11df024177f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052615 Oct 05 18:41:27.857992 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3490/7224] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:41:27 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 18:41:27.872358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:27.873179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:27.884139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:27.884664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:27.885121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:27.885856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:27.886368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:27.886799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:27.969877 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] HTTP exception thrown: Instance 0e551296-1103-4753-80c7-28f71b031f9e is not attached to volume f6ad24e2-f7c9-4b52-8486-521529ed4e33 Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Request method failure captured: Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments/f6ad24e2-f7c9-4b52-8486-521529ed4e33 HTTP/1.1 Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc-1lSuTle24nHTAw2AMKHH3U9RVbPgzHbLWJX3UaC9Qo3CjugLVDr9dcdnABCTX0UoJH0aE3AOvlv9TaHGHMPDxhffgxRs-9_dpL8pIkDoPsNCcCfbo_rpSzBY0AIr05hmApGCzxis9DFXxi_RVM56-RuEx0z0rvz0y4EmfG-ATl8I Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2033ecfc3ee54955b8daf40b6069a73d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}] Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6b4b7fc3f9504801a75eaccb919b100f Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0e551296-1103-4753-80c7-28f71b031f9e is not attached to volume f6ad24e2-f7c9-4b52-8486-521529ed4e33 Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': '0e551296-1103-4753-80c7-28f71b031f9e', 'id': 'f6ad24e2-f7c9-4b52-8486-521529ed4e33'} Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f6ad24e2-f7c9-4b52-8486-521529ed4e33. Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e551296-1103-4753-80c7-28f71b031f9e is not attached to volume f6ad24e2-f7c9-4b52-8486-521529ed4e33 Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:41:27.979752 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:41:27.984020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:41:27.984020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:41:27.984020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e551296-1103-4753-80c7-28f71b031f9e is not attached to volume f6ad24e2-f7c9-4b52-8486-521529ed4e33 Oct 05 18:41:27.984020 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:41:27.984020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Returning 404 to user: Instance 0e551296-1103-4753-80c7-28f71b031f9e is not attached to volume f6ad24e2-f7c9-4b52-8486-521529ed4e33 {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:41:27.984020 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49d87511-4983-4fe3-87b0-9dd214c134fb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments/f6ad24e2-f7c9-4b52-8486-521529ed4e33" status: 404 len: 154 microversion: 2.1 time: 0.115928 Oct 05 18:41:27.984020 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3735/7225] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:41:27 2022] DELETE /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e/os-volume_attachments/f6ad24e2-f7c9-4b52-8486-521529ed4e33 => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:41:31.339568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f3c8b51b-5dc6-41b2-b3be-101b6c557cc2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:31.340163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f3c8b51b-5dc6-41b2-b3be-101b6c557cc2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:31.347894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3c8b51b-5dc6-41b2-b3be-101b6c557cc2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:31.348487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3c8b51b-5dc6-41b2-b3be-101b6c557cc2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:31.348995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3c8b51b-5dc6-41b2-b3be-101b6c557cc2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:31.349782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3c8b51b-5dc6-41b2-b3be-101b6c557cc2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:31.350339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3c8b51b-5dc6-41b2-b3be-101b6c557cc2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:31.350839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3c8b51b-5dc6-41b2-b3be-101b6c557cc2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:31.379155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f3c8b51b-5dc6-41b2-b3be-101b6c557cc2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:41:31.459167 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f3c8b51b-5dc6-41b2-b3be-101b6c557cc2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 204 len: 0 microversion: 2.1 time: 0.122996 Oct 05 18:41:31.460149 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3491/7226] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:41:31 2022] DELETE /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:41:31.468670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56dafc8e-6403-4122-a457-c1b487f6a65c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:31.469905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56dafc8e-6403-4122-a457-c1b487f6a65c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:31.477044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56dafc8e-6403-4122-a457-c1b487f6a65c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:31.477547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56dafc8e-6403-4122-a457-c1b487f6a65c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:31.477992 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56dafc8e-6403-4122-a457-c1b487f6a65c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:31.478914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56dafc8e-6403-4122-a457-c1b487f6a65c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:31.479390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56dafc8e-6403-4122-a457-c1b487f6a65c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:31.479829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56dafc8e-6403-4122-a457-c1b487f6a65c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:31.623443 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-56dafc8e-6403-4122-a457-c1b487f6a65c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:31.640886 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56dafc8e-6403-4122-a457-c1b487f6a65c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1560 microversion: 2.1 time: 0.174456 Oct 05 18:41:31.642663 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3736/7227] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:31 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:32.670662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-291121d9-8ecc-435f-9ff0-893748890990 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:32.671879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-291121d9-8ecc-435f-9ff0-893748890990 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:32.679812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-291121d9-8ecc-435f-9ff0-893748890990 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:32.680296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-291121d9-8ecc-435f-9ff0-893748890990 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:32.680728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-291121d9-8ecc-435f-9ff0-893748890990 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:32.681425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-291121d9-8ecc-435f-9ff0-893748890990 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:32.681879 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-291121d9-8ecc-435f-9ff0-893748890990 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:32.682313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-291121d9-8ecc-435f-9ff0-893748890990 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:32.817123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-291121d9-8ecc-435f-9ff0-893748890990 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:32.825070 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-291121d9-8ecc-435f-9ff0-893748890990 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1560 microversion: 2.1 time: 0.161704 Oct 05 18:41:32.825618 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3492/7228] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:32 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:33.533163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-2dd1e87b-8228-4af7-a1a3-daf2de132eb3 req-18049280-4e19-4f99-ae2d-e28ddf3af60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e551296-1103-4753-80c7-28f71b031f9e", "name": "network-vif-deleted", "tag": "b4e138b6-2538-4ef4-ac3c-4ee0b3c3c0f2"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:41:33.545787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2dd1e87b-8228-4af7-a1a3-daf2de132eb3 req-18049280-4e19-4f99-ae2d-e28ddf3af60c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:33.546401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2dd1e87b-8228-4af7-a1a3-daf2de132eb3 req-18049280-4e19-4f99-ae2d-e28ddf3af60c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:33.546942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-2dd1e87b-8228-4af7-a1a3-daf2de132eb3 req-18049280-4e19-4f99-ae2d-e28ddf3af60c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:33.561386 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-2dd1e87b-8228-4af7-a1a3-daf2de132eb3 req-18049280-4e19-4f99-ae2d-e28ddf3af60c service nova] Creating event network-vif-deleted:b4e138b6-2538-4ef4-ac3c-4ee0b3c3c0f2 for instance 0e551296-1103-4753-80c7-28f71b031f9e on n-h2-835595-3 Oct 05 18:41:33.568119 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-2dd1e87b-8228-4af7-a1a3-daf2de132eb3 req-18049280-4e19-4f99-ae2d-e28ddf3af60c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037926 Oct 05 18:41:33.569278 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3737/7229] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:33.854009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:33.855039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:33.866794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:33.867607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:33.868329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:33.869470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:33.870228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:33.871030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:33.908275 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:33.908915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:33.909362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:33.909819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lazy-loading 'fault' on Instance uuid 0e551296-1103-4753-80c7-28f71b031f9e {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:41:33.962323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:33.970554 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2aaf4758-13fb-49d4-80b3-7881dc3cf736 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 200 len: 1352 microversion: 2.1 time: 0.123128 Oct 05 18:41:33.971139 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3493/7230] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:33 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 1352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:34.999132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:35.000190 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0e551296-1103-4753-80c7-28f71b031f9e] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:35.012606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:35.013418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:35.014232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:35.015466 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:35.016191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:35.016979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:35.031089 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] HTTP exception thrown: Instance 0e551296-1103-4753-80c7-28f71b031f9e could not be found. Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Request method failure captured: Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e HTTP/1.1 Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc-1lSuTle24nHTAw2AMKHH3U9RVbPgzHbLWJX3UaC9Qo3CjugLVDr9dcdnABCTX0UoJH0aE3AOvlv9TaHGHMPDxhffgxRs-9_dpL8pIkDoPsNCcCfbo_rpSzBY0AIr05hmApGCzxis9DFXxi_RVM56-RuEx0z0rvz0y4EmfG-ATl8I Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2033ecfc3ee54955b8daf40b6069a73d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}] Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6b4b7fc3f9504801a75eaccb919b100f Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0e551296-1103-4753-80c7-28f71b031f9e could not be found. Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '0e551296-1103-4753-80c7-28f71b031f9e'} Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e551296-1103-4753-80c7-28f71b031f9e could not be found. Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e551296-1103-4753-80c7-28f71b031f9e could not be found. Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:41:35.032788 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e551296-1103-4753-80c7-28f71b031f9e could not be found. Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Returning 404 to user: Instance 0e551296-1103-4753-80c7-28f71b031f9e could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cedf0c21-dc35-4ee2-878d-f5ee46d43f14 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e" status: 404 len: 111 microversion: 2.1 time: 0.042777 Oct 05 18:41:35.037122 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3738/7231] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:34 2022] GET /compute/v2.1/servers/0e551296-1103-4753-80c7-28f71b031f9e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:41:35.043140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-45face6f-f960-4760-b7df-6ac5f500b37c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '.version_select at 0x7f77740559d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:35.064870 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-45face6f-f960-4760-b7df-6ac5f500b37c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1432159235" status: 202 len: 0 microversion: 2.1 time: 0.025554 Oct 05 18:41:35.065445 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3494/7232] 10.222.0.70 () {58 vars in 1278 bytes} [Wed Oct 5 18:41:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1432159235 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:41:35.082703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1b47206e-20af-4fdb-8b0c-cc28d1bfc916 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Action: 'create', calling method: .version_select at 0x7f7774db7d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-335052257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsolot0W1RIZoCOPdIFyoIHRmb2qwfK2wNQW4Uyqi+mR7qU9DRwT+Ek14qNj2efk7Hi8WQ1LzyN+lMFP0NJyg0sJ0qYB3IZinY+rUBElJ6lH7oXoPxsXhJejesCHKBNkg=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:41:35.098885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-1b47206e-20af-4fdb-8b0c-cc28d1bfc916 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:41:35.107599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-1b47206e-20af-4fdb-8b0c-cc28d1bfc916 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for user 6b4b7fc3f9504801a75eaccb919b100f and project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:41:35.132857 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1b47206e-20af-4fdb-8b0c-cc28d1bfc916 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.054200 Oct 05 18:41:35.133458 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3739/7233] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:41:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:41:35.184787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-594828811", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-335052257", "networks": [{"uuid": "f4ae09fa-bef4-4240-be7f-663445c4e0b1"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:41:35.247394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] validate_networks() for [('f4ae09fa-bef4-4240-be7f-663445c4e0b1', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:41:35.981606 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:41:35.982026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:41:35.982524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:41:35.982928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:41:35.983336 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:41:35.993016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:35.993497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:35.993923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:35.994677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:35.995124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:35.995541 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:36.012395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:41:36.018740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for user 6b4b7fc3f9504801a75eaccb919b100f and project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:41:36.031669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:41:36.034009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:41:36.083197 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c85472d-689c-4a2f-b470-4cacb0e58791 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.902534 Oct 05 18:41:36.083939 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3495/7234] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:41:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:41:36.096549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-04598cca-9754-4a4e-b1e4-26eca5124805 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:36.097166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-04598cca-9754-4a4e-b1e4-26eca5124805 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:36.175206 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-04598cca-9754-4a4e-b1e4-26eca5124805 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:36.184587 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-04598cca-9754-4a4e-b1e4-26eca5124805 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1261 microversion: 2.1 time: 0.092926 Oct 05 18:41:36.185379 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3740/7235] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:36 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1261 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:37.210476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6b3be106-da1e-4480-9056-cad8476967df tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:37.211727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6b3be106-da1e-4480-9056-cad8476967df tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:37.218187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3be106-da1e-4480-9056-cad8476967df tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:37.218716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3be106-da1e-4480-9056-cad8476967df tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:37.219422 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3be106-da1e-4480-9056-cad8476967df tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:37.219938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3be106-da1e-4480-9056-cad8476967df tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:37.220385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3be106-da1e-4480-9056-cad8476967df tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:37.220809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6b3be106-da1e-4480-9056-cad8476967df tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:37.307113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6b3be106-da1e-4480-9056-cad8476967df tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:37.315213 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6b3be106-da1e-4480-9056-cad8476967df tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1321 microversion: 2.1 time: 0.109972 Oct 05 18:41:37.318083 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3496/7236] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:37 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1321 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:38.341444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9cfc1756-7b86-4ca9-9b19-d25f9a368968 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:38.342519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9cfc1756-7b86-4ca9-9b19-d25f9a368968 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:38.352467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cfc1756-7b86-4ca9-9b19-d25f9a368968 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:38.353086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cfc1756-7b86-4ca9-9b19-d25f9a368968 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:38.353609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cfc1756-7b86-4ca9-9b19-d25f9a368968 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:38.354249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cfc1756-7b86-4ca9-9b19-d25f9a368968 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:38.354751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cfc1756-7b86-4ca9-9b19-d25f9a368968 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:38.355189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9cfc1756-7b86-4ca9-9b19-d25f9a368968 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:38.494366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9cfc1756-7b86-4ca9-9b19-d25f9a368968 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:38.502983 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9cfc1756-7b86-4ca9-9b19-d25f9a368968 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1361 microversion: 2.1 time: 0.167232 Oct 05 18:41:38.503615 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3741/7237] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:38 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:38.655799 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-703d4a75-c810-4099-add7-69adefbe6fbb req-a69f1911-b5bf-4941-8f1c-0030a5fb4a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a354b3a-77ee-43e8-881c-f1f941248f9c", "tag": "ae8be786-8997-4493-a9fe-fa48b3b46fb5"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:41:38.675170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-703d4a75-c810-4099-add7-69adefbe6fbb req-a69f1911-b5bf-4941-8f1c-0030a5fb4a2e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:38.676850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-703d4a75-c810-4099-add7-69adefbe6fbb req-a69f1911-b5bf-4941-8f1c-0030a5fb4a2e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:38.677446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-703d4a75-c810-4099-add7-69adefbe6fbb req-a69f1911-b5bf-4941-8f1c-0030a5fb4a2e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:38.692726 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-703d4a75-c810-4099-add7-69adefbe6fbb req-a69f1911-b5bf-4941-8f1c-0030a5fb4a2e service nova] Creating event network-changed:ae8be786-8997-4493-a9fe-fa48b3b46fb5 for instance 0a354b3a-77ee-43e8-881c-f1f941248f9c on n-h2-835595-3 Oct 05 18:41:38.698364 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-703d4a75-c810-4099-add7-69adefbe6fbb req-a69f1911-b5bf-4941-8f1c-0030a5fb4a2e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046695 Oct 05 18:41:38.699262 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3497/7238] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:41:39.531024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0fe762b-9429-4df6-b086-79d345514723 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:39.532132 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0fe762b-9429-4df6-b086-79d345514723 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:39.543730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0fe762b-9429-4df6-b086-79d345514723 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:39.544541 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0fe762b-9429-4df6-b086-79d345514723 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:39.545334 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0fe762b-9429-4df6-b086-79d345514723 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:39.546563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0fe762b-9429-4df6-b086-79d345514723 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:39.547379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0fe762b-9429-4df6-b086-79d345514723 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:39.547827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0fe762b-9429-4df6-b086-79d345514723 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:39.697452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0fe762b-9429-4df6-b086-79d345514723 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:39.706601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0fe762b-9429-4df6-b086-79d345514723 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1361 microversion: 2.1 time: 0.182223 Oct 05 18:41:39.707115 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3742/7239] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:39 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:40.735561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-63069f52-5521-4ad7-9ad3-e8ecf2269c8d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:40.736637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-63069f52-5521-4ad7-9ad3-e8ecf2269c8d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:40.747670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63069f52-5521-4ad7-9ad3-e8ecf2269c8d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:40.748474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63069f52-5521-4ad7-9ad3-e8ecf2269c8d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:40.749201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63069f52-5521-4ad7-9ad3-e8ecf2269c8d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:40.750338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63069f52-5521-4ad7-9ad3-e8ecf2269c8d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:40.751191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63069f52-5521-4ad7-9ad3-e8ecf2269c8d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:40.751798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-63069f52-5521-4ad7-9ad3-e8ecf2269c8d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:40.889204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-63069f52-5521-4ad7-9ad3-e8ecf2269c8d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:40.897759 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-63069f52-5521-4ad7-9ad3-e8ecf2269c8d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1361 microversion: 2.1 time: 0.171031 Oct 05 18:41:40.898348 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3498/7240] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:40 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:41.924707 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-413cfe73-91f6-464a-bba6-ba998bcca520 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:41.925340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-413cfe73-91f6-464a-bba6-ba998bcca520 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:41.932778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-413cfe73-91f6-464a-bba6-ba998bcca520 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:41.933283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-413cfe73-91f6-464a-bba6-ba998bcca520 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:41.933737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-413cfe73-91f6-464a-bba6-ba998bcca520 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:41.934490 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-413cfe73-91f6-464a-bba6-ba998bcca520 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:41.934965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-413cfe73-91f6-464a-bba6-ba998bcca520 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:41.935406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-413cfe73-91f6-464a-bba6-ba998bcca520 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:42.079620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-413cfe73-91f6-464a-bba6-ba998bcca520 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:42.091073 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-413cfe73-91f6-464a-bba6-ba998bcca520 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1361 microversion: 2.1 time: 0.172011 Oct 05 18:41:42.091856 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3743/7241] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:41 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:43.062701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d80d4d37-7880-4a99-9e11-80222c8a1722 req-0bd5a02d-6180-4aa7-a7f9-e95abdb7e0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a354b3a-77ee-43e8-881c-f1f941248f9c", "name": "network-vif-plugged", "status": "completed", "tag": "ae8be786-8997-4493-a9fe-fa48b3b46fb5"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:41:43.073392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d80d4d37-7880-4a99-9e11-80222c8a1722 req-0bd5a02d-6180-4aa7-a7f9-e95abdb7e0bd service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:43.073633 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d80d4d37-7880-4a99-9e11-80222c8a1722 req-0bd5a02d-6180-4aa7-a7f9-e95abdb7e0bd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:43.074137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d80d4d37-7880-4a99-9e11-80222c8a1722 req-0bd5a02d-6180-4aa7-a7f9-e95abdb7e0bd service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:43.085879 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d80d4d37-7880-4a99-9e11-80222c8a1722 req-0bd5a02d-6180-4aa7-a7f9-e95abdb7e0bd service nova] Creating event network-vif-plugged:ae8be786-8997-4493-a9fe-fa48b3b46fb5 for instance 0a354b3a-77ee-43e8-881c-f1f941248f9c on n-h2-835595-3 Oct 05 18:41:43.091008 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d80d4d37-7880-4a99-9e11-80222c8a1722 req-0bd5a02d-6180-4aa7-a7f9-e95abdb7e0bd service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097119 Oct 05 18:41:43.091862 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3499/7242] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:43.116599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-84f3a27c-4e65-4c9d-96fd-3d16cbf1faeb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:43.117485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-84f3a27c-4e65-4c9d-96fd-3d16cbf1faeb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:43.124560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84f3a27c-4e65-4c9d-96fd-3d16cbf1faeb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:43.125064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84f3a27c-4e65-4c9d-96fd-3d16cbf1faeb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:43.125505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84f3a27c-4e65-4c9d-96fd-3d16cbf1faeb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:43.126212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84f3a27c-4e65-4c9d-96fd-3d16cbf1faeb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:43.126717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84f3a27c-4e65-4c9d-96fd-3d16cbf1faeb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:43.127163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-84f3a27c-4e65-4c9d-96fd-3d16cbf1faeb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:43.260335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-84f3a27c-4e65-4c9d-96fd-3d16cbf1faeb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:43.268613 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-84f3a27c-4e65-4c9d-96fd-3d16cbf1faeb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1361 microversion: 2.1 time: 0.157612 Oct 05 18:41:43.269326 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3744/7243] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:43 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:44.296698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa8177e5-fe28-4482-add0-0825dee6cca8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:44.297663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa8177e5-fe28-4482-add0-0825dee6cca8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:44.307019 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8177e5-fe28-4482-add0-0825dee6cca8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:44.307669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8177e5-fe28-4482-add0-0825dee6cca8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:44.308271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8177e5-fe28-4482-add0-0825dee6cca8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:44.309201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8177e5-fe28-4482-add0-0825dee6cca8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:44.309811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8177e5-fe28-4482-add0-0825dee6cca8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:44.310420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8177e5-fe28-4482-add0-0825dee6cca8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:44.452731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aa8177e5-fe28-4482-add0-0825dee6cca8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:44.461236 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa8177e5-fe28-4482-add0-0825dee6cca8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1361 microversion: 2.1 time: 0.172044 Oct 05 18:41:44.461805 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3500/7244] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:44 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:45.484828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-843df0ca-3aa5-4e23-b423-8a4724bb5193 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:45.485350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-843df0ca-3aa5-4e23-b423-8a4724bb5193 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:45.492993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-843df0ca-3aa5-4e23-b423-8a4724bb5193 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:45.493500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-843df0ca-3aa5-4e23-b423-8a4724bb5193 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:45.493950 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-843df0ca-3aa5-4e23-b423-8a4724bb5193 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:45.494754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-843df0ca-3aa5-4e23-b423-8a4724bb5193 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:45.495229 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-843df0ca-3aa5-4e23-b423-8a4724bb5193 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:45.495668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-843df0ca-3aa5-4e23-b423-8a4724bb5193 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:45.635210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-843df0ca-3aa5-4e23-b423-8a4724bb5193 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:45.644172 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-843df0ca-3aa5-4e23-b423-8a4724bb5193 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1552 microversion: 2.1 time: 0.163460 Oct 05 18:41:45.644753 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3745/7245] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:45 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:45.678171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-21545ce3-ac1e-4ff2-aefe-b0b6f2e37ccf tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:45.678821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-21545ce3-ac1e-4ff2-aefe-b0b6f2e37ccf tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:45.686223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21545ce3-ac1e-4ff2-aefe-b0b6f2e37ccf tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:45.686745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21545ce3-ac1e-4ff2-aefe-b0b6f2e37ccf tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:45.687189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21545ce3-ac1e-4ff2-aefe-b0b6f2e37ccf tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:45.687913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21545ce3-ac1e-4ff2-aefe-b0b6f2e37ccf tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:45.688369 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21545ce3-ac1e-4ff2-aefe-b0b6f2e37ccf tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:45.688797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21545ce3-ac1e-4ff2-aefe-b0b6f2e37ccf tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:45.841332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-21545ce3-ac1e-4ff2-aefe-b0b6f2e37ccf tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:41:45.849635 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-21545ce3-ac1e-4ff2-aefe-b0b6f2e37ccf tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1552 microversion: 2.1 time: 0.176115 Oct 05 18:41:45.850230 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3501/7246] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:41:45 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:41:47.384911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8047b5dc-f712-4267-a36e-6b5ab3ed7440 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:41:47.387375 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8047b5dc-f712-4267-a36e-6b5ab3ed7440 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:47.389427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:47.396063 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8047b5dc-f712-4267-a36e-6b5ab3ed7440 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:47.396565 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8047b5dc-f712-4267-a36e-6b5ab3ed7440 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:47.397022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8047b5dc-f712-4267-a36e-6b5ab3ed7440 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:47.397733 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8047b5dc-f712-4267-a36e-6b5ab3ed7440 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:47.398203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8047b5dc-f712-4267-a36e-6b5ab3ed7440 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:47.398668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8047b5dc-f712-4267-a36e-6b5ab3ed7440 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:47.656452 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8047b5dc-f712-4267-a36e-6b5ab3ed7440 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "POST /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275400 Oct 05 18:41:47.657314 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3746/7247] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:41:47 2022] POST /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:58.424580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b296409-df9b-4cea-be27-d9eec7d5c108 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:58.425064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b296409-df9b-4cea-be27-d9eec7d5c108 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:58.427416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:58.428102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:58.429042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:58.429750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:58.436810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b296409-df9b-4cea-be27-d9eec7d5c108 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:58.437303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b296409-df9b-4cea-be27-d9eec7d5c108 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:58.437745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b296409-df9b-4cea-be27-d9eec7d5c108 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:58.438467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b296409-df9b-4cea-be27-d9eec7d5c108 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:58.438925 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b296409-df9b-4cea-be27-d9eec7d5c108 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:58.439371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b296409-df9b-4cea-be27-d9eec7d5c108 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:58.530492 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-8b296409-df9b-4cea-be27-d9eec7d5c108 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lazy-loading 'services' on Instance uuid 0a354b3a-77ee-43e8-881c-f1f941248f9c {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:41:58.603105 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b296409-df9b-4cea-be27-d9eec7d5c108 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments/e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf" status: 202 len: 0 microversion: 2.1 time: 0.182512 Oct 05 18:41:58.604062 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3502/7248] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:41:58 2022] DELETE /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments/e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:41:58.611936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:58.613253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:41:58.618955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2c500a22-5529-4e96-900a-f9c6924bbddb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:58.622425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2c500a22-5529-4e96-900a-f9c6924bbddb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:58.634717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c500a22-5529-4e96-900a-f9c6924bbddb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:58.635298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c500a22-5529-4e96-900a-f9c6924bbddb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:58.635934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c500a22-5529-4e96-900a-f9c6924bbddb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:58.636666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c500a22-5529-4e96-900a-f9c6924bbddb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:58.637135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c500a22-5529-4e96-900a-f9c6924bbddb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:58.637579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2c500a22-5529-4e96-900a-f9c6924bbddb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:58.673951 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2c500a22-5529-4e96-900a-f9c6924bbddb tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064925 Oct 05 18:41:58.674739 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3747/7249] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:41:58 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:41:59.688285 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c387aa47-7124-4e78-aae4-8ff941998089 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:41:59.690802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c387aa47-7124-4e78-aae4-8ff941998089 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:41:59.697758 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c387aa47-7124-4e78-aae4-8ff941998089 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:59.698315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c387aa47-7124-4e78-aae4-8ff941998089 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:59.698791 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c387aa47-7124-4e78-aae4-8ff941998089 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:59.699490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c387aa47-7124-4e78-aae4-8ff941998089 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:41:59.699941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c387aa47-7124-4e78-aae4-8ff941998089 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:41:59.700367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c387aa47-7124-4e78-aae4-8ff941998089 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:41:59.731627 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c387aa47-7124-4e78-aae4-8ff941998089 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048520 Oct 05 18:41:59.732127 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3503/7250] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:41:59 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:00.744486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0a7f54d-90ff-4f9e-a50a-c6a82d42c1c6 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:00.746819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0a7f54d-90ff-4f9e-a50a-c6a82d42c1c6 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:00.754388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a7f54d-90ff-4f9e-a50a-c6a82d42c1c6 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:00.754894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a7f54d-90ff-4f9e-a50a-c6a82d42c1c6 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:00.755346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a7f54d-90ff-4f9e-a50a-c6a82d42c1c6 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:00.756064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a7f54d-90ff-4f9e-a50a-c6a82d42c1c6 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:00.756569 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a7f54d-90ff-4f9e-a50a-c6a82d42c1c6 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:00.757008 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a7f54d-90ff-4f9e-a50a-c6a82d42c1c6 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:00.788718 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0a7f54d-90ff-4f9e-a50a-c6a82d42c1c6 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048298 Oct 05 18:42:00.789292 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3748/7251] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:42:00 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:01.801695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-20c1346e-12b3-471a-b6d2-bac0c284e95b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:01.804067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-20c1346e-12b3-471a-b6d2-bac0c284e95b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:01.811366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20c1346e-12b3-471a-b6d2-bac0c284e95b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:01.811890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20c1346e-12b3-471a-b6d2-bac0c284e95b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:01.812328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20c1346e-12b3-471a-b6d2-bac0c284e95b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:01.813030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20c1346e-12b3-471a-b6d2-bac0c284e95b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:01.813483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20c1346e-12b3-471a-b6d2-bac0c284e95b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:01.813912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-20c1346e-12b3-471a-b6d2-bac0c284e95b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:01.845067 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-20c1346e-12b3-471a-b6d2-bac0c284e95b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047461 Oct 05 18:42:01.845563 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3504/7252] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:42:01 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:02.857752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c5dc73b1-aece-4b80-b8ae-3b5d49992ec1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:02.860019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c5dc73b1-aece-4b80-b8ae-3b5d49992ec1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:02.867641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5dc73b1-aece-4b80-b8ae-3b5d49992ec1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:02.868152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5dc73b1-aece-4b80-b8ae-3b5d49992ec1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:02.868607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5dc73b1-aece-4b80-b8ae-3b5d49992ec1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:02.869332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5dc73b1-aece-4b80-b8ae-3b5d49992ec1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:02.869809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5dc73b1-aece-4b80-b8ae-3b5d49992ec1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:02.870255 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5dc73b1-aece-4b80-b8ae-3b5d49992ec1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:02.901488 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c5dc73b1-aece-4b80-b8ae-3b5d49992ec1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047916 Oct 05 18:42:02.902339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3749/7253] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:42:02 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:03.914837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7fe4c866-bfa7-499b-b549-4c1d410c82ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:03.917103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7fe4c866-bfa7-499b-b549-4c1d410c82ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:03.924757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fe4c866-bfa7-499b-b549-4c1d410c82ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:03.925283 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fe4c866-bfa7-499b-b549-4c1d410c82ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:03.925719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fe4c866-bfa7-499b-b549-4c1d410c82ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:03.926480 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fe4c866-bfa7-499b-b549-4c1d410c82ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:03.926943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fe4c866-bfa7-499b-b549-4c1d410c82ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:03.927368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7fe4c866-bfa7-499b-b549-4c1d410c82ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:03.958052 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7fe4c866-bfa7-499b-b549-4c1d410c82ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047272 Oct 05 18:42:03.958661 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3505/7254] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:42:03 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 18:42:03.969693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:03.970210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:03.977451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:03.977892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:03.978377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:03.979094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:03.979573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:03.980016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:04.058927 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] HTTP exception thrown: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c is not attached to volume e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Request method failure captured: Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments/e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf HTTP/1.1 Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc-1lSuTle24nHTAw2AMKHH3U9RVbPgzHbLWJX3UaC9Qo3CjugLVDr9dcdnABCTX0UoJH0aE3AOvlv9TaHGHMPDxhffgxRs-9_dpL8pIkDoPsNCcCfbo_rpSzBY0AIr05hmApGCzxis9DFXxi_RVM56-RuEx0z0rvz0y4EmfG-ATl8I Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2033ecfc3ee54955b8daf40b6069a73d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}] Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6b4b7fc3f9504801a75eaccb919b100f Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c is not attached to volume e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': '0a354b3a-77ee-43e8-881c-f1f941248f9c', 'id': 'e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf'} Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf. Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c is not attached to volume e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:42:04.060584 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:42:04.065589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:42:04.065589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:42:04.065589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c is not attached to volume e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf Oct 05 18:42:04.065589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:04.065589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Returning 404 to user: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c is not attached to volume e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:42:04.065589 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e9e79d2-3a93-4837-a7b0-ac1fd65dd6a3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments/e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf" status: 404 len: 154 microversion: 2.1 time: 0.096560 Oct 05 18:42:04.065589 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3750/7255] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:42:03 2022] DELETE /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c/os-volume_attachments/e9d0cfbf-ce6d-46f8-b87d-a5fbd85a10bf => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:42:07.429836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6340655f-9b76-4765-9ae8-e1804b7eb35d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:07.430466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6340655f-9b76-4765-9ae8-e1804b7eb35d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:07.437911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6340655f-9b76-4765-9ae8-e1804b7eb35d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:07.438525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6340655f-9b76-4765-9ae8-e1804b7eb35d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:07.438973 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6340655f-9b76-4765-9ae8-e1804b7eb35d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:07.439696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6340655f-9b76-4765-9ae8-e1804b7eb35d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:07.440148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6340655f-9b76-4765-9ae8-e1804b7eb35d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:07.440573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6340655f-9b76-4765-9ae8-e1804b7eb35d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:07.468637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6340655f-9b76-4765-9ae8-e1804b7eb35d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:42:07.550547 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6340655f-9b76-4765-9ae8-e1804b7eb35d tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 204 len: 0 microversion: 2.1 time: 0.124389 Oct 05 18:42:07.551411 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3506/7256] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:42:07 2022] DELETE /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:42:07.560003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dee31192-8718-4cef-8dc3-e09e49dc80a1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:07.560635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dee31192-8718-4cef-8dc3-e09e49dc80a1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:07.568496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dee31192-8718-4cef-8dc3-e09e49dc80a1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:07.569003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dee31192-8718-4cef-8dc3-e09e49dc80a1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:07.569457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dee31192-8718-4cef-8dc3-e09e49dc80a1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:07.570180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dee31192-8718-4cef-8dc3-e09e49dc80a1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:07.570720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dee31192-8718-4cef-8dc3-e09e49dc80a1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:07.571159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dee31192-8718-4cef-8dc3-e09e49dc80a1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:07.705358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dee31192-8718-4cef-8dc3-e09e49dc80a1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:07.713623 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dee31192-8718-4cef-8dc3-e09e49dc80a1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1558 microversion: 2.1 time: 0.157678 Oct 05 18:42:07.714203 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3751/7257] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:07 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:08.737938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9df54d9e-278c-47db-a352-db683dc55a7b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:08.738767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9df54d9e-278c-47db-a352-db683dc55a7b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:08.746136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df54d9e-278c-47db-a352-db683dc55a7b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:08.746663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df54d9e-278c-47db-a352-db683dc55a7b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:08.747103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df54d9e-278c-47db-a352-db683dc55a7b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:08.747801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df54d9e-278c-47db-a352-db683dc55a7b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:08.748262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df54d9e-278c-47db-a352-db683dc55a7b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:08.748688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9df54d9e-278c-47db-a352-db683dc55a7b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:08.895210 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9df54d9e-278c-47db-a352-db683dc55a7b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:08.904517 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9df54d9e-278c-47db-a352-db683dc55a7b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1558 microversion: 2.1 time: 0.170916 Oct 05 18:42:08.905106 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3507/7258] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:08 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1558 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:09.625592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-27a2eacc-67a2-4769-a6ed-0ad5375380bf req-e58f4ddc-a862-4d90-811b-c00294df8361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a354b3a-77ee-43e8-881c-f1f941248f9c", "name": "network-vif-deleted", "tag": "ae8be786-8997-4493-a9fe-fa48b3b46fb5"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:42:09.640346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-27a2eacc-67a2-4769-a6ed-0ad5375380bf req-e58f4ddc-a862-4d90-811b-c00294df8361 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:09.640944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-27a2eacc-67a2-4769-a6ed-0ad5375380bf req-e58f4ddc-a862-4d90-811b-c00294df8361 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:09.641405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-27a2eacc-67a2-4769-a6ed-0ad5375380bf req-e58f4ddc-a862-4d90-811b-c00294df8361 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:09.656164 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-27a2eacc-67a2-4769-a6ed-0ad5375380bf req-e58f4ddc-a862-4d90-811b-c00294df8361 service nova] Creating event network-vif-deleted:ae8be786-8997-4493-a9fe-fa48b3b46fb5 for instance 0a354b3a-77ee-43e8-881c-f1f941248f9c on n-h2-835595-3 Oct 05 18:42:09.662521 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-27a2eacc-67a2-4769-a6ed-0ad5375380bf req-e58f4ddc-a862-4d90-811b-c00294df8361 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040621 Oct 05 18:42:09.663149 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3752/7259] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:09.928016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:09.929547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:09.937195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:09.937764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:09.938322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:09.939165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:09.939665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:09.940155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:09.973650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:09.974137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:09.974598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:09.975044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lazy-loading 'fault' on Instance uuid 0a354b3a-77ee-43e8-881c-f1f941248f9c {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:42:10.023489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:10.031640 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-935a1c4e-103f-42f1-a280-6e1f097d00ca tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 200 len: 1351 microversion: 2.1 time: 0.107775 Oct 05 18:42:10.032234 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3508/7260] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:09 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:11.060919 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:11.062106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0a354b3a-77ee-43e8-881c-f1f941248f9c] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:11.074139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:11.075018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:11.075769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:11.076945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:11.077732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:11.078511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:11.093684 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] HTTP exception thrown: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c could not be found. Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Request method failure captured: Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c HTTP/1.1 Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc-1lSuTle24nHTAw2AMKHH3U9RVbPgzHbLWJX3UaC9Qo3CjugLVDr9dcdnABCTX0UoJH0aE3AOvlv9TaHGHMPDxhffgxRs-9_dpL8pIkDoPsNCcCfbo_rpSzBY0AIr05hmApGCzxis9DFXxi_RVM56-RuEx0z0rvz0y4EmfG-ATl8I Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2033ecfc3ee54955b8daf40b6069a73d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}] Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6b4b7fc3f9504801a75eaccb919b100f Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c could not be found. Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '0a354b3a-77ee-43e8-881c-f1f941248f9c'} Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c could not be found. Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c could not be found. Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:11.095355 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c could not be found. Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Returning 404 to user: Instance 0a354b3a-77ee-43e8-881c-f1f941248f9c could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f7b34d0f-94a7-4ed4-a096-fb1c9a06808b tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c" status: 404 len: 111 microversion: 2.1 time: 0.043238 Oct 05 18:42:11.100066 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3753/7261] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:11 2022] GET /compute/v2.1/servers/0a354b3a-77ee-43e8-881c-f1f941248f9c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:42:11.105794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-786e5f06-9ee2-45b7-8d1d-5a4ae1a18c34 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '.version_select at 0x7f77746ce160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:11.128552 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-786e5f06-9ee2-45b7-8d1d-5a4ae1a18c34 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-335052257" status: 202 len: 0 microversion: 2.1 time: 0.026627 Oct 05 18:42:11.129223 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3509/7262] 10.222.0.70 () {58 vars in 1275 bytes} [Wed Oct 5 18:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-335052257 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:42:11.146414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a725ff39-8066-4155-9e11-6d75925a30f2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Action: 'create', calling method: .version_select at 0x7f7774335550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1535327996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJAwONzmdaacfjf3cYdOfD7ZfDbFeTTP6ubIwKpGbevYObNY2Zvy2Iu455+BjXlrLBH5NJKVz+MzBSMxbGIlxKCygjOln1XxxapcYKj9jW9Pzyd9kv03+YDm+vCA9uAsg=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:42:11.162097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-a725ff39-8066-4155-9e11-6d75925a30f2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:42:11.168697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-a725ff39-8066-4155-9e11-6d75925a30f2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for user 6b4b7fc3f9504801a75eaccb919b100f and project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:42:11.194166 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a725ff39-8066-4155-9e11-6d75925a30f2 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.052151 Oct 05 18:42:11.194839 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3754/7263] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:42:11 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:42:11.248828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2079714669", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1535327996", "networks": [{"uuid": "f4ae09fa-bef4-4240-be7f-663445c4e0b1"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:42:11.305026 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] validate_networks() for [('f4ae09fa-bef4-4240-be7f-663445c4e0b1', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:42:11.690506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:42:11.690934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:42:11.691482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:42:11.691891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:42:11.692303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:42:11.701516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:11.701998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:11.702651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:11.703384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:11.703838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:11.704259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:11.721572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:42:11.726929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Getting quotas for user 6b4b7fc3f9504801a75eaccb919b100f and project 2033ecfc3ee54955b8daf40b6069a73d. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:42:11.739859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:42:11.742190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:42:11.792457 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-05f96eb7-e9d8-4834-a869-e7a05b707fc8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550041 Oct 05 18:42:11.793235 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3510/7264] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:42:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:42:11.807305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-834580f4-154d-43a3-a04f-25a3f33ec579 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:11.807946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-834580f4-154d-43a3-a04f-25a3f33ec579 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:11.869087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-834580f4-154d-43a3-a04f-25a3f33ec579 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:11.876325 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-834580f4-154d-43a3-a04f-25a3f33ec579 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1263 microversion: 2.1 time: 0.073094 Oct 05 18:42:11.876986 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3755/7265] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:11 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1263 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:12.900468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e9324453-d480-42f2-a79c-52160a6bc8fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:12.901072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e9324453-d480-42f2-a79c-52160a6bc8fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:12.908408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9324453-d480-42f2-a79c-52160a6bc8fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:12.909497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9324453-d480-42f2-a79c-52160a6bc8fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:12.909497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9324453-d480-42f2-a79c-52160a6bc8fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:12.910219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9324453-d480-42f2-a79c-52160a6bc8fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:12.910811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9324453-d480-42f2-a79c-52160a6bc8fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:12.911238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e9324453-d480-42f2-a79c-52160a6bc8fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:12.982744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e9324453-d480-42f2-a79c-52160a6bc8fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:12.992317 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e9324453-d480-42f2-a79c-52160a6bc8fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1323 microversion: 2.1 time: 0.096012 Oct 05 18:42:12.992623 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3511/7266] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:12 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1323 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:14.014893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-21d97788-abc2-4075-b4f0-9d40572a9240 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:14.015601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-21d97788-abc2-4075-b4f0-9d40572a9240 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:14.023438 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d97788-abc2-4075-b4f0-9d40572a9240 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:14.023947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d97788-abc2-4075-b4f0-9d40572a9240 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:14.024399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d97788-abc2-4075-b4f0-9d40572a9240 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:14.025128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d97788-abc2-4075-b4f0-9d40572a9240 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:14.025599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d97788-abc2-4075-b4f0-9d40572a9240 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:14.026041 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-21d97788-abc2-4075-b4f0-9d40572a9240 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:14.170230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-21d97788-abc2-4075-b4f0-9d40572a9240 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:14.180143 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-21d97788-abc2-4075-b4f0-9d40572a9240 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1363 microversion: 2.1 time: 0.169252 Oct 05 18:42:14.181158 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3756/7267] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:14 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:14.284300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b5901e20-f4fe-43d4-880d-57bf7d7a0b87 req-94aa7b8c-f1d1-49b4-8264-1d002973e784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf2fac9-6716-4faa-9e44-3d5a60761bc2", "tag": "403a959a-786f-4484-b72d-0c6c6075690b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:42:14.295231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b5901e20-f4fe-43d4-880d-57bf7d7a0b87 req-94aa7b8c-f1d1-49b4-8264-1d002973e784 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:14.295718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b5901e20-f4fe-43d4-880d-57bf7d7a0b87 req-94aa7b8c-f1d1-49b4-8264-1d002973e784 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:14.296151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b5901e20-f4fe-43d4-880d-57bf7d7a0b87 req-94aa7b8c-f1d1-49b4-8264-1d002973e784 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:14.307726 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b5901e20-f4fe-43d4-880d-57bf7d7a0b87 req-94aa7b8c-f1d1-49b4-8264-1d002973e784 service nova] Creating event network-changed:403a959a-786f-4484-b72d-0c6c6075690b for instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 on n-h2-835595-3 Oct 05 18:42:14.312608 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b5901e20-f4fe-43d4-880d-57bf7d7a0b87 req-94aa7b8c-f1d1-49b4-8264-1d002973e784 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032395 Oct 05 18:42:14.313238 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3512/7268] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:15.209225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5871d5b6-ea30-4421-aa5a-8200da75c0a5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:15.210070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5871d5b6-ea30-4421-aa5a-8200da75c0a5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:15.221756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5871d5b6-ea30-4421-aa5a-8200da75c0a5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:15.222709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5871d5b6-ea30-4421-aa5a-8200da75c0a5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:15.223170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5871d5b6-ea30-4421-aa5a-8200da75c0a5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:15.223906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5871d5b6-ea30-4421-aa5a-8200da75c0a5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:15.224359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5871d5b6-ea30-4421-aa5a-8200da75c0a5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:15.224797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5871d5b6-ea30-4421-aa5a-8200da75c0a5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:15.357891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5871d5b6-ea30-4421-aa5a-8200da75c0a5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:15.365997 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5871d5b6-ea30-4421-aa5a-8200da75c0a5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1363 microversion: 2.1 time: 0.163597 Oct 05 18:42:15.366558 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3757/7269] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:15 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:16.390148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e38dfd34-fe01-4b9e-9324-2ae84d8e7069 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:16.390817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e38dfd34-fe01-4b9e-9324-2ae84d8e7069 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:16.397734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e38dfd34-fe01-4b9e-9324-2ae84d8e7069 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:16.398217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e38dfd34-fe01-4b9e-9324-2ae84d8e7069 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:16.398693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e38dfd34-fe01-4b9e-9324-2ae84d8e7069 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:16.399382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e38dfd34-fe01-4b9e-9324-2ae84d8e7069 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:16.399836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e38dfd34-fe01-4b9e-9324-2ae84d8e7069 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:16.400258 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e38dfd34-fe01-4b9e-9324-2ae84d8e7069 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:16.533708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e38dfd34-fe01-4b9e-9324-2ae84d8e7069 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:16.541958 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e38dfd34-fe01-4b9e-9324-2ae84d8e7069 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1363 microversion: 2.1 time: 0.157294 Oct 05 18:42:16.542578 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3513/7270] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:16 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:17.566510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-55413e4d-2968-4dcd-8726-caf70e028bbe tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:17.567102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-55413e4d-2968-4dcd-8726-caf70e028bbe tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:17.574405 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55413e4d-2968-4dcd-8726-caf70e028bbe tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:17.574922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55413e4d-2968-4dcd-8726-caf70e028bbe tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:17.575369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55413e4d-2968-4dcd-8726-caf70e028bbe tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:17.576081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55413e4d-2968-4dcd-8726-caf70e028bbe tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:17.576555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55413e4d-2968-4dcd-8726-caf70e028bbe tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:17.577000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-55413e4d-2968-4dcd-8726-caf70e028bbe tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:17.722006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-55413e4d-2968-4dcd-8726-caf70e028bbe tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:17.729989 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-55413e4d-2968-4dcd-8726-caf70e028bbe tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1363 microversion: 2.1 time: 0.167634 Oct 05 18:42:17.730623 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3758/7271] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:17 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:18.757241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-82714be3-9550-4a46-91b7-9460d55334cc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:18.758057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-82714be3-9550-4a46-91b7-9460d55334cc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:18.766551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82714be3-9550-4a46-91b7-9460d55334cc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:18.767326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82714be3-9550-4a46-91b7-9460d55334cc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:18.769503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82714be3-9550-4a46-91b7-9460d55334cc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:18.770235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82714be3-9550-4a46-91b7-9460d55334cc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:18.770723 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82714be3-9550-4a46-91b7-9460d55334cc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:18.771148 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-82714be3-9550-4a46-91b7-9460d55334cc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:18.912729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-82714be3-9550-4a46-91b7-9460d55334cc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:18.920735 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-82714be3-9550-4a46-91b7-9460d55334cc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1363 microversion: 2.1 time: 0.170593 Oct 05 18:42:18.921377 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3514/7272] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:18 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:19.192728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8c571316-d0aa-4c0e-b8f4-8e1e0862d1b7 req-1e95b94d-2efa-4666-9635-5ece7e313de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf2fac9-6716-4faa-9e44-3d5a60761bc2", "name": "network-vif-plugged", "status": "completed", "tag": "403a959a-786f-4484-b72d-0c6c6075690b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:42:19.206753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8c571316-d0aa-4c0e-b8f4-8e1e0862d1b7 req-1e95b94d-2efa-4666-9635-5ece7e313de3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:19.207475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8c571316-d0aa-4c0e-b8f4-8e1e0862d1b7 req-1e95b94d-2efa-4666-9635-5ece7e313de3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:19.207934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8c571316-d0aa-4c0e-b8f4-8e1e0862d1b7 req-1e95b94d-2efa-4666-9635-5ece7e313de3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:19.219525 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8c571316-d0aa-4c0e-b8f4-8e1e0862d1b7 req-1e95b94d-2efa-4666-9635-5ece7e313de3 service nova] Creating event network-vif-plugged:403a959a-786f-4484-b72d-0c6c6075690b for instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 on n-h2-835595-3 Oct 05 18:42:19.225276 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8c571316-d0aa-4c0e-b8f4-8e1e0862d1b7 req-1e95b94d-2efa-4666-9635-5ece7e313de3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036264 Oct 05 18:42:19.225917 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3759/7273] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:19.943471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1fefa452-325e-4951-8938-b27a727680a8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:19.944074 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1fefa452-325e-4951-8938-b27a727680a8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:19.951344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fefa452-325e-4951-8938-b27a727680a8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:19.951825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fefa452-325e-4951-8938-b27a727680a8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:19.952254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fefa452-325e-4951-8938-b27a727680a8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:19.952935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fefa452-325e-4951-8938-b27a727680a8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:19.953386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fefa452-325e-4951-8938-b27a727680a8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:19.953802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1fefa452-325e-4951-8938-b27a727680a8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:20.094008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1fefa452-325e-4951-8938-b27a727680a8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:20.106086 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1fefa452-325e-4951-8938-b27a727680a8 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1363 microversion: 2.1 time: 0.166246 Oct 05 18:42:20.106880 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3515/7274] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:19 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:21.133332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-01ad14c5-86d3-4023-b161-e91a249dca53 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:21.134226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-01ad14c5-86d3-4023-b161-e91a249dca53 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:21.143869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01ad14c5-86d3-4023-b161-e91a249dca53 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:21.144492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01ad14c5-86d3-4023-b161-e91a249dca53 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:21.145055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01ad14c5-86d3-4023-b161-e91a249dca53 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:21.145942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01ad14c5-86d3-4023-b161-e91a249dca53 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:21.146580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01ad14c5-86d3-4023-b161-e91a249dca53 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:21.147125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-01ad14c5-86d3-4023-b161-e91a249dca53 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:21.283212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-01ad14c5-86d3-4023-b161-e91a249dca53 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:21.293928 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-01ad14c5-86d3-4023-b161-e91a249dca53 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1554 microversion: 2.1 time: 0.166247 Oct 05 18:42:21.294845 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3760/7275] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:21 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:21.319940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2de3199c-07be-41ae-b042-28601bad556f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:21.320586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2de3199c-07be-41ae-b042-28601bad556f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:21.331390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de3199c-07be-41ae-b042-28601bad556f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:21.331998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de3199c-07be-41ae-b042-28601bad556f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:21.332517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de3199c-07be-41ae-b042-28601bad556f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:21.333222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de3199c-07be-41ae-b042-28601bad556f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:21.333681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de3199c-07be-41ae-b042-28601bad556f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:21.334109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2de3199c-07be-41ae-b042-28601bad556f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:21.469631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2de3199c-07be-41ae-b042-28601bad556f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:21.477655 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2de3199c-07be-41ae-b042-28601bad556f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1554 microversion: 2.1 time: 0.164064 Oct 05 18:42:21.478257 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3516/7276] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:21 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:22.995837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0a63928-0df2-43c0-95cc-6cbfb1699643 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa474907-fa8a-48f0-a999-505ee5dbb2c9"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:42:22.998245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0a63928-0df2-43c0-95cc-6cbfb1699643 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:23.000280 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:42:23.006862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a63928-0df2-43c0-95cc-6cbfb1699643 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:23.007393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a63928-0df2-43c0-95cc-6cbfb1699643 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:23.007846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a63928-0df2-43c0-95cc-6cbfb1699643 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:23.008560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a63928-0df2-43c0-95cc-6cbfb1699643 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:23.009034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a63928-0df2-43c0-95cc-6cbfb1699643 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:23.009477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a63928-0df2-43c0-95cc-6cbfb1699643 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:23.260169 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0a63928-0df2-43c0-95cc-6cbfb1699643 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "POST /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268228 Oct 05 18:42:23.260896 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3761/7277] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:42:22 2022] POST /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:34.023809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-593f4df5-8b21-40e7-ba15-68a5b3fd839c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:34.024325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-593f4df5-8b21-40e7-ba15-68a5b3fd839c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:34.026685 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:42:34.027330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:42:34.028096 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:42:34.028731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:42:34.035356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-593f4df5-8b21-40e7-ba15-68a5b3fd839c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:34.035844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-593f4df5-8b21-40e7-ba15-68a5b3fd839c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:34.036279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-593f4df5-8b21-40e7-ba15-68a5b3fd839c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:34.036966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-593f4df5-8b21-40e7-ba15-68a5b3fd839c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:34.037418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-593f4df5-8b21-40e7-ba15-68a5b3fd839c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:34.037839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-593f4df5-8b21-40e7-ba15-68a5b3fd839c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:34.119579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-593f4df5-8b21-40e7-ba15-68a5b3fd839c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lazy-loading 'services' on Instance uuid 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:42:34.195974 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-593f4df5-8b21-40e7-ba15-68a5b3fd839c tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments/aa474907-fa8a-48f0-a999-505ee5dbb2c9" status: 202 len: 0 microversion: 2.1 time: 0.175864 Oct 05 18:42:34.196792 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3517/7278] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:42:34 2022] DELETE /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments/aa474907-fa8a-48f0-a999-505ee5dbb2c9 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:42:34.204697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:42:34.205584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:42:34.210977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8cb2276b-16af-44f3-95c9-9847d24f91a4 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:34.213834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8cb2276b-16af-44f3-95c9-9847d24f91a4 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:34.224450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cb2276b-16af-44f3-95c9-9847d24f91a4 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:34.224962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cb2276b-16af-44f3-95c9-9847d24f91a4 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:34.225419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cb2276b-16af-44f3-95c9-9847d24f91a4 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:34.226142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cb2276b-16af-44f3-95c9-9847d24f91a4 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:34.226644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cb2276b-16af-44f3-95c9-9847d24f91a4 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:34.227095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8cb2276b-16af-44f3-95c9-9847d24f91a4 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:34.262573 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8cb2276b-16af-44f3-95c9-9847d24f91a4 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059749 Oct 05 18:42:34.263172 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3762/7279] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:42:34 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:35.277468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2743b891-2700-453d-8ce2-bc6fb44d9698 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:35.279863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2743b891-2700-453d-8ce2-bc6fb44d9698 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:35.286835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2743b891-2700-453d-8ce2-bc6fb44d9698 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:35.287315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2743b891-2700-453d-8ce2-bc6fb44d9698 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:35.287745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2743b891-2700-453d-8ce2-bc6fb44d9698 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:35.288493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2743b891-2700-453d-8ce2-bc6fb44d9698 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:35.288937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2743b891-2700-453d-8ce2-bc6fb44d9698 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:35.289354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2743b891-2700-453d-8ce2-bc6fb44d9698 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:35.322550 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2743b891-2700-453d-8ce2-bc6fb44d9698 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050270 Oct 05 18:42:35.323129 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3518/7280] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:42:35 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:36.335854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d61eebb3-1794-49a9-b1d1-13a21a8b8a08 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:36.338129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d61eebb3-1794-49a9-b1d1-13a21a8b8a08 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:36.345235 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61eebb3-1794-49a9-b1d1-13a21a8b8a08 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:36.345746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61eebb3-1794-49a9-b1d1-13a21a8b8a08 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:36.346228 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61eebb3-1794-49a9-b1d1-13a21a8b8a08 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:36.346957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61eebb3-1794-49a9-b1d1-13a21a8b8a08 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:36.347619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61eebb3-1794-49a9-b1d1-13a21a8b8a08 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:36.347853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d61eebb3-1794-49a9-b1d1-13a21a8b8a08 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:36.380288 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d61eebb3-1794-49a9-b1d1-13a21a8b8a08 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048712 Oct 05 18:42:36.380848 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3763/7281] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:42:36 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:37.394399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-204b62e7-02d6-445a-a51b-eb4bd14048ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:37.396974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-204b62e7-02d6-445a-a51b-eb4bd14048ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:37.405012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-204b62e7-02d6-445a-a51b-eb4bd14048ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:37.405836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-204b62e7-02d6-445a-a51b-eb4bd14048ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:37.406413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-204b62e7-02d6-445a-a51b-eb4bd14048ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:37.407143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-204b62e7-02d6-445a-a51b-eb4bd14048ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:37.407589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-204b62e7-02d6-445a-a51b-eb4bd14048ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:37.408033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-204b62e7-02d6-445a-a51b-eb4bd14048ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:37.438867 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-204b62e7-02d6-445a-a51b-eb4bd14048ea tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049777 Oct 05 18:42:37.439469 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3519/7282] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:42:37 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:38.451752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-705cd701-30e7-4150-ac51-835c1c381e33 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:38.454044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-705cd701-30e7-4150-ac51-835c1c381e33 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:38.461482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-705cd701-30e7-4150-ac51-835c1c381e33 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:38.462016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-705cd701-30e7-4150-ac51-835c1c381e33 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:38.462508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-705cd701-30e7-4150-ac51-835c1c381e33 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:38.463223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-705cd701-30e7-4150-ac51-835c1c381e33 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:38.463695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-705cd701-30e7-4150-ac51-835c1c381e33 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:38.464122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-705cd701-30e7-4150-ac51-835c1c381e33 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:38.495182 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-705cd701-30e7-4150-ac51-835c1c381e33 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047485 Oct 05 18:42:38.495764 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3764/7283] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:42:38 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:39.509729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f74ad2a-2f1a-4bc9-8956-3dc14edd21d3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:39.512574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f74ad2a-2f1a-4bc9-8956-3dc14edd21d3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:39.522423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f74ad2a-2f1a-4bc9-8956-3dc14edd21d3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:39.522908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f74ad2a-2f1a-4bc9-8956-3dc14edd21d3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:39.523346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f74ad2a-2f1a-4bc9-8956-3dc14edd21d3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:39.524049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f74ad2a-2f1a-4bc9-8956-3dc14edd21d3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:39.524507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f74ad2a-2f1a-4bc9-8956-3dc14edd21d3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:39.524929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f74ad2a-2f1a-4bc9-8956-3dc14edd21d3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:39.556932 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f74ad2a-2f1a-4bc9-8956-3dc14edd21d3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052265 Oct 05 18:42:39.557485 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3520/7284] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:42:39 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 18:42:39.571393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:39.571946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:39.579832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:39.580342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:39.580803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:39.581574 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:39.582055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:39.582540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:39.667992 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] HTTP exception thrown: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 is not attached to volume aa474907-fa8a-48f0-a999-505ee5dbb2c9 Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Request method failure captured: Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments/aa474907-fa8a-48f0-a999-505ee5dbb2c9 HTTP/1.1 Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc-1lSuTle24nHTAw2AMKHH3U9RVbPgzHbLWJX3UaC9Qo3CjugLVDr9dcdnABCTX0UoJH0aE3AOvlv9TaHGHMPDxhffgxRs-9_dpL8pIkDoPsNCcCfbo_rpSzBY0AIr05hmApGCzxis9DFXxi_RVM56-RuEx0z0rvz0y4EmfG-ATl8I Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2033ecfc3ee54955b8daf40b6069a73d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}] Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6b4b7fc3f9504801a75eaccb919b100f Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 is not attached to volume aa474907-fa8a-48f0-a999-505ee5dbb2c9 Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': '0bf2fac9-6716-4faa-9e44-3d5a60761bc2', 'id': 'aa474907-fa8a-48f0-a999-505ee5dbb2c9'} Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id aa474907-fa8a-48f0-a999-505ee5dbb2c9. Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 is not attached to volume aa474907-fa8a-48f0-a999-505ee5dbb2c9 Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:42:39.669702 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:42:39.674175 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:42:39.674175 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:42:39.674175 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 is not attached to volume aa474907-fa8a-48f0-a999-505ee5dbb2c9 Oct 05 18:42:39.674175 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:39.674175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Returning 404 to user: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 is not attached to volume aa474907-fa8a-48f0-a999-505ee5dbb2c9 {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:42:39.674175 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-70d94417-9982-4250-b296-3e6383d68ab1 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments/aa474907-fa8a-48f0-a999-505ee5dbb2c9" status: 404 len: 154 microversion: 2.1 time: 0.104047 Oct 05 18:42:39.674175 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3765/7285] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:42:39 2022] DELETE /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2/os-volume_attachments/aa474907-fa8a-48f0-a999-505ee5dbb2c9 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:42:43.028660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0471cd7a-d3ef-4434-aab9-29020c60cb1f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:43.029782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0471cd7a-d3ef-4434-aab9-29020c60cb1f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:43.037437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0471cd7a-d3ef-4434-aab9-29020c60cb1f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:43.037915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0471cd7a-d3ef-4434-aab9-29020c60cb1f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:43.038377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0471cd7a-d3ef-4434-aab9-29020c60cb1f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:43.039084 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0471cd7a-d3ef-4434-aab9-29020c60cb1f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:43.039530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0471cd7a-d3ef-4434-aab9-29020c60cb1f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:43.039933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0471cd7a-d3ef-4434-aab9-29020c60cb1f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:43.069772 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0471cd7a-d3ef-4434-aab9-29020c60cb1f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:42:43.165764 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0471cd7a-d3ef-4434-aab9-29020c60cb1f tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 204 len: 0 microversion: 2.1 time: 0.139936 Oct 05 18:42:43.166731 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3521/7286] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:42:43 2022] DELETE /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:42:43.175271 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0b0016cf-3745-448b-8066-6a014227b3fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:43.176026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0b0016cf-3745-448b-8066-6a014227b3fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:43.184150 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b0016cf-3745-448b-8066-6a014227b3fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:43.184737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b0016cf-3745-448b-8066-6a014227b3fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:43.185267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b0016cf-3745-448b-8066-6a014227b3fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:43.186062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b0016cf-3745-448b-8066-6a014227b3fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:43.186638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b0016cf-3745-448b-8066-6a014227b3fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:43.187350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0b0016cf-3745-448b-8066-6a014227b3fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:43.326708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0b0016cf-3745-448b-8066-6a014227b3fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:43.335032 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0b0016cf-3745-448b-8066-6a014227b3fc tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1560 microversion: 2.1 time: 0.163955 Oct 05 18:42:43.335592 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3766/7287] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:43 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:44.364254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a8fb59ff-0514-4561-8c60-469cb18225b5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:44.365371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a8fb59ff-0514-4561-8c60-469cb18225b5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:44.377123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8fb59ff-0514-4561-8c60-469cb18225b5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:44.377937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8fb59ff-0514-4561-8c60-469cb18225b5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:44.378627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8fb59ff-0514-4561-8c60-469cb18225b5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:44.379325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8fb59ff-0514-4561-8c60-469cb18225b5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:44.379782 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8fb59ff-0514-4561-8c60-469cb18225b5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:44.380206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a8fb59ff-0514-4561-8c60-469cb18225b5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:44.524989 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a8fb59ff-0514-4561-8c60-469cb18225b5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:44.533468 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a8fb59ff-0514-4561-8c60-469cb18225b5 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1560 microversion: 2.1 time: 0.176674 Oct 05 18:42:44.534063 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3522/7288] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:44 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:45.431071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4b1c5f01-9c6d-4b45-9fbf-007085a6b0ba req-2a6472fe-bf3f-4661-ac51-8d7743009e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf2fac9-6716-4faa-9e44-3d5a60761bc2", "name": "network-vif-deleted", "tag": "403a959a-786f-4484-b72d-0c6c6075690b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:42:45.441163 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4b1c5f01-9c6d-4b45-9fbf-007085a6b0ba req-2a6472fe-bf3f-4661-ac51-8d7743009e11 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:45.441760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4b1c5f01-9c6d-4b45-9fbf-007085a6b0ba req-2a6472fe-bf3f-4661-ac51-8d7743009e11 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:45.442308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4b1c5f01-9c6d-4b45-9fbf-007085a6b0ba req-2a6472fe-bf3f-4661-ac51-8d7743009e11 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:45.454764 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4b1c5f01-9c6d-4b45-9fbf-007085a6b0ba req-2a6472fe-bf3f-4661-ac51-8d7743009e11 service nova] Creating event network-vif-deleted:403a959a-786f-4484-b72d-0c6c6075690b for instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 on n-h2-835595-3 Oct 05 18:42:45.460914 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4b1c5f01-9c6d-4b45-9fbf-007085a6b0ba req-2a6472fe-bf3f-4661-ac51-8d7743009e11 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121136 Oct 05 18:42:45.461782 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3767/7289] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:42:45.557423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-640f3a91-cf2f-41ca-ac38-8d1df0f65ef3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:45.558830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-640f3a91-cf2f-41ca-ac38-8d1df0f65ef3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:45.568861 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-640f3a91-cf2f-41ca-ac38-8d1df0f65ef3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:45.569639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-640f3a91-cf2f-41ca-ac38-8d1df0f65ef3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:45.570081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-640f3a91-cf2f-41ca-ac38-8d1df0f65ef3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:45.570813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-640f3a91-cf2f-41ca-ac38-8d1df0f65ef3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:45.571270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-640f3a91-cf2f-41ca-ac38-8d1df0f65ef3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:45.571662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-640f3a91-cf2f-41ca-ac38-8d1df0f65ef3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:45.636805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-640f3a91-cf2f-41ca-ac38-8d1df0f65ef3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b4b7fc3f9504801a75eaccb919b100f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2033ecfc3ee54955b8daf40b6069a73d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:42:45.645684 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-640f3a91-cf2f-41ca-ac38-8d1df0f65ef3 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 200 len: 1348 microversion: 2.1 time: 0.092325 Oct 05 18:42:45.646263 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3523/7290] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:45 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:42:46.675824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:46.677085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] [instance: 0bf2fac9-6716-4faa-9e44-3d5a60761bc2] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:42:46.688803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:46.689646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:46.690452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:46.691416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:42:46.691896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:42:46.692346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:42:46.706860 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] HTTP exception thrown: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 could not be found. Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Request method failure captured: Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 HTTP/1.1 Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPc-1lSuTle24nHTAw2AMKHH3U9RVbPgzHbLWJX3UaC9Qo3CjugLVDr9dcdnABCTX0UoJH0aE3AOvlv9TaHGHMPDxhffgxRs-9_dpL8pIkDoPsNCcCfbo_rpSzBY0AIr05hmApGCzxis9DFXxi_RVM56-RuEx0z0rvz0y4EmfG-ATl8I Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_2033ecfc3ee54955b8daf40b6069a73d", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/2033ecfc3ee54955b8daf40b6069a73d"}]}] Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 2033ecfc3ee54955b8daf40b6069a73d Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1022049195 Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 6b4b7fc3f9504801a75eaccb919b100f Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestEncryptedCinderVolumes-1022049195-project Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 could not be found. Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '0bf2fac9-6716-4faa-9e44-3d5a60761bc2'} Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 could not be found. Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 could not be found. Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:46.709246 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 could not be found. Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Returning 404 to user: Instance 0bf2fac9-6716-4faa-9e44-3d5a60761bc2 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-068bdf35-b734-4b4f-862f-3844cb6a5d6e tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2" status: 404 len: 111 microversion: 2.1 time: 0.042667 Oct 05 18:42:46.713736 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3768/7291] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:42:46 2022] GET /compute/v2.1/servers/0bf2fac9-6716-4faa-9e44-3d5a60761bc2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:42:46.719769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f6e2323-979b-48a5-83c7-6662c1203b28 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] Calling method '.version_select at 0x7f77753e7ca0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:42:46.741642 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f6e2323-979b-48a5-83c7-6662c1203b28 tempest-TestEncryptedCinderVolumes-1022049195 tempest-TestEncryptedCinderVolumes-1022049195-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1535327996" status: 202 len: 0 microversion: 2.1 time: 0.025794 Oct 05 18:42:46.742268 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3524/7292] 10.222.0.70 () {58 vars in 1278 bytes} [Wed Oct 5 18:42:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1535327996 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:43:13.408671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5e8de990-b33c-4c2b-b61d-5b144844eb46 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'create', calling method: .version_select at 0x7f777960a9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1184992381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMILd0InmM1GlW3e0mQ+y6zunmwNwTyQgz0b6NI8FxnHeho6hivLQa+SHwoW6FmXfk8X4xvPWMnNQ207fhy7YP+xKkLQB8XaW/pzmrH1iDlCLqHzLwlzFnQ7miyhq7ie+w=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:43:13.414647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=14 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:13.415326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=34 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:13.427911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-5e8de990-b33c-4c2b-b61d-5b144844eb46 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Getting quotas for project c2dbde858f4648319751e3c651946041. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:43:13.433216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-5e8de990-b33c-4c2b-b61d-5b144844eb46 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Getting quotas for user 9c9a55d86ea74f9a8e7c1bab661928be and project c2dbde858f4648319751e3c651946041. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:43:13.459461 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5e8de990-b33c-4c2b-b61d-5b144844eb46 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055223 Oct 05 18:43:13.460085 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3769/7293] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:43:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:43:13.509747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:13.510554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:13.515165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1372343508", "imageRef": "cbe21549-198e-4bb8-a5af-6c8ad518e006", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1184992381", "networks": [{"uuid": "13bd4ff6-f690-499c-82fe-1394f669002c"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:43:13.568647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] validate_networks() for [('13bd4ff6-f690-499c-82fe-1394f669002c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:43:14.072152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:43:14.072614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:43:14.073090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:43:14.073498 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:43:14.073912 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:43:14.083682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:14.084172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:14.084604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:14.085338 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:14.085792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:14.086218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:14.105655 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Getting quotas for project c2dbde858f4648319751e3c651946041. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:43:14.111532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Getting quotas for user 9c9a55d86ea74f9a8e7c1bab661928be and project c2dbde858f4648319751e3c651946041. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:43:14.125136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:43:14.127426 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cbe21549-198e-4bb8-a5af-6c8ad518e006',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:43:14.174598 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dbfafac2-8270-4c02-a9af-bfa4254bebe7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.667533 Oct 05 18:43:14.175241 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3525/7294] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 18:43:14.187094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-eb74dd55-950d-47f3-983a-50326f6aa8a2 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:14.187734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-eb74dd55-950d-47f3-983a-50326f6aa8a2 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:14.243533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-eb74dd55-950d-47f3-983a-50326f6aa8a2 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:14.251825 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-eb74dd55-950d-47f3-983a-50326f6aa8a2 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1259 microversion: 2.1 time: 0.069080 Oct 05 18:43:14.252763 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3770/7295] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:14 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:15.276027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cbb80bc6-f344-40ad-8abf-1315504a84d7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:15.276629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-cbb80bc6-f344-40ad-8abf-1315504a84d7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:15.283972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbb80bc6-f344-40ad-8abf-1315504a84d7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:15.284457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbb80bc6-f344-40ad-8abf-1315504a84d7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:15.284886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbb80bc6-f344-40ad-8abf-1315504a84d7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:15.285564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbb80bc6-f344-40ad-8abf-1315504a84d7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:15.286186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbb80bc6-f344-40ad-8abf-1315504a84d7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:15.286659 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-cbb80bc6-f344-40ad-8abf-1315504a84d7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:15.350129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-cbb80bc6-f344-40ad-8abf-1315504a84d7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:15.360704 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cbb80bc6-f344-40ad-8abf-1315504a84d7 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1329 microversion: 2.1 time: 0.090578 Oct 05 18:43:15.361304 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3526/7296] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:15 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1329 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:16.385787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2fbaa86a-e165-4ff2-b280-1c1785eac816 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:16.387508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2fbaa86a-e165-4ff2-b280-1c1785eac816 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:16.396393 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2fbaa86a-e165-4ff2-b280-1c1785eac816 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:16.397324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2fbaa86a-e165-4ff2-b280-1c1785eac816 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:16.398148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2fbaa86a-e165-4ff2-b280-1c1785eac816 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:16.399424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2fbaa86a-e165-4ff2-b280-1c1785eac816 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:16.400890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2fbaa86a-e165-4ff2-b280-1c1785eac816 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:16.401552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2fbaa86a-e165-4ff2-b280-1c1785eac816 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:16.541572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2fbaa86a-e165-4ff2-b280-1c1785eac816 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:16.549706 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2fbaa86a-e165-4ff2-b280-1c1785eac816 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.168328 Oct 05 18:43:16.550460 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3771/7297] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:16 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:17.575042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ff856b0c-f0d4-43b0-b4d8-b410d6a0f31d tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:17.577250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ff856b0c-f0d4-43b0-b4d8-b410d6a0f31d tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:17.585362 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff856b0c-f0d4-43b0-b4d8-b410d6a0f31d tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:17.585853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff856b0c-f0d4-43b0-b4d8-b410d6a0f31d tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:17.586310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff856b0c-f0d4-43b0-b4d8-b410d6a0f31d tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:17.587046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff856b0c-f0d4-43b0-b4d8-b410d6a0f31d tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:17.587469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff856b0c-f0d4-43b0-b4d8-b410d6a0f31d tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:17.588098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff856b0c-f0d4-43b0-b4d8-b410d6a0f31d tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:17.733333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ff856b0c-f0d4-43b0-b4d8-b410d6a0f31d tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:17.743252 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ff856b0c-f0d4-43b0-b4d8-b410d6a0f31d tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.173465 Oct 05 18:43:17.743990 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3527/7298] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:17 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:18.766960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8f7c9aaa-abbf-42fd-820e-4c1abc651f5e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:18.768932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8f7c9aaa-abbf-42fd-820e-4c1abc651f5e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:18.776582 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7c9aaa-abbf-42fd-820e-4c1abc651f5e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:18.777454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7c9aaa-abbf-42fd-820e-4c1abc651f5e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:18.778148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7c9aaa-abbf-42fd-820e-4c1abc651f5e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:18.779288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7c9aaa-abbf-42fd-820e-4c1abc651f5e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:18.780014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7c9aaa-abbf-42fd-820e-4c1abc651f5e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:18.780535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8f7c9aaa-abbf-42fd-820e-4c1abc651f5e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:18.926860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8f7c9aaa-abbf-42fd-820e-4c1abc651f5e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:18.935226 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8f7c9aaa-abbf-42fd-820e-4c1abc651f5e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.172225 Oct 05 18:43:18.935837 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3772/7299] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:18 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:19.959171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-86a2189c-5979-49f4-9949-05d78d324e96 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:19.960624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-86a2189c-5979-49f4-9949-05d78d324e96 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:19.969412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a2189c-5979-49f4-9949-05d78d324e96 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:19.970213 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a2189c-5979-49f4-9949-05d78d324e96 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:19.970676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a2189c-5979-49f4-9949-05d78d324e96 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:19.971551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a2189c-5979-49f4-9949-05d78d324e96 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:19.972016 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a2189c-5979-49f4-9949-05d78d324e96 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:19.972441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86a2189c-5979-49f4-9949-05d78d324e96 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:20.114788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86a2189c-5979-49f4-9949-05d78d324e96 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:20.122871 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-86a2189c-5979-49f4-9949-05d78d324e96 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.168435 Oct 05 18:43:20.138341 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3528/7300] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:19 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:21.148215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82a8fde1-6678-4cc4-9019-8753f685ad8b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:21.149668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-82a8fde1-6678-4cc4-9019-8753f685ad8b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:21.157283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82a8fde1-6678-4cc4-9019-8753f685ad8b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:21.157875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82a8fde1-6678-4cc4-9019-8753f685ad8b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:21.158432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82a8fde1-6678-4cc4-9019-8753f685ad8b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:21.159223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82a8fde1-6678-4cc4-9019-8753f685ad8b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:21.159685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82a8fde1-6678-4cc4-9019-8753f685ad8b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:21.160130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82a8fde1-6678-4cc4-9019-8753f685ad8b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:21.303125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-82a8fde1-6678-4cc4-9019-8753f685ad8b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:21.316570 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-82a8fde1-6678-4cc4-9019-8753f685ad8b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.174298 Oct 05 18:43:21.323078 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3773/7301] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:21 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:22.341405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4d8e90af-9ddf-415b-ac40-8568b94b9ceb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:22.342136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4d8e90af-9ddf-415b-ac40-8568b94b9ceb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:22.349399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d8e90af-9ddf-415b-ac40-8568b94b9ceb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:22.349900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d8e90af-9ddf-415b-ac40-8568b94b9ceb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:22.350364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d8e90af-9ddf-415b-ac40-8568b94b9ceb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:22.351083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d8e90af-9ddf-415b-ac40-8568b94b9ceb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:22.351536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d8e90af-9ddf-415b-ac40-8568b94b9ceb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:22.351945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4d8e90af-9ddf-415b-ac40-8568b94b9ceb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:22.500030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4d8e90af-9ddf-415b-ac40-8568b94b9ceb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:22.507967 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4d8e90af-9ddf-415b-ac40-8568b94b9ceb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.170568 Oct 05 18:43:22.508537 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3529/7302] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:22 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:23.530606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8a94233f-dbc0-414c-bc02-d2b089bb3b4b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:23.531265 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8a94233f-dbc0-414c-bc02-d2b089bb3b4b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:23.538324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a94233f-dbc0-414c-bc02-d2b089bb3b4b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:23.538854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a94233f-dbc0-414c-bc02-d2b089bb3b4b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:23.539317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a94233f-dbc0-414c-bc02-d2b089bb3b4b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:23.540042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a94233f-dbc0-414c-bc02-d2b089bb3b4b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:23.540519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a94233f-dbc0-414c-bc02-d2b089bb3b4b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:23.540952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8a94233f-dbc0-414c-bc02-d2b089bb3b4b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:23.728238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8a94233f-dbc0-414c-bc02-d2b089bb3b4b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:23.738024 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8a94233f-dbc0-414c-bc02-d2b089bb3b4b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.211298 Oct 05 18:43:23.738773 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3774/7303] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:23 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:23.865368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-23d44d38-87e0-4a9e-9f16-cc09d94444fa req-69c61b04-9af4-4953-9c39-af4e01b2c6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d6794d-b0aa-4263-b933-18649506145f", "tag": "7bef45be-12bd-4a6e-bb19-c9d0d3dfac99"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:43:23.877006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-23d44d38-87e0-4a9e-9f16-cc09d94444fa req-69c61b04-9af4-4953-9c39-af4e01b2c6af service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:23.877808 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-23d44d38-87e0-4a9e-9f16-cc09d94444fa req-69c61b04-9af4-4953-9c39-af4e01b2c6af service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:23.878472 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-23d44d38-87e0-4a9e-9f16-cc09d94444fa req-69c61b04-9af4-4953-9c39-af4e01b2c6af service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:23.890254 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-23d44d38-87e0-4a9e-9f16-cc09d94444fa req-69c61b04-9af4-4953-9c39-af4e01b2c6af service nova] Creating event network-changed:7bef45be-12bd-4a6e-bb19-c9d0d3dfac99 for instance c2d6794d-b0aa-4263-b933-18649506145f on n-h2-835595-3 Oct 05 18:43:23.895932 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-23d44d38-87e0-4a9e-9f16-cc09d94444fa req-69c61b04-9af4-4953-9c39-af4e01b2c6af service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034391 Oct 05 18:43:23.896723 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3530/7304] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:43:24.761493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d426b86-f5f0-4ec4-8015-3e278f7eccaa tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:24.762094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d426b86-f5f0-4ec4-8015-3e278f7eccaa tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:24.764054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:24.770728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d426b86-f5f0-4ec4-8015-3e278f7eccaa tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:24.771230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d426b86-f5f0-4ec4-8015-3e278f7eccaa tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:24.771717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d426b86-f5f0-4ec4-8015-3e278f7eccaa tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:24.772477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d426b86-f5f0-4ec4-8015-3e278f7eccaa tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:24.772956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d426b86-f5f0-4ec4-8015-3e278f7eccaa tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:24.773396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d426b86-f5f0-4ec4-8015-3e278f7eccaa tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:24.903719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d426b86-f5f0-4ec4-8015-3e278f7eccaa tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:24.912150 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d426b86-f5f0-4ec4-8015-3e278f7eccaa tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.154720 Oct 05 18:43:24.912747 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3775/7305] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:24 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:25.932631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:25.933416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:25.938851 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-10493bc9-1116-4f0e-a9a9-156c23ba86d8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:25.939526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-10493bc9-1116-4f0e-a9a9-156c23ba86d8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:25.946702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10493bc9-1116-4f0e-a9a9-156c23ba86d8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:25.947181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10493bc9-1116-4f0e-a9a9-156c23ba86d8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:25.947604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10493bc9-1116-4f0e-a9a9-156c23ba86d8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:25.948611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10493bc9-1116-4f0e-a9a9-156c23ba86d8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:25.948754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10493bc9-1116-4f0e-a9a9-156c23ba86d8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:25.949133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10493bc9-1116-4f0e-a9a9-156c23ba86d8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:26.091403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-10493bc9-1116-4f0e-a9a9-156c23ba86d8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:26.099684 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-10493bc9-1116-4f0e-a9a9-156c23ba86d8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.168018 Oct 05 18:43:26.100261 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3531/7306] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:25 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:27.128121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-74c86f62-a720-412f-83b1-99932ab7a24e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:27.128759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-74c86f62-a720-412f-83b1-99932ab7a24e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:27.138216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74c86f62-a720-412f-83b1-99932ab7a24e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:27.140013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74c86f62-a720-412f-83b1-99932ab7a24e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:27.140649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74c86f62-a720-412f-83b1-99932ab7a24e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:27.141621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74c86f62-a720-412f-83b1-99932ab7a24e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:27.142176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74c86f62-a720-412f-83b1-99932ab7a24e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:27.143096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-74c86f62-a720-412f-83b1-99932ab7a24e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:27.280829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-74c86f62-a720-412f-83b1-99932ab7a24e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:27.288828 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-74c86f62-a720-412f-83b1-99932ab7a24e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.165252 Oct 05 18:43:27.289421 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3776/7307] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:27 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:28.316163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0aaf0270-349c-4924-9c9f-9b354c3499d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:28.317288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0aaf0270-349c-4924-9c9f-9b354c3499d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:28.328830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aaf0270-349c-4924-9c9f-9b354c3499d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:28.329656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aaf0270-349c-4924-9c9f-9b354c3499d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:28.330413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aaf0270-349c-4924-9c9f-9b354c3499d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:28.331596 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aaf0270-349c-4924-9c9f-9b354c3499d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:28.332459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aaf0270-349c-4924-9c9f-9b354c3499d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:28.332885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0aaf0270-349c-4924-9c9f-9b354c3499d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:28.473862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0aaf0270-349c-4924-9c9f-9b354c3499d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:28.483116 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0aaf0270-349c-4924-9c9f-9b354c3499d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.173519 Oct 05 18:43:28.483665 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3532/7308] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:28 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:29.506164 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ccf9aec-498d-4df3-acca-5d9bb6bd0d89 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:29.506851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ccf9aec-498d-4df3-acca-5d9bb6bd0d89 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:29.513925 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccf9aec-498d-4df3-acca-5d9bb6bd0d89 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:29.514445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccf9aec-498d-4df3-acca-5d9bb6bd0d89 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:29.515121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccf9aec-498d-4df3-acca-5d9bb6bd0d89 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:29.515679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccf9aec-498d-4df3-acca-5d9bb6bd0d89 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:29.516157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccf9aec-498d-4df3-acca-5d9bb6bd0d89 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:29.516600 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ccf9aec-498d-4df3-acca-5d9bb6bd0d89 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:29.543507 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-57c2966f-b52d-42e5-8607-c9e76920ab79 req-ad390e10-1099-43bd-8a44-866e058e8a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d6794d-b0aa-4263-b933-18649506145f", "name": "network-vif-plugged", "status": "completed", "tag": "7bef45be-12bd-4a6e-bb19-c9d0d3dfac99"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:43:29.573976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-57c2966f-b52d-42e5-8607-c9e76920ab79 req-ad390e10-1099-43bd-8a44-866e058e8a0e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:29.574501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-57c2966f-b52d-42e5-8607-c9e76920ab79 req-ad390e10-1099-43bd-8a44-866e058e8a0e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:29.574928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-57c2966f-b52d-42e5-8607-c9e76920ab79 req-ad390e10-1099-43bd-8a44-866e058e8a0e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:29.587426 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-57c2966f-b52d-42e5-8607-c9e76920ab79 req-ad390e10-1099-43bd-8a44-866e058e8a0e service nova] Creating event network-vif-plugged:7bef45be-12bd-4a6e-bb19-c9d0d3dfac99 for instance c2d6794d-b0aa-4263-b933-18649506145f on n-h2-835595-3 Oct 05 18:43:29.592602 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-57c2966f-b52d-42e5-8607-c9e76920ab79 req-ad390e10-1099-43bd-8a44-866e058e8a0e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052856 Oct 05 18:43:29.593354 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3533/7309] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:43:29.705260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5ccf9aec-498d-4df3-acca-5d9bb6bd0d89 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:29.713562 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ccf9aec-498d-4df3-acca-5d9bb6bd0d89 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.211600 Oct 05 18:43:29.714131 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3777/7310] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:29 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:30.738133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d859c04c-d40e-4e53-9430-d9da405d0b63 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:30.738868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d859c04c-d40e-4e53-9430-d9da405d0b63 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:30.745508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d859c04c-d40e-4e53-9430-d9da405d0b63 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:30.745990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d859c04c-d40e-4e53-9430-d9da405d0b63 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:30.746456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d859c04c-d40e-4e53-9430-d9da405d0b63 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:30.747143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d859c04c-d40e-4e53-9430-d9da405d0b63 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:30.747603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d859c04c-d40e-4e53-9430-d9da405d0b63 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:30.748036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d859c04c-d40e-4e53-9430-d9da405d0b63 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:30.895009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d859c04c-d40e-4e53-9430-d9da405d0b63 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:30.904109 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d859c04c-d40e-4e53-9430-d9da405d0b63 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1359 microversion: 2.1 time: 0.171224 Oct 05 18:43:30.904706 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3534/7311] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:30 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:31.929823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e3444020-43f6-459e-ad73-4ec1194c6681 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:31.930604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e3444020-43f6-459e-ad73-4ec1194c6681 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:31.938037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3444020-43f6-459e-ad73-4ec1194c6681 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:31.938571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3444020-43f6-459e-ad73-4ec1194c6681 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:31.939026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3444020-43f6-459e-ad73-4ec1194c6681 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:31.939743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3444020-43f6-459e-ad73-4ec1194c6681 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:31.940242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3444020-43f6-459e-ad73-4ec1194c6681 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:31.940686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e3444020-43f6-459e-ad73-4ec1194c6681 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:32.075455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e3444020-43f6-459e-ad73-4ec1194c6681 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:32.086121 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e3444020-43f6-459e-ad73-4ec1194c6681 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1548 microversion: 2.1 time: 0.160717 Oct 05 18:43:32.086745 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3778/7312] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:31 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:32.108437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27f51c09-d75f-4b62-8475-2986ac221488 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:32.109031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-27f51c09-d75f-4b62-8475-2986ac221488 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:32.116216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f51c09-d75f-4b62-8475-2986ac221488 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:32.116705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f51c09-d75f-4b62-8475-2986ac221488 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:32.117166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f51c09-d75f-4b62-8475-2986ac221488 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:32.117863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f51c09-d75f-4b62-8475-2986ac221488 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:32.118343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f51c09-d75f-4b62-8475-2986ac221488 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:32.118773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27f51c09-d75f-4b62-8475-2986ac221488 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:32.249611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-27f51c09-d75f-4b62-8475-2986ac221488 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:32.257927 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-27f51c09-d75f-4b62-8475-2986ac221488 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1548 microversion: 2.1 time: 0.153410 Oct 05 18:43:32.258555 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3535/7313] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:32 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:32.280248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:32.285263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:32.286031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Searching by: {'deleted': False, 'project_id': 'c2dbde858f4648319751e3c651946041'} {{(pid=128844) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 18:43:32.291915 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:32.292410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:32.292859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:32.293599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:32.294095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:32.294759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:32.321257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.multi_cell_list [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128844) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 18:43:32.348463 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a52e5cbf-8c1d-4d6e-b481-e22f9f1ac13f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.072140 Oct 05 18:43:32.349058 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3779/7314] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 18:43:32 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:43:32.361843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-53ed2fb2-41dc-4ce8-a1d1-46c546ecc928 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:32.362499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-53ed2fb2-41dc-4ce8-a1d1-46c546ecc928 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:32.369102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53ed2fb2-41dc-4ce8-a1d1-46c546ecc928 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:32.369586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53ed2fb2-41dc-4ce8-a1d1-46c546ecc928 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:32.370018 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53ed2fb2-41dc-4ce8-a1d1-46c546ecc928 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:32.370776 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53ed2fb2-41dc-4ce8-a1d1-46c546ecc928 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:32.371206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53ed2fb2-41dc-4ce8-a1d1-46c546ecc928 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:32.371626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-53ed2fb2-41dc-4ce8-a1d1-46c546ecc928 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:32.503192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-53ed2fb2-41dc-4ce8-a1d1-46c546ecc928 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:32.511171 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-53ed2fb2-41dc-4ce8-a1d1-46c546ecc928 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1548 microversion: 2.1 time: 0.153701 Oct 05 18:43:32.511743 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3536/7315] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:32 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:34.077119 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b5bb92e7-e29d-4dde-a530-2ee249c647d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1d54a31-b3c1-419d-a685-fdee84c08224"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:43:34.080383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b5bb92e7-e29d-4dde-a530-2ee249c647d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:34.088409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5bb92e7-e29d-4dde-a530-2ee249c647d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:34.088921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5bb92e7-e29d-4dde-a530-2ee249c647d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:34.089380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5bb92e7-e29d-4dde-a530-2ee249c647d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:34.090109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5bb92e7-e29d-4dde-a530-2ee249c647d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:34.090618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5bb92e7-e29d-4dde-a530-2ee249c647d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:34.091065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b5bb92e7-e29d-4dde-a530-2ee249c647d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:34.354705 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b5bb92e7-e29d-4dde-a530-2ee249c647d3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284137 Oct 05 18:43:34.355444 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3780/7316] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:43:34 2022] POST /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:43:47.521894 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-953f1e1b-a436-4ca8-b1e9-79a213553c7e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:47.522525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-953f1e1b-a436-4ca8-b1e9-79a213553c7e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:47.525787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:47.526259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=60 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:47.532783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-953f1e1b-a436-4ca8-b1e9-79a213553c7e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:47.533282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-953f1e1b-a436-4ca8-b1e9-79a213553c7e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:47.533719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-953f1e1b-a436-4ca8-b1e9-79a213553c7e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:47.534475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-953f1e1b-a436-4ca8-b1e9-79a213553c7e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:47.534933 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-953f1e1b-a436-4ca8-b1e9-79a213553c7e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:47.535365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-953f1e1b-a436-4ca8-b1e9-79a213553c7e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:47.678634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-953f1e1b-a436-4ca8-b1e9-79a213553c7e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:47.687482 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-953f1e1b-a436-4ca8-b1e9-79a213553c7e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1594 microversion: 2.1 time: 0.170290 Oct 05 18:43:47.688099 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3537/7317] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:47 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1594 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:43:49.718362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:49.723473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:49.724457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:43:49.886738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-4bddb9f8-441a-4e12-8a5a-d03897806dbe req-7688d4f7-ef8c-4a1e-a7e4-28f760e778b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d6794d-b0aa-4263-b933-18649506145f", "tag": "7bef45be-12bd-4a6e-bb19-c9d0d3dfac99"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:43:49.897900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4bddb9f8-441a-4e12-8a5a-d03897806dbe req-7688d4f7-ef8c-4a1e-a7e4-28f760e778b7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:49.898798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4bddb9f8-441a-4e12-8a5a-d03897806dbe req-7688d4f7-ef8c-4a1e-a7e4-28f760e778b7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:49.899435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-4bddb9f8-441a-4e12-8a5a-d03897806dbe req-7688d4f7-ef8c-4a1e-a7e4-28f760e778b7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:49.917365 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-4bddb9f8-441a-4e12-8a5a-d03897806dbe req-7688d4f7-ef8c-4a1e-a7e4-28f760e778b7 service nova] Creating event network-changed:7bef45be-12bd-4a6e-bb19-c9d0d3dfac99 for instance c2d6794d-b0aa-4263-b933-18649506145f on n-h2-835595-3 Oct 05 18:43:49.924163 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-4bddb9f8-441a-4e12-8a5a-d03897806dbe req-7688d4f7-ef8c-4a1e-a7e4-28f760e778b7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.207981 Oct 05 18:43:49.925551 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3781/7318] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:43:51.295371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-52f21a1b-45a3-486d-b477-773f3eeed487 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1443821928"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:43:51.295949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-52f21a1b-45a3-486d-b477-773f3eeed487 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:51.303266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f21a1b-45a3-486d-b477-773f3eeed487 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:51.303814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f21a1b-45a3-486d-b477-773f3eeed487 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:51.304235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f21a1b-45a3-486d-b477-773f3eeed487 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:51.304938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f21a1b-45a3-486d-b477-773f3eeed487 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:51.305396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f21a1b-45a3-486d-b477-773f3eeed487 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:51.305818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-52f21a1b-45a3-486d-b477-773f3eeed487 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:51.434788 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.network.security_group_api [None req-52f21a1b-45a3-486d-b477-773f3eeed487 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Adding security group d9d46d23-cc59-4cc9-82c7-909dcf00b1e0 to port 7bef45be-12bd-4a6e-bb19-c9d0d3dfac99 Oct 05 18:43:51.770257 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-52f21a1b-45a3-486d-b477-773f3eeed487 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/action" status: 202 len: 0 microversion: 2.1 time: 0.478940 Oct 05 18:43:51.771383 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3538/7319] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:43:51 2022] POST /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/action => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:43:51.780590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c4106111-aafc-40cc-9698-21b45c4f8eb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:43:51.781974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c4106111-aafc-40cc-9698-21b45c4f8eb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:43:51.789251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4106111-aafc-40cc-9698-21b45c4f8eb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:51.789750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4106111-aafc-40cc-9698-21b45c4f8eb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:51.790195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4106111-aafc-40cc-9698-21b45c4f8eb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:51.790932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4106111-aafc-40cc-9698-21b45c4f8eb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:51.791629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4106111-aafc-40cc-9698-21b45c4f8eb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:51.792058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c4106111-aafc-40cc-9698-21b45c4f8eb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:51.940939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-2494b29d-fa36-459d-bc5e-12fafd0d14bf req-9f06292d-1a8c-4614-8230-4c34e6fdac11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d6794d-b0aa-4263-b933-18649506145f", "tag": "7bef45be-12bd-4a6e-bb19-c9d0d3dfac99"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:43:51.951227 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2494b29d-fa36-459d-bc5e-12fafd0d14bf req-9f06292d-1a8c-4614-8230-4c34e6fdac11 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:43:51.951939 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2494b29d-fa36-459d-bc5e-12fafd0d14bf req-9f06292d-1a8c-4614-8230-4c34e6fdac11 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:43:51.952635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2494b29d-fa36-459d-bc5e-12fafd0d14bf req-9f06292d-1a8c-4614-8230-4c34e6fdac11 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:43:51.959755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c4106111-aafc-40cc-9698-21b45c4f8eb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:43:51.965340 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-2494b29d-fa36-459d-bc5e-12fafd0d14bf req-9f06292d-1a8c-4614-8230-4c34e6fdac11 service nova] Creating event network-changed:7bef45be-12bd-4a6e-bb19-c9d0d3dfac99 for instance c2d6794d-b0aa-4263-b933-18649506145f on n-h2-835595-3 Oct 05 18:43:51.970730 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c4106111-aafc-40cc-9698-21b45c4f8eb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1760 microversion: 2.1 time: 0.194546 Oct 05 18:43:51.971165 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-2494b29d-fa36-459d-bc5e-12fafd0d14bf req-9f06292d-1a8c-4614-8230-4c34e6fdac11 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033953 Oct 05 18:43:51.971825 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3539/7320] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:43:51.975153 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3782/7321] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:43:51 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1760 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:45:30.153419 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1744094-4a20-4501-8b29-640f444f590e] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 18:45:30.154221 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3358724b-f52c-4a69-8c22-3305520f8c1e] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 18:45:30.154826 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:45:30.155571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=12 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:45:30.156448 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 18:45:30.156598 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/action (ip 10.222.0.70) !!! Oct 05 18:45:30.157991 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 18:45:30.158154 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/action (ip 10.222.0.70) !!! Oct 05 18:45:30.164867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6085d7f2-2de0-466e-af92-a33e4037c6f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:45:30.167180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6085d7f2-2de0-466e-af92-a33e4037c6f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:45:30.176526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6085d7f2-2de0-466e-af92-a33e4037c6f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:45:30.177009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6085d7f2-2de0-466e-af92-a33e4037c6f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:45:30.177435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6085d7f2-2de0-466e-af92-a33e4037c6f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:45:30.178133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6085d7f2-2de0-466e-af92-a33e4037c6f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:45:30.178592 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6085d7f2-2de0-466e-af92-a33e4037c6f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:45:30.179012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6085d7f2-2de0-466e-af92-a33e4037c6f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:45:30.263959 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6085d7f2-2de0-466e-af92-a33e4037c6f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/action" status: 202 len: 0 microversion: 2.1 time: 0.112259 Oct 05 18:45:30.264603 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3540/7322] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:45:30 2022] POST /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:45:30.271648 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d9585d8e-c85f-4e0e-8626-ea6a3c823e4e] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 18:45:30.275478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4b449417-a515-4e14-a2e4-5fb9b13158de tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:45:30.276103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4b449417-a515-4e14-a2e4-5fb9b13158de tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:45:30.278165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=4 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:45:30.279006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:45:30.279974 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:45:30.280147 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f (ip 10.222.0.70) !!! Oct 05 18:45:30.281331 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 18:45:30.281463 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:45:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f (ip 10.222.0.70) !!! Oct 05 18:45:30.290104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b449417-a515-4e14-a2e4-5fb9b13158de tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:45:30.290635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b449417-a515-4e14-a2e4-5fb9b13158de tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:45:30.291091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b449417-a515-4e14-a2e4-5fb9b13158de tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:45:30.291808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b449417-a515-4e14-a2e4-5fb9b13158de tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:45:30.292282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b449417-a515-4e14-a2e4-5fb9b13158de tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:45:30.292734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4b449417-a515-4e14-a2e4-5fb9b13158de tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:45:30.616385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4b449417-a515-4e14-a2e4-5fb9b13158de tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:45:30.625706 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4b449417-a515-4e14-a2e4-5fb9b13158de tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1762 microversion: 2.1 time: 0.356251 Oct 05 18:45:30.626387 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3783/7323] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:45:30 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1762 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:45:31.664913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b341c9c-836b-4ba0-b43e-03e892bb28f3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:45:31.665662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b341c9c-836b-4ba0-b43e-03e892bb28f3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:45:31.685337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b341c9c-836b-4ba0-b43e-03e892bb28f3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:45:31.686211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b341c9c-836b-4ba0-b43e-03e892bb28f3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:45:31.686889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b341c9c-836b-4ba0-b43e-03e892bb28f3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:45:31.687784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b341c9c-836b-4ba0-b43e-03e892bb28f3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:45:31.688243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b341c9c-836b-4ba0-b43e-03e892bb28f3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:45:31.688670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b341c9c-836b-4ba0-b43e-03e892bb28f3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:45:31.689671 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1744094-4a20-4501-8b29-640f444f590e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 36834. Oct 05 18:45:31.699693 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] [3358724b-f52c-4a69-8c22-3305520f8c1e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 36836. Oct 05 18:45:31.907005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8b341c9c-836b-4ba0-b43e-03e892bb28f3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:45:31.917629 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b341c9c-836b-4ba0-b43e-03e892bb28f3 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1760 microversion: 2.1 time: 0.269984 Oct 05 18:45:31.918217 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3541/7324] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:45:31 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1760 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:46:45.546856 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e95dc271-cddc-4501-83b4-4d8d4789eaf1] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 18:46:45.549092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:46:45.550827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:46:45.560081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-26c627b8-819d-49ba-9f9e-1e1864054c00 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1443821928"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:46:45.561102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-26c627b8-819d-49ba-9f9e-1e1864054c00 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:45.568963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c627b8-819d-49ba-9f9e-1e1864054c00 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:45.569445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c627b8-819d-49ba-9f9e-1e1864054c00 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:45.569892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c627b8-819d-49ba-9f9e-1e1864054c00 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:45.570629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c627b8-819d-49ba-9f9e-1e1864054c00 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:45.571093 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c627b8-819d-49ba-9f9e-1e1864054c00 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:45.571532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-26c627b8-819d-49ba-9f9e-1e1864054c00 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:45.576550 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] [d9585d8e-c85f-4e0e-8626-ea6a3c823e4e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 36866. Oct 05 18:46:45.709265 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.network.security_group_api [None req-26c627b8-819d-49ba-9f9e-1e1864054c00 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Removing security group d9d46d23-cc59-4cc9-82c7-909dcf00b1e0 from port 7bef45be-12bd-4a6e-bb19-c9d0d3dfac99 Oct 05 18:46:46.023952 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-26c627b8-819d-49ba-9f9e-1e1864054c00 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/action" status: 202 len: 0 microversion: 2.1 time: 0.480928 Oct 05 18:46:46.028340 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3784/7325] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:46:45 2022] POST /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:46:46.031532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:46:46.032948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:46:46.037116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-aa2d08ce-7e87-488a-9921-6833f89f64ed req-a1fb26a2-2771-477b-8c6a-bc04c1272325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d6794d-b0aa-4263-b933-18649506145f", "tag": "7bef45be-12bd-4a6e-bb19-c9d0d3dfac99"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:46:46.060525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-aa2d08ce-7e87-488a-9921-6833f89f64ed req-a1fb26a2-2771-477b-8c6a-bc04c1272325 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:46.061032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-aa2d08ce-7e87-488a-9921-6833f89f64ed req-a1fb26a2-2771-477b-8c6a-bc04c1272325 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:46.061470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-aa2d08ce-7e87-488a-9921-6833f89f64ed req-a1fb26a2-2771-477b-8c6a-bc04c1272325 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:46.092069 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-aa2d08ce-7e87-488a-9921-6833f89f64ed req-a1fb26a2-2771-477b-8c6a-bc04c1272325 service nova] Creating event network-changed:7bef45be-12bd-4a6e-bb19-c9d0d3dfac99 for instance c2d6794d-b0aa-4263-b933-18649506145f on n-h2-835595-3 Oct 05 18:46:46.109952 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-aa2d08ce-7e87-488a-9921-6833f89f64ed req-a1fb26a2-2771-477b-8c6a-bc04c1272325 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079946 Oct 05 18:46:46.110428 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3542/7326] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:46:47.156861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-180ab208-7476-49bd-a06b-30549c4925d3 req-96320d37-c9be-4627-9ab0-a1805067bfde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d6794d-b0aa-4263-b933-18649506145f", "tag": "7bef45be-12bd-4a6e-bb19-c9d0d3dfac99"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:46:47.177290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-180ab208-7476-49bd-a06b-30549c4925d3 req-96320d37-c9be-4627-9ab0-a1805067bfde service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:47.178070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-180ab208-7476-49bd-a06b-30549c4925d3 req-96320d37-c9be-4627-9ab0-a1805067bfde service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:47.178748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-180ab208-7476-49bd-a06b-30549c4925d3 req-96320d37-c9be-4627-9ab0-a1805067bfde service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:47.203120 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-180ab208-7476-49bd-a06b-30549c4925d3 req-96320d37-c9be-4627-9ab0-a1805067bfde service nova] Creating event network-changed:7bef45be-12bd-4a6e-bb19-c9d0d3dfac99 for instance c2d6794d-b0aa-4263-b933-18649506145f on n-h2-835595-3 Oct 05 18:46:47.207508 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [req-180ab208-7476-49bd-a06b-30549c4925d3 req-96320d37-c9be-4627-9ab0-a1805067bfde service nova] [733d6df2-420a-4374-ad77-30a44f9c7592] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 18:46:47.209520 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] [e95dc271-cddc-4501-83b4-4d8d4789eaf1] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 36888. Oct 05 18:46:47.209656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ff9232af-fb6e-4945-91aa-18973eb8cfd4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:47.210197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ff9232af-fb6e-4945-91aa-18973eb8cfd4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:47.220317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff9232af-fb6e-4945-91aa-18973eb8cfd4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:47.221100 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff9232af-fb6e-4945-91aa-18973eb8cfd4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:47.221542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff9232af-fb6e-4945-91aa-18973eb8cfd4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:47.222316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff9232af-fb6e-4945-91aa-18973eb8cfd4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:47.223080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff9232af-fb6e-4945-91aa-18973eb8cfd4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:47.223505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ff9232af-fb6e-4945-91aa-18973eb8cfd4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:47.315229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-ff9232af-fb6e-4945-91aa-18973eb8cfd4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lazy-loading 'services' on Instance uuid c2d6794d-b0aa-4263-b933-18649506145f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:46:47.394682 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ff9232af-fb6e-4945-91aa-18973eb8cfd4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments/d1d54a31-b3c1-419d-a685-fdee84c08224" status: 202 len: 0 microversion: 2.1 time: 0.189930 Oct 05 18:46:47.395543 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3543/7327] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:46:47 2022] DELETE /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments/d1d54a31-b3c1-419d-a685-fdee84c08224 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:46:47.407263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7b84012f-3059-419e-b817-b80060729dda tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:47.409908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7b84012f-3059-419e-b817-b80060729dda tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:47.417321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b84012f-3059-419e-b817-b80060729dda tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:47.417954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b84012f-3059-419e-b817-b80060729dda tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:47.418485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b84012f-3059-419e-b817-b80060729dda tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:47.419324 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b84012f-3059-419e-b817-b80060729dda tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:47.419880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b84012f-3059-419e-b817-b80060729dda tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:47.420417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7b84012f-3059-419e-b817-b80060729dda tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:47.455203 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7b84012f-3059-419e-b817-b80060729dda tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054963 Oct 05 18:46:47.456204 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3544/7328] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:46:47 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:46:48.217025 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [req-180ab208-7476-49bd-a06b-30549c4925d3 req-96320d37-c9be-4627-9ab0-a1805067bfde service nova] [733d6df2-420a-4374-ad77-30a44f9c7592] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 36900. Oct 05 18:46:48.222675 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-180ab208-7476-49bd-a06b-30549c4925d3 req-96320d37-c9be-4627-9ab0-a1805067bfde service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.071901 Oct 05 18:46:48.230767 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3785/7329] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:46:48.468513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a61e186f-770f-4fc1-8a22-ddac451b41f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:48.470738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a61e186f-770f-4fc1-8a22-ddac451b41f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:48.478206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a61e186f-770f-4fc1-8a22-ddac451b41f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:48.478724 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a61e186f-770f-4fc1-8a22-ddac451b41f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:48.479159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a61e186f-770f-4fc1-8a22-ddac451b41f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:48.479913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a61e186f-770f-4fc1-8a22-ddac451b41f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:48.480371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a61e186f-770f-4fc1-8a22-ddac451b41f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:48.480793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a61e186f-770f-4fc1-8a22-ddac451b41f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:48.511262 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a61e186f-770f-4fc1-8a22-ddac451b41f6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046804 Oct 05 18:46:48.511831 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3545/7330] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:46:48 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:46:49.526599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59a12536-cb2c-4a9d-9a64-4a2c1c5ee278 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:49.528965 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-59a12536-cb2c-4a9d-9a64-4a2c1c5ee278 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:49.535823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59a12536-cb2c-4a9d-9a64-4a2c1c5ee278 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:49.536388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59a12536-cb2c-4a9d-9a64-4a2c1c5ee278 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:49.536838 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59a12536-cb2c-4a9d-9a64-4a2c1c5ee278 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:49.537561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59a12536-cb2c-4a9d-9a64-4a2c1c5ee278 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:49.538030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59a12536-cb2c-4a9d-9a64-4a2c1c5ee278 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:49.538503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59a12536-cb2c-4a9d-9a64-4a2c1c5ee278 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:49.574983 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-59a12536-cb2c-4a9d-9a64-4a2c1c5ee278 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053776 Oct 05 18:46:49.575898 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3786/7331] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:46:49 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:46:50.587856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9a0c6934-2fc7-4c25-8b90-e164ee3d0db5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:50.590073 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9a0c6934-2fc7-4c25-8b90-e164ee3d0db5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:50.597466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0c6934-2fc7-4c25-8b90-e164ee3d0db5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:50.597955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0c6934-2fc7-4c25-8b90-e164ee3d0db5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:50.598430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0c6934-2fc7-4c25-8b90-e164ee3d0db5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:50.599124 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0c6934-2fc7-4c25-8b90-e164ee3d0db5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:50.599578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0c6934-2fc7-4c25-8b90-e164ee3d0db5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:50.600006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9a0c6934-2fc7-4c25-8b90-e164ee3d0db5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:50.630633 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9a0c6934-2fc7-4c25-8b90-e164ee3d0db5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046956 Oct 05 18:46:50.631203 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3546/7332] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:46:50 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:46:51.643761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-15b92bc7-20e1-43aa-8a23-15e0cb378c71 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:51.646777 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15b92bc7-20e1-43aa-8a23-15e0cb378c71 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:51.654475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b92bc7-20e1-43aa-8a23-15e0cb378c71 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:51.654982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b92bc7-20e1-43aa-8a23-15e0cb378c71 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:51.655434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b92bc7-20e1-43aa-8a23-15e0cb378c71 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:51.656153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b92bc7-20e1-43aa-8a23-15e0cb378c71 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:51.656633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b92bc7-20e1-43aa-8a23-15e0cb378c71 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:51.657104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15b92bc7-20e1-43aa-8a23-15e0cb378c71 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:51.689544 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-15b92bc7-20e1-43aa-8a23-15e0cb378c71 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050313 Oct 05 18:46:51.690389 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3787/7333] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:46:51 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:46:52.704652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8e074e3-b4ab-46fd-a88e-820efbc1d953 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:52.707360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8e074e3-b4ab-46fd-a88e-820efbc1d953 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:52.720099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e074e3-b4ab-46fd-a88e-820efbc1d953 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:52.720701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e074e3-b4ab-46fd-a88e-820efbc1d953 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:52.721237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e074e3-b4ab-46fd-a88e-820efbc1d953 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:52.723719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e074e3-b4ab-46fd-a88e-820efbc1d953 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:52.723719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e074e3-b4ab-46fd-a88e-820efbc1d953 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:52.723719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e074e3-b4ab-46fd-a88e-820efbc1d953 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:52.755779 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8e074e3-b4ab-46fd-a88e-820efbc1d953 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056755 Oct 05 18:46:52.756348 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3547/7334] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:46:52 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 18:46:52.768294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:52.768827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:52.776218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:52.776708 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:52.777152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:52.777846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:52.778306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:52.778799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:52.865708 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] HTTP exception thrown: Instance c2d6794d-b0aa-4263-b933-18649506145f is not attached to volume d1d54a31-b3c1-419d-a685-fdee84c08224 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Request method failure captured: Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments/d1d54a31-b3c1-419d-a685-fdee84c08224 HTTP/1.1 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPdAy_c51akg48RxLGhe-n1h-qgcLOrIopzwL0Awznrzns5kowRKfsjGbe2DQm3QM40wbkVC5BZfBQrqBskvaNaLBNRkjtaBmNZEAEw57S5uD7FzAyfsOSDRpzLvHo7KA4iay7reuIatf3Fiv-muPSRBhfftYS_cT82VfKPVwqBQRHyo Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c2dbde858f4648319751e3c651946041 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c2dbde858f4648319751e3c651946041"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2dbde858f4648319751e3c651946041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c2dbde858f4648319751e3c651946041", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2dbde858f4648319751e3c651946041"}]}] Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c2dbde858f4648319751e3c651946041 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestMinimumBasicScenario-1194592050-project Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9c9a55d86ea74f9a8e7c1bab661928be Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestMinimumBasicScenario-1194592050-project Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance c2d6794d-b0aa-4263-b933-18649506145f is not attached to volume d1d54a31-b3c1-419d-a685-fdee84c08224 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': 'c2d6794d-b0aa-4263-b933-18649506145f', 'id': 'd1d54a31-b3c1-419d-a685-fdee84c08224'} Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d1d54a31-b3c1-419d-a685-fdee84c08224. Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d6794d-b0aa-4263-b933-18649506145f is not attached to volume d1d54a31-b3c1-419d-a685-fdee84c08224 Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:46:52.868238 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:46:52.873710 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:46:52.873710 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:46:52.873710 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d6794d-b0aa-4263-b933-18649506145f is not attached to volume d1d54a31-b3c1-419d-a685-fdee84c08224 Oct 05 18:46:52.873710 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:46:52.873710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Returning 404 to user: Instance c2d6794d-b0aa-4263-b933-18649506145f is not attached to volume d1d54a31-b3c1-419d-a685-fdee84c08224 {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:46:52.873710 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ea7b50c-b93b-4832-9a98-fe8d91c418ac tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments/d1d54a31-b3c1-419d-a685-fdee84c08224" status: 404 len: 154 microversion: 2.1 time: 0.106040 Oct 05 18:46:52.873710 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3788/7335] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:46:52 2022] DELETE /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f/os-volume_attachments/d1d54a31-b3c1-419d-a685-fdee84c08224 => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:46:56.138888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aa8b492a-3d12-4691-8b21-6b049abd71bf tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:56.139443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa8b492a-3d12-4691-8b21-6b049abd71bf tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:56.147028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8b492a-3d12-4691-8b21-6b049abd71bf tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:56.147518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8b492a-3d12-4691-8b21-6b049abd71bf tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:56.147954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8b492a-3d12-4691-8b21-6b049abd71bf tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:56.148683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8b492a-3d12-4691-8b21-6b049abd71bf tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:56.149135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8b492a-3d12-4691-8b21-6b049abd71bf tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:56.149577 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aa8b492a-3d12-4691-8b21-6b049abd71bf tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:56.176187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aa8b492a-3d12-4691-8b21-6b049abd71bf tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:46:56.259419 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aa8b492a-3d12-4691-8b21-6b049abd71bf tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "DELETE /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 204 len: 0 microversion: 2.1 time: 0.124112 Oct 05 18:46:56.260198 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3548/7336] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:46:56 2022] DELETE /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:46:56.270264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-649e8b4c-f076-4e98-ba37-d219784074b5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:56.271642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-649e8b4c-f076-4e98-ba37-d219784074b5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:56.280763 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-649e8b4c-f076-4e98-ba37-d219784074b5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:56.281543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-649e8b4c-f076-4e98-ba37-d219784074b5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:56.282122 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-649e8b4c-f076-4e98-ba37-d219784074b5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:56.283007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-649e8b4c-f076-4e98-ba37-d219784074b5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:56.283682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-649e8b4c-f076-4e98-ba37-d219784074b5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:56.284268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-649e8b4c-f076-4e98-ba37-d219784074b5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:56.425003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-649e8b4c-f076-4e98-ba37-d219784074b5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:46:56.433364 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-649e8b4c-f076-4e98-ba37-d219784074b5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1554 microversion: 2.1 time: 0.168258 Oct 05 18:46:56.433960 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3789/7337] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:46:56 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:46:57.467140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-499e9ab7-f83d-4034-96e9-9769a50c64bc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:57.468728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-499e9ab7-f83d-4034-96e9-9769a50c64bc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:57.475654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-499e9ab7-f83d-4034-96e9-9769a50c64bc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:57.476137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-499e9ab7-f83d-4034-96e9-9769a50c64bc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:57.476566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-499e9ab7-f83d-4034-96e9-9769a50c64bc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:57.477249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-499e9ab7-f83d-4034-96e9-9769a50c64bc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:57.477697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-499e9ab7-f83d-4034-96e9-9769a50c64bc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:57.478131 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-499e9ab7-f83d-4034-96e9-9769a50c64bc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:57.610652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-499e9ab7-f83d-4034-96e9-9769a50c64bc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:46:57.619346 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-499e9ab7-f83d-4034-96e9-9769a50c64bc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1554 microversion: 2.1 time: 0.160294 Oct 05 18:46:57.619934 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3549/7338] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:46:57 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:46:58.372977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a2cfccd6-0665-4d3f-b602-5d6b34efc622 req-3f336a4d-9355-4711-aef0-0c95775ba958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d6794d-b0aa-4263-b933-18649506145f", "name": "network-vif-deleted", "tag": "7bef45be-12bd-4a6e-bb19-c9d0d3dfac99"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:46:58.388558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a2cfccd6-0665-4d3f-b602-5d6b34efc622 req-3f336a4d-9355-4711-aef0-0c95775ba958 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:58.389323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a2cfccd6-0665-4d3f-b602-5d6b34efc622 req-3f336a4d-9355-4711-aef0-0c95775ba958 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:58.389717 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a2cfccd6-0665-4d3f-b602-5d6b34efc622 req-3f336a4d-9355-4711-aef0-0c95775ba958 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:58.402035 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a2cfccd6-0665-4d3f-b602-5d6b34efc622 req-3f336a4d-9355-4711-aef0-0c95775ba958 service nova] Creating event network-vif-deleted:7bef45be-12bd-4a6e-bb19-c9d0d3dfac99 for instance c2d6794d-b0aa-4263-b933-18649506145f on n-h2-835595-3 Oct 05 18:46:58.407215 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a2cfccd6-0665-4d3f-b602-5d6b34efc622 req-3f336a4d-9355-4711-aef0-0c95775ba958 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038274 Oct 05 18:46:58.407824 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3790/7339] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:46:58.643193 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:58.643807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:58.651284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:58.651774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:58.652192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:58.652922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:58.653356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:58.653807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:58.687102 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:58.687589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:58.688027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:58.688556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lazy-loading 'fault' on Instance uuid c2d6794d-b0aa-4263-b933-18649506145f {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:46:58.736063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:46:58.744814 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-795ca0b6-d896-40ac-b902-9bd776401ca5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 200 len: 1349 microversion: 2.1 time: 0.105969 Oct 05 18:46:58.758301 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3550/7340] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:46:58 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 1349 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:46:59.775683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:59.776853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: c2d6794d-b0aa-4263-b933-18649506145f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:46:59.784784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:59.785293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:59.785748 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:59.786500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:46:59.786975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:46:59.787416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:46:59.801740 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] HTTP exception thrown: Instance c2d6794d-b0aa-4263-b933-18649506145f could not be found. Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Request method failure captured: Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f HTTP/1.1 Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPdAy_c51akg48RxLGhe-n1h-qgcLOrIopzwL0Awznrzns5kowRKfsjGbe2DQm3QM40wbkVC5BZfBQrqBskvaNaLBNRkjtaBmNZEAEw57S5uD7FzAyfsOSDRpzLvHo7KA4iay7reuIatf3Fiv-muPSRBhfftYS_cT82VfKPVwqBQRHyo Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c2dbde858f4648319751e3c651946041 Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c2dbde858f4648319751e3c651946041"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2dbde858f4648319751e3c651946041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c2dbde858f4648319751e3c651946041", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2dbde858f4648319751e3c651946041"}]}] Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c2dbde858f4648319751e3c651946041 Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestMinimumBasicScenario-1194592050-project Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9c9a55d86ea74f9a8e7c1bab661928be Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestMinimumBasicScenario-1194592050-project Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance c2d6794d-b0aa-4263-b933-18649506145f could not be found. Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'c2d6794d-b0aa-4263-b933-18649506145f'} Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d6794d-b0aa-4263-b933-18649506145f could not be found. Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d6794d-b0aa-4263-b933-18649506145f could not be found. Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:46:59.803382 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:46:59.808339 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:46:59.808339 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:46:59.808339 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:46:59.808339 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:46:59.808339 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:46:59.808339 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d6794d-b0aa-4263-b933-18649506145f could not be found. Oct 05 18:46:59.808339 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:46:59.808339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Returning 404 to user: Instance c2d6794d-b0aa-4263-b933-18649506145f could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:46:59.808339 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c6cdff0b-a1b3-4d92-a6d3-201f90d9a101 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f" status: 404 len: 111 microversion: 2.1 time: 0.037907 Oct 05 18:46:59.809071 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3791/7341] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:46:59 2022] GET /compute/v2.1/servers/c2d6794d-b0aa-4263-b933-18649506145f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:46:59.814056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fedf4d37-4cb0-48a2-a8f2-9e69193370f4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '.version_select at 0x7f77795549d0>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:46:59.842499 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fedf4d37-4cb0-48a2-a8f2-9e69193370f4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1184992381" status: 202 len: 0 microversion: 2.1 time: 0.032231 Oct 05 18:46:59.843065 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3551/7342] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 18:46:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1184992381 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:47:08.909460 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-873f80a2-8b9d-49b9-a9be-d14d5535b224 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'create', calling method: .version_select at 0x7f777528e820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1178033137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDpb82qjLvgOWkMoUmRqxO7vhwGoSAtqVTIjqf5QbpozL4kwkcDDpL+x6c0CkZGM0cp0rdU8bPAz8bkVZeVLPQLfLhWxRiCAPb7QrcDYkCmOn5b2k8lGlhObP4JuvrIPw=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:47:08.928066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-873f80a2-8b9d-49b9-a9be-d14d5535b224 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Getting quotas for project c2dbde858f4648319751e3c651946041. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:47:08.933837 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-873f80a2-8b9d-49b9-a9be-d14d5535b224 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Getting quotas for user 9c9a55d86ea74f9a8e7c1bab661928be and project c2dbde858f4648319751e3c651946041. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:47:08.966374 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-873f80a2-8b9d-49b9-a9be-d14d5535b224 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060809 Oct 05 18:47:08.966927 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3792/7343] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:47:08 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:47:09.018000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:09.022233 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-226753845", "imageRef": "e8471536-c418-4149-a154-44287fab32b9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1178033137", "networks": [{"uuid": "13bd4ff6-f690-499c-82fe-1394f669002c"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:47:09.076678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] validate_networks() for [('13bd4ff6-f690-499c-82fe-1394f669002c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:47:09.466455 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:47:09.466889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:47:09.467363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:47:09.467774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:47:09.468185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:47:09.477739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:09.478228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:09.478696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:09.479420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:09.479869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:09.480293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:09.498950 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Getting quotas for project c2dbde858f4648319751e3c651946041. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:47:09.504636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Getting quotas for user 9c9a55d86ea74f9a8e7c1bab661928be and project c2dbde858f4648319751e3c651946041. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:47:09.518170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:47:09.520530 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e8471536-c418-4149-a154-44287fab32b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:47:09.571554 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-230de159-d1cd-4f96-abea-c7bc59dce86a tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555428 Oct 05 18:47:09.572423 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3552/7344] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:47:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:47:09.583828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f277a69a-7863-4521-ad21-d8aa72908ab1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:09.584545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f277a69a-7863-4521-ad21-d8aa72908ab1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:09.638812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f277a69a-7863-4521-ad21-d8aa72908ab1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:09.646110 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f277a69a-7863-4521-ad21-d8aa72908ab1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1258 microversion: 2.1 time: 0.066406 Oct 05 18:47:09.646686 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3793/7345] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:09 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:47:10.670608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-405d36d5-5e44-4397-a2d6-f885532dbac8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:10.671870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-405d36d5-5e44-4397-a2d6-f885532dbac8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:10.679323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-405d36d5-5e44-4397-a2d6-f885532dbac8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:10.679810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-405d36d5-5e44-4397-a2d6-f885532dbac8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:10.680363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-405d36d5-5e44-4397-a2d6-f885532dbac8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:10.681046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-405d36d5-5e44-4397-a2d6-f885532dbac8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:10.681509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-405d36d5-5e44-4397-a2d6-f885532dbac8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:10.681961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-405d36d5-5e44-4397-a2d6-f885532dbac8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:10.763603 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-405d36d5-5e44-4397-a2d6-f885532dbac8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:10.772421 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-405d36d5-5e44-4397-a2d6-f885532dbac8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1328 microversion: 2.1 time: 0.107257 Oct 05 18:47:10.773083 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3553/7346] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:10 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:11.797468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c3e058f4-cedc-49bd-a6a3-37c27aa6acb4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:11.798420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c3e058f4-cedc-49bd-a6a3-37c27aa6acb4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:11.800715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=34 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:11.809033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3e058f4-cedc-49bd-a6a3-37c27aa6acb4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:11.809579 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3e058f4-cedc-49bd-a6a3-37c27aa6acb4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:11.810034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3e058f4-cedc-49bd-a6a3-37c27aa6acb4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:11.810802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3e058f4-cedc-49bd-a6a3-37c27aa6acb4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:11.811283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3e058f4-cedc-49bd-a6a3-37c27aa6acb4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:11.811728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c3e058f4-cedc-49bd-a6a3-37c27aa6acb4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:11.954872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c3e058f4-cedc-49bd-a6a3-37c27aa6acb4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:11.964911 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c3e058f4-cedc-49bd-a6a3-37c27aa6acb4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.172435 Oct 05 18:47:11.965815 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3794/7347] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:11 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:12.990804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-61a037f6-fbcf-4b60-bb12-ece58c7a13d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:12.991653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-61a037f6-fbcf-4b60-bb12-ece58c7a13d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:12.999346 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a037f6-fbcf-4b60-bb12-ece58c7a13d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:12.999885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a037f6-fbcf-4b60-bb12-ece58c7a13d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:13.000411 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a037f6-fbcf-4b60-bb12-ece58c7a13d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:13.001181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a037f6-fbcf-4b60-bb12-ece58c7a13d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:13.001671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a037f6-fbcf-4b60-bb12-ece58c7a13d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:13.002106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61a037f6-fbcf-4b60-bb12-ece58c7a13d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:13.151747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-61a037f6-fbcf-4b60-bb12-ece58c7a13d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:13.159856 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-61a037f6-fbcf-4b60-bb12-ece58c7a13d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.174517 Oct 05 18:47:13.160802 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3554/7348] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:12 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:14.184116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9d992bed-e289-46e0-9d66-3e7b7397d298 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:14.184745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9d992bed-e289-46e0-9d66-3e7b7397d298 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:14.196928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d992bed-e289-46e0-9d66-3e7b7397d298 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:14.197445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d992bed-e289-46e0-9d66-3e7b7397d298 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:14.197918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d992bed-e289-46e0-9d66-3e7b7397d298 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:14.198689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d992bed-e289-46e0-9d66-3e7b7397d298 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:14.199166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d992bed-e289-46e0-9d66-3e7b7397d298 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:14.199589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9d992bed-e289-46e0-9d66-3e7b7397d298 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:14.341753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9d992bed-e289-46e0-9d66-3e7b7397d298 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:14.349934 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9d992bed-e289-46e0-9d66-3e7b7397d298 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.170210 Oct 05 18:47:14.350780 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3795/7349] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:14 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:15.373847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7a4899d2-abba-477a-a7b5-e494d3b4213f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:15.374528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7a4899d2-abba-477a-a7b5-e494d3b4213f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:15.381836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4899d2-abba-477a-a7b5-e494d3b4213f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:15.382327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4899d2-abba-477a-a7b5-e494d3b4213f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:15.382827 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4899d2-abba-477a-a7b5-e494d3b4213f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:15.383518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4899d2-abba-477a-a7b5-e494d3b4213f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:15.383966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4899d2-abba-477a-a7b5-e494d3b4213f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:15.384410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7a4899d2-abba-477a-a7b5-e494d3b4213f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:15.528656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7a4899d2-abba-477a-a7b5-e494d3b4213f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:15.537215 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7a4899d2-abba-477a-a7b5-e494d3b4213f tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.167728 Oct 05 18:47:15.537814 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3555/7350] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:15 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:16.564848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7fbdc442-6d4f-4bbd-b5cc-c9a152509d7c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:16.565586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7fbdc442-6d4f-4bbd-b5cc-c9a152509d7c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:16.568557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:16.573672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbdc442-6d4f-4bbd-b5cc-c9a152509d7c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:16.574178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbdc442-6d4f-4bbd-b5cc-c9a152509d7c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:16.574658 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbdc442-6d4f-4bbd-b5cc-c9a152509d7c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:16.575377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbdc442-6d4f-4bbd-b5cc-c9a152509d7c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:16.575921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbdc442-6d4f-4bbd-b5cc-c9a152509d7c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:16.576363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7fbdc442-6d4f-4bbd-b5cc-c9a152509d7c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:16.732937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7fbdc442-6d4f-4bbd-b5cc-c9a152509d7c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:16.741286 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7fbdc442-6d4f-4bbd-b5cc-c9a152509d7c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.181397 Oct 05 18:47:16.741892 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3796/7351] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:16 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:17.764905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-edbdf987-3afd-4d8c-89e5-060fece28314 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:17.766126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-edbdf987-3afd-4d8c-89e5-060fece28314 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:17.773049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:17.774572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbdf987-3afd-4d8c-89e5-060fece28314 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:17.775281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbdf987-3afd-4d8c-89e5-060fece28314 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:17.775771 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbdf987-3afd-4d8c-89e5-060fece28314 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:17.776862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbdf987-3afd-4d8c-89e5-060fece28314 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:17.777331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbdf987-3afd-4d8c-89e5-060fece28314 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:17.777790 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edbdf987-3afd-4d8c-89e5-060fece28314 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:17.917394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-edbdf987-3afd-4d8c-89e5-060fece28314 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:17.925799 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-edbdf987-3afd-4d8c-89e5-060fece28314 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.165140 Oct 05 18:47:17.926757 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3556/7352] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:17 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:18.949374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-08da336e-a373-4c8a-8b62-fdeeddf7b2cc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:18.949952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-08da336e-a373-4c8a-8b62-fdeeddf7b2cc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:18.957326 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08da336e-a373-4c8a-8b62-fdeeddf7b2cc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:18.957834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08da336e-a373-4c8a-8b62-fdeeddf7b2cc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:18.958453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08da336e-a373-4c8a-8b62-fdeeddf7b2cc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:18.959110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08da336e-a373-4c8a-8b62-fdeeddf7b2cc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:18.959590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08da336e-a373-4c8a-8b62-fdeeddf7b2cc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:18.960095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-08da336e-a373-4c8a-8b62-fdeeddf7b2cc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:19.096679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-08da336e-a373-4c8a-8b62-fdeeddf7b2cc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:19.104793 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-08da336e-a373-4c8a-8b62-fdeeddf7b2cc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.159734 Oct 05 18:47:19.105393 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3797/7353] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:18 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:19.904605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-27d3b3e4-83c8-4ce1-ac7b-ce2d4931c983 req-8a34260a-878f-4bda-803b-1e861623ae0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07198aa8-59d6-4674-b03c-e6fff571f3c0", "tag": "3f1090af-299f-4a36-94e3-caf7c1df06b8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:47:19.913521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:19.914269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:19.919201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-27d3b3e4-83c8-4ce1-ac7b-ce2d4931c983 req-8a34260a-878f-4bda-803b-1e861623ae0a service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:19.919713 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-27d3b3e4-83c8-4ce1-ac7b-ce2d4931c983 req-8a34260a-878f-4bda-803b-1e861623ae0a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:19.920141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-27d3b3e4-83c8-4ce1-ac7b-ce2d4931c983 req-8a34260a-878f-4bda-803b-1e861623ae0a service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:19.935757 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-27d3b3e4-83c8-4ce1-ac7b-ce2d4931c983 req-8a34260a-878f-4bda-803b-1e861623ae0a service nova] Creating event network-changed:3f1090af-299f-4a36-94e3-caf7c1df06b8 for instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 on n-h1-835595-3 Oct 05 18:47:19.940707 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-27d3b3e4-83c8-4ce1-ac7b-ce2d4931c983 req-8a34260a-878f-4bda-803b-1e861623ae0a service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040799 Oct 05 18:47:19.943174 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3557/7354] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:47:20.129013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-af001c29-e3af-46d5-84b4-e52164abd647 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:20.129628 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-af001c29-e3af-46d5-84b4-e52164abd647 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:20.131602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:20.138337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af001c29-e3af-46d5-84b4-e52164abd647 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:20.139183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af001c29-e3af-46d5-84b4-e52164abd647 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:20.139638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af001c29-e3af-46d5-84b4-e52164abd647 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:20.140341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af001c29-e3af-46d5-84b4-e52164abd647 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:20.140821 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af001c29-e3af-46d5-84b4-e52164abd647 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:20.141257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af001c29-e3af-46d5-84b4-e52164abd647 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:20.278253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-af001c29-e3af-46d5-84b4-e52164abd647 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:20.286583 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-af001c29-e3af-46d5-84b4-e52164abd647 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.161523 Oct 05 18:47:20.287884 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3798/7355] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:20 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:21.312263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bc24a504-8c7a-4bea-8a2a-6ec57fc5b528 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:21.313099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bc24a504-8c7a-4bea-8a2a-6ec57fc5b528 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:21.319526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc24a504-8c7a-4bea-8a2a-6ec57fc5b528 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:21.320057 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc24a504-8c7a-4bea-8a2a-6ec57fc5b528 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:21.320468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc24a504-8c7a-4bea-8a2a-6ec57fc5b528 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:21.321165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc24a504-8c7a-4bea-8a2a-6ec57fc5b528 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:21.321615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc24a504-8c7a-4bea-8a2a-6ec57fc5b528 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:21.322036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bc24a504-8c7a-4bea-8a2a-6ec57fc5b528 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:21.559568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bc24a504-8c7a-4bea-8a2a-6ec57fc5b528 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:21.570729 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bc24a504-8c7a-4bea-8a2a-6ec57fc5b528 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.263558 Oct 05 18:47:21.571540 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3558/7356] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:21 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:22.600401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-93b46e07-3bea-41f0-a0ac-c278338413e5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:22.601426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-93b46e07-3bea-41f0-a0ac-c278338413e5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:22.610902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93b46e07-3bea-41f0-a0ac-c278338413e5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:22.611409 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93b46e07-3bea-41f0-a0ac-c278338413e5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:22.611870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93b46e07-3bea-41f0-a0ac-c278338413e5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:22.612588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93b46e07-3bea-41f0-a0ac-c278338413e5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:22.613066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93b46e07-3bea-41f0-a0ac-c278338413e5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:22.613514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-93b46e07-3bea-41f0-a0ac-c278338413e5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:22.756877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-93b46e07-3bea-41f0-a0ac-c278338413e5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:22.765429 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-93b46e07-3bea-41f0-a0ac-c278338413e5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.171674 Oct 05 18:47:22.766012 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3799/7357] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:22 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:23.788521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-de932477-ef2a-4751-8ad3-c07096327750 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:23.789147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-de932477-ef2a-4751-8ad3-c07096327750 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:23.796172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de932477-ef2a-4751-8ad3-c07096327750 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:23.796664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de932477-ef2a-4751-8ad3-c07096327750 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:23.797101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de932477-ef2a-4751-8ad3-c07096327750 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:23.797788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de932477-ef2a-4751-8ad3-c07096327750 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:23.798252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de932477-ef2a-4751-8ad3-c07096327750 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:23.798705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-de932477-ef2a-4751-8ad3-c07096327750 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:23.938171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-de932477-ef2a-4751-8ad3-c07096327750 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:23.945965 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-de932477-ef2a-4751-8ad3-c07096327750 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.161486 Oct 05 18:47:23.946570 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3559/7358] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:23 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:24.969554 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e517dc08-6014-46a7-a85c-6360ef7d6c52 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:24.970323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e517dc08-6014-46a7-a85c-6360ef7d6c52 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:24.977714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e517dc08-6014-46a7-a85c-6360ef7d6c52 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:24.978217 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e517dc08-6014-46a7-a85c-6360ef7d6c52 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:24.978730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e517dc08-6014-46a7-a85c-6360ef7d6c52 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:24.979413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e517dc08-6014-46a7-a85c-6360ef7d6c52 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:24.979892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e517dc08-6014-46a7-a85c-6360ef7d6c52 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:24.980374 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e517dc08-6014-46a7-a85c-6360ef7d6c52 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:25.123452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e517dc08-6014-46a7-a85c-6360ef7d6c52 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:25.131660 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e517dc08-6014-46a7-a85c-6360ef7d6c52 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.166184 Oct 05 18:47:25.132251 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3800/7359] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:24 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:25.992900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-975cfa83-f98d-4cc1-898c-2a1ec326e567 req-f8bdb2ee-29cc-4686-869f-6269d4c2eff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07198aa8-59d6-4674-b03c-e6fff571f3c0", "name": "network-vif-plugged", "status": "completed", "tag": "3f1090af-299f-4a36-94e3-caf7c1df06b8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:47:26.002753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-975cfa83-f98d-4cc1-898c-2a1ec326e567 req-f8bdb2ee-29cc-4686-869f-6269d4c2eff6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:26.003235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-975cfa83-f98d-4cc1-898c-2a1ec326e567 req-f8bdb2ee-29cc-4686-869f-6269d4c2eff6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:26.003662 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-975cfa83-f98d-4cc1-898c-2a1ec326e567 req-f8bdb2ee-29cc-4686-869f-6269d4c2eff6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:26.015762 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-975cfa83-f98d-4cc1-898c-2a1ec326e567 req-f8bdb2ee-29cc-4686-869f-6269d4c2eff6 service nova] Creating event network-vif-plugged:3f1090af-299f-4a36-94e3-caf7c1df06b8 for instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 on n-h1-835595-3 Oct 05 18:47:26.021002 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-975cfa83-f98d-4cc1-898c-2a1ec326e567 req-f8bdb2ee-29cc-4686-869f-6269d4c2eff6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123610 Oct 05 18:47:26.021608 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3560/7360] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:47:26.157656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e4021d49-2ab2-4586-8b5b-43c4ba3da997 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:26.158261 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e4021d49-2ab2-4586-8b5b-43c4ba3da997 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:26.165756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4021d49-2ab2-4586-8b5b-43c4ba3da997 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:26.166188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4021d49-2ab2-4586-8b5b-43c4ba3da997 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:26.166716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4021d49-2ab2-4586-8b5b-43c4ba3da997 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:26.167442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4021d49-2ab2-4586-8b5b-43c4ba3da997 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:26.167918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4021d49-2ab2-4586-8b5b-43c4ba3da997 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:26.168366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4021d49-2ab2-4586-8b5b-43c4ba3da997 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:26.303065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e4021d49-2ab2-4586-8b5b-43c4ba3da997 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:26.314799 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e4021d49-2ab2-4586-8b5b-43c4ba3da997 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1358 microversion: 2.1 time: 0.161229 Oct 05 18:47:26.315601 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3801/7361] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:26 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:27.346076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3adc2747-9cd1-420c-b3b3-cee34c9e9ddd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:27.346880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3adc2747-9cd1-420c-b3b3-cee34c9e9ddd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:27.354708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3adc2747-9cd1-420c-b3b3-cee34c9e9ddd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:27.355271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3adc2747-9cd1-420c-b3b3-cee34c9e9ddd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:27.355777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3adc2747-9cd1-420c-b3b3-cee34c9e9ddd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:27.356580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3adc2747-9cd1-420c-b3b3-cee34c9e9ddd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:27.357105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3adc2747-9cd1-420c-b3b3-cee34c9e9ddd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:27.357600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3adc2747-9cd1-420c-b3b3-cee34c9e9ddd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:27.498858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3adc2747-9cd1-420c-b3b3-cee34c9e9ddd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:27.506879 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3adc2747-9cd1-420c-b3b3-cee34c9e9ddd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1547 microversion: 2.1 time: 0.167865 Oct 05 18:47:27.507473 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3561/7362] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:27 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:27.529700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a607c087-3598-40d5-85c7-a943029ab796 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:27.530347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a607c087-3598-40d5-85c7-a943029ab796 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:27.537396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a607c087-3598-40d5-85c7-a943029ab796 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:27.537895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a607c087-3598-40d5-85c7-a943029ab796 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:27.538363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a607c087-3598-40d5-85c7-a943029ab796 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:27.539069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a607c087-3598-40d5-85c7-a943029ab796 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:27.539533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a607c087-3598-40d5-85c7-a943029ab796 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:27.539968 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a607c087-3598-40d5-85c7-a943029ab796 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:27.695519 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a607c087-3598-40d5-85c7-a943029ab796 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:27.703669 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a607c087-3598-40d5-85c7-a943029ab796 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1547 microversion: 2.1 time: 0.178007 Oct 05 18:47:27.704269 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3802/7363] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:27 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1547 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:27.725643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:27.730390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:27.731164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Searching by: {'deleted': False, 'project_id': 'c2dbde858f4648319751e3c651946041'} {{(pid=128843) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 05 18:47:27.737027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:27.737538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:27.737969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:27.738720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:27.739171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:27.739588 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:27.765114 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.multi_cell_list [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 05 18:47:27.794147 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-10888996-095d-480d-a03e-4b9697432a5c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.072468 Oct 05 18:47:27.794832 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3562/7364] 10.222.0.70 () {58 vars in 1125 bytes} [Wed Oct 5 18:47:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:47:27.806976 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a144c92d-636c-4f92-9ad0-8b0bdf2b3493 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:27.807609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a144c92d-636c-4f92-9ad0-8b0bdf2b3493 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:27.813754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a144c92d-636c-4f92-9ad0-8b0bdf2b3493 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:27.814248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a144c92d-636c-4f92-9ad0-8b0bdf2b3493 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:27.814731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a144c92d-636c-4f92-9ad0-8b0bdf2b3493 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:27.815437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a144c92d-636c-4f92-9ad0-8b0bdf2b3493 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:27.815903 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a144c92d-636c-4f92-9ad0-8b0bdf2b3493 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:27.816340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a144c92d-636c-4f92-9ad0-8b0bdf2b3493 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:27.953736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a144c92d-636c-4f92-9ad0-8b0bdf2b3493 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:27.964854 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a144c92d-636c-4f92-9ad0-8b0bdf2b3493 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1547 microversion: 2.1 time: 0.161812 Oct 05 18:47:27.965683 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3803/7365] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:27 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:29.513211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-67245d27-b41e-4280-9344-fbf82b1ddefb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "154baa20-9cdf-4922-89a1-59b5deef3446"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:47:29.515666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-67245d27-b41e-4280-9344-fbf82b1ddefb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:29.522828 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67245d27-b41e-4280-9344-fbf82b1ddefb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:29.523318 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67245d27-b41e-4280-9344-fbf82b1ddefb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:29.523759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67245d27-b41e-4280-9344-fbf82b1ddefb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:29.524476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67245d27-b41e-4280-9344-fbf82b1ddefb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:29.524929 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67245d27-b41e-4280-9344-fbf82b1ddefb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:29.525354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-67245d27-b41e-4280-9344-fbf82b1ddefb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:29.806593 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-67245d27-b41e-4280-9344-fbf82b1ddefb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297349 Oct 05 18:47:29.807485 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3563/7366] 10.222.0.70 () {60 vars in 1323 bytes} [Wed Oct 5 18:47:29 2022] POST /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:47:40.651674 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7d0805e2-62d5-4a1d-96c7-29b731153873 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:40.652313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7d0805e2-62d5-4a1d-96c7-29b731153873 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:40.655399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=15 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:40.656232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=60 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:40.662012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d0805e2-62d5-4a1d-96c7-29b731153873 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:40.662558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d0805e2-62d5-4a1d-96c7-29b731153873 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:40.663023 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d0805e2-62d5-4a1d-96c7-29b731153873 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:40.663737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d0805e2-62d5-4a1d-96c7-29b731153873 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:40.664213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d0805e2-62d5-4a1d-96c7-29b731153873 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:40.664652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7d0805e2-62d5-4a1d-96c7-29b731153873 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:40.800738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-7d0805e2-62d5-4a1d-96c7-29b731153873 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:40.809356 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7d0805e2-62d5-4a1d-96c7-29b731153873 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1593 microversion: 2.1 time: 0.161593 Oct 05 18:47:40.809945 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3804/7367] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:40 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:42.802325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:42.803284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=15 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:42.803922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:42.808555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f55cc78a-cff9-4a68-80b2-18cf4328ffac req-cfdffaae-1039-4bc7-96b0-41cdf1f588dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07198aa8-59d6-4674-b03c-e6fff571f3c0", "tag": "3f1090af-299f-4a36-94e3-caf7c1df06b8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:47:42.821301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f55cc78a-cff9-4a68-80b2-18cf4328ffac req-cfdffaae-1039-4bc7-96b0-41cdf1f588dc service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:42.821862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f55cc78a-cff9-4a68-80b2-18cf4328ffac req-cfdffaae-1039-4bc7-96b0-41cdf1f588dc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:42.822458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f55cc78a-cff9-4a68-80b2-18cf4328ffac req-cfdffaae-1039-4bc7-96b0-41cdf1f588dc service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:42.836442 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f55cc78a-cff9-4a68-80b2-18cf4328ffac req-cfdffaae-1039-4bc7-96b0-41cdf1f588dc service nova] Creating event network-changed:3f1090af-299f-4a36-94e3-caf7c1df06b8 for instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 on n-h1-835595-3 Oct 05 18:47:42.842177 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f55cc78a-cff9-4a68-80b2-18cf4328ffac req-cfdffaae-1039-4bc7-96b0-41cdf1f588dc service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041943 Oct 05 18:47:42.843503 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3564/7368] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:47:43.803139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b58eeac4-4f1a-4488-998e-699fc1af8345 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-974594428"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:47:43.803740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b58eeac4-4f1a-4488-998e-699fc1af8345 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:43.811293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58eeac4-4f1a-4488-998e-699fc1af8345 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:43.811815 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58eeac4-4f1a-4488-998e-699fc1af8345 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:43.812268 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58eeac4-4f1a-4488-998e-699fc1af8345 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:43.813003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58eeac4-4f1a-4488-998e-699fc1af8345 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:43.813479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58eeac4-4f1a-4488-998e-699fc1af8345 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:43.813923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b58eeac4-4f1a-4488-998e-699fc1af8345 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:43.947910 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.network.security_group_api [None req-b58eeac4-4f1a-4488-998e-699fc1af8345 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Adding security group e3d8f85d-4ee3-49f2-aa84-d4d18627d9ae to port 3f1090af-299f-4a36-94e3-caf7c1df06b8 Oct 05 18:47:44.617513 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b58eeac4-4f1a-4488-998e-699fc1af8345 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/action" status: 202 len: 0 microversion: 2.1 time: 0.818307 Oct 05 18:47:44.618724 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3805/7369] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:47:43 2022] POST /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:47:44.627838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f150fc00-217c-4e58-ac18-aaf4111dc4e4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:44.628842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f150fc00-217c-4e58-ac18-aaf4111dc4e4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:44.629508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-637da369-76d5-4ef5-8de8-a7b06bc0d461 req-a0a55806-ea83-4667-b98c-fb41adb1c1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07198aa8-59d6-4674-b03c-e6fff571f3c0", "tag": "3f1090af-299f-4a36-94e3-caf7c1df06b8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:47:44.639764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f150fc00-217c-4e58-ac18-aaf4111dc4e4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:44.640797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f150fc00-217c-4e58-ac18-aaf4111dc4e4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:44.641446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f150fc00-217c-4e58-ac18-aaf4111dc4e4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:44.642384 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f150fc00-217c-4e58-ac18-aaf4111dc4e4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:44.643037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f150fc00-217c-4e58-ac18-aaf4111dc4e4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:44.643678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f150fc00-217c-4e58-ac18-aaf4111dc4e4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:44.646932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-637da369-76d5-4ef5-8de8-a7b06bc0d461 req-a0a55806-ea83-4667-b98c-fb41adb1c1d7 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:44.647530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-637da369-76d5-4ef5-8de8-a7b06bc0d461 req-a0a55806-ea83-4667-b98c-fb41adb1c1d7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:44.648243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-637da369-76d5-4ef5-8de8-a7b06bc0d461 req-a0a55806-ea83-4667-b98c-fb41adb1c1d7 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:44.667975 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-637da369-76d5-4ef5-8de8-a7b06bc0d461 req-a0a55806-ea83-4667-b98c-fb41adb1c1d7 service nova] Creating event network-changed:3f1090af-299f-4a36-94e3-caf7c1df06b8 for instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 on n-h1-835595-3 Oct 05 18:47:44.673953 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-637da369-76d5-4ef5-8de8-a7b06bc0d461 req-a0a55806-ea83-4667-b98c-fb41adb1c1d7 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049691 Oct 05 18:47:44.674942 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3806/7370] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:47:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:47:44.904097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f150fc00-217c-4e58-ac18-aaf4111dc4e4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:47:44.916323 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f150fc00-217c-4e58-ac18-aaf4111dc4e4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1758 microversion: 2.1 time: 0.293040 Oct 05 18:47:44.916897 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3565/7371] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:44 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1758 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:47:59.864323 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:59.865586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=12 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:59.872007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f5469092-ad66-4326-ac01-d750b22652fc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:47:59.874342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f5469092-ad66-4326-ac01-d750b22652fc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:59.881876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5469092-ad66-4326-ac01-d750b22652fc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:59.882424 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5469092-ad66-4326-ac01-d750b22652fc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:59.882877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5469092-ad66-4326-ac01-d750b22652fc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:59.883590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5469092-ad66-4326-ac01-d750b22652fc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:59.884067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5469092-ad66-4326-ac01-d750b22652fc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:59.884854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f5469092-ad66-4326-ac01-d750b22652fc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:59.967464 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f5469092-ad66-4326-ac01-d750b22652fc tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/action" status: 202 len: 0 microversion: 2.1 time: 0.106659 Oct 05 18:47:59.969883 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3807/7372] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:47:59 2022] POST /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:47:59.976353 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ac222d4a-d489-4813-81c3-ece478bbd3d1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:47:59.976974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ac222d4a-d489-4813-81c3-ece478bbd3d1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:47:59.980095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:59.980873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=8 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:47:59.986548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac222d4a-d489-4813-81c3-ece478bbd3d1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:59.987043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac222d4a-d489-4813-81c3-ece478bbd3d1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:59.987483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac222d4a-d489-4813-81c3-ece478bbd3d1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:47:59.988185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac222d4a-d489-4813-81c3-ece478bbd3d1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:47:59.988646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac222d4a-d489-4813-81c3-ece478bbd3d1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:47:59.989068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ac222d4a-d489-4813-81c3-ece478bbd3d1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:00.234485 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ac222d4a-d489-4813-81c3-ece478bbd3d1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:00.243182 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ac222d4a-d489-4813-81c3-ece478bbd3d1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1750 microversion: 2.1 time: 0.270753 Oct 05 18:48:00.243757 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3566/7373] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:47:59 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1750 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:01.268732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2ab054ac-7905-4dc2-9b3d-4996b98d0adb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:01.269588 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2ab054ac-7905-4dc2-9b3d-4996b98d0adb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:01.276258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ab054ac-7905-4dc2-9b3d-4996b98d0adb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:01.276728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ab054ac-7905-4dc2-9b3d-4996b98d0adb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:01.277211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ab054ac-7905-4dc2-9b3d-4996b98d0adb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:01.277926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ab054ac-7905-4dc2-9b3d-4996b98d0adb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:01.278428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ab054ac-7905-4dc2-9b3d-4996b98d0adb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:01.278873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2ab054ac-7905-4dc2-9b3d-4996b98d0adb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:01.425308 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2ab054ac-7905-4dc2-9b3d-4996b98d0adb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:01.436602 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2ab054ac-7905-4dc2-9b3d-4996b98d0adb tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1755 microversion: 2.1 time: 0.173136 Oct 05 18:48:01.437203 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3808/7374] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:01 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:02.465468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0ef4e1bb-a0ab-4c23-856a-345f55fe13e1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:02.466128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0ef4e1bb-a0ab-4c23-856a-345f55fe13e1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:02.473642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ef4e1bb-a0ab-4c23-856a-345f55fe13e1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:02.474185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ef4e1bb-a0ab-4c23-856a-345f55fe13e1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:02.474701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ef4e1bb-a0ab-4c23-856a-345f55fe13e1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:02.475468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ef4e1bb-a0ab-4c23-856a-345f55fe13e1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:02.475975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ef4e1bb-a0ab-4c23-856a-345f55fe13e1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:02.476482 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0ef4e1bb-a0ab-4c23-856a-345f55fe13e1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:02.623060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0ef4e1bb-a0ab-4c23-856a-345f55fe13e1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:02.636350 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0ef4e1bb-a0ab-4c23-856a-345f55fe13e1 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1755 microversion: 2.1 time: 0.176933 Oct 05 18:48:02.636944 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3567/7375] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:02 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:03.663826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9e83a787-bafc-4ed3-9d5a-7dfbf1d64690 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:03.664905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9e83a787-bafc-4ed3-9d5a-7dfbf1d64690 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:03.676873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e83a787-bafc-4ed3-9d5a-7dfbf1d64690 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:03.677709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e83a787-bafc-4ed3-9d5a-7dfbf1d64690 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:03.678507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e83a787-bafc-4ed3-9d5a-7dfbf1d64690 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:03.679683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e83a787-bafc-4ed3-9d5a-7dfbf1d64690 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:03.680474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e83a787-bafc-4ed3-9d5a-7dfbf1d64690 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:03.681212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9e83a787-bafc-4ed3-9d5a-7dfbf1d64690 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:03.828715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9e83a787-bafc-4ed3-9d5a-7dfbf1d64690 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:03.841018 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9e83a787-bafc-4ed3-9d5a-7dfbf1d64690 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1755 microversion: 2.1 time: 0.183862 Oct 05 18:48:03.841617 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3809/7376] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:03 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:04.952277 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-199b50c5-e1f9-42f1-9860-804fa010947b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:04.953022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-199b50c5-e1f9-42f1-9860-804fa010947b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:04.960436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-199b50c5-e1f9-42f1-9860-804fa010947b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:04.961099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-199b50c5-e1f9-42f1-9860-804fa010947b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:04.961644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-199b50c5-e1f9-42f1-9860-804fa010947b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:04.962546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-199b50c5-e1f9-42f1-9860-804fa010947b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:04.963045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-199b50c5-e1f9-42f1-9860-804fa010947b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:04.963465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-199b50c5-e1f9-42f1-9860-804fa010947b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:05.124625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-199b50c5-e1f9-42f1-9860-804fa010947b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:05.137525 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-199b50c5-e1f9-42f1-9860-804fa010947b tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1755 microversion: 2.1 time: 0.267987 Oct 05 18:48:05.138252 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3568/7377] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:04 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1755 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:06.165038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-15bb1802-8d7b-4d22-a7ee-21b14bff48cd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:06.165637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15bb1802-8d7b-4d22-a7ee-21b14bff48cd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:06.176623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15bb1802-8d7b-4d22-a7ee-21b14bff48cd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:06.177279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15bb1802-8d7b-4d22-a7ee-21b14bff48cd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:06.177875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15bb1802-8d7b-4d22-a7ee-21b14bff48cd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:06.178861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15bb1802-8d7b-4d22-a7ee-21b14bff48cd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:06.179333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15bb1802-8d7b-4d22-a7ee-21b14bff48cd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:06.179886 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15bb1802-8d7b-4d22-a7ee-21b14bff48cd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:06.338085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-15bb1802-8d7b-4d22-a7ee-21b14bff48cd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:06.346914 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-15bb1802-8d7b-4d22-a7ee-21b14bff48cd tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1755 microversion: 2.1 time: 0.188226 Oct 05 18:48:06.347499 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3810/7378] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:06 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1755 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:07.375740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7039197d-68fb-44e8-99ca-4cd63885ffb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:07.376699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7039197d-68fb-44e8-99ca-4cd63885ffb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:07.388518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7039197d-68fb-44e8-99ca-4cd63885ffb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:07.389010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7039197d-68fb-44e8-99ca-4cd63885ffb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:07.390695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7039197d-68fb-44e8-99ca-4cd63885ffb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:07.390695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7039197d-68fb-44e8-99ca-4cd63885ffb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:07.391230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7039197d-68fb-44e8-99ca-4cd63885ffb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:07.392097 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7039197d-68fb-44e8-99ca-4cd63885ffb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:07.550298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7039197d-68fb-44e8-99ca-4cd63885ffb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:07.561400 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7039197d-68fb-44e8-99ca-4cd63885ffb8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1755 microversion: 2.1 time: 0.190198 Oct 05 18:48:07.562211 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3569/7379] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:07 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:08.589173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6a98869d-4f89-447b-a3b7-ec63dc525ff8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:08.590180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6a98869d-4f89-447b-a3b7-ec63dc525ff8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:08.602055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98869d-4f89-447b-a3b7-ec63dc525ff8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:08.602962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98869d-4f89-447b-a3b7-ec63dc525ff8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:08.603759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98869d-4f89-447b-a3b7-ec63dc525ff8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:08.604930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98869d-4f89-447b-a3b7-ec63dc525ff8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:08.605593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98869d-4f89-447b-a3b7-ec63dc525ff8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:08.606033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6a98869d-4f89-447b-a3b7-ec63dc525ff8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:08.766661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6a98869d-4f89-447b-a3b7-ec63dc525ff8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:08.775459 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6a98869d-4f89-447b-a3b7-ec63dc525ff8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1755 microversion: 2.1 time: 0.192958 Oct 05 18:48:08.776057 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3811/7380] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:08 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1755 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:09.804910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-64847fb7-84c1-4dbb-a24e-ef35b8ee13b6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:09.805532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-64847fb7-84c1-4dbb-a24e-ef35b8ee13b6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:09.813490 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64847fb7-84c1-4dbb-a24e-ef35b8ee13b6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:09.813976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64847fb7-84c1-4dbb-a24e-ef35b8ee13b6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:09.814454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64847fb7-84c1-4dbb-a24e-ef35b8ee13b6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:09.815149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64847fb7-84c1-4dbb-a24e-ef35b8ee13b6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:09.815604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64847fb7-84c1-4dbb-a24e-ef35b8ee13b6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:09.816055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-64847fb7-84c1-4dbb-a24e-ef35b8ee13b6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:09.969639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-64847fb7-84c1-4dbb-a24e-ef35b8ee13b6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:09.978719 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-64847fb7-84c1-4dbb-a24e-ef35b8ee13b6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1755 microversion: 2.1 time: 0.177799 Oct 05 18:48:09.979303 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3570/7381] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:09 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:11.006531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-77728f91-a2ea-43ad-9b19-dea174eefb45 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:11.007635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-77728f91-a2ea-43ad-9b19-dea174eefb45 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:11.020028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77728f91-a2ea-43ad-9b19-dea174eefb45 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:11.020866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77728f91-a2ea-43ad-9b19-dea174eefb45 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:11.021611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77728f91-a2ea-43ad-9b19-dea174eefb45 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:11.023263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77728f91-a2ea-43ad-9b19-dea174eefb45 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:11.024686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77728f91-a2ea-43ad-9b19-dea174eefb45 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:11.025990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77728f91-a2ea-43ad-9b19-dea174eefb45 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:11.190232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-77728f91-a2ea-43ad-9b19-dea174eefb45 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:11.199298 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-77728f91-a2ea-43ad-9b19-dea174eefb45 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1755 microversion: 2.1 time: 0.199402 Oct 05 18:48:11.199872 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3812/7382] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:10 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:12.223957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f826c971-e44e-4313-a7b6-a27439717ae4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:12.224650 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f826c971-e44e-4313-a7b6-a27439717ae4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:12.232909 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f826c971-e44e-4313-a7b6-a27439717ae4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:12.233454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f826c971-e44e-4313-a7b6-a27439717ae4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:12.233941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f826c971-e44e-4313-a7b6-a27439717ae4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:12.234763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f826c971-e44e-4313-a7b6-a27439717ae4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:12.235273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f826c971-e44e-4313-a7b6-a27439717ae4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:12.235726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f826c971-e44e-4313-a7b6-a27439717ae4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:12.385813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f826c971-e44e-4313-a7b6-a27439717ae4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:12.395236 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f826c971-e44e-4313-a7b6-a27439717ae4 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1758 microversion: 2.1 time: 0.175722 Oct 05 18:48:12.395823 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3571/7383] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:12 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:44.638437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c61d0e73-c137-4708-acba-ea52a71dabc6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-974594428"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:48:44.639458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c61d0e73-c137-4708-acba-ea52a71dabc6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:44.642713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=12 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:48:44.643419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:48:44.648900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c61d0e73-c137-4708-acba-ea52a71dabc6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:44.649403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c61d0e73-c137-4708-acba-ea52a71dabc6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:44.649855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c61d0e73-c137-4708-acba-ea52a71dabc6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:44.650597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c61d0e73-c137-4708-acba-ea52a71dabc6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:44.651070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c61d0e73-c137-4708-acba-ea52a71dabc6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:44.651511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c61d0e73-c137-4708-acba-ea52a71dabc6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:44.792947 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.network.security_group_api [None req-c61d0e73-c137-4708-acba-ea52a71dabc6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Removing security group e3d8f85d-4ee3-49f2-aa84-d4d18627d9ae from port 3f1090af-299f-4a36-94e3-caf7c1df06b8 Oct 05 18:48:45.110780 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c61d0e73-c137-4708-acba-ea52a71dabc6 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "POST /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/action" status: 202 len: 0 microversion: 2.1 time: 0.480282 Oct 05 18:48:45.115002 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3813/7384] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:48:44 2022] POST /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:48:45.121529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=12 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:48:45.123957 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=36 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:48:45.183249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-57deb220-e085-4929-8b64-2d75165bd11b req-74b9ff4d-71de-4a1d-8355-68aad867bc1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07198aa8-59d6-4674-b03c-e6fff571f3c0", "tag": "3f1090af-299f-4a36-94e3-caf7c1df06b8"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:48:45.193504 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-57deb220-e085-4929-8b64-2d75165bd11b req-74b9ff4d-71de-4a1d-8355-68aad867bc1d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:45.193988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-57deb220-e085-4929-8b64-2d75165bd11b req-74b9ff4d-71de-4a1d-8355-68aad867bc1d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:45.194604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-57deb220-e085-4929-8b64-2d75165bd11b req-74b9ff4d-71de-4a1d-8355-68aad867bc1d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:45.206426 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-57deb220-e085-4929-8b64-2d75165bd11b req-74b9ff4d-71de-4a1d-8355-68aad867bc1d service nova] Creating event network-changed:3f1090af-299f-4a36-94e3-caf7c1df06b8 for instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 on n-h1-835595-3 Oct 05 18:48:45.211969 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-57deb220-e085-4929-8b64-2d75165bd11b req-74b9ff4d-71de-4a1d-8355-68aad867bc1d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095918 Oct 05 18:48:45.212995 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3572/7385] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:48:46.189601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ffc70d64-199f-4da0-91a1-2f1812a485c5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:46.190123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ffc70d64-199f-4da0-91a1-2f1812a485c5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:46.196756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffc70d64-199f-4da0-91a1-2f1812a485c5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:46.197269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffc70d64-199f-4da0-91a1-2f1812a485c5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:46.197728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffc70d64-199f-4da0-91a1-2f1812a485c5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:46.198509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffc70d64-199f-4da0-91a1-2f1812a485c5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:46.198988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffc70d64-199f-4da0-91a1-2f1812a485c5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:46.199432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ffc70d64-199f-4da0-91a1-2f1812a485c5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:46.282035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-ffc70d64-199f-4da0-91a1-2f1812a485c5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lazy-loading 'services' on Instance uuid 07198aa8-59d6-4674-b03c-e6fff571f3c0 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:48:46.357308 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ffc70d64-199f-4da0-91a1-2f1812a485c5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "DELETE /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments/154baa20-9cdf-4922-89a1-59b5deef3446" status: 202 len: 0 microversion: 2.1 time: 0.172646 Oct 05 18:48:46.358291 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3814/7386] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:48:46 2022] DELETE /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments/154baa20-9cdf-4922-89a1-59b5deef3446 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:48:46.368781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-caac4e41-ef35-4e35-9532-6134feaea432 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:46.371969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-caac4e41-ef35-4e35-9532-6134feaea432 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:46.380189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-caac4e41-ef35-4e35-9532-6134feaea432 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:46.381010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-caac4e41-ef35-4e35-9532-6134feaea432 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:46.381631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-caac4e41-ef35-4e35-9532-6134feaea432 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:46.382424 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-caac4e41-ef35-4e35-9532-6134feaea432 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:46.382946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-caac4e41-ef35-4e35-9532-6134feaea432 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:46.383380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-caac4e41-ef35-4e35-9532-6134feaea432 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:46.430952 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-caac4e41-ef35-4e35-9532-6134feaea432 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067801 Oct 05 18:48:46.435985 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3573/7387] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:48:46 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:48:47.238594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9bc5c5d2-40df-4c94-9975-cf36dd73b42f req-331b4ace-1457-47c9-a638-3388914e6b9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07198aa8-59d6-4674-b03c-e6fff571f3c0", "tag": "3f1090af-299f-4a36-94e3-caf7c1df06b8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:48:47.249383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9bc5c5d2-40df-4c94-9975-cf36dd73b42f req-331b4ace-1457-47c9-a638-3388914e6b9b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:47.249952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9bc5c5d2-40df-4c94-9975-cf36dd73b42f req-331b4ace-1457-47c9-a638-3388914e6b9b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:47.250503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9bc5c5d2-40df-4c94-9975-cf36dd73b42f req-331b4ace-1457-47c9-a638-3388914e6b9b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:47.262636 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9bc5c5d2-40df-4c94-9975-cf36dd73b42f req-331b4ace-1457-47c9-a638-3388914e6b9b service nova] Creating event network-changed:3f1090af-299f-4a36-94e3-caf7c1df06b8 for instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 on n-h1-835595-3 Oct 05 18:48:47.267854 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9bc5c5d2-40df-4c94-9975-cf36dd73b42f req-331b4ace-1457-47c9-a638-3388914e6b9b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033782 Oct 05 18:48:47.268430 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3815/7388] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:48:47.445381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6041743f-644c-4230-9825-72d3616d7ac9 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:47.447814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6041743f-644c-4230-9825-72d3616d7ac9 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:47.454109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6041743f-644c-4230-9825-72d3616d7ac9 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:47.454998 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6041743f-644c-4230-9825-72d3616d7ac9 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:47.455663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6041743f-644c-4230-9825-72d3616d7ac9 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:47.456573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6041743f-644c-4230-9825-72d3616d7ac9 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:47.457222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6041743f-644c-4230-9825-72d3616d7ac9 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:47.458545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6041743f-644c-4230-9825-72d3616d7ac9 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:47.491480 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6041743f-644c-4230-9825-72d3616d7ac9 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051848 Oct 05 18:48:47.496932 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3574/7389] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:48:47 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:48:48.507161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6acff5dd-aca8-45ed-83cb-2669d51ff3f8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:48.509523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6acff5dd-aca8-45ed-83cb-2669d51ff3f8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:48.516313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6acff5dd-aca8-45ed-83cb-2669d51ff3f8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:48.516934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6acff5dd-aca8-45ed-83cb-2669d51ff3f8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:48.517388 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6acff5dd-aca8-45ed-83cb-2669d51ff3f8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:48.518103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6acff5dd-aca8-45ed-83cb-2669d51ff3f8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:48.518608 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6acff5dd-aca8-45ed-83cb-2669d51ff3f8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:48.519048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6acff5dd-aca8-45ed-83cb-2669d51ff3f8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:48.553643 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6acff5dd-aca8-45ed-83cb-2669d51ff3f8 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052172 Oct 05 18:48:48.554197 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3816/7390] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:48:48 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:48:49.566880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-77f8f049-1931-405f-9b79-9b778fed54d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:49.569734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-77f8f049-1931-405f-9b79-9b778fed54d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:49.577032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f8f049-1931-405f-9b79-9b778fed54d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:49.577516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f8f049-1931-405f-9b79-9b778fed54d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:49.577947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f8f049-1931-405f-9b79-9b778fed54d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:49.578676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f8f049-1931-405f-9b79-9b778fed54d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:49.579172 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f8f049-1931-405f-9b79-9b778fed54d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:49.579597 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77f8f049-1931-405f-9b79-9b778fed54d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:49.612489 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-77f8f049-1931-405f-9b79-9b778fed54d5 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049760 Oct 05 18:48:49.613056 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3575/7391] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:48:49 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:48:50.625683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-65ff9774-a2ed-4a4c-9472-73caffcf5e21 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:50.627949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-65ff9774-a2ed-4a4c-9472-73caffcf5e21 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:50.635744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65ff9774-a2ed-4a4c-9472-73caffcf5e21 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:50.636253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65ff9774-a2ed-4a4c-9472-73caffcf5e21 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:50.636710 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65ff9774-a2ed-4a4c-9472-73caffcf5e21 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:50.637416 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65ff9774-a2ed-4a4c-9472-73caffcf5e21 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:50.637913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65ff9774-a2ed-4a4c-9472-73caffcf5e21 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:50.638385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-65ff9774-a2ed-4a4c-9472-73caffcf5e21 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:50.668744 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-65ff9774-a2ed-4a4c-9472-73caffcf5e21 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047114 Oct 05 18:48:50.669328 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3817/7392] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:48:50 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:48:51.685043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-937090be-e420-472d-8e39-61e094e65013 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:51.688624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-937090be-e420-472d-8e39-61e094e65013 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:51.701610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937090be-e420-472d-8e39-61e094e65013 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:51.702488 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937090be-e420-472d-8e39-61e094e65013 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:51.703217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937090be-e420-472d-8e39-61e094e65013 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:51.704273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937090be-e420-472d-8e39-61e094e65013 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:51.704746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937090be-e420-472d-8e39-61e094e65013 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:51.705179 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-937090be-e420-472d-8e39-61e094e65013 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:51.734924 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-937090be-e420-472d-8e39-61e094e65013 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056571 Oct 05 18:48:51.735826 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3576/7393] 10.222.0.70 () {58 vars in 1302 bytes} [Wed Oct 5 18:48:51 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 05 18:48:51.746563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:51.747130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:51.754652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:51.755168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:51.755597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:51.756300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:51.756750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:51.757183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:51.805735 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:48:51.805939 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:48:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments/154baa20-9cdf-4922-89a1-59b5deef3446 (ip 10.222.0.70) !!! Oct 05 18:48:51.840261 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] HTTP exception thrown: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 is not attached to volume 154baa20-9cdf-4922-89a1-59b5deef3446 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Request method failure captured: Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: request: DELETE /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments/154baa20-9cdf-4922-89a1-59b5deef3446 HTTP/1.1 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPdAy_c51akg48RxLGhe-n1h-qgcLOrIopzwL0Awznrzns5kowRKfsjGbe2DQm3QM40wbkVC5BZfBQrqBskvaNaLBNRkjtaBmNZEAEw57S5uD7FzAyfsOSDRpzLvHo7KA4iay7reuIatf3Fiv-muPSRBhfftYS_cT82VfKPVwqBQRHyo Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c2dbde858f4648319751e3c651946041 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c2dbde858f4648319751e3c651946041"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2dbde858f4648319751e3c651946041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c2dbde858f4648319751e3c651946041", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2dbde858f4648319751e3c651946041"}]}] Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c2dbde858f4648319751e3c651946041 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestMinimumBasicScenario-1194592050-project Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9c9a55d86ea74f9a8e7c1bab661928be Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestMinimumBasicScenario-1194592050-project Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 is not attached to volume 154baa20-9cdf-4922-89a1-59b5deef3446 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'server_id': '07198aa8-59d6-4674-b03c-e6fff571f3c0', 'id': '154baa20-9cdf-4922-89a1-59b5deef3446'} Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 154baa20-9cdf-4922-89a1-59b5deef3446. Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 is not attached to volume 154baa20-9cdf-4922-89a1-59b5deef3446 Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:48:51.841943 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:48:51.850539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:48:51.850539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:48:51.850539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 is not attached to volume 154baa20-9cdf-4922-89a1-59b5deef3446 Oct 05 18:48:51.850539 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:48:51.850539 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Returning 404 to user: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 is not attached to volume 154baa20-9cdf-4922-89a1-59b5deef3446 {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:48:51.850539 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a35571ba-09d5-4f2b-a434-08a1d970bb8e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "DELETE /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments/154baa20-9cdf-4922-89a1-59b5deef3446" status: 404 len: 154 microversion: 2.1 time: 0.101070 Oct 05 18:48:51.850539 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3818/7394] 10.222.0.70 () {58 vars in 1416 bytes} [Wed Oct 5 18:48:51 2022] DELETE /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0/os-volume_attachments/154baa20-9cdf-4922-89a1-59b5deef3446 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:48:55.108332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-96d52526-8c6c-4e8b-9f8c-d21a82bb5971 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:55.108932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-96d52526-8c6c-4e8b-9f8c-d21a82bb5971 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:55.116563 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96d52526-8c6c-4e8b-9f8c-d21a82bb5971 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:55.117051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96d52526-8c6c-4e8b-9f8c-d21a82bb5971 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:55.117500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96d52526-8c6c-4e8b-9f8c-d21a82bb5971 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:55.118167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96d52526-8c6c-4e8b-9f8c-d21a82bb5971 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:55.118657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96d52526-8c6c-4e8b-9f8c-d21a82bb5971 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:55.119104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-96d52526-8c6c-4e8b-9f8c-d21a82bb5971 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:55.146089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-96d52526-8c6c-4e8b-9f8c-d21a82bb5971 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:48:55.233432 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-96d52526-8c6c-4e8b-9f8c-d21a82bb5971 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "DELETE /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 204 len: 0 microversion: 2.1 time: 0.128497 Oct 05 18:48:55.234178 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3577/7395] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:48:55 2022] DELETE /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:48:55.243413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e4f41b5-5bf2-4164-9404-bed1ad4ce723 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:55.244213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e4f41b5-5bf2-4164-9404-bed1ad4ce723 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:55.253037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4f41b5-5bf2-4164-9404-bed1ad4ce723 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:55.253769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4f41b5-5bf2-4164-9404-bed1ad4ce723 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:55.254652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4f41b5-5bf2-4164-9404-bed1ad4ce723 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:55.255475 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4f41b5-5bf2-4164-9404-bed1ad4ce723 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:55.256067 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4f41b5-5bf2-4164-9404-bed1ad4ce723 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:55.256575 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8e4f41b5-5bf2-4164-9404-bed1ad4ce723 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:55.391668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e4f41b5-5bf2-4164-9404-bed1ad4ce723 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:55.401191 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e4f41b5-5bf2-4164-9404-bed1ad4ce723 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1553 microversion: 2.1 time: 0.162203 Oct 05 18:48:55.401814 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3819/7396] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:55 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:56.425195 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2c1c3f8f-606a-48d6-bf12-287ccaaa055c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:56.425881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2c1c3f8f-606a-48d6-bf12-287ccaaa055c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:56.432954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c1c3f8f-606a-48d6-bf12-287ccaaa055c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:56.433438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c1c3f8f-606a-48d6-bf12-287ccaaa055c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:56.433875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c1c3f8f-606a-48d6-bf12-287ccaaa055c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:56.434774 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c1c3f8f-606a-48d6-bf12-287ccaaa055c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:56.435224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c1c3f8f-606a-48d6-bf12-287ccaaa055c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:56.435651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2c1c3f8f-606a-48d6-bf12-287ccaaa055c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:56.581038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2c1c3f8f-606a-48d6-bf12-287ccaaa055c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:56.589054 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2c1c3f8f-606a-48d6-bf12-287ccaaa055c tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1553 microversion: 2.1 time: 0.168314 Oct 05 18:48:56.589634 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3578/7397] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:56 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1553 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:57.432898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-dd96705d-7911-45a0-89d6-a6e2ffb4c8d6 req-dbd4f691-2815-4823-8e74-36c270eebf30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07198aa8-59d6-4674-b03c-e6fff571f3c0", "name": "network-vif-deleted", "tag": "3f1090af-299f-4a36-94e3-caf7c1df06b8"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:48:57.443373 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dd96705d-7911-45a0-89d6-a6e2ffb4c8d6 req-dbd4f691-2815-4823-8e74-36c270eebf30 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:57.443875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dd96705d-7911-45a0-89d6-a6e2ffb4c8d6 req-dbd4f691-2815-4823-8e74-36c270eebf30 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:57.444345 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-dd96705d-7911-45a0-89d6-a6e2ffb4c8d6 req-dbd4f691-2815-4823-8e74-36c270eebf30 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:57.458563 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-dd96705d-7911-45a0-89d6-a6e2ffb4c8d6 req-dbd4f691-2815-4823-8e74-36c270eebf30 service nova] Creating event network-vif-deleted:3f1090af-299f-4a36-94e3-caf7c1df06b8 for instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 on n-h1-835595-3 Oct 05 18:48:57.464882 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-dd96705d-7911-45a0-89d6-a6e2ffb4c8d6 req-dbd4f691-2815-4823-8e74-36c270eebf30 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089333 Oct 05 18:48:57.465586 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3820/7398] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:48:57.611555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:57.612170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:57.619133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:57.619545 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:57.619972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:57.620654 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:57.621106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:57.621522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:57.657859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:57.658462 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:57.658889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:57.659360 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lazy-loading 'fault' on Instance uuid 07198aa8-59d6-4674-b03c-e6fff571f3c0 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:48:57.704714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c9a55d86ea74f9a8e7c1bab661928be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2dbde858f4648319751e3c651946041', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:48:57.713083 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b68ec375-e386-403a-b340-c6dbe4bee32e tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 200 len: 1348 microversion: 2.1 time: 0.105627 Oct 05 18:48:57.713677 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3579/7399] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:57 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:48:58.743877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:58.744954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] [instance: 07198aa8-59d6-4674-b03c-e6fff571f3c0] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:48:58.754726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:58.755230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:58.755681 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:58.756397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:48:58.756874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:48:58.757321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:48:58.771299 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] HTTP exception thrown: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 could not be found. Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Request method failure captured: Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 HTTP/1.1 Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPdAy_c51akg48RxLGhe-n1h-qgcLOrIopzwL0Awznrzns5kowRKfsjGbe2DQm3QM40wbkVC5BZfBQrqBskvaNaLBNRkjtaBmNZEAEw57S5uD7FzAyfsOSDRpzLvHo7KA4iay7reuIatf3Fiv-muPSRBhfftYS_cT82VfKPVwqBQRHyo Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: c2dbde858f4648319751e3c651946041 Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/c2dbde858f4648319751e3c651946041"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2dbde858f4648319751e3c651946041"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_c2dbde858f4648319751e3c651946041", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/c2dbde858f4648319751e3c651946041"}]}] Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: c2dbde858f4648319751e3c651946041 Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1194592050 Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestMinimumBasicScenario-1194592050-project Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9c9a55d86ea74f9a8e7c1bab661928be Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestMinimumBasicScenario-1194592050-project Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 could not be found. Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '07198aa8-59d6-4674-b03c-e6fff571f3c0'} Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 could not be found. Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 could not be found. Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:48:58.773002 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:48:58.777937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:48:58.777937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:48:58.777937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:48:58.777937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:48:58.777937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:48:58.777937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 could not be found. Oct 05 18:48:58.777937 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:48:58.777937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Returning 404 to user: Instance 07198aa8-59d6-4674-b03c-e6fff571f3c0 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:48:58.777937 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fe1a6645-af32-494a-b05a-5dc3e7550af0 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0" status: 404 len: 111 microversion: 2.1 time: 0.039440 Oct 05 18:48:58.777937 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3821/7400] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:48:58 2022] GET /compute/v2.1/servers/07198aa8-59d6-4674-b03c-e6fff571f3c0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:48:58.783576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fa1d57d6-14e2-47b4-aff2-b9bd46baca32 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] Calling method '.version_select at 0x7f776ff9b670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:48:58.808799 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fa1d57d6-14e2-47b4-aff2-b9bd46baca32 tempest-TestMinimumBasicScenario-1194592050 tempest-TestMinimumBasicScenario-1194592050-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1178033137" status: 202 len: 0 microversion: 2.1 time: 0.028950 Oct 05 18:48:58.809477 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3580/7401] 10.222.0.70 () {58 vars in 1272 bytes} [Wed Oct 5 18:48:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1178033137 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:49:07.750670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c87dfed3-1975-4278-8ecb-9ffc7cb5c724 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'create', calling method: .version_select at 0x7f776ff69f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2093080727", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvWTIMjbHFAkRVrZnb3zC1yc8IkaYNkLhj6BF/QhDTCuQ3+fthjH+BxIwAaRMYydn5tKWEFX5/GliMct/2WEkxANfFtp1urBmIT3IJJhxdygViY2IchkOOzYeUu/Bn94w=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:49:07.768337 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c87dfed3-1975-4278-8ecb-9ffc7cb5c724 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:49:07.774117 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-c87dfed3-1975-4278-8ecb-9ffc7cb5c724 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for user 50cf0acb7d924ed7a2829f7603209ca5 and project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:49:07.805033 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c87dfed3-1975-4278-8ecb-9ffc7cb5c724 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.238264 Oct 05 18:49:07.805643 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3822/7402] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:49:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:49:14.019761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:14.020551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:14.024699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-278704472", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "5ce849ac-62f8-4b14-b5da-fa5792816b97"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2093080727", "security_groups": [{"name": "tempest-secgroup-smoke-1851335302"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:49:14.154220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] validate_networks() for [('5ce849ac-62f8-4b14-b5da-fa5792816b97', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:49:14.661133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:49:14.661665 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:49:14.662200 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:49:14.662734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:49:14.663174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:49:14.672206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:14.672692 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:14.673132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:14.673910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:14.674604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:14.675028 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:14.693246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:49:14.698676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for user 50cf0acb7d924ed7a2829f7603209ca5 and project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:49:14.712690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:49:14.715066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:49:14.768890 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a152a0f-c6c5-4c59-a273-6da113288e01 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.751279 Oct 05 18:49:14.769883 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3581/7403] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:49:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:49:14.780872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:14.788513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d537699d-8878-4c2d-b35f-220cea076652 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:14.789340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d537699d-8878-4c2d-b35f-220cea076652 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:14.791358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:14.853481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d537699d-8878-4c2d-b35f-220cea076652 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:14.860553 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d537699d-8878-4c2d-b35f-220cea076652 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1266 microversion: 2.1 time: 0.082583 Oct 05 18:49:14.861534 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3823/7404] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:14 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:15.884688 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9cd34aed-26f4-489e-84c7-880057686db0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:15.885980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9cd34aed-26f4-489e-84c7-880057686db0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:15.893079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cd34aed-26f4-489e-84c7-880057686db0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:15.893579 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cd34aed-26f4-489e-84c7-880057686db0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:15.894012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cd34aed-26f4-489e-84c7-880057686db0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:15.894745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cd34aed-26f4-489e-84c7-880057686db0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:15.895163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cd34aed-26f4-489e-84c7-880057686db0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:15.895820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9cd34aed-26f4-489e-84c7-880057686db0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:15.963798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9cd34aed-26f4-489e-84c7-880057686db0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:15.972959 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9cd34aed-26f4-489e-84c7-880057686db0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1318 microversion: 2.1 time: 0.093097 Oct 05 18:49:15.973561 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3582/7405] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:15 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1318 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:16.998969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d84392e-3142-430c-ae96-71657fca9a34 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:16.999603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d84392e-3142-430c-ae96-71657fca9a34 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:17.008245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d84392e-3142-430c-ae96-71657fca9a34 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:17.008751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d84392e-3142-430c-ae96-71657fca9a34 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:17.009203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d84392e-3142-430c-ae96-71657fca9a34 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:17.009924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d84392e-3142-430c-ae96-71657fca9a34 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:17.010711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d84392e-3142-430c-ae96-71657fca9a34 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:17.011168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d84392e-3142-430c-ae96-71657fca9a34 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:17.232010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d84392e-3142-430c-ae96-71657fca9a34 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:17.241503 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d84392e-3142-430c-ae96-71657fca9a34 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1392 microversion: 2.1 time: 0.246541 Oct 05 18:49:17.241927 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3824/7406] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:16 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1392 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:49:17.550761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-a54b62cf-91b6-4efc-9755-af6081fbd7e0 req-2c4c0675-52fc-48a1-bfb1-c1edaa9f01ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c47395-f611-45d4-a57d-b550b816cddc", "tag": "64a21b7b-75ba-4807-b8cd-bd6f6bdc7778"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:49:17.562567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a54b62cf-91b6-4efc-9755-af6081fbd7e0 req-2c4c0675-52fc-48a1-bfb1-c1edaa9f01ec service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:17.563049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a54b62cf-91b6-4efc-9755-af6081fbd7e0 req-2c4c0675-52fc-48a1-bfb1-c1edaa9f01ec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:17.563475 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-a54b62cf-91b6-4efc-9755-af6081fbd7e0 req-2c4c0675-52fc-48a1-bfb1-c1edaa9f01ec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:17.575557 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-a54b62cf-91b6-4efc-9755-af6081fbd7e0 req-2c4c0675-52fc-48a1-bfb1-c1edaa9f01ec service nova] Creating event network-changed:64a21b7b-75ba-4807-b8cd-bd6f6bdc7778 for instance 11c47395-f611-45d4-a57d-b550b816cddc on n-h2-835595-3 Oct 05 18:49:17.580554 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-a54b62cf-91b6-4efc-9755-af6081fbd7e0 req-2c4c0675-52fc-48a1-bfb1-c1edaa9f01ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033880 Oct 05 18:49:17.581159 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3583/7407] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:49:18.268502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-325dd17e-62ff-4712-b7ea-0377f623cba4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:18.269176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-325dd17e-62ff-4712-b7ea-0377f623cba4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:18.276740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd17e-62ff-4712-b7ea-0377f623cba4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:18.277246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd17e-62ff-4712-b7ea-0377f623cba4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:18.277700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd17e-62ff-4712-b7ea-0377f623cba4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:18.278461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd17e-62ff-4712-b7ea-0377f623cba4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:18.278941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd17e-62ff-4712-b7ea-0377f623cba4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:18.279390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325dd17e-62ff-4712-b7ea-0377f623cba4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:18.431750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-325dd17e-62ff-4712-b7ea-0377f623cba4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:18.440154 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-325dd17e-62ff-4712-b7ea-0377f623cba4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1392 microversion: 2.1 time: 0.177798 Oct 05 18:49:18.440759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3825/7408] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:18 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:19.465323 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-49b89f18-0ee9-4d63-a291-48074aac4cd9 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:19.465908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-49b89f18-0ee9-4d63-a291-48074aac4cd9 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:19.472801 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b89f18-0ee9-4d63-a291-48074aac4cd9 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:19.473282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b89f18-0ee9-4d63-a291-48074aac4cd9 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:19.473718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b89f18-0ee9-4d63-a291-48074aac4cd9 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:19.474423 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b89f18-0ee9-4d63-a291-48074aac4cd9 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:19.474900 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b89f18-0ee9-4d63-a291-48074aac4cd9 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:19.475322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-49b89f18-0ee9-4d63-a291-48074aac4cd9 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:19.608540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-49b89f18-0ee9-4d63-a291-48074aac4cd9 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:19.616335 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-49b89f18-0ee9-4d63-a291-48074aac4cd9 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1392 microversion: 2.1 time: 0.156373 Oct 05 18:49:19.616969 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3584/7409] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:19 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:20.644042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-86bbc1c0-cc0a-499c-baeb-371c11e1a5b7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:20.645603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-86bbc1c0-cc0a-499c-baeb-371c11e1a5b7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:20.657529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86bbc1c0-cc0a-499c-baeb-371c11e1a5b7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:20.658403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86bbc1c0-cc0a-499c-baeb-371c11e1a5b7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:20.659199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86bbc1c0-cc0a-499c-baeb-371c11e1a5b7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:20.660387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86bbc1c0-cc0a-499c-baeb-371c11e1a5b7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:20.661183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86bbc1c0-cc0a-499c-baeb-371c11e1a5b7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:20.661938 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-86bbc1c0-cc0a-499c-baeb-371c11e1a5b7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:20.805656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-86bbc1c0-cc0a-499c-baeb-371c11e1a5b7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:20.813642 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-86bbc1c0-cc0a-499c-baeb-371c11e1a5b7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1392 microversion: 2.1 time: 0.176623 Oct 05 18:49:20.814339 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3826/7410] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:20 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:21.257750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-4184e0e7-38f5-4f95-a799-467a8ce75ec8 req-14e3810e-c5f8-4bf0-9e2b-ca77b26c45ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c47395-f611-45d4-a57d-b550b816cddc", "name": "network-vif-plugged", "status": "completed", "tag": "64a21b7b-75ba-4807-b8cd-bd6f6bdc7778"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:49:21.270505 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4184e0e7-38f5-4f95-a799-467a8ce75ec8 req-14e3810e-c5f8-4bf0-9e2b-ca77b26c45ba service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:21.271000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4184e0e7-38f5-4f95-a799-467a8ce75ec8 req-14e3810e-c5f8-4bf0-9e2b-ca77b26c45ba service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:21.271797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-4184e0e7-38f5-4f95-a799-467a8ce75ec8 req-14e3810e-c5f8-4bf0-9e2b-ca77b26c45ba service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:21.283095 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-4184e0e7-38f5-4f95-a799-467a8ce75ec8 req-14e3810e-c5f8-4bf0-9e2b-ca77b26c45ba service nova] Creating event network-vif-plugged:64a21b7b-75ba-4807-b8cd-bd6f6bdc7778 for instance 11c47395-f611-45d4-a57d-b550b816cddc on n-h2-835595-3 Oct 05 18:49:21.288203 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-4184e0e7-38f5-4f95-a799-467a8ce75ec8 req-14e3810e-c5f8-4bf0-9e2b-ca77b26c45ba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034302 Oct 05 18:49:21.288783 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3585/7411] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:49:21.841213 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1176ec7d-e55f-4b18-8a15-23fd5d7b1467 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:21.842584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1176ec7d-e55f-4b18-8a15-23fd5d7b1467 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:21.850822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1176ec7d-e55f-4b18-8a15-23fd5d7b1467 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:21.851293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1176ec7d-e55f-4b18-8a15-23fd5d7b1467 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:21.851768 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1176ec7d-e55f-4b18-8a15-23fd5d7b1467 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:21.852469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1176ec7d-e55f-4b18-8a15-23fd5d7b1467 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:21.852934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1176ec7d-e55f-4b18-8a15-23fd5d7b1467 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:21.853372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1176ec7d-e55f-4b18-8a15-23fd5d7b1467 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:22.015872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1176ec7d-e55f-4b18-8a15-23fd5d7b1467 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:22.024419 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1176ec7d-e55f-4b18-8a15-23fd5d7b1467 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1392 microversion: 2.1 time: 0.190013 Oct 05 18:49:22.024995 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3827/7412] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:21 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1392 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:23.052150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5544c96d-caab-47b2-aa27-98dee7fcd43d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:23.052978 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5544c96d-caab-47b2-aa27-98dee7fcd43d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:23.062322 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5544c96d-caab-47b2-aa27-98dee7fcd43d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:23.062948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5544c96d-caab-47b2-aa27-98dee7fcd43d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:23.063487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5544c96d-caab-47b2-aa27-98dee7fcd43d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:23.064508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5544c96d-caab-47b2-aa27-98dee7fcd43d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:23.065072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5544c96d-caab-47b2-aa27-98dee7fcd43d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:23.065599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5544c96d-caab-47b2-aa27-98dee7fcd43d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:23.214241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5544c96d-caab-47b2-aa27-98dee7fcd43d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:23.222760 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5544c96d-caab-47b2-aa27-98dee7fcd43d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1563 microversion: 2.1 time: 0.177061 Oct 05 18:49:23.223320 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3586/7413] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:23 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1563 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:23.248035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a2c73fa4-0bde-4160-bdc3-b9bf0a467a60 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:23.248698 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a2c73fa4-0bde-4160-bdc3-b9bf0a467a60 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:23.256866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c73fa4-0bde-4160-bdc3-b9bf0a467a60 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:23.257377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c73fa4-0bde-4160-bdc3-b9bf0a467a60 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:23.257830 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c73fa4-0bde-4160-bdc3-b9bf0a467a60 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:23.258578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c73fa4-0bde-4160-bdc3-b9bf0a467a60 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:23.259055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c73fa4-0bde-4160-bdc3-b9bf0a467a60 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:23.259502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a2c73fa4-0bde-4160-bdc3-b9bf0a467a60 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:23.395131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a2c73fa4-0bde-4160-bdc3-b9bf0a467a60 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:23.403340 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a2c73fa4-0bde-4160-bdc3-b9bf0a467a60 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1563 microversion: 2.1 time: 0.161445 Oct 05 18:49:23.403925 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3828/7414] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:23 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:25.408087 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d4e40559-5c9d-46d1-a174-08886cce7639 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:25.408689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d4e40559-5c9d-46d1-a174-08886cce7639 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:25.409827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d148a560-9e7a-4854-b777-63312a6eaf53 req-bc76bcc8-9617-430d-9fc0-43e037bd3d07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c47395-f611-45d4-a57d-b550b816cddc", "tag": "64a21b7b-75ba-4807-b8cd-bd6f6bdc7778"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:49:25.414657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:25.415716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:25.415905 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:25.417853 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4e40559-5c9d-46d1-a174-08886cce7639 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:25.418463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4e40559-5c9d-46d1-a174-08886cce7639 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:25.418938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4e40559-5c9d-46d1-a174-08886cce7639 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:25.419722 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4e40559-5c9d-46d1-a174-08886cce7639 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:25.420366 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4e40559-5c9d-46d1-a174-08886cce7639 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:25.421375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d4e40559-5c9d-46d1-a174-08886cce7639 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:25.422728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d148a560-9e7a-4854-b777-63312a6eaf53 req-bc76bcc8-9617-430d-9fc0-43e037bd3d07 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:25.423446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d148a560-9e7a-4854-b777-63312a6eaf53 req-bc76bcc8-9617-430d-9fc0-43e037bd3d07 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:25.424102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d148a560-9e7a-4854-b777-63312a6eaf53 req-bc76bcc8-9617-430d-9fc0-43e037bd3d07 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:25.437497 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d148a560-9e7a-4854-b777-63312a6eaf53 req-bc76bcc8-9617-430d-9fc0-43e037bd3d07 service nova] Creating event network-changed:64a21b7b-75ba-4807-b8cd-bd6f6bdc7778 for instance 11c47395-f611-45d4-a57d-b550b816cddc on n-h2-835595-3 Oct 05 18:49:25.443445 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d148a560-9e7a-4854-b777-63312a6eaf53 req-bc76bcc8-9617-430d-9fc0-43e037bd3d07 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037601 Oct 05 18:49:25.444446 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3829/7415] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:49:25.563235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d4e40559-5c9d-46d1-a174-08886cce7639 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:25.571977 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d4e40559-5c9d-46d1-a174-08886cce7639 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1563 microversion: 2.1 time: 0.168725 Oct 05 18:49:25.572771 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3587/7416] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:25 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1563 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:48.879656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=15 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:48.880593 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=32 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:48.886218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56d99310-8a78-48f8-b590-b7b4253a17a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:49:48.889120 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56d99310-8a78-48f8-b590-b7b4253a17a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:48.898241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d99310-8a78-48f8-b590-b7b4253a17a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:48.898857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d99310-8a78-48f8-b590-b7b4253a17a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:48.899278 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d99310-8a78-48f8-b590-b7b4253a17a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:48.899988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d99310-8a78-48f8-b590-b7b4253a17a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:48.900444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d99310-8a78-48f8-b590-b7b4253a17a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:48.900879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56d99310-8a78-48f8-b590-b7b4253a17a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:48.954315 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56d99310-8a78-48f8-b590-b7b4253a17a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc/action" status: 200 len: 24562 microversion: 2.1 time: 0.077052 Oct 05 18:49:48.955017 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3830/7417] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:49:48 2022] POST /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc/action => generated 24562 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:49:55.373174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2db17e72-495f-4234-98b4-38c6bea78292 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:49:55.374608 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2db17e72-495f-4234-98b4-38c6bea78292 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:55.377643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:55.378922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=30 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:49:55.385639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2db17e72-495f-4234-98b4-38c6bea78292 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:55.386115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2db17e72-495f-4234-98b4-38c6bea78292 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:55.386573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2db17e72-495f-4234-98b4-38c6bea78292 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:55.387260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2db17e72-495f-4234-98b4-38c6bea78292 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:55.387711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2db17e72-495f-4234-98b4-38c6bea78292 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:55.388142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2db17e72-495f-4234-98b4-38c6bea78292 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:55.457125 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2db17e72-495f-4234-98b4-38c6bea78292 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc/action" status: 202 len: 0 microversion: 2.1 time: 0.090777 Oct 05 18:49:55.460818 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3588/7418] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:49:55 2022] POST /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:49:55.467045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a5215b4-9161-496e-a254-e14a2613902e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:55.467855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9a5215b4-9161-496e-a254-e14a2613902e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:55.475967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5215b4-9161-496e-a254-e14a2613902e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:55.476573 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5215b4-9161-496e-a254-e14a2613902e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:55.477113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5215b4-9161-496e-a254-e14a2613902e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:55.477952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5215b4-9161-496e-a254-e14a2613902e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:55.478474 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5215b4-9161-496e-a254-e14a2613902e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:55.478921 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5215b4-9161-496e-a254-e14a2613902e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:55.622893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9a5215b4-9161-496e-a254-e14a2613902e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:55.632296 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a5215b4-9161-496e-a254-e14a2613902e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1687 microversion: 2.1 time: 0.169497 Oct 05 18:49:55.633050 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3831/7419] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:55 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:56.664255 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bd344e56-37f2-4f19-9305-9dd4caf59997 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:56.664954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bd344e56-37f2-4f19-9305-9dd4caf59997 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:56.672503 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd344e56-37f2-4f19-9305-9dd4caf59997 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:56.673038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd344e56-37f2-4f19-9305-9dd4caf59997 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:56.673582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd344e56-37f2-4f19-9305-9dd4caf59997 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:56.674536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd344e56-37f2-4f19-9305-9dd4caf59997 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:56.675050 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd344e56-37f2-4f19-9305-9dd4caf59997 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:56.675522 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bd344e56-37f2-4f19-9305-9dd4caf59997 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:56.844333 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bd344e56-37f2-4f19-9305-9dd4caf59997 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:56.854782 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bd344e56-37f2-4f19-9305-9dd4caf59997 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1667 microversion: 2.1 time: 0.199643 Oct 05 18:49:56.855341 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3589/7420] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:56 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1667 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:57.955292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5790798d-d92b-4eba-99c8-86b3001d8d5d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:49:57.957503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5790798d-d92b-4eba-99c8-86b3001d8d5d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:57.968834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5790798d-d92b-4eba-99c8-86b3001d8d5d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:57.969342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5790798d-d92b-4eba-99c8-86b3001d8d5d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:57.969799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5790798d-d92b-4eba-99c8-86b3001d8d5d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:57.970555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5790798d-d92b-4eba-99c8-86b3001d8d5d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:57.971037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5790798d-d92b-4eba-99c8-86b3001d8d5d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:57.971479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5790798d-d92b-4eba-99c8-86b3001d8d5d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:58.022365 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5790798d-d92b-4eba-99c8-86b3001d8d5d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc/action" status: 200 len: 32633 microversion: 2.1 time: 0.070904 Oct 05 18:49:58.023030 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3832/7421] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:49:57 2022] POST /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc/action => generated 32633 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:49:58.035010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6f684542-dfb9-4a51-a26d-527965e0855f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:49:58.035542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6f684542-dfb9-4a51-a26d-527965e0855f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:58.042649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f684542-dfb9-4a51-a26d-527965e0855f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:58.043136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f684542-dfb9-4a51-a26d-527965e0855f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:58.043574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f684542-dfb9-4a51-a26d-527965e0855f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:58.044264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f684542-dfb9-4a51-a26d-527965e0855f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:58.044730 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f684542-dfb9-4a51-a26d-527965e0855f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:58.045165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f684542-dfb9-4a51-a26d-527965e0855f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:58.117512 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6f684542-dfb9-4a51-a26d-527965e0855f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc/action" status: 202 len: 0 microversion: 2.1 time: 0.085330 Oct 05 18:49:58.119105 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3590/7422] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:49:58 2022] POST /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 05 18:49:58.128735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d18c5577-0b6f-4106-a353-c486a65c7464 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:58.129486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d18c5577-0b6f-4106-a353-c486a65c7464 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:58.136686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d18c5577-0b6f-4106-a353-c486a65c7464 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:58.137266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d18c5577-0b6f-4106-a353-c486a65c7464 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:58.137725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d18c5577-0b6f-4106-a353-c486a65c7464 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:58.138471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d18c5577-0b6f-4106-a353-c486a65c7464 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:58.138962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d18c5577-0b6f-4106-a353-c486a65c7464 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:58.139407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d18c5577-0b6f-4106-a353-c486a65c7464 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:58.278933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d18c5577-0b6f-4106-a353-c486a65c7464 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:58.287300 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d18c5577-0b6f-4106-a353-c486a65c7464 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1674 microversion: 2.1 time: 0.162824 Oct 05 18:49:58.287901 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3833/7423] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:58 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:59.317745 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-61929dfb-5805-4752-bb57-c6f4af157a7e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:49:59.318896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-61929dfb-5805-4752-bb57-c6f4af157a7e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:59.329444 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61929dfb-5805-4752-bb57-c6f4af157a7e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:59.330247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61929dfb-5805-4752-bb57-c6f4af157a7e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:59.331024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61929dfb-5805-4752-bb57-c6f4af157a7e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:59.332178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61929dfb-5805-4752-bb57-c6f4af157a7e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:59.332930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61929dfb-5805-4752-bb57-c6f4af157a7e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:59.333640 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61929dfb-5805-4752-bb57-c6f4af157a7e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:59.487816 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-61929dfb-5805-4752-bb57-c6f4af157a7e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:49:59.496354 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-61929dfb-5805-4752-bb57-c6f4af157a7e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1682 microversion: 2.1 time: 0.186891 Oct 05 18:49:59.496945 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3591/7424] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:49:59 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:49:59.596429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-25cd75ff-6a6b-4451-a5a0-f4dd9b4c7147 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:49:59.598715 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-25cd75ff-6a6b-4451-a5a0-f4dd9b4c7147 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:49:59.607385 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cd75ff-6a6b-4451-a5a0-f4dd9b4c7147 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:59.607888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cd75ff-6a6b-4451-a5a0-f4dd9b4c7147 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:59.608343 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cd75ff-6a6b-4451-a5a0-f4dd9b4c7147 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:59.609059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cd75ff-6a6b-4451-a5a0-f4dd9b4c7147 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:49:59.609529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cd75ff-6a6b-4451-a5a0-f4dd9b4c7147 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:49:59.609971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-25cd75ff-6a6b-4451-a5a0-f4dd9b4c7147 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:49:59.661909 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-25cd75ff-6a6b-4451-a5a0-f4dd9b4c7147 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc/action" status: 200 len: 34991 microversion: 2.1 time: 0.069414 Oct 05 18:49:59.662602 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3834/7425] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:49:59 2022] POST /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc/action => generated 34991 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:50:00.765170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7af2c78a-d7ee-4da0-8a0a-f163c3ca46ec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:00.766412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7af2c78a-d7ee-4da0-8a0a-f163c3ca46ec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:00.768467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f55b2caf-c68b-4241-aff3-87b741c5e112 req-69d13723-716b-4082-8d70-2605acfd025e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11c47395-f611-45d4-a57d-b550b816cddc", "tag": "64a21b7b-75ba-4807-b8cd-bd6f6bdc7778"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:50:00.773986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7af2c78a-d7ee-4da0-8a0a-f163c3ca46ec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:00.774501 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7af2c78a-d7ee-4da0-8a0a-f163c3ca46ec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:00.774946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7af2c78a-d7ee-4da0-8a0a-f163c3ca46ec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:00.775638 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7af2c78a-d7ee-4da0-8a0a-f163c3ca46ec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:00.776055 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7af2c78a-d7ee-4da0-8a0a-f163c3ca46ec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:00.776710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7af2c78a-d7ee-4da0-8a0a-f163c3ca46ec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:00.780911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f55b2caf-c68b-4241-aff3-87b741c5e112 req-69d13723-716b-4082-8d70-2605acfd025e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:00.781489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f55b2caf-c68b-4241-aff3-87b741c5e112 req-69d13723-716b-4082-8d70-2605acfd025e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:00.781987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f55b2caf-c68b-4241-aff3-87b741c5e112 req-69d13723-716b-4082-8d70-2605acfd025e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:00.795263 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f55b2caf-c68b-4241-aff3-87b741c5e112 req-69d13723-716b-4082-8d70-2605acfd025e service nova] Creating event network-changed:64a21b7b-75ba-4807-b8cd-bd6f6bdc7778 for instance 11c47395-f611-45d4-a57d-b550b816cddc on n-h2-835595-3 Oct 05 18:50:00.800511 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f55b2caf-c68b-4241-aff3-87b741c5e112 req-69d13723-716b-4082-8d70-2605acfd025e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036940 Oct 05 18:50:00.801496 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3835/7426] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:50:00.803064 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7af2c78a-d7ee-4da0-8a0a-f163c3ca46ec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:50:00.889661 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7af2c78a-d7ee-4da0-8a0a-f163c3ca46ec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "DELETE /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 204 len: 0 microversion: 2.1 time: 0.128623 Oct 05 18:50:00.894115 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3592/7427] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:50:00 2022] DELETE /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:50:00.901071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-583e47ec-20d3-42f0-9424-3fee36f95a22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:00.901799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-583e47ec-20d3-42f0-9424-3fee36f95a22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:00.910218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-583e47ec-20d3-42f0-9424-3fee36f95a22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:00.910839 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-583e47ec-20d3-42f0-9424-3fee36f95a22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:00.911666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-583e47ec-20d3-42f0-9424-3fee36f95a22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:00.912406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-583e47ec-20d3-42f0-9424-3fee36f95a22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:00.913054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-583e47ec-20d3-42f0-9424-3fee36f95a22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:00.913586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-583e47ec-20d3-42f0-9424-3fee36f95a22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:01.085655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-583e47ec-20d3-42f0-9424-3fee36f95a22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:01.093978 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-583e47ec-20d3-42f0-9424-3fee36f95a22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1688 microversion: 2.1 time: 0.197924 Oct 05 18:50:01.094895 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3836/7428] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:00 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:50:02.122765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-01113669-ccd2-459b-b198-84bdaffa70e2 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:02.124149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-01113669-ccd2-459b-b198-84bdaffa70e2 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:02.133876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01113669-ccd2-459b-b198-84bdaffa70e2 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:02.134402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01113669-ccd2-459b-b198-84bdaffa70e2 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:02.134843 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01113669-ccd2-459b-b198-84bdaffa70e2 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:02.135543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01113669-ccd2-459b-b198-84bdaffa70e2 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:02.136001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01113669-ccd2-459b-b198-84bdaffa70e2 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:02.136432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-01113669-ccd2-459b-b198-84bdaffa70e2 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:02.284165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-01113669-ccd2-459b-b198-84bdaffa70e2 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:02.292276 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-01113669-ccd2-459b-b198-84bdaffa70e2 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1688 microversion: 2.1 time: 0.177078 Oct 05 18:50:02.292795 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3593/7429] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:02 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:03.315644 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f385ad80-35cf-4f30-863c-979df5a9ea80 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:03.316476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f385ad80-35cf-4f30-863c-979df5a9ea80 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:03.324028 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f385ad80-35cf-4f30-863c-979df5a9ea80 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:03.324538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f385ad80-35cf-4f30-863c-979df5a9ea80 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:03.325222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f385ad80-35cf-4f30-863c-979df5a9ea80 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:03.326246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f385ad80-35cf-4f30-863c-979df5a9ea80 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:03.326740 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f385ad80-35cf-4f30-863c-979df5a9ea80 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:03.327188 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f385ad80-35cf-4f30-863c-979df5a9ea80 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:03.330315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d4180c91-ea06-4497-bafe-23519833418a req-3d14ee9f-c308-4f69-b6c7-ac978891da74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c47395-f611-45d4-a57d-b550b816cddc", "name": "network-vif-deleted", "tag": "64a21b7b-75ba-4807-b8cd-bd6f6bdc7778"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:50:03.341755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d4180c91-ea06-4497-bafe-23519833418a req-3d14ee9f-c308-4f69-b6c7-ac978891da74 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:03.342270 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d4180c91-ea06-4497-bafe-23519833418a req-3d14ee9f-c308-4f69-b6c7-ac978891da74 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:03.342732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d4180c91-ea06-4497-bafe-23519833418a req-3d14ee9f-c308-4f69-b6c7-ac978891da74 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:03.354604 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d4180c91-ea06-4497-bafe-23519833418a req-3d14ee9f-c308-4f69-b6c7-ac978891da74 service nova] Creating event network-vif-deleted:64a21b7b-75ba-4807-b8cd-bd6f6bdc7778 for instance 11c47395-f611-45d4-a57d-b550b816cddc on n-h2-835595-3 Oct 05 18:50:03.359941 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d4180c91-ea06-4497-bafe-23519833418a req-3d14ee9f-c308-4f69-b6c7-ac978891da74 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033386 Oct 05 18:50:03.360873 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3594/7430] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:50:03.396445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f385ad80-35cf-4f30-863c-979df5a9ea80 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:03.406328 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f385ad80-35cf-4f30-863c-979df5a9ea80 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 200 len: 1501 microversion: 2.1 time: 0.094701 Oct 05 18:50:03.406956 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3837/7431] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:03 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 1501 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:04.432979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:04.433683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 11c47395-f611-45d4-a57d-b550b816cddc] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:04.440600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:04.441086 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:04.441517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:04.442219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:04.442711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:04.443139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:04.457425 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] HTTP exception thrown: Instance 11c47395-f611-45d4-a57d-b550b816cddc could not be found. Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Request method failure captured: Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc HTTP/1.1 Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPdGijeU7qFfC_ZC-2iZhrmZOWIAXMzv5itCrmjUOnT-6Aa05p-rcjGSx7tBZy0D-QS4h9HkcJxp_v1YhPgxyw6OEJyhnuQVEzFbh9isYsyeee9IVB0Y7pSdYkqX_y7MwhXl8c9Xz5rMnw1YHO9LVM_n5zXK8EqtQn7Ah_DiwCSq2s_M Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4d5f5e1db74b41ecb00348934af567f9 Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d5f5e1db74b41ecb00348934af567f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d5f5e1db74b41ecb00348934af567f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d5f5e1db74b41ecb00348934af567f9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d5f5e1db74b41ecb00348934af567f9"}]}] Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4d5f5e1db74b41ecb00348934af567f9 Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestNetworkAdvancedServerOps-402293327-project Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 50cf0acb7d924ed7a2829f7603209ca5 Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestNetworkAdvancedServerOps-402293327-project Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 11c47395-f611-45d4-a57d-b550b816cddc could not be found. Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '11c47395-f611-45d4-a57d-b550b816cddc'} Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c47395-f611-45d4-a57d-b550b816cddc could not be found. Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c47395-f611-45d4-a57d-b550b816cddc could not be found. Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:50:04.459165 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c47395-f611-45d4-a57d-b550b816cddc could not be found. Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Returning 404 to user: Instance 11c47395-f611-45d4-a57d-b550b816cddc could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f9481adf-da18-4861-bf36-93779ca6be22 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc" status: 404 len: 111 microversion: 2.1 time: 0.032866 Oct 05 18:50:04.463864 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3595/7432] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:04 2022] GET /compute/v2.1/servers/11c47395-f611-45d4-a57d-b550b816cddc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:50:07.523630 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-256c13a5-62ac-462a-8f87-324901dc8101 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '.version_select at 0x7f7774378670>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:07.545654 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-256c13a5-62ac-462a-8f87-324901dc8101 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2093080727" status: 202 len: 0 microversion: 2.1 time: 0.025865 Oct 05 18:50:07.546485 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3838/7433] 10.222.0.70 () {58 vars in 1284 bytes} [Wed Oct 5 18:50:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2093080727 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:50:07.575999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-cfbaa036-71d9-4da8-b6ad-ae5749f9ec0b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'create', calling method: .version_select at 0x7f77745e0e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-529691099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKhvW5l9QW2e8ll/oBn2BE2Gt2jHwAGBQCaoOO71bw6yKgvdZ08PqSb4cmZxU2FQ5y2YssBOcotMzMIz/OWlAA+NpLrbFEvAnNa+RsbFVhJ2WIhUnt8uUALdvnwNIqz0pQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:50:07.598476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-cfbaa036-71d9-4da8-b6ad-ae5749f9ec0b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:50:07.603902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-cfbaa036-71d9-4da8-b6ad-ae5749f9ec0b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for user 50cf0acb7d924ed7a2829f7603209ca5 and project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:50:07.634373 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-cfbaa036-71d9-4da8-b6ad-ae5749f9ec0b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.062144 Oct 05 18:50:07.634996 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3596/7434] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:50:07 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:50:13.752094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1950620364", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "ade4e6e6-989d-4195-b464-51ec7f613069"}], "key_name": "tempest-TestNetworkAdvancedServerOps-529691099", "security_groups": [{"name": "tempest-secgroup-smoke-605765798"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:50:13.783885 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=38 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:13.917104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] validate_networks() for [('ade4e6e6-989d-4195-b464-51ec7f613069', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:50:14.483752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:50:14.484182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:50:14.486585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:50:14.487209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:50:14.488275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:50:14.499249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:14.499989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:14.500437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:14.501241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:14.501646 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:14.502087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:14.524397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:50:14.529701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for user 50cf0acb7d924ed7a2829f7603209ca5 and project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:50:14.542352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:50:14.544760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:50:14.595342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-02542183-8623-4cd7-9af3-5f98500f3313 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.847956 Oct 05 18:50:14.596560 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3839/7435] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:50:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:50:14.606133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:14.610736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f0cca67c-bd1c-4285-baf8-d1aebf9958bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:14.611487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f0cca67c-bd1c-4285-baf8-d1aebf9958bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:14.676370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f0cca67c-bd1c-4285-baf8-d1aebf9958bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:14.685867 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f0cca67c-bd1c-4285-baf8-d1aebf9958bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1266 microversion: 2.1 time: 0.081447 Oct 05 18:50:14.687002 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3597/7436] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:14 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:50:15.710774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d0a2879d-3819-4896-9d02-f53490e64ed8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:15.711643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d0a2879d-3819-4896-9d02-f53490e64ed8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:15.729101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a2879d-3819-4896-9d02-f53490e64ed8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:15.730172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a2879d-3819-4896-9d02-f53490e64ed8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:15.730741 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a2879d-3819-4896-9d02-f53490e64ed8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:15.731702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a2879d-3819-4896-9d02-f53490e64ed8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:15.732251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a2879d-3819-4896-9d02-f53490e64ed8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:15.732770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d0a2879d-3819-4896-9d02-f53490e64ed8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:15.827761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d0a2879d-3819-4896-9d02-f53490e64ed8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:15.838789 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d0a2879d-3819-4896-9d02-f53490e64ed8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1326 microversion: 2.1 time: 0.133339 Oct 05 18:50:15.854306 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3840/7437] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:15 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1326 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:16.865612 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-57c49b13-92e0-4369-ba70-6d851937620e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:16.867860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-57c49b13-92e0-4369-ba70-6d851937620e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:16.875997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57c49b13-92e0-4369-ba70-6d851937620e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:16.876519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57c49b13-92e0-4369-ba70-6d851937620e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:16.878188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57c49b13-92e0-4369-ba70-6d851937620e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:16.879181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57c49b13-92e0-4369-ba70-6d851937620e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:16.879821 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57c49b13-92e0-4369-ba70-6d851937620e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:16.880477 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-57c49b13-92e0-4369-ba70-6d851937620e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:17.105280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-57c49b13-92e0-4369-ba70-6d851937620e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:17.114397 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-57c49b13-92e0-4369-ba70-6d851937620e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1391 microversion: 2.1 time: 0.253048 Oct 05 18:50:17.115336 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3598/7438] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:16 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1391 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:17.431904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e6c60902-cff1-40d4-8f65-b73ccaed5620 req-a9b5715e-6e5b-407a-91c5-30de564a93cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0297bb5d-f200-4b5b-b4ac-a6fb086c7a72", "tag": "952c043d-1be6-4f14-86f5-4fef7fe515ef"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:50:17.455916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e6c60902-cff1-40d4-8f65-b73ccaed5620 req-a9b5715e-6e5b-407a-91c5-30de564a93cf service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:17.456860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e6c60902-cff1-40d4-8f65-b73ccaed5620 req-a9b5715e-6e5b-407a-91c5-30de564a93cf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:17.457700 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e6c60902-cff1-40d4-8f65-b73ccaed5620 req-a9b5715e-6e5b-407a-91c5-30de564a93cf service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:17.478074 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e6c60902-cff1-40d4-8f65-b73ccaed5620 req-a9b5715e-6e5b-407a-91c5-30de564a93cf service nova] Creating event network-changed:952c043d-1be6-4f14-86f5-4fef7fe515ef for instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 on n-h1-835595-3 Oct 05 18:50:17.483836 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e6c60902-cff1-40d4-8f65-b73ccaed5620 req-a9b5715e-6e5b-407a-91c5-30de564a93cf service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063862 Oct 05 18:50:17.484619 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3841/7439] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:50:18.142355 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e4d970da-747d-439d-9f93-666f44ff0b72 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:18.143412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e4d970da-747d-439d-9f93-666f44ff0b72 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:18.152003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d970da-747d-439d-9f93-666f44ff0b72 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:18.152496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d970da-747d-439d-9f93-666f44ff0b72 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:18.152937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d970da-747d-439d-9f93-666f44ff0b72 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:18.153642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d970da-747d-439d-9f93-666f44ff0b72 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:18.154104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d970da-747d-439d-9f93-666f44ff0b72 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:18.154572 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e4d970da-747d-439d-9f93-666f44ff0b72 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:18.285308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e4d970da-747d-439d-9f93-666f44ff0b72 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:18.296984 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e4d970da-747d-439d-9f93-666f44ff0b72 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1391 microversion: 2.1 time: 0.161087 Oct 05 18:50:18.297567 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3599/7440] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:18 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:19.322906 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-15d265dc-3937-4ef5-911e-cfd6df67af1a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:19.323661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-15d265dc-3937-4ef5-911e-cfd6df67af1a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:19.326566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:19.333103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d265dc-3937-4ef5-911e-cfd6df67af1a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:19.333786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d265dc-3937-4ef5-911e-cfd6df67af1a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:19.334135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d265dc-3937-4ef5-911e-cfd6df67af1a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:19.334888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d265dc-3937-4ef5-911e-cfd6df67af1a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:19.335367 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d265dc-3937-4ef5-911e-cfd6df67af1a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:19.335813 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-15d265dc-3937-4ef5-911e-cfd6df67af1a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:19.483291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-15d265dc-3937-4ef5-911e-cfd6df67af1a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:19.492038 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-15d265dc-3937-4ef5-911e-cfd6df67af1a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1391 microversion: 2.1 time: 0.174009 Oct 05 18:50:19.492632 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3842/7441] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:19 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1391 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:20.519911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e2b3467-9728-4ea9-810a-a54f25d898b1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:20.520923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e2b3467-9728-4ea9-810a-a54f25d898b1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:20.530005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e2b3467-9728-4ea9-810a-a54f25d898b1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:20.530526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e2b3467-9728-4ea9-810a-a54f25d898b1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:20.530959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e2b3467-9728-4ea9-810a-a54f25d898b1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:20.531687 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e2b3467-9728-4ea9-810a-a54f25d898b1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:20.532141 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e2b3467-9728-4ea9-810a-a54f25d898b1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:20.532558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e2b3467-9728-4ea9-810a-a54f25d898b1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:20.668280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2e2b3467-9728-4ea9-810a-a54f25d898b1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:20.676121 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e2b3467-9728-4ea9-810a-a54f25d898b1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1391 microversion: 2.1 time: 0.163057 Oct 05 18:50:20.676705 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3600/7442] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:20 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:21.703910 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9ec41f58-4b9c-4dca-916c-ee2f42376a2e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:21.704963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9ec41f58-4b9c-4dca-916c-ee2f42376a2e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:21.713859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ec41f58-4b9c-4dca-916c-ee2f42376a2e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:21.714389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ec41f58-4b9c-4dca-916c-ee2f42376a2e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:21.714846 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ec41f58-4b9c-4dca-916c-ee2f42376a2e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:21.715557 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ec41f58-4b9c-4dca-916c-ee2f42376a2e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:21.716037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ec41f58-4b9c-4dca-916c-ee2f42376a2e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:21.716483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9ec41f58-4b9c-4dca-916c-ee2f42376a2e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:21.861236 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9ec41f58-4b9c-4dca-916c-ee2f42376a2e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:21.870113 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9ec41f58-4b9c-4dca-916c-ee2f42376a2e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1391 microversion: 2.1 time: 0.173388 Oct 05 18:50:21.870726 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3843/7443] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:21 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1391 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:22.693337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-80e15d80-5d0c-4ee0-9d79-30a68b9c2457 req-bbe22302-29a4-495d-8bd2-570e0353feb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0297bb5d-f200-4b5b-b4ac-a6fb086c7a72", "name": "network-vif-plugged", "status": "completed", "tag": "952c043d-1be6-4f14-86f5-4fef7fe515ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:50:22.706682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-80e15d80-5d0c-4ee0-9d79-30a68b9c2457 req-bbe22302-29a4-495d-8bd2-570e0353feb8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:22.707379 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-80e15d80-5d0c-4ee0-9d79-30a68b9c2457 req-bbe22302-29a4-495d-8bd2-570e0353feb8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:22.708090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-80e15d80-5d0c-4ee0-9d79-30a68b9c2457 req-bbe22302-29a4-495d-8bd2-570e0353feb8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:22.719521 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-80e15d80-5d0c-4ee0-9d79-30a68b9c2457 req-bbe22302-29a4-495d-8bd2-570e0353feb8 service nova] Creating event network-vif-plugged:952c043d-1be6-4f14-86f5-4fef7fe515ef for instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 on n-h1-835595-3 Oct 05 18:50:22.724626 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-80e15d80-5d0c-4ee0-9d79-30a68b9c2457 req-bbe22302-29a4-495d-8bd2-570e0353feb8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035468 Oct 05 18:50:22.725398 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3601/7444] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:50:22.896180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6e7b4862-6fbc-4fec-add3-3c4cfd4d443f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:22.896778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6e7b4862-6fbc-4fec-add3-3c4cfd4d443f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:22.905242 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6e7b4862-6fbc-4fec-add3-3c4cfd4d443f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:22.905752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6e7b4862-6fbc-4fec-add3-3c4cfd4d443f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:22.906348 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6e7b4862-6fbc-4fec-add3-3c4cfd4d443f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:22.907014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6e7b4862-6fbc-4fec-add3-3c4cfd4d443f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:22.907520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6e7b4862-6fbc-4fec-add3-3c4cfd4d443f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:22.907933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6e7b4862-6fbc-4fec-add3-3c4cfd4d443f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:23.046659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6e7b4862-6fbc-4fec-add3-3c4cfd4d443f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:23.054661 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6e7b4862-6fbc-4fec-add3-3c4cfd4d443f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1391 microversion: 2.1 time: 0.164789 Oct 05 18:50:23.055252 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3844/7445] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:22 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:24.082329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5c8c61f7-cb97-4322-a884-0b48dd050b53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:24.083273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5c8c61f7-cb97-4322-a884-0b48dd050b53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:24.090337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c8c61f7-cb97-4322-a884-0b48dd050b53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:24.090854 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c8c61f7-cb97-4322-a884-0b48dd050b53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:24.091290 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c8c61f7-cb97-4322-a884-0b48dd050b53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:24.091988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c8c61f7-cb97-4322-a884-0b48dd050b53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:24.092451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c8c61f7-cb97-4322-a884-0b48dd050b53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:24.092876 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5c8c61f7-cb97-4322-a884-0b48dd050b53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:24.231616 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5c8c61f7-cb97-4322-a884-0b48dd050b53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:24.240177 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5c8c61f7-cb97-4322-a884-0b48dd050b53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1563 microversion: 2.1 time: 0.165573 Oct 05 18:50:24.240773 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3602/7446] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:24 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:24.263514 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d79bc93e-390d-4d32-a499-1b1474e08ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:24.264151 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d79bc93e-390d-4d32-a499-1b1474e08ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:24.271621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d79bc93e-390d-4d32-a499-1b1474e08ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:24.272130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d79bc93e-390d-4d32-a499-1b1474e08ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:24.272584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d79bc93e-390d-4d32-a499-1b1474e08ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:24.273297 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d79bc93e-390d-4d32-a499-1b1474e08ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:24.273772 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d79bc93e-390d-4d32-a499-1b1474e08ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:24.274211 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d79bc93e-390d-4d32-a499-1b1474e08ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:24.416829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d79bc93e-390d-4d32-a499-1b1474e08ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:24.425236 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d79bc93e-390d-4d32-a499-1b1474e08ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1563 microversion: 2.1 time: 0.165900 Oct 05 18:50:24.425837 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3845/7447] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:24 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:26.098081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b01fd432-9e9a-48d7-a645-ad02b171b921 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:26.098715 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b01fd432-9e9a-48d7-a645-ad02b171b921 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:26.102095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:26.105671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:26.105902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9e9943c2-b825-431d-b287-36a500a3dadf req-2a4597e6-b5cc-4da7-91fc-4846f4b3e460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0297bb5d-f200-4b5b-b4ac-a6fb086c7a72", "tag": "952c043d-1be6-4f14-86f5-4fef7fe515ef"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:50:26.113388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b01fd432-9e9a-48d7-a645-ad02b171b921 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:26.116080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:26.116880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:26.117174 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b01fd432-9e9a-48d7-a645-ad02b171b921 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:26.117840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b01fd432-9e9a-48d7-a645-ad02b171b921 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:26.120615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9e9943c2-b825-431d-b287-36a500a3dadf req-2a4597e6-b5cc-4da7-91fc-4846f4b3e460 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:26.121188 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b01fd432-9e9a-48d7-a645-ad02b171b921 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:26.121755 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b01fd432-9e9a-48d7-a645-ad02b171b921 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:26.121879 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9e9943c2-b825-431d-b287-36a500a3dadf req-2a4597e6-b5cc-4da7-91fc-4846f4b3e460 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:26.122231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b01fd432-9e9a-48d7-a645-ad02b171b921 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:26.124231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9e9943c2-b825-431d-b287-36a500a3dadf req-2a4597e6-b5cc-4da7-91fc-4846f4b3e460 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:26.144302 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9e9943c2-b825-431d-b287-36a500a3dadf req-2a4597e6-b5cc-4da7-91fc-4846f4b3e460 service nova] Creating event network-changed:952c043d-1be6-4f14-86f5-4fef7fe515ef for instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 on n-h1-835595-3 Oct 05 18:50:26.150324 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9e9943c2-b825-431d-b287-36a500a3dadf req-2a4597e6-b5cc-4da7-91fc-4846f4b3e460 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049880 Oct 05 18:50:26.151120 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3846/7448] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:50:26.360284 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b01fd432-9e9a-48d7-a645-ad02b171b921 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:26.368990 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b01fd432-9e9a-48d7-a645-ad02b171b921 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1563 microversion: 2.1 time: 0.274676 Oct 05 18:50:26.378497 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3603/7449] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:26 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1563 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:49.667505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=9 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:49.668370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=36 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:49.673109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-de942dbb-9a15-49ad-b37f-8398d0763646 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:50:49.675470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-de942dbb-9a15-49ad-b37f-8398d0763646 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:49.683106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de942dbb-9a15-49ad-b37f-8398d0763646 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:49.683612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de942dbb-9a15-49ad-b37f-8398d0763646 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:49.684070 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de942dbb-9a15-49ad-b37f-8398d0763646 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:49.684781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de942dbb-9a15-49ad-b37f-8398d0763646 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:49.685258 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de942dbb-9a15-49ad-b37f-8398d0763646 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:49.685704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-de942dbb-9a15-49ad-b37f-8398d0763646 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:49.741099 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-de942dbb-9a15-49ad-b37f-8398d0763646 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72/action" status: 200 len: 24568 microversion: 2.1 time: 0.075438 Oct 05 18:50:49.742098 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3847/7450] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:50:49 2022] POST /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72/action => generated 24568 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:50:56.132899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d18ca237-ef76-45fd-a4be-de32d2ca1d97 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:50:56.135259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d18ca237-ef76-45fd-a4be-de32d2ca1d97 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:56.138176 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:56.138866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=32 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:50:56.144348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d18ca237-ef76-45fd-a4be-de32d2ca1d97 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:56.144849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d18ca237-ef76-45fd-a4be-de32d2ca1d97 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:56.145291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d18ca237-ef76-45fd-a4be-de32d2ca1d97 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:56.145990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d18ca237-ef76-45fd-a4be-de32d2ca1d97 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:56.146469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d18ca237-ef76-45fd-a4be-de32d2ca1d97 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:56.146896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d18ca237-ef76-45fd-a4be-de32d2ca1d97 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:56.232359 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d18ca237-ef76-45fd-a4be-de32d2ca1d97 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72/action" status: 202 len: 0 microversion: 2.1 time: 0.102971 Oct 05 18:50:56.233626 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3604/7451] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:50:56 2022] POST /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:50:56.244737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-78784d89-23ac-493b-996a-a7d65b6cf681 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:56.245467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-78784d89-23ac-493b-996a-a7d65b6cf681 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:56.254300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78784d89-23ac-493b-996a-a7d65b6cf681 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:56.254933 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78784d89-23ac-493b-996a-a7d65b6cf681 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:56.255391 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78784d89-23ac-493b-996a-a7d65b6cf681 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:56.256695 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78784d89-23ac-493b-996a-a7d65b6cf681 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:56.257471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78784d89-23ac-493b-996a-a7d65b6cf681 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:56.257902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-78784d89-23ac-493b-996a-a7d65b6cf681 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:56.446656 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-78784d89-23ac-493b-996a-a7d65b6cf681 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:56.454937 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-78784d89-23ac-493b-996a-a7d65b6cf681 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1673 microversion: 2.1 time: 0.216011 Oct 05 18:50:56.455508 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3848/7452] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:56 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1673 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:57.483970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f706ca10-594f-4941-8009-ad48b977c782 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:57.485101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f706ca10-594f-4941-8009-ad48b977c782 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:57.500000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f706ca10-594f-4941-8009-ad48b977c782 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:57.500823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f706ca10-594f-4941-8009-ad48b977c782 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:57.501586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f706ca10-594f-4941-8009-ad48b977c782 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:57.502769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f706ca10-594f-4941-8009-ad48b977c782 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:57.503560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f706ca10-594f-4941-8009-ad48b977c782 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:57.504289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f706ca10-594f-4941-8009-ad48b977c782 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:57.718024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f706ca10-594f-4941-8009-ad48b977c782 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:57.726527 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f706ca10-594f-4941-8009-ad48b977c782 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1678 microversion: 2.1 time: 0.249715 Oct 05 18:50:57.727175 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3605/7453] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:57 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1678 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:58.754971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56745df0-4d7c-42a1-8b1b-9c546af93bbe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:58.755927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56745df0-4d7c-42a1-8b1b-9c546af93bbe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:58.764727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56745df0-4d7c-42a1-8b1b-9c546af93bbe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:58.765222 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56745df0-4d7c-42a1-8b1b-9c546af93bbe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:58.765665 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56745df0-4d7c-42a1-8b1b-9c546af93bbe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:58.766407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56745df0-4d7c-42a1-8b1b-9c546af93bbe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:58.766872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56745df0-4d7c-42a1-8b1b-9c546af93bbe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:58.767302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56745df0-4d7c-42a1-8b1b-9c546af93bbe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:58.903239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-56745df0-4d7c-42a1-8b1b-9c546af93bbe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:50:58.911936 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56745df0-4d7c-42a1-8b1b-9c546af93bbe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1678 microversion: 2.1 time: 0.163677 Oct 05 18:50:58.912546 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3849/7454] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:58 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:50:59.938949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-50fd3d0c-63f8-4c29-be3a-7232e29cfc46 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:50:59.939649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-50fd3d0c-63f8-4c29-be3a-7232e29cfc46 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:50:59.947222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50fd3d0c-63f8-4c29-be3a-7232e29cfc46 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:59.947701 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50fd3d0c-63f8-4c29-be3a-7232e29cfc46 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:59.948140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50fd3d0c-63f8-4c29-be3a-7232e29cfc46 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:50:59.948805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50fd3d0c-63f8-4c29-be3a-7232e29cfc46 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:50:59.949294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50fd3d0c-63f8-4c29-be3a-7232e29cfc46 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:50:59.949720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-50fd3d0c-63f8-4c29-be3a-7232e29cfc46 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:00.109382 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-50fd3d0c-63f8-4c29-be3a-7232e29cfc46 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:00.121230 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-50fd3d0c-63f8-4c29-be3a-7232e29cfc46 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1678 microversion: 2.1 time: 0.186292 Oct 05 18:51:00.121824 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3606/7455] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:50:59 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:01.149153 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1d92ba90-dc6e-45b1-b699-2b74c4ed2896 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:01.150152 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1d92ba90-dc6e-45b1-b699-2b74c4ed2896 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:01.162425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d92ba90-dc6e-45b1-b699-2b74c4ed2896 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:01.163170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d92ba90-dc6e-45b1-b699-2b74c4ed2896 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:01.163934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d92ba90-dc6e-45b1-b699-2b74c4ed2896 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:01.165115 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d92ba90-dc6e-45b1-b699-2b74c4ed2896 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:01.166072 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d92ba90-dc6e-45b1-b699-2b74c4ed2896 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:01.166598 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1d92ba90-dc6e-45b1-b699-2b74c4ed2896 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:01.313974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1d92ba90-dc6e-45b1-b699-2b74c4ed2896 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:01.322598 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1d92ba90-dc6e-45b1-b699-2b74c4ed2896 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1678 microversion: 2.1 time: 0.180178 Oct 05 18:51:01.323215 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3850/7456] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:01 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:02.351039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ea5e9c2b-fd4f-4b3e-a980-fcf66a150127 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:02.352032 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ea5e9c2b-fd4f-4b3e-a980-fcf66a150127 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:02.362618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea5e9c2b-fd4f-4b3e-a980-fcf66a150127 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:02.363432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea5e9c2b-fd4f-4b3e-a980-fcf66a150127 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:02.364196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea5e9c2b-fd4f-4b3e-a980-fcf66a150127 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:02.365297 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea5e9c2b-fd4f-4b3e-a980-fcf66a150127 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:02.366109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea5e9c2b-fd4f-4b3e-a980-fcf66a150127 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:02.366865 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ea5e9c2b-fd4f-4b3e-a980-fcf66a150127 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:02.506683 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ea5e9c2b-fd4f-4b3e-a980-fcf66a150127 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:02.515388 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ea5e9c2b-fd4f-4b3e-a980-fcf66a150127 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1678 microversion: 2.1 time: 0.171765 Oct 05 18:51:02.515967 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3607/7457] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:02 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:03.541949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d1bed895-e4e8-4171-a40e-ad4f00cd67d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:03.542619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d1bed895-e4e8-4171-a40e-ad4f00cd67d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:03.550077 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1bed895-e4e8-4171-a40e-ad4f00cd67d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:03.550649 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1bed895-e4e8-4171-a40e-ad4f00cd67d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:03.551106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1bed895-e4e8-4171-a40e-ad4f00cd67d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:03.551827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1bed895-e4e8-4171-a40e-ad4f00cd67d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:03.552301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1bed895-e4e8-4171-a40e-ad4f00cd67d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:03.552793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d1bed895-e4e8-4171-a40e-ad4f00cd67d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:03.687075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d1bed895-e4e8-4171-a40e-ad4f00cd67d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:03.695729 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d1bed895-e4e8-4171-a40e-ad4f00cd67d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1678 microversion: 2.1 time: 0.160002 Oct 05 18:51:03.696320 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3851/7458] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:03 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:04.723891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6f042069-aa2f-4399-9f87-6d372573957f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:04.724806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6f042069-aa2f-4399-9f87-6d372573957f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:04.733344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f042069-aa2f-4399-9f87-6d372573957f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:04.733838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f042069-aa2f-4399-9f87-6d372573957f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:04.734294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f042069-aa2f-4399-9f87-6d372573957f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:04.734996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f042069-aa2f-4399-9f87-6d372573957f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:04.735478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f042069-aa2f-4399-9f87-6d372573957f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:04.735882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f042069-aa2f-4399-9f87-6d372573957f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:04.871279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6f042069-aa2f-4399-9f87-6d372573957f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:04.879841 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6f042069-aa2f-4399-9f87-6d372573957f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1678 microversion: 2.1 time: 0.162903 Oct 05 18:51:04.880625 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3608/7459] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:04 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:05.903652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-33dfc1db-5416-4a53-9929-bec47f4f6f8e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:05.904203 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-33dfc1db-5416-4a53-9929-bec47f4f6f8e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:05.911496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33dfc1db-5416-4a53-9929-bec47f4f6f8e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:05.911995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33dfc1db-5416-4a53-9929-bec47f4f6f8e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:05.912439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33dfc1db-5416-4a53-9929-bec47f4f6f8e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:05.913226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33dfc1db-5416-4a53-9929-bec47f4f6f8e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:05.914296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33dfc1db-5416-4a53-9929-bec47f4f6f8e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:05.914739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-33dfc1db-5416-4a53-9929-bec47f4f6f8e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:06.058774 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-33dfc1db-5416-4a53-9929-bec47f4f6f8e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:06.066853 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-33dfc1db-5416-4a53-9929-bec47f4f6f8e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1678 microversion: 2.1 time: 0.167278 Oct 05 18:51:06.067452 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3852/7460] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:05 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:07.097377 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4f8167c1-b518-487b-881c-7f17643fe461 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:07.098093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4f8167c1-b518-487b-881c-7f17643fe461 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:07.105684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f8167c1-b518-487b-881c-7f17643fe461 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:07.106300 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f8167c1-b518-487b-881c-7f17643fe461 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:07.106643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f8167c1-b518-487b-881c-7f17643fe461 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:07.107342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f8167c1-b518-487b-881c-7f17643fe461 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:07.107796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f8167c1-b518-487b-881c-7f17643fe461 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:07.108223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4f8167c1-b518-487b-881c-7f17643fe461 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:07.244582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-4f8167c1-b518-487b-881c-7f17643fe461 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:07.252759 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4f8167c1-b518-487b-881c-7f17643fe461 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1678 microversion: 2.1 time: 0.159379 Oct 05 18:51:07.253343 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3609/7461] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:07 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:08.280071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e6ee715-fe90-4fd1-9536-f2c94ffe04bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:08.281109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e6ee715-fe90-4fd1-9536-f2c94ffe04bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:08.292767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6ee715-fe90-4fd1-9536-f2c94ffe04bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:08.293604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6ee715-fe90-4fd1-9536-f2c94ffe04bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:08.294361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6ee715-fe90-4fd1-9536-f2c94ffe04bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:08.295571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6ee715-fe90-4fd1-9536-f2c94ffe04bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:08.296356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6ee715-fe90-4fd1-9536-f2c94ffe04bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:08.297161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e6ee715-fe90-4fd1-9536-f2c94ffe04bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:08.443087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4e6ee715-fe90-4fd1-9536-f2c94ffe04bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:08.452155 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e6ee715-fe90-4fd1-9536-f2c94ffe04bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1681 microversion: 2.1 time: 0.178818 Oct 05 18:51:08.452794 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3853/7462] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:08 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:32.694438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-033b0711-2e8c-49e0-ac1f-f4952680cac7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:51:32.698128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-033b0711-2e8c-49e0-ac1f-f4952680cac7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:32.701232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=12 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:51:32.701902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:51:32.708405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-033b0711-2e8c-49e0-ac1f-f4952680cac7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:32.708903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-033b0711-2e8c-49e0-ac1f-f4952680cac7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:32.709364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-033b0711-2e8c-49e0-ac1f-f4952680cac7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:32.710068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-033b0711-2e8c-49e0-ac1f-f4952680cac7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:32.710548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-033b0711-2e8c-49e0-ac1f-f4952680cac7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:32.710970 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-033b0711-2e8c-49e0-ac1f-f4952680cac7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:32.775629 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-033b0711-2e8c-49e0-ac1f-f4952680cac7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72/action" status: 200 len: 68918 microversion: 2.1 time: 0.087963 Oct 05 18:51:32.776271 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3610/7463] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:51:32 2022] POST /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72/action => generated 68918 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:51:39.813533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-929bea77-d053-4e69-9c7c-a408562aea51 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:39.814173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-929bea77-d053-4e69-9c7c-a408562aea51 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:39.816869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-29103881-01da-43a5-ada3-fa1926d8eafd req-413838c1-6dd0-4732-96ad-1d87198391eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0297bb5d-f200-4b5b-b4ac-a6fb086c7a72", "tag": "952c043d-1be6-4f14-86f5-4fef7fe515ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:51:39.822137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=14 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:51:39.823082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=40 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:51:39.824770 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929bea77-d053-4e69-9c7c-a408562aea51 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:39.825395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929bea77-d053-4e69-9c7c-a408562aea51 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:39.826066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929bea77-d053-4e69-9c7c-a408562aea51 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:39.827038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929bea77-d053-4e69-9c7c-a408562aea51 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:39.827552 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929bea77-d053-4e69-9c7c-a408562aea51 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:39.828267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-929bea77-d053-4e69-9c7c-a408562aea51 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:39.832207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-29103881-01da-43a5-ada3-fa1926d8eafd req-413838c1-6dd0-4732-96ad-1d87198391eb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:39.832850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-29103881-01da-43a5-ada3-fa1926d8eafd req-413838c1-6dd0-4732-96ad-1d87198391eb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:39.833484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-29103881-01da-43a5-ada3-fa1926d8eafd req-413838c1-6dd0-4732-96ad-1d87198391eb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:39.845307 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-29103881-01da-43a5-ada3-fa1926d8eafd req-413838c1-6dd0-4732-96ad-1d87198391eb service nova] Creating event network-changed:952c043d-1be6-4f14-86f5-4fef7fe515ef for instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 on n-h1-835595-3 Oct 05 18:51:39.850839 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-29103881-01da-43a5-ada3-fa1926d8eafd req-413838c1-6dd0-4732-96ad-1d87198391eb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039508 Oct 05 18:51:39.851458 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3611/7464] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:51:39.857522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-929bea77-d053-4e69-9c7c-a408562aea51 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:51:39.965037 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-929bea77-d053-4e69-9c7c-a408562aea51 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "DELETE /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 204 len: 0 microversion: 2.1 time: 0.155764 Oct 05 18:51:39.965863 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3854/7465] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:51:39 2022] DELETE /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:51:39.975399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c3dd4a3d-1cd9-49e5-9c0a-2efd3ad9843c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:39.976228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3dd4a3d-1cd9-49e5-9c0a-2efd3ad9843c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:39.983767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3dd4a3d-1cd9-49e5-9c0a-2efd3ad9843c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:39.984269 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3dd4a3d-1cd9-49e5-9c0a-2efd3ad9843c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:39.984705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3dd4a3d-1cd9-49e5-9c0a-2efd3ad9843c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:39.985415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3dd4a3d-1cd9-49e5-9c0a-2efd3ad9843c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:39.985874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3dd4a3d-1cd9-49e5-9c0a-2efd3ad9843c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:39.986314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3dd4a3d-1cd9-49e5-9c0a-2efd3ad9843c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:40.468459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c3dd4a3d-1cd9-49e5-9c0a-2efd3ad9843c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:40.476704 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c3dd4a3d-1cd9-49e5-9c0a-2efd3ad9843c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1687 microversion: 2.1 time: 0.505737 Oct 05 18:51:40.477086 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3612/7466] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:39 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1687 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:51:41.502047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-489141c6-201a-4dc9-b062-9d057c36a539 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:41.504485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-489141c6-201a-4dc9-b062-9d057c36a539 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:41.510199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-489141c6-201a-4dc9-b062-9d057c36a539 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:41.510743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-489141c6-201a-4dc9-b062-9d057c36a539 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:41.511162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-489141c6-201a-4dc9-b062-9d057c36a539 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:41.511913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-489141c6-201a-4dc9-b062-9d057c36a539 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:41.512381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-489141c6-201a-4dc9-b062-9d057c36a539 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:41.513159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-489141c6-201a-4dc9-b062-9d057c36a539 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:41.736445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-489141c6-201a-4dc9-b062-9d057c36a539 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:41.745387 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-489141c6-201a-4dc9-b062-9d057c36a539 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 200 len: 1687 microversion: 2.1 time: 0.247699 Oct 05 18:51:41.746149 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3855/7467] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:41 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 1687 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:42.008947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-597449a4-b146-4ced-b658-a342cccedfc8 req-3b322809-29bf-42ea-977c-185bf306d176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0297bb5d-f200-4b5b-b4ac-a6fb086c7a72", "name": "network-vif-deleted", "tag": "952c043d-1be6-4f14-86f5-4fef7fe515ef"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:51:42.020924 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-597449a4-b146-4ced-b658-a342cccedfc8 req-3b322809-29bf-42ea-977c-185bf306d176 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:42.021699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-597449a4-b146-4ced-b658-a342cccedfc8 req-3b322809-29bf-42ea-977c-185bf306d176 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:42.022134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-597449a4-b146-4ced-b658-a342cccedfc8 req-3b322809-29bf-42ea-977c-185bf306d176 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:42.033201 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-597449a4-b146-4ced-b658-a342cccedfc8 req-3b322809-29bf-42ea-977c-185bf306d176 service nova] Creating event network-vif-deleted:952c043d-1be6-4f14-86f5-4fef7fe515ef for instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 on n-h1-835595-3 Oct 05 18:51:42.038023 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-597449a4-b146-4ced-b658-a342cccedfc8 req-3b322809-29bf-42ea-977c-185bf306d176 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032822 Oct 05 18:51:42.038776 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3613/7468] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:51:42.773471 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:42.774495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:42.786134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:42.787010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:42.787756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:42.788909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:42.789688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:42.790470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:42.807075 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] HTTP exception thrown: Instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 could not be found. Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Request method failure captured: Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 HTTP/1.1 Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPdGijeU7qFfC_ZC-2iZhrmZOWIAXMzv5itCrmjUOnT-6Aa05p-rcjGSx7tBZy0D-QS4h9HkcJxp_v1YhPgxyw6OEJyhnuQVEzFbh9isYsyeee9IVB0Y7pSdYkqX_y7MwhXl8c9Xz5rMnw1YHO9LVM_n5zXK8EqtQn7Ah_DiwCSq2s_M Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 4d5f5e1db74b41ecb00348934af567f9 Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d5f5e1db74b41ecb00348934af567f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d5f5e1db74b41ecb00348934af567f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d5f5e1db74b41ecb00348934af567f9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d5f5e1db74b41ecb00348934af567f9"}]}] Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 4d5f5e1db74b41ecb00348934af567f9 Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestNetworkAdvancedServerOps-402293327-project Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 50cf0acb7d924ed7a2829f7603209ca5 Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestNetworkAdvancedServerOps-402293327-project Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 could not be found. Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '0297bb5d-f200-4b5b-b4ac-a6fb086c7a72'} Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 could not be found. Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 could not be found. Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:51:42.808744 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 could not be found. Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Returning 404 to user: Instance 0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dbc1501d-388b-4071-94f4-767f4ca7b512 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72" status: 404 len: 111 microversion: 2.1 time: 0.043415 Oct 05 18:51:42.813300 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3856/7469] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:42 2022] GET /compute/v2.1/servers/0297bb5d-f200-4b5b-b4ac-a6fb086c7a72 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:51:46.238838 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a3271659-b0a2-4ba1-a496-8f88991dbad3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '.version_select at 0x7f776ff61160>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:46.274674 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a3271659-b0a2-4ba1-a496-8f88991dbad3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-529691099" status: 202 len: 0 microversion: 2.1 time: 0.041531 Oct 05 18:51:46.275380 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3614/7470] 10.222.0.70 () {58 vars in 1281 bytes} [Wed Oct 5 18:51:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-529691099 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:51:46.306269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9cc8b663-ea98-4c1c-9e4f-0497d1bd1913 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'create', calling method: .version_select at 0x7f7774378430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-330732952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFTlWZcS4g2L0QOcVQlz73n4t1GoG0JErpTK+aCsBEhiB0FKJMsKo8ggFOUUBnRMWKPjxa5X4XrAzGNBt/FwpDFaGb/7OtXcN3sZBMR/n1mRWgN0JZLqeMF2t5ywEj1qZw=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:51:46.324103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9cc8b663-ea98-4c1c-9e4f-0497d1bd1913 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:51:46.332848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-9cc8b663-ea98-4c1c-9e4f-0497d1bd1913 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for user 50cf0acb7d924ed7a2829f7603209ca5 and project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:51:46.356016 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9cc8b663-ea98-4c1c-9e4f-0497d1bd1913 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.053783 Oct 05 18:51:46.356728 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3857/7471] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:51:46 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:51:52.128395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=14 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:51:52.133381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-914510003", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "343852d7-65c9-4aca-b234-7a9f44eda807"}], "key_name": "tempest-TestNetworkAdvancedServerOps-330732952", "security_groups": [{"name": "tempest-secgroup-smoke-298528455"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:51:52.284170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] validate_networks() for [('343852d7-65c9-4aca-b234-7a9f44eda807', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:51:52.686987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:51:52.687448 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:51:52.687920 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:51:52.688327 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:51:52.688734 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:51:52.698038 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:52.698555 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:52.698993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:52.699691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:52.700212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:52.700615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:52.719903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:51:52.725234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for user 50cf0acb7d924ed7a2829f7603209ca5 and project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:51:52.738132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:51:52.741029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:51:52.786724 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [a7b70a10-373c-4631-a9c7-4b714321832a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 18:51:53.796067 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [a7b70a10-373c-4631-a9c7-4b714321832a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 37818. Oct 05 18:51:53.800302 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-84b98eef-1324-4f42-85c5-b3c83d5c3f0d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.673625 Oct 05 18:51:53.800936 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3615/7472] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:51:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 1675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:51:53.812848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cda5a0dd-6580-4b2c-89aa-971dd0470f68 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:53.813543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cda5a0dd-6580-4b2c-89aa-971dd0470f68 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:53.818083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:51:53.887181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cda5a0dd-6580-4b2c-89aa-971dd0470f68 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:53.908413 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cda5a0dd-6580-4b2c-89aa-971dd0470f68 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1265 microversion: 2.1 time: 0.099924 Oct 05 18:51:53.915226 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3858/7473] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:53 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1265 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:54.938168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-30500d24-3b0b-4765-8fe9-44796e3e24f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:54.939453 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30500d24-3b0b-4765-8fe9-44796e3e24f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:54.947162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30500d24-3b0b-4765-8fe9-44796e3e24f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:54.947646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30500d24-3b0b-4765-8fe9-44796e3e24f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:54.948078 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30500d24-3b0b-4765-8fe9-44796e3e24f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:54.948762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30500d24-3b0b-4765-8fe9-44796e3e24f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:54.949415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30500d24-3b0b-4765-8fe9-44796e3e24f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:54.949813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30500d24-3b0b-4765-8fe9-44796e3e24f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:55.045271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-30500d24-3b0b-4765-8fe9-44796e3e24f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:55.053530 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-30500d24-3b0b-4765-8fe9-44796e3e24f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1335 microversion: 2.1 time: 0.120169 Oct 05 18:51:55.054141 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3616/7474] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:54 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1335 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:56.077945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-044cd1d4-b97a-4efb-8beb-3dcb17c9b172 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:56.078986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-044cd1d4-b97a-4efb-8beb-3dcb17c9b172 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:56.090756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-044cd1d4-b97a-4efb-8beb-3dcb17c9b172 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:56.091263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-044cd1d4-b97a-4efb-8beb-3dcb17c9b172 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:56.091714 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-044cd1d4-b97a-4efb-8beb-3dcb17c9b172 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:56.092441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-044cd1d4-b97a-4efb-8beb-3dcb17c9b172 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:56.092943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-044cd1d4-b97a-4efb-8beb-3dcb17c9b172 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:56.093383 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-044cd1d4-b97a-4efb-8beb-3dcb17c9b172 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:56.237962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-044cd1d4-b97a-4efb-8beb-3dcb17c9b172 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:56.246380 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-044cd1d4-b97a-4efb-8beb-3dcb17c9b172 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1390 microversion: 2.1 time: 0.173069 Oct 05 18:51:56.247169 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3859/7475] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:56 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:56.404289 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-e3de40de-21d4-4116-961b-6a99b1e073ee req-059cd216-e613-4ec9-be4b-bc064ad97708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883077f6-8a8c-44a2-a30f-cc2e241ddc17", "tag": "25cef6fd-4048-4b4a-9fa5-e93959e4937d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:51:56.418092 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e3de40de-21d4-4116-961b-6a99b1e073ee req-059cd216-e613-4ec9-be4b-bc064ad97708 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:56.418887 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e3de40de-21d4-4116-961b-6a99b1e073ee req-059cd216-e613-4ec9-be4b-bc064ad97708 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:56.419496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-e3de40de-21d4-4116-961b-6a99b1e073ee req-059cd216-e613-4ec9-be4b-bc064ad97708 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:56.433448 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-e3de40de-21d4-4116-961b-6a99b1e073ee req-059cd216-e613-4ec9-be4b-bc064ad97708 service nova] Creating event network-changed:25cef6fd-4048-4b4a-9fa5-e93959e4937d for instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 on n-h2-835595-3 Oct 05 18:51:56.438520 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-e3de40de-21d4-4116-961b-6a99b1e073ee req-059cd216-e613-4ec9-be4b-bc064ad97708 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038308 Oct 05 18:51:56.439129 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3617/7476] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:51:57.269322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac14590f-5afc-44be-bfdb-c7bb0760fd4e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:57.269996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac14590f-5afc-44be-bfdb-c7bb0760fd4e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:57.277377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac14590f-5afc-44be-bfdb-c7bb0760fd4e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:57.277877 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac14590f-5afc-44be-bfdb-c7bb0760fd4e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:57.278302 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac14590f-5afc-44be-bfdb-c7bb0760fd4e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:57.279035 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac14590f-5afc-44be-bfdb-c7bb0760fd4e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:57.279504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac14590f-5afc-44be-bfdb-c7bb0760fd4e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:57.279937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac14590f-5afc-44be-bfdb-c7bb0760fd4e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:57.428816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ac14590f-5afc-44be-bfdb-c7bb0760fd4e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:57.437428 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac14590f-5afc-44be-bfdb-c7bb0760fd4e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1390 microversion: 2.1 time: 0.172327 Oct 05 18:51:57.438012 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3860/7477] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:57 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1390 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:58.466595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-99435297-2230-426b-815e-63e790e44f2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:58.467743 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-99435297-2230-426b-815e-63e790e44f2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:58.478389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99435297-2230-426b-815e-63e790e44f2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:58.479223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99435297-2230-426b-815e-63e790e44f2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:58.479951 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99435297-2230-426b-815e-63e790e44f2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:58.481105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99435297-2230-426b-815e-63e790e44f2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:58.481858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99435297-2230-426b-815e-63e790e44f2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:58.482637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-99435297-2230-426b-815e-63e790e44f2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:58.621499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-99435297-2230-426b-815e-63e790e44f2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:58.632163 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-99435297-2230-426b-815e-63e790e44f2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1390 microversion: 2.1 time: 0.174337 Oct 05 18:51:58.632751 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3618/7478] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:58 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1390 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:51:59.658962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ce541d0-a17c-412f-87ba-c361427e218c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:51:59.659742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3ce541d0-a17c-412f-87ba-c361427e218c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:51:59.668686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ce541d0-a17c-412f-87ba-c361427e218c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:59.669310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ce541d0-a17c-412f-87ba-c361427e218c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:59.669872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ce541d0-a17c-412f-87ba-c361427e218c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:59.670807 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ce541d0-a17c-412f-87ba-c361427e218c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:51:59.671401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ce541d0-a17c-412f-87ba-c361427e218c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:51:59.671940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ce541d0-a17c-412f-87ba-c361427e218c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:51:59.822592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3ce541d0-a17c-412f-87ba-c361427e218c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:51:59.830847 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ce541d0-a17c-412f-87ba-c361427e218c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1390 microversion: 2.1 time: 0.178025 Oct 05 18:51:59.831474 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3861/7479] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:51:59 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1390 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:00.858247 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1f9a7354-de63-4995-b8e9-889721a42fec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:00.859241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1f9a7354-de63-4995-b8e9-889721a42fec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:00.871518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f9a7354-de63-4995-b8e9-889721a42fec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:00.872331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f9a7354-de63-4995-b8e9-889721a42fec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:00.873052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f9a7354-de63-4995-b8e9-889721a42fec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:00.874189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f9a7354-de63-4995-b8e9-889721a42fec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:00.875012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f9a7354-de63-4995-b8e9-889721a42fec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:00.875678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f9a7354-de63-4995-b8e9-889721a42fec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:01.028046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1f9a7354-de63-4995-b8e9-889721a42fec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:01.037749 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1f9a7354-de63-4995-b8e9-889721a42fec tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1390 microversion: 2.1 time: 0.186080 Oct 05 18:52:01.038669 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3619/7480] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:00 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1390 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:02.037570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ecf54e1a-6acb-4d1a-9b8a-058f13c63d28 req-df7c4d53-b3e7-4d34-bae9-df106500373d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883077f6-8a8c-44a2-a30f-cc2e241ddc17", "name": "network-vif-plugged", "status": "completed", "tag": "25cef6fd-4048-4b4a-9fa5-e93959e4937d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:52:02.050432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ecf54e1a-6acb-4d1a-9b8a-058f13c63d28 req-df7c4d53-b3e7-4d34-bae9-df106500373d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:02.053567 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ecf54e1a-6acb-4d1a-9b8a-058f13c63d28 req-df7c4d53-b3e7-4d34-bae9-df106500373d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:02.054040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ecf54e1a-6acb-4d1a-9b8a-058f13c63d28 req-df7c4d53-b3e7-4d34-bae9-df106500373d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:02.060339 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f356bd6f-e987-4062-a612-3380524e861f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:02.061535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f356bd6f-e987-4062-a612-3380524e861f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:02.068534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f356bd6f-e987-4062-a612-3380524e861f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:02.069012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f356bd6f-e987-4062-a612-3380524e861f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:02.069326 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ecf54e1a-6acb-4d1a-9b8a-058f13c63d28 req-df7c4d53-b3e7-4d34-bae9-df106500373d service nova] Creating event network-vif-plugged:25cef6fd-4048-4b4a-9fa5-e93959e4937d for instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 on n-h2-835595-3 Oct 05 18:52:02.069639 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f356bd6f-e987-4062-a612-3380524e861f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:02.070363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f356bd6f-e987-4062-a612-3380524e861f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:02.070817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f356bd6f-e987-4062-a612-3380524e861f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:02.071237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f356bd6f-e987-4062-a612-3380524e861f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:02.075293 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ecf54e1a-6acb-4d1a-9b8a-058f13c63d28 req-df7c4d53-b3e7-4d34-bae9-df106500373d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041672 Oct 05 18:52:02.077002 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3862/7481] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:52:02.277076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f356bd6f-e987-4062-a612-3380524e861f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:02.289425 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f356bd6f-e987-4062-a612-3380524e861f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1390 microversion: 2.1 time: 0.232988 Oct 05 18:52:02.290299 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3620/7482] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:02 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1390 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:52:03.316636 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-03ae4d3b-c10e-41fd-ac6c-f40be14ffb00 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:03.317620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-03ae4d3b-c10e-41fd-ac6c-f40be14ffb00 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:03.324329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03ae4d3b-c10e-41fd-ac6c-f40be14ffb00 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:03.324824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03ae4d3b-c10e-41fd-ac6c-f40be14ffb00 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:03.325296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03ae4d3b-c10e-41fd-ac6c-f40be14ffb00 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:03.326058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03ae4d3b-c10e-41fd-ac6c-f40be14ffb00 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:03.326563 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03ae4d3b-c10e-41fd-ac6c-f40be14ffb00 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:03.327052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-03ae4d3b-c10e-41fd-ac6c-f40be14ffb00 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:03.493212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-03ae4d3b-c10e-41fd-ac6c-f40be14ffb00 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:03.504083 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-03ae4d3b-c10e-41fd-ac6c-f40be14ffb00 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1563 microversion: 2.1 time: 0.192537 Oct 05 18:52:03.504604 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3863/7483] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:03 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1563 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:03.528184 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c24037a3-6c46-4b10-bd61-338c775d430d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:03.528807 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c24037a3-6c46-4b10-bd61-338c775d430d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:03.530867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:52:03.531567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:52:03.533436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:52:03.539618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c24037a3-6c46-4b10-bd61-338c775d430d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:03.540103 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c24037a3-6c46-4b10-bd61-338c775d430d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:03.540536 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c24037a3-6c46-4b10-bd61-338c775d430d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:03.541235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c24037a3-6c46-4b10-bd61-338c775d430d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:03.541694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c24037a3-6c46-4b10-bd61-338c775d430d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:03.542115 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c24037a3-6c46-4b10-bd61-338c775d430d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:03.682678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c24037a3-6c46-4b10-bd61-338c775d430d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:03.690906 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c24037a3-6c46-4b10-bd61-338c775d430d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1563 microversion: 2.1 time: 0.166721 Oct 05 18:52:03.691484 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3621/7484] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:03 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:05.334832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b69c080c-ba63-4fdd-a68d-df8a659cf937 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:05.340356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-1b1b5318-8109-4de4-a374-66b0eb2ec3eb req-23bb5755-e487-4bf5-9c18-d7ac1bf1bf95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883077f6-8a8c-44a2-a30f-cc2e241ddc17", "tag": "25cef6fd-4048-4b4a-9fa5-e93959e4937d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:52:05.347507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b69c080c-ba63-4fdd-a68d-df8a659cf937 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:05.350102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:52:05.356736 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1b1b5318-8109-4de4-a374-66b0eb2ec3eb req-23bb5755-e487-4bf5-9c18-d7ac1bf1bf95 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:05.356944 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b69c080c-ba63-4fdd-a68d-df8a659cf937 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:05.357220 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1b1b5318-8109-4de4-a374-66b0eb2ec3eb req-23bb5755-e487-4bf5-9c18-d7ac1bf1bf95 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:05.357410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b69c080c-ba63-4fdd-a68d-df8a659cf937 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:05.357652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-1b1b5318-8109-4de4-a374-66b0eb2ec3eb req-23bb5755-e487-4bf5-9c18-d7ac1bf1bf95 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:05.357863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b69c080c-ba63-4fdd-a68d-df8a659cf937 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:05.358668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b69c080c-ba63-4fdd-a68d-df8a659cf937 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:05.359143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b69c080c-ba63-4fdd-a68d-df8a659cf937 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:05.360463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b69c080c-ba63-4fdd-a68d-df8a659cf937 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:05.371055 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-1b1b5318-8109-4de4-a374-66b0eb2ec3eb req-23bb5755-e487-4bf5-9c18-d7ac1bf1bf95 service nova] Creating event network-changed:25cef6fd-4048-4b4a-9fa5-e93959e4937d for instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 on n-h2-835595-3 Oct 05 18:52:05.376857 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-1b1b5318-8109-4de4-a374-66b0eb2ec3eb req-23bb5755-e487-4bf5-9c18-d7ac1bf1bf95 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040044 Oct 05 18:52:05.378048 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3622/7485] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:52:05.506432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b69c080c-ba63-4fdd-a68d-df8a659cf937 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:05.515463 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b69c080c-ba63-4fdd-a68d-df8a659cf937 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1563 microversion: 2.1 time: 0.184550 Oct 05 18:52:05.516066 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3864/7486] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:05 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1563 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:28.835971 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6f0f1437-632b-44e4-97a3-1362c0c0e119 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:52:28.838201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6f0f1437-632b-44e4-97a3-1362c0c0e119 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:28.843613 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:52:28.844298 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=36 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:52:28.851630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f0f1437-632b-44e4-97a3-1362c0c0e119 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:28.852122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f0f1437-632b-44e4-97a3-1362c0c0e119 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:28.852573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f0f1437-632b-44e4-97a3-1362c0c0e119 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:28.853263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f0f1437-632b-44e4-97a3-1362c0c0e119 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:28.853719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f0f1437-632b-44e4-97a3-1362c0c0e119 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:28.854137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6f0f1437-632b-44e4-97a3-1362c0c0e119 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:28.919654 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6f0f1437-632b-44e4-97a3-1362c0c0e119 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17/action" status: 200 len: 24572 microversion: 2.1 time: 0.089501 Oct 05 18:52:28.920710 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3623/7487] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:52:28 2022] POST /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17/action => generated 24572 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:52:35.336908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:52:35.340642 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:35.344078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:52:35.345372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=32 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:52:35.355420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:35.355952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:35.356380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:35.357140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:35.357604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:35.358022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:35.403988 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:35.410136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Old instance type m1.heat2, new instance type m1.heat {{(pid=128844) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 05 18:52:35.417344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:52:35.417784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:52:35.418291 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:52:35.418742 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:52:35.419165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:52:35.492848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-762ef8cf-d241-4605-bc90-cb8cfa19337c tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17/action" status: 202 len: 0 microversion: 2.1 time: 0.162826 Oct 05 18:52:35.493848 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3865/7488] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:52:35 2022] POST /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:52:35.502627 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-659ff3c7-f444-4623-9891-5c000761a862 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:35.503351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-659ff3c7-f444-4623-9891-5c000761a862 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:35.510907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659ff3c7-f444-4623-9891-5c000761a862 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:35.511390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659ff3c7-f444-4623-9891-5c000761a862 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:35.511949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659ff3c7-f444-4623-9891-5c000761a862 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:35.512700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659ff3c7-f444-4623-9891-5c000761a862 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:35.513149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659ff3c7-f444-4623-9891-5c000761a862 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:35.513571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-659ff3c7-f444-4623-9891-5c000761a862 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:35.652631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-659ff3c7-f444-4623-9891-5c000761a862 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:35.660458 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-659ff3c7-f444-4623-9891-5c000761a862 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1691 microversion: 2.1 time: 0.162136 Oct 05 18:52:35.661031 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3624/7489] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:35 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:36.685446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f0b007b-f5dc-4a05-a878-dcecda5703ab tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:36.686048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f0b007b-f5dc-4a05-a878-dcecda5703ab tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:36.693166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0b007b-f5dc-4a05-a878-dcecda5703ab tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:36.693719 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0b007b-f5dc-4a05-a878-dcecda5703ab tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:36.694254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0b007b-f5dc-4a05-a878-dcecda5703ab tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:36.695007 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0b007b-f5dc-4a05-a878-dcecda5703ab tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:36.695462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0b007b-f5dc-4a05-a878-dcecda5703ab tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:36.695955 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f0b007b-f5dc-4a05-a878-dcecda5703ab tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:36.830735 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f0b007b-f5dc-4a05-a878-dcecda5703ab tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:36.838949 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f0b007b-f5dc-4a05-a878-dcecda5703ab tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1691 microversion: 2.1 time: 0.158582 Oct 05 18:52:36.839620 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3866/7490] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:36 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:37.867265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-43cb8eea-b0e4-4fe6-b143-f0d8580564d0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:37.868305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-43cb8eea-b0e4-4fe6-b143-f0d8580564d0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:37.877689 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43cb8eea-b0e4-4fe6-b143-f0d8580564d0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:37.878144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43cb8eea-b0e4-4fe6-b143-f0d8580564d0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:37.878604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43cb8eea-b0e4-4fe6-b143-f0d8580564d0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:37.879295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43cb8eea-b0e4-4fe6-b143-f0d8580564d0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:37.879744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43cb8eea-b0e4-4fe6-b143-f0d8580564d0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:37.880162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-43cb8eea-b0e4-4fe6-b143-f0d8580564d0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:38.018121 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-43cb8eea-b0e4-4fe6-b143-f0d8580564d0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:38.026837 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-43cb8eea-b0e4-4fe6-b143-f0d8580564d0 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1696 microversion: 2.1 time: 0.166719 Oct 05 18:52:38.027425 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3625/7491] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:37 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1696 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:39.059195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1c6506a3-b5d8-4280-9a49-f4c294b0bac1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:39.059957 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1c6506a3-b5d8-4280-9a49-f4c294b0bac1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:39.068835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c6506a3-b5d8-4280-9a49-f4c294b0bac1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:39.069453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c6506a3-b5d8-4280-9a49-f4c294b0bac1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:39.070013 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c6506a3-b5d8-4280-9a49-f4c294b0bac1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:39.070909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c6506a3-b5d8-4280-9a49-f4c294b0bac1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:39.071527 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c6506a3-b5d8-4280-9a49-f4c294b0bac1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:39.072078 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1c6506a3-b5d8-4280-9a49-f4c294b0bac1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:39.223615 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1c6506a3-b5d8-4280-9a49-f4c294b0bac1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:39.232773 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1c6506a3-b5d8-4280-9a49-f4c294b0bac1 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1696 microversion: 2.1 time: 0.178504 Oct 05 18:52:39.233347 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3867/7492] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:39 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:40.260875 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-37fccfa9-0050-4e12-a615-12cfc0a321ff tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:40.261454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-37fccfa9-0050-4e12-a615-12cfc0a321ff tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:40.268744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37fccfa9-0050-4e12-a615-12cfc0a321ff tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:40.269228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37fccfa9-0050-4e12-a615-12cfc0a321ff tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:40.269666 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37fccfa9-0050-4e12-a615-12cfc0a321ff tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:40.270401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37fccfa9-0050-4e12-a615-12cfc0a321ff tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:40.270857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37fccfa9-0050-4e12-a615-12cfc0a321ff tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:40.271296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-37fccfa9-0050-4e12-a615-12cfc0a321ff tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:40.411098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-37fccfa9-0050-4e12-a615-12cfc0a321ff tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:40.419264 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-37fccfa9-0050-4e12-a615-12cfc0a321ff tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1696 microversion: 2.1 time: 0.165258 Oct 05 18:52:40.419879 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3626/7493] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:40 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:41.446967 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4c976a2b-90f3-4b29-8926-498fe4ed08dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:41.447961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4c976a2b-90f3-4b29-8926-498fe4ed08dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:41.459626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c976a2b-90f3-4b29-8926-498fe4ed08dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:41.460476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c976a2b-90f3-4b29-8926-498fe4ed08dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:41.461233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c976a2b-90f3-4b29-8926-498fe4ed08dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:41.462457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c976a2b-90f3-4b29-8926-498fe4ed08dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:41.463252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c976a2b-90f3-4b29-8926-498fe4ed08dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:41.464010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4c976a2b-90f3-4b29-8926-498fe4ed08dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:41.606038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4c976a2b-90f3-4b29-8926-498fe4ed08dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:41.618207 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4c976a2b-90f3-4b29-8926-498fe4ed08dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1696 microversion: 2.1 time: 0.177614 Oct 05 18:52:41.618839 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3868/7494] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:41 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1696 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:42.645364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-72b25f46-0773-49ba-89d2-1e376b1f5781 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:42.646340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-72b25f46-0773-49ba-89d2-1e376b1f5781 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:42.658099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b25f46-0773-49ba-89d2-1e376b1f5781 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:42.658977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b25f46-0773-49ba-89d2-1e376b1f5781 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:42.659708 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b25f46-0773-49ba-89d2-1e376b1f5781 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:42.660859 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b25f46-0773-49ba-89d2-1e376b1f5781 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:42.661624 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b25f46-0773-49ba-89d2-1e376b1f5781 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:42.662343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-72b25f46-0773-49ba-89d2-1e376b1f5781 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:42.807151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-72b25f46-0773-49ba-89d2-1e376b1f5781 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:42.819561 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-72b25f46-0773-49ba-89d2-1e376b1f5781 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1696 microversion: 2.1 time: 0.180502 Oct 05 18:52:42.820495 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3627/7495] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:42 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1696 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:43.847792 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4609951c-3bc0-459d-aa48-79e64dd0a35d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:43.848818 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4609951c-3bc0-459d-aa48-79e64dd0a35d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:43.860441 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4609951c-3bc0-459d-aa48-79e64dd0a35d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:43.861622 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4609951c-3bc0-459d-aa48-79e64dd0a35d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:43.862363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4609951c-3bc0-459d-aa48-79e64dd0a35d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:43.863560 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4609951c-3bc0-459d-aa48-79e64dd0a35d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:43.864333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4609951c-3bc0-459d-aa48-79e64dd0a35d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:43.865102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4609951c-3bc0-459d-aa48-79e64dd0a35d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:44.004795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4609951c-3bc0-459d-aa48-79e64dd0a35d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:44.014540 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4609951c-3bc0-459d-aa48-79e64dd0a35d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1696 microversion: 2.1 time: 0.173414 Oct 05 18:52:44.015117 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3869/7496] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:43 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:45.042780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2306fdce-18b9-4f71-ba2b-97d0324afbe7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:45.043392 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2306fdce-18b9-4f71-ba2b-97d0324afbe7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:45.050753 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2306fdce-18b9-4f71-ba2b-97d0324afbe7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:45.051260 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2306fdce-18b9-4f71-ba2b-97d0324afbe7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:45.051695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2306fdce-18b9-4f71-ba2b-97d0324afbe7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:45.052402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2306fdce-18b9-4f71-ba2b-97d0324afbe7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:45.052862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2306fdce-18b9-4f71-ba2b-97d0324afbe7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:45.053287 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2306fdce-18b9-4f71-ba2b-97d0324afbe7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:45.195005 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-2306fdce-18b9-4f71-ba2b-97d0324afbe7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:45.203275 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2306fdce-18b9-4f71-ba2b-97d0324afbe7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1696 microversion: 2.1 time: 0.167170 Oct 05 18:52:45.203923 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3628/7497] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:45 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1696 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:46.232489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-17786bab-dca0-487c-b43b-b1af5280334d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:46.233537 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-17786bab-dca0-487c-b43b-b1af5280334d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:46.245621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17786bab-dca0-487c-b43b-b1af5280334d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:46.246124 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17786bab-dca0-487c-b43b-b1af5280334d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:46.246612 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17786bab-dca0-487c-b43b-b1af5280334d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:46.247324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17786bab-dca0-487c-b43b-b1af5280334d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:46.247797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17786bab-dca0-487c-b43b-b1af5280334d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:46.248259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-17786bab-dca0-487c-b43b-b1af5280334d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:46.388680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-17786bab-dca0-487c-b43b-b1af5280334d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:46.396981 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-17786bab-dca0-487c-b43b-b1af5280334d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1696 microversion: 2.1 time: 0.172262 Oct 05 18:52:46.397537 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3870/7498] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:46 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1696 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:47.424675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aad7ad07-b974-4b15-a7cf-308e4290da36 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:47.425856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aad7ad07-b974-4b15-a7cf-308e4290da36 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:47.435726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad7ad07-b974-4b15-a7cf-308e4290da36 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:47.436218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad7ad07-b974-4b15-a7cf-308e4290da36 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:47.436657 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad7ad07-b974-4b15-a7cf-308e4290da36 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:47.437350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad7ad07-b974-4b15-a7cf-308e4290da36 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:47.437805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad7ad07-b974-4b15-a7cf-308e4290da36 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:47.438214 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aad7ad07-b974-4b15-a7cf-308e4290da36 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:47.589469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-aad7ad07-b974-4b15-a7cf-308e4290da36 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:47.597728 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aad7ad07-b974-4b15-a7cf-308e4290da36 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1696 microversion: 2.1 time: 0.180096 Oct 05 18:52:47.598317 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3629/7499] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:47 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:48.625309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2df270ef-bb63-43ac-929c-7645bdf9b0fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:48.626324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2df270ef-bb63-43ac-929c-7645bdf9b0fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:48.636756 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df270ef-bb63-43ac-929c-7645bdf9b0fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:48.637275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df270ef-bb63-43ac-929c-7645bdf9b0fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:48.637727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df270ef-bb63-43ac-929c-7645bdf9b0fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:48.638488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df270ef-bb63-43ac-929c-7645bdf9b0fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:48.638963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df270ef-bb63-43ac-929c-7645bdf9b0fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:48.639417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2df270ef-bb63-43ac-929c-7645bdf9b0fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:48.792380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2df270ef-bb63-43ac-929c-7645bdf9b0fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:48.800700 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2df270ef-bb63-43ac-929c-7645bdf9b0fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1696 microversion: 2.1 time: 0.182021 Oct 05 18:52:48.801276 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3871/7500] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:48 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1696 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:49.824560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-21835e0f-1c33-498f-8582-f096ed699c2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:49.825225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-21835e0f-1c33-498f-8582-f096ed699c2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:49.832699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21835e0f-1c33-498f-8582-f096ed699c2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:49.833163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21835e0f-1c33-498f-8582-f096ed699c2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:49.833694 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21835e0f-1c33-498f-8582-f096ed699c2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:49.834435 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21835e0f-1c33-498f-8582-f096ed699c2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:49.834898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21835e0f-1c33-498f-8582-f096ed699c2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:49.835328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-21835e0f-1c33-498f-8582-f096ed699c2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:49.964329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9e3c8c47-02f0-4830-9286-c7e831f9d83b req-9a98ee1d-a4ee-41ec-9dbc-d78fc6f01595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883077f6-8a8c-44a2-a30f-cc2e241ddc17", "name": "network-vif-unplugged", "status": "completed", "tag": "25cef6fd-4048-4b4a-9fa5-e93959e4937d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:52:49.978377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9e3c8c47-02f0-4830-9286-c7e831f9d83b req-9a98ee1d-a4ee-41ec-9dbc-d78fc6f01595 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:49.979074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9e3c8c47-02f0-4830-9286-c7e831f9d83b req-9a98ee1d-a4ee-41ec-9dbc-d78fc6f01595 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:49.979605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-21835e0f-1c33-498f-8582-f096ed699c2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:49.980065 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9e3c8c47-02f0-4830-9286-c7e831f9d83b req-9a98ee1d-a4ee-41ec-9dbc-d78fc6f01595 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:49.988094 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-21835e0f-1c33-498f-8582-f096ed699c2b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1695 microversion: 2.1 time: 0.167507 Oct 05 18:52:49.988668 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3630/7501] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:49 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1695 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:49.994327 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9e3c8c47-02f0-4830-9286-c7e831f9d83b req-9a98ee1d-a4ee-41ec-9dbc-d78fc6f01595 service nova] Creating event network-vif-unplugged:25cef6fd-4048-4b4a-9fa5-e93959e4937d for instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 on n-h1-835595-3 Oct 05 18:52:50.000434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-9e3c8c47-02f0-4830-9286-c7e831f9d83b req-9a98ee1d-a4ee-41ec-9dbc-d78fc6f01595 service nova] Instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:52:50.012462 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9e3c8c47-02f0-4830-9286-c7e831f9d83b req-9a98ee1d-a4ee-41ec-9dbc-d78fc6f01595 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053668 Oct 05 18:52:50.013245 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3872/7502] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:52:51.013629 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a5df74c-dfc5-45b1-91ae-862b113412c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:51.014240 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a5df74c-dfc5-45b1-91ae-862b113412c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:51.022216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5df74c-dfc5-45b1-91ae-862b113412c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:51.022752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5df74c-dfc5-45b1-91ae-862b113412c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:51.023183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5df74c-dfc5-45b1-91ae-862b113412c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:51.023904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5df74c-dfc5-45b1-91ae-862b113412c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:51.024388 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5df74c-dfc5-45b1-91ae-862b113412c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:51.024813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6a5df74c-dfc5-45b1-91ae-862b113412c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:51.172225 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6a5df74c-dfc5-45b1-91ae-862b113412c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:51.181073 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a5df74c-dfc5-45b1-91ae-862b113412c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1695 microversion: 2.1 time: 0.171501 Oct 05 18:52:51.181808 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3631/7503] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:51 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:52.061143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-fe728777-b7b6-43b8-a271-0b4e41e55f77 req-022d07fd-0059-441d-a04e-c36a7aa92235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883077f6-8a8c-44a2-a30f-cc2e241ddc17", "tag": "25cef6fd-4048-4b4a-9fa5-e93959e4937d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:52:52.071306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fe728777-b7b6-43b8-a271-0b4e41e55f77 req-022d07fd-0059-441d-a04e-c36a7aa92235 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:52.071800 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fe728777-b7b6-43b8-a271-0b4e41e55f77 req-022d07fd-0059-441d-a04e-c36a7aa92235 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:52.072243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fe728777-b7b6-43b8-a271-0b4e41e55f77 req-022d07fd-0059-441d-a04e-c36a7aa92235 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:52.084297 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-fe728777-b7b6-43b8-a271-0b4e41e55f77 req-022d07fd-0059-441d-a04e-c36a7aa92235 service nova] Creating event network-changed:25cef6fd-4048-4b4a-9fa5-e93959e4937d for instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 on n-h1-835595-3 Oct 05 18:52:52.090103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [req-fe728777-b7b6-43b8-a271-0b4e41e55f77 req-022d07fd-0059-441d-a04e-c36a7aa92235 service nova] Instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-835595-3', 'n-h2-835595-3'} {{(pid=128844) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 05 18:52:52.101171 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-fe728777-b7b6-43b8-a271-0b4e41e55f77 req-022d07fd-0059-441d-a04e-c36a7aa92235 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046012 Oct 05 18:52:52.101759 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3873/7504] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:52:52.204746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1af6a14a-8eb1-40b8-80ea-f5bf8bdd9b32 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:52.205471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1af6a14a-8eb1-40b8-80ea-f5bf8bdd9b32 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:52.212520 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af6a14a-8eb1-40b8-80ea-f5bf8bdd9b32 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:52.213350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af6a14a-8eb1-40b8-80ea-f5bf8bdd9b32 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:52.214015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af6a14a-8eb1-40b8-80ea-f5bf8bdd9b32 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:52.215389 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af6a14a-8eb1-40b8-80ea-f5bf8bdd9b32 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:52.215842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af6a14a-8eb1-40b8-80ea-f5bf8bdd9b32 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:52.216263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1af6a14a-8eb1-40b8-80ea-f5bf8bdd9b32 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:52.389387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1af6a14a-8eb1-40b8-80ea-f5bf8bdd9b32 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:52.398159 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1af6a14a-8eb1-40b8-80ea-f5bf8bdd9b32 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1693 microversion: 2.1 time: 0.197359 Oct 05 18:52:52.398774 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3632/7505] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:52 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1693 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:53.422855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dd77aaa4-66d4-4c3a-8498-02c472c873fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:53.423584 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dd77aaa4-66d4-4c3a-8498-02c472c873fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:53.429959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd77aaa4-66d4-4c3a-8498-02c472c873fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:53.430492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd77aaa4-66d4-4c3a-8498-02c472c873fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:53.431017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd77aaa4-66d4-4c3a-8498-02c472c873fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:53.431841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd77aaa4-66d4-4c3a-8498-02c472c873fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:53.432325 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd77aaa4-66d4-4c3a-8498-02c472c873fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:53.432771 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dd77aaa4-66d4-4c3a-8498-02c472c873fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:53.575502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-dd77aaa4-66d4-4c3a-8498-02c472c873fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:53.583531 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dd77aaa4-66d4-4c3a-8498-02c472c873fe tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1690 microversion: 2.1 time: 0.166074 Oct 05 18:52:53.584110 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3874/7506] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:53 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1690 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:53.605966 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-54c5ba1c-dfe3-4e9b-accf-4a03279848a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:52:53.606573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-54c5ba1c-dfe3-4e9b-accf-4a03279848a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:53.614347 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54c5ba1c-dfe3-4e9b-accf-4a03279848a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:53.614848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54c5ba1c-dfe3-4e9b-accf-4a03279848a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:53.615293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54c5ba1c-dfe3-4e9b-accf-4a03279848a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:53.615993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54c5ba1c-dfe3-4e9b-accf-4a03279848a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:53.616449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54c5ba1c-dfe3-4e9b-accf-4a03279848a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:53.617040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-54c5ba1c-dfe3-4e9b-accf-4a03279848a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:53.680297 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-54c5ba1c-dfe3-4e9b-accf-4a03279848a6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17/action" status: 204 len: 0 microversion: 2.1 time: 0.077945 Oct 05 18:52:53.680960 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3633/7507] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:52:53 2022] POST /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:52:53.690723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6830bff1-4e6f-4cbf-9f77-95e233e15b90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:53.691352 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6830bff1-4e6f-4cbf-9f77-95e233e15b90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:53.699290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6830bff1-4e6f-4cbf-9f77-95e233e15b90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:53.699803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6830bff1-4e6f-4cbf-9f77-95e233e15b90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:53.700266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6830bff1-4e6f-4cbf-9f77-95e233e15b90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:53.701169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6830bff1-4e6f-4cbf-9f77-95e233e15b90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:53.701679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6830bff1-4e6f-4cbf-9f77-95e233e15b90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:53.702130 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6830bff1-4e6f-4cbf-9f77-95e233e15b90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:53.857192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6830bff1-4e6f-4cbf-9f77-95e233e15b90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:53.871976 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6830bff1-4e6f-4cbf-9f77-95e233e15b90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1690 microversion: 2.1 time: 0.186250 Oct 05 18:52:53.886473 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3875/7508] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:53 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1690 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:53.895099 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-acd88353-c5d4-4167-9f8c-fcd5354a549e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:53.895810 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-acd88353-c5d4-4167-9f8c-fcd5354a549e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:53.901930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acd88353-c5d4-4167-9f8c-fcd5354a549e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:53.902829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acd88353-c5d4-4167-9f8c-fcd5354a549e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:53.903272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acd88353-c5d4-4167-9f8c-fcd5354a549e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:53.903979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acd88353-c5d4-4167-9f8c-fcd5354a549e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:53.904436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acd88353-c5d4-4167-9f8c-fcd5354a549e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:53.904860 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-acd88353-c5d4-4167-9f8c-fcd5354a549e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:54.138698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-acd88353-c5d4-4167-9f8c-fcd5354a549e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:54.147537 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-acd88353-c5d4-4167-9f8c-fcd5354a549e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1690 microversion: 2.1 time: 0.256719 Oct 05 18:52:54.148188 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3634/7509] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:53 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1690 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:55.171155 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2b0a95e1-8801-4070-956e-190ef12b5756 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:52:55.171754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2b0a95e1-8801-4070-956e-190ef12b5756 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:52:55.179234 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b0a95e1-8801-4070-956e-190ef12b5756 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:55.179738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b0a95e1-8801-4070-956e-190ef12b5756 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:55.180171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b0a95e1-8801-4070-956e-190ef12b5756 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:55.180900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b0a95e1-8801-4070-956e-190ef12b5756 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:55.181440 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b0a95e1-8801-4070-956e-190ef12b5756 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:55.181873 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2b0a95e1-8801-4070-956e-190ef12b5756 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:55.333592 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2b0a95e1-8801-4070-956e-190ef12b5756 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:52:55.342771 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2b0a95e1-8801-4070-956e-190ef12b5756 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1682 microversion: 2.1 time: 0.175607 Oct 05 18:52:55.343462 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3876/7510] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:52:55 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:52:55.556083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-83973c75-6d17-48d2-b15a-8ebdeb0fb922 req-9a248f8f-2c30-40fd-92e1-bb2a465fed5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883077f6-8a8c-44a2-a30f-cc2e241ddc17", "name": "network-vif-plugged", "status": "completed", "tag": "25cef6fd-4048-4b4a-9fa5-e93959e4937d"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:52:55.566586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-83973c75-6d17-48d2-b15a-8ebdeb0fb922 req-9a248f8f-2c30-40fd-92e1-bb2a465fed5b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:52:55.567090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-83973c75-6d17-48d2-b15a-8ebdeb0fb922 req-9a248f8f-2c30-40fd-92e1-bb2a465fed5b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:52:55.567528 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-83973c75-6d17-48d2-b15a-8ebdeb0fb922 req-9a248f8f-2c30-40fd-92e1-bb2a465fed5b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:52:55.579247 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-83973c75-6d17-48d2-b15a-8ebdeb0fb922 req-9a248f8f-2c30-40fd-92e1-bb2a465fed5b service nova] Creating event network-vif-plugged:25cef6fd-4048-4b4a-9fa5-e93959e4937d for instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 on n-h1-835595-3 Oct 05 18:52:55.584613 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-83973c75-6d17-48d2-b15a-8ebdeb0fb922 req-9a248f8f-2c30-40fd-92e1-bb2a465fed5b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128348 Oct 05 18:52:55.585335 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3635/7511] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:53:17.558232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ba81a4d8-1608-4db3-97de-c833d6eabd57 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:53:17.560545 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ba81a4d8-1608-4db3-97de-c833d6eabd57 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:17.563098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=28 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:53:17.564633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:53:17.571146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba81a4d8-1608-4db3-97de-c833d6eabd57 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:17.571645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba81a4d8-1608-4db3-97de-c833d6eabd57 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:17.572100 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba81a4d8-1608-4db3-97de-c833d6eabd57 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:17.572797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba81a4d8-1608-4db3-97de-c833d6eabd57 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:17.573266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba81a4d8-1608-4db3-97de-c833d6eabd57 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:17.573699 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ba81a4d8-1608-4db3-97de-c833d6eabd57 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:17.630940 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ba81a4d8-1608-4db3-97de-c833d6eabd57 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17/action" status: 200 len: 24582 microversion: 2.1 time: 0.076885 Oct 05 18:53:17.631866 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3877/7512] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:53:17 2022] POST /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17/action => generated 24582 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:53:24.664911 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=26 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:53:24.666137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:53:24.668913 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-40bb4f79-f509-4704-8bc4-6235007c24cf req-2a8e6269-be89-44d4-97ba-7b9614a729a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883077f6-8a8c-44a2-a30f-cc2e241ddc17", "tag": "25cef6fd-4048-4b4a-9fa5-e93959e4937d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:53:24.670253 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-688ec896-10c8-4751-8e92-c24b3b5c89c4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:24.670975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-688ec896-10c8-4751-8e92-c24b3b5c89c4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:24.678952 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-688ec896-10c8-4751-8e92-c24b3b5c89c4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:24.679469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-688ec896-10c8-4751-8e92-c24b3b5c89c4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:24.679891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-688ec896-10c8-4751-8e92-c24b3b5c89c4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:24.680340 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-40bb4f79-f509-4704-8bc4-6235007c24cf req-2a8e6269-be89-44d4-97ba-7b9614a729a4 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:24.680717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-688ec896-10c8-4751-8e92-c24b3b5c89c4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:24.680833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-40bb4f79-f509-4704-8bc4-6235007c24cf req-2a8e6269-be89-44d4-97ba-7b9614a729a4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:24.681181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-688ec896-10c8-4751-8e92-c24b3b5c89c4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:24.681294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-40bb4f79-f509-4704-8bc4-6235007c24cf req-2a8e6269-be89-44d4-97ba-7b9614a729a4 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:24.681762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-688ec896-10c8-4751-8e92-c24b3b5c89c4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:24.694674 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-40bb4f79-f509-4704-8bc4-6235007c24cf req-2a8e6269-be89-44d4-97ba-7b9614a729a4 service nova] Creating event network-changed:25cef6fd-4048-4b4a-9fa5-e93959e4937d for instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 on n-h1-835595-3 Oct 05 18:53:24.701493 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-40bb4f79-f509-4704-8bc4-6235007c24cf req-2a8e6269-be89-44d4-97ba-7b9614a729a4 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036805 Oct 05 18:53:24.703132 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3878/7513] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:53:24.709918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-688ec896-10c8-4751-8e92-c24b3b5c89c4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:53:24.798478 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-688ec896-10c8-4751-8e92-c24b3b5c89c4 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "DELETE /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 204 len: 0 microversion: 2.1 time: 0.135887 Oct 05 18:53:24.802578 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3636/7514] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:53:24 2022] DELETE /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:53:24.810647 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12d7b8a3-cde7-423f-9653-ee1d88948ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:24.811413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12d7b8a3-cde7-423f-9653-ee1d88948ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:24.819046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12d7b8a3-cde7-423f-9653-ee1d88948ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:24.819558 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12d7b8a3-cde7-423f-9653-ee1d88948ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:24.820014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12d7b8a3-cde7-423f-9653-ee1d88948ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:24.820995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12d7b8a3-cde7-423f-9653-ee1d88948ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:24.821469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12d7b8a3-cde7-423f-9653-ee1d88948ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:24.821911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12d7b8a3-cde7-423f-9653-ee1d88948ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:24.986623 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-12d7b8a3-cde7-423f-9653-ee1d88948ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:24.994777 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12d7b8a3-cde7-423f-9653-ee1d88948ad8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1688 microversion: 2.1 time: 0.190836 Oct 05 18:53:24.995741 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3879/7515] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:24 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:53:26.019558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5d0de05a-b68d-4b62-bd26-86b8168c8cde tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:26.020249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5d0de05a-b68d-4b62-bd26-86b8168c8cde tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:26.027576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d0de05a-b68d-4b62-bd26-86b8168c8cde tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:26.028077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d0de05a-b68d-4b62-bd26-86b8168c8cde tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:26.028516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d0de05a-b68d-4b62-bd26-86b8168c8cde tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:26.029224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d0de05a-b68d-4b62-bd26-86b8168c8cde tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:26.029678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d0de05a-b68d-4b62-bd26-86b8168c8cde tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:26.030109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d0de05a-b68d-4b62-bd26-86b8168c8cde tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:26.256459 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5d0de05a-b68d-4b62-bd26-86b8168c8cde tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:26.265046 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5d0de05a-b68d-4b62-bd26-86b8168c8cde tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 200 len: 1688 microversion: 2.1 time: 0.250095 Oct 05 18:53:26.265625 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3637/7516] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:26 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 1688 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:26.599524 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-eadebe27-2ecc-4dae-b51a-972a3f77aec4 req-07fd4988-2eb1-4a24-b2e4-0416293b7ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883077f6-8a8c-44a2-a30f-cc2e241ddc17", "name": "network-vif-deleted", "tag": "25cef6fd-4048-4b4a-9fa5-e93959e4937d"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:53:26.611667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-eadebe27-2ecc-4dae-b51a-972a3f77aec4 req-07fd4988-2eb1-4a24-b2e4-0416293b7ed0 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:26.612165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-eadebe27-2ecc-4dae-b51a-972a3f77aec4 req-07fd4988-2eb1-4a24-b2e4-0416293b7ed0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:26.612609 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-eadebe27-2ecc-4dae-b51a-972a3f77aec4 req-07fd4988-2eb1-4a24-b2e4-0416293b7ed0 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:26.624342 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-eadebe27-2ecc-4dae-b51a-972a3f77aec4 req-07fd4988-2eb1-4a24-b2e4-0416293b7ed0 service nova] Creating event network-vif-deleted:25cef6fd-4048-4b4a-9fa5-e93959e4937d for instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 on n-h1-835595-3 Oct 05 18:53:26.629631 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-eadebe27-2ecc-4dae-b51a-972a3f77aec4 req-07fd4988-2eb1-4a24-b2e4-0416293b7ed0 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033864 Oct 05 18:53:26.630455 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3880/7517] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:53:27.294171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:27.295250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 883077f6-8a8c-44a2-a30f-cc2e241ddc17] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:27.306941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:27.307684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:27.308391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:27.309517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:27.310265 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:27.311012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:27.328727 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] HTTP exception thrown: Instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 could not be found. Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Request method failure captured: Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 HTTP/1.1 Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPdGijeU7qFfC_ZC-2iZhrmZOWIAXMzv5itCrmjUOnT-6Aa05p-rcjGSx7tBZy0D-QS4h9HkcJxp_v1YhPgxyw6OEJyhnuQVEzFbh9isYsyeee9IVB0Y7pSdYkqX_y7MwhXl8c9Xz5rMnw1YHO9LVM_n5zXK8EqtQn7Ah_DiwCSq2s_M Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4d5f5e1db74b41ecb00348934af567f9 Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d5f5e1db74b41ecb00348934af567f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d5f5e1db74b41ecb00348934af567f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d5f5e1db74b41ecb00348934af567f9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d5f5e1db74b41ecb00348934af567f9"}]}] Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4d5f5e1db74b41ecb00348934af567f9 Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestNetworkAdvancedServerOps-402293327-project Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 50cf0acb7d924ed7a2829f7603209ca5 Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestNetworkAdvancedServerOps-402293327-project Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 could not be found. Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '883077f6-8a8c-44a2-a30f-cc2e241ddc17'} Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 could not be found. Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 could not be found. Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:53:27.330408 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 could not be found. Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Returning 404 to user: Instance 883077f6-8a8c-44a2-a30f-cc2e241ddc17 could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d1d10ff3-40c3-492d-82ba-375a285da506 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17" status: 404 len: 111 microversion: 2.1 time: 0.044875 Oct 05 18:53:27.335576 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3638/7518] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:27 2022] GET /compute/v2.1/servers/883077f6-8a8c-44a2-a30f-cc2e241ddc17 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:53:30.685568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d72e21ab-a2b5-4f97-a36f-5a5edff142ee tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '.version_select at 0x7f77756373a0>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:30.707929 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d72e21ab-a2b5-4f97-a36f-5a5edff142ee tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-330732952" status: 202 len: 0 microversion: 2.1 time: 0.027869 Oct 05 18:53:30.708697 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3881/7519] 10.222.0.70 () {58 vars in 1281 bytes} [Wed Oct 5 18:53:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-330732952 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:53:30.734833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b9140e39-1ed0-44da-b205-8072eae558b3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'create', calling method: .version_select at 0x7f7775bb80d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1096370645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgvNB4kUOHUZNZLNlGcsI6Ux+o2Gpzoc3jqzbhDv6GlMOSCuMcAGUGVWPOtDa0x3/CY62gn43xLLzX+at1JT9rCI/TKdgnNvLYHNm5Y7w1Swoj0S3ClNQJch55P8m4vgQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:53:30.751610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b9140e39-1ed0-44da-b205-8072eae558b3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:53:30.757779 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-b9140e39-1ed0-44da-b205-8072eae558b3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for user 50cf0acb7d924ed7a2829f7603209ca5 and project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:53:30.783339 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b9140e39-1ed0-44da-b205-8072eae558b3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052914 Oct 05 18:53:30.783962 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3639/7520] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:53:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:53:36.802465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=14 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:53:36.807390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-461524984", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "6adef99e-0baa-4b2e-9d4b-f3a973ac89e0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1096370645", "security_groups": [{"name": "tempest-secgroup-smoke-1484956820"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:53:36.918586 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] validate_networks() for [('6adef99e-0baa-4b2e-9d4b-f3a973ac89e0', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:53:37.365923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:53:37.366522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:53:37.367447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:53:37.367961 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:53:37.368606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:53:37.379517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:37.380219 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:37.380863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:37.381610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:37.382086 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:37.382769 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:37.403200 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:53:37.408997 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for user 50cf0acb7d924ed7a2829f7603209ca5 and project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:53:37.424392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:53:37.427145 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:53:37.478779 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-fb3fe9cd-c89e-4c7b-a393-58cbbde6e6dc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.677895 Oct 05 18:53:37.479897 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3882/7521] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:53:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:53:37.489316 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:53:37.499272 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6a71c954-6985-4712-9923-92d487a4b615 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:37.500047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6a71c954-6985-4712-9923-92d487a4b615 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:37.581795 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6a71c954-6985-4712-9923-92d487a4b615 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:37.589246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6a71c954-6985-4712-9923-92d487a4b615 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1266 microversion: 2.1 time: 0.101768 Oct 05 18:53:37.591495 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3640/7522] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:37 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:38.615286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ecc02ed3-fac8-4109-a1fb-7d858527427a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:38.617091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ecc02ed3-fac8-4109-a1fb-7d858527427a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:38.625855 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecc02ed3-fac8-4109-a1fb-7d858527427a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:38.626690 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecc02ed3-fac8-4109-a1fb-7d858527427a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:38.627344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecc02ed3-fac8-4109-a1fb-7d858527427a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:38.628259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecc02ed3-fac8-4109-a1fb-7d858527427a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:38.628876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecc02ed3-fac8-4109-a1fb-7d858527427a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:38.630307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecc02ed3-fac8-4109-a1fb-7d858527427a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:38.705538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ecc02ed3-fac8-4109-a1fb-7d858527427a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:38.716088 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ecc02ed3-fac8-4109-a1fb-7d858527427a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1336 microversion: 2.1 time: 0.106180 Oct 05 18:53:38.718931 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3883/7523] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:38 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1336 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:39.742451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f3e22b57-e138-4ac6-8d75-c92f8dc05f07 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:39.743169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f3e22b57-e138-4ac6-8d75-c92f8dc05f07 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:39.751299 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3e22b57-e138-4ac6-8d75-c92f8dc05f07 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:39.753677 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3e22b57-e138-4ac6-8d75-c92f8dc05f07 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:39.754122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3e22b57-e138-4ac6-8d75-c92f8dc05f07 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:39.754927 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3e22b57-e138-4ac6-8d75-c92f8dc05f07 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:39.755312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3e22b57-e138-4ac6-8d75-c92f8dc05f07 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:39.755739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f3e22b57-e138-4ac6-8d75-c92f8dc05f07 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:39.961445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f3e22b57-e138-4ac6-8d75-c92f8dc05f07 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:39.974620 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f3e22b57-e138-4ac6-8d75-c92f8dc05f07 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1392 microversion: 2.1 time: 0.236477 Oct 05 18:53:39.975343 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3641/7524] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:39 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1392 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:40.153109 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-3863ab4c-79d7-4f54-8630-8a9ad0849760 req-ee1a18c5-f27d-4229-87b1-ac3a00a32f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dced407-89ad-4e82-b048-2091e8ae461f", "tag": "607ea19b-81a6-474a-b881-19560f1de46e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:53:40.187472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3863ab4c-79d7-4f54-8630-8a9ad0849760 req-ee1a18c5-f27d-4229-87b1-ac3a00a32f95 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:40.188123 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3863ab4c-79d7-4f54-8630-8a9ad0849760 req-ee1a18c5-f27d-4229-87b1-ac3a00a32f95 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:40.188667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-3863ab4c-79d7-4f54-8630-8a9ad0849760 req-ee1a18c5-f27d-4229-87b1-ac3a00a32f95 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:40.205570 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-3863ab4c-79d7-4f54-8630-8a9ad0849760 req-ee1a18c5-f27d-4229-87b1-ac3a00a32f95 service nova] Creating event network-changed:607ea19b-81a6-474a-b881-19560f1de46e for instance 4dced407-89ad-4e82-b048-2091e8ae461f on n-h2-835595-3 Oct 05 18:53:40.211716 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-3863ab4c-79d7-4f54-8630-8a9ad0849760 req-ee1a18c5-f27d-4229-87b1-ac3a00a32f95 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066730 Oct 05 18:53:40.212775 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3884/7525] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:53:41.000427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6649a4f-17cc-4d9e-b356-1f987f2b9665 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:41.000999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c6649a4f-17cc-4d9e-b356-1f987f2b9665 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:41.008626 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6649a4f-17cc-4d9e-b356-1f987f2b9665 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:41.009118 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6649a4f-17cc-4d9e-b356-1f987f2b9665 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:41.009558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6649a4f-17cc-4d9e-b356-1f987f2b9665 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:41.010266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6649a4f-17cc-4d9e-b356-1f987f2b9665 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:41.010756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6649a4f-17cc-4d9e-b356-1f987f2b9665 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:41.011186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6649a4f-17cc-4d9e-b356-1f987f2b9665 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:41.153888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c6649a4f-17cc-4d9e-b356-1f987f2b9665 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:41.165363 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c6649a4f-17cc-4d9e-b356-1f987f2b9665 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1392 microversion: 2.1 time: 0.168763 Oct 05 18:53:41.166135 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3642/7526] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:40 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:42.193703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-49eb09b1-c8a2-40e7-af68-62f4c6a21fa8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:42.194702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-49eb09b1-c8a2-40e7-af68-62f4c6a21fa8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:42.202585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb09b1-c8a2-40e7-af68-62f4c6a21fa8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:42.203095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb09b1-c8a2-40e7-af68-62f4c6a21fa8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:42.203523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb09b1-c8a2-40e7-af68-62f4c6a21fa8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:42.204277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb09b1-c8a2-40e7-af68-62f4c6a21fa8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:42.204896 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb09b1-c8a2-40e7-af68-62f4c6a21fa8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:42.205316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-49eb09b1-c8a2-40e7-af68-62f4c6a21fa8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:42.346365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-49eb09b1-c8a2-40e7-af68-62f4c6a21fa8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:42.354518 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-49eb09b1-c8a2-40e7-af68-62f4c6a21fa8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1392 microversion: 2.1 time: 0.165159 Oct 05 18:53:42.355080 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3885/7527] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:42 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:43.389217 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d038e58e-90db-41e1-ac19-4edabd168f8a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:43.390042 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d038e58e-90db-41e1-ac19-4edabd168f8a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:43.400872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d038e58e-90db-41e1-ac19-4edabd168f8a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:43.401373 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d038e58e-90db-41e1-ac19-4edabd168f8a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:43.401804 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d038e58e-90db-41e1-ac19-4edabd168f8a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:43.402551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d038e58e-90db-41e1-ac19-4edabd168f8a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:43.403010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d038e58e-90db-41e1-ac19-4edabd168f8a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:43.403438 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d038e58e-90db-41e1-ac19-4edabd168f8a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:43.539661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d038e58e-90db-41e1-ac19-4edabd168f8a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:43.547611 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d038e58e-90db-41e1-ac19-4edabd168f8a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1392 microversion: 2.1 time: 0.165169 Oct 05 18:53:43.548194 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3643/7528] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:43 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:44.571458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-47744051-50db-4f80-8613-ab831038101b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:44.572074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-47744051-50db-4f80-8613-ab831038101b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:44.579362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47744051-50db-4f80-8613-ab831038101b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:44.579868 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47744051-50db-4f80-8613-ab831038101b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:44.580317 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47744051-50db-4f80-8613-ab831038101b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:44.581033 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47744051-50db-4f80-8613-ab831038101b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:44.581502 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47744051-50db-4f80-8613-ab831038101b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:44.581917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-47744051-50db-4f80-8613-ab831038101b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:44.721253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-47744051-50db-4f80-8613-ab831038101b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:44.729429 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-47744051-50db-4f80-8613-ab831038101b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1392 microversion: 2.1 time: 0.162114 Oct 05 18:53:44.730030 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3886/7529] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:44 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:45.756849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c5a99526-7415-4f14-9f74-d9199c9c5fdf tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:45.759740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c5a99526-7415-4f14-9f74-d9199c9c5fdf tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:45.766012 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a99526-7415-4f14-9f74-d9199c9c5fdf tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:45.766525 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a99526-7415-4f14-9f74-d9199c9c5fdf tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:45.766954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a99526-7415-4f14-9f74-d9199c9c5fdf tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:45.767644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a99526-7415-4f14-9f74-d9199c9c5fdf tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:45.768093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a99526-7415-4f14-9f74-d9199c9c5fdf tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:45.768508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c5a99526-7415-4f14-9f74-d9199c9c5fdf tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:45.905330 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c5a99526-7415-4f14-9f74-d9199c9c5fdf tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:45.913559 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c5a99526-7415-4f14-9f74-d9199c9c5fdf tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1392 microversion: 2.1 time: 0.162924 Oct 05 18:53:45.914180 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3644/7530] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:45 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:46.584937 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6c3576c3-d88d-4d13-b83c-03bb2951512e req-5a3c5f8f-6f50-4a80-b2b2-ceeb9a474689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dced407-89ad-4e82-b048-2091e8ae461f", "name": "network-vif-plugged", "status": "completed", "tag": "607ea19b-81a6-474a-b881-19560f1de46e"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:53:46.595521 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6c3576c3-d88d-4d13-b83c-03bb2951512e req-5a3c5f8f-6f50-4a80-b2b2-ceeb9a474689 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:46.596018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6c3576c3-d88d-4d13-b83c-03bb2951512e req-5a3c5f8f-6f50-4a80-b2b2-ceeb9a474689 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:46.596439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6c3576c3-d88d-4d13-b83c-03bb2951512e req-5a3c5f8f-6f50-4a80-b2b2-ceeb9a474689 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:46.609151 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6c3576c3-d88d-4d13-b83c-03bb2951512e req-5a3c5f8f-6f50-4a80-b2b2-ceeb9a474689 service nova] Creating event network-vif-plugged:607ea19b-81a6-474a-b881-19560f1de46e for instance 4dced407-89ad-4e82-b048-2091e8ae461f on n-h2-835595-3 Oct 05 18:53:46.614156 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6c3576c3-d88d-4d13-b83c-03bb2951512e req-5a3c5f8f-6f50-4a80-b2b2-ceeb9a474689 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033087 Oct 05 18:53:46.614765 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3887/7531] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:53:46.936963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c531ae50-2564-4d87-ac59-c6d1ccd77058 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:46.937593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c531ae50-2564-4d87-ac59-c6d1ccd77058 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:46.945246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c531ae50-2564-4d87-ac59-c6d1ccd77058 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:46.945733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c531ae50-2564-4d87-ac59-c6d1ccd77058 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:46.946170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c531ae50-2564-4d87-ac59-c6d1ccd77058 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:46.946902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c531ae50-2564-4d87-ac59-c6d1ccd77058 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:46.947363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c531ae50-2564-4d87-ac59-c6d1ccd77058 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:46.947792 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c531ae50-2564-4d87-ac59-c6d1ccd77058 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:47.084551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c531ae50-2564-4d87-ac59-c6d1ccd77058 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:47.093001 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c531ae50-2564-4d87-ac59-c6d1ccd77058 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1392 microversion: 2.1 time: 0.160040 Oct 05 18:53:47.093591 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3645/7532] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:46 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:48.116960 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:53:48.118479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:53:48.127633 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bc179619-e873-4214-8b3d-ae2c30c91629 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:48.128890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bc179619-e873-4214-8b3d-ae2c30c91629 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:48.131840 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:53:48.138909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc179619-e873-4214-8b3d-ae2c30c91629 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:48.139414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc179619-e873-4214-8b3d-ae2c30c91629 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:48.139870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc179619-e873-4214-8b3d-ae2c30c91629 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:48.140578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc179619-e873-4214-8b3d-ae2c30c91629 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:48.141046 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc179619-e873-4214-8b3d-ae2c30c91629 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:48.141508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bc179619-e873-4214-8b3d-ae2c30c91629 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:48.282227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bc179619-e873-4214-8b3d-ae2c30c91629 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:48.290446 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bc179619-e873-4214-8b3d-ae2c30c91629 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1564 microversion: 2.1 time: 0.175459 Oct 05 18:53:48.291035 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3888/7533] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:48 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:48.322209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6331a3f6-23b3-4eeb-9439-8e78ab1183a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:48.322842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6331a3f6-23b3-4eeb-9439-8e78ab1183a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:48.324761 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:53:48.331075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6331a3f6-23b3-4eeb-9439-8e78ab1183a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:48.331562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6331a3f6-23b3-4eeb-9439-8e78ab1183a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:48.331997 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6331a3f6-23b3-4eeb-9439-8e78ab1183a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:48.332680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6331a3f6-23b3-4eeb-9439-8e78ab1183a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:48.333130 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6331a3f6-23b3-4eeb-9439-8e78ab1183a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:48.333546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6331a3f6-23b3-4eeb-9439-8e78ab1183a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:48.485698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6331a3f6-23b3-4eeb-9439-8e78ab1183a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:48.495815 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6331a3f6-23b3-4eeb-9439-8e78ab1183a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1564 microversion: 2.1 time: 0.178670 Oct 05 18:53:48.496380 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3646/7534] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:48 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1564 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:53:50.467851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63220afb-324c-45db-b7da-c52ee09fea29 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:53:50.468895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63220afb-324c-45db-b7da-c52ee09fea29 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:53:50.476738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63220afb-324c-45db-b7da-c52ee09fea29 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:50.477934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63220afb-324c-45db-b7da-c52ee09fea29 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:50.478685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63220afb-324c-45db-b7da-c52ee09fea29 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:50.479617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63220afb-324c-45db-b7da-c52ee09fea29 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:50.480282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63220afb-324c-45db-b7da-c52ee09fea29 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:50.480918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63220afb-324c-45db-b7da-c52ee09fea29 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:50.524308 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d9afc743-4430-47f1-959b-f940ca0bb03b req-b997712e-fb96-433f-aca0-8f1eae6836da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dced407-89ad-4e82-b048-2091e8ae461f", "tag": "607ea19b-81a6-474a-b881-19560f1de46e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:53:50.534778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d9afc743-4430-47f1-959b-f940ca0bb03b req-b997712e-fb96-433f-aca0-8f1eae6836da service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:53:50.535332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d9afc743-4430-47f1-959b-f940ca0bb03b req-b997712e-fb96-433f-aca0-8f1eae6836da service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:53:50.535768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d9afc743-4430-47f1-959b-f940ca0bb03b req-b997712e-fb96-433f-aca0-8f1eae6836da service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:53:50.547443 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d9afc743-4430-47f1-959b-f940ca0bb03b req-b997712e-fb96-433f-aca0-8f1eae6836da service nova] Creating event network-changed:607ea19b-81a6-474a-b881-19560f1de46e for instance 4dced407-89ad-4e82-b048-2091e8ae461f on n-h2-835595-3 Oct 05 18:53:50.553529 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d9afc743-4430-47f1-959b-f940ca0bb03b req-b997712e-fb96-433f-aca0-8f1eae6836da service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091423 Oct 05 18:53:50.554587 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3647/7535] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:53:50.629176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63220afb-324c-45db-b7da-c52ee09fea29 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:53:50.637893 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63220afb-324c-45db-b7da-c52ee09fea29 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1564 microversion: 2.1 time: 0.180772 Oct 05 18:53:50.638586 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3889/7536] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:53:50 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:13.921421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:54:13.922183 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=38 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:54:13.973113 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6438ceaf-2498-445d-bb5e-ff549b9a06a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:54:13.975464 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6438ceaf-2498-445d-bb5e-ff549b9a06a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:13.982496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6438ceaf-2498-445d-bb5e-ff549b9a06a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:13.982986 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6438ceaf-2498-445d-bb5e-ff549b9a06a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:13.983428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6438ceaf-2498-445d-bb5e-ff549b9a06a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:13.984119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6438ceaf-2498-445d-bb5e-ff549b9a06a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:13.984578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6438ceaf-2498-445d-bb5e-ff549b9a06a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:13.985004 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6438ceaf-2498-445d-bb5e-ff549b9a06a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:14.037840 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6438ceaf-2498-445d-bb5e-ff549b9a06a8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f/action" status: 200 len: 24574 microversion: 2.1 time: 0.118256 Oct 05 18:54:14.038540 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3648/7537] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:54:13 2022] POST /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f/action => generated 24574 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:54:20.428445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-dee4087e-1ac7-4d2f-9452-dd1181f262d5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:54:20.432309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:54:20.433637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=36 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:54:20.445458 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dee4087e-1ac7-4d2f-9452-dd1181f262d5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:20.445963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dee4087e-1ac7-4d2f-9452-dd1181f262d5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:20.446456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-dee4087e-1ac7-4d2f-9452-dd1181f262d5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:20.470556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-dee4087e-1ac7-4d2f-9452-dd1181f262d5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Going to try to stop instance {{(pid=128844) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 05 18:54:20.517742 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-dee4087e-1ac7-4d2f-9452-dd1181f262d5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f/action" status: 202 len: 0 microversion: 2.1 time: 0.095990 Oct 05 18:54:20.518401 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3890/7538] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:54:20 2022] POST /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:54:20.527254 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-30a22611-1594-42cd-893f-6e91c41043c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:20.527945 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30a22611-1594-42cd-893f-6e91c41043c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:20.537281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30a22611-1594-42cd-893f-6e91c41043c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:20.537767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30a22611-1594-42cd-893f-6e91c41043c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:20.538197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30a22611-1594-42cd-893f-6e91c41043c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:20.538996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30a22611-1594-42cd-893f-6e91c41043c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:20.539447 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30a22611-1594-42cd-893f-6e91c41043c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:20.539883 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30a22611-1594-42cd-893f-6e91c41043c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:20.691618 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-30a22611-1594-42cd-893f-6e91c41043c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:20.700014 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-30a22611-1594-42cd-893f-6e91c41043c3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1692 microversion: 2.1 time: 0.177001 Oct 05 18:54:20.700749 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3649/7539] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:20 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1692 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:21.731179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aeb2869a-5dce-4a07-8b22-3ffbd8b27658 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:21.732397 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aeb2869a-5dce-4a07-8b22-3ffbd8b27658 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:21.741662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb2869a-5dce-4a07-8b22-3ffbd8b27658 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:21.742176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb2869a-5dce-4a07-8b22-3ffbd8b27658 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:21.742666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb2869a-5dce-4a07-8b22-3ffbd8b27658 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:21.743380 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb2869a-5dce-4a07-8b22-3ffbd8b27658 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:21.743848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb2869a-5dce-4a07-8b22-3ffbd8b27658 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:21.744294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aeb2869a-5dce-4a07-8b22-3ffbd8b27658 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:21.893857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aeb2869a-5dce-4a07-8b22-3ffbd8b27658 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:21.904662 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aeb2869a-5dce-4a07-8b22-3ffbd8b27658 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1692 microversion: 2.1 time: 0.182874 Oct 05 18:54:21.905493 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3891/7540] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:21 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1692 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:22.931001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-51264801-7faf-4eca-8207-eca0823740d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:22.931830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-51264801-7faf-4eca-8207-eca0823740d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:22.943889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51264801-7faf-4eca-8207-eca0823740d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:22.944395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51264801-7faf-4eca-8207-eca0823740d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:22.944834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51264801-7faf-4eca-8207-eca0823740d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:22.945554 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51264801-7faf-4eca-8207-eca0823740d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:22.945988 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51264801-7faf-4eca-8207-eca0823740d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:22.946449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-51264801-7faf-4eca-8207-eca0823740d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:23.097703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-51264801-7faf-4eca-8207-eca0823740d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:23.109826 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-51264801-7faf-4eca-8207-eca0823740d8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1692 microversion: 2.1 time: 0.184118 Oct 05 18:54:23.110763 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3650/7541] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:22 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1692 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:24.135632 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-56a365f8-7634-47a7-a5e3-37018b577e37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:24.136221 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-56a365f8-7634-47a7-a5e3-37018b577e37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:24.143648 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56a365f8-7634-47a7-a5e3-37018b577e37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:24.144154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56a365f8-7634-47a7-a5e3-37018b577e37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:24.144602 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56a365f8-7634-47a7-a5e3-37018b577e37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:24.145359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56a365f8-7634-47a7-a5e3-37018b577e37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:24.145832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56a365f8-7634-47a7-a5e3-37018b577e37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:24.146303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-56a365f8-7634-47a7-a5e3-37018b577e37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:24.281139 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-56a365f8-7634-47a7-a5e3-37018b577e37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:24.289329 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-56a365f8-7634-47a7-a5e3-37018b577e37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1692 microversion: 2.1 time: 0.157797 Oct 05 18:54:24.289915 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3892/7542] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:24 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:25.320949 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-090b8b8a-0f1d-4e35-92c0-8c7640f6d106 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:25.321919 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-090b8b8a-0f1d-4e35-92c0-8c7640f6d106 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:25.333243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-090b8b8a-0f1d-4e35-92c0-8c7640f6d106 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:25.333733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-090b8b8a-0f1d-4e35-92c0-8c7640f6d106 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:25.334170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-090b8b8a-0f1d-4e35-92c0-8c7640f6d106 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:25.334905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-090b8b8a-0f1d-4e35-92c0-8c7640f6d106 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:25.335357 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-090b8b8a-0f1d-4e35-92c0-8c7640f6d106 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:25.335784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-090b8b8a-0f1d-4e35-92c0-8c7640f6d106 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:25.482896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-090b8b8a-0f1d-4e35-92c0-8c7640f6d106 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:25.491647 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-090b8b8a-0f1d-4e35-92c0-8c7640f6d106 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1692 microversion: 2.1 time: 0.177413 Oct 05 18:54:25.492239 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3651/7543] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:25 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:26.515532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-92714087-84d2-48d9-ad02-a7307aaa9216 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:26.516170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-92714087-84d2-48d9-ad02-a7307aaa9216 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:26.523530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92714087-84d2-48d9-ad02-a7307aaa9216 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:26.524040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92714087-84d2-48d9-ad02-a7307aaa9216 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:26.524483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92714087-84d2-48d9-ad02-a7307aaa9216 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:26.525187 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92714087-84d2-48d9-ad02-a7307aaa9216 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:26.525652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92714087-84d2-48d9-ad02-a7307aaa9216 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:26.526087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-92714087-84d2-48d9-ad02-a7307aaa9216 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:26.664510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-92714087-84d2-48d9-ad02-a7307aaa9216 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:26.673044 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-92714087-84d2-48d9-ad02-a7307aaa9216 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1692 microversion: 2.1 time: 0.161643 Oct 05 18:54:26.673713 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3893/7544] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:26 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:27.701111 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-35ee64fc-556c-4e21-819d-725a90bb0c90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:27.702047 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-35ee64fc-556c-4e21-819d-725a90bb0c90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:27.711880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ee64fc-556c-4e21-819d-725a90bb0c90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:27.712375 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ee64fc-556c-4e21-819d-725a90bb0c90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:27.712806 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ee64fc-556c-4e21-819d-725a90bb0c90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:27.713499 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ee64fc-556c-4e21-819d-725a90bb0c90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:27.713977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ee64fc-556c-4e21-819d-725a90bb0c90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:27.714417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-35ee64fc-556c-4e21-819d-725a90bb0c90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:27.862343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-35ee64fc-556c-4e21-819d-725a90bb0c90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:27.875182 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-35ee64fc-556c-4e21-819d-725a90bb0c90 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1692 microversion: 2.1 time: 0.180519 Oct 05 18:54:27.876056 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3652/7545] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:27 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:28.905671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-a34fbe51-188e-41fd-9345-60871b99fd74 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:28.906845 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-a34fbe51-188e-41fd-9345-60871b99fd74 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:28.917048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a34fbe51-188e-41fd-9345-60871b99fd74 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:28.917638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a34fbe51-188e-41fd-9345-60871b99fd74 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:28.918136 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a34fbe51-188e-41fd-9345-60871b99fd74 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:28.918920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a34fbe51-188e-41fd-9345-60871b99fd74 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:28.919442 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a34fbe51-188e-41fd-9345-60871b99fd74 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:28.919887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-a34fbe51-188e-41fd-9345-60871b99fd74 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:29.062269 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-a34fbe51-188e-41fd-9345-60871b99fd74 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:29.070646 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-a34fbe51-188e-41fd-9345-60871b99fd74 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1692 microversion: 2.1 time: 0.172075 Oct 05 18:54:29.071263 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3894/7546] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:28 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:30.096215 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-627244ee-231c-4784-9915-bb83f452ad10 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:30.096849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-627244ee-231c-4784-9915-bb83f452ad10 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:30.104313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-627244ee-231c-4784-9915-bb83f452ad10 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:30.105135 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-627244ee-231c-4784-9915-bb83f452ad10 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:30.105593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-627244ee-231c-4784-9915-bb83f452ad10 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:30.106261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-627244ee-231c-4784-9915-bb83f452ad10 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:30.106740 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-627244ee-231c-4784-9915-bb83f452ad10 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:30.107177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-627244ee-231c-4784-9915-bb83f452ad10 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:30.251757 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-627244ee-231c-4784-9915-bb83f452ad10 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:30.260266 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-627244ee-231c-4784-9915-bb83f452ad10 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1692 microversion: 2.1 time: 0.169251 Oct 05 18:54:30.260854 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3653/7547] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:30 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1692 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:31.284144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0f5c5c13-d059-449b-b074-ff2e54d90d5e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:31.284744 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0f5c5c13-d059-449b-b074-ff2e54d90d5e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:31.292513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5c5c13-d059-449b-b074-ff2e54d90d5e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:31.293018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5c5c13-d059-449b-b074-ff2e54d90d5e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:31.293473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5c5c13-d059-449b-b074-ff2e54d90d5e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:31.294208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5c5c13-d059-449b-b074-ff2e54d90d5e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:31.294737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5c5c13-d059-449b-b074-ff2e54d90d5e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:31.295179 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0f5c5c13-d059-449b-b074-ff2e54d90d5e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:31.432045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0f5c5c13-d059-449b-b074-ff2e54d90d5e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:31.441646 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0f5c5c13-d059-449b-b074-ff2e54d90d5e tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1669 microversion: 2.1 time: 0.161570 Oct 05 18:54:31.442272 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3895/7548] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:31 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:32.540891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fb722687-0047-412f-9bfd-b9f9712395e3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:54:32.543335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fb722687-0047-412f-9bfd-b9f9712395e3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:32.550390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb722687-0047-412f-9bfd-b9f9712395e3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:32.550881 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb722687-0047-412f-9bfd-b9f9712395e3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:32.551310 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb722687-0047-412f-9bfd-b9f9712395e3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:32.552029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb722687-0047-412f-9bfd-b9f9712395e3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:32.552478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb722687-0047-412f-9bfd-b9f9712395e3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:32.552901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fb722687-0047-412f-9bfd-b9f9712395e3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:32.606290 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fb722687-0047-412f-9bfd-b9f9712395e3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f/action" status: 200 len: 35625 microversion: 2.1 time: 0.068887 Oct 05 18:54:32.607156 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3654/7549] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:54:32 2022] POST /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f/action => generated 35625 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:54:32.626220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6f18461d-d5d3-43cb-81a4-717fd6d5ae3d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:54:32.634914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f18461d-d5d3-43cb-81a4-717fd6d5ae3d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:32.635444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f18461d-d5d3-43cb-81a4-717fd6d5ae3d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:32.635872 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6f18461d-d5d3-43cb-81a4-717fd6d5ae3d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:32.658357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6f18461d-d5d3-43cb-81a4-717fd6d5ae3d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Going to try to start instance {{(pid=128844) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 05 18:54:32.709544 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6f18461d-d5d3-43cb-81a4-717fd6d5ae3d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f/action" status: 202 len: 0 microversion: 2.1 time: 0.088899 Oct 05 18:54:32.710913 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3896/7550] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:54:32 2022] POST /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:54:32.728229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e96dd7d6-6790-436f-a8fc-8c183b9f0490 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:32.730714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e96dd7d6-6790-436f-a8fc-8c183b9f0490 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:32.743904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96dd7d6-6790-436f-a8fc-8c183b9f0490 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:32.744568 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96dd7d6-6790-436f-a8fc-8c183b9f0490 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:32.745276 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96dd7d6-6790-436f-a8fc-8c183b9f0490 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:32.746476 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96dd7d6-6790-436f-a8fc-8c183b9f0490 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:32.747252 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96dd7d6-6790-436f-a8fc-8c183b9f0490 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:32.747992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e96dd7d6-6790-436f-a8fc-8c183b9f0490 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:32.992814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e96dd7d6-6790-436f-a8fc-8c183b9f0490 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:33.001350 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e96dd7d6-6790-436f-a8fc-8c183b9f0490 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1678 microversion: 2.1 time: 0.284100 Oct 05 18:54:33.002013 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3655/7551] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:32 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1678 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:34.026249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-bf03b7b2-6782-41fd-9e61-dc41c6ab3329 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:54:34.027056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-bf03b7b2-6782-41fd-9e61-dc41c6ab3329 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:34.034725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf03b7b2-6782-41fd-9e61-dc41c6ab3329 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:34.035232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf03b7b2-6782-41fd-9e61-dc41c6ab3329 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:34.035687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf03b7b2-6782-41fd-9e61-dc41c6ab3329 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:34.036540 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf03b7b2-6782-41fd-9e61-dc41c6ab3329 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:34.037018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf03b7b2-6782-41fd-9e61-dc41c6ab3329 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:34.037461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-bf03b7b2-6782-41fd-9e61-dc41c6ab3329 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:34.182175 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-bf03b7b2-6782-41fd-9e61-dc41c6ab3329 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:54:34.190632 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-bf03b7b2-6782-41fd-9e61-dc41c6ab3329 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1682 microversion: 2.1 time: 0.168812 Oct 05 18:54:34.191212 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3897/7552] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:54:34 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:54:58.433487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-2e26ac35-327d-4efd-aa85-488291eb20d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:54:58.436302 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-2e26ac35-327d-4efd-aa85-488291eb20d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:54:58.440716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=16 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:54:58.441673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=44 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:54:58.450631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e26ac35-327d-4efd-aa85-488291eb20d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:58.451337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e26ac35-327d-4efd-aa85-488291eb20d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:58.451992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e26ac35-327d-4efd-aa85-488291eb20d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:58.453054 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e26ac35-327d-4efd-aa85-488291eb20d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:54:58.453744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e26ac35-327d-4efd-aa85-488291eb20d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:54:58.454187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-2e26ac35-327d-4efd-aa85-488291eb20d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:54:58.518993 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-2e26ac35-327d-4efd-aa85-488291eb20d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f/action" status: 200 len: 60181 microversion: 2.1 time: 0.089984 Oct 05 18:54:58.519633 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3656/7553] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:54:58 2022] POST /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f/action => generated 60181 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:55:05.584716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3ff00f2d-aa24-41fe-9ebf-1040724ceb06 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:05.585282 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3ff00f2d-aa24-41fe-9ebf-1040724ceb06 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:05.587509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-2b32c055-1767-485c-8bd6-304fd6405983 req-e56216ac-bc1c-4306-ae78-ac034910dad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dced407-89ad-4e82-b048-2091e8ae461f", "tag": "607ea19b-81a6-474a-b881-19560f1de46e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:55:05.587990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=16 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:05.588417 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:05.596487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff00f2d-aa24-41fe-9ebf-1040724ceb06 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:05.596980 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff00f2d-aa24-41fe-9ebf-1040724ceb06 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:05.597713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff00f2d-aa24-41fe-9ebf-1040724ceb06 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:05.598463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff00f2d-aa24-41fe-9ebf-1040724ceb06 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:05.598941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff00f2d-aa24-41fe-9ebf-1040724ceb06 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:05.599401 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3ff00f2d-aa24-41fe-9ebf-1040724ceb06 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:05.599850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2b32c055-1767-485c-8bd6-304fd6405983 req-e56216ac-bc1c-4306-ae78-ac034910dad5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:05.600564 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2b32c055-1767-485c-8bd6-304fd6405983 req-e56216ac-bc1c-4306-ae78-ac034910dad5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:05.601342 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2b32c055-1767-485c-8bd6-304fd6405983 req-e56216ac-bc1c-4306-ae78-ac034910dad5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:05.613549 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-2b32c055-1767-485c-8bd6-304fd6405983 req-e56216ac-bc1c-4306-ae78-ac034910dad5 service nova] Creating event network-changed:607ea19b-81a6-474a-b881-19560f1de46e for instance 4dced407-89ad-4e82-b048-2091e8ae461f on n-h2-835595-3 Oct 05 18:55:05.619213 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-2b32c055-1767-485c-8bd6-304fd6405983 req-e56216ac-bc1c-4306-ae78-ac034910dad5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036174 Oct 05 18:55:05.619813 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3657/7554] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:55:05.629822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3ff00f2d-aa24-41fe-9ebf-1040724ceb06 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:55:05.732762 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3ff00f2d-aa24-41fe-9ebf-1040724ceb06 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "DELETE /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 204 len: 0 microversion: 2.1 time: 0.151509 Oct 05 18:55:05.738392 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3898/7555] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:55:05 2022] DELETE /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:55:05.750601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-586f8f80-9bed-427b-b9f5-224727de8f37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:05.752262 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-586f8f80-9bed-427b-b9f5-224727de8f37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:05.763166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-586f8f80-9bed-427b-b9f5-224727de8f37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:05.764022 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-586f8f80-9bed-427b-b9f5-224727de8f37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:05.764918 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-586f8f80-9bed-427b-b9f5-224727de8f37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:05.766548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-586f8f80-9bed-427b-b9f5-224727de8f37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:05.768293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-586f8f80-9bed-427b-b9f5-224727de8f37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:05.769140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-586f8f80-9bed-427b-b9f5-224727de8f37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:05.922112 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-586f8f80-9bed-427b-b9f5-224727de8f37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:05.930318 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-586f8f80-9bed-427b-b9f5-224727de8f37 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1688 microversion: 2.1 time: 0.188489 Oct 05 18:55:05.930906 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3658/7556] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:05 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:55:06.957061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c9391488-12dd-43eb-a5c5-360e0c47999f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:06.957809 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c9391488-12dd-43eb-a5c5-360e0c47999f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:06.964825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9391488-12dd-43eb-a5c5-360e0c47999f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:06.965333 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9391488-12dd-43eb-a5c5-360e0c47999f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:06.965785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9391488-12dd-43eb-a5c5-360e0c47999f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:06.966572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9391488-12dd-43eb-a5c5-360e0c47999f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:06.967016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9391488-12dd-43eb-a5c5-360e0c47999f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:06.967450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c9391488-12dd-43eb-a5c5-360e0c47999f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:07.108942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c9391488-12dd-43eb-a5c5-360e0c47999f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:07.117286 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c9391488-12dd-43eb-a5c5-360e0c47999f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1688 microversion: 2.1 time: 0.164608 Oct 05 18:55:07.117981 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3899/7557] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:06 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:07.952273 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-9f92101e-0127-4f62-a22e-ba17da3ef069 req-fccca210-a0b9-4138-8b0a-135e18a37e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dced407-89ad-4e82-b048-2091e8ae461f", "name": "network-vif-deleted", "tag": "607ea19b-81a6-474a-b881-19560f1de46e"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:55:07.962747 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9f92101e-0127-4f62-a22e-ba17da3ef069 req-fccca210-a0b9-4138-8b0a-135e18a37e88 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:07.963143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9f92101e-0127-4f62-a22e-ba17da3ef069 req-fccca210-a0b9-4138-8b0a-135e18a37e88 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:07.963589 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-9f92101e-0127-4f62-a22e-ba17da3ef069 req-fccca210-a0b9-4138-8b0a-135e18a37e88 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:07.978058 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-9f92101e-0127-4f62-a22e-ba17da3ef069 req-fccca210-a0b9-4138-8b0a-135e18a37e88 service nova] Creating event network-vif-deleted:607ea19b-81a6-474a-b881-19560f1de46e for instance 4dced407-89ad-4e82-b048-2091e8ae461f on n-h2-835595-3 Oct 05 18:55:07.982952 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-9f92101e-0127-4f62-a22e-ba17da3ef069 req-fccca210-a0b9-4138-8b0a-135e18a37e88 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034609 Oct 05 18:55:07.983588 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3659/7558] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:55:08.142841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:08.143467 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:08.150597 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:08.151097 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:08.151543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:08.152243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:08.152712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:08.153148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:08.185305 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:08.185723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:08.186166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:08.186657 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lazy-loading 'fault' on Instance uuid 4dced407-89ad-4e82-b048-2091e8ae461f {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:55:08.229759 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:08.238179 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-82203747-fce0-456c-8b21-b311a0eb49bd tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 200 len: 1356 microversion: 2.1 time: 0.099851 Oct 05 18:55:08.238843 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3900/7559] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:08 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:09.264762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:09.265534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 4dced407-89ad-4e82-b048-2091e8ae461f] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:09.274328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:09.274940 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:09.275471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:09.276320 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:09.276882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:09.277407 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:09.293120 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] HTTP exception thrown: Instance 4dced407-89ad-4e82-b048-2091e8ae461f could not be found. Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Request method failure captured: Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f HTTP/1.1 Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPdGijeU7qFfC_ZC-2iZhrmZOWIAXMzv5itCrmjUOnT-6Aa05p-rcjGSx7tBZy0D-QS4h9HkcJxp_v1YhPgxyw6OEJyhnuQVEzFbh9isYsyeee9IVB0Y7pSdYkqX_y7MwhXl8c9Xz5rMnw1YHO9LVM_n5zXK8EqtQn7Ah_DiwCSq2s_M Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 4d5f5e1db74b41ecb00348934af567f9 Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d5f5e1db74b41ecb00348934af567f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d5f5e1db74b41ecb00348934af567f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d5f5e1db74b41ecb00348934af567f9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d5f5e1db74b41ecb00348934af567f9"}]}] Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 4d5f5e1db74b41ecb00348934af567f9 Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestNetworkAdvancedServerOps-402293327-project Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 50cf0acb7d924ed7a2829f7603209ca5 Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestNetworkAdvancedServerOps-402293327-project Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 4dced407-89ad-4e82-b048-2091e8ae461f could not be found. Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '4dced407-89ad-4e82-b048-2091e8ae461f'} Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dced407-89ad-4e82-b048-2091e8ae461f could not be found. Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dced407-89ad-4e82-b048-2091e8ae461f could not be found. Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:55:09.294863 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dced407-89ad-4e82-b048-2091e8ae461f could not be found. Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Returning 404 to user: Instance 4dced407-89ad-4e82-b048-2091e8ae461f could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-027ab25b-2c17-4c24-83cc-94a7e191376a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f" status: 404 len: 111 microversion: 2.1 time: 0.038327 Oct 05 18:55:09.299947 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3660/7560] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:09 2022] GET /compute/v2.1/servers/4dced407-89ad-4e82-b048-2091e8ae461f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:55:12.832779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-de2cb6c6-8496-4f35-9055-2dff35daf85b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '.version_select at 0x7f776ffef280>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:12.857567 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-de2cb6c6-8496-4f35-9055-2dff35daf85b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1096370645" status: 202 len: 0 microversion: 2.1 time: 0.028571 Oct 05 18:55:12.858271 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3901/7561] 10.222.0.70 () {58 vars in 1284 bytes} [Wed Oct 5 18:55:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1096370645 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:55:12.888812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-58f3a248-be7d-4a5b-97c5-bb3aa351cbae tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'create', calling method: .version_select at 0x7f776fe75430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-208882903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIH0QIdOCPnQfpM6nr7RZOJe6Xw4oWN0QQQyO+Hz5qrxEOX2P3kzaT0b5TkN3vR+KzwztKXZJlYqJ5kVLQr7DaTlX7EJtJCj0hM3JXbZgSS2J1D99eIyyMRTj3c0H2yhcQ=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:55:12.905081 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-58f3a248-be7d-4a5b-97c5-bb3aa351cbae tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:55:12.911137 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-58f3a248-be7d-4a5b-97c5-bb3aa351cbae tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for user 50cf0acb7d924ed7a2829f7603209ca5 and project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:55:12.936394 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-58f3a248-be7d-4a5b-97c5-bb3aa351cbae tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051517 Oct 05 18:55:12.937232 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3661/7562] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:55:12 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 18:55:18.259902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:18.265603 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1776170976", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "networks": [{"uuid": "475029bc-8581-4442-bff1-01161e263701"}], "key_name": "tempest-TestNetworkAdvancedServerOps-208882903", "security_groups": [{"name": "tempest-secgroup-smoke-828455663"}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:55:18.403154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] validate_networks() for [('475029bc-8581-4442-bff1-01161e263701', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:55:19.161245 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:55:19.161686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:55:19.162180 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:55:19.162650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:55:19.163054 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:55:19.172703 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:19.173205 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:19.173866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:19.174822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:19.175303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:19.175948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:19.194532 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:55:19.200316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Getting quotas for user 50cf0acb7d924ed7a2829f7603209ca5 and project 4d5f5e1db74b41ecb00348934af567f9. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:55:19.213684 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:55:19.216095 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:55:19.264872 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-24a55485-46d6-4a80-b223-5ab4acf95e08 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.006867 Oct 05 18:55:19.265892 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3902/7563] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:55:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:55:19.285695 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d5bbb63f-edf6-49ac-800b-77db50c7f17a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:19.286449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d5bbb63f-edf6-49ac-800b-77db50c7f17a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:19.289571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=16 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:19.351332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d5bbb63f-edf6-49ac-800b-77db50c7f17a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:19.360600 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d5bbb63f-edf6-49ac-800b-77db50c7f17a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1266 microversion: 2.1 time: 0.087375 Oct 05 18:55:19.361213 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3662/7564] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:19 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:55:20.384516 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4d7edc23-e843-48a8-8bfe-8b4e8a8e649f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:20.385566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4d7edc23-e843-48a8-8bfe-8b4e8a8e649f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:20.393696 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7edc23-e843-48a8-8bfe-8b4e8a8e649f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:20.394451 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7edc23-e843-48a8-8bfe-8b4e8a8e649f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:20.395350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7edc23-e843-48a8-8bfe-8b4e8a8e649f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:20.396238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7edc23-e843-48a8-8bfe-8b4e8a8e649f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:20.396901 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7edc23-e843-48a8-8bfe-8b4e8a8e649f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:20.397344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4d7edc23-e843-48a8-8bfe-8b4e8a8e649f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:20.504044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4d7edc23-e843-48a8-8bfe-8b4e8a8e649f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:20.513006 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4d7edc23-e843-48a8-8bfe-8b4e8a8e649f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1326 microversion: 2.1 time: 0.133427 Oct 05 18:55:20.514080 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3903/7565] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:20 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1326 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:21.537390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8c791bc2-b5ea-4dda-b35e-e54519e925f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:21.537993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8c791bc2-b5ea-4dda-b35e-e54519e925f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:21.545427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c791bc2-b5ea-4dda-b35e-e54519e925f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:21.546154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c791bc2-b5ea-4dda-b35e-e54519e925f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:21.546598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c791bc2-b5ea-4dda-b35e-e54519e925f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:21.547319 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c791bc2-b5ea-4dda-b35e-e54519e925f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:21.547781 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c791bc2-b5ea-4dda-b35e-e54519e925f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:21.548216 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8c791bc2-b5ea-4dda-b35e-e54519e925f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:21.803566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8c791bc2-b5ea-4dda-b35e-e54519e925f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:21.813052 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8c791bc2-b5ea-4dda-b35e-e54519e925f8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1391 microversion: 2.1 time: 0.279191 Oct 05 18:55:21.813793 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3663/7566] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:21 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1391 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:22.091216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-796f019b-3c33-4f9b-846a-c31572ea04f9 req-e402a651-d7cb-406e-bcac-dd3ed63a4cfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95182dd4-a119-4570-90ea-f832d849ce5a", "tag": "730635a2-b07a-49c0-b400-144355c40ad1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:55:22.103174 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-796f019b-3c33-4f9b-846a-c31572ea04f9 req-e402a651-d7cb-406e-bcac-dd3ed63a4cfa service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:22.103732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-796f019b-3c33-4f9b-846a-c31572ea04f9 req-e402a651-d7cb-406e-bcac-dd3ed63a4cfa service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:22.104449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-796f019b-3c33-4f9b-846a-c31572ea04f9 req-e402a651-d7cb-406e-bcac-dd3ed63a4cfa service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:22.117854 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-796f019b-3c33-4f9b-846a-c31572ea04f9 req-e402a651-d7cb-406e-bcac-dd3ed63a4cfa service nova] Creating event network-changed:730635a2-b07a-49c0-b400-144355c40ad1 for instance 95182dd4-a119-4570-90ea-f832d849ce5a on n-h1-835595-3 Oct 05 18:55:22.124570 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-796f019b-3c33-4f9b-846a-c31572ea04f9 req-e402a651-d7cb-406e-bcac-dd3ed63a4cfa service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112497 Oct 05 18:55:22.125368 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3904/7567] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:55:22.837376 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5a85fe74-6a9e-4d40-87ec-bebbdb975d53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:22.838021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5a85fe74-6a9e-4d40-87ec-bebbdb975d53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:22.847759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a85fe74-6a9e-4d40-87ec-bebbdb975d53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:22.848364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a85fe74-6a9e-4d40-87ec-bebbdb975d53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:22.848953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a85fe74-6a9e-4d40-87ec-bebbdb975d53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:22.850132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a85fe74-6a9e-4d40-87ec-bebbdb975d53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:22.850615 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a85fe74-6a9e-4d40-87ec-bebbdb975d53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:22.851088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5a85fe74-6a9e-4d40-87ec-bebbdb975d53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:23.021558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5a85fe74-6a9e-4d40-87ec-bebbdb975d53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:23.031725 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5a85fe74-6a9e-4d40-87ec-bebbdb975d53 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1391 microversion: 2.1 time: 0.198889 Oct 05 18:55:23.032310 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3664/7568] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:22 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1391 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:24.055463 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-2d06bd26-e787-4b0c-8e5e-c77a4fc35914 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:24.056645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-2d06bd26-e787-4b0c-8e5e-c77a4fc35914 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:24.066161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d06bd26-e787-4b0c-8e5e-c77a4fc35914 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:24.066778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d06bd26-e787-4b0c-8e5e-c77a4fc35914 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:24.067472 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d06bd26-e787-4b0c-8e5e-c77a4fc35914 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:24.068486 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d06bd26-e787-4b0c-8e5e-c77a4fc35914 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:24.069461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d06bd26-e787-4b0c-8e5e-c77a4fc35914 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:24.071346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-2d06bd26-e787-4b0c-8e5e-c77a4fc35914 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:24.213040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-2d06bd26-e787-4b0c-8e5e-c77a4fc35914 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:24.221259 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-2d06bd26-e787-4b0c-8e5e-c77a4fc35914 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1391 microversion: 2.1 time: 0.170825 Oct 05 18:55:24.221913 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3905/7569] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:24 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:25.248201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f28734d3-4dda-4833-9f69-a823c615d9c5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:25.249066 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f28734d3-4dda-4833-9f69-a823c615d9c5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:25.256223 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f28734d3-4dda-4833-9f69-a823c615d9c5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:25.256711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f28734d3-4dda-4833-9f69-a823c615d9c5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:25.257144 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f28734d3-4dda-4833-9f69-a823c615d9c5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:25.257847 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f28734d3-4dda-4833-9f69-a823c615d9c5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:25.258311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f28734d3-4dda-4833-9f69-a823c615d9c5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:25.258764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f28734d3-4dda-4833-9f69-a823c615d9c5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:25.398611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f28734d3-4dda-4833-9f69-a823c615d9c5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:25.406786 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f28734d3-4dda-4833-9f69-a823c615d9c5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1391 microversion: 2.1 time: 0.164621 Oct 05 18:55:25.407338 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3665/7570] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:25 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:26.104871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-8424babb-8700-4f90-9459-56dc7851871a req-eefc45d0-a092-495c-b904-6d52bd2f0bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95182dd4-a119-4570-90ea-f832d849ce5a", "name": "network-vif-plugged", "status": "completed", "tag": "730635a2-b07a-49c0-b400-144355c40ad1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:55:26.118468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8424babb-8700-4f90-9459-56dc7851871a req-eefc45d0-a092-495c-b904-6d52bd2f0bec service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:26.119091 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8424babb-8700-4f90-9459-56dc7851871a req-eefc45d0-a092-495c-b904-6d52bd2f0bec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:26.119556 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-8424babb-8700-4f90-9459-56dc7851871a req-eefc45d0-a092-495c-b904-6d52bd2f0bec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:26.132119 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-8424babb-8700-4f90-9459-56dc7851871a req-eefc45d0-a092-495c-b904-6d52bd2f0bec service nova] Creating event network-vif-plugged:730635a2-b07a-49c0-b400-144355c40ad1 for instance 95182dd4-a119-4570-90ea-f832d849ce5a on n-h1-835595-3 Oct 05 18:55:26.137547 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-8424babb-8700-4f90-9459-56dc7851871a req-eefc45d0-a092-495c-b904-6d52bd2f0bec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036717 Oct 05 18:55:26.138205 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3906/7571] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:55:26.430083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bfa949e1-b72c-4b8a-87c3-6bcc91a2c50f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:26.430858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bfa949e1-b72c-4b8a-87c3-6bcc91a2c50f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:26.438484 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfa949e1-b72c-4b8a-87c3-6bcc91a2c50f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:26.438963 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfa949e1-b72c-4b8a-87c3-6bcc91a2c50f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:26.439418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfa949e1-b72c-4b8a-87c3-6bcc91a2c50f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:26.440098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfa949e1-b72c-4b8a-87c3-6bcc91a2c50f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:26.440532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfa949e1-b72c-4b8a-87c3-6bcc91a2c50f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:26.441031 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bfa949e1-b72c-4b8a-87c3-6bcc91a2c50f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:26.594943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bfa949e1-b72c-4b8a-87c3-6bcc91a2c50f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:26.603523 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bfa949e1-b72c-4b8a-87c3-6bcc91a2c50f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1391 microversion: 2.1 time: 0.177749 Oct 05 18:55:26.604111 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3666/7572] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:26 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1391 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:27.630248 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-828a9cfc-408d-40c2-ae28-5b8b511574cc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:27.630959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-828a9cfc-408d-40c2-ae28-5b8b511574cc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:27.639262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-828a9cfc-408d-40c2-ae28-5b8b511574cc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:27.639922 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-828a9cfc-408d-40c2-ae28-5b8b511574cc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:27.640456 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-828a9cfc-408d-40c2-ae28-5b8b511574cc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:27.641439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-828a9cfc-408d-40c2-ae28-5b8b511574cc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:27.641912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-828a9cfc-408d-40c2-ae28-5b8b511574cc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:27.642349 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-828a9cfc-408d-40c2-ae28-5b8b511574cc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:27.789419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-828a9cfc-408d-40c2-ae28-5b8b511574cc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:27.797652 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-828a9cfc-408d-40c2-ae28-5b8b511574cc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1563 microversion: 2.1 time: 0.174505 Oct 05 18:55:27.798238 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3907/7573] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:27 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:27.819850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b07e9ac5-8f18-496c-a23a-eb2a819be40f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:27.820413 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b07e9ac5-8f18-496c-a23a-eb2a819be40f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:27.827658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b07e9ac5-8f18-496c-a23a-eb2a819be40f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:27.828143 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b07e9ac5-8f18-496c-a23a-eb2a819be40f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:27.828645 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b07e9ac5-8f18-496c-a23a-eb2a819be40f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:27.829334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b07e9ac5-8f18-496c-a23a-eb2a819be40f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:27.829787 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b07e9ac5-8f18-496c-a23a-eb2a819be40f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:27.830207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b07e9ac5-8f18-496c-a23a-eb2a819be40f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:27.969224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b07e9ac5-8f18-496c-a23a-eb2a819be40f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:27.977492 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b07e9ac5-8f18-496c-a23a-eb2a819be40f tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1563 microversion: 2.1 time: 0.161207 Oct 05 18:55:27.978082 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3667/7574] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:27 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:29.640449 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f908b212-0526-48be-a900-0d9638a25565 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:29.641081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f908b212-0526-48be-a900-0d9638a25565 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:29.647206 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-25b016bf-381c-4f59-9e53-b9c62b7ae59b req-7576421e-3981-4ed1-92bd-857394080278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95182dd4-a119-4570-90ea-f832d849ce5a", "tag": "730635a2-b07a-49c0-b400-144355c40ad1"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:55:29.652141 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:29.652869 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:29.661744 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:29.662449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:29.664650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908b212-0526-48be-a900-0d9638a25565 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:29.665220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908b212-0526-48be-a900-0d9638a25565 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:29.665667 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908b212-0526-48be-a900-0d9638a25565 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:29.666470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908b212-0526-48be-a900-0d9638a25565 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:29.666946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908b212-0526-48be-a900-0d9638a25565 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:29.667386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f908b212-0526-48be-a900-0d9638a25565 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:29.677610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-25b016bf-381c-4f59-9e53-b9c62b7ae59b req-7576421e-3981-4ed1-92bd-857394080278 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:29.678095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-25b016bf-381c-4f59-9e53-b9c62b7ae59b req-7576421e-3981-4ed1-92bd-857394080278 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:29.678553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-25b016bf-381c-4f59-9e53-b9c62b7ae59b req-7576421e-3981-4ed1-92bd-857394080278 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:29.690602 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-25b016bf-381c-4f59-9e53-b9c62b7ae59b req-7576421e-3981-4ed1-92bd-857394080278 service nova] Creating event network-changed:730635a2-b07a-49c0-b400-144355c40ad1 for instance 95182dd4-a119-4570-90ea-f832d849ce5a on n-h1-835595-3 Oct 05 18:55:29.696286 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-25b016bf-381c-4f59-9e53-b9c62b7ae59b req-7576421e-3981-4ed1-92bd-857394080278 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052460 Oct 05 18:55:29.698427 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3668/7575] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:55:29.827399 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f908b212-0526-48be-a900-0d9638a25565 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:29.836459 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f908b212-0526-48be-a900-0d9638a25565 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1563 microversion: 2.1 time: 0.200092 Oct 05 18:55:29.837050 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3908/7576] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:29 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1563 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:55:53.121154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=32 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:53.121886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:53.126212 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4b9a3bfd-91a3-4b4b-b28b-3a9496d702bc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:55:53.128512 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4b9a3bfd-91a3-4b4b-b28b-3a9496d702bc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:53.135637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b9a3bfd-91a3-4b4b-b28b-3a9496d702bc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:53.136129 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b9a3bfd-91a3-4b4b-b28b-3a9496d702bc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:53.136567 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b9a3bfd-91a3-4b4b-b28b-3a9496d702bc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:53.137261 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b9a3bfd-91a3-4b4b-b28b-3a9496d702bc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:53.137718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b9a3bfd-91a3-4b4b-b28b-3a9496d702bc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:53.138149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4b9a3bfd-91a3-4b4b-b28b-3a9496d702bc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:53.201926 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4b9a3bfd-91a3-4b4b-b28b-3a9496d702bc tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a/action" status: 200 len: 24522 microversion: 2.1 time: 0.082179 Oct 05 18:55:53.202628 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3669/7577] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:55:53 2022] POST /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a/action => generated 24522 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:55:59.582614 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4e0fd9df-83cf-442b-87a8-766f79f85f7d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:55:59.583571 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4e0fd9df-83cf-442b-87a8-766f79f85f7d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:59.586866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:59.588066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=30 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:55:59.598366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9df-83cf-442b-87a8-766f79f85f7d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:59.598796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9df-83cf-442b-87a8-766f79f85f7d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:59.599241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9df-83cf-442b-87a8-766f79f85f7d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:59.599943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9df-83cf-442b-87a8-766f79f85f7d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:59.600709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9df-83cf-442b-87a8-766f79f85f7d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:59.601169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4e0fd9df-83cf-442b-87a8-766f79f85f7d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:59.625817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-4e0fd9df-83cf-442b-87a8-766f79f85f7d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lazy-loading 'flavor' on Instance uuid 95182dd4-a119-4570-90ea-f832d849ce5a {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:55:59.698887 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4e0fd9df-83cf-442b-87a8-766f79f85f7d tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a/action" status: 202 len: 0 microversion: 2.1 time: 0.122587 Oct 05 18:55:59.699725 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3909/7578] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:55:59 2022] POST /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:55:59.710185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c6639756-cee2-4792-bed3-4c5566558fb5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:55:59.710972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c6639756-cee2-4792-bed3-4c5566558fb5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:55:59.718858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6639756-cee2-4792-bed3-4c5566558fb5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:59.719354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6639756-cee2-4792-bed3-4c5566558fb5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:59.719794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6639756-cee2-4792-bed3-4c5566558fb5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:59.720521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6639756-cee2-4792-bed3-4c5566558fb5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:55:59.720994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6639756-cee2-4792-bed3-4c5566558fb5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:55:59.721434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c6639756-cee2-4792-bed3-4c5566558fb5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:55:59.909620 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c6639756-cee2-4792-bed3-4c5566558fb5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:55:59.917706 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c6639756-cee2-4792-bed3-4c5566558fb5 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1690 microversion: 2.1 time: 0.211884 Oct 05 18:55:59.918305 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3670/7579] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:55:59 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1690 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:00.947613 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6134fbaa-d063-4a97-8752-525d2843ccb8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:00.948342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6134fbaa-d063-4a97-8752-525d2843ccb8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:00.955595 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6134fbaa-d063-4a97-8752-525d2843ccb8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:00.956134 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6134fbaa-d063-4a97-8752-525d2843ccb8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:00.956564 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6134fbaa-d063-4a97-8752-525d2843ccb8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:00.957310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6134fbaa-d063-4a97-8752-525d2843ccb8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:00.957823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6134fbaa-d063-4a97-8752-525d2843ccb8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:00.958292 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6134fbaa-d063-4a97-8752-525d2843ccb8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:01.152038 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6134fbaa-d063-4a97-8752-525d2843ccb8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:01.164353 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6134fbaa-d063-4a97-8752-525d2843ccb8 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1673 microversion: 2.1 time: 0.223129 Oct 05 18:56:01.165007 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3910/7580] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:00 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1673 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:02.266030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a44439d6-a86e-4356-92fc-55461ca674d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:56:02.268478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a44439d6-a86e-4356-92fc-55461ca674d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:02.277700 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a44439d6-a86e-4356-92fc-55461ca674d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:02.278245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a44439d6-a86e-4356-92fc-55461ca674d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:02.278798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a44439d6-a86e-4356-92fc-55461ca674d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:02.279574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a44439d6-a86e-4356-92fc-55461ca674d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:02.280082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a44439d6-a86e-4356-92fc-55461ca674d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:02.280556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a44439d6-a86e-4356-92fc-55461ca674d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:02.331524 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a44439d6-a86e-4356-92fc-55461ca674d7 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a/action" status: 200 len: 35659 microversion: 2.1 time: 0.069992 Oct 05 18:56:02.332163 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3671/7581] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:56:02 2022] POST /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a/action => generated 35659 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:56:02.344412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-37f7439f-8ed3-4d87-9a47-7c2fbffefee3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:56:02.344963 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-37f7439f-8ed3-4d87-9a47-7c2fbffefee3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:02.352709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37f7439f-8ed3-4d87-9a47-7c2fbffefee3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:02.353207 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37f7439f-8ed3-4d87-9a47-7c2fbffefee3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:02.353655 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37f7439f-8ed3-4d87-9a47-7c2fbffefee3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:02.354389 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37f7439f-8ed3-4d87-9a47-7c2fbffefee3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:02.354860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37f7439f-8ed3-4d87-9a47-7c2fbffefee3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:02.355298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-37f7439f-8ed3-4d87-9a47-7c2fbffefee3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:02.425652 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-37f7439f-8ed3-4d87-9a47-7c2fbffefee3 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a/action" status: 202 len: 0 microversion: 2.1 time: 0.084967 Oct 05 18:56:02.426305 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3911/7582] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:56:02 2022] POST /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:56:02.435201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-23383773-e46c-41f3-92ee-dbf8d8116188 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:02.435904 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-23383773-e46c-41f3-92ee-dbf8d8116188 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:02.443238 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23383773-e46c-41f3-92ee-dbf8d8116188 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:02.443786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23383773-e46c-41f3-92ee-dbf8d8116188 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:02.444181 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23383773-e46c-41f3-92ee-dbf8d8116188 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:02.444913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23383773-e46c-41f3-92ee-dbf8d8116188 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:02.445458 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23383773-e46c-41f3-92ee-dbf8d8116188 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:02.445910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-23383773-e46c-41f3-92ee-dbf8d8116188 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:02.666535 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-23383773-e46c-41f3-92ee-dbf8d8116188 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:02.675010 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-23383773-e46c-41f3-92ee-dbf8d8116188 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1679 microversion: 2.1 time: 0.243966 Oct 05 18:56:02.675598 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3672/7583] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:02 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:03.705754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9a5abe62-c93e-4ca8-b488-630e08eab88a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:03.706969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9a5abe62-c93e-4ca8-b488-630e08eab88a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:03.715162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5abe62-c93e-4ca8-b488-630e08eab88a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:03.715668 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5abe62-c93e-4ca8-b488-630e08eab88a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:03.716126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5abe62-c93e-4ca8-b488-630e08eab88a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:03.716823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5abe62-c93e-4ca8-b488-630e08eab88a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:03.717318 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5abe62-c93e-4ca8-b488-630e08eab88a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:03.717755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9a5abe62-c93e-4ca8-b488-630e08eab88a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:03.859832 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9a5abe62-c93e-4ca8-b488-630e08eab88a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:03.868387 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9a5abe62-c93e-4ca8-b488-630e08eab88a tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1679 microversion: 2.1 time: 0.171265 Oct 05 18:56:03.870160 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3912/7584] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:03 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:04.892463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dd546920-dbe1-4f8f-9eb6-c0ab26e10b50 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:04.893082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dd546920-dbe1-4f8f-9eb6-c0ab26e10b50 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:04.901354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd546920-dbe1-4f8f-9eb6-c0ab26e10b50 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:04.902132 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd546920-dbe1-4f8f-9eb6-c0ab26e10b50 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:04.902857 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd546920-dbe1-4f8f-9eb6-c0ab26e10b50 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:04.903930 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd546920-dbe1-4f8f-9eb6-c0ab26e10b50 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:04.904637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd546920-dbe1-4f8f-9eb6-c0ab26e10b50 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:04.905286 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd546920-dbe1-4f8f-9eb6-c0ab26e10b50 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:05.059197 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dd546920-dbe1-4f8f-9eb6-c0ab26e10b50 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:05.073939 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dd546920-dbe1-4f8f-9eb6-c0ab26e10b50 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1682 microversion: 2.1 time: 0.185236 Oct 05 18:56:05.074722 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3673/7585] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:04 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:05.175736 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2943fd8-7de5-4774-81b0-333aa53a1438 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:56:05.178096 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f2943fd8-7de5-4774-81b0-333aa53a1438 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:05.185356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2943fd8-7de5-4774-81b0-333aa53a1438 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:05.185856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2943fd8-7de5-4774-81b0-333aa53a1438 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:05.186311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2943fd8-7de5-4774-81b0-333aa53a1438 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:05.187069 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2943fd8-7de5-4774-81b0-333aa53a1438 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:05.187522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2943fd8-7de5-4774-81b0-333aa53a1438 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:05.187956 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f2943fd8-7de5-4774-81b0-333aa53a1438 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:05.229484 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f2943fd8-7de5-4774-81b0-333aa53a1438 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "POST /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a/action" status: 200 len: 35659 microversion: 2.1 time: 0.057631 Oct 05 18:56:05.230146 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3913/7586] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:56:05 2022] POST /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a/action => generated 35659 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 05 18:56:06.331219 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b4a45b57-ceeb-4f5a-8b9b-1b20d6a9047b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:06.331889 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b4a45b57-ceeb-4f5a-8b9b-1b20d6a9047b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:06.335111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-fbcf8c3f-6542-45fc-8862-16e1cf390c89 req-bbc17f68-c473-4bd5-a58e-a4ec50f09f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95182dd4-a119-4570-90ea-f832d849ce5a", "tag": "730635a2-b07a-49c0-b400-144355c40ad1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:56:06.339523 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4a45b57-ceeb-4f5a-8b9b-1b20d6a9047b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:06.340296 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4a45b57-ceeb-4f5a-8b9b-1b20d6a9047b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:06.340714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4a45b57-ceeb-4f5a-8b9b-1b20d6a9047b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:06.341445 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4a45b57-ceeb-4f5a-8b9b-1b20d6a9047b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:06.341948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4a45b57-ceeb-4f5a-8b9b-1b20d6a9047b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:06.342632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b4a45b57-ceeb-4f5a-8b9b-1b20d6a9047b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:06.347510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fbcf8c3f-6542-45fc-8862-16e1cf390c89 req-bbc17f68-c473-4bd5-a58e-a4ec50f09f7d service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:06.348371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fbcf8c3f-6542-45fc-8862-16e1cf390c89 req-bbc17f68-c473-4bd5-a58e-a4ec50f09f7d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:06.348779 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-fbcf8c3f-6542-45fc-8862-16e1cf390c89 req-bbc17f68-c473-4bd5-a58e-a4ec50f09f7d service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:06.361292 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-fbcf8c3f-6542-45fc-8862-16e1cf390c89 req-bbc17f68-c473-4bd5-a58e-a4ec50f09f7d service nova] Creating event network-changed:730635a2-b07a-49c0-b400-144355c40ad1 for instance 95182dd4-a119-4570-90ea-f832d849ce5a on n-h1-835595-3 Oct 05 18:56:06.366862 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-fbcf8c3f-6542-45fc-8862-16e1cf390c89 req-bbc17f68-c473-4bd5-a58e-a4ec50f09f7d service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036826 Oct 05 18:56:06.367478 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3914/7587] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:56:06.373138 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b4a45b57-ceeb-4f5a-8b9b-1b20d6a9047b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 18:56:06.479157 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b4a45b57-ceeb-4f5a-8b9b-1b20d6a9047b tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "DELETE /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 204 len: 0 microversion: 2.1 time: 0.147428 Oct 05 18:56:06.480110 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3674/7588] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 18:56:06 2022] DELETE /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 18:56:06.489220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d5cacd6e-767b-41b8-b350-5323c4a693fb tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:06.489927 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d5cacd6e-767b-41b8-b350-5323c4a693fb tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:06.496946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5cacd6e-767b-41b8-b350-5323c4a693fb tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:06.497445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5cacd6e-767b-41b8-b350-5323c4a693fb tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:06.497890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5cacd6e-767b-41b8-b350-5323c4a693fb tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:06.498639 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5cacd6e-767b-41b8-b350-5323c4a693fb tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:06.499861 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5cacd6e-767b-41b8-b350-5323c4a693fb tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:06.500303 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d5cacd6e-767b-41b8-b350-5323c4a693fb tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:06.637662 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d5cacd6e-767b-41b8-b350-5323c4a693fb tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:06.646109 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d5cacd6e-767b-41b8-b350-5323c4a693fb tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1688 microversion: 2.1 time: 0.161247 Oct 05 18:56:06.646756 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3915/7589] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:06 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:07.675187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bef55f86-61ef-43ad-a5c5-ac0eb71a95f6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:07.676465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bef55f86-61ef-43ad-a5c5-ac0eb71a95f6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:07.683547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef55f86-61ef-43ad-a5c5-ac0eb71a95f6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:07.684036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef55f86-61ef-43ad-a5c5-ac0eb71a95f6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:07.684479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef55f86-61ef-43ad-a5c5-ac0eb71a95f6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:07.685159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef55f86-61ef-43ad-a5c5-ac0eb71a95f6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:07.685642 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef55f86-61ef-43ad-a5c5-ac0eb71a95f6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:07.686082 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bef55f86-61ef-43ad-a5c5-ac0eb71a95f6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:07.828586 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bef55f86-61ef-43ad-a5c5-ac0eb71a95f6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:07.837050 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bef55f86-61ef-43ad-a5c5-ac0eb71a95f6 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1688 microversion: 2.1 time: 0.169149 Oct 05 18:56:07.842522 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3675/7590] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:07 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:08.609697 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-192476dc-af44-4f30-a6ec-2179e022446c req-685971c1-48b3-48b1-842b-1924841a5e77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95182dd4-a119-4570-90ea-f832d849ce5a", "name": "network-vif-deleted", "tag": "730635a2-b07a-49c0-b400-144355c40ad1"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:56:08.620366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-192476dc-af44-4f30-a6ec-2179e022446c req-685971c1-48b3-48b1-842b-1924841a5e77 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:08.620859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-192476dc-af44-4f30-a6ec-2179e022446c req-685971c1-48b3-48b1-842b-1924841a5e77 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:08.621301 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-192476dc-af44-4f30-a6ec-2179e022446c req-685971c1-48b3-48b1-842b-1924841a5e77 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:08.632982 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-192476dc-af44-4f30-a6ec-2179e022446c req-685971c1-48b3-48b1-842b-1924841a5e77 service nova] Creating event network-vif-deleted:730635a2-b07a-49c0-b400-144355c40ad1 for instance 95182dd4-a119-4570-90ea-f832d849ce5a on n-h1-835595-3 Oct 05 18:56:08.638208 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-192476dc-af44-4f30-a6ec-2179e022446c req-685971c1-48b3-48b1-842b-1924841a5e77 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032210 Oct 05 18:56:08.638841 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3916/7591] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:56:08.861419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:08.862036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:08.869222 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:08.869702 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:08.870133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:08.870855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:08.871332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:08.871727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:08.906496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:08.907001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:08.907439 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:08.908095 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lazy-loading 'fault' on Instance uuid 95182dd4-a119-4570-90ea-f832d849ce5a {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:56:08.952059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50cf0acb7d924ed7a2829f7603209ca5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d5f5e1db74b41ecb00348934af567f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:08.960246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-072755cc-c9d8-4b39-88c9-93a04bfb6a83 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 200 len: 1356 microversion: 2.1 time: 0.102991 Oct 05 18:56:08.960873 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3676/7592] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:08 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:09.990049 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:09.990814 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] [instance: 95182dd4-a119-4570-90ea-f832d849ce5a] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:09.997365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:09.997867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:09.998346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:09.999081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:09.999549 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:09.999989 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:10.013908 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] HTTP exception thrown: Instance 95182dd4-a119-4570-90ea-f832d849ce5a could not be found. Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Request method failure captured: Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a HTTP/1.1 Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPdGijeU7qFfC_ZC-2iZhrmZOWIAXMzv5itCrmjUOnT-6Aa05p-rcjGSx7tBZy0D-QS4h9HkcJxp_v1YhPgxyw6OEJyhnuQVEzFbh9isYsyeee9IVB0Y7pSdYkqX_y7MwhXl8c9Xz5rMnw1YHO9LVM_n5zXK8EqtQn7Ah_DiwCSq2s_M Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 4d5f5e1db74b41ecb00348934af567f9 Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/4d5f5e1db74b41ecb00348934af567f9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d5f5e1db74b41ecb00348934af567f9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_4d5f5e1db74b41ecb00348934af567f9", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/4d5f5e1db74b41ecb00348934af567f9"}]}] Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 4d5f5e1db74b41ecb00348934af567f9 Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-402293327 Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestNetworkAdvancedServerOps-402293327-project Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 50cf0acb7d924ed7a2829f7603209ca5 Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestNetworkAdvancedServerOps-402293327-project Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance 95182dd4-a119-4570-90ea-f832d849ce5a could not be found. Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': '95182dd4-a119-4570-90ea-f832d849ce5a'} Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95182dd4-a119-4570-90ea-f832d849ce5a could not be found. Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95182dd4-a119-4570-90ea-f832d849ce5a could not be found. Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:56:10.015576 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95182dd4-a119-4570-90ea-f832d849ce5a could not be found. Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Returning 404 to user: Instance 95182dd4-a119-4570-90ea-f832d849ce5a could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5874c0b3-873d-480e-9788-3ac984682139 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a" status: 404 len: 111 microversion: 2.1 time: 0.034245 Oct 05 18:56:10.020825 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3917/7593] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:09 2022] GET /compute/v2.1/servers/95182dd4-a119-4570-90ea-f832d849ce5a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 18:56:13.129230 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-576d6132-b90c-41ed-8bdc-94b770580c14 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] Calling method '.version_select at 0x7f77740c9670>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:13.151887 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-576d6132-b90c-41ed-8bdc-94b770580c14 tempest-TestNetworkAdvancedServerOps-402293327 tempest-TestNetworkAdvancedServerOps-402293327-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-208882903" status: 202 len: 0 microversion: 2.1 time: 0.026942 Oct 05 18:56:13.152534 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3677/7594] 10.222.0.70 () {58 vars in 1281 bytes} [Wed Oct 5 18:56:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-208882903 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:56:24.487266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=18 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:56:24.488031 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:56:24.662788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3bcfc470-491b-4d0a-8c0a-b831cb4d427c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Action: 'create', calling method: .version_select at 0x7f776c68c940>, body: {"keypair": {"name": "tempest-TestShelveInstance-2120428836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCWTU1/nts2LL3kaj2/lWDZzwdX4ya3nEywr/wBrit5xGaQHHebSGF9MtsIgpK5OjOgB4Lo72NiGJenpNlRO1R4u2rTjNP2ixnR0HBQWZ8gCJcCICJMBQ5PEOvsYGqNow=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:56:24.678293 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-3bcfc470-491b-4d0a-8c0a-b831cb4d427c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Getting quotas for project 7a6a8408fe804f3ba003c04f91389ff0. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:56:24.687601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-3bcfc470-491b-4d0a-8c0a-b831cb4d427c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Getting quotas for user 9b033c45094440e2b9b3e61486b7ed58 and project 7a6a8408fe804f3ba003c04f91389ff0. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:56:24.714523 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3bcfc470-491b-4d0a-8c0a-b831cb4d427c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.232752 Oct 05 18:56:24.715264 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3918/7595] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 18:56:24 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:56:25.799643 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:56:25.800410 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:56:25.804813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-164600997", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2120428836", "security_groups": [{"name": "tempest-secgroup-smoke-1766708479"}], "networks": [{"uuid": "dffe86f9-2197-4b69-8bd4-b6d6d21427e8"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:56:25.942874 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] validate_networks() for [('dffe86f9-2197-4b69-8bd4-b6d6d21427e8', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 18:56:26.485246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 18:56:26.485674 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 18:56:26.486189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 18:56:26.486632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 18:56:26.487381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 18:56:26.497517 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:26.498009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:26.498474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:26.499187 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:26.499893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:26.505052 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:26.529987 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Getting quotas for project 7a6a8408fe804f3ba003c04f91389ff0. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 18:56:26.535766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Getting quotas for user 9b033c45094440e2b9b3e61486b7ed58 and project 7a6a8408fe804f3ba003c04f91389ff0. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 18:56:26.549972 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 18:56:26.552470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 18:56:26.607579 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-edfdfadf-e6fb-456a-9588-83a0ea6265f5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809727 Oct 05 18:56:26.608248 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3678/7596] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 18:56:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 18:56:26.621170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f31bd8d5-b6ab-4b3c-b885-109155094430 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:26.621825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f31bd8d5-b6ab-4b3c-b885-109155094430 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:26.678583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f31bd8d5-b6ab-4b3c-b885-109155094430 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:26.685852 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f31bd8d5-b6ab-4b3c-b885-109155094430 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1246 microversion: 2.1 time: 0.070244 Oct 05 18:56:26.686449 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3919/7597] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:26 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:27.709380 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0bb83ec2-f3a2-43a1-8b1e-a4015de2b69f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:27.710142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0bb83ec2-f3a2-43a1-8b1e-a4015de2b69f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:27.767676 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0bb83ec2-f3a2-43a1-8b1e-a4015de2b69f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:27.776503 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0bb83ec2-f3a2-43a1-8b1e-a4015de2b69f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1246 microversion: 2.1 time: 0.071866 Oct 05 18:56:27.777611 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3679/7598] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:27 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:28.800189 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9fbd1d4b-a887-4309-9f0f-9efe2d4e2b40 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:28.800794 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9fbd1d4b-a887-4309-9f0f-9efe2d4e2b40 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:28.859170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9fbd1d4b-a887-4309-9f0f-9efe2d4e2b40 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:28.867323 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9fbd1d4b-a887-4309-9f0f-9efe2d4e2b40 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1246 microversion: 2.1 time: 0.070795 Oct 05 18:56:28.867980 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3920/7599] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:28 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1246 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:29.890573 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-56d06a6f-60aa-4b4c-a183-6c04e7a840c4 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:29.891205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-56d06a6f-60aa-4b4c-a183-6c04e7a840c4 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:29.950602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-56d06a6f-60aa-4b4c-a183-6c04e7a840c4 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:29.958461 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-56d06a6f-60aa-4b4c-a183-6c04e7a840c4 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1246 microversion: 2.1 time: 0.071378 Oct 05 18:56:29.963232 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3680/7600] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:29 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:30.981251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-107287cb-d0ad-44f0-bff4-3f97c2db9f3d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:30.981895 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-107287cb-d0ad-44f0-bff4-3f97c2db9f3d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:30.989452 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-107287cb-d0ad-44f0-bff4-3f97c2db9f3d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:30.989996 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-107287cb-d0ad-44f0-bff4-3f97c2db9f3d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:30.990496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-107287cb-d0ad-44f0-bff4-3f97c2db9f3d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:30.991214 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-107287cb-d0ad-44f0-bff4-3f97c2db9f3d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:30.991689 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-107287cb-d0ad-44f0-bff4-3f97c2db9f3d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:30.992159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-107287cb-d0ad-44f0-bff4-3f97c2db9f3d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:31.058083 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-107287cb-d0ad-44f0-bff4-3f97c2db9f3d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:31.066210 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-107287cb-d0ad-44f0-bff4-3f97c2db9f3d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1250 microversion: 2.1 time: 0.089115 Oct 05 18:56:31.066825 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3921/7601] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:30 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:32.089246 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ef46974c-aaa3-4f10-96be-328889751d50 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:32.090544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ef46974c-aaa3-4f10-96be-328889751d50 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:32.097349 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef46974c-aaa3-4f10-96be-328889751d50 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:32.097842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef46974c-aaa3-4f10-96be-328889751d50 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:32.098303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef46974c-aaa3-4f10-96be-328889751d50 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:32.099372 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef46974c-aaa3-4f10-96be-328889751d50 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:32.099825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef46974c-aaa3-4f10-96be-328889751d50 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:32.100242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ef46974c-aaa3-4f10-96be-328889751d50 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:32.164767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ef46974c-aaa3-4f10-96be-328889751d50 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:32.173550 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ef46974c-aaa3-4f10-96be-328889751d50 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1304 microversion: 2.1 time: 0.088368 Oct 05 18:56:32.175101 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3681/7602] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:32 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:33.199478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-20b998b5-095f-40c7-8727-09957c3aba99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:33.200105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-20b998b5-095f-40c7-8727-09957c3aba99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:33.207610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b998b5-095f-40c7-8727-09957c3aba99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:33.208616 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b998b5-095f-40c7-8727-09957c3aba99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:33.209108 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b998b5-095f-40c7-8727-09957c3aba99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:33.209831 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b998b5-095f-40c7-8727-09957c3aba99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:33.211021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b998b5-095f-40c7-8727-09957c3aba99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:33.211021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-20b998b5-095f-40c7-8727-09957c3aba99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:33.348461 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-cb3c8dcd-8af2-48af-8735-8a70464312ef req-b43ab363-4c8c-4d99-add2-bcd0454e6814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5268c587-29f1-4420-8c3c-be2f4dd737ce", "tag": "4d775237-1f3e-44a3-af9a-fa06f0299a62"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:56:33.360497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-cb3c8dcd-8af2-48af-8735-8a70464312ef req-b43ab363-4c8c-4d99-add2-bcd0454e6814 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:33.361065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-cb3c8dcd-8af2-48af-8735-8a70464312ef req-b43ab363-4c8c-4d99-add2-bcd0454e6814 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:33.361605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-cb3c8dcd-8af2-48af-8735-8a70464312ef req-b43ab363-4c8c-4d99-add2-bcd0454e6814 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:33.373334 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-cb3c8dcd-8af2-48af-8735-8a70464312ef req-b43ab363-4c8c-4d99-add2-bcd0454e6814 service nova] Creating event network-changed:4d775237-1f3e-44a3-af9a-fa06f0299a62 for instance 5268c587-29f1-4420-8c3c-be2f4dd737ce on n-h2-835595-3 Oct 05 18:56:33.378508 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-cb3c8dcd-8af2-48af-8735-8a70464312ef req-b43ab363-4c8c-4d99-add2-bcd0454e6814 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034142 Oct 05 18:56:33.379598 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3682/7603] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:56:33.435974 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-20b998b5-095f-40c7-8727-09957c3aba99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:33.444347 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-20b998b5-095f-40c7-8727-09957c3aba99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1372 microversion: 2.1 time: 0.249044 Oct 05 18:56:33.445253 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3922/7604] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:33 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:34.475529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f718e3d1-cfb8-452e-a055-1b5d9c653fba tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:34.476250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f718e3d1-cfb8-452e-a055-1b5d9c653fba tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:34.485783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f718e3d1-cfb8-452e-a055-1b5d9c653fba tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:34.486443 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f718e3d1-cfb8-452e-a055-1b5d9c653fba tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:34.487058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f718e3d1-cfb8-452e-a055-1b5d9c653fba tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:34.488076 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f718e3d1-cfb8-452e-a055-1b5d9c653fba tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:34.488710 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f718e3d1-cfb8-452e-a055-1b5d9c653fba tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:34.489402 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f718e3d1-cfb8-452e-a055-1b5d9c653fba tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:35.250636 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f718e3d1-cfb8-452e-a055-1b5d9c653fba tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:35.258924 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f718e3d1-cfb8-452e-a055-1b5d9c653fba tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1372 microversion: 2.1 time: 0.791936 Oct 05 18:56:35.259468 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3683/7605] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:34 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1372 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:36.286444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-16dfe0ce-0e51-407c-b21a-be153db9e8c9 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:36.287476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-16dfe0ce-0e51-407c-b21a-be153db9e8c9 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:36.299304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16dfe0ce-0e51-407c-b21a-be153db9e8c9 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:36.300158 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16dfe0ce-0e51-407c-b21a-be153db9e8c9 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:36.300862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16dfe0ce-0e51-407c-b21a-be153db9e8c9 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:36.302000 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16dfe0ce-0e51-407c-b21a-be153db9e8c9 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:36.302533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16dfe0ce-0e51-407c-b21a-be153db9e8c9 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:36.302941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16dfe0ce-0e51-407c-b21a-be153db9e8c9 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:36.454296 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-16dfe0ce-0e51-407c-b21a-be153db9e8c9 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:36.462488 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-16dfe0ce-0e51-407c-b21a-be153db9e8c9 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1372 microversion: 2.1 time: 0.182583 Oct 05 18:56:36.463076 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3923/7606] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:36 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:37.486249 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8b3e53a9-5818-4bb6-ae52-289408294010 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:37.486896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8b3e53a9-5818-4bb6-ae52-289408294010 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:37.489767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:56:37.495508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b3e53a9-5818-4bb6-ae52-289408294010 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:37.495996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b3e53a9-5818-4bb6-ae52-289408294010 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:37.496418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b3e53a9-5818-4bb6-ae52-289408294010 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:37.497155 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b3e53a9-5818-4bb6-ae52-289408294010 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:37.497600 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b3e53a9-5818-4bb6-ae52-289408294010 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:37.498020 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8b3e53a9-5818-4bb6-ae52-289408294010 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:37.629068 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8b3e53a9-5818-4bb6-ae52-289408294010 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:37.640518 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8b3e53a9-5818-4bb6-ae52-289408294010 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1372 microversion: 2.1 time: 0.158166 Oct 05 18:56:37.641275 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3684/7607] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:37 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:38.668860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e4100bb9-ae05-42fc-8c92-3c1909dcf8ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:38.669775 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e4100bb9-ae05-42fc-8c92-3c1909dcf8ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:38.681737 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4100bb9-ae05-42fc-8c92-3c1909dcf8ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:38.682620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4100bb9-ae05-42fc-8c92-3c1909dcf8ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:38.683363 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4100bb9-ae05-42fc-8c92-3c1909dcf8ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:38.684520 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4100bb9-ae05-42fc-8c92-3c1909dcf8ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:38.685295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4100bb9-ae05-42fc-8c92-3c1909dcf8ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:38.686015 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e4100bb9-ae05-42fc-8c92-3c1909dcf8ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:38.832900 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e4100bb9-ae05-42fc-8c92-3c1909dcf8ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:38.844681 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e4100bb9-ae05-42fc-8c92-3c1909dcf8ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1372 microversion: 2.1 time: 0.182404 Oct 05 18:56:38.845503 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3924/7608] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:38 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:39.442437 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-3010515b-728c-4460-9fff-741237477f91 req-85693152-26b0-4eca-b697-896a2b9d793f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5268c587-29f1-4420-8c3c-be2f4dd737ce", "name": "network-vif-plugged", "status": "completed", "tag": "4d775237-1f3e-44a3-af9a-fa06f0299a62"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:56:39.454218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3010515b-728c-4460-9fff-741237477f91 req-85693152-26b0-4eca-b697-896a2b9d793f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:39.454809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3010515b-728c-4460-9fff-741237477f91 req-85693152-26b0-4eca-b697-896a2b9d793f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:39.455243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-3010515b-728c-4460-9fff-741237477f91 req-85693152-26b0-4eca-b697-896a2b9d793f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:39.467280 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-3010515b-728c-4460-9fff-741237477f91 req-85693152-26b0-4eca-b697-896a2b9d793f service nova] Creating event network-vif-plugged:4d775237-1f3e-44a3-af9a-fa06f0299a62 for instance 5268c587-29f1-4420-8c3c-be2f4dd737ce on n-h2-835595-3 Oct 05 18:56:39.472297 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-3010515b-728c-4460-9fff-741237477f91 req-85693152-26b0-4eca-b697-896a2b9d793f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034068 Oct 05 18:56:39.472896 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3685/7609] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:56:39.869876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d3c9024b-eac2-4906-a228-3a110711b727 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:39.870493 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d3c9024b-eac2-4906-a228-3a110711b727 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:39.872332 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=8 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:56:39.879607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3c9024b-eac2-4906-a228-3a110711b727 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:39.880143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3c9024b-eac2-4906-a228-3a110711b727 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:39.880601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3c9024b-eac2-4906-a228-3a110711b727 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:39.881366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3c9024b-eac2-4906-a228-3a110711b727 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:39.881844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3c9024b-eac2-4906-a228-3a110711b727 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:39.882310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d3c9024b-eac2-4906-a228-3a110711b727 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:40.040011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d3c9024b-eac2-4906-a228-3a110711b727 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:40.048283 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d3c9024b-eac2-4906-a228-3a110711b727 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1372 microversion: 2.1 time: 0.182554 Oct 05 18:56:40.048861 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3925/7610] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:39 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:41.071363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=10 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:56:41.079646 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e8ec6c8c-081a-484a-a18e-1fbdd9df8e20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:41.080752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e8ec6c8c-081a-484a-a18e-1fbdd9df8e20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:41.091975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8ec6c8c-081a-484a-a18e-1fbdd9df8e20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:41.092773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8ec6c8c-081a-484a-a18e-1fbdd9df8e20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:41.093486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8ec6c8c-081a-484a-a18e-1fbdd9df8e20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:41.094711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8ec6c8c-081a-484a-a18e-1fbdd9df8e20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:41.095471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8ec6c8c-081a-484a-a18e-1fbdd9df8e20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:41.096168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e8ec6c8c-081a-484a-a18e-1fbdd9df8e20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:41.244237 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e8ec6c8c-081a-484a-a18e-1fbdd9df8e20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:41.256611 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e8ec6c8c-081a-484a-a18e-1fbdd9df8e20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1555 microversion: 2.1 time: 0.186762 Oct 05 18:56:41.257446 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3686/7611] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:41 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1555 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:41.279304 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ad2d162-4879-469d-a1f4-fb89704e4002 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:56:41.279943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ad2d162-4879-469d-a1f4-fb89704e4002 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:56:41.291459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ad2d162-4879-469d-a1f4-fb89704e4002 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:41.291459 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ad2d162-4879-469d-a1f4-fb89704e4002 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:41.292945 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ad2d162-4879-469d-a1f4-fb89704e4002 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:41.293672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ad2d162-4879-469d-a1f4-fb89704e4002 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:41.294148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ad2d162-4879-469d-a1f4-fb89704e4002 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:41.294847 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ad2d162-4879-469d-a1f4-fb89704e4002 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:41.434428 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0ad2d162-4879-469d-a1f4-fb89704e4002 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:56:41.442703 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ad2d162-4879-469d-a1f4-fb89704e4002 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1555 microversion: 2.1 time: 0.167291 Oct 05 18:56:41.443265 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3926/7612] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:56:41 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:56:43.160497 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f62523d1-20f2-43a7-933c-7d414c364275 req-aaa5fcd9-e405-4d68-b571-49137e4cf9e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5268c587-29f1-4420-8c3c-be2f4dd737ce", "tag": "4d775237-1f3e-44a3-af9a-fa06f0299a62"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:56:43.171279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f62523d1-20f2-43a7-933c-7d414c364275 req-aaa5fcd9-e405-4d68-b571-49137e4cf9e2 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:56:43.171756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f62523d1-20f2-43a7-933c-7d414c364275 req-aaa5fcd9-e405-4d68-b571-49137e4cf9e2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:56:43.172205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f62523d1-20f2-43a7-933c-7d414c364275 req-aaa5fcd9-e405-4d68-b571-49137e4cf9e2 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:56:43.183568 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f62523d1-20f2-43a7-933c-7d414c364275 req-aaa5fcd9-e405-4d68-b571-49137e4cf9e2 service nova] Creating event network-changed:4d775237-1f3e-44a3-af9a-fa06f0299a62 for instance 5268c587-29f1-4420-8c3c-be2f4dd737ce on n-h2-835595-3 Oct 05 18:56:43.188603 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f62523d1-20f2-43a7-933c-7d414c364275 req-aaa5fcd9-e405-4d68-b571-49137e4cf9e2 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032236 Oct 05 18:56:43.189441 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3687/7613] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:58:35.612577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:58:35.613811 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=36 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:58:35.616169 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 18:58:35.616581 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:58:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce/action (ip 10.222.0.70) !!! Oct 05 18:58:35.617520 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 18:58:35.617660 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 18:58:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce/action (ip 10.222.0.70) !!! Oct 05 18:58:35.622523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0621a197-49d1-4e79-82b7-091daf5cdbaf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:58:35.623082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0621a197-49d1-4e79-82b7-091daf5cdbaf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:35.632676 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0621a197-49d1-4e79-82b7-091daf5cdbaf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:35.633166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0621a197-49d1-4e79-82b7-091daf5cdbaf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:35.633617 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0621a197-49d1-4e79-82b7-091daf5cdbaf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:35.634355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0621a197-49d1-4e79-82b7-091daf5cdbaf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:35.634822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0621a197-49d1-4e79-82b7-091daf5cdbaf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:35.635260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0621a197-49d1-4e79-82b7-091daf5cdbaf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:35.661087 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-0621a197-49d1-4e79-82b7-091daf5cdbaf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lazy-loading 'flavor' on Instance uuid 5268c587-29f1-4420-8c3c-be2f4dd737ce {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 18:58:35.870599 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0621a197-49d1-4e79-82b7-091daf5cdbaf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "POST /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce/action" status: 202 len: 0 microversion: 2.1 time: 0.261329 Oct 05 18:58:35.871090 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3927/7614] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:58:35 2022] POST /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:58:35.878948 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3358724b-f52c-4a69-8c22-3305520f8c1e] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 18:58:35.879948 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1744094-4a20-4501-8b29-640f444f590e] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 18:58:35.880551 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:58:35.881292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=32 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:58:35.883336 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 18:58:35.883559 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 18:58:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce (ip 10.222.0.70) !!! Oct 05 18:58:35.898891 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-db77fe6e-5e13-4c08-8dff-f3766d15e67b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:35.899641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-db77fe6e-5e13-4c08-8dff-f3766d15e67b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:35.908582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db77fe6e-5e13-4c08-8dff-f3766d15e67b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:35.909093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db77fe6e-5e13-4c08-8dff-f3766d15e67b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:35.909537 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db77fe6e-5e13-4c08-8dff-f3766d15e67b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:35.910363 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db77fe6e-5e13-4c08-8dff-f3766d15e67b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:35.910825 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db77fe6e-5e13-4c08-8dff-f3766d15e67b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:35.911294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-db77fe6e-5e13-4c08-8dff-f3766d15e67b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:36.045365 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-db77fe6e-5e13-4c08-8dff-f3766d15e67b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:36.053429 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-db77fe6e-5e13-4c08-8dff-f3766d15e67b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.176873 Oct 05 18:58:36.054012 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3688/7615] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:35 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:37.082724 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1dc016f9-230b-49f3-815a-b6722ae2fa42 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:37.083505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1dc016f9-230b-49f3-815a-b6722ae2fa42 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:37.091781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc016f9-230b-49f3-815a-b6722ae2fa42 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:37.092191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc016f9-230b-49f3-815a-b6722ae2fa42 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:37.092731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc016f9-230b-49f3-815a-b6722ae2fa42 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:37.093384 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc016f9-230b-49f3-815a-b6722ae2fa42 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:37.094131 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc016f9-230b-49f3-815a-b6722ae2fa42 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:37.094620 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1dc016f9-230b-49f3-815a-b6722ae2fa42 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:37.226387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1dc016f9-230b-49f3-815a-b6722ae2fa42 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:37.234871 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1dc016f9-230b-49f3-815a-b6722ae2fa42 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.160727 Oct 05 18:58:37.235426 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3928/7616] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:37 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:38.263765 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-77a18e34-35e2-4c3d-b83a-6d5b905e444b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:38.264601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-77a18e34-35e2-4c3d-b83a-6d5b905e444b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:38.276584 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77a18e34-35e2-4c3d-b83a-6d5b905e444b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:38.277218 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77a18e34-35e2-4c3d-b83a-6d5b905e444b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:38.277766 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77a18e34-35e2-4c3d-b83a-6d5b905e444b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:38.278673 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77a18e34-35e2-4c3d-b83a-6d5b905e444b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:38.279257 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77a18e34-35e2-4c3d-b83a-6d5b905e444b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:38.279793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-77a18e34-35e2-4c3d-b83a-6d5b905e444b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:38.285105 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] [3358724b-f52c-4a69-8c22-3305520f8c1e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 38596. Oct 05 18:58:38.288692 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1744094-4a20-4501-8b29-640f444f590e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 38598. Oct 05 18:58:38.428104 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-77a18e34-35e2-4c3d-b83a-6d5b905e444b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:38.436863 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-77a18e34-35e2-4c3d-b83a-6d5b905e444b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.180864 Oct 05 18:58:38.437422 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3689/7617] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:38 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:39.464610 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e2815328-8c03-4084-8ca7-f3a7ea8a4108 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:39.465259 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e2815328-8c03-4084-8ca7-f3a7ea8a4108 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:39.473728 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2815328-8c03-4084-8ca7-f3a7ea8a4108 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:39.474233 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2815328-8c03-4084-8ca7-f3a7ea8a4108 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:39.474812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2815328-8c03-4084-8ca7-f3a7ea8a4108 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:39.475531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2815328-8c03-4084-8ca7-f3a7ea8a4108 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:39.476006 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2815328-8c03-4084-8ca7-f3a7ea8a4108 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:39.476455 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e2815328-8c03-4084-8ca7-f3a7ea8a4108 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:39.618314 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e2815328-8c03-4084-8ca7-f3a7ea8a4108 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:39.626935 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e2815328-8c03-4084-8ca7-f3a7ea8a4108 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.166391 Oct 05 18:58:39.627520 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3929/7618] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:39 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:40.654836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7eb95484-372a-46db-9815-7aa5d174f32b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:40.655905 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7eb95484-372a-46db-9815-7aa5d174f32b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:40.667582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7eb95484-372a-46db-9815-7aa5d174f32b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:40.668393 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7eb95484-372a-46db-9815-7aa5d174f32b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:40.669123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7eb95484-372a-46db-9815-7aa5d174f32b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:40.670348 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7eb95484-372a-46db-9815-7aa5d174f32b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:40.671119 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7eb95484-372a-46db-9815-7aa5d174f32b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:40.671837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7eb95484-372a-46db-9815-7aa5d174f32b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:40.815519 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7eb95484-372a-46db-9815-7aa5d174f32b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:40.827777 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7eb95484-372a-46db-9815-7aa5d174f32b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.179414 Oct 05 18:58:40.828534 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3690/7619] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:40 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:41.856371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8eff8ef7-0fb4-4f29-81a6-7fbc5a5c3cad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:41.857410 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8eff8ef7-0fb4-4f29-81a6-7fbc5a5c3cad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:41.870447 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8eff8ef7-0fb4-4f29-81a6-7fbc5a5c3cad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:41.871294 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8eff8ef7-0fb4-4f29-81a6-7fbc5a5c3cad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:41.872058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8eff8ef7-0fb4-4f29-81a6-7fbc5a5c3cad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:41.873469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8eff8ef7-0fb4-4f29-81a6-7fbc5a5c3cad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:41.874263 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8eff8ef7-0fb4-4f29-81a6-7fbc5a5c3cad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:41.875050 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8eff8ef7-0fb4-4f29-81a6-7fbc5a5c3cad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:42.011970 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8eff8ef7-0fb4-4f29-81a6-7fbc5a5c3cad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:42.024475 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8eff8ef7-0fb4-4f29-81a6-7fbc5a5c3cad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.174623 Oct 05 18:58:42.025271 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3930/7620] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:41 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:43.053343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-adb66949-cf2a-413f-80e9-534195d99872 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:43.054079 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-adb66949-cf2a-413f-80e9-534195d99872 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:43.061354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adb66949-cf2a-413f-80e9-534195d99872 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:43.061835 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adb66949-cf2a-413f-80e9-534195d99872 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:43.062266 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adb66949-cf2a-413f-80e9-534195d99872 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:43.062984 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adb66949-cf2a-413f-80e9-534195d99872 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:43.063432 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adb66949-cf2a-413f-80e9-534195d99872 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:43.063849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-adb66949-cf2a-413f-80e9-534195d99872 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:43.200428 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-adb66949-cf2a-413f-80e9-534195d99872 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:43.211651 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-adb66949-cf2a-413f-80e9-534195d99872 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.164973 Oct 05 18:58:43.212239 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3691/7621] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:43 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:44.239876 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-894401c8-7c59-40f7-b122-fe556db55cb8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:44.240743 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-894401c8-7c59-40f7-b122-fe556db55cb8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:44.252462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-894401c8-7c59-40f7-b122-fe556db55cb8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:44.253295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-894401c8-7c59-40f7-b122-fe556db55cb8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:44.254037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-894401c8-7c59-40f7-b122-fe556db55cb8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:44.255244 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-894401c8-7c59-40f7-b122-fe556db55cb8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:44.256018 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-894401c8-7c59-40f7-b122-fe556db55cb8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:44.256790 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-894401c8-7c59-40f7-b122-fe556db55cb8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:44.408784 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-894401c8-7c59-40f7-b122-fe556db55cb8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:44.421560 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-894401c8-7c59-40f7-b122-fe556db55cb8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.188138 Oct 05 18:58:44.422366 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3931/7622] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:44 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:45.452051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dd11c6a5-c8d9-48ec-9c49-540656243cf7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:45.453009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dd11c6a5-c8d9-48ec-9c49-540656243cf7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:45.462872 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd11c6a5-c8d9-48ec-9c49-540656243cf7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:45.463358 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd11c6a5-c8d9-48ec-9c49-540656243cf7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:45.463783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd11c6a5-c8d9-48ec-9c49-540656243cf7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:45.464486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd11c6a5-c8d9-48ec-9c49-540656243cf7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:45.464910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd11c6a5-c8d9-48ec-9c49-540656243cf7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:45.465343 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dd11c6a5-c8d9-48ec-9c49-540656243cf7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:45.602043 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dd11c6a5-c8d9-48ec-9c49-540656243cf7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:45.610534 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dd11c6a5-c8d9-48ec-9c49-540656243cf7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.165248 Oct 05 18:58:45.611114 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3692/7623] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:45 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:46.638727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-325b56e3-6d66-4d70-98a3-5a317d565e03 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:46.639810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-325b56e3-6d66-4d70-98a3-5a317d565e03 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:46.649949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325b56e3-6d66-4d70-98a3-5a317d565e03 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:46.650511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325b56e3-6d66-4d70-98a3-5a317d565e03 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:46.650952 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325b56e3-6d66-4d70-98a3-5a317d565e03 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:46.651669 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325b56e3-6d66-4d70-98a3-5a317d565e03 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:46.652147 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325b56e3-6d66-4d70-98a3-5a317d565e03 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:46.652590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-325b56e3-6d66-4d70-98a3-5a317d565e03 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:46.797126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-325b56e3-6d66-4d70-98a3-5a317d565e03 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:46.805454 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-325b56e3-6d66-4d70-98a3-5a317d565e03 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1700 microversion: 2.1 time: 0.173541 Oct 05 18:58:46.806040 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3932/7624] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:46 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1700 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:47.831788 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9828ae50-2e0b-4401-be72-3661d255077e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:47.832415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9828ae50-2e0b-4401-be72-3661d255077e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:47.843044 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9828ae50-2e0b-4401-be72-3661d255077e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:47.843914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9828ae50-2e0b-4401-be72-3661d255077e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:47.844354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9828ae50-2e0b-4401-be72-3661d255077e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:47.845051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9828ae50-2e0b-4401-be72-3661d255077e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:47.845506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9828ae50-2e0b-4401-be72-3661d255077e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:47.845938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9828ae50-2e0b-4401-be72-3661d255077e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:47.996778 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9828ae50-2e0b-4401-be72-3661d255077e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:48.004953 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9828ae50-2e0b-4401-be72-3661d255077e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1700 microversion: 2.1 time: 0.178549 Oct 05 18:58:48.005718 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3693/7625] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:47 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1700 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:49.029578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac88ef85-2279-435d-b60d-8e011e7e6628 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:49.030406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac88ef85-2279-435d-b60d-8e011e7e6628 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:49.038817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac88ef85-2279-435d-b60d-8e011e7e6628 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:49.039705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac88ef85-2279-435d-b60d-8e011e7e6628 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:49.040382 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac88ef85-2279-435d-b60d-8e011e7e6628 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:49.041286 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac88ef85-2279-435d-b60d-8e011e7e6628 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:49.041948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac88ef85-2279-435d-b60d-8e011e7e6628 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:49.042483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac88ef85-2279-435d-b60d-8e011e7e6628 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:49.194619 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ac88ef85-2279-435d-b60d-8e011e7e6628 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:49.203469 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac88ef85-2279-435d-b60d-8e011e7e6628 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1695 microversion: 2.1 time: 0.178230 Oct 05 18:58:49.213807 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3933/7626] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:49 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1695 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:50.229795 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1f90a5d1-9bbb-4ec7-b9d6-99a7914c8ada tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:50.231492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1f90a5d1-9bbb-4ec7-b9d6-99a7914c8ada tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:50.244277 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f90a5d1-9bbb-4ec7-b9d6-99a7914c8ada tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:50.250362 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f90a5d1-9bbb-4ec7-b9d6-99a7914c8ada tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:50.250972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f90a5d1-9bbb-4ec7-b9d6-99a7914c8ada tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:50.251966 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f90a5d1-9bbb-4ec7-b9d6-99a7914c8ada tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:50.252488 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f90a5d1-9bbb-4ec7-b9d6-99a7914c8ada tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:50.252752 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d9fa24e4-dac5-4b5a-863b-5eb779e1d8c9 req-edbd3fc3-55e1-46bd-a00b-215470bb0457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5268c587-29f1-4420-8c3c-be2f4dd737ce", "name": "network-vif-plugged", "status": "completed", "tag": "4d775237-1f3e-44a3-af9a-fa06f0299a62"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:58:50.253230 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1f90a5d1-9bbb-4ec7-b9d6-99a7914c8ada tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:50.266209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d9fa24e4-dac5-4b5a-863b-5eb779e1d8c9 req-edbd3fc3-55e1-46bd-a00b-215470bb0457 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:50.270956 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d9fa24e4-dac5-4b5a-863b-5eb779e1d8c9 req-edbd3fc3-55e1-46bd-a00b-215470bb0457 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:50.271641 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d9fa24e4-dac5-4b5a-863b-5eb779e1d8c9 req-edbd3fc3-55e1-46bd-a00b-215470bb0457 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:50.291265 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d9fa24e4-dac5-4b5a-863b-5eb779e1d8c9 req-edbd3fc3-55e1-46bd-a00b-215470bb0457 service nova] Creating event network-vif-plugged:4d775237-1f3e-44a3-af9a-fa06f0299a62 for instance 5268c587-29f1-4420-8c3c-be2f4dd737ce on n-h2-835595-3 Oct 05 18:58:50.297292 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d9fa24e4-dac5-4b5a-863b-5eb779e1d8c9 req-edbd3fc3-55e1-46bd-a00b-215470bb0457 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133454 Oct 05 18:58:50.298263 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3694/7627] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:58:50.422716 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1f90a5d1-9bbb-4ec7-b9d6-99a7914c8ada tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:50.431725 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1f90a5d1-9bbb-4ec7-b9d6-99a7914c8ada tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1695 microversion: 2.1 time: 0.206418 Oct 05 18:58:50.432331 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3934/7628] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:50 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1695 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:51.457367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c4355d49-f798-4512-8369-442c32cfb402 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:51.458145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c4355d49-f798-4512-8369-442c32cfb402 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:51.465619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4355d49-f798-4512-8369-442c32cfb402 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:51.466224 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4355d49-f798-4512-8369-442c32cfb402 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:51.466576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4355d49-f798-4512-8369-442c32cfb402 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:51.467291 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4355d49-f798-4512-8369-442c32cfb402 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:51.467834 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4355d49-f798-4512-8369-442c32cfb402 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:51.468619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c4355d49-f798-4512-8369-442c32cfb402 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:51.616139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c4355d49-f798-4512-8369-442c32cfb402 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:51.625591 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c4355d49-f798-4512-8369-442c32cfb402 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1695 microversion: 2.1 time: 0.173548 Oct 05 18:58:51.626271 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3695/7629] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:51 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1695 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:52.652507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-16badc1b-e52b-4142-8712-249a9bd7d899 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:52.653146 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-16badc1b-e52b-4142-8712-249a9bd7d899 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:52.660882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16badc1b-e52b-4142-8712-249a9bd7d899 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:52.661386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16badc1b-e52b-4142-8712-249a9bd7d899 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:52.662113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16badc1b-e52b-4142-8712-249a9bd7d899 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:52.663144 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16badc1b-e52b-4142-8712-249a9bd7d899 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:52.663816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16badc1b-e52b-4142-8712-249a9bd7d899 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:52.664418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-16badc1b-e52b-4142-8712-249a9bd7d899 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:52.821159 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-16badc1b-e52b-4142-8712-249a9bd7d899 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:52.832797 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-16badc1b-e52b-4142-8712-249a9bd7d899 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1695 microversion: 2.1 time: 0.186546 Oct 05 18:58:52.835101 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3935/7630] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:52 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:53.857466 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-59efc334-01e5-443c-95e4-6eb108333ac6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:53.858088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-59efc334-01e5-443c-95e4-6eb108333ac6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:53.865196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59efc334-01e5-443c-95e4-6eb108333ac6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:53.865898 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59efc334-01e5-443c-95e4-6eb108333ac6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:53.866910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59efc334-01e5-443c-95e4-6eb108333ac6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:53.868839 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59efc334-01e5-443c-95e4-6eb108333ac6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:53.869580 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59efc334-01e5-443c-95e4-6eb108333ac6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:53.870008 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-59efc334-01e5-443c-95e4-6eb108333ac6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:54.023954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-59efc334-01e5-443c-95e4-6eb108333ac6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:54.032639 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-59efc334-01e5-443c-95e4-6eb108333ac6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1695 microversion: 2.1 time: 0.179199 Oct 05 18:58:54.033255 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3696/7631] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:53 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:55.057309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-efc45c91-e8f8-4a09-9c45-da6fbcc78548 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:55.057981 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-efc45c91-e8f8-4a09-9c45-da6fbcc78548 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:55.066650 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efc45c91-e8f8-4a09-9c45-da6fbcc78548 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:55.067481 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efc45c91-e8f8-4a09-9c45-da6fbcc78548 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:55.068186 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efc45c91-e8f8-4a09-9c45-da6fbcc78548 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:55.069320 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efc45c91-e8f8-4a09-9c45-da6fbcc78548 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:55.070003 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efc45c91-e8f8-4a09-9c45-da6fbcc78548 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:55.070465 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-efc45c91-e8f8-4a09-9c45-da6fbcc78548 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:55.255711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-efc45c91-e8f8-4a09-9c45-da6fbcc78548 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:55.267270 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-efc45c91-e8f8-4a09-9c45-da6fbcc78548 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1695 microversion: 2.1 time: 0.213840 Oct 05 18:58:55.268740 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3936/7632] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:55 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:56.291686 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-34a1c558-cd3d-4412-b332-7bd677c87516 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:56.292303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-34a1c558-cd3d-4412-b332-7bd677c87516 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:56.299943 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34a1c558-cd3d-4412-b332-7bd677c87516 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:56.300885 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34a1c558-cd3d-4412-b332-7bd677c87516 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:56.301829 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34a1c558-cd3d-4412-b332-7bd677c87516 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:56.302594 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34a1c558-cd3d-4412-b332-7bd677c87516 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:56.303281 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34a1c558-cd3d-4412-b332-7bd677c87516 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:56.303786 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-34a1c558-cd3d-4412-b332-7bd677c87516 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:56.463832 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-34a1c558-cd3d-4412-b332-7bd677c87516 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:56.473802 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-34a1c558-cd3d-4412-b332-7bd677c87516 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1695 microversion: 2.1 time: 0.186100 Oct 05 18:58:56.474787 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3697/7633] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:56 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1695 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:57.497691 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-9c7130d2-e6f6-498c-875c-8b682f2320fe tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:57.498561 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-9c7130d2-e6f6-498c-875c-8b682f2320fe tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:57.506355 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c7130d2-e6f6-498c-875c-8b682f2320fe tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:57.506890 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c7130d2-e6f6-498c-875c-8b682f2320fe tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:57.507426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c7130d2-e6f6-498c-875c-8b682f2320fe tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:57.508081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c7130d2-e6f6-498c-875c-8b682f2320fe tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:57.508626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c7130d2-e6f6-498c-875c-8b682f2320fe tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:57.509010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-9c7130d2-e6f6-498c-875c-8b682f2320fe tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:57.661788 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-9c7130d2-e6f6-498c-875c-8b682f2320fe tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:57.669906 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-9c7130d2-e6f6-498c-875c-8b682f2320fe tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1695 microversion: 2.1 time: 0.176383 Oct 05 18:58:57.670538 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3937/7634] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:57 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1695 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:58.693784 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b46743ce-e226-43e3-ab51-adb2847c7550 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:58.694549 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b46743ce-e226-43e3-ab51-adb2847c7550 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:58.702985 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46743ce-e226-43e3-ab51-adb2847c7550 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:58.703500 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46743ce-e226-43e3-ab51-adb2847c7550 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:58.703935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46743ce-e226-43e3-ab51-adb2847c7550 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:58.704669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46743ce-e226-43e3-ab51-adb2847c7550 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:58.705108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46743ce-e226-43e3-ab51-adb2847c7550 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:58.705531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b46743ce-e226-43e3-ab51-adb2847c7550 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:58.839903 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b46743ce-e226-43e3-ab51-adb2847c7550 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:58:58.848475 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b46743ce-e226-43e3-ab51-adb2847c7550 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1677 microversion: 2.1 time: 0.158742 Oct 05 18:58:58.849079 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3698/7635] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:58 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:58:59.876866 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ec93f541-7c9a-4cc8-965b-11add21a50bf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:58:59.877979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ec93f541-7c9a-4cc8-965b-11add21a50bf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:58:59.889624 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec93f541-7c9a-4cc8-965b-11add21a50bf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:59.890500 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec93f541-7c9a-4cc8-965b-11add21a50bf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:59.891253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec93f541-7c9a-4cc8-965b-11add21a50bf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:58:59.892425 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec93f541-7c9a-4cc8-965b-11add21a50bf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:58:59.893216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec93f541-7c9a-4cc8-965b-11add21a50bf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:58:59.893946 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ec93f541-7c9a-4cc8-965b-11add21a50bf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:00.046101 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ec93f541-7c9a-4cc8-965b-11add21a50bf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:00.054556 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ec93f541-7c9a-4cc8-965b-11add21a50bf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1677 microversion: 2.1 time: 0.184310 Oct 05 18:59:00.055160 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3938/7636] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:58:59 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:00.161709 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-2426771f-7d62-4ed2-b658-22977ed6c50d req-1bd14941-62dc-4b9d-a7a7-523cf94f2dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5268c587-29f1-4420-8c3c-be2f4dd737ce", "name": "network-vif-unplugged", "status": "completed", "tag": "4d775237-1f3e-44a3-af9a-fa06f0299a62"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:59:00.172768 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2426771f-7d62-4ed2-b658-22977ed6c50d req-1bd14941-62dc-4b9d-a7a7-523cf94f2dff service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:00.173251 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2426771f-7d62-4ed2-b658-22977ed6c50d req-1bd14941-62dc-4b9d-a7a7-523cf94f2dff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:00.173681 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-2426771f-7d62-4ed2-b658-22977ed6c50d req-1bd14941-62dc-4b9d-a7a7-523cf94f2dff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:00.185580 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-2426771f-7d62-4ed2-b658-22977ed6c50d req-1bd14941-62dc-4b9d-a7a7-523cf94f2dff service nova] Creating event network-vif-unplugged:4d775237-1f3e-44a3-af9a-fa06f0299a62 for instance 5268c587-29f1-4420-8c3c-be2f4dd737ce on n-h2-835595-3 Oct 05 18:59:00.190759 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-2426771f-7d62-4ed2-b658-22977ed6c50d req-1bd14941-62dc-4b9d-a7a7-523cf94f2dff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032865 Oct 05 18:59:00.191370 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3699/7637] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:59:01.082825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-70f36779-8fd9-48ec-9217-ce4ff916bd74 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:01.084055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-70f36779-8fd9-48ec-9217-ce4ff916bd74 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:01.096492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f36779-8fd9-48ec-9217-ce4ff916bd74 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:01.097288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f36779-8fd9-48ec-9217-ce4ff916bd74 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:01.098048 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f36779-8fd9-48ec-9217-ce4ff916bd74 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:01.099281 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f36779-8fd9-48ec-9217-ce4ff916bd74 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:01.100058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f36779-8fd9-48ec-9217-ce4ff916bd74 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:01.100802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-70f36779-8fd9-48ec-9217-ce4ff916bd74 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:01.243505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-70f36779-8fd9-48ec-9217-ce4ff916bd74 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:01.251654 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-70f36779-8fd9-48ec-9217-ce4ff916bd74 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1680 microversion: 2.1 time: 0.175625 Oct 05 18:59:01.252243 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3939/7638] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:01 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:01.277147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:59:01.277892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:01.284450 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:01.284946 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:01.285367 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:01.286065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:01.286558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:01.286983 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:01.352671 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128843) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 18:59:01.436355 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [a7b70a10-373c-4631-a9c7-4b714321832a] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 18:59:02.446141 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [a7b70a10-373c-4631-a9c7-4b714321832a] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 38700. Oct 05 18:59:02.450246 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b5b93547-3031-4bcc-8200-1ac073d7a9c0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "POST /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce/action" status: 202 len: 0 microversion: 2.1 time: 1.179186 Oct 05 18:59:02.450925 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3700/7639] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 18:59:01 2022] POST /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce/action => generated 0 bytes in 1181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 18:59:02.459512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-416d2ed9-9083-4ad6-87e0-cea5674a5145 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:02.460110 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-416d2ed9-9083-4ad6-87e0-cea5674a5145 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:02.466893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-416d2ed9-9083-4ad6-87e0-cea5674a5145 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:02.467264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-416d2ed9-9083-4ad6-87e0-cea5674a5145 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:02.467720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-416d2ed9-9083-4ad6-87e0-cea5674a5145 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:02.468780 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-416d2ed9-9083-4ad6-87e0-cea5674a5145 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:02.469290 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-416d2ed9-9083-4ad6-87e0-cea5674a5145 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:02.469823 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-416d2ed9-9083-4ad6-87e0-cea5674a5145 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:02.608183 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-416d2ed9-9083-4ad6-87e0-cea5674a5145 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:02.616620 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-416d2ed9-9083-4ad6-87e0-cea5674a5145 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1628 microversion: 2.1 time: 0.161145 Oct 05 18:59:02.617211 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3940/7640] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:02 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1628 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:03.645858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-81ab3e53-39d9-4efd-aa7e-e9a44c763eb1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:03.646873 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-81ab3e53-39d9-4efd-aa7e-e9a44c763eb1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:03.656207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ab3e53-39d9-4efd-aa7e-e9a44c763eb1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:03.656698 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ab3e53-39d9-4efd-aa7e-e9a44c763eb1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:03.657133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ab3e53-39d9-4efd-aa7e-e9a44c763eb1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:03.657824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ab3e53-39d9-4efd-aa7e-e9a44c763eb1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:03.658301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ab3e53-39d9-4efd-aa7e-e9a44c763eb1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:03.658764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-81ab3e53-39d9-4efd-aa7e-e9a44c763eb1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:03.808256 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-81ab3e53-39d9-4efd-aa7e-e9a44c763eb1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:03.816427 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-81ab3e53-39d9-4efd-aa7e-e9a44c763eb1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.178529 Oct 05 18:59:03.817015 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3701/7641] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:03 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:04.840531 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-be0a8144-5c56-448f-a70b-0412bd582317 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:04.841798 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-be0a8144-5c56-448f-a70b-0412bd582317 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:04.849902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be0a8144-5c56-448f-a70b-0412bd582317 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:04.850916 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be0a8144-5c56-448f-a70b-0412bd582317 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:04.851555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be0a8144-5c56-448f-a70b-0412bd582317 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:04.852461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be0a8144-5c56-448f-a70b-0412bd582317 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:04.853103 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be0a8144-5c56-448f-a70b-0412bd582317 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:04.853738 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-be0a8144-5c56-448f-a70b-0412bd582317 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:04.876111 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:59:05.029721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-be0a8144-5c56-448f-a70b-0412bd582317 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:05.038301 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-be0a8144-5c56-448f-a70b-0412bd582317 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.201772 Oct 05 18:59:05.039173 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3941/7642] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:04 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:06.063021 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-78c4648e-e901-425c-9eff-13d5ef71dd1d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:06.063836 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-78c4648e-e901-425c-9eff-13d5ef71dd1d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:06.067436 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:59:06.074390 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78c4648e-e901-425c-9eff-13d5ef71dd1d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:06.074893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78c4648e-e901-425c-9eff-13d5ef71dd1d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:06.075334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78c4648e-e901-425c-9eff-13d5ef71dd1d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:06.076048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78c4648e-e901-425c-9eff-13d5ef71dd1d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:06.076502 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78c4648e-e901-425c-9eff-13d5ef71dd1d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:06.076926 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-78c4648e-e901-425c-9eff-13d5ef71dd1d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:06.080783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:59:06.236896 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-78c4648e-e901-425c-9eff-13d5ef71dd1d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:06.245305 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-78c4648e-e901-425c-9eff-13d5ef71dd1d tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.187992 Oct 05 18:59:06.245901 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3702/7643] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:06 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:07.269252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-821cdc1f-aa84-4f6e-bbdd-d70af214c21c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:07.269889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-821cdc1f-aa84-4f6e-bbdd-d70af214c21c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:07.276750 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=31 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 18:59:07.279319 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-821cdc1f-aa84-4f6e-bbdd-d70af214c21c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:07.279810 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-821cdc1f-aa84-4f6e-bbdd-d70af214c21c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:07.280331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-821cdc1f-aa84-4f6e-bbdd-d70af214c21c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:07.281116 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-821cdc1f-aa84-4f6e-bbdd-d70af214c21c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:07.281799 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-821cdc1f-aa84-4f6e-bbdd-d70af214c21c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:07.282316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-821cdc1f-aa84-4f6e-bbdd-d70af214c21c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:07.427346 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-821cdc1f-aa84-4f6e-bbdd-d70af214c21c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:07.435985 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-821cdc1f-aa84-4f6e-bbdd-d70af214c21c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.170593 Oct 05 18:59:07.448247 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3942/7644] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:07 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:08.463783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ca3c30ea-7212-4828-8c2f-33b4d7bf0479 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:08.465152 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ca3c30ea-7212-4828-8c2f-33b4d7bf0479 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:08.472892 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca3c30ea-7212-4828-8c2f-33b4d7bf0479 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:08.473749 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca3c30ea-7212-4828-8c2f-33b4d7bf0479 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:08.474194 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca3c30ea-7212-4828-8c2f-33b4d7bf0479 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:08.474993 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca3c30ea-7212-4828-8c2f-33b4d7bf0479 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:08.475405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca3c30ea-7212-4828-8c2f-33b4d7bf0479 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:08.475841 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ca3c30ea-7212-4828-8c2f-33b4d7bf0479 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:08.620173 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ca3c30ea-7212-4828-8c2f-33b4d7bf0479 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:08.628932 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ca3c30ea-7212-4828-8c2f-33b4d7bf0479 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.170002 Oct 05 18:59:08.638613 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3703/7645] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:08 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:09.654507 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d28b9bb9-65ac-4e24-b0be-31ceead7750b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:09.655313 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d28b9bb9-65ac-4e24-b0be-31ceead7750b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:09.662342 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d28b9bb9-65ac-4e24-b0be-31ceead7750b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:09.662848 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d28b9bb9-65ac-4e24-b0be-31ceead7750b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:09.663299 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d28b9bb9-65ac-4e24-b0be-31ceead7750b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:09.664021 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d28b9bb9-65ac-4e24-b0be-31ceead7750b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:09.664489 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d28b9bb9-65ac-4e24-b0be-31ceead7750b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:09.664959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d28b9bb9-65ac-4e24-b0be-31ceead7750b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:09.811932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d28b9bb9-65ac-4e24-b0be-31ceead7750b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:09.820444 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d28b9bb9-65ac-4e24-b0be-31ceead7750b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.170023 Oct 05 18:59:09.821018 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3943/7646] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:09 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 18:59:10.847234 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-e43b58ca-2e47-45bf-b6c2-b6f59a2ad7bd tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:10.847890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-e43b58ca-2e47-45bf-b6c2-b6f59a2ad7bd tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:10.855151 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e43b58ca-2e47-45bf-b6c2-b6f59a2ad7bd tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:10.855678 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e43b58ca-2e47-45bf-b6c2-b6f59a2ad7bd tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:10.856147 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e43b58ca-2e47-45bf-b6c2-b6f59a2ad7bd tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:10.856880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e43b58ca-2e47-45bf-b6c2-b6f59a2ad7bd tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:10.857335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e43b58ca-2e47-45bf-b6c2-b6f59a2ad7bd tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:10.857764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-e43b58ca-2e47-45bf-b6c2-b6f59a2ad7bd tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:11.017204 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-e43b58ca-2e47-45bf-b6c2-b6f59a2ad7bd tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:11.025407 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-e43b58ca-2e47-45bf-b6c2-b6f59a2ad7bd tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.183602 Oct 05 18:59:11.026353 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3704/7647] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:10 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:12.055196 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-51c4297f-694d-4cce-ad3c-a232f367b1cc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:12.056654 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-51c4297f-694d-4cce-ad3c-a232f367b1cc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:12.069169 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51c4297f-694d-4cce-ad3c-a232f367b1cc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:12.070019 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51c4297f-694d-4cce-ad3c-a232f367b1cc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:12.070829 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51c4297f-694d-4cce-ad3c-a232f367b1cc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:12.072020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51c4297f-694d-4cce-ad3c-a232f367b1cc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:12.072816 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51c4297f-694d-4cce-ad3c-a232f367b1cc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:12.073757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51c4297f-694d-4cce-ad3c-a232f367b1cc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:12.226683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-51c4297f-694d-4cce-ad3c-a232f367b1cc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:12.235340 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-51c4297f-694d-4cce-ad3c-a232f367b1cc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.187320 Oct 05 18:59:12.235908 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3944/7648] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:12 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:13.263430 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-1f724f1b-47f7-4682-95d2-8cf1d5fa8212 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:13.264002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-1f724f1b-47f7-4682-95d2-8cf1d5fa8212 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:13.271576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f724f1b-47f7-4682-95d2-8cf1d5fa8212 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:13.272094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f724f1b-47f7-4682-95d2-8cf1d5fa8212 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:13.272531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f724f1b-47f7-4682-95d2-8cf1d5fa8212 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:13.273232 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f724f1b-47f7-4682-95d2-8cf1d5fa8212 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:13.273682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f724f1b-47f7-4682-95d2-8cf1d5fa8212 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:13.274108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-1f724f1b-47f7-4682-95d2-8cf1d5fa8212 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:13.414278 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-1f724f1b-47f7-4682-95d2-8cf1d5fa8212 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:13.425818 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-1f724f1b-47f7-4682-95d2-8cf1d5fa8212 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.166221 Oct 05 18:59:13.426659 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3705/7649] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:13 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:14.454432 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-19a06653-0702-4743-9b26-2cd78fdcfb41 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:14.455264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-19a06653-0702-4743-9b26-2cd78fdcfb41 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:14.464739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a06653-0702-4743-9b26-2cd78fdcfb41 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:14.465411 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a06653-0702-4743-9b26-2cd78fdcfb41 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:14.466022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a06653-0702-4743-9b26-2cd78fdcfb41 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:14.467017 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a06653-0702-4743-9b26-2cd78fdcfb41 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:14.467987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a06653-0702-4743-9b26-2cd78fdcfb41 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:14.468577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19a06653-0702-4743-9b26-2cd78fdcfb41 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:14.608495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-19a06653-0702-4743-9b26-2cd78fdcfb41 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:14.621291 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-19a06653-0702-4743-9b26-2cd78fdcfb41 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.171863 Oct 05 18:59:14.622034 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3945/7650] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:14 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:15.653850 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c7a0844d-a66f-4c5e-9064-d3f9ccf49323 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:15.654899 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c7a0844d-a66f-4c5e-9064-d3f9ccf49323 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:15.666777 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a0844d-a66f-4c5e-9064-d3f9ccf49323 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:15.667591 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a0844d-a66f-4c5e-9064-d3f9ccf49323 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:15.668328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a0844d-a66f-4c5e-9064-d3f9ccf49323 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:15.669494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a0844d-a66f-4c5e-9064-d3f9ccf49323 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:15.670315 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a0844d-a66f-4c5e-9064-d3f9ccf49323 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:15.671045 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c7a0844d-a66f-4c5e-9064-d3f9ccf49323 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:15.822968 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c7a0844d-a66f-4c5e-9064-d3f9ccf49323 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:15.831211 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c7a0844d-a66f-4c5e-9064-d3f9ccf49323 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.183996 Oct 05 18:59:15.831801 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3706/7651] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:15 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:16.855566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-df3f5506-cca8-44ca-b8de-dfa8403ac4d2 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:16.856195 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-df3f5506-cca8-44ca-b8de-dfa8403ac4d2 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:16.863483 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df3f5506-cca8-44ca-b8de-dfa8403ac4d2 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:16.863986 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df3f5506-cca8-44ca-b8de-dfa8403ac4d2 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:16.864435 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df3f5506-cca8-44ca-b8de-dfa8403ac4d2 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:16.865154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df3f5506-cca8-44ca-b8de-dfa8403ac4d2 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:16.865683 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df3f5506-cca8-44ca-b8de-dfa8403ac4d2 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:16.866126 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-df3f5506-cca8-44ca-b8de-dfa8403ac4d2 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:17.010094 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-df3f5506-cca8-44ca-b8de-dfa8403ac4d2 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:17.019781 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-df3f5506-cca8-44ca-b8de-dfa8403ac4d2 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.168517 Oct 05 18:59:17.020364 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3946/7652] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:16 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:18.050190 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-12c77ba2-39b3-427a-bd58-b1ed6acf3c99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:18.051228 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-12c77ba2-39b3-427a-bd58-b1ed6acf3c99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:18.062886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12c77ba2-39b3-427a-bd58-b1ed6acf3c99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:18.063750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12c77ba2-39b3-427a-bd58-b1ed6acf3c99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:18.064489 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12c77ba2-39b3-427a-bd58-b1ed6acf3c99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:18.065649 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12c77ba2-39b3-427a-bd58-b1ed6acf3c99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:18.066467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12c77ba2-39b3-427a-bd58-b1ed6acf3c99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:18.067189 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-12c77ba2-39b3-427a-bd58-b1ed6acf3c99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:18.210540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-12c77ba2-39b3-427a-bd58-b1ed6acf3c99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:18.219762 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-12c77ba2-39b3-427a-bd58-b1ed6acf3c99 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.175794 Oct 05 18:59:18.220395 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3707/7653] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:18 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:18.336414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-d4caebb8-d0a8-4244-90af-e8212ddbb6d7 req-4792a6ae-4b7f-47e6-9b78-947446dfc1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5268c587-29f1-4420-8c3c-be2f4dd737ce", "name": "network-vif-plugged", "status": "completed", "tag": "4d775237-1f3e-44a3-af9a-fa06f0299a62"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 18:59:18.349705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d4caebb8-d0a8-4244-90af-e8212ddbb6d7 req-4792a6ae-4b7f-47e6-9b78-947446dfc1eb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:18.350218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d4caebb8-d0a8-4244-90af-e8212ddbb6d7 req-4792a6ae-4b7f-47e6-9b78-947446dfc1eb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:18.350704 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-d4caebb8-d0a8-4244-90af-e8212ddbb6d7 req-4792a6ae-4b7f-47e6-9b78-947446dfc1eb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:18.362222 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-d4caebb8-d0a8-4244-90af-e8212ddbb6d7 req-4792a6ae-4b7f-47e6-9b78-947446dfc1eb service nova] Creating event network-vif-plugged:4d775237-1f3e-44a3-af9a-fa06f0299a62 for instance 5268c587-29f1-4420-8c3c-be2f4dd737ce on n-h2-835595-3 Oct 05 18:59:18.367672 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-d4caebb8-d0a8-4244-90af-e8212ddbb6d7 req-4792a6ae-4b7f-47e6-9b78-947446dfc1eb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035036 Oct 05 18:59:18.368320 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3947/7654] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 18:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 18:59:19.248070 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-7467d0a6-8dd7-4679-bdd4-dbc1c26f15e5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:19.248955 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-7467d0a6-8dd7-4679-bdd4-dbc1c26f15e5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:19.260117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467d0a6-8dd7-4679-bdd4-dbc1c26f15e5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:19.260917 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467d0a6-8dd7-4679-bdd4-dbc1c26f15e5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:19.261644 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467d0a6-8dd7-4679-bdd4-dbc1c26f15e5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:19.262833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467d0a6-8dd7-4679-bdd4-dbc1c26f15e5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:19.263585 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467d0a6-8dd7-4679-bdd4-dbc1c26f15e5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:19.264292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-7467d0a6-8dd7-4679-bdd4-dbc1c26f15e5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:19.425351 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-7467d0a6-8dd7-4679-bdd4-dbc1c26f15e5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:19.433706 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-7467d0a6-8dd7-4679-bdd4-dbc1c26f15e5 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1686 microversion: 2.1 time: 0.192544 Oct 05 18:59:19.434316 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3708/7655] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:19 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1686 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 18:59:20.458407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-af476d7e-59c8-4750-b512-c06e7dfde03f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 18:59:20.459118 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-af476d7e-59c8-4750-b512-c06e7dfde03f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 18:59:20.466892 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af476d7e-59c8-4750-b512-c06e7dfde03f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:20.467713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af476d7e-59c8-4750-b512-c06e7dfde03f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:20.468172 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af476d7e-59c8-4750-b512-c06e7dfde03f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:20.468880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af476d7e-59c8-4750-b512-c06e7dfde03f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 18:59:20.469430 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af476d7e-59c8-4750-b512-c06e7dfde03f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 18:59:20.469914 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-af476d7e-59c8-4750-b512-c06e7dfde03f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 18:59:20.617663 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-af476d7e-59c8-4750-b512-c06e7dfde03f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 18:59:20.626231 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-af476d7e-59c8-4750-b512-c06e7dfde03f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1673 microversion: 2.1 time: 0.172260 Oct 05 18:59:20.626877 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3948/7656] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 18:59:20 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:00:31.083619 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=13 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:00:31.085239 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=41 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:00:31.090923 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-4a93addd-51ba-4023-abe9-8ad02e00c8f6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:31.091857 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=13 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:00:31.092562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4a93addd-51ba-4023-abe9-8ad02e00c8f6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:31.092720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=40 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:00:31.100769 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a93addd-51ba-4023-abe9-8ad02e00c8f6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:31.101544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a93addd-51ba-4023-abe9-8ad02e00c8f6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:31.102231 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a93addd-51ba-4023-abe9-8ad02e00c8f6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:31.103487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a93addd-51ba-4023-abe9-8ad02e00c8f6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:31.104161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a93addd-51ba-4023-abe9-8ad02e00c8f6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:31.105036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-4a93addd-51ba-4023-abe9-8ad02e00c8f6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:31.136168 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-4a93addd-51ba-4023-abe9-8ad02e00c8f6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 19:00:31.157322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-98c2218a-7533-4770-8d1b-1c300e847a5a req-cc75748a-6c3a-4839-82d7-1bcc7199a891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5268c587-29f1-4420-8c3c-be2f4dd737ce", "tag": "4d775237-1f3e-44a3-af9a-fa06f0299a62"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:00:31.167279 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-98c2218a-7533-4770-8d1b-1c300e847a5a req-cc75748a-6c3a-4839-82d7-1bcc7199a891 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:31.167767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-98c2218a-7533-4770-8d1b-1c300e847a5a req-cc75748a-6c3a-4839-82d7-1bcc7199a891 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:31.168439 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-98c2218a-7533-4770-8d1b-1c300e847a5a req-cc75748a-6c3a-4839-82d7-1bcc7199a891 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:31.180573 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-98c2218a-7533-4770-8d1b-1c300e847a5a req-cc75748a-6c3a-4839-82d7-1bcc7199a891 service nova] Creating event network-changed:4d775237-1f3e-44a3-af9a-fa06f0299a62 for instance 5268c587-29f1-4420-8c3c-be2f4dd737ce on n-h2-835595-3 Oct 05 19:00:31.186009 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-98c2218a-7533-4770-8d1b-1c300e847a5a req-cc75748a-6c3a-4839-82d7-1bcc7199a891 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100524 Oct 05 19:00:31.187311 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3949/7657] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:00:31.266681 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-4a93addd-51ba-4023-abe9-8ad02e00c8f6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "DELETE /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 204 len: 0 microversion: 2.1 time: 0.184206 Oct 05 19:00:31.267853 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3709/7658] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 19:00:31 2022] DELETE /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 19:00:31.276679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-39a9361d-5d9f-44ac-b612-1951387253ee tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:31.277611 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-39a9361d-5d9f-44ac-b612-1951387253ee tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:31.284372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a9361d-5d9f-44ac-b612-1951387253ee tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:31.284951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a9361d-5d9f-44ac-b612-1951387253ee tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:31.285599 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a9361d-5d9f-44ac-b612-1951387253ee tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:31.286356 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a9361d-5d9f-44ac-b612-1951387253ee tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:31.286817 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a9361d-5d9f-44ac-b612-1951387253ee tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:31.287446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-39a9361d-5d9f-44ac-b612-1951387253ee tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:31.429585 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-39a9361d-5d9f-44ac-b612-1951387253ee tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:00:31.438408 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-39a9361d-5d9f-44ac-b612-1951387253ee tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.166179 Oct 05 19:00:31.438996 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3950/7659] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:00:31 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 19:00:32.461922 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-992cd29f-2afb-421b-9d23-b9e10ff8adb3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:32.462660 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-992cd29f-2afb-421b-9d23-b9e10ff8adb3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:32.470427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992cd29f-2afb-421b-9d23-b9e10ff8adb3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:32.470953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992cd29f-2afb-421b-9d23-b9e10ff8adb3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:32.471401 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992cd29f-2afb-421b-9d23-b9e10ff8adb3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:32.472145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992cd29f-2afb-421b-9d23-b9e10ff8adb3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:32.472605 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992cd29f-2afb-421b-9d23-b9e10ff8adb3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:32.473029 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-992cd29f-2afb-421b-9d23-b9e10ff8adb3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:32.711420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-992cd29f-2afb-421b-9d23-b9e10ff8adb3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:00:32.720323 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-992cd29f-2afb-421b-9d23-b9e10ff8adb3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 200 len: 1679 microversion: 2.1 time: 0.262682 Oct 05 19:00:32.720880 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3710/7660] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:00:32 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:00:33.134824 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-e2563bd1-e0b2-495b-aa36-fb3dcd5d3563 req-20a32b25-a8dc-4cca-b900-18346c5d779c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5268c587-29f1-4420-8c3c-be2f4dd737ce", "name": "network-vif-deleted", "tag": "4d775237-1f3e-44a3-af9a-fa06f0299a62"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:00:33.144396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e2563bd1-e0b2-495b-aa36-fb3dcd5d3563 req-20a32b25-a8dc-4cca-b900-18346c5d779c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:33.144887 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e2563bd1-e0b2-495b-aa36-fb3dcd5d3563 req-20a32b25-a8dc-4cca-b900-18346c5d779c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:33.145324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-e2563bd1-e0b2-495b-aa36-fb3dcd5d3563 req-20a32b25-a8dc-4cca-b900-18346c5d779c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:33.156727 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-e2563bd1-e0b2-495b-aa36-fb3dcd5d3563 req-20a32b25-a8dc-4cca-b900-18346c5d779c service nova] Creating event network-vif-deleted:4d775237-1f3e-44a3-af9a-fa06f0299a62 for instance 5268c587-29f1-4420-8c3c-be2f4dd737ce on n-h2-835595-3 Oct 05 19:00:33.161643 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-e2563bd1-e0b2-495b-aa36-fb3dcd5d3563 req-20a32b25-a8dc-4cca-b900-18346c5d779c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089274 Oct 05 19:00:33.162187 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3951/7661] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:00:33.748009 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:33.748902 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: 5268c587-29f1-4420-8c3c-be2f4dd737ce] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:33.760556 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:33.761440 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:33.762170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:33.763403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:33.764159 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:33.764869 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:33.781614 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.wsgi [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] HTTP exception thrown: Instance 5268c587-29f1-4420-8c3c-be2f4dd737ce could not be found. Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Request method failure captured: Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: request: GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce HTTP/1.1 Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: Accept: application/json Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: Accept-Encoding: identity Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: Connection: close Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: Content-Length: 0 Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: Content-Type: application/json Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: Host: 10.222.0.70 Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: Openstack-System-Scope: None Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: User-Agent: python-urllib3/1.26.12 Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Auth-Token: gAAAAABjPdNT3U8fd-5HaUoG8nWtZ2TV1GPT2ZXsAcySWeKFR7vmMSAJD2HfUXwy19wSBL03F5IOtUmBVdiA8YUl76cOFxLYzjTycc-L_cDKFO6veX375EZJUI1y_FdjtleYWyzD9VCFRkfm0Y99f7AM79n-_v2kfvEVqLxn_m7UHtnwgYwWFIA Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Id: None Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Domain-Name: None Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Identity-Status: Confirmed Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Is-Admin-Project: True Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Id: default Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Domain-Name: Default Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Id: 7a6a8408fe804f3ba003c04f91389ff0 Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Project-Name: tempest-TestShelveInstance-653748856 Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Role: reader,member Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Roles: reader,member Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7a6a8408fe804f3ba003c04f91389ff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a6a8408fe804f3ba003c04f91389ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7a6a8408fe804f3ba003c04f91389ff0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a6a8408fe804f3ba003c04f91389ff0"}]}] Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant: tempest-TestShelveInstance-653748856 Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Id: 7a6a8408fe804f3ba003c04f91389ff0 Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-Tenant-Name: tempest-TestShelveInstance-653748856 Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-User: tempest-TestShelveInstance-653748856-project Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Id: default Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-User-Domain-Name: Default Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-User-Id: 9b033c45094440e2b9b3e61486b7ed58 Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: X-User-Name: tempest-TestShelveInstance-653748856-project Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: method: > Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: exception: Instance 5268c587-29f1-4420-8c3c-be2f4dd737ce could not be found. Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: action_args: {'id': '5268c587-29f1-4420-8c3c-be2f4dd737ce'} Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5268c587-29f1-4420-8c3c-be2f4dd737ce could not be found. Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5268c587-29f1-4420-8c3c-be2f4dd737ce could not be found. Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 19:00:33.783332 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 19:00:33.788844 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:00:33.788844 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 19:00:33.788844 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 19:00:33.788844 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 19:00:33.788844 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 19:00:33.788844 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5268c587-29f1-4420-8c3c-be2f4dd737ce could not be found. Oct 05 19:00:33.788844 n-d-835595-3 devstack@n-api.service[128843]: ERROR nova.api.openstack.wsgi Oct 05 19:00:33.788844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Returning 404 to user: Instance 5268c587-29f1-4420-8c3c-be2f4dd737ce could not be found. {{(pid=128843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 19:00:33.788844 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d79c9985-d13b-472d-b70f-fa3ee7eecf30 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce" status: 404 len: 111 microversion: 2.1 time: 0.043947 Oct 05 19:00:33.788844 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3711/7662] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:00:33 2022] GET /compute/v2.1/servers/5268c587-29f1-4420-8c3c-be2f4dd737ce => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 19:00:33.972948 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6a23852c-02a2-41c4-8926-aa6db1cc613c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '.version_select at 0x7f776ffded30>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:34.000954 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6a23852c-02a2-41c4-8926-aa6db1cc613c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2120428836" status: 202 len: 0 microversion: 2.1 time: 0.032170 Oct 05 19:00:34.001568 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3952/7663] 10.222.0.70 () {58 vars in 1254 bytes} [Wed Oct 5 19:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2120428836 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 19:00:34.022529 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d472ccea-8049-4ab3-b0a3-259bd2929181 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Action: 'create', calling method: .version_select at 0x7f77749da820>, body: {"keypair": {"name": "tempest-TestShelveInstance-302887787", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBERVKe2g0gzXj1Tl3PQxslBiFJwdcMMTvclqKS2dUiMPO5rEyMaSyDUhtjIJYd7t8nIrNSGkkJElt2tk4t/ous5lE1ek68kqFI5FmTP8XBNCy8Xgg3hIOe3uzXf81xam9A=="}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:00:34.039037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-d472ccea-8049-4ab3-b0a3-259bd2929181 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Getting quotas for project 7a6a8408fe804f3ba003c04f91389ff0. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 19:00:34.043487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-d472ccea-8049-4ab3-b0a3-259bd2929181 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Getting quotas for user 9b033c45094440e2b9b3e61486b7ed58 and project 7a6a8408fe804f3ba003c04f91389ff0. Resources: {'key_pairs'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 19:00:34.074337 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d472ccea-8049-4ab3-b0a3-259bd2929181 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.055815 Oct 05 19:00:34.074972 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3712/7664] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 19:00:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:00:51.441525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-364584606", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-302887787", "security_groups": [{"name": "tempest-secgroup-smoke-2057504408"}], "networks": [{"uuid": "dffe86f9-2197-4b69-8bd4-b6d6d21427e8"}], "block_device_mapping_v2": [{"uuid": "aee69ef0-c7c2-4078-b81c-271c18ca16f0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:00:51.461720 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=10 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:00:51.462454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:00:51.582344 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.network.neutron [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] validate_networks() for [('dffe86f9-2197-4b69-8bd4-b6d6d21427e8', None, None, None, None, None)] {{(pid=128844) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 19:00:52.048239 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Flavor limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 19:00:52.048734 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Image limits 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 19:00:52.049223 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Flavor pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 19:00:52.049860 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Image pref 0:0:0 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 19:00:52.050638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.virt.hardware [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 19:00:52.064418 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:52.065247 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:52.065995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:52.067270 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:52.068051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:52.068781 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:52.087066 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Getting quotas for project 7a6a8408fe804f3ba003c04f91389ff0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 19:00:52.092870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Getting quotas for user 9b033c45094440e2b9b3e61486b7ed58 and project 7a6a8408fe804f3ba003c04f91389ff0. Resources: {'cores', 'ram', 'instances'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 19:00:52.153991 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Going to run 1 instances... {{(pid=128844) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 19:00:52.156287 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aee69ef0-c7c2-4078-b81c-271c18ca16f0',volume_size=None,volume_type=None)] {{(pid=128844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 19:00:52.296758 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-12ef11d2-e63e-4e8a-8b89-25c3780d0ead tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.861381 Oct 05 19:00:52.297383 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3953/7665] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 19:00:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 19:00:52.306866 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:00:52.308063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:00:52.308964 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:00:52.313483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fe00d152-2a03-4dc6-8e6a-8574ac6fa090 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:52.314136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fe00d152-2a03-4dc6-8e6a-8574ac6fa090 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:52.395468 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fe00d152-2a03-4dc6-8e6a-8574ac6fa090 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:00:52.404026 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fe00d152-2a03-4dc6-8e6a-8574ac6fa090 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1087 microversion: 2.1 time: 0.099112 Oct 05 19:00:52.404607 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3713/7666] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:00:52 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1087 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:00:53.428256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e6a6c71e-ebaa-48a5-b94e-2ceec3066c1e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:53.428889 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e6a6c71e-ebaa-48a5-b94e-2ceec3066c1e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:53.486477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e6a6c71e-ebaa-48a5-b94e-2ceec3066c1e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:00:53.494478 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e6a6c71e-ebaa-48a5-b94e-2ceec3066c1e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1087 microversion: 2.1 time: 0.070999 Oct 05 19:00:53.495063 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3954/7667] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:00:53 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:00:54.517013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-abc4c90d-6c72-44f2-b1c7-3f8a3351757e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:54.517647 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-abc4c90d-6c72-44f2-b1c7-3f8a3351757e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:54.573441 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-abc4c90d-6c72-44f2-b1c7-3f8a3351757e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:00:54.580037 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-abc4c90d-6c72-44f2-b1c7-3f8a3351757e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1087 microversion: 2.1 time: 0.066974 Oct 05 19:00:54.580706 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3714/7668] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:00:54 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1087 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:00:55.604589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-be56f84d-d59d-4db9-8cd3-000b68d5f934 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:55.606321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-be56f84d-d59d-4db9-8cd3-000b68d5f934 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:55.661347 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-be56f84d-d59d-4db9-8cd3-000b68d5f934 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:00:55.668952 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-be56f84d-d59d-4db9-8cd3-000b68d5f934 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1087 microversion: 2.1 time: 0.068952 Oct 05 19:00:55.669719 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3955/7669] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:00:55 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:00:56.695264 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f8b11e53-e09a-41ac-ac40-e5d46249280b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:56.696243 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f8b11e53-e09a-41ac-ac40-e5d46249280b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:56.709117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8b11e53-e09a-41ac-ac40-e5d46249280b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:56.709932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8b11e53-e09a-41ac-ac40-e5d46249280b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:56.710720 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8b11e53-e09a-41ac-ac40-e5d46249280b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:56.711737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8b11e53-e09a-41ac-ac40-e5d46249280b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:56.712198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8b11e53-e09a-41ac-ac40-e5d46249280b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:56.712635 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f8b11e53-e09a-41ac-ac40-e5d46249280b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:56.782094 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f8b11e53-e09a-41ac-ac40-e5d46249280b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:00:56.790526 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f8b11e53-e09a-41ac-ac40-e5d46249280b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1137 microversion: 2.1 time: 0.101764 Oct 05 19:00:56.791126 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3715/7670] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:00:56 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1137 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:00:57.816941 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e738ac7e-dc38-4c09-81b3-bae6beff8945 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:57.817867 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e738ac7e-dc38-4c09-81b3-bae6beff8945 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:57.826450 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e738ac7e-dc38-4c09-81b3-bae6beff8945 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:57.827107 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e738ac7e-dc38-4c09-81b3-bae6beff8945 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:57.827685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e738ac7e-dc38-4c09-81b3-bae6beff8945 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:57.828671 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e738ac7e-dc38-4c09-81b3-bae6beff8945 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:57.829251 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e738ac7e-dc38-4c09-81b3-bae6beff8945 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:57.829803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e738ac7e-dc38-4c09-81b3-bae6beff8945 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:57.910629 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e738ac7e-dc38-4c09-81b3-bae6beff8945 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:00:57.920165 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e738ac7e-dc38-4c09-81b3-bae6beff8945 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1203 microversion: 2.1 time: 0.107625 Oct 05 19:00:57.931810 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3956/7671] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:00:57 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1203 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:00:58.943037 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8bac886f-0772-4204-8eec-2f7fe9db53fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:00:58.944279 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8bac886f-0772-4204-8eec-2f7fe9db53fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:00:58.951309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bac886f-0772-4204-8eec-2f7fe9db53fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:58.952040 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bac886f-0772-4204-8eec-2f7fe9db53fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:58.952656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bac886f-0772-4204-8eec-2f7fe9db53fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:58.953542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bac886f-0772-4204-8eec-2f7fe9db53fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:58.954161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bac886f-0772-4204-8eec-2f7fe9db53fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:58.954767 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8bac886f-0772-4204-8eec-2f7fe9db53fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:59.098748 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8bac886f-0772-4204-8eec-2f7fe9db53fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:00:59.108363 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8bac886f-0772-4204-8eec-2f7fe9db53fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1271 microversion: 2.1 time: 0.169197 Oct 05 19:00:59.114951 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3716/7672] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:00:58 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:00:59.248482 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c4d30c57-d113-4d82-8ffc-ad3ada1f0d91 req-32d50b1d-b0ac-4b18-99ab-ca48dd46134e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a25b07-a89d-44cc-9144-9ddc4a9cd668", "tag": "214e6793-ac47-4115-a561-2f62fdfdc5f9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:00:59.262871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c4d30c57-d113-4d82-8ffc-ad3ada1f0d91 req-32d50b1d-b0ac-4b18-99ab-ca48dd46134e service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:00:59.263672 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c4d30c57-d113-4d82-8ffc-ad3ada1f0d91 req-32d50b1d-b0ac-4b18-99ab-ca48dd46134e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:00:59.264338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c4d30c57-d113-4d82-8ffc-ad3ada1f0d91 req-32d50b1d-b0ac-4b18-99ab-ca48dd46134e service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:00:59.278013 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c4d30c57-d113-4d82-8ffc-ad3ada1f0d91 req-32d50b1d-b0ac-4b18-99ab-ca48dd46134e service nova] Creating event network-changed:214e6793-ac47-4115-a561-2f62fdfdc5f9 for instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 on n-h1-835595-3 Oct 05 19:00:59.283596 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c4d30c57-d113-4d82-8ffc-ad3ada1f0d91 req-32d50b1d-b0ac-4b18-99ab-ca48dd46134e service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039189 Oct 05 19:00:59.284589 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3957/7673] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:01:00.132158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-fca2cf28-3870-40fe-a1b7-31c0c0ae8aa6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:00.132739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-fca2cf28-3870-40fe-a1b7-31c0c0ae8aa6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:00.139803 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fca2cf28-3870-40fe-a1b7-31c0c0ae8aa6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:00.140295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fca2cf28-3870-40fe-a1b7-31c0c0ae8aa6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:00.140729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fca2cf28-3870-40fe-a1b7-31c0c0ae8aa6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:00.141431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fca2cf28-3870-40fe-a1b7-31c0c0ae8aa6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:00.141886 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fca2cf28-3870-40fe-a1b7-31c0c0ae8aa6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:00.142404 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-fca2cf28-3870-40fe-a1b7-31c0c0ae8aa6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:00.335325 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-fca2cf28-3870-40fe-a1b7-31c0c0ae8aa6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:00.343763 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-fca2cf28-3870-40fe-a1b7-31c0c0ae8aa6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1271 microversion: 2.1 time: 0.215736 Oct 05 19:01:00.344353 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3717/7674] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:00 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1271 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:01.369339 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-87443462-fc12-4f45-8b78-025da35e1e49 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:01.370059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-87443462-fc12-4f45-8b78-025da35e1e49 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:01.376990 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87443462-fc12-4f45-8b78-025da35e1e49 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:01.377522 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87443462-fc12-4f45-8b78-025da35e1e49 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:01.377977 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87443462-fc12-4f45-8b78-025da35e1e49 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:01.378753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87443462-fc12-4f45-8b78-025da35e1e49 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:01.379243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87443462-fc12-4f45-8b78-025da35e1e49 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:01.379706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-87443462-fc12-4f45-8b78-025da35e1e49 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:01.573370 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-87443462-fc12-4f45-8b78-025da35e1e49 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:01.581704 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-87443462-fc12-4f45-8b78-025da35e1e49 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1271 microversion: 2.1 time: 0.218424 Oct 05 19:01:01.582258 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3958/7675] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:01 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1271 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:02.609699 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9d97c697-3d7a-48c6-a706-583f31a0b23a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:02.610855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9d97c697-3d7a-48c6-a706-583f31a0b23a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:02.620582 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d97c697-3d7a-48c6-a706-583f31a0b23a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:02.621065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d97c697-3d7a-48c6-a706-583f31a0b23a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:02.621513 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d97c697-3d7a-48c6-a706-583f31a0b23a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:02.622211 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d97c697-3d7a-48c6-a706-583f31a0b23a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:02.622703 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d97c697-3d7a-48c6-a706-583f31a0b23a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:02.623134 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9d97c697-3d7a-48c6-a706-583f31a0b23a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:02.762446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9d97c697-3d7a-48c6-a706-583f31a0b23a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:02.770939 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9d97c697-3d7a-48c6-a706-583f31a0b23a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1259 microversion: 2.1 time: 0.168024 Oct 05 19:01:02.771593 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3718/7676] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:02 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:03.798881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-6592c8c5-1c0f-4ad8-8bc3-2220958779a6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:03.799853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-6592c8c5-1c0f-4ad8-8bc3-2220958779a6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:03.803037 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:01:03.813309 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6592c8c5-1c0f-4ad8-8bc3-2220958779a6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:03.814173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6592c8c5-1c0f-4ad8-8bc3-2220958779a6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:03.814935 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6592c8c5-1c0f-4ad8-8bc3-2220958779a6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:03.816092 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6592c8c5-1c0f-4ad8-8bc3-2220958779a6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:03.816844 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6592c8c5-1c0f-4ad8-8bc3-2220958779a6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:03.817576 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-6592c8c5-1c0f-4ad8-8bc3-2220958779a6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:03.956365 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-6592c8c5-1c0f-4ad8-8bc3-2220958779a6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:03.964750 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-6592c8c5-1c0f-4ad8-8bc3-2220958779a6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1259 microversion: 2.1 time: 0.172639 Oct 05 19:01:03.965397 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3959/7677] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:03 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:04.988083 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b3e72383-1dfd-499a-b615-41aa73fd9b92 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:04.988840 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b3e72383-1dfd-499a-b615-41aa73fd9b92 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:04.991622 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=4 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:01:04.997576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3e72383-1dfd-499a-b615-41aa73fd9b92 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:04.998059 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3e72383-1dfd-499a-b615-41aa73fd9b92 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:04.998562 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3e72383-1dfd-499a-b615-41aa73fd9b92 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:04.999292 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3e72383-1dfd-499a-b615-41aa73fd9b92 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:04.999746 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3e72383-1dfd-499a-b615-41aa73fd9b92 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:05.000182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b3e72383-1dfd-499a-b615-41aa73fd9b92 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:05.156658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b3e72383-1dfd-499a-b615-41aa73fd9b92 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:05.165305 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b3e72383-1dfd-499a-b615-41aa73fd9b92 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1259 microversion: 2.1 time: 0.181313 Oct 05 19:01:05.165827 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3719/7678] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:04 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:06.188154 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-07ba8a92-6a16-4f8a-8e02-2ec6e4b7c5a0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:06.188806 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-07ba8a92-6a16-4f8a-8e02-2ec6e4b7c5a0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:06.191535 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=10 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:01:06.197505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ba8a92-6a16-4f8a-8e02-2ec6e4b7c5a0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:06.198011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ba8a92-6a16-4f8a-8e02-2ec6e4b7c5a0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:06.198495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ba8a92-6a16-4f8a-8e02-2ec6e4b7c5a0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:06.199215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ba8a92-6a16-4f8a-8e02-2ec6e4b7c5a0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:06.199680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ba8a92-6a16-4f8a-8e02-2ec6e4b7c5a0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:06.200098 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-07ba8a92-6a16-4f8a-8e02-2ec6e4b7c5a0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:06.347712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-07ba8a92-6a16-4f8a-8e02-2ec6e4b7c5a0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:06.360213 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-07ba8a92-6a16-4f8a-8e02-2ec6e4b7c5a0 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1259 microversion: 2.1 time: 0.175681 Oct 05 19:01:06.361013 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3960/7679] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:06 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:07.389717 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d1f81f8d-4a4d-4855-b6ca-8aa068e90e2b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:07.390515 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d1f81f8d-4a4d-4855-b6ca-8aa068e90e2b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:07.400108 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1f81f8d-4a4d-4855-b6ca-8aa068e90e2b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:07.400728 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1f81f8d-4a4d-4855-b6ca-8aa068e90e2b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:07.401280 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1f81f8d-4a4d-4855-b6ca-8aa068e90e2b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:07.402149 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1f81f8d-4a4d-4855-b6ca-8aa068e90e2b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:07.402762 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1f81f8d-4a4d-4855-b6ca-8aa068e90e2b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:07.403309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d1f81f8d-4a4d-4855-b6ca-8aa068e90e2b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:07.542063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d1f81f8d-4a4d-4855-b6ca-8aa068e90e2b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:07.550705 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d1f81f8d-4a4d-4855-b6ca-8aa068e90e2b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1259 microversion: 2.1 time: 0.166024 Oct 05 19:01:07.551291 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3720/7680] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:07 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:08.578327 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-77a51efa-891f-4dc5-a0c2-3ecc0b6788cf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:08.579306 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-77a51efa-891f-4dc5-a0c2-3ecc0b6788cf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:08.592052 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77a51efa-891f-4dc5-a0c2-3ecc0b6788cf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:08.592908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77a51efa-891f-4dc5-a0c2-3ecc0b6788cf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:08.593661 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77a51efa-891f-4dc5-a0c2-3ecc0b6788cf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:08.594414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77a51efa-891f-4dc5-a0c2-3ecc0b6788cf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:08.594891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77a51efa-891f-4dc5-a0c2-3ecc0b6788cf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:08.595322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-77a51efa-891f-4dc5-a0c2-3ecc0b6788cf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:08.741262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-77a51efa-891f-4dc5-a0c2-3ecc0b6788cf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:08.750005 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-77a51efa-891f-4dc5-a0c2-3ecc0b6788cf tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1259 microversion: 2.1 time: 0.178791 Oct 05 19:01:08.750632 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3961/7681] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:08 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:09.777150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-19fd6535-60ad-48e9-973e-4efeb95ad3d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:09.778030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-19fd6535-60ad-48e9-973e-4efeb95ad3d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:09.787117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19fd6535-60ad-48e9-973e-4efeb95ad3d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:09.787805 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19fd6535-60ad-48e9-973e-4efeb95ad3d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:09.788412 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19fd6535-60ad-48e9-973e-4efeb95ad3d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:09.789394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19fd6535-60ad-48e9-973e-4efeb95ad3d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:09.790030 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19fd6535-60ad-48e9-973e-4efeb95ad3d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:09.790690 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-19fd6535-60ad-48e9-973e-4efeb95ad3d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:09.941002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-19fd6535-60ad-48e9-973e-4efeb95ad3d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:09.949550 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-19fd6535-60ad-48e9-973e-4efeb95ad3d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1259 microversion: 2.1 time: 0.179740 Oct 05 19:01:09.964902 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3721/7682] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:09 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:10.973508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b17a2642-0fd4-480f-9f2f-7a31ecb6e00b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:10.974128 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b17a2642-0fd4-480f-9f2f-7a31ecb6e00b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:10.981530 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17a2642-0fd4-480f-9f2f-7a31ecb6e00b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:10.982034 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17a2642-0fd4-480f-9f2f-7a31ecb6e00b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:10.982536 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17a2642-0fd4-480f-9f2f-7a31ecb6e00b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:10.983249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17a2642-0fd4-480f-9f2f-7a31ecb6e00b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:10.983723 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17a2642-0fd4-480f-9f2f-7a31ecb6e00b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:10.984165 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b17a2642-0fd4-480f-9f2f-7a31ecb6e00b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:11.127797 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b17a2642-0fd4-480f-9f2f-7a31ecb6e00b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:11.136504 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b17a2642-0fd4-480f-9f2f-7a31ecb6e00b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1259 microversion: 2.1 time: 0.167113 Oct 05 19:01:11.137099 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3962/7683] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:10 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:11.958938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-0bda4050-86f4-45b3-af52-99b0e8869650 req-1b391b2d-6f93-44da-b527-9248e4b3c6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a25b07-a89d-44cc-9144-9ddc4a9cd668", "name": "network-vif-plugged", "status": "completed", "tag": "214e6793-ac47-4115-a561-2f62fdfdc5f9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:01:11.970487 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0bda4050-86f4-45b3-af52-99b0e8869650 req-1b391b2d-6f93-44da-b527-9248e4b3c6c8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:11.970999 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0bda4050-86f4-45b3-af52-99b0e8869650 req-1b391b2d-6f93-44da-b527-9248e4b3c6c8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:11.972006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-0bda4050-86f4-45b3-af52-99b0e8869650 req-1b391b2d-6f93-44da-b527-9248e4b3c6c8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:11.983300 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-0bda4050-86f4-45b3-af52-99b0e8869650 req-1b391b2d-6f93-44da-b527-9248e4b3c6c8 service nova] Creating event network-vif-plugged:214e6793-ac47-4115-a561-2f62fdfdc5f9 for instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 on n-h1-835595-3 Oct 05 19:01:11.988571 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-0bda4050-86f4-45b3-af52-99b0e8869650 req-1b391b2d-6f93-44da-b527-9248e4b3c6c8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033604 Oct 05 19:01:11.989204 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3722/7684] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:01:12.160372 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-daa05345-6191-458f-95d3-8b2be956e030 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:12.160982 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-daa05345-6191-458f-95d3-8b2be956e030 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:12.168322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-daa05345-6191-458f-95d3-8b2be956e030 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:12.168826 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-daa05345-6191-458f-95d3-8b2be956e030 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:12.169276 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-daa05345-6191-458f-95d3-8b2be956e030 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:12.169985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-daa05345-6191-458f-95d3-8b2be956e030 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:12.170497 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-daa05345-6191-458f-95d3-8b2be956e030 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:12.170975 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-daa05345-6191-458f-95d3-8b2be956e030 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:12.316193 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-daa05345-6191-458f-95d3-8b2be956e030 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:12.326434 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-daa05345-6191-458f-95d3-8b2be956e030 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1259 microversion: 2.1 time: 0.169853 Oct 05 19:01:12.327245 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3963/7685] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:12 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:13.354368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d3e414b9-43fe-4e36-ab21-0a278bc2f603 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:13.355177 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d3e414b9-43fe-4e36-ab21-0a278bc2f603 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:13.364431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3e414b9-43fe-4e36-ab21-0a278bc2f603 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:13.364915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3e414b9-43fe-4e36-ab21-0a278bc2f603 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:13.365356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3e414b9-43fe-4e36-ab21-0a278bc2f603 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:13.366046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3e414b9-43fe-4e36-ab21-0a278bc2f603 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:13.366538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3e414b9-43fe-4e36-ab21-0a278bc2f603 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:13.366962 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d3e414b9-43fe-4e36-ab21-0a278bc2f603 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:13.507418 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d3e414b9-43fe-4e36-ab21-0a278bc2f603 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:13.519232 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d3e414b9-43fe-4e36-ab21-0a278bc2f603 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1442 microversion: 2.1 time: 0.172907 Oct 05 19:01:13.519821 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3723/7686] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:13 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1442 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:13.541434 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-19957b3a-7f4d-45f2-9907-cfb7b1402235 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:01:13.542056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-19957b3a-7f4d-45f2-9907-cfb7b1402235 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:01:13.549068 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19957b3a-7f4d-45f2-9907-cfb7b1402235 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:13.549675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19957b3a-7f4d-45f2-9907-cfb7b1402235 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:13.550125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19957b3a-7f4d-45f2-9907-cfb7b1402235 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:13.550851 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19957b3a-7f4d-45f2-9907-cfb7b1402235 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:13.551322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19957b3a-7f4d-45f2-9907-cfb7b1402235 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:13.551755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-19957b3a-7f4d-45f2-9907-cfb7b1402235 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:13.701761 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-19957b3a-7f4d-45f2-9907-cfb7b1402235 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:01:13.712601 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-19957b3a-7f4d-45f2-9907-cfb7b1402235 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1442 microversion: 2.1 time: 0.174786 Oct 05 19:01:13.713441 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3964/7687] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:01:13 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1442 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:01:15.392386 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b91fc635-6fc0-489c-8e39-940bec80ce77 req-ee76bdd7-3f69-4693-8340-95b6184652ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a25b07-a89d-44cc-9144-9ddc4a9cd668", "tag": "214e6793-ac47-4115-a561-2f62fdfdc5f9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:01:15.403263 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b91fc635-6fc0-489c-8e39-940bec80ce77 req-ee76bdd7-3f69-4693-8340-95b6184652ec service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:01:15.403737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b91fc635-6fc0-489c-8e39-940bec80ce77 req-ee76bdd7-3f69-4693-8340-95b6184652ec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:01:15.404170 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b91fc635-6fc0-489c-8e39-940bec80ce77 req-ee76bdd7-3f69-4693-8340-95b6184652ec service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:01:15.416140 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b91fc635-6fc0-489c-8e39-940bec80ce77 req-ee76bdd7-3f69-4693-8340-95b6184652ec service nova] Creating event network-changed:214e6793-ac47-4115-a561-2f62fdfdc5f9 for instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 on n-h1-835595-3 Oct 05 19:01:15.423711 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b91fc635-6fc0-489c-8e39-940bec80ce77 req-ee76bdd7-3f69-4693-8340-95b6184652ec service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035188 Oct 05 19:01:15.424689 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3724/7688] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:03:11.628970 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d9585d8e-c85f-4e0e-8626-ea6a3c823e4e] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 19:03:11.630606 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e95dc271-cddc-4501-83b4-4d8d4789eaf1] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 19:03:11.632253 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:03:11.633505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=52 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:03:11.636273 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 19:03:11.636567 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 19:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668/action (ip 10.222.0.70) !!! Oct 05 19:03:11.703010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0c95c226-1ad9-4f7a-8885-8a40acfa67fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:03:11.703570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0c95c226-1ad9-4f7a-8885-8a40acfa67fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:11.710014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c95c226-1ad9-4f7a-8885-8a40acfa67fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:11.710862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c95c226-1ad9-4f7a-8885-8a40acfa67fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:11.711310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c95c226-1ad9-4f7a-8885-8a40acfa67fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:11.712014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c95c226-1ad9-4f7a-8885-8a40acfa67fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:11.712485 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c95c226-1ad9-4f7a-8885-8a40acfa67fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:11.712923 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0c95c226-1ad9-4f7a-8885-8a40acfa67fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:11.736979 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.objects.instance [None req-0c95c226-1ad9-4f7a-8885-8a40acfa67fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lazy-loading 'flavor' on Instance uuid e6a25b07-a89d-44cc-9144-9ddc4a9cd668 {{(pid=128844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 19:03:11.821848 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0c95c226-1ad9-4f7a-8885-8a40acfa67fb tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "POST /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668/action" status: 202 len: 0 microversion: 2.1 time: 0.195910 Oct 05 19:03:11.822482 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3965/7689] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 19:03:11 2022] POST /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 19:03:11.829230 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1744094-4a20-4501-8b29-640f444f590e] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 19:03:11.830116 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3358724b-f52c-4a69-8c22-3305520f8c1e] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 19:03:11.830750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=28 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:03:11.831509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=52 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:03:11.832508 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 05 19:03:11.832674 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 19:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 (ip 10.222.0.70) !!! Oct 05 19:03:11.834055 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 19:03:11.834226 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 19:03:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 (ip 10.222.0.70) !!! Oct 05 19:03:11.841764 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-772605a0-31c4-409e-83b5-e3e09d67643e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:11.842581 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-772605a0-31c4-409e-83b5-e3e09d67643e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:11.852046 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-772605a0-31c4-409e-83b5-e3e09d67643e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:11.852543 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-772605a0-31c4-409e-83b5-e3e09d67643e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:11.852979 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-772605a0-31c4-409e-83b5-e3e09d67643e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:11.853680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-772605a0-31c4-409e-83b5-e3e09d67643e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:11.854136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-772605a0-31c4-409e-83b5-e3e09d67643e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:11.854601 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-772605a0-31c4-409e-83b5-e3e09d67643e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:11.996381 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-772605a0-31c4-409e-83b5-e3e09d67643e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:12.004733 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-772605a0-31c4-409e-83b5-e3e09d67643e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.177553 Oct 05 19:03:12.005328 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3725/7690] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:11 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:13.033924 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-4496f714-c84f-4840-bd43-c72880f7359a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:13.035113 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-4496f714-c84f-4840-bd43-c72880f7359a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:13.051324 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4496f714-c84f-4840-bd43-c72880f7359a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:13.051827 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4496f714-c84f-4840-bd43-c72880f7359a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:13.052307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4496f714-c84f-4840-bd43-c72880f7359a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:13.053044 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4496f714-c84f-4840-bd43-c72880f7359a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:13.053534 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4496f714-c84f-4840-bd43-c72880f7359a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:13.053971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-4496f714-c84f-4840-bd43-c72880f7359a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:13.060957 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] [e95dc271-cddc-4501-83b4-4d8d4789eaf1] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39136. Oct 05 19:03:13.071862 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] [d9585d8e-c85f-4e0e-8626-ea6a3c823e4e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39134. Oct 05 19:03:13.205468 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-4496f714-c84f-4840-bd43-c72880f7359a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:13.217893 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-4496f714-c84f-4840-bd43-c72880f7359a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.191396 Oct 05 19:03:13.218691 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3966/7691] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:13 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:14.245814 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-bcf7fcb2-2a76-476f-8904-147b74cf2160 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:14.246867 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-bcf7fcb2-2a76-476f-8904-147b74cf2160 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:14.258307 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcf7fcb2-2a76-476f-8904-147b74cf2160 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:14.258913 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcf7fcb2-2a76-476f-8904-147b74cf2160 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:14.259334 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcf7fcb2-2a76-476f-8904-147b74cf2160 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:14.260025 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcf7fcb2-2a76-476f-8904-147b74cf2160 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:14.260478 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcf7fcb2-2a76-476f-8904-147b74cf2160 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:14.260907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-bcf7fcb2-2a76-476f-8904-147b74cf2160 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:14.264675 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1744094-4a20-4501-8b29-640f444f590e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39140. Oct 05 19:03:14.267790 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] [3358724b-f52c-4a69-8c22-3305520f8c1e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39142. Oct 05 19:03:14.401127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-bcf7fcb2-2a76-476f-8904-147b74cf2160 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:14.414226 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-bcf7fcb2-2a76-476f-8904-147b74cf2160 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.174766 Oct 05 19:03:14.415221 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3726/7692] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:14 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:15.446170 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b81560f4-3f3c-4c06-995e-9568b80dcba6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:15.447249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b81560f4-3f3c-4c06-995e-9568b80dcba6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:15.459231 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b81560f4-3f3c-4c06-995e-9568b80dcba6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:15.460062 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b81560f4-3f3c-4c06-995e-9568b80dcba6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:15.461167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b81560f4-3f3c-4c06-995e-9568b80dcba6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:15.462353 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b81560f4-3f3c-4c06-995e-9568b80dcba6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:15.463177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b81560f4-3f3c-4c06-995e-9568b80dcba6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:15.463917 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b81560f4-3f3c-4c06-995e-9568b80dcba6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:15.607637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b81560f4-3f3c-4c06-995e-9568b80dcba6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:15.615803 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b81560f4-3f3c-4c06-995e-9568b80dcba6 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.176606 Oct 05 19:03:15.616393 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3967/7693] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:15 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:16.643198 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c8e19d84-c4ed-44c3-84e6-da895437f78c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:16.643773 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c8e19d84-c4ed-44c3-84e6-da895437f78c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:16.651001 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e19d84-c4ed-44c3-84e6-da895437f78c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:16.651483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e19d84-c4ed-44c3-84e6-da895437f78c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:16.651914 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e19d84-c4ed-44c3-84e6-da895437f78c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:16.652599 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e19d84-c4ed-44c3-84e6-da895437f78c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:16.653051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e19d84-c4ed-44c3-84e6-da895437f78c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:16.653469 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c8e19d84-c4ed-44c3-84e6-da895437f78c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:16.796731 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c8e19d84-c4ed-44c3-84e6-da895437f78c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:16.804844 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c8e19d84-c4ed-44c3-84e6-da895437f78c tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.168014 Oct 05 19:03:16.805396 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3727/7694] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:16 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:17.832547 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-50275c08-e439-4da7-9604-6071cf374a29 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:17.833635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-50275c08-e439-4da7-9604-6071cf374a29 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:17.845479 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50275c08-e439-4da7-9604-6071cf374a29 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:17.846295 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50275c08-e439-4da7-9604-6071cf374a29 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:17.846753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50275c08-e439-4da7-9604-6071cf374a29 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:17.847457 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50275c08-e439-4da7-9604-6071cf374a29 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:17.847926 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50275c08-e439-4da7-9604-6071cf374a29 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:17.848359 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-50275c08-e439-4da7-9604-6071cf374a29 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:18.001322 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-50275c08-e439-4da7-9604-6071cf374a29 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:18.013191 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-50275c08-e439-4da7-9604-6071cf374a29 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.187051 Oct 05 19:03:18.013973 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3968/7695] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:17 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:19.041133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3e8d7dd1-9fbf-4e19-8487-bba35fdb0eac tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:19.041760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3e8d7dd1-9fbf-4e19-8487-bba35fdb0eac tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:19.051716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e8d7dd1-9fbf-4e19-8487-bba35fdb0eac tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:19.052446 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e8d7dd1-9fbf-4e19-8487-bba35fdb0eac tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:19.052882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e8d7dd1-9fbf-4e19-8487-bba35fdb0eac tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:19.053578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e8d7dd1-9fbf-4e19-8487-bba35fdb0eac tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:19.054027 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e8d7dd1-9fbf-4e19-8487-bba35fdb0eac tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:19.054508 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3e8d7dd1-9fbf-4e19-8487-bba35fdb0eac tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:19.187364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3e8d7dd1-9fbf-4e19-8487-bba35fdb0eac tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:19.195850 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3e8d7dd1-9fbf-4e19-8487-bba35fdb0eac tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.160754 Oct 05 19:03:19.196465 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3728/7696] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:19 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:20.233177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8b1f9a23-65b9-410f-8281-dfbf71d7dc56 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:20.234210 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8b1f9a23-65b9-410f-8281-dfbf71d7dc56 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:20.246266 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b1f9a23-65b9-410f-8281-dfbf71d7dc56 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:20.247160 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b1f9a23-65b9-410f-8281-dfbf71d7dc56 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:20.247909 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b1f9a23-65b9-410f-8281-dfbf71d7dc56 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:20.249084 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b1f9a23-65b9-410f-8281-dfbf71d7dc56 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:20.249870 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b1f9a23-65b9-410f-8281-dfbf71d7dc56 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:20.250670 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8b1f9a23-65b9-410f-8281-dfbf71d7dc56 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:20.399881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8b1f9a23-65b9-410f-8281-dfbf71d7dc56 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:20.408452 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8b1f9a23-65b9-410f-8281-dfbf71d7dc56 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.181993 Oct 05 19:03:20.409027 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3969/7697] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:20 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:21.434975 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-426ca00a-1925-4c0a-ad7e-06519c9eaf20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:21.435837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-426ca00a-1925-4c0a-ad7e-06519c9eaf20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:21.444991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-426ca00a-1925-4c0a-ad7e-06519c9eaf20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:21.445697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-426ca00a-1925-4c0a-ad7e-06519c9eaf20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:21.446311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-426ca00a-1925-4c0a-ad7e-06519c9eaf20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:21.447312 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-426ca00a-1925-4c0a-ad7e-06519c9eaf20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:21.447994 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-426ca00a-1925-4c0a-ad7e-06519c9eaf20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:21.448560 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-426ca00a-1925-4c0a-ad7e-06519c9eaf20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:21.606049 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-426ca00a-1925-4c0a-ad7e-06519c9eaf20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:21.618280 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-426ca00a-1925-4c0a-ad7e-06519c9eaf20 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.188586 Oct 05 19:03:21.619028 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3729/7698] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:21 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:22.645510 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ecdd4f69-8ff0-46ac-bc3f-fd53289e56ab tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:22.646148 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ecdd4f69-8ff0-46ac-bc3f-fd53289e56ab tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:22.653747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdd4f69-8ff0-46ac-bc3f-fd53289e56ab tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:22.654257 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdd4f69-8ff0-46ac-bc3f-fd53289e56ab tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:22.654747 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdd4f69-8ff0-46ac-bc3f-fd53289e56ab tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:22.655476 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdd4f69-8ff0-46ac-bc3f-fd53289e56ab tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:22.655949 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdd4f69-8ff0-46ac-bc3f-fd53289e56ab tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:22.656392 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ecdd4f69-8ff0-46ac-bc3f-fd53289e56ab tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:22.870042 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ecdd4f69-8ff0-46ac-bc3f-fd53289e56ab tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:22.878937 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ecdd4f69-8ff0-46ac-bc3f-fd53289e56ab tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.237527 Oct 05 19:03:22.879635 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3970/7699] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:22 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:23.907171 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6ce7ebea-ef86-4bda-a81b-ed5168459aca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:23.908653 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6ce7ebea-ef86-4bda-a81b-ed5168459aca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:23.916479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ce7ebea-ef86-4bda-a81b-ed5168459aca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:23.917105 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ce7ebea-ef86-4bda-a81b-ed5168459aca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:23.917574 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ce7ebea-ef86-4bda-a81b-ed5168459aca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:23.918313 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ce7ebea-ef86-4bda-a81b-ed5168459aca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:23.918890 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ce7ebea-ef86-4bda-a81b-ed5168459aca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:23.919301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6ce7ebea-ef86-4bda-a81b-ed5168459aca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:24.054818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6ce7ebea-ef86-4bda-a81b-ed5168459aca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:24.066527 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6ce7ebea-ef86-4bda-a81b-ed5168459aca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.166066 Oct 05 19:03:24.067467 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3730/7700] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:23 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:25.099386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-983e1a1c-3e6f-4d37-85e1-fe90b6e081e3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:25.100176 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-983e1a1c-3e6f-4d37-85e1-fe90b6e081e3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:25.107496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-983e1a1c-3e6f-4d37-85e1-fe90b6e081e3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:25.107993 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-983e1a1c-3e6f-4d37-85e1-fe90b6e081e3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:25.108433 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-983e1a1c-3e6f-4d37-85e1-fe90b6e081e3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:25.109143 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-983e1a1c-3e6f-4d37-85e1-fe90b6e081e3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:25.109606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-983e1a1c-3e6f-4d37-85e1-fe90b6e081e3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:25.110040 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-983e1a1c-3e6f-4d37-85e1-fe90b6e081e3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:25.248995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-983e1a1c-3e6f-4d37-85e1-fe90b6e081e3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:25.257218 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-983e1a1c-3e6f-4d37-85e1-fe90b6e081e3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.161967 Oct 05 19:03:25.257811 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3971/7701] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:25 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:26.280818 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-02f4a77c-9c03-4008-9310-cc82ca718394 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:26.281465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-02f4a77c-9c03-4008-9310-cc82ca718394 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:26.288558 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4a77c-9c03-4008-9310-cc82ca718394 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:26.289072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4a77c-9c03-4008-9310-cc82ca718394 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:26.289544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4a77c-9c03-4008-9310-cc82ca718394 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:26.290241 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4a77c-9c03-4008-9310-cc82ca718394 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:26.290733 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4a77c-9c03-4008-9310-cc82ca718394 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:26.291156 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-02f4a77c-9c03-4008-9310-cc82ca718394 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:26.430449 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-02f4a77c-9c03-4008-9310-cc82ca718394 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:26.443156 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-02f4a77c-9c03-4008-9310-cc82ca718394 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1568 microversion: 2.1 time: 0.166133 Oct 05 19:03:26.444000 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3731/7702] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:26 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:26.471601 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-267120eb-e45d-407f-b6f8-f6ea5212eb94 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:03:26.472311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-267120eb-e45d-407f-b6f8-f6ea5212eb94 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:26.479987 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-267120eb-e45d-407f-b6f8-f6ea5212eb94 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:26.480492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-267120eb-e45d-407f-b6f8-f6ea5212eb94 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:26.480951 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-267120eb-e45d-407f-b6f8-f6ea5212eb94 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:26.481666 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-267120eb-e45d-407f-b6f8-f6ea5212eb94 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:26.482142 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-267120eb-e45d-407f-b6f8-f6ea5212eb94 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:26.482618 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-267120eb-e45d-407f-b6f8-f6ea5212eb94 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:26.533985 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-267120eb-e45d-407f-b6f8-f6ea5212eb94 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128844) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 05 19:03:26.609001 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-267120eb-e45d-407f-b6f8-f6ea5212eb94 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "POST /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668/action" status: 202 len: 0 microversion: 2.1 time: 0.141981 Oct 05 19:03:26.609571 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3972/7703] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 19:03:26 2022] POST /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 19:03:26.618479 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-6dc69abc-9889-4858-a9b9-c636c29ae95b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:26.619756 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-6dc69abc-9889-4858-a9b9-c636c29ae95b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:26.625337 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc69abc-9889-4858-a9b9-c636c29ae95b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:26.625813 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc69abc-9889-4858-a9b9-c636c29ae95b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:26.626305 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc69abc-9889-4858-a9b9-c636c29ae95b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:26.627088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc69abc-9889-4858-a9b9-c636c29ae95b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:26.628075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc69abc-9889-4858-a9b9-c636c29ae95b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:26.628809 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-6dc69abc-9889-4858-a9b9-c636c29ae95b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:26.645316 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-1bc949be-e0cc-482d-a749-9a06cdc94d9e req-39c36fa9-e6d2-4dcb-9485-a6983e0a5877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a25b07-a89d-44cc-9144-9ddc4a9cd668", "name": "network-vif-unplugged", "status": "completed", "tag": "214e6793-ac47-4115-a561-2f62fdfdc5f9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:03:26.657232 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1bc949be-e0cc-482d-a749-9a06cdc94d9e req-39c36fa9-e6d2-4dcb-9485-a6983e0a5877 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:26.658080 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1bc949be-e0cc-482d-a749-9a06cdc94d9e req-39c36fa9-e6d2-4dcb-9485-a6983e0a5877 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:26.658760 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-1bc949be-e0cc-482d-a749-9a06cdc94d9e req-39c36fa9-e6d2-4dcb-9485-a6983e0a5877 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:26.671590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.compute.server_external_events [req-1bc949be-e0cc-482d-a749-9a06cdc94d9e req-39c36fa9-e6d2-4dcb-9485-a6983e0a5877 service nova] Unable to find a host for instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668. Dropping event network-vif-unplugged {{(pid=128844) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 05 19:03:26.672781 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-1bc949be-e0cc-482d-a749-9a06cdc94d9e req-39c36fa9-e6d2-4dcb-9485-a6983e0a5877 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036760 Oct 05 19:03:26.673861 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3973/7704] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 05 19:03:26.802364 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-6dc69abc-9889-4858-a9b9-c636c29ae95b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:26.811290 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-6dc69abc-9889-4858-a9b9-c636c29ae95b tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1516 microversion: 2.1 time: 0.196708 Oct 05 19:03:26.811880 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3732/7705] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:26 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:27.836739 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f337e29f-5fa6-4f7e-a9fe-4a73079f511a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:27.837427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f337e29f-5fa6-4f7e-a9fe-4a73079f511a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:27.844971 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f337e29f-5fa6-4f7e-a9fe-4a73079f511a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:27.845496 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f337e29f-5fa6-4f7e-a9fe-4a73079f511a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:27.845942 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f337e29f-5fa6-4f7e-a9fe-4a73079f511a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:27.846694 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f337e29f-5fa6-4f7e-a9fe-4a73079f511a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:27.847162 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f337e29f-5fa6-4f7e-a9fe-4a73079f511a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:27.847583 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f337e29f-5fa6-4f7e-a9fe-4a73079f511a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:27.987786 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f337e29f-5fa6-4f7e-a9fe-4a73079f511a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:27.996878 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f337e29f-5fa6-4f7e-a9fe-4a73079f511a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1518 microversion: 2.1 time: 0.164424 Oct 05 19:03:27.997511 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3974/7706] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:27 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:29.021164 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-76bda91c-d037-4190-b267-2ef4d8e4d389 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:29.022242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-76bda91c-d037-4190-b267-2ef4d8e4d389 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:29.029371 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76bda91c-d037-4190-b267-2ef4d8e4d389 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:29.029868 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76bda91c-d037-4190-b267-2ef4d8e4d389 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:29.030303 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76bda91c-d037-4190-b267-2ef4d8e4d389 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:29.031033 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76bda91c-d037-4190-b267-2ef4d8e4d389 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:29.031493 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76bda91c-d037-4190-b267-2ef4d8e4d389 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:29.031953 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-76bda91c-d037-4190-b267-2ef4d8e4d389 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:29.163415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-76bda91c-d037-4190-b267-2ef4d8e4d389 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:29.171628 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-76bda91c-d037-4190-b267-2ef4d8e4d389 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1518 microversion: 2.1 time: 0.154556 Oct 05 19:03:29.172214 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3733/7707] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:29 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:30.197568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-27470537-3445-4aee-92d1-15ce95ee49c7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:30.198138 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-27470537-3445-4aee-92d1-15ce95ee49c7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:30.205751 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27470537-3445-4aee-92d1-15ce95ee49c7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:30.206256 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27470537-3445-4aee-92d1-15ce95ee49c7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:30.206808 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27470537-3445-4aee-92d1-15ce95ee49c7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:30.207529 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27470537-3445-4aee-92d1-15ce95ee49c7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:30.208004 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27470537-3445-4aee-92d1-15ce95ee49c7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:30.208462 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-27470537-3445-4aee-92d1-15ce95ee49c7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:30.353590 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-27470537-3445-4aee-92d1-15ce95ee49c7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:30.361730 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-27470537-3445-4aee-92d1-15ce95ee49c7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1518 microversion: 2.1 time: 0.168344 Oct 05 19:03:30.362331 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3975/7708] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:30 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 19:03:31.385561 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c1c46b7b-b42d-403f-8c1d-242d0f3ae7dc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:31.386205 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c1c46b7b-b42d-403f-8c1d-242d0f3ae7dc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:31.393958 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c46b7b-b42d-403f-8c1d-242d0f3ae7dc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:31.394696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c46b7b-b42d-403f-8c1d-242d0f3ae7dc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:31.395229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c46b7b-b42d-403f-8c1d-242d0f3ae7dc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:31.396013 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c46b7b-b42d-403f-8c1d-242d0f3ae7dc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:31.396559 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c46b7b-b42d-403f-8c1d-242d0f3ae7dc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:31.397178 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c1c46b7b-b42d-403f-8c1d-242d0f3ae7dc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:31.536663 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c1c46b7b-b42d-403f-8c1d-242d0f3ae7dc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:31.546188 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c1c46b7b-b42d-403f-8c1d-242d0f3ae7dc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1518 microversion: 2.1 time: 0.164703 Oct 05 19:03:31.546863 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3734/7709] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:31 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:32.570664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-d9a6ee83-cac5-4dbb-9821-2e2d328b105e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:32.571461 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-d9a6ee83-cac5-4dbb-9821-2e2d328b105e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:32.578911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a6ee83-cac5-4dbb-9821-2e2d328b105e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:32.579533 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a6ee83-cac5-4dbb-9821-2e2d328b105e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:32.580057 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a6ee83-cac5-4dbb-9821-2e2d328b105e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:32.580972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a6ee83-cac5-4dbb-9821-2e2d328b105e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:32.581635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a6ee83-cac5-4dbb-9821-2e2d328b105e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:32.582071 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-d9a6ee83-cac5-4dbb-9821-2e2d328b105e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:32.723954 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-d9a6ee83-cac5-4dbb-9821-2e2d328b105e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:32.732598 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-d9a6ee83-cac5-4dbb-9821-2e2d328b105e tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.166076 Oct 05 19:03:32.733190 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3976/7710] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:32 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:33.756540 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d716e64e-db35-49bf-bb7b-2cdbf1d35024 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:33.757122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d716e64e-db35-49bf-bb7b-2cdbf1d35024 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:33.764356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d716e64e-db35-49bf-bb7b-2cdbf1d35024 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:33.765051 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d716e64e-db35-49bf-bb7b-2cdbf1d35024 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:33.765235 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d716e64e-db35-49bf-bb7b-2cdbf1d35024 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:33.765959 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d716e64e-db35-49bf-bb7b-2cdbf1d35024 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:33.766454 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d716e64e-db35-49bf-bb7b-2cdbf1d35024 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:33.766880 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d716e64e-db35-49bf-bb7b-2cdbf1d35024 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:33.801796 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6368e530-0983-4670-8846-303844630226 req-cc2a43b4-16b3-44de-8701-8646feae8a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a25b07-a89d-44cc-9144-9ddc4a9cd668", "tag": "214e6793-ac47-4115-a561-2f62fdfdc5f9"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:03:33.815311 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6368e530-0983-4670-8846-303844630226 req-cc2a43b4-16b3-44de-8701-8646feae8a4b service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:33.815908 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6368e530-0983-4670-8846-303844630226 req-cc2a43b4-16b3-44de-8701-8646feae8a4b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:33.816361 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6368e530-0983-4670-8846-303844630226 req-cc2a43b4-16b3-44de-8701-8646feae8a4b service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:33.828907 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6368e530-0983-4670-8846-303844630226 req-cc2a43b4-16b3-44de-8701-8646feae8a4b service nova] Creating event network-changed:214e6793-ac47-4115-a561-2f62fdfdc5f9 for instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 on n-h2-835595-3 Oct 05 19:03:33.835408 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6368e530-0983-4670-8846-303844630226 req-cc2a43b4-16b3-44de-8701-8646feae8a4b service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036428 Oct 05 19:03:33.836018 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3977/7711] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:03:34.021628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d716e64e-db35-49bf-bb7b-2cdbf1d35024 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:34.029728 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d716e64e-db35-49bf-bb7b-2cdbf1d35024 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.277285 Oct 05 19:03:34.030540 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3735/7712] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:33 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:35.054252 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-362b9bd4-d4a2-4582-9d0f-65793df28f1a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:35.055001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-362b9bd4-d4a2-4582-9d0f-65793df28f1a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:35.062503 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-362b9bd4-d4a2-4582-9d0f-65793df28f1a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:35.063010 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-362b9bd4-d4a2-4582-9d0f-65793df28f1a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:35.063473 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-362b9bd4-d4a2-4582-9d0f-65793df28f1a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:35.064181 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-362b9bd4-d4a2-4582-9d0f-65793df28f1a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:35.064645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-362b9bd4-d4a2-4582-9d0f-65793df28f1a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:35.065061 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-362b9bd4-d4a2-4582-9d0f-65793df28f1a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:35.204283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-362b9bd4-d4a2-4582-9d0f-65793df28f1a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:35.212845 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-362b9bd4-d4a2-4582-9d0f-65793df28f1a tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.162894 Oct 05 19:03:35.213630 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3978/7713] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:35 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:36.240658 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-27c913d2-a6c1-4eef-8987-1d6463dbeb69 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:36.241370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-27c913d2-a6c1-4eef-8987-1d6463dbeb69 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:36.248670 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c913d2-a6c1-4eef-8987-1d6463dbeb69 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:36.249154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c913d2-a6c1-4eef-8987-1d6463dbeb69 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:36.249590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c913d2-a6c1-4eef-8987-1d6463dbeb69 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:36.250309 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c913d2-a6c1-4eef-8987-1d6463dbeb69 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:36.250759 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c913d2-a6c1-4eef-8987-1d6463dbeb69 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:36.251182 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-27c913d2-a6c1-4eef-8987-1d6463dbeb69 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:36.386628 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-27c913d2-a6c1-4eef-8987-1d6463dbeb69 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:36.394848 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-27c913d2-a6c1-4eef-8987-1d6463dbeb69 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.160985 Oct 05 19:03:36.395440 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3736/7714] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:36 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:37.422863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-63890d5b-81ba-4a2d-9248-f9bc74152381 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:37.423904 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-63890d5b-81ba-4a2d-9248-f9bc74152381 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:37.432513 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63890d5b-81ba-4a2d-9248-f9bc74152381 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:37.433014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63890d5b-81ba-4a2d-9248-f9bc74152381 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:37.433470 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63890d5b-81ba-4a2d-9248-f9bc74152381 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:37.434184 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63890d5b-81ba-4a2d-9248-f9bc74152381 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:37.434693 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63890d5b-81ba-4a2d-9248-f9bc74152381 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:37.435137 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-63890d5b-81ba-4a2d-9248-f9bc74152381 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:37.583881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-63890d5b-81ba-4a2d-9248-f9bc74152381 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:37.587804 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:03:37.592847 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-63890d5b-81ba-4a2d-9248-f9bc74152381 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.176787 Oct 05 19:03:37.593438 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3979/7715] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:37 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:38.628259 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5f870c02-6bae-46fd-8b33-0eddc81e9be7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:38.629282 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5f870c02-6bae-46fd-8b33-0eddc81e9be7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:38.637328 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f870c02-6bae-46fd-8b33-0eddc81e9be7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:38.637837 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f870c02-6bae-46fd-8b33-0eddc81e9be7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:38.638321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f870c02-6bae-46fd-8b33-0eddc81e9be7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:38.639065 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f870c02-6bae-46fd-8b33-0eddc81e9be7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:38.639546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f870c02-6bae-46fd-8b33-0eddc81e9be7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:38.640056 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5f870c02-6bae-46fd-8b33-0eddc81e9be7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:38.782331 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5f870c02-6bae-46fd-8b33-0eddc81e9be7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:38.790959 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5f870c02-6bae-46fd-8b33-0eddc81e9be7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.169389 Oct 05 19:03:38.791540 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3737/7716] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:38 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:39.819157 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c974783a-d55c-4c7d-9076-a38aba718bc3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:39.820264 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c974783a-d55c-4c7d-9076-a38aba718bc3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:39.832712 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c974783a-d55c-4c7d-9076-a38aba718bc3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:39.833437 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c974783a-d55c-4c7d-9076-a38aba718bc3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:39.833891 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c974783a-d55c-4c7d-9076-a38aba718bc3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:39.834918 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c974783a-d55c-4c7d-9076-a38aba718bc3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:39.835426 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c974783a-d55c-4c7d-9076-a38aba718bc3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:39.835863 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c974783a-d55c-4c7d-9076-a38aba718bc3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:39.986446 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-c974783a-d55c-4c7d-9076-a38aba718bc3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:39.995148 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c974783a-d55c-4c7d-9076-a38aba718bc3 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.182689 Oct 05 19:03:39.995757 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3980/7717] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:39 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:41.019196 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-61729b92-6557-48fb-8f7e-54ac75209c79 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:41.019817 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-61729b92-6557-48fb-8f7e-54ac75209c79 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:41.027719 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61729b92-6557-48fb-8f7e-54ac75209c79 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:41.028209 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61729b92-6557-48fb-8f7e-54ac75209c79 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:41.028669 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61729b92-6557-48fb-8f7e-54ac75209c79 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:41.029370 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61729b92-6557-48fb-8f7e-54ac75209c79 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:41.029823 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61729b92-6557-48fb-8f7e-54ac75209c79 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:41.030244 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-61729b92-6557-48fb-8f7e-54ac75209c79 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:41.174675 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-61729b92-6557-48fb-8f7e-54ac75209c79 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:41.183103 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-61729b92-6557-48fb-8f7e-54ac75209c79 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.167964 Oct 05 19:03:41.183694 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3738/7718] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:41 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:42.210911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-59e8ab0f-902c-48a7-8e90-aeaef0f951f7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:42.211570 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-59e8ab0f-902c-48a7-8e90-aeaef0f951f7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:42.214936 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:03:42.221828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59e8ab0f-902c-48a7-8e90-aeaef0f951f7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:42.222512 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59e8ab0f-902c-48a7-8e90-aeaef0f951f7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:42.223064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59e8ab0f-902c-48a7-8e90-aeaef0f951f7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:42.223939 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59e8ab0f-902c-48a7-8e90-aeaef0f951f7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:42.224543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59e8ab0f-902c-48a7-8e90-aeaef0f951f7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:42.225081 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-59e8ab0f-902c-48a7-8e90-aeaef0f951f7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:42.368508 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-59e8ab0f-902c-48a7-8e90-aeaef0f951f7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:42.376708 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-59e8ab0f-902c-48a7-8e90-aeaef0f951f7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.172552 Oct 05 19:03:42.377291 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3981/7719] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:42 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:43.403844 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9c9c6513-98d6-423c-b131-be010a6fff83 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:43.404812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9c9c6513-98d6-423c-b131-be010a6fff83 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:43.409034 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=29 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:03:43.415326 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c9c6513-98d6-423c-b131-be010a6fff83 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:43.415811 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c9c6513-98d6-423c-b131-be010a6fff83 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:43.416242 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c9c6513-98d6-423c-b131-be010a6fff83 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:43.416934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c9c6513-98d6-423c-b131-be010a6fff83 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:43.417391 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c9c6513-98d6-423c-b131-be010a6fff83 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:43.417802 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9c9c6513-98d6-423c-b131-be010a6fff83 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:43.420533 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=85 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:03:43.553288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9c9c6513-98d6-423c-b131-be010a6fff83 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:43.561618 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9c9c6513-98d6-423c-b131-be010a6fff83 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.164422 Oct 05 19:03:43.562434 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3739/7720] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:43 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:44.588825 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-99a9d55f-4e1c-42ab-8ff9-df08b2f7f53f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:44.589862 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-99a9d55f-4e1c-42ab-8ff9-df08b2f7f53f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:44.600106 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a9d55f-4e1c-42ab-8ff9-df08b2f7f53f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:44.600606 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a9d55f-4e1c-42ab-8ff9-df08b2f7f53f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:44.601051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a9d55f-4e1c-42ab-8ff9-df08b2f7f53f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:44.601752 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a9d55f-4e1c-42ab-8ff9-df08b2f7f53f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:44.602215 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a9d55f-4e1c-42ab-8ff9-df08b2f7f53f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:44.602705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-99a9d55f-4e1c-42ab-8ff9-df08b2f7f53f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:44.744626 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-99a9d55f-4e1c-42ab-8ff9-df08b2f7f53f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:44.753145 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-99a9d55f-4e1c-42ab-8ff9-df08b2f7f53f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.171347 Oct 05 19:03:44.753722 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3982/7721] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:44 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:45.639167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-07af5e9c-d268-4bd0-9a5a-930d1b029e9e req-c568728e-cb98-4f2a-8996-ee01399e04a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a25b07-a89d-44cc-9144-9ddc4a9cd668", "name": "network-vif-plugged", "status": "completed", "tag": "214e6793-ac47-4115-a561-2f62fdfdc5f9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:03:45.649609 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-07af5e9c-d268-4bd0-9a5a-930d1b029e9e req-c568728e-cb98-4f2a-8996-ee01399e04a1 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:45.650191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-07af5e9c-d268-4bd0-9a5a-930d1b029e9e req-c568728e-cb98-4f2a-8996-ee01399e04a1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:45.650656 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-07af5e9c-d268-4bd0-9a5a-930d1b029e9e req-c568728e-cb98-4f2a-8996-ee01399e04a1 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:45.662696 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-07af5e9c-d268-4bd0-9a5a-930d1b029e9e req-c568728e-cb98-4f2a-8996-ee01399e04a1 service nova] Creating event network-vif-plugged:214e6793-ac47-4115-a561-2f62fdfdc5f9 for instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 on n-h2-835595-3 Oct 05 19:03:45.666225 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [req-07af5e9c-d268-4bd0-9a5a-930d1b029e9e req-c568728e-cb98-4f2a-8996-ee01399e04a1 service nova] [4653666a-cd96-43eb-aa4e-49d0d71941b0] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 19:03:45.779194 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-051099d1-4707-42f4-a8ee-59f9768e95e1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:45.780055 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-051099d1-4707-42f4-a8ee-59f9768e95e1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:45.789444 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051099d1-4707-42f4-a8ee-59f9768e95e1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:45.790105 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051099d1-4707-42f4-a8ee-59f9768e95e1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:45.790732 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051099d1-4707-42f4-a8ee-59f9768e95e1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:45.791659 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051099d1-4707-42f4-a8ee-59f9768e95e1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:45.792288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051099d1-4707-42f4-a8ee-59f9768e95e1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:45.792871 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-051099d1-4707-42f4-a8ee-59f9768e95e1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:45.933572 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-051099d1-4707-42f4-a8ee-59f9768e95e1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:45.941683 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-051099d1-4707-42f4-a8ee-59f9768e95e1 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.167813 Oct 05 19:03:45.942267 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3983/7722] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:45 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:46.677771 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [req-07af5e9c-d268-4bd0-9a5a-930d1b029e9e req-c568728e-cb98-4f2a-8996-ee01399e04a1 service nova] [4653666a-cd96-43eb-aa4e-49d0d71941b0] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39222. Oct 05 19:03:46.681516 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-07af5e9c-d268-4bd0-9a5a-930d1b029e9e req-c568728e-cb98-4f2a-8996-ee01399e04a1 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.046830 Oct 05 19:03:46.682213 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3740/7723] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:03:46.966310 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5ec293cd-b88c-4296-9d6c-10a817cd9dbc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:46.967812 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5ec293cd-b88c-4296-9d6c-10a817cd9dbc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:46.976226 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ec293cd-b88c-4296-9d6c-10a817cd9dbc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:46.976730 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ec293cd-b88c-4296-9d6c-10a817cd9dbc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:46.977182 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ec293cd-b88c-4296-9d6c-10a817cd9dbc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:46.977898 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ec293cd-b88c-4296-9d6c-10a817cd9dbc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:46.978406 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ec293cd-b88c-4296-9d6c-10a817cd9dbc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:46.978850 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5ec293cd-b88c-4296-9d6c-10a817cd9dbc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:47.130959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5ec293cd-b88c-4296-9d6c-10a817cd9dbc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:47.140414 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5ec293cd-b88c-4296-9d6c-10a817cd9dbc tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1574 microversion: 2.1 time: 0.178626 Oct 05 19:03:47.141060 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3984/7724] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:46 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:03:48.168035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-3c57a512-4f62-420a-8d3d-43a225e969ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:03:48.169023 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-3c57a512-4f62-420a-8d3d-43a225e969ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:03:48.177842 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c57a512-4f62-420a-8d3d-43a225e969ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:48.178314 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c57a512-4f62-420a-8d3d-43a225e969ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:48.178793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c57a512-4f62-420a-8d3d-43a225e969ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:48.179483 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c57a512-4f62-420a-8d3d-43a225e969ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:03:48.179935 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c57a512-4f62-420a-8d3d-43a225e969ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:03:48.180354 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-3c57a512-4f62-420a-8d3d-43a225e969ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:03:48.326961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-3c57a512-4f62-420a-8d3d-43a225e969ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:03:48.335554 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-3c57a512-4f62-420a-8d3d-43a225e969ad tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1561 microversion: 2.1 time: 0.175030 Oct 05 19:03:48.336137 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3741/7725] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:03:48 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:04.922706 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-c5cc6040-34d6-4315-b0a1-6e429085fed7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:04.923350 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c5cc6040-34d6-4315-b0a1-6e429085fed7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:04.928089 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-c7c2eaa2-96aa-46be-970d-1ed96c6884b7 req-d20a8d28-e67a-4302-b12b-5eb756ef2539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a25b07-a89d-44cc-9144-9ddc4a9cd668", "tag": "214e6793-ac47-4115-a561-2f62fdfdc5f9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:05:04.932589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=7 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:04.933641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=30 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:04.936731 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cc6040-34d6-4315-b0a1-6e429085fed7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:04.937596 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cc6040-34d6-4315-b0a1-6e429085fed7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:04.938637 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cc6040-34d6-4315-b0a1-6e429085fed7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:04.939369 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cc6040-34d6-4315-b0a1-6e429085fed7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:04.940047 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cc6040-34d6-4315-b0a1-6e429085fed7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:04.940702 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-c5cc6040-34d6-4315-b0a1-6e429085fed7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:04.944815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=5 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:04.945506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=13 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:04.953091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c7c2eaa2-96aa-46be-970d-1ed96c6884b7 req-d20a8d28-e67a-4302-b12b-5eb756ef2539 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:04.953566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c7c2eaa2-96aa-46be-970d-1ed96c6884b7 req-d20a8d28-e67a-4302-b12b-5eb756ef2539 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:04.953991 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-c7c2eaa2-96aa-46be-970d-1ed96c6884b7 req-d20a8d28-e67a-4302-b12b-5eb756ef2539 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:04.970802 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-c5cc6040-34d6-4315-b0a1-6e429085fed7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Going to try to terminate instance {{(pid=128844) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 19:05:04.975645 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-c7c2eaa2-96aa-46be-970d-1ed96c6884b7 req-d20a8d28-e67a-4302-b12b-5eb756ef2539 service nova] Creating event network-changed:214e6793-ac47-4115-a561-2f62fdfdc5f9 for instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 on n-h2-835595-3 Oct 05 19:05:04.981038 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-c7c2eaa2-96aa-46be-970d-1ed96c6884b7 req-d20a8d28-e67a-4302-b12b-5eb756ef2539 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057852 Oct 05 19:05:04.981656 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3742/7726] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 19:05:05.059524 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-c5cc6040-34d6-4315-b0a1-6e429085fed7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 204 len: 0 microversion: 2.1 time: 0.142666 Oct 05 19:05:05.060196 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3985/7727] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 19:05:04 2022] DELETE /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 19:05:05.071080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c44c1cbe-8d92-4c94-a570-9e71aee41263 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:05.071820 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c44c1cbe-8d92-4c94-a570-9e71aee41263 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:05.078607 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c44c1cbe-8d92-4c94-a570-9e71aee41263 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:05.079093 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c44c1cbe-8d92-4c94-a570-9e71aee41263 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:05.079527 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c44c1cbe-8d92-4c94-a570-9e71aee41263 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:05.080229 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c44c1cbe-8d92-4c94-a570-9e71aee41263 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:05.080684 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c44c1cbe-8d92-4c94-a570-9e71aee41263 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:05.081106 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c44c1cbe-8d92-4c94-a570-9e71aee41263 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:05.212161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c44c1cbe-8d92-4c94-a570-9e71aee41263 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:05.220441 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c44c1cbe-8d92-4c94-a570-9e71aee41263 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.154852 Oct 05 19:05:05.221039 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3743/7728] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:05 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:06.244709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5fe82e00-c345-4fb8-aa5b-c400bda06a43 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:06.245395 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5fe82e00-c345-4fb8-aa5b-c400bda06a43 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:06.252607 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe82e00-c345-4fb8-aa5b-c400bda06a43 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:06.253104 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe82e00-c345-4fb8-aa5b-c400bda06a43 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:06.253548 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe82e00-c345-4fb8-aa5b-c400bda06a43 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:06.254246 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe82e00-c345-4fb8-aa5b-c400bda06a43 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:06.254767 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe82e00-c345-4fb8-aa5b-c400bda06a43 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:06.255199 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5fe82e00-c345-4fb8-aa5b-c400bda06a43 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:06.398220 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5fe82e00-c345-4fb8-aa5b-c400bda06a43 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:06.406812 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5fe82e00-c345-4fb8-aa5b-c400bda06a43 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1567 microversion: 2.1 time: 0.166555 Oct 05 19:05:06.407375 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3986/7729] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:06 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:07.049420 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-f95b0b4f-160c-4976-9c0d-35a74850e169 req-69a0c0b4-bae6-40e1-8c36-4c8706d45ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a25b07-a89d-44cc-9144-9ddc4a9cd668", "name": "network-vif-deleted", "tag": "214e6793-ac47-4115-a561-2f62fdfdc5f9"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:05:07.060928 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f95b0b4f-160c-4976-9c0d-35a74850e169 req-69a0c0b4-bae6-40e1-8c36-4c8706d45ae3 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:07.061417 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f95b0b4f-160c-4976-9c0d-35a74850e169 req-69a0c0b4-bae6-40e1-8c36-4c8706d45ae3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:07.061870 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-f95b0b4f-160c-4976-9c0d-35a74850e169 req-69a0c0b4-bae6-40e1-8c36-4c8706d45ae3 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:07.073955 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-f95b0b4f-160c-4976-9c0d-35a74850e169 req-69a0c0b4-bae6-40e1-8c36-4c8706d45ae3 service nova] Creating event network-vif-deleted:214e6793-ac47-4115-a561-2f62fdfdc5f9 for instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 on n-h2-835595-3 Oct 05 19:05:07.078916 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-f95b0b4f-160c-4976-9c0d-35a74850e169 req-69a0c0b4-bae6-40e1-8c36-4c8706d45ae3 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033247 Oct 05 19:05:07.079509 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3744/7730] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:05:07.435102 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0ff38e54-6d97-4a28-a5a6-da3f33e790d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:07.435833 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0ff38e54-6d97-4a28-a5a6-da3f33e790d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:07.443685 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff38e54-6d97-4a28-a5a6-da3f33e790d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:07.444551 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff38e54-6d97-4a28-a5a6-da3f33e790d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:07.445240 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff38e54-6d97-4a28-a5a6-da3f33e790d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:07.446075 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff38e54-6d97-4a28-a5a6-da3f33e790d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:07.446641 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff38e54-6d97-4a28-a5a6-da3f33e790d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:07.447140 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0ff38e54-6d97-4a28-a5a6-da3f33e790d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:07.516329 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0ff38e54-6d97-4a28-a5a6-da3f33e790d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:07.525015 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0ff38e54-6d97-4a28-a5a6-da3f33e790d8 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1218 microversion: 2.1 time: 0.094158 Oct 05 19:05:07.525613 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3987/7731] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:07 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:08.549990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-5d82a40f-3c5d-45fa-8c44-5fba90c6ba3f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:08.551340 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-5d82a40f-3c5d-45fa-8c44-5fba90c6ba3f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:08.558509 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d82a40f-3c5d-45fa-8c44-5fba90c6ba3f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:08.558995 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d82a40f-3c5d-45fa-8c44-5fba90c6ba3f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:08.559425 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d82a40f-3c5d-45fa-8c44-5fba90c6ba3f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:08.560088 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d82a40f-3c5d-45fa-8c44-5fba90c6ba3f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:08.560542 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d82a40f-3c5d-45fa-8c44-5fba90c6ba3f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:08.560961 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-5d82a40f-3c5d-45fa-8c44-5fba90c6ba3f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:08.627394 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-5d82a40f-3c5d-45fa-8c44-5fba90c6ba3f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:08.635708 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-5d82a40f-3c5d-45fa-8c44-5fba90c6ba3f tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1380 microversion: 2.1 time: 0.091130 Oct 05 19:05:08.636254 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3745/7732] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:08 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1380 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:09.659834 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cfd5cc4b-8b26-4ed8-9621-d4272cb4e2a7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:09.660454 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cfd5cc4b-8b26-4ed8-9621-d4272cb4e2a7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:09.667882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfd5cc4b-8b26-4ed8-9621-d4272cb4e2a7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:09.668387 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfd5cc4b-8b26-4ed8-9621-d4272cb4e2a7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:09.668841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfd5cc4b-8b26-4ed8-9621-d4272cb4e2a7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:09.669578 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfd5cc4b-8b26-4ed8-9621-d4272cb4e2a7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:09.670030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfd5cc4b-8b26-4ed8-9621-d4272cb4e2a7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:09.670509 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cfd5cc4b-8b26-4ed8-9621-d4272cb4e2a7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:09.738469 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cfd5cc4b-8b26-4ed8-9621-d4272cb4e2a7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:09.746811 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cfd5cc4b-8b26-4ed8-9621-d4272cb4e2a7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1380 microversion: 2.1 time: 0.091089 Oct 05 19:05:09.747413 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3988/7733] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:09 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1380 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:10.770812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8aeade3b-974a-4ab3-b865-ddadd9f835d7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:10.771467 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8aeade3b-974a-4ab3-b865-ddadd9f835d7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:10.778937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aeade3b-974a-4ab3-b865-ddadd9f835d7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:10.779534 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aeade3b-974a-4ab3-b865-ddadd9f835d7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:10.779996 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aeade3b-974a-4ab3-b865-ddadd9f835d7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:10.780716 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aeade3b-974a-4ab3-b865-ddadd9f835d7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:10.781180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aeade3b-974a-4ab3-b865-ddadd9f835d7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:10.781610 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8aeade3b-974a-4ab3-b865-ddadd9f835d7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:10.846036 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8aeade3b-974a-4ab3-b865-ddadd9f835d7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b033c45094440e2b9b3e61486b7ed58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a6a8408fe804f3ba003c04f91389ff0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:10.854668 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8aeade3b-974a-4ab3-b865-ddadd9f835d7 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 200 len: 1380 microversion: 2.1 time: 0.087889 Oct 05 19:05:10.855230 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3746/7734] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:10 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 1380 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:11.877841 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:11.878727 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] [instance: e6a25b07-a89d-44cc-9144-9ddc4a9cd668] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:11.886059 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:11.886682 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:11.887208 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:11.887947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:11.888407 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:11.888881 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:11.903059 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] HTTP exception thrown: Instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 could not be found. Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Request method failure captured: Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 HTTP/1.1 Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPdNT3U8fd-5HaUoG8nWtZ2TV1GPT2ZXsAcySWeKFR7vmMSAJD2HfUXwy19wSBL03F5IOtUmBVdiA8YUl76cOFxLYzjTycc-L_cDKFO6veX375EZJUI1y_FdjtleYWyzD9VCFRkfm0Y99f7AM79n-_v2kfvEVqLxn_m7UHtnwgYwWFIA Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: 7a6a8408fe804f3ba003c04f91389ff0 Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestShelveInstance-653748856 Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/7a6a8408fe804f3ba003c04f91389ff0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a6a8408fe804f3ba003c04f91389ff0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_7a6a8408fe804f3ba003c04f91389ff0", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/7a6a8408fe804f3ba003c04f91389ff0"}]}] Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestShelveInstance-653748856 Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: 7a6a8408fe804f3ba003c04f91389ff0 Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestShelveInstance-653748856 Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestShelveInstance-653748856-project Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 9b033c45094440e2b9b3e61486b7ed58 Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestShelveInstance-653748856-project Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 could not be found. Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e6a25b07-a89d-44cc-9144-9ddc4a9cd668'} Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 could not be found. Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 could not be found. Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 19:05:11.904766 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:05:11.909757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:05:11.909757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 19:05:11.909757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 19:05:11.909757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 19:05:11.909757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 19:05:11.909757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 could not be found. Oct 05 19:05:11.909757 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:05:11.909757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Returning 404 to user: Instance e6a25b07-a89d-44cc-9144-9ddc4a9cd668 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 19:05:11.909757 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-7bb14209-4637-4367-8151-bae1d769e0ca tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668" status: 404 len: 111 microversion: 2.1 time: 0.032655 Oct 05 19:05:11.909757 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3989/7735] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:11 2022] GET /compute/v2.1/servers/e6a25b07-a89d-44cc-9144-9ddc4a9cd668 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 19:05:12.094726 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-deada93a-5c46-4775-ae7f-823ced52c064 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] Calling method '.version_select at 0x7f77740c9b80>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:12.127580 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-deada93a-5c46-4775-ae7f-823ced52c064 tempest-TestShelveInstance-653748856 tempest-TestShelveInstance-653748856-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-302887787" status: 202 len: 0 microversion: 2.1 time: 0.040073 Oct 05 19:05:12.130682 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3747/7736] 10.222.0.70 () {58 vars in 1251 bytes} [Wed Oct 5 19:05:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-302887787 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 05 19:05:29.567580 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:29.568341 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:29.754227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1dae0247-d29c-47e4-9246-efe8c805c872 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Action: 'create', calling method: .version_select at 0x7f776c5e0160>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1721243846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBow+dVGYMyUup6kId0GrTeoC3tlfAKZz0hA7UUmOOvMkK1+JZuTHS9FctDO4IyVslPUdBq5UvC45U8rMmcIb6WPpySRi7OTuqf/L4mp4A93iFh0D9PCp4fjk9FI7NLT8Q=="}} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:05:29.771634 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-1dae0247-d29c-47e4-9246-efe8c805c872 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Getting quotas for project b3b00de9b1ff46e6a85171dd0bc7a1ad. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 19:05:29.778129 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.quota [None req-1dae0247-d29c-47e4-9246-efe8c805c872 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Getting quotas for user 34380d55eeed40f3a0de2085d47568b7 and project b3b00de9b1ff46e6a85171dd0bc7a1ad. Resources: {'key_pairs'} {{(pid=128844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 19:05:29.817321 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1dae0247-d29c-47e4-9246-efe8c805c872 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.248031 Oct 05 19:05:29.817321 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3990/7737] 10.222.0.70 () {60 vars in 1159 bytes} [Wed Oct 5 19:05:29 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:05:30.938729 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-11502762", "imageRef": "0510c978-5936-46d4-9cc7-8d23f52ed26e", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1721243846", "security_groups": [{"name": "tempest-secgroup-smoke-410641544"}], "networks": [{"uuid": "5fe19355-ce20-43b6-a656-e5b4477c185c"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:05:30.950969 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=22 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:30.951630 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:31.053110 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] validate_networks() for [('5fe19355-ce20-43b6-a656-e5b4477c185c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 19:05:31.603737 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 19:05:31.604166 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 19:05:31.604822 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 19:05:31.605754 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 19:05:31.606185 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 19:05:31.615797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:31.616288 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:31.616727 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:31.617456 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:31.617915 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:31.618396 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:31.636301 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Getting quotas for project b3b00de9b1ff46e6a85171dd0bc7a1ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 19:05:31.641862 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Getting quotas for user 34380d55eeed40f3a0de2085d47568b7 and project b3b00de9b1ff46e6a85171dd0bc7a1ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 19:05:31.655226 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 19:05:31.657625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0510c978-5936-46d4-9cc7-8d23f52ed26e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 19:05:31.728837 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-aae2a67e-304b-4ceb-94ef-1331f78eb751 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.794669 Oct 05 19:05:31.729517 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3748/7738] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 19:05:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 05 19:05:31.742577 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8e50447d-e607-401c-a205-a2e65c3e2255 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:31.743403 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8e50447d-e607-401c-a205-a2e65c3e2255 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:31.819940 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8e50447d-e607-401c-a205-a2e65c3e2255 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:31.827950 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8e50447d-e607-401c-a205-a2e65c3e2255 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1247 microversion: 2.1 time: 0.090591 Oct 05 19:05:31.828774 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3991/7739] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:31 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1247 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:32.855941 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0df8708f-937e-42a7-88fb-9f410052a98c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:32.857180 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-0df8708f-937e-42a7-88fb-9f410052a98c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:32.864566 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0df8708f-937e-42a7-88fb-9f410052a98c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:32.865058 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0df8708f-937e-42a7-88fb-9f410052a98c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:32.865496 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0df8708f-937e-42a7-88fb-9f410052a98c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:32.866201 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0df8708f-937e-42a7-88fb-9f410052a98c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:32.866693 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0df8708f-937e-42a7-88fb-9f410052a98c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:32.867128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-0df8708f-937e-42a7-88fb-9f410052a98c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:32.934661 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-0df8708f-937e-42a7-88fb-9f410052a98c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:32.942723 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0df8708f-937e-42a7-88fb-9f410052a98c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1299 microversion: 2.1 time: 0.091482 Oct 05 19:05:32.943316 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3749/7740] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:32 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:33.969492 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-aface1d7-ba8d-49c9-850d-065c871a51d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:33.972555 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-aface1d7-ba8d-49c9-850d-065c871a51d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:33.983568 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aface1d7-ba8d-49c9-850d-065c871a51d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:33.986209 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aface1d7-ba8d-49c9-850d-065c871a51d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:33.989032 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aface1d7-ba8d-49c9-850d-065c871a51d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:33.990121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aface1d7-ba8d-49c9-850d-065c871a51d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:33.990875 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aface1d7-ba8d-49c9-850d-065c871a51d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:33.992283 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-aface1d7-ba8d-49c9-850d-065c871a51d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:34.239225 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-aface1d7-ba8d-49c9-850d-065c871a51d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:34.253192 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-aface1d7-ba8d-49c9-850d-065c871a51d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1372 microversion: 2.1 time: 0.288362 Oct 05 19:05:34.254682 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3992/7741] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:33 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1372 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:34.980163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-d71a893a-ea72-42ea-af1e-29ce43646cac req-8e5febd3-7000-4582-918d-9164de507bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ee8ae9-72ef-4134-8e33-c5251108cc29", "tag": "a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:05:34.990192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d71a893a-ea72-42ea-af1e-29ce43646cac req-8e5febd3-7000-4582-918d-9164de507bda service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:34.990707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d71a893a-ea72-42ea-af1e-29ce43646cac req-8e5febd3-7000-4582-918d-9164de507bda service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:34.991140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-d71a893a-ea72-42ea-af1e-29ce43646cac req-8e5febd3-7000-4582-918d-9164de507bda service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:35.002242 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-d71a893a-ea72-42ea-af1e-29ce43646cac req-8e5febd3-7000-4582-918d-9164de507bda service nova] Creating event network-changed:a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b for instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 on n-h1-835595-3 Oct 05 19:05:35.007352 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-d71a893a-ea72-42ea-af1e-29ce43646cac req-8e5febd3-7000-4582-918d-9164de507bda service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123841 Oct 05 19:05:35.007960 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3750/7742] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:05:35.277121 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-3c3411c6-d2f7-43c7-98c7-f89005e40c26 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:35.277701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-3c3411c6-d2f7-43c7-98c7-f89005e40c26 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:35.285856 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c3411c6-d2f7-43c7-98c7-f89005e40c26 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:35.286396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c3411c6-d2f7-43c7-98c7-f89005e40c26 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:35.286822 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c3411c6-d2f7-43c7-98c7-f89005e40c26 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:35.287543 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c3411c6-d2f7-43c7-98c7-f89005e40c26 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:35.288012 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c3411c6-d2f7-43c7-98c7-f89005e40c26 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:35.288705 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-3c3411c6-d2f7-43c7-98c7-f89005e40c26 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:35.440024 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-3c3411c6-d2f7-43c7-98c7-f89005e40c26 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:35.448154 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-3c3411c6-d2f7-43c7-98c7-f89005e40c26 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1372 microversion: 2.1 time: 0.175112 Oct 05 19:05:35.448709 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3993/7743] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:35 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:36.471080 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f0a2d63-e174-4738-937a-820c1dde1d27 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:36.472416 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9f0a2d63-e174-4738-937a-820c1dde1d27 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:36.480651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f0a2d63-e174-4738-937a-820c1dde1d27 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:36.481414 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f0a2d63-e174-4738-937a-820c1dde1d27 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:36.482015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f0a2d63-e174-4738-937a-820c1dde1d27 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:36.483271 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f0a2d63-e174-4738-937a-820c1dde1d27 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:36.483954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f0a2d63-e174-4738-937a-820c1dde1d27 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:36.484565 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f0a2d63-e174-4738-937a-820c1dde1d27 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:36.640583 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-9f0a2d63-e174-4738-937a-820c1dde1d27 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:36.648994 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9f0a2d63-e174-4738-937a-820c1dde1d27 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1372 microversion: 2.1 time: 0.182111 Oct 05 19:05:36.649774 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3751/7744] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:36 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:37.676422 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-ac30c627-d54a-4da0-8442-18248ef516fd tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:37.677429 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-ac30c627-d54a-4da0-8442-18248ef516fd tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:37.689056 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac30c627-d54a-4da0-8442-18248ef516fd tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:37.689893 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac30c627-d54a-4da0-8442-18248ef516fd tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:37.690721 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac30c627-d54a-4da0-8442-18248ef516fd tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:37.691902 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac30c627-d54a-4da0-8442-18248ef516fd tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:37.692688 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac30c627-d54a-4da0-8442-18248ef516fd tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:37.693413 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-ac30c627-d54a-4da0-8442-18248ef516fd tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:37.830020 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-ac30c627-d54a-4da0-8442-18248ef516fd tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:37.842918 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-ac30c627-d54a-4da0-8442-18248ef516fd tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1372 microversion: 2.1 time: 0.172803 Oct 05 19:05:37.843750 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3994/7745] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:37 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:38.870705 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-af1f6c8f-ff39-4f3c-b6d8-b64915f9c398 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:38.871648 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-af1f6c8f-ff39-4f3c-b6d8-b64915f9c398 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:38.883295 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af1f6c8f-ff39-4f3c-b6d8-b64915f9c398 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:38.884098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af1f6c8f-ff39-4f3c-b6d8-b64915f9c398 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:38.884815 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af1f6c8f-ff39-4f3c-b6d8-b64915f9c398 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:38.885948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af1f6c8f-ff39-4f3c-b6d8-b64915f9c398 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:38.886750 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af1f6c8f-ff39-4f3c-b6d8-b64915f9c398 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:38.887531 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-af1f6c8f-ff39-4f3c-b6d8-b64915f9c398 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:39.025250 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-af1f6c8f-ff39-4f3c-b6d8-b64915f9c398 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:39.039282 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-af1f6c8f-ff39-4f3c-b6d8-b64915f9c398 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1372 microversion: 2.1 time: 0.175165 Oct 05 19:05:39.039981 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3752/7746] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:38 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:40.063026 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cb61fc02-adce-43b4-a04b-453de4901d39 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:40.063594 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cb61fc02-adce-43b4-a04b-453de4901d39 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:40.071045 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb61fc02-adce-43b4-a04b-453de4901d39 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:40.071550 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb61fc02-adce-43b4-a04b-453de4901d39 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:40.072009 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb61fc02-adce-43b4-a04b-453de4901d39 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:40.072725 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb61fc02-adce-43b4-a04b-453de4901d39 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:40.073197 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb61fc02-adce-43b4-a04b-453de4901d39 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:40.073643 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cb61fc02-adce-43b4-a04b-453de4901d39 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:40.229001 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cb61fc02-adce-43b4-a04b-453de4901d39 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:40.237333 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cb61fc02-adce-43b4-a04b-453de4901d39 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1372 microversion: 2.1 time: 0.178685 Oct 05 19:05:40.237902 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3995/7747] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:40 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:41.260746 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f0651c41-6e1d-45df-a283-786244301cc0 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:41.262396 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f0651c41-6e1d-45df-a283-786244301cc0 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:41.266797 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-b7e854e1-8b15-4e87-8c1e-a6eab2d4fc74 req-c754ac25-493b-48d0-a3d2-feef3eb8e653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ee8ae9-72ef-4134-8e33-c5251108cc29", "name": "network-vif-plugged", "status": "completed", "tag": "a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:05:41.270178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0651c41-6e1d-45df-a283-786244301cc0 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:41.271149 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0651c41-6e1d-45df-a283-786244301cc0 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:41.271835 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0651c41-6e1d-45df-a283-786244301cc0 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:41.272803 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0651c41-6e1d-45df-a283-786244301cc0 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:41.273249 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0651c41-6e1d-45df-a283-786244301cc0 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:41.273882 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-f0651c41-6e1d-45df-a283-786244301cc0 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:41.276652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b7e854e1-8b15-4e87-8c1e-a6eab2d4fc74 req-c754ac25-493b-48d0-a3d2-feef3eb8e653 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:41.277126 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b7e854e1-8b15-4e87-8c1e-a6eab2d4fc74 req-c754ac25-493b-48d0-a3d2-feef3eb8e653 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:41.277548 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-b7e854e1-8b15-4e87-8c1e-a6eab2d4fc74 req-c754ac25-493b-48d0-a3d2-feef3eb8e653 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:41.294028 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-b7e854e1-8b15-4e87-8c1e-a6eab2d4fc74 req-c754ac25-493b-48d0-a3d2-feef3eb8e653 service nova] Creating event network-vif-plugged:a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b for instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 on n-h1-835595-3 Oct 05 19:05:41.300084 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-b7e854e1-8b15-4e87-8c1e-a6eab2d4fc74 req-c754ac25-493b-48d0-a3d2-feef3eb8e653 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094408 Oct 05 19:05:41.301080 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3753/7748] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:05:41.472477 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f0651c41-6e1d-45df-a283-786244301cc0 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:41.480880 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f0651c41-6e1d-45df-a283-786244301cc0 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1372 microversion: 2.1 time: 0.223980 Oct 05 19:05:41.481467 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3996/7749] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:41 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:42.506191 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-f5676c9c-750d-4a89-9a3b-51f0063236a9 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:42.506783 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-f5676c9c-750d-4a89-9a3b-51f0063236a9 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:42.509154 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:42.509824 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:42.518532 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5676c9c-750d-4a89-9a3b-51f0063236a9 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:42.519015 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5676c9c-750d-4a89-9a3b-51f0063236a9 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:42.519431 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5676c9c-750d-4a89-9a3b-51f0063236a9 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:42.520140 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5676c9c-750d-4a89-9a3b-51f0063236a9 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:42.520590 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5676c9c-750d-4a89-9a3b-51f0063236a9 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:42.521010 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-f5676c9c-750d-4a89-9a3b-51f0063236a9 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:42.666812 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-f5676c9c-750d-4a89-9a3b-51f0063236a9 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:42.674746 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-f5676c9c-750d-4a89-9a3b-51f0063236a9 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1372 microversion: 2.1 time: 0.173093 Oct 05 19:05:42.675323 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3754/7750] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:42 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:43.698014 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-b6382205-70d7-4d11-a234-b67450ac9f99 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:43.699331 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-b6382205-70d7-4d11-a234-b67450ac9f99 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:43.701379 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=6 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:05:43.707675 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6382205-70d7-4d11-a234-b67450ac9f99 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:43.708171 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6382205-70d7-4d11-a234-b67450ac9f99 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:43.708635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6382205-70d7-4d11-a234-b67450ac9f99 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:43.709412 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6382205-70d7-4d11-a234-b67450ac9f99 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:43.709894 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6382205-70d7-4d11-a234-b67450ac9f99 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:43.710364 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-b6382205-70d7-4d11-a234-b67450ac9f99 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:43.858711 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-b6382205-70d7-4d11-a234-b67450ac9f99 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:43.870761 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-b6382205-70d7-4d11-a234-b67450ac9f99 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1557 microversion: 2.1 time: 0.176948 Oct 05 19:05:43.871533 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3997/7751] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:43 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1557 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:43.896494 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-b8b47945-eb91-4fd4-8b81-a9577acc9725 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:05:43.897117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-b8b47945-eb91-4fd4-8b81-a9577acc9725 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:05:43.907974 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b47945-eb91-4fd4-8b81-a9577acc9725 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:43.908571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b47945-eb91-4fd4-8b81-a9577acc9725 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:43.909003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b47945-eb91-4fd4-8b81-a9577acc9725 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:43.909704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b47945-eb91-4fd4-8b81-a9577acc9725 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:43.910162 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b47945-eb91-4fd4-8b81-a9577acc9725 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:43.910631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-b8b47945-eb91-4fd4-8b81-a9577acc9725 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:44.060136 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-b8b47945-eb91-4fd4-8b81-a9577acc9725 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:05:44.068597 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-b8b47945-eb91-4fd4-8b81-a9577acc9725 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1557 microversion: 2.1 time: 0.178525 Oct 05 19:05:44.069147 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3755/7752] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:05:43 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1557 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:05:46.211156 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-96b66970-9b09-44ad-a03f-8b47b92a0dd2 req-69b4633e-c83a-4fcf-a3c8-859b117dc3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ee8ae9-72ef-4134-8e33-c5251108cc29", "tag": "a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:05:46.221027 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-96b66970-9b09-44ad-a03f-8b47b92a0dd2 req-69b4633e-c83a-4fcf-a3c8-859b117dc3d8 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:05:46.221526 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-96b66970-9b09-44ad-a03f-8b47b92a0dd2 req-69b4633e-c83a-4fcf-a3c8-859b117dc3d8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:05:46.221972 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-96b66970-9b09-44ad-a03f-8b47b92a0dd2 req-69b4633e-c83a-4fcf-a3c8-859b117dc3d8 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:05:46.233759 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-96b66970-9b09-44ad-a03f-8b47b92a0dd2 req-69b4633e-c83a-4fcf-a3c8-859b117dc3d8 service nova] Creating event network-changed:a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b for instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 on n-h1-835595-3 Oct 05 19:05:46.238992 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-96b66970-9b09-44ad-a03f-8b47b92a0dd2 req-69b4633e-c83a-4fcf-a3c8-859b117dc3d8 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093781 Oct 05 19:05:46.239977 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3998/7753] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:07:40.410084 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3358724b-f52c-4a69-8c22-3305520f8c1e] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 19:07:40.411081 n-d-835595-3 devstack@n-api.service[128843]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d1744094-4a20-4501-8b29-640f444f590e] AMQP server on 10.222.0.70:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 05 19:07:40.411691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:07:40.412471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=36 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:07:40.417937 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-9f8f796e-58f1-4696-a4e1-58dd1045a7d6 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1136464998"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:07:40.420335 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-9f8f796e-58f1-4696-a4e1-58dd1045a7d6 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:07:40.427977 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f8f796e-58f1-4696-a4e1-58dd1045a7d6 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:40.428538 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f8f796e-58f1-4696-a4e1-58dd1045a7d6 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:40.429003 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f8f796e-58f1-4696-a4e1-58dd1045a7d6 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:40.429696 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f8f796e-58f1-4696-a4e1-58dd1045a7d6 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:40.430150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f8f796e-58f1-4696-a4e1-58dd1045a7d6 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:40.430604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-9f8f796e-58f1-4696-a4e1-58dd1045a7d6 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:40.764543 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-9f8f796e-58f1-4696-a4e1-58dd1045a7d6 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "POST /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29/action" status: 202 len: 0 microversion: 2.1 time: 0.356135 Oct 05 19:07:40.765199 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3756/7754] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 19:07:40 2022] POST /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 19:07:47.888183 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d9585d8e-c85f-4e0e-8626-ea6a3c823e4e] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 19:07:47.889640 n-d-835595-3 devstack@n-api.service[128844]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e95dc271-cddc-4501-83b4-4d8d4789eaf1] AMQP server on 10.222.0.70:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 05 19:07:47.890298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:07:47.891420 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=38 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:07:47.892890 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 19:07:47.893259 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 19:07:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Oct 05 19:07:47.918943 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-28bf33fb-1066-4df9-9f4a-4cde5cf38086 req-7eeb6764-f00f-45eb-b378-9d85f8bd5ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ee8ae9-72ef-4134-8e33-c5251108cc29", "name": "network-vif-plugged", "status": "completed", "tag": "a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:07:47.950051 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-28bf33fb-1066-4df9-9f4a-4cde5cf38086 req-7eeb6764-f00f-45eb-b378-9d85f8bd5ac5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:47.950930 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-28bf33fb-1066-4df9-9f4a-4cde5cf38086 req-7eeb6764-f00f-45eb-b378-9d85f8bd5ac5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:47.951653 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-28bf33fb-1066-4df9-9f4a-4cde5cf38086 req-7eeb6764-f00f-45eb-b378-9d85f8bd5ac5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:47.968110 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-28bf33fb-1066-4df9-9f4a-4cde5cf38086 req-7eeb6764-f00f-45eb-b378-9d85f8bd5ac5 service nova] Creating event network-vif-plugged:a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b for instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 on n-h1-835595-3 Oct 05 19:07:47.977950 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-28bf33fb-1066-4df9-9f4a-4cde5cf38086 req-7eeb6764-f00f-45eb-b378-9d85f8bd5ac5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091159 Oct 05 19:07:47.979994 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 3999/7755] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 19:07:54.378192 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:07:54.379395 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:07:54.384000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1724192779", "imageRef": "4beb76b9-c135-44cd-94b5-66a2d0686b8f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1721243846", "security_groups": [{"name": "tempest-secgroup-smoke-410641544"}], "networks": [{"uuid": "5fe19355-ce20-43b6-a656-e5b4477c185c"}]}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:07:54.408949 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] [3358724b-f52c-4a69-8c22-3305520f8c1e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39644. Oct 05 19:07:54.410855 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] [d1744094-4a20-4501-8b29-640f444f590e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39646. Oct 05 19:07:54.498718 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.network.neutron [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] validate_networks() for [('5fe19355-ce20-43b6-a656-e5b4477c185c', None, None, None, None, None)] {{(pid=128843) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 05 19:07:54.877739 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Flavor limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 05 19:07:54.878345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Image limits 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 05 19:07:54.878992 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Flavor pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 05 19:07:54.879575 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Image pref 0:0:0 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 05 19:07:54.880116 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.virt.hardware [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 05 19:07:54.889932 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:54.890465 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:54.890907 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:54.891634 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:54.892091 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:54.892514 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:54.910849 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Getting quotas for project b3b00de9b1ff46e6a85171dd0bc7a1ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 05 19:07:54.916704 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.quota [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Getting quotas for user 34380d55eeed40f3a0de2085d47568b7 and project b3b00de9b1ff46e6a85171dd0bc7a1ad. Resources: {'cores', 'ram', 'instances'} {{(pid=128843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 05 19:07:54.930614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Going to run 1 instances... {{(pid=128843) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 05 19:07:54.933117 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4beb76b9-c135-44cd-94b5-66a2d0686b8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 05 19:07:54.983345 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-91b3b7ac-b885-4980-bee3-9ee48409c186 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.607234 Oct 05 19:07:54.984188 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3757/7756] 10.222.0.70 () {60 vars in 1147 bytes} [Wed Oct 5 19:07:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 05 19:07:54.998969 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-f2e2d077-a50e-4c03-9a15-e401740c5074 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:07:55.000212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-f2e2d077-a50e-4c03-9a15-e401740c5074 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:07:55.032918 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] [d9585d8e-c85f-4e0e-8626-ea6a3c823e4e] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39660. Oct 05 19:07:55.041188 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] [e95dc271-cddc-4501-83b4-4d8d4789eaf1] Reconnected to AMQP server on 10.222.0.70:5672 via [amqp] client with port 39662. Oct 05 19:07:55.130166 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-f2e2d077-a50e-4c03-9a15-e401740c5074 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:07:55.138209 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-f2e2d077-a50e-4c03-9a15-e401740c5074 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1249 microversion: 2.1 time: 0.146363 Oct 05 19:07:55.138833 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4000/7757] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:07:54 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1249 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 05 19:07:56.163067 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-224acb51-460e-4898-9e13-7574e9e2bc4c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:07:56.163706 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-224acb51-460e-4898-9e13-7574e9e2bc4c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:07:56.172830 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-224acb51-460e-4898-9e13-7574e9e2bc4c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:56.173760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-224acb51-460e-4898-9e13-7574e9e2bc4c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:56.174293 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-224acb51-460e-4898-9e13-7574e9e2bc4c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:56.175077 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-224acb51-460e-4898-9e13-7574e9e2bc4c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:56.175882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-224acb51-460e-4898-9e13-7574e9e2bc4c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:56.176321 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-224acb51-460e-4898-9e13-7574e9e2bc4c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:56.249245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-224acb51-460e-4898-9e13-7574e9e2bc4c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:07:56.257462 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-224acb51-460e-4898-9e13-7574e9e2bc4c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1319 microversion: 2.1 time: 0.099748 Oct 05 19:07:56.258317 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3758/7758] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:07:56 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1319 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:07:57.282427 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-1da2e059-2b78-47d2-bf0c-a06ab0c9509a tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:07:57.283192 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-1da2e059-2b78-47d2-bf0c-a06ab0c9509a tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:07:57.290757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da2e059-2b78-47d2-bf0c-a06ab0c9509a tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:57.291351 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da2e059-2b78-47d2-bf0c-a06ab0c9509a tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:57.291874 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da2e059-2b78-47d2-bf0c-a06ab0c9509a tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:57.292664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da2e059-2b78-47d2-bf0c-a06ab0c9509a tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:57.293216 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da2e059-2b78-47d2-bf0c-a06ab0c9509a tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:57.293726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-1da2e059-2b78-47d2-bf0c-a06ab0c9509a tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:57.435082 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-1da2e059-2b78-47d2-bf0c-a06ab0c9509a tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:07:57.444374 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-1da2e059-2b78-47d2-bf0c-a06ab0c9509a tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.166511 Oct 05 19:07:57.444976 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4001/7759] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:07:57 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:07:57.908345 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [req-ca5eb852-5e4e-4717-a01a-8d3730508803 req-3f8b01c1-4764-47ff-ba73-6133dfd5f449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ee8ae9-72ef-4134-8e33-c5251108cc29", "name": "network-vif-unplugged", "status": "completed", "tag": "a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b"}]} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:07:57.936167 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ca5eb852-5e4e-4717-a01a-8d3730508803 req-3f8b01c1-4764-47ff-ba73-6133dfd5f449 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:57.936901 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ca5eb852-5e4e-4717-a01a-8d3730508803 req-3f8b01c1-4764-47ff-ba73-6133dfd5f449 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:57.937518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [req-ca5eb852-5e4e-4717-a01a-8d3730508803 req-3f8b01c1-4764-47ff-ba73-6133dfd5f449 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:57.953841 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.compute.server_external_events [req-ca5eb852-5e4e-4717-a01a-8d3730508803 req-3f8b01c1-4764-47ff-ba73-6133dfd5f449 service nova] Creating event network-vif-unplugged:a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b for instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 on n-h1-835595-3 Oct 05 19:07:57.960114 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [req-ca5eb852-5e4e-4717-a01a-8d3730508803 req-3f8b01c1-4764-47ff-ba73-6133dfd5f449 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056770 Oct 05 19:07:57.960926 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3759/7760] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 05 19:07:58.468755 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-e789ed67-c256-4780-a23b-2aef0890542b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:07:58.470645 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-e789ed67-c256-4780-a23b-2aef0890542b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:07:58.478819 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e789ed67-c256-4780-a23b-2aef0890542b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:58.479464 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e789ed67-c256-4780-a23b-2aef0890542b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:58.480358 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e789ed67-c256-4780-a23b-2aef0890542b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:58.481218 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e789ed67-c256-4780-a23b-2aef0890542b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:58.481785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e789ed67-c256-4780-a23b-2aef0890542b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:58.482357 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-e789ed67-c256-4780-a23b-2aef0890542b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:58.630298 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-e789ed67-c256-4780-a23b-2aef0890542b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:07:58.638368 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-e789ed67-c256-4780-a23b-2aef0890542b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.173721 Oct 05 19:07:58.639041 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4002/7761] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:07:58 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:07:59.663741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-86e0b286-c34a-4ae5-88af-bbc6b87f883c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:07:59.664578 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-86e0b286-c34a-4ae5-88af-bbc6b87f883c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:07:59.672133 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86e0b286-c34a-4ae5-88af-bbc6b87f883c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:59.672632 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86e0b286-c34a-4ae5-88af-bbc6b87f883c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:59.673075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86e0b286-c34a-4ae5-88af-bbc6b87f883c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:59.673938 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86e0b286-c34a-4ae5-88af-bbc6b87f883c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:07:59.674682 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86e0b286-c34a-4ae5-88af-bbc6b87f883c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:07:59.675186 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-86e0b286-c34a-4ae5-88af-bbc6b87f883c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:07:59.826819 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-86e0b286-c34a-4ae5-88af-bbc6b87f883c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:07:59.835333 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-86e0b286-c34a-4ae5-88af-bbc6b87f883c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.177164 Oct 05 19:07:59.836142 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3760/7762] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:07:59 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:00.857523 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-390b2346-9eeb-474d-9a26-43e5f92a7410 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:00.858178 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-390b2346-9eeb-474d-9a26-43e5f92a7410 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:00.865275 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390b2346-9eeb-474d-9a26-43e5f92a7410 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:00.865801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390b2346-9eeb-474d-9a26-43e5f92a7410 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:00.866243 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390b2346-9eeb-474d-9a26-43e5f92a7410 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:00.866962 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390b2346-9eeb-474d-9a26-43e5f92a7410 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:00.867511 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390b2346-9eeb-474d-9a26-43e5f92a7410 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:00.868030 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-390b2346-9eeb-474d-9a26-43e5f92a7410 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:01.011920 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-390b2346-9eeb-474d-9a26-43e5f92a7410 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:01.020178 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-390b2346-9eeb-474d-9a26-43e5f92a7410 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.166572 Oct 05 19:08:01.020878 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4003/7763] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:00 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:02.043451 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c27401eb-ae6c-4b76-91a9-3167035ca2ab tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:02.044405 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c27401eb-ae6c-4b76-91a9-3167035ca2ab tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:02.053595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27401eb-ae6c-4b76-91a9-3167035ca2ab tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:02.054611 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27401eb-ae6c-4b76-91a9-3167035ca2ab tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:02.055524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27401eb-ae6c-4b76-91a9-3167035ca2ab tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:02.056547 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27401eb-ae6c-4b76-91a9-3167035ca2ab tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:02.056981 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27401eb-ae6c-4b76-91a9-3167035ca2ab tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:02.057415 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c27401eb-ae6c-4b76-91a9-3167035ca2ab tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:02.209593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c27401eb-ae6c-4b76-91a9-3167035ca2ab tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:02.218545 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c27401eb-ae6c-4b76-91a9-3167035ca2ab tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.179404 Oct 05 19:08:02.219202 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3761/7764] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:02 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:03.243525 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-30e575f8-8d10-45cd-a9f4-0c9df2bd81bc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:03.244241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-30e575f8-8d10-45cd-a9f4-0c9df2bd81bc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:03.251692 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30e575f8-8d10-45cd-a9f4-0c9df2bd81bc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:03.252191 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30e575f8-8d10-45cd-a9f4-0c9df2bd81bc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:03.252652 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30e575f8-8d10-45cd-a9f4-0c9df2bd81bc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:03.253371 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30e575f8-8d10-45cd-a9f4-0c9df2bd81bc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:03.253843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30e575f8-8d10-45cd-a9f4-0c9df2bd81bc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:03.254307 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-30e575f8-8d10-45cd-a9f4-0c9df2bd81bc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:03.392859 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-30e575f8-8d10-45cd-a9f4-0c9df2bd81bc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:03.400713 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-30e575f8-8d10-45cd-a9f4-0c9df2bd81bc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.161716 Oct 05 19:08:03.401491 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4004/7765] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:03 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:04.424858 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-ab9baf23-4770-42ba-a507-cd67ffa971b2 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:04.425614 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-ab9baf23-4770-42ba-a507-cd67ffa971b2 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:04.433506 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab9baf23-4770-42ba-a507-cd67ffa971b2 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:04.434000 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab9baf23-4770-42ba-a507-cd67ffa971b2 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:04.434470 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab9baf23-4770-42ba-a507-cd67ffa971b2 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:04.435169 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab9baf23-4770-42ba-a507-cd67ffa971b2 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:04.435691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab9baf23-4770-42ba-a507-cd67ffa971b2 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:04.436123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-ab9baf23-4770-42ba-a507-cd67ffa971b2 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:04.660294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-ab9baf23-4770-42ba-a507-cd67ffa971b2 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:04.668930 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-ab9baf23-4770-42ba-a507-cd67ffa971b2 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.248146 Oct 05 19:08:04.669537 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3762/7766] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:04 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:04.807687 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-554c10fa-f8c2-423c-a0c4-0413765382a5 req-6f16fa8a-e14b-405b-980e-e24c958b21a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5658637-4536-41ef-a223-72687d27d791", "tag": "bd454a2f-0215-436c-923d-79697133ff72"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:08:04.822135 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-554c10fa-f8c2-423c-a0c4-0413765382a5 req-6f16fa8a-e14b-405b-980e-e24c958b21a5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:04.822566 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-554c10fa-f8c2-423c-a0c4-0413765382a5 req-6f16fa8a-e14b-405b-980e-e24c958b21a5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:04.823011 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-554c10fa-f8c2-423c-a0c4-0413765382a5 req-6f16fa8a-e14b-405b-980e-e24c958b21a5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:04.834882 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-554c10fa-f8c2-423c-a0c4-0413765382a5 req-6f16fa8a-e14b-405b-980e-e24c958b21a5 service nova] Creating event network-changed:bd454a2f-0215-436c-923d-79697133ff72 for instance e5658637-4536-41ef-a223-72687d27d791 on n-h2-835595-3 Oct 05 19:08:04.840012 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-554c10fa-f8c2-423c-a0c4-0413765382a5 req-6f16fa8a-e14b-405b-980e-e24c958b21a5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036352 Oct 05 19:08:04.840588 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4005/7767] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:08:05.696751 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a7897791-7368-45a8-bddb-d1cb0d8dfdde tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:05.697652 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a7897791-7368-45a8-bddb-d1cb0d8dfdde tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:05.700794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:08:05.701916 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell0:SELECT=6 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:08:05.712207 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7897791-7368-45a8-bddb-d1cb0d8dfdde tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:05.712697 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7897791-7368-45a8-bddb-d1cb0d8dfdde tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:05.713142 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7897791-7368-45a8-bddb-d1cb0d8dfdde tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:05.713833 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7897791-7368-45a8-bddb-d1cb0d8dfdde tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:05.714317 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7897791-7368-45a8-bddb-d1cb0d8dfdde tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:05.714725 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a7897791-7368-45a8-bddb-d1cb0d8dfdde tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:05.860053 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a7897791-7368-45a8-bddb-d1cb0d8dfdde tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:05.868513 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a7897791-7368-45a8-bddb-d1cb0d8dfdde tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.178730 Oct 05 19:08:05.869102 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3763/7768] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:05 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:06.889709 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell0:SELECT=2 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:08:06.894785 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-0853d1e5-1752-4cbb-8658-84df1c3becca tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:06.895495 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-0853d1e5-1752-4cbb-8658-84df1c3becca tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:06.902386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0853d1e5-1752-4cbb-8658-84df1c3becca tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:06.902888 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0853d1e5-1752-4cbb-8658-84df1c3becca tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:06.903335 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0853d1e5-1752-4cbb-8658-84df1c3becca tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:06.904039 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0853d1e5-1752-4cbb-8658-84df1c3becca tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:06.904504 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0853d1e5-1752-4cbb-8658-84df1c3becca tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:06.904934 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-0853d1e5-1752-4cbb-8658-84df1c3becca tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:07.043679 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-0853d1e5-1752-4cbb-8658-84df1c3becca tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:07.052227 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-0853d1e5-1752-4cbb-8658-84df1c3becca tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.163287 Oct 05 19:08:07.052922 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4006/7769] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:06 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:08.080122 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-8fd186ef-ece4-4ca1-8cd4-b5c3b3ed813b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:08.081385 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-8fd186ef-ece4-4ca1-8cd4-b5c3b3ed813b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:08.093163 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fd186ef-ece4-4ca1-8cd4-b5c3b3ed813b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:08.093967 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fd186ef-ece4-4ca1-8cd4-b5c3b3ed813b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:08.094707 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fd186ef-ece4-4ca1-8cd4-b5c3b3ed813b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:08.095848 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fd186ef-ece4-4ca1-8cd4-b5c3b3ed813b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:08.096651 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fd186ef-ece4-4ca1-8cd4-b5c3b3ed813b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:08.097329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-8fd186ef-ece4-4ca1-8cd4-b5c3b3ed813b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:08.240602 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-8fd186ef-ece4-4ca1-8cd4-b5c3b3ed813b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:08.252882 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-8fd186ef-ece4-4ca1-8cd4-b5c3b3ed813b tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.179740 Oct 05 19:08:08.253741 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3764/7770] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:08 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:09.276754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-cee9cd26-0b1d-46d5-9d87-70a5576ccf0f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:09.277390 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-cee9cd26-0b1d-46d5-9d87-70a5576ccf0f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:09.284793 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cee9cd26-0b1d-46d5-9d87-70a5576ccf0f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:09.285288 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cee9cd26-0b1d-46d5-9d87-70a5576ccf0f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:09.285745 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cee9cd26-0b1d-46d5-9d87-70a5576ccf0f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:09.286517 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cee9cd26-0b1d-46d5-9d87-70a5576ccf0f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:09.287002 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cee9cd26-0b1d-46d5-9d87-70a5576ccf0f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:09.287505 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-cee9cd26-0b1d-46d5-9d87-70a5576ccf0f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:09.421880 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-cee9cd26-0b1d-46d5-9d87-70a5576ccf0f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:09.430245 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-cee9cd26-0b1d-46d5-9d87-70a5576ccf0f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.157499 Oct 05 19:08:09.430860 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4007/7771] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:09 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:10.457796 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-30782e7d-c64f-4598-8379-5abfe8b369dc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:10.458793 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-30782e7d-c64f-4598-8379-5abfe8b369dc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:10.470368 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30782e7d-c64f-4598-8379-5abfe8b369dc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:10.471161 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30782e7d-c64f-4598-8379-5abfe8b369dc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:10.471877 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30782e7d-c64f-4598-8379-5abfe8b369dc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:10.473006 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30782e7d-c64f-4598-8379-5abfe8b369dc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:10.473760 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30782e7d-c64f-4598-8379-5abfe8b369dc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:10.474387 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-30782e7d-c64f-4598-8379-5abfe8b369dc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:10.626245 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-30782e7d-c64f-4598-8379-5abfe8b369dc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:10.634419 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-30782e7d-c64f-4598-8379-5abfe8b369dc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.183653 Oct 05 19:08:10.635028 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3765/7772] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:10 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:10.762167 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-ee5223d7-8990-427b-94b5-96a9ce4a18db req-0e3c8ac4-81dc-4017-a521-45c11ab9e08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5658637-4536-41ef-a223-72687d27d791", "name": "network-vif-plugged", "status": "completed", "tag": "bd454a2f-0215-436c-923d-79697133ff72"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:08:10.774058 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ee5223d7-8990-427b-94b5-96a9ce4a18db req-0e3c8ac4-81dc-4017-a521-45c11ab9e08c service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:10.774625 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ee5223d7-8990-427b-94b5-96a9ce4a18db req-0e3c8ac4-81dc-4017-a521-45c11ab9e08c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:10.775076 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-ee5223d7-8990-427b-94b5-96a9ce4a18db req-0e3c8ac4-81dc-4017-a521-45c11ab9e08c service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:10.787018 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-ee5223d7-8990-427b-94b5-96a9ce4a18db req-0e3c8ac4-81dc-4017-a521-45c11ab9e08c service nova] Creating event network-vif-plugged:bd454a2f-0215-436c-923d-79697133ff72 for instance e5658637-4536-41ef-a223-72687d27d791 on n-h2-835595-3 Oct 05 19:08:10.792215 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-ee5223d7-8990-427b-94b5-96a9ce4a18db req-0e3c8ac4-81dc-4017-a521-45c11ab9e08c service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033931 Oct 05 19:08:10.792809 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4008/7773] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:08:11.658072 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c401bc43-1b7b-43ce-977f-23efe3ea9af3 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:11.658714 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c401bc43-1b7b-43ce-977f-23efe3ea9af3 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:11.666041 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c401bc43-1b7b-43ce-977f-23efe3ea9af3 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:11.666553 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c401bc43-1b7b-43ce-977f-23efe3ea9af3 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:11.666990 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c401bc43-1b7b-43ce-977f-23efe3ea9af3 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:11.667680 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c401bc43-1b7b-43ce-977f-23efe3ea9af3 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:11.668128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c401bc43-1b7b-43ce-977f-23efe3ea9af3 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:11.668550 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c401bc43-1b7b-43ce-977f-23efe3ea9af3 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:11.808888 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-c401bc43-1b7b-43ce-977f-23efe3ea9af3 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:11.820714 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c401bc43-1b7b-43ce-977f-23efe3ea9af3 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1374 microversion: 2.1 time: 0.166759 Oct 05 19:08:11.821304 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3766/7774] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:11 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:12.852273 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-5d160c64-027c-430b-ad53-8911533c933f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:12.853022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-5d160c64-027c-430b-ad53-8911533c933f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:12.859995 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d160c64-027c-430b-ad53-8911533c933f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:12.860487 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d160c64-027c-430b-ad53-8911533c933f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:12.860928 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d160c64-027c-430b-ad53-8911533c933f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:12.861621 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d160c64-027c-430b-ad53-8911533c933f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:12.862085 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d160c64-027c-430b-ad53-8911533c933f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:12.862546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-5d160c64-027c-430b-ad53-8911533c933f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:13.004168 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-5d160c64-027c-430b-ad53-8911533c933f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:13.012421 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-5d160c64-027c-430b-ad53-8911533c933f tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1560 microversion: 2.1 time: 0.167411 Oct 05 19:08:13.013013 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4009/7775] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:12 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:13.034539 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-dac157ba-b679-4cfa-b689-c799e4e5f179 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:08:13.035107 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-dac157ba-b679-4cfa-b689-c799e4e5f179 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:08:13.042048 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dac157ba-b679-4cfa-b689-c799e4e5f179 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:13.042571 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dac157ba-b679-4cfa-b689-c799e4e5f179 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:13.043002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dac157ba-b679-4cfa-b689-c799e4e5f179 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:13.043691 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dac157ba-b679-4cfa-b689-c799e4e5f179 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:13.044175 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dac157ba-b679-4cfa-b689-c799e4e5f179 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:13.044595 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-dac157ba-b679-4cfa-b689-c799e4e5f179 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:13.189039 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-dac157ba-b679-4cfa-b689-c799e4e5f179 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:08:13.197406 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-dac157ba-b679-4cfa-b689-c799e4e5f179 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1560 microversion: 2.1 time: 0.166796 Oct 05 19:08:13.197982 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3767/7776] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:08:13 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:08:14.945022 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-c136babd-1a58-4188-bcf9-c4b02af610fe req-00adb51e-46e6-4ff5-9423-ff88c6db79ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5658637-4536-41ef-a223-72687d27d791", "tag": "bd454a2f-0215-436c-923d-79697133ff72"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:08:14.956227 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c136babd-1a58-4188-bcf9-c4b02af610fe req-00adb51e-46e6-4ff5-9423-ff88c6db79ff service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:08:14.956726 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c136babd-1a58-4188-bcf9-c4b02af610fe req-00adb51e-46e6-4ff5-9423-ff88c6db79ff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:08:14.957173 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-c136babd-1a58-4188-bcf9-c4b02af610fe req-00adb51e-46e6-4ff5-9423-ff88c6db79ff service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:08:14.971827 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-c136babd-1a58-4188-bcf9-c4b02af610fe req-00adb51e-46e6-4ff5-9423-ff88c6db79ff service nova] Creating event network-changed:bd454a2f-0215-436c-923d-79697133ff72 for instance e5658637-4536-41ef-a223-72687d27d791 on n-h2-835595-3 Oct 05 19:08:14.976944 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-c136babd-1a58-4188-bcf9-c4b02af610fe req-00adb51e-46e6-4ff5-9423-ff88c6db79ff service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036334 Oct 05 19:08:14.977569 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4010/7777] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:09:42.268329 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:09:42.269546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=58 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:09:42.271873 n-d-835595-3 devstack@n-api.service[128843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 19:09:42.272190 n-d-835595-3 devstack@n-api.service[128843]: Wed Oct 5 19:09:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791/action (ip 10.222.0.70) !!! Oct 05 19:09:42.278954 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-afb44b02-a511-426c-9afb-05d1e317275d tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-291742530"}} {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:09:42.282794 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-afb44b02-a511-426c-9afb-05d1e317275d tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:09:42.295419 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-afb44b02-a511-426c-9afb-05d1e317275d tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:42.295910 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-afb44b02-a511-426c-9afb-05d1e317275d tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:42.296344 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-afb44b02-a511-426c-9afb-05d1e317275d tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:42.297024 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-afb44b02-a511-426c-9afb-05d1e317275d tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:42.297471 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-afb44b02-a511-426c-9afb-05d1e317275d tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:42.297893 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-afb44b02-a511-426c-9afb-05d1e317275d tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:42.509635 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-afb44b02-a511-426c-9afb-05d1e317275d tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "POST /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791/action" status: 202 len: 0 microversion: 2.1 time: 0.244607 Oct 05 19:09:42.510309 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3768/7778] 10.222.0.70 () {60 vars in 1278 bytes} [Wed Oct 5 19:09:42 2022] POST /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 05 19:09:47.160016 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_api:SELECT=26 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:09:47.160787 n-d-835595-3 devstack@n-api.service[128844]: DEBUG dbcounter [-] [128844] Writing DB stats nova_cell1:SELECT=50 {{(pid=128844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:09:47.162109 n-d-835595-3 devstack@n-api.service[128844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 05 19:09:47.162260 n-d-835595-3 devstack@n-api.service[128844]: Wed Oct 5 19:09:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.70) !!! Oct 05 19:09:47.167854 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-f4190e7b-0c1a-4600-b482-b3fd8226ef2b req-40bcbf64-661a-48aa-8a76-347c4b13251f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5658637-4536-41ef-a223-72687d27d791", "name": "network-vif-plugged", "status": "completed", "tag": "bd454a2f-0215-436c-923d-79697133ff72"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:09:47.180254 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f4190e7b-0c1a-4600-b482-b3fd8226ef2b req-40bcbf64-661a-48aa-8a76-347c4b13251f service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:47.180828 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f4190e7b-0c1a-4600-b482-b3fd8226ef2b req-40bcbf64-661a-48aa-8a76-347c4b13251f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:47.181267 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-f4190e7b-0c1a-4600-b482-b3fd8226ef2b req-40bcbf64-661a-48aa-8a76-347c4b13251f service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:47.197990 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-f4190e7b-0c1a-4600-b482-b3fd8226ef2b req-40bcbf64-661a-48aa-8a76-347c4b13251f service nova] Creating event network-vif-plugged:bd454a2f-0215-436c-923d-79697133ff72 for instance e5658637-4536-41ef-a223-72687d27d791 on n-h2-835595-3 Oct 05 19:09:47.203835 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-f4190e7b-0c1a-4600-b482-b3fd8226ef2b req-40bcbf64-661a-48aa-8a76-347c4b13251f service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046586 Oct 05 19:09:47.204817 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4011/7779] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:09:56.198732 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_api:SELECT=2 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:09:56.199518 n-d-835595-3 devstack@n-api.service[128843]: DEBUG dbcounter [-] [128843] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 05 19:09:56.203944 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a2dfb942-e26e-45de-aca9-2e4e80955b6c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:09:56.204526 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a2dfb942-e26e-45de-aca9-2e4e80955b6c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:09:56.204932 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-9b910c3c-915d-4f85-89a1-33fbcb4bccd9 req-e30c7a4b-843d-45b9-8dc8-a147c8737ecb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5658637-4536-41ef-a223-72687d27d791", "tag": "bd454a2f-0215-436c-923d-79697133ff72"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:09:56.212625 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2dfb942-e26e-45de-aca9-2e4e80955b6c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:56.213109 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2dfb942-e26e-45de-aca9-2e4e80955b6c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:56.213546 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2dfb942-e26e-45de-aca9-2e4e80955b6c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:56.214236 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2dfb942-e26e-45de-aca9-2e4e80955b6c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:56.214721 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2dfb942-e26e-45de-aca9-2e4e80955b6c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:56.215123 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a2dfb942-e26e-45de-aca9-2e4e80955b6c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:56.215686 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9b910c3c-915d-4f85-89a1-33fbcb4bccd9 req-e30c7a4b-843d-45b9-8dc8-a147c8737ecb service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:56.216177 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9b910c3c-915d-4f85-89a1-33fbcb4bccd9 req-e30c7a4b-843d-45b9-8dc8-a147c8737ecb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:56.216635 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-9b910c3c-915d-4f85-89a1-33fbcb4bccd9 req-e30c7a4b-843d-45b9-8dc8-a147c8737ecb service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:56.228821 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-9b910c3c-915d-4f85-89a1-33fbcb4bccd9 req-e30c7a4b-843d-45b9-8dc8-a147c8737ecb service nova] Creating event network-changed:bd454a2f-0215-436c-923d-79697133ff72 for instance e5658637-4536-41ef-a223-72687d27d791 on n-h2-835595-3 Oct 05 19:09:56.234579 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-9b910c3c-915d-4f85-89a1-33fbcb4bccd9 req-e30c7a4b-843d-45b9-8dc8-a147c8737ecb service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035283 Oct 05 19:09:56.235172 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4012/7780] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:09:56.245356 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a2dfb942-e26e-45de-aca9-2e4e80955b6c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 19:09:56.340366 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a2dfb942-e26e-45de-aca9-2e4e80955b6c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 204 len: 0 microversion: 2.1 time: 0.143700 Oct 05 19:09:56.342243 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3769/7781] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 19:09:56 2022] DELETE /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 19:09:56.352321 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-8c30d0fc-4da6-4487-8949-c9b7f5f5c5a4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:09:56.353366 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-8c30d0fc-4da6-4487-8949-c9b7f5f5c5a4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:09:56.360805 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c30d0fc-4da6-4487-8949-c9b7f5f5c5a4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:56.361778 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c30d0fc-4da6-4487-8949-c9b7f5f5c5a4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:56.363414 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c30d0fc-4da6-4487-8949-c9b7f5f5c5a4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:56.364338 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c30d0fc-4da6-4487-8949-c9b7f5f5c5a4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:56.365546 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c30d0fc-4da6-4487-8949-c9b7f5f5c5a4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:56.366161 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-8c30d0fc-4da6-4487-8949-c9b7f5f5c5a4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:56.514978 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-8c30d0fc-4da6-4487-8949-c9b7f5f5c5a4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:09:56.523025 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-8c30d0fc-4da6-4487-8949-c9b7f5f5c5a4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1685 microversion: 2.1 time: 0.176048 Oct 05 19:09:56.523614 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4013/7782] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:09:56 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1685 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:09:57.551434 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-d49eb981-2586-44ee-9970-6a62e03fde92 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:09:57.552474 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-d49eb981-2586-44ee-9970-6a62e03fde92 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:09:57.560856 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d49eb981-2586-44ee-9970-6a62e03fde92 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:57.561350 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d49eb981-2586-44ee-9970-6a62e03fde92 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:57.561780 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d49eb981-2586-44ee-9970-6a62e03fde92 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:57.562521 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d49eb981-2586-44ee-9970-6a62e03fde92 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:57.562976 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d49eb981-2586-44ee-9970-6a62e03fde92 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:57.563403 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-d49eb981-2586-44ee-9970-6a62e03fde92 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:57.734948 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-d49eb981-2586-44ee-9970-6a62e03fde92 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:09:57.743679 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-d49eb981-2586-44ee-9970-6a62e03fde92 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1685 microversion: 2.1 time: 0.199775 Oct 05 19:09:57.744244 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3770/7783] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:09:57 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1685 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:09:58.613386 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a3e1f9a9-75bf-4ae6-be5b-9a87cc30e336 req-062f1369-2b12-4681-bc27-551548a2bcf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5658637-4536-41ef-a223-72687d27d791", "name": "network-vif-deleted", "tag": "bd454a2f-0215-436c-923d-79697133ff72"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:09:58.623953 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a3e1f9a9-75bf-4ae6-be5b-9a87cc30e336 req-062f1369-2b12-4681-bc27-551548a2bcf6 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:58.624453 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a3e1f9a9-75bf-4ae6-be5b-9a87cc30e336 req-062f1369-2b12-4681-bc27-551548a2bcf6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:58.624907 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a3e1f9a9-75bf-4ae6-be5b-9a87cc30e336 req-062f1369-2b12-4681-bc27-551548a2bcf6 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:58.637228 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a3e1f9a9-75bf-4ae6-be5b-9a87cc30e336 req-062f1369-2b12-4681-bc27-551548a2bcf6 service nova] Creating event network-vif-deleted:bd454a2f-0215-436c-923d-79697133ff72 for instance e5658637-4536-41ef-a223-72687d27d791 on n-h2-835595-3 Oct 05 19:09:58.642436 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a3e1f9a9-75bf-4ae6-be5b-9a87cc30e336 req-062f1369-2b12-4681-bc27-551548a2bcf6 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032792 Oct 05 19:09:58.643039 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4014/7784] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:09:58.767399 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:09:58.768101 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:09:58.775221 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:58.775711 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:58.776158 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:58.776855 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:58.777311 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:58.777741 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:58.811150 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:58.811637 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:58.812075 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:58.812524 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lazy-loading 'fault' on Instance uuid e5658637-4536-41ef-a223-72687d27d791 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 19:09:58.860294 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:09:58.868467 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a1dab158-7fe2-4113-af8a-38b19d37a3d7 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 200 len: 1339 microversion: 2.1 time: 0.105049 Oct 05 19:09:58.869053 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3771/7785] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:09:58 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:09:59.893125 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:09:59.893843 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e5658637-4536-41ef-a223-72687d27d791] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:09:59.900754 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:59.901262 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:59.901713 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:59.902478 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:09:59.902959 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:09:59.903404 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:09:59.917709 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] HTTP exception thrown: Instance e5658637-4536-41ef-a223-72687d27d791 could not be found. Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Request method failure captured: Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 HTTP/1.1 Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPdV0GrvZXZOziIQBFZ8a9RRslI5euTuprkd72kkZ6TDoWNHRNzampV8lFxL_UplKtgR9lABZB8sgzy50qxX6RQQD_HolntI72i3YSdEnL_1WFtFJWKiZmEaVQiLZZJv7yR9UVjvhbQX8MCQV08koBQ-CDg5IoJwivvag8Dbiw6nNVZA Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: b3b00de9b1ff46e6a85171dd0bc7a1ad Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestSnapshotPattern-922155245 Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b3b00de9b1ff46e6a85171dd0bc7a1ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b3b00de9b1ff46e6a85171dd0bc7a1ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b3b00de9b1ff46e6a85171dd0bc7a1ad", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b3b00de9b1ff46e6a85171dd0bc7a1ad"}]}] Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestSnapshotPattern-922155245 Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: b3b00de9b1ff46e6a85171dd0bc7a1ad Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestSnapshotPattern-922155245 Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestSnapshotPattern-922155245-project Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 34380d55eeed40f3a0de2085d47568b7 Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestSnapshotPattern-922155245-project Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e5658637-4536-41ef-a223-72687d27d791 could not be found. Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e5658637-4536-41ef-a223-72687d27d791'} Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5658637-4536-41ef-a223-72687d27d791 could not be found. Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5658637-4536-41ef-a223-72687d27d791 could not be found. Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 19:09:59.919436 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:09:59.925638 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:09:59.925638 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 19:09:59.925638 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 19:09:59.925638 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 19:09:59.925638 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 19:09:59.925638 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5658637-4536-41ef-a223-72687d27d791 could not be found. Oct 05 19:09:59.925638 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:09:59.925638 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Returning 404 to user: Instance e5658637-4536-41ef-a223-72687d27d791 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 19:09:59.925638 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-51543b2a-af4e-4253-91da-a0410ebd3835 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791" status: 404 len: 111 microversion: 2.1 time: 0.033013 Oct 05 19:09:59.925638 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4015/7786] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:09:59 2022] GET /compute/v2.1/servers/e5658637-4536-41ef-a223-72687d27d791 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 05 19:10:01.661604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-c3d97de8-9676-4b08-8a39-f6e13856c44e tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:10:01.662738 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3d97de8-9676-4b08-8a39-f6e13856c44e tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:10:01.663241 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-6b39604b-576d-4428-86cc-85c14432694e req-32932ba3-1995-47cf-b355-b0665a8201f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3ee8ae9-72ef-4134-8e33-c5251108cc29", "tag": "a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:10:01.670486 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d97de8-9676-4b08-8a39-f6e13856c44e tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:01.671002 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d97de8-9676-4b08-8a39-f6e13856c44e tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:01.671427 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d97de8-9676-4b08-8a39-f6e13856c44e tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:01.672145 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d97de8-9676-4b08-8a39-f6e13856c44e tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:01.672604 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d97de8-9676-4b08-8a39-f6e13856c44e tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:01.673035 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-c3d97de8-9676-4b08-8a39-f6e13856c44e tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:01.675238 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6b39604b-576d-4428-86cc-85c14432694e req-32932ba3-1995-47cf-b355-b0665a8201f5 service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:01.675801 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6b39604b-576d-4428-86cc-85c14432694e req-32932ba3-1995-47cf-b355-b0665a8201f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:01.676330 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-6b39604b-576d-4428-86cc-85c14432694e req-32932ba3-1995-47cf-b355-b0665a8201f5 service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:01.687864 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-6b39604b-576d-4428-86cc-85c14432694e req-32932ba3-1995-47cf-b355-b0665a8201f5 service nova] Creating event network-changed:a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b for instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 on n-h1-835595-3 Oct 05 19:10:01.693866 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-6b39604b-576d-4428-86cc-85c14432694e req-32932ba3-1995-47cf-b355-b0665a8201f5 service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034581 Oct 05 19:10:01.694961 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4016/7787] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:10:01.704908 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-c3d97de8-9676-4b08-8a39-f6e13856c44e tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Going to try to terminate instance {{(pid=128843) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 05 19:10:01.802731 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-c3d97de8-9676-4b08-8a39-f6e13856c44e tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "DELETE /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 204 len: 0 microversion: 2.1 time: 0.145751 Oct 05 19:10:01.806842 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3772/7788] 10.222.0.70 () {58 vars in 1239 bytes} [Wed Oct 5 19:10:01 2022] DELETE /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 05 19:10:01.812664 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-689706f5-e18b-4c53-86a4-458ff48fa71c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:10:01.813381 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-689706f5-e18b-4c53-86a4-458ff48fa71c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:10:01.819680 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-689706f5-e18b-4c53-86a4-458ff48fa71c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:01.820185 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-689706f5-e18b-4c53-86a4-458ff48fa71c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:01.820701 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-689706f5-e18b-4c53-86a4-458ff48fa71c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:01.821604 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-689706f5-e18b-4c53-86a4-458ff48fa71c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:01.822074 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-689706f5-e18b-4c53-86a4-458ff48fa71c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:01.822538 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-689706f5-e18b-4c53-86a4-458ff48fa71c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:01.975368 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.policy [None req-689706f5-e18b-4c53-86a4-458ff48fa71c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128844) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:10:01.984010 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-689706f5-e18b-4c53-86a4-458ff48fa71c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1681 microversion: 2.1 time: 0.174987 Oct 05 19:10:01.984276 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4017/7789] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:10:01 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:10:03.013544 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-a1e2c44f-c0cd-4fe3-b307-c8dfc4785bdc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:10:03.014598 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-a1e2c44f-c0cd-4fe3-b307-c8dfc4785bdc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:10:03.024763 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1e2c44f-c0cd-4fe3-b307-c8dfc4785bdc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:03.025463 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1e2c44f-c0cd-4fe3-b307-c8dfc4785bdc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:03.026090 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1e2c44f-c0cd-4fe3-b307-c8dfc4785bdc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:03.027139 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1e2c44f-c0cd-4fe3-b307-c8dfc4785bdc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:03.027798 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1e2c44f-c0cd-4fe3-b307-c8dfc4785bdc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:03.028421 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-a1e2c44f-c0cd-4fe3-b307-c8dfc4785bdc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:03.175127 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-a1e2c44f-c0cd-4fe3-b307-c8dfc4785bdc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:10:03.186715 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-a1e2c44f-c0cd-4fe3-b307-c8dfc4785bdc tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1681 microversion: 2.1 time: 0.179273 Oct 05 19:10:03.187504 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3773/7790] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:10:03 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:10:03.806088 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [req-a5de7be5-79a3-4ea4-887b-4e5c27a88501 req-8b2a7e65-6a19-4685-8450-443373d0ddba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3ee8ae9-72ef-4134-8e33-c5251108cc29", "name": "network-vif-deleted", "tag": "a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b"}]} {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 05 19:10:03.816445 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a5de7be5-79a3-4ea4-887b-4e5c27a88501 req-8b2a7e65-6a19-4685-8450-443373d0ddba service nova] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:03.816912 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a5de7be5-79a3-4ea4-887b-4e5c27a88501 req-8b2a7e65-6a19-4685-8450-443373d0ddba service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:03.817377 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [req-a5de7be5-79a3-4ea4-887b-4e5c27a88501 req-8b2a7e65-6a19-4685-8450-443373d0ddba service nova] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:03.829097 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.compute.server_external_events [req-a5de7be5-79a3-4ea4-887b-4e5c27a88501 req-8b2a7e65-6a19-4685-8450-443373d0ddba service nova] Creating event network-vif-deleted:a5e4dc6a-1c5c-4841-8ce5-a29e054e7c4b for instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 on n-h1-835595-3 Oct 05 19:10:03.833997 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [req-a5de7be5-79a3-4ea4-887b-4e5c27a88501 req-8b2a7e65-6a19-4685-8450-443373d0ddba service nova] 10.222.0.70 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031756 Oct 05 19:10:03.834609 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4018/7791] 10.222.0.70 () {64 vars in 1317 bytes} [Wed Oct 5 19:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 05 19:10:04.212882 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:10:04.213516 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.compute.api [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128843) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:10:04.221457 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:04.221980 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:04.222593 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:04.223128 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:04.223576 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:04.224098 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:04.255664 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:04.256063 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:04.256491 n-d-835595-3 devstack@n-api.service[128843]: DEBUG oslo_concurrency.lockutils [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:04.256934 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.objects.instance [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lazy-loading 'fault' on Instance uuid e3ee8ae9-72ef-4134-8e33-c5251108cc29 {{(pid=128843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 05 19:10:04.304060 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.policy [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34380d55eeed40f3a0de2085d47568b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3b00de9b1ff46e6a85171dd0bc7a1ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128843) authorize /opt/stack/nova/nova/policy.py:199}} Oct 05 19:10:04.312303 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-269f5965-6904-4f06-bc1e-6721714c3d2c tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 200 len: 1337 microversion: 2.1 time: 0.103673 Oct 05 19:10:04.312883 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3774/7792] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:10:04 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 1337 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 05 19:10:05.341753 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '>' {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:10:05.343064 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.compute.api [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] [instance: e3ee8ae9-72ef-4134-8e33-c5251108cc29] Fetching instance by UUID {{(pid=128844) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 05 19:10:05.353260 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:05.353757 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:05.354212 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:05.354947 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Acquiring lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 05 19:10:05.355419 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 05 19:10:05.355853 n-d-835595-3 devstack@n-api.service[128844]: DEBUG oslo_concurrency.lockutils [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Lock "7b356d48-72d2-49eb-8427-f4c09b8b2828" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 05 19:10:05.370226 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.wsgi [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] HTTP exception thrown: Instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 could not be found. Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Request method failure captured: Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: request: GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 HTTP/1.1 Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: Accept: application/json Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: Accept-Encoding: identity Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: Connection: close Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: Content-Length: 0 Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: Content-Type: application/json Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: Host: 10.222.0.70 Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: Openstack-System-Scope: None Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: User-Agent: python-urllib3/1.26.12 Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Auth-Token: gAAAAABjPdV0GrvZXZOziIQBFZ8a9RRslI5euTuprkd72kkZ6TDoWNHRNzampV8lFxL_UplKtgR9lABZB8sgzy50qxX6RQQD_HolntI72i3YSdEnL_1WFtFJWKiZmEaVQiLZZJv7yR9UVjvhbQX8MCQV08koBQ-CDg5IoJwivvag8Dbiw6nNVZA Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Id: None Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Domain-Name: None Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Identity-Status: Confirmed Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Is-Admin-Project: True Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Id: default Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Domain-Name: Default Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Id: b3b00de9b1ff46e6a85171dd0bc7a1ad Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Project-Name: tempest-TestSnapshotPattern-922155245 Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Role: reader,member Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Roles: reader,member Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2/b3b00de9b1ff46e6a85171dd0bc7a1ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b3b00de9b1ff46e6a85171dd0bc7a1ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70:8080/v1/AUTH_b3b00de9b1ff46e6a85171dd0bc7a1ad", "adminURL": "http://10.222.0.70:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.70/volume/v3/b3b00de9b1ff46e6a85171dd0bc7a1ad"}]}] Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant: tempest-TestSnapshotPattern-922155245 Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Id: b3b00de9b1ff46e6a85171dd0bc7a1ad Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-Tenant-Name: tempest-TestSnapshotPattern-922155245 Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-User: tempest-TestSnapshotPattern-922155245-project Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Id: default Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-User-Domain-Name: Default Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-User-Id: 34380d55eeed40f3a0de2085d47568b7 Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: X-User-Name: tempest-TestSnapshotPattern-922155245-project Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: method: > Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: exception: Instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 could not be found. Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: action_args: {'id': 'e3ee8ae9-72ef-4134-8e33-c5251108cc29'} Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: {{(pid=128844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 could not be found. Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 could not be found. Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 05 19:10:05.371911 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:10:05.377589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 05 19:10:05.377589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 05 19:10:05.377589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 05 19:10:05.377589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 05 19:10:05.377589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 05 19:10:05.377589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 could not be found. Oct 05 19:10:05.377589 n-d-835595-3 devstack@n-api.service[128844]: ERROR nova.api.openstack.wsgi Oct 05 19:10:05.377589 n-d-835595-3 devstack@n-api.service[128844]: DEBUG nova.api.openstack.wsgi [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Returning 404 to user: Instance e3ee8ae9-72ef-4134-8e33-c5251108cc29 could not be found. {{(pid=128844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 05 19:10:05.377589 n-d-835595-3 devstack@n-api.service[128844]: INFO nova.api.openstack.requestlog [None req-380a3676-5e94-4c77-aaf4-24c5a990d1ef tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29" status: 404 len: 111 microversion: 2.1 time: 0.040119 Oct 05 19:10:05.377589 n-d-835595-3 devstack@n-api.service[128844]: [pid: 128844|app: 0|req: 4019/7793] 10.222.0.70 () {58 vars in 1236 bytes} [Wed Oct 5 19:10:05 2022] GET /compute/v2.1/servers/e3ee8ae9-72ef-4134-8e33-c5251108cc29 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 05 19:10:05.538631 n-d-835595-3 devstack@n-api.service[128843]: DEBUG nova.api.openstack.wsgi [None req-0c665334-dbf9-4ed2-850e-749a1f6412e4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] Calling method '.version_select at 0x7f7774631700>' {{(pid=128843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 05 19:10:05.562890 n-d-835595-3 devstack@n-api.service[128843]: INFO nova.api.openstack.requestlog [None req-0c665334-dbf9-4ed2-850e-749a1f6412e4 tempest-TestSnapshotPattern-922155245 tempest-TestSnapshotPattern-922155245-project] 10.222.0.70 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1721243846" status: 202 len: 0 microversion: 2.1 time: 0.028055 Oct 05 19:10:05.563969 n-d-835595-3 devstack@n-api.service[128843]: [pid: 128843|app: 0|req: 3775/7794] 10.222.0.70 () {58 vars in 1257 bytes} [Wed Oct 5 19:10:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1721243846 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)